2024-04-25T08:50:08.155 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T08:50:08.155 DEBUG:teuthology.run:Teuthology command: teuthology --name neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi --archive /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} --owner scheduled_neesingh@teuthology --verbose -- /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/orig.config.yaml 2024-04-25T08:50:08.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T08:50:08.288 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7673008' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v2 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: 5787d42d10024ba410e822a8aba474331cb9af02 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5869 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 5787d42d10024ba410e822a8aba474331cb9af02 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXYbjecAw0nYeMl1wDM7sXDzLGe8Ual9MKxZFMt0YV57aaalTn8HSzu35uaBTfhSwSQKZ3tK620Oi99K9ki0I8= smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPunG97XKwp74rS7Oo8zEpB9fJYhZtR0GCCNlGYOEh6keKDgZJLjRgsruOCy8mXOEFE+ndv45rhJWIFNlAtjaLE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:15:18 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T08:50:08.288 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa; will attempt to use it 2024-04-25T08:50:08.289 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks 2024-04-25T08:50:08.289 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T08:50:08.290 INFO:teuthology.task.internal:Checking packages... 2024-04-25T08:50:08.315 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T08:50:08.315 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T08:50:08.315 INFO:teuthology.packaging:ref: None 2024-04-25T08:50:08.315 INFO:teuthology.packaging:tag: None 2024-04-25T08:50:08.315 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T08:50:08.315 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:50:08.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T08:50:08.462 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628.g97ae6cc9 2024-04-25T08:50:08.464 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T08:50:08.473 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T08:50:08.473 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T08:50:08.599 INFO:teuthology.task.internal:Saving configuration 2024-04-25T08:50:08.618 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T08:50:08.631 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:50:08.655 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:45:04.229249', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXYbjecAw0nYeMl1wDM7sXDzLGe8Ual9MKxZFMt0YV57aaalTn8HSzu35uaBTfhSwSQKZ3tK620Oi99K9ki0I8='} 2024-04-25T08:50:08.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:45:04.227214', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPunG97XKwp74rS7Oo8zEpB9fJYhZtR0GCCNlGYOEh6keKDgZJLjRgsruOCy8mXOEFE+ndv45rhJWIFNlAtjaLE='} 2024-04-25T08:50:08.679 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T08:50:08.690 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T08:50:08.690 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T08:50:08.690 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T08:50:08.786 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f75eb238160>, signals=[15]) 2024-04-25T08:50:08.787 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T08:50:08.797 INFO:teuthology.task.internal:Opening connections... 2024-04-25T08:50:08.798 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:50:08.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:08.878 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:50:08.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:08.956 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T08:50:08.967 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-04-25T08:50:08.986 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-04-25T08:50:08.986 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-04-25T08:50:09.044 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T08:50:09.045 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T08:50:09.046 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T08:50:09.046 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-04-25T08:50:09.068 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-04-25T08:50:09.086 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-04-25T08:50:09.086 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-25T08:50:09.142 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-25T08:50:09.142 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-25T08:50:09.142 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-25T08:50:09.142 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T08:50:09.143 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T08:50:09.143 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-25T08:50:09.168 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T08:50:09.180 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T08:50:09.203 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T08:50:09.204 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:50:09.206 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:50:09.222 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T08:50:09.237 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T08:50:09.237 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:50:09.264 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:50:09.297 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T08:50:09.361 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T08:50:09.380 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T08:50:09.380 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-25T08:50:09.381 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T08:50:09.381 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:50:09.381 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:50:09.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:50:09.398 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-04-25T08:50:09.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:50:09.399 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-04-25T08:50:09.455 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-437.el9.x86_64 2024-04-25T08:50:09.455 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.14.0-437.el9.x86_64 2024-04-25T08:50:09.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-04-25T08:50:09.457 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-437.el9.x86_64 2024-04-25T08:50:09.457 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-437.el9.x86_64 2024-04-25T08:50:09.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-04-25T08:50:11.917 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-25T08:50:12.134 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.0 MB 00:01 2024-04-25T08:50:14.952 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-04-25T08:50:14.976 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 19 MB 00:01 2024-04-25T08:50:19.685 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.2 MB 00:01 2024-04-25T08:50:19.828 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-04-25T08:50:21.161 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-25T08:50:21.362 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-04-25T08:50:22.238 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 28 MB/s | 21 MB 00:00 2024-04-25T08:50:23.220 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T08:50:27.472 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-04-25T08:50:28.178 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-25T08:50:29.436 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T08:50:29.436 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T08:50:29.536 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-25T08:50:29.538 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-25T08:50:29.538 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-25T08:50:29.653 DEBUG:teuthology.orchestra.run.smithi005:> echo no | sudo yum reinstall kernel || true 2024-04-25T08:50:30.076 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T08:50:30.076 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T08:50:30.168 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T08:50:30.169 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-04-25T08:50:30.169 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T08:50:30.172 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:50:27 AM UTC. 2024-04-25T08:50:30.280 DEBUG:teuthology.orchestra.run.smithi080:> echo no | sudo yum reinstall kernel || true 2024-04-25T08:50:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-25T08:50:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-25T08:50:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-04-25T08:50:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-25T08:50:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:Reinstalling: 2024-04-25T08:50:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:50:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:50:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-25T08:50:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-25T08:50:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:50:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 255 k 2024-04-25T08:50:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 0 2024-04-25T08:50:30.321 INFO:teuthology.orchestra.run.smithi005.stderr:Operation aborted. 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi005.stdout:Is this ok [y/N]: 2024-04-25T08:50:30.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum reinstall -y kernel || true 2024-04-25T08:50:30.778 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 08:50:28 AM UTC. 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:50:27 AM UTC. 2024-04-25T08:50:30.907 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T08:50:30.924 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T08:50:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-25T08:50:30.924 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T08:50:30.924 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-25T08:50:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:50:30.924 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:50:30.924 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T08:50:30.925 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T08:50:30.925 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:50:30.925 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-25T08:50:30.925 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-25T08:50:30.925 INFO:teuthology.orchestra.run.smithi080.stderr:Operation aborted. 2024-04-25T08:50:30.992 INFO:teuthology.orchestra.run.smithi080.stdout:Is this ok [y/N]: 2024-04-25T08:50:30.992 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum reinstall -y kernel || true 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout:Reinstalling: 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 255 k 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 0 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-25T08:50:31.486 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:50:28 AM UTC. 2024-04-25T08:50:31.601 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T08:50:31.602 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T08:50:31.602 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-25T08:50:31.602 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T08:50:31.602 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-25T08:50:31.602 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:50:31.602 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:50:31.603 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T08:50:31.603 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T08:50:31.603 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:50:31.603 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-25T08:50:31.603 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-25T08:50:31.603 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-25T08:50:31.606 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-437.el9.x86_64.rpm 796 kB/s | 255 kB 00:00 2024-04-25T08:50:31.606 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:50:31.606 INFO:teuthology.orchestra.run.smithi005.stdout:Total 433 kB/s | 255 kB 00:00 2024-04-25T08:50:31.623 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-25T08:50:31.825 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-25T08:50:31.825 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-25T08:50:31.830 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-25T08:50:31.830 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-25T08:50:31.948 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-25T08:50:31.955 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64.rpm 899 kB/s | 255 kB 00:00 2024-04-25T08:50:31.955 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:50:31.955 INFO:teuthology.orchestra.run.smithi080.stdout:Total 723 kB/s | 255 kB 00:00 2024-04-25T08:50:31.983 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-25T08:50:32.049 INFO:teuthology.orchestra.run.smithi005.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:50:32.049 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:50:32.166 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-25T08:50:32.166 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-25T08:50:32.171 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-25T08:50:32.171 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-25T08:50:32.301 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-25T08:50:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:50:32.381 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:50:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:50:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:50:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:50:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:50:33.504 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:50:33.504 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:50:33.504 INFO:teuthology.orchestra.run.smithi005.stdout:Reinstalled: 2024-04-25T08:50:33.504 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T08:50:33.504 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:50:33.504 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-25T08:50:33.688 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T08:50:33.775 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T08:50:33.776 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T08:50:33.776 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T08:50:33.776 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalled: 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T08:50:34.009 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T08:50:34.097 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T08:50:34.097 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T08:50:34.097 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T08:50:34.097 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:34.097 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T08:50:34.105 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T08:50:34.105 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:50:34.107 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:50:34.121 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T08:50:34.135 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T08:50:34.165 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T08:50:34.165 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:50:34.167 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:50:34.199 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T08:50:34.206 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T08:50:34.206 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:50:34.234 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:50:34.271 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:34.291 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:34.294 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:34.315 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:34.316 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T08:50:34.323 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T08:50:34.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:50:34.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:50:34.357 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T08:50:34.367 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T08:50:34.367 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:50:34.391 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:50:34.411 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:50:34.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:50:34.541 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:50:34.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:50:34.663 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:50:34.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:50:34.728 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:50:34.770 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:50:34.816 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:50:34.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:50:34.937 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:50:34.937 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:50:35.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-04-25T08:50:35.003 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-04-25T08:50:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:50:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:50:35.539 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T08:50:35.546 INFO:teuthology.task.internal:Starting timer... 2024-04-25T08:50:35.546 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T08:50:35.578 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T08:50:35.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-04-25T08:50:35.678 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-04-25T08:50:35.680 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-04-25T08:50:35.736 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-04-25T08:50:35.738 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T08:50:35.738 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-04-25T08:50:35.764 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-04-25T08:50:35.764 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-04-25T08:50:35.788 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-04-25T08:50:35.788 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi080.front.sepia.ceph.com': 'permissive'} 2024-04-25T08:50:35.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:50:35.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:50:35.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:50:35.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:50:35.854 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T08:50:35.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-04-25T08:50:35.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-04-25T08:50:35.917 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T08:50:35.930 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T08:50:35.946 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T08:50:35.948 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi080.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T08:54:05.831 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi080.front.sepia.ceph.com')] 2024-04-25T08:54:05.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-25T08:54:05.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:54:05.912 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-04-25T08:54:06.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-25T08:54:06.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-25T08:54:06.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:54:06.080 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-25T08:54:06.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-25T08:54:06.157 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T08:54:06.168 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T08:54:06.168 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:54:06.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:54:06.171 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:54:06.171 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:54:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T08:54:06.211 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T08:54:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T08:54:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-04-25T08:54:06.238 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T08:54:06.246 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-04-25T08:54:06.260 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-04-25T08:54:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T08:54:06.270 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-04-25T08:54:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T08:54:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T08:54:06.296 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T08:54:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-25T08:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.341 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.342 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.350 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:54:06.353 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:54:06.353 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-25T08:54:06.353 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.353 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.353 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.353 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:54:06.354 INFO:teuthology.run_tasks:Running task install... 2024-04-25T08:54:06.363 DEBUG:teuthology.task.install:project ceph 2024-04-25T08:54:06.363 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T08:54:06.363 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T08:54:06.363 INFO:teuthology.task.install:Using flavor: default 2024-04-25T08:54:06.369 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T08:54:06.369 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T08:54:06.370 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T08:54:06.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:54:06.373 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T08:54:06.373 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:54:06.515 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T08:54:06.515 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T08:54:06.554 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T08:54:06.555 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T08:54:06.627 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T08:54:06.627 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:54:06.627 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T08:54:06.653 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T08:54:06.653 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T08:54:06.664 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T08:54:06.664 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:54:06.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T08:54:06.690 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T08:54:06.690 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T08:54:06.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T08:54:06.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T08:54:06.790 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T08:54:06.829 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T08:54:06.853 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-04-25T08:54:06.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-04-25T08:54:06.894 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-04-25T08:54:06.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-04-25T08:54:07.079 INFO:teuthology.orchestra.run.smithi080.stdout:48 files removed 2024-04-25T08:54:07.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T08:54:07.130 INFO:teuthology.orchestra.run.smithi005.stdout:48 files removed 2024-04-25T08:54:07.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T08:54:07.690 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 252 kB/s | 82 kB 00:00 2024-04-25T08:54:07.774 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 239 kB/s | 82 kB 00:00 2024-04-25T08:54:08.032 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 34 kB/s | 10 kB 00:00 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 30 kB/s | 10 kB 00:00 2024-04-25T08:54:08.358 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-04-25T08:54:08.483 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-04-25T08:54:09.034 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-25T08:54:10.383 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:01 2024-04-25T08:54:11.343 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T08:54:12.401 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-25T08:54:16.102 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-04-25T08:54:17.085 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.2 MB 00:01 2024-04-25T08:54:17.553 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-25T08:54:18.679 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-04-25T08:54:19.594 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-04-25T08:54:22.370 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 21 MB 00:02 2024-04-25T08:54:23.896 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-25T08:54:26.122 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:54:26.123 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T08:54:26.135 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T08:54:26.136 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T08:54:26.137 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T08:54:26.140 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T08:54:26.141 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T08:54:26.206 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T08:54:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T08:54:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T08:54:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T08:54:26.219 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T08:54:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T08:54:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T08:54:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T08:54:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T08:54:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T08:54:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T08:54:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T08:54:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout:Install 148 Packages 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 4 Packages 2024-04-25T08:54:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:54:26.229 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 215 M 2024-04-25T08:54:26.229 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-25T08:54:26.756 INFO:teuthology.orchestra.run.smithi005.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-04-25T08:54:26.989 INFO:teuthology.orchestra.run.smithi005.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 3.7 MB/s | 887 kB 00:00 2024-04-25T08:54:27.048 INFO:teuthology.orchestra.run.smithi005.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 2.4 MB/s | 145 kB 00:00 2024-04-25T08:54:27.331 INFO:teuthology.orchestra.run.smithi005.stdout:(4/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 7.2 MB/s | 5.3 MB 00:00 2024-04-25T08:54:27.373 INFO:teuthology.orchestra.run.smithi005.stdout:(5/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 6.5 MB/s | 2.1 MB 00:00 2024-04-25T08:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-04-25T08:54:27.524 INFO:teuthology.orchestra.run.smithi005.stdout:(6/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 7.8 MB/s | 1.5 MB 00:00 2024-04-25T08:54:28.057 INFO:teuthology.orchestra.run.smithi005.stdout:(7/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 6.9 MB/s | 4.7 MB 00:00 2024-04-25T08:54:28.515 INFO:teuthology.orchestra.run.smithi005.stdout:(8/152): ceph-common-19.0.0-1628.g97ae6cc9.el9. 10 MB/s | 20 MB 00:01 2024-04-25T08:54:28.582 INFO:teuthology.orchestra.run.smithi005.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 378 kB/s | 25 kB 00:00 2024-04-25T08:54:29.581 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:54:29.582 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:54:29.593 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T08:54:29.593 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T08:54:29.594 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T08:54:29.595 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T08:54:29.597 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T08:54:29.599 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T08:54:29.600 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T08:54:29.661 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T08:54:29.670 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T08:54:29.671 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T08:54:29.672 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T08:54:29.673 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T08:54:29.674 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T08:54:29.675 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T08:54:29.676 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T08:54:29.677 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T08:54:29.678 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T08:54:29.679 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T08:54:29.680 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout:Install 148 Packages 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 4 Packages 2024-04-25T08:54:29.681 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:54:29.682 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 215 M 2024-04-25T08:54:29.682 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-25T08:54:30.366 INFO:teuthology.orchestra.run.smithi005.stdout:(10/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x8 5.9 MB/s | 17 MB 00:02 2024-04-25T08:54:30.416 INFO:teuthology.orchestra.run.smithi005.stdout:(11/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 4.3 MB/s | 220 kB 00:00 2024-04-25T08:54:30.550 INFO:teuthology.orchestra.run.smithi005.stdout:(12/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el 3.9 MB/s | 9.8 MB 00:02 2024-04-25T08:54:30.564 INFO:teuthology.orchestra.run.smithi080.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-04-25T08:54:30.575 INFO:teuthology.orchestra.run.smithi005.stdout:(13/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 170 kB/s | 27 kB 00:00 2024-04-25T08:54:30.592 INFO:teuthology.orchestra.run.smithi005.stdout:(14/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 748 kB/s | 31 kB 00:00 2024-04-25T08:54:30.634 INFO:teuthology.orchestra.run.smithi005.stdout:(15/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 3.8 MB/s | 163 kB 00:00 2024-04-25T08:54:30.727 INFO:teuthology.orchestra.run.smithi005.stdout:(16/152): librados-devel-19.0.0-1628.g97ae6cc9. 1.3 MB/s | 127 kB 00:00 2024-04-25T08:54:30.768 INFO:teuthology.orchestra.run.smithi005.stdout:(17/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 3.8 MB/s | 744 kB 00:00 2024-04-25T08:54:30.981 INFO:teuthology.orchestra.run.smithi080.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 2.1 MB/s | 887 kB 00:00 2024-04-25T08:54:31.056 INFO:teuthology.orchestra.run.smithi080.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 1.9 MB/s | 145 kB 00:00 2024-04-25T08:54:31.193 INFO:teuthology.orchestra.run.smithi005.stdout:(18/152): ceph-test-19.0.0-1628.g97ae6cc9.el9.x 18 MB/s | 47 MB 00:02 2024-04-25T08:54:31.235 INFO:teuthology.orchestra.run.smithi005.stdout:(19/152): libradosstriper1-19.0.0-1628.g97ae6cc 984 kB/s | 501 kB 00:00 2024-04-25T08:54:31.252 INFO:teuthology.orchestra.run.smithi005.stdout:(20/152): python3-ceph-argparse-19.0.0-1628.g97 774 kB/s | 45 kB 00:00 2024-04-25T08:54:31.319 INFO:teuthology.orchestra.run.smithi005.stdout:(21/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 2.4 MB/s | 162 kB 00:00 2024-04-25T08:54:31.344 INFO:teuthology.orchestra.run.smithi005.stdout:(22/152): python3-ceph-common-19.0.0-1628.g97ae 1.2 MB/s | 131 kB 00:00 2024-04-25T08:54:31.403 INFO:teuthology.orchestra.run.smithi005.stdout:(23/152): python3-rados-19.0.0-1628.g97ae6cc9.e 3.8 MB/s | 321 kB 00:00 2024-04-25T08:54:31.470 INFO:teuthology.orchestra.run.smithi005.stdout:(24/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 2.3 MB/s | 298 kB 00:00 2024-04-25T08:54:31.495 INFO:teuthology.orchestra.run.smithi005.stdout:(25/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.1 MB/s | 99 kB 00:00 2024-04-25T08:54:31.516 INFO:teuthology.orchestra.run.smithi080.stdout:(4/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 4.5 MB/s | 5.3 MB 00:01 2024-04-25T08:54:31.522 INFO:teuthology.orchestra.run.smithi005.stdout:(26/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-25T08:54:31.565 INFO:teuthology.orchestra.run.smithi080.stdout:(5/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 4.2 MB/s | 2.1 MB 00:00 2024-04-25T08:54:31.596 INFO:teuthology.orchestra.run.smithi005.stdout:(27/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 2.2 MB/s | 170 kB 00:00 2024-04-25T08:54:31.704 INFO:teuthology.orchestra.run.smithi005.stdout:(28/152): ceph-grafana-dashboards-19.0.0-1628.g 290 kB/s | 31 kB 00:00 2024-04-25T08:54:31.763 INFO:teuthology.orchestra.run.smithi005.stdout:(29/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 2.3 MB/s | 138 kB 00:00 2024-04-25T08:54:31.813 INFO:teuthology.orchestra.run.smithi005.stdout:(30/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 9.7 MB/s | 3.1 MB 00:00 2024-04-25T08:54:31.832 INFO:teuthology.orchestra.run.smithi080.stdout:(6/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-04-25T08:54:31.938 INFO:teuthology.orchestra.run.smithi005.stdout:(31/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 4.4 MB/s | 5.1 MB 00:01 2024-04-25T08:54:32.130 INFO:teuthology.orchestra.run.smithi005.stdout:(32/152): ceph-mgr-modules-core-19.0.0-1628.g97 1.3 MB/s | 248 kB 00:00 2024-04-25T08:54:32.231 INFO:teuthology.orchestra.run.smithi005.stdout:(33/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 493 kB/s | 49 kB 00:00 2024-04-25T08:54:32.331 INFO:teuthology.orchestra.run.smithi005.stdout:(34/152): ceph-prometheus-alerts-19.0.0-1628.g9 154 kB/s | 15 kB 00:00 2024-04-25T08:54:32.456 INFO:teuthology.orchestra.run.smithi005.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-04-25T08:54:32.482 INFO:teuthology.orchestra.run.smithi005.stdout:(36/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 1.7 MB/s | 264 kB 00:00 2024-04-25T08:54:32.523 INFO:teuthology.orchestra.run.smithi005.stdout:(37/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 2.3 MB/s | 1.8 MB 00:00 2024-04-25T08:54:32.565 INFO:teuthology.orchestra.run.smithi005.stdout:(38/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 6.7 MB/s | 748 kB 00:00 2024-04-25T08:54:32.591 INFO:teuthology.orchestra.run.smithi005.stdout:(39/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 167 kB/s | 18 kB 00:00 2024-04-25T08:54:32.841 INFO:teuthology.orchestra.run.smithi005.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 781 kB/s | 195 kB 00:00 2024-04-25T08:54:32.966 INFO:teuthology.orchestra.run.smithi005.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-04-25T08:54:33.092 INFO:teuthology.orchestra.run.smithi005.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-04-25T08:54:33.117 INFO:teuthology.orchestra.run.smithi005.stdout:(43/152): fuse-2.9.9-15.el9.x86_64.rpm 135 kB/s | 80 kB 00:00 2024-04-25T08:54:33.132 INFO:teuthology.orchestra.run.smithi080.stdout:(7/152): ceph-common-19.0.0-1628.g97ae6cc9.el9. 7.1 MB/s | 20 MB 00:02 2024-04-25T08:54:33.199 INFO:teuthology.orchestra.run.smithi080.stdout:(8/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 2.9 MB/s | 4.7 MB 00:01 2024-04-25T08:54:33.274 INFO:teuthology.orchestra.run.smithi080.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 337 kB/s | 25 kB 00:00 2024-04-25T08:54:33.342 INFO:teuthology.orchestra.run.smithi005.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-04-25T08:54:33.467 INFO:teuthology.orchestra.run.smithi005.stdout:(45/152): python3-ply-3.11-14.el9.noarch.rpm 284 kB/s | 106 kB 00:00 2024-04-25T08:54:33.517 INFO:teuthology.orchestra.run.smithi005.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 338 kB/s | 135 kB 00:00 2024-04-25T08:54:33.551 INFO:teuthology.orchestra.run.smithi005.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 597 kB/s | 125 kB 00:00 2024-04-25T08:54:33.700 INFO:teuthology.orchestra.run.smithi080.stdout:(10/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el 17 MB/s | 9.8 MB 00:00 2024-04-25T08:54:33.758 INFO:teuthology.orchestra.run.smithi080.stdout:(11/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 3.7 MB/s | 220 kB 00:00 2024-04-25T08:54:33.776 INFO:teuthology.orchestra.run.smithi005.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-04-25T08:54:33.816 INFO:teuthology.orchestra.run.smithi080.stdout:(12/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 465 kB/s | 27 kB 00:00 2024-04-25T08:54:33.835 INFO:teuthology.orchestra.run.smithi005.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-04-25T08:54:33.860 INFO:teuthology.orchestra.run.smithi005.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-04-25T08:54:33.867 INFO:teuthology.orchestra.run.smithi080.stdout:(13/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 624 kB/s | 31 kB 00:00 2024-04-25T08:54:33.893 INFO:teuthology.orchestra.run.smithi005.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-04-25T08:54:33.919 INFO:teuthology.orchestra.run.smithi005.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-25T08:54:33.944 INFO:teuthology.orchestra.run.smithi005.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-04-25T08:54:33.951 INFO:teuthology.orchestra.run.smithi080.stdout:(14/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 8.7 MB/s | 744 kB 00:00 2024-04-25T08:54:33.994 INFO:teuthology.orchestra.run.smithi005.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-04-25T08:54:34.018 INFO:teuthology.orchestra.run.smithi080.stdout:(15/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 2.4 MB/s | 163 kB 00:00 2024-04-25T08:54:34.053 INFO:teuthology.orchestra.run.smithi005.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-04-25T08:54:34.076 INFO:teuthology.orchestra.run.smithi080.stdout:(16/152): librados-devel-19.0.0-1628.g97ae6cc9. 2.1 MB/s | 127 kB 00:00 2024-04-25T08:54:34.111 INFO:teuthology.orchestra.run.smithi005.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-25T08:54:34.151 INFO:teuthology.orchestra.run.smithi080.stdout:(17/152): libradosstriper1-19.0.0-1628.g97ae6cc 6.5 MB/s | 501 kB 00:00 2024-04-25T08:54:34.162 INFO:teuthology.orchestra.run.smithi005.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-04-25T08:54:34.187 INFO:teuthology.orchestra.run.smithi005.stdout:(58/152): python3-urllib3-1.26.5-5.el9.noarch.r 298 kB/s | 215 kB 00:00 2024-04-25T08:54:34.212 INFO:teuthology.orchestra.run.smithi005.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-04-25T08:54:34.246 INFO:teuthology.orchestra.run.smithi005.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-04-25T08:54:34.271 INFO:teuthology.orchestra.run.smithi005.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-04-25T08:54:34.305 INFO:teuthology.orchestra.run.smithi005.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-04-25T08:54:34.330 INFO:teuthology.orchestra.run.smithi005.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-04-25T08:54:34.364 INFO:teuthology.orchestra.run.smithi005.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-04-25T08:54:34.389 INFO:teuthology.orchestra.run.smithi005.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-04-25T08:54:34.477 INFO:teuthology.orchestra.run.smithi080.stdout:(18/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 16 MB/s | 5.1 MB 00:00 2024-04-25T08:54:34.498 INFO:teuthology.orchestra.run.smithi005.stdout:(66/152): libtool-2.4.6-45.el9.x86_64.rpm 1.8 MB/s | 582 kB 00:00 2024-04-25T08:54:34.527 INFO:teuthology.orchestra.run.smithi080.stdout:(19/152): python3-ceph-argparse-19.0.0-1628.g97 905 kB/s | 45 kB 00:00 2024-04-25T08:54:34.577 INFO:teuthology.orchestra.run.smithi080.stdout:(20/152): python3-ceph-common-19.0.0-1628.g97ae 2.6 MB/s | 131 kB 00:00 2024-04-25T08:54:34.636 INFO:teuthology.orchestra.run.smithi080.stdout:(21/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 2.7 MB/s | 162 kB 00:00 2024-04-25T08:54:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-25T08:54:34.707 INFO:teuthology.orchestra.run.smithi005.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T08:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:(22/152): python3-rados-19.0.0-1628.g97ae6cc9.e 4.2 MB/s | 321 kB 00:00 2024-04-25T08:54:34.740 INFO:teuthology.orchestra.run.smithi005.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-04-25T08:54:34.765 INFO:teuthology.orchestra.run.smithi005.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T08:54:34.778 INFO:teuthology.orchestra.run.smithi080.stdout:(23/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 4.4 MB/s | 298 kB 00:00 2024-04-25T08:54:34.845 INFO:teuthology.orchestra.run.smithi080.stdout:(24/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.4 MB/s | 99 kB 00:00 2024-04-25T08:54:34.866 INFO:teuthology.orchestra.run.smithi005.stdout:(71/152): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-04-25T08:54:34.899 INFO:teuthology.orchestra.run.smithi005.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-04-25T08:54:34.916 INFO:teuthology.orchestra.run.smithi005.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-04-25T08:54:34.920 INFO:teuthology.orchestra.run.smithi080.stdout:(25/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-25T08:54:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-25T08:54:35.059 INFO:teuthology.orchestra.run.smithi005.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-04-25T08:54:35.084 INFO:teuthology.orchestra.run.smithi005.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-25T08:54:35.109 INFO:teuthology.orchestra.run.smithi005.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-25T08:54:35.134 INFO:teuthology.orchestra.run.smithi005.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-04-25T08:54:35.154 INFO:teuthology.orchestra.run.smithi080.stdout:(26/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 13 MB/s | 3.1 MB 00:00 2024-04-25T08:54:35.168 INFO:teuthology.orchestra.run.smithi005.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T08:54:35.185 INFO:teuthology.orchestra.run.smithi005.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-04-25T08:54:35.261 INFO:teuthology.orchestra.run.smithi005.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-25T08:54:35.286 INFO:teuthology.orchestra.run.smithi005.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-25T08:54:35.327 INFO:teuthology.orchestra.run.smithi005.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-25T08:54:35.330 INFO:teuthology.orchestra.run.smithi080.stdout:(27/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x8 4.8 MB/s | 17 MB 00:03 2024-04-25T08:54:35.353 INFO:teuthology.orchestra.run.smithi005.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-25T08:54:35.355 INFO:teuthology.orchestra.run.smithi080.stdout:(28/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 849 kB/s | 170 kB 00:00 2024-04-25T08:54:35.372 INFO:teuthology.orchestra.run.smithi080.stdout:(29/152): ceph-grafana-dashboards-19.0.0-1628.g 747 kB/s | 31 kB 00:00 2024-04-25T08:54:35.386 INFO:teuthology.orchestra.run.smithi005.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-04-25T08:54:35.431 INFO:teuthology.orchestra.run.smithi080.stdout:(30/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 1.8 MB/s | 138 kB 00:00 2024-04-25T08:54:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-04-25T08:54:35.478 INFO:teuthology.orchestra.run.smithi005.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-04-25T08:54:35.504 INFO:teuthology.orchestra.run.smithi005.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-25T08:54:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-25T08:54:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-04-25T08:54:35.579 INFO:teuthology.orchestra.run.smithi005.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-04-25T08:54:35.613 INFO:teuthology.orchestra.run.smithi005.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-04-25T08:54:35.638 INFO:teuthology.orchestra.run.smithi005.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-04-25T08:54:35.672 INFO:teuthology.orchestra.run.smithi005.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-25T08:54:35.697 INFO:teuthology.orchestra.run.smithi005.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-04-25T08:54:35.731 INFO:teuthology.orchestra.run.smithi005.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-04-25T08:54:35.756 INFO:teuthology.orchestra.run.smithi005.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T08:54:35.806 INFO:teuthology.orchestra.run.smithi080.stdout:(31/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 4.1 MB/s | 1.8 MB 00:00 2024-04-25T08:54:35.807 INFO:teuthology.orchestra.run.smithi005.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-04-25T08:54:35.823 INFO:teuthology.orchestra.run.smithi005.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-25T08:54:35.873 INFO:teuthology.orchestra.run.smithi005.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-04-25T08:54:35.899 INFO:teuthology.orchestra.run.smithi005.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-04-25T08:54:35.906 INFO:teuthology.orchestra.run.smithi080.stdout:(32/152): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-04-25T08:54:35.932 INFO:teuthology.orchestra.run.smithi080.stdout:(33/152): ceph-mgr-modules-core-19.0.0-1628.g97 1.9 MB/s | 248 kB 00:00 2024-04-25T08:54:35.965 INFO:teuthology.orchestra.run.smithi080.stdout:(34/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 843 kB/s | 49 kB 00:00 2024-04-25T08:54:35.991 INFO:teuthology.orchestra.run.smithi080.stdout:(35/152): ceph-prometheus-alerts-19.0.0-1628.g9 261 kB/s | 15 kB 00:00 2024-04-25T08:54:36.024 INFO:teuthology.orchestra.run.smithi080.stdout:(36/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 4.4 MB/s | 264 kB 00:00 2024-04-25T08:54:36.075 INFO:teuthology.orchestra.run.smithi080.stdout:(37/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 8.7 MB/s | 748 kB 00:00 2024-04-25T08:54:36.100 INFO:teuthology.orchestra.run.smithi080.stdout:(38/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 243 kB/s | 18 kB 00:00 2024-04-25T08:54:36.126 INFO:teuthology.orchestra.run.smithi005.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-25T08:54:36.152 INFO:teuthology.orchestra.run.smithi005.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 80 kB/s | 22 kB 00:00 2024-04-25T08:54:36.217 INFO:teuthology.orchestra.run.smithi080.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 566 kB/s | 80 kB 00:00 2024-04-25T08:54:36.284 INFO:teuthology.orchestra.run.smithi080.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-25T08:54:36.317 INFO:teuthology.orchestra.run.smithi080.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-04-25T08:54:36.343 INFO:teuthology.orchestra.run.smithi080.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-04-25T08:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-25T08:54:36.410 INFO:teuthology.orchestra.run.smithi005.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-04-25T08:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-25T08:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-04-25T08:54:36.485 INFO:teuthology.orchestra.run.smithi080.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-25T08:54:36.511 INFO:teuthology.orchestra.run.smithi080.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T08:54:36.669 INFO:teuthology.orchestra.run.smithi005.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-25T08:54:36.694 INFO:teuthology.orchestra.run.smithi005.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 570 kB/s | 309 kB 00:00 2024-04-25T08:54:36.752 INFO:teuthology.orchestra.run.smithi005.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 876 kB/s | 548 kB 00:00 2024-04-25T08:54:36.794 INFO:teuthology.orchestra.run.smithi005.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi080.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-04-25T08:54:36.853 INFO:teuthology.orchestra.run.smithi005.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-04-25T08:54:36.895 INFO:teuthology.orchestra.run.smithi005.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-04-25T08:54:36.970 INFO:teuthology.orchestra.run.smithi005.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-25T08:54:37.129 INFO:teuthology.orchestra.run.smithi005.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-04-25T08:54:37.162 INFO:teuthology.orchestra.run.smithi005.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2024-04-25T08:54:37.187 INFO:teuthology.orchestra.run.smithi080.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 298 kB/s | 107 kB 00:00 2024-04-25T08:54:37.229 INFO:teuthology.orchestra.run.smithi005.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-04-25T08:54:37.254 INFO:teuthology.orchestra.run.smithi005.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-04-25T08:54:37.321 INFO:teuthology.orchestra.run.smithi005.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-04-25T08:54:37.345 INFO:teuthology.orchestra.run.smithi080.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 136 kB/s | 21 kB 00:00 2024-04-25T08:54:37.363 INFO:teuthology.orchestra.run.smithi005.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-25T08:54:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:(118/152): libarrow-9.0.0-10.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-04-25T08:54:37.531 INFO:teuthology.orchestra.run.smithi005.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-04-25T08:54:37.556 INFO:teuthology.orchestra.run.smithi005.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2024-04-25T08:54:37.598 INFO:teuthology.orchestra.run.smithi005.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-04-25T08:54:37.603 INFO:teuthology.orchestra.run.smithi080.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-04-25T08:54:37.648 INFO:teuthology.orchestra.run.smithi005.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-04-25T08:54:37.707 INFO:teuthology.orchestra.run.smithi005.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-25T08:54:37.749 INFO:teuthology.orchestra.run.smithi005.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-04-25T08:54:37.804 INFO:teuthology.orchestra.run.smithi080.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 163 kB/s | 33 kB 00:00 2024-04-25T08:54:37.832 INFO:teuthology.orchestra.run.smithi005.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-04-25T08:54:37.849 INFO:teuthology.orchestra.run.smithi005.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2024-04-25T08:54:37.866 INFO:teuthology.orchestra.run.smithi005.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-04-25T08:54:37.879 INFO:teuthology.orchestra.run.smithi080.stdout:(53/152): bison-3.7.4-5.el9.x86_64.rpm 689 kB/s | 943 kB 00:01 2024-04-25T08:54:37.925 INFO:teuthology.orchestra.run.smithi005.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-25T08:54:37.958 INFO:teuthology.orchestra.run.smithi005.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 215 kB/s | 20 kB 00:00 2024-04-25T08:54:38.000 INFO:teuthology.orchestra.run.smithi005.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-04-25T08:54:38.013 INFO:teuthology.orchestra.run.smithi080.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 136 kB/s | 18 kB 00:00 2024-04-25T08:54:38.017 INFO:teuthology.orchestra.run.smithi005.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 502 kB/s | 46 kB 00:00 2024-04-25T08:54:38.067 INFO:teuthology.orchestra.run.smithi005.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 723 kB/s | 79 kB 00:00 2024-04-25T08:54:38.101 INFO:teuthology.orchestra.run.smithi005.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 572 kB/s | 58 kB 00:00 2024-04-25T08:54:38.113 INFO:teuthology.orchestra.run.smithi080.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-04-25T08:54:38.126 INFO:teuthology.orchestra.run.smithi005.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-04-25T08:54:38.168 INFO:teuthology.orchestra.run.smithi005.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-04-25T08:54:38.202 INFO:teuthology.orchestra.run.smithi005.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 897 kB/s | 90 kB 00:00 2024-04-25T08:54:38.227 INFO:teuthology.orchestra.run.smithi005.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 280 kB/s | 28 kB 00:00 2024-04-25T08:54:38.269 INFO:teuthology.orchestra.run.smithi005.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-04-25T08:54:38.303 INFO:teuthology.orchestra.run.smithi005.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-25T08:54:38.328 INFO:teuthology.orchestra.run.smithi005.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-04-25T08:54:38.363 INFO:teuthology.orchestra.run.smithi080.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 641 kB/s | 160 kB 00:00 2024-04-25T08:54:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-04-25T08:54:38.403 INFO:teuthology.orchestra.run.smithi005.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2024-04-25T08:54:38.428 INFO:teuthology.orchestra.run.smithi005.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-25T08:54:38.479 INFO:teuthology.orchestra.run.smithi005.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 824 kB/s | 90 kB 00:00 2024-04-25T08:54:38.512 INFO:teuthology.orchestra.run.smithi005.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-25T08:54:38.538 INFO:teuthology.orchestra.run.smithi005.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-04-25T08:54:38.555 INFO:teuthology.orchestra.run.smithi080.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 236 kB/s | 45 kB 00:00 2024-04-25T08:54:38.596 INFO:teuthology.orchestra.run.smithi005.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-25T08:54:38.646 INFO:teuthology.orchestra.run.smithi005.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T08:54:38.847 INFO:teuthology.orchestra.run.smithi080.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-04-25T08:54:39.138 INFO:teuthology.orchestra.run.smithi005.stdout:(149/152): librados2-19.0.0-1628.g97ae6cc9.el9. 5.6 MB/s | 3.4 MB 00:00 2024-04-25T08:54:39.214 INFO:teuthology.orchestra.run.smithi005.stdout:(150/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 5.1 MB/s | 3.1 MB 00:00 2024-04-25T08:54:39.623 INFO:teuthology.orchestra.run.smithi080.stdout:(59/152): ceph-test-19.0.0-1628.g97ae6cc9.el9.x 7.5 MB/s | 47 MB 00:06 2024-04-25T08:54:39.706 INFO:teuthology.orchestra.run.smithi005.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.2 MB/s | 2.4 MB 00:00 2024-04-25T08:54:39.765 INFO:teuthology.orchestra.run.smithi080.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 635 kB/s | 582 kB 00:00 2024-04-25T08:54:39.781 INFO:teuthology.orchestra.run.smithi080.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 161 kB/s | 25 kB 00:00 2024-04-25T08:54:39.907 INFO:teuthology.orchestra.run.smithi080.stdout:(62/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.4 MB/s | 3.0 MB 00:02 2024-04-25T08:54:39.942 INFO:teuthology.orchestra.run.smithi080.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 270 kB/s | 47 kB 00:00 2024-04-25T08:54:40.074 INFO:teuthology.orchestra.run.smithi080.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-04-25T08:54:40.099 INFO:teuthology.orchestra.run.smithi080.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 222 kB/s | 35 kB 00:00 2024-04-25T08:54:40.166 INFO:teuthology.orchestra.run.smithi080.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 728 kB/s | 188 kB 00:00 2024-04-25T08:54:40.289 INFO:teuthology.orchestra.run.smithi005.stdout:(152/152): openssl-3.2.1-1.el9.x86_64.rpm 841 kB/s | 1.3 MB 00:01 2024-04-25T08:54:40.293 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:54:40.293 INFO:teuthology.orchestra.run.smithi005.stdout:Total 15 MB/s | 215 MB 00:14 2024-04-25T08:54:40.650 INFO:teuthology.orchestra.run.smithi080.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-04-25T08:54:40.825 INFO:teuthology.orchestra.run.smithi080.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-04-25T08:54:41.233 INFO:teuthology.orchestra.run.smithi080.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 326 kB/s | 133 kB 00:00 2024-04-25T08:54:41.460 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-25T08:54:41.619 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-25T08:54:41.619 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-25T08:54:41.867 INFO:teuthology.orchestra.run.smithi080.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 749 kB/s | 911 kB 00:01 2024-04-25T08:54:42.060 INFO:teuthology.orchestra.run.smithi080.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 2.4 MB/s | 4.7 MB 00:01 2024-04-25T08:54:42.275 INFO:teuthology.orchestra.run.smithi080.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 404 kB/s | 87 kB 00:00 2024-04-25T08:54:42.359 INFO:teuthology.orchestra.run.smithi080.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-04-25T08:54:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 977 kB/s | 244 kB 00:00 2024-04-25T08:54:42.885 INFO:teuthology.orchestra.run.smithi080.stdout:(75/152): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-04-25T08:54:42.910 INFO:teuthology.orchestra.run.smithi080.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 825 kB/s | 248 kB 00:00 2024-04-25T08:54:43.027 INFO:teuthology.orchestra.run.smithi080.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 180 kB/s | 26 kB 00:00 2024-04-25T08:54:43.061 INFO:teuthology.orchestra.run.smithi080.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 127 kB/s | 19 kB 00:00 2024-04-25T08:54:43.203 INFO:teuthology.orchestra.run.smithi080.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 245 kB/s | 35 kB 00:00 2024-04-25T08:54:43.328 INFO:teuthology.orchestra.run.smithi080.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 573 kB/s | 172 kB 00:00 2024-04-25T08:54:43.468 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-25T08:54:43.468 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-25T08:54:43.687 INFO:teuthology.orchestra.run.smithi080.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-04-25T08:54:43.712 INFO:teuthology.orchestra.run.smithi080.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 653 kB/s | 250 kB 00:00 2024-04-25T08:54:43.896 INFO:teuthology.orchestra.run.smithi080.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 420 kB/s | 77 kB 00:00 2024-04-25T08:54:43.937 INFO:teuthology.orchestra.run.smithi080.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 888 kB/s | 222 kB 00:00 2024-04-25T08:54:44.128 INFO:teuthology.orchestra.run.smithi080.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 182 kB/s | 42 kB 00:00 2024-04-25T08:54:44.230 INFO:teuthology.orchestra.run.smithi080.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 922 kB/s | 269 kB 00:00 2024-04-25T08:54:44.413 INFO:teuthology.orchestra.run.smithi080.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 558 kB/s | 159 kB 00:00 2024-04-25T08:54:44.597 INFO:teuthology.orchestra.run.smithi080.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 760 kB/s | 279 kB 00:00 2024-04-25T08:54:44.622 INFO:teuthology.orchestra.run.smithi080.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 245 kB/s | 51 kB 00:00 2024-04-25T08:54:44.772 INFO:teuthology.orchestra.run.smithi080.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 306 kB/s | 54 kB 00:00 2024-04-25T08:54:44.948 INFO:teuthology.orchestra.run.smithi080.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 238 kB/s | 42 kB 00:00 2024-04-25T08:54:45.131 INFO:teuthology.orchestra.run.smithi080.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 241 kB/s | 44 kB 00:00 2024-04-25T08:54:45.240 INFO:teuthology.orchestra.run.smithi080.stdout:(93/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-04-25T08:54:45.382 INFO:teuthology.orchestra.run.smithi080.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 254 kB/s | 36 kB 00:00 2024-04-25T08:54:45.407 INFO:teuthology.orchestra.run.smithi080.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 801 kB/s | 221 kB 00:00 2024-04-25T08:54:45.574 INFO:teuthology.orchestra.run.smithi080.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-04-25T08:54:45.666 INFO:teuthology.orchestra.run.smithi080.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-04-25T08:54:45.749 INFO:teuthology.orchestra.run.smithi080.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 329 kB/s | 58 kB 00:00 2024-04-25T08:54:45.866 INFO:teuthology.orchestra.run.smithi080.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 468 kB/s | 94 kB 00:00 2024-04-25T08:54:45.942 INFO:teuthology.orchestra.run.smithi080.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-04-25T08:54:46.034 INFO:teuthology.orchestra.run.smithi080.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 268 kB/s | 45 kB 00:00 2024-04-25T08:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi080.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.9 MB/s | 548 kB 00:00 2024-04-25T08:54:46.426 INFO:teuthology.orchestra.run.smithi080.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-04-25T08:54:46.451 INFO:teuthology.orchestra.run.smithi080.stdout:(105/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-04-25T08:54:46.485 INFO:teuthology.orchestra.run.smithi080.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 329 kB/s | 19 kB 00:00 2024-04-25T08:54:46.544 INFO:teuthology.orchestra.run.smithi080.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2024-04-25T08:54:46.602 INFO:teuthology.orchestra.run.smithi080.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 834 kB/s | 49 kB 00:00 2024-04-25T08:54:46.661 INFO:teuthology.orchestra.run.smithi080.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-25T08:54:46.853 INFO:teuthology.orchestra.run.smithi080.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 788 kB/s | 151 kB 00:00 2024-04-25T08:54:46.954 INFO:teuthology.orchestra.run.smithi080.stdout:(111/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.2 MB/s | 838 kB 00:00 2024-04-25T08:54:47.021 INFO:teuthology.orchestra.run.smithi080.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-04-25T08:54:47.121 INFO:teuthology.orchestra.run.smithi080.stdout:(113/152): libarrow-9.0.0-10.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-04-25T08:54:47.146 INFO:teuthology.orchestra.run.smithi080.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 347 kB/s | 43 kB 00:00 2024-04-25T08:54:47.181 INFO:teuthology.orchestra.run.smithi080.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-04-25T08:54:47.205 INFO:teuthology.orchestra.run.smithi080.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2024-04-25T08:54:47.230 INFO:teuthology.orchestra.run.smithi080.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-04-25T08:54:47.281 INFO:teuthology.orchestra.run.smithi080.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-25T08:54:47.306 INFO:teuthology.orchestra.run.smithi080.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-25T08:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 601 kB/s | 35 kB 00:00 2024-04-25T08:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-04-25T08:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-25T08:54:47.474 INFO:teuthology.orchestra.run.smithi080.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-04-25T08:54:47.524 INFO:teuthology.orchestra.run.smithi080.stdout:(124/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-25T08:54:47.549 INFO:teuthology.orchestra.run.smithi080.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-25T08:54:47.583 INFO:teuthology.orchestra.run.smithi080.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-04-25T08:54:47.608 INFO:teuthology.orchestra.run.smithi080.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-04-25T08:54:47.642 INFO:teuthology.orchestra.run.smithi080.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-04-25T08:54:47.684 INFO:teuthology.orchestra.run.smithi080.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-04-25T08:54:47.709 INFO:teuthology.orchestra.run.smithi080.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-04-25T08:54:47.735 INFO:teuthology.orchestra.run.smithi080.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-25T08:54:47.910 INFO:teuthology.orchestra.run.smithi080.stdout:(132/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-04-25T08:54:47.935 INFO:teuthology.orchestra.run.smithi080.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 255 kB/s | 58 kB 00:00 2024-04-25T08:54:47.961 INFO:teuthology.orchestra.run.smithi080.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-04-25T08:54:47.994 INFO:teuthology.orchestra.run.smithi080.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-04-25T08:54:48.019 INFO:teuthology.orchestra.run.smithi080.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-04-25T08:54:48.053 INFO:teuthology.orchestra.run.smithi080.stdout:(137/152): python3-portend-3.1.0-2.el9.noarch.r 115 kB/s | 16 kB 00:00 2024-04-25T08:54:48.078 INFO:teuthology.orchestra.run.smithi080.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-04-25T08:54:48.104 INFO:teuthology.orchestra.run.smithi080.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-25T08:54:48.137 INFO:teuthology.orchestra.run.smithi080.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-04-25T08:54:48.163 INFO:teuthology.orchestra.run.smithi080.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 868 kB/s | 51 kB 00:00 2024-04-25T08:54:48.188 INFO:teuthology.orchestra.run.smithi080.stdout:(142/152): python3-rsa-4.9-2.el9.noarch.rpm 439 kB/s | 59 kB 00:00 2024-04-25T08:54:48.230 INFO:teuthology.orchestra.run.smithi080.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-25T08:54:48.255 INFO:teuthology.orchestra.run.smithi080.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 975 kB/s | 90 kB 00:00 2024-04-25T08:54:48.289 INFO:teuthology.orchestra.run.smithi080.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-04-25T08:54:48.314 INFO:teuthology.orchestra.run.smithi080.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-25T08:54:48.373 INFO:teuthology.orchestra.run.smithi080.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-04-25T08:54:48.423 INFO:teuthology.orchestra.run.smithi080.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T08:54:48.640 INFO:teuthology.orchestra.run.smithi080.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 1.3 MB 00:00 2024-04-25T08:54:48.732 INFO:teuthology.orchestra.run.smithi080.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-04-25T08:54:48.807 INFO:teuthology.orchestra.run.smithi080.stdout:(151/152): librados2-19.0.0-1628.g97ae6cc9.el9. 6.8 MB/s | 3.4 MB 00:00 2024-04-25T08:54:48.949 INFO:teuthology.orchestra.run.smithi080.stdout:(152/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 5.4 MB/s | 3.1 MB 00:00 2024-04-25T08:54:48.951 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:54:48.952 INFO:teuthology.orchestra.run.smithi080.stdout:Total 11 MB/s | 215 MB 00:19 2024-04-25T08:54:49.533 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-25T08:54:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T08:54:49.900 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T08:54:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T08:54:49.995 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T08:54:50.019 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T08:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-25T08:54:50.064 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T08:54:50.192 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-25T08:54:50.192 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-25T08:54:50.406 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T08:54:50.511 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:54:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:54:50.654 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:54:50.730 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:54:50.759 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:54:50.916 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T08:54:50.964 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T08:54:50.992 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:54:51.097 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:54:51.126 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:54:51.231 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:54:51.252 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:54:51.273 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:54:51.461 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:54:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:54:51.605 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T08:54:51.700 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T08:54:51.734 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T08:54:51.770 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T08:54:51.844 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T08:54:51.893 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T08:54:51.923 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-25T08:54:51.923 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-25T08:54:51.938 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T08:54:51.978 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T08:54:52.006 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T08:54:52.078 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T08:54:52.130 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T08:54:52.167 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T08:54:52.211 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T08:54:52.289 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T08:54:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T08:54:52.365 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T08:54:52.385 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T08:54:52.459 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T08:54:52.508 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T08:54:52.595 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T08:54:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T08:54:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T08:54:53.351 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T08:54:53.443 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T08:54:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T08:54:53.519 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T08:54:53.557 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T08:54:53.599 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T08:54:53.775 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T08:54:53.844 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T08:54:53.900 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T08:54:53.975 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T08:54:54.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T08:54:54.047 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T08:54:54.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T08:54:54.130 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T08:54:54.166 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T08:54:54.207 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T08:54:54.351 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T08:54:54.396 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T08:54:54.426 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T08:54:54.468 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T08:54:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T08:54:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T08:54:54.641 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T08:54:54.683 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T08:54:54.707 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T08:54:54.787 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T08:54:54.923 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T08:54:55.073 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T08:54:55.101 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T08:54:55.136 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T08:54:55.175 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T08:54:55.223 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T08:54:55.252 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T08:54:55.287 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T08:54:55.320 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T08:54:55.363 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T08:54:55.396 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T08:54:55.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T08:54:55.536 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T08:54:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T08:54:55.614 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T08:54:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T08:54:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T08:54:56.548 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T08:54:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T08:54:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T08:54:56.735 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T08:54:56.799 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T08:54:56.890 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T08:54:56.935 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T08:54:57.119 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T08:54:57.148 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T08:54:57.228 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T08:54:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-25T08:54:57.910 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T08:54:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T08:54:58.034 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T08:54:58.176 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T08:54:58.237 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T08:54:58.278 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T08:54:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T08:54:58.347 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T08:54:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T08:54:58.779 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:54:58.901 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:54:58.997 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:54:59.088 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:54:59.127 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:54:59.273 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T08:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T08:54:59.345 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T08:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:54:59.426 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T08:54:59.446 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T08:54:59.455 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:54:59.471 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T08:54:59.478 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:54:59.540 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:54:59.562 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:54:59.588 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:54:59.728 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:54:59.762 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:54:59.798 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T08:54:59.868 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T08:54:59.950 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T08:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T08:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T08:55:00.041 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:55:00.071 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T08:55:00.103 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T08:55:00.108 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T08:55:00.137 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T08:55:00.181 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T08:55:00.222 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T08:55:00.250 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T08:55:00.319 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T08:55:00.373 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T08:55:00.403 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T08:55:00.450 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T08:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T08:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T08:55:00.588 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T08:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T08:55:00.611 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T08:55:00.666 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:55:00.696 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T08:55:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T08:55:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T08:55:00.953 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T08:55:01.005 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T08:55:01.531 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T08:55:01.617 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T08:55:01.646 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T08:55:01.681 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T08:55:01.719 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T08:55:01.760 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T08:55:01.901 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T08:55:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T08:55:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T08:55:02.083 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T08:55:02.115 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T08:55:02.151 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T08:55:02.198 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T08:55:02.234 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T08:55:02.277 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T08:55:02.319 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T08:55:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T08:55:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T08:55:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T08:55:02.580 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T08:55:02.673 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T08:55:02.705 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T08:55:02.745 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T08:55:02.779 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T08:55:02.804 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T08:55:02.878 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T08:55:02.977 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:55:03.005 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T08:55:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:55:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T08:55:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T08:55:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T08:55:03.155 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T08:55:03.187 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T08:55:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T08:55:03.251 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T08:55:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T08:55:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T08:55:03.447 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T08:55:03.491 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T08:55:03.522 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T08:55:03.569 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T08:55:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:55:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:55:03.667 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T08:55:03.684 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:55:03.684 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T08:55:03.685 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T08:55:03.685 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:03.713 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:55:03.724 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T08:55:04.441 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T08:55:04.488 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T08:55:04.521 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T08:55:04.620 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T08:55:04.671 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T08:55:04.757 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T08:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T08:55:04.975 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T08:55:05.005 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T08:55:05.082 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T08:55:05.729 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T08:55:05.845 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T08:55:07.060 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T08:55:07.160 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T08:55:07.188 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T08:55:07.222 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T08:55:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T08:55:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:55:07.658 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:55:07.706 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T08:55:07.742 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T08:55:08.195 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T08:55:08.238 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:55:08.309 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:55:08.331 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T08:55:10.565 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:55:10.603 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:55:11.140 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:55:11.190 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:55:11.305 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:55:11.305 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T08:55:11.305 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T08:55:11.306 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:11.341 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:55:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-04-25T08:55:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:55:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:55:15.967 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:15.967 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T08:55:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:17.553 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:55:17.580 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:55:17.580 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:17.580 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T08:55:17.580 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:55:17.580 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:55:17.581 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:17.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:55:17.819 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:55:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T08:55:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:55:17.819 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:55:17.819 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:18.279 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:55:18.303 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:55:18.303 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:18.303 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T08:55:18.303 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:55:18.303 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:55:18.304 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:18.410 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T08:55:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T08:55:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T08:55:18.728 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T08:55:18.772 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T08:55:18.852 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T08:55:18.943 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:55:19.093 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:55:19.139 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T08:55:19.170 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T08:55:19.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T08:55:19.626 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:55:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:55:19.695 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T08:55:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T08:55:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:55:20.026 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:55:20.053 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:55:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:55:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:55:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:55:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T08:55:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:55:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:55:21.447 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:21.447 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T08:55:21.447 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:55:21.447 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:55:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:55:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:55:21.610 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T08:55:21.664 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T08:55:22.566 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T08:55:22.600 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:55:22.624 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:55:22.625 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:22.625 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T08:55:22.625 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:55:22.625 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:55:22.625 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:22.668 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:55:22.691 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:55:22.691 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:22.691 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T08:55:22.691 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:22.743 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:55:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:55:22.767 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:22.767 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T08:55:22.767 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:55:22.767 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:55:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:22.899 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /root 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-04-25T08:55:22.900 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:55:23.087 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:55:23.088 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:23.088 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T08:55:23.088 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:23.094 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:55:23.118 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:55:23.118 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:23.118 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T08:55:23.118 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:55:23.118 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:55:23.118 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:24.566 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:55:24.592 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:55:24.592 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:24.592 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T08:55:24.592 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:55:24.592 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:55:24.592 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:24.792 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:55:24.814 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:55:24.814 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:24.814 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T08:55:24.814 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:55:24.814 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:55:24.814 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:25.251 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:55:25.273 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:55:25.273 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:25.273 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T08:55:25.273 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:55:25.273 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:55:25.273 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:25.380 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T08:55:25.429 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T08:55:25.484 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T08:55:25.667 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T08:55:25.718 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T08:55:25.796 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T08:55:25.884 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:55:26.021 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:55:26.069 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T08:55:26.101 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T08:55:26.128 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T08:55:26.554 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:55:26.594 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:55:26.625 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T08:55:26.685 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T08:55:26.709 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:55:26.937 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:55:26.968 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:55:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T08:55:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T08:55:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T08:55:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T08:55:27.929 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:55:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T08:55:27.959 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:55:28.060 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:55:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T08:55:28.176 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T08:55:28.198 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T08:55:28.222 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T08:55:28.253 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:55:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:55:28.276 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:28.276 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T08:55:28.276 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:55:28.276 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:55:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:55:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:55:28.429 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T08:55:28.477 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T08:55:28.839 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:55:28.878 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:55:28.899 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:55:29.329 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T08:55:29.365 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:55:29.388 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:55:29.388 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:29.388 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T08:55:29.388 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:55:29.388 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:55:29.389 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:29.433 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:55:29.454 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:55:29.454 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:29.454 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T08:55:29.455 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:29.500 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:55:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:55:29.522 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:29.522 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T08:55:29.523 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:55:29.523 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:55:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:29.817 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T08:55:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:55:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:55:29.848 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:55:29.848 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T08:55:29.848 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:55:29.848 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:55:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:29.908 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T08:55:29.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T08:55:30.034 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T08:55:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T08:55:30.071 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:55:30.146 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:55:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:55:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:55:30.262 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:55:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:55:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T08:55:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T08:55:34.319 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T08:55:34.352 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T08:55:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T08:55:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T08:55:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T08:55:34.638 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T08:55:35.248 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:55:35.286 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:55:35.305 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:55:35.424 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:55:35.424 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T08:55:35.424 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T08:55:35.424 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T08:55:35.424 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T08:55:35.424 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T08:55:35.425 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T08:55:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T08:55:35.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T08:55:35.428 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T08:55:35.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T08:55:35.430 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T08:55:35.431 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T08:55:35.432 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T08:55:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T08:55:35.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:55:35.435 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T08:55:36.131 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T08:55:36.217 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T08:55:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T08:55:36.338 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T08:55:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T08:55:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:55:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:55:36.488 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:55:36.488 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:55:36.580 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:55:36.644 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:55:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:55:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:37.584 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-04-25T08:55:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.584 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.585 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:37.586 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T08:55:37.587 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T08:55:37.588 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T08:55:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T08:55:37.591 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.592 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T08:55:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:37.594 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-25T08:55:37.992 DEBUG:teuthology.parallel:result is None 2024-04-25T08:55:42.006 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T08:55:42.007 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T08:55:42.008 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T08:55:42.009 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T08:55:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T08:55:42.011 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T08:55:42.012 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T08:55:42.013 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T08:55:42.014 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T08:55:42.015 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T08:55:42.016 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:55:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T08:55:44.213 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:55:44.213 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:44.213 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-04-25T08:55:44.213 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.213 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.213 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.214 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.215 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T08:55:44.216 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.217 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T08:55:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.219 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T08:55:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T08:55:44.221 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T08:55:44.222 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T08:55:44.223 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T08:55:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T08:55:44.225 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T08:55:44.225 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T08:55:44.225 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T08:55:44.225 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:44.225 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T08:55:44.657 DEBUG:teuthology.parallel:result is None 2024-04-25T08:55:44.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:55:44.809 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T08:55:44.836 INFO:teuthology.orchestra.run.smithi005.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:55:44.837 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:55:44.837 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T08:55:44.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:55:44.985 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T08:55:45.008 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:55:45.008 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:55:45.008 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T08:55:45.010 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T08:55:45.010 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:45.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T08:55:45.044 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:45.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T08:55:45.075 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T08:55:45.075 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:45.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T08:55:45.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T08:55:45.180 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:45.180 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T08:55:45.206 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T08:55:45.269 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T08:55:45.270 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:45.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T08:55:45.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T08:55:45.367 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:45.367 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T08:55:45.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T08:55:45.456 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T08:55:45.456 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:45.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T08:55:45.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T08:55:45.553 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:45.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T08:55:45.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T08:55:45.641 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T08:55:45.730 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T08:55:45.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-04-25T08:55:45.733 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-04-25T08:55:45.760 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T08:55:45.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T08:55:45.802 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T08:55:45.828 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T08:55:45.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T08:55:45.872 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T08:55:45.904 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T08:55:45.905 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T08:55:45.905 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T08:55:45.905 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:45.905 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T08:55:45.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:46.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:46.097 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:46.097 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T08:55:46.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:46.218 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:46.264 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T08:55:46.264 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T08:55:46.264 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7673008', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': '5787d42d10024ba410e822a8aba474331cb9af02'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5869, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '5787d42d10024ba410e822a8aba474331cb9af02', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXYbjecAw0nYeMl1wDM7sXDzLGe8Ual9MKxZFMt0YV57aaalTn8HSzu35uaBTfhSwSQKZ3tK620Oi99K9ki0I8=', 'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPunG97XKwp74rS7Oo8zEpB9fJYhZtR0GCCNlGYOEh6keKDgZJLjRgsruOCy8mXOEFE+ndv45rhJWIFNlAtjaLE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:15:18', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T08:55:46.265 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T08:55:46.267 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T08:55:46.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T08:55:46.324 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T08:55:46.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:46.378 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T08:55:46.404 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T08:55:46.404 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-25 08:55:30.762122667 +0000 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-25 08:53:47.563127107 +0000 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-25 08:53:47.563127107 +0000 2024-04-25T08:55:46.461 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-25 08:53:47.563127107 +0000 2024-04-25T08:55:46.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T08:55:46.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T08:55:46.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T08:55:46.525 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000110208 s, 4.6 MB/s 2024-04-25T08:55:46.526 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T08:55:46.583 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-25 08:55:30.762122667 +0000 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-25 08:53:47.891120144 +0000 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-25 08:53:47.891120144 +0000 2024-04-25T08:55:46.640 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-25 08:53:47.891120144 +0000 2024-04-25T08:55:46.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T08:55:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T08:55:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T08:55:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000104963 s, 4.9 MB/s 2024-04-25T08:55:46.705 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T08:55:46.761 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-04-25T08:55:46.817 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T08:55:46.817 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:46.818 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T08:55:46.818 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:46.818 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:46.818 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-25 08:55:30.763122646 +0000 2024-04-25T08:55:46.818 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-25 08:53:48.236112823 +0000 2024-04-25T08:55:46.818 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-25 08:53:48.236112823 +0000 2024-04-25T08:55:46.818 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-25 08:53:48.236112823 +0000 2024-04-25T08:55:46.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T08:55:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T08:55:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T08:55:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000101217 s, 5.1 MB/s 2024-04-25T08:55:46.882 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T08:55:46.939 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-04-25T08:55:46.993 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-25 08:55:30.763122646 +0000 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-25 08:53:48.556106033 +0000 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-25 08:53:48.556106033 +0000 2024-04-25T08:55:46.994 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-25 08:53:48.556106033 +0000 2024-04-25T08:55:46.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T08:55:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T08:55:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T08:55:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000103665 s, 4.9 MB/s 2024-04-25T08:55:47.059 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T08:55:47.116 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:55:47.116 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:47.116 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T08:55:47.132 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T08:55:47.132 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-04-25T08:55:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T08:55:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:47.187 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T08:55:47.187 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:47.187 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:47.187 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 08:55:37.022145839 +0000 2024-04-25T08:55:47.188 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 08:53:44.524547491 +0000 2024-04-25T08:55:47.188 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 08:53:44.524547491 +0000 2024-04-25T08:55:47.188 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 08:53:44.524547491 +0000 2024-04-25T08:55:47.188 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T08:55:47.249 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T08:55:47.249 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T08:55:47.249 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000192731 s, 2.7 MB/s 2024-04-25T08:55:47.251 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T08:55:47.306 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 08:55:37.022145839 +0000 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 08:53:45.028535782 +0000 2024-04-25T08:55:47.360 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 08:53:45.028535782 +0000 2024-04-25T08:55:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 08:53:45.028535782 +0000 2024-04-25T08:55:47.361 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T08:55:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T08:55:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T08:55:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000180114 s, 2.8 MB/s 2024-04-25T08:55:47.424 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T08:55:47.479 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 08:55:37.023145818 +0000 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 08:53:45.368527882 +0000 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 08:53:45.368527882 +0000 2024-04-25T08:55:47.533 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 08:53:45.368527882 +0000 2024-04-25T08:55:47.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T08:55:47.595 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T08:55:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T08:55:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000195472 s, 2.6 MB/s 2024-04-25T08:55:47.597 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T08:55:47.651 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-04-25T08:55:47.706 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T08:55:47.706 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:55:47.706 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-25T08:55:47.706 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:55:47.706 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:55:47.707 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 08:55:37.023145818 +0000 2024-04-25T08:55:47.707 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 08:53:45.709519960 +0000 2024-04-25T08:55:47.707 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 08:53:45.709519960 +0000 2024-04-25T08:55:47.707 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 08:53:45.709519960 +0000 2024-04-25T08:55:47.707 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T08:55:47.767 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T08:55:47.768 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T08:55:47.768 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000168362 s, 3.0 MB/s 2024-04-25T08:55:47.769 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T08:55:47.825 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:55:47.825 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T08:55:47.825 INFO:tasks.ceph:Generating config... 2024-04-25T08:55:47.826 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T08:55:47.826 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T08:55:47.826 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T08:55:47.826 INFO:tasks.ceph:[client] pid file = 2024-04-25T08:55:47.826 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T08:55:47.826 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T08:55:47.826 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T08:55:47.827 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T08:55:47.828 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T08:55:47.828 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T08:55:47.828 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T08:55:47.828 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T08:55:47.828 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T08:55:47.828 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T08:55:47.829 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T08:55:47.829 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T08:55:47.829 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T08:55:47.829 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T08:55:47.829 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T08:55:47.829 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T08:55:47.829 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T08:55:47.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T08:55:47.889 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T08:55:47.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T08:55:47.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:55:47.962 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.80'), ('mon.c', '[v2:172.21.15.80:3301,v1:172.21.15.80:6790]')] 2024-04-25T08:55:47.962 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.80,[v2:172.21.15.80:3301,v1:172.21.15.80:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T08:55:47.963 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:47.963 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T08:55:48.018 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.80 --addv c '[v2:172.21.15.80:3301,v1:172.21.15.80:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:48.104 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid dc25bcb4-77ea-4563-9f35-ae8cfdf8a422 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:fsid dc25bcb4-77ea-4563-9f35-ae8cfdf8a422 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-04-25T08:55:48.116143+0000 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-25T08:55:48.116143+0000 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 17 (quincy) 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] mon.c 2024-04-25T08:55:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T08:55:48.107 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T08:55:48.122 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dc25bcb4-77ea-4563-9f35-ae8cfdf8a422... 2024-04-25T08:55:48.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T08:55:48.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T08:55:48.203 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-04-25T08:55:48.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-04-25T08:55:48.205 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.5,172.21.15.80,[v2:172.21.15.80:3301,v1:172.21.15.80:6790]" 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on skipped message = False 2024-04-25T08:55:48.206 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = dc25bcb4-77ea-4563-9f35-ae8cfdf8a422 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-04-25T08:55:48.207 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.208 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: bdev async discard = True 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: bdev enable discard = True 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore allocator = bitmap 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 1/20 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 1/20 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 4/10 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-04-25T08:55:48.209 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T08:55:48.210 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.211 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: mon op complaint time = 120 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T08:55:48.212 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout: client mount timeout = 600 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = "" 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-25T08:55:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:[mds] 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds = 20 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds balancer = 20 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: mds cache max size = 1000 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug frag = True 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug scatterstat = True 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: mds log max segments = 1 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: mds op complaint time = 180 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: mds verify scatter = True 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T08:55:48.214 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-04-25T08:55:48.219 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.220 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.80,[v2:172.21.15.80:3301,v1:172.21.15.80:6790]" 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = dc25bcb4-77ea-4563-9f35-ae8cfdf8a422 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-04-25T08:55:48.221 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-04-25T08:55:48.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2024-04-25T08:55:48.223 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.224 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.225 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T08:55:48.226 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-04-25T08:55:48.227 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: mds cache max size = 1000 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: mds log max segments = 1 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-04-25T08:55:48.228 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-04-25T08:55:48.228 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T08:55:48.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T08:55:48.311 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T08:55:48.311 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:48.311 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T08:55:48.327 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:48.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T08:55:48.382 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:55:48.382 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:48.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T08:55:48.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:55:48.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:55:48.455 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:48.510 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:55:48.510 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:48.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T08:55:48.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:55:48.544 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:55:48.545 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:48.599 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T08:55:48.599 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T08:55:48.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T08:55:48.649 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T08:55:48.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T08:55:48.727 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T08:55:48.729 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T08:55:48.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T08:55:48.779 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T08:55:48.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T08:55:48.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T08:55:48.896 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T08:55:48.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T08:55:48.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T08:55:48.970 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T08:55:48.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T08:55:48.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T08:55:49.083 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T08:55:49.086 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T08:55:49.109 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T08:55:49.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T08:55:49.150 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T08:55:49.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T08:55:49.243 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T08:55:49.255 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T08:55:49.294 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T08:55:49.305 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T08:55:49.384 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T08:55:49.396 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T08:55:49.396 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T08:55:49.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T08:55:49.421 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:55:49.422 INFO:tasks.ceph:role: osd.0 2024-04-25T08:55:49.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:55:49.422 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T08:55:49.485 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:55:49.485 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:55:49.485 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:55:49.486 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:55:49.486 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:55:49.486 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:55:49.486 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:55:49.486 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:55:49.486 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:55:49.486 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:55:49.518 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-25T08:55:49.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-25T08:55:49.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T08:55:49.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T08:55:49.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T08:55:49.723 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:55:49.723 INFO:tasks.ceph:role: osd.1 2024-04-25T08:55:49.723 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:55:49.723 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:55:49.787 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:55:49.819 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-25T08:55:49.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-25T08:55:49.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T08:55:49.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T08:55:49.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T08:55:50.030 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:55:50.031 INFO:tasks.ceph:role: osd.2 2024-04-25T08:55:50.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:55:50.031 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T08:55:50.094 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:55:50.095 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:55:50.127 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-25T08:55:50.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-25T08:55:50.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T08:55:50.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T08:55:50.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T08:55:50.333 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:55:50.333 INFO:tasks.ceph:role: osd.3 2024-04-25T08:55:50.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:55:50.333 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:55:50.397 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:55:50.429 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-25T08:55:50.431 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-25T08:55:50.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T08:55:50.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T08:55:50.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:50.674+0000 7fd8f6757640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T08:55:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:50.674+0000 7fd8f6757640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T08:55:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:50.674+0000 7fd8f6757640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:55:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:50.674+0000 7fd8f6757640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:55:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:50.674+0000 7fd8f6757640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:55:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:50.675+0000 7fd8f6757640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T08:55:53.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T08:55:53.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:53.647+0000 7f9d1fadd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T08:55:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:53.647+0000 7f9d1fadd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T08:55:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:53.647+0000 7f9d1fadd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:55:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:53.647+0000 7f9d1fadd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:55:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:53.647+0000 7f9d1fadd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:55:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:53.647+0000 7f9d1fadd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T08:55:56.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T08:55:56.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:56.612+0000 7f43b8432640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T08:55:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:56.612+0000 7f43b8432640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T08:55:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:56.612+0000 7f43b8432640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:55:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:56.612+0000 7f43b8432640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:55:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:56.612+0000 7f43b8432640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:55:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:56.613+0000 7f43b8432640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T08:55:59.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T08:55:59.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:55:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:59.577+0000 7f877a1ba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T08:55:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:59.577+0000 7f877a1ba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T08:55:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:59.577+0000 7f877a1ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:55:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:59.577+0000 7f877a1ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:55:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:59.578+0000 7f877a1ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:55:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:55:59.578+0000 7f877a1ba640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T08:56:02.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T08:56:02.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T08:56:02.481 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:56:02.481 INFO:tasks.ceph:role: osd.4 2024-04-25T08:56:02.481 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:56:02.482 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:56:02.557 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:56:03.059 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T08:56:03.061 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T08:56:03.061 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T08:56:03.182 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T08:56:03.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T08:56:03.279 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:56:03.279 INFO:tasks.ceph:role: osd.5 2024-04-25T08:56:03.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:56:03.280 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:56:03.350 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:56:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:56:03.351 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:56:03.819 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T08:56:03.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T08:56:03.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T08:56:03.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T08:56:03.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T08:56:04.005 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:56:04.005 INFO:tasks.ceph:role: osd.6 2024-04-25T08:56:04.005 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:56:04.005 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:56:04.076 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:56:04.077 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:56:04.077 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:56:04.568 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T08:56:04.570 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T08:56:04.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T08:56:04.698 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T08:56:04.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T08:56:04.793 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:56:04.793 INFO:tasks.ceph:role: osd.7 2024-04-25T08:56:04.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:56:04.793 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:56:04.864 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:56:05.366 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T08:56:05.368 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T08:56:05.368 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T08:56:05.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T08:56:05.524 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:56:05.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:05.626+0000 7fd6ae412640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T08:56:05.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:05.627+0000 7fd6ae412640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T08:56:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:05.627+0000 7fd6ae412640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:56:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:05.627+0000 7fd6ae412640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:56:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:05.627+0000 7fd6ae412640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:56:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:05.627+0000 7fd6ae412640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T08:56:08.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T08:56:08.490 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:56:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:08.586+0000 7f5cac60d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T08:56:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:08.587+0000 7f5cac60d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T08:56:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:08.587+0000 7f5cac60d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:56:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:08.587+0000 7f5cac60d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:56:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:08.587+0000 7f5cac60d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:56:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:08.587+0000 7f5cac60d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T08:56:11.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T08:56:11.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:56:11.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:11.549+0000 7fd3fe368640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T08:56:11.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:11.550+0000 7fd3fe368640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T08:56:11.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:11.550+0000 7fd3fe368640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:56:11.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:11.550+0000 7fd3fe368640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:56:11.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:11.550+0000 7fd3fe368640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:56:11.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:11.550+0000 7fd3fe368640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T08:56:14.390 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T08:56:14.416 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:56:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:14.515+0000 7ff34b886640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T08:56:14.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:14.516+0000 7ff34b886640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T08:56:14.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:14.516+0000 7ff34b886640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:56:14.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:14.516+0000 7ff34b886640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:56:14.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:14.516+0000 7ff34b886640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:56:14.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:14.516+0000 7ff34b886640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T08:56:16.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:16.269 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:17.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T08:56:17.383 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T08:56:17.383 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:17.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T08:56:17.413 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:17.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T08:56:17.483 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:17.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T08:56:17.553 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:17.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T08:56:17.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:17.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T08:56:17.692 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:17.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T08:56:17.759 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:17.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T08:56:17.826 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:17.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T08:56:17.853 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:17.853 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T08:56:17.920 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:17.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T08:56:17.986 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:17.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T08:56:18.051 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:18.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T08:56:18.116 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:18.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T08:56:18.181 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:18.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T08:56:18.245 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:18.245 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T08:56:18.264 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:18.264 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T08:56:18.323 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:18.323 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T08:56:18.338 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:18.338 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T08:56:18.394 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T08:56:18.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T08:56:18.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T08:56:18.437 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg== 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A== 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA== 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ== 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w== 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-04-25T08:56:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew== 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ== 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA== 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w== 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg== 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA== 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA== 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-04-25T08:56:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA== 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA== 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA== 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg== 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2024-04-25T08:56:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ== 2024-04-25T08:56:18.458 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2024-04-25T08:56:18.458 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg== 2024-04-25T08:56:18.458 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A== 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA== 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ== 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w== 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew== 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ== 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA== 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-25T08:56:18.459 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[client.2] 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA== 2024-04-25T08:56:18.460 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2024-04-25T08:56:18.461 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg== 2024-04-25T08:56:18.461 INFO:teuthology.orchestra.run.smithi080.stdout:[client.3] 2024-04-25T08:56:18.461 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ== 2024-04-25T08:56:18.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:56:18.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:56:18.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:18.556 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:18.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:18.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:18.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.667 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.820 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:18.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:56:18.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:56:18.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:18.921 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:18.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:18.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:56:19.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.032 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.082 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.184 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:56:19.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.289 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.344 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.399 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:56:19.451 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T08:56:19.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T08:56:19.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:56:19.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T08:56:19.594 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T08:56:19.618 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:56:19.711 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T08:56:19.735 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T08:56:19.799 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:56:19.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T08:56:19.916 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:56:19.918 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:56:19.971 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T08:56:19.971 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T08:56:19.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T08:56:19.975 INFO:tasks.ceph.mon.a:Started 2024-04-25T08:56:19.975 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T08:56:19.975 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T08:56:20.014 INFO:tasks.ceph.mon.b:Started 2024-04-25T08:56:20.014 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T08:56:20.014 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T08:56:20.016 INFO:tasks.ceph.mon.c:Started 2024-04-25T08:56:20.016 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T08:56:20.016 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T08:56:20.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T08:56:20.019 INFO:tasks.ceph.mgr.y:Started 2024-04-25T08:56:20.019 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T08:56:20.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T08:56:20.021 INFO:tasks.ceph.mgr.x:Started 2024-04-25T08:56:20.021 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T08:56:20.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T08:56:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.134+0000 7fe509e9e640 1 Processor -- start 2024-04-25T08:56:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.135+0000 7fe509e9e640 1 -- start start 2024-04-25T08:56:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.135+0000 7fe509e9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 0x7fe5040d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.135+0000 7fe509e9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50406e6b0 con 0x7fe5040cefe0 2024-04-25T08:56:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.135+0000 7fe509e9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50406e990 con 0x7fe5040715d0 2024-04-25T08:56:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.135+0000 7fe509e9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50406f2c0 con 0x7fe50415bcf0 2024-04-25T08:56:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.136+0000 7fe503fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5040cefe0 0x7fe5040cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32862/0 (socket says 172.21.15.5:32862) 2024-04-25T08:56:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.136+0000 7fe503fff640 1 -- 172.21.15.5:0/3830684760 learned_addr learned my addr 172.21.15.5:0/3830684760 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.136+0000 7fe5037fe640 1 --2- 172.21.15.5:0/3830684760 >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 0x7fe5040d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.136+0000 7fe5037fe640 1 -- 172.21.15.5:0/3830684760 >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 msgr2=0x7fe5040d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T08:56:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.136+0000 7fe5037fe640 1 -- 172.21.15.5:0/3830684760 >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 msgr2=0x7fe5040d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T08:56:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.136+0000 7fe5037fe640 1 --2- 172.21.15.5:0/3830684760 >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 0x7fe5040d0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T08:56:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.136+0000 7fe5037fe640 1 --2- 172.21.15.5:0/3830684760 >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 0x7fe5040d0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T08:56:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996407332 0 0) 0x7fe50406e6b0 con 0x7fe5040cefe0 2024-04-25T08:56:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4ec003520 con 0x7fe5040cefe0 2024-04-25T08:56:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149062867 0 0) 0x7fe4ec003520 con 0x7fe5040cefe0 2024-04-25T08:56:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 msgr2=0x7fe5040d0740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:56:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 --2- 172.21.15.5:0/3830684760 >> v2:172.21.15.80:3300/0 conn(0x7fe50415bcf0 0x7fe5040d0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 >> v1:172.21.15.80:6789/0 conn(0x7fe5040715d0 legacy=0x7fe5040ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50406ec70 con 0x7fe5040cefe0 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fe4fc0019f0 con 0x7fe5040cefe0 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 >> v1:172.21.15.5:6789/0 conn(0x7fe5040cefe0 legacy=0x7fe5040cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe4ec0039b0 0x7fe4ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe4ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4ec0051c0 0x7fe4ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50406f2c0 con 0x7fe4ec004800 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec00c110 con 0x7fe4ec0051c0 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec00c310 con 0x7fe4ec0039b0 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe502ffd640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe4ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe503fff640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4ec0051c0 0x7fe4ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe5037fe640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe4ec0039b0 0x7fe4ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe502ffd640 1 -- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe4ec0039b0 msgr2=0x7fe4ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe502ffd640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe4ec0039b0 0x7fe4ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe502ffd640 1 -- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4ec0051c0 msgr2=0x7fe4ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe502ffd640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4ec0051c0 0x7fe4ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe502ffd640 1 -- 172.21.15.5:0/3830684760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec003520 con 0x7fe4ec004800 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.300+0000 7fe503fff640 1 -- 172.21.15.5:0/3830684760 reap_dead start 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.301+0000 7fe502ffd640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe4ec004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4001720 tx=0x7fe4ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47d029c247b5b6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.301+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4001370 con 0x7fe4ec004800 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.301+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f40052d0 con 0x7fe4ec004800 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.301+0000 7fe5027fc640 1 -- 172.21.15.5:0/3830684760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f402ab90 con 0x7fe4ec004800 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.302+0000 7fe509e9e640 1 -- 172.21.15.5:0/3830684760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 msgr2=0x7fe4ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.302+0000 7fe509e9e640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe4ec004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4001720 tx=0x7fe4ec005830 comp rx=0 tx=0).stop 2024-04-25T08:56:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.302+0000 7fe509e9e640 1 -- 172.21.15.5:0/3830684760 shutdown_connections 2024-04-25T08:56:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.302+0000 7fe509e9e640 1 --2- 172.21.15.5:0/3830684760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe4ec004c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.302+0000 7fe509e9e640 1 -- 172.21.15.5:0/3830684760 >> 172.21.15.5:0/3830684760 conn(0x7fe50406cc90 msgr2=0x7fe50406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.302+0000 7fe509e9e640 1 -- 172.21.15.5:0/3830684760 shutdown_connections 2024-04-25T08:56:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.302+0000 7fe509e9e640 1 -- 172.21.15.5:0/3830684760 wait complete. 2024-04-25T08:56:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.304+0000 7fe509e9e640 1 Processor -- start 2024-04-25T08:56:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.304+0000 7fe509e9e640 1 -- start start 2024-04-25T08:56:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.304+0000 7fe509e9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe50415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.304+0000 7fe509e9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe504145680 0x7fe504145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe509e9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5041f52b0 0x7fe5041f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe509e9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50415c0d0 con 0x7fe4ec004800 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe509e9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040ce1f0 con 0x7fe5041f52b0 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe509e9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50406e110 con 0x7fe504145680 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe50415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe50415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45304/0 (socket says 172.21.15.5:45304) 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 -- 172.21.15.5:0/2759478364 learned_addr learned my addr 172.21.15.5:0/2759478364 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe503fff640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5041f52b0 0x7fe5041f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe502ffd640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe504145680 0x7fe504145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 -- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe504145680 msgr2=0x7fe504145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe504145680 0x7fe504145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 -- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5041f52b0 msgr2=0x7fe5041f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5041f52b0 0x7fe5041f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 -- 172.21.15.5:0/2759478364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040a9680 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe503fff640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5041f52b0 0x7fe5041f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.305+0000 7fe5037fe640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe50415b110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8010820 tx=0x7fe4f8010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.306+0000 7fe4ebfff640 1 -- 172.21.15.5:0/2759478364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f801a020 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.306+0000 7fe4ebfff640 1 -- 172.21.15.5:0/2759478364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8010e70 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.306+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5040a9960 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.306+0000 7fe4ebfff640 1 -- 172.21.15.5:0/2759478364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800ebc0 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.306+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe504158da0 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.306+0000 7fe4ebfff640 1 -- 172.21.15.5:0/2759478364 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe4f801d020 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.306+0000 7fe4ebfff640 1 -- 172.21.15.5:0/2759478364 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe4f8014780 con 0x7fe4ec004800 2024-04-25T08:56:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.307+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50404ef20 con 0x7fe4ec004800 2024-04-25T08:56:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.310+0000 7fe4ebfff640 1 -- 172.21.15.5:0/2759478364 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe4f8024020 con 0x7fe4ec004800 2024-04-25T08:56:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.377+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe504073dd0 con 0x7fe4ec004800 2024-04-25T08:56:20.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.379+0000 7fe4ebfff640 1 -- 172.21.15.5:0/2759478364 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe4f800ed60 con 0x7fe4ec004800 2024-04-25T08:56:20.368 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 msgr2=0x7fe50415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe50415b110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8010820 tx=0x7fe4f8010c20 comp rx=0 tx=0).stop 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 shutdown_connections 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5041f52b0 0x7fe5041f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe504145680 0x7fe504145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 --2- 172.21.15.5:0/2759478364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ec004800 0x7fe50415b110 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 >> 172.21.15.5:0/2759478364 conn(0x7fe50406cc90 msgr2=0x7fe504071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 shutdown_connections 2024-04-25T08:56:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:20.380+0000 7fe509e9e640 1 -- 172.21.15.5:0/2759478364 wait complete. 2024-04-25T08:56:20.380 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T08:56:20.380 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T08:56:20.380 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:20.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T08:56:20.399 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:20.409+0000 7f88a1c9a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T08:56:20.404 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:20.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T08:56:20.408 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:20.419+0000 7f91aef21040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T08:56:20.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:20.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T08:56:20.496 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:20.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T08:56:20.539 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:20.550+0000 7f88a1c9a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:56:20.562 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:20.562 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T08:56:20.564 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:20.574+0000 7f91aef21040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:56:20.587 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:20.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T08:56:20.594 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:20.604+0000 7f88a1c9a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T08:56:20.617 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:20.617 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T08:56:20.619 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:20.631+0000 7f91aef21040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T08:56:20.680 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:56:20.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T08:56:20.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 5a064f71-599e-4ab9-b8fb-23796c79795e 0 2024-04-25T08:56:20.850 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:20.860+0000 7f88a1c9a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T08:56:20.872 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:20.884+0000 7f91aef21040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T08:56:20.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.891+0000 7f707415c640 1 Processor -- start 2024-04-25T08:56:20.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.891+0000 7f707415c640 1 -- start start 2024-04-25T08:56:20.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f707415c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f706c0b72b0 0x7f706c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f707415c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f707415c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0cc010 con 0x7f706c0ce6e0 2024-04-25T08:56:20.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f707415c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0cdde0 con 0x7f706c0b72b0 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f707415c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0cc2f0 con 0x7f706c0d0d20 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f7071ef8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f706c0b72b0 0x7f706c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f70716f7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f7071ef8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f706c0b72b0 0x7f706c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37746/0 (socket says 172.21.15.80:37746) 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f70716f7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57492/0 (socket says 172.21.15.80:57492) 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.892+0000 7f7071ef8640 1 -- 172.21.15.80:0/858961975 learned_addr learned my addr 172.21.15.80:0/858961975 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7071ef8640 1 -- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 msgr2=0x7f706c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7071ef8640 1 --2- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7071ef8640 1 -- 172.21.15.80:0/858961975 >> v1:172.21.15.80:6789/0 conn(0x7f706c0ce6e0 legacy=0x7f706c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7071ef8640 1 -- 172.21.15.80:0/858961975 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0cc5d0 con 0x7f706c0b72b0 2024-04-25T08:56:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f70716f7640 1 --2- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7071ef8640 1 --2- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0b72b0 0x7f706c0cfd70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f705c009870 tx=0x7f705c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beba8e4418bcfe22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7070ef6640 1 -- 172.21.15.80:0/858961975 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c037070 con 0x7f706c0b72b0 2024-04-25T08:56:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7070ef6640 1 -- 172.21.15.80:0/858961975 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c032440 con 0x7f706c0b72b0 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.893+0000 7f7070ef6640 1 -- 172.21.15.80:0/858961975 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c032810 con 0x7f706c0b72b0 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 -- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0b72b0 msgr2=0x7f706c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 --2- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0b72b0 0x7f706c0cfd70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f705c009870 tx=0x7f705c02a270 comp rx=0 tx=0).stop 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 -- 172.21.15.80:0/858961975 shutdown_connections 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 --2- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 --2- 172.21.15.80:0/858961975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0b72b0 0x7f706c0cfd70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 -- 172.21.15.80:0/858961975 >> 172.21.15.80:0/858961975 conn(0x7f706c0d1920 msgr2=0x7f706c0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 -- 172.21.15.80:0/858961975 shutdown_connections 2024-04-25T08:56:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.894+0000 7f707415c640 1 -- 172.21.15.80:0/858961975 wait complete. 2024-04-25T08:56:20.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.895+0000 7f707415c640 1 Processor -- start 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.895+0000 7f707415c640 1 -- start start 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f707415c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f706c0b72b0 0x7f706c1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f707415c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0ce6e0 0x7f706c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f707415c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f707415c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0d1550 con 0x7f706c0b72b0 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f707415c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0b4770 con 0x7f706c0ce6e0 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f707415c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0d1180 con 0x7f706c0d0d20 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0ce6e0 0x7f706c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70726f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0ce6e0 0x7f706c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37762/0 (socket says 172.21.15.80:37762) 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 -- 172.21.15.80:0/156141778 learned_addr learned my addr 172.21.15.80:0/156141778 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f7071ef8640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f706c0b72b0 0x7f706c1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 -- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 msgr2=0x7f706c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 -- 172.21.15.80:0/156141778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f706c0b72b0 msgr2=0x7f706c1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f706c0b72b0 0x7f706c1f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70716f7640 1 -- 172.21.15.80:0/156141778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0ca520 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.896+0000 7f70726f9640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f70716f7640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0ce6e0 0x7f706c0c7550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f706800ebe0 tx=0x7f706800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f70627fc640 1 -- 172.21.15.80:0/156141778 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068017070 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f70627fc640 1 -- 172.21.15.80:0/156141778 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706800cc30 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c09e940 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f70627fc640 1 -- 172.21.15.80:0/156141778 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068013470 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c09ef00 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f70627fc640 1 -- 172.21.15.80:0/156141778 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f706801a070 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.897+0000 7f70627fc640 1 -- 172.21.15.80:0/156141778 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7068013de0 con 0x7f706c0ce6e0 2024-04-25T08:56:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.898+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c04ef20 con 0x7f706c0ce6e0 2024-04-25T08:56:20.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.902+0000 7f70627fc640 1 -- 172.21.15.80:0/156141778 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7068005990 con 0x7f706c0ce6e0 2024-04-25T08:56:20.899 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:20.910+0000 7f88a1c9a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T08:56:20.920 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:20.932+0000 7f91aef21040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T08:56:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.971+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a064f71-599e-4ab9-b8fb-23796c79795e", "id": 0} v 0) v1 -- 0x7f706c06d3b0 con 0x7f706c0ce6e0 2024-04-25T08:56:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.977+0000 7f70627fc640 1 -- 172.21.15.80:0/156141778 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a064f71-599e-4ab9-b8fb-23796c79795e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7068005b70 con 0x7f706c0ce6e0 2024-04-25T08:56:20.967 INFO:teuthology.orchestra.run.smithi080.stdout:0 2024-04-25T08:56:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0ce6e0 msgr2=0x7f706c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0ce6e0 0x7f706c0c7550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f706800ebe0 tx=0x7f706800c520 comp rx=0 tx=0).stop 2024-04-25T08:56:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 shutdown_connections 2024-04-25T08:56:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f706c0d0d20 0x7f706c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f706c0ce6e0 0x7f706c0c7550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 --2- 172.21.15.80:0/156141778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f706c0b72b0 0x7f706c1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 >> 172.21.15.80:0/156141778 conn(0x7f706c0d1920 msgr2=0x7f706c160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 shutdown_connections 2024-04-25T08:56:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:20.978+0000 7f707415c640 1 -- 172.21.15.80:0/156141778 wait complete. 2024-04-25T08:56:20.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 71a83604-6b0e-42a3-bd0a-9e3306362178 1 2024-04-25T08:56:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.085+0000 7fdefa22a640 1 Processor -- start 2024-04-25T08:56:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.085+0000 7fdefa22a640 1 -- start start 2024-04-25T08:56:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdefa22a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdef415a9d0 0x7fdef4071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdefa22a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdef406dbe0 0x7fdef406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdefa22a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef406e070 con 0x7fdef406b120 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdefa22a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef406e350 con 0x7fdef406dbe0 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdefa22a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef406e630 con 0x7fdef415a9d0 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdef37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdef415a9d0 0x7fdef4071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdef37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdef415a9d0 0x7fdef4071e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37764/0 (socket says 172.21.15.80:37764) 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdef37fe640 1 -- 172.21.15.80:0/3521487692 learned_addr learned my addr 172.21.15.80:0/3521487692 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.086+0000 7fdef2ffd640 1 --2- 172.21.15.80:0/3521487692 >> v2:172.21.15.5:3300/0 conn(0x7fdef406dbe0 0x7fdef406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef37fe640 1 -- 172.21.15.80:0/3521487692 >> v2:172.21.15.5:3300/0 conn(0x7fdef406dbe0 msgr2=0x7fdef406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef37fe640 1 --2- 172.21.15.80:0/3521487692 >> v2:172.21.15.5:3300/0 conn(0x7fdef406dbe0 0x7fdef406abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef37fe640 1 -- 172.21.15.80:0/3521487692 >> v1:172.21.15.80:6789/0 conn(0x7fdef406b120 legacy=0x7fdef415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef37fe640 1 -- 172.21.15.80:0/3521487692 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef406e910 con 0x7fdef415a9d0 2024-04-25T08:56:21.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef37fe640 1 --2- 172.21.15.80:0/3521487692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef415a9d0 0x7fdef4071e00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdef40b34d0 tx=0x7fdee802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856fff4c62060462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef27fc640 1 -- 172.21.15.80:0/3521487692 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8037070 con 0x7fdef415a9d0 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef27fc640 1 -- 172.21.15.80:0/3521487692 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8032440 con 0x7fdef415a9d0 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.087+0000 7fdef27fc640 1 -- 172.21.15.80:0/3521487692 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8032810 con 0x7fdef415a9d0 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 -- 172.21.15.80:0/3521487692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef415a9d0 msgr2=0x7fdef4071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 --2- 172.21.15.80:0/3521487692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef415a9d0 0x7fdef4071e00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdef40b34d0 tx=0x7fdee802a270 comp rx=0 tx=0).stop 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 -- 172.21.15.80:0/3521487692 shutdown_connections 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 --2- 172.21.15.80:0/3521487692 >> v2:172.21.15.5:3300/0 conn(0x7fdef406dbe0 0x7fdef406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 --2- 172.21.15.80:0/3521487692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef415a9d0 0x7fdef4071e00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 -- 172.21.15.80:0/3521487692 >> 172.21.15.80:0/3521487692 conn(0x7fdef40b2560 msgr2=0x7fdef40b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 -- 172.21.15.80:0/3521487692 shutdown_connections 2024-04-25T08:56:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.088+0000 7fdefa22a640 1 -- 172.21.15.80:0/3521487692 wait complete. 2024-04-25T08:56:21.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.090+0000 7fdefa22a640 1 Processor -- start 2024-04-25T08:56:21.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.090+0000 7fdefa22a640 1 -- start start 2024-04-25T08:56:21.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdefa22a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdef406b120 0x7fdef41efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdefa22a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdef415a9d0 0x7fdef4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdefa22a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef41582f0 0x7fdef415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdefa22a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4072340 con 0x7fdef406b120 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdefa22a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef415adb0 con 0x7fdef41582f0 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdefa22a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef40b4a70 con 0x7fdef415a9d0 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdef2ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdef415a9d0 0x7fdef4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdef3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef41582f0 0x7fdef415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdef2ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdef415a9d0 0x7fdef4157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57522/0 (socket says 172.21.15.80:57522) 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdef2ffd640 1 -- 172.21.15.80:0/2259668351 learned_addr learned my addr 172.21.15.80:0/2259668351 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdef3fff640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef41582f0 0x7fdef415d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37772/0 (socket says 172.21.15.80:37772) 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.091+0000 7fdef37fe640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdef406b120 0x7fdef41efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdef2ffd640 1 -- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef41582f0 msgr2=0x7fdef415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdef2ffd640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef41582f0 0x7fdef415d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdef2ffd640 1 -- 172.21.15.80:0/2259668351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdef406b120 msgr2=0x7fdef41efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdef2ffd640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdef406b120 0x7fdef41efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdef2ffd640 1 -- 172.21.15.80:0/2259668351 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef41f00a0 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdef3fff640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef41582f0 0x7fdef415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdef2ffd640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdef415a9d0 0x7fdef4157db0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdee400fa10 tx=0x7fdee400fed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdedbfff640 1 -- 172.21.15.80:0/2259668351 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4007c30 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdedbfff640 1 -- 172.21.15.80:0/2259668351 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee4007dd0 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdedbfff640 1 -- 172.21.15.80:0/2259668351 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4011670 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef4158920 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef40a9430 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdedbfff640 1 -- 172.21.15.80:0/2259668351 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdee4019020 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.092+0000 7fdedbfff640 1 -- 172.21.15.80:0/2259668351 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fdee40247a0 con 0x7fdef415a9d0 2024-04-25T08:56:21.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.093+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef404ef20 con 0x7fdef415a9d0 2024-04-25T08:56:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.095+0000 7fdedbfff640 1 -- 172.21.15.80:0/2259668351 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fdee4029020 con 0x7fdef415a9d0 2024-04-25T08:56:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.166+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd new", "uuid": "71a83604-6b0e-42a3-bd0a-9e3306362178", "id": 1} v 0) v1 -- 0x7fdef40008d0 con 0x7fdef415a9d0 2024-04-25T08:56:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.169+0000 7fdedbfff640 1 -- 172.21.15.80:0/2259668351 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71a83604-6b0e-42a3-bd0a-9e3306362178", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdee4011e00 con 0x7fdef415a9d0 2024-04-25T08:56:21.158 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T08:56:21.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdef415a9d0 msgr2=0x7fdef4157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdef415a9d0 0x7fdef4157db0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdee400fa10 tx=0x7fdee400fed0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 shutdown_connections 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdef41582f0 0x7fdef415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdef415a9d0 0x7fdef4157db0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 --2- 172.21.15.80:0/2259668351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdef406b120 0x7fdef41efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 >> 172.21.15.80:0/2259668351 conn(0x7fdef40b2560 msgr2=0x7fdef40cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 shutdown_connections 2024-04-25T08:56:21.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.170+0000 7fdefa22a640 1 -- 172.21.15.80:0/2259668351 wait complete. 2024-04-25T08:56:21.170 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new f8b7d74d-c9fe-49a3-a3a9-800a91021020 2 2024-04-25T08:56:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.276+0000 7f13c457d640 1 Processor -- start 2024-04-25T08:56:21.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.276+0000 7f13c457d640 1 -- start start 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c457d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13bc15de80 0x7f13bc0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c457d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc15e260 con 0x7f13bc0ce1c0 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c457d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc0cf2e0 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c457d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0d1ef0 con 0x7f13bc15de80 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c2319640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13bc15de80 0x7f13bc0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c2319640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13bc15de80 0x7f13bc0ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37784/0 (socket says 172.21.15.80:37784) 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c2319640 1 -- 172.21.15.80:0/3943424975 learned_addr learned my addr 172.21.15.80:0/3943424975 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c2b1a640 1 --1- 172.21.15.80:0/3943424975 >> v1:172.21.15.80:6789/0 conn(0x7f13bc0d2dc0 0x7f13bc0b6cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33996/0 (socket says 172.21.15.80:33996) 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c2319640 1 -- 172.21.15.80:0/3943424975 >> v1:172.21.15.80:6789/0 conn(0x7f13bc0d2dc0 legacy=0x7f13bc0b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c2319640 1 -- 172.21.15.80:0/3943424975 >> v1:172.21.15.5:6789/0 conn(0x7f13bc0ce1c0 legacy=0x7f13bc0d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.277+0000 7f13c2319640 1 -- 172.21.15.80:0/3943424975 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0d18c0 con 0x7f13bc15de80 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.278+0000 7f13c2319640 1 --2- 172.21.15.80:0/3943424975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc15de80 0x7f13bc0ceda0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009870 tx=0x7f13b802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=653a34590b9e5cce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.278+0000 7f13c1317640 1 -- 172.21.15.80:0/3943424975 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8037070 con 0x7f13bc15de80 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.278+0000 7f13c1317640 1 -- 172.21.15.80:0/3943424975 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b8032440 con 0x7f13bc15de80 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.278+0000 7f13c1317640 1 -- 172.21.15.80:0/3943424975 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8032810 con 0x7f13bc15de80 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.279+0000 7f13c457d640 1 -- 172.21.15.80:0/3943424975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc15de80 msgr2=0x7f13bc0ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.279+0000 7f13c457d640 1 --2- 172.21.15.80:0/3943424975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc15de80 0x7f13bc0ceda0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009870 tx=0x7f13b802a270 comp rx=0 tx=0).stop 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.279+0000 7f13c457d640 1 -- 172.21.15.80:0/3943424975 shutdown_connections 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.279+0000 7f13c457d640 1 --2- 172.21.15.80:0/3943424975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc15de80 0x7f13bc0ceda0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.279+0000 7f13c457d640 1 -- 172.21.15.80:0/3943424975 >> 172.21.15.80:0/3943424975 conn(0x7f13bc06b000 msgr2=0x7f13bc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.279+0000 7f13c457d640 1 -- 172.21.15.80:0/3943424975 shutdown_connections 2024-04-25T08:56:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.279+0000 7f13c457d640 1 -- 172.21.15.80:0/3943424975 wait complete. 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.280+0000 7f13c457d640 1 Processor -- start 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.280+0000 7f13c457d640 1 -- start start 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.280+0000 7f13c457d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13bc0ce1c0 0x7f13bc153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.280+0000 7f13c457d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc0d2dc0 0x7f13bc0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.280+0000 7f13c457d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13bc15de80 0x7f13bc0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c457d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0b7400 con 0x7f13bc0ce1c0 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c457d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0d1b80 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c457d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0b7580 con 0x7f13bc15de80 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc0d2dc0 0x7f13bc0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c2b1a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13bc15de80 0x7f13bc0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc0d2dc0 0x7f13bc0cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37798/0 (socket says 172.21.15.80:37798) 2024-04-25T08:56:21.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c2b1a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13bc15de80 0x7f13bc0ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57534/0 (socket says 172.21.15.80:57534) 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 -- 172.21.15.80:0/3789008471 learned_addr learned my addr 172.21.15.80:0/3789008471 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c2319640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13bc0ce1c0 0x7f13bc153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 -- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13bc15de80 msgr2=0x7f13bc0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13bc15de80 0x7f13bc0ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 -- 172.21.15.80:0/3789008471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13bc0ce1c0 msgr2=0x7f13bc153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13bc0ce1c0 0x7f13bc153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 -- 172.21.15.80:0/3789008471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc1f74e0 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c2b1a640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13bc15de80 0x7f13bc0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c1b18640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc0d2dc0 0x7f13bc0cc7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00c400 tx=0x7f13ac00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13b2ffd640 1 -- 172.21.15.80:0/3789008471 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0052d0 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13b2ffd640 1 -- 172.21.15.80:0/3789008471 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac005490 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc1f77c0 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13b2ffd640 1 -- 172.21.15.80:0/3789008471 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac007260 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.281+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc1f7d80 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.282+0000 7f13b2ffd640 1 -- 172.21.15.80:0/3789008471 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f13ac007400 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.282+0000 7f13b2ffd640 1 -- 172.21.15.80:0/3789008471 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f13ac011590 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.282+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc1f7f80 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.284+0000 7f13b2ffd640 1 -- 172.21.15.80:0/3789008471 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f13ac0035f0 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.358+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8b7d74d-c9fe-49a3-a3a9-800a91021020", "id": 2} v 0) v1 -- 0x7f13bc04ef20 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.361+0000 7f13b2ffd640 1 -- 172.21.15.80:0/3789008471 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8b7d74d-c9fe-49a3-a3a9-800a91021020", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f13ac003aa0 con 0x7f13bc0d2dc0 2024-04-25T08:56:21.351 INFO:teuthology.orchestra.run.smithi080.stdout:2 2024-04-25T08:56:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc0d2dc0 msgr2=0x7f13bc0cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc0d2dc0 0x7f13bc0cc7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00c400 tx=0x7f13ac00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 shutdown_connections 2024-04-25T08:56:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13bc15de80 0x7f13bc0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13bc0d2dc0 0x7f13bc0cc7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 --2- 172.21.15.80:0/3789008471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13bc0ce1c0 0x7f13bc153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 >> 172.21.15.80:0/3789008471 conn(0x7f13bc06b000 msgr2=0x7f13bc0d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 shutdown_connections 2024-04-25T08:56:21.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.362+0000 7f13c457d640 1 -- 172.21.15.80:0/3789008471 wait complete. 2024-04-25T08:56:21.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 93499828-762d-4087-8ee5-f7620b8ffa49 3 2024-04-25T08:56:21.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.470+0000 7f5367ee1640 1 Processor -- start 2024-04-25T08:56:21.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.470+0000 7f5367ee1640 1 -- start start 2024-04-25T08:56:21.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5367ee1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5367ee1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53600b24b0 0x7f53600b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5367ee1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600cf7a0 con 0x7f53600cff00 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5367ee1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600cd350 con 0x7f53600b24b0 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5367ee1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600d24e0 con 0x7f536015c0f0 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5365c7d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f536547c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53600b24b0 0x7f53600b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f536547c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53600b24b0 0x7f53600b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37814/0 (socket says 172.21.15.80:37814) 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5365c7d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57550/0 (socket says 172.21.15.80:57550) 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f536547c640 1 -- 172.21.15.80:0/1632732047 learned_addr learned my addr 172.21.15.80:0/1632732047 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f536547c640 1 -- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 msgr2=0x7f53600cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f536547c640 1 --2- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f536547c640 1 -- 172.21.15.80:0/1632732047 >> v1:172.21.15.80:6789/0 conn(0x7f53600cff00 legacy=0x7f53600c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f536547c640 1 -- 172.21.15.80:0/1632732047 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600d27c0 con 0x7f53600b24b0 2024-04-25T08:56:21.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.471+0000 7f5365c7d640 1 --2- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:21.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.472+0000 7f536547c640 1 --2- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f53600b2930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5350009870 tx=0x7f535002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b446eda9e8217740 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.472+0000 7f5364c7b640 1 -- 172.21.15.80:0/1632732047 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350037070 con 0x7f53600b24b0 2024-04-25T08:56:21.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.472+0000 7f5364c7b640 1 -- 172.21.15.80:0/1632732047 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5350032440 con 0x7f53600b24b0 2024-04-25T08:56:21.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.472+0000 7f5364c7b640 1 -- 172.21.15.80:0/1632732047 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350032810 con 0x7f53600b24b0 2024-04-25T08:56:21.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.472+0000 7f5367ee1640 1 -- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 msgr2=0x7f53600b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.472+0000 7f5367ee1640 1 --2- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f53600b2930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5350009870 tx=0x7f535002a270 comp rx=0 tx=0).stop 2024-04-25T08:56:21.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.473+0000 7f5367ee1640 1 -- 172.21.15.80:0/1632732047 shutdown_connections 2024-04-25T08:56:21.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.473+0000 7f5367ee1640 1 --2- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f53600b2930 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.473+0000 7f5367ee1640 1 --2- 172.21.15.80:0/1632732047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.473+0000 7f5367ee1640 1 -- 172.21.15.80:0/1632732047 >> 172.21.15.80:0/1632732047 conn(0x7f53600d1920 msgr2=0x7f53600d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.473+0000 7f5367ee1640 1 -- 172.21.15.80:0/1632732047 shutdown_connections 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.473+0000 7f5367ee1640 1 -- 172.21.15.80:0/1632732047 wait complete. 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.474+0000 7f5367ee1640 1 Processor -- start 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.474+0000 7f5367ee1640 1 -- start start 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.474+0000 7f5367ee1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f5360153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.474+0000 7f5367ee1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53600cff00 0x7f53600b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.474+0000 7f5367ee1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5367ee1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600cdd20 con 0x7f53600cff00 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5367ee1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600cfa40 con 0x7f53600b24b0 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5367ee1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600cdea0 con 0x7f536015c0f0 2024-04-25T08:56:21.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f5360153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f5360153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37826/0 (socket says 172.21.15.80:37826) 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 -- 172.21.15.80:0/209403934 learned_addr learned my addr 172.21.15.80:0/209403934 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f536647e640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f536547c640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53600cff00 0x7f53600b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 -- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 msgr2=0x7f53600ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 -- 172.21.15.80:0/209403934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53600cff00 msgr2=0x7f53600b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53600cff00 0x7f53600b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 -- 172.21.15.80:0/209403934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600cb6b0 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5365c7d640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f5360153c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f535c012fc0 tx=0x7f535c010490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f53567fc640 1 -- 172.21.15.80:0/209403934 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c010da0 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f53567fc640 1 -- 172.21.15.80:0/209403934 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c01d070 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53600b5610 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f53567fc640 1 -- 172.21.15.80:0/209403934 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c0186a0 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53600b5bd0 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.475+0000 7f53567fc640 1 -- 172.21.15.80:0/209403934 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f535c016050 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.476+0000 7f53567fc640 1 -- 172.21.15.80:0/209403934 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f535c0064b0 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.476+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536004ef20 con 0x7f53600b24b0 2024-04-25T08:56:21.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.478+0000 7f53567fc640 1 -- 172.21.15.80:0/209403934 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f535c026020 con 0x7f53600b24b0 2024-04-25T08:56:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.550+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93499828-762d-4087-8ee5-f7620b8ffa49", "id": 3} v 0) v1 -- 0x7f536015b8a0 con 0x7f53600b24b0 2024-04-25T08:56:21.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.553+0000 7f53567fc640 1 -- 172.21.15.80:0/209403934 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93499828-762d-4087-8ee5-f7620b8ffa49", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f535c014040 con 0x7f53600b24b0 2024-04-25T08:56:21.542 INFO:teuthology.orchestra.run.smithi080.stdout:3 2024-04-25T08:56:21.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 msgr2=0x7f5360153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f5360153c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f535c012fc0 tx=0x7f535c010490 comp rx=0 tx=0).stop 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 shutdown_connections 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536015c0f0 0x7f53600ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53600cff00 0x7f53600b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 --2- 172.21.15.80:0/209403934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53600b24b0 0x7f5360153c20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 >> 172.21.15.80:0/209403934 conn(0x7f53600d1920 msgr2=0x7f53600c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 shutdown_connections 2024-04-25T08:56:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.554+0000 7f5367ee1640 1 -- 172.21.15.80:0/209403934 wait complete. 2024-04-25T08:56:21.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new c4fbdf1d-dd3f-455a-8420-b8527fb95078 4 2024-04-25T08:56:21.611 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:21.622+0000 7f88a1c9a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T08:56:21.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.661+0000 7f5a7725d640 1 Processor -- start 2024-04-25T08:56:21.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.661+0000 7f5a7725d640 1 -- start start 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.661+0000 7f5a7725d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a7015de80 0x7f5a700ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a7725d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a700ce1c0 0x7f5a700d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a7725d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7015e260 con 0x7f5a700d2dc0 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a7725d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700d1ef0 con 0x7f5a7015de80 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a7725d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700cf2e0 con 0x7f5a700ce1c0 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a6ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a700ce1c0 0x7f5a700d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a6ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a700ce1c0 0x7f5a700d2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37832/0 (socket says 172.21.15.80:37832) 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a6ffff640 1 -- 172.21.15.80:0/169645528 learned_addr learned my addr 172.21.15.80:0/169645528 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a74ff9640 1 --2- 172.21.15.80:0/169645528 >> v2:172.21.15.5:3300/0 conn(0x7f5a7015de80 0x7f5a700ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a6ffff640 1 -- 172.21.15.80:0/169645528 >> v2:172.21.15.5:3300/0 conn(0x7f5a7015de80 msgr2=0x7f5a700ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a6ffff640 1 --2- 172.21.15.80:0/169645528 >> v2:172.21.15.5:3300/0 conn(0x7f5a7015de80 0x7f5a700ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a6ffff640 1 -- 172.21.15.80:0/169645528 >> v1:172.21.15.5:6789/0 conn(0x7f5a700d2dc0 legacy=0x7f5a700b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a6ffff640 1 -- 172.21.15.80:0/169645528 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700d18c0 con 0x7f5a700ce1c0 2024-04-25T08:56:21.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.662+0000 7f5a74ff9640 1 --2- 172.21.15.80:0/169645528 >> v2:172.21.15.5:3300/0 conn(0x7f5a7015de80 0x7f5a700ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:21.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a6ffff640 1 --2- 172.21.15.80:0/169645528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a700ce1c0 0x7f5a700d2380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5a700c7650 tx=0x7f5a5c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a4e818ac72ffe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a6f7fe640 1 -- 172.21.15.80:0/169645528 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c037070 con 0x7f5a700ce1c0 2024-04-25T08:56:21.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a6f7fe640 1 -- 172.21.15.80:0/169645528 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c032440 con 0x7f5a700ce1c0 2024-04-25T08:56:21.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a6f7fe640 1 -- 172.21.15.80:0/169645528 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c032810 con 0x7f5a700ce1c0 2024-04-25T08:56:21.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a7725d640 1 -- 172.21.15.80:0/169645528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a700ce1c0 msgr2=0x7f5a700d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a7725d640 1 --2- 172.21.15.80:0/169645528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a700ce1c0 0x7f5a700d2380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5a700c7650 tx=0x7f5a5c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a7725d640 1 -- 172.21.15.80:0/169645528 shutdown_connections 2024-04-25T08:56:21.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.663+0000 7f5a7725d640 1 --2- 172.21.15.80:0/169645528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a700ce1c0 0x7f5a700d2380 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.664+0000 7f5a7725d640 1 --2- 172.21.15.80:0/169645528 >> v2:172.21.15.5:3300/0 conn(0x7f5a7015de80 0x7f5a700ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.664+0000 7f5a7725d640 1 -- 172.21.15.80:0/169645528 >> 172.21.15.80:0/169645528 conn(0x7f5a7006b000 msgr2=0x7f5a7006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.664+0000 7f5a7725d640 1 -- 172.21.15.80:0/169645528 shutdown_connections 2024-04-25T08:56:21.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.664+0000 7f5a7725d640 1 -- 172.21.15.80:0/169645528 wait complete. 2024-04-25T08:56:21.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.665+0000 7f5a7725d640 1 Processor -- start 2024-04-25T08:56:21.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.665+0000 7f5a7725d640 1 -- start start 2024-04-25T08:56:21.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.665+0000 7f5a7725d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a700ce1c0 0x7f5a701f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a7725d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a700d2dc0 0x7f5a701572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a7725d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7015de80 0x7f5a700b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a7725d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700d28c0 con 0x7f5a700d2dc0 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a7725d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700d1b80 con 0x7f5a7015de80 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a7725d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700b7400 con 0x7f5a700ce1c0 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7015de80 0x7f5a700b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a74ff9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a700ce1c0 0x7f5a701f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7015de80 0x7f5a700b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37842/0 (socket says 172.21.15.80:37842) 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 -- 172.21.15.80:0/2335992372 learned_addr learned my addr 172.21.15.80:0/2335992372 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a74ff9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a700ce1c0 0x7f5a701f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57570/0 (socket says 172.21.15.80:57570) 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a6ffff640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a700d2dc0 0x7f5a701572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 -- 172.21.15.80:0/2335992372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a700ce1c0 msgr2=0x7f5a701f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a700ce1c0 0x7f5a701f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 -- 172.21.15.80:0/2335992372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a700d2dc0 msgr2=0x7f5a701572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a700d2dc0 0x7f5a701572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 -- 172.21.15.80:0/2335992372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700b57a0 con 0x7f5a7015de80 2024-04-25T08:56:21.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a757fa640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7015de80 0x7f5a700b4ec0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c7d0 tx=0x7f5a6800cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a6d7fa640 1 -- 172.21.15.80:0/2335992372 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68003b70 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a6d7fa640 1 -- 172.21.15.80:0/2335992372 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a68003d30 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a700b5a80 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a6d7fa640 1 -- 172.21.15.80:0/2335992372 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800aa90 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.666+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a701f71d0 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.667+0000 7f5a6d7fa640 1 -- 172.21.15.80:0/2335992372 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5a6800ac30 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.667+0000 7f5a6d7fa640 1 -- 172.21.15.80:0/2335992372 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5a680055e0 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.667+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7004ef20 con 0x7f5a7015de80 2024-04-25T08:56:21.660 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:21.669+0000 7f91aef21040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T08:56:21.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.669+0000 7f5a6d7fa640 1 -- 172.21.15.80:0/2335992372 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5a680050d0 con 0x7f5a7015de80 2024-04-25T08:56:21.703 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:21.713+0000 7f88a1c9a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T08:56:21.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.741+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4fbdf1d-dd3f-455a-8420-b8527fb95078", "id": 4} v 0) v1 -- 0x7f5a700d01a0 con 0x7f5a7015de80 2024-04-25T08:56:21.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.744+0000 7f5a6d7fa640 1 -- 172.21.15.80:0/2335992372 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4fbdf1d-dd3f-455a-8420-b8527fb95078", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a680052b0 con 0x7f5a7015de80 2024-04-25T08:56:21.734 INFO:teuthology.orchestra.run.smithi080.stdout:4 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7015de80 msgr2=0x7f5a700b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7015de80 0x7f5a700b4ec0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c7d0 tx=0x7f5a6800cc90 comp rx=0 tx=0).stop 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 shutdown_connections 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7015de80 0x7f5a700b4ec0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a700d2dc0 0x7f5a701572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 --2- 172.21.15.80:0/2335992372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a700ce1c0 0x7f5a701f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 >> 172.21.15.80:0/2335992372 conn(0x7f5a7006b000 msgr2=0x7f5a700cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 shutdown_connections 2024-04-25T08:56:21.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.745+0000 7f5a7725d640 1 -- 172.21.15.80:0/2335992372 wait complete. 2024-04-25T08:56:21.745 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 399ef7ed-a941-4160-bd42-80121fbe96d3 5 2024-04-25T08:56:21.748 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:21.758+0000 7f88a1c9a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T08:56:21.750 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:21.761+0000 7f91aef21040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T08:56:21.795 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:21.806+0000 7f91aef21040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T08:56:21.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.852+0000 7f3688646640 1 Processor -- start 2024-04-25T08:56:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.852+0000 7f3688646640 1 -- start start 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f3688646640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f368015c0f0 0x7f36800cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f3688646640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36800d0610 0x7f36800b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f3688646640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800cf7a0 con 0x7f36800b24b0 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f3688646640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800cd350 con 0x7f36800d0610 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f3688646640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800d24e0 con 0x7f368015c0f0 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f36863e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f368015c0f0 0x7f36800cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f3686be3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36800d0610 0x7f36800b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f36863e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f368015c0f0 0x7f36800cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57584/0 (socket says 172.21.15.80:57584) 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f36863e2640 1 -- 172.21.15.80:0/4283852330 learned_addr learned my addr 172.21.15.80:0/4283852330 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f36863e2640 1 -- 172.21.15.80:0/4283852330 >> v2:172.21.15.80:3300/0 conn(0x7f36800d0610 msgr2=0x7f36800b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f36863e2640 1 --2- 172.21.15.80:0/4283852330 >> v2:172.21.15.80:3300/0 conn(0x7f36800d0610 0x7f36800b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f36863e2640 1 -- 172.21.15.80:0/4283852330 >> v1:172.21.15.80:6789/0 conn(0x7f36800b24b0 legacy=0x7f36800cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f36863e2640 1 -- 172.21.15.80:0/4283852330 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800d27c0 con 0x7f368015c0f0 2024-04-25T08:56:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.853+0000 7f3686be3640 1 --2- 172.21.15.80:0/4283852330 >> v2:172.21.15.80:3300/0 conn(0x7f36800d0610 0x7f36800b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.854+0000 7f36863e2640 1 --2- 172.21.15.80:0/4283852330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f368015c0f0 0x7f36800cd7e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f367c00f9b0 tx=0x7f367c02e550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7986e59b287fbd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.854+0000 7f36853e0640 1 -- 172.21.15.80:0/4283852330 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c03a070 con 0x7f368015c0f0 2024-04-25T08:56:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.854+0000 7f36853e0640 1 -- 172.21.15.80:0/4283852330 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c033710 con 0x7f368015c0f0 2024-04-25T08:56:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.854+0000 7f36853e0640 1 -- 172.21.15.80:0/4283852330 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c033ae0 con 0x7f368015c0f0 2024-04-25T08:56:21.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 -- 172.21.15.80:0/4283852330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f368015c0f0 msgr2=0x7f36800cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 --2- 172.21.15.80:0/4283852330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f368015c0f0 0x7f36800cd7e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f367c00f9b0 tx=0x7f367c02e550 comp rx=0 tx=0).stop 2024-04-25T08:56:21.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 -- 172.21.15.80:0/4283852330 shutdown_connections 2024-04-25T08:56:21.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 --2- 172.21.15.80:0/4283852330 >> v2:172.21.15.80:3300/0 conn(0x7f36800d0610 0x7f36800b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 --2- 172.21.15.80:0/4283852330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f368015c0f0 0x7f36800cd7e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 -- 172.21.15.80:0/4283852330 >> 172.21.15.80:0/4283852330 conn(0x7f36800d1920 msgr2=0x7f36800d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 -- 172.21.15.80:0/4283852330 shutdown_connections 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.855+0000 7f3688646640 1 -- 172.21.15.80:0/4283852330 wait complete. 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.856+0000 7f3688646640 1 Processor -- start 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.856+0000 7f3688646640 1 -- start start 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3688646640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800b24b0 0x7f36801f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3688646640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36800d0610 0x7f368015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3688646640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368015c0f0 0x7f36801eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3688646640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800cdd20 con 0x7f36800b24b0 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3688646640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800cfa40 con 0x7f368015c0f0 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3688646640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800cdea0 con 0x7f36800d0610 2024-04-25T08:56:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36800d0610 0x7f368015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3686be3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368015c0f0 0x7f36801eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36800d0610 0x7f368015ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57594/0 (socket says 172.21.15.80:57594) 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3686be3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368015c0f0 0x7f36801eff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37864/0 (socket says 172.21.15.80:37864) 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 -- 172.21.15.80:0/3723597632 learned_addr learned my addr 172.21.15.80:0/3723597632 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f36863e2640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800b24b0 0x7f36801f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 -- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368015c0f0 msgr2=0x7f36801eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368015c0f0 0x7f36801eff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 -- 172.21.15.80:0/3723597632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800b24b0 msgr2=0x7f36801f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800b24b0 0x7f36801f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 -- 172.21.15.80:0/3723597632 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368015b390 con 0x7f36800d0610 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3686be3640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368015c0f0 0x7f36801eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3685be1640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36800d0610 0x7f368015ae50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f367000c400 tx=0x7f367000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3676ffd640 1 -- 172.21.15.80:0/3723597632 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700052d0 con 0x7f36800d0610 2024-04-25T08:56:21.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.857+0000 7f3676ffd640 1 -- 172.21.15.80:0/3723597632 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670005490 con 0x7f36800d0610 2024-04-25T08:56:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.858+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36801f08e0 con 0x7f36800d0610 2024-04-25T08:56:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.858+0000 7f3676ffd640 1 -- 172.21.15.80:0/3723597632 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670007260 con 0x7f36800d0610 2024-04-25T08:56:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.858+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36801f36b0 con 0x7f36800d0610 2024-04-25T08:56:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.858+0000 7f3676ffd640 1 -- 172.21.15.80:0/3723597632 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3670007400 con 0x7f36800d0610 2024-04-25T08:56:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.858+0000 7f3676ffd640 1 -- 172.21.15.80:0/3723597632 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3670011590 con 0x7f36800d0610 2024-04-25T08:56:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.858+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36801f0e00 con 0x7f36800d0610 2024-04-25T08:56:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.861+0000 7f3676ffd640 1 -- 172.21.15.80:0/3723597632 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f36801f0e00 con 0x7f36800d0610 2024-04-25T08:56:21.920 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:21.931+0000 7f88a1c9a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T08:56:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.933+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd new", "uuid": "399ef7ed-a941-4160-bd42-80121fbe96d3", "id": 5} v 0) v1 -- 0x7f368004ef20 con 0x7f36800d0610 2024-04-25T08:56:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.936+0000 7f3676ffd640 1 -- 172.21.15.80:0/3723597632 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "399ef7ed-a941-4160-bd42-80121fbe96d3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36700039b0 con 0x7f36800d0610 2024-04-25T08:56:21.925 INFO:teuthology.orchestra.run.smithi080.stdout:5 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36800d0610 msgr2=0x7f368015ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36800d0610 0x7f368015ae50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f367000c400 tx=0x7f367000c800 comp rx=0 tx=0).stop 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 shutdown_connections 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368015c0f0 0x7f36801eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36800d0610 0x7f368015ae50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 --2- 172.21.15.80:0/3723597632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800b24b0 0x7f36801f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 >> 172.21.15.80:0/3723597632 conn(0x7f36800d1920 msgr2=0x7f36800c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 shutdown_connections 2024-04-25T08:56:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:21.937+0000 7f3688646640 1 -- 172.21.15.80:0/3723597632 wait complete. 2024-04-25T08:56:21.937 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new d674a70b-f7bd-4f94-8fb3-29b46bbc4746 6 2024-04-25T08:56:21.969 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:21.980+0000 7f91aef21040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T08:56:21.977 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:21.988+0000 7f88a1c9a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T08:56:22.027 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:22.037+0000 7f91aef21040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T08:56:22.032 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:22.043+0000 7f88a1c9a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T08:56:22.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.044+0000 7f720f370640 1 Processor -- start 2024-04-25T08:56:22.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.044+0000 7f720f370640 1 -- start start 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720f370640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72080cefe0 0x7f72080d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720f370640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f72080cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720f370640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720806e6b0 con 0x7f720815bcf0 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720f370640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720806f2c0 con 0x7f72080cefe0 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720f370640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720806e990 con 0x7f72080715d0 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720d10c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f720815bcf0 0x7f72080ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34012/0 (socket says 172.21.15.80:34012) 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720d10c640 1 -- 172.21.15.80:0/4122290264 learned_addr learned my addr 172.21.15.80:0/4122290264 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720d90d640 1 --2- 172.21.15.80:0/4122290264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f72080cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720c90b640 1 --2- 172.21.15.80:0/4122290264 >> v2:172.21.15.5:3300/0 conn(0x7f72080cefe0 0x7f72080d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f71fffff640 1 -- 172.21.15.80:0/4122290264 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209084390 0 0) 0x7f720806e6b0 con 0x7f720815bcf0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f71fffff640 1 -- 172.21.15.80:0/4122290264 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f4003520 con 0x7f720815bcf0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720d90d640 1 -- 172.21.15.80:0/4122290264 >> v2:172.21.15.5:3300/0 conn(0x7f72080cefe0 msgr2=0x7f72080d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720d90d640 1 --2- 172.21.15.80:0/4122290264 >> v2:172.21.15.5:3300/0 conn(0x7f72080cefe0 0x7f72080d0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720d90d640 1 -- 172.21.15.80:0/4122290264 >> v1:172.21.15.80:6789/0 conn(0x7f720815bcf0 legacy=0x7f72080ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.045+0000 7f720d90d640 1 -- 172.21.15.80:0/4122290264 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720806ec70 con 0x7f72080715d0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.046+0000 7f720d90d640 1 --2- 172.21.15.80:0/4122290264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f72080cc950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7200009d90 tx=0x7f720002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=becd944c5a52d485 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.046+0000 7f71fffff640 1 -- 172.21.15.80:0/4122290264 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200007740 con 0x7f72080715d0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.046+0000 7f71fffff640 1 -- 172.21.15.80:0/4122290264 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72000078e0 con 0x7f72080715d0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.046+0000 7f71fffff640 1 -- 172.21.15.80:0/4122290264 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200007cb0 con 0x7f72080715d0 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 -- 172.21.15.80:0/4122290264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 msgr2=0x7f72080cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 --2- 172.21.15.80:0/4122290264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f72080cc950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7200009d90 tx=0x7f720002a660 comp rx=0 tx=0).stop 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 -- 172.21.15.80:0/4122290264 shutdown_connections 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 --2- 172.21.15.80:0/4122290264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f72080cc950 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 --2- 172.21.15.80:0/4122290264 >> v2:172.21.15.5:3300/0 conn(0x7f72080cefe0 0x7f72080d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 -- 172.21.15.80:0/4122290264 >> 172.21.15.80:0/4122290264 conn(0x7f720806cc90 msgr2=0x7f720806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 -- 172.21.15.80:0/4122290264 shutdown_connections 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.047+0000 7f720f370640 1 -- 172.21.15.80:0/4122290264 wait complete. 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.048+0000 7f720f370640 1 Processor -- start 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.048+0000 7f720f370640 1 -- start start 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720f370640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f720814be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720f370640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080cefe0 0x7f7208148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720f370640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720815bcf0 0x7f7208146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720f370640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720815c0d0 con 0x7f72080cefe0 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720f370640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080ce1f0 con 0x7f720815bcf0 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720f370640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720806e110 con 0x7f72080715d0 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d10c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f720814be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720815bcf0 0x7f7208146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720815bcf0 0x7f7208146360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37880/0 (socket says 172.21.15.80:37880) 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 -- 172.21.15.80:0/3960717095 learned_addr learned my addr 172.21.15.80:0/3960717095 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720c90b640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080cefe0 0x7f7208148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 -- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 msgr2=0x7f720814be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f720814be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 -- 172.21.15.80:0/3960717095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080cefe0 msgr2=0x7f7208148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080cefe0 0x7f7208148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 -- 172.21.15.80:0/3960717095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080ad840 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d10c640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f720814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720d90d640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720815bcf0 0x7f7208146360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7200009eb0 tx=0x7f7200004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f71fdffb640 1 -- 172.21.15.80:0/3960717095 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200040070 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f71fdffb640 1 -- 172.21.15.80:0/3960717095 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7200031bc0 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f71fdffb640 1 -- 172.21.15.80:0/3960717095 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200009450 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.049+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72080adae0 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.050+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72080ae0a0 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.050+0000 7f71fdffb640 1 -- 172.21.15.80:0/3960717095 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7200039040 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.050+0000 7f71fdffb640 1 -- 172.21.15.80:0/3960717095 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7200045d60 con 0x7f720815bcf0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.051+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720804ef20 con 0x7f720815bcf0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.053+0000 7f71fdffb640 1 -- 172.21.15.80:0/3960717095 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7200007840 con 0x7f720815bcf0 2024-04-25T08:56:22.081 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:22.093+0000 7f91aef21040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T08:56:22.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.125+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d674a70b-f7bd-4f94-8fb3-29b46bbc4746", "id": 6} v 0) v1 -- 0x7f720815b270 con 0x7f720815bcf0 2024-04-25T08:56:22.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.128+0000 7f71fdffb640 1 -- 172.21.15.80:0/3960717095 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d674a70b-f7bd-4f94-8fb3-29b46bbc4746", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7200045460 con 0x7f720815bcf0 2024-04-25T08:56:22.118 INFO:teuthology.orchestra.run.smithi080.stdout:6 2024-04-25T08:56:22.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720815bcf0 msgr2=0x7f7208146360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720815bcf0 0x7f7208146360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7200009eb0 tx=0x7f7200004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:22.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 shutdown_connections 2024-04-25T08:56:22.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720815bcf0 0x7f7208146360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72080cefe0 0x7f7208148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 --2- 172.21.15.80:0/3960717095 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72080715d0 0x7f720814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 >> 172.21.15.80:0/3960717095 conn(0x7f720806cc90 msgr2=0x7f72080b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 shutdown_connections 2024-04-25T08:56:22.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.129+0000 7f720f370640 1 -- 172.21.15.80:0/3960717095 wait complete. 2024-04-25T08:56:22.129 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new b685a12f-237d-497f-b1b2-4b0dcf08a50d 7 2024-04-25T08:56:22.150 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:22.161+0000 7f88a1c9a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:56:22.198 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:22.210+0000 7f91aef21040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:56:22.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.257+0000 7f8142f5c640 1 Processor -- start 2024-04-25T08:56:22.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.257+0000 7f8142f5c640 1 -- start start 2024-04-25T08:56:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8142f5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c152b90 0x7f813c15f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8142f5c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f813c15fc30 0x7f813c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8142f5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f813c06abe0 0x7f813c066e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8142f5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c06b9d0 con 0x7f813c06abe0 2024-04-25T08:56:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8142f5c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c06b130 con 0x7f813c15fc30 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8142f5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c06b410 con 0x7f813c152b90 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c152b90 0x7f813c15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f813bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f813c15fc30 0x7f813c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c152b90 0x7f813c15f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:57610/0 (socket says 172.21.15.80:57610) 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f813bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f813c15fc30 0x7f813c0668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37884/0 (socket says 172.21.15.80:37884) 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 -- 172.21.15.80:0/557111303 learned_addr learned my addr 172.21.15.80:0/557111303 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f81414f9640 1 --2- 172.21.15.80:0/557111303 >> v2:172.21.15.5:3300/0 conn(0x7f813c06abe0 0x7f813c066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 -- 172.21.15.80:0/557111303 >> v2:172.21.15.80:3300/0 conn(0x7f813c15fc30 msgr2=0x7f813c0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 --2- 172.21.15.80:0/557111303 >> v2:172.21.15.80:3300/0 conn(0x7f813c15fc30 0x7f813c0668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 -- 172.21.15.80:0/557111303 >> v2:172.21.15.5:3300/0 conn(0x7f813c06abe0 msgr2=0x7f813c066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 --2- 172.21.15.80:0/557111303 >> v2:172.21.15.5:3300/0 conn(0x7f813c06abe0 0x7f813c066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f8140cf8640 1 -- 172.21.15.80:0/557111303 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c06b6f0 con 0x7f813c152b90 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.258+0000 7f81414f9640 1 --2- 172.21.15.80:0/557111303 >> v2:172.21.15.5:3300/0 conn(0x7f813c06abe0 0x7f813c066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.259+0000 7f8140cf8640 1 --2- 172.21.15.80:0/557111303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c152b90 0x7f813c15f6f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f813c06bc20 tx=0x7f813002a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4a5fbc727d7fa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.259+0000 7f813b7fe640 1 -- 172.21.15.80:0/557111303 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130037070 con 0x7f813c152b90 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.259+0000 7f813b7fe640 1 -- 172.21.15.80:0/557111303 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130032440 con 0x7f813c152b90 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.259+0000 7f813b7fe640 1 -- 172.21.15.80:0/557111303 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130032810 con 0x7f813c152b90 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 -- 172.21.15.80:0/557111303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c152b90 msgr2=0x7f813c15f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 --2- 172.21.15.80:0/557111303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c152b90 0x7f813c15f6f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f813c06bc20 tx=0x7f813002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 -- 172.21.15.80:0/557111303 shutdown_connections 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 --2- 172.21.15.80:0/557111303 >> v2:172.21.15.5:3300/0 conn(0x7f813c06abe0 0x7f813c066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 --2- 172.21.15.80:0/557111303 >> v2:172.21.15.80:3300/0 conn(0x7f813c15fc30 0x7f813c0668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 --2- 172.21.15.80:0/557111303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c152b90 0x7f813c15f6f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 -- 172.21.15.80:0/557111303 >> 172.21.15.80:0/557111303 conn(0x7f813c0b2560 msgr2=0x7f813c0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 -- 172.21.15.80:0/557111303 shutdown_connections 2024-04-25T08:56:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.260+0000 7f8142f5c640 1 -- 172.21.15.80:0/557111303 wait complete. 2024-04-25T08:56:22.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.261+0000 7f8142f5c640 1 Processor -- start 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.261+0000 7f8142f5c640 1 -- start start 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c06abe0 0x7f813c13b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f813c152b90 0x7f813c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c15fc30 0x7f813c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0d0640 con 0x7f813c152b90 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c152f70 con 0x7f813c06abe0 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0cd340 con 0x7f813c15fc30 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8140cf8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c06abe0 0x7f813c13b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81414f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c15fc30 0x7f813c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8140cf8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c06abe0 0x7f813c13b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37888/0 (socket says 172.21.15.80:37888) 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8140cf8640 1 -- 172.21.15.80:0/1672762199 learned_addr learned my addr 172.21.15.80:0/1672762199 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f813bfff640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f813c152b90 0x7f813c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81414f9640 1 -- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c06abe0 msgr2=0x7f813c13b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81414f9640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c06abe0 0x7f813c13b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81414f9640 1 -- 172.21.15.80:0/1672762199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f813c152b90 msgr2=0x7f813c0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81414f9640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f813c152b90 0x7f813c0b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81414f9640 1 -- 172.21.15.80:0/1672762199 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c13b840 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8140cf8640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c06abe0 0x7f813c13b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81414f9640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c15fc30 0x7f813c15e180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8134007db0 tx=0x7f813400d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81397fa640 1 -- 172.21.15.80:0/1672762199 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813401a070 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81397fa640 1 -- 172.21.15.80:0/1672762199 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8134015400 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c1f73c0 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f81397fa640 1 -- 172.21.15.80:0/1672762199 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340157b0 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.262+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c1f7980 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.263+0000 7f81397fa640 1 -- 172.21.15.80:0/1672762199 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f813401d070 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.263+0000 7f81397fa640 1 -- 172.21.15.80:0/1672762199 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f813401fad0 con 0x7f813c15fc30 2024-04-25T08:56:22.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.263+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c04ef20 con 0x7f813c15fc30 2024-04-25T08:56:22.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.265+0000 7f81397fa640 1 -- 172.21.15.80:0/1672762199 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f813c13b840 con 0x7f813c15fc30 2024-04-25T08:56:22.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.340+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b685a12f-237d-497f-b1b2-4b0dcf08a50d", "id": 7} v 0) v1 -- 0x7f813c15dc60 con 0x7f813c15fc30 2024-04-25T08:56:22.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.343+0000 7f81397fa640 1 -- 172.21.15.80:0/1672762199 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b685a12f-237d-497f-b1b2-4b0dcf08a50d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8134010070 con 0x7f813c15fc30 2024-04-25T08:56:22.333 INFO:teuthology.orchestra.run.smithi080.stdout:7 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c15fc30 msgr2=0x7f813c15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c15fc30 0x7f813c15e180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8134007db0 tx=0x7f813400d4a0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 shutdown_connections 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f813c15fc30 0x7f813c15e180 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f813c152b90 0x7f813c0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 --2- 172.21.15.80:0/1672762199 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c06abe0 0x7f813c13b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 >> 172.21.15.80:0/1672762199 conn(0x7f813c0b2560 msgr2=0x7f813c14b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 shutdown_connections 2024-04-25T08:56:22.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T08:56:22.344+0000 7f8142f5c640 1 -- 172.21.15.80:0/1672762199 wait complete. 2024-04-25T08:56:22.344 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T08:56:22.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T08:56:22.347 INFO:tasks.ceph.osd.0:Started 2024-04-25T08:56:22.347 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T08:56:22.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T08:56:22.349 INFO:tasks.ceph.osd.1:Started 2024-04-25T08:56:22.349 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T08:56:22.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T08:56:22.351 INFO:tasks.ceph.osd.2:Started 2024-04-25T08:56:22.351 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T08:56:22.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T08:56:22.353 INFO:tasks.ceph.osd.3:Started 2024-04-25T08:56:22.353 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T08:56:22.354 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T08:56:22.355 INFO:tasks.ceph.osd.4:Started 2024-04-25T08:56:22.356 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T08:56:22.356 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T08:56:22.357 INFO:tasks.ceph.osd.5:Started 2024-04-25T08:56:22.358 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T08:56:22.358 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T08:56:22.360 INFO:tasks.ceph.osd.6:Started 2024-04-25T08:56:22.360 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T08:56:22.360 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T08:56:22.362 INFO:tasks.ceph.osd.7:Started 2024-04-25T08:56:22.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.494+0000 7f91806b3640 1 Processor -- start 2024-04-25T08:56:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.494+0000 7f91806b3640 1 -- start start 2024-04-25T08:56:22.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f91806b3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91780b0a50 0x7f91780ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f91806b3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91780cbf40 0x7f91780ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f91806b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917806ba50 con 0x7f91780b0e30 2024-04-25T08:56:22.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f91806b3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917806b800 con 0x7f91780b0a50 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f91806b3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917806bd30 con 0x7f91780cbf40 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917e44f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91780b0a50 0x7f91780ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917e44f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91780b0a50 0x7f91780ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44826/0 (socket says 172.21.15.5:44826) 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917e44f640 1 -- 172.21.15.5:0/3174989546 learned_addr learned my addr 172.21.15.5:0/3174989546 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917ec50640 1 --2- 172.21.15.5:0/3174989546 >> v2:172.21.15.80:3300/0 conn(0x7f91780cbf40 0x7f91780ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917ec50640 1 -- 172.21.15.5:0/3174989546 >> v2:172.21.15.5:3300/0 conn(0x7f91780b0a50 msgr2=0x7f91780ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917ec50640 1 --2- 172.21.15.5:0/3174989546 >> v2:172.21.15.5:3300/0 conn(0x7f91780b0a50 0x7f91780ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917ec50640 1 -- 172.21.15.5:0/3174989546 >> v1:172.21.15.80:6789/0 conn(0x7f91780b0e30 legacy=0x7f91780d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917ec50640 1 -- 172.21.15.5:0/3174989546 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917806c010 con 0x7f91780cbf40 2024-04-25T08:56:22.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.495+0000 7f917e44f640 1 --2- 172.21.15.5:0/3174989546 >> v2:172.21.15.5:3300/0 conn(0x7f91780b0a50 0x7f91780ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.496+0000 7f917ec50640 1 --2- 172.21.15.5:0/3174989546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780cbf40 0x7f91780ce740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91780cf8d0 tx=0x7f917002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e77e473c8911f17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.496+0000 7f917d44d640 1 -- 172.21.15.5:0/3174989546 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170007740 con 0x7f91780cbf40 2024-04-25T08:56:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.496+0000 7f917d44d640 1 -- 172.21.15.5:0/3174989546 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91700078e0 con 0x7f91780cbf40 2024-04-25T08:56:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.496+0000 7f917d44d640 1 -- 172.21.15.5:0/3174989546 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170007cb0 con 0x7f91780cbf40 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 -- 172.21.15.5:0/3174989546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780cbf40 msgr2=0x7f91780ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 --2- 172.21.15.5:0/3174989546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780cbf40 0x7f91780ce740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91780cf8d0 tx=0x7f917002a5f0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 -- 172.21.15.5:0/3174989546 shutdown_connections 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 --2- 172.21.15.5:0/3174989546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780cbf40 0x7f91780ce740 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 --2- 172.21.15.5:0/3174989546 >> v2:172.21.15.5:3300/0 conn(0x7f91780b0a50 0x7f91780ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 -- 172.21.15.5:0/3174989546 >> 172.21.15.5:0/3174989546 conn(0x7f91780d18f0 msgr2=0x7f91780d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 -- 172.21.15.5:0/3174989546 shutdown_connections 2024-04-25T08:56:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.497+0000 7f91806b3640 1 -- 172.21.15.5:0/3174989546 wait complete. 2024-04-25T08:56:22.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.498+0000 7f91806b3640 1 Processor -- start 2024-04-25T08:56:22.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.498+0000 7f91806b3640 1 -- start start 2024-04-25T08:56:22.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f91806b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f91780b0a50 0x7f917815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f91806b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780b0e30 0x7f91780ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f91806b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91780cbf40 0x7f917814e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f91806b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780b2bf0 con 0x7f91780cbf40 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f91806b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780cfd60 con 0x7f91780b0e30 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f91806b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917815eb50 con 0x7f91780b0a50 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91780cbf40 0x7f917814e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917e44f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f91780b0a50 0x7f917815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91780cbf40 0x7f917814e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44836/0 (socket says 172.21.15.5:44836) 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 -- 172.21.15.5:0/1153440184 learned_addr learned my addr 172.21.15.5:0/1153440184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917dc4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780b0e30 0x7f91780ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 -- 172.21.15.5:0/1153440184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f91780b0a50 msgr2=0x7f917815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 --2- 172.21.15.5:0/1153440184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f91780b0a50 0x7f917815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 -- 172.21.15.5:0/1153440184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780b0e30 msgr2=0x7f91780ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 --2- 172.21.15.5:0/1153440184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780b0e30 0x7f91780ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.499+0000 7f917ec50640 1 -- 172.21.15.5:0/1153440184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917815edd0 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f917ec50640 1 --2- 172.21.15.5:0/1153440184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91780cbf40 0x7f917814e850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9170009e50 tx=0x7f9170004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f916effd640 1 -- 172.21.15.5:0/1153440184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917003f070 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f916effd640 1 -- 172.21.15.5:0/1153440184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170031bf0 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f916effd640 1 -- 172.21.15.5:0/1153440184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170009450 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917815f0b0 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917815f670 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f916effd640 1 -- 172.21.15.5:0/1153440184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9170044460 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.500+0000 7f916effd640 1 -- 172.21.15.5:0/1153440184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9170007840 con 0x7f91780cbf40 2024-04-25T08:56:22.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.501+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917806cd70 con 0x7f91780cbf40 2024-04-25T08:56:22.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.503+0000 7f916effd640 1 -- 172.21.15.5:0/1153440184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f917003b410 con 0x7f91780cbf40 2024-04-25T08:56:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.566+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9178161850 con 0x7f91780cbf40 2024-04-25T08:56:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f916effd640 1 -- 172.21.15.5:0/1153440184 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f917003b9a0 con 0x7f91780cbf40 2024-04-25T08:56:22.556 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:22.556 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:22.341737+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91780cbf40 msgr2=0x7f917814e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f91806b3640 1 --2- 172.21.15.5:0/1153440184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91780cbf40 0x7f917814e850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9170009e50 tx=0x7f9170004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 shutdown_connections 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f91806b3640 1 --2- 172.21.15.5:0/1153440184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91780cbf40 0x7f917814e850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f91806b3640 1 --2- 172.21.15.5:0/1153440184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91780b0e30 0x7f91780ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f91806b3640 1 --2- 172.21.15.5:0/1153440184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f91780b0a50 0x7f917815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.567+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 >> 172.21.15.5:0/1153440184 conn(0x7f91780d18f0 msgr2=0x7f9178068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.568+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 shutdown_connections 2024-04-25T08:56:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:22.568+0000 7f91806b3640 1 -- 172.21.15.5:0/1153440184 wait complete. 2024-04-25T08:56:22.558 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:22.568+0000 7f88a1c9a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T08:56:22.567 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T08:56:22.567 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T08:56:22.638 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:22.649+0000 7f91aef21040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T08:56:22.813 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:22.823+0000 7f88a1c9a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T08:56:22.864 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:22.874+0000 7f88a1c9a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T08:56:22.908 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:22.920+0000 7f91aef21040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T08:56:22.956 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-04-25T08:56:22.966+0000 7f3eb92dd640 -1 Falling back to public interface 2024-04-25T08:56:22.956 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-04-25T08:56:22.967+0000 7fae2591d640 -1 Falling back to public interface 2024-04-25T08:56:22.958 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-25T08:56:22.969+0000 7faed1c12640 -1 Falling back to public interface 2024-04-25T08:56:22.963 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:22.975+0000 7f91aef21040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T08:56:22.975 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-04-25T08:56:22.985+0000 7f2571418640 -1 Falling back to public interface 2024-04-25T08:56:22.978 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-25T08:56:22.990+0000 7f131ae15640 -1 Falling back to public interface 2024-04-25T08:56:22.979 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-04-25T08:56:22.989+0000 7eff57423640 -1 Falling back to public interface 2024-04-25T08:56:22.980 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-25T08:56:22.991+0000 7f3f163fc640 -1 Falling back to public interface 2024-04-25T08:56:22.983 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-25T08:56:22.994+0000 7fa639bdc640 -1 Falling back to public interface 2024-04-25T08:56:22.983 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:22.994+0000 7f88a1c9a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T08:56:23.090 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.101+0000 7f91aef21040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T08:56:23.263 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:23.273+0000 7f88a1c9a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T08:56:23.312 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:23.322+0000 7f88a1c9a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T08:56:23.373 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:23.385 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.397+0000 7f91aef21040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T08:56:23.437 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.448+0000 7f91aef21040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T08:56:23.466 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.477+0000 7f788296a640 1 Processor -- start 2024-04-25T08:56:23.466 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.477+0000 7f788296a640 1 -- start start 2024-04-25T08:56:23.467 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:23.477+0000 7f88a1c9a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T08:56:23.468 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f788296a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f787c15bc50 0x7f787c0d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f788296a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f787c1602b0 0x7f787c0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f788296a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0cf740 con 0x7f787c15f6a0 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f788296a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c0cf400 con 0x7f787c15bc50 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f788296a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c0d0a00 con 0x7f787c1602b0 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f787bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f787c15bc50 0x7f787c0d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f787bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f787c15bc50 0x7f787c0d04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44838/0 (socket says 172.21.15.5:44838) 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f787bfff640 1 -- 172.21.15.5:0/3956413388 learned_addr learned my addr 172.21.15.5:0/3956413388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.478+0000 7f787b7fe640 1 --2- 172.21.15.5:0/3956413388 >> v2:172.21.15.80:3300/0 conn(0x7f787c1602b0 0x7f787c0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.479+0000 7f787bfff640 1 -- 172.21.15.5:0/3956413388 >> v2:172.21.15.80:3300/0 conn(0x7f787c1602b0 msgr2=0x7f787c0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.479+0000 7f787bfff640 1 --2- 172.21.15.5:0/3956413388 >> v2:172.21.15.80:3300/0 conn(0x7f787c1602b0 0x7f787c0cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.479+0000 7f787bfff640 1 -- 172.21.15.5:0/3956413388 >> v1:172.21.15.80:6789/0 conn(0x7f787c15f6a0 legacy=0x7f787c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.479+0000 7f787bfff640 1 -- 172.21.15.5:0/3956413388 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0cf9e0 con 0x7f787c15bc50 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.480+0000 7f787bfff640 1 --2- 172.21.15.5:0/3956413388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15bc50 0x7f787c0d04c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f787c070ca0 tx=0x7f787002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c020e8c160a1605a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:23.469 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.480+0000 7f787affd640 1 -- 172.21.15.5:0/3956413388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870037070 con 0x7f787c15bc50 2024-04-25T08:56:23.470 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.480+0000 7f787affd640 1 -- 172.21.15.5:0/3956413388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7870032440 con 0x7f787c15bc50 2024-04-25T08:56:23.470 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.480+0000 7f787affd640 1 -- 172.21.15.5:0/3956413388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870032810 con 0x7f787c15bc50 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.480+0000 7f788296a640 1 -- 172.21.15.5:0/3956413388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15bc50 msgr2=0x7f787c0d04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.480+0000 7f788296a640 1 --2- 172.21.15.5:0/3956413388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15bc50 0x7f787c0d04c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f787c070ca0 tx=0x7f787002a270 comp rx=0 tx=0).stop 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.481+0000 7f788296a640 1 -- 172.21.15.5:0/3956413388 shutdown_connections 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.481+0000 7f788296a640 1 --2- 172.21.15.5:0/3956413388 >> v2:172.21.15.80:3300/0 conn(0x7f787c1602b0 0x7f787c0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.481+0000 7f788296a640 1 --2- 172.21.15.5:0/3956413388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15bc50 0x7f787c0d04c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.481+0000 7f788296a640 1 -- 172.21.15.5:0/3956413388 >> 172.21.15.5:0/3956413388 conn(0x7f787c0b3520 msgr2=0x7f787c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.481+0000 7f788296a640 1 -- 172.21.15.5:0/3956413388 shutdown_connections 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.481+0000 7f788296a640 1 -- 172.21.15.5:0/3956413388 wait complete. 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.482+0000 7f788296a640 1 Processor -- start 2024-04-25T08:56:23.471 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.482+0000 7f788296a640 1 -- start start 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f788296a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f787c15bc50 0x7f787c156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f788296a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15f6a0 0x7f787c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f788296a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f787c1602b0 0x7f787c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f788296a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0cefa0 con 0x7f787c15f6a0 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f788296a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0cffa0 con 0x7f787c1602b0 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f788296a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0cf120 con 0x7f787c15bc50 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15f6a0 0x7f787c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:23.474 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15f6a0 0x7f787c0cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44844/0 (socket says 172.21.15.5:44844) 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 -- 172.21.15.5:0/1094501650 learned_addr learned my addr 172.21.15.5:0/1094501650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787bfff640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f787c15bc50 0x7f787c156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f7880f07640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f787c1602b0 0x7f787c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 -- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f787c15bc50 msgr2=0x7f787c156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f787c15bc50 0x7f787c156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 -- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f787c1602b0 msgr2=0x7f787c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f787c1602b0 0x7f787c1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 -- 172.21.15.5:0/1094501650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0cb430 con 0x7f787c15f6a0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f787b7fe640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15f6a0 0x7f787c0cada0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e9b0 tx=0x7f786c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f7878ff9640 1 -- 172.21.15.5:0/1094501650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c017070 con 0x7f787c15f6a0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f7878ff9640 1 -- 172.21.15.5:0/1094501650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00c9a0 con 0x7f787c15f6a0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c0cb710 con 0x7f787c15f6a0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.483+0000 7f7878ff9640 1 -- 172.21.15.5:0/1094501650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00cd90 con 0x7f787c15f6a0 2024-04-25T08:56:23.475 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.484+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c1f6f90 con 0x7f787c15f6a0 2024-04-25T08:56:23.476 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.484+0000 7f7878ff9640 1 -- 172.21.15.5:0/1094501650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f786c01a070 con 0x7f787c15f6a0 2024-04-25T08:56:23.476 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.484+0000 7f7878ff9640 1 -- 172.21.15.5:0/1094501650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f786c01cc60 con 0x7f787c15f6a0 2024-04-25T08:56:23.476 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.484+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c15b4b0 con 0x7f787c15f6a0 2024-04-25T08:56:23.476 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.487+0000 7f7878ff9640 1 -- 172.21.15.5:0/1094501650 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f787c15b4b0 con 0x7f787c15f6a0 2024-04-25T08:56:23.538 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.549+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f787c04ef20 con 0x7f787c15f6a0 2024-04-25T08:56:23.539 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.549+0000 7f7878ff9640 1 -- 172.21.15.5:0/1094501650 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f786c01c650 con 0x7f787c15f6a0 2024-04-25T08:56:23.540 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-25T08:56:23.540 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:22.341737+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:23.541 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15f6a0 msgr2=0x7f787c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15f6a0 0x7f787c0cada0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e9b0 tx=0x7f786c00ee70 comp rx=0 tx=0).stop 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 shutdown_connections 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f787c1602b0 0x7f787c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f787c15f6a0 0x7f787c0cada0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 --2- 172.21.15.5:0/1094501650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f787c15bc50 0x7f787c156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 >> 172.21.15.5:0/1094501650 conn(0x7f787c0b3520 msgr2=0x7f787c06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 shutdown_connections 2024-04-25T08:56:23.542 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:23.550+0000 7f788296a640 1 -- 172.21.15.5:0/1094501650 wait complete. 2024-04-25T08:56:23.549 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T08:56:23.605 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:23.615+0000 7f88a1c9a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T08:56:23.605 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.616+0000 7f91aef21040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T08:56:23.654 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:23.664+0000 7f88a1c9a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T08:56:23.723 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:23.733+0000 7f88a1c9a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T08:56:23.749 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.760+0000 7f91aef21040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T08:56:23.769 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:23.780+0000 7f88a1c9a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T08:56:23.801 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.813+0000 7f91aef21040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T08:56:23.875 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.886+0000 7f91aef21040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T08:56:23.923 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:23.934+0000 7f91aef21040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T08:56:24.245 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:24.255+0000 7f88a1c9a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T08:56:24.362 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:24.372+0000 7f88a1c9a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T08:56:24.426 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:24.437+0000 7f91aef21040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T08:56:24.546 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-25T08:56:24.557+0000 7f91aef21040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T08:56:25.377 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:25.388+0000 7f8843114640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T08:56:25.378 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-04-25T08:56:25.388+0000 7f8843114640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T08:56:26.425 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-25T08:56:26.435+0000 7f131ae15640 -1 osd.3 0 log_to_monitors true 2024-04-25T08:56:26.455 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-04-25T08:56:26.466+0000 7f3eb92dd640 -1 osd.7 0 log_to_monitors true 2024-04-25T08:56:26.462 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-04-25T08:56:26.472+0000 7fae2591d640 -1 osd.6 0 log_to_monitors true 2024-04-25T08:56:26.484 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-25T08:56:26.494+0000 7faed1c12640 -1 osd.0 0 log_to_monitors true 2024-04-25T08:56:26.484 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-25T08:56:26.494+0000 7f3f163fc640 -1 osd.1 0 log_to_monitors true 2024-04-25T08:56:26.494 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-04-25T08:56:26.505+0000 7f2571418640 -1 osd.4 0 log_to_monitors true 2024-04-25T08:56:26.500 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-25T08:56:26.510+0000 7fa639bdc640 -1 osd.2 0 log_to_monitors true 2024-04-25T08:56:26.510 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-04-25T08:56:26.521+0000 7eff57423640 -1 osd.5 0 log_to_monitors true 2024-04-25T08:56:29.858 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-25T08:56:29.868+0000 7faece637640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T08:56:29.871 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-25T08:56:29.882+0000 7faec5431640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:29.886 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-25T08:56:29.897+0000 7f3f11b6f640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T08:56:29.897 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-25T08:56:29.908+0000 7f3f0a1a1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:29.920 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-25T08:56:29.931+0000 7f1315f09640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T08:56:29.923 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-25T08:56:29.933+0000 7fa63534f640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T08:56:29.942 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-25T08:56:29.953+0000 7fa62d981640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:29.943 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-25T08:56:29.953+0000 7f130e53b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:30.358 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:30.456 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.466+0000 7f1bb1aee640 1 Processor -- start 2024-04-25T08:56:30.456 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.466+0000 7f1bb1aee640 1 -- start start 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.467+0000 7f1bb1aee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bac0b94e0 0x7f1bac0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.467+0000 7f1bb1aee640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac1626f0 con 0x7f1bac15dcb0 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.467+0000 7f1bb1aee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac162130 con 0x7f1bac0ced40 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.467+0000 7f1bb1aee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bac161f10 con 0x7f1bac0b94e0 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.467+0000 7f1bab7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1bac15dcb0 0x7f1bac161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57380/0 (socket says 172.21.15.5:57380) 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.467+0000 7f1bab7fe640 1 -- 172.21.15.5:0/2267675360 learned_addr learned my addr 172.21.15.5:0/2267675360 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.467+0000 7f1baaffd640 1 --2- 172.21.15.5:0/2267675360 >> v2:172.21.15.80:3300/0 conn(0x7f1bac0b94e0 0x7f1bac0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.468+0000 7f1baa7fc640 1 -- 172.21.15.5:0/2267675360 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961657867 0 0) 0x7f1bac1626f0 con 0x7f1bac15dcb0 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.468+0000 7f1baa7fc640 1 -- 172.21.15.5:0/2267675360 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b94003520 con 0x7f1bac15dcb0 2024-04-25T08:56:30.458 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.468+0000 7f1baa7fc640 1 -- 172.21.15.5:0/2267675360 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1391265971 0 0) 0x7f1b94003520 con 0x7f1bac15dcb0 2024-04-25T08:56:30.459 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.468+0000 7f1baaffd640 1 -- 172.21.15.5:0/2267675360 >> v1:172.21.15.80:6789/0 conn(0x7f1bac0ced40 legacy=0x7f1bac0d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:30.459 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.468+0000 7f1baaffd640 1 -- 172.21.15.5:0/2267675360 >> v1:172.21.15.5:6789/0 conn(0x7f1bac15dcb0 legacy=0x7f1bac161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:30.459 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.468+0000 7f1baaffd640 1 -- 172.21.15.5:0/2267675360 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac162410 con 0x7f1bac0b94e0 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1baaffd640 1 --2- 172.21.15.5:0/2267675360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0ce800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00097a0 tx=0x7f1ba002a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34df0b18eb27b9c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1baa7fc640 1 -- 172.21.15.5:0/2267675360 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0037070 con 0x7f1bac0b94e0 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1baa7fc640 1 -- 172.21.15.5:0/2267675360 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba002ab30 con 0x7f1bac0b94e0 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1baa7fc640 1 -- 172.21.15.5:0/2267675360 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c001670 con 0x7f1bac0b94e0 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2267675360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0b94e0 msgr2=0x7f1bac0ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2267675360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0ce800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00097a0 tx=0x7f1ba002a0a0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2267675360 shutdown_connections 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2267675360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0ce800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2267675360 >> 172.21.15.5:0/2267675360 conn(0x7f1bac0668f0 msgr2=0x7f1bac066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:30.460 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2267675360 shutdown_connections 2024-04-25T08:56:30.461 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.469+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2267675360 wait complete. 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.471+0000 7f1bb1aee640 1 Processor -- start 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.471+0000 7f1bb1aee640 1 -- start start 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.471+0000 7f1bb1aee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bb1aee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0ced40 0x7f1bac160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bb1aee640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1bac15dcb0 0x7f1bac14b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bb1aee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0d1f30 con 0x7f1bac0b94e0 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bb1aee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0cf1b0 con 0x7f1bac0ced40 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bb1aee640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac15e090 con 0x7f1bac15dcb0 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44890/0 (socket says 172.21.15.5:44890) 2024-04-25T08:56:30.463 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 -- 172.21.15.5:0/2011876100 learned_addr learned my addr 172.21.15.5:0/2011876100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1baaffd640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0ced40 0x7f1bac160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1babfff640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1bac15dcb0 0x7f1bac14b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 -- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1bac15dcb0 msgr2=0x7f1bac14b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1bac15dcb0 0x7f1bac14b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 -- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0ced40 msgr2=0x7f1bac160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0ced40 0x7f1bac160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 -- 172.21.15.5:0/2011876100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0b3c70 con 0x7f1bac0b94e0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bab7fe640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0cd330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c580 tx=0x7f1b9c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1b93fff640 1 -- 172.21.15.5:0/2011876100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c017070 con 0x7f1bac0b94e0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1b93fff640 1 -- 172.21.15.5:0/2011876100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c005ce0 con 0x7f1bac0b94e0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac0cba80 con 0x7f1bac0b94e0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1b93fff640 1 -- 172.21.15.5:0/2011876100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c007330 con 0x7f1bac0b94e0 2024-04-25T08:56:30.464 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.472+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac0cc040 con 0x7f1bac0b94e0 2024-04-25T08:56:30.465 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.473+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bac04ef20 con 0x7f1bac0b94e0 2024-04-25T08:56:30.465 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.474+0000 7f1b93fff640 1 -- 172.21.15.5:0/2011876100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f1b9c01a070 con 0x7f1bac0b94e0 2024-04-25T08:56:30.465 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.474+0000 7f1b93fff640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b9806b470 0x7f1b9806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:30.465 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.474+0000 7f1b93fff640 1 -- 172.21.15.5:0/2011876100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f1b9c0887c0 con 0x7f1bac0b94e0 2024-04-25T08:56:30.466 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.474+0000 7f1baaffd640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b9806b470 0x7f1b9806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:30.466 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.475+0000 7f1baaffd640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b9806b470 0x7f1b9806d930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0034000 tx=0x7f1ba002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:30.468 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.479+0000 7f1b93fff640 1 -- 172.21.15.5:0/2011876100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b9c057e70 con 0x7f1bac0b94e0 2024-04-25T08:56:30.492 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-04-25T08:56:30.502+0000 7fae21090640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T08:56:30.502 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-04-25T08:56:30.513+0000 7fae196c2640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:30.511 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-04-25T08:56:30.522+0000 7eff52b96640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T08:56:30.516 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-04-25T08:56:30.526+0000 7f3eb4a50640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T08:56:30.530 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-04-25T08:56:30.541+0000 7eff4b1c8640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:30.531 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-04-25T08:56:30.542+0000 7f3ead082640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:30.540 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-04-25T08:56:30.551+0000 7f256c636640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T08:56:30.551 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-04-25T08:56:30.562+0000 7f2564c68640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:56:30.652 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.662+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bac0d1760 con 0x7f1bac0b94e0 2024-04-25T08:56:30.653 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.663+0000 7f1b93fff640 1 -- 172.21.15.5:0/2011876100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f1b9c05bf10 con 0x7f1bac0b94e0 2024-04-25T08:56:30.653 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-25T08:56:30.653 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":12,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:28.393109+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:30.655 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b9806b470 msgr2=0x7f1b9806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:30.655 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b9806b470 0x7f1b9806d930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0034000 tx=0x7f1ba002e000 comp rx=0 tx=0).stop 2024-04-25T08:56:30.655 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac0b94e0 msgr2=0x7f1bac0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0cd330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c580 tx=0x7f1b9c00ca40 comp rx=0 tx=0).stop 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 shutdown_connections 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b9806b470 0x7f1b9806d930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1bac15dcb0 0x7f1bac14b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bac0ced40 0x7f1bac160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 --2- 172.21.15.5:0/2011876100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac0b94e0 0x7f1bac0cd330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 >> 172.21.15.5:0/2011876100 conn(0x7f1bac0668f0 msgr2=0x7f1bac0b8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 shutdown_connections 2024-04-25T08:56:30.656 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:30.665+0000 7f1bb1aee640 1 -- 172.21.15.5:0/2011876100 wait complete. 2024-04-25T08:56:30.665 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T08:56:37.472 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:37.576 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.586+0000 7f08db3c8640 1 Processor -- start 2024-04-25T08:56:37.576 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.586+0000 7f08db3c8640 1 -- start start 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.587+0000 7f08db3c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d40d09a0 0x7f08d40b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.587+0000 7f08db3c8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d40d0e10 con 0x7f08d40d04f0 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.587+0000 7f08db3c8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d40d28f0 con 0x7f08d415df50 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.587+0000 7f08db3c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d415e330 con 0x7f08d40d09a0 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.587+0000 7f08d8963640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08d40d04f0 0x7f08d40b6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58230/0 (socket says 172.21.15.5:58230) 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.587+0000 7f08d8963640 1 -- 172.21.15.5:0/1932682992 learned_addr learned my addr 172.21.15.5:0/1932682992 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.587+0000 7f08d9965640 1 --2- 172.21.15.5:0/1932682992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d40d09a0 0x7f08d40b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.588+0000 7f08cbfff640 1 -- 172.21.15.5:0/1932682992 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065352953 0 0) 0x7f08d40d0e10 con 0x7f08d40d04f0 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.588+0000 7f08cbfff640 1 -- 172.21.15.5:0/1932682992 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c0003520 con 0x7f08d40d04f0 2024-04-25T08:56:37.578 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.588+0000 7f08cbfff640 1 -- 172.21.15.5:0/1932682992 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004496601 0 0) 0x7f08d40d28f0 con 0x7f08d415df50 2024-04-25T08:56:37.579 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.588+0000 7f08cbfff640 1 -- 172.21.15.5:0/1932682992 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d40d0e10 con 0x7f08d415df50 2024-04-25T08:56:37.579 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.588+0000 7f08d9965640 1 -- 172.21.15.5:0/1932682992 >> v1:172.21.15.80:6789/0 conn(0x7f08d415df50 legacy=0x7f08d40d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.579 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.588+0000 7f08d9965640 1 -- 172.21.15.5:0/1932682992 >> v1:172.21.15.5:6789/0 conn(0x7f08d40d04f0 legacy=0x7f08d40b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.579 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.588+0000 7f08d9965640 1 -- 172.21.15.5:0/1932682992 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40d2bd0 con 0x7f08d40d09a0 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08d9965640 1 --2- 172.21.15.5:0/1932682992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d40d09a0 0x7f08d40b7480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009dc0 tx=0x7f08cc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464a8576f3d7c819 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08cbfff640 1 -- 172.21.15.5:0/1932682992 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc007740 con 0x7f08d40d09a0 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08cbfff640 1 -- 172.21.15.5:0/1932682992 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc0078e0 con 0x7f08d40d09a0 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08cbfff640 1 -- 172.21.15.5:0/1932682992 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc007cb0 con 0x7f08d40d09a0 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08db3c8640 1 -- 172.21.15.5:0/1932682992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d40d09a0 msgr2=0x7f08d40b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08db3c8640 1 --2- 172.21.15.5:0/1932682992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d40d09a0 0x7f08d40b7480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009dc0 tx=0x7f08cc02a6d0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08db3c8640 1 -- 172.21.15.5:0/1932682992 shutdown_connections 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08db3c8640 1 --2- 172.21.15.5:0/1932682992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d40d09a0 0x7f08d40b7480 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08db3c8640 1 -- 172.21.15.5:0/1932682992 >> 172.21.15.5:0/1932682992 conn(0x7f08d40717e0 msgr2=0x7f08d40668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:37.580 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08db3c8640 1 -- 172.21.15.5:0/1932682992 shutdown_connections 2024-04-25T08:56:37.581 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.589+0000 7f08db3c8640 1 -- 172.21.15.5:0/1932682992 wait complete. 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 Processor -- start 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 -- start start 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d40d04f0 0x7f08d40cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d09a0 0x7f08d4149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d415df50 0x7f08d414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40d3190 con 0x7f08d40d04f0 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40d2690 con 0x7f08d40d09a0 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.591+0000 7f08db3c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40d3470 con 0x7f08d415df50 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d40d04f0 0x7f08d40cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d40d04f0 0x7f08d40cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42764/0 (socket says 172.21.15.5:42764) 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 -- 172.21.15.5:0/724537142 learned_addr learned my addr 172.21.15.5:0/724537142 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9965640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d415df50 0x7f08d414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d8963640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d09a0 0x7f08d4149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.583 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 -- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d415df50 msgr2=0x7f08d414c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d415df50 0x7f08d414c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 -- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d09a0 msgr2=0x7f08d4149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d09a0 0x7f08d4149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 -- 172.21.15.5:0/724537142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d414cd40 con 0x7f08d40d04f0 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d8963640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d09a0 0x7f08d4149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08d9164640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d40d04f0 0x7f08d40cacc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c430 tx=0x7f08d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08c9ffb640 1 -- 172.21.15.5:0/724537142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0017070 con 0x7f08d40d04f0 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08c9ffb640 1 -- 172.21.15.5:0/724537142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d00052f0 con 0x7f08d40d04f0 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08c9ffb640 1 -- 172.21.15.5:0/724537142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0003830 con 0x7f08d40d04f0 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.592+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d40b6090 con 0x7f08d40d04f0 2024-04-25T08:56:37.584 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.593+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d40cc980 con 0x7f08d40d04f0 2024-04-25T08:56:37.585 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.593+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d404ef20 con 0x7f08d40d04f0 2024-04-25T08:56:37.585 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.594+0000 7f08c9ffb640 1 -- 172.21.15.5:0/724537142 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08d001a070 con 0x7f08d40d04f0 2024-04-25T08:56:37.586 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.594+0000 7f08c9ffb640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b806b4d0 0x7f08b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.586 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.594+0000 7f08c9ffb640 1 -- 172.21.15.5:0/724537142 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f08d0089350 con 0x7f08d40d04f0 2024-04-25T08:56:37.586 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.594+0000 7f08d8963640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b806b4d0 0x7f08b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.586 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.595+0000 7f08d8963640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b806b4d0 0x7f08b806d990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08d41f6d90 tx=0x7f08c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:37.588 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.599+0000 7f08c9ffb640 1 -- 172.21.15.5:0/724537142 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08d414cd40 con 0x7f08d40d04f0 2024-04-25T08:56:37.769 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.780+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08d40b7d80 con 0x7f08d40d04f0 2024-04-25T08:56:37.770 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.781+0000 7f08c9ffb640 1 -- 172.21.15.5:0/724537142 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12800 (secure 0 0 0) 0x7f08d0058480 con 0x7f08d40d04f0 2024-04-25T08:56:37.770 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-25T08:56:37.771 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":16,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:34.512535+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:37.773 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b806b4d0 msgr2=0x7f08b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.773 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b806b4d0 0x7f08b806d990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08d41f6d90 tx=0x7f08c4009040 comp rx=0 tx=0).stop 2024-04-25T08:56:37.773 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d40d04f0 msgr2=0x7f08d40cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.773 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d40d04f0 0x7f08d40cacc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c430 tx=0x7f08d000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.773 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 shutdown_connections 2024-04-25T08:56:37.773 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b806b4d0 0x7f08b806d990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.773 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d415df50 0x7f08d414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.774 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d09a0 0x7f08d4149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.774 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 --2- 172.21.15.5:0/724537142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d40d04f0 0x7f08d40cacc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.774 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 >> 172.21.15.5:0/724537142 conn(0x7f08d40717e0 msgr2=0x7f08d40b86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:37.774 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 shutdown_connections 2024-04-25T08:56:37.774 INFO:teuthology.misc.health.smithi005.stderr:2024-04-25T08:56:37.783+0000 7f08db3c8640 1 -- 172.21.15.5:0/724537142 wait complete. 2024-04-25T08:56:37.783 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T08:56:37.783 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T08:56:37.783 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:56:37.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:56:37.785 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:56:37.785 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:56:37.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:56:37.787 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:56:37.788 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:56:37.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:56:37.790 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:56:37.791 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:56:37.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:56:37.796 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:56:37.796 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T08:56:37.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:37.861 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T08:56:37.862 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T08:56:37.877 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T08:56:37.878 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T08:56:37.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.913+0000 7f62810e1640 1 Processor -- start 2024-04-25T08:56:37.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.913+0000 7f62810e1640 1 -- start start 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.914+0000 7f62810e1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f627c15def0 0x7f627c0d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.914+0000 7f62810e1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0d2550 con 0x7f627c0d0400 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.914+0000 7f62810e1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0d2830 con 0x7f627c0b94c0 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.914+0000 7f62810e1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c15e2d0 con 0x7f627c15def0 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.914+0000 7f627b59e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f627c0d0400 0x7f627c0d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58242/0 (socket says 172.21.15.5:58242) 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.914+0000 7f627b59e640 1 -- 172.21.15.5:0/3618155433 learned_addr learned my addr 172.21.15.5:0/3618155433 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.914+0000 7f627ad9d640 1 --2- 172.21.15.5:0/3618155433 >> v2:172.21.15.80:3300/0 conn(0x7f627c15def0 0x7f627c0d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.915+0000 7f6279d9b640 1 -- 172.21.15.5:0/3618155433 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640103363 0 0) 0x7f627c0d2550 con 0x7f627c0d0400 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.915+0000 7f6279d9b640 1 -- 172.21.15.5:0/3618155433 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6264003520 con 0x7f627c0d0400 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.915+0000 7f627ad9d640 1 -- 172.21.15.5:0/3618155433 >> v1:172.21.15.80:6789/0 conn(0x7f627c0b94c0 legacy=0x7f627c0d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.915+0000 7f6279d9b640 1 -- 172.21.15.5:0/3618155433 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678702569 0 0) 0x7f627c0d2830 con 0x7f627c0b94c0 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.915+0000 7f627ad9d640 1 -- 172.21.15.5:0/3618155433 >> v1:172.21.15.5:6789/0 conn(0x7f627c0d0400 legacy=0x7f627c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.915+0000 7f627ad9d640 1 -- 172.21.15.5:0/3618155433 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0d2b10 con 0x7f627c15def0 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f627ad9d640 1 --2- 172.21.15.5:0/3618155433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c15def0 0x7f627c0d35f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f626c0097a0 tx=0x7f626c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dd6705bfb7c40e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f6279d9b640 1 -- 172.21.15.5:0/3618155433 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c037070 con 0x7f627c15def0 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f6279d9b640 1 -- 172.21.15.5:0/3618155433 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c032440 con 0x7f627c15def0 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f6279d9b640 1 -- 172.21.15.5:0/3618155433 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0327f0 con 0x7f627c15def0 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f62810e1640 1 -- 172.21.15.5:0/3618155433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c15def0 msgr2=0x7f627c0d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f62810e1640 1 --2- 172.21.15.5:0/3618155433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c15def0 0x7f627c0d35f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f626c0097a0 tx=0x7f626c02a230 comp rx=0 tx=0).stop 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f62810e1640 1 -- 172.21.15.5:0/3618155433 shutdown_connections 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f62810e1640 1 --2- 172.21.15.5:0/3618155433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c15def0 0x7f627c0d35f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f62810e1640 1 -- 172.21.15.5:0/3618155433 >> 172.21.15.5:0/3618155433 conn(0x7f627c06b000 msgr2=0x7f627c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f62810e1640 1 -- 172.21.15.5:0/3618155433 shutdown_connections 2024-04-25T08:56:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.916+0000 7f62810e1640 1 -- 172.21.15.5:0/3618155433 wait complete. 2024-04-25T08:56:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 Processor -- start 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 -- start start 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c0b94c0 0x7f627c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f627c0d0400 0x7f627c0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f627c15def0 0x7f627c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c168990 con 0x7f627c15def0 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0d30d0 con 0x7f627c0b94c0 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.918+0000 7f62810e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c168b10 con 0x7f627c0d0400 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f627c15def0 0x7f627c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f627c15def0 0x7f627c0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42802/0 (socket says 172.21.15.5:42802) 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c0b94c0 0x7f627c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 -- 172.21.15.5:0/793699498 learned_addr learned my addr 172.21.15.5:0/793699498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627a59c640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f627c0d0400 0x7f627c0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 -- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f627c0d0400 msgr2=0x7f627c0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f627c0d0400 0x7f627c0cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 -- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c0b94c0 msgr2=0x7f627c0cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c0b94c0 0x7f627c0cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 -- 172.21.15.5:0/793699498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0cd450 con 0x7f627c15def0 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627ad9d640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c0b94c0 0x7f627c0cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f627b59e640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f627c15def0 0x7f627c0cce30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f627400cb40 tx=0x7f627400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f62637fe640 1 -- 172.21.15.5:0/793699498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274017070 con 0x7f627c15def0 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f62637fe640 1 -- 172.21.15.5:0/793699498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627400aca0 con 0x7f627c15def0 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f62637fe640 1 -- 172.21.15.5:0/793699498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274012620 con 0x7f627c15def0 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c0cd730 con 0x7f627c15def0 2024-04-25T08:56:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.919+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c0cdcf0 con 0x7f627c15def0 2024-04-25T08:56:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.920+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c155e10 con 0x7f627c15def0 2024-04-25T08:56:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.921+0000 7f62637fe640 1 -- 172.21.15.5:0/793699498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f627401a070 con 0x7f627c15def0 2024-04-25T08:56:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.921+0000 7f62637fe640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f626806b4d0 0x7f626806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.921+0000 7f62637fe640 1 -- 172.21.15.5:0/793699498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6274089c10 con 0x7f627c15def0 2024-04-25T08:56:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.921+0000 7f627ad9d640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f626806b4d0 0x7f626806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.922+0000 7f627ad9d640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f626806b4d0 0x7f626806d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f626c034000 tx=0x7f626c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:37.925+0000 7f62637fe640 1 -- 172.21.15.5:0/793699498 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f627c155e10 con 0x7f627c15def0 2024-04-25T08:56:38.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.106+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f627c0b37e0 con 0x7f627c15def0 2024-04-25T08:56:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.107+0000 7f62637fe640 1 -- 172.21.15.5:0/793699498 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12800 (secure 0 0 0) 0x7f6274058790 con 0x7f627c15def0 2024-04-25T08:56:38.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:34.512535+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f626806b4d0 msgr2=0x7f626806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f626806b4d0 0x7f626806d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f626c034000 tx=0x7f626c02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f627c15def0 msgr2=0x7f627c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f627c15def0 0x7f627c0cce30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f627400cb40 tx=0x7f627400a060 comp rx=0 tx=0).stop 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 shutdown_connections 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f626806b4d0 0x7f626806d990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f627c15def0 0x7f627c0cce30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f627c0d0400 0x7f627c0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 --2- 172.21.15.5:0/793699498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c0b94c0 0x7f627c0cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 >> 172.21.15.5:0/793699498 conn(0x7f627c06b000 msgr2=0x7f627c155700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 shutdown_connections 2024-04-25T08:56:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.109+0000 7f62810e1640 1 -- 172.21.15.5:0/793699498 wait complete. 2024-04-25T08:56:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:38.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.226+0000 7fdf72b5c640 1 Processor -- start 2024-04-25T08:56:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.226+0000 7fdf72b5c640 1 -- start start 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf72b5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf6c15df10 0x7fdf6c1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf72b5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf72b5c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf6c0cee10 0x7fdf6c0d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf72b5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0d20d0 con 0x7fdf6c15df10 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf72b5c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c162150 con 0x7fdf6c0cee10 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf72b5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c162430 con 0x7fdf6c0b6250 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf6c15df10 0x7fdf6c1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf6c15df10 0x7fdf6c1618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42804/0 (socket says 172.21.15.5:42804) 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 -- 172.21.15.5:0/1071198290 learned_addr learned my addr 172.21.15.5:0/1071198290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf63fff640 1 --2- 172.21.15.5:0/1071198290 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf710f9640 1 --2- 172.21.15.5:0/1071198290 >> v2:172.21.15.80:3300/0 conn(0x7fdf6c0cee10 0x7fdf6c0d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 -- 172.21.15.5:0/1071198290 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 msgr2=0x7fdf6c0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 --2- 172.21.15.5:0/1071198290 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c0ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 -- 172.21.15.5:0/1071198290 >> v2:172.21.15.80:3300/0 conn(0x7fdf6c0cee10 msgr2=0x7fdf6c0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 --2- 172.21.15.5:0/1071198290 >> v2:172.21.15.80:3300/0 conn(0x7fdf6c0cee10 0x7fdf6c0d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.227+0000 7fdf708f8640 1 -- 172.21.15.5:0/1071198290 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c162710 con 0x7fdf6c15df10 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.228+0000 7fdf708f8640 1 --2- 172.21.15.5:0/1071198290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c1618d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0d2040 tx=0x7fdf6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c71f0ade75113c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.228+0000 7fdf637fe640 1 -- 172.21.15.5:0/1071198290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68037070 con 0x7fdf6c15df10 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.228+0000 7fdf637fe640 1 -- 172.21.15.5:0/1071198290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf68032440 con 0x7fdf6c15df10 2024-04-25T08:56:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.228+0000 7fdf637fe640 1 -- 172.21.15.5:0/1071198290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68032810 con 0x7fdf6c15df10 2024-04-25T08:56:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 -- 172.21.15.5:0/1071198290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 msgr2=0x7fdf6c1618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/1071198290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c1618d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0d2040 tx=0x7fdf6802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 -- 172.21.15.5:0/1071198290 shutdown_connections 2024-04-25T08:56:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/1071198290 >> v2:172.21.15.80:3300/0 conn(0x7fdf6c0cee10 0x7fdf6c0d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/1071198290 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/1071198290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c1618d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 -- 172.21.15.5:0/1071198290 >> 172.21.15.5:0/1071198290 conn(0x7fdf6c0668f0 msgr2=0x7fdf6c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 -- 172.21.15.5:0/1071198290 shutdown_connections 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.229+0000 7fdf72b5c640 1 -- 172.21.15.5:0/1071198290 wait complete. 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.230+0000 7fdf72b5c640 1 Processor -- start 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.230+0000 7fdf72b5c640 1 -- start start 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf72b5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf72b5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf6c0cee10 0x7fdf6c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf72b5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf72b5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0d0980 con 0x7fdf6c15df10 2024-04-25T08:56:38.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf72b5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c161e10 con 0x7fdf6c0cee10 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf72b5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0d0b00 con 0x7fdf6c0b6250 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c0c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42806/0 (socket says 172.21.15.5:42806) 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 -- 172.21.15.5:0/536378589 learned_addr learned my addr 172.21.15.5:0/536378589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf63fff640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf6c0cee10 0x7fdf6c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf708f8640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 -- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 msgr2=0x7fdf6c14d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c14d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 -- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf6c0cee10 msgr2=0x7fdf6c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf6c0cee10 0x7fdf6c14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 -- 172.21.15.5:0/536378589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c14b850 con 0x7fdf6c15df10 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf708f8640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf710f9640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c0c9230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400efc0 tx=0x7fdf6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf617fa640 1 -- 172.21.15.5:0/536378589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64018020 con 0x7fdf6c15df10 2024-04-25T08:56:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf617fa640 1 -- 172.21.15.5:0/536378589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf64014480 con 0x7fdf6c15df10 2024-04-25T08:56:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.231+0000 7fdf617fa640 1 -- 172.21.15.5:0/536378589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64014870 con 0x7fdf6c15df10 2024-04-25T08:56:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.232+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c14bb30 con 0x7fdf6c15df10 2024-04-25T08:56:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.232+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c14c0f0 con 0x7fdf6c15df10 2024-04-25T08:56:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.233+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c04ef20 con 0x7fdf6c15df10 2024-04-25T08:56:38.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.233+0000 7fdf617fa640 1 -- 172.21.15.5:0/536378589 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf64005d10 con 0x7fdf6c15df10 2024-04-25T08:56:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.233+0000 7fdf617fa640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf5806b500 0x7fdf5806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.234+0000 7fdf617fa640 1 -- 172.21.15.5:0/536378589 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf6408a900 con 0x7fdf6c15df10 2024-04-25T08:56:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.234+0000 7fdf708f8640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf5806b500 0x7fdf5806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.234+0000 7fdf708f8640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf5806b500 0x7fdf5806d9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdf68034000 tx=0x7fdf6802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.238+0000 7fdf617fa640 1 -- 172.21.15.5:0/536378589 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf64022070 con 0x7fdf6c15df10 2024-04-25T08:56:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.417+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf6c0b3340 con 0x7fdf6c15df10 2024-04-25T08:56:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.417+0000 7fdf617fa640 1 -- 172.21.15.5:0/536378589 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf64010040 con 0x7fdf6c15df10 2024-04-25T08:56:38.407 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:56:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf5806b500 msgr2=0x7fdf5806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf5806b500 0x7fdf5806d9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdf68034000 tx=0x7fdf6802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 msgr2=0x7fdf6c0c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c0c9230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400efc0 tx=0x7fdf6400c490 comp rx=0 tx=0).stop 2024-04-25T08:56:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 shutdown_connections 2024-04-25T08:56:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf5806b500 0x7fdf5806d9c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c15df10 0x7fdf6c0c9230 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf6c0cee10 0x7fdf6c14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 --2- 172.21.15.5:0/536378589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf6c0b6250 0x7fdf6c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 >> 172.21.15.5:0/536378589 conn(0x7fdf6c0668f0 msgr2=0x7fdf6c0b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 shutdown_connections 2024-04-25T08:56:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.419+0000 7fdf72b5c640 1 -- 172.21.15.5:0/536378589 wait complete. 2024-04-25T08:56:38.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:38.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.532+0000 7ff76fe93640 1 Processor -- start 2024-04-25T08:56:38.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.532+0000 7ff76fe93640 1 -- start start 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76fe93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff76815e0a0 0x7ff7680d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76fe93640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7680d3990 0x7ff7680d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76fe93640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7680b7f60 con 0x7ff7680ce5e0 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76fe93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7680d4330 con 0x7ff76815e0a0 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76fe93640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7680b29c0 con 0x7ff7680d3990 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76dc2f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff76815e0a0 0x7ff7680d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76dc2f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff76815e0a0 0x7ff7680d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42816/0 (socket says 172.21.15.5:42816) 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76dc2f640 1 -- 172.21.15.5:0/4151520316 learned_addr learned my addr 172.21.15.5:0/4151520316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76d42e640 1 --2- 172.21.15.5:0/4151520316 >> v2:172.21.15.80:3300/0 conn(0x7ff7680d3990 0x7ff7680d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76dc2f640 1 -- 172.21.15.5:0/4151520316 >> v2:172.21.15.80:3300/0 conn(0x7ff7680d3990 msgr2=0x7ff7680d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76dc2f640 1 --2- 172.21.15.5:0/4151520316 >> v2:172.21.15.80:3300/0 conn(0x7ff7680d3990 0x7ff7680d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76dc2f640 1 -- 172.21.15.5:0/4151520316 >> v1:172.21.15.80:6789/0 conn(0x7ff7680ce5e0 legacy=0x7ff7680cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.533+0000 7ff76dc2f640 1 -- 172.21.15.5:0/4151520316 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680d2080 con 0x7ff76815e0a0 2024-04-25T08:56:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76dc2f640 1 --2- 172.21.15.5:0/4151520316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76815e0a0 0x7ff7680d0d50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff7680676e0 tx=0x7ff76402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bbc544d63cccfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76cc2d640 1 -- 172.21.15.5:0/4151520316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764037070 con 0x7ff76815e0a0 2024-04-25T08:56:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76cc2d640 1 -- 172.21.15.5:0/4151520316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764032440 con 0x7ff76815e0a0 2024-04-25T08:56:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76cc2d640 1 -- 172.21.15.5:0/4151520316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764032810 con 0x7ff76815e0a0 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76fe93640 1 -- 172.21.15.5:0/4151520316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76815e0a0 msgr2=0x7ff7680d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76fe93640 1 --2- 172.21.15.5:0/4151520316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76815e0a0 0x7ff7680d0d50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff7680676e0 tx=0x7ff76402a230 comp rx=0 tx=0).stop 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76fe93640 1 -- 172.21.15.5:0/4151520316 shutdown_connections 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76fe93640 1 --2- 172.21.15.5:0/4151520316 >> v2:172.21.15.80:3300/0 conn(0x7ff7680d3990 0x7ff7680d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76fe93640 1 --2- 172.21.15.5:0/4151520316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76815e0a0 0x7ff7680d0d50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.534+0000 7ff76fe93640 1 -- 172.21.15.5:0/4151520316 >> 172.21.15.5:0/4151520316 conn(0x7ff7680668f0 msgr2=0x7ff768066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.535+0000 7ff76fe93640 1 -- 172.21.15.5:0/4151520316 shutdown_connections 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.535+0000 7ff76fe93640 1 -- 172.21.15.5:0/4151520316 wait complete. 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 Processor -- start 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 -- start start 2024-04-25T08:56:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7680ce5e0 0x7ff7680c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7680d3990 0x7ff7680aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff76815e0a0 0x7ff7680ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680d2920 con 0x7ff7680d3990 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680d2640 con 0x7ff76815e0a0 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.536+0000 7ff76fe93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680d2c00 con 0x7ff7680ce5e0 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7680d3990 0x7ff7680aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7680d3990 0x7ff7680aaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42830/0 (socket says 172.21.15.5:42830) 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 -- 172.21.15.5:0/1770186286 learned_addr learned my addr 172.21.15.5:0/1770186286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76dc2f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7680ce5e0 0x7ff7680c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76e430640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff76815e0a0 0x7ff7680ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 -- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7680ce5e0 msgr2=0x7ff7680c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7680ce5e0 0x7ff7680c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 -- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff76815e0a0 msgr2=0x7ff7680ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff76815e0a0 0x7ff7680ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 -- 172.21.15.5:0/1770186286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680ca1a0 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76d42e640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7680d3990 0x7ff7680aaee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c7f0 tx=0x7ff75800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff75e7fc640 1 -- 172.21.15.5:0/1770186286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758015070 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff75e7fc640 1 -- 172.21.15.5:0/1770186286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758004240 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7680ca480 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff75e7fc640 1 -- 172.21.15.5:0/1770186286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758007620 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.537+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7680cc280 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.538+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76804ef20 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.539+0000 7ff75e7fc640 1 -- 172.21.15.5:0/1770186286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff7580079d0 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.539+0000 7ff75e7fc640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff74c06b4d0 0x7ff74c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.539+0000 7ff75e7fc640 1 -- 172.21.15.5:0/1770186286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff75808a280 con 0x7ff7680d3990 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.539+0000 7ff76dc2f640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff74c06b4d0 0x7ff74c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:38.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.540+0000 7ff76dc2f640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff74c06b4d0 0x7ff74c06d990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff76402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:38.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.543+0000 7ff75e7fc640 1 -- 172.21.15.5:0/1770186286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff758058e00 con 0x7ff7680d3990 2024-04-25T08:56:38.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.759+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7680c8b90 con 0x7ff7680d3990 2024-04-25T08:56:38.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.760+0000 7ff75e7fc640 1 -- 172.21.15.5:0/1770186286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7ff75805cea0 con 0x7ff7680d3990 2024-04-25T08:56:38.750 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:38.750 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T08:56:38.750 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-04-25T08:56:38.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff74c06b4d0 msgr2=0x7ff74c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff74c06b4d0 0x7ff74c06d990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff76402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7680d3990 msgr2=0x7ff7680aaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7680d3990 0x7ff7680aaee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c7f0 tx=0x7ff75800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 shutdown_connections 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff74c06b4d0 0x7ff74c06d990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff76815e0a0 0x7ff7680ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7680d3990 0x7ff7680aaee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 --2- 172.21.15.5:0/1770186286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7680ce5e0 0x7ff7680c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.761+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 >> 172.21.15.5:0/1770186286 conn(0x7ff7680668f0 msgr2=0x7ff7680cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.762+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 shutdown_connections 2024-04-25T08:56:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:38.762+0000 7ff76fe93640 1 -- 172.21.15.5:0/1770186286 wait complete. 2024-04-25T08:56:40.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:40.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.886+0000 7fa549314640 1 Processor -- start 2024-04-25T08:56:40.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.886+0000 7fa549314640 1 -- start start 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa549314640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa54415e0a0 0x7fa5440d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa549314640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa5440d3990 0x7fa5440d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa549314640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5440b7f60 con 0x7fa5440ce5e0 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa549314640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5440d4330 con 0x7fa5440d3990 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa549314640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440b29c0 con 0x7fa54415e0a0 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa5437fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa5440ce5e0 0x7fa5440cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57916/0 (socket says 172.21.15.5:57916) 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa5437fe640 1 -- 172.21.15.5:0/1062981459 learned_addr learned my addr 172.21.15.5:0/1062981459 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa542ffd640 1 --2- 172.21.15.5:0/1062981459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa54415e0a0 0x7fa5440d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.887+0000 7fa5427fc640 1 --2- 172.21.15.5:0/1062981459 >> v2:172.21.15.80:3300/0 conn(0x7fa5440d3990 0x7fa5440d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.888+0000 7fa541ffb640 1 -- 172.21.15.5:0/1062981459 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061282571 0 0) 0x7fa5440b7f60 con 0x7fa5440ce5e0 2024-04-25T08:56:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.888+0000 7fa541ffb640 1 -- 172.21.15.5:0/1062981459 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa52c003520 con 0x7fa5440ce5e0 2024-04-25T08:56:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.888+0000 7fa542ffd640 1 -- 172.21.15.5:0/1062981459 >> v2:172.21.15.80:3300/0 conn(0x7fa5440d3990 msgr2=0x7fa5440d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.888+0000 7fa542ffd640 1 --2- 172.21.15.5:0/1062981459 >> v2:172.21.15.80:3300/0 conn(0x7fa5440d3990 0x7fa5440d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.888+0000 7fa542ffd640 1 -- 172.21.15.5:0/1062981459 >> v1:172.21.15.5:6789/0 conn(0x7fa5440ce5e0 legacy=0x7fa5440cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.888+0000 7fa542ffd640 1 -- 172.21.15.5:0/1062981459 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440d2080 con 0x7fa54415e0a0 2024-04-25T08:56:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.888+0000 7fa5427fc640 1 --2- 172.21.15.5:0/1062981459 >> v2:172.21.15.80:3300/0 conn(0x7fa5440d3990 0x7fa5440d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa542ffd640 1 --2- 172.21.15.5:0/1062981459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa54415e0a0 0x7fa5440d0d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0097a0 tx=0x7fa53c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee2b200769dedf1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa541ffb640 1 -- 172.21.15.5:0/1062981459 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c037070 con 0x7fa54415e0a0 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa541ffb640 1 -- 172.21.15.5:0/1062981459 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c032440 con 0x7fa54415e0a0 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa541ffb640 1 -- 172.21.15.5:0/1062981459 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c032810 con 0x7fa54415e0a0 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 -- 172.21.15.5:0/1062981459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa54415e0a0 msgr2=0x7fa5440d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 --2- 172.21.15.5:0/1062981459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa54415e0a0 0x7fa5440d0d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0097a0 tx=0x7fa53c02a180 comp rx=0 tx=0).stop 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 -- 172.21.15.5:0/1062981459 shutdown_connections 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 --2- 172.21.15.5:0/1062981459 >> v2:172.21.15.80:3300/0 conn(0x7fa5440d3990 0x7fa5440d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 --2- 172.21.15.5:0/1062981459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa54415e0a0 0x7fa5440d0d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 -- 172.21.15.5:0/1062981459 >> 172.21.15.5:0/1062981459 conn(0x7fa5440668f0 msgr2=0x7fa544066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 -- 172.21.15.5:0/1062981459 shutdown_connections 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.889+0000 7fa549314640 1 -- 172.21.15.5:0/1062981459 wait complete. 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 Processor -- start 2024-04-25T08:56:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 -- start start 2024-04-25T08:56:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5440ce5e0 0x7fa5440cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5440d3990 0x7fa5440b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa54415e0a0 0x7fa5440b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440d2920 con 0x7fa54415e0a0 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440d2640 con 0x7fa5440d3990 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.891+0000 7fa549314640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440d2c00 con 0x7fa5440ce5e0 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa54415e0a0 0x7fa5440b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa54415e0a0 0x7fa5440b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35558/0 (socket says 172.21.15.5:35558) 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 -- 172.21.15.5:0/79488888 learned_addr learned my addr 172.21.15.5:0/79488888 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5427fc640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5440d3990 0x7fa5440b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa542ffd640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5440ce5e0 0x7fa5440cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 -- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5440ce5e0 msgr2=0x7fa5440cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5440ce5e0 0x7fa5440cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 -- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5440d3990 msgr2=0x7fa5440b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5440d3990 0x7fa5440b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 -- 172.21.15.5:0/79488888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5441f4710 con 0x7fa54415e0a0 2024-04-25T08:56:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa5437fe640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa54415e0a0 0x7fa5440b4310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa53400caa0 tx=0x7fa53400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa52b7fe640 1 -- 172.21.15.5:0/79488888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534017070 con 0x7fa54415e0a0 2024-04-25T08:56:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa52b7fe640 1 -- 172.21.15.5:0/79488888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400ac00 con 0x7fa54415e0a0 2024-04-25T08:56:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa52b7fe640 1 -- 172.21.15.5:0/79488888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534012400 con 0x7fa54415e0a0 2024-04-25T08:56:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5440ccaa0 con 0x7fa54415e0a0 2024-04-25T08:56:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.892+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa544158240 con 0x7fa54415e0a0 2024-04-25T08:56:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.893+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54404ef20 con 0x7fa54415e0a0 2024-04-25T08:56:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.894+0000 7fa52b7fe640 1 -- 172.21.15.5:0/79488888 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa53401a070 con 0x7fa54415e0a0 2024-04-25T08:56:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.894+0000 7fa52b7fe640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa53006b4d0 0x7fa53006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.895+0000 7fa52b7fe640 1 -- 172.21.15.5:0/79488888 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa534089c00 con 0x7fa54415e0a0 2024-04-25T08:56:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.895+0000 7fa542ffd640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa53006b4d0 0x7fa53006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.895+0000 7fa542ffd640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa53006b4d0 0x7fa53006d990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa53c034000 tx=0x7fa53c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:40.899+0000 7fa52b7fe640 1 -- 172.21.15.5:0/79488888 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa534090080 con 0x7fa54415e0a0 2024-04-25T08:56:41.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.116+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5440b49f0 con 0x7fa54415e0a0 2024-04-25T08:56:41.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.116+0000 7fa52b7fe640 1 -- 172.21.15.5:0/79488888 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3685 (secure 0 0 0) 0x7fa534058780 con 0x7fa54415e0a0 2024-04-25T08:56:41.106 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:41.106 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-04-25T08:56:41.107 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-04-25T08:56:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa53006b4d0 msgr2=0x7fa53006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa53006b4d0 0x7fa53006d990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa53c034000 tx=0x7fa53c02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa54415e0a0 msgr2=0x7fa5440b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa54415e0a0 0x7fa5440b4310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa53400caa0 tx=0x7fa53400cf60 comp rx=0 tx=0).stop 2024-04-25T08:56:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 shutdown_connections 2024-04-25T08:56:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa53006b4d0 0x7fa53006d990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa54415e0a0 0x7fa5440b4310 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5440d3990 0x7fa5440b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 --2- 172.21.15.5:0/79488888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5440ce5e0 0x7fa5440cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 >> 172.21.15.5:0/79488888 conn(0x7fa5440668f0 msgr2=0x7fa54415d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 shutdown_connections 2024-04-25T08:56:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.118+0000 7fa549314640 1 -- 172.21.15.5:0/79488888 wait complete. 2024-04-25T08:56:41.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.230+0000 7f6de0f7e640 1 Processor -- start 2024-04-25T08:56:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.230+0000 7f6de0f7e640 1 -- start start 2024-04-25T08:56:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6de0f7e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ddc15e0a0 0x7f6ddc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6de0f7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6de0f7e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0b7f60 con 0x7f6ddc0d3990 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6de0f7e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b29c0 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6de0f7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0d2080 con 0x7f6ddc0d3df0 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dda59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ddc15e0a0 0x7f6ddc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dd9d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ddc0d3990 0x7f6ddc0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57920/0 (socket says 172.21.15.5:57920) 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dda59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ddc15e0a0 0x7f6ddc0d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35560/0 (socket says 172.21.15.5:35560) 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dd9d9b640 1 -- 172.21.15.5:0/3090316319 learned_addr learned my addr 172.21.15.5:0/3090316319 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6ddad9d640 1 --2- 172.21.15.5:0/3090316319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dda59c640 1 -- 172.21.15.5:0/3090316319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3df0 msgr2=0x7f6ddc0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dda59c640 1 --2- 172.21.15.5:0/3090316319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dda59c640 1 -- 172.21.15.5:0/3090316319 >> v1:172.21.15.5:6789/0 conn(0x7f6ddc0d3990 legacy=0x7f6ddc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.231+0000 7f6dda59c640 1 -- 172.21.15.5:0/3090316319 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0d2360 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.232+0000 7f6dda59c640 1 --2- 172.21.15.5:0/3090316319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc0d0d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40097a0 tx=0x7f6dd402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba928f7dedcdc0fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.232+0000 7f6dd959a640 1 -- 172.21.15.5:0/3090316319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4037070 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.232+0000 7f6dd959a640 1 -- 172.21.15.5:0/3090316319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd4032440 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.232+0000 7f6dd959a640 1 -- 172.21.15.5:0/3090316319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4032810 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3090316319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 msgr2=0x7f6ddc0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3090316319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc0d0d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40097a0 tx=0x7f6dd402a180 comp rx=0 tx=0).stop 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3090316319 shutdown_connections 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3090316319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3090316319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc0d0d50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3090316319 >> 172.21.15.5:0/3090316319 conn(0x7f6ddc0668f0 msgr2=0x7f6ddc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3090316319 shutdown_connections 2024-04-25T08:56:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.233+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3090316319 wait complete. 2024-04-25T08:56:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.234+0000 7f6de0f7e640 1 Processor -- start 2024-04-25T08:56:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.234+0000 7f6de0f7e640 1 -- start start 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6de0f7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3990 0x7f6ddc1f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6de0f7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6de0f7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6de0f7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0d2c00 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6de0f7e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0d2920 con 0x7f6ddc0d3df0 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6de0f7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0d4280 con 0x7f6ddc0d3990 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc15c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35576/0 (socket says 172.21.15.5:35576) 2024-04-25T08:56:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 -- 172.21.15.5:0/3317073140 learned_addr learned my addr 172.21.15.5:0/3317073140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6dd9d9b640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6dda59c640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3990 0x7f6ddc1f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 -- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3990 msgr2=0x7f6ddc1f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3990 0x7f6ddc1f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 -- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ddc0d3df0 msgr2=0x7f6ddc0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 -- 172.21.15.5:0/3317073140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0ccf90 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.235+0000 7f6ddad9d640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc15c710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc007e40 tx=0x7f6dcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.236+0000 7f6dd2ffd640 1 -- 172.21.15.5:0/3317073140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc014620 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.236+0000 7f6dd2ffd640 1 -- 172.21.15.5:0/3317073140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc019070 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.236+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc0cbc90 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.236+0000 7f6dd2ffd640 1 -- 172.21.15.5:0/3317073140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc014a20 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.236+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc0cc250 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.237+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc04ef20 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.237+0000 7f6dd2ffd640 1 -- 172.21.15.5:0/3317073140 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6dcc014bc0 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.238+0000 7f6dd2ffd640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6dbc06b4d0 0x7f6dbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.238+0000 7f6dd2ffd640 1 -- 172.21.15.5:0/3317073140 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6dcc08a820 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.238+0000 7f6dda59c640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6dbc06b4d0 0x7f6dbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.239+0000 7f6dda59c640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6dbc06b4d0 0x7f6dbc06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4034000 tx=0x7f6dd402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.242+0000 7f6dd2ffd640 1 -- 172.21.15.5:0/3317073140 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6dcc059950 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.425+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ddc0ab2f0 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.425+0000 7f6dd2ffd640 1 -- 172.21.15.5:0/3317073140 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12800 (secure 0 0 0) 0x7f6dcc059250 con 0x7f6ddc15e0a0 2024-04-25T08:56:41.415 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:41.415 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:34.512535+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.427+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6dbc06b4d0 msgr2=0x7f6dbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.427+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6dbc06b4d0 0x7f6dbc06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4034000 tx=0x7f6dd402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.427+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 msgr2=0x7f6ddc15c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.427+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc15c710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc007e40 tx=0x7f6dcc00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 shutdown_connections 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6dbc06b4d0 0x7f6dbc06d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc15e0a0 0x7f6ddc15c710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ddc0d3df0 0x7f6ddc0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 --2- 172.21.15.5:0/3317073140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ddc0d3990 0x7f6ddc1f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 >> 172.21.15.5:0/3317073140 conn(0x7f6ddc0668f0 msgr2=0x7f6ddc0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 shutdown_connections 2024-04-25T08:56:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.428+0000 7f6de0f7e640 1 -- 172.21.15.5:0/3317073140 wait complete. 2024-04-25T08:56:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:41.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.542+0000 7f7e0ef90640 1 Processor -- start 2024-04-25T08:56:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.542+0000 7f7e0ef90640 1 -- start start 2024-04-25T08:56:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e0ef90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 0x7f7e0806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e0ef90640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e080cc780 0x7f7e080ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e0ef90640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080d27f0 con 0x7f7e080d0c80 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e0ef90640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e080cfee0 con 0x7f7e080cc780 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e0ef90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080d01c0 con 0x7f7e0815e0b0 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e07fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e080d0c80 0x7f7e080cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57934/0 (socket says 172.21.15.5:57934) 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e07fff640 1 -- 172.21.15.5:0/1397680545 learned_addr learned my addr 172.21.15.5:0/1397680545 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/1397680545 >> v2:172.21.15.80:3300/0 conn(0x7f7e080cc780 0x7f7e080ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e0cd2c640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 0x7f7e0806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.543+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232168417 0 0) 0x7f7e080d27f0 con 0x7f7e080d0c80 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df0003520 con 0x7f7e080d0c80 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 543430796 0 0) 0x7f7df0003520 con 0x7f7e080d0c80 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 msgr2=0x7f7e0806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 0x7f7e0806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 >> v2:172.21.15.80:3300/0 conn(0x7f7e080cc780 msgr2=0x7f7e080ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 --2- 172.21.15.5:0/1397680545 >> v2:172.21.15.80:3300/0 conn(0x7f7e080cc780 0x7f7e080ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080d04a0 con 0x7f7e080d0c80 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f7dfc001670 con 0x7f7e080d0c80 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 >> v1:172.21.15.5:6789/0 conn(0x7f7e080d0c80 legacy=0x7f7e080cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df00039b0 0x7f7df0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 0x7f7df0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df0004d40 0x7f7df00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080cfee0 con 0x7f7df0004d40 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080d01c0 con 0x7f7df00039b0 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df000b9c0 con 0x7f7e0815e0b0 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df0004d40 0x7f7df00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e0cd2c640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df00039b0 0x7f7df0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e07fff640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 0x7f7df0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e0d52d640 1 -- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 msgr2=0x7f7df0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0815e0b0 0x7f7df0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e0d52d640 1 -- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df00039b0 msgr2=0x7f7df0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df00039b0 0x7f7df0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.544+0000 7f7e0d52d640 1 -- 172.21.15.5:0/1397680545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0003520 con 0x7f7df0004d40 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.545+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df0004d40 0x7f7df00051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009fc0 tx=0x7f7df0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413d7b99d2069063 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.545+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00009c10 con 0x7f7df0004d40 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.545+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00036070 con 0x7f7df0004d40 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.545+0000 7f7e077fe640 1 -- 172.21.15.5:0/1397680545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0002d070 con 0x7f7df0004d40 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.546+0000 7f7e0ef90640 1 -- 172.21.15.5:0/1397680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df0004d40 msgr2=0x7f7df00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.546+0000 7f7e0ef90640 1 --2- 172.21.15.5:0/1397680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df0004d40 0x7f7df00051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009fc0 tx=0x7f7df0005830 comp rx=0 tx=0).stop 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.546+0000 7f7e0d52d640 1 -- 172.21.15.5:0/1397680545 reap_dead start 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.546+0000 7f7e0ef90640 1 -- 172.21.15.5:0/1397680545 shutdown_connections 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.546+0000 7f7e0ef90640 1 -- 172.21.15.5:0/1397680545 >> 172.21.15.5:0/1397680545 conn(0x7f7e080d1a20 msgr2=0x7f7e080d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.546+0000 7f7e0ef90640 1 -- 172.21.15.5:0/1397680545 shutdown_connections 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.546+0000 7f7e0ef90640 1 -- 172.21.15.5:0/1397680545 wait complete. 2024-04-25T08:56:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.547+0000 7f7e0ef90640 1 Processor -- start 2024-04-25T08:56:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.547+0000 7f7e0ef90640 1 -- start start 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0ef90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7df0004d40 0x7f7e08160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0ef90640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0809ce30 0x7f7e0815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0ef90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e081f6fe0 0x7f7e081f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0ef90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080cfb90 con 0x7f7e081f6fe0 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0ef90640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0815e490 con 0x7f7e0809ce30 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0ef90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080ccc10 con 0x7f7df0004d40 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e081f6fe0 0x7f7e081f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e081f6fe0 0x7f7e081f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35584/0 (socket says 172.21.15.5:35584) 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 -- 172.21.15.5:0/3811459883 learned_addr learned my addr 172.21.15.5:0/3811459883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e07fff640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0809ce30 0x7f7e0815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0cd2c640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7df0004d40 0x7f7e08160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 -- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7df0004d40 msgr2=0x7f7e08160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7df0004d40 0x7f7e08160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 -- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0809ce30 msgr2=0x7f7e0815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0809ce30 0x7f7e0815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 -- 172.21.15.5:0/3811459883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08161200 con 0x7f7e081f6fe0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e07fff640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0809ce30 0x7f7e0815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.548+0000 7f7e0d52d640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e081f6fe0 0x7f7e081f7470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e230 tx=0x7f7e00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.549+0000 7f7e057fa640 1 -- 172.21.15.5:0/3811459883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00009c10 con 0x7f7e081f6fe0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.549+0000 7f7e057fa640 1 -- 172.21.15.5:0/3811459883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00003990 con 0x7f7e081f6fe0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.549+0000 7f7e057fa640 1 -- 172.21.15.5:0/3811459883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00003d60 con 0x7f7e081f6fe0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.549+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e081614e0 con 0x7f7e081f6fe0 2024-04-25T08:56:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.549+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e08161aa0 con 0x7f7e081f6fe0 2024-04-25T08:56:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.550+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0804ef20 con 0x7f7e081f6fe0 2024-04-25T08:56:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.550+0000 7f7e057fa640 1 -- 172.21.15.5:0/3811459883 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e00005d10 con 0x7f7e081f6fe0 2024-04-25T08:56:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.550+0000 7f7e057fa640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df406b4d0 0x7f7df406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.551+0000 7f7e057fa640 1 -- 172.21.15.5:0/3811459883 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e000ab520 con 0x7f7e081f6fe0 2024-04-25T08:56:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.551+0000 7f7e0cd2c640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df406b4d0 0x7f7df406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.551+0000 7f7e0cd2c640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df406b4d0 0x7f7df406d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e0806af10 tx=0x7f7df8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.555+0000 7f7e057fa640 1 -- 172.21.15.5:0/3811459883 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e0004a060 con 0x7f7e081f6fe0 2024-04-25T08:56:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.733+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e0806b080 con 0x7f7e081f6fe0 2024-04-25T08:56:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.734+0000 7f7e057fa640 1 -- 172.21.15.5:0/3811459883 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e0007a650 con 0x7f7e081f6fe0 2024-04-25T08:56:41.724 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:56:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df406b4d0 msgr2=0x7f7df406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df406b4d0 0x7f7df406d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e0806af10 tx=0x7f7df8008040 comp rx=0 tx=0).stop 2024-04-25T08:56:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e081f6fe0 msgr2=0x7f7e081f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e081f6fe0 0x7f7e081f7470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e230 tx=0x7f7e00009750 comp rx=0 tx=0).stop 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 shutdown_connections 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df406b4d0 0x7f7df406d990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e081f6fe0 0x7f7e081f7470 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0809ce30 0x7f7e0815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 --2- 172.21.15.5:0/3811459883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7df0004d40 0x7f7e08160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 >> 172.21.15.5:0/3811459883 conn(0x7f7e080d1a20 msgr2=0x7f7e0806fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 shutdown_connections 2024-04-25T08:56:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.736+0000 7f7e0ef90640 1 -- 172.21.15.5:0/3811459883 wait complete. 2024-04-25T08:56:41.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:56:41.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.847+0000 7f83edb0a640 1 Processor -- start 2024-04-25T08:56:41.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.847+0000 7f83edb0a640 1 -- start start 2024-04-25T08:56:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83edb0a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 0x7f83e80b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83edb0a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83e80b3e10 0x7f83e806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83edb0a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e80b5740 con 0x7f83e80668f0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83edb0a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80b5a20 con 0x7f83e80b3e10 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83edb0a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80b5d00 con 0x7f83e8161fe0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83e77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f83e80668f0 0x7f83e8066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57940/0 (socket says 172.21.15.5:57940) 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83e77fe640 1 -- 172.21.15.5:0/840311883 learned_addr learned my addr 172.21.15.5:0/840311883 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83e6ffd640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 0x7f83e80b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83e7fff640 1 --2- 172.21.15.5:0/840311883 >> v2:172.21.15.80:3300/0 conn(0x7f83e80b3e10 0x7f83e806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670437861 0 0) 0x7f83e80b5740 con 0x7f83e80668f0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.848+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d0003520 con 0x7f83e80668f0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284292218 0 0) 0x7f83d0003520 con 0x7f83e80668f0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 msgr2=0x7f83e80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 0x7f83e80b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 >> v2:172.21.15.80:3300/0 conn(0x7f83e80b3e10 msgr2=0x7f83e806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 --2- 172.21.15.5:0/840311883 >> v2:172.21.15.80:3300/0 conn(0x7f83e80b3e10 0x7f83e806d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e81617e0 con 0x7f83e80668f0 2024-04-25T08:56:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f83d8001670 con 0x7f83e80668f0 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 >> v1:172.21.15.5:6789/0 conn(0x7f83e80668f0 legacy=0x7f83e8066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83d00039b0 0x7f83d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 0x7f83d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80b5a20 con 0x7f83d0004d40 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80b5d00 con 0x7f83d00039b0 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d000b9c0 con 0x7f83e8161fe0 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e7fff640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e77fe640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83d00039b0 0x7f83d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e6ffd640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 0x7f83d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e7fff640 1 -- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 msgr2=0x7f83d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e7fff640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e8161fe0 0x7f83d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e7fff640 1 -- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83d00039b0 msgr2=0x7f83d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e7fff640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83d00039b0 0x7f83d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.849+0000 7f83e7fff640 1 -- 172.21.15.5:0/840311883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0003520 con 0x7f83d0004d40 2024-04-25T08:56:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.850+0000 7f83e7fff640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83d00051c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009f90 tx=0x7f83d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4ae4e600c941c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.850+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0009c10 con 0x7f83d0004d40 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.850+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0036070 con 0x7f83d0004d40 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.850+0000 7f83e67fc640 1 -- 172.21.15.5:0/840311883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0031880 con 0x7f83d0004d40 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.851+0000 7f83edb0a640 1 -- 172.21.15.5:0/840311883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 msgr2=0x7f83d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.851+0000 7f83edb0a640 1 --2- 172.21.15.5:0/840311883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83d00051c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009f90 tx=0x7f83d0005830 comp rx=0 tx=0).stop 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.851+0000 7f83e7fff640 1 -- 172.21.15.5:0/840311883 reap_dead start 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.851+0000 7f83edb0a640 1 -- 172.21.15.5:0/840311883 shutdown_connections 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.851+0000 7f83edb0a640 1 -- 172.21.15.5:0/840311883 >> 172.21.15.5:0/840311883 conn(0x7f83e80b25d0 msgr2=0x7f83e80b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.851+0000 7f83edb0a640 1 -- 172.21.15.5:0/840311883 shutdown_connections 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.851+0000 7f83edb0a640 1 -- 172.21.15.5:0/840311883 wait complete. 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.852+0000 7f83edb0a640 1 Processor -- start 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.852+0000 7f83edb0a640 1 -- start start 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83e815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e80cd100 0x7f83e81e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e81e7a80 0x7f83e81321d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e806f1b0 con 0x7f83d0004d40 2024-04-25T08:56:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e806f030 con 0x7f83e80cd100 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8162460 con 0x7f83e81e7a80 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83e815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83e815fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35614/0 (socket says 172.21.15.5:35614) 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 -- 172.21.15.5:0/1164960157 learned_addr learned my addr 172.21.15.5:0/1164960157 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 -- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e81e7a80 msgr2=0x7f83e81321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e81e7a80 0x7f83e81321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 -- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e80cd100 msgr2=0x7f83e81e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e80cd100 0x7f83e81e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 -- 172.21.15.5:0/1164960157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e8130140 con 0x7f83d0004d40 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83e77fe640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83e815fcb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83d80072c0 tx=0x7f83d8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83cffff640 1 -- 172.21.15.5:0/1164960157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d800f860 con 0x7f83d0004d40 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83cffff640 1 -- 172.21.15.5:0/1164960157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8018070 con 0x7f83d0004d40 2024-04-25T08:56:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e81303e0 con 0x7f83d0004d40 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83cffff640 1 -- 172.21.15.5:0/1164960157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d800fc60 con 0x7f83d0004d40 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.853+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e81309a0 con 0x7f83d0004d40 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.854+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e804ef20 con 0x7f83d0004d40 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.855+0000 7f83cffff640 1 -- 172.21.15.5:0/1164960157 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83d801d460 con 0x7f83d0004d40 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.855+0000 7f83cffff640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83d406b4d0 0x7f83d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.856+0000 7f83cffff640 1 -- 172.21.15.5:0/1164960157 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f83d8089f30 con 0x7f83d0004d40 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.856+0000 7f83e6ffd640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83d406b4d0 0x7f83d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.856+0000 7f83e6ffd640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83d406b4d0 0x7f83d406d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83e8071730 tx=0x7f83dc0095d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:41.860+0000 7f83cffff640 1 -- 172.21.15.5:0/1164960157 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83d80590f0 con 0x7f83d0004d40 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.043+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f83e8072140 con 0x7f83d0004d40 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.043+0000 7f83cffff640 1 -- 172.21.15.5:0/1164960157 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f83d80589f0 con 0x7f83d0004d40 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:56:42.033 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T08:56:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83d406b4d0 msgr2=0x7f83d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83d406b4d0 0x7f83d406d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83e8071730 tx=0x7f83dc0095d0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 msgr2=0x7f83e815fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83e815fcb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83d80072c0 tx=0x7f83d8007780 comp rx=0 tx=0).stop 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 shutdown_connections 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83d406b4d0 0x7f83d406d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83e81e7a80 0x7f83e81321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e80cd100 0x7f83e81e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 --2- 172.21.15.5:0/1164960157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d0004d40 0x7f83e815fcb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 >> 172.21.15.5:0/1164960157 conn(0x7f83e80b25d0 msgr2=0x7f83e80af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 shutdown_connections 2024-04-25T08:56:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.045+0000 7f83edb0a640 1 -- 172.21.15.5:0/1164960157 wait complete. 2024-04-25T08:56:42.045 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:56:42.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:56:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.160+0000 7f97633bd640 1 Processor -- start 2024-04-25T08:56:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.160+0000 7f97633bd640 1 -- start start 2024-04-25T08:56:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f97633bd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f975c15ddf0 0x7f975c0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f97633bd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f975c0ceb40 0x7f975c1624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f97633bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c0ce800 con 0x7f975c0d0840 2024-04-25T08:56:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f97633bd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c1629f0 con 0x7f975c0ceb40 2024-04-25T08:56:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f97633bd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0cf320 con 0x7f975c15ddf0 2024-04-25T08:56:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f9760958640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f975c0ceb40 0x7f975c1624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f9760958640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f975c0ceb40 0x7f975c1624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35618/0 (socket says 172.21.15.5:35618) 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f9760958640 1 -- 172.21.15.5:0/843555214 learned_addr learned my addr 172.21.15.5:0/843555214 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.161+0000 7f9761159640 1 --2- 172.21.15.5:0/843555214 >> v2:172.21.15.80:3300/0 conn(0x7f975c15ddf0 0x7f975c0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f9760958640 1 -- 172.21.15.5:0/843555214 >> v2:172.21.15.80:3300/0 conn(0x7f975c15ddf0 msgr2=0x7f975c0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f9760958640 1 --2- 172.21.15.5:0/843555214 >> v2:172.21.15.80:3300/0 conn(0x7f975c15ddf0 0x7f975c0b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f9760958640 1 -- 172.21.15.5:0/843555214 >> v1:172.21.15.80:6789/0 conn(0x7f975c0d0840 legacy=0x7f975c0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f9760958640 1 -- 172.21.15.5:0/843555214 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0cf040 con 0x7f975c0ceb40 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f9761159640 1 --2- 172.21.15.5:0/843555214 >> v2:172.21.15.80:3300/0 conn(0x7f975c15ddf0 0x7f975c0b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f9760958640 1 --2- 172.21.15.5:0/843555214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0ceb40 0x7f975c1624b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f975c073030 tx=0x7f975002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8def41ec75e770ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f975bfff640 1 -- 172.21.15.5:0/843555214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750037070 con 0x7f975c0ceb40 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f975bfff640 1 -- 172.21.15.5:0/843555214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750032440 con 0x7f975c0ceb40 2024-04-25T08:56:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.162+0000 7f975bfff640 1 -- 172.21.15.5:0/843555214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750032810 con 0x7f975c0ceb40 2024-04-25T08:56:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 -- 172.21.15.5:0/843555214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0ceb40 msgr2=0x7f975c1624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 --2- 172.21.15.5:0/843555214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0ceb40 0x7f975c1624b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f975c073030 tx=0x7f975002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 -- 172.21.15.5:0/843555214 shutdown_connections 2024-04-25T08:56:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 --2- 172.21.15.5:0/843555214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0ceb40 0x7f975c1624b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 --2- 172.21.15.5:0/843555214 >> v2:172.21.15.80:3300/0 conn(0x7f975c15ddf0 0x7f975c0b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 -- 172.21.15.5:0/843555214 >> 172.21.15.5:0/843555214 conn(0x7f975c066ad0 msgr2=0x7f975c066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 -- 172.21.15.5:0/843555214 shutdown_connections 2024-04-25T08:56:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.163+0000 7f97633bd640 1 -- 172.21.15.5:0/843555214 wait complete. 2024-04-25T08:56:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.164+0000 7f97633bd640 1 Processor -- start 2024-04-25T08:56:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.164+0000 7f97633bd640 1 -- start start 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f97633bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f975c0ceb40 0x7f975c0cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f97633bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0d0840 0x7f975c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f97633bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975c15ddf0 0x7f975c161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f97633bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0d24a0 con 0x7f975c0d0840 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f97633bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0d21c0 con 0x7f975c15ddf0 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f97633bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15e1d0 con 0x7f975c0ceb40 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0d0840 0x7f975c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0d0840 0x7f975c0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35630/0 (socket says 172.21.15.5:35630) 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 -- 172.21.15.5:0/370453988 learned_addr learned my addr 172.21.15.5:0/370453988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 -- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f975c0ceb40 msgr2=0x7f975c0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f975c0ceb40 0x7f975c0cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 -- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975c15ddf0 msgr2=0x7f975c161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f976195a640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975c15ddf0 0x7f975c161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975c15ddf0 0x7f975c161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.165+0000 7f9760958640 1 -- 172.21.15.5:0/370453988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c161640 con 0x7f975c0d0840 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.166+0000 7f9760958640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0d0840 0x7f975c0cc630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f975002a1e0 tx=0x7f97500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.166+0000 7f9759ffb640 1 -- 172.21.15.5:0/370453988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750037040 con 0x7f975c0d0840 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.166+0000 7f9759ffb640 1 -- 172.21.15.5:0/370453988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750042070 con 0x7f975c0d0840 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.166+0000 7f9759ffb640 1 -- 172.21.15.5:0/370453988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750030bb0 con 0x7f975c0d0840 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.166+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c15ee70 con 0x7f975c0d0840 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.166+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c15f430 con 0x7f975c0d0840 2024-04-25T08:56:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.167+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c04ef20 con 0x7f975c0d0840 2024-04-25T08:56:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.168+0000 7f9759ffb640 1 -- 172.21.15.5:0/370453988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9750047460 con 0x7f975c0d0840 2024-04-25T08:56:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.168+0000 7f9759ffb640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f974806b4d0 0x7f974806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.168+0000 7f9759ffb640 1 -- 172.21.15.5:0/370453988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f97500aab30 con 0x7f975c0d0840 2024-04-25T08:56:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.168+0000 7f9761159640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f974806b4d0 0x7f974806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.169+0000 7f9761159640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f974806b4d0 0x7f974806d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9754006fd0 tx=0x7f9754008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.172+0000 7f9759ffb640 1 -- 172.21.15.5:0/370453988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f975c0ce800 con 0x7f975c0d0840 2024-04-25T08:56:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:42.354+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f975c0d18d0 con 0x7f975c0d0840 2024-04-25T08:56:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.183+0000 7f9759ffb640 1 -- 172.21.15.5:0/370453988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9750045360 con 0x7f975c0d0840 2024-04-25T08:56:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T08:56:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f974806b4d0 msgr2=0x7f974806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f974806b4d0 0x7f974806d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9754006fd0 tx=0x7f9754008040 comp rx=0 tx=0).stop 2024-04-25T08:56:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0d0840 msgr2=0x7f975c0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0d0840 0x7f975c0cc630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f975002a1e0 tx=0x7f97500046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 shutdown_connections 2024-04-25T08:56:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f974806b4d0 0x7f974806d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975c15ddf0 0x7f975c161100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975c0d0840 0x7f975c0cc630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 --2- 172.21.15.5:0/370453988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f975c0ceb40 0x7f975c0cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 >> 172.21.15.5:0/370453988 conn(0x7f975c066ad0 msgr2=0x7f975c162180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 shutdown_connections 2024-04-25T08:56:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.187+0000 7f97633bd640 1 -- 172.21.15.5:0/370453988 wait complete. 2024-04-25T08:56:43.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:56:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 Processor -- start 2024-04-25T08:56:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 -- start start 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe91015bce0 0x7fe91006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100cf790 0x7fe9100cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9100b3480 0x7fe9100b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91015c0c0 con 0x7fe91015bce0 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe910070e90 con 0x7fe9100b3480 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.317+0000 7fe91646f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe910071170 con 0x7fe9100cf790 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe91015bce0 0x7fe91006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe91015bce0 0x7fe91006c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35634/0 (socket says 172.21.15.5:35634) 2024-04-25T08:56:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 -- 172.21.15.5:0/3430353459 learned_addr learned my addr 172.21.15.5:0/3430353459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 -- 172.21.15.5:0/3430353459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100cf790 msgr2=0x7fe9100cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 --2- 172.21.15.5:0/3430353459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100cf790 0x7fe9100cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 -- 172.21.15.5:0/3430353459 >> v2:172.21.15.80:3300/0 conn(0x7fe9100b3480 msgr2=0x7fe9100b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe914a0c640 1 --2- 172.21.15.5:0/3430353459 >> v2:172.21.15.80:3300/0 conn(0x7fe9100b3480 0x7fe9100b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 --2- 172.21.15.5:0/3430353459 >> v2:172.21.15.80:3300/0 conn(0x7fe9100b3480 0x7fe9100b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe90ffff640 1 -- 172.21.15.5:0/3430353459 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910071450 con 0x7fe91015bce0 2024-04-25T08:56:43.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.318+0000 7fe914a0c640 1 --2- 172.21.15.5:0/3430353459 >> v2:172.21.15.80:3300/0 conn(0x7fe9100b3480 0x7fe9100b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe90ffff640 1 --2- 172.21.15.5:0/3430353459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe91006c400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe910074c30 tx=0x7fe90002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589f025a7c2c5f29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:43.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe90effd640 1 -- 172.21.15.5:0/3430353459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900037070 con 0x7fe91015bce0 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe90effd640 1 -- 172.21.15.5:0/3430353459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe900032440 con 0x7fe91015bce0 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe90effd640 1 -- 172.21.15.5:0/3430353459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900032810 con 0x7fe91015bce0 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 -- 172.21.15.5:0/3430353459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 msgr2=0x7fe91006c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 --2- 172.21.15.5:0/3430353459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe91006c400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe910074c30 tx=0x7fe90002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 -- 172.21.15.5:0/3430353459 shutdown_connections 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 --2- 172.21.15.5:0/3430353459 >> v2:172.21.15.80:3300/0 conn(0x7fe9100b3480 0x7fe9100b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 --2- 172.21.15.5:0/3430353459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100cf790 0x7fe9100cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 --2- 172.21.15.5:0/3430353459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe91006c400 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 -- 172.21.15.5:0/3430353459 >> 172.21.15.5:0/3430353459 conn(0x7fe9100b1550 msgr2=0x7fe9100b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.319+0000 7fe91646f640 1 -- 172.21.15.5:0/3430353459 shutdown_connections 2024-04-25T08:56:43.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.320+0000 7fe91646f640 1 -- 172.21.15.5:0/3430353459 wait complete. 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.321+0000 7fe91646f640 1 Processor -- start 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.321+0000 7fe91646f640 1 -- start start 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.321+0000 7fe91646f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100b3480 0x7fe910157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.321+0000 7fe91646f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9100cf790 0x7fe9100adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe91646f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe910153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe91646f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100b4140 con 0x7fe91015bce0 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe91646f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100b3e30 con 0x7fe9100cf790 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe91646f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91006c940 con 0x7fe9100b3480 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe910153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe910153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35640/0 (socket says 172.21.15.5:35640) 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 -- 172.21.15.5:0/2832280027 learned_addr learned my addr 172.21.15.5:0/2832280027 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe90f7fe640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9100cf790 0x7fe9100adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe90ffff640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100b3480 0x7fe910157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 -- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100b3480 msgr2=0x7fe910157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100b3480 0x7fe910157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 -- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9100cf790 msgr2=0x7fe9100adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9100cf790 0x7fe9100adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 -- 172.21.15.5:0/2832280027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910158e50 con 0x7fe91015bce0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe914a0c640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe910153ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe90800cef0 tx=0x7fe90800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe90cff9640 1 -- 172.21.15.5:0/2832280027 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90801a070 con 0x7fe91015bce0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe90cff9640 1 -- 172.21.15.5:0/2832280027 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90800d840 con 0x7fe91015bce0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9101585b0 con 0x7fe91015bce0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe90cff9640 1 -- 172.21.15.5:0/2832280027 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800dc30 con 0x7fe91015bce0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.322+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe910158b70 con 0x7fe91015bce0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.323+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe910158040 con 0x7fe91015bce0 2024-04-25T08:56:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.324+0000 7fe90cff9640 1 -- 172.21.15.5:0/2832280027 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe90801d070 con 0x7fe91015bce0 2024-04-25T08:56:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.324+0000 7fe90cff9640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe8fc06b4d0 0x7fe8fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.324+0000 7fe90cff9640 1 -- 172.21.15.5:0/2832280027 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe90808a7a0 con 0x7fe91015bce0 2024-04-25T08:56:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.325+0000 7fe90ffff640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe8fc06b4d0 0x7fe8fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.325+0000 7fe90ffff640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe8fc06b4d0 0x7fe8fc06d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe900034000 tx=0x7fe90002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.329+0000 7fe90cff9640 1 -- 172.21.15.5:0/2832280027 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9080591b0 con 0x7fe91015bce0 2024-04-25T08:56:43.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:43.510+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe91004ef20 con 0x7fe91015bce0 2024-04-25T08:56:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.189+0000 7fe90cff9640 1 -- 172.21.15.5:0/2832280027 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe90805d250 con 0x7fe91015bce0 2024-04-25T08:56:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T08:56:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe8fc06b4d0 msgr2=0x7fe8fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe8fc06b4d0 0x7fe8fc06d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe900034000 tx=0x7fe90002e000 comp rx=0 tx=0).stop 2024-04-25T08:56:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 msgr2=0x7fe910153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe910153ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe90800cef0 tx=0x7fe90800a710 comp rx=0 tx=0).stop 2024-04-25T08:56:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 shutdown_connections 2024-04-25T08:56:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe8fc06b4d0 0x7fe8fc06d990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91015bce0 0x7fe910153ec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9100cf790 0x7fe9100adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 --2- 172.21.15.5:0/2832280027 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9100b3480 0x7fe910157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.193+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 >> 172.21.15.5:0/2832280027 conn(0x7fe9100b1550 msgr2=0x7fe9100afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.194+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 shutdown_connections 2024-04-25T08:56:44.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.196+0000 7fe91646f640 1 -- 172.21.15.5:0/2832280027 wait complete. 2024-04-25T08:56:44.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:56:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.330+0000 7f6d67389640 1 Processor -- start 2024-04-25T08:56:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.331+0000 7f6d67389640 1 -- start start 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.331+0000 7f6d67389640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d60162380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.331+0000 7f6d67389640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d6015e040 0x7f6d600d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.331+0000 7f6d67389640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d600ce7b0 con 0x7f6d600d09b0 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.331+0000 7f6d67389640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d600d0e40 con 0x7f6d6015e040 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.331+0000 7f6d67389640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600b6cd0 con 0x7f6d6015dc60 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d64924640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d6015e040 0x7f6d600d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d64924640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d6015e040 0x7f6d600d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35642/0 (socket says 172.21.15.5:35642) 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d64924640 1 -- 172.21.15.5:0/1053799840 learned_addr learned my addr 172.21.15.5:0/1053799840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d65926640 1 --1- 172.21.15.5:0/1053799840 >> v1:172.21.15.5:6789/0 conn(0x7f6d600d09b0 0x7f6d600b55f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57950/0 (socket says 172.21.15.5:57950) 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d65125640 1 --2- 172.21.15.5:0/1053799840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d60162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d64924640 1 -- 172.21.15.5:0/1053799840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 msgr2=0x7f6d60162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d64924640 1 --2- 172.21.15.5:0/1053799840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d60162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d64924640 1 -- 172.21.15.5:0/1053799840 >> v1:172.21.15.5:6789/0 conn(0x7f6d600d09b0 legacy=0x7f6d600b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d64924640 1 -- 172.21.15.5:0/1053799840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600cea90 con 0x7f6d6015e040 2024-04-25T08:56:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.332+0000 7f6d57fff640 1 -- 172.21.15.5:0/1053799840 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516355071 0 0) 0x7f6d600ce7b0 con 0x7f6d600d09b0 2024-04-25T08:56:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d64924640 1 --2- 172.21.15.5:0/1053799840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600d0470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d500098a0 tx=0x7f6d5002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d307794dd45f1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d57fff640 1 -- 172.21.15.5:0/1053799840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50037070 con 0x7f6d6015e040 2024-04-25T08:56:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d57fff640 1 -- 172.21.15.5:0/1053799840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50032440 con 0x7f6d6015e040 2024-04-25T08:56:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d57fff640 1 -- 172.21.15.5:0/1053799840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50032810 con 0x7f6d6015e040 2024-04-25T08:56:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d67389640 1 -- 172.21.15.5:0/1053799840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 msgr2=0x7f6d600d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d67389640 1 --2- 172.21.15.5:0/1053799840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600d0470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d500098a0 tx=0x7f6d5002a290 comp rx=0 tx=0).stop 2024-04-25T08:56:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d67389640 1 -- 172.21.15.5:0/1053799840 shutdown_connections 2024-04-25T08:56:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d67389640 1 --2- 172.21.15.5:0/1053799840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600d0470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d67389640 1 --2- 172.21.15.5:0/1053799840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d60162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.333+0000 7f6d67389640 1 -- 172.21.15.5:0/1053799840 >> 172.21.15.5:0/1053799840 conn(0x7f6d600668f0 msgr2=0x7f6d60066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.334+0000 7f6d67389640 1 -- 172.21.15.5:0/1053799840 shutdown_connections 2024-04-25T08:56:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.334+0000 7f6d67389640 1 -- 172.21.15.5:0/1053799840 wait complete. 2024-04-25T08:56:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 Processor -- start 2024-04-25T08:56:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 -- start start 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d600d09b0 0x7f6d600cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d600b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600b3220 con 0x7f6d6015e040 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600cf050 con 0x7f6d600d09b0 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d67389640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600cf330 con 0x7f6d6015dc60 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.335+0000 7f6d65926640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35656/0 (socket says 172.21.15.5:35656) 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 -- 172.21.15.5:0/2787851750 learned_addr learned my addr 172.21.15.5:0/2787851750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d64924640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d600b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65125640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d600d09b0 0x7f6d600cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 -- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 msgr2=0x7f6d600b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d600b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 -- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d600d09b0 msgr2=0x7f6d600cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d600d09b0 0x7f6d600cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 -- 172.21.15.5:0/2787851750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600cda20 con 0x7f6d6015e040 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d65926640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600c9d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800c7a0 tx=0x7f6d5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d55ffb640 1 -- 172.21.15.5:0/2787851750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58018070 con 0x7f6d6015e040 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d55ffb640 1 -- 172.21.15.5:0/2787851750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5800a640 con 0x7f6d6015e040 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d55ffb640 1 -- 172.21.15.5:0/2787851750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5800aab0 con 0x7f6d6015e040 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d60149f00 con 0x7f6d6015e040 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.336+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6014a4c0 con 0x7f6d6015e040 2024-04-25T08:56:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.337+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6004ef20 con 0x7f6d6015e040 2024-04-25T08:56:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.338+0000 7f6d55ffb640 1 -- 172.21.15.5:0/2787851750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d5800ac50 con 0x7f6d6015e040 2024-04-25T08:56:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.338+0000 7f6d55ffb640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d4406b4d0 0x7f6d4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.338+0000 7f6d55ffb640 1 -- 172.21.15.5:0/2787851750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6d58089710 con 0x7f6d6015e040 2024-04-25T08:56:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.338+0000 7f6d65125640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d4406b4d0 0x7f6d4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.339+0000 7f6d65125640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d4406b4d0 0x7f6d4406d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009b40 tx=0x7f6d5c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.343+0000 7f6d55ffb640 1 -- 172.21.15.5:0/2787851750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d58057fa0 con 0x7f6d6015e040 2024-04-25T08:56:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:44.559+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d600d1910 con 0x7f6d6015e040 2024-04-25T08:56:45.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.197+0000 7f6d55ffb640 1 -- 172.21.15.5:0/2787851750 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6d5805c040 con 0x7f6d6015e040 2024-04-25T08:56:45.190 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.202+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d4406b4d0 msgr2=0x7f6d4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.202+0000 7f6d67389640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d4406b4d0 0x7f6d4406d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009b40 tx=0x7f6d5c009190 comp rx=0 tx=0).stop 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.202+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 msgr2=0x7f6d600c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.202+0000 7f6d67389640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600c9d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800c7a0 tx=0x7f6d5800cc60 comp rx=0 tx=0).stop 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.203+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 shutdown_connections 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.203+0000 7f6d67389640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d4406b4d0 0x7f6d4406d990 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009b40 tx=0x7f6d5c009190 comp rx=0 tx=0).stop 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.203+0000 7f6d67389640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d6015e040 0x7f6d600c9d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.203+0000 7f6d67389640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d6015dc60 0x7f6d600b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.203+0000 7f6d67389640 1 --2- 172.21.15.5:0/2787851750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d600d09b0 0x7f6d600cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.203+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 >> 172.21.15.5:0/2787851750 conn(0x7f6d600668f0 msgr2=0x7f6d6015e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:45.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.206+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 shutdown_connections 2024-04-25T08:56:45.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.207+0000 7f6d67389640 1 -- 172.21.15.5:0/2787851750 wait complete. 2024-04-25T08:56:45.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.334+0000 7f245fe53640 1 Processor -- start 2024-04-25T08:56:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.335+0000 7f245fe53640 1 -- start start 2024-04-25T08:56:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.335+0000 7f245fe53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 0x7f24580ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.335+0000 7f245fe53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245806ba50 con 0x7f24580b0e30 2024-04-25T08:56:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.335+0000 7f245fe53640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245806bd30 con 0x7f24580cbf40 2024-04-25T08:56:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.335+0000 7f245fe53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245806b800 con 0x7f24580b0a50 2024-04-25T08:56:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.335+0000 7f245d3ee640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f24580b0e30 0x7f24580d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57956/0 (socket says 172.21.15.5:57956) 2024-04-25T08:56:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.335+0000 7f245d3ee640 1 -- 172.21.15.5:0/2394596520 learned_addr learned my addr 172.21.15.5:0/2394596520 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:45.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245dbef640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 0x7f24580ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572168364 0 0) 0x7f245806ba50 con 0x7f24580b0e30 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2444003520 con 0x7f24580b0e30 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2801551976 0 0) 0x7f2444003520 con 0x7f24580b0e30 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 msgr2=0x7f24580ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 0x7f24580ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 >> v1:172.21.15.80:6789/0 conn(0x7f24580cbf40 legacy=0x7f24580b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245806c010 con 0x7f24580b0e30 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2448001670 con 0x7f24580b0e30 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 >> v1:172.21.15.5:6789/0 conn(0x7f24580b0e30 legacy=0x7f24580d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24440039e0 0x7f2444003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2444004390 0x7f2444004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 0x7f2444005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245806b800 con 0x7f24440039e0 2024-04-25T08:56:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244400ba70 con 0x7f2444004390 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244400bc70 con 0x7f24580b0a50 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245dbef640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24440039e0 0x7f2444003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245d3ee640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2444004390 0x7f2444004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245e3f0640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 0x7f2444005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245dbef640 1 -- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 msgr2=0x7f2444005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245dbef640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24580b0a50 0x7f2444005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245dbef640 1 -- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2444004390 msgr2=0x7f2444004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245dbef640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2444004390 0x7f2444004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.336+0000 7f245dbef640 1 -- 172.21.15.5:0/2394596520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2444003520 con 0x7f24440039e0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.337+0000 7f245dbef640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24440039e0 0x7f2444003dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2454009ac0 tx=0x7f2444005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3817e36f704a8991 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.337+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454036070 con 0x7f24440039e0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.337+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454031400 con 0x7f24440039e0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.337+0000 7f245cbed640 1 -- 172.21.15.5:0/2394596520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454009690 con 0x7f24440039e0 2024-04-25T08:56:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.338+0000 7f245fe53640 1 -- 172.21.15.5:0/2394596520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24440039e0 msgr2=0x7f2444003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.338+0000 7f245fe53640 1 --2- 172.21.15.5:0/2394596520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24440039e0 0x7f2444003dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2454009ac0 tx=0x7f2444005830 comp rx=0 tx=0).stop 2024-04-25T08:56:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.338+0000 7f245e3f0640 1 -- 172.21.15.5:0/2394596520 reap_dead start 2024-04-25T08:56:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.338+0000 7f245fe53640 1 -- 172.21.15.5:0/2394596520 shutdown_connections 2024-04-25T08:56:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.338+0000 7f245fe53640 1 -- 172.21.15.5:0/2394596520 >> 172.21.15.5:0/2394596520 conn(0x7f24580d18f0 msgr2=0x7f24580d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.338+0000 7f245fe53640 1 -- 172.21.15.5:0/2394596520 shutdown_connections 2024-04-25T08:56:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.338+0000 7f245fe53640 1 -- 172.21.15.5:0/2394596520 wait complete. 2024-04-25T08:56:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.339+0000 7f245fe53640 1 Processor -- start 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.339+0000 7f245fe53640 1 -- start start 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245fe53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24440039e0 0x7f24580c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245fe53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2458152b80 0x7f24580d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245fe53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2458149420 0x7f24581498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245fe53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580b2bf0 con 0x7f2458149420 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245fe53640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580cfd60 con 0x7f24440039e0 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245fe53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458158610 con 0x7f2458152b80 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2458149420 0x7f24581498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2458149420 0x7f24581498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35680/0 (socket says 172.21.15.5:35680) 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 -- 172.21.15.5:0/3243762636 learned_addr learned my addr 172.21.15.5:0/3243762636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245dbef640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24440039e0 0x7f24580c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245d3ee640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2458152b80 0x7f24580d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 -- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2458152b80 msgr2=0x7f24580d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2458152b80 0x7f24580d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 -- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24440039e0 msgr2=0x7f24580c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24440039e0 0x7f24580c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 -- 172.21.15.5:0/3243762636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580c9540 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245dbef640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24440039e0 0x7f24580c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245d3ee640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2458152b80 0x7f24580d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.340+0000 7f245e3f0640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2458149420 0x7f24581498a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f24580cf8a0 tx=0x7f245000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.341+0000 7f244e7fc640 1 -- 172.21.15.5:0/3243762636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450003b80 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.341+0000 7f244e7fc640 1 -- 172.21.15.5:0/3243762636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450018070 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.341+0000 7f244e7fc640 1 -- 172.21.15.5:0/3243762636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500050d0 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.341+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2458159c40 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.341+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245815a200 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.342+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245804ef20 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.342+0000 7f244e7fc640 1 -- 172.21.15.5:0/3243762636 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2450005270 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.342+0000 7f244e7fc640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f243c06b500 0x7f243c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.343+0000 7f244e7fc640 1 -- 172.21.15.5:0/3243762636 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f245008a180 con 0x7f2458149420 2024-04-25T08:56:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.343+0000 7f245dbef640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f243c06b500 0x7f243c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.343+0000 7f245dbef640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f243c06b500 0x7f243c06d9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2454033000 tx=0x7f2454008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.347+0000 7f244e7fc640 1 -- 172.21.15.5:0/3243762636 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f245001a310 con 0x7f2458149420 2024-04-25T08:56:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.527+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24580726d0 con 0x7f2458149420 2024-04-25T08:56:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.529+0000 7f244e7fc640 1 -- 172.21.15.5:0/3243762636 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f2450059090 con 0x7f2458149420 2024-04-25T08:56:45.519 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:45.519 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:44.561326+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f243c06b500 msgr2=0x7f243c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f243c06b500 0x7f243c06d9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2454033000 tx=0x7f2454008030 comp rx=0 tx=0).stop 2024-04-25T08:56:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2458149420 msgr2=0x7f24581498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2458149420 0x7f24581498a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f24580cf8a0 tx=0x7f245000ff70 comp rx=0 tx=0).stop 2024-04-25T08:56:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 shutdown_connections 2024-04-25T08:56:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f243c06b500 0x7f243c06d9c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2458149420 0x7f24581498a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2458152b80 0x7f24580d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 --2- 172.21.15.5:0/3243762636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24440039e0 0x7f24580c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 >> 172.21.15.5:0/3243762636 conn(0x7f24580d18f0 msgr2=0x7f245806f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 shutdown_connections 2024-04-25T08:56:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.531+0000 7f245fe53640 1 -- 172.21.15.5:0/3243762636 wait complete. 2024-04-25T08:56:45.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.642+0000 7f34ba916640 1 Processor -- start 2024-04-25T08:56:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.642+0000 7f34ba916640 1 -- start start 2024-04-25T08:56:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34ba916640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34b40d3df0 0x7f34b40b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34ba916640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40b29c0 con 0x7f34b40d3990 2024-04-25T08:56:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34ba916640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40d2080 con 0x7f34b415e0a0 2024-04-25T08:56:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34ba916640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b40d1460 con 0x7f34b40d3df0 2024-04-25T08:56:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34b8eb3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34b40d3df0 0x7f34b40b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34b8eb3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34b40d3df0 0x7f34b40b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35696/0 (socket says 172.21.15.5:35696) 2024-04-25T08:56:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1952567863 learned_addr learned my addr 172.21.15.5:0/1952567863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34b37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f34b40d3990 0x7f34b40b6f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57960/0 (socket says 172.21.15.5:57960) 2024-04-25T08:56:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1952567863 >> v1:172.21.15.80:6789/0 conn(0x7f34b415e0a0 legacy=0x7f34b40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1952567863 >> v1:172.21.15.5:6789/0 conn(0x7f34b40d3990 legacy=0x7f34b40b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.643+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1952567863 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b40d2360 con 0x7f34b40d3df0 2024-04-25T08:56:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.644+0000 7f34b8eb3640 1 --2- 172.21.15.5:0/1952567863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b40d3df0 0x7f34b40b7660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009e50 tx=0x7f34ac02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3a9dc33baf12dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.644+0000 7f34b2ffd640 1 -- 172.21.15.5:0/1952567863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac036070 con 0x7f34b40d3df0 2024-04-25T08:56:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.644+0000 7f34b2ffd640 1 -- 172.21.15.5:0/1952567863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac031600 con 0x7f34b40d3df0 2024-04-25T08:56:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.644+0000 7f34b2ffd640 1 -- 172.21.15.5:0/1952567863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac0319f0 con 0x7f34b40d3df0 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.645+0000 7f34ba916640 1 -- 172.21.15.5:0/1952567863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b40d3df0 msgr2=0x7f34b40b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.645+0000 7f34ba916640 1 --2- 172.21.15.5:0/1952567863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b40d3df0 0x7f34b40b7660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009e50 tx=0x7f34ac02a7c0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.645+0000 7f34ba916640 1 -- 172.21.15.5:0/1952567863 shutdown_connections 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.645+0000 7f34ba916640 1 --2- 172.21.15.5:0/1952567863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b40d3df0 0x7f34b40b7660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.645+0000 7f34ba916640 1 -- 172.21.15.5:0/1952567863 >> 172.21.15.5:0/1952567863 conn(0x7f34b40668f0 msgr2=0x7f34b4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.645+0000 7f34ba916640 1 -- 172.21.15.5:0/1952567863 shutdown_connections 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.645+0000 7f34ba916640 1 -- 172.21.15.5:0/1952567863 wait complete. 2024-04-25T08:56:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.646+0000 7f34ba916640 1 Processor -- start 2024-04-25T08:56:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.646+0000 7f34ba916640 1 -- start start 2024-04-25T08:56:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34ba916640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b40d3990 0x7f34b41593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34ba916640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34b40d3df0 0x7f34b40cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34ba916640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b415e0a0 0x7f34b40c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34ba916640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40d2c00 con 0x7f34b415e0a0 2024-04-25T08:56:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34ba916640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40d2920 con 0x7f34b40d3990 2024-04-25T08:56:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34ba916640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40d4280 con 0x7f34b40d3df0 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b415e0a0 0x7f34b40c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b415e0a0 0x7f34b40c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35708/0 (socket says 172.21.15.5:35708) 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1398673262 learned_addr learned my addr 172.21.15.5:0/1398673262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b3fff640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b40d3990 0x7f34b41593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b37fe640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34b40d3df0 0x7f34b40cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34b40d3df0 msgr2=0x7f34b40cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34b40d3df0 0x7f34b40cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b40d3990 msgr2=0x7f34b41593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b40d3990 0x7f34b41593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 -- 172.21.15.5:0/1398673262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b4159920 con 0x7f34b415e0a0 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b3fff640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b40d3990 0x7f34b41593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b37fe640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34b40d3df0 0x7f34b40cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.647+0000 7f34b8eb3640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b415e0a0 0x7f34b40c9880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34ac034040 tx=0x7f34ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.648+0000 7f34b0ff9640 1 -- 172.21.15.5:0/1398673262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac036050 con 0x7f34b415e0a0 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.648+0000 7f34b0ff9640 1 -- 172.21.15.5:0/1398673262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac042070 con 0x7f34b415e0a0 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.648+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b40cd720 con 0x7f34b415e0a0 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.648+0000 7f34b0ff9640 1 -- 172.21.15.5:0/1398673262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac009510 con 0x7f34b415e0a0 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.648+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b40cc490 con 0x7f34b415e0a0 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.649+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b4067fc0 con 0x7f34b415e0a0 2024-04-25T08:56:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.649+0000 7f34b0ff9640 1 -- 172.21.15.5:0/1398673262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34ac004470 con 0x7f34b415e0a0 2024-04-25T08:56:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.649+0000 7f34b0ff9640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34a006b4d0 0x7f34a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.650+0000 7f34b0ff9640 1 -- 172.21.15.5:0/1398673262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34ac0ab0b0 con 0x7f34b415e0a0 2024-04-25T08:56:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.650+0000 7f34b3fff640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34a006b4d0 0x7f34a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.650+0000 7f34b3fff640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34a006b4d0 0x7f34a006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34a8001680 tx=0x7f34a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.654+0000 7f34b0ff9640 1 -- 172.21.15.5:0/1398673262 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34b4067fc0 con 0x7f34b415e0a0 2024-04-25T08:56:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.838+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34b404ef20 con 0x7f34b415e0a0 2024-04-25T08:56:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.839+0000 7f34b0ff9640 1 -- 172.21.15.5:0/1398673262 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f34ac079fc0 con 0x7f34b415e0a0 2024-04-25T08:56:45.829 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:45.829 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:44.561326+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34a006b4d0 msgr2=0x7f34a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34a006b4d0 0x7f34a006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34a8001680 tx=0x7f34a8009040 comp rx=0 tx=0).stop 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b415e0a0 msgr2=0x7f34b40c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b415e0a0 0x7f34b40c9880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34ac034040 tx=0x7f34ac004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 shutdown_connections 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34a006b4d0 0x7f34a006d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34b415e0a0 0x7f34b40c9880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34b40d3df0 0x7f34b40cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 --2- 172.21.15.5:0/1398673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b40d3990 0x7f34b41593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 >> 172.21.15.5:0/1398673262 conn(0x7f34b40668f0 msgr2=0x7f34b415f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 shutdown_connections 2024-04-25T08:56:45.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.841+0000 7f34ba916640 1 -- 172.21.15.5:0/1398673262 wait complete. 2024-04-25T08:56:45.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:56:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.955+0000 7f2820088640 1 Processor -- start 2024-04-25T08:56:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.955+0000 7f2820088640 1 -- start start 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f2820088640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28180ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f2820088640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2818162150 con 0x7f281815df10 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f2820088640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2818162430 con 0x7f28180cee10 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f2820088640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180d20d0 con 0x7f28180b6250 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f281de24640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f281815df10 0x7f28181618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57962/0 (socket says 172.21.15.5:57962) 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f281de24640 1 -- 172.21.15.5:0/3894357121 learned_addr learned my addr 172.21.15.5:0/3894357121 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f281d623640 1 --2- 172.21.15.5:0/3894357121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28180ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f281ce22640 1 -- 172.21.15.5:0/3894357121 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424372302 0 0) 0x7f2818162150 con 0x7f281815df10 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.956+0000 7f281ce22640 1 -- 172.21.15.5:0/3894357121 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2804003520 con 0x7f281815df10 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.957+0000 7f281ce22640 1 -- 172.21.15.5:0/3894357121 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394585237 0 0) 0x7f2818162430 con 0x7f28180cee10 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.957+0000 7f281ce22640 1 -- 172.21.15.5:0/3894357121 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2818162150 con 0x7f28180cee10 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.957+0000 7f281d623640 1 -- 172.21.15.5:0/3894357121 >> v1:172.21.15.80:6789/0 conn(0x7f28180cee10 legacy=0x7f28180d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.957+0000 7f281d623640 1 -- 172.21.15.5:0/3894357121 >> v1:172.21.15.5:6789/0 conn(0x7f281815df10 legacy=0x7f28181618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.957+0000 7f281d623640 1 -- 172.21.15.5:0/3894357121 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818162710 con 0x7f28180b6250 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.957+0000 7f281d623640 1 --2- 172.21.15.5:0/3894357121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28180ce8d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28080097d0 tx=0x7f280802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9634a3385af2c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.957+0000 7f281ce22640 1 -- 172.21.15.5:0/3894357121 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808037070 con 0x7f28180b6250 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f281ce22640 1 -- 172.21.15.5:0/3894357121 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808032440 con 0x7f28180b6250 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f281ce22640 1 -- 172.21.15.5:0/3894357121 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28080327f0 con 0x7f28180b6250 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f2820088640 1 -- 172.21.15.5:0/3894357121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 msgr2=0x7f28180ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f2820088640 1 --2- 172.21.15.5:0/3894357121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28180ce8d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28080097d0 tx=0x7f280802a210 comp rx=0 tx=0).stop 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f2820088640 1 -- 172.21.15.5:0/3894357121 shutdown_connections 2024-04-25T08:56:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f2820088640 1 --2- 172.21.15.5:0/3894357121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28180ce8d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f2820088640 1 -- 172.21.15.5:0/3894357121 >> 172.21.15.5:0/3894357121 conn(0x7f28180668f0 msgr2=0x7f2818066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f2820088640 1 -- 172.21.15.5:0/3894357121 shutdown_connections 2024-04-25T08:56:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.958+0000 7f2820088640 1 -- 172.21.15.5:0/3894357121 wait complete. 2024-04-25T08:56:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.959+0000 7f2820088640 1 Processor -- start 2024-04-25T08:56:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.959+0000 7f2820088640 1 -- start start 2024-04-25T08:56:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f2820088640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28181f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f2820088640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28180cee10 0x7f28180cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f2820088640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f281815df10 0x7f28180d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f2820088640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180d2df0 con 0x7f28180cee10 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f2820088640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180d2c70 con 0x7f281815df10 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f2820088640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180d2f70 con 0x7f28180b6250 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28180cee10 0x7f28180cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28180cee10 0x7f28180cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35712/0 (socket says 172.21.15.5:35712) 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 -- 172.21.15.5:0/3960106855 learned_addr learned my addr 172.21.15.5:0/3960106855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281de24640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28181f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281e625640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f281815df10 0x7f28180d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 -- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 msgr2=0x7f28181f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28181f7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 -- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f281815df10 msgr2=0x7f28180d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f281815df10 0x7f28180d3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.960+0000 7f281d623640 1 -- 172.21.15.5:0/3960106855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28181f7800 con 0x7f28180cee10 2024-04-25T08:56:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.961+0000 7f281d623640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28180cee10 0x7f28180cccc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f280802a250 tx=0x7f28080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.961+0000 7f280e7fc640 1 -- 172.21.15.5:0/3960106855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808041020 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.961+0000 7f280e7fc640 1 -- 172.21.15.5:0/3960106855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280803d6e0 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.961+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28181f7ae0 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.961+0000 7f280e7fc640 1 -- 172.21.15.5:0/3960106855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808037040 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.961+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28180d4390 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.962+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28181f8000 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.962+0000 7f280e7fc640 1 -- 172.21.15.5:0/3960106855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2808044020 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.963+0000 7f280e7fc640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27fc06b4d0 0x7f27fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.963+0000 7f280e7fc640 1 -- 172.21.15.5:0/3960106855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28080aa9d0 con 0x7f28180cee10 2024-04-25T08:56:45.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.963+0000 7f281de24640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27fc06b4d0 0x7f27fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:45.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.963+0000 7f281de24640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27fc06b4d0 0x7f27fc06d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2810000f60 tx=0x7f2810009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:45.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:45.967+0000 7f280e7fc640 1 -- 172.21.15.5:0/3960106855 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f280804b030 con 0x7f28180cee10 2024-04-25T08:56:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.185+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f281804ef20 con 0x7f28180cee10 2024-04-25T08:56:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.202+0000 7f280e7fc640 1 -- 172.21.15.5:0/3960106855 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2808079860 con 0x7f28180cee10 2024-04-25T08:56:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27fc06b4d0 msgr2=0x7f27fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27fc06b4d0 0x7f27fc06d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2810000f60 tx=0x7f2810009040 comp rx=0 tx=0).stop 2024-04-25T08:56:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28180cee10 msgr2=0x7f28180cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28180cee10 0x7f28180cccc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f280802a250 tx=0x7f28080046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 shutdown_connections 2024-04-25T08:56:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27fc06b4d0 0x7f27fc06d990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f281815df10 0x7f28180d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28180cee10 0x7f28180cccc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 --2- 172.21.15.5:0/3960106855 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28180b6250 0x7f28181f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 >> 172.21.15.5:0/3960106855 conn(0x7f28180668f0 msgr2=0x7f28180b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 shutdown_connections 2024-04-25T08:56:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.204+0000 7f2820088640 1 -- 172.21.15.5:0/3960106855 wait complete. 2024-04-25T08:56:46.205 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:56:46.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:56:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.319+0000 7fb2f1093640 1 Processor -- start 2024-04-25T08:56:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.319+0000 7fb2f1093640 1 -- start start 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2f1093640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2ec15df10 0x7fb2ec1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2f1093640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0b6250 0x7fb2ec0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2f1093640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec162150 con 0x7fb2ec0cee10 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2f1093640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0d20d0 con 0x7fb2ec15df10 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2f1093640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec162430 con 0x7fb2ec0b6250 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2ead9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2ec15df10 0x7fb2ec1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2ead9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2ec15df10 0x7fb2ec1618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44020/0 (socket says 172.21.15.5:44020) 2024-04-25T08:56:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2ead9d640 1 -- 172.21.15.5:0/383386807 learned_addr learned my addr 172.21.15.5:0/383386807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.320+0000 7fb2ea59c640 1 --2- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0b6250 0x7fb2ec0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.321+0000 7fb2ead9d640 1 -- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0b6250 msgr2=0x7fb2ec0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.321+0000 7fb2ead9d640 1 --2- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0b6250 0x7fb2ec0ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.321+0000 7fb2ead9d640 1 -- 172.21.15.5:0/383386807 >> v1:172.21.15.80:6789/0 conn(0x7fb2ec0cee10 legacy=0x7fb2ec0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.321+0000 7fb2ead9d640 1 -- 172.21.15.5:0/383386807 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec162710 con 0x7fb2ec15df10 2024-04-25T08:56:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.321+0000 7fb2ea59c640 1 --2- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0b6250 0x7fb2ec0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:46.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.321+0000 7fb2ead9d640 1 --2- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec15df10 0x7fb2ec1618d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009e50 tx=0x7fb2dc02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bf5c65079873529 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:46.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2e9d9b640 1 -- 172.21.15.5:0/383386807 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc036070 con 0x7fb2ec15df10 2024-04-25T08:56:46.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2e9d9b640 1 -- 172.21.15.5:0/383386807 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc031600 con 0x7fb2ec15df10 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2e9d9b640 1 -- 172.21.15.5:0/383386807 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0319d0 con 0x7fb2ec15df10 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 -- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec15df10 msgr2=0x7fb2ec1618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 --2- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec15df10 0x7fb2ec1618d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009e50 tx=0x7fb2dc02a710 comp rx=0 tx=0).stop 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 -- 172.21.15.5:0/383386807 shutdown_connections 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 --2- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0b6250 0x7fb2ec0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 --2- 172.21.15.5:0/383386807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec15df10 0x7fb2ec1618d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 -- 172.21.15.5:0/383386807 >> 172.21.15.5:0/383386807 conn(0x7fb2ec0668f0 msgr2=0x7fb2ec066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 -- 172.21.15.5:0/383386807 shutdown_connections 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.322+0000 7fb2f1093640 1 -- 172.21.15.5:0/383386807 wait complete. 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 Processor -- start 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 -- start start 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec0b6250 0x7fb2ec1e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0cee10 0x7fb2ec1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec15df10 0x7fb2ec0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0d3570 con 0x7fb2ec15df10 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec161e10 con 0x7fb2ec0b6250 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.324+0000 7fb2f1093640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0d36f0 con 0x7fb2ec0cee10 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec0b6250 0x7fb2ec1e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2eb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec15df10 0x7fb2ec0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec0b6250 0x7fb2ec1e80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44030/0 (socket says 172.21.15.5:44030) 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 -- 172.21.15.5:0/3364937606 learned_addr learned my addr 172.21.15.5:0/3364937606 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ea59c640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0cee10 0x7fb2ec1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 -- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0cee10 msgr2=0x7fb2ec1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0cee10 0x7fb2ec1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 -- 172.21.15.5:0/3364937606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec15df10 msgr2=0x7fb2ec0c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec15df10 0x7fb2ec0c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 -- 172.21.15.5:0/3364937606 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0c7290 con 0x7fb2ec0b6250 2024-04-25T08:56:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2eb59e640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec15df10 0x7fb2ec0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2ead9d640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec0b6250 0x7fb2ec1e80d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc034040 tx=0x7fb2dc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2d37fe640 1 -- 172.21.15.5:0/3364937606 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc036050 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2d37fe640 1 -- 172.21.15.5:0/3364937606 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc042070 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0c7570 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2d37fe640 1 -- 172.21.15.5:0/3364937606 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc009510 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.325+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec0c7b30 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.327+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec04ef20 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.327+0000 7fb2d37fe640 1 -- 172.21.15.5:0/3364937606 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb2dc007c70 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.327+0000 7fb2d37fe640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb2d806b4d0 0x7fb2d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.327+0000 7fb2d37fe640 1 -- 172.21.15.5:0/3364937606 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2dc0aaf40 con 0x7fb2ec0b6250 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.328+0000 7fb2ea59c640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb2d806b4d0 0x7fb2d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.328+0000 7fb2ea59c640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb2d806b4d0 0x7fb2d806d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec15d820 tx=0x7fb2e0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:46.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.332+0000 7fb2d37fe640 1 -- 172.21.15.5:0/3364937606 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2dc0796d0 con 0x7fb2ec0b6250 2024-04-25T08:56:46.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:46.329 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:46.550+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb2ec0d1910 con 0x7fb2ec0b6250 2024-04-25T08:56:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.210+0000 7fb2d37fe640 1 -- 172.21.15.5:0/3364937606 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb2dc07d770 con 0x7fb2ec0b6250 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb2d806b4d0 msgr2=0x7fb2d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb2d806b4d0 0x7fb2d806d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec15d820 tx=0x7fb2e0009190 comp rx=0 tx=0).stop 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec0b6250 msgr2=0x7fb2ec1e80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec0b6250 0x7fb2ec1e80d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc034040 tx=0x7fb2dc004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 shutdown_connections 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb2d806b4d0 0x7fb2d806d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec15df10 0x7fb2ec0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2ec0cee10 0x7fb2ec1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 --2- 172.21.15.5:0/3364937606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2ec0b6250 0x7fb2ec1e80d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 >> 172.21.15.5:0/3364937606 conn(0x7fb2ec0668f0 msgr2=0x7fb2ec0b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 shutdown_connections 2024-04-25T08:56:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.213+0000 7fb2f1093640 1 -- 172.21.15.5:0/3364937606 wait complete. 2024-04-25T08:56:47.216 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:56:47.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:47.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.333+0000 7fa955df5640 1 Processor -- start 2024-04-25T08:56:47.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.333+0000 7fa955df5640 1 -- start start 2024-04-25T08:56:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa955df5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa95006b7d0 0x7fa95006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa955df5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9500b4730 con 0x7fa95006bbb0 2024-04-25T08:56:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa955df5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9500d0da0 con 0x7fa95015e120 2024-04-25T08:56:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa955df5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9500cbf30 con 0x7fa95006b7d0 2024-04-25T08:56:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa94f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa95006b7d0 0x7fa95006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa94effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa95006bbb0 0x7fa95015da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57972/0 (socket says 172.21.15.5:57972) 2024-04-25T08:56:47.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa94f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa95006b7d0 0x7fa95006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35740/0 (socket says 172.21.15.5:35740) 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.334+0000 7fa94effd640 1 -- 172.21.15.5:0/3759297067 learned_addr learned my addr 172.21.15.5:0/3759297067 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.335+0000 7fa94f7fe640 1 -- 172.21.15.5:0/3759297067 >> v1:172.21.15.80:6789/0 conn(0x7fa95015e120 legacy=0x7fa9500ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.335+0000 7fa94f7fe640 1 -- 172.21.15.5:0/3759297067 >> v1:172.21.15.5:6789/0 conn(0x7fa95006bbb0 legacy=0x7fa95015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.335+0000 7fa94f7fe640 1 -- 172.21.15.5:0/3759297067 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500cc180 con 0x7fa95006b7d0 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.335+0000 7fa94f7fe640 1 --2- 172.21.15.5:0/3759297067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95006aef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9400097a0 tx=0x7fa94002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d585d5f3355490c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.335+0000 7fa94e7fc640 1 -- 172.21.15.5:0/3759297067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940037070 con 0x7fa95006b7d0 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.335+0000 7fa94e7fc640 1 -- 172.21.15.5:0/3759297067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa940032440 con 0x7fa95006b7d0 2024-04-25T08:56:47.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.335+0000 7fa94e7fc640 1 -- 172.21.15.5:0/3759297067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940032810 con 0x7fa95006b7d0 2024-04-25T08:56:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.336+0000 7fa955df5640 1 -- 172.21.15.5:0/3759297067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 msgr2=0x7fa95006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.336+0000 7fa955df5640 1 --2- 172.21.15.5:0/3759297067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95006aef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9400097a0 tx=0x7fa94002a270 comp rx=0 tx=0).stop 2024-04-25T08:56:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.336+0000 7fa955df5640 1 -- 172.21.15.5:0/3759297067 shutdown_connections 2024-04-25T08:56:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.336+0000 7fa955df5640 1 --2- 172.21.15.5:0/3759297067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95006aef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.336+0000 7fa955df5640 1 -- 172.21.15.5:0/3759297067 >> 172.21.15.5:0/3759297067 conn(0x7fa9500d18e0 msgr2=0x7fa9500d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:47.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.336+0000 7fa955df5640 1 -- 172.21.15.5:0/3759297067 shutdown_connections 2024-04-25T08:56:47.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.336+0000 7fa955df5640 1 -- 172.21.15.5:0/3759297067 wait complete. 2024-04-25T08:56:47.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.337+0000 7fa955df5640 1 Processor -- start 2024-04-25T08:56:47.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.337+0000 7fa955df5640 1 -- start start 2024-04-25T08:56:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa955df5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa955df5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa95006bbb0 0x7fa9500cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa955df5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa95015e120 0x7fa9501601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa955df5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500d0630 con 0x7fa95006b7d0 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa955df5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500cc7d0 con 0x7fa95006bbb0 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa955df5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500d07b0 con 0x7fa95015e120 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa94f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa94f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95014df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35748/0 (socket says 172.21.15.5:35748) 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa94f7fe640 1 -- 172.21.15.5:0/1297195174 learned_addr learned my addr 172.21.15.5:0/1297195174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa94effd640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa95006bbb0 0x7fa9500cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.338+0000 7fa94ffff640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa95015e120 0x7fa9501601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa94f7fe640 1 -- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa95015e120 msgr2=0x7fa9501601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa94f7fe640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa95015e120 0x7fa9501601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa94f7fe640 1 -- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa95006bbb0 msgr2=0x7fa9500cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa94f7fe640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa95006bbb0 0x7fa9500cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa94f7fe640 1 -- 172.21.15.5:0/1297195174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95014e4a0 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa94f7fe640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95014df60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c00 tx=0x7fa9400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa937fff640 1 -- 172.21.15.5:0/1297195174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940037040 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa937fff640 1 -- 172.21.15.5:0/1297195174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa940042070 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9500c9560 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa937fff640 1 -- 172.21.15.5:0/1297195174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940030a70 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.339+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9500c9ae0 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.340+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95004ef20 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.340+0000 7fa937fff640 1 -- 172.21.15.5:0/1297195174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa940030c10 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.341+0000 7fa937fff640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa93c06b4d0 0x7fa93c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.341+0000 7fa937fff640 1 -- 172.21.15.5:0/1297195174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9400aaca0 con 0x7fa95006b7d0 2024-04-25T08:56:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.341+0000 7fa94effd640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa93c06b4d0 0x7fa93c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.341+0000 7fa94effd640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa93c06b4d0 0x7fa93c06d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b4480 tx=0x7fa944009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.345+0000 7fa937fff640 1 -- 172.21.15.5:0/1297195174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa95014e4a0 con 0x7fa95006b7d0 2024-04-25T08:56:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.564+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa95015dc60 con 0x7fa95006b7d0 2024-04-25T08:56:47.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.564+0000 7fa937fff640 1 -- 172.21.15.5:0/1297195174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7fa940079b10 con 0x7fa95006b7d0 2024-04-25T08:56:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:47.554 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:56:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:56:47.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa93c06b4d0 msgr2=0x7fa93c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa93c06b4d0 0x7fa93c06d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b4480 tx=0x7fa944009040 comp rx=0 tx=0).stop 2024-04-25T08:56:47.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 msgr2=0x7fa95014df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95014df60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c00 tx=0x7fa9400046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 shutdown_connections 2024-04-25T08:56:47.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa93c06b4d0 0x7fa93c06d990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa95015e120 0x7fa9501601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa95006bbb0 0x7fa9500cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 --2- 172.21.15.5:0/1297195174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95006b7d0 0x7fa95014df60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 >> 172.21.15.5:0/1297195174 conn(0x7fa9500d18e0 msgr2=0x7fa9500d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 shutdown_connections 2024-04-25T08:56:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.566+0000 7fa955df5640 1 -- 172.21.15.5:0/1297195174 wait complete. 2024-04-25T08:56:47.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.677+0000 7f6be12b3640 1 Processor -- start 2024-04-25T08:56:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6be12b3640 1 -- start start 2024-04-25T08:56:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6be12b3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6bdc15e0a0 0x7f6bdc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6be12b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3df0 0x7f6bdc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6be12b3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0b7f60 con 0x7f6bdc0d3990 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6be12b3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc0b29c0 con 0x7f6bdc15e0a0 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6be12b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0d2080 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6bdaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6bdc15e0a0 0x7f6bdc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6bda7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6bdc0d3990 0x7f6bdc0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57986/0 (socket says 172.21.15.5:57986) 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.678+0000 7f6bda7fc640 1 -- 172.21.15.5:0/530263545 learned_addr learned my addr 172.21.15.5:0/530263545 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.679+0000 7f6bdb7fe640 1 --2- 172.21.15.5:0/530263545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3df0 0x7f6bdc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.679+0000 7f6bdaffd640 1 -- 172.21.15.5:0/530263545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3df0 msgr2=0x7f6bdc0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.679+0000 7f6bdaffd640 1 --2- 172.21.15.5:0/530263545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3df0 0x7f6bdc0cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.679+0000 7f6bdaffd640 1 -- 172.21.15.5:0/530263545 >> v1:172.21.15.5:6789/0 conn(0x7f6bdc0d3990 legacy=0x7f6bdc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.679+0000 7f6bdaffd640 1 -- 172.21.15.5:0/530263545 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0d2360 con 0x7f6bdc15e0a0 2024-04-25T08:56:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.679+0000 7f6bd9ffb640 1 -- 172.21.15.5:0/530263545 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102369431 0 0) 0x7f6bdc0b7f60 con 0x7f6bdc0d3990 2024-04-25T08:56:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.679+0000 7f6bdaffd640 1 --2- 172.21.15.5:0/530263545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc15e0a0 0x7f6bdc0d0d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f5b237493d211 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6bd9ffb640 1 -- 172.21.15.5:0/530263545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc007740 con 0x7f6bdc15e0a0 2024-04-25T08:56:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6bd9ffb640 1 -- 172.21.15.5:0/530263545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc0078e0 con 0x7f6bdc15e0a0 2024-04-25T08:56:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6bd9ffb640 1 -- 172.21.15.5:0/530263545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc007cb0 con 0x7f6bdc15e0a0 2024-04-25T08:56:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 -- 172.21.15.5:0/530263545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc15e0a0 msgr2=0x7f6bdc0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 --2- 172.21.15.5:0/530263545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc15e0a0 0x7f6bdc0d0d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc02a660 comp rx=0 tx=0).stop 2024-04-25T08:56:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 -- 172.21.15.5:0/530263545 shutdown_connections 2024-04-25T08:56:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 --2- 172.21.15.5:0/530263545 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3df0 0x7f6bdc0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 --2- 172.21.15.5:0/530263545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc15e0a0 0x7f6bdc0d0d50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 -- 172.21.15.5:0/530263545 >> 172.21.15.5:0/530263545 conn(0x7f6bdc0668f0 msgr2=0x7f6bdc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 -- 172.21.15.5:0/530263545 shutdown_connections 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.680+0000 7f6be12b3640 1 -- 172.21.15.5:0/530263545 wait complete. 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 Processor -- start 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 -- start start 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3990 0x7f6bdc0c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc0d3df0 0x7f6bdc0ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bdc15e0a0 0x7f6bdc0b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0d2c00 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0d2920 con 0x7f6bdc15e0a0 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6be12b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0d4280 con 0x7f6bdc0d3990 2024-04-25T08:56:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6bda7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc0d3df0 0x7f6bdc0ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6bda7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc0d3df0 0x7f6bdc0ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35764/0 (socket says 172.21.15.5:35764) 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.682+0000 7f6bda7fc640 1 -- 172.21.15.5:0/2554498362 learned_addr learned my addr 172.21.15.5:0/2554498362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bdb7fe640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bdc15e0a0 0x7f6bdc0b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bdaffd640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3990 0x7f6bdc0c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bda7fc640 1 -- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3990 msgr2=0x7f6bdc0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bda7fc640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3990 0x7f6bdc0c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bda7fc640 1 -- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bdc15e0a0 msgr2=0x7f6bdc0b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bda7fc640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bdc15e0a0 0x7f6bdc0b8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bda7fc640 1 -- 172.21.15.5:0/2554498362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0c72f0 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bda7fc640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc0d3df0 0x7f6bdc0ab250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c430 tx=0x7f6bc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bd37fe640 1 -- 172.21.15.5:0/2554498362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40074e0 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bd37fe640 1 -- 172.21.15.5:0/2554498362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40047e0 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc1f8150 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6bd37fe640 1 -- 172.21.15.5:0/2554498362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4004bd0 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.683+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc1f7950 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.684+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc04ef20 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.684+0000 7f6bd37fe640 1 -- 172.21.15.5:0/2554498362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6bc4011070 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.685+0000 7f6bd37fe640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bbc06b4d0 0x7f6bbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.685+0000 7f6bd37fe640 1 -- 172.21.15.5:0/2554498362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bc4089db0 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.685+0000 7f6bdaffd640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bbc06b4d0 0x7f6bbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.686+0000 7f6bdaffd640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bbc06b4d0 0x7f6bbc06d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc034000 tx=0x7f6bcc02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.689+0000 7f6bd37fe640 1 -- 172.21.15.5:0/2554498362 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6bdc0c72f0 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.868+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bdc0d05f0 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.869+0000 7f6bd37fe640 1 -- 172.21.15.5:0/2554498362 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f6bc4058c30 con 0x7f6bdc0d3df0 2024-04-25T08:56:47.859 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:47.860 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bbc06b4d0 msgr2=0x7f6bbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bbc06b4d0 0x7f6bbc06d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc034000 tx=0x7f6bcc02f000 comp rx=0 tx=0).stop 2024-04-25T08:56:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc0d3df0 msgr2=0x7f6bdc0ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc0d3df0 0x7f6bdc0ab250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c430 tx=0x7f6bc400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 shutdown_connections 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bbc06b4d0 0x7f6bbc06d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bdc15e0a0 0x7f6bdc0b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bdc0d3df0 0x7f6bdc0ab250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 --2- 172.21.15.5:0/2554498362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bdc0d3990 0x7f6bdc0c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 >> 172.21.15.5:0/2554498362 conn(0x7f6bdc0668f0 msgr2=0x7f6bdc0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 shutdown_connections 2024-04-25T08:56:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.871+0000 7f6be12b3640 1 -- 172.21.15.5:0/2554498362 wait complete. 2024-04-25T08:56:47.872 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:56:47.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.983+0000 7f35a237e640 1 Processor -- start 2024-04-25T08:56:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.983+0000 7f35a237e640 1 -- start start 2024-04-25T08:56:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f35a237e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c15e0a0 0x7f359c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f35a237e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f359c0d3990 0x7f359c0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f35a237e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c0b7f60 con 0x7f359c0ce5e0 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f35a237e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0d4330 con 0x7f359c0d3990 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f35a237e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b29c0 con 0x7f359c15e0a0 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f359c0d3990 0x7f359c0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f359c0d3990 0x7f359c0d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35768/0 (socket says 172.21.15.5:35768) 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359b7fe640 1 -- 172.21.15.5:0/3675456300 learned_addr learned my addr 172.21.15.5:0/3675456300 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359bfff640 1 --2- 172.21.15.5:0/3675456300 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c15e0a0 0x7f359c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359b7fe640 1 -- 172.21.15.5:0/3675456300 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c15e0a0 msgr2=0x7f359c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359b7fe640 1 --2- 172.21.15.5:0/3675456300 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c15e0a0 0x7f359c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359b7fe640 1 -- 172.21.15.5:0/3675456300 >> v1:172.21.15.80:6789/0 conn(0x7f359c0ce5e0 legacy=0x7f359c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.984+0000 7f359b7fe640 1 -- 172.21.15.5:0/3675456300 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0d2080 con 0x7f359c0d3990 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f359b7fe640 1 --2- 172.21.15.5:0/3675456300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c0d3df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3590009870 tx=0x7f359002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e58ba4d8d12646 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f359affd640 1 -- 172.21.15.5:0/3675456300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590037070 con 0x7f359c0d3990 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f359affd640 1 -- 172.21.15.5:0/3675456300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590032440 con 0x7f359c0d3990 2024-04-25T08:56:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f359affd640 1 -- 172.21.15.5:0/3675456300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590032810 con 0x7f359c0d3990 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 -- 172.21.15.5:0/3675456300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 msgr2=0x7f359c0d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 --2- 172.21.15.5:0/3675456300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c0d3df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3590009870 tx=0x7f359002a270 comp rx=0 tx=0).stop 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 -- 172.21.15.5:0/3675456300 shutdown_connections 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 --2- 172.21.15.5:0/3675456300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c0d3df0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 --2- 172.21.15.5:0/3675456300 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c15e0a0 0x7f359c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 -- 172.21.15.5:0/3675456300 >> 172.21.15.5:0/3675456300 conn(0x7f359c0668f0 msgr2=0x7f359c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 -- 172.21.15.5:0/3675456300 shutdown_connections 2024-04-25T08:56:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.985+0000 7f35a237e640 1 -- 172.21.15.5:0/3675456300 wait complete. 2024-04-25T08:56:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 Processor -- start 2024-04-25T08:56:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 -- start start 2024-04-25T08:56:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c0ce5e0 0x7f359c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f359c15e0a0 0x7f359c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0d2920 con 0x7f359c0d3990 2024-04-25T08:56:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0d2640 con 0x7f359c15e0a0 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.987+0000 7f35a237e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0d2c00 con 0x7f359c0ce5e0 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c15e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35782/0 (socket says 172.21.15.5:35782) 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 -- 172.21.15.5:0/1043735999 learned_addr learned my addr 172.21.15.5:0/1043735999 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359bfff640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c0ce5e0 0x7f359c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f35a091b640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f359c15e0a0 0x7f359c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 -- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c0ce5e0 msgr2=0x7f359c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c0ce5e0 0x7f359c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 -- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f359c15e0a0 msgr2=0x7f359c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f359c15e0a0 0x7f359c0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 -- 172.21.15.5:0/1043735999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c15edf0 con 0x7f359c0d3990 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f359b7fe640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c15e480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3590000c00 tx=0x7f35900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f3598ff9640 1 -- 172.21.15.5:0/1043735999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590041020 con 0x7f359c0d3990 2024-04-25T08:56:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f3598ff9640 1 -- 172.21.15.5:0/1043735999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35900306c0 con 0x7f359c0d3990 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f3598ff9640 1 -- 172.21.15.5:0/1043735999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590037040 con 0x7f359c0d3990 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c15f0d0 con 0x7f359c0d3990 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.988+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c15f690 con 0x7f359c0d3990 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.989+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c04ef20 con 0x7f359c0d3990 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.990+0000 7f3598ff9640 1 -- 172.21.15.5:0/1043735999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3590044020 con 0x7f359c0d3990 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.990+0000 7f3598ff9640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f358806b4d0 0x7f358806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.990+0000 7f3598ff9640 1 -- 172.21.15.5:0/1043735999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35900aa920 con 0x7f359c0d3990 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.990+0000 7f359bfff640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f358806b4d0 0x7f358806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.991+0000 7f359bfff640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f358806b4d0 0x7f358806d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f358c006fd0 tx=0x7f358c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:47.994+0000 7f3598ff9640 1 -- 172.21.15.5:0/1043735999 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f359004b030 con 0x7f359c0d3990 2024-04-25T08:56:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.169+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f359c0d03a0 con 0x7f358806b4d0 2024-04-25T08:56:48.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.176+0000 7f3598ff9640 1 -- 172.21.15.5:0/1043735999 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237079 (secure 0 0 0) 0x7f359c0d03a0 con 0x7f358806b4d0 2024-04-25T08:56:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:48.169 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f358806b4d0 msgr2=0x7f358806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f358806b4d0 0x7f358806d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f358c006fd0 tx=0x7f358c008040 comp rx=0 tx=0).stop 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 msgr2=0x7f359c15e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c15e480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3590000c00 tx=0x7f35900046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 shutdown_connections 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f358806b4d0 0x7f358806d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f359c15e0a0 0x7f359c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f359c0d3990 0x7f359c15e480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 --2- 172.21.15.5:0/1043735999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f359c0ce5e0 0x7f359c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 >> 172.21.15.5:0/1043735999 conn(0x7f359c0668f0 msgr2=0x7f359c0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 shutdown_connections 2024-04-25T08:56:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.178+0000 7f35a237e640 1 -- 172.21.15.5:0/1043735999 wait complete. 2024-04-25T08:56:48.179 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T08:56:46.386969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235192,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739528,"statfs":{"total":773094113280,"available":772853276672,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000828"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T08:56:35.024244+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:56:35.024244+0000","last_peered":"2024-04-25T08:56:35.024244+0000","last_clean":"2024-04-25T08:56:35.024244+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:56:35.024244+0000","last_undegraded":"2024-04-25T08:56:35.024244+0000","last_fullsized":"2024-04-25T08:56:35.024244+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:44.185353+0000","last_change":"2024-04-25T08:56:44.185353+0000","last_active":"2024-04-25T08:56:44.185353+0000","last_peered":"2024-04-25T08:56:44.185353+0000","last_clean":"2024-04-25T08:56:44.185353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:44.185353+0000","last_undegraded":"2024-04-25T08:56:44.185353+0000","last_fullsized":"2024-04-25T08:56:44.185353+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:43.180585+0000","last_change":"2024-04-25T08:56:43.180585+0000","last_active":"2024-04-25T08:56:43.180585+0000","last_peered":"2024-04-25T08:56:43.180585+0000","last_clean":"2024-04-25T08:56:43.180585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:43.180585+0000","last_undegraded":"2024-04-25T08:56:43.180585+0000","last_fullsized":"2024-04-25T08:56:43.180585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:48.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.329+0000 7f511e49e640 1 Processor -- start 2024-04-25T08:56:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.329+0000 7f511e49e640 1 -- start start 2024-04-25T08:56:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f511e49e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5118067000 0x7f511806f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f511e49e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f511815cb00 0x7f511806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f511e49e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511806fd70 con 0x7f51180afdf0 2024-04-25T08:56:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f511e49e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5118160560 con 0x7f5118067000 2024-04-25T08:56:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f511e49e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51180b01d0 con 0x7f511815cb00 2024-04-25T08:56:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f51177fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5118067000 0x7f511806f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f51177fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5118067000 0x7f511806f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35794/0 (socket says 172.21.15.5:35794) 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f5117fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f51180afdf0 0x7f51180668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57998/0 (socket says 172.21.15.5:57998) 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f51177fe640 1 -- 172.21.15.5:0/2672118245 learned_addr learned my addr 172.21.15.5:0/2672118245 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.330+0000 7f511ca3b640 1 --2- 172.21.15.5:0/2672118245 >> v2:172.21.15.80:3300/0 conn(0x7f511815cb00 0x7f511806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.331+0000 7f51177fe640 1 -- 172.21.15.5:0/2672118245 >> v2:172.21.15.80:3300/0 conn(0x7f511815cb00 msgr2=0x7f511806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.331+0000 7f51177fe640 1 --2- 172.21.15.5:0/2672118245 >> v2:172.21.15.80:3300/0 conn(0x7f511815cb00 0x7f511806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.331+0000 7f51177fe640 1 -- 172.21.15.5:0/2672118245 >> v1:172.21.15.5:6789/0 conn(0x7f51180afdf0 legacy=0x7f51180668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.331+0000 7f51177fe640 1 -- 172.21.15.5:0/2672118245 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511815cf40 con 0x7f5118067000 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.331+0000 7f5116ffd640 1 -- 172.21.15.5:0/2672118245 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79189438 0 0) 0x7f511806fd70 con 0x7f51180afdf0 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.331+0000 7f51177fe640 1 --2- 172.21.15.5:0/2672118245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5118067000 0x7f511806f6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5118159bb0 tx=0x7f510802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913d7d837302f309 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.331+0000 7f5116ffd640 1 -- 172.21.15.5:0/2672118245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108037070 con 0x7f5118067000 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f5116ffd640 1 -- 172.21.15.5:0/2672118245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108032440 con 0x7f5118067000 2024-04-25T08:56:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f5116ffd640 1 -- 172.21.15.5:0/2672118245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108032810 con 0x7f5118067000 2024-04-25T08:56:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 -- 172.21.15.5:0/2672118245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5118067000 msgr2=0x7f511806f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 --2- 172.21.15.5:0/2672118245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5118067000 0x7f511806f6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5118159bb0 tx=0x7f510802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 -- 172.21.15.5:0/2672118245 shutdown_connections 2024-04-25T08:56:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 --2- 172.21.15.5:0/2672118245 >> v2:172.21.15.80:3300/0 conn(0x7f511815cb00 0x7f511806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 --2- 172.21.15.5:0/2672118245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5118067000 0x7f511806f6e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 -- 172.21.15.5:0/2672118245 >> 172.21.15.5:0/2672118245 conn(0x7f51180d0870 msgr2=0x7f51180d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 -- 172.21.15.5:0/2672118245 shutdown_connections 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.332+0000 7f511e49e640 1 -- 172.21.15.5:0/2672118245 wait complete. 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.333+0000 7f511e49e640 1 Processor -- start 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.333+0000 7f511e49e640 1 -- start start 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511e49e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5118067000 0x7f5118154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511e49e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51180afdf0 0x7f51181525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511e49e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f511815cb00 0x7f511815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511e49e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511815fd60 con 0x7f511815cb00 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511e49e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511815fa80 con 0x7f51180afdf0 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511e49e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5118160040 con 0x7f5118067000 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511ca3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f511815cb00 0x7f511815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511ca3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f511815cb00 0x7f511815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35798/0 (socket says 172.21.15.5:35798) 2024-04-25T08:56:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f511ca3b640 1 -- 172.21.15.5:0/4032925382 learned_addr learned my addr 172.21.15.5:0/4032925382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f51177fe640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51180afdf0 0x7f51181525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.334+0000 7f5117fff640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5118067000 0x7f5118154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511ca3b640 1 -- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5118067000 msgr2=0x7f5118154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511ca3b640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5118067000 0x7f5118154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511ca3b640 1 -- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51180afdf0 msgr2=0x7f51181525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511ca3b640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51180afdf0 0x7f51181525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511ca3b640 1 -- 172.21.15.5:0/4032925382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118151e10 con 0x7f511815cb00 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511ca3b640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f511815cb00 0x7f511815aec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f511000efc0 tx=0x7f511000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f5114ff9640 1 -- 172.21.15.5:0/4032925382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110018020 con 0x7f511815cb00 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f5114ff9640 1 -- 172.21.15.5:0/4032925382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110014480 con 0x7f511815cb00 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51181520f0 con 0x7f511815cb00 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f5114ff9640 1 -- 172.21.15.5:0/4032925382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110014870 con 0x7f511815cb00 2024-04-25T08:56:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.335+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5118152ae0 con 0x7f511815cb00 2024-04-25T08:56:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.336+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511804ef20 con 0x7f511815cb00 2024-04-25T08:56:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.336+0000 7f5114ff9640 1 -- 172.21.15.5:0/4032925382 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5110005d10 con 0x7f511815cb00 2024-04-25T08:56:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.337+0000 7f5114ff9640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f50f806b4d0 0x7f50f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.337+0000 7f5114ff9640 1 -- 172.21.15.5:0/4032925382 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f511008ae00 con 0x7f511815cb00 2024-04-25T08:56:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.337+0000 7f5117fff640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f50f806b4d0 0x7f50f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.338+0000 7f5117fff640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f50f806b4d0 0x7f50f806d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5100000f60 tx=0x7f5100007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.341+0000 7f5114ff9640 1 -- 172.21.15.5:0/4032925382 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5110022030 con 0x7f511815cb00 2024-04-25T08:56:48.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.518+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5118151bc0 con 0x7f50f806b4d0 2024-04-25T08:56:48.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.525+0000 7f5114ff9640 1 -- 172.21.15.5:0/4032925382 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251947 (secure 0 0 0) 0x7f5118151bc0 con 0x7f50f806b4d0 2024-04-25T08:56:48.517 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:48.518 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.527+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f50f806b4d0 msgr2=0x7f50f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.527+0000 7f511e49e640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f50f806b4d0 0x7f50f806d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5100000f60 tx=0x7f5100007d50 comp rx=0 tx=0).stop 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f511815cb00 msgr2=0x7f511815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f511815cb00 0x7f511815aec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f511000efc0 tx=0x7f511000c490 comp rx=0 tx=0).stop 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 shutdown_connections 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f50f806b4d0 0x7f50f806d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f511815cb00 0x7f511815aec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51180afdf0 0x7f51181525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 --2- 172.21.15.5:0/4032925382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5118067000 0x7f5118154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 >> 172.21.15.5:0/4032925382 conn(0x7f51180d0870 msgr2=0x7f51180ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:48.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 shutdown_connections 2024-04-25T08:56:48.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.528+0000 7f511e49e640 1 -- 172.21.15.5:0/4032925382 wait complete. 2024-04-25T08:56:48.528 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T08:56:48.387461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235544,"kb_used_data":2740,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739176,"statfs":{"total":773094113280,"available":772852916224,"internally_reserved":0,"allocated":2805760,"data_stored":1708928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.199901"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312750+0000","last_change":"2024-04-25T08:56:45.214215+0000","last_active":"2024-04-25T08:56:46.312750+0000","last_peered":"2024-04-25T08:56:46.312750+0000","last_clean":"2024-04-25T08:56:46.312750+0000","last_became_active":"2024-04-25T08:56:45.213888+0000","last_became_peered":"2024-04-25T08:56:45.213888+0000","last_unstale":"2024-04-25T08:56:46.312750+0000","last_undegraded":"2024-04-25T08:56:46.312750+0000","last_fullsized":"2024-04-25T08:56:46.312750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:40.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202219+0000","last_change":"2024-04-25T08:56:45.223882+0000","last_active":"2024-04-25T08:56:46.202219+0000","last_peered":"2024-04-25T08:56:46.202219+0000","last_clean":"2024-04-25T08:56:46.202219+0000","last_became_active":"2024-04-25T08:56:45.223600+0000","last_became_peered":"2024-04-25T08:56:45.223600+0000","last_unstale":"2024-04-25T08:56:46.202219+0000","last_undegraded":"2024-04-25T08:56:46.202219+0000","last_fullsized":"2024-04-25T08:56:46.202219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312857+0000","last_change":"2024-04-25T08:56:45.207050+0000","last_active":"2024-04-25T08:56:46.312857+0000","last_peered":"2024-04-25T08:56:46.312857+0000","last_clean":"2024-04-25T08:56:46.312857+0000","last_became_active":"2024-04-25T08:56:45.206781+0000","last_became_peered":"2024-04-25T08:56:45.206781+0000","last_unstale":"2024-04-25T08:56:46.312857+0000","last_undegraded":"2024-04-25T08:56:46.312857+0000","last_fullsized":"2024-04-25T08:56:46.312857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313273+0000","last_change":"2024-04-25T08:56:45.204379+0000","last_active":"2024-04-25T08:56:46.313273+0000","last_peered":"2024-04-25T08:56:46.313273+0000","last_clean":"2024-04-25T08:56:46.313273+0000","last_became_active":"2024-04-25T08:56:45.204046+0000","last_became_peered":"2024-04-25T08:56:45.204046+0000","last_unstale":"2024-04-25T08:56:46.313273+0000","last_undegraded":"2024-04-25T08:56:46.313273+0000","last_fullsized":"2024-04-25T08:56:46.313273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:37.397335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313242+0000","last_change":"2024-04-25T08:56:45.214884+0000","last_active":"2024-04-25T08:56:46.313242+0000","last_peered":"2024-04-25T08:56:46.313242+0000","last_clean":"2024-04-25T08:56:46.313242+0000","last_became_active":"2024-04-25T08:56:45.214584+0000","last_became_peered":"2024-04-25T08:56:45.214584+0000","last_unstale":"2024-04-25T08:56:46.313242+0000","last_undegraded":"2024-04-25T08:56:46.313242+0000","last_fullsized":"2024-04-25T08:56:46.313242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:57.667683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312739+0000","last_change":"2024-04-25T08:56:45.216977+0000","last_active":"2024-04-25T08:56:46.312739+0000","last_peered":"2024-04-25T08:56:46.312739+0000","last_clean":"2024-04-25T08:56:46.312739+0000","last_became_active":"2024-04-25T08:56:45.216691+0000","last_became_peered":"2024-04-25T08:56:45.216691+0000","last_unstale":"2024-04-25T08:56:46.312739+0000","last_undegraded":"2024-04-25T08:56:46.312739+0000","last_fullsized":"2024-04-25T08:56:46.312739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312147+0000","last_change":"2024-04-25T08:56:45.219245+0000","last_active":"2024-04-25T08:56:46.312147+0000","last_peered":"2024-04-25T08:56:46.312147+0000","last_clean":"2024-04-25T08:56:46.312147+0000","last_became_active":"2024-04-25T08:56:45.218966+0000","last_became_peered":"2024-04-25T08:56:45.218966+0000","last_unstale":"2024-04-25T08:56:46.312147+0000","last_undegraded":"2024-04-25T08:56:46.312147+0000","last_fullsized":"2024-04-25T08:56:46.312147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312173+0000","last_change":"2024-04-25T08:56:45.211941+0000","last_active":"2024-04-25T08:56:46.312173+0000","last_peered":"2024-04-25T08:56:46.312173+0000","last_clean":"2024-04-25T08:56:46.312173+0000","last_became_active":"2024-04-25T08:56:45.211654+0000","last_became_peered":"2024-04-25T08:56:45.211654+0000","last_unstale":"2024-04-25T08:56:46.312173+0000","last_undegraded":"2024-04-25T08:56:46.312173+0000","last_fullsized":"2024-04-25T08:56:46.312173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.046928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312926+0000","last_change":"2024-04-25T08:56:45.222927+0000","last_active":"2024-04-25T08:56:46.312926+0000","last_peered":"2024-04-25T08:56:46.312926+0000","last_clean":"2024-04-25T08:56:46.312926+0000","last_became_active":"2024-04-25T08:56:45.222621+0000","last_became_peered":"2024-04-25T08:56:45.222621+0000","last_unstale":"2024-04-25T08:56:46.312926+0000","last_undegraded":"2024-04-25T08:56:46.312926+0000","last_fullsized":"2024-04-25T08:56:46.312926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:54.059797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208198+0000","last_change":"2024-04-25T08:56:45.219827+0000","last_active":"2024-04-25T08:56:46.208198+0000","last_peered":"2024-04-25T08:56:46.208198+0000","last_clean":"2024-04-25T08:56:46.208198+0000","last_became_active":"2024-04-25T08:56:45.219443+0000","last_became_peered":"2024-04-25T08:56:45.219443+0000","last_unstale":"2024-04-25T08:56:46.208198+0000","last_undegraded":"2024-04-25T08:56:46.208198+0000","last_fullsized":"2024-04-25T08:56:46.208198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208115+0000","last_change":"2024-04-25T08:56:45.217372+0000","last_active":"2024-04-25T08:56:46.208115+0000","last_peered":"2024-04-25T08:56:46.208115+0000","last_clean":"2024-04-25T08:56:46.208115+0000","last_became_active":"2024-04-25T08:56:45.217109+0000","last_became_peered":"2024-04-25T08:56:45.217109+0000","last_unstale":"2024-04-25T08:56:46.208115+0000","last_undegraded":"2024-04-25T08:56:46.208115+0000","last_fullsized":"2024-04-25T08:56:46.208115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202878+0000","last_change":"2024-04-25T08:56:45.205751+0000","last_active":"2024-04-25T08:56:46.202878+0000","last_peered":"2024-04-25T08:56:46.202878+0000","last_clean":"2024-04-25T08:56:46.202878+0000","last_became_active":"2024-04-25T08:56:45.205247+0000","last_became_peered":"2024-04-25T08:56:45.205247+0000","last_unstale":"2024-04-25T08:56:46.202878+0000","last_undegraded":"2024-04-25T08:56:46.202878+0000","last_fullsized":"2024-04-25T08:56:46.202878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:13.577419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312640+0000","last_change":"2024-04-25T08:56:45.207035+0000","last_active":"2024-04-25T08:56:46.312640+0000","last_peered":"2024-04-25T08:56:46.312640+0000","last_clean":"2024-04-25T08:56:46.312640+0000","last_became_active":"2024-04-25T08:56:45.206276+0000","last_became_peered":"2024-04-25T08:56:45.206276+0000","last_unstale":"2024-04-25T08:56:46.312640+0000","last_undegraded":"2024-04-25T08:56:46.312640+0000","last_fullsized":"2024-04-25T08:56:46.312640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312187+0000","last_change":"2024-04-25T08:56:45.215524+0000","last_active":"2024-04-25T08:56:46.312187+0000","last_peered":"2024-04-25T08:56:46.312187+0000","last_clean":"2024-04-25T08:56:46.312187+0000","last_became_active":"2024-04-25T08:56:45.215237+0000","last_became_peered":"2024-04-25T08:56:45.215237+0000","last_unstale":"2024-04-25T08:56:46.312187+0000","last_undegraded":"2024-04-25T08:56:46.312187+0000","last_fullsized":"2024-04-25T08:56:46.312187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201999+0000","last_change":"2024-04-25T08:56:45.211498+0000","last_active":"2024-04-25T08:56:46.201999+0000","last_peered":"2024-04-25T08:56:46.201999+0000","last_clean":"2024-04-25T08:56:46.201999+0000","last_became_active":"2024-04-25T08:56:45.210845+0000","last_became_peered":"2024-04-25T08:56:45.210845+0000","last_unstale":"2024-04-25T08:56:46.201999+0000","last_undegraded":"2024-04-25T08:56:46.201999+0000","last_fullsized":"2024-04-25T08:56:46.201999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312644+0000","last_change":"2024-04-25T08:56:45.222046+0000","last_active":"2024-04-25T08:56:46.312644+0000","last_peered":"2024-04-25T08:56:46.312644+0000","last_clean":"2024-04-25T08:56:46.312644+0000","last_became_active":"2024-04-25T08:56:45.221786+0000","last_became_peered":"2024-04-25T08:56:45.221786+0000","last_unstale":"2024-04-25T08:56:46.312644+0000","last_undegraded":"2024-04-25T08:56:46.312644+0000","last_fullsized":"2024-04-25T08:56:46.312644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313399+0000","last_change":"2024-04-25T08:56:45.220510+0000","last_active":"2024-04-25T08:56:46.313399+0000","last_peered":"2024-04-25T08:56:46.313399+0000","last_clean":"2024-04-25T08:56:46.313399+0000","last_became_active":"2024-04-25T08:56:45.218056+0000","last_became_peered":"2024-04-25T08:56:45.218056+0000","last_unstale":"2024-04-25T08:56:46.313399+0000","last_undegraded":"2024-04-25T08:56:46.313399+0000","last_fullsized":"2024-04-25T08:56:46.313399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:54.059797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201473+0000","last_change":"2024-04-25T08:56:45.205595+0000","last_active":"2024-04-25T08:56:46.201473+0000","last_peered":"2024-04-25T08:56:46.201473+0000","last_clean":"2024-04-25T08:56:46.201473+0000","last_became_active":"2024-04-25T08:56:45.205275+0000","last_became_peered":"2024-04-25T08:56:45.205275+0000","last_unstale":"2024-04-25T08:56:46.201473+0000","last_undegraded":"2024-04-25T08:56:46.201473+0000","last_fullsized":"2024-04-25T08:56:46.201473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:33.839170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312741+0000","last_change":"2024-04-25T08:56:45.214789+0000","last_active":"2024-04-25T08:56:46.312741+0000","last_peered":"2024-04-25T08:56:46.312741+0000","last_clean":"2024-04-25T08:56:46.312741+0000","last_became_active":"2024-04-25T08:56:45.214505+0000","last_became_peered":"2024-04-25T08:56:45.214505+0000","last_unstale":"2024-04-25T08:56:46.312741+0000","last_undegraded":"2024-04-25T08:56:46.312741+0000","last_fullsized":"2024-04-25T08:56:46.312741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:43.480760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208010+0000","last_change":"2024-04-25T08:56:45.207623+0000","last_active":"2024-04-25T08:56:46.208010+0000","last_peered":"2024-04-25T08:56:46.208010+0000","last_clean":"2024-04-25T08:56:46.208010+0000","last_became_active":"2024-04-25T08:56:45.207355+0000","last_became_peered":"2024-04-25T08:56:45.207355+0000","last_unstale":"2024-04-25T08:56:46.208010+0000","last_undegraded":"2024-04-25T08:56:46.208010+0000","last_fullsized":"2024-04-25T08:56:46.208010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313039+0000","last_change":"2024-04-25T08:56:45.217625+0000","last_active":"2024-04-25T08:56:46.313039+0000","last_peered":"2024-04-25T08:56:46.313039+0000","last_clean":"2024-04-25T08:56:46.313039+0000","last_became_active":"2024-04-25T08:56:45.217339+0000","last_became_peered":"2024-04-25T08:56:45.217339+0000","last_unstale":"2024-04-25T08:56:46.313039+0000","last_undegraded":"2024-04-25T08:56:46.313039+0000","last_fullsized":"2024-04-25T08:56:46.313039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312884+0000","last_change":"2024-04-25T08:56:45.208901+0000","last_active":"2024-04-25T08:56:46.312884+0000","last_peered":"2024-04-25T08:56:46.312884+0000","last_clean":"2024-04-25T08:56:46.312884+0000","last_became_active":"2024-04-25T08:56:45.208627+0000","last_became_peered":"2024-04-25T08:56:45.208627+0000","last_unstale":"2024-04-25T08:56:46.312884+0000","last_undegraded":"2024-04-25T08:56:46.312884+0000","last_fullsized":"2024-04-25T08:56:46.312884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312527+0000","last_change":"2024-04-25T08:56:45.207471+0000","last_active":"2024-04-25T08:56:46.312527+0000","last_peered":"2024-04-25T08:56:46.312527+0000","last_clean":"2024-04-25T08:56:46.312527+0000","last_became_active":"2024-04-25T08:56:45.207134+0000","last_became_peered":"2024-04-25T08:56:45.207134+0000","last_unstale":"2024-04-25T08:56:46.312527+0000","last_undegraded":"2024-04-25T08:56:46.312527+0000","last_fullsized":"2024-04-25T08:56:46.312527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312799+0000","last_change":"2024-04-25T08:56:45.213278+0000","last_active":"2024-04-25T08:56:46.312799+0000","last_peered":"2024-04-25T08:56:46.312799+0000","last_clean":"2024-04-25T08:56:46.312799+0000","last_became_active":"2024-04-25T08:56:45.212789+0000","last_became_peered":"2024-04-25T08:56:45.212789+0000","last_unstale":"2024-04-25T08:56:46.312799+0000","last_undegraded":"2024-04-25T08:56:46.312799+0000","last_fullsized":"2024-04-25T08:56:46.312799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312402+0000","last_change":"2024-04-25T08:56:45.206688+0000","last_active":"2024-04-25T08:56:46.312402+0000","last_peered":"2024-04-25T08:56:46.312402+0000","last_clean":"2024-04-25T08:56:46.312402+0000","last_became_active":"2024-04-25T08:56:45.205893+0000","last_became_peered":"2024-04-25T08:56:45.205893+0000","last_unstale":"2024-04-25T08:56:46.312402+0000","last_undegraded":"2024-04-25T08:56:46.312402+0000","last_fullsized":"2024-04-25T08:56:46.312402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208267+0000","last_change":"2024-04-25T08:56:45.209708+0000","last_active":"2024-04-25T08:56:46.208267+0000","last_peered":"2024-04-25T08:56:46.208267+0000","last_clean":"2024-04-25T08:56:46.208267+0000","last_became_active":"2024-04-25T08:56:45.209448+0000","last_became_peered":"2024-04-25T08:56:45.209448+0000","last_unstale":"2024-04-25T08:56:46.208267+0000","last_undegraded":"2024-04-25T08:56:46.208267+0000","last_fullsized":"2024-04-25T08:56:46.208267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202250+0000","last_change":"2024-04-25T08:56:45.213535+0000","last_active":"2024-04-25T08:56:46.202250+0000","last_peered":"2024-04-25T08:56:46.202250+0000","last_clean":"2024-04-25T08:56:46.202250+0000","last_became_active":"2024-04-25T08:56:45.213239+0000","last_became_peered":"2024-04-25T08:56:45.213239+0000","last_unstale":"2024-04-25T08:56:46.202250+0000","last_undegraded":"2024-04-25T08:56:46.202250+0000","last_fullsized":"2024-04-25T08:56:46.202250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312923+0000","last_change":"2024-04-25T08:56:45.207576+0000","last_active":"2024-04-25T08:56:46.312923+0000","last_peered":"2024-04-25T08:56:46.312923+0000","last_clean":"2024-04-25T08:56:46.312923+0000","last_became_active":"2024-04-25T08:56:45.206807+0000","last_became_peered":"2024-04-25T08:56:45.206807+0000","last_unstale":"2024-04-25T08:56:46.312923+0000","last_undegraded":"2024-04-25T08:56:46.312923+0000","last_fullsized":"2024-04-25T08:56:46.312923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313032+0000","last_change":"2024-04-25T08:56:45.209841+0000","last_active":"2024-04-25T08:56:46.313032+0000","last_peered":"2024-04-25T08:56:46.313032+0000","last_clean":"2024-04-25T08:56:46.313032+0000","last_became_active":"2024-04-25T08:56:45.209571+0000","last_became_peered":"2024-04-25T08:56:45.209571+0000","last_unstale":"2024-04-25T08:56:46.313032+0000","last_undegraded":"2024-04-25T08:56:46.313032+0000","last_fullsized":"2024-04-25T08:56:46.313032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313341+0000","last_change":"2024-04-25T08:56:45.211522+0000","last_active":"2024-04-25T08:56:46.313341+0000","last_peered":"2024-04-25T08:56:46.313341+0000","last_clean":"2024-04-25T08:56:46.313341+0000","last_became_active":"2024-04-25T08:56:45.211239+0000","last_became_peered":"2024-04-25T08:56:45.211239+0000","last_unstale":"2024-04-25T08:56:46.313341+0000","last_undegraded":"2024-04-25T08:56:46.313341+0000","last_fullsized":"2024-04-25T08:56:46.313341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:43.480760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201271+0000","last_change":"2024-04-25T08:56:45.217257+0000","last_active":"2024-04-25T08:56:46.201271+0000","last_peered":"2024-04-25T08:56:46.201271+0000","last_clean":"2024-04-25T08:56:46.201271+0000","last_became_active":"2024-04-25T08:56:45.216898+0000","last_became_peered":"2024-04-25T08:56:45.216898+0000","last_unstale":"2024-04-25T08:56:46.201271+0000","last_undegraded":"2024-04-25T08:56:46.201271+0000","last_fullsized":"2024-04-25T08:56:46.201271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207823+0000","last_change":"2024-04-25T08:56:45.219777+0000","last_active":"2024-04-25T08:56:46.207823+0000","last_peered":"2024-04-25T08:56:46.207823+0000","last_clean":"2024-04-25T08:56:46.207823+0000","last_became_active":"2024-04-25T08:56:45.218541+0000","last_became_peered":"2024-04-25T08:56:45.218541+0000","last_unstale":"2024-04-25T08:56:46.207823+0000","last_undegraded":"2024-04-25T08:56:46.207823+0000","last_fullsized":"2024-04-25T08:56:46.207823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202756+0000","last_change":"2024-04-25T08:56:45.211649+0000","last_active":"2024-04-25T08:56:46.202756+0000","last_peered":"2024-04-25T08:56:46.202756+0000","last_clean":"2024-04-25T08:56:46.202756+0000","last_became_active":"2024-04-25T08:56:45.211344+0000","last_became_peered":"2024-04-25T08:56:45.211344+0000","last_unstale":"2024-04-25T08:56:46.202756+0000","last_undegraded":"2024-04-25T08:56:46.202756+0000","last_fullsized":"2024-04-25T08:56:46.202756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:22.869310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312755+0000","last_change":"2024-04-25T08:56:44.214502+0000","last_active":"2024-04-25T08:56:46.312755+0000","last_peered":"2024-04-25T08:56:46.312755+0000","last_clean":"2024-04-25T08:56:46.312755+0000","last_became_active":"2024-04-25T08:56:44.214144+0000","last_became_peered":"2024-04-25T08:56:44.214144+0000","last_unstale":"2024-04-25T08:56:46.312755+0000","last_undegraded":"2024-04-25T08:56:46.312755+0000","last_fullsized":"2024-04-25T08:56:46.312755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:59.869328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313200+0000","last_change":"2024-04-25T08:56:45.210462+0000","last_active":"2024-04-25T08:56:46.313200+0000","last_peered":"2024-04-25T08:56:46.313200+0000","last_clean":"2024-04-25T08:56:46.313200+0000","last_became_active":"2024-04-25T08:56:45.210182+0000","last_became_peered":"2024-04-25T08:56:45.210182+0000","last_unstale":"2024-04-25T08:56:46.313200+0000","last_undegraded":"2024-04-25T08:56:46.313200+0000","last_fullsized":"2024-04-25T08:56:46.313200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207842+0000","last_change":"2024-04-25T08:56:44.208738+0000","last_active":"2024-04-25T08:56:46.207842+0000","last_peered":"2024-04-25T08:56:46.207842+0000","last_clean":"2024-04-25T08:56:46.207842+0000","last_became_active":"2024-04-25T08:56:44.208463+0000","last_became_peered":"2024-04-25T08:56:44.208463+0000","last_unstale":"2024-04-25T08:56:46.207842+0000","last_undegraded":"2024-04-25T08:56:46.207842+0000","last_fullsized":"2024-04-25T08:56:46.207842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312653+0000","last_change":"2024-04-25T08:56:44.211862+0000","last_active":"2024-04-25T08:56:46.312653+0000","last_peered":"2024-04-25T08:56:46.312653+0000","last_clean":"2024-04-25T08:56:46.312653+0000","last_became_active":"2024-04-25T08:56:44.211570+0000","last_became_peered":"2024-04-25T08:56:44.211570+0000","last_unstale":"2024-04-25T08:56:46.312653+0000","last_undegraded":"2024-04-25T08:56:46.312653+0000","last_fullsized":"2024-04-25T08:56:46.312653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:46.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313056+0000","last_change":"2024-04-25T08:56:45.219509+0000","last_active":"2024-04-25T08:56:46.313056+0000","last_peered":"2024-04-25T08:56:46.313056+0000","last_clean":"2024-04-25T08:56:46.313056+0000","last_became_active":"2024-04-25T08:56:45.219154+0000","last_became_peered":"2024-04-25T08:56:45.219154+0000","last_unstale":"2024-04-25T08:56:46.313056+0000","last_undegraded":"2024-04-25T08:56:46.313056+0000","last_fullsized":"2024-04-25T08:56:46.313056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312752+0000","last_change":"2024-04-25T08:56:44.200599+0000","last_active":"2024-04-25T08:56:46.312752+0000","last_peered":"2024-04-25T08:56:46.312752+0000","last_clean":"2024-04-25T08:56:46.312752+0000","last_became_active":"2024-04-25T08:56:44.200191+0000","last_became_peered":"2024-04-25T08:56:44.200191+0000","last_unstale":"2024-04-25T08:56:46.312752+0000","last_undegraded":"2024-04-25T08:56:46.312752+0000","last_fullsized":"2024-04-25T08:56:46.312752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202126+0000","last_change":"2024-04-25T08:56:45.211808+0000","last_active":"2024-04-25T08:56:46.202126+0000","last_peered":"2024-04-25T08:56:46.202126+0000","last_clean":"2024-04-25T08:56:46.202126+0000","last_became_active":"2024-04-25T08:56:45.211189+0000","last_became_peered":"2024-04-25T08:56:45.211189+0000","last_unstale":"2024-04-25T08:56:46.202126+0000","last_undegraded":"2024-04-25T08:56:46.202126+0000","last_fullsized":"2024-04-25T08:56:46.202126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208129+0000","last_change":"2024-04-25T08:56:44.205653+0000","last_active":"2024-04-25T08:56:46.208129+0000","last_peered":"2024-04-25T08:56:46.208129+0000","last_clean":"2024-04-25T08:56:46.208129+0000","last_became_active":"2024-04-25T08:56:44.205360+0000","last_became_peered":"2024-04-25T08:56:44.205360+0000","last_unstale":"2024-04-25T08:56:46.208129+0000","last_undegraded":"2024-04-25T08:56:46.208129+0000","last_fullsized":"2024-04-25T08:56:46.208129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313249+0000","last_change":"2024-04-25T08:56:45.208313+0000","last_active":"2024-04-25T08:56:46.313249+0000","last_peered":"2024-04-25T08:56:46.313249+0000","last_clean":"2024-04-25T08:56:46.313249+0000","last_became_active":"2024-04-25T08:56:45.207996+0000","last_became_peered":"2024-04-25T08:56:45.207996+0000","last_unstale":"2024-04-25T08:56:46.313249+0000","last_undegraded":"2024-04-25T08:56:46.313249+0000","last_fullsized":"2024-04-25T08:56:46.313249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313024+0000","last_change":"2024-04-25T08:56:44.208544+0000","last_active":"2024-04-25T08:56:46.313024+0000","last_peered":"2024-04-25T08:56:46.313024+0000","last_clean":"2024-04-25T08:56:46.313024+0000","last_became_active":"2024-04-25T08:56:44.208279+0000","last_became_peered":"2024-04-25T08:56:44.208279+0000","last_unstale":"2024-04-25T08:56:46.313024+0000","last_undegraded":"2024-04-25T08:56:46.313024+0000","last_fullsized":"2024-04-25T08:56:46.313024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313098+0000","last_change":"2024-04-25T08:56:45.224921+0000","last_active":"2024-04-25T08:56:46.313098+0000","last_peered":"2024-04-25T08:56:46.313098+0000","last_clean":"2024-04-25T08:56:46.313098+0000","last_became_active":"2024-04-25T08:56:45.224477+0000","last_became_peered":"2024-04-25T08:56:45.224477+0000","last_unstale":"2024-04-25T08:56:46.313098+0000","last_undegraded":"2024-04-25T08:56:46.313098+0000","last_fullsized":"2024-04-25T08:56:46.313098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202246+0000","last_change":"2024-04-25T08:56:44.210451+0000","last_active":"2024-04-25T08:56:46.202246+0000","last_peered":"2024-04-25T08:56:46.202246+0000","last_clean":"2024-04-25T08:56:46.202246+0000","last_became_active":"2024-04-25T08:56:44.210149+0000","last_became_peered":"2024-04-25T08:56:44.210149+0000","last_unstale":"2024-04-25T08:56:46.202246+0000","last_undegraded":"2024-04-25T08:56:46.202246+0000","last_fullsized":"2024-04-25T08:56:46.202246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202999+0000","last_change":"2024-04-25T08:56:45.215179+0000","last_active":"2024-04-25T08:56:46.202999+0000","last_peered":"2024-04-25T08:56:46.202999+0000","last_clean":"2024-04-25T08:56:46.202999+0000","last_became_active":"2024-04-25T08:56:45.214913+0000","last_became_peered":"2024-04-25T08:56:45.214913+0000","last_unstale":"2024-04-25T08:56:46.202999+0000","last_undegraded":"2024-04-25T08:56:46.202999+0000","last_fullsized":"2024-04-25T08:56:46.202999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:51.875796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207952+0000","last_change":"2024-04-25T08:56:44.211758+0000","last_active":"2024-04-25T08:56:46.207952+0000","last_peered":"2024-04-25T08:56:46.207952+0000","last_clean":"2024-04-25T08:56:46.207952+0000","last_became_active":"2024-04-25T08:56:44.211556+0000","last_became_peered":"2024-04-25T08:56:44.211556+0000","last_unstale":"2024-04-25T08:56:46.207952+0000","last_undegraded":"2024-04-25T08:56:46.207952+0000","last_fullsized":"2024-04-25T08:56:46.207952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312667+0000","last_change":"2024-04-25T08:56:45.212558+0000","last_active":"2024-04-25T08:56:46.312667+0000","last_peered":"2024-04-25T08:56:46.312667+0000","last_clean":"2024-04-25T08:56:46.312667+0000","last_became_active":"2024-04-25T08:56:45.212258+0000","last_became_peered":"2024-04-25T08:56:45.212258+0000","last_unstale":"2024-04-25T08:56:46.312667+0000","last_undegraded":"2024-04-25T08:56:46.312667+0000","last_fullsized":"2024-04-25T08:56:46.312667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.819156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313161+0000","last_change":"2024-04-25T08:56:44.203992+0000","last_active":"2024-04-25T08:56:46.313161+0000","last_peered":"2024-04-25T08:56:46.313161+0000","last_clean":"2024-04-25T08:56:46.313161+0000","last_became_active":"2024-04-25T08:56:44.203708+0000","last_became_peered":"2024-04-25T08:56:44.203708+0000","last_unstale":"2024-04-25T08:56:46.313161+0000","last_undegraded":"2024-04-25T08:56:46.313161+0000","last_fullsized":"2024-04-25T08:56:46.313161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:58.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312991+0000","last_change":"2024-04-25T08:56:45.216900+0000","last_active":"2024-04-25T08:56:46.312991+0000","last_peered":"2024-04-25T08:56:46.312991+0000","last_clean":"2024-04-25T08:56:46.312991+0000","last_became_active":"2024-04-25T08:56:45.216635+0000","last_became_peered":"2024-04-25T08:56:45.216635+0000","last_unstale":"2024-04-25T08:56:46.312991+0000","last_undegraded":"2024-04-25T08:56:46.312991+0000","last_fullsized":"2024-04-25T08:56:46.312991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.046928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313390+0000","last_change":"2024-04-25T08:56:44.207778+0000","last_active":"2024-04-25T08:56:46.313390+0000","last_peered":"2024-04-25T08:56:46.313390+0000","last_clean":"2024-04-25T08:56:46.313390+0000","last_became_active":"2024-04-25T08:56:44.207350+0000","last_became_peered":"2024-04-25T08:56:44.207350+0000","last_unstale":"2024-04-25T08:56:46.313390+0000","last_undegraded":"2024-04-25T08:56:46.313390+0000","last_fullsized":"2024-04-25T08:56:46.313390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312668+0000","last_change":"2024-04-25T08:56:45.217676+0000","last_active":"2024-04-25T08:56:46.312668+0000","last_peered":"2024-04-25T08:56:46.312668+0000","last_clean":"2024-04-25T08:56:46.312668+0000","last_became_active":"2024-04-25T08:56:45.217175+0000","last_became_peered":"2024-04-25T08:56:45.217175+0000","last_unstale":"2024-04-25T08:56:46.312668+0000","last_undegraded":"2024-04-25T08:56:46.312668+0000","last_fullsized":"2024-04-25T08:56:46.312668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:37.397335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207779+0000","last_change":"2024-04-25T08:56:44.207850+0000","last_active":"2024-04-25T08:56:46.207779+0000","last_peered":"2024-04-25T08:56:46.207779+0000","last_clean":"2024-04-25T08:56:46.207779+0000","last_became_active":"2024-04-25T08:56:44.207520+0000","last_became_peered":"2024-04-25T08:56:44.207520+0000","last_unstale":"2024-04-25T08:56:46.207779+0000","last_undegraded":"2024-04-25T08:56:46.207779+0000","last_fullsized":"2024-04-25T08:56:46.207779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207823+0000","last_change":"2024-04-25T08:56:45.218163+0000","last_active":"2024-04-25T08:56:46.207823+0000","last_peered":"2024-04-25T08:56:46.207823+0000","last_clean":"2024-04-25T08:56:46.207823+0000","last_became_active":"2024-04-25T08:56:45.217700+0000","last_became_peered":"2024-04-25T08:56:45.217700+0000","last_unstale":"2024-04-25T08:56:46.207823+0000","last_undegraded":"2024-04-25T08:56:46.207823+0000","last_fullsized":"2024-04-25T08:56:46.207823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201199+0000","last_change":"2024-04-25T08:56:44.205778+0000","last_active":"2024-04-25T08:56:46.201199+0000","last_peered":"2024-04-25T08:56:46.201199+0000","last_clean":"2024-04-25T08:56:46.201199+0000","last_became_active":"2024-04-25T08:56:44.205483+0000","last_became_peered":"2024-04-25T08:56:44.205483+0000","last_unstale":"2024-04-25T08:56:46.201199+0000","last_undegraded":"2024-04-25T08:56:46.201199+0000","last_fullsized":"2024-04-25T08:56:46.201199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:46.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312166+0000","last_change":"2024-04-25T08:56:45.211144+0000","last_active":"2024-04-25T08:56:46.312166+0000","last_peered":"2024-04-25T08:56:46.312166+0000","last_clean":"2024-04-25T08:56:46.312166+0000","last_became_active":"2024-04-25T08:56:45.210768+0000","last_became_peered":"2024-04-25T08:56:45.210768+0000","last_unstale":"2024-04-25T08:56:46.312166+0000","last_undegraded":"2024-04-25T08:56:46.312166+0000","last_fullsized":"2024-04-25T08:56:46.312166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202956+0000","last_change":"2024-04-25T08:56:44.207687+0000","last_active":"2024-04-25T08:56:46.202956+0000","last_peered":"2024-04-25T08:56:46.202956+0000","last_clean":"2024-04-25T08:56:46.202956+0000","last_became_active":"2024-04-25T08:56:44.207385+0000","last_became_peered":"2024-04-25T08:56:44.207385+0000","last_unstale":"2024-04-25T08:56:46.202956+0000","last_undegraded":"2024-04-25T08:56:46.202956+0000","last_fullsized":"2024-04-25T08:56:46.202956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:46.762190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312589+0000","last_change":"2024-04-25T08:56:45.212331+0000","last_active":"2024-04-25T08:56:46.312589+0000","last_peered":"2024-04-25T08:56:46.312589+0000","last_clean":"2024-04-25T08:56:46.312589+0000","last_became_active":"2024-04-25T08:56:45.212031+0000","last_became_peered":"2024-04-25T08:56:45.212031+0000","last_unstale":"2024-04-25T08:56:46.312589+0000","last_undegraded":"2024-04-25T08:56:46.312589+0000","last_fullsized":"2024-04-25T08:56:46.312589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201454+0000","last_change":"2024-04-25T08:56:44.208898+0000","last_active":"2024-04-25T08:56:46.201454+0000","last_peered":"2024-04-25T08:56:46.201454+0000","last_clean":"2024-04-25T08:56:46.201454+0000","last_became_active":"2024-04-25T08:56:44.208607+0000","last_became_peered":"2024-04-25T08:56:44.208607+0000","last_unstale":"2024-04-25T08:56:46.201454+0000","last_undegraded":"2024-04-25T08:56:46.201454+0000","last_fullsized":"2024-04-25T08:56:46.201454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312973+0000","last_change":"2024-04-25T08:56:45.217243+0000","last_active":"2024-04-25T08:56:46.312973+0000","last_peered":"2024-04-25T08:56:46.312973+0000","last_clean":"2024-04-25T08:56:46.312973+0000","last_became_active":"2024-04-25T08:56:45.216943+0000","last_became_peered":"2024-04-25T08:56:45.216943+0000","last_unstale":"2024-04-25T08:56:46.312973+0000","last_undegraded":"2024-04-25T08:56:46.312973+0000","last_fullsized":"2024-04-25T08:56:46.312973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:53.035287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202338+0000","last_change":"2024-04-25T08:56:44.207711+0000","last_active":"2024-04-25T08:56:46.202338+0000","last_peered":"2024-04-25T08:56:46.202338+0000","last_clean":"2024-04-25T08:56:46.202338+0000","last_became_active":"2024-04-25T08:56:44.207001+0000","last_became_peered":"2024-04-25T08:56:44.207001+0000","last_unstale":"2024-04-25T08:56:46.202338+0000","last_undegraded":"2024-04-25T08:56:46.202338+0000","last_fullsized":"2024-04-25T08:56:46.202338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:32.834402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313464+0000","last_change":"2024-04-25T08:56:45.210543+0000","last_active":"2024-04-25T08:56:46.313464+0000","last_peered":"2024-04-25T08:56:46.313464+0000","last_clean":"2024-04-25T08:56:46.313464+0000","last_became_active":"2024-04-25T08:56:45.210276+0000","last_became_peered":"2024-04-25T08:56:45.210276+0000","last_unstale":"2024-04-25T08:56:46.313464+0000","last_undegraded":"2024-04-25T08:56:46.313464+0000","last_fullsized":"2024-04-25T08:56:46.313464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:53.035287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201395+0000","last_change":"2024-04-25T08:56:44.203045+0000","last_active":"2024-04-25T08:56:46.201395+0000","last_peered":"2024-04-25T08:56:46.201395+0000","last_clean":"2024-04-25T08:56:46.201395+0000","last_became_active":"2024-04-25T08:56:44.202649+0000","last_became_peered":"2024-04-25T08:56:44.202649+0000","last_unstale":"2024-04-25T08:56:46.201395+0000","last_undegraded":"2024-04-25T08:56:46.201395+0000","last_fullsized":"2024-04-25T08:56:46.201395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:08.626305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312471+0000","last_change":"2024-04-25T08:56:45.221348+0000","last_active":"2024-04-25T08:56:46.312471+0000","last_peered":"2024-04-25T08:56:46.312471+0000","last_clean":"2024-04-25T08:56:46.312471+0000","last_became_active":"2024-04-25T08:56:45.221025+0000","last_became_peered":"2024-04-25T08:56:45.221025+0000","last_unstale":"2024-04-25T08:56:46.312471+0000","last_undegraded":"2024-04-25T08:56:46.312471+0000","last_fullsized":"2024-04-25T08:56:46.312471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312137+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:56:46.312137+0000","last_peered":"2024-04-25T08:56:46.312137+0000","last_clean":"2024-04-25T08:56:46.312137+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:56:46.312137+0000","last_undegraded":"2024-04-25T08:56:46.312137+0000","last_fullsized":"2024-04-25T08:56:46.312137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312814+0000","last_change":"2024-04-25T08:56:44.200807+0000","last_active":"2024-04-25T08:56:46.312814+0000","last_peered":"2024-04-25T08:56:46.312814+0000","last_clean":"2024-04-25T08:56:46.312814+0000","last_became_active":"2024-04-25T08:56:44.200035+0000","last_became_peered":"2024-04-25T08:56:44.200035+0000","last_unstale":"2024-04-25T08:56:46.312814+0000","last_undegraded":"2024-04-25T08:56:46.312814+0000","last_fullsized":"2024-04-25T08:56:46.312814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:08.626305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312931+0000","last_change":"2024-04-25T08:56:45.211720+0000","last_active":"2024-04-25T08:56:46.312931+0000","last_peered":"2024-04-25T08:56:46.312931+0000","last_clean":"2024-04-25T08:56:46.312931+0000","last_became_active":"2024-04-25T08:56:45.211423+0000","last_became_peered":"2024-04-25T08:56:45.211423+0000","last_unstale":"2024-04-25T08:56:46.312931+0000","last_undegraded":"2024-04-25T08:56:46.312931+0000","last_fullsized":"2024-04-25T08:56:46.312931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312074+0000","last_change":"2024-04-25T08:56:44.214689+0000","last_active":"2024-04-25T08:56:46.312074+0000","last_peered":"2024-04-25T08:56:46.312074+0000","last_clean":"2024-04-25T08:56:46.312074+0000","last_became_active":"2024-04-25T08:56:44.214419+0000","last_became_peered":"2024-04-25T08:56:44.214419+0000","last_unstale":"2024-04-25T08:56:46.312074+0000","last_undegraded":"2024-04-25T08:56:46.312074+0000","last_fullsized":"2024-04-25T08:56:46.312074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312174+0000","last_change":"2024-04-25T08:56:45.207245+0000","last_active":"2024-04-25T08:56:46.312174+0000","last_peered":"2024-04-25T08:56:46.312174+0000","last_clean":"2024-04-25T08:56:46.312174+0000","last_became_active":"2024-04-25T08:56:45.206744+0000","last_became_peered":"2024-04-25T08:56:45.206744+0000","last_unstale":"2024-04-25T08:56:46.312174+0000","last_undegraded":"2024-04-25T08:56:46.312174+0000","last_fullsized":"2024-04-25T08:56:46.312174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:34.740579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201303+0000","last_change":"2024-04-25T08:56:44.209586+0000","last_active":"2024-04-25T08:56:46.201303+0000","last_peered":"2024-04-25T08:56:46.201303+0000","last_clean":"2024-04-25T08:56:46.201303+0000","last_became_active":"2024-04-25T08:56:44.209270+0000","last_became_peered":"2024-04-25T08:56:44.209270+0000","last_unstale":"2024-04-25T08:56:46.201303+0000","last_undegraded":"2024-04-25T08:56:46.201303+0000","last_fullsized":"2024-04-25T08:56:46.201303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201993+0000","last_change":"2024-04-25T08:56:45.212305+0000","last_active":"2024-04-25T08:56:46.201993+0000","last_peered":"2024-04-25T08:56:46.201993+0000","last_clean":"2024-04-25T08:56:46.201993+0000","last_became_active":"2024-04-25T08:56:45.210796+0000","last_became_peered":"2024-04-25T08:56:45.210796+0000","last_unstale":"2024-04-25T08:56:46.201993+0000","last_undegraded":"2024-04-25T08:56:46.201993+0000","last_fullsized":"2024-04-25T08:56:46.201993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313436+0000","last_change":"2024-04-25T08:56:44.208927+0000","last_active":"2024-04-25T08:56:46.313436+0000","last_peered":"2024-04-25T08:56:46.313436+0000","last_clean":"2024-04-25T08:56:46.313436+0000","last_became_active":"2024-04-25T08:56:44.208247+0000","last_became_peered":"2024-04-25T08:56:44.208247+0000","last_unstale":"2024-04-25T08:56:46.313436+0000","last_undegraded":"2024-04-25T08:56:46.313436+0000","last_fullsized":"2024-04-25T08:56:46.313436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202914+0000","last_change":"2024-04-25T08:56:45.215544+0000","last_active":"2024-04-25T08:56:46.202914+0000","last_peered":"2024-04-25T08:56:46.202914+0000","last_clean":"2024-04-25T08:56:46.202914+0000","last_became_active":"2024-04-25T08:56:45.215254+0000","last_became_peered":"2024-04-25T08:56:45.215254+0000","last_unstale":"2024-04-25T08:56:46.202914+0000","last_undegraded":"2024-04-25T08:56:46.202914+0000","last_fullsized":"2024-04-25T08:56:46.202914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:07.425213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202106+0000","last_change":"2024-04-25T08:56:44.208338+0000","last_active":"2024-04-25T08:56:46.202106+0000","last_peered":"2024-04-25T08:56:46.202106+0000","last_clean":"2024-04-25T08:56:46.202106+0000","last_became_active":"2024-04-25T08:56:44.208015+0000","last_became_peered":"2024-04-25T08:56:44.208015+0000","last_unstale":"2024-04-25T08:56:46.202106+0000","last_undegraded":"2024-04-25T08:56:46.202106+0000","last_fullsized":"2024-04-25T08:56:46.202106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313288+0000","last_change":"2024-04-25T08:56:45.214759+0000","last_active":"2024-04-25T08:56:46.313288+0000","last_peered":"2024-04-25T08:56:46.313288+0000","last_clean":"2024-04-25T08:56:46.313288+0000","last_became_active":"2024-04-25T08:56:45.212500+0000","last_became_peered":"2024-04-25T08:56:45.212500+0000","last_unstale":"2024-04-25T08:56:46.313288+0000","last_undegraded":"2024-04-25T08:56:46.313288+0000","last_fullsized":"2024-04-25T08:56:46.313288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.819156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312834+0000","last_change":"2024-04-25T08:56:44.214874+0000","last_active":"2024-04-25T08:56:46.312834+0000","last_peered":"2024-04-25T08:56:46.312834+0000","last_clean":"2024-04-25T08:56:46.312834+0000","last_became_active":"2024-04-25T08:56:44.214468+0000","last_became_peered":"2024-04-25T08:56:44.214468+0000","last_unstale":"2024-04-25T08:56:46.312834+0000","last_undegraded":"2024-04-25T08:56:46.312834+0000","last_fullsized":"2024-04-25T08:56:46.312834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:32.834402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202189+0000","last_change":"2024-04-25T08:56:45.210674+0000","last_active":"2024-04-25T08:56:46.202189+0000","last_peered":"2024-04-25T08:56:46.202189+0000","last_clean":"2024-04-25T08:56:46.202189+0000","last_became_active":"2024-04-25T08:56:45.210330+0000","last_became_peered":"2024-04-25T08:56:45.210330+0000","last_unstale":"2024-04-25T08:56:46.202189+0000","last_undegraded":"2024-04-25T08:56:46.202189+0000","last_fullsized":"2024-04-25T08:56:46.202189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207197+0000","last_change":"2024-04-25T08:56:44.212498+0000","last_active":"2024-04-25T08:56:46.207197+0000","last_peered":"2024-04-25T08:56:46.207197+0000","last_clean":"2024-04-25T08:56:46.207197+0000","last_became_active":"2024-04-25T08:56:44.212180+0000","last_became_peered":"2024-04-25T08:56:44.212180+0000","last_unstale":"2024-04-25T08:56:46.207197+0000","last_undegraded":"2024-04-25T08:56:46.207197+0000","last_fullsized":"2024-04-25T08:56:46.207197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312549+0000","last_change":"2024-04-25T08:56:45.218534+0000","last_active":"2024-04-25T08:56:46.312549+0000","last_peered":"2024-04-25T08:56:46.312549+0000","last_clean":"2024-04-25T08:56:46.312549+0000","last_became_active":"2024-04-25T08:56:45.218166+0000","last_became_peered":"2024-04-25T08:56:45.218166+0000","last_unstale":"2024-04-25T08:56:46.312549+0000","last_undegraded":"2024-04-25T08:56:46.312549+0000","last_fullsized":"2024-04-25T08:56:46.312549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208185+0000","last_change":"2024-04-25T08:56:44.211242+0000","last_active":"2024-04-25T08:56:46.208185+0000","last_peered":"2024-04-25T08:56:46.208185+0000","last_clean":"2024-04-25T08:56:46.208185+0000","last_became_active":"2024-04-25T08:56:44.210967+0000","last_became_peered":"2024-04-25T08:56:44.210967+0000","last_unstale":"2024-04-25T08:56:46.208185+0000","last_undegraded":"2024-04-25T08:56:46.208185+0000","last_fullsized":"2024-04-25T08:56:46.208185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312699+0000","last_change":"2024-04-25T08:56:45.214551+0000","last_active":"2024-04-25T08:56:46.312699+0000","last_peered":"2024-04-25T08:56:46.312699+0000","last_clean":"2024-04-25T08:56:46.312699+0000","last_became_active":"2024-04-25T08:56:45.214250+0000","last_became_peered":"2024-04-25T08:56:45.214250+0000","last_unstale":"2024-04-25T08:56:46.312699+0000","last_undegraded":"2024-04-25T08:56:46.312699+0000","last_fullsized":"2024-04-25T08:56:46.312699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:38.844974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312069+0000","last_change":"2024-04-25T08:56:44.215078+0000","last_active":"2024-04-25T08:56:46.312069+0000","last_peered":"2024-04-25T08:56:46.312069+0000","last_clean":"2024-04-25T08:56:46.312069+0000","last_became_active":"2024-04-25T08:56:44.214389+0000","last_became_peered":"2024-04-25T08:56:44.214389+0000","last_unstale":"2024-04-25T08:56:46.312069+0000","last_undegraded":"2024-04-25T08:56:46.312069+0000","last_fullsized":"2024-04-25T08:56:46.312069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.203031+0000","last_change":"2024-04-25T08:56:45.200378+0000","last_active":"2024-04-25T08:56:46.203031+0000","last_peered":"2024-04-25T08:56:46.203031+0000","last_clean":"2024-04-25T08:56:46.203031+0000","last_became_active":"2024-04-25T08:56:45.200097+0000","last_became_peered":"2024-04-25T08:56:45.200097+0000","last_unstale":"2024-04-25T08:56:46.203031+0000","last_undegraded":"2024-04-25T08:56:46.203031+0000","last_fullsized":"2024-04-25T08:56:46.203031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202120+0000","last_change":"2024-04-25T08:56:44.207693+0000","last_active":"2024-04-25T08:56:46.202120+0000","last_peered":"2024-04-25T08:56:46.202120+0000","last_clean":"2024-04-25T08:56:46.202120+0000","last_became_active":"2024-04-25T08:56:44.207401+0000","last_became_peered":"2024-04-25T08:56:44.207401+0000","last_unstale":"2024-04-25T08:56:46.202120+0000","last_undegraded":"2024-04-25T08:56:46.202120+0000","last_fullsized":"2024-04-25T08:56:46.202120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313184+0000","last_change":"2024-04-25T08:56:45.215069+0000","last_active":"2024-04-25T08:56:46.313184+0000","last_peered":"2024-04-25T08:56:46.313184+0000","last_clean":"2024-04-25T08:56:46.313184+0000","last_became_active":"2024-04-25T08:56:45.214326+0000","last_became_peered":"2024-04-25T08:56:45.214326+0000","last_unstale":"2024-04-25T08:56:46.313184+0000","last_undegraded":"2024-04-25T08:56:46.313184+0000","last_fullsized":"2024-04-25T08:56:46.313184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202098+0000","last_change":"2024-04-25T08:56:44.210794+0000","last_active":"2024-04-25T08:56:46.202098+0000","last_peered":"2024-04-25T08:56:46.202098+0000","last_clean":"2024-04-25T08:56:46.202098+0000","last_became_active":"2024-04-25T08:56:44.210493+0000","last_became_peered":"2024-04-25T08:56:44.210493+0000","last_unstale":"2024-04-25T08:56:46.202098+0000","last_undegraded":"2024-04-25T08:56:46.202098+0000","last_fullsized":"2024-04-25T08:56:46.202098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312764+0000","last_change":"2024-04-25T08:56:45.215033+0000","last_active":"2024-04-25T08:56:46.312764+0000","last_peered":"2024-04-25T08:56:46.312764+0000","last_clean":"2024-04-25T08:56:46.312764+0000","last_became_active":"2024-04-25T08:56:45.214737+0000","last_became_peered":"2024-04-25T08:56:45.214737+0000","last_unstale":"2024-04-25T08:56:46.312764+0000","last_undegraded":"2024-04-25T08:56:46.312764+0000","last_fullsized":"2024-04-25T08:56:46.312764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312808+0000","last_change":"2024-04-25T08:56:44.214790+0000","last_active":"2024-04-25T08:56:46.312808+0000","last_peered":"2024-04-25T08:56:46.312808+0000","last_clean":"2024-04-25T08:56:46.312808+0000","last_became_active":"2024-04-25T08:56:44.214065+0000","last_became_peered":"2024-04-25T08:56:44.214065+0000","last_unstale":"2024-04-25T08:56:46.312808+0000","last_undegraded":"2024-04-25T08:56:46.312808+0000","last_fullsized":"2024-04-25T08:56:46.312808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207833+0000","last_change":"2024-04-25T08:56:45.206755+0000","last_active":"2024-04-25T08:56:46.207833+0000","last_peered":"2024-04-25T08:56:46.207833+0000","last_clean":"2024-04-25T08:56:46.207833+0000","last_became_active":"2024-04-25T08:56:45.206478+0000","last_became_peered":"2024-04-25T08:56:45.206478+0000","last_unstale":"2024-04-25T08:56:46.207833+0000","last_undegraded":"2024-04-25T08:56:46.207833+0000","last_fullsized":"2024-04-25T08:56:46.207833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313135+0000","last_change":"2024-04-25T08:56:45.214962+0000","last_active":"2024-04-25T08:56:46.313135+0000","last_peered":"2024-04-25T08:56:46.313135+0000","last_clean":"2024-04-25T08:56:46.313135+0000","last_became_active":"2024-04-25T08:56:45.214427+0000","last_became_peered":"2024-04-25T08:56:45.214427+0000","last_unstale":"2024-04-25T08:56:46.313135+0000","last_undegraded":"2024-04-25T08:56:46.313135+0000","last_fullsized":"2024-04-25T08:56:46.313135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312386+0000","last_change":"2024-04-25T08:56:44.214088+0000","last_active":"2024-04-25T08:56:46.312386+0000","last_peered":"2024-04-25T08:56:46.312386+0000","last_clean":"2024-04-25T08:56:46.312386+0000","last_became_active":"2024-04-25T08:56:44.213784+0000","last_became_peered":"2024-04-25T08:56:44.213784+0000","last_unstale":"2024-04-25T08:56:46.312386+0000","last_undegraded":"2024-04-25T08:56:46.312386+0000","last_fullsized":"2024-04-25T08:56:46.312386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313419+0000","last_change":"2024-04-25T08:56:45.212864+0000","last_active":"2024-04-25T08:56:46.313419+0000","last_peered":"2024-04-25T08:56:46.313419+0000","last_clean":"2024-04-25T08:56:46.313419+0000","last_became_active":"2024-04-25T08:56:45.211275+0000","last_became_peered":"2024-04-25T08:56:45.211275+0000","last_unstale":"2024-04-25T08:56:46.313419+0000","last_undegraded":"2024-04-25T08:56:46.313419+0000","last_fullsized":"2024-04-25T08:56:46.313419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:40.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312581+0000","last_change":"2024-04-25T08:56:44.214267+0000","last_active":"2024-04-25T08:56:46.312581+0000","last_peered":"2024-04-25T08:56:46.312581+0000","last_clean":"2024-04-25T08:56:46.312581+0000","last_became_active":"2024-04-25T08:56:44.213968+0000","last_became_peered":"2024-04-25T08:56:44.213968+0000","last_unstale":"2024-04-25T08:56:46.312581+0000","last_undegraded":"2024-04-25T08:56:46.312581+0000","last_fullsized":"2024-04-25T08:56:46.312581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313067+0000","last_change":"2024-04-25T08:56:45.225578+0000","last_active":"2024-04-25T08:56:46.313067+0000","last_peered":"2024-04-25T08:56:46.313067+0000","last_clean":"2024-04-25T08:56:46.313067+0000","last_became_active":"2024-04-25T08:56:45.224851+0000","last_became_peered":"2024-04-25T08:56:45.224851+0000","last_unstale":"2024-04-25T08:56:46.313067+0000","last_undegraded":"2024-04-25T08:56:46.313067+0000","last_fullsized":"2024-04-25T08:56:46.313067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312485+0000","last_change":"2024-04-25T08:56:44.209898+0000","last_active":"2024-04-25T08:56:46.312485+0000","last_peered":"2024-04-25T08:56:46.312485+0000","last_clean":"2024-04-25T08:56:46.312485+0000","last_became_active":"2024-04-25T08:56:44.208992+0000","last_became_peered":"2024-04-25T08:56:44.208992+0000","last_unstale":"2024-04-25T08:56:46.312485+0000","last_undegraded":"2024-04-25T08:56:46.312485+0000","last_fullsized":"2024-04-25T08:56:46.312485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312300+0000","last_change":"2024-04-25T08:56:45.207031+0000","last_active":"2024-04-25T08:56:46.312300+0000","last_peered":"2024-04-25T08:56:46.312300+0000","last_clean":"2024-04-25T08:56:46.312300+0000","last_became_active":"2024-04-25T08:56:45.206558+0000","last_became_peered":"2024-04-25T08:56:45.206558+0000","last_unstale":"2024-04-25T08:56:46.312300+0000","last_undegraded":"2024-04-25T08:56:46.312300+0000","last_fullsized":"2024-04-25T08:56:46.312300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313186+0000","last_change":"2024-04-25T08:56:44.214095+0000","last_active":"2024-04-25T08:56:46.313186+0000","last_peered":"2024-04-25T08:56:46.313186+0000","last_clean":"2024-04-25T08:56:46.313186+0000","last_became_active":"2024-04-25T08:56:44.213800+0000","last_became_peered":"2024-04-25T08:56:44.213800+0000","last_unstale":"2024-04-25T08:56:46.313186+0000","last_undegraded":"2024-04-25T08:56:46.313186+0000","last_fullsized":"2024-04-25T08:56:46.313186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:52.735112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:48.532 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:56:48.533 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T08:56:48.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T08:56:48.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T08:56:48.533 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T08:56:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.679+0000 7f87d0a9a640 1 Processor -- start 2024-04-25T08:56:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.679+0000 7f87d0a9a640 1 -- start start 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87d0a9a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc15e0a0 0x7f87cc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87d0a9a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87cc0d3990 0x7f87cc0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87d0a9a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f87cc0ce5e0 0x7f87cc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87d0a9a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0d4330 con 0x7f87cc0d3990 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87d0a9a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0b29c0 con 0x7f87cc0ce5e0 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87d0a9a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0d2080 con 0x7f87cc15e0a0 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87cc0d3990 0x7f87cc0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87cc0d3990 0x7f87cc0d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35802/0 (socket says 172.21.15.5:35802) 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 -- 172.21.15.5:0/172160254 learned_addr learned my addr 172.21.15.5:0/172160254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87cad9d640 1 --2- 172.21.15.5:0/172160254 >> v2:172.21.15.80:3300/0 conn(0x7f87cc0ce5e0 0x7f87cc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 -- 172.21.15.5:0/172160254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc15e0a0 msgr2=0x7f87cc0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87ca59c640 1 --2- 172.21.15.5:0/172160254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc15e0a0 0x7f87cc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 --2- 172.21.15.5:0/172160254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc15e0a0 0x7f87cc0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 -- 172.21.15.5:0/172160254 >> v2:172.21.15.80:3300/0 conn(0x7f87cc0ce5e0 msgr2=0x7f87cc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 --2- 172.21.15.5:0/172160254 >> v2:172.21.15.80:3300/0 conn(0x7f87cc0ce5e0 0x7f87cc0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87c3fff640 1 -- 172.21.15.5:0/172160254 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0d2360 con 0x7f87cc0d3990 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87cad9d640 1 --2- 172.21.15.5:0/172160254 >> v2:172.21.15.80:3300/0 conn(0x7f87cc0ce5e0 0x7f87cc0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.680+0000 7f87ca59c640 1 --2- 172.21.15.5:0/172160254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc15e0a0 0x7f87cc0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.681+0000 7f87c3fff640 1 --2- 172.21.15.5:0/172160254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc0d3990 0x7f87cc0d3df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87cc08cfd0 tx=0x7f87b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90234b1ab9a4a48d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.681+0000 7f87c9d9b640 1 -- 172.21.15.5:0/172160254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4037070 con 0x7f87cc0d3990 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.681+0000 7f87c9d9b640 1 -- 172.21.15.5:0/172160254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b4032440 con 0x7f87cc0d3990 2024-04-25T08:56:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.681+0000 7f87c9d9b640 1 -- 172.21.15.5:0/172160254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4032810 con 0x7f87cc0d3990 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 -- 172.21.15.5:0/172160254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc0d3990 msgr2=0x7f87cc0d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/172160254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc0d3990 0x7f87cc0d3df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87cc08cfd0 tx=0x7f87b402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 -- 172.21.15.5:0/172160254 shutdown_connections 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/172160254 >> v2:172.21.15.80:3300/0 conn(0x7f87cc0ce5e0 0x7f87cc0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/172160254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc0d3990 0x7f87cc0d3df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/172160254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc15e0a0 0x7f87cc0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 -- 172.21.15.5:0/172160254 >> 172.21.15.5:0/172160254 conn(0x7f87cc0668f0 msgr2=0x7f87cc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 -- 172.21.15.5:0/172160254 shutdown_connections 2024-04-25T08:56:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.682+0000 7f87d0a9a640 1 -- 172.21.15.5:0/172160254 wait complete. 2024-04-25T08:56:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.683+0000 7f87d0a9a640 1 Processor -- start 2024-04-25T08:56:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.683+0000 7f87d0a9a640 1 -- start start 2024-04-25T08:56:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87d0a9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87cc0ce5e0 0x7f87cc0aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87d0a9a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc0d3990 0x7f87cc1f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87d0a9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc15e0a0 0x7f87cc1f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87d0a9a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0d2c00 con 0x7f87cc15e0a0 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87d0a9a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0d2920 con 0x7f87cc0ce5e0 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87d0a9a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc15e480 con 0x7f87cc0d3990 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc15e0a0 0x7f87cc1f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc15e0a0 0x7f87cc1f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35808/0 (socket says 172.21.15.5:35808) 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 -- 172.21.15.5:0/3514991649 learned_addr learned my addr 172.21.15.5:0/3514991649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87ca59c640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87cc0ce5e0 0x7f87cc0aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87c3fff640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc0d3990 0x7f87cc1f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 -- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc0d3990 msgr2=0x7f87cc1f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc0d3990 0x7f87cc1f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 -- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87cc0ce5e0 msgr2=0x7f87cc0aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87cc0ce5e0 0x7f87cc0aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 -- 172.21.15.5:0/3514991649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc1f3780 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87ca59c640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87cc0ce5e0 0x7f87cc0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87cad9d640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc15e0a0 0x7f87cc1f3240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f87c400cd10 tx=0x7f87c400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87c2ffd640 1 -- 172.21.15.5:0/3514991649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400f680 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87c2ffd640 1 -- 172.21.15.5:0/3514991649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c400f840 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc0b5c70 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.684+0000 7f87c2ffd640 1 -- 172.21.15.5:0/3514991649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400fc30 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.685+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc14ab70 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.686+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc04ef20 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.686+0000 7f87c2ffd640 1 -- 172.21.15.5:0/3514991649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f87c40213f0 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.686+0000 7f87c2ffd640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f87ac06b4d0 0x7f87ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.686+0000 7f87c2ffd640 1 -- 172.21.15.5:0/3514991649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87c408afe0 con 0x7f87cc15e0a0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.687+0000 7f87ca59c640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f87ac06b4d0 0x7f87ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:48.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.687+0000 7f87ca59c640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f87ac06b4d0 0x7f87ac06d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87bc006fd0 tx=0x7f87bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:48.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.690+0000 7f87c2ffd640 1 -- 172.21.15.5:0/3514991649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87cc1f3780 con 0x7f87cc15e0a0 2024-04-25T08:56:48.875 INFO:tasks.ceph.mds.b.smithi080.stderr:2024-04-25T08:56:48.885+0000 7f55e17c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:56:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.918+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f87cc0d1c70 con 0x7f87cc15e0a0 2024-04-25T08:56:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.921+0000 7f87c2ffd640 1 -- 172.21.15.5:0/3514991649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171781 (secure 0 0 0) 0x7f87c4014030 con 0x7f87cc15e0a0 2024-04-25T08:56:48.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f87ac06b4d0 msgr2=0x7f87ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f87ac06b4d0 0x7f87ac06d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87bc006fd0 tx=0x7f87bc008040 comp rx=0 tx=0).stop 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc15e0a0 msgr2=0x7f87cc1f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc15e0a0 0x7f87cc1f3240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f87c400cd10 tx=0x7f87c400a650 comp rx=0 tx=0).stop 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 shutdown_connections 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f87ac06b4d0 0x7f87ac06d990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87cc15e0a0 0x7f87cc1f3240 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87cc0d3990 0x7f87cc1f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 --2- 172.21.15.5:0/3514991649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87cc0ce5e0 0x7f87cc0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 >> 172.21.15.5:0/3514991649 conn(0x7f87cc0668f0 msgr2=0x7f87cc066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 shutdown_connections 2024-04-25T08:56:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:48.923+0000 7f87d0a9a640 1 -- 172.21.15.5:0/3514991649 wait complete. 2024-04-25T08:56:48.923 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":353132559},{"type":"v1","addr":"172.21.15.80:6833","nonce":353132559}]},"active_addr":"172.21.15.80:6833/353132559","active_change":"2024-04-25T08:56:24.375688+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":654628284}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2014612264}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1937975329}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2354339132}]}]} 2024-04-25T08:56:48.927 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T08:56:48.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T08:56:48.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.037+0000 7fe93717e640 1 Processor -- start 2024-04-25T08:56:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.037+0000 7fe93717e640 1 -- start start 2024-04-25T08:56:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.038+0000 7fe93717e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300d3990 0x7fe9300d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.038+0000 7fe93717e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300b29c0 con 0x7fe93015e0a0 2024-04-25T08:56:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.038+0000 7fe93717e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300d2080 con 0x7fe9300b6f50 2024-04-25T08:56:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.038+0000 7fe93717e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300d4330 con 0x7fe9300d3990 2024-04-25T08:56:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.038+0000 7fe934f1a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe93015e0a0 0x7fe9300d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58006/0 (socket says 172.21.15.5:58006) 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.038+0000 7fe934f1a640 1 -- 172.21.15.5:0/4026069121 learned_addr learned my addr 172.21.15.5:0/4026069121 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.038+0000 7fe92ffff640 1 --2- 172.21.15.5:0/4026069121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300d3990 0x7fe9300d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747140233 0 0) 0x7fe9300b29c0 con 0x7fe93015e0a0 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe920003520 con 0x7fe93015e0a0 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447100412 0 0) 0x7fe9300d2080 con 0x7fe9300b6f50 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9300b29c0 con 0x7fe9300b6f50 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92ffff640 1 -- 172.21.15.5:0/4026069121 >> v1:172.21.15.80:6789/0 conn(0x7fe9300b6f50 legacy=0x7fe9300b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397242943 0 0) 0x7fe920003520 con 0x7fe93015e0a0 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92ffff640 1 -- 172.21.15.5:0/4026069121 >> v1:172.21.15.5:6789/0 conn(0x7fe93015e0a0 legacy=0x7fe9300d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92ffff640 1 -- 172.21.15.5:0/4026069121 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300d2360 con 0x7fe9300d3990 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.039+0000 7fe92ffff640 1 --2- 172.21.15.5:0/4026069121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300d3990 0x7fe9300d3df0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097d0 tx=0x7fe91c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7fde5e4dc0c113d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c037070 con 0x7fe9300d3990 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c02ac30 con 0x7fe9300d3990 2024-04-25T08:56:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe92f7fe640 1 -- 172.21.15.5:0/4026069121 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924001670 con 0x7fe9300d3990 2024-04-25T08:56:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe93717e640 1 -- 172.21.15.5:0/4026069121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300d3990 msgr2=0x7fe9300d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe93717e640 1 --2- 172.21.15.5:0/4026069121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300d3990 0x7fe9300d3df0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097d0 tx=0x7fe91c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe93717e640 1 -- 172.21.15.5:0/4026069121 shutdown_connections 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe93717e640 1 --2- 172.21.15.5:0/4026069121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300d3990 0x7fe9300d3df0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe93717e640 1 -- 172.21.15.5:0/4026069121 >> 172.21.15.5:0/4026069121 conn(0x7fe9300668f0 msgr2=0x7fe930066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe93717e640 1 -- 172.21.15.5:0/4026069121 shutdown_connections 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.040+0000 7fe93717e640 1 -- 172.21.15.5:0/4026069121 wait complete. 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.041+0000 7fe93717e640 1 Processor -- start 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.041+0000 7fe93717e640 1 -- start start 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe93717e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300b6f50 0x7fe9301f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe93717e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9300d3990 0x7fe9300cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe93717e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe93015e0a0 0x7fe9301604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe93717e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300d2920 con 0x7fe9300d3990 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe93717e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300d1460 con 0x7fe93015e0a0 2024-04-25T08:56:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe93717e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300d2c00 con 0x7fe9300b6f50 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9300d3990 0x7fe9300cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9300d3990 0x7fe9300cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35822/0 (socket says 172.21.15.5:35822) 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.042+0000 7fe92ffff640 1 -- 172.21.15.5:0/2712259106 learned_addr learned my addr 172.21.15.5:0/2712259106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe934f1a640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300b6f50 0x7fe9301f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe93571b640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe93015e0a0 0x7fe9301604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92ffff640 1 -- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300b6f50 msgr2=0x7fe9301f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92ffff640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300b6f50 0x7fe9301f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92ffff640 1 -- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe93015e0a0 msgr2=0x7fe9301604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92ffff640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe93015e0a0 0x7fe9301604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92ffff640 1 -- 172.21.15.5:0/2712259106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93014db70 con 0x7fe9300d3990 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92ffff640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9300d3990 0x7fe9300cb650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe91c035040 tx=0x7fe91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92d7fa640 1 -- 172.21.15.5:0/2712259106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c037050 con 0x7fe9300d3990 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93014de50 con 0x7fe9300d3990 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92d7fa640 1 -- 172.21.15.5:0/2712259106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c038040 con 0x7fe9300d3990 2024-04-25T08:56:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe92d7fa640 1 -- 172.21.15.5:0/2712259106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0044e0 con 0x7fe9300d3990 2024-04-25T08:56:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.043+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93014e410 con 0x7fe9300d3990 2024-04-25T08:56:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.044+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93004ef20 con 0x7fe9300d3990 2024-04-25T08:56:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.045+0000 7fe92d7fa640 1 -- 172.21.15.5:0/2712259106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe91c045020 con 0x7fe9300d3990 2024-04-25T08:56:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.045+0000 7fe92d7fa640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe91406b4d0 0x7fe91406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.045+0000 7fe92d7fa640 1 -- 172.21.15.5:0/2712259106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe91c0a9ec0 con 0x7fe9300d3990 2024-04-25T08:56:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.045+0000 7fe934f1a640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe91406b4d0 0x7fe91406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.046+0000 7fe934f1a640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe91406b4d0 0x7fe91406d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9240017e0 tx=0x7fe924001610 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.049+0000 7fe92d7fa640 1 -- 172.21.15.5:0/2712259106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe91c04c020 con 0x7fe9300d3990 2024-04-25T08:56:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.230+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9300d0e80 con 0x7fe9300d3990 2024-04-25T08:56:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.231+0000 7fe92d7fa640 1 -- 172.21.15.5:0/2712259106 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fe91c095e20 con 0x7fe9300d3990 2024-04-25T08:56:49.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:49.221 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe91406b4d0 msgr2=0x7fe91406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe91406b4d0 0x7fe91406d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9240017e0 tx=0x7fe924001610 comp rx=0 tx=0).stop 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9300d3990 msgr2=0x7fe9300cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9300d3990 0x7fe9300cb650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe91c035040 tx=0x7fe91c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 shutdown_connections 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe91406b4d0 0x7fe91406d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe93015e0a0 0x7fe9301604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9300d3990 0x7fe9300cb650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 --2- 172.21.15.5:0/2712259106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe9300b6f50 0x7fe9301f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 >> 172.21.15.5:0/2712259106 conn(0x7fe9300668f0 msgr2=0x7fe93015d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 shutdown_connections 2024-04-25T08:56:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.233+0000 7fe93717e640 1 -- 172.21.15.5:0/2712259106 wait complete. 2024-04-25T08:56:49.234 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T08:56:49.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.345+0000 7f3c87129640 1 Processor -- start 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.345+0000 7f3c87129640 1 -- start start 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.346+0000 7f3c87129640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c800d3990 0x7f3c800d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.346+0000 7f3c87129640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c800b29c0 con 0x7f3c800b6f50 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.346+0000 7f3c87129640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c800d2080 con 0x7f3c8015e0a0 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.346+0000 7f3c87129640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c800d4330 con 0x7f3c800d3990 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.346+0000 7f3c7ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c800d3990 0x7f3c800d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.346+0000 7f3c856c6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c800b6f50 0x7f3c800b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58014/0 (socket says 172.21.15.5:58014) 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.346+0000 7f3c856c6640 1 -- 172.21.15.5:0/2743511992 learned_addr learned my addr 172.21.15.5:0/2743511992 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.347+0000 7f3c7f7fe640 1 -- 172.21.15.5:0/2743511992 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030376719 0 0) 0x7f3c800b29c0 con 0x7f3c800b6f50 2024-04-25T08:56:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.347+0000 7f3c7f7fe640 1 -- 172.21.15.5:0/2743511992 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c70003520 con 0x7f3c800b6f50 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.347+0000 7f3c7ffff640 1 -- 172.21.15.5:0/2743511992 >> v1:172.21.15.80:6789/0 conn(0x7f3c8015e0a0 legacy=0x7f3c800d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.347+0000 7f3c7ffff640 1 -- 172.21.15.5:0/2743511992 >> v1:172.21.15.5:6789/0 conn(0x7f3c800b6f50 legacy=0x7f3c800b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.347+0000 7f3c7ffff640 1 -- 172.21.15.5:0/2743511992 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800d2360 con 0x7f3c800d3990 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.347+0000 7f3c7ffff640 1 --2- 172.21.15.5:0/2743511992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c800d3df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0097a0 tx=0x7f3c6c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521352629cbf92c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.347+0000 7f3c7f7fe640 1 -- 172.21.15.5:0/2743511992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c037070 con 0x7f3c800d3990 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c7f7fe640 1 -- 172.21.15.5:0/2743511992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c032440 con 0x7f3c800d3990 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c7f7fe640 1 -- 172.21.15.5:0/2743511992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c032810 con 0x7f3c800d3990 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c87129640 1 -- 172.21.15.5:0/2743511992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 msgr2=0x7f3c800d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c87129640 1 --2- 172.21.15.5:0/2743511992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c800d3df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0097a0 tx=0x7f3c6c02a230 comp rx=0 tx=0).stop 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c87129640 1 -- 172.21.15.5:0/2743511992 shutdown_connections 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c87129640 1 --2- 172.21.15.5:0/2743511992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c800d3df0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c87129640 1 -- 172.21.15.5:0/2743511992 >> 172.21.15.5:0/2743511992 conn(0x7f3c800668f0 msgr2=0x7f3c80066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c87129640 1 -- 172.21.15.5:0/2743511992 shutdown_connections 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.348+0000 7f3c87129640 1 -- 172.21.15.5:0/2743511992 wait complete. 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.349+0000 7f3c87129640 1 Processor -- start 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.349+0000 7f3c87129640 1 -- start start 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c87129640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c800b6f50 0x7f3c801590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c87129640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c8015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c87129640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c8015e0a0 0x7f3c800ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c87129640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800d2920 con 0x7f3c800d3990 2024-04-25T08:56:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c87129640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800d1460 con 0x7f3c800b6f50 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c87129640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800d2c00 con 0x7f3c8015e0a0 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c8015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c8015ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35842/0 (socket says 172.21.15.5:35842) 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c7ffff640 1 -- 172.21.15.5:0/3851487753 learned_addr learned my addr 172.21.15.5:0/3851487753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c856c6640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c8015e0a0 0x7f3c800ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.350+0000 7f3c84ec5640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c800b6f50 0x7f3c801590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7ffff640 1 -- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c8015e0a0 msgr2=0x7f3c800ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7ffff640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c8015e0a0 0x7f3c800ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7ffff640 1 -- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c800b6f50 msgr2=0x7f3c801590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7ffff640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c800b6f50 0x7f3c801590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7ffff640 1 -- 172.21.15.5:0/3851487753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800abb90 con 0x7f3c800d3990 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7ffff640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c8015ada0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c035040 tx=0x7f3c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7d7fa640 1 -- 172.21.15.5:0/3851487753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c037040 con 0x7f3c800d3990 2024-04-25T08:56:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7d7fa640 1 -- 172.21.15.5:0/3851487753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c030500 con 0x7f3c800d3990 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c800cc660 con 0x7f3c800d3990 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c7d7fa640 1 -- 172.21.15.5:0/3851487753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c030910 con 0x7f3c800d3990 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.351+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c800ccc20 con 0x7f3c800d3990 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.352+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8004ef20 con 0x7f3c800d3990 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.352+0000 7f3c7d7fa640 1 -- 172.21.15.5:0/3851487753 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c6c044020 con 0x7f3c800d3990 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.353+0000 7f3c7d7fa640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c6406b4d0 0x7f3c6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.353+0000 7f3c7d7fa640 1 -- 172.21.15.5:0/3851487753 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c6c0aa2a0 con 0x7f3c800d3990 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.353+0000 7f3c84ec5640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c6406b4d0 0x7f3c6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.354+0000 7f3c84ec5640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c6406b4d0 0x7f3c6406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c74001780 tx=0x7f3c74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.357+0000 7f3c7d7fa640 1 -- 172.21.15.5:0/3851487753 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c6c078b60 con 0x7f3c800d3990 2024-04-25T08:56:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.538+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c80161310 con 0x7f3c800d3990 2024-04-25T08:56:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.539+0000 7f3c7d7fa640 1 -- 172.21.15.5:0/3851487753 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f3c6c07cc00 con 0x7f3c800d3990 2024-04-25T08:56:49.530 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:49.530 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:49.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c6406b4d0 msgr2=0x7f3c6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c6406b4d0 0x7f3c6406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c74001780 tx=0x7f3c74009040 comp rx=0 tx=0).stop 2024-04-25T08:56:49.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 msgr2=0x7f3c8015ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c8015ada0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c035040 tx=0x7f3c6c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 shutdown_connections 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c6406b4d0 0x7f3c6406d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c8015e0a0 0x7f3c800ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c800d3990 0x7f3c8015ada0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 --2- 172.21.15.5:0/3851487753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c800b6f50 0x7f3c801590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.541+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 >> 172.21.15.5:0/3851487753 conn(0x7f3c800668f0 msgr2=0x7f3c800d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.542+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 shutdown_connections 2024-04-25T08:56:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.542+0000 7f3c87129640 1 -- 172.21.15.5:0/3851487753 wait complete. 2024-04-25T08:56:49.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T08:56:49.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T08:56:49.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T08:56:49.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T08:56:49.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T08:56:49.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T08:56:49.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T08:56:49.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T08:56:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.728+0000 7f7ecd60d640 1 Processor -- start 2024-04-25T08:56:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.728+0000 7f7ecd60d640 1 -- start start 2024-04-25T08:56:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.728+0000 7f74420a7640 1 Processor -- start 2024-04-25T08:56:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.728+0000 7f74420a7640 1 -- start start 2024-04-25T08:56:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.729+0000 7f7ecd60d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ec00535a0 0x7f7ec00e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.729+0000 7f7ecd60d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 0x7f7ec0053980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.729+0000 7f7ec7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ec00535a0 0x7f7ec00e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.729+0000 7f7ec7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ec00535a0 0x7f7ec00e7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44156/0 (socket says 172.21.15.5:44156) 2024-04-25T08:56:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.729+0000 7f7ec7fff640 1 -- 172.21.15.5:0/3643870194 learned_addr learned my addr 172.21.15.5:0/3643870194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.729+0000 7f7ec77fe640 1 --2- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 0x7f7ec0053980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74420a7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f743c0ce6e0 0x7f743c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74410a5640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f743c161210 0x7f743c0d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:35542/0 (socket says 172.21.15.5:35542) 2024-04-25T08:56:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74410a5640 1 -- 172.21.15.5:0/152870834 learned_addr learned my addr 172.21.15.5:0/152870834 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.729+0000 7f7ecd60d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec0053ec0 con 0x7f7ec00eb130 2024-04-25T08:56:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f7ecd60d640 1 -- 172.21.15.5:0/3643870194 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec0057af0 con 0x7f7ec00535a0 2024-04-25T08:56:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f7ecd60d640 1 -- 172.21.15.5:0/3643870194 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0007220 con 0x7f7ec0058b10 2024-04-25T08:56:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7fade6e38640 1 Processor -- start 2024-04-25T08:56:49.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74420a7640 1 --2- 172.21.15.5:0/152870834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c0b6ab0 0x7f743c0b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0d2110 con 0x7f743c161210 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0cf080 con 0x7f743c0ce6e0 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0d23e0 con 0x7f743c0b6ab0 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f74418a6640 1 --2- 172.21.15.5:0/152870834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c0b6ab0 0x7f743c0b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f74408a4640 1 --2- 172.21.15.5:0/152870834 >> v2:172.21.15.80:3300/0 conn(0x7f743c0ce6e0 0x7f743c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f74418a6640 1 -- 172.21.15.5:0/152870834 >> v2:172.21.15.80:3300/0 conn(0x7f743c0ce6e0 msgr2=0x7f743c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f74418a6640 1 --2- 172.21.15.5:0/152870834 >> v2:172.21.15.80:3300/0 conn(0x7f743c0ce6e0 0x7f743c0ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f74418a6640 1 -- 172.21.15.5:0/152870834 >> v1:172.21.15.80:6789/0 conn(0x7f743c161210 legacy=0x7f743c0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7f8aaf407640 1 Processor -- start 2024-04-25T08:56:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f8aaf407640 1 -- start start 2024-04-25T08:56:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.730+0000 7fade6e38640 1 -- start start 2024-04-25T08:56:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7fd770dd6640 1 Processor -- start 2024-04-25T08:56:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f74418a6640 1 -- 172.21.15.5:0/152870834 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0d26c0 con 0x7f743c0b6ab0 2024-04-25T08:56:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f2fa84e1640 1 Processor -- start 2024-04-25T08:56:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7f2fa84e1640 1 -- start start 2024-04-25T08:56:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aaf407640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8aa8162320 0x7f8aa806c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aaf407640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8aa80aebc0 0x7f8aa806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aaf407640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa806e7a0 con 0x7f8aa8161f40 2024-04-25T08:56:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aaf407640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa80b43f0 con 0x7f8aa80aebc0 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aaf407640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa80cf280 con 0x7f8aa8162320 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade6e38640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadd803c0f0 0x7fadd803c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade6e38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 0x7fadd80539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade6e38640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80e7980 con 0x7fadd8037fd0 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade6e38640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80383b0 con 0x7fadd803c0f0 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade6e38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd803cac0 con 0x7fadd8053530 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade5e36640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fadd8037fd0 0x7fadd8058410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58022/0 (socket says 172.21.15.5:58022) 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade5e36640 1 -- 172.21.15.5:0/1817429215 learned_addr learned my addr 172.21.15.5:0/1817429215 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7fade5635640 1 --2- 172.21.15.5:0/1817429215 >> v2:172.21.15.80:3300/0 conn(0x7fadd803c0f0 0x7fadd803c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aac9a2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8aa8162320 0x7f8aa806c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aad9a4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8aa80aebc0 0x7f8aa806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aac9a2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8aa8162320 0x7f8aa806c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44188/0 (socket says 172.21.15.5:44188) 2024-04-25T08:56:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f8aac9a2640 1 -- 172.21.15.5:0/2660406751 learned_addr learned my addr 172.21.15.5:0/2660406751 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f74408a4640 1 --2- 172.21.15.5:0/152870834 >> v2:172.21.15.80:3300/0 conn(0x7f743c0ce6e0 0x7f743c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.731+0000 7fd770dd6640 1 -- start start 2024-04-25T08:56:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f7ec6ffd640 1 -- 172.21.15.5:0/3643870194 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047878908 0 0) 0x7f7ec0053ec0 con 0x7f7ec00eb130 2024-04-25T08:56:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.732+0000 7f7ec6ffd640 1 -- 172.21.15.5:0/3643870194 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb8003520 con 0x7f7ec00eb130 2024-04-25T08:56:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7fd76b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd7640e7750 0x7fd7640489c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58038/0 (socket says 172.21.15.5:58038) 2024-04-25T08:56:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7fd76b7fe640 1 -- 172.21.15.5:0/3240179415 learned_addr learned my addr 172.21.15.5:0/3240179415 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7fd770dd6640 1 --2- 172.21.15.5:0/3240179415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd76400b0a0 0x7fd764053f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f2fa84e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa01621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f2fa84e1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa0162850 con 0x7f2fa006d1e0 2024-04-25T08:56:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f2fa84e1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00ce820 con 0x7f2fa01583a0 2024-04-25T08:56:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f2fa84e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00af5b0 con 0x7f2fa00cf5e0 2024-04-25T08:56:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413197735 0 0) 0x7fadd80e7980 con 0x7fadd8037fd0 2024-04-25T08:56:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadcc003520 con 0x7fadd8037fd0 2024-04-25T08:56:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f2fa627d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2fa01583a0 0x7f2fa006cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:35562/0 (socket says 172.21.15.5:35562) 2024-04-25T08:56:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f2fa627d640 1 -- 172.21.15.5:0/2878008416 learned_addr learned my addr 172.21.15.5:0/2878008416 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f2fa6a7e640 1 --2- 172.21.15.5:0/2878008416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa01621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7fd76affd640 1 --2- 172.21.15.5:0/3240179415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd76400b0a0 0x7fd764053f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f7ec7fff640 1 -- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 msgr2=0x7f7ec0053980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f7ec7fff640 1 --2- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 0x7f7ec0053980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f7ec7fff640 1 -- 172.21.15.5:0/3643870194 >> v1:172.21.15.80:6789/0 conn(0x7f7ec00eb130 legacy=0x7f7ec00eb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f7ec7fff640 1 -- 172.21.15.5:0/3643870194 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0056ee0 con 0x7f7ec00535a0 2024-04-25T08:56:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd764007840 con 0x7fd7640e7750 2024-04-25T08:56:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f7ec77fe640 1 --2- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 0x7f7ec0053980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd764007b20 con 0x7fd764007330 2024-04-25T08:56:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f2fa6a7e640 1 -- 172.21.15.5:0/2878008416 >> v1:172.21.15.80:6789/0 conn(0x7f2fa01583a0 legacy=0x7f2fa006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f2fa527b640 1 -- 172.21.15.5:0/2878008416 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445874979 0 0) 0x7f2fa00ce820 con 0x7f2fa01583a0 2024-04-25T08:56:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f2fa6a7e640 1 -- 172.21.15.5:0/2878008416 >> v1:172.21.15.5:6789/0 conn(0x7f2fa006d1e0 legacy=0x7f2fa0161a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f2fa6a7e640 1 -- 172.21.15.5:0/2878008416 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00ceb00 con 0x7f2fa00cf5e0 2024-04-25T08:56:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640e7b30 con 0x7fd76400b0a0 2024-04-25T08:56:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f74418a6640 1 --2- 172.21.15.5:0/152870834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c0b6ab0 0x7f743c0b6f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74340097a0 tx=0x7f743402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb8bcf9361a59ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f8aac9a2640 1 -- 172.21.15.5:0/2660406751 >> v2:172.21.15.5:3300/0 conn(0x7f8aa80aebc0 msgr2=0x7f8aa806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f8aac9a2640 1 --2- 172.21.15.5:0/2660406751 >> v2:172.21.15.5:3300/0 conn(0x7f8aa80aebc0 0x7f8aa806c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f8aac9a2640 1 -- 172.21.15.5:0/2660406751 >> v1:172.21.15.80:6789/0 conn(0x7f8aa8161f40 legacy=0x7f8aa80b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.733+0000 7f8aac9a2640 1 -- 172.21.15.5:0/2660406751 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa806ea40 con 0x7f8aa8162320 2024-04-25T08:56:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332440870 0 0) 0x7fadcc003520 con 0x7fadd8037fd0 2024-04-25T08:56:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 msgr2=0x7fadd80539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 0x7fadd80539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 >> v2:172.21.15.80:3300/0 conn(0x7fadd803c0f0 msgr2=0x7fadd803c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 --2- 172.21.15.5:0/1817429215 >> v2:172.21.15.80:3300/0 conn(0x7fadd803c0f0 0x7fadd803c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8057090 con 0x7fadd8037fd0 2024-04-25T08:56:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7faddc001670 con 0x7fadd8037fd0 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f7433fff640 1 -- 172.21.15.5:0/152870834 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434037070 con 0x7f743c0b6ab0 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f7433fff640 1 -- 172.21.15.5:0/152870834 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7434032440 con 0x7f743c0b6ab0 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 >> v1:172.21.15.5:6789/0 conn(0x7fadd8037fd0 legacy=0x7fadd8058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0039b0 0x7fadcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc004800 0x7fadcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 0x7fadcc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd803cac0 con 0x7fadcc004800 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc00bad0 con 0x7fadcc0039b0 2024-04-25T08:56:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc00bcd0 con 0x7fadd8053530 2024-04-25T08:56:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f7433fff640 1 -- 172.21.15.5:0/152870834 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434032810 con 0x7f743c0b6ab0 2024-04-25T08:56:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f7ec7fff640 1 --2- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec00535a0 0x7f7ec00e7b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ec804fab0 tx=0x7f7ebc02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf3c002b9ba8d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7f8aac9a2640 1 --2- 172.21.15.5:0/2660406751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8162320 0x7f8aa806c420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8aa806e140 tx=0x7f8a9402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29ae5cad45d3ff0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade6637640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 0x7fadcc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fd76a7fc640 1 -- 172.21.15.5:0/3240179415 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434718962 0 0) 0x7fd764007b20 con 0x7fd764007330 2024-04-25T08:56:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fd76affd640 1 -- 172.21.15.5:0/3240179415 >> v1:172.21.15.80:6789/0 conn(0x7fd764007330 legacy=0x7fd76404f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fd76affd640 1 -- 172.21.15.5:0/3240179415 >> v1:172.21.15.5:6789/0 conn(0x7fd7640e7750 legacy=0x7fd7640489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fd76affd640 1 -- 172.21.15.5:0/3240179415 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764053730 con 0x7fd76400b0a0 2024-04-25T08:56:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.734+0000 7fade5e36640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0039b0 0x7fadcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f7ec6ffd640 1 -- 172.21.15.5:0/3643870194 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc037070 con 0x7f7ec00535a0 2024-04-25T08:56:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f7ec6ffd640 1 -- 172.21.15.5:0/3643870194 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc02aaf0 con 0x7f7ec00535a0 2024-04-25T08:56:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f7ec6ffd640 1 -- 172.21.15.5:0/3643870194 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec804f440 con 0x7f7ec00535a0 2024-04-25T08:56:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f181839e640 1 Processor -- start 2024-04-25T08:56:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f181839e640 1 -- start start 2024-04-25T08:56:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7fade6637640 1 -- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0039b0 msgr2=0x7fadcc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7fade6637640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0039b0 0x7fadcc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7fade6637640 1 -- 172.21.15.5:0/1817429215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc004800 msgr2=0x7fadcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7fade6637640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc004800 0x7fadcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7fade6637640 1 -- 172.21.15.5:0/1817429215 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8057090 con 0x7fadd8053530 2024-04-25T08:56:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f2fa6a7e640 1 --2- 172.21.15.5:0/2878008416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa01621a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009dc0 tx=0x7f2f9802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3398b2d88da9344e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f2fa527b640 1 -- 172.21.15.5:0/2878008416 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9802ae60 con 0x7f2fa00cf5e0 2024-04-25T08:56:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f2fa527b640 1 -- 172.21.15.5:0/2878008416 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98007740 con 0x7f2fa00cf5e0 2024-04-25T08:56:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f2fa527b640 1 -- 172.21.15.5:0/2878008416 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007b10 con 0x7f2fa00cf5e0 2024-04-25T08:56:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c0b6ab0 msgr2=0x7f743c0b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f8aa7fff640 1 -- 172.21.15.5:0/2660406751 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94037070 con 0x7f8aa8162320 2024-04-25T08:56:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f8aa7fff640 1 -- 172.21.15.5:0/2660406751 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94032440 con 0x7f8aa8162320 2024-04-25T08:56:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f8aa7fff640 1 -- 172.21.15.5:0/2660406751 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94032810 con 0x7f8aa8162320 2024-04-25T08:56:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f7ecd60d640 1 -- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec00535a0 msgr2=0x7f7ec00e7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.735+0000 7f7ecd60d640 1 --2- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec00535a0 0x7f7ec00e7b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ec804fab0 tx=0x7f7ebc02a060 comp rx=0 tx=0).stop 2024-04-25T08:56:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f74420a7640 1 --2- 172.21.15.5:0/152870834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c0b6ab0 0x7f743c0b6f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74340097a0 tx=0x7f743402a180 comp rx=0 tx=0).stop 2024-04-25T08:56:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f7ecd60d640 1 -- 172.21.15.5:0/3643870194 shutdown_connections 2024-04-25T08:56:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fd76affd640 1 --2- 172.21.15.5:0/3240179415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd76400b0a0 0x7fd764053f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7580097d0 tx=0x7fd75802a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f622790ecd9ceb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 shutdown_connections 2024-04-25T08:56:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f7ecd60d640 1 --2- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 0x7f7ec0053980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f7ecd60d640 1 --2- 172.21.15.5:0/3643870194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec00535a0 0x7f7ec00e7b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f7ecd60d640 1 -- 172.21.15.5:0/3643870194 >> 172.21.15.5:0/3643870194 conn(0x7f7ec003aa40 msgr2=0x7f7ec003ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f7ecd60d640 1 -- 172.21.15.5:0/3643870194 shutdown_connections 2024-04-25T08:56:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f7ecd60d640 1 -- 172.21.15.5:0/3643870194 wait complete. 2024-04-25T08:56:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f74420a7640 1 --2- 172.21.15.5:0/152870834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c0b6ab0 0x7f743c0b6f40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fade6637640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 0x7fadcc0051e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fade0069340 tx=0x7fadcc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b9ebf24b7b49446 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fd76a7fc640 1 -- 172.21.15.5:0/3240179415 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758037070 con 0x7fd76400b0a0 2024-04-25T08:56:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f74420a7640 1 --2- 172.21.15.5:0/152870834 >> v2:172.21.15.80:3300/0 conn(0x7f743c0ce6e0 0x7f743c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 >> 172.21.15.5:0/152870834 conn(0x7f743c0668f0 msgr2=0x7f743c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fd76a7fc640 1 -- 172.21.15.5:0/3240179415 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758032640 con 0x7fd76400b0a0 2024-04-25T08:56:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fd76a7fc640 1 -- 172.21.15.5:0/3240179415 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758032a10 con 0x7fd76400b0a0 2024-04-25T08:56:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade004fe10 con 0x7fadd8053530 2024-04-25T08:56:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade00ad440 con 0x7fadd8053530 2024-04-25T08:56:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7fade4e34640 1 -- 172.21.15.5:0/1817429215 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00ad8f0 con 0x7fadd8053530 2024-04-25T08:56:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f2fa84e1640 1 -- 172.21.15.5:0/2878008416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 msgr2=0x7f2fa01621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 shutdown_connections 2024-04-25T08:56:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f2fa84e1640 1 --2- 172.21.15.5:0/2878008416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa01621a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009dc0 tx=0x7f2f9802a680 comp rx=0 tx=0).stop 2024-04-25T08:56:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f74420a7640 1 -- 172.21.15.5:0/152870834 wait complete. 2024-04-25T08:56:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f8aaf407640 1 -- 172.21.15.5:0/2660406751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8162320 msgr2=0x7f8aa806c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f181839e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18101434f0 0x7f181015e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f8aaf407640 1 --2- 172.21.15.5:0/2660406751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8162320 0x7f8aa806c420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8aa806e140 tx=0x7f8a9402a210 comp rx=0 tx=0).stop 2024-04-25T08:56:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f2fa84e1640 1 -- 172.21.15.5:0/2878008416 shutdown_connections 2024-04-25T08:56:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f2fa84e1640 1 --2- 172.21.15.5:0/2878008416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa01621a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.736+0000 7f2fa84e1640 1 -- 172.21.15.5:0/2878008416 >> 172.21.15.5:0/2878008416 conn(0x7f2fa00b1da0 msgr2=0x7f2fa00b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181613a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18101434f0 0x7f181015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181613a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18101434f0 0x7f181015e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35862/0 (socket says 172.21.15.5:35862) 2024-04-25T08:56:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181613a640 1 -- 172.21.15.5:0/2770427786 learned_addr learned my addr 172.21.15.5:0/2770427786 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181839e640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18100b1820 0x7f18100b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7fade6e38640 1 -- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 msgr2=0x7fadcc0051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f8aaf407640 1 -- 172.21.15.5:0/2660406751 shutdown_connections 2024-04-25T08:56:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f8aaf407640 1 --2- 172.21.15.5:0/2660406751 >> v2:172.21.15.5:3300/0 conn(0x7f8aa80aebc0 0x7f8aa806c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f8aaf407640 1 --2- 172.21.15.5:0/2660406751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8162320 0x7f8aa806c420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f8aaf407640 1 -- 172.21.15.5:0/2660406751 >> 172.21.15.5:0/2660406751 conn(0x7f8aa8066f20 msgr2=0x7f8aa80b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7fade6e38640 1 --2- 172.21.15.5:0/1817429215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd8053530 0x7fadcc0051e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fade0069340 tx=0x7fadcc005830 comp rx=0 tx=0).stop 2024-04-25T08:56:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1810070c50 con 0x7f18101438d0 2024-04-25T08:56:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7fade6637640 1 -- 172.21.15.5:0/1817429215 reap_dead start 2024-04-25T08:56:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181693b640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18100b1820 0x7f18100b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f7ecd60d640 1 Processor -- start 2024-04-25T08:56:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100cdc80 con 0x7f18101434f0 2024-04-25T08:56:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18100ca180 con 0x7f18100b1820 2024-04-25T08:56:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7f1815138640 1 -- 172.21.15.5:0/2770427786 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396789374 0 0) 0x7f1810070c50 con 0x7f18101438d0 2024-04-25T08:56:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd76400b0a0 msgr2=0x7fd764053f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.737+0000 7fd770dd6640 1 --2- 172.21.15.5:0/3240179415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd76400b0a0 0x7fd764053f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7580097d0 tx=0x7fd75802a2c0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f2fa84e1640 1 -- 172.21.15.5:0/2878008416 shutdown_connections 2024-04-25T08:56:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f7ecd60d640 1 -- start start 2024-04-25T08:56:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 shutdown_connections 2024-04-25T08:56:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fd770dd6640 1 --2- 172.21.15.5:0/3240179415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd76400b0a0 0x7fd764053f30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 >> 172.21.15.5:0/3240179415 conn(0x7fd76400a3f0 msgr2=0x7fd76400a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f2fa84e1640 1 -- 172.21.15.5:0/2878008416 wait complete. 2024-04-25T08:56:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fade6e38640 1 -- 172.21.15.5:0/1817429215 shutdown_connections 2024-04-25T08:56:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fade6e38640 1 -- 172.21.15.5:0/1817429215 >> 172.21.15.5:0/1817429215 conn(0x7fadd8058ee0 msgr2=0x7fadd80592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fea5f2c6640 1 Processor -- start 2024-04-25T08:56:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fade6e38640 1 -- 172.21.15.5:0/1817429215 shutdown_connections 2024-04-25T08:56:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fade6e38640 1 -- 172.21.15.5:0/1817429215 wait complete. 2024-04-25T08:56:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f8aaf407640 1 -- 172.21.15.5:0/2660406751 shutdown_connections 2024-04-25T08:56:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fea5f2c6640 1 -- start start 2024-04-25T08:56:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f74420a7640 1 Processor -- start 2024-04-25T08:56:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f74420a7640 1 -- start start 2024-04-25T08:56:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 shutdown_connections 2024-04-25T08:56:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f181613a640 1 -- 172.21.15.5:0/2770427786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18100b1820 msgr2=0x7f18100b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecd60d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec00535a0 0x7f7ec0050e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecd60d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 0x7f7ec003cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecd60d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ec00eb130 0x7f7ec000e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecd60d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0057780 con 0x7f7ec00eb130 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecd60d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00574a0 con 0x7f7ec00535a0 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecd60d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00e1fa0 con 0x7f7ec0058b10 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ec00eb130 0x7f7ec000e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ec00eb130 0x7f7ec000e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35874/0 (socket says 172.21.15.5:35874) 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 -- 172.21.15.5:0/2044032801 learned_addr learned my addr 172.21.15.5:0/2044032801 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 -- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 msgr2=0x7f7ec003cb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7fea5f2c6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea580b94c0 0x7fea580d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7fea5f2c6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7fea5f2c6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea580d0d40 con 0x7fea5815def0 2024-04-25T08:56:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7fea5f2c6640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5815e2d0 con 0x7fea580b94c0 2024-04-25T08:56:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7fea5f2c6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d2550 con 0x7fea580d0400 2024-04-25T08:56:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f2fa84e1640 1 Processor -- start 2024-04-25T08:56:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec0058b10 0x7f7ec003cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 -- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec00535a0 msgr2=0x7f7ec0050e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec00535a0 0x7f7ec0050e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f7ecce0c640 1 -- 172.21.15.5:0/2044032801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec003d470 con 0x7f7ec00eb130 2024-04-25T08:56:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f181613a640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18100b1820 0x7f18100b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f2fa84e1640 1 -- start start 2024-04-25T08:56:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5c861640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea580b94c0 0x7fea580d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5d863640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5d863640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35876/0 (socket says 172.21.15.5:35876) 2024-04-25T08:56:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5d863640 1 -- 172.21.15.5:0/1215542277 learned_addr learned my addr 172.21.15.5:0/1215542277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f181613a640 1 -- 172.21.15.5:0/2770427786 >> v1:172.21.15.80:6789/0 conn(0x7f18101438d0 legacy=0x7f1810070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f181613a640 1 -- 172.21.15.5:0/2770427786 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181015e850 con 0x7f18101434f0 2024-04-25T08:56:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.738+0000 7f181693b640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18100b1820 0x7f18100b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f7ecce0c640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ec00eb130 0x7f7ec000e910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80646b0 tx=0x7f7ec8068e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fade6e38640 1 Processor -- start 2024-04-25T08:56:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8090070 con 0x7f7ec00eb130 2024-04-25T08:56:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5d863640 1 -- 172.21.15.5:0/1215542277 >> v2:172.21.15.80:3300/0 conn(0x7fea580b94c0 msgr2=0x7fea580d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5d863640 1 --2- 172.21.15.5:0/1215542277 >> v2:172.21.15.80:3300/0 conn(0x7fea580b94c0 0x7fea580d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5d863640 1 -- 172.21.15.5:0/1215542277 >> v1:172.21.15.5:6789/0 conn(0x7fea5815def0 legacy=0x7fea580d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fea5d863640 1 -- 172.21.15.5:0/1215542277 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580d2830 con 0x7fea580d0400 2024-04-25T08:56:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7fade6e38640 1 -- start start 2024-04-25T08:56:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f74420a7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0b6ab0 0x7f743c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.739+0000 7f8aaf407640 1 -- 172.21.15.5:0/2660406751 wait complete. 2024-04-25T08:56:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f8aaf407640 1 Processor -- start 2024-04-25T08:56:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8068f60 con 0x7f7ec00eb130 2024-04-25T08:56:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80708f0 con 0x7f7ec00eb130 2024-04-25T08:56:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f7ecd60d640 1 -- 172.21.15.5:0/2044032801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec003d750 con 0x7f7ec00eb130 2024-04-25T08:56:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.740+0000 7f7ecd60d640 1 -- 172.21.15.5:0/2044032801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec00e2200 con 0x7f7ec00eb130 2024-04-25T08:56:49.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f8aaf407640 1 -- start start 2024-04-25T08:56:49.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f74420a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c0ce6e0 0x7f743c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f181613a640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 0x7f181015e310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f180800c540 tx=0x7f180802ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c7743d70257982 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f74410a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0b6ab0 0x7f743c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f74410a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0b6ab0 0x7f743c0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35880/0 (socket says 172.21.15.5:35880) 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa84e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa006d1e0 0x7f2fa014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa84e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa0200ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa84e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa01583a0 0x7f2fa015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa84e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0158780 con 0x7f2fa01583a0 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa84e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00cf150 con 0x7f2fa006d1e0 2024-04-25T08:56:49.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa84e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0168d20 con 0x7f2fa00cf5e0 2024-04-25T08:56:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f74410a5640 1 -- 172.21.15.5:0/4248464712 learned_addr learned my addr 172.21.15.5:0/4248464712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f74420a7640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c161210 0x7f743c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa5a7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa0200ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa5a7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa0200ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35886/0 (socket says 172.21.15.5:35886) 2024-04-25T08:56:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa5a7c640 1 -- 172.21.15.5:0/825564356 learned_addr learned my addr 172.21.15.5:0/825564356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa627d640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa006d1e0 0x7f2fa014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f2fa6a7e640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa01583a0 0x7f2fa015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.741+0000 7f74408a4640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c0ce6e0 0x7f743c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f74418a6640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c161210 0x7f743c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f74420a7640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0d2f60 con 0x7f743c0b6ab0 2024-04-25T08:56:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f74420a7640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0d2c80 con 0x7f743c0ce6e0 2024-04-25T08:56:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f74420a7640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0d3480 con 0x7f743c161210 2024-04-25T08:56:49.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f7ecd60d640 1 -- 172.21.15.5:0/2044032801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ea8001030 con 0x7f7ec00eb130 2024-04-25T08:56:49.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f1815138640 1 -- 172.21.15.5:0/2770427786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180802b800 con 0x7f18101434f0 2024-04-25T08:56:49.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f1815138640 1 -- 172.21.15.5:0/2770427786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180802b9a0 con 0x7f18101434f0 2024-04-25T08:56:49.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f1815138640 1 -- 172.21.15.5:0/2770427786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180802bdb0 con 0x7f18101434f0 2024-04-25T08:56:49.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade6e38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd8053530 0x7fadd817cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade6e38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd80e0cc0 0x7fadd80e1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f8aaf407640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa80aebc0 0x7f8aa81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f8aaf407640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8161f40 0x7f8aa8164f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f8aaf407640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8aa8162320 0x7f8aa8200a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f8aaf407640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa806ed20 con 0x7f8aa80aebc0 2024-04-25T08:56:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade6e38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd80512a0 0x7fadd8051720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade6e38640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8057930 con 0x7fadd8053530 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade6e38640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8057650 con 0x7fadd80e0cc0 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade6e38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8057c10 con 0x7fadd80512a0 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade5635640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd80e0cc0 0x7fadd80e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade5e36640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd8053530 0x7fadd817cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade5e36640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd8053530 0x7fadd817cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35886/0 (socket says 172.21.15.5:35886) 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade5e36640 1 -- 172.21.15.5:0/857230413 learned_addr learned my addr 172.21.15.5:0/857230413 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fade6637640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd80512a0 0x7fadd8051720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fea5d863640 1 --2- 172.21.15.5:0/1215542277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580d0800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea50009e50 tx=0x7fea5002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc96c4eaea722a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f8aaf407640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80cf560 con 0x7f8aa8161f40 2024-04-25T08:56:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f8aaf407640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80ae690 con 0x7f8aa8162320 2024-04-25T08:56:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa80aebc0 0x7f8aa81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f2fa627d640 1 -- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 msgr2=0x7f2fa0200ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f2fa627d640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cf5e0 0x7f2fa0200ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f2fa627d640 1 -- 172.21.15.5:0/825564356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa01583a0 msgr2=0x7f2fa015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f2fa627d640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa01583a0 0x7f2fa015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7f2fa627d640 1 -- 172.21.15.5:0/825564356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00b4ab0 con 0x7f2fa006d1e0 2024-04-25T08:56:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa80aebc0 0x7f8aa81576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35892/0 (socket says 172.21.15.5:35892) 2024-04-25T08:56:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 -- 172.21.15.5:0/3753771126 learned_addr learned my addr 172.21.15.5:0/3753771126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f2fa6a7e640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa01583a0 0x7f2fa015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 msgr2=0x7f181015e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 0x7f181015e310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f180800c540 tx=0x7f180802ad00 comp rx=0 tx=0).stop 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade5635640 1 -- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd80512a0 msgr2=0x7fadd8051720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade5635640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd80512a0 0x7fadd8051720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade5635640 1 -- 172.21.15.5:0/857230413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd8053530 msgr2=0x7fadd817cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade5635640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd8053530 0x7fadd817cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade5635640 1 -- 172.21.15.5:0/857230413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8051fd0 con 0x7fadd80e0cc0 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fea4ffff640 1 -- 172.21.15.5:0/1215542277 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50036070 con 0x7fea580d0400 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fea4ffff640 1 -- 172.21.15.5:0/1215542277 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50031600 con 0x7fea580d0400 2024-04-25T08:56:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 shutdown_connections 2024-04-25T08:56:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade5635640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd80e0cc0 0x7fadd80e1120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadd000d520 tx=0x7fadd000d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18100b1820 0x7f18100b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 --2- 172.21.15.5:0/2770427786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 0x7f181015e310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 >> 172.21.15.5:0/2770427786 conn(0x7f18100cfbc0 msgr2=0x7f18100cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ec8093070 con 0x7f7ec00eb130 2024-04-25T08:56:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f2fa627d640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa006d1e0 0x7f2fa014bdf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00c3e0 tx=0x7f2f9c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004020 con 0x7fadd80e0cc0 2024-04-25T08:56:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 shutdown_connections 2024-04-25T08:56:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f181839e640 1 -- 172.21.15.5:0/2770427786 wait complete. 2024-04-25T08:56:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.742+0000 7fd770dd6640 1 -- 172.21.15.5:0/3240179415 wait complete. 2024-04-25T08:56:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0074e0 con 0x7f2fa006d1e0 2024-04-25T08:56:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0047e0 con 0x7f2fa006d1e0 2024-04-25T08:56:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c004c10 con 0x7f2fa006d1e0 2024-04-25T08:56:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade6e38640 1 -- 172.21.15.5:0/857230413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80522b0 con 0x7fadd80e0cc0 2024-04-25T08:56:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7fade6e38640 1 -- 172.21.15.5:0/857230413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd8052870 con 0x7fadd80e0cc0 2024-04-25T08:56:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd00041e0 con 0x7fadd80e0cc0 2024-04-25T08:56:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fea5f2c6640 1 -- 172.21.15.5:0/1215542277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 msgr2=0x7fea580d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fea5f2c6640 1 --2- 172.21.15.5:0/1215542277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580d0800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea50009e50 tx=0x7fea5002a710 comp rx=0 tx=0).stop 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aac9a2640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8161f40 0x7f8aa8164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad9a4640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8aa8162320 0x7f8aa8200a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 -- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8aa8162320 msgr2=0x7f8aa8200a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8aa8162320 0x7f8aa8200a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 -- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8161f40 msgr2=0x7f8aa8164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8aa8161f40 0x7f8aa8164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f8aad1a3640 1 -- 172.21.15.5:0/3753771126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8164350 con 0x7f8aa80aebc0 2024-04-25T08:56:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f8aad1a3640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa80aebc0 0x7f8aa81576c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c8a0 tx=0x7f8a9c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f74410a5640 1 -- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c161210 msgr2=0x7f743c0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f74410a5640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f743c161210 0x7f743c0caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f74410a5640 1 -- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c0ce6e0 msgr2=0x7f743c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f74410a5640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c0ce6e0 0x7f743c0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f74410a5640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0c75c0 con 0x7f743c0b6ab0 2024-04-25T08:56:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f7ec4ff9640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7eac06b5a0 0x7f7eac06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ec81052d0 con 0x7f7ec00eb130 2024-04-25T08:56:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f7ec4ff9640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7f7eac0737c0 0x7f7eac075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 --> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ec8071e50 con 0x7f7eac0737c0 2024-04-25T08:56:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ec81056c0 con 0x7f7ec00eb130 2024-04-25T08:56:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fd770dd6640 1 Processor -- start 2024-04-25T08:56:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003b70 con 0x7f8aa80aebc0 2024-04-25T08:56:49.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd00043d0 con 0x7fadd80e0cc0 2024-04-25T08:56:49.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.743+0000 7f74410a5640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0b6ab0 0x7f743c0c8660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f743800cbc0 tx=0x7f743800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c003d30 con 0x7f8aa80aebc0 2024-04-25T08:56:49.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00aa90 con 0x7f8aa80aebc0 2024-04-25T08:56:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa00b4d90 con 0x7f2fa006d1e0 2024-04-25T08:56:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fea5f2c6640 1 -- 172.21.15.5:0/1215542277 shutdown_connections 2024-04-25T08:56:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fea5f2c6640 1 --2- 172.21.15.5:0/1215542277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580d0800 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fea5f2c6640 1 --2- 172.21.15.5:0/1215542277 >> v2:172.21.15.80:3300/0 conn(0x7fea580b94c0 0x7fea580d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fea5f2c6640 1 -- 172.21.15.5:0/1215542277 >> 172.21.15.5:0/1215542277 conn(0x7fea5806b000 msgr2=0x7fea5806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7fd770dd6640 1 -- start start 2024-04-25T08:56:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.744+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa00b3320 con 0x7f2fa006d1e0 2024-04-25T08:56:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7fade6e38640 1 -- 172.21.15.5:0/857230413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fadc8001030 con 0x7fadd80e0cc0 2024-04-25T08:56:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa81632b0 con 0x7f8aa80aebc0 2024-04-25T08:56:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f7ec7fff640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7eac06b5a0 0x7f7eac06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f7ec77fe640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7f7eac0737c0 0x7f7eac075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438017070 con 0x7f743c0b6ab0 2024-04-25T08:56:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800aca0 con 0x7f743c0b6ab0 2024-04-25T08:56:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438012600 con 0x7f743c0b6ab0 2024-04-25T08:56:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7f74420a7640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c0c78a0 con 0x7f743c0b6ab0 2024-04-25T08:56:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7f74420a7640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c0c7e60 con 0x7f743c0b6ab0 2024-04-25T08:56:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd770dd6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd764007330 0x7fd76404c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd770dd6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd76400b0a0 0x7fd7640e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd764007330 0x7fd76404c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd764007330 0x7fd76404c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35912/0 (socket says 172.21.15.5:35912) 2024-04-25T08:56:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd770dd6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7640e7750 0x7fd7640e9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd770dd6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764053420 con 0x7fd76400b0a0 2024-04-25T08:56:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa8163870 con 0x7f8aa80aebc0 2024-04-25T08:56:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7f181839e640 1 Processor -- start 2024-04-25T08:56:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7f181839e640 1 -- start start 2024-04-25T08:56:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fadd001b020 con 0x7fadd80e0cc0 2024-04-25T08:56:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.745+0000 7f7ec7fff640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7eac06b5a0 0x7f7eac06da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc034000 tx=0x7f7ebc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fea5f2c6640 1 -- 172.21.15.5:0/1215542277 shutdown_connections 2024-04-25T08:56:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd76affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd76400b0a0 0x7fd7640e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd76affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd76400b0a0 0x7fd7640e8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35896/0 (socket says 172.21.15.5:35896) 2024-04-25T08:56:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd76affd640 1 -- 172.21.15.5:0/3331932600 learned_addr learned my addr 172.21.15.5:0/3331932600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8aa804ef20 con 0x7f8aa80aebc0 2024-04-25T08:56:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd770dd6640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640490d0 con 0x7fd7640e7750 2024-04-25T08:56:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fd770dd6640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd764048560 con 0x7fd764007330 2024-04-25T08:56:49.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fa006c9d0 con 0x7f2fa006d1e0 2024-04-25T08:56:49.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.746+0000 7fea5f2c6640 1 -- 172.21.15.5:0/1215542277 wait complete. 2024-04-25T08:56:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f7ec77fe640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7f7eac0737c0 0x7f7eac075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fadd67fc640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadc406b4d0 0x7fadc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadd0089f10 con 0x7fadd80e0cc0 2024-04-25T08:56:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f181839e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18100b1820 0x7f1810159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fd76bfff640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7640e7750 0x7fd7640e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fd76b7fe640 1 -- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7640e7750 msgr2=0x7fd7640e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fd76b7fe640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7640e7750 0x7fd7640e9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fd76b7fe640 1 -- 172.21.15.5:0/3331932600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd76400b0a0 msgr2=0x7fd7640e8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fd76b7fe640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd76400b0a0 0x7fd7640e8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fd76b7fe640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76404d070 con 0x7fd764007330 2024-04-25T08:56:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f74420a7640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f743c15dc00 con 0x7f743c0b6ab0 2024-04-25T08:56:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f181839e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 0x7f181013cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fd76b7fe640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd764007330 0x7fd76404c5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c440 tx=0x7fd76000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f181613a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18100b1820 0x7f1810159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f181613a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18100b1820 0x7f1810159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44284/0 (socket says 172.21.15.5:44284) 2024-04-25T08:56:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fadd67fc640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fadc40736f0 0x7fadc4075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f181613a640 1 -- 172.21.15.5:0/746018477 learned_addr learned my addr 172.21.15.5:0/746018477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7f181839e640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18101438d0 0x7f18101420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.747+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 --> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadc40761c0 con 0x7fadc40736f0 2024-04-25T08:56:49.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100cd910 con 0x7f18101434f0 2024-04-25T08:56:49.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadd008c570 con 0x7fadd80e0cc0 2024-04-25T08:56:49.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100ca700 con 0x7f18100b1820 2024-04-25T08:56:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181693b640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18101438d0 0x7f18101420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18100cc020 con 0x7f18101438d0 2024-04-25T08:56:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== osd.6 v2:172.21.15.80:6805/2858900277 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7ec8071e50 con 0x7f7eac0737c0 2024-04-25T08:56:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7fea5f2c6640 1 Processor -- start 2024-04-25T08:56:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7fade5e36640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadc406b4d0 0x7fadc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7fea5f2c6640 1 -- start start 2024-04-25T08:56:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7fade6637640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fadc40736f0 0x7fadc4075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181613a640 1 -- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18101438d0 msgr2=0x7f18101420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181613a640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18101438d0 0x7f18101420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181613a640 1 -- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 msgr2=0x7f181013cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f1815939640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 0x7f181013cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f9c011070 con 0x7f2fa006d1e0 2024-04-25T08:56:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181613a640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 0x7f181013cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f181613a640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181013d670 con 0x7f18100b1820 2024-04-25T08:56:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f1815939640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18101434f0 0x7f181013cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f181613a640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18100b1820 0x7f1810159860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1808035040 tx=0x7f1808004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f2f96ffd640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b5a0 0x7f2f8406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a9c00ac30 con 0x7f8aa80aebc0 2024-04-25T08:56:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f8aa5ffb640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a8c06b520 0x7f8a8c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fea5f2c6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea580b94c0 0x7fea580cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f743801a070 con 0x7f743c0b6ab0 2024-04-25T08:56:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808043020 con 0x7f18100b1820 2024-04-25T08:56:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fea5f2c6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fea5f2c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5815def0 0x7fea58157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fea5f2c6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d30d0 con 0x7fea580b94c0 2024-04-25T08:56:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180800a960 con 0x7f18100b1820 2024-04-25T08:56:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760017070 con 0x7fd764007330 2024-04-25T08:56:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760005ce0 con 0x7fd764007330 2024-04-25T08:56:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a9c057350 con 0x7f8aa80aebc0 2024-04-25T08:56:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f8aa5ffb640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f8a8c074350 0x7f8a8c0767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 --> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a8c076ec0 con 0x7f8a8c074350 2024-04-25T08:56:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180803f6b0 con 0x7f18100b1820 2024-04-25T08:56:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f9c089c00 con 0x7f2fa006d1e0 2024-04-25T08:56:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f2f96ffd640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7f2f84073820 0x7f2f84075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f2fa5a7c640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b5a0 0x7f2f8406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fea5f2c6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d2df0 con 0x7fea5815def0 2024-04-25T08:56:49.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fea5f2c6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580b6c60 con 0x7fea580d0400 2024-04-25T08:56:49.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 --> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f840762f0 con 0x7f2f84073820 2024-04-25T08:56:49.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fea5d863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5815def0 0x7fea58157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7f8aac9a2640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a8c06b520 0x7f8a8c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9c055ce0 con 0x7f8aa80aebc0 2024-04-25T08:56:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f9c08e2a0 con 0x7f2fa006d1e0 2024-04-25T08:56:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fea5d863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5815def0 0x7fea58157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44290/0 (socket says 172.21.15.5:44290) 2024-04-25T08:56:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.748+0000 7fade6637640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fadc40736f0 0x7fadc4075b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.749+0000 7fade5e36640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadc406b4d0 0x7fadc406d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faddc000ff0 tx=0x7faddc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== osd.5 v2:172.21.15.80:6824/1661516176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fadc40761c0 con 0x7fadc40736f0 2024-04-25T08:56:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fea5d863640 1 -- 172.21.15.5:0/4185475008 learned_addr learned my addr 172.21.15.5:0/4185475008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fea5c861640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600072d0 con 0x7fd764007330 2024-04-25T08:56:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f7431ffb640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f742006b5d0 0x7f742006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f743808aa20 con 0x7f743c0b6ab0 2024-04-25T08:56:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f7431ffb640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f7420073850 0x7f7420075c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7438014ec0 con 0x7f7420073850 2024-04-25T08:56:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f743808ae10 con 0x7f743c0b6ab0 2024-04-25T08:56:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f2fa6a7e640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7f2f84073820 0x7f2f84075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fd770dd6640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76404d350 con 0x7fd764007330 2024-04-25T08:56:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f74418a6640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f7420073850 0x7f7420075c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7fd770dd6640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76404d910 con 0x7fd764007330 2024-04-25T08:56:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f8aad9a4640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f8a8c074350 0x7f8a8c0767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f74408a4640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f742006b5d0 0x7f742006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181013d950 con 0x7f18100b1820 2024-04-25T08:56:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181013df10 con 0x7f18100b1820 2024-04-25T08:56:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.750+0000 7f8aac9a2640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a8c06b520 0x7f8a8c06d9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a94034000 tx=0x7f8a9402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea5d863640 1 -- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 msgr2=0x7fea580ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea5d863640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea5d863640 1 -- 172.21.15.5:0/4185475008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea580b94c0 msgr2=0x7fea580cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea5d863640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea580b94c0 0x7fea580cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea5d863640 1 -- 172.21.15.5:0/4185475008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5806ce90 con 0x7fea5815def0 2024-04-25T08:56:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7f74418a6640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f7420073850 0x7f7420075c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea5c861640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d0400 0x7fea580ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea5d863640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5815def0 0x7fea58157040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea5002ac30 tx=0x7fea50004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7f8aad9a4640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f8a8c074350 0x7f8a8c0767f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f181004ef20 con 0x7f18100b1820 2024-04-25T08:56:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7f74408a4640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f742006b5d0 0x7f742006da90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f743c0b61d0 tx=0x7f742c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.751+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50041030 con 0x7fea5815def0 2024-04-25T08:56:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.752+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5815c450 con 0x7fea5815def0 2024-04-25T08:56:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.752+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50031400 con 0x7fea5815def0 2024-04-25T08:56:49.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.752+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50036040 con 0x7fea5815def0 2024-04-25T08:56:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.752+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== osd.0 v2:172.21.15.5:6800/1814386695 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7438014ec0 con 0x7f7420073850 2024-04-25T08:56:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.752+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea580ccf40 con 0x7fea5815def0 2024-04-25T08:56:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.753+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== osd.2 v2:172.21.15.5:6823/3851787171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8a8c076ec0 con 0x7f8a8c074350 2024-04-25T08:56:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.753+0000 7f2fa6a7e640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7f2f84073820 0x7f2f84075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.752+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd744001030 con 0x7fd764007330 2024-04-25T08:56:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.753+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd76001a070 con 0x7fd764007330 2024-04-25T08:56:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.753+0000 7fd757fff640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd75006b5a0 0x7fd75006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.753+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea5804ef20 con 0x7fea5815def0 2024-04-25T08:56:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.753+0000 7f2fa5a7c640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b5a0 0x7f2f8406da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006da20 tx=0x7f2f90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.754+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd760089430 con 0x7fd764007330 2024-04-25T08:56:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.753+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1808046020 con 0x7f18100b1820 2024-04-25T08:56:49.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.754+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== osd.4 v2:172.21.15.80:6816/1836296073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2f840762f0 con 0x7f2f84073820 2024-04-25T08:56:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.754+0000 7fd757fff640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7fd7500737c0 0x7fd750075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.754+0000 7fd76bfff640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7fd7500737c0 0x7fd750075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.754+0000 7f1806ffd640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17f406b5d0 0x7f17f406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.754+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fea50044070 con 0x7fea5815def0 2024-04-25T08:56:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18080abdf0 con 0x7f18100b1820 2024-04-25T08:56:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7f1815939640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17f406b5d0 0x7f17f406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fd76bfff640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7fd7500737c0 0x7fd750075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7f1806ffd640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7f17f40737f0 0x7f17f4075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd760005ce0 con 0x7fd7500737c0 2024-04-25T08:56:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd760090050 con 0x7fd764007330 2024-04-25T08:56:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fea4dffb640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3c06b5a0 0x7fea3c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea500abb90 con 0x7fea5815def0 2024-04-25T08:56:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fea5d062640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3c06b5a0 0x7fea3c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7f181693b640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7f17f40737f0 0x7f17f4075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1808034e90 con 0x7f17f40737f0 2024-04-25T08:56:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fea4dffb640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7fea3c0737c0 0x7fea3c075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 --> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea3c076290 con 0x7fea3c0737c0 2024-04-25T08:56:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.755+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea500abf80 con 0x7fea5815def0 2024-04-25T08:56:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.756+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18080ac1e0 con 0x7f18100b1820 2024-04-25T08:56:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.756+0000 7fea5c861640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7fea3c0737c0 0x7fea3c075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.756+0000 7f1815939640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17f406b5d0 0x7f17f406da90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f180c007fd0 tx=0x7f180c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.756+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== osd.1 v2:172.21.15.5:6815/1158282071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd760005ce0 con 0x7fd7500737c0 2024-04-25T08:56:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.756+0000 7fd76affd640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd75006b5a0 0x7fd75006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.756+0000 7f181693b640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7f17f40737f0 0x7f17f4075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.756+0000 7fea5d062640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3c06b5a0 0x7fea3c06da60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea54000f60 tx=0x7fea540079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.757+0000 7fea5c861640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7fea3c0737c0 0x7fea3c075be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.757+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== osd.3 v2:172.21.15.5:6808/2008289449 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1808034e90 con 0x7f17f40737f0 2024-04-25T08:56:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.757+0000 7fd76affd640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd75006b5a0 0x7fd75006da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd75802a300 tx=0x7fd75802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.758+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== osd.7 v2:172.21.15.80:6800/4179945280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fea3c076290 con 0x7fea3c0737c0 2024-04-25T08:56:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.781+0000 7f7ecd60d640 1 -- 172.21.15.5:0/2044032801 --> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ea8002d50 con 0x7f7eac0737c0 2024-04-25T08:56:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.782+0000 7f7ec4ff9640 1 -- 172.21.15.5:0/2044032801 <== osd.6 v2:172.21.15.80:6805/2858900277 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ea8002d50 con 0x7f7eac0737c0 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.782+0000 7f7eb27fc640 1 -- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7f7eac0737c0 msgr2=0x7f7eac075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.782+0000 7f7eb27fc640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7f7eac0737c0 0x7f7eac075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.783+0000 7f7eb27fc640 1 -- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7eac06b5a0 msgr2=0x7f7eac06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.783+0000 7f7eb27fc640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7eac06b5a0 0x7f7eac06da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc034000 tx=0x7f7ebc02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.783+0000 7f7eb27fc640 1 -- 172.21.15.5:0/2044032801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ec00eb130 msgr2=0x7f7ec000e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.783+0000 7f7eb27fc640 1 --2- 172.21.15.5:0/2044032801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ec00eb130 0x7f7ec000e910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80646b0 tx=0x7f7ec8068e30 comp rx=0 tx=0).stop 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.783+0000 7f7ecce0c640 1 -- 172.21.15.5:0/2044032801 reap_dead start 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.783+0000 7f7eb27fc640 1 -- 172.21.15.5:0/2044032801 shutdown_connections 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.783+0000 7f7eb27fc640 1 -- 172.21.15.5:0/2044032801 >> 172.21.15.5:0/2044032801 conn(0x7f7ec003aa40 msgr2=0x7f7ec0004b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.784+0000 7fade6e38640 1 -- 172.21.15.5:0/857230413 --> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fadc8002dd0 con 0x7fadc40736f0 2024-04-25T08:56:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.784+0000 7f7eb27fc640 1 -- 172.21.15.5:0/2044032801 shutdown_connections 2024-04-25T08:56:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.784+0000 7f7eb27fc640 1 -- 172.21.15.5:0/2044032801 wait complete. 2024-04-25T08:56:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.785+0000 7f74420a7640 1 -- 172.21.15.5:0/4248464712 --> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f743c15dc00 con 0x7f7420073850 2024-04-25T08:56:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.785+0000 7fadd67fc640 1 -- 172.21.15.5:0/857230413 <== osd.5 v2:172.21.15.80:6824/1661516176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fadc8002dd0 con 0x7fadc40736f0 2024-04-25T08:56:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.785+0000 7f7431ffb640 1 -- 172.21.15.5:0/4248464712 <== osd.0 v2:172.21.15.5:6800/1814386695 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f743c15dc00 con 0x7f7420073850 2024-04-25T08:56:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.785+0000 7fadc3fff640 1 -- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fadc40736f0 msgr2=0x7fadc4075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fadc40736f0 0x7fadc4075b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 -- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadc406b4d0 msgr2=0x7fadc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadc406b4d0 0x7fadc406d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faddc000ff0 tx=0x7faddc009040 comp rx=0 tx=0).stop 2024-04-25T08:56:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 -- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd80e0cc0 msgr2=0x7fadd80e1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 --2- 172.21.15.5:0/857230413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd80e0cc0 0x7fadd80e1120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadd000d520 tx=0x7fadd000d9e0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fade6637640 1 -- 172.21.15.5:0/857230413 reap_dead start 2024-04-25T08:56:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 --> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8aa80b4110 con 0x7f8a8c074350 2024-04-25T08:56:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7f741f7fe640 1 -- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f7420073850 msgr2=0x7f7420075c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7f741f7fe640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f7420073850 0x7f7420075c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 -- 172.21.15.5:0/857230413 shutdown_connections 2024-04-25T08:56:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 -- 172.21.15.5:0/857230413 >> 172.21.15.5:0/857230413 conn(0x7fadd8058ee0 msgr2=0x7fadd804e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.786+0000 7fadc3fff640 1 -- 172.21.15.5:0/857230413 shutdown_connections 2024-04-25T08:56:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 -- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f742006b5d0 msgr2=0x7f742006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f742006b5d0 0x7f742006da90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f743c0b61d0 tx=0x7f742c008040 comp rx=0 tx=0).stop 2024-04-25T08:56:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 -- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0b6ab0 msgr2=0x7f743c0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 --2- 172.21.15.5:0/4248464712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0b6ab0 0x7f743c0c8660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f743800cbc0 tx=0x7f743800a060 comp rx=0 tx=0).stop 2024-04-25T08:56:49.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f74418a6640 1 -- 172.21.15.5:0/4248464712 reap_dead start 2024-04-25T08:56:49.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f8aa5ffb640 1 -- 172.21.15.5:0/3753771126 <== osd.2 v2:172.21.15.5:6823/3851787171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8aa80b4110 con 0x7f8a8c074350 2024-04-25T08:56:49.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7fadc3fff640 1 -- 172.21.15.5:0/857230413 wait complete. 2024-04-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 -- 172.21.15.5:0/4248464712 shutdown_connections 2024-04-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 -- 172.21.15.5:0/4248464712 >> 172.21.15.5:0/4248464712 conn(0x7f743c0668f0 msgr2=0x7f743c15f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 -- 172.21.15.5:0/4248464712 shutdown_connections 2024-04-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f741f7fe640 1 -- 172.21.15.5:0/4248464712 wait complete. 2024-04-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f8a8c074350 msgr2=0x7f8a8c0767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f8aaf407640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f8a8c074350 0x7f8a8c0767f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.787+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a8c06b520 msgr2=0x7f8a8c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.788+0000 7f8aaf407640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a8c06b520 0x7f8a8c06d9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a94034000 tx=0x7f8a9402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.788+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa80aebc0 msgr2=0x7f8aa81576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.788+0000 7f8aaf407640 1 --2- 172.21.15.5:0/3753771126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa80aebc0 0x7f8aa81576c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c8a0 tx=0x7f8a9c00cd60 comp rx=0 tx=0).stop 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.788+0000 7f8aad9a4640 1 -- 172.21.15.5:0/3753771126 reap_dead start 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.788+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 shutdown_connections 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.788+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 >> 172.21.15.5:0/3753771126 conn(0x7f8aa8066f20 msgr2=0x7f8aa80b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.788+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 shutdown_connections 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.789+0000 7f8aaf407640 1 -- 172.21.15.5:0/3753771126 wait complete. 2024-04-25T08:56:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.789+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 --> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fa00ae180 con 0x7f2f84073820 2024-04-25T08:56:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.789+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 --> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd744002dd0 con 0x7fd7500737c0 2024-04-25T08:56:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f2f96ffd640 1 -- 172.21.15.5:0/825564356 <== osd.4 v2:172.21.15.80:6816/1836296073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fa00ae180 con 0x7f2f84073820 2024-04-25T08:56:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7fd757fff640 1 -- 172.21.15.5:0/3331932600 <== osd.1 v2:172.21.15.5:6815/1158282071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd744002dd0 con 0x7fd7500737c0 2024-04-25T08:56:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7f2f84073820 msgr2=0x7f2f84075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 --> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18100ccb40 con 0x7f17f40737f0 2024-04-25T08:56:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f2fa84e1640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7f2f84073820 0x7f2f84075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b5a0 msgr2=0x7f2f8406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f2fa84e1640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b5a0 0x7f2f8406da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006da20 tx=0x7f2f90009040 comp rx=0 tx=0).stop 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa006d1e0 msgr2=0x7f2fa014bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7f2fa84e1640 1 --2- 172.21.15.5:0/825564356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa006d1e0 0x7f2fa014bdf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00c3e0 tx=0x7f2f9c00c8a0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7f2fa6a7e640 1 -- 172.21.15.5:0/825564356 reap_dead start 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 shutdown_connections 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 >> 172.21.15.5:0/825564356 conn(0x7f2fa00b1da0 msgr2=0x7f2fa01617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7fd7500737c0 msgr2=0x7fd750075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.790+0000 7fd755ffb640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7fd7500737c0 0x7fd750075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd75006b5a0 msgr2=0x7fd75006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd75006b5a0 0x7fd75006da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd75802a300 tx=0x7fd75802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 shutdown_connections 2024-04-25T08:56:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7f2fa84e1640 1 -- 172.21.15.5:0/825564356 wait complete. 2024-04-25T08:56:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7f1806ffd640 1 -- 172.21.15.5:0/746018477 <== osd.3 v2:172.21.15.5:6808/2008289449 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18100ccb40 con 0x7f17f40737f0 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd764007330 msgr2=0x7fd76404c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 --2- 172.21.15.5:0/3331932600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd764007330 0x7fd76404c5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c440 tx=0x7fd76000c900 comp rx=0 tx=0).stop 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd76bfff640 1 -- 172.21.15.5:0/3331932600 reap_dead start 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 shutdown_connections 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 >> 172.21.15.5:0/3331932600 conn(0x7fd76400a3f0 msgr2=0x7fd7640489c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 shutdown_connections 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.791+0000 7fd755ffb640 1 -- 172.21.15.5:0/3331932600 wait complete. 2024-04-25T08:56:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 --> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea580cd390 con 0x7fea3c0737c0 2024-04-25T08:56:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7f17f40737f0 msgr2=0x7f17f4075c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7f181839e640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7f17f40737f0 0x7f17f4075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17f406b5d0 msgr2=0x7f17f406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7f181839e640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17f406b5d0 0x7f17f406da90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f180c007fd0 tx=0x7f180c009040 comp rx=0 tx=0).stop 2024-04-25T08:56:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7fea4dffb640 1 -- 172.21.15.5:0/4185475008 <== osd.7 v2:172.21.15.80:6800/4179945280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea580cd390 con 0x7fea3c0737c0 2024-04-25T08:56:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18100b1820 msgr2=0x7f1810159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7f181839e640 1 --2- 172.21.15.5:0/746018477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18100b1820 0x7f1810159860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1808035040 tx=0x7f1808004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.792+0000 7f181693b640 1 -- 172.21.15.5:0/746018477 reap_dead start 2024-04-25T08:56:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.793+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 shutdown_connections 2024-04-25T08:56:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.793+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 >> 172.21.15.5:0/746018477 conn(0x7f18100cfbc0 msgr2=0x7f18100ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.793+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 shutdown_connections 2024-04-25T08:56:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.793+0000 7f181839e640 1 -- 172.21.15.5:0/746018477 wait complete. 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.794+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7fea3c0737c0 msgr2=0x7fea3c075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.794+0000 7fea5f2c6640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7fea3c0737c0 0x7fea3c075be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.794+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3c06b5a0 msgr2=0x7fea3c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.794+0000 7fea5f2c6640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3c06b5a0 0x7fea3c06da60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea54000f60 tx=0x7fea540079d0 comp rx=0 tx=0).stop 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.794+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5815def0 msgr2=0x7fea58157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.794+0000 7fea5f2c6640 1 --2- 172.21.15.5:0/4185475008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5815def0 0x7fea58157040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea5002ac30 tx=0x7fea50004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.794+0000 7fea5d863640 1 -- 172.21.15.5:0/4185475008 reap_dead start 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.795+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 shutdown_connections 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.795+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 >> 172.21.15.5:0/4185475008 conn(0x7fea5806b000 msgr2=0x7fea5815d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.795+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 shutdown_connections 2024-04-25T08:56:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:49.795+0000 7fea5f2c6640 1 -- 172.21.15.5:0/4185475008 wait complete. 2024-04-25T08:56:49.842 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:49.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T08:56:49.843 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-04-25T08:56:49.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T08:56:49.844 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:49.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T08:56:49.845 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:49.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T08:56:49.846 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:49.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T08:56:49.847 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-04-25T08:56:49.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T08:56:49.848 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:49.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T08:56:49.849 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:49.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T08:56:50.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.065+0000 7f5c0f86b640 1 Processor -- start 2024-04-25T08:56:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.065+0000 7f5c0f86b640 1 -- start start 2024-04-25T08:56:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f5c0f86b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c081576a0 0x7f5c0815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f5c0f86b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c080aef30 0x7f5c080b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f3beffff640 1 Processor -- start 2024-04-25T08:56:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f5c0f86b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c080703c0 con 0x7f5c0806c420 2024-04-25T08:56:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f5c0f86b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c080b2ba0 con 0x7f5c080aef30 2024-04-25T08:56:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f5c0f86b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0806cc30 con 0x7f5c081576a0 2024-04-25T08:56:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f5c0ce06640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5c0806c420 0x7f5c080ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:35578/0 (socket says 172.21.15.5:35578) 2024-04-25T08:56:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f5c0ce06640 1 -- 172.21.15.5:0/1529497329 learned_addr learned my addr 172.21.15.5:0/1529497329 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.067+0000 7f3beffff640 1 -- start start 2024-04-25T08:56:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651623520 0 0) 0x7f5c080703c0 con 0x7f5c0806c420 2024-04-25T08:56:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf4003520 con 0x7f5c0806c420 2024-04-25T08:56:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5c0de08640 1 --2- 172.21.15.5:0/1529497329 >> v2:172.21.15.5:3300/0 conn(0x7f5c080aef30 0x7f5c080b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5c0d607640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c081576a0 0x7f5c0815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 <== mon.1 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312176369 0 0) 0x7f5bf4003520 con 0x7f5c0806c420 2024-04-25T08:56:50.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c081576a0 msgr2=0x7f5c0815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f3beffff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf0067410 0x7f3bf00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f3beffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bf015e160 0x7f3bf0159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f3beffff640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf015e6b0 con 0x7f3bf00b3600 2024-04-25T08:56:50.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f3beffff640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf00b2b20 con 0x7f3bf015e160 2024-04-25T08:56:50.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f3beffff640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b2e00 con 0x7f3bf0067410 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3beeffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf0067410 0x7f3bf00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3beeffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf0067410 0x7f3bf00b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35940/0 (socket says 172.21.15.5:35940) 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3beeffd640 1 -- 172.21.15.5:0/2704425515 learned_addr learned my addr 172.21.15.5:0/2704425515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3bee7fc640 1 --2- 172.21.15.5:0/2704425515 >> v2:172.21.15.80:3300/0 conn(0x7f3bf015e160 0x7f3bf0159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3beeffd640 1 -- 172.21.15.5:0/2704425515 >> v2:172.21.15.80:3300/0 conn(0x7f3bf015e160 msgr2=0x7f3bf0159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3beeffd640 1 --2- 172.21.15.5:0/2704425515 >> v2:172.21.15.80:3300/0 conn(0x7f3bf015e160 0x7f3bf0159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3beeffd640 1 -- 172.21.15.5:0/2704425515 >> v1:172.21.15.5:6789/0 conn(0x7f3bf00b3600 legacy=0x7f3bf00cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7fb4033e0640 1 Processor -- start 2024-04-25T08:56:50.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7fb4033e0640 1 -- start start 2024-04-25T08:56:50.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f3beeffd640 1 -- 172.21.15.5:0/2704425515 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf015a000 con 0x7f3bf0067410 2024-04-25T08:56:50.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f2f4f59e640 1 Processor -- start 2024-04-25T08:56:50.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f2f4f59e640 1 -- start start 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c081576a0 0x7f5c0815ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 >> v2:172.21.15.5:3300/0 conn(0x7f5c080aef30 msgr2=0x7f5c080b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 --2- 172.21.15.5:0/1529497329 >> v2:172.21.15.5:3300/0 conn(0x7f5c080aef30 0x7f5c080b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0806cf10 con 0x7f5c0806c420 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 <== mon.1 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f5c000019f0 con 0x7f5c0806c420 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 >> v1:172.21.15.80:6789/0 conn(0x7f5c0806c420 legacy=0x7f5c080ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf40039b0 0x7f5bf4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.068+0000 7f5bfffff640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf4004800 0x7f5bf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f5bfffff640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080b2ba0 con 0x7f5bf40051c0 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0806cc30 con 0x7f5bf40039b0 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf400c0b0 con 0x7f5bf4004800 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f5c0de08640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.069+0000 7f5c0d607640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf40039b0 0x7f5bf4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f5c0de08640 1 -- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf4004800 msgr2=0x7f5bf4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T08:56:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f5c0de08640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf4004800 0x7f5bf4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f5c0de08640 1 -- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf40039b0 msgr2=0x7f5bf4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f5c0de08640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bf40039b0 0x7f5bf4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f5c0de08640 1 -- 172.21.15.5:0/1529497329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0806cf10 con 0x7f5bf40051c0 2024-04-25T08:56:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f190b193640 1 Processor -- start 2024-04-25T08:56:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f190b193640 1 -- start start 2024-04-25T08:56:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f3beeffd640 1 --2- 172.21.15.5:0/2704425515 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf0067410 0x7f3bf00b5110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009870 tx=0x7f3be002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117c4f45aa7fce2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f4db8b06640 1 Processor -- start 2024-04-25T08:56:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f3bedffb640 1 -- 172.21.15.5:0/2704425515 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0037070 con 0x7f3bf0067410 2024-04-25T08:56:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f66aebfb640 1 Processor -- start 2024-04-25T08:56:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7f66aebfb640 1 -- start start 2024-04-25T08:56:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f66aebfb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66a00e7560 0x7f66a0005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f66aebfb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a0052f80 0x7f66a00533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f66aebfb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a004f460 con 0x7f66a0047ca0 2024-04-25T08:56:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f66aebfb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a004f740 con 0x7f66a00e7560 2024-04-25T08:56:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.070+0000 7fb4033e0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3fc0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb40117c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3fc0cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb40117c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3fc0cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35954/0 (socket says 172.21.15.5:35954) 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb40117c640 1 -- 172.21.15.5:0/878077243 learned_addr learned my addr 172.21.15.5:0/878077243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc0cfdb0 con 0x7fb3fc071c90 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc06d7f0 con 0x7fb3fc0720f0 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc070bf0 con 0x7fb3fc0cf490 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734973707 0 0) 0x7fb3fc06d7f0 con 0x7fb3fc0720f0 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e8003520 con 0x7fb3fc0720f0 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 <== mon.1 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1597347486 0 0) 0x7fb3e8003520 con 0x7fb3fc0720f0 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 msgr2=0x7fb3fc0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb3f3fff640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3fc0cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 >> v1:172.21.15.5:6789/0 conn(0x7fb3fc071c90 legacy=0x7fb3fc0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f2f4f59e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f48104ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f2f4f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f48105220 0x7f2f480063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f2f4f59e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f48005ea0 con 0x7f2f480068e0 2024-04-25T08:56:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f2f4f59e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f48054200 con 0x7f2f48105220 2024-04-25T08:56:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f2f4f59e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4803a360 con 0x7f2f48104900 2024-04-25T08:56:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f3bedffb640 1 -- 172.21.15.5:0/2704425515 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be002ae50 con 0x7f3bf0067410 2024-04-25T08:56:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f3bedffb640 1 -- 172.21.15.5:0/2704425515 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0032860 con 0x7f3bf0067410 2024-04-25T08:56:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f66aebfb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a004fbc0 con 0x7f66a0052f80 2024-04-25T08:56:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66ae3fa640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a0052f80 0x7f66a00533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc070ed0 con 0x7fb3fc0720f0 2024-04-25T08:56:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 <== mon.1 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb3f8001670 con 0x7fb3fc0720f0 2024-04-25T08:56:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 >> v1:172.21.15.80:6789/0 conn(0x7fb3fc0720f0 legacy=0x7fb3fc16ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80039e0 0x7fb3e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e8004d40 0x7fb3e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc070bf0 con 0x7fb3e80039e0 2024-04-25T08:56:50.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e800fe80 con 0x7fb3e8004d40 2024-04-25T08:56:50.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8010080 con 0x7fb3fc0cf490 2024-04-25T08:56:50.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66ae3fa640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a0052f80 0x7f66a00533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35966/0 (socket says 172.21.15.5:35966) 2024-04-25T08:56:50.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f2f4e59c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f48104ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f2f4dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f48105220 0x7f2f480063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66ae3fa640 1 -- 172.21.15.5:0/2503866167 learned_addr learned my addr 172.21.15.5:0/2503866167 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f2f4e59c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f48104ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35956/0 (socket says 172.21.15.5:35956) 2024-04-25T08:56:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66adbf9640 1 --2- 172.21.15.5:0/2503866167 >> v2:172.21.15.5:3300/0 conn(0x7f66a00e7560 0x7f66a0005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb40197d640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e8004d40 0x7fb3e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb40117c640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80039e0 0x7fb3e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb40197d640 1 -- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 msgr2=0x7fb3e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190b193640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18fc00aac0 0x7f18fc0df0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190b193640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc0535e0 con 0x7f18fc053090 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190b193640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc0538c0 con 0x7f18fc050170 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190b193640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc053ba0 con 0x7f18fc00aac0 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.071+0000 7f4db8b06640 1 -- start start 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66ae3fa640 1 -- 172.21.15.5:0/2503866167 >> v2:172.21.15.5:3300/0 conn(0x7f66a00e7560 msgr2=0x7f66a0005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66ae3fa640 1 --2- 172.21.15.5:0/2503866167 >> v2:172.21.15.5:3300/0 conn(0x7f66a00e7560 0x7f66a0005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66ae3fa640 1 -- 172.21.15.5:0/2503866167 >> v1:172.21.15.5:6789/0 conn(0x7f66a0047ca0 legacy=0x7f66a0006420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f66ae3fa640 1 -- 172.21.15.5:0/2503866167 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a004fea0 con 0x7f66a0052f80 2024-04-25T08:56:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f4db8b06640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4db4159bd0 0x7f4db406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f4db8b06640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db40b3450 con 0x7f4db40ae7b0 2024-04-25T08:56:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f4db8b06640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db40b3730 con 0x7f4db4070710 2024-04-25T08:56:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f4db8b06640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40b3a10 con 0x7f4db4159bd0 2024-04-25T08:56:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190a191640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18fc00aac0 0x7f18fc0df0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190a191640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18fc00aac0 0x7f18fc0df0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35978/0 (socket says 172.21.15.5:35978) 2024-04-25T08:56:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190a992640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f18fc050170 0x7f18fc0e9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:35590/0 (socket says 172.21.15.5:35590) 2024-04-25T08:56:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f190a191640 1 -- 172.21.15.5:0/2024640986 learned_addr learned my addr 172.21.15.5:0/2024640986 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f4db37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4db4159bd0 0x7f4db406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f4db37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4db4159bd0 0x7f4db406c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44322/0 (socket says 172.21.15.5:44322) 2024-04-25T08:56:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f4db37fe640 1 -- 172.21.15.5:0/698550151 learned_addr learned my addr 172.21.15.5:0/698550151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7fc9c669a640 1 Processor -- start 2024-04-25T08:56:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb40097b640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7fb40197d640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7fb40197d640 1 -- 172.21.15.5:0/878077243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80039e0 msgr2=0x7fb3e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7fb40197d640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80039e0 0x7fb3e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7fb40197d640 1 -- 172.21.15.5:0/878077243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8003520 con 0x7fb3e8004d40 2024-04-25T08:56:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7fc9c669a640 1 -- start start 2024-04-25T08:56:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f190a191640 1 -- 172.21.15.5:0/2024640986 >> v1:172.21.15.80:6789/0 conn(0x7f18fc050170 legacy=0x7f18fc0e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f190a191640 1 -- 172.21.15.5:0/2024640986 >> v1:172.21.15.5:6789/0 conn(0x7f18fc053090 legacy=0x7f18fc04fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f5c0de08640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009cd0 tx=0x7f5bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba11f58ff9dc77ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7fb40097b640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3fc0cf490 0x7fb3e8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:50.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f4db37fe640 1 -- 172.21.15.5:0/698550151 >> v1:172.21.15.80:6789/0 conn(0x7f4db4070710 legacy=0x7f4db4070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f4db37fe640 1 -- 172.21.15.5:0/698550151 >> v1:172.21.15.5:6789/0 conn(0x7f4db40ae7b0 legacy=0x7f4db406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f4db37fe640 1 -- 172.21.15.5:0/698550151 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db40b3cf0 con 0x7f4db4159bd0 2024-04-25T08:56:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.072+0000 7f2f4e59c640 1 -- 172.21.15.5:0/3218639078 learned_addr learned my addr 172.21.15.5:0/3218639078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f2f4dd9b640 1 -- 172.21.15.5:0/3218639078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 msgr2=0x7f2f48104ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f2f4dd9b640 1 --2- 172.21.15.5:0/3218639078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f48104ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f2f4dd9b640 1 -- 172.21.15.5:0/3218639078 >> v1:172.21.15.80:6789/0 conn(0x7f2f480068e0 legacy=0x7f2f48006cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f2f4dd9b640 1 -- 172.21.15.5:0/3218639078 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4803a640 con 0x7f2f48105220 2024-04-25T08:56:50.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f3beffff640 1 -- 172.21.15.5:0/2704425515 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf0067410 msgr2=0x7f3bf00b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f3beffff640 1 --2- 172.21.15.5:0/2704425515 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf0067410 0x7f3bf00b5110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009870 tx=0x7f3be002a300 comp rx=0 tx=0).stop 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f3beffff640 1 -- 172.21.15.5:0/2704425515 shutdown_connections 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f3beffff640 1 --2- 172.21.15.5:0/2704425515 >> v2:172.21.15.80:3300/0 conn(0x7f3bf015e160 0x7f3bf0159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f3beffff640 1 --2- 172.21.15.5:0/2704425515 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf0067410 0x7f3bf00b5110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f3beffff640 1 -- 172.21.15.5:0/2704425515 >> 172.21.15.5:0/2704425515 conn(0x7f3bf00668f0 msgr2=0x7f3bf0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f3beffff640 1 -- 172.21.15.5:0/2704425515 shutdown_connections 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f66ae3fa640 1 --2- 172.21.15.5:0/2503866167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a0052f80 0x7f66a00533d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17956f1fc90fd918 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f3beffff640 1 -- 172.21.15.5:0/2704425515 wait complete. 2024-04-25T08:56:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f2f4dd9b640 1 --2- 172.21.15.5:0/3218639078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f48105220 0x7f2f480063a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f500694d0 tx=0x7f2f50069610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc66b00b81dda21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7fb40197d640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e8004d40 0x7fb3e80051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8007f20 tx=0x7fb3e8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d480aeed46cdc5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f2f4d59a640 1 -- 172.21.15.5:0/3218639078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500a0070 con 0x7f2f48105220 2024-04-25T08:56:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.073+0000 7f190a191640 1 -- 172.21.15.5:0/2024640986 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc053e80 con 0x7f18fc00aac0 2024-04-25T08:56:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f2f4d59a640 1 -- 172.21.15.5:0/3218639078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f500997d0 con 0x7f2f48105220 2024-04-25T08:56:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f2f4d59a640 1 -- 172.21.15.5:0/3218639078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50099c20 con 0x7f2f48105220 2024-04-25T08:56:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f4db37fe640 1 --2- 172.21.15.5:0/698550151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 0x7f4db406c100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4da4008870 tx=0x7f4da402c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c539296142bd220 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8036070 con 0x7fb3e8004d40 2024-04-25T08:56:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f802ae50 con 0x7fb3e8004d40 2024-04-25T08:56:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7fb3f3fff640 1 -- 172.21.15.5:0/878077243 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8007b70 con 0x7fb3e8004d40 2024-04-25T08:56:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8036070 con 0x7f5bf40051c0 2024-04-25T08:56:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf8031400 con 0x7f5bf40051c0 2024-04-25T08:56:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f5bfffff640 1 -- 172.21.15.5:0/1529497329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8009670 con 0x7f5bf40051c0 2024-04-25T08:56:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f4db2ffd640 1 -- 172.21.15.5:0/698550151 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da403a070 con 0x7f4db4159bd0 2024-04-25T08:56:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f4db2ffd640 1 -- 172.21.15.5:0/698550151 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4032480 con 0x7f4db4159bd0 2024-04-25T08:56:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f4db2ffd640 1 -- 172.21.15.5:0/698550151 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4032850 con 0x7f4db4159bd0 2024-04-25T08:56:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f66acbf7640 1 -- 172.21.15.5:0/2503866167 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4037070 con 0x7f66a0052f80 2024-04-25T08:56:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f66acbf7640 1 -- 172.21.15.5:0/2503866167 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a4032440 con 0x7f66a0052f80 2024-04-25T08:56:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.074+0000 7f66acbf7640 1 -- 172.21.15.5:0/2503866167 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4032810 con 0x7f66a0052f80 2024-04-25T08:56:50.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9c669a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9c00ceb40 0x7fc9c00b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e8004d40 msgr2=0x7fb3e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9c669a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00d2110 con 0x7fc9c0161210 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9c4e97640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc9c00ce6e0 0x7fc9c00b6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:35594/0 (socket says 172.21.15.5:35594) 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9c4e97640 1 -- 172.21.15.5:0/2815297222 learned_addr learned my addr 172.21.15.5:0/2815297222 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9c669a640 1 -- 172.21.15.5:0/2815297222 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00d23e0 con 0x7fc9c00ce6e0 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fb4033e0640 1 --2- 172.21.15.5:0/878077243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e8004d40 0x7fb3e80051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8007f20 tx=0x7fb3e8005830 comp rx=0 tx=0).stop 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fb40197d640 1 -- 172.21.15.5:0/878077243 reap_dead start 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 shutdown_connections 2024-04-25T08:56:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 >> 172.21.15.5:0/878077243 conn(0x7fb3fc0741c0 msgr2=0x7fb3fc0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f66aebfb640 1 -- 172.21.15.5:0/2503866167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a0052f80 msgr2=0x7f66a00533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f66aebfb640 1 --2- 172.21.15.5:0/2503866167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a0052f80 0x7f66a00533d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402a180 comp rx=0 tx=0).stop 2024-04-25T08:56:50.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9c669a640 1 -- 172.21.15.5:0/2815297222 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00d26c0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 shutdown_connections 2024-04-25T08:56:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fb4033e0640 1 -- 172.21.15.5:0/878077243 wait complete. 2024-04-25T08:56:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f66aebfb640 1 -- 172.21.15.5:0/2503866167 shutdown_connections 2024-04-25T08:56:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f66aebfb640 1 --2- 172.21.15.5:0/2503866167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a0052f80 0x7f66a00533d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f66aebfb640 1 --2- 172.21.15.5:0/2503866167 >> v2:172.21.15.5:3300/0 conn(0x7f66a00e7560 0x7f66a0005ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f66aebfb640 1 -- 172.21.15.5:0/2503866167 >> 172.21.15.5:0/2503866167 conn(0x7f66a0009fb0 msgr2=0x7f66a000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9b7fff640 1 -- 172.21.15.5:0/2815297222 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622645308 0 0) 0x7fc9c00d23e0 con 0x7fc9c00ce6e0 2024-04-25T08:56:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f4db8b06640 1 -- 172.21.15.5:0/698550151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 msgr2=0x7f4db406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f4db8b06640 1 --2- 172.21.15.5:0/698550151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 0x7f4db406c100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4da4008870 tx=0x7f4da402c750 comp rx=0 tx=0).stop 2024-04-25T08:56:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7fc9c5e99640 1 --2- 172.21.15.5:0/2815297222 >> v2:172.21.15.80:3300/0 conn(0x7fc9c00ceb40 0x7fc9c00b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7fc9b7fff640 1 -- 172.21.15.5:0/2815297222 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac003520 con 0x7fc9c00ce6e0 2024-04-25T08:56:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.075+0000 7f190a191640 1 --2- 172.21.15.5:0/2024640986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc00aac0 0x7f18fc0df0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009870 tx=0x7f18f402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549e7aa88e950b9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f5c0f86b640 1 -- 172.21.15.5:0/1529497329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bf40051c0 msgr2=0x7f5bf400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f5c0f86b640 1 --2- 172.21.15.5:0/1529497329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009cd0 tx=0x7f5bf4005830 comp rx=0 tx=0).stop 2024-04-25T08:56:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f5c0de08640 1 -- 172.21.15.5:0/1529497329 reap_dead start 2024-04-25T08:56:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f66aebfb640 1 -- 172.21.15.5:0/2503866167 shutdown_connections 2024-04-25T08:56:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f190918f640 1 -- 172.21.15.5:0/2024640986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4037070 con 0x7f18fc00aac0 2024-04-25T08:56:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f3beffff640 1 Processor -- start 2024-04-25T08:56:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f3beffff640 1 -- start start 2024-04-25T08:56:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f66aebfb640 1 -- 172.21.15.5:0/2503866167 wait complete. 2024-04-25T08:56:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f190918f640 1 -- 172.21.15.5:0/2024640986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f4032440 con 0x7f18fc00aac0 2024-04-25T08:56:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f5c0f86b640 1 -- 172.21.15.5:0/1529497329 shutdown_connections 2024-04-25T08:56:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f5c0f86b640 1 -- 172.21.15.5:0/1529497329 >> 172.21.15.5:0/1529497329 conn(0x7f5c08066f20 msgr2=0x7f5c080b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f190918f640 1 -- 172.21.15.5:0/2024640986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4032810 con 0x7f18fc00aac0 2024-04-25T08:56:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7f5c0f86b640 1 -- 172.21.15.5:0/1529497329 shutdown_connections 2024-04-25T08:56:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f5c0f86b640 1 -- 172.21.15.5:0/1529497329 wait complete. 2024-04-25T08:56:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f2f4f59e640 1 -- 172.21.15.5:0/3218639078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f48105220 msgr2=0x7f2f480063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f2f4f59e640 1 --2- 172.21.15.5:0/3218639078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f48105220 0x7f2f480063a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f500694d0 tx=0x7f2f50069610 comp rx=0 tx=0).stop 2024-04-25T08:56:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7fc9c5e99640 1 -- 172.21.15.5:0/2815297222 >> v1:172.21.15.80:6789/0 conn(0x7fc9c00ce6e0 legacy=0x7fc9c00b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7fc9c5e99640 1 -- 172.21.15.5:0/2815297222 >> v1:172.21.15.5:6789/0 conn(0x7fc9c0161210 legacy=0x7fc9c00d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.076+0000 7fc9c5e99640 1 -- 172.21.15.5:0/2815297222 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00d29a0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f190b193640 1 -- 172.21.15.5:0/2024640986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc00aac0 msgr2=0x7f18fc0df0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f190b193640 1 --2- 172.21.15.5:0/2024640986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc00aac0 0x7f18fc0df0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009870 tx=0x7f18f402a2a0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f2f4f59e640 1 -- 172.21.15.5:0/3218639078 shutdown_connections 2024-04-25T08:56:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f2f4f59e640 1 --2- 172.21.15.5:0/3218639078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f48105220 0x7f2f480063a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f2f4f59e640 1 --2- 172.21.15.5:0/3218639078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f48104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f2f4f59e640 1 -- 172.21.15.5:0/3218639078 >> 172.21.15.5:0/3218639078 conn(0x7f2f48009f70 msgr2=0x7f2f4800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f190b193640 1 -- 172.21.15.5:0/2024640986 shutdown_connections 2024-04-25T08:56:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f190b193640 1 --2- 172.21.15.5:0/2024640986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc00aac0 0x7f18fc0df0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f190b193640 1 -- 172.21.15.5:0/2024640986 >> 172.21.15.5:0/2024640986 conn(0x7f18fc009fa0 msgr2=0x7f18fc00a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f3beffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0067410 0x7f3bf015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f190b193640 1 -- 172.21.15.5:0/2024640986 shutdown_connections 2024-04-25T08:56:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f3beffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf00b3600 0x7f3bf0070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f3beffff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf015e160 0x7f3bf0137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f3beffff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b3a90 con 0x7f3bf00b3600 2024-04-25T08:56:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f3beffff640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b0b00 con 0x7f3bf0067410 2024-04-25T08:56:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f3beffff640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b3c10 con 0x7f3bf015e160 2024-04-25T08:56:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f190b193640 1 -- 172.21.15.5:0/2024640986 wait complete. 2024-04-25T08:56:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.077+0000 7f2f4f59e640 1 -- 172.21.15.5:0/3218639078 shutdown_connections 2024-04-25T08:56:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bee7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf00b3600 0x7f3bf0070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7fb4033e0640 1 Processor -- start 2024-04-25T08:56:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3beeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0067410 0x7f3bf015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f66aebfb640 1 Processor -- start 2024-04-25T08:56:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bee7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf00b3600 0x7f3bf0070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35980/0 (socket says 172.21.15.5:35980) 2024-04-25T08:56:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bee7fc640 1 -- 172.21.15.5:0/123441793 learned_addr learned my addr 172.21.15.5:0/123441793 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bef7fe640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf015e160 0x7f3bf0137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7fb4033e0640 1 -- start start 2024-04-25T08:56:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f2f4f59e640 1 -- 172.21.15.5:0/3218639078 wait complete. 2024-04-25T08:56:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bef7fe640 1 -- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0067410 msgr2=0x7f3bf015bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bef7fe640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0067410 0x7f3bf015bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bef7fe640 1 -- 172.21.15.5:0/123441793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf00b3600 msgr2=0x7f3bf0070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bef7fe640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf00b3600 0x7f3bf0070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f3bef7fe640 1 -- 172.21.15.5:0/123441793 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf015b1e0 con 0x7f3bf015e160 2024-04-25T08:56:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f4db8b06640 1 -- 172.21.15.5:0/698550151 shutdown_connections 2024-04-25T08:56:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f4db8b06640 1 --2- 172.21.15.5:0/698550151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 0x7f4db406c100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f4db8b06640 1 -- 172.21.15.5:0/698550151 >> 172.21.15.5:0/698550151 conn(0x7f4db40b12d0 msgr2=0x7f4db40b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f5c0f86b640 1 Processor -- start 2024-04-25T08:56:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f66aebfb640 1 -- start start 2024-04-25T08:56:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.078+0000 7f5c0f86b640 1 -- start start 2024-04-25T08:56:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fc9c5e99640 1 --2- 172.21.15.5:0/2815297222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c00b71c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009d90 tx=0x7fc9b802a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa38fd847e37e89a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f3bef7fe640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf015e160 0x7f3bf0137f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3be400c3c0 tx=0x7f3be400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f190b193640 1 Processor -- start 2024-04-25T08:56:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f4db8b06640 1 -- 172.21.15.5:0/698550151 shutdown_connections 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f4db8b06640 1 -- 172.21.15.5:0/698550151 wait complete. 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f190b193640 1 -- start start 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f66aebfb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a0047ca0 0x7f66a004e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f66aebfb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a0052f80 0x7f66a004bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f66aebfb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a00e7560 0x7f66a004c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f66aebfb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00e7ac0 con 0x7f66a0052f80 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f66aebfb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00e7940 con 0x7f66a0047ca0 2024-04-25T08:56:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f66aebfb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a004f080 con 0x7f66a00e7560 2024-04-25T08:56:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fb4033e0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3e8004d40 0x7fb3fc169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fb4033e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc0a9e40 0x7fb3fc16bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fb4033e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3fc16c230 0x7fb3fc208e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fb4033e0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc071770 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fb4033e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc071490 con 0x7fb3fc16c230 2024-04-25T08:56:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fb4033e0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0707b0 con 0x7fb3e8004d40 2024-04-25T08:56:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f2f4f59e640 1 Processor -- start 2024-04-25T08:56:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0f86b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf40051c0 0x7f5c0814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0f86b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c081e4570 0x7f5c0815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fc9b7fff640 1 -- 172.21.15.5:0/2815297222 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8007740 con 0x7fc9c00ceb40 2024-04-25T08:56:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7fc9b7fff640 1 -- 172.21.15.5:0/2815297222 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b80078e0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fb40097b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc0a9e40 0x7fb3fc16bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0f86b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080cd8e0 0x7f5c080cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fb40097b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc0a9e40 0x7fb3fc16bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35990/0 (socket says 172.21.15.5:35990) 2024-04-25T08:56:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0f86b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0806c880 con 0x7f5c080cd8e0 2024-04-25T08:56:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fb40097b640 1 -- 172.21.15.5:0/1808880281 learned_addr learned my addr 172.21.15.5:0/1808880281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0f86b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0806d4d0 con 0x7f5c081e4570 2024-04-25T08:56:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0f86b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080cba40 con 0x7f5bf40051c0 2024-04-25T08:56:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f3bd77fe640 1 -- 172.21.15.5:0/123441793 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40052d0 con 0x7f3bf015e160 2024-04-25T08:56:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf015a420 con 0x7f3bf015e160 2024-04-25T08:56:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.079+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf015a9e0 con 0x7f3bf015e160 2024-04-25T08:56:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190b193640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18fc00aac0 0x7f18fc049430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190b193640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc050170 0x7f18fc0d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fc9c669a640 1 -- 172.21.15.5:0/2815297222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 msgr2=0x7fc9c00b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190b193640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18fc053090 0x7f18fc04a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190b193640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc007260 con 0x7f18fc050170 2024-04-25T08:56:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190b193640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0070e0 con 0x7f18fc00aac0 2024-04-25T08:56:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190b193640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0e00f0 con 0x7f18fc053090 2024-04-25T08:56:50.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0de08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080cd8e0 0x7f5c080cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2815297222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c00b71c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009d90 tx=0x7fc9b802a610 comp rx=0 tx=0).stop 2024-04-25T08:56:50.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0de08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080cd8e0 0x7f5c080cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36002/0 (socket says 172.21.15.5:36002) 2024-04-25T08:56:50.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f5c0de08640 1 -- 172.21.15.5:0/3311110142 learned_addr learned my addr 172.21.15.5:0/3311110142 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190a191640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18fc00aac0 0x7f18fc049430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fc9c669a640 1 -- 172.21.15.5:0/2815297222 shutdown_connections 2024-04-25T08:56:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2815297222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c00b71c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f2f4f59e640 1 -- start start 2024-04-25T08:56:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7fc9c669a640 1 -- 172.21.15.5:0/2815297222 >> 172.21.15.5:0/2815297222 conn(0x7fc9c00668f0 msgr2=0x7fc9c0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190a992640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18fc053090 0x7f18fc04a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f3bd77fe640 1 -- 172.21.15.5:0/123441793 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be4005470 con 0x7f3bf015e160 2024-04-25T08:56:50.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f3bd77fe640 1 -- 172.21.15.5:0/123441793 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4007260 con 0x7f3bf015e160 2024-04-25T08:56:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190a191640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18fc00aac0 0x7f18fc049430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44358/0 (socket says 172.21.15.5:44358) 2024-04-25T08:56:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.080+0000 7f190a191640 1 -- 172.21.15.5:0/572438625 learned_addr learned my addr 172.21.15.5:0/572438625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f3bd57fa640 1 -- 172.21.15.5:0/123441793 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd0005290 con 0x7f3bf015e160 2024-04-25T08:56:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7fc9c669a640 1 -- 172.21.15.5:0/2815297222 shutdown_connections 2024-04-25T08:56:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7fc9c669a640 1 -- 172.21.15.5:0/2815297222 wait complete. 2024-04-25T08:56:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f190a191640 1 -- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18fc053090 msgr2=0x7f18fc04a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f190a191640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18fc053090 0x7f18fc04a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f2f4f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f480068e0 0x7f2f4804bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f190a191640 1 -- 172.21.15.5:0/572438625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc050170 msgr2=0x7f18fc0d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f66ad3f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a0052f80 0x7f66a004bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f190a191640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc050170 0x7f18fc0d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f190a191640 1 -- 172.21.15.5:0/572438625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc04a140 con 0x7f18fc00aac0 2024-04-25T08:56:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f66ad3f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a0052f80 0x7f66a004bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36022/0 (socket says 172.21.15.5:36022) 2024-04-25T08:56:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f66ad3f8640 1 -- 172.21.15.5:0/94672749 learned_addr learned my addr 172.21.15.5:0/94672749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f2f4e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f480068e0 0x7f2f4804bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f2f4e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f480068e0 0x7f2f4804bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36034/0 (socket says 172.21.15.5:36034) 2024-04-25T08:56:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f2f4e59c640 1 -- 172.21.15.5:0/488842123 learned_addr learned my addr 172.21.15.5:0/488842123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f66ad3f8640 1 -- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a00e7560 msgr2=0x7f66a004c810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T08:56:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f66ad3f8640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a00e7560 0x7f66a004c810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f66ad3f8640 1 -- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a0047ca0 msgr2=0x7f66a004e5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:50.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f2f4f59e640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f4804a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f66ad3f8640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a0047ca0 0x7f66a004e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f66ad3f8640 1 -- 172.21.15.5:0/94672749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00cc7c0 con 0x7f66a0052f80 2024-04-25T08:56:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f2f4f59e640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48105220 0x7f2f480ff340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f4db8b06640 1 Processor -- start 2024-04-25T08:56:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f190a191640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18fc00aac0 0x7f18fc049430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009870 tx=0x7f18f40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f4db8b06640 1 -- start start 2024-04-25T08:56:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f2f4dd9b640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f4804a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0d607640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf40051c0 0x7f5c0814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0ce06640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c081e4570 0x7f5c0815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0d607640 1 -- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c081e4570 msgr2=0x7f5c0815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0d607640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c081e4570 0x7f5c0815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0d607640 1 -- 172.21.15.5:0/3311110142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080cd8e0 msgr2=0x7f5c080cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0d607640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080cd8e0 0x7f5c080cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0d607640 1 -- 172.21.15.5:0/3311110142 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c080ce210 con 0x7f5bf40051c0 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7f5c0d607640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf40051c0 0x7f5c0814f2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400f860 tx=0x7f5c0400fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f66ad3f8640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a0052f80 0x7f66a004bb90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f669800c400 tx=0x7f669800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f2f4ed9d640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48105220 0x7f2f480ff340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f2f4f59e640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48105640 con 0x7f2f480068e0 2024-04-25T08:56:50.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f2f4f59e640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48101140 con 0x7f2f48105220 2024-04-25T08:56:50.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f2f4f59e640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f481057c0 con 0x7f2f48104900 2024-04-25T08:56:50.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f18faffd640 1 -- 172.21.15.5:0/572438625 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4041070 con 0x7f18fc00aac0 2024-04-25T08:56:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f669e7fc640 1 -- 172.21.15.5:0/94672749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698011790 con 0x7f66a0052f80 2024-04-25T08:56:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7fb40097b640 1 -- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3e8004d40 msgr2=0x7fb3fc169cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7fb40097b640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3e8004d40 0x7fb3fc169cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7fb40097b640 1 -- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3fc16c230 msgr2=0x7fb3fc208e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7fb40097b640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3fc16c230 0x7fb3fc208e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.081+0000 7fb40097b640 1 -- 172.21.15.5:0/1808880281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc208990 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f66aebfb640 1 -- 172.21.15.5:0/94672749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00cc200 con 0x7f66a0052f80 2024-04-25T08:56:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc049b80 con 0x7f18fc00aac0 2024-04-25T08:56:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc04cce0 con 0x7f18fc00aac0 2024-04-25T08:56:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f66aebfb640 1 -- 172.21.15.5:0/94672749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a0038fd0 con 0x7f66a0052f80 2024-04-25T08:56:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f669e7fc640 1 -- 172.21.15.5:0/94672749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698017070 con 0x7f66a0052f80 2024-04-25T08:56:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.082+0000 7f669e7fc640 1 -- 172.21.15.5:0/94672749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698011b90 con 0x7f66a0052f80 2024-04-25T08:56:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.083+0000 7f18faffd640 1 -- 172.21.15.5:0/572438625 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f403c870 con 0x7f18fc00aac0 2024-04-25T08:56:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.083+0000 7fb40097b640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc0a9e40 0x7fb3fc16bcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00d5f0 tx=0x7fb3ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.083+0000 7fc9c669a640 1 Processor -- start 2024-04-25T08:56:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.083+0000 7fc9c669a640 1 -- start start 2024-04-25T08:56:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.083+0000 7f4db8b06640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db4070710 0x7f4db414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f18faffd640 1 -- 172.21.15.5:0/572438625 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4037040 con 0x7f18fc00aac0 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4db8b06640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4db40ae7b0 0x7f4db414b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4db8b06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 0x7f4db4158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4db8b06640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4159fb0 con 0x7f4db4070710 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4db8b06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db406ea10 con 0x7f4db4159bd0 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4db8b06640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db40b44f0 con 0x7f4db40ae7b0 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4dabfff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4db40ae7b0 0x7f4db414b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4dabfff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4db40ae7b0 0x7f4db414b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:36032/0 (socket says 172.21.15.5:36032) 2024-04-25T08:56:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4dabfff640 1 -- 172.21.15.5:0/3174598184 learned_addr learned my addr 172.21.15.5:0/3174598184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f4db37fe640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db4070710 0x7f4db414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f4db37fe640 1 -- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4db40ae7b0 msgr2=0x7f4db414b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f4db37fe640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4db40ae7b0 0x7f4db414b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f4db37fe640 1 -- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 msgr2=0x7f4db4158610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f4db37fe640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 0x7f4db4158610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f4db37fe640 1 -- 172.21.15.5:0/3174598184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db413cec0 con 0x7f4db4070710 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f3bd77fe640 1 -- 172.21.15.5:0/123441793 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3be4007400 con 0x7f3bf015e160 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f669e7fc640 1 -- 172.21.15.5:0/94672749 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f669801c460 con 0x7f66a0052f80 2024-04-25T08:56:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f66aebfb640 1 -- 172.21.15.5:0/94672749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6690005290 con 0x7f66a0052f80 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fb3f1ffb640 1 -- 172.21.15.5:0/1808880281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0069d0 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fb3f1ffb640 1 -- 172.21.15.5:0/1808880281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec006b70 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fb4033e0640 1 -- 172.21.15.5:0/1808880281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc0aa2c0 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fb4033e0640 1 -- 172.21.15.5:0/1808880281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc20c6b0 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fb3f1ffb640 1 -- 172.21.15.5:0/1808880281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec007030 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f2f4e59c640 1 -- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 msgr2=0x7f2f4804a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f2f4e59c640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f4804a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f2f4e59c640 1 -- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48105220 msgr2=0x7f2f480ff340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f2f4e59c640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48105220 0x7f2f480ff340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f2f4e59c640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4804c250 con 0x7f2f480068e0 2024-04-25T08:56:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fc9c669a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9c00ce6e0 0x7fc9c00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fc9c669a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c01f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fc9c669a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9c0161210 0x7fc9c00b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7fc9c669a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00cef90 con 0x7fc9c0161210 2024-04-25T08:56:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7fc9c669a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00d2f60 con 0x7fc9c00ceb40 2024-04-25T08:56:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7fc9c669a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00d3480 con 0x7fc9c00ce6e0 2024-04-25T08:56:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f4db37fe640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db4070710 0x7f4db414e030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4db4072ac0 tx=0x7f4da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.084+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec005290 con 0x7f18fc00aac0 2024-04-25T08:56:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f3bd77fe640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3bdc06b4d0 0x7f3bdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f2f4e59c640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f480068e0 0x7f2f4804bb50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400ba60 tx=0x7f2f4400e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f669e7fc640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f668c06b4d0 0x7f668c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7fc9c5e99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9c0161210 0x7fc9c00b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f3beeffd640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3bdc06b4d0 0x7f3bdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7f669e7fc640 1 -- 172.21.15.5:0/94672749 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f669808a080 con 0x7f66a0052f80 2024-04-25T08:56:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7f3bd77fe640 1 -- 172.21.15.5:0/123441793 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3be4089d20 con 0x7f3bf015e160 2024-04-25T08:56:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c5e99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9c0161210 0x7fc9c00b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36052/0 (socket says 172.21.15.5:36052) 2024-04-25T08:56:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c01f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c5698640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9c00ce6e0 0x7fc9c00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c01f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:44384/0 (socket says 172.21.15.5:44384) 2024-04-25T08:56:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 -- 172.21.15.5:0/2084047109 learned_addr learned my addr 172.21.15.5:0/2084047109 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7f66adbf9640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f668c06b4d0 0x7f668c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7f3beeffd640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3bdc06b4d0 0x7f3bdc06d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3be0034000 tx=0x7f3be002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 -- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9c00ce6e0 msgr2=0x7fc9c00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9c00ce6e0 0x7fc9c00b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 -- 172.21.15.5:0/2084047109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9c0161210 msgr2=0x7fc9c00b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.085+0000 7f18faffd640 1 -- 172.21.15.5:0/572438625 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f18f4044070 con 0x7f18fc00aac0 2024-04-25T08:56:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7f18faffd640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18e806b5a0 0x7f18e806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fb4033e0640 1 -- 172.21.15.5:0/1808880281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc005290 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9c0161210 0x7fc9c00b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 -- 172.21.15.5:0/2084047109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c01511b0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7f18faffd640 1 -- 172.21.15.5:0/572438625 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18f40ab250 con 0x7f18fc00aac0 2024-04-25T08:56:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c5e99640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9c0161210 0x7fc9c00b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7fc9c4e97640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c01f2ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c390 tx=0x7fc9b000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.086+0000 7f1909990640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18e806b5a0 0x7f18e806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f66adbf9640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f668c06b4d0 0x7f668c06d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66a802d370 tx=0x7f66a806d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f5bfdffb640 1 -- 172.21.15.5:0/3311110142 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400dbb0 con 0x7f5bf40051c0 2024-04-25T08:56:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c080ce4f0 con 0x7f5bf40051c0 2024-04-25T08:56:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f1909990640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18e806b5a0 0x7f18e806da60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0dd8e0 tx=0x7f1904069610 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f3bd77fe640 1 -- 172.21.15.5:0/123441793 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3be40585c0 con 0x7f3bf015e160 2024-04-25T08:56:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7fb3f1ffb640 1 -- 172.21.15.5:0/1808880281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3ec0071d0 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c080cbc90 con 0x7f5bf40051c0 2024-04-25T08:56:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f5bfdffb640 1 -- 172.21.15.5:0/3311110142 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0400dd50 con 0x7f5bf40051c0 2024-04-25T08:56:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.087+0000 7f5bfdffb640 1 -- 172.21.15.5:0/3311110142 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04013680 con 0x7f5bf40051c0 2024-04-25T08:56:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.088+0000 7fb3f1ffb640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3e006b5d0 0x7fb3e006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.088+0000 7fb3f1ffb640 1 -- 172.21.15.5:0/1808880281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3ec08a130 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.088+0000 7fb40117c640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3e006b5d0 0x7fb3e006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.088+0000 7fb40117c640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3e006b5d0 0x7fb3e006da90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400aca0 tx=0x7fb3f400c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.089+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be8005290 con 0x7f5bf40051c0 2024-04-25T08:56:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.089+0000 7f5bfdffb640 1 -- 172.21.15.5:0/3311110142 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c04013820 con 0x7f5bf40051c0 2024-04-25T08:56:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.089+0000 7f5bfdffb640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bec06b4d0 0x7f5bec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.089+0000 7f5bfdffb640 1 -- 172.21.15.5:0/3311110142 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c0408a970 con 0x7f5bf40051c0 2024-04-25T08:56:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.089+0000 7f5c0ce06640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bec06b4d0 0x7f5bec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.090+0000 7f5c0ce06640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bec06b4d0 0x7f5bec06d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c08071ad0 tx=0x7f5c00007d90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.090+0000 7fc9b5ffb640 1 -- 172.21.15.5:0/2084047109 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0017070 con 0x7fc9c00ceb40 2024-04-25T08:56:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.090+0000 7fc9b5ffb640 1 -- 172.21.15.5:0/2084047109 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0005ce0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.091+0000 7fc9b5ffb640 1 -- 172.21.15.5:0/2084047109 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00072d0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.091+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c00cc940 con 0x7fc9c00ceb40 2024-04-25T08:56:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.091+0000 7f18faffd640 1 -- 172.21.15.5:0/572438625 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18f407a140 con 0x7f18fc00aac0 2024-04-25T08:56:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.091+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c00ccf00 con 0x7fc9c00ceb40 2024-04-25T08:56:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.091+0000 7f4db0ff9640 1 -- 172.21.15.5:0/3174598184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4043070 con 0x7f4db4070710 2024-04-25T08:56:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.091+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db413cbe0 con 0x7f4db4070710 2024-04-25T08:56:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.092+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db414d830 con 0x7f4db4070710 2024-04-25T08:56:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.092+0000 7f669e7fc640 1 -- 172.21.15.5:0/94672749 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6698058e60 con 0x7f66a0052f80 2024-04-25T08:56:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.092+0000 7fc9b5ffb640 1 -- 172.21.15.5:0/2084047109 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc9b001a070 con 0x7fc9c00ceb40 2024-04-25T08:56:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.093+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c0074f70 con 0x7fc9c00ceb40 2024-04-25T08:56:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.093+0000 7fc9b5ffb640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc9a406b500 0x7fc9a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.093+0000 7fc9b5ffb640 1 -- 172.21.15.5:0/2084047109 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9b0089480 con 0x7fc9c00ceb40 2024-04-25T08:56:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.093+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db414d340 con 0x7f4db4070710 2024-04-25T08:56:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.093+0000 7fc9c5698640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc9a406b500 0x7fc9a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.094+0000 7f5bfdffb640 1 -- 172.21.15.5:0/3311110142 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c04017030 con 0x7f5bf40051c0 2024-04-25T08:56:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.094+0000 7fc9c5698640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc9a406b500 0x7fc9a406d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc000f60 tx=0x7fc9bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.098+0000 7fc9b5ffb640 1 -- 172.21.15.5:0/2084047109 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc9b0057cb0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.099+0000 7f4db0ff9640 1 -- 172.21.15.5:0/3174598184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4032480 con 0x7f4db4070710 2024-04-25T08:56:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.099+0000 7f4db0ff9640 1 -- 172.21.15.5:0/3174598184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da404d060 con 0x7f4db4070710 2024-04-25T08:56:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.099+0000 7f2f3effd640 1 -- 172.21.15.5:0/488842123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400eda0 con 0x7f2f480068e0 2024-04-25T08:56:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.099+0000 7f2f3effd640 1 -- 172.21.15.5:0/488842123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f44009050 con 0x7f2f480068e0 2024-04-25T08:56:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.099+0000 7fb3f1ffb640 1 -- 172.21.15.5:0/1808880281 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3fc208990 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.101+0000 7f4db0ff9640 1 -- 172.21.15.5:0/3174598184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4da4046070 con 0x7f4db4070710 2024-04-25T08:56:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.100+0000 7f2f4f59e640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4804c530 con 0x7f2f480068e0 2024-04-25T08:56:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.100+0000 7f2f4f59e640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4804caf0 con 0x7f2f480068e0 2024-04-25T08:56:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.100+0000 7f2f3effd640 1 -- 172.21.15.5:0/488842123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44008450 con 0x7f2f480068e0 2024-04-25T08:56:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.102+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f48005280 con 0x7f2f480068e0 2024-04-25T08:56:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.102+0000 7f4db0ff9640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d9406b4d0 0x7f4d9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.103+0000 7f4db0ff9640 1 -- 172.21.15.5:0/3174598184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4da40aa0c0 con 0x7f4db4070710 2024-04-25T08:56:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.103+0000 7f4dabfff640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d9406b4d0 0x7f4d9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.104+0000 7f4dabfff640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d9406b4d0 0x7f4d9406d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4db41f3070 tx=0x7f4d9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.106+0000 7f4db0ff9640 1 -- 172.21.15.5:0/3174598184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4da4078ab0 con 0x7f4db4070710 2024-04-25T08:56:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.108+0000 7f2f3effd640 1 -- 172.21.15.5:0/488842123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f440085f0 con 0x7f2f480068e0 2024-04-25T08:56:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.109+0000 7f2f3effd640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f3006b5a0 0x7f2f3006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.109+0000 7f2f3effd640 1 -- 172.21.15.5:0/488842123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f4408b440 con 0x7f2f480068e0 2024-04-25T08:56:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.116+0000 7f2f4dd9b640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f3006b5a0 0x7f2f3006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.116+0000 7f2f3effd640 1 -- 172.21.15.5:0/488842123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f4405a210 con 0x7f2f480068e0 2024-04-25T08:56:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.118+0000 7f2f4dd9b640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f3006b5a0 0x7f2f3006da60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f48006090 tx=0x7f2f50096000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.503+0000 7f3bd57fa640 1 -- 172.21.15.5:0/123441793 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3bd0005850 con 0x7f3bf015e160 2024-04-25T08:56:50.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.504+0000 7f3bd77fe640 1 -- 172.21.15.5:0/123441793 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3be405c660 con 0x7f3bf015e160 2024-04-25T08:56:50.493 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-04-25T08:56:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.507+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3bdc06b4d0 msgr2=0x7f3bdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.507+0000 7f3beffff640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3bdc06b4d0 0x7f3bdc06d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3be0034000 tx=0x7f3be002e000 comp rx=0 tx=0).stop 2024-04-25T08:56:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.507+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf015e160 msgr2=0x7f3bf0137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.507+0000 7f3beffff640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf015e160 0x7f3bf0137f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3be400c3c0 tx=0x7f3be400c880 comp rx=0 tx=0).stop 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.507+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 shutdown_connections 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.507+0000 7f3beffff640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3bdc06b4d0 0x7f3bdc06d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.507+0000 7f3beffff640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bf015e160 0x7f3bf0137f30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.508+0000 7f3beffff640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bf00b3600 0x7f3bf0070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.508+0000 7f3beffff640 1 --2- 172.21.15.5:0/123441793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0067410 0x7f3bf015bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.508+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 >> 172.21.15.5:0/123441793 conn(0x7f3bf00668f0 msgr2=0x7f3bf0071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.508+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 shutdown_connections 2024-04-25T08:56:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.508+0000 7f3beffff640 1 -- 172.21.15.5:0/123441793 wait complete. 2024-04-25T08:56:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.511+0000 7f66aebfb640 1 -- 172.21.15.5:0/94672749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6690005580 con 0x7f66a0052f80 2024-04-25T08:56:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.512+0000 7f669e7fc640 1 -- 172.21.15.5:0/94672749 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6698058760 con 0x7f66a0052f80 2024-04-25T08:56:50.502 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-04-25T08:56:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.515+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18ec005580 con 0x7f18fc00aac0 2024-04-25T08:56:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.516+0000 7f668bfff640 1 -- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f668c06b4d0 msgr2=0x7f668c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.516+0000 7f668bfff640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f668c06b4d0 0x7f668c06d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66a802d370 tx=0x7f66a806d040 comp rx=0 tx=0).stop 2024-04-25T08:56:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.516+0000 7f18faffd640 1 -- 172.21.15.5:0/572438625 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18f4079a40 con 0x7f18fc00aac0 2024-04-25T08:56:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.516+0000 7f668bfff640 1 -- 172.21.15.5:0/94672749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a0052f80 msgr2=0x7f66a004bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.516+0000 7f668bfff640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a0052f80 0x7f66a004bb90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f669800c400 tx=0x7f669800c8c0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.507 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-04-25T08:56:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.516+0000 7f668bfff640 1 -- 172.21.15.5:0/94672749 shutdown_connections 2024-04-25T08:56:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.516+0000 7f668bfff640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f668c06b4d0 0x7f668c06d990 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66a802d370 tx=0x7f66a806d040 comp rx=0 tx=0).stop 2024-04-25T08:56:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.517+0000 7f668bfff640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66a00e7560 0x7f66a004c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.517+0000 7f668bfff640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a0052f80 0x7f66a004bb90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.517+0000 7f668bfff640 1 --2- 172.21.15.5:0/94672749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a0047ca0 0x7f66a004e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.517+0000 7f668bfff640 1 -- 172.21.15.5:0/94672749 >> 172.21.15.5:0/94672749 conn(0x7f66a0009fb0 msgr2=0x7f66a00e5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.520+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18e806b5a0 msgr2=0x7f18e806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.520+0000 7f668bfff640 1 -- 172.21.15.5:0/94672749 shutdown_connections 2024-04-25T08:56:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.520+0000 7f190b193640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18e806b5a0 0x7f18e806da60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0dd8e0 tx=0x7f1904069610 comp rx=0 tx=0).stop 2024-04-25T08:56:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.520+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18fc00aac0 msgr2=0x7f18fc049430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.520+0000 7f190b193640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18fc00aac0 0x7f18fc049430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009870 tx=0x7f18f40046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.520+0000 7f668bfff640 1 -- 172.21.15.5:0/94672749 wait complete. 2024-04-25T08:56:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 shutdown_connections 2024-04-25T08:56:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18e806b5a0 0x7f18e806da60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18fc053090 0x7f18fc04a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18fc050170 0x7f18fc0d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 --2- 172.21.15.5:0/572438625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18fc00aac0 0x7f18fc049430 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 >> 172.21.15.5:0/572438625 conn(0x7f18fc009fa0 msgr2=0x7f18fc005fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 shutdown_connections 2024-04-25T08:56:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.521+0000 7f190b193640 1 -- 172.21.15.5:0/572438625 wait complete. 2024-04-25T08:56:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.522+0000 7fb4033e0640 1 -- 172.21.15.5:0/1808880281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb3dc005580 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.523+0000 7fb3f1ffb640 1 -- 172.21.15.5:0/1808880281 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3ec016020 con 0x7fb3fc0a9e40 2024-04-25T08:56:50.513 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-04-25T08:56:50.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 -- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3e006b5d0 msgr2=0x7fb3e006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3e006b5d0 0x7fb3e006da90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400aca0 tx=0x7fb3f400c040 comp rx=0 tx=0).stop 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 -- 172.21.15.5:0/1808880281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc0a9e40 msgr2=0x7fb3fc16bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc0a9e40 0x7fb3fc16bcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00d5f0 tx=0x7fb3ec00dab0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 -- 172.21.15.5:0/1808880281 shutdown_connections 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3e006b5d0 0x7fb3e006da90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3fc16c230 0x7fb3fc208e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.526+0000 7fb3e77fe640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc0a9e40 0x7fb3fc16bcf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.527+0000 7fb3e77fe640 1 --2- 172.21.15.5:0/1808880281 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3e8004d40 0x7fb3fc169cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.527+0000 7fb3e77fe640 1 -- 172.21.15.5:0/1808880281 >> 172.21.15.5:0/1808880281 conn(0x7fb3fc0741c0 msgr2=0x7fb3fc0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.527+0000 7fb3e77fe640 1 -- 172.21.15.5:0/1808880281 shutdown_connections 2024-04-25T08:56:50.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.527+0000 7fb3e77fe640 1 -- 172.21.15.5:0/1808880281 wait complete. 2024-04-25T08:56:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.527+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc9c00b8ba0 con 0x7fc9c00ceb40 2024-04-25T08:56:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.528+0000 7fc9b5ffb640 1 -- 172.21.15.5:0/2084047109 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9b005bd50 con 0x7fc9c00ceb40 2024-04-25T08:56:50.518 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-04-25T08:56:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.531+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2f48052730 con 0x7f2f480068e0 2024-04-25T08:56:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.531+0000 7f2f3effd640 1 -- 172.21.15.5:0/488842123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f44059b10 con 0x7f2f480068e0 2024-04-25T08:56:50.521 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc9a406b500 msgr2=0x7fc9a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc9a406b500 0x7fc9a406d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc000f60 tx=0x7fc9bc009040 comp rx=0 tx=0).stop 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 msgr2=0x7fc9c01f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c01f2ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c390 tx=0x7fc9b000c850 comp rx=0 tx=0).stop 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 shutdown_connections 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc9a406b500 0x7fc9a406d9c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9c0161210 0x7fc9c00b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9c00ceb40 0x7fc9c01f2ca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 --2- 172.21.15.5:0/2084047109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9c00ce6e0 0x7fc9c00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 >> 172.21.15.5:0/2084047109 conn(0x7fc9c00668f0 msgr2=0x7fc9c00b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 shutdown_connections 2024-04-25T08:56:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7fc9c669a640 1 -- 172.21.15.5:0/2084047109 wait complete. 2024-04-25T08:56:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.532+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4db414d340 con 0x7f4db4070710 2024-04-25T08:56:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.533+0000 7f4db0ff9640 1 -- 172.21.15.5:0/3174598184 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4da407cb50 con 0x7f4db4070710 2024-04-25T08:56:50.524 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.534+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5be8005580 con 0x7f5bf40051c0 2024-04-25T08:56:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f5bfdffb640 1 -- 172.21.15.5:0/3311110142 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c040597e0 con 0x7f5bf40051c0 2024-04-25T08:56:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f3006b5a0 msgr2=0x7f2f3006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f3006b5a0 0x7f2f3006da60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f48006090 tx=0x7f2f50096000 comp rx=0 tx=0).stop 2024-04-25T08:56:50.525 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-04-25T08:56:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f480068e0 msgr2=0x7f2f4804bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f480068e0 0x7f2f4804bb50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400ba60 tx=0x7f2f4400e490 comp rx=0 tx=0).stop 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 shutdown_connections 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f3006b5a0 0x7f2f3006da60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48105220 0x7f2f480ff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f48104900 0x7f2f4804a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 --2- 172.21.15.5:0/488842123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f480068e0 0x7f2f4804bb50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 >> 172.21.15.5:0/488842123 conn(0x7f2f48009f70 msgr2=0x7f2f4804f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 shutdown_connections 2024-04-25T08:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.535+0000 7f2f3cff9640 1 -- 172.21.15.5:0/488842123 wait complete. 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d9406b4d0 msgr2=0x7f4d9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d9406b4d0 0x7f4d9406d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4db41f3070 tx=0x7f4d9c009040 comp rx=0 tx=0).stop 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db4070710 msgr2=0x7f4db414e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db4070710 0x7f4db414e030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4db4072ac0 tx=0x7f4da40046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 shutdown_connections 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d9406b4d0 0x7f4d9406d990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db4159bd0 0x7f4db4158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4db40ae7b0 0x7f4db414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 --2- 172.21.15.5:0/3174598184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db4070710 0x7f4db414e030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 >> 172.21.15.5:0/3174598184 conn(0x7f4db40b12d0 msgr2=0x7f4db4154030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 shutdown_connections 2024-04-25T08:56:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.537+0000 7f4db8b06640 1 -- 172.21.15.5:0/3174598184 wait complete. 2024-04-25T08:56:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bec06b4d0 msgr2=0x7f5bec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bec06b4d0 0x7f5bec06d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c08071ad0 tx=0x7f5c00007d90 comp rx=0 tx=0).stop 2024-04-25T08:56:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf40051c0 msgr2=0x7f5c0814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf40051c0 0x7f5c0814f2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400f860 tx=0x7f5c0400fd20 comp rx=0 tx=0).stop 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 shutdown_connections 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bec06b4d0 0x7f5bec06d990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080cd8e0 0x7f5c080cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c081e4570 0x7f5c0815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 --2- 172.21.15.5:0/3311110142 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bf40051c0 0x7f5c0814f2e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.538+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 >> 172.21.15.5:0/3311110142 conn(0x7f5c08066f20 msgr2=0x7f5c080ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.539+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 shutdown_connections 2024-04-25T08:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:50.539+0000 7f5c0f86b640 1 -- 172.21.15.5:0/3311110142 wait complete. 2024-04-25T08:56:50.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-25T08:56:50.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-25T08:56:50.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-25T08:56:50.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-04-25T08:56:50.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-25T08:56:50.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-25T08:56:50.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-25T08:56:51.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T08:56:51.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T08:56:51.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T08:56:51.540 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T08:56:51.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T08:56:51.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T08:56:51.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T08:56:51.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T08:56:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.695+0000 7f1beda93640 1 Processor -- start 2024-04-25T08:56:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.695+0000 7f1beda93640 1 -- start start 2024-04-25T08:56:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.696+0000 7f1beda93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be003a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.696+0000 7f1beda93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be003aa60 con 0x7f1be0101030 2024-04-25T08:56:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.696+0000 7f1beda93640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be0007020 con 0x7f1be00065f0 2024-04-25T08:56:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.696+0000 7f1beda93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0007300 con 0x7f1be0100c50 2024-04-25T08:56:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.697+0000 7f1be7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1be0101030 0x7f1be0005ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38200/0 (socket says 172.21.15.5:38200) 2024-04-25T08:56:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.697+0000 7f1be7fff640 1 -- 172.21.15.5:0/457910576 learned_addr learned my addr 172.21.15.5:0/457910576 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.697+0000 7f1beca91640 1 --2- 172.21.15.5:0/457910576 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be003a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.698+0000 7f1be77fe640 1 -- 172.21.15.5:0/457910576 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661130555 0 0) 0x7f1be0007020 con 0x7f1be00065f0 2024-04-25T08:56:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.698+0000 7f1be77fe640 1 -- 172.21.15.5:0/457910576 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd8003520 con 0x7f1be00065f0 2024-04-25T08:56:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.698+0000 7f1be77fe640 1 -- 172.21.15.5:0/457910576 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984637174 0 0) 0x7f1be003aa60 con 0x7f1be0101030 2024-04-25T08:56:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.698+0000 7f1be77fe640 1 -- 172.21.15.5:0/457910576 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be0007020 con 0x7f1be0101030 2024-04-25T08:56:51.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.699+0000 7f1beca91640 1 -- 172.21.15.5:0/457910576 >> v1:172.21.15.80:6789/0 conn(0x7f1be00065f0 legacy=0x7f1be0053030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.699+0000 7f1beca91640 1 -- 172.21.15.5:0/457910576 >> v1:172.21.15.5:6789/0 conn(0x7f1be0101030 legacy=0x7f1be0005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.699+0000 7f1beca91640 1 -- 172.21.15.5:0/457910576 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00075e0 con 0x7f1be0100c50 2024-04-25T08:56:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.700+0000 7f1beca91640 1 --2- 172.21.15.5:0/457910576 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be003a3a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40087d0 tx=0x7f1bd402c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49062fd94671c2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.700+0000 7f1be77fe640 1 -- 172.21.15.5:0/457910576 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd403a070 con 0x7f1be0100c50 2024-04-25T08:56:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.701+0000 7f1be77fe640 1 -- 172.21.15.5:0/457910576 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd4032480 con 0x7f1be0100c50 2024-04-25T08:56:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.702+0000 7f1beda93640 1 -- 172.21.15.5:0/457910576 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 msgr2=0x7f1be003a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.702+0000 7f1beda93640 1 --2- 172.21.15.5:0/457910576 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be003a3a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40087d0 tx=0x7f1bd402c580 comp rx=0 tx=0).stop 2024-04-25T08:56:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.702+0000 7f1beda93640 1 -- 172.21.15.5:0/457910576 shutdown_connections 2024-04-25T08:56:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.702+0000 7f1beda93640 1 --2- 172.21.15.5:0/457910576 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be003a3a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.702+0000 7f1beda93640 1 -- 172.21.15.5:0/457910576 >> 172.21.15.5:0/457910576 conn(0x7f1be0009fb0 msgr2=0x7f1be000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.702+0000 7f1beda93640 1 -- 172.21.15.5:0/457910576 shutdown_connections 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.702+0000 7f1beda93640 1 -- 172.21.15.5:0/457910576 wait complete. 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.704+0000 7f1beda93640 1 Processor -- start 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.705+0000 7f1beda93640 1 -- start start 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.706+0000 7f1beda93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be00065f0 0x7f1be01bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.706+0000 7f1beda93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be002c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.706+0000 7f1beda93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1be0101030 0x7f1be002e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1beda93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0053740 con 0x7f1be00065f0 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1beda93640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0006cb0 con 0x7f1be0101030 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1beda93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00538c0 con 0x7f1be0100c50 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1be0101030 0x7f1be002e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1be0101030 0x7f1be002e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36580/0 (socket says 172.21.15.5:36580) 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 -- 172.21.15.5:0/3348760080 learned_addr learned my addr 172.21.15.5:0/3348760080 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 -- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 msgr2=0x7f1be002c630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:51.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be002c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 -- 172.21.15.5:0/3348760080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be00065f0 msgr2=0x7f1be01bb8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T08:56:51.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be00065f0 0x7f1be01bb8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.707+0000 7f1bed292640 1 -- 172.21.15.5:0/3348760080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be002cfa0 con 0x7f1be0101030 2024-04-25T08:56:51.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.708+0000 7f1bed292640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1be0101030 0x7f1be002e360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1be8069f50 tx=0x7f1be8068710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.708+0000 7f1be57fa640 1 -- 172.21.15.5:0/3348760080 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be807e070 con 0x7f1be0101030 2024-04-25T08:56:51.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.708+0000 7f1beda93640 1 -- 172.21.15.5:0/3348760080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be002d280 con 0x7f1be0101030 2024-04-25T08:56:51.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.708+0000 7f1beda93640 1 -- 172.21.15.5:0/3348760080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be002d840 con 0x7f1be0101030 2024-04-25T08:56:51.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.710+0000 7f1be57fa640 1 -- 172.21.15.5:0/3348760080 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be80823b0 con 0x7f1be0101030 2024-04-25T08:56:51.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.710+0000 7f1be57fa640 1 -- 172.21.15.5:0/3348760080 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8082840 con 0x7f1be0101030 2024-04-25T08:56:51.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.711+0000 7f1beda93640 1 -- 172.21.15.5:0/3348760080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be00052c0 con 0x7f1be0101030 2024-04-25T08:56:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.713+0000 7f1be57fa640 1 -- 172.21.15.5:0/3348760080 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1be8081070 con 0x7f1be0101030 2024-04-25T08:56:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.713+0000 7f1be57fa640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1bcc06b5a0 0x7f1bcc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.713+0000 7f1be57fa640 1 -- 172.21.15.5:0/3348760080 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1be80f3d10 con 0x7f1be0101030 2024-04-25T08:56:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.714+0000 7f1beca91640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1bcc06b5a0 0x7f1bcc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.714+0000 7f1beca91640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1bcc06b5a0 0x7f1bcc06da60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4037000 tx=0x7f1bd4030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.718+0000 7f1be57fa640 1 -- 172.21.15.5:0/3348760080 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1be80c2520 con 0x7f1be0101030 2024-04-25T08:56:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.748+0000 7f6c96353640 1 Processor -- start 2024-04-25T08:56:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.748+0000 7f6c96353640 1 -- start start 2024-04-25T08:56:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.749+0000 7f6c96353640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c9006e480 0x7f6c90153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.749+0000 7f6c96353640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90072290 0x7f6c900b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.749+0000 7f6c96353640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9006c760 con 0x7f6c90154460 2024-04-25T08:56:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.749+0000 7f6c96353640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c900715e0 con 0x7f6c9006e480 2024-04-25T08:56:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.749+0000 7f6c96353640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9006ca40 con 0x7f6c90072290 2024-04-25T08:56:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.749+0000 7f6c8f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6c90154460 0x7f6c90071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38206/0 (socket says 172.21.15.5:38206) 2024-04-25T08:56:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.750+0000 7f6c8f7fe640 1 -- 172.21.15.5:0/3258264882 learned_addr learned my addr 172.21.15.5:0/3258264882 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.750+0000 7f6c8ffff640 1 --2- 172.21.15.5:0/3258264882 >> v2:172.21.15.80:3300/0 conn(0x7f6c9006e480 0x7f6c90153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.750+0000 7f6c948f0640 1 --2- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90072290 0x7f6c900b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.750+0000 7f3b8d5f8640 1 Processor -- start 2024-04-25T08:56:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.750+0000 7f3b8d5f8640 1 -- start start 2024-04-25T08:56:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f6c8effd640 1 -- 172.21.15.5:0/3258264882 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419720611 0 0) 0x7f6c9006c760 con 0x7f6c90154460 2024-04-25T08:56:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f6c8effd640 1 -- 172.21.15.5:0/3258264882 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c78003520 con 0x7f6c90154460 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f3b8d5f8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b880d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f3b8d5f8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3b880d0a60 0x7f3b880ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f3b8d5f8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880ce9c0 con 0x7f3b880cdf00 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f3b8d5f8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b880d1fc0 con 0x7f3b880d0a60 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f3b8d5f8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880d1690 con 0x7f3b881655d0 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.750+0000 7f71e8276640 1 Processor -- start 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.750+0000 7f71e8276640 1 -- start start 2024-04-25T08:56:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f71e8276640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71d8100d80 0x7f71d8037c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f71e8276640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d8052ef0 con 0x7f71d8033950 2024-04-25T08:56:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f71e8276640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d80531d0 con 0x7f71d80543c0 2024-04-25T08:56:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f71e8276640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d8050390 con 0x7f71d8100d80 2024-04-25T08:56:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f6c8ffff640 1 -- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90072290 msgr2=0x7f6c900b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f6c8ffff640 1 --2- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90072290 0x7f6c900b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f6c8ffff640 1 -- 172.21.15.5:0/3258264882 >> v1:172.21.15.5:6789/0 conn(0x7f6c90154460 legacy=0x7f6c90071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f6c8ffff640 1 -- 172.21.15.5:0/3258264882 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9006cd20 con 0x7f6c9006e480 2024-04-25T08:56:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f71e6012640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71d8100d80 0x7f71d8037c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f71e6012640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71d8100d80 0x7f71d8037c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36610/0 (socket says 172.21.15.5:36610) 2024-04-25T08:56:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f71e6012640 1 -- 172.21.15.5:0/3348289573 learned_addr learned my addr 172.21.15.5:0/3348289573 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f71e6012640 1 -- 172.21.15.5:0/3348289573 >> v1:172.21.15.80:6789/0 conn(0x7f71d80543c0 legacy=0x7f71d804f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f5b3cd1c640 1 Processor -- start 2024-04-25T08:56:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.751+0000 7f5b3cd1c640 1 -- start start 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f71e6012640 1 -- 172.21.15.5:0/3348289573 >> v1:172.21.15.5:6789/0 conn(0x7f71d8033950 legacy=0x7f71d8053cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f71e6012640 1 -- 172.21.15.5:0/3348289573 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80534b0 con 0x7f71d8100d80 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f3b877fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3b880cdf00 0x7f3b880d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:51582/0 (socket says 172.21.15.5:51582) 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f3b877fe640 1 -- 172.21.15.5:0/2519937684 learned_addr learned my addr 172.21.15.5:0/2519937684 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f3b87fff640 1 --2- 172.21.15.5:0/2519937684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b880d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f3b8cdf7640 1 --2- 172.21.15.5:0/2519937684 >> v2:172.21.15.80:3300/0 conn(0x7f3b880d0a60 0x7f3b880ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.752+0000 7f3b86ffd640 1 -- 172.21.15.5:0/2519937684 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115910277 0 0) 0x7f3b880ce9c0 con 0x7f3b880cdf00 2024-04-25T08:56:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f3b86ffd640 1 -- 172.21.15.5:0/2519937684 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b70003520 con 0x7f3b880cdf00 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f3b87fff640 1 -- 172.21.15.5:0/2519937684 >> v2:172.21.15.80:3300/0 conn(0x7f3b880d0a60 msgr2=0x7f3b880ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f3b87fff640 1 --2- 172.21.15.5:0/2519937684 >> v2:172.21.15.80:3300/0 conn(0x7f3b880d0a60 0x7f3b880ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f3b87fff640 1 -- 172.21.15.5:0/2519937684 >> v1:172.21.15.80:6789/0 conn(0x7f3b880cdf00 legacy=0x7f3b880d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f3b87fff640 1 -- 172.21.15.5:0/2519937684 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880d1970 con 0x7f3b881655d0 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b3cd1c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b300073e0 0x7f5b30053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b3cd1c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b30005ed0 con 0x7f5b30104930 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b3cd1c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b30054230 con 0x7f5b30054510 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b3cd1c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3003a390 con 0x7f5b300073e0 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b37fff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b300073e0 0x7f5b30053be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b37fff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b300073e0 0x7f5b30053be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:50834/0 (socket says 172.21.15.5:50834) 2024-04-25T08:56:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b37fff640 1 -- 172.21.15.5:0/2027931433 learned_addr learned my addr 172.21.15.5:0/2027931433 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f5b377fe640 1 --1- 172.21.15.5:0/2027931433 >> v1:172.21.15.5:6789/0 conn(0x7f5b30104930 0x7f5b30104d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38214/0 (socket says 172.21.15.5:38214) 2024-04-25T08:56:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f6c8ffff640 1 --2- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9006e480 0x7f6c90153f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009d90 tx=0x7f6c8802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce3db2b7b04cf395 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f6c8effd640 1 -- 172.21.15.5:0/3258264882 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88007740 con 0x7f6c9006e480 2024-04-25T08:56:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f6c8effd640 1 -- 172.21.15.5:0/3258264882 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c880078e0 con 0x7f6c9006e480 2024-04-25T08:56:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.753+0000 7f6c8effd640 1 -- 172.21.15.5:0/3258264882 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88007cb0 con 0x7f6c9006e480 2024-04-25T08:56:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f71e6012640 1 --2- 172.21.15.5:0/3348289573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d8100d80 0x7f71d8037c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71e00739b0 tx=0x7f71dc02e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac788b038a2f35d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f9a3984a640 1 Processor -- start 2024-04-25T08:56:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f3b87fff640 1 --2- 172.21.15.5:0/2519937684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b880d2450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3b880d2140 tx=0x7f3b8002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=174b034d9e5ff672 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f9a3984a640 1 -- start start 2024-04-25T08:56:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f5b37fff640 1 -- 172.21.15.5:0/2027931433 >> v1:172.21.15.80:6789/0 conn(0x7f5b30054510 legacy=0x7f5b300534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f5b37fff640 1 -- 172.21.15.5:0/2027931433 >> v1:172.21.15.5:6789/0 conn(0x7f5b30104930 legacy=0x7f5b30104d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f5b37fff640 1 -- 172.21.15.5:0/2027931433 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3003a670 con 0x7f5b300073e0 2024-04-25T08:56:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f3b86ffd640 1 -- 172.21.15.5:0/2519937684 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8002ae60 con 0x7f3b881655d0 2024-04-25T08:56:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f3b86ffd640 1 -- 172.21.15.5:0/2519937684 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80007740 con 0x7f3b881655d0 2024-04-25T08:56:51.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f71e5010640 1 -- 172.21.15.5:0/3348289573 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc03c070 con 0x7f71d8100d80 2024-04-25T08:56:51.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.754+0000 7f71e5010640 1 -- 172.21.15.5:0/3348289573 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc034480 con 0x7f71d8100d80 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 -- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9006e480 msgr2=0x7f6c90153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 --2- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9006e480 0x7f6c90153f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009d90 tx=0x7f6c8802a660 comp rx=0 tx=0).stop 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 -- 172.21.15.5:0/3258264882 shutdown_connections 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 --2- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90072290 0x7f6c900b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 --2- 172.21.15.5:0/3258264882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9006e480 0x7f6c90153f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 -- 172.21.15.5:0/3258264882 >> 172.21.15.5:0/3258264882 conn(0x7f6c900668f0 msgr2=0x7f6c90066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 -- 172.21.15.5:0/3258264882 shutdown_connections 2024-04-25T08:56:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f6c96353640 1 -- 172.21.15.5:0/3258264882 wait complete. 2024-04-25T08:56:51.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f3b86ffd640 1 -- 172.21.15.5:0/2519937684 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80007b10 con 0x7f3b881655d0 2024-04-25T08:56:51.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2519937684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 msgr2=0x7f3b880d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f3b8d5f8640 1 --2- 172.21.15.5:0/2519937684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b880d2450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3b880d2140 tx=0x7f3b8002a680 comp rx=0 tx=0).stop 2024-04-25T08:56:51.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f9a3984a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a2c0e0070 0x7f9a2c0e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f9a3984a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c008590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f71e8276640 1 -- 172.21.15.5:0/3348289573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d8100d80 msgr2=0x7f71d8037c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f71e8276640 1 --2- 172.21.15.5:0/3348289573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d8100d80 0x7f71d8037c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71e00739b0 tx=0x7f71dc02e640 comp rx=0 tx=0).stop 2024-04-25T08:56:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f5b37fff640 1 --2- 172.21.15.5:0/2027931433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b300073e0 0x7f5b30053be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b38062780 tx=0x7f5b38069610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcf65bb03024a18a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f9a3984a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0e48e0 con 0x7f9a2c008ad0 2024-04-25T08:56:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f9a3984a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c008f30 con 0x7f9a2c0e0070 2024-04-25T08:56:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.755+0000 7f9a3984a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0544f0 con 0x7f9a2c0e3fe0 2024-04-25T08:56:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a337fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a2c008ad0 0x7f9a2c050420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:51614/0 (socket says 172.21.15.5:51614) 2024-04-25T08:56:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a327fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c008590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a337fe640 1 -- 172.21.15.5:0/771664879 learned_addr learned my addr 172.21.15.5:0/771664879 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a32ffd640 1 --2- 172.21.15.5:0/771664879 >> v2:172.21.15.80:3300/0 conn(0x7f9a2c0e0070 0x7f9a2c0e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f5b367fc640 1 -- 172.21.15.5:0/2027931433 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b380a0070 con 0x7f5b300073e0 2024-04-25T08:56:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f71e8276640 1 -- 172.21.15.5:0/3348289573 shutdown_connections 2024-04-25T08:56:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f71e8276640 1 --2- 172.21.15.5:0/3348289573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d8100d80 0x7f71d8037c70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f71e8276640 1 -- 172.21.15.5:0/3348289573 >> 172.21.15.5:0/3348289573 conn(0x7f71d8009fe0 msgr2=0x7f71d800a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f5b367fc640 1 -- 172.21.15.5:0/2027931433 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b380997d0 con 0x7f5b300073e0 2024-04-25T08:56:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f5b367fc640 1 -- 172.21.15.5:0/2027931433 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38099c40 con 0x7f5b300073e0 2024-04-25T08:56:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f83f1f8b640 1 Processor -- start 2024-04-25T08:56:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f71e8276640 1 -- 172.21.15.5:0/3348289573 shutdown_connections 2024-04-25T08:56:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a327fc640 1 -- 172.21.15.5:0/771664879 >> v2:172.21.15.80:3300/0 conn(0x7f9a2c0e0070 msgr2=0x7f9a2c0e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a327fc640 1 --2- 172.21.15.5:0/771664879 >> v2:172.21.15.80:3300/0 conn(0x7f9a2c0e0070 0x7f9a2c0e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a327fc640 1 -- 172.21.15.5:0/771664879 >> v1:172.21.15.80:6789/0 conn(0x7f9a2c008ad0 legacy=0x7f9a2c050420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/2027931433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b300073e0 msgr2=0x7f5b30053be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/2027931433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b300073e0 0x7f5b30053be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b38062780 tx=0x7f5b38069610 comp rx=0 tx=0).stop 2024-04-25T08:56:51.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f6c96353640 1 Processor -- start 2024-04-25T08:56:51.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f9a327fc640 1 -- 172.21.15.5:0/771664879 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c055990 con 0x7f9a2c0e3fe0 2024-04-25T08:56:51.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f9a327fc640 1 --2- 172.21.15.5:0/771664879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c008590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a34050820 tx=0x7f9a34069610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d729d0c017ec04b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.756+0000 7f83f1f8b640 1 -- start start 2024-04-25T08:56:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2519937684 shutdown_connections 2024-04-25T08:56:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f3b8d5f8640 1 --2- 172.21.15.5:0/2519937684 >> v2:172.21.15.80:3300/0 conn(0x7f3b880d0a60 0x7f3b880ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f3b8d5f8640 1 --2- 172.21.15.5:0/2519937684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b880d2450 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2519937684 >> 172.21.15.5:0/2519937684 conn(0x7f3b8806b210 msgr2=0x7f3b880668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f71e8276640 1 -- 172.21.15.5:0/3348289573 wait complete. 2024-04-25T08:56:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f6c96353640 1 -- start start 2024-04-25T08:56:51.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/2027931433 shutdown_connections 2024-04-25T08:56:51.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/2027931433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b300073e0 0x7f5b30053be0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/2027931433 >> 172.21.15.5:0/2027931433 conn(0x7f5b30009fa0 msgr2=0x7f5b3000a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2519937684 shutdown_connections 2024-04-25T08:56:51.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f9a31ffb640 1 -- 172.21.15.5:0/771664879 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340b1070 con 0x7f9a2c0e3fe0 2024-04-25T08:56:51.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f83f1f8b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83ec0b4870 0x7f83ec0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f9a31ffb640 1 -- 172.21.15.5:0/771664879 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340aa7d0 con 0x7f9a2c0e3fe0 2024-04-25T08:56:51.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f83f1f8b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83ec072820 0x7f83ec0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f83f1f8b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec06e820 con 0x7f83ec15a8a0 2024-04-25T08:56:51.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.757+0000 7f83f1f8b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec0af9f0 con 0x7f83ec0b4870 2024-04-25T08:56:51.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f83f1f8b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec072dd0 con 0x7f83ec072820 2024-04-25T08:56:51.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f83e3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f83ec15a8a0 0x7f83ec072110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38226/0 (socket says 172.21.15.5:38226) 2024-04-25T08:56:51.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f83e3fff640 1 -- 172.21.15.5:0/2886452712 learned_addr learned my addr 172.21.15.5:0/2886452712 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:51.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/2027931433 shutdown_connections 2024-04-25T08:56:51.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f9a3984a640 1 -- 172.21.15.5:0/771664879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 msgr2=0x7f9a2c008590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f9a3984a640 1 --2- 172.21.15.5:0/771664879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c008590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a34050820 tx=0x7f9a34069610 comp rx=0 tx=0).stop 2024-04-25T08:56:51.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f6c96353640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9006e480 0x7f6c901405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c96353640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90072290 0x7f6c90151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f71e8276640 1 Processor -- start 2024-04-25T08:56:51.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c96353640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90154460 0x7f6c90151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f9a3984a640 1 -- 172.21.15.5:0/771664879 shutdown_connections 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f9a3984a640 1 --2- 172.21.15.5:0/771664879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c008590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f9a3984a640 1 --2- 172.21.15.5:0/771664879 >> v2:172.21.15.80:3300/0 conn(0x7f9a2c0e0070 0x7f9a2c0e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f9a3984a640 1 -- 172.21.15.5:0/771664879 >> 172.21.15.5:0/771664879 conn(0x7f9a2c055bc0 msgr2=0x7f9a2c055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c8f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90072290 0x7f6c90151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c8f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90072290 0x7f6c90151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36632/0 (socket says 172.21.15.5:36632) 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c8f7fe640 1 -- 172.21.15.5:0/3636883721 learned_addr learned my addr 172.21.15.5:0/3636883721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c948f0640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90154460 0x7f6c90151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f83eb7fe640 1 --2- 172.21.15.5:0/2886452712 >> v2:172.21.15.5:3300/0 conn(0x7f83ec0b4870 0x7f83ec0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f83ebfff640 1 --2- 172.21.15.5:0/2886452712 >> v2:172.21.15.80:3300/0 conn(0x7f83ec072820 0x7f83ec0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f83eb7fe640 1 -- 172.21.15.5:0/2886452712 >> v2:172.21.15.80:3300/0 conn(0x7f83ec072820 msgr2=0x7f83ec0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f83eb7fe640 1 --2- 172.21.15.5:0/2886452712 >> v2:172.21.15.80:3300/0 conn(0x7f83ec072820 0x7f83ec0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f83eb7fe640 1 -- 172.21.15.5:0/2886452712 >> v1:172.21.15.5:6789/0 conn(0x7f83ec15a8a0 legacy=0x7f83ec072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f83eb7fe640 1 -- 172.21.15.5:0/2886452712 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec06eb00 con 0x7f83ec0b4870 2024-04-25T08:56:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f9a3984a640 1 -- 172.21.15.5:0/771664879 shutdown_connections 2024-04-25T08:56:51.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9006d240 con 0x7f6c9006e480 2024-04-25T08:56:51.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c900b2d90 con 0x7f6c90072290 2024-04-25T08:56:51.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c8ffff640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9006e480 0x7f6c901405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9013f510 con 0x7f6c90154460 2024-04-25T08:56:51.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f9a3984a640 1 -- 172.21.15.5:0/771664879 wait complete. 2024-04-25T08:56:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.758+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2519937684 wait complete. 2024-04-25T08:56:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f3b8d5f8640 1 Processor -- start 2024-04-25T08:56:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f71e8276640 1 -- start start 2024-04-25T08:56:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f6c948f0640 1 -- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90072290 msgr2=0x7f6c90151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f6c948f0640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90072290 0x7f6c90151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f83eb7fe640 1 --2- 172.21.15.5:0/2886452712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec0b4870 0x7f83ec0cf430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83ec06d9d0 tx=0x7f83dc02a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69402f43c4bee837 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f6c948f0640 1 -- 172.21.15.5:0/3636883721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9006e480 msgr2=0x7f6c901405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f6c948f0640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9006e480 0x7f6c901405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f83eaffd640 1 -- 172.21.15.5:0/2886452712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc037070 con 0x7f83ec0b4870 2024-04-25T08:56:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/2027931433 wait complete. 2024-04-25T08:56:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f83eaffd640 1 -- 172.21.15.5:0/2886452712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc032440 con 0x7f83ec0b4870 2024-04-25T08:56:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f5b3cd1c640 1 Processor -- start 2024-04-25T08:56:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f83eaffd640 1 -- 172.21.15.5:0/2886452712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc037070 con 0x7f83ec0b4870 2024-04-25T08:56:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f6c948f0640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9013f7f0 con 0x7f6c90154460 2024-04-25T08:56:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f6c8ffff640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9006e480 0x7f6c901405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f6c948f0640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90154460 0x7f6c90151b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400e7f0 tx=0x7f6c8400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7ff78cfc4640 1 Processor -- start 2024-04-25T08:56:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.759+0000 7ff78cfc4640 1 -- start start 2024-04-25T08:56:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7ff78cfc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff780057590 0x7ff780052c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f5b3cd1c640 1 -- start start 2024-04-25T08:56:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7ff78cfc4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780051b90 con 0x7ff7800e7690 2024-04-25T08:56:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7ff78cfc4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780051e70 con 0x7ff780049d30 2024-04-25T08:56:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7ff78cfc4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff780052150 con 0x7ff780057590 2024-04-25T08:56:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f9a3984a640 1 Processor -- start 2024-04-25T08:56:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f71e8276640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d8033950 0x7f71d819fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f71e8276640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d80543c0 0x7f71d819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7ff78659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7800e7690 0x7ff7800513b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38234/0 (socket says 172.21.15.5:38234) 2024-04-25T08:56:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7ff78659c640 1 -- 172.21.15.5:0/2946939856 learned_addr learned my addr 172.21.15.5:0/2946939856 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f9a3984a640 1 -- start start 2024-04-25T08:56:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f71e8276640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71d8100d80 0x7f71d804e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.760+0000 7f3b8d5f8640 1 -- start start 2024-04-25T08:56:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f71e5811640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d80543c0 0x7f71d819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f71e5811640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d80543c0 0x7f71d819c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36648/0 (socket says 172.21.15.5:36648) 2024-04-25T08:56:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f3b8d5f8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b880cdf00 0x7f3b880b8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.761+0000 7f6c8cff9640 1 -- 172.21.15.5:0/3636883721 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84017070 con 0x7f6c90154460 2024-04-25T08:56:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f3b8d5f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b880d0a60 0x7f3b880cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f71e5811640 1 -- 172.21.15.5:0/2737731122 learned_addr learned my addr 172.21.15.5:0/2737731122 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f6c8cff9640 1 -- 172.21.15.5:0/3636883721 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400c940 con 0x7f6c90154460 2024-04-25T08:56:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f83f1f8b640 1 -- 172.21.15.5:0/2886452712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec0b4870 msgr2=0x7f83ec0cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/2886452712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec0b4870 0x7f83ec0cf430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83ec06d9d0 tx=0x7f83dc02a370 comp rx=0 tx=0).stop 2024-04-25T08:56:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f3b8d5f8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b88200480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff785d9b640 1 --2- 172.21.15.5:0/2946939856 >> v2:172.21.15.80:3300/0 conn(0x7ff780057590 0x7ff780052c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577087185 0 0) 0x7ff780051b90 con 0x7ff7800e7690 2024-04-25T08:56:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff770003520 con 0x7ff7800e7690 2024-04-25T08:56:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9013fad0 con 0x7f6c90154460 2024-04-25T08:56:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c90140af0 con 0x7f6c90154460 2024-04-25T08:56:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f6c8cff9640 1 -- 172.21.15.5:0/3636883721 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400cd30 con 0x7f6c90154460 2024-04-25T08:56:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f83f1f8b640 1 -- 172.21.15.5:0/2886452712 shutdown_connections 2024-04-25T08:56:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8034110 con 0x7f71d8033950 2024-04-25T08:56:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8052ca0 con 0x7f71d80543c0 2024-04-25T08:56:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f5b3cd1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b300073e0 0x7f5b300f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f71e6813640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71d8100d80 0x7f71d804e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1087260124 0 0) 0x7ff770003520 con 0x7ff7800e7690 2024-04-25T08:56:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 >> v2:172.21.15.80:3300/0 conn(0x7ff780057590 msgr2=0x7ff780052c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 --2- 172.21.15.5:0/2946939856 >> v2:172.21.15.80:3300/0 conn(0x7ff780057590 0x7ff780052c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 >> v1:172.21.15.80:6789/0 conn(0x7ff780049d30 legacy=0x7ff7800365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780052430 con 0x7ff7800e7690 2024-04-25T08:56:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7ff778001670 con 0x7ff7800e7690 2024-04-25T08:56:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 >> v1:172.21.15.5:6789/0 conn(0x7ff7800e7690 legacy=0x7ff7800513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f9a3984a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c008ad0 0x7f9a2c0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7700039b0 0x7ff770003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/2886452712 >> v2:172.21.15.80:3300/0 conn(0x7f83ec072820 0x7f83ec0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/2886452712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec0b4870 0x7f83ec0cf430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f83f1f8b640 1 -- 172.21.15.5:0/2886452712 >> 172.21.15.5:0/2886452712 conn(0x7f83ec0b1da0 msgr2=0x7f83ec0b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770004800 0x7ff770004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7700051c0 0x7ff77000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780052150 con 0x7ff7700051c0 2024-04-25T08:56:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77000c0f0 con 0x7ff770004800 2024-04-25T08:56:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77000c2f0 con 0x7ff7700039b0 2024-04-25T08:56:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f5b377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b300073e0 0x7f5b300f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f9a3984a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0e0070 0x7f9a2c0ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c008ad0 0x7f9a2c0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c008ad0 0x7f9a2c0c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36650/0 (socket says 172.21.15.5:36650) 2024-04-25T08:56:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 -- 172.21.15.5:0/2143018395 learned_addr learned my addr 172.21.15.5:0/2143018395 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a3984a640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c036630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a3984a640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c009450 con 0x7f9a2c0e0070 2024-04-25T08:56:51.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a3984a640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0e4420 con 0x7f9a2c008ad0 2024-04-25T08:56:51.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a3984a640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c053ea0 con 0x7f9a2c0e3fe0 2024-04-25T08:56:51.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f83f1f8b640 1 -- 172.21.15.5:0/2886452712 shutdown_connections 2024-04-25T08:56:51.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f83f1f8b640 1 -- 172.21.15.5:0/2886452712 wait complete. 2024-04-25T08:56:51.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff785d9b640 1 --2- 172.21.15.5:0/2946939856 >> v2:172.21.15.80:3300/0 conn(0x7ff780057590 0x7ff780052c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:51.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff786d9d640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7700051c0 0x7ff77000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff785d9b640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770004800 0x7ff770004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff78659c640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7700039b0 0x7ff770003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a327fc640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0e0070 0x7f9a2c0ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a337fe640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c036630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.762+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80381b0 con 0x7f71d8100d80 2024-04-25T08:56:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f71e6012640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d8033950 0x7f71d819fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f5b3cd1c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b30054510 0x7f5b30035f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f5b3cd1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b30104930 0x7f5b301aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f5b3cd1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b30105420 con 0x7f5b300073e0 2024-04-25T08:56:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f5b3cd1c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b30101170 con 0x7f5b30104930 2024-04-25T08:56:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f5b377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b300073e0 0x7f5b300f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55532/0 (socket says 172.21.15.5:55532) 2024-04-25T08:56:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f5b3cd1c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301055a0 con 0x7f5b30054510 2024-04-25T08:56:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f5b377fe640 1 -- 172.21.15.5:0/3193996687 learned_addr learned my addr 172.21.15.5:0/3193996687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 -- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 msgr2=0x7f9a2c036630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c036630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 -- 172.21.15.5:0/2143018395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0e0070 msgr2=0x7f9a2c0ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0e0070 0x7f9a2c0ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f9a32ffd640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0ec270 con 0x7f9a2c008ad0 2024-04-25T08:56:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff78659c640 1 -- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770004800 msgr2=0x7ff770004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff78659c640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770004800 0x7ff770004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff78659c640 1 -- 172.21.15.5:0/2946939856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7700051c0 msgr2=0x7ff77000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff78659c640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7700051c0 0x7ff77000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7ff78659c640 1 -- 172.21.15.5:0/2946939856 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780052430 con 0x7ff7700039b0 2024-04-25T08:56:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7ff786d9d640 1 -- 172.21.15.5:0/2946939856 reap_dead start 2024-04-25T08:56:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b377fe640 1 -- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b30054510 msgr2=0x7f5b30035f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b377fe640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b30054510 0x7f5b30035f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b377fe640 1 -- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b30104930 msgr2=0x7f5b301aacd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:56:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b377fe640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b30104930 0x7f5b301aacd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b377fe640 1 -- 172.21.15.5:0/3193996687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30036470 con 0x7f5b300073e0 2024-04-25T08:56:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f71e5811640 1 -- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71d8100d80 msgr2=0x7f71d804e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f71e5811640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71d8100d80 0x7f71d804e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f71e5811640 1 -- 172.21.15.5:0/2737731122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d8033950 msgr2=0x7f71d819fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f71e5811640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d8033950 0x7f71d819fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b880cdf00 0x7f3b880b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b377fe640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b300073e0 0x7f5b300f64c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c3f0 tx=0x7f5b2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.763+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b880cdf00 0x7f3b880b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36656/0 (socket says 172.21.15.5:36656) 2024-04-25T08:56:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f3b87fff640 1 -- 172.21.15.5:0/2831601688 learned_addr learned my addr 172.21.15.5:0/2831601688 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f3b877fe640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b880d0a60 0x7f3b880cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880d2990 con 0x7f3b880d0a60 2024-04-25T08:56:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88166b10 con 0x7f3b880cdf00 2024-04-25T08:56:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881659b0 con 0x7f3b881655d0 2024-04-25T08:56:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f71e5811640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d81a03e0 con 0x7f71d80543c0 2024-04-25T08:56:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f71e5811640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d80543c0 0x7f71d819c7b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c410 tx=0x7f71d000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f9a32ffd640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c008ad0 0x7f9a2c0c4dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e9e0 tx=0x7f9a2400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b23fff640 1 -- 172.21.15.5:0/3193996687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0074e0 con 0x7f5b300073e0 2024-04-25T08:56:51.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b23fff640 1 -- 172.21.15.5:0/3193996687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c007680 con 0x7f5b300073e0 2024-04-25T08:56:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f5b23fff640 1 -- 172.21.15.5:0/3193996687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c004a20 con 0x7f5b300073e0 2024-04-25T08:56:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b30036710 con 0x7f5b300073e0 2024-04-25T08:56:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b300f3ba0 con 0x7f5b300073e0 2024-04-25T08:56:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f71d6ffd640 1 -- 172.21.15.5:0/2737731122 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0017070 con 0x7f71d80543c0 2024-04-25T08:56:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f71d6ffd640 1 -- 172.21.15.5:0/2737731122 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d00035f0 con 0x7f71d80543c0 2024-04-25T08:56:51.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f71d6ffd640 1 -- 172.21.15.5:0/2737731122 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0003a20 con 0x7f71d80543c0 2024-04-25T08:56:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f3b877fe640 1 -- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 msgr2=0x7f3b88200480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f3b877fe640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b88200480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f3b877fe640 1 -- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b880cdf00 msgr2=0x7f3b880b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f3b877fe640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b880cdf00 0x7f3b880b8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f3b877fe640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88201420 con 0x7f3b880d0a60 2024-04-25T08:56:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d80f1f80 con 0x7f71d80543c0 2024-04-25T08:56:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d80f2540 con 0x7f71d80543c0 2024-04-25T08:56:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.764+0000 7f6c8cff9640 1 -- 172.21.15.5:0/3636883721 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c8401a070 con 0x7f6c90154460 2024-04-25T08:56:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f6c8cff9640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7c06b5a0 0x7f6c7c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f6c8cff9640 1 -- 172.21.15.5:0/3636883721 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c8408a020 con 0x7f6c90154460 2024-04-25T08:56:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7ff78659c640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7700039b0 0x7ff770003db0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff778007fd0 tx=0x7ff770005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a47c8201428f854 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f83f1f8b640 1 Processor -- start 2024-04-25T08:56:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f6c8ffff640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7c06b5a0 0x7f6c7c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f3b877fe640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b880d0a60 0x7f3b880cd500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c3c0 tx=0x7f3b78001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f9a1bfff640 1 -- 172.21.15.5:0/2143018395 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24017070 con 0x7f9a2c008ad0 2024-04-25T08:56:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f83f1f8b640 1 -- start start 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.766+0000 7f3b84ff9640 1 -- 172.21.15.5:0/2831601688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78017070 con 0x7f3b880d0a60 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.766+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b88201700 con 0x7f3b880d0a60 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.766+0000 7f3b8d5f8640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b88201cc0 con 0x7f3b880d0a60 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.766+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778036070 con 0x7ff7700039b0 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.766+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778005af0 con 0x7ff7700039b0 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.766+0000 7ff78559a640 1 -- 172.21.15.5:0/2946939856 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778007d50 con 0x7ff7700039b0 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7700039b0 msgr2=0x7ff770003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7700039b0 0x7ff770003db0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff778007fd0 tx=0x7ff770005830 comp rx=0 tx=0).stop 2024-04-25T08:56:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f9a3984a640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c0ec550 con 0x7f9a2c008ad0 2024-04-25T08:56:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.765+0000 7f9a3984a640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c0ecb10 con 0x7f9a2c008ad0 2024-04-25T08:56:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f9a1bfff640 1 -- 172.21.15.5:0/2143018395 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400c9d0 con 0x7f9a2c008ad0 2024-04-25T08:56:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f6c8ffff640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7c06b5a0 0x7f6c7c06da60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c88034000 tx=0x7f6c8802f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f83f1f8b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec072820 0x7f83ec152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f83f1f8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83ec0b4870 0x7f83ec14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f83f1f8b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83ec15a8a0 0x7f83ec14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f83f1f8b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0b4c50 con 0x7f83ec072820 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f83f1f8b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec06f0c0 con 0x7f83ec0b4870 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f83f1f8b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0b1550 con 0x7f83ec15a8a0 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c8005290 con 0x7f71d80543c0 2024-04-25T08:56:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c70005290 con 0x7f6c90154460 2024-04-25T08:56:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f3b84ff9640 1 -- 172.21.15.5:0/2831601688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78005ce0 con 0x7f3b880d0a60 2024-04-25T08:56:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f9a1bfff640 1 -- 172.21.15.5:0/2143018395 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400cdc0 con 0x7f9a2c008ad0 2024-04-25T08:56:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83ec0b4870 0x7f83ec14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83ebfff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83ec15a8a0 0x7f83ec14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b300052b0 con 0x7f5b300073e0 2024-04-25T08:56:51.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83ec0b4870 0x7f83ec14c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36678/0 (socket says 172.21.15.5:36678) 2024-04-25T08:56:51.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83e3fff640 1 -- 172.21.15.5:0/300280297 learned_addr learned my addr 172.21.15.5:0/300280297 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f71d6ffd640 1 -- 172.21.15.5:0/2737731122 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71d001a070 con 0x7f71d80543c0 2024-04-25T08:56:51.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.767+0000 7f3b84ff9640 1 -- 172.21.15.5:0/2831601688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780072d0 con 0x7f3b880d0a60 2024-04-25T08:56:51.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c005700 con 0x7f9a2c008ad0 2024-04-25T08:56:51.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83e3fff640 1 -- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83ec15a8a0 msgr2=0x7f83ec14cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83e3fff640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83ec15a8a0 0x7f83ec14cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b60005290 con 0x7f3b880d0a60 2024-04-25T08:56:51.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83e3fff640 1 -- 172.21.15.5:0/300280297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec072820 msgr2=0x7f83ec152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f83e3fff640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec072820 0x7f83ec152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f83e3fff640 1 -- 172.21.15.5:0/300280297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec0b04b0 con 0x7f83ec0b4870 2024-04-25T08:56:51.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7f5b23fff640 1 -- 172.21.15.5:0/3193996687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b2c01a020 con 0x7f5b300073e0 2024-04-25T08:56:51.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f5b23fff640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b1c06b500 0x7f5b1c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f71d6ffd640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71c406b5d0 0x7f71c406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f71d6ffd640 1 -- 172.21.15.5:0/2737731122 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71d0089510 con 0x7f71d80543c0 2024-04-25T08:56:51.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f83e3fff640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83ec0b4870 0x7f83ec14c7e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c480 tx=0x7f83d400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2946939856 shutdown_connections 2024-04-25T08:56:51.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2946939856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7700039b0 0x7ff770003db0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f9a1bfff640 1 -- 172.21.15.5:0/2143018395 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a2401a070 con 0x7f9a2c008ad0 2024-04-25T08:56:51.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.768+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2946939856 >> 172.21.15.5:0/2946939856 conn(0x7ff780020030 msgr2=0x7ff780056d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:51.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f71e6012640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71c406b5d0 0x7f71c406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f5b23fff640 1 -- 172.21.15.5:0/3193996687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b2c0898f0 con 0x7f5b300073e0 2024-04-25T08:56:51.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.769+0000 7f5b36ffd640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b1c06b500 0x7f5b1c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7f5b36ffd640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b1c06b500 0x7f5b1c06d9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b3004f900 tx=0x7f5b240079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2946939856 shutdown_connections 2024-04-25T08:56:51.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7f9a1bfff640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9a2006b5a0 0x7f9a2006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7f9a1bfff640 1 -- 172.21.15.5:0/2143018395 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a2408a550 con 0x7f9a2c008ad0 2024-04-25T08:56:51.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7f71e6012640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71c406b5d0 0x7f71c406da90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71dc039000 tx=0x7f71dc00d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7f9a327fc640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9a2006b5a0 0x7f9a2006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2946939856 wait complete. 2024-04-25T08:56:51.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7f3b84ff9640 1 -- 172.21.15.5:0/2831601688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b7801a070 con 0x7f3b880d0a60 2024-04-25T08:56:51.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.770+0000 7f9a327fc640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9a2006b5a0 0x7f9a2006da60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c054670 tx=0x7f9a340a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.771+0000 7f3b84ff9640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b7406b550 0x7f3b7406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.771+0000 7f3b84ff9640 1 -- 172.21.15.5:0/2831601688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b78089c90 con 0x7f3b880d0a60 2024-04-25T08:56:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.771+0000 7f3b87fff640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b7406b550 0x7f3b7406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.772+0000 7ff78cfc4640 1 Processor -- start 2024-04-25T08:56:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.772+0000 7f3b87fff640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b7406b550 0x7f3b7406da10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009bd0 tx=0x7f3b8002f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.772+0000 7ff78cfc4640 1 -- start start 2024-04-25T08:56:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7f83e8ff9640 1 -- 172.21.15.5:0/300280297 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4017070 con 0x7f83ec0b4870 2024-04-25T08:56:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78cfc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7700039b0 0x7ff7800e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78cfc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7800e2f10 0x7ff780180780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78cfc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff780180cc0 0x7ff780050470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78cfc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78004a1a0 con 0x7ff7800e2f10 2024-04-25T08:56:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78cfc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800e7a70 con 0x7ff7700039b0 2024-04-25T08:56:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78cfc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78004a320 con 0x7ff780180cc0 2024-04-25T08:56:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7f6c8cff9640 1 -- 172.21.15.5:0/3636883721 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c840588c0 con 0x7f6c90154460 2024-04-25T08:56:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7f71d6ffd640 1 -- 172.21.15.5:0/2737731122 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71d0058400 con 0x7f71d80543c0 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7700039b0 0x7ff7800e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7700039b0 0x7ff7800e29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36694/0 (socket says 172.21.15.5:36694) 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff78659c640 1 -- 172.21.15.5:0/2250960134 learned_addr learned my addr 172.21.15.5:0/2250960134 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff785d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7800e2f10 0x7ff780180780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7ff786d9d640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff780180cc0 0x7ff780050470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.774+0000 7ff78659c640 1 -- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff780180cc0 msgr2=0x7ff780050470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.774+0000 7ff78659c640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff780180cc0 0x7ff780050470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.774+0000 7ff78659c640 1 -- 172.21.15.5:0/2250960134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7800e2f10 msgr2=0x7ff780180780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.774+0000 7ff78659c640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7800e2f10 0x7ff780180780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.774+0000 7ff78659c640 1 -- 172.21.15.5:0/2250960134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78004ded0 con 0x7ff7700039b0 2024-04-25T08:56:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.773+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec0b0790 con 0x7f83ec0b4870 2024-04-25T08:56:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.774+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec0b0d50 con 0x7f83ec0b4870 2024-04-25T08:56:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.774+0000 7ff78659c640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7700039b0 0x7ff7800e29d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff77800c320 tx=0x7ff778001970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.775+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec04ef20 con 0x7f83ec0b4870 2024-04-25T08:56:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.776+0000 7f5b23fff640 1 -- 172.21.15.5:0/3193996687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b2c058760 con 0x7f5b300073e0 2024-04-25T08:56:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.777+0000 7f83e8ff9640 1 -- 172.21.15.5:0/300280297 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4005ce0 con 0x7f83ec0b4870 2024-04-25T08:56:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.777+0000 7ff776ffd640 1 -- 172.21.15.5:0/2250960134 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778041070 con 0x7ff7700039b0 2024-04-25T08:56:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.777+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78004e1b0 con 0x7ff7700039b0 2024-04-25T08:56:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.778+0000 7f9a1bfff640 1 -- 172.21.15.5:0/2143018395 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a24059440 con 0x7f9a2c008ad0 2024-04-25T08:56:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.778+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78004e770 con 0x7ff7700039b0 2024-04-25T08:56:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.778+0000 7ff776ffd640 1 -- 172.21.15.5:0/2250960134 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778005ac0 con 0x7ff7700039b0 2024-04-25T08:56:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.778+0000 7ff776ffd640 1 -- 172.21.15.5:0/2250960134 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77804b060 con 0x7ff7700039b0 2024-04-25T08:56:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.778+0000 7f83e8ff9640 1 -- 172.21.15.5:0/300280297 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4021060 con 0x7f83ec0b4870 2024-04-25T08:56:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.780+0000 7f83e8ff9640 1 -- 172.21.15.5:0/300280297 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83d401a070 con 0x7f83ec0b4870 2024-04-25T08:56:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.780+0000 7f83e8ff9640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83cc06b4d0 0x7f83cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.781+0000 7f83e8ff9640 1 -- 172.21.15.5:0/300280297 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83d4089960 con 0x7f83ec0b4870 2024-04-25T08:56:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.780+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c005290 con 0x7ff7700039b0 2024-04-25T08:56:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.781+0000 7f83eb7fe640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83cc06b4d0 0x7f83cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.781+0000 7ff776ffd640 1 -- 172.21.15.5:0/2250960134 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff778044070 con 0x7ff7700039b0 2024-04-25T08:56:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.782+0000 7f83eb7fe640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83cc06b4d0 0x7f83cc06d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83dc034000 tx=0x7f83dc02c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.782+0000 7ff776ffd640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff76806b500 0x7ff76806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.782+0000 7f3b84ff9640 1 -- 172.21.15.5:0/2831601688 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b780584a0 con 0x7f3b880d0a60 2024-04-25T08:56:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.782+0000 7ff785d9b640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff76806b500 0x7ff76806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.782+0000 7ff776ffd640 1 -- 172.21.15.5:0/2250960134 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff778077d60 con 0x7ff7700039b0 2024-04-25T08:56:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.783+0000 7f83e8ff9640 1 -- 172.21.15.5:0/300280297 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83d4058200 con 0x7f83ec0b4870 2024-04-25T08:56:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.783+0000 7ff785d9b640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff76806b500 0x7ff76806d9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7800e5e70 tx=0x7ff77c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:51.787+0000 7ff776ffd640 1 -- 172.21.15.5:0/2250960134 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff778079cc0 con 0x7ff7700039b0 2024-04-25T08:56:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.132+0000 7f1beda93640 1 -- 172.21.15.5:0/3348760080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1be0052770 con 0x7f1be0101030 2024-04-25T08:56:52.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.133+0000 7f1be57fa640 1 -- 172.21.15.5:0/3348760080 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1be80c65c0 con 0x7f1be0101030 2024-04-25T08:56:52.123 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.136+0000 7f1bd2ffd640 1 -- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1bcc06b5a0 msgr2=0x7f1bcc06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.136+0000 7f1bd2ffd640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1bcc06b5a0 0x7f1bcc06da60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4037000 tx=0x7f1bd4030000 comp rx=0 tx=0).stop 2024-04-25T08:56:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.136+0000 7f1bd2ffd640 1 -- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1be0101030 msgr2=0x7f1be002e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.136+0000 7f1bd2ffd640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1be0101030 0x7f1be002e360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1be8069f50 tx=0x7f1be8068710 comp rx=0 tx=0).stop 2024-04-25T08:56:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 -- 172.21.15.5:0/3348760080 shutdown_connections 2024-04-25T08:56:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1bcc06b5a0 0x7f1bcc06da60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1be0101030 0x7f1be002e360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1be0100c50 0x7f1be002c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 --2- 172.21.15.5:0/3348760080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1be00065f0 0x7f1be01bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 -- 172.21.15.5:0/3348760080 >> 172.21.15.5:0/3348760080 conn(0x7f1be0009fb0 msgr2=0x7f1be0102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 -- 172.21.15.5:0/3348760080 shutdown_connections 2024-04-25T08:56:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.137+0000 7f1bd2ffd640 1 -- 172.21.15.5:0/3348760080 wait complete. 2024-04-25T08:56:52.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-25T08:56:52.144 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.171+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5b30052d70 con 0x7f5b300073e0 2024-04-25T08:56:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.172+0000 7f5b23fff640 1 -- 172.21.15.5:0/3193996687 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b2c058060 con 0x7f5b300073e0 2024-04-25T08:56:52.162 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-04-25T08:56:52.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b1c06b500 msgr2=0x7f5b1c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b1c06b500 0x7f5b1c06d9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b3004f900 tx=0x7f5b240079b0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b300073e0 msgr2=0x7f5b300f64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b300073e0 0x7f5b300f64c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c3f0 tx=0x7f5b2c00c8b0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 shutdown_connections 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b1c06b500 0x7f5b1c06d9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b30104930 0x7f5b301aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b30054510 0x7f5b30035f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 --2- 172.21.15.5:0/3193996687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b300073e0 0x7f5b300f64c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 >> 172.21.15.5:0/3193996687 conn(0x7f5b30009fa0 msgr2=0x7f5b30004b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 shutdown_connections 2024-04-25T08:56:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.174+0000 7f5b3cd1c640 1 -- 172.21.15.5:0/3193996687 wait complete. 2024-04-25T08:56:52.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-25T08:56:52.175 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.194+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f71c8005580 con 0x7f71d80543c0 2024-04-25T08:56:52.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.195+0000 7f71d6ffd640 1 -- 172.21.15.5:0/2737731122 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71d00010c0 con 0x7f71d80543c0 2024-04-25T08:56:52.185 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:52.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.197+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c70005580 con 0x7f6c90154460 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71c406b5d0 msgr2=0x7f71c406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71c406b5d0 0x7f71c406da90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71dc039000 tx=0x7f71dc00d040 comp rx=0 tx=0).stop 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d80543c0 msgr2=0x7f71d819c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d80543c0 0x7f71d819c7b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c410 tx=0x7f71d000c810 comp rx=0 tx=0).stop 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 shutdown_connections 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71c406b5d0 0x7f71c406da90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71d8100d80 0x7f71d804e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71d80543c0 0x7f71d819c7b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 --2- 172.21.15.5:0/2737731122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d8033950 0x7f71d819fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 >> 172.21.15.5:0/2737731122 conn(0x7f71d8009fe0 msgr2=0x7f71d80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 shutdown_connections 2024-04-25T08:56:52.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f71e8276640 1 -- 172.21.15.5:0/2737731122 wait complete. 2024-04-25T08:56:52.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.198+0000 7f6c8cff9640 1 -- 172.21.15.5:0/3636883721 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c8405c960 con 0x7f6c90154460 2024-04-25T08:56:52.189 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7c06b5a0 msgr2=0x7f6c7c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7c06b5a0 0x7f6c7c06da60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c88034000 tx=0x7f6c8802f000 comp rx=0 tx=0).stop 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90154460 msgr2=0x7f6c90151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90154460 0x7f6c90151b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400e7f0 tx=0x7f6c8400ecb0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 shutdown_connections 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7c06b5a0 0x7f6c7c06da60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c90154460 0x7f6c90151b40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c90072290 0x7f6c90151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 --2- 172.21.15.5:0/3636883721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9006e480 0x7f6c901405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 >> 172.21.15.5:0/3636883721 conn(0x7f6c900668f0 msgr2=0x7f6c9015d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 shutdown_connections 2024-04-25T08:56:52.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.201+0000 7f6c96353640 1 -- 172.21.15.5:0/3636883721 wait complete. 2024-04-25T08:56:52.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.203+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9a2c0539b0 con 0x7f9a2c008ad0 2024-04-25T08:56:52.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.204+0000 7f9a1bfff640 1 -- 172.21.15.5:0/2143018395 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a24058d40 con 0x7f9a2c008ad0 2024-04-25T08:56:52.194 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-04-25T08:56:52.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9a2006b5a0 msgr2=0x7f9a2006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9a2006b5a0 0x7f9a2006da60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c054670 tx=0x7f9a340a7000 comp rx=0 tx=0).stop 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c008ad0 msgr2=0x7f9a2c0c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c008ad0 0x7f9a2c0c4dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e9e0 tx=0x7f9a2400eea0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 shutdown_connections 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9a2006b5a0 0x7f9a2006da60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a2c0e3fe0 0x7f9a2c036630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a2c0e0070 0x7f9a2c0ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 --2- 172.21.15.5:0/2143018395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c008ad0 0x7f9a2c0c4dc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.207+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 >> 172.21.15.5:0/2143018395 conn(0x7f9a2c055bc0 msgr2=0x7f9a2c006a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.208+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 shutdown_connections 2024-04-25T08:56:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.208+0000 7f9a19ffb640 1 -- 172.21.15.5:0/2143018395 wait complete. 2024-04-25T08:56:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.209+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f83ec06e4d0 con 0x7f83ec0b4870 2024-04-25T08:56:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.209+0000 7f83e8ff9640 1 -- 172.21.15.5:0/300280297 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83d405c2a0 con 0x7f83ec0b4870 2024-04-25T08:56:52.199 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:52.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.209+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b60005850 con 0x7f3b880d0a60 2024-04-25T08:56:52.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.210+0000 7f3b84ff9640 1 -- 172.21.15.5:0/2831601688 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b7805c540 con 0x7f3b880d0a60 2024-04-25T08:56:52.200 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83cc06b4d0 msgr2=0x7f83cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83cc06b4d0 0x7f83cc06d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83dc034000 tx=0x7f83dc02c000 comp rx=0 tx=0).stop 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83ec0b4870 msgr2=0x7f83ec14c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83ec0b4870 0x7f83ec14c7e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c480 tx=0x7f83d400c940 comp rx=0 tx=0).stop 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 shutdown_connections 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f83cc06b4d0 0x7f83cc06d990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83ec15a8a0 0x7f83ec14cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83ec0b4870 0x7f83ec14c7e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 --2- 172.21.15.5:0/300280297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83ec072820 0x7f83ec152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.212+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 >> 172.21.15.5:0/300280297 conn(0x7f83ec0b1da0 msgr2=0x7f83ec15cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 shutdown_connections 2024-04-25T08:56:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f83f1f8b640 1 -- 172.21.15.5:0/300280297 wait complete. 2024-04-25T08:56:52.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b7406b550 msgr2=0x7f3b7406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b7406b550 0x7f3b7406da10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009bd0 tx=0x7f3b8002f000 comp rx=0 tx=0).stop 2024-04-25T08:56:52.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b880d0a60 msgr2=0x7f3b880cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b880d0a60 0x7f3b880cd500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c3c0 tx=0x7f3b78001e70 comp rx=0 tx=0).stop 2024-04-25T08:56:52.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 shutdown_connections 2024-04-25T08:56:52.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b7406b550 0x7f3b7406da10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b881655d0 0x7f3b88200480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b880d0a60 0x7f3b880cd500 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 --2- 172.21.15.5:0/2831601688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b880cdf00 0x7f3b880b8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 >> 172.21.15.5:0/2831601688 conn(0x7f3b8806b210 msgr2=0x7f3b880b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.213+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 shutdown_connections 2024-04-25T08:56:52.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.214+0000 7f3b6e7fc640 1 -- 172.21.15.5:0/2831601688 wait complete. 2024-04-25T08:56:52.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-04-25T08:56:52.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.214+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff76c005850 con 0x7ff7700039b0 2024-04-25T08:56:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.215+0000 7ff776ffd640 1 -- 172.21.15.5:0/2250960134 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff77807dd60 con 0x7ff7700039b0 2024-04-25T08:56:52.207 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.207 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-04-25T08:56:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff76806b500 msgr2=0x7ff76806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff76806b500 0x7ff76806d9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7800e5e70 tx=0x7ff77c008040 comp rx=0 tx=0).stop 2024-04-25T08:56:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7700039b0 msgr2=0x7ff7800e29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7700039b0 0x7ff7800e29d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff77800c320 tx=0x7ff778001970 comp rx=0 tx=0).stop 2024-04-25T08:56:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 shutdown_connections 2024-04-25T08:56:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff76806b500 0x7ff76806d9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff780180cc0 0x7ff780050470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7800e2f10 0x7ff780180780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 --2- 172.21.15.5:0/2250960134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7700039b0 0x7ff7800e29d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 >> 172.21.15.5:0/2250960134 conn(0x7ff780020030 msgr2=0x7ff78000cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 shutdown_connections 2024-04-25T08:56:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.217+0000 7ff78cfc4640 1 -- 172.21.15.5:0/2250960134 wait complete. 2024-04-25T08:56:52.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-25T08:56:52.210 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-25T08:56:52.220 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-25T08:56:52.221 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-25T08:56:52.223 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-04-25T08:56:52.224 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:52.224 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T08:56:52.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.373+0000 7f9b8fe38640 1 Processor -- start 2024-04-25T08:56:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.373+0000 7f9b8fe38640 1 -- start start 2024-04-25T08:56:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8fe38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b2cc0 0x7f9b880b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8fe38640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b880b7130 0x7f9b880ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8fe38640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880d20e0 con 0x7f9b8815de70 2024-04-25T08:56:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8fe38640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880d2a10 con 0x7f9b880b7130 2024-04-25T08:56:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8fe38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880d23c0 con 0x7f9b880b2cc0 2024-04-25T08:56:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8d3d3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b2cc0 0x7f9b880b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8e3d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b880b7130 0x7f9b880ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8e3d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b880b7130 0x7f9b880ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36698/0 (socket says 172.21.15.5:36698) 2024-04-25T08:56:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8d3d3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b2cc0 0x7f9b880b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:50932/0 (socket says 172.21.15.5:50932) 2024-04-25T08:56:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8e3d5640 1 -- 172.21.15.5:0/2604236091 learned_addr learned my addr 172.21.15.5:0/2604236091 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.374+0000 7f9b8dbd4640 1 --1- 172.21.15.5:0/2604236091 >> v1:172.21.15.80:6789/0 conn(0x7f9b8815de70 0x7f9b880b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:51640/0 (socket says 172.21.15.5:51640) 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.375+0000 7f9b8e3d5640 1 -- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b2cc0 msgr2=0x7f9b880b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.375+0000 7f9b8e3d5640 1 --2- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b2cc0 0x7f9b880b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.375+0000 7f9b8e3d5640 1 -- 172.21.15.5:0/2604236091 >> v1:172.21.15.80:6789/0 conn(0x7f9b8815de70 legacy=0x7f9b880b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.375+0000 7f9b8e3d5640 1 -- 172.21.15.5:0/2604236091 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880d26a0 con 0x7f9b880b7130 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.375+0000 7f9b8d3d3640 1 --2- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b2cc0 0x7f9b880b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.375+0000 7f9b8e3d5640 1 --2- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b880b7130 0x7f9b880ce7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009e50 tx=0x7f9b8002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528e29919c5ed3d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.375+0000 7f9b8cbd2640 1 -- 172.21.15.5:0/2604236091 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80036070 con 0x7f9b880b7130 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8cbd2640 1 -- 172.21.15.5:0/2604236091 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80031600 con 0x7f9b880b7130 2024-04-25T08:56:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8cbd2640 1 -- 172.21.15.5:0/2604236091 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800319d0 con 0x7f9b880b7130 2024-04-25T08:56:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b880b7130 msgr2=0x7f9b880ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b880b7130 0x7f9b880ce7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009e50 tx=0x7f9b8002a710 comp rx=0 tx=0).stop 2024-04-25T08:56:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2604236091 shutdown_connections 2024-04-25T08:56:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b880b7130 0x7f9b880ce7f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2604236091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b2cc0 0x7f9b880b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2604236091 >> 172.21.15.5:0/2604236091 conn(0x7f9b8806b000 msgr2=0x7f9b8806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2604236091 shutdown_connections 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.376+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2604236091 wait complete. 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.377+0000 7f9b8fe38640 1 Processor -- start 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.377+0000 7f9b8fe38640 1 -- start start 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8fe38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b880b2cc0 0x7f9b881f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8fe38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b7130 0x7f9b880c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8fe38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b8815de70 0x7f9b8814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8fe38640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880cf0c0 con 0x7f9b880b2cc0 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8fe38640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880cef40 con 0x7f9b8815de70 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8fe38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880c7d80 con 0x7f9b880b7130 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8dbd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b880b2cc0 0x7f9b881f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8dbd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b880b2cc0 0x7f9b881f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55610/0 (socket says 172.21.15.5:55610) 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8dbd4640 1 -- 172.21.15.5:0/2269142113 learned_addr learned my addr 172.21.15.5:0/2269142113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8e3d5640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b8815de70 0x7f9b8814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8d3d3640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b7130 0x7f9b880c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8dbd4640 1 -- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b7130 msgr2=0x7f9b880c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8dbd4640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b7130 0x7f9b880c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8dbd4640 1 -- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b8815de70 msgr2=0x7f9b8814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.378+0000 7f9b8dbd4640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b8815de70 0x7f9b8814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b8dbd4640 1 -- 172.21.15.5:0/2269142113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b881f6c50 con 0x7f9b880b2cc0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b8e3d5640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b8815de70 0x7f9b8814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b8d3d3640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b7130 0x7f9b880c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b8dbd4640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b880b2cc0 0x7f9b881f6710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b8400c3c0 tx=0x7f9b8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b7e7fc640 1 -- 172.21.15.5:0/2269142113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840074e0 con 0x7f9b880b2cc0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b7e7fc640 1 -- 172.21.15.5:0/2269142113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b84007680 con 0x7f9b880b2cc0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880cd540 con 0x7f9b880b2cc0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b7e7fc640 1 -- 172.21.15.5:0/2269142113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b84004a00 con 0x7f9b880b2cc0 2024-04-25T08:56:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.379+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b880cca60 con 0x7f9b880b2cc0 2024-04-25T08:56:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.380+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8804ef20 con 0x7f9b880b2cc0 2024-04-25T08:56:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.380+0000 7f9b7e7fc640 1 -- 172.21.15.5:0/2269142113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b8401a020 con 0x7f9b880b2cc0 2024-04-25T08:56:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.381+0000 7f9b7e7fc640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b6c06b4d0 0x7f9b6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.381+0000 7f9b7e7fc640 1 -- 172.21.15.5:0/2269142113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b84089a10 con 0x7f9b880b2cc0 2024-04-25T08:56:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.381+0000 7f9b8d3d3640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b6c06b4d0 0x7f9b6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.381+0000 7f9b8d3d3640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b6c06b4d0 0x7f9b6c06d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b88159920 tx=0x7f9b78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.385+0000 7f9b7e7fc640 1 -- 172.21.15.5:0/2269142113 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b84058810 con 0x7f9b880b2cc0 2024-04-25T08:56:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.560+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b88071800 con 0x7f9b6c06b4d0 2024-04-25T08:56:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.567+0000 7f9b7e7fc640 1 -- 172.21.15.5:0/2269142113 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7f9b88071800 con 0x7f9b6c06b4d0 2024-04-25T08:56:52.560 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:56:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b6c06b4d0 msgr2=0x7f9b6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b6c06b4d0 0x7f9b6c06d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b88159920 tx=0x7f9b78008040 comp rx=0 tx=0).stop 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b880b2cc0 msgr2=0x7f9b881f6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b880b2cc0 0x7f9b881f6710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b8400c3c0 tx=0x7f9b8400c880 comp rx=0 tx=0).stop 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 shutdown_connections 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b6c06b4d0 0x7f9b6c06d990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b8815de70 0x7f9b8814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b880b7130 0x7f9b880c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 --2- 172.21.15.5:0/2269142113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b880b2cc0 0x7f9b881f6710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 >> 172.21.15.5:0/2269142113 conn(0x7f9b8806b000 msgr2=0x7f9b880b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 shutdown_connections 2024-04-25T08:56:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.570+0000 7f9b8fe38640 1 -- 172.21.15.5:0/2269142113 wait complete. 2024-04-25T08:56:52.571 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T08:56:52.388796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235656,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739064,"statfs":{"total":773094113280,"available":772852801536,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002229"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312750+0000","last_change":"2024-04-25T08:56:45.214215+0000","last_active":"2024-04-25T08:56:46.312750+0000","last_peered":"2024-04-25T08:56:46.312750+0000","last_clean":"2024-04-25T08:56:46.312750+0000","last_became_active":"2024-04-25T08:56:45.213888+0000","last_became_peered":"2024-04-25T08:56:45.213888+0000","last_unstale":"2024-04-25T08:56:46.312750+0000","last_undegraded":"2024-04-25T08:56:46.312750+0000","last_fullsized":"2024-04-25T08:56:46.312750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:40.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202219+0000","last_change":"2024-04-25T08:56:45.223882+0000","last_active":"2024-04-25T08:56:46.202219+0000","last_peered":"2024-04-25T08:56:46.202219+0000","last_clean":"2024-04-25T08:56:46.202219+0000","last_became_active":"2024-04-25T08:56:45.223600+0000","last_became_peered":"2024-04-25T08:56:45.223600+0000","last_unstale":"2024-04-25T08:56:46.202219+0000","last_undegraded":"2024-04-25T08:56:46.202219+0000","last_fullsized":"2024-04-25T08:56:46.202219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312857+0000","last_change":"2024-04-25T08:56:45.207050+0000","last_active":"2024-04-25T08:56:46.312857+0000","last_peered":"2024-04-25T08:56:46.312857+0000","last_clean":"2024-04-25T08:56:46.312857+0000","last_became_active":"2024-04-25T08:56:45.206781+0000","last_became_peered":"2024-04-25T08:56:45.206781+0000","last_unstale":"2024-04-25T08:56:46.312857+0000","last_undegraded":"2024-04-25T08:56:46.312857+0000","last_fullsized":"2024-04-25T08:56:46.312857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313273+0000","last_change":"2024-04-25T08:56:45.204379+0000","last_active":"2024-04-25T08:56:46.313273+0000","last_peered":"2024-04-25T08:56:46.313273+0000","last_clean":"2024-04-25T08:56:46.313273+0000","last_became_active":"2024-04-25T08:56:45.204046+0000","last_became_peered":"2024-04-25T08:56:45.204046+0000","last_unstale":"2024-04-25T08:56:46.313273+0000","last_undegraded":"2024-04-25T08:56:46.313273+0000","last_fullsized":"2024-04-25T08:56:46.313273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:37.397335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313242+0000","last_change":"2024-04-25T08:56:45.214884+0000","last_active":"2024-04-25T08:56:46.313242+0000","last_peered":"2024-04-25T08:56:46.313242+0000","last_clean":"2024-04-25T08:56:46.313242+0000","last_became_active":"2024-04-25T08:56:45.214584+0000","last_became_peered":"2024-04-25T08:56:45.214584+0000","last_unstale":"2024-04-25T08:56:46.313242+0000","last_undegraded":"2024-04-25T08:56:46.313242+0000","last_fullsized":"2024-04-25T08:56:46.313242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:57.667683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312739+0000","last_change":"2024-04-25T08:56:45.216977+0000","last_active":"2024-04-25T08:56:46.312739+0000","last_peered":"2024-04-25T08:56:46.312739+0000","last_clean":"2024-04-25T08:56:46.312739+0000","last_became_active":"2024-04-25T08:56:45.216691+0000","last_became_peered":"2024-04-25T08:56:45.216691+0000","last_unstale":"2024-04-25T08:56:46.312739+0000","last_undegraded":"2024-04-25T08:56:46.312739+0000","last_fullsized":"2024-04-25T08:56:46.312739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312147+0000","last_change":"2024-04-25T08:56:45.219245+0000","last_active":"2024-04-25T08:56:46.312147+0000","last_peered":"2024-04-25T08:56:46.312147+0000","last_clean":"2024-04-25T08:56:46.312147+0000","last_became_active":"2024-04-25T08:56:45.218966+0000","last_became_peered":"2024-04-25T08:56:45.218966+0000","last_unstale":"2024-04-25T08:56:46.312147+0000","last_undegraded":"2024-04-25T08:56:46.312147+0000","last_fullsized":"2024-04-25T08:56:46.312147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312173+0000","last_change":"2024-04-25T08:56:45.211941+0000","last_active":"2024-04-25T08:56:46.312173+0000","last_peered":"2024-04-25T08:56:46.312173+0000","last_clean":"2024-04-25T08:56:46.312173+0000","last_became_active":"2024-04-25T08:56:45.211654+0000","last_became_peered":"2024-04-25T08:56:45.211654+0000","last_unstale":"2024-04-25T08:56:46.312173+0000","last_undegraded":"2024-04-25T08:56:46.312173+0000","last_fullsized":"2024-04-25T08:56:46.312173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.046928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312926+0000","last_change":"2024-04-25T08:56:45.222927+0000","last_active":"2024-04-25T08:56:46.312926+0000","last_peered":"2024-04-25T08:56:46.312926+0000","last_clean":"2024-04-25T08:56:46.312926+0000","last_became_active":"2024-04-25T08:56:45.222621+0000","last_became_peered":"2024-04-25T08:56:45.222621+0000","last_unstale":"2024-04-25T08:56:46.312926+0000","last_undegraded":"2024-04-25T08:56:46.312926+0000","last_fullsized":"2024-04-25T08:56:46.312926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:54.059797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208198+0000","last_change":"2024-04-25T08:56:45.219827+0000","last_active":"2024-04-25T08:56:46.208198+0000","last_peered":"2024-04-25T08:56:46.208198+0000","last_clean":"2024-04-25T08:56:46.208198+0000","last_became_active":"2024-04-25T08:56:45.219443+0000","last_became_peered":"2024-04-25T08:56:45.219443+0000","last_unstale":"2024-04-25T08:56:46.208198+0000","last_undegraded":"2024-04-25T08:56:46.208198+0000","last_fullsized":"2024-04-25T08:56:46.208198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208115+0000","last_change":"2024-04-25T08:56:45.217372+0000","last_active":"2024-04-25T08:56:46.208115+0000","last_peered":"2024-04-25T08:56:46.208115+0000","last_clean":"2024-04-25T08:56:46.208115+0000","last_became_active":"2024-04-25T08:56:45.217109+0000","last_became_peered":"2024-04-25T08:56:45.217109+0000","last_unstale":"2024-04-25T08:56:46.208115+0000","last_undegraded":"2024-04-25T08:56:46.208115+0000","last_fullsized":"2024-04-25T08:56:46.208115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202878+0000","last_change":"2024-04-25T08:56:45.205751+0000","last_active":"2024-04-25T08:56:46.202878+0000","last_peered":"2024-04-25T08:56:46.202878+0000","last_clean":"2024-04-25T08:56:46.202878+0000","last_became_active":"2024-04-25T08:56:45.205247+0000","last_became_peered":"2024-04-25T08:56:45.205247+0000","last_unstale":"2024-04-25T08:56:46.202878+0000","last_undegraded":"2024-04-25T08:56:46.202878+0000","last_fullsized":"2024-04-25T08:56:46.202878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:13.577419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312640+0000","last_change":"2024-04-25T08:56:45.207035+0000","last_active":"2024-04-25T08:56:46.312640+0000","last_peered":"2024-04-25T08:56:46.312640+0000","last_clean":"2024-04-25T08:56:46.312640+0000","last_became_active":"2024-04-25T08:56:45.206276+0000","last_became_peered":"2024-04-25T08:56:45.206276+0000","last_unstale":"2024-04-25T08:56:46.312640+0000","last_undegraded":"2024-04-25T08:56:46.312640+0000","last_fullsized":"2024-04-25T08:56:46.312640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312187+0000","last_change":"2024-04-25T08:56:45.215524+0000","last_active":"2024-04-25T08:56:46.312187+0000","last_peered":"2024-04-25T08:56:46.312187+0000","last_clean":"2024-04-25T08:56:46.312187+0000","last_became_active":"2024-04-25T08:56:45.215237+0000","last_became_peered":"2024-04-25T08:56:45.215237+0000","last_unstale":"2024-04-25T08:56:46.312187+0000","last_undegraded":"2024-04-25T08:56:46.312187+0000","last_fullsized":"2024-04-25T08:56:46.312187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201999+0000","last_change":"2024-04-25T08:56:45.211498+0000","last_active":"2024-04-25T08:56:46.201999+0000","last_peered":"2024-04-25T08:56:46.201999+0000","last_clean":"2024-04-25T08:56:46.201999+0000","last_became_active":"2024-04-25T08:56:45.210845+0000","last_became_peered":"2024-04-25T08:56:45.210845+0000","last_unstale":"2024-04-25T08:56:46.201999+0000","last_undegraded":"2024-04-25T08:56:46.201999+0000","last_fullsized":"2024-04-25T08:56:46.201999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312644+0000","last_change":"2024-04-25T08:56:45.222046+0000","last_active":"2024-04-25T08:56:46.312644+0000","last_peered":"2024-04-25T08:56:46.312644+0000","last_clean":"2024-04-25T08:56:46.312644+0000","last_became_active":"2024-04-25T08:56:45.221786+0000","last_became_peered":"2024-04-25T08:56:45.221786+0000","last_unstale":"2024-04-25T08:56:46.312644+0000","last_undegraded":"2024-04-25T08:56:46.312644+0000","last_fullsized":"2024-04-25T08:56:46.312644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313399+0000","last_change":"2024-04-25T08:56:45.220510+0000","last_active":"2024-04-25T08:56:46.313399+0000","last_peered":"2024-04-25T08:56:46.313399+0000","last_clean":"2024-04-25T08:56:46.313399+0000","last_became_active":"2024-04-25T08:56:45.218056+0000","last_became_peered":"2024-04-25T08:56:45.218056+0000","last_unstale":"2024-04-25T08:56:46.313399+0000","last_undegraded":"2024-04-25T08:56:46.313399+0000","last_fullsized":"2024-04-25T08:56:46.313399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:54.059797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201473+0000","last_change":"2024-04-25T08:56:45.205595+0000","last_active":"2024-04-25T08:56:46.201473+0000","last_peered":"2024-04-25T08:56:46.201473+0000","last_clean":"2024-04-25T08:56:46.201473+0000","last_became_active":"2024-04-25T08:56:45.205275+0000","last_became_peered":"2024-04-25T08:56:45.205275+0000","last_unstale":"2024-04-25T08:56:46.201473+0000","last_undegraded":"2024-04-25T08:56:46.201473+0000","last_fullsized":"2024-04-25T08:56:46.201473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:33.839170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312741+0000","last_change":"2024-04-25T08:56:45.214789+0000","last_active":"2024-04-25T08:56:46.312741+0000","last_peered":"2024-04-25T08:56:46.312741+0000","last_clean":"2024-04-25T08:56:46.312741+0000","last_became_active":"2024-04-25T08:56:45.214505+0000","last_became_peered":"2024-04-25T08:56:45.214505+0000","last_unstale":"2024-04-25T08:56:46.312741+0000","last_undegraded":"2024-04-25T08:56:46.312741+0000","last_fullsized":"2024-04-25T08:56:46.312741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:43.480760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208010+0000","last_change":"2024-04-25T08:56:45.207623+0000","last_active":"2024-04-25T08:56:46.208010+0000","last_peered":"2024-04-25T08:56:46.208010+0000","last_clean":"2024-04-25T08:56:46.208010+0000","last_became_active":"2024-04-25T08:56:45.207355+0000","last_became_peered":"2024-04-25T08:56:45.207355+0000","last_unstale":"2024-04-25T08:56:46.208010+0000","last_undegraded":"2024-04-25T08:56:46.208010+0000","last_fullsized":"2024-04-25T08:56:46.208010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313039+0000","last_change":"2024-04-25T08:56:45.217625+0000","last_active":"2024-04-25T08:56:46.313039+0000","last_peered":"2024-04-25T08:56:46.313039+0000","last_clean":"2024-04-25T08:56:46.313039+0000","last_became_active":"2024-04-25T08:56:45.217339+0000","last_became_peered":"2024-04-25T08:56:45.217339+0000","last_unstale":"2024-04-25T08:56:46.313039+0000","last_undegraded":"2024-04-25T08:56:46.313039+0000","last_fullsized":"2024-04-25T08:56:46.313039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312884+0000","last_change":"2024-04-25T08:56:45.208901+0000","last_active":"2024-04-25T08:56:46.312884+0000","last_peered":"2024-04-25T08:56:46.312884+0000","last_clean":"2024-04-25T08:56:46.312884+0000","last_became_active":"2024-04-25T08:56:45.208627+0000","last_became_peered":"2024-04-25T08:56:45.208627+0000","last_unstale":"2024-04-25T08:56:46.312884+0000","last_undegraded":"2024-04-25T08:56:46.312884+0000","last_fullsized":"2024-04-25T08:56:46.312884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312527+0000","last_change":"2024-04-25T08:56:45.207471+0000","last_active":"2024-04-25T08:56:46.312527+0000","last_peered":"2024-04-25T08:56:46.312527+0000","last_clean":"2024-04-25T08:56:46.312527+0000","last_became_active":"2024-04-25T08:56:45.207134+0000","last_became_peered":"2024-04-25T08:56:45.207134+0000","last_unstale":"2024-04-25T08:56:46.312527+0000","last_undegraded":"2024-04-25T08:56:46.312527+0000","last_fullsized":"2024-04-25T08:56:46.312527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312799+0000","last_change":"2024-04-25T08:56:45.213278+0000","last_active":"2024-04-25T08:56:46.312799+0000","last_peered":"2024-04-25T08:56:46.312799+0000","last_clean":"2024-04-25T08:56:46.312799+0000","last_became_active":"2024-04-25T08:56:45.212789+0000","last_became_peered":"2024-04-25T08:56:45.212789+0000","last_unstale":"2024-04-25T08:56:46.312799+0000","last_undegraded":"2024-04-25T08:56:46.312799+0000","last_fullsized":"2024-04-25T08:56:46.312799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312402+0000","last_change":"2024-04-25T08:56:45.206688+0000","last_active":"2024-04-25T08:56:46.312402+0000","last_peered":"2024-04-25T08:56:46.312402+0000","last_clean":"2024-04-25T08:56:46.312402+0000","last_became_active":"2024-04-25T08:56:45.205893+0000","last_became_peered":"2024-04-25T08:56:45.205893+0000","last_unstale":"2024-04-25T08:56:46.312402+0000","last_undegraded":"2024-04-25T08:56:46.312402+0000","last_fullsized":"2024-04-25T08:56:46.312402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208267+0000","last_change":"2024-04-25T08:56:45.209708+0000","last_active":"2024-04-25T08:56:46.208267+0000","last_peered":"2024-04-25T08:56:46.208267+0000","last_clean":"2024-04-25T08:56:46.208267+0000","last_became_active":"2024-04-25T08:56:45.209448+0000","last_became_peered":"2024-04-25T08:56:45.209448+0000","last_unstale":"2024-04-25T08:56:46.208267+0000","last_undegraded":"2024-04-25T08:56:46.208267+0000","last_fullsized":"2024-04-25T08:56:46.208267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202250+0000","last_change":"2024-04-25T08:56:45.213535+0000","last_active":"2024-04-25T08:56:46.202250+0000","last_peered":"2024-04-25T08:56:46.202250+0000","last_clean":"2024-04-25T08:56:46.202250+0000","last_became_active":"2024-04-25T08:56:45.213239+0000","last_became_peered":"2024-04-25T08:56:45.213239+0000","last_unstale":"2024-04-25T08:56:46.202250+0000","last_undegraded":"2024-04-25T08:56:46.202250+0000","last_fullsized":"2024-04-25T08:56:46.202250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312923+0000","last_change":"2024-04-25T08:56:45.207576+0000","last_active":"2024-04-25T08:56:46.312923+0000","last_peered":"2024-04-25T08:56:46.312923+0000","last_clean":"2024-04-25T08:56:46.312923+0000","last_became_active":"2024-04-25T08:56:45.206807+0000","last_became_peered":"2024-04-25T08:56:45.206807+0000","last_unstale":"2024-04-25T08:56:46.312923+0000","last_undegraded":"2024-04-25T08:56:46.312923+0000","last_fullsized":"2024-04-25T08:56:46.312923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313032+0000","last_change":"2024-04-25T08:56:45.209841+0000","last_active":"2024-04-25T08:56:46.313032+0000","last_peered":"2024-04-25T08:56:46.313032+0000","last_clean":"2024-04-25T08:56:46.313032+0000","last_became_active":"2024-04-25T08:56:45.209571+0000","last_became_peered":"2024-04-25T08:56:45.209571+0000","last_unstale":"2024-04-25T08:56:46.313032+0000","last_undegraded":"2024-04-25T08:56:46.313032+0000","last_fullsized":"2024-04-25T08:56:46.313032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313341+0000","last_change":"2024-04-25T08:56:45.211522+0000","last_active":"2024-04-25T08:56:46.313341+0000","last_peered":"2024-04-25T08:56:46.313341+0000","last_clean":"2024-04-25T08:56:46.313341+0000","last_became_active":"2024-04-25T08:56:45.211239+0000","last_became_peered":"2024-04-25T08:56:45.211239+0000","last_unstale":"2024-04-25T08:56:46.313341+0000","last_undegraded":"2024-04-25T08:56:46.313341+0000","last_fullsized":"2024-04-25T08:56:46.313341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:43.480760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201271+0000","last_change":"2024-04-25T08:56:45.217257+0000","last_active":"2024-04-25T08:56:46.201271+0000","last_peered":"2024-04-25T08:56:46.201271+0000","last_clean":"2024-04-25T08:56:46.201271+0000","last_became_active":"2024-04-25T08:56:45.216898+0000","last_became_peered":"2024-04-25T08:56:45.216898+0000","last_unstale":"2024-04-25T08:56:46.201271+0000","last_undegraded":"2024-04-25T08:56:46.201271+0000","last_fullsized":"2024-04-25T08:56:46.201271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207823+0000","last_change":"2024-04-25T08:56:45.219777+0000","last_active":"2024-04-25T08:56:46.207823+0000","last_peered":"2024-04-25T08:56:46.207823+0000","last_clean":"2024-04-25T08:56:46.207823+0000","last_became_active":"2024-04-25T08:56:45.218541+0000","last_became_peered":"2024-04-25T08:56:45.218541+0000","last_unstale":"2024-04-25T08:56:46.207823+0000","last_undegraded":"2024-04-25T08:56:46.207823+0000","last_fullsized":"2024-04-25T08:56:46.207823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202756+0000","last_change":"2024-04-25T08:56:45.211649+0000","last_active":"2024-04-25T08:56:46.202756+0000","last_peered":"2024-04-25T08:56:46.202756+0000","last_clean":"2024-04-25T08:56:46.202756+0000","last_became_active":"2024-04-25T08:56:45.211344+0000","last_became_peered":"2024-04-25T08:56:45.211344+0000","last_unstale":"2024-04-25T08:56:46.202756+0000","last_undegraded":"2024-04-25T08:56:46.202756+0000","last_fullsized":"2024-04-25T08:56:46.202756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:22.869310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312755+0000","last_change":"2024-04-25T08:56:44.214502+0000","last_active":"2024-04-25T08:56:46.312755+0000","last_peered":"2024-04-25T08:56:46.312755+0000","last_clean":"2024-04-25T08:56:46.312755+0000","last_became_active":"2024-04-25T08:56:44.214144+0000","last_became_peered":"2024-04-25T08:56:44.214144+0000","last_unstale":"2024-04-25T08:56:46.312755+0000","last_undegraded":"2024-04-25T08:56:46.312755+0000","last_fullsized":"2024-04-25T08:56:46.312755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:59.869328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313200+0000","last_change":"2024-04-25T08:56:45.210462+0000","last_active":"2024-04-25T08:56:46.313200+0000","last_peered":"2024-04-25T08:56:46.313200+0000","last_clean":"2024-04-25T08:56:46.313200+0000","last_became_active":"2024-04-25T08:56:45.210182+0000","last_became_peered":"2024-04-25T08:56:45.210182+0000","last_unstale":"2024-04-25T08:56:46.313200+0000","last_undegraded":"2024-04-25T08:56:46.313200+0000","last_fullsized":"2024-04-25T08:56:46.313200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207842+0000","last_change":"2024-04-25T08:56:44.208738+0000","last_active":"2024-04-25T08:56:46.207842+0000","last_peered":"2024-04-25T08:56:46.207842+0000","last_clean":"2024-04-25T08:56:46.207842+0000","last_became_active":"2024-04-25T08:56:44.208463+0000","last_became_peered":"2024-04-25T08:56:44.208463+0000","last_unstale":"2024-04-25T08:56:46.207842+0000","last_undegraded":"2024-04-25T08:56:46.207842+0000","last_fullsized":"2024-04-25T08:56:46.207842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312653+0000","last_change":"2024-04-25T08:56:44.211862+0000","last_active":"2024-04-25T08:56:46.312653+0000","last_peered":"2024-04-25T08:56:46.312653+0000","last_clean":"2024-04-25T08:56:46.312653+0000","last_became_active":"2024-04-25T08:56:44.211570+0000","last_became_peered":"2024-04-25T08:56:44.211570+0000","last_unstale":"2024-04-25T08:56:46.312653+0000","last_undegraded":"2024-04-25T08:56:46.312653+0000","last_fullsized":"2024-04-25T08:56:46.312653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:46.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313056+0000","last_change":"2024-04-25T08:56:45.219509+0000","last_active":"2024-04-25T08:56:46.313056+0000","last_peered":"2024-04-25T08:56:46.313056+0000","last_clean":"2024-04-25T08:56:46.313056+0000","last_became_active":"2024-04-25T08:56:45.219154+0000","last_became_peered":"2024-04-25T08:56:45.219154+0000","last_unstale":"2024-04-25T08:56:46.313056+0000","last_undegraded":"2024-04-25T08:56:46.313056+0000","last_fullsized":"2024-04-25T08:56:46.313056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312752+0000","last_change":"2024-04-25T08:56:44.200599+0000","last_active":"2024-04-25T08:56:46.312752+0000","last_peered":"2024-04-25T08:56:46.312752+0000","last_clean":"2024-04-25T08:56:46.312752+0000","last_became_active":"2024-04-25T08:56:44.200191+0000","last_became_peered":"2024-04-25T08:56:44.200191+0000","last_unstale":"2024-04-25T08:56:46.312752+0000","last_undegraded":"2024-04-25T08:56:46.312752+0000","last_fullsized":"2024-04-25T08:56:46.312752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202126+0000","last_change":"2024-04-25T08:56:45.211808+0000","last_active":"2024-04-25T08:56:46.202126+0000","last_peered":"2024-04-25T08:56:46.202126+0000","last_clean":"2024-04-25T08:56:46.202126+0000","last_became_active":"2024-04-25T08:56:45.211189+0000","last_became_peered":"2024-04-25T08:56:45.211189+0000","last_unstale":"2024-04-25T08:56:46.202126+0000","last_undegraded":"2024-04-25T08:56:46.202126+0000","last_fullsized":"2024-04-25T08:56:46.202126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208129+0000","last_change":"2024-04-25T08:56:44.205653+0000","last_active":"2024-04-25T08:56:46.208129+0000","last_peered":"2024-04-25T08:56:46.208129+0000","last_clean":"2024-04-25T08:56:46.208129+0000","last_became_active":"2024-04-25T08:56:44.205360+0000","last_became_peered":"2024-04-25T08:56:44.205360+0000","last_unstale":"2024-04-25T08:56:46.208129+0000","last_undegraded":"2024-04-25T08:56:46.208129+0000","last_fullsized":"2024-04-25T08:56:46.208129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313249+0000","last_change":"2024-04-25T08:56:45.208313+0000","last_active":"2024-04-25T08:56:46.313249+0000","last_peered":"2024-04-25T08:56:46.313249+0000","last_clean":"2024-04-25T08:56:46.313249+0000","last_became_active":"2024-04-25T08:56:45.207996+0000","last_became_peered":"2024-04-25T08:56:45.207996+0000","last_unstale":"2024-04-25T08:56:46.313249+0000","last_undegraded":"2024-04-25T08:56:46.313249+0000","last_fullsized":"2024-04-25T08:56:46.313249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313024+0000","last_change":"2024-04-25T08:56:44.208544+0000","last_active":"2024-04-25T08:56:46.313024+0000","last_peered":"2024-04-25T08:56:46.313024+0000","last_clean":"2024-04-25T08:56:46.313024+0000","last_became_active":"2024-04-25T08:56:44.208279+0000","last_became_peered":"2024-04-25T08:56:44.208279+0000","last_unstale":"2024-04-25T08:56:46.313024+0000","last_undegraded":"2024-04-25T08:56:46.313024+0000","last_fullsized":"2024-04-25T08:56:46.313024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313098+0000","last_change":"2024-04-25T08:56:45.224921+0000","last_active":"2024-04-25T08:56:46.313098+0000","last_peered":"2024-04-25T08:56:46.313098+0000","last_clean":"2024-04-25T08:56:46.313098+0000","last_became_active":"2024-04-25T08:56:45.224477+0000","last_became_peered":"2024-04-25T08:56:45.224477+0000","last_unstale":"2024-04-25T08:56:46.313098+0000","last_undegraded":"2024-04-25T08:56:46.313098+0000","last_fullsized":"2024-04-25T08:56:46.313098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202246+0000","last_change":"2024-04-25T08:56:44.210451+0000","last_active":"2024-04-25T08:56:46.202246+0000","last_peered":"2024-04-25T08:56:46.202246+0000","last_clean":"2024-04-25T08:56:46.202246+0000","last_became_active":"2024-04-25T08:56:44.210149+0000","last_became_peered":"2024-04-25T08:56:44.210149+0000","last_unstale":"2024-04-25T08:56:46.202246+0000","last_undegraded":"2024-04-25T08:56:46.202246+0000","last_fullsized":"2024-04-25T08:56:46.202246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202999+0000","last_change":"2024-04-25T08:56:45.215179+0000","last_active":"2024-04-25T08:56:46.202999+0000","last_peered":"2024-04-25T08:56:46.202999+0000","last_clean":"2024-04-25T08:56:46.202999+0000","last_became_active":"2024-04-25T08:56:45.214913+0000","last_became_peered":"2024-04-25T08:56:45.214913+0000","last_unstale":"2024-04-25T08:56:46.202999+0000","last_undegraded":"2024-04-25T08:56:46.202999+0000","last_fullsized":"2024-04-25T08:56:46.202999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:51.875796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207952+0000","last_change":"2024-04-25T08:56:44.211758+0000","last_active":"2024-04-25T08:56:46.207952+0000","last_peered":"2024-04-25T08:56:46.207952+0000","last_clean":"2024-04-25T08:56:46.207952+0000","last_became_active":"2024-04-25T08:56:44.211556+0000","last_became_peered":"2024-04-25T08:56:44.211556+0000","last_unstale":"2024-04-25T08:56:46.207952+0000","last_undegraded":"2024-04-25T08:56:46.207952+0000","last_fullsized":"2024-04-25T08:56:46.207952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312667+0000","last_change":"2024-04-25T08:56:45.212558+0000","last_active":"2024-04-25T08:56:46.312667+0000","last_peered":"2024-04-25T08:56:46.312667+0000","last_clean":"2024-04-25T08:56:46.312667+0000","last_became_active":"2024-04-25T08:56:45.212258+0000","last_became_peered":"2024-04-25T08:56:45.212258+0000","last_unstale":"2024-04-25T08:56:46.312667+0000","last_undegraded":"2024-04-25T08:56:46.312667+0000","last_fullsized":"2024-04-25T08:56:46.312667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.819156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313161+0000","last_change":"2024-04-25T08:56:44.203992+0000","last_active":"2024-04-25T08:56:46.313161+0000","last_peered":"2024-04-25T08:56:46.313161+0000","last_clean":"2024-04-25T08:56:46.313161+0000","last_became_active":"2024-04-25T08:56:44.203708+0000","last_became_peered":"2024-04-25T08:56:44.203708+0000","last_unstale":"2024-04-25T08:56:46.313161+0000","last_undegraded":"2024-04-25T08:56:46.313161+0000","last_fullsized":"2024-04-25T08:56:46.313161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:58.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312991+0000","last_change":"2024-04-25T08:56:45.216900+0000","last_active":"2024-04-25T08:56:46.312991+0000","last_peered":"2024-04-25T08:56:46.312991+0000","last_clean":"2024-04-25T08:56:46.312991+0000","last_became_active":"2024-04-25T08:56:45.216635+0000","last_became_peered":"2024-04-25T08:56:45.216635+0000","last_unstale":"2024-04-25T08:56:46.312991+0000","last_undegraded":"2024-04-25T08:56:46.312991+0000","last_fullsized":"2024-04-25T08:56:46.312991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.046928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313390+0000","last_change":"2024-04-25T08:56:44.207778+0000","last_active":"2024-04-25T08:56:46.313390+0000","last_peered":"2024-04-25T08:56:46.313390+0000","last_clean":"2024-04-25T08:56:46.313390+0000","last_became_active":"2024-04-25T08:56:44.207350+0000","last_became_peered":"2024-04-25T08:56:44.207350+0000","last_unstale":"2024-04-25T08:56:46.313390+0000","last_undegraded":"2024-04-25T08:56:46.313390+0000","last_fullsized":"2024-04-25T08:56:46.313390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312668+0000","last_change":"2024-04-25T08:56:45.217676+0000","last_active":"2024-04-25T08:56:46.312668+0000","last_peered":"2024-04-25T08:56:46.312668+0000","last_clean":"2024-04-25T08:56:46.312668+0000","last_became_active":"2024-04-25T08:56:45.217175+0000","last_became_peered":"2024-04-25T08:56:45.217175+0000","last_unstale":"2024-04-25T08:56:46.312668+0000","last_undegraded":"2024-04-25T08:56:46.312668+0000","last_fullsized":"2024-04-25T08:56:46.312668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:37.397335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207779+0000","last_change":"2024-04-25T08:56:44.207850+0000","last_active":"2024-04-25T08:56:46.207779+0000","last_peered":"2024-04-25T08:56:46.207779+0000","last_clean":"2024-04-25T08:56:46.207779+0000","last_became_active":"2024-04-25T08:56:44.207520+0000","last_became_peered":"2024-04-25T08:56:44.207520+0000","last_unstale":"2024-04-25T08:56:46.207779+0000","last_undegraded":"2024-04-25T08:56:46.207779+0000","last_fullsized":"2024-04-25T08:56:46.207779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207823+0000","last_change":"2024-04-25T08:56:45.218163+0000","last_active":"2024-04-25T08:56:46.207823+0000","last_peered":"2024-04-25T08:56:46.207823+0000","last_clean":"2024-04-25T08:56:46.207823+0000","last_became_active":"2024-04-25T08:56:45.217700+0000","last_became_peered":"2024-04-25T08:56:45.217700+0000","last_unstale":"2024-04-25T08:56:46.207823+0000","last_undegraded":"2024-04-25T08:56:46.207823+0000","last_fullsized":"2024-04-25T08:56:46.207823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201199+0000","last_change":"2024-04-25T08:56:44.205778+0000","last_active":"2024-04-25T08:56:46.201199+0000","last_peered":"2024-04-25T08:56:46.201199+0000","last_clean":"2024-04-25T08:56:46.201199+0000","last_became_active":"2024-04-25T08:56:44.205483+0000","last_became_peered":"2024-04-25T08:56:44.205483+0000","last_unstale":"2024-04-25T08:56:46.201199+0000","last_undegraded":"2024-04-25T08:56:46.201199+0000","last_fullsized":"2024-04-25T08:56:46.201199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:46.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312166+0000","last_change":"2024-04-25T08:56:45.211144+0000","last_active":"2024-04-25T08:56:46.312166+0000","last_peered":"2024-04-25T08:56:46.312166+0000","last_clean":"2024-04-25T08:56:46.312166+0000","last_became_active":"2024-04-25T08:56:45.210768+0000","last_became_peered":"2024-04-25T08:56:45.210768+0000","last_unstale":"2024-04-25T08:56:46.312166+0000","last_undegraded":"2024-04-25T08:56:46.312166+0000","last_fullsized":"2024-04-25T08:56:46.312166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202956+0000","last_change":"2024-04-25T08:56:44.207687+0000","last_active":"2024-04-25T08:56:46.202956+0000","last_peered":"2024-04-25T08:56:46.202956+0000","last_clean":"2024-04-25T08:56:46.202956+0000","last_became_active":"2024-04-25T08:56:44.207385+0000","last_became_peered":"2024-04-25T08:56:44.207385+0000","last_unstale":"2024-04-25T08:56:46.202956+0000","last_undegraded":"2024-04-25T08:56:46.202956+0000","last_fullsized":"2024-04-25T08:56:46.202956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:46.762190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312589+0000","last_change":"2024-04-25T08:56:45.212331+0000","last_active":"2024-04-25T08:56:46.312589+0000","last_peered":"2024-04-25T08:56:46.312589+0000","last_clean":"2024-04-25T08:56:46.312589+0000","last_became_active":"2024-04-25T08:56:45.212031+0000","last_became_peered":"2024-04-25T08:56:45.212031+0000","last_unstale":"2024-04-25T08:56:46.312589+0000","last_undegraded":"2024-04-25T08:56:46.312589+0000","last_fullsized":"2024-04-25T08:56:46.312589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201454+0000","last_change":"2024-04-25T08:56:44.208898+0000","last_active":"2024-04-25T08:56:46.201454+0000","last_peered":"2024-04-25T08:56:46.201454+0000","last_clean":"2024-04-25T08:56:46.201454+0000","last_became_active":"2024-04-25T08:56:44.208607+0000","last_became_peered":"2024-04-25T08:56:44.208607+0000","last_unstale":"2024-04-25T08:56:46.201454+0000","last_undegraded":"2024-04-25T08:56:46.201454+0000","last_fullsized":"2024-04-25T08:56:46.201454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312973+0000","last_change":"2024-04-25T08:56:45.217243+0000","last_active":"2024-04-25T08:56:46.312973+0000","last_peered":"2024-04-25T08:56:46.312973+0000","last_clean":"2024-04-25T08:56:46.312973+0000","last_became_active":"2024-04-25T08:56:45.216943+0000","last_became_peered":"2024-04-25T08:56:45.216943+0000","last_unstale":"2024-04-25T08:56:46.312973+0000","last_undegraded":"2024-04-25T08:56:46.312973+0000","last_fullsized":"2024-04-25T08:56:46.312973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:53.035287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202338+0000","last_change":"2024-04-25T08:56:44.207711+0000","last_active":"2024-04-25T08:56:46.202338+0000","last_peered":"2024-04-25T08:56:46.202338+0000","last_clean":"2024-04-25T08:56:46.202338+0000","last_became_active":"2024-04-25T08:56:44.207001+0000","last_became_peered":"2024-04-25T08:56:44.207001+0000","last_unstale":"2024-04-25T08:56:46.202338+0000","last_undegraded":"2024-04-25T08:56:46.202338+0000","last_fullsized":"2024-04-25T08:56:46.202338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:32.834402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313464+0000","last_change":"2024-04-25T08:56:45.210543+0000","last_active":"2024-04-25T08:56:46.313464+0000","last_peered":"2024-04-25T08:56:46.313464+0000","last_clean":"2024-04-25T08:56:46.313464+0000","last_became_active":"2024-04-25T08:56:45.210276+0000","last_became_peered":"2024-04-25T08:56:45.210276+0000","last_unstale":"2024-04-25T08:56:46.313464+0000","last_undegraded":"2024-04-25T08:56:46.313464+0000","last_fullsized":"2024-04-25T08:56:46.313464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:53.035287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201395+0000","last_change":"2024-04-25T08:56:44.203045+0000","last_active":"2024-04-25T08:56:46.201395+0000","last_peered":"2024-04-25T08:56:46.201395+0000","last_clean":"2024-04-25T08:56:46.201395+0000","last_became_active":"2024-04-25T08:56:44.202649+0000","last_became_peered":"2024-04-25T08:56:44.202649+0000","last_unstale":"2024-04-25T08:56:46.201395+0000","last_undegraded":"2024-04-25T08:56:46.201395+0000","last_fullsized":"2024-04-25T08:56:46.201395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:08.626305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312471+0000","last_change":"2024-04-25T08:56:45.221348+0000","last_active":"2024-04-25T08:56:46.312471+0000","last_peered":"2024-04-25T08:56:46.312471+0000","last_clean":"2024-04-25T08:56:46.312471+0000","last_became_active":"2024-04-25T08:56:45.221025+0000","last_became_peered":"2024-04-25T08:56:45.221025+0000","last_unstale":"2024-04-25T08:56:46.312471+0000","last_undegraded":"2024-04-25T08:56:46.312471+0000","last_fullsized":"2024-04-25T08:56:46.312471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312137+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:56:46.312137+0000","last_peered":"2024-04-25T08:56:46.312137+0000","last_clean":"2024-04-25T08:56:46.312137+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:56:46.312137+0000","last_undegraded":"2024-04-25T08:56:46.312137+0000","last_fullsized":"2024-04-25T08:56:46.312137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312814+0000","last_change":"2024-04-25T08:56:44.200807+0000","last_active":"2024-04-25T08:56:46.312814+0000","last_peered":"2024-04-25T08:56:46.312814+0000","last_clean":"2024-04-25T08:56:46.312814+0000","last_became_active":"2024-04-25T08:56:44.200035+0000","last_became_peered":"2024-04-25T08:56:44.200035+0000","last_unstale":"2024-04-25T08:56:46.312814+0000","last_undegraded":"2024-04-25T08:56:46.312814+0000","last_fullsized":"2024-04-25T08:56:46.312814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:08.626305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312931+0000","last_change":"2024-04-25T08:56:45.211720+0000","last_active":"2024-04-25T08:56:46.312931+0000","last_peered":"2024-04-25T08:56:46.312931+0000","last_clean":"2024-04-25T08:56:46.312931+0000","last_became_active":"2024-04-25T08:56:45.211423+0000","last_became_peered":"2024-04-25T08:56:45.211423+0000","last_unstale":"2024-04-25T08:56:46.312931+0000","last_undegraded":"2024-04-25T08:56:46.312931+0000","last_fullsized":"2024-04-25T08:56:46.312931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312074+0000","last_change":"2024-04-25T08:56:44.214689+0000","last_active":"2024-04-25T08:56:46.312074+0000","last_peered":"2024-04-25T08:56:46.312074+0000","last_clean":"2024-04-25T08:56:46.312074+0000","last_became_active":"2024-04-25T08:56:44.214419+0000","last_became_peered":"2024-04-25T08:56:44.214419+0000","last_unstale":"2024-04-25T08:56:46.312074+0000","last_undegraded":"2024-04-25T08:56:46.312074+0000","last_fullsized":"2024-04-25T08:56:46.312074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312174+0000","last_change":"2024-04-25T08:56:45.207245+0000","last_active":"2024-04-25T08:56:46.312174+0000","last_peered":"2024-04-25T08:56:46.312174+0000","last_clean":"2024-04-25T08:56:46.312174+0000","last_became_active":"2024-04-25T08:56:45.206744+0000","last_became_peered":"2024-04-25T08:56:45.206744+0000","last_unstale":"2024-04-25T08:56:46.312174+0000","last_undegraded":"2024-04-25T08:56:46.312174+0000","last_fullsized":"2024-04-25T08:56:46.312174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:34.740579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201303+0000","last_change":"2024-04-25T08:56:44.209586+0000","last_active":"2024-04-25T08:56:46.201303+0000","last_peered":"2024-04-25T08:56:46.201303+0000","last_clean":"2024-04-25T08:56:46.201303+0000","last_became_active":"2024-04-25T08:56:44.209270+0000","last_became_peered":"2024-04-25T08:56:44.209270+0000","last_unstale":"2024-04-25T08:56:46.201303+0000","last_undegraded":"2024-04-25T08:56:46.201303+0000","last_fullsized":"2024-04-25T08:56:46.201303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201993+0000","last_change":"2024-04-25T08:56:45.212305+0000","last_active":"2024-04-25T08:56:46.201993+0000","last_peered":"2024-04-25T08:56:46.201993+0000","last_clean":"2024-04-25T08:56:46.201993+0000","last_became_active":"2024-04-25T08:56:45.210796+0000","last_became_peered":"2024-04-25T08:56:45.210796+0000","last_unstale":"2024-04-25T08:56:46.201993+0000","last_undegraded":"2024-04-25T08:56:46.201993+0000","last_fullsized":"2024-04-25T08:56:46.201993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313436+0000","last_change":"2024-04-25T08:56:44.208927+0000","last_active":"2024-04-25T08:56:46.313436+0000","last_peered":"2024-04-25T08:56:46.313436+0000","last_clean":"2024-04-25T08:56:46.313436+0000","last_became_active":"2024-04-25T08:56:44.208247+0000","last_became_peered":"2024-04-25T08:56:44.208247+0000","last_unstale":"2024-04-25T08:56:46.313436+0000","last_undegraded":"2024-04-25T08:56:46.313436+0000","last_fullsized":"2024-04-25T08:56:46.313436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202914+0000","last_change":"2024-04-25T08:56:45.215544+0000","last_active":"2024-04-25T08:56:46.202914+0000","last_peered":"2024-04-25T08:56:46.202914+0000","last_clean":"2024-04-25T08:56:46.202914+0000","last_became_active":"2024-04-25T08:56:45.215254+0000","last_became_peered":"2024-04-25T08:56:45.215254+0000","last_unstale":"2024-04-25T08:56:46.202914+0000","last_undegraded":"2024-04-25T08:56:46.202914+0000","last_fullsized":"2024-04-25T08:56:46.202914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:07.425213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202106+0000","last_change":"2024-04-25T08:56:44.208338+0000","last_active":"2024-04-25T08:56:46.202106+0000","last_peered":"2024-04-25T08:56:46.202106+0000","last_clean":"2024-04-25T08:56:46.202106+0000","last_became_active":"2024-04-25T08:56:44.208015+0000","last_became_peered":"2024-04-25T08:56:44.208015+0000","last_unstale":"2024-04-25T08:56:46.202106+0000","last_undegraded":"2024-04-25T08:56:46.202106+0000","last_fullsized":"2024-04-25T08:56:46.202106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313288+0000","last_change":"2024-04-25T08:56:45.214759+0000","last_active":"2024-04-25T08:56:46.313288+0000","last_peered":"2024-04-25T08:56:46.313288+0000","last_clean":"2024-04-25T08:56:46.313288+0000","last_became_active":"2024-04-25T08:56:45.212500+0000","last_became_peered":"2024-04-25T08:56:45.212500+0000","last_unstale":"2024-04-25T08:56:46.313288+0000","last_undegraded":"2024-04-25T08:56:46.313288+0000","last_fullsized":"2024-04-25T08:56:46.313288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.819156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312834+0000","last_change":"2024-04-25T08:56:44.214874+0000","last_active":"2024-04-25T08:56:46.312834+0000","last_peered":"2024-04-25T08:56:46.312834+0000","last_clean":"2024-04-25T08:56:46.312834+0000","last_became_active":"2024-04-25T08:56:44.214468+0000","last_became_peered":"2024-04-25T08:56:44.214468+0000","last_unstale":"2024-04-25T08:56:46.312834+0000","last_undegraded":"2024-04-25T08:56:46.312834+0000","last_fullsized":"2024-04-25T08:56:46.312834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:32.834402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202189+0000","last_change":"2024-04-25T08:56:45.210674+0000","last_active":"2024-04-25T08:56:46.202189+0000","last_peered":"2024-04-25T08:56:46.202189+0000","last_clean":"2024-04-25T08:56:46.202189+0000","last_became_active":"2024-04-25T08:56:45.210330+0000","last_became_peered":"2024-04-25T08:56:45.210330+0000","last_unstale":"2024-04-25T08:56:46.202189+0000","last_undegraded":"2024-04-25T08:56:46.202189+0000","last_fullsized":"2024-04-25T08:56:46.202189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207197+0000","last_change":"2024-04-25T08:56:44.212498+0000","last_active":"2024-04-25T08:56:46.207197+0000","last_peered":"2024-04-25T08:56:46.207197+0000","last_clean":"2024-04-25T08:56:46.207197+0000","last_became_active":"2024-04-25T08:56:44.212180+0000","last_became_peered":"2024-04-25T08:56:44.212180+0000","last_unstale":"2024-04-25T08:56:46.207197+0000","last_undegraded":"2024-04-25T08:56:46.207197+0000","last_fullsized":"2024-04-25T08:56:46.207197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312549+0000","last_change":"2024-04-25T08:56:45.218534+0000","last_active":"2024-04-25T08:56:46.312549+0000","last_peered":"2024-04-25T08:56:46.312549+0000","last_clean":"2024-04-25T08:56:46.312549+0000","last_became_active":"2024-04-25T08:56:45.218166+0000","last_became_peered":"2024-04-25T08:56:45.218166+0000","last_unstale":"2024-04-25T08:56:46.312549+0000","last_undegraded":"2024-04-25T08:56:46.312549+0000","last_fullsized":"2024-04-25T08:56:46.312549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208185+0000","last_change":"2024-04-25T08:56:44.211242+0000","last_active":"2024-04-25T08:56:46.208185+0000","last_peered":"2024-04-25T08:56:46.208185+0000","last_clean":"2024-04-25T08:56:46.208185+0000","last_became_active":"2024-04-25T08:56:44.210967+0000","last_became_peered":"2024-04-25T08:56:44.210967+0000","last_unstale":"2024-04-25T08:56:46.208185+0000","last_undegraded":"2024-04-25T08:56:46.208185+0000","last_fullsized":"2024-04-25T08:56:46.208185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312699+0000","last_change":"2024-04-25T08:56:45.214551+0000","last_active":"2024-04-25T08:56:46.312699+0000","last_peered":"2024-04-25T08:56:46.312699+0000","last_clean":"2024-04-25T08:56:46.312699+0000","last_became_active":"2024-04-25T08:56:45.214250+0000","last_became_peered":"2024-04-25T08:56:45.214250+0000","last_unstale":"2024-04-25T08:56:46.312699+0000","last_undegraded":"2024-04-25T08:56:46.312699+0000","last_fullsized":"2024-04-25T08:56:46.312699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:38.844974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312069+0000","last_change":"2024-04-25T08:56:44.215078+0000","last_active":"2024-04-25T08:56:46.312069+0000","last_peered":"2024-04-25T08:56:46.312069+0000","last_clean":"2024-04-25T08:56:46.312069+0000","last_became_active":"2024-04-25T08:56:44.214389+0000","last_became_peered":"2024-04-25T08:56:44.214389+0000","last_unstale":"2024-04-25T08:56:46.312069+0000","last_undegraded":"2024-04-25T08:56:46.312069+0000","last_fullsized":"2024-04-25T08:56:46.312069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.203031+0000","last_change":"2024-04-25T08:56:45.200378+0000","last_active":"2024-04-25T08:56:46.203031+0000","last_peered":"2024-04-25T08:56:46.203031+0000","last_clean":"2024-04-25T08:56:46.203031+0000","last_became_active":"2024-04-25T08:56:45.200097+0000","last_became_peered":"2024-04-25T08:56:45.200097+0000","last_unstale":"2024-04-25T08:56:46.203031+0000","last_undegraded":"2024-04-25T08:56:46.203031+0000","last_fullsized":"2024-04-25T08:56:46.203031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202120+0000","last_change":"2024-04-25T08:56:44.207693+0000","last_active":"2024-04-25T08:56:46.202120+0000","last_peered":"2024-04-25T08:56:46.202120+0000","last_clean":"2024-04-25T08:56:46.202120+0000","last_became_active":"2024-04-25T08:56:44.207401+0000","last_became_peered":"2024-04-25T08:56:44.207401+0000","last_unstale":"2024-04-25T08:56:46.202120+0000","last_undegraded":"2024-04-25T08:56:46.202120+0000","last_fullsized":"2024-04-25T08:56:46.202120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313184+0000","last_change":"2024-04-25T08:56:45.215069+0000","last_active":"2024-04-25T08:56:46.313184+0000","last_peered":"2024-04-25T08:56:46.313184+0000","last_clean":"2024-04-25T08:56:46.313184+0000","last_became_active":"2024-04-25T08:56:45.214326+0000","last_became_peered":"2024-04-25T08:56:45.214326+0000","last_unstale":"2024-04-25T08:56:46.313184+0000","last_undegraded":"2024-04-25T08:56:46.313184+0000","last_fullsized":"2024-04-25T08:56:46.313184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202098+0000","last_change":"2024-04-25T08:56:44.210794+0000","last_active":"2024-04-25T08:56:46.202098+0000","last_peered":"2024-04-25T08:56:46.202098+0000","last_clean":"2024-04-25T08:56:46.202098+0000","last_became_active":"2024-04-25T08:56:44.210493+0000","last_became_peered":"2024-04-25T08:56:44.210493+0000","last_unstale":"2024-04-25T08:56:46.202098+0000","last_undegraded":"2024-04-25T08:56:46.202098+0000","last_fullsized":"2024-04-25T08:56:46.202098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312764+0000","last_change":"2024-04-25T08:56:45.215033+0000","last_active":"2024-04-25T08:56:46.312764+0000","last_peered":"2024-04-25T08:56:46.312764+0000","last_clean":"2024-04-25T08:56:46.312764+0000","last_became_active":"2024-04-25T08:56:45.214737+0000","last_became_peered":"2024-04-25T08:56:45.214737+0000","last_unstale":"2024-04-25T08:56:46.312764+0000","last_undegraded":"2024-04-25T08:56:46.312764+0000","last_fullsized":"2024-04-25T08:56:46.312764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312808+0000","last_change":"2024-04-25T08:56:44.214790+0000","last_active":"2024-04-25T08:56:46.312808+0000","last_peered":"2024-04-25T08:56:46.312808+0000","last_clean":"2024-04-25T08:56:46.312808+0000","last_became_active":"2024-04-25T08:56:44.214065+0000","last_became_peered":"2024-04-25T08:56:44.214065+0000","last_unstale":"2024-04-25T08:56:46.312808+0000","last_undegraded":"2024-04-25T08:56:46.312808+0000","last_fullsized":"2024-04-25T08:56:46.312808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207833+0000","last_change":"2024-04-25T08:56:45.206755+0000","last_active":"2024-04-25T08:56:46.207833+0000","last_peered":"2024-04-25T08:56:46.207833+0000","last_clean":"2024-04-25T08:56:46.207833+0000","last_became_active":"2024-04-25T08:56:45.206478+0000","last_became_peered":"2024-04-25T08:56:45.206478+0000","last_unstale":"2024-04-25T08:56:46.207833+0000","last_undegraded":"2024-04-25T08:56:46.207833+0000","last_fullsized":"2024-04-25T08:56:46.207833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313135+0000","last_change":"2024-04-25T08:56:45.214962+0000","last_active":"2024-04-25T08:56:46.313135+0000","last_peered":"2024-04-25T08:56:46.313135+0000","last_clean":"2024-04-25T08:56:46.313135+0000","last_became_active":"2024-04-25T08:56:45.214427+0000","last_became_peered":"2024-04-25T08:56:45.214427+0000","last_unstale":"2024-04-25T08:56:46.313135+0000","last_undegraded":"2024-04-25T08:56:46.313135+0000","last_fullsized":"2024-04-25T08:56:46.313135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312386+0000","last_change":"2024-04-25T08:56:44.214088+0000","last_active":"2024-04-25T08:56:46.312386+0000","last_peered":"2024-04-25T08:56:46.312386+0000","last_clean":"2024-04-25T08:56:46.312386+0000","last_became_active":"2024-04-25T08:56:44.213784+0000","last_became_peered":"2024-04-25T08:56:44.213784+0000","last_unstale":"2024-04-25T08:56:46.312386+0000","last_undegraded":"2024-04-25T08:56:46.312386+0000","last_fullsized":"2024-04-25T08:56:46.312386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313419+0000","last_change":"2024-04-25T08:56:45.212864+0000","last_active":"2024-04-25T08:56:46.313419+0000","last_peered":"2024-04-25T08:56:46.313419+0000","last_clean":"2024-04-25T08:56:46.313419+0000","last_became_active":"2024-04-25T08:56:45.211275+0000","last_became_peered":"2024-04-25T08:56:45.211275+0000","last_unstale":"2024-04-25T08:56:46.313419+0000","last_undegraded":"2024-04-25T08:56:46.313419+0000","last_fullsized":"2024-04-25T08:56:46.313419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:40.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312581+0000","last_change":"2024-04-25T08:56:44.214267+0000","last_active":"2024-04-25T08:56:46.312581+0000","last_peered":"2024-04-25T08:56:46.312581+0000","last_clean":"2024-04-25T08:56:46.312581+0000","last_became_active":"2024-04-25T08:56:44.213968+0000","last_became_peered":"2024-04-25T08:56:44.213968+0000","last_unstale":"2024-04-25T08:56:46.312581+0000","last_undegraded":"2024-04-25T08:56:46.312581+0000","last_fullsized":"2024-04-25T08:56:46.312581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313067+0000","last_change":"2024-04-25T08:56:45.225578+0000","last_active":"2024-04-25T08:56:46.313067+0000","last_peered":"2024-04-25T08:56:46.313067+0000","last_clean":"2024-04-25T08:56:46.313067+0000","last_became_active":"2024-04-25T08:56:45.224851+0000","last_became_peered":"2024-04-25T08:56:45.224851+0000","last_unstale":"2024-04-25T08:56:46.313067+0000","last_undegraded":"2024-04-25T08:56:46.313067+0000","last_fullsized":"2024-04-25T08:56:46.313067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312485+0000","last_change":"2024-04-25T08:56:44.209898+0000","last_active":"2024-04-25T08:56:46.312485+0000","last_peered":"2024-04-25T08:56:46.312485+0000","last_clean":"2024-04-25T08:56:46.312485+0000","last_became_active":"2024-04-25T08:56:44.208992+0000","last_became_peered":"2024-04-25T08:56:44.208992+0000","last_unstale":"2024-04-25T08:56:46.312485+0000","last_undegraded":"2024-04-25T08:56:46.312485+0000","last_fullsized":"2024-04-25T08:56:46.312485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312300+0000","last_change":"2024-04-25T08:56:45.207031+0000","last_active":"2024-04-25T08:56:46.312300+0000","last_peered":"2024-04-25T08:56:46.312300+0000","last_clean":"2024-04-25T08:56:46.312300+0000","last_became_active":"2024-04-25T08:56:45.206558+0000","last_became_peered":"2024-04-25T08:56:45.206558+0000","last_unstale":"2024-04-25T08:56:46.312300+0000","last_undegraded":"2024-04-25T08:56:46.312300+0000","last_fullsized":"2024-04-25T08:56:46.312300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313186+0000","last_change":"2024-04-25T08:56:44.214095+0000","last_active":"2024-04-25T08:56:46.313186+0000","last_peered":"2024-04-25T08:56:46.313186+0000","last_clean":"2024-04-25T08:56:46.313186+0000","last_became_active":"2024-04-25T08:56:44.213800+0000","last_became_peered":"2024-04-25T08:56:44.213800+0000","last_unstale":"2024-04-25T08:56:46.313186+0000","last_undegraded":"2024-04-25T08:56:46.313186+0000","last_fullsized":"2024-04-25T08:56:46.313186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:52.735112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:52.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.722+0000 7f71f9f7d640 1 Processor -- start 2024-04-25T08:56:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.722+0000 7f71f9f7d640 1 -- start start 2024-04-25T08:56:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f9f7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71f415e0a0 0x7f71f40d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f9f7d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f40d3df0 0x7f71f40cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f9f7d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40b7f60 con 0x7f71f40d3990 2024-04-25T08:56:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f9f7d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f40b29c0 con 0x7f71f415e0a0 2024-04-25T08:56:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f9f7d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40d2080 con 0x7f71f40d3df0 2024-04-25T08:56:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71f415e0a0 0x7f71f40d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f2ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f71f40d3990 0x7f71f40ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38250/0 (socket says 172.21.15.5:38250) 2024-04-25T08:56:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.723+0000 7f71f2ffd640 1 -- 172.21.15.5:0/268227448 learned_addr learned my addr 172.21.15.5:0/268227448 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.724+0000 7f71f3fff640 1 --2- 172.21.15.5:0/268227448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f40d3df0 0x7f71f40cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.724+0000 7f71f37fe640 1 -- 172.21.15.5:0/268227448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f40d3df0 msgr2=0x7f71f40cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.724+0000 7f71f37fe640 1 --2- 172.21.15.5:0/268227448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f40d3df0 0x7f71f40cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.724+0000 7f71f37fe640 1 -- 172.21.15.5:0/268227448 >> v1:172.21.15.5:6789/0 conn(0x7f71f40d3990 legacy=0x7f71f40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.724+0000 7f71f27fc640 1 -- 172.21.15.5:0/268227448 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666880112 0 0) 0x7f71f40b7f60 con 0x7f71f40d3990 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.724+0000 7f71f37fe640 1 -- 172.21.15.5:0/268227448 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40d2360 con 0x7f71f415e0a0 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.724+0000 7f71f37fe640 1 --2- 172.21.15.5:0/268227448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f415e0a0 0x7f71f40d0d50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71e40097a0 tx=0x7f71e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb95b3667416b072 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f27fc640 1 -- 172.21.15.5:0/268227448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4037070 con 0x7f71f415e0a0 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f27fc640 1 -- 172.21.15.5:0/268227448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4032440 con 0x7f71f415e0a0 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f27fc640 1 -- 172.21.15.5:0/268227448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4032810 con 0x7f71f415e0a0 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 -- 172.21.15.5:0/268227448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f415e0a0 msgr2=0x7f71f40d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/268227448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f415e0a0 0x7f71f40d0d50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71e40097a0 tx=0x7f71e402a180 comp rx=0 tx=0).stop 2024-04-25T08:56:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 -- 172.21.15.5:0/268227448 shutdown_connections 2024-04-25T08:56:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/268227448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f40d3df0 0x7f71f40cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/268227448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f415e0a0 0x7f71f40d0d50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 -- 172.21.15.5:0/268227448 >> 172.21.15.5:0/268227448 conn(0x7f71f40668f0 msgr2=0x7f71f4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 -- 172.21.15.5:0/268227448 shutdown_connections 2024-04-25T08:56:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.725+0000 7f71f9f7d640 1 -- 172.21.15.5:0/268227448 wait complete. 2024-04-25T08:56:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.726+0000 7f71f9f7d640 1 Processor -- start 2024-04-25T08:56:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f9f7d640 1 -- start start 2024-04-25T08:56:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f9f7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71f40d3990 0x7f71f40c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f9f7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f40d3df0 0x7f71f415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f9f7d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f415e0a0 0x7f71f40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f9f7d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40d2c00 con 0x7f71f40d3df0 2024-04-25T08:56:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f9f7d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40d2920 con 0x7f71f40d3990 2024-04-25T08:56:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f9f7d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40d4280 con 0x7f71f415e0a0 2024-04-25T08:56:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f40d3df0 0x7f71f415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f40d3df0 0x7f71f415a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55632/0 (socket says 172.21.15.5:55632) 2024-04-25T08:56:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.727+0000 7f71f2ffd640 1 -- 172.21.15.5:0/1099481998 learned_addr learned my addr 172.21.15.5:0/1099481998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f3fff640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f415e0a0 0x7f71f40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f37fe640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71f40d3990 0x7f71f40c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f2ffd640 1 -- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f415e0a0 msgr2=0x7f71f40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f415e0a0 0x7f71f40cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f2ffd640 1 -- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71f40d3990 msgr2=0x7f71f40c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71f40d3990 0x7f71f40c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f2ffd640 1 -- 172.21.15.5:0/1099481998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40c88a0 con 0x7f71f40d3df0 2024-04-25T08:56:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f40d3df0 0x7f71f415a880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c3f0 tx=0x7f71e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:52.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71dbfff640 1 -- 172.21.15.5:0/1099481998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80074e0 con 0x7f71f40d3df0 2024-04-25T08:56:52.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71dbfff640 1 -- 172.21.15.5:0/1099481998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e80047e0 con 0x7f71f40d3df0 2024-04-25T08:56:52.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f40c8b80 con 0x7f71f40d3df0 2024-04-25T08:56:52.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71dbfff640 1 -- 172.21.15.5:0/1099481998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8004c10 con 0x7f71f40d3df0 2024-04-25T08:56:52.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.728+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f40c9140 con 0x7f71f40d3df0 2024-04-25T08:56:52.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.729+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4068550 con 0x7f71f40d3df0 2024-04-25T08:56:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.729+0000 7f71dbfff640 1 -- 172.21.15.5:0/1099481998 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71e8011070 con 0x7f71f40d3df0 2024-04-25T08:56:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.730+0000 7f71dbfff640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71e006b4d0 0x7f71e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.730+0000 7f71dbfff640 1 -- 172.21.15.5:0/1099481998 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e8089cc0 con 0x7f71f40d3df0 2024-04-25T08:56:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.730+0000 7f71f37fe640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71e006b4d0 0x7f71e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.730+0000 7f71f37fe640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71e006b4d0 0x7f71e006d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71e4034000 tx=0x7f71e402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.734+0000 7f71dbfff640 1 -- 172.21.15.5:0/1099481998 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71f4068550 con 0x7f71f40d3df0 2024-04-25T08:56:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.910+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71f404ef20 con 0x7f71e006b4d0 2024-04-25T08:56:52.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.917+0000 7f71dbfff640 1 -- 172.21.15.5:0/1099481998 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7f71f404ef20 con 0x7f71e006b4d0 2024-04-25T08:56:52.910 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:52.912 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:56:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71e006b4d0 msgr2=0x7f71e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71e006b4d0 0x7f71e006d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71e4034000 tx=0x7f71e402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f40d3df0 msgr2=0x7f71f415a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f40d3df0 0x7f71f415a880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c3f0 tx=0x7f71e800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 shutdown_connections 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f71e006b4d0 0x7f71e006d990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f71f415e0a0 0x7f71f40cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f40d3df0 0x7f71f415a880 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 --2- 172.21.15.5:0/1099481998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71f40d3990 0x7f71f40c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.919+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 >> 172.21.15.5:0/1099481998 conn(0x7f71f40668f0 msgr2=0x7f71f4160490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.920+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 shutdown_connections 2024-04-25T08:56:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:52.920+0000 7f71f9f7d640 1 -- 172.21.15.5:0/1099481998 wait complete. 2024-04-25T08:56:52.920 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T08:56:52.388796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235656,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739064,"statfs":{"total":773094113280,"available":772852801536,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002229"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312750+0000","last_change":"2024-04-25T08:56:45.214215+0000","last_active":"2024-04-25T08:56:46.312750+0000","last_peered":"2024-04-25T08:56:46.312750+0000","last_clean":"2024-04-25T08:56:46.312750+0000","last_became_active":"2024-04-25T08:56:45.213888+0000","last_became_peered":"2024-04-25T08:56:45.213888+0000","last_unstale":"2024-04-25T08:56:46.312750+0000","last_undegraded":"2024-04-25T08:56:46.312750+0000","last_fullsized":"2024-04-25T08:56:46.312750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:40.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202219+0000","last_change":"2024-04-25T08:56:45.223882+0000","last_active":"2024-04-25T08:56:46.202219+0000","last_peered":"2024-04-25T08:56:46.202219+0000","last_clean":"2024-04-25T08:56:46.202219+0000","last_became_active":"2024-04-25T08:56:45.223600+0000","last_became_peered":"2024-04-25T08:56:45.223600+0000","last_unstale":"2024-04-25T08:56:46.202219+0000","last_undegraded":"2024-04-25T08:56:46.202219+0000","last_fullsized":"2024-04-25T08:56:46.202219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312857+0000","last_change":"2024-04-25T08:56:45.207050+0000","last_active":"2024-04-25T08:56:46.312857+0000","last_peered":"2024-04-25T08:56:46.312857+0000","last_clean":"2024-04-25T08:56:46.312857+0000","last_became_active":"2024-04-25T08:56:45.206781+0000","last_became_peered":"2024-04-25T08:56:45.206781+0000","last_unstale":"2024-04-25T08:56:46.312857+0000","last_undegraded":"2024-04-25T08:56:46.312857+0000","last_fullsized":"2024-04-25T08:56:46.312857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.325182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313273+0000","last_change":"2024-04-25T08:56:45.204379+0000","last_active":"2024-04-25T08:56:46.313273+0000","last_peered":"2024-04-25T08:56:46.313273+0000","last_clean":"2024-04-25T08:56:46.313273+0000","last_became_active":"2024-04-25T08:56:45.204046+0000","last_became_peered":"2024-04-25T08:56:45.204046+0000","last_unstale":"2024-04-25T08:56:46.313273+0000","last_undegraded":"2024-04-25T08:56:46.313273+0000","last_fullsized":"2024-04-25T08:56:46.313273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:37.397335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313242+0000","last_change":"2024-04-25T08:56:45.214884+0000","last_active":"2024-04-25T08:56:46.313242+0000","last_peered":"2024-04-25T08:56:46.313242+0000","last_clean":"2024-04-25T08:56:46.313242+0000","last_became_active":"2024-04-25T08:56:45.214584+0000","last_became_peered":"2024-04-25T08:56:45.214584+0000","last_unstale":"2024-04-25T08:56:46.313242+0000","last_undegraded":"2024-04-25T08:56:46.313242+0000","last_fullsized":"2024-04-25T08:56:46.313242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:57.667683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312739+0000","last_change":"2024-04-25T08:56:45.216977+0000","last_active":"2024-04-25T08:56:46.312739+0000","last_peered":"2024-04-25T08:56:46.312739+0000","last_clean":"2024-04-25T08:56:46.312739+0000","last_became_active":"2024-04-25T08:56:45.216691+0000","last_became_peered":"2024-04-25T08:56:45.216691+0000","last_unstale":"2024-04-25T08:56:46.312739+0000","last_undegraded":"2024-04-25T08:56:46.312739+0000","last_fullsized":"2024-04-25T08:56:46.312739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312147+0000","last_change":"2024-04-25T08:56:45.219245+0000","last_active":"2024-04-25T08:56:46.312147+0000","last_peered":"2024-04-25T08:56:46.312147+0000","last_clean":"2024-04-25T08:56:46.312147+0000","last_became_active":"2024-04-25T08:56:45.218966+0000","last_became_peered":"2024-04-25T08:56:45.218966+0000","last_unstale":"2024-04-25T08:56:46.312147+0000","last_undegraded":"2024-04-25T08:56:46.312147+0000","last_fullsized":"2024-04-25T08:56:46.312147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312173+0000","last_change":"2024-04-25T08:56:45.211941+0000","last_active":"2024-04-25T08:56:46.312173+0000","last_peered":"2024-04-25T08:56:46.312173+0000","last_clean":"2024-04-25T08:56:46.312173+0000","last_became_active":"2024-04-25T08:56:45.211654+0000","last_became_peered":"2024-04-25T08:56:45.211654+0000","last_unstale":"2024-04-25T08:56:46.312173+0000","last_undegraded":"2024-04-25T08:56:46.312173+0000","last_fullsized":"2024-04-25T08:56:46.312173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.046928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312926+0000","last_change":"2024-04-25T08:56:45.222927+0000","last_active":"2024-04-25T08:56:46.312926+0000","last_peered":"2024-04-25T08:56:46.312926+0000","last_clean":"2024-04-25T08:56:46.312926+0000","last_became_active":"2024-04-25T08:56:45.222621+0000","last_became_peered":"2024-04-25T08:56:45.222621+0000","last_unstale":"2024-04-25T08:56:46.312926+0000","last_undegraded":"2024-04-25T08:56:46.312926+0000","last_fullsized":"2024-04-25T08:56:46.312926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:54.059797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208198+0000","last_change":"2024-04-25T08:56:45.219827+0000","last_active":"2024-04-25T08:56:46.208198+0000","last_peered":"2024-04-25T08:56:46.208198+0000","last_clean":"2024-04-25T08:56:46.208198+0000","last_became_active":"2024-04-25T08:56:45.219443+0000","last_became_peered":"2024-04-25T08:56:45.219443+0000","last_unstale":"2024-04-25T08:56:46.208198+0000","last_undegraded":"2024-04-25T08:56:46.208198+0000","last_fullsized":"2024-04-25T08:56:46.208198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208115+0000","last_change":"2024-04-25T08:56:45.217372+0000","last_active":"2024-04-25T08:56:46.208115+0000","last_peered":"2024-04-25T08:56:46.208115+0000","last_clean":"2024-04-25T08:56:46.208115+0000","last_became_active":"2024-04-25T08:56:45.217109+0000","last_became_peered":"2024-04-25T08:56:45.217109+0000","last_unstale":"2024-04-25T08:56:46.208115+0000","last_undegraded":"2024-04-25T08:56:46.208115+0000","last_fullsized":"2024-04-25T08:56:46.208115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202878+0000","last_change":"2024-04-25T08:56:45.205751+0000","last_active":"2024-04-25T08:56:46.202878+0000","last_peered":"2024-04-25T08:56:46.202878+0000","last_clean":"2024-04-25T08:56:46.202878+0000","last_became_active":"2024-04-25T08:56:45.205247+0000","last_became_peered":"2024-04-25T08:56:45.205247+0000","last_unstale":"2024-04-25T08:56:46.202878+0000","last_undegraded":"2024-04-25T08:56:46.202878+0000","last_fullsized":"2024-04-25T08:56:46.202878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:13.577419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312640+0000","last_change":"2024-04-25T08:56:45.207035+0000","last_active":"2024-04-25T08:56:46.312640+0000","last_peered":"2024-04-25T08:56:46.312640+0000","last_clean":"2024-04-25T08:56:46.312640+0000","last_became_active":"2024-04-25T08:56:45.206276+0000","last_became_peered":"2024-04-25T08:56:45.206276+0000","last_unstale":"2024-04-25T08:56:46.312640+0000","last_undegraded":"2024-04-25T08:56:46.312640+0000","last_fullsized":"2024-04-25T08:56:46.312640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312187+0000","last_change":"2024-04-25T08:56:45.215524+0000","last_active":"2024-04-25T08:56:46.312187+0000","last_peered":"2024-04-25T08:56:46.312187+0000","last_clean":"2024-04-25T08:56:46.312187+0000","last_became_active":"2024-04-25T08:56:45.215237+0000","last_became_peered":"2024-04-25T08:56:45.215237+0000","last_unstale":"2024-04-25T08:56:46.312187+0000","last_undegraded":"2024-04-25T08:56:46.312187+0000","last_fullsized":"2024-04-25T08:56:46.312187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201999+0000","last_change":"2024-04-25T08:56:45.211498+0000","last_active":"2024-04-25T08:56:46.201999+0000","last_peered":"2024-04-25T08:56:46.201999+0000","last_clean":"2024-04-25T08:56:46.201999+0000","last_became_active":"2024-04-25T08:56:45.210845+0000","last_became_peered":"2024-04-25T08:56:45.210845+0000","last_unstale":"2024-04-25T08:56:46.201999+0000","last_undegraded":"2024-04-25T08:56:46.201999+0000","last_fullsized":"2024-04-25T08:56:46.201999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312644+0000","last_change":"2024-04-25T08:56:45.222046+0000","last_active":"2024-04-25T08:56:46.312644+0000","last_peered":"2024-04-25T08:56:46.312644+0000","last_clean":"2024-04-25T08:56:46.312644+0000","last_became_active":"2024-04-25T08:56:45.221786+0000","last_became_peered":"2024-04-25T08:56:45.221786+0000","last_unstale":"2024-04-25T08:56:46.312644+0000","last_undegraded":"2024-04-25T08:56:46.312644+0000","last_fullsized":"2024-04-25T08:56:46.312644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313399+0000","last_change":"2024-04-25T08:56:45.220510+0000","last_active":"2024-04-25T08:56:46.313399+0000","last_peered":"2024-04-25T08:56:46.313399+0000","last_clean":"2024-04-25T08:56:46.313399+0000","last_became_active":"2024-04-25T08:56:45.218056+0000","last_became_peered":"2024-04-25T08:56:45.218056+0000","last_unstale":"2024-04-25T08:56:46.313399+0000","last_undegraded":"2024-04-25T08:56:46.313399+0000","last_fullsized":"2024-04-25T08:56:46.313399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:54.059797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201473+0000","last_change":"2024-04-25T08:56:45.205595+0000","last_active":"2024-04-25T08:56:46.201473+0000","last_peered":"2024-04-25T08:56:46.201473+0000","last_clean":"2024-04-25T08:56:46.201473+0000","last_became_active":"2024-04-25T08:56:45.205275+0000","last_became_peered":"2024-04-25T08:56:45.205275+0000","last_unstale":"2024-04-25T08:56:46.201473+0000","last_undegraded":"2024-04-25T08:56:46.201473+0000","last_fullsized":"2024-04-25T08:56:46.201473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:33.839170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312741+0000","last_change":"2024-04-25T08:56:45.214789+0000","last_active":"2024-04-25T08:56:46.312741+0000","last_peered":"2024-04-25T08:56:46.312741+0000","last_clean":"2024-04-25T08:56:46.312741+0000","last_became_active":"2024-04-25T08:56:45.214505+0000","last_became_peered":"2024-04-25T08:56:45.214505+0000","last_unstale":"2024-04-25T08:56:46.312741+0000","last_undegraded":"2024-04-25T08:56:46.312741+0000","last_fullsized":"2024-04-25T08:56:46.312741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:43.480760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208010+0000","last_change":"2024-04-25T08:56:45.207623+0000","last_active":"2024-04-25T08:56:46.208010+0000","last_peered":"2024-04-25T08:56:46.208010+0000","last_clean":"2024-04-25T08:56:46.208010+0000","last_became_active":"2024-04-25T08:56:45.207355+0000","last_became_peered":"2024-04-25T08:56:45.207355+0000","last_unstale":"2024-04-25T08:56:46.208010+0000","last_undegraded":"2024-04-25T08:56:46.208010+0000","last_fullsized":"2024-04-25T08:56:46.208010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313039+0000","last_change":"2024-04-25T08:56:45.217625+0000","last_active":"2024-04-25T08:56:46.313039+0000","last_peered":"2024-04-25T08:56:46.313039+0000","last_clean":"2024-04-25T08:56:46.313039+0000","last_became_active":"2024-04-25T08:56:45.217339+0000","last_became_peered":"2024-04-25T08:56:45.217339+0000","last_unstale":"2024-04-25T08:56:46.313039+0000","last_undegraded":"2024-04-25T08:56:46.313039+0000","last_fullsized":"2024-04-25T08:56:46.313039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312884+0000","last_change":"2024-04-25T08:56:45.208901+0000","last_active":"2024-04-25T08:56:46.312884+0000","last_peered":"2024-04-25T08:56:46.312884+0000","last_clean":"2024-04-25T08:56:46.312884+0000","last_became_active":"2024-04-25T08:56:45.208627+0000","last_became_peered":"2024-04-25T08:56:45.208627+0000","last_unstale":"2024-04-25T08:56:46.312884+0000","last_undegraded":"2024-04-25T08:56:46.312884+0000","last_fullsized":"2024-04-25T08:56:46.312884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312527+0000","last_change":"2024-04-25T08:56:45.207471+0000","last_active":"2024-04-25T08:56:46.312527+0000","last_peered":"2024-04-25T08:56:46.312527+0000","last_clean":"2024-04-25T08:56:46.312527+0000","last_became_active":"2024-04-25T08:56:45.207134+0000","last_became_peered":"2024-04-25T08:56:45.207134+0000","last_unstale":"2024-04-25T08:56:46.312527+0000","last_undegraded":"2024-04-25T08:56:46.312527+0000","last_fullsized":"2024-04-25T08:56:46.312527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312799+0000","last_change":"2024-04-25T08:56:45.213278+0000","last_active":"2024-04-25T08:56:46.312799+0000","last_peered":"2024-04-25T08:56:46.312799+0000","last_clean":"2024-04-25T08:56:46.312799+0000","last_became_active":"2024-04-25T08:56:45.212789+0000","last_became_peered":"2024-04-25T08:56:45.212789+0000","last_unstale":"2024-04-25T08:56:46.312799+0000","last_undegraded":"2024-04-25T08:56:46.312799+0000","last_fullsized":"2024-04-25T08:56:46.312799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312402+0000","last_change":"2024-04-25T08:56:45.206688+0000","last_active":"2024-04-25T08:56:46.312402+0000","last_peered":"2024-04-25T08:56:46.312402+0000","last_clean":"2024-04-25T08:56:46.312402+0000","last_became_active":"2024-04-25T08:56:45.205893+0000","last_became_peered":"2024-04-25T08:56:45.205893+0000","last_unstale":"2024-04-25T08:56:46.312402+0000","last_undegraded":"2024-04-25T08:56:46.312402+0000","last_fullsized":"2024-04-25T08:56:46.312402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208267+0000","last_change":"2024-04-25T08:56:45.209708+0000","last_active":"2024-04-25T08:56:46.208267+0000","last_peered":"2024-04-25T08:56:46.208267+0000","last_clean":"2024-04-25T08:56:46.208267+0000","last_became_active":"2024-04-25T08:56:45.209448+0000","last_became_peered":"2024-04-25T08:56:45.209448+0000","last_unstale":"2024-04-25T08:56:46.208267+0000","last_undegraded":"2024-04-25T08:56:46.208267+0000","last_fullsized":"2024-04-25T08:56:46.208267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202250+0000","last_change":"2024-04-25T08:56:45.213535+0000","last_active":"2024-04-25T08:56:46.202250+0000","last_peered":"2024-04-25T08:56:46.202250+0000","last_clean":"2024-04-25T08:56:46.202250+0000","last_became_active":"2024-04-25T08:56:45.213239+0000","last_became_peered":"2024-04-25T08:56:45.213239+0000","last_unstale":"2024-04-25T08:56:46.202250+0000","last_undegraded":"2024-04-25T08:56:46.202250+0000","last_fullsized":"2024-04-25T08:56:46.202250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312923+0000","last_change":"2024-04-25T08:56:45.207576+0000","last_active":"2024-04-25T08:56:46.312923+0000","last_peered":"2024-04-25T08:56:46.312923+0000","last_clean":"2024-04-25T08:56:46.312923+0000","last_became_active":"2024-04-25T08:56:45.206807+0000","last_became_peered":"2024-04-25T08:56:45.206807+0000","last_unstale":"2024-04-25T08:56:46.312923+0000","last_undegraded":"2024-04-25T08:56:46.312923+0000","last_fullsized":"2024-04-25T08:56:46.312923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:58.719285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313032+0000","last_change":"2024-04-25T08:56:45.209841+0000","last_active":"2024-04-25T08:56:46.313032+0000","last_peered":"2024-04-25T08:56:46.313032+0000","last_clean":"2024-04-25T08:56:46.313032+0000","last_became_active":"2024-04-25T08:56:45.209571+0000","last_became_peered":"2024-04-25T08:56:45.209571+0000","last_unstale":"2024-04-25T08:56:46.313032+0000","last_undegraded":"2024-04-25T08:56:46.313032+0000","last_fullsized":"2024-04-25T08:56:46.313032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313341+0000","last_change":"2024-04-25T08:56:45.211522+0000","last_active":"2024-04-25T08:56:46.313341+0000","last_peered":"2024-04-25T08:56:46.313341+0000","last_clean":"2024-04-25T08:56:46.313341+0000","last_became_active":"2024-04-25T08:56:45.211239+0000","last_became_peered":"2024-04-25T08:56:45.211239+0000","last_unstale":"2024-04-25T08:56:46.313341+0000","last_undegraded":"2024-04-25T08:56:46.313341+0000","last_fullsized":"2024-04-25T08:56:46.313341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:43.480760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201271+0000","last_change":"2024-04-25T08:56:45.217257+0000","last_active":"2024-04-25T08:56:46.201271+0000","last_peered":"2024-04-25T08:56:46.201271+0000","last_clean":"2024-04-25T08:56:46.201271+0000","last_became_active":"2024-04-25T08:56:45.216898+0000","last_became_peered":"2024-04-25T08:56:45.216898+0000","last_unstale":"2024-04-25T08:56:46.201271+0000","last_undegraded":"2024-04-25T08:56:46.201271+0000","last_fullsized":"2024-04-25T08:56:46.201271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207823+0000","last_change":"2024-04-25T08:56:45.219777+0000","last_active":"2024-04-25T08:56:46.207823+0000","last_peered":"2024-04-25T08:56:46.207823+0000","last_clean":"2024-04-25T08:56:46.207823+0000","last_became_active":"2024-04-25T08:56:45.218541+0000","last_became_peered":"2024-04-25T08:56:45.218541+0000","last_unstale":"2024-04-25T08:56:46.207823+0000","last_undegraded":"2024-04-25T08:56:46.207823+0000","last_fullsized":"2024-04-25T08:56:46.207823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202756+0000","last_change":"2024-04-25T08:56:45.211649+0000","last_active":"2024-04-25T08:56:46.202756+0000","last_peered":"2024-04-25T08:56:46.202756+0000","last_clean":"2024-04-25T08:56:46.202756+0000","last_became_active":"2024-04-25T08:56:45.211344+0000","last_became_peered":"2024-04-25T08:56:45.211344+0000","last_unstale":"2024-04-25T08:56:46.202756+0000","last_undegraded":"2024-04-25T08:56:46.202756+0000","last_fullsized":"2024-04-25T08:56:46.202756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:22.869310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312755+0000","last_change":"2024-04-25T08:56:44.214502+0000","last_active":"2024-04-25T08:56:46.312755+0000","last_peered":"2024-04-25T08:56:46.312755+0000","last_clean":"2024-04-25T08:56:46.312755+0000","last_became_active":"2024-04-25T08:56:44.214144+0000","last_became_peered":"2024-04-25T08:56:44.214144+0000","last_unstale":"2024-04-25T08:56:46.312755+0000","last_undegraded":"2024-04-25T08:56:46.312755+0000","last_fullsized":"2024-04-25T08:56:46.312755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:59.869328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313200+0000","last_change":"2024-04-25T08:56:45.210462+0000","last_active":"2024-04-25T08:56:46.313200+0000","last_peered":"2024-04-25T08:56:46.313200+0000","last_clean":"2024-04-25T08:56:46.313200+0000","last_became_active":"2024-04-25T08:56:45.210182+0000","last_became_peered":"2024-04-25T08:56:45.210182+0000","last_unstale":"2024-04-25T08:56:46.313200+0000","last_undegraded":"2024-04-25T08:56:46.313200+0000","last_fullsized":"2024-04-25T08:56:46.313200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:13.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207842+0000","last_change":"2024-04-25T08:56:44.208738+0000","last_active":"2024-04-25T08:56:46.207842+0000","last_peered":"2024-04-25T08:56:46.207842+0000","last_clean":"2024-04-25T08:56:46.207842+0000","last_became_active":"2024-04-25T08:56:44.208463+0000","last_became_peered":"2024-04-25T08:56:44.208463+0000","last_unstale":"2024-04-25T08:56:46.207842+0000","last_undegraded":"2024-04-25T08:56:46.207842+0000","last_fullsized":"2024-04-25T08:56:46.207842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312653+0000","last_change":"2024-04-25T08:56:44.211862+0000","last_active":"2024-04-25T08:56:46.312653+0000","last_peered":"2024-04-25T08:56:46.312653+0000","last_clean":"2024-04-25T08:56:46.312653+0000","last_became_active":"2024-04-25T08:56:44.211570+0000","last_became_peered":"2024-04-25T08:56:44.211570+0000","last_unstale":"2024-04-25T08:56:46.312653+0000","last_undegraded":"2024-04-25T08:56:46.312653+0000","last_fullsized":"2024-04-25T08:56:46.312653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:46.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313056+0000","last_change":"2024-04-25T08:56:45.219509+0000","last_active":"2024-04-25T08:56:46.313056+0000","last_peered":"2024-04-25T08:56:46.313056+0000","last_clean":"2024-04-25T08:56:46.313056+0000","last_became_active":"2024-04-25T08:56:45.219154+0000","last_became_peered":"2024-04-25T08:56:45.219154+0000","last_unstale":"2024-04-25T08:56:46.313056+0000","last_undegraded":"2024-04-25T08:56:46.313056+0000","last_fullsized":"2024-04-25T08:56:46.313056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312752+0000","last_change":"2024-04-25T08:56:44.200599+0000","last_active":"2024-04-25T08:56:46.312752+0000","last_peered":"2024-04-25T08:56:46.312752+0000","last_clean":"2024-04-25T08:56:46.312752+0000","last_became_active":"2024-04-25T08:56:44.200191+0000","last_became_peered":"2024-04-25T08:56:44.200191+0000","last_unstale":"2024-04-25T08:56:46.312752+0000","last_undegraded":"2024-04-25T08:56:46.312752+0000","last_fullsized":"2024-04-25T08:56:46.312752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202126+0000","last_change":"2024-04-25T08:56:45.211808+0000","last_active":"2024-04-25T08:56:46.202126+0000","last_peered":"2024-04-25T08:56:46.202126+0000","last_clean":"2024-04-25T08:56:46.202126+0000","last_became_active":"2024-04-25T08:56:45.211189+0000","last_became_peered":"2024-04-25T08:56:45.211189+0000","last_unstale":"2024-04-25T08:56:46.202126+0000","last_undegraded":"2024-04-25T08:56:46.202126+0000","last_fullsized":"2024-04-25T08:56:46.202126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208129+0000","last_change":"2024-04-25T08:56:44.205653+0000","last_active":"2024-04-25T08:56:46.208129+0000","last_peered":"2024-04-25T08:56:46.208129+0000","last_clean":"2024-04-25T08:56:46.208129+0000","last_became_active":"2024-04-25T08:56:44.205360+0000","last_became_peered":"2024-04-25T08:56:44.205360+0000","last_unstale":"2024-04-25T08:56:46.208129+0000","last_undegraded":"2024-04-25T08:56:46.208129+0000","last_fullsized":"2024-04-25T08:56:46.208129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313249+0000","last_change":"2024-04-25T08:56:45.208313+0000","last_active":"2024-04-25T08:56:46.313249+0000","last_peered":"2024-04-25T08:56:46.313249+0000","last_clean":"2024-04-25T08:56:46.313249+0000","last_became_active":"2024-04-25T08:56:45.207996+0000","last_became_peered":"2024-04-25T08:56:45.207996+0000","last_unstale":"2024-04-25T08:56:46.313249+0000","last_undegraded":"2024-04-25T08:56:46.313249+0000","last_fullsized":"2024-04-25T08:56:46.313249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313024+0000","last_change":"2024-04-25T08:56:44.208544+0000","last_active":"2024-04-25T08:56:46.313024+0000","last_peered":"2024-04-25T08:56:46.313024+0000","last_clean":"2024-04-25T08:56:46.313024+0000","last_became_active":"2024-04-25T08:56:44.208279+0000","last_became_peered":"2024-04-25T08:56:44.208279+0000","last_unstale":"2024-04-25T08:56:46.313024+0000","last_undegraded":"2024-04-25T08:56:46.313024+0000","last_fullsized":"2024-04-25T08:56:46.313024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313098+0000","last_change":"2024-04-25T08:56:45.224921+0000","last_active":"2024-04-25T08:56:46.313098+0000","last_peered":"2024-04-25T08:56:46.313098+0000","last_clean":"2024-04-25T08:56:46.313098+0000","last_became_active":"2024-04-25T08:56:45.224477+0000","last_became_peered":"2024-04-25T08:56:45.224477+0000","last_unstale":"2024-04-25T08:56:46.313098+0000","last_undegraded":"2024-04-25T08:56:46.313098+0000","last_fullsized":"2024-04-25T08:56:46.313098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202246+0000","last_change":"2024-04-25T08:56:44.210451+0000","last_active":"2024-04-25T08:56:46.202246+0000","last_peered":"2024-04-25T08:56:46.202246+0000","last_clean":"2024-04-25T08:56:46.202246+0000","last_became_active":"2024-04-25T08:56:44.210149+0000","last_became_peered":"2024-04-25T08:56:44.210149+0000","last_unstale":"2024-04-25T08:56:46.202246+0000","last_undegraded":"2024-04-25T08:56:46.202246+0000","last_fullsized":"2024-04-25T08:56:46.202246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202999+0000","last_change":"2024-04-25T08:56:45.215179+0000","last_active":"2024-04-25T08:56:46.202999+0000","last_peered":"2024-04-25T08:56:46.202999+0000","last_clean":"2024-04-25T08:56:46.202999+0000","last_became_active":"2024-04-25T08:56:45.214913+0000","last_became_peered":"2024-04-25T08:56:45.214913+0000","last_unstale":"2024-04-25T08:56:46.202999+0000","last_undegraded":"2024-04-25T08:56:46.202999+0000","last_fullsized":"2024-04-25T08:56:46.202999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:51.875796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207952+0000","last_change":"2024-04-25T08:56:44.211758+0000","last_active":"2024-04-25T08:56:46.207952+0000","last_peered":"2024-04-25T08:56:46.207952+0000","last_clean":"2024-04-25T08:56:46.207952+0000","last_became_active":"2024-04-25T08:56:44.211556+0000","last_became_peered":"2024-04-25T08:56:44.211556+0000","last_unstale":"2024-04-25T08:56:46.207952+0000","last_undegraded":"2024-04-25T08:56:46.207952+0000","last_fullsized":"2024-04-25T08:56:46.207952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312667+0000","last_change":"2024-04-25T08:56:45.212558+0000","last_active":"2024-04-25T08:56:46.312667+0000","last_peered":"2024-04-25T08:56:46.312667+0000","last_clean":"2024-04-25T08:56:46.312667+0000","last_became_active":"2024-04-25T08:56:45.212258+0000","last_became_peered":"2024-04-25T08:56:45.212258+0000","last_unstale":"2024-04-25T08:56:46.312667+0000","last_undegraded":"2024-04-25T08:56:46.312667+0000","last_fullsized":"2024-04-25T08:56:46.312667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.819156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313161+0000","last_change":"2024-04-25T08:56:44.203992+0000","last_active":"2024-04-25T08:56:46.313161+0000","last_peered":"2024-04-25T08:56:46.313161+0000","last_clean":"2024-04-25T08:56:46.313161+0000","last_became_active":"2024-04-25T08:56:44.203708+0000","last_became_peered":"2024-04-25T08:56:44.203708+0000","last_unstale":"2024-04-25T08:56:46.313161+0000","last_undegraded":"2024-04-25T08:56:46.313161+0000","last_fullsized":"2024-04-25T08:56:46.313161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:58.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312991+0000","last_change":"2024-04-25T08:56:45.216900+0000","last_active":"2024-04-25T08:56:46.312991+0000","last_peered":"2024-04-25T08:56:46.312991+0000","last_clean":"2024-04-25T08:56:46.312991+0000","last_became_active":"2024-04-25T08:56:45.216635+0000","last_became_peered":"2024-04-25T08:56:45.216635+0000","last_unstale":"2024-04-25T08:56:46.312991+0000","last_undegraded":"2024-04-25T08:56:46.312991+0000","last_fullsized":"2024-04-25T08:56:46.312991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.046928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313390+0000","last_change":"2024-04-25T08:56:44.207778+0000","last_active":"2024-04-25T08:56:46.313390+0000","last_peered":"2024-04-25T08:56:46.313390+0000","last_clean":"2024-04-25T08:56:46.313390+0000","last_became_active":"2024-04-25T08:56:44.207350+0000","last_became_peered":"2024-04-25T08:56:44.207350+0000","last_unstale":"2024-04-25T08:56:46.313390+0000","last_undegraded":"2024-04-25T08:56:46.313390+0000","last_fullsized":"2024-04-25T08:56:46.313390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312668+0000","last_change":"2024-04-25T08:56:45.217676+0000","last_active":"2024-04-25T08:56:46.312668+0000","last_peered":"2024-04-25T08:56:46.312668+0000","last_clean":"2024-04-25T08:56:46.312668+0000","last_became_active":"2024-04-25T08:56:45.217175+0000","last_became_peered":"2024-04-25T08:56:45.217175+0000","last_unstale":"2024-04-25T08:56:46.312668+0000","last_undegraded":"2024-04-25T08:56:46.312668+0000","last_fullsized":"2024-04-25T08:56:46.312668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:37.397335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207779+0000","last_change":"2024-04-25T08:56:44.207850+0000","last_active":"2024-04-25T08:56:46.207779+0000","last_peered":"2024-04-25T08:56:46.207779+0000","last_clean":"2024-04-25T08:56:46.207779+0000","last_became_active":"2024-04-25T08:56:44.207520+0000","last_became_peered":"2024-04-25T08:56:44.207520+0000","last_unstale":"2024-04-25T08:56:46.207779+0000","last_undegraded":"2024-04-25T08:56:46.207779+0000","last_fullsized":"2024-04-25T08:56:46.207779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207823+0000","last_change":"2024-04-25T08:56:45.218163+0000","last_active":"2024-04-25T08:56:46.207823+0000","last_peered":"2024-04-25T08:56:46.207823+0000","last_clean":"2024-04-25T08:56:46.207823+0000","last_became_active":"2024-04-25T08:56:45.217700+0000","last_became_peered":"2024-04-25T08:56:45.217700+0000","last_unstale":"2024-04-25T08:56:46.207823+0000","last_undegraded":"2024-04-25T08:56:46.207823+0000","last_fullsized":"2024-04-25T08:56:46.207823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:17.233948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201199+0000","last_change":"2024-04-25T08:56:44.205778+0000","last_active":"2024-04-25T08:56:46.201199+0000","last_peered":"2024-04-25T08:56:46.201199+0000","last_clean":"2024-04-25T08:56:46.201199+0000","last_became_active":"2024-04-25T08:56:44.205483+0000","last_became_peered":"2024-04-25T08:56:44.205483+0000","last_unstale":"2024-04-25T08:56:46.201199+0000","last_undegraded":"2024-04-25T08:56:46.201199+0000","last_fullsized":"2024-04-25T08:56:46.201199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:46.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312166+0000","last_change":"2024-04-25T08:56:45.211144+0000","last_active":"2024-04-25T08:56:46.312166+0000","last_peered":"2024-04-25T08:56:46.312166+0000","last_clean":"2024-04-25T08:56:46.312166+0000","last_became_active":"2024-04-25T08:56:45.210768+0000","last_became_peered":"2024-04-25T08:56:45.210768+0000","last_unstale":"2024-04-25T08:56:46.312166+0000","last_undegraded":"2024-04-25T08:56:46.312166+0000","last_fullsized":"2024-04-25T08:56:46.312166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202956+0000","last_change":"2024-04-25T08:56:44.207687+0000","last_active":"2024-04-25T08:56:46.202956+0000","last_peered":"2024-04-25T08:56:46.202956+0000","last_clean":"2024-04-25T08:56:46.202956+0000","last_became_active":"2024-04-25T08:56:44.207385+0000","last_became_peered":"2024-04-25T08:56:44.207385+0000","last_unstale":"2024-04-25T08:56:46.202956+0000","last_undegraded":"2024-04-25T08:56:46.202956+0000","last_fullsized":"2024-04-25T08:56:46.202956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:46.762190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312589+0000","last_change":"2024-04-25T08:56:45.212331+0000","last_active":"2024-04-25T08:56:46.312589+0000","last_peered":"2024-04-25T08:56:46.312589+0000","last_clean":"2024-04-25T08:56:46.312589+0000","last_became_active":"2024-04-25T08:56:45.212031+0000","last_became_peered":"2024-04-25T08:56:45.212031+0000","last_unstale":"2024-04-25T08:56:46.312589+0000","last_undegraded":"2024-04-25T08:56:46.312589+0000","last_fullsized":"2024-04-25T08:56:46.312589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201454+0000","last_change":"2024-04-25T08:56:44.208898+0000","last_active":"2024-04-25T08:56:46.201454+0000","last_peered":"2024-04-25T08:56:46.201454+0000","last_clean":"2024-04-25T08:56:46.201454+0000","last_became_active":"2024-04-25T08:56:44.208607+0000","last_became_peered":"2024-04-25T08:56:44.208607+0000","last_unstale":"2024-04-25T08:56:46.201454+0000","last_undegraded":"2024-04-25T08:56:46.201454+0000","last_fullsized":"2024-04-25T08:56:46.201454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312973+0000","last_change":"2024-04-25T08:56:45.217243+0000","last_active":"2024-04-25T08:56:46.312973+0000","last_peered":"2024-04-25T08:56:46.312973+0000","last_clean":"2024-04-25T08:56:46.312973+0000","last_became_active":"2024-04-25T08:56:45.216943+0000","last_became_peered":"2024-04-25T08:56:45.216943+0000","last_unstale":"2024-04-25T08:56:46.312973+0000","last_undegraded":"2024-04-25T08:56:46.312973+0000","last_fullsized":"2024-04-25T08:56:46.312973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:53.035287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202338+0000","last_change":"2024-04-25T08:56:44.207711+0000","last_active":"2024-04-25T08:56:46.202338+0000","last_peered":"2024-04-25T08:56:46.202338+0000","last_clean":"2024-04-25T08:56:46.202338+0000","last_became_active":"2024-04-25T08:56:44.207001+0000","last_became_peered":"2024-04-25T08:56:44.207001+0000","last_unstale":"2024-04-25T08:56:46.202338+0000","last_undegraded":"2024-04-25T08:56:46.202338+0000","last_fullsized":"2024-04-25T08:56:46.202338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:32.834402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313464+0000","last_change":"2024-04-25T08:56:45.210543+0000","last_active":"2024-04-25T08:56:46.313464+0000","last_peered":"2024-04-25T08:56:46.313464+0000","last_clean":"2024-04-25T08:56:46.313464+0000","last_became_active":"2024-04-25T08:56:45.210276+0000","last_became_peered":"2024-04-25T08:56:45.210276+0000","last_unstale":"2024-04-25T08:56:46.313464+0000","last_undegraded":"2024-04-25T08:56:46.313464+0000","last_fullsized":"2024-04-25T08:56:46.313464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:53.035287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201395+0000","last_change":"2024-04-25T08:56:44.203045+0000","last_active":"2024-04-25T08:56:46.201395+0000","last_peered":"2024-04-25T08:56:46.201395+0000","last_clean":"2024-04-25T08:56:46.201395+0000","last_became_active":"2024-04-25T08:56:44.202649+0000","last_became_peered":"2024-04-25T08:56:44.202649+0000","last_unstale":"2024-04-25T08:56:46.201395+0000","last_undegraded":"2024-04-25T08:56:46.201395+0000","last_fullsized":"2024-04-25T08:56:46.201395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:08.626305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312471+0000","last_change":"2024-04-25T08:56:45.221348+0000","last_active":"2024-04-25T08:56:46.312471+0000","last_peered":"2024-04-25T08:56:46.312471+0000","last_clean":"2024-04-25T08:56:46.312471+0000","last_became_active":"2024-04-25T08:56:45.221025+0000","last_became_peered":"2024-04-25T08:56:45.221025+0000","last_unstale":"2024-04-25T08:56:46.312471+0000","last_undegraded":"2024-04-25T08:56:46.312471+0000","last_fullsized":"2024-04-25T08:56:46.312471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:23.306509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312137+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:56:46.312137+0000","last_peered":"2024-04-25T08:56:46.312137+0000","last_clean":"2024-04-25T08:56:46.312137+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:56:46.312137+0000","last_undegraded":"2024-04-25T08:56:46.312137+0000","last_fullsized":"2024-04-25T08:56:46.312137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312814+0000","last_change":"2024-04-25T08:56:44.200807+0000","last_active":"2024-04-25T08:56:46.312814+0000","last_peered":"2024-04-25T08:56:46.312814+0000","last_clean":"2024-04-25T08:56:46.312814+0000","last_became_active":"2024-04-25T08:56:44.200035+0000","last_became_peered":"2024-04-25T08:56:44.200035+0000","last_unstale":"2024-04-25T08:56:46.312814+0000","last_undegraded":"2024-04-25T08:56:46.312814+0000","last_fullsized":"2024-04-25T08:56:46.312814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:08.626305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312931+0000","last_change":"2024-04-25T08:56:45.211720+0000","last_active":"2024-04-25T08:56:46.312931+0000","last_peered":"2024-04-25T08:56:46.312931+0000","last_clean":"2024-04-25T08:56:46.312931+0000","last_became_active":"2024-04-25T08:56:45.211423+0000","last_became_peered":"2024-04-25T08:56:45.211423+0000","last_unstale":"2024-04-25T08:56:46.312931+0000","last_undegraded":"2024-04-25T08:56:46.312931+0000","last_fullsized":"2024-04-25T08:56:46.312931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:26.314509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312074+0000","last_change":"2024-04-25T08:56:44.214689+0000","last_active":"2024-04-25T08:56:46.312074+0000","last_peered":"2024-04-25T08:56:46.312074+0000","last_clean":"2024-04-25T08:56:46.312074+0000","last_became_active":"2024-04-25T08:56:44.214419+0000","last_became_peered":"2024-04-25T08:56:44.214419+0000","last_unstale":"2024-04-25T08:56:46.312074+0000","last_undegraded":"2024-04-25T08:56:46.312074+0000","last_fullsized":"2024-04-25T08:56:46.312074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312174+0000","last_change":"2024-04-25T08:56:45.207245+0000","last_active":"2024-04-25T08:56:46.312174+0000","last_peered":"2024-04-25T08:56:46.312174+0000","last_clean":"2024-04-25T08:56:46.312174+0000","last_became_active":"2024-04-25T08:56:45.206744+0000","last_became_peered":"2024-04-25T08:56:45.206744+0000","last_unstale":"2024-04-25T08:56:46.312174+0000","last_undegraded":"2024-04-25T08:56:46.312174+0000","last_fullsized":"2024-04-25T08:56:46.312174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:34.740579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201303+0000","last_change":"2024-04-25T08:56:44.209586+0000","last_active":"2024-04-25T08:56:46.201303+0000","last_peered":"2024-04-25T08:56:46.201303+0000","last_clean":"2024-04-25T08:56:46.201303+0000","last_became_active":"2024-04-25T08:56:44.209270+0000","last_became_peered":"2024-04-25T08:56:44.209270+0000","last_unstale":"2024-04-25T08:56:46.201303+0000","last_undegraded":"2024-04-25T08:56:46.201303+0000","last_fullsized":"2024-04-25T08:56:46.201303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.201993+0000","last_change":"2024-04-25T08:56:45.212305+0000","last_active":"2024-04-25T08:56:46.201993+0000","last_peered":"2024-04-25T08:56:46.201993+0000","last_clean":"2024-04-25T08:56:46.201993+0000","last_became_active":"2024-04-25T08:56:45.210796+0000","last_became_peered":"2024-04-25T08:56:45.210796+0000","last_unstale":"2024-04-25T08:56:46.201993+0000","last_undegraded":"2024-04-25T08:56:46.201993+0000","last_fullsized":"2024-04-25T08:56:46.201993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313436+0000","last_change":"2024-04-25T08:56:44.208927+0000","last_active":"2024-04-25T08:56:46.313436+0000","last_peered":"2024-04-25T08:56:46.313436+0000","last_clean":"2024-04-25T08:56:46.313436+0000","last_became_active":"2024-04-25T08:56:44.208247+0000","last_became_peered":"2024-04-25T08:56:44.208247+0000","last_unstale":"2024-04-25T08:56:46.313436+0000","last_undegraded":"2024-04-25T08:56:46.313436+0000","last_fullsized":"2024-04-25T08:56:46.313436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202914+0000","last_change":"2024-04-25T08:56:45.215544+0000","last_active":"2024-04-25T08:56:46.202914+0000","last_peered":"2024-04-25T08:56:46.202914+0000","last_clean":"2024-04-25T08:56:46.202914+0000","last_became_active":"2024-04-25T08:56:45.215254+0000","last_became_peered":"2024-04-25T08:56:45.215254+0000","last_unstale":"2024-04-25T08:56:46.202914+0000","last_undegraded":"2024-04-25T08:56:46.202914+0000","last_fullsized":"2024-04-25T08:56:46.202914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:07.425213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202106+0000","last_change":"2024-04-25T08:56:44.208338+0000","last_active":"2024-04-25T08:56:46.202106+0000","last_peered":"2024-04-25T08:56:46.202106+0000","last_clean":"2024-04-25T08:56:46.202106+0000","last_became_active":"2024-04-25T08:56:44.208015+0000","last_became_peered":"2024-04-25T08:56:44.208015+0000","last_unstale":"2024-04-25T08:56:46.202106+0000","last_undegraded":"2024-04-25T08:56:46.202106+0000","last_fullsized":"2024-04-25T08:56:46.202106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313288+0000","last_change":"2024-04-25T08:56:45.214759+0000","last_active":"2024-04-25T08:56:46.313288+0000","last_peered":"2024-04-25T08:56:46.313288+0000","last_clean":"2024-04-25T08:56:46.313288+0000","last_became_active":"2024-04-25T08:56:45.212500+0000","last_became_peered":"2024-04-25T08:56:45.212500+0000","last_unstale":"2024-04-25T08:56:46.313288+0000","last_undegraded":"2024-04-25T08:56:46.313288+0000","last_fullsized":"2024-04-25T08:56:46.313288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.819156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312834+0000","last_change":"2024-04-25T08:56:44.214874+0000","last_active":"2024-04-25T08:56:46.312834+0000","last_peered":"2024-04-25T08:56:46.312834+0000","last_clean":"2024-04-25T08:56:46.312834+0000","last_became_active":"2024-04-25T08:56:44.214468+0000","last_became_peered":"2024-04-25T08:56:44.214468+0000","last_unstale":"2024-04-25T08:56:46.312834+0000","last_undegraded":"2024-04-25T08:56:46.312834+0000","last_fullsized":"2024-04-25T08:56:46.312834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:32.834402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202189+0000","last_change":"2024-04-25T08:56:45.210674+0000","last_active":"2024-04-25T08:56:46.202189+0000","last_peered":"2024-04-25T08:56:46.202189+0000","last_clean":"2024-04-25T08:56:46.202189+0000","last_became_active":"2024-04-25T08:56:45.210330+0000","last_became_peered":"2024-04-25T08:56:45.210330+0000","last_unstale":"2024-04-25T08:56:46.202189+0000","last_undegraded":"2024-04-25T08:56:46.202189+0000","last_fullsized":"2024-04-25T08:56:46.202189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207197+0000","last_change":"2024-04-25T08:56:44.212498+0000","last_active":"2024-04-25T08:56:46.207197+0000","last_peered":"2024-04-25T08:56:46.207197+0000","last_clean":"2024-04-25T08:56:46.207197+0000","last_became_active":"2024-04-25T08:56:44.212180+0000","last_became_peered":"2024-04-25T08:56:44.212180+0000","last_unstale":"2024-04-25T08:56:46.207197+0000","last_undegraded":"2024-04-25T08:56:46.207197+0000","last_fullsized":"2024-04-25T08:56:46.207197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312549+0000","last_change":"2024-04-25T08:56:45.218534+0000","last_active":"2024-04-25T08:56:46.312549+0000","last_peered":"2024-04-25T08:56:46.312549+0000","last_clean":"2024-04-25T08:56:46.312549+0000","last_became_active":"2024-04-25T08:56:45.218166+0000","last_became_peered":"2024-04-25T08:56:45.218166+0000","last_unstale":"2024-04-25T08:56:46.312549+0000","last_undegraded":"2024-04-25T08:56:46.312549+0000","last_fullsized":"2024-04-25T08:56:46.312549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.208185+0000","last_change":"2024-04-25T08:56:44.211242+0000","last_active":"2024-04-25T08:56:46.208185+0000","last_peered":"2024-04-25T08:56:46.208185+0000","last_clean":"2024-04-25T08:56:46.208185+0000","last_became_active":"2024-04-25T08:56:44.210967+0000","last_became_peered":"2024-04-25T08:56:44.210967+0000","last_unstale":"2024-04-25T08:56:46.208185+0000","last_undegraded":"2024-04-25T08:56:46.208185+0000","last_fullsized":"2024-04-25T08:56:46.208185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312699+0000","last_change":"2024-04-25T08:56:45.214551+0000","last_active":"2024-04-25T08:56:46.312699+0000","last_peered":"2024-04-25T08:56:46.312699+0000","last_clean":"2024-04-25T08:56:46.312699+0000","last_became_active":"2024-04-25T08:56:45.214250+0000","last_became_peered":"2024-04-25T08:56:45.214250+0000","last_unstale":"2024-04-25T08:56:46.312699+0000","last_undegraded":"2024-04-25T08:56:46.312699+0000","last_fullsized":"2024-04-25T08:56:46.312699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:38.844974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312069+0000","last_change":"2024-04-25T08:56:44.215078+0000","last_active":"2024-04-25T08:56:46.312069+0000","last_peered":"2024-04-25T08:56:46.312069+0000","last_clean":"2024-04-25T08:56:46.312069+0000","last_became_active":"2024-04-25T08:56:44.214389+0000","last_became_peered":"2024-04-25T08:56:44.214389+0000","last_unstale":"2024-04-25T08:56:46.312069+0000","last_undegraded":"2024-04-25T08:56:46.312069+0000","last_fullsized":"2024-04-25T08:56:46.312069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:21.864542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.203031+0000","last_change":"2024-04-25T08:56:45.200378+0000","last_active":"2024-04-25T08:56:46.203031+0000","last_peered":"2024-04-25T08:56:46.203031+0000","last_clean":"2024-04-25T08:56:46.203031+0000","last_became_active":"2024-04-25T08:56:45.200097+0000","last_became_peered":"2024-04-25T08:56:45.200097+0000","last_unstale":"2024-04-25T08:56:46.203031+0000","last_undegraded":"2024-04-25T08:56:46.203031+0000","last_fullsized":"2024-04-25T08:56:46.203031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202120+0000","last_change":"2024-04-25T08:56:44.207693+0000","last_active":"2024-04-25T08:56:46.202120+0000","last_peered":"2024-04-25T08:56:46.202120+0000","last_clean":"2024-04-25T08:56:46.202120+0000","last_became_active":"2024-04-25T08:56:44.207401+0000","last_became_peered":"2024-04-25T08:56:44.207401+0000","last_unstale":"2024-04-25T08:56:46.202120+0000","last_undegraded":"2024-04-25T08:56:46.202120+0000","last_fullsized":"2024-04-25T08:56:46.202120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313184+0000","last_change":"2024-04-25T08:56:45.215069+0000","last_active":"2024-04-25T08:56:46.313184+0000","last_peered":"2024-04-25T08:56:46.313184+0000","last_clean":"2024-04-25T08:56:46.313184+0000","last_became_active":"2024-04-25T08:56:45.214326+0000","last_became_peered":"2024-04-25T08:56:45.214326+0000","last_unstale":"2024-04-25T08:56:46.313184+0000","last_undegraded":"2024-04-25T08:56:46.313184+0000","last_fullsized":"2024-04-25T08:56:46.313184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.202098+0000","last_change":"2024-04-25T08:56:44.210794+0000","last_active":"2024-04-25T08:56:46.202098+0000","last_peered":"2024-04-25T08:56:46.202098+0000","last_clean":"2024-04-25T08:56:46.202098+0000","last_became_active":"2024-04-25T08:56:44.210493+0000","last_became_peered":"2024-04-25T08:56:44.210493+0000","last_unstale":"2024-04-25T08:56:46.202098+0000","last_undegraded":"2024-04-25T08:56:46.202098+0000","last_fullsized":"2024-04-25T08:56:46.202098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:12.572651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312764+0000","last_change":"2024-04-25T08:56:45.215033+0000","last_active":"2024-04-25T08:56:46.312764+0000","last_peered":"2024-04-25T08:56:46.312764+0000","last_clean":"2024-04-25T08:56:46.312764+0000","last_became_active":"2024-04-25T08:56:45.214737+0000","last_became_peered":"2024-04-25T08:56:45.214737+0000","last_unstale":"2024-04-25T08:56:46.312764+0000","last_undegraded":"2024-04-25T08:56:46.312764+0000","last_fullsized":"2024-04-25T08:56:46.312764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312808+0000","last_change":"2024-04-25T08:56:44.214790+0000","last_active":"2024-04-25T08:56:46.312808+0000","last_peered":"2024-04-25T08:56:46.312808+0000","last_clean":"2024-04-25T08:56:46.312808+0000","last_became_active":"2024-04-25T08:56:44.214065+0000","last_became_peered":"2024-04-25T08:56:44.214065+0000","last_unstale":"2024-04-25T08:56:46.312808+0000","last_undegraded":"2024-04-25T08:56:46.312808+0000","last_fullsized":"2024-04-25T08:56:46.312808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.207833+0000","last_change":"2024-04-25T08:56:45.206755+0000","last_active":"2024-04-25T08:56:46.207833+0000","last_peered":"2024-04-25T08:56:46.207833+0000","last_clean":"2024-04-25T08:56:46.207833+0000","last_became_active":"2024-04-25T08:56:45.206478+0000","last_became_peered":"2024-04-25T08:56:45.206478+0000","last_unstale":"2024-04-25T08:56:46.207833+0000","last_undegraded":"2024-04-25T08:56:46.207833+0000","last_fullsized":"2024-04-25T08:56:46.207833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313135+0000","last_change":"2024-04-25T08:56:45.214962+0000","last_active":"2024-04-25T08:56:46.313135+0000","last_peered":"2024-04-25T08:56:46.313135+0000","last_clean":"2024-04-25T08:56:46.313135+0000","last_became_active":"2024-04-25T08:56:45.214427+0000","last_became_peered":"2024-04-25T08:56:45.214427+0000","last_unstale":"2024-04-25T08:56:46.313135+0000","last_undegraded":"2024-04-25T08:56:46.313135+0000","last_fullsized":"2024-04-25T08:56:46.313135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:59.350350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312386+0000","last_change":"2024-04-25T08:56:44.214088+0000","last_active":"2024-04-25T08:56:46.312386+0000","last_peered":"2024-04-25T08:56:46.312386+0000","last_clean":"2024-04-25T08:56:46.312386+0000","last_became_active":"2024-04-25T08:56:44.213784+0000","last_became_peered":"2024-04-25T08:56:44.213784+0000","last_unstale":"2024-04-25T08:56:46.312386+0000","last_undegraded":"2024-04-25T08:56:46.312386+0000","last_fullsized":"2024-04-25T08:56:46.312386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.420445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313419+0000","last_change":"2024-04-25T08:56:45.212864+0000","last_active":"2024-04-25T08:56:46.313419+0000","last_peered":"2024-04-25T08:56:46.313419+0000","last_clean":"2024-04-25T08:56:46.313419+0000","last_became_active":"2024-04-25T08:56:45.211275+0000","last_became_peered":"2024-04-25T08:56:45.211275+0000","last_unstale":"2024-04-25T08:56:46.313419+0000","last_undegraded":"2024-04-25T08:56:46.313419+0000","last_fullsized":"2024-04-25T08:56:46.313419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:40.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312581+0000","last_change":"2024-04-25T08:56:44.214267+0000","last_active":"2024-04-25T08:56:46.312581+0000","last_peered":"2024-04-25T08:56:46.312581+0000","last_clean":"2024-04-25T08:56:46.312581+0000","last_became_active":"2024-04-25T08:56:44.213968+0000","last_became_peered":"2024-04-25T08:56:44.213968+0000","last_unstale":"2024-04-25T08:56:46.312581+0000","last_undegraded":"2024-04-25T08:56:46.312581+0000","last_fullsized":"2024-04-25T08:56:46.312581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:17.771428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313067+0000","last_change":"2024-04-25T08:56:45.225578+0000","last_active":"2024-04-25T08:56:46.313067+0000","last_peered":"2024-04-25T08:56:46.313067+0000","last_clean":"2024-04-25T08:56:46.313067+0000","last_became_active":"2024-04-25T08:56:45.224851+0000","last_became_peered":"2024-04-25T08:56:45.224851+0000","last_unstale":"2024-04-25T08:56:46.313067+0000","last_undegraded":"2024-04-25T08:56:46.313067+0000","last_fullsized":"2024-04-25T08:56:46.313067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:07.232507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312485+0000","last_change":"2024-04-25T08:56:44.209898+0000","last_active":"2024-04-25T08:56:46.312485+0000","last_peered":"2024-04-25T08:56:46.312485+0000","last_clean":"2024-04-25T08:56:46.312485+0000","last_became_active":"2024-04-25T08:56:44.208992+0000","last_became_peered":"2024-04-25T08:56:44.208992+0000","last_unstale":"2024-04-25T08:56:46.312485+0000","last_undegraded":"2024-04-25T08:56:46.312485+0000","last_fullsized":"2024-04-25T08:56:46.312485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:50.871028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.312300+0000","last_change":"2024-04-25T08:56:45.207031+0000","last_active":"2024-04-25T08:56:46.312300+0000","last_peered":"2024-04-25T08:56:46.312300+0000","last_clean":"2024-04-25T08:56:46.312300+0000","last_became_active":"2024-04-25T08:56:45.206558+0000","last_became_peered":"2024-04-25T08:56:45.206558+0000","last_unstale":"2024-04-25T08:56:46.312300+0000","last_undegraded":"2024-04-25T08:56:46.312300+0000","last_fullsized":"2024-04-25T08:56:46.312300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:44.185353+0000","last_clean_scrub_stamp":"2024-04-25T08:56:44.185353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:14.412381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T08:56:46.313186+0000","last_change":"2024-04-25T08:56:44.214095+0000","last_active":"2024-04-25T08:56:46.313186+0000","last_peered":"2024-04-25T08:56:46.313186+0000","last_clean":"2024-04-25T08:56:46.313186+0000","last_became_active":"2024-04-25T08:56:44.213800+0000","last_became_peered":"2024-04-25T08:56:44.213800+0000","last_unstale":"2024-04-25T08:56:46.313186+0000","last_undegraded":"2024-04-25T08:56:46.313186+0000","last_fullsized":"2024-04-25T08:56:46.313186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:43.180585+0000","last_clean_scrub_stamp":"2024-04-25T08:56:43.180585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:52.735112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:52.924 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T08:56:52.924 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T08:56:52.924 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T08:56:52.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T08:56:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.070+0000 7f226b688640 1 Processor -- start 2024-04-25T08:56:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.070+0000 7f226b688640 1 -- start start 2024-04-25T08:56:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f226b688640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f226415e0a0 0x7f22640d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f226b688640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22640d3990 0x7f22640d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f226b688640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22640b7f60 con 0x7f22640ce5e0 2024-04-25T08:56:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f226b688640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22640d4330 con 0x7f22640d3990 2024-04-25T08:56:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f226b688640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22640b29c0 con 0x7f226415e0a0 2024-04-25T08:56:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2268c23640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22640d3990 0x7f22640d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2268c23640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22640d3990 0x7f22640d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55646/0 (socket says 172.21.15.5:55646) 2024-04-25T08:56:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2268c23640 1 -- 172.21.15.5:0/1046750133 learned_addr learned my addr 172.21.15.5:0/1046750133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2269424640 1 --2- 172.21.15.5:0/1046750133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f226415e0a0 0x7f22640d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2268c23640 1 -- 172.21.15.5:0/1046750133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f226415e0a0 msgr2=0x7f22640d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2268c23640 1 --2- 172.21.15.5:0/1046750133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f226415e0a0 0x7f22640d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2268c23640 1 -- 172.21.15.5:0/1046750133 >> v1:172.21.15.80:6789/0 conn(0x7f22640ce5e0 legacy=0x7f22640cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.071+0000 7f2268c23640 1 -- 172.21.15.5:0/1046750133 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22640d2080 con 0x7f22640d3990 2024-04-25T08:56:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.072+0000 7f2268c23640 1 --2- 172.21.15.5:0/1046750133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22640d3990 0x7f22640d3df0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2254009870 tx=0x7f225402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a35f5789036f10d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.072+0000 7f225bfff640 1 -- 172.21.15.5:0/1046750133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254037070 con 0x7f22640d3990 2024-04-25T08:56:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.072+0000 7f225bfff640 1 -- 172.21.15.5:0/1046750133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254032440 con 0x7f22640d3990 2024-04-25T08:56:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.072+0000 7f225bfff640 1 -- 172.21.15.5:0/1046750133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254032810 con 0x7f22640d3990 2024-04-25T08:56:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.072+0000 7f226b688640 1 -- 172.21.15.5:0/1046750133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22640d3990 msgr2=0x7f22640d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.072+0000 7f226b688640 1 --2- 172.21.15.5:0/1046750133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22640d3990 0x7f22640d3df0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2254009870 tx=0x7f225402a270 comp rx=0 tx=0).stop 2024-04-25T08:56:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.073+0000 7f226b688640 1 -- 172.21.15.5:0/1046750133 shutdown_connections 2024-04-25T08:56:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.073+0000 7f226b688640 1 --2- 172.21.15.5:0/1046750133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22640d3990 0x7f22640d3df0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.073+0000 7f226b688640 1 --2- 172.21.15.5:0/1046750133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f226415e0a0 0x7f22640d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.073+0000 7f226b688640 1 -- 172.21.15.5:0/1046750133 >> 172.21.15.5:0/1046750133 conn(0x7f22640668f0 msgr2=0x7f2264066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:53.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.073+0000 7f226b688640 1 -- 172.21.15.5:0/1046750133 shutdown_connections 2024-04-25T08:56:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.073+0000 7f226b688640 1 -- 172.21.15.5:0/1046750133 wait complete. 2024-04-25T08:56:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.074+0000 7f226b688640 1 Processor -- start 2024-04-25T08:56:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.074+0000 7f226b688640 1 -- start start 2024-04-25T08:56:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.074+0000 7f226b688640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22640ce5e0 0x7f226414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.074+0000 7f226b688640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640d3990 0x7f226415e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f226b688640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f226415e0a0 0x7f22640ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f226b688640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640d2920 con 0x7f226415e0a0 2024-04-25T08:56:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f226b688640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640d2640 con 0x7f22640d3990 2024-04-25T08:56:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f226b688640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22640d2c00 con 0x7f22640ce5e0 2024-04-25T08:56:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f226415e0a0 0x7f22640ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f226415e0a0 0x7f22640ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55656/0 (socket says 172.21.15.5:55656) 2024-04-25T08:56:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 -- 172.21.15.5:0/363094495 learned_addr learned my addr 172.21.15.5:0/363094495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269424640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22640ce5e0 0x7f226414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2268c23640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640d3990 0x7f226415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 -- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22640ce5e0 msgr2=0x7f226414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22640ce5e0 0x7f226414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 -- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640d3990 msgr2=0x7f226415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640d3990 0x7f226415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 -- 172.21.15.5:0/363094495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226415edf0 con 0x7f226415e0a0 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2268c23640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640d3990 0x7f226415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269424640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22640ce5e0 0x7f226414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2269c25640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f226415e0a0 0x7f22640ccc60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c6e0 tx=0x7f225c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2259ffb640 1 -- 172.21.15.5:0/363094495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c003b70 con 0x7f226415e0a0 2024-04-25T08:56:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2259ffb640 1 -- 172.21.15.5:0/363094495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c003d30 con 0x7f226415e0a0 2024-04-25T08:56:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226415f0d0 con 0x7f226415e0a0 2024-04-25T08:56:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f2259ffb640 1 -- 172.21.15.5:0/363094495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c005310 con 0x7f226415e0a0 2024-04-25T08:56:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.075+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226415f690 con 0x7f226415e0a0 2024-04-25T08:56:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.076+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226404ef20 con 0x7f226415e0a0 2024-04-25T08:56:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.077+0000 7f2259ffb640 1 -- 172.21.15.5:0/363094495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f225c0054b0 con 0x7f226415e0a0 2024-04-25T08:56:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.077+0000 7f2259ffb640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f224806b4d0 0x7f224806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.077+0000 7f2259ffb640 1 -- 172.21.15.5:0/363094495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f225c08a040 con 0x7f226415e0a0 2024-04-25T08:56:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.078+0000 7f2269424640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f224806b4d0 0x7f224806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.078+0000 7f2269424640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f224806b4d0 0x7f224806d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2260006fd0 tx=0x7f2260008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.081+0000 7f2259ffb640 1 -- 172.21.15.5:0/363094495 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f225c058ec0 con 0x7f226415e0a0 2024-04-25T08:56:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.305+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f22640d03a0 con 0x7f226415e0a0 2024-04-25T08:56:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.306+0000 7f2259ffb640 1 -- 172.21.15.5:0/363094495 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f225c0587c0 con 0x7f226415e0a0 2024-04-25T08:56:53.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:53.297 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T08:56:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f224806b4d0 msgr2=0x7f224806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f224806b4d0 0x7f224806d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2260006fd0 tx=0x7f2260008040 comp rx=0 tx=0).stop 2024-04-25T08:56:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f226415e0a0 msgr2=0x7f22640ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f226415e0a0 0x7f22640ccc60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c6e0 tx=0x7f225c00cba0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 shutdown_connections 2024-04-25T08:56:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f224806b4d0 0x7f224806d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f226415e0a0 0x7f22640ccc60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640d3990 0x7f226415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 --2- 172.21.15.5:0/363094495 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22640ce5e0 0x7f226414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 >> 172.21.15.5:0/363094495 conn(0x7f22640668f0 msgr2=0x7f22640b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 shutdown_connections 2024-04-25T08:56:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.308+0000 7f226b688640 1 -- 172.21.15.5:0/363094495 wait complete. 2024-04-25T08:56:53.309 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T08:56:53.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.420+0000 7f1d4725d640 1 Processor -- start 2024-04-25T08:56:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.420+0000 7f1d4725d640 1 -- start start 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d4725d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d4015de70 0x7f1d400b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d4725d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d400b2cc0 0x7f1d400b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d4725d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d400d20e0 con 0x7f1d400b7130 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d4725d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400d2a10 con 0x7f1d400b2cc0 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d4725d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400d23c0 con 0x7f1d4015de70 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d3ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d400b2cc0 0x7f1d400b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d457fa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1d400b7130 0x7f1d400ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38254/0 (socket says 172.21.15.5:38254) 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d457fa640 1 -- 172.21.15.5:0/3221817253 learned_addr learned my addr 172.21.15.5:0/3221817253 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d44ff9640 1 --2- 172.21.15.5:0/3221817253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d4015de70 0x7f1d400b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d3ffff640 1 -- 172.21.15.5:0/3221817253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d4015de70 msgr2=0x7f1d400b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d3ffff640 1 --2- 172.21.15.5:0/3221817253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d4015de70 0x7f1d400b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d3ffff640 1 -- 172.21.15.5:0/3221817253 >> v1:172.21.15.5:6789/0 conn(0x7f1d400b7130 legacy=0x7f1d400ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d3ffff640 1 -- 172.21.15.5:0/3221817253 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400d26a0 con 0x7f1d400b2cc0 2024-04-25T08:56:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.421+0000 7f1d3f7fe640 1 -- 172.21.15.5:0/3221817253 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289928541 0 0) 0x7f1d400d20e0 con 0x7f1d400b7130 2024-04-25T08:56:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.422+0000 7f1d3ffff640 1 --2- 172.21.15.5:0/3221817253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d400b6bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d340097a0 tx=0x7f1d3402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be70a255afa3bf65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.422+0000 7f1d3f7fe640 1 -- 172.21.15.5:0/3221817253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34037070 con 0x7f1d400b2cc0 2024-04-25T08:56:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.422+0000 7f1d3f7fe640 1 -- 172.21.15.5:0/3221817253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34032440 con 0x7f1d400b2cc0 2024-04-25T08:56:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.422+0000 7f1d3f7fe640 1 -- 172.21.15.5:0/3221817253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34032810 con 0x7f1d400b2cc0 2024-04-25T08:56:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 -- 172.21.15.5:0/3221817253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 msgr2=0x7f1d400b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 --2- 172.21.15.5:0/3221817253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d400b6bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d340097a0 tx=0x7f1d3402a180 comp rx=0 tx=0).stop 2024-04-25T08:56:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 -- 172.21.15.5:0/3221817253 shutdown_connections 2024-04-25T08:56:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 --2- 172.21.15.5:0/3221817253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d400b6bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 --2- 172.21.15.5:0/3221817253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d4015de70 0x7f1d400b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 -- 172.21.15.5:0/3221817253 >> 172.21.15.5:0/3221817253 conn(0x7f1d4006b000 msgr2=0x7f1d4006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 -- 172.21.15.5:0/3221817253 shutdown_connections 2024-04-25T08:56:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.423+0000 7f1d4725d640 1 -- 172.21.15.5:0/3221817253 wait complete. 2024-04-25T08:56:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.424+0000 7f1d4725d640 1 Processor -- start 2024-04-25T08:56:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.424+0000 7f1d4725d640 1 -- start start 2024-04-25T08:56:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d4725d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d40152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d4725d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d400b7130 0x7f1d400c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d4725d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4015de70 0x7f1d400c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d4725d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400cf080 con 0x7f1d400b2cc0 2024-04-25T08:56:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d4725d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400cef00 con 0x7f1d4015de70 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d4725d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400cf200 con 0x7f1d400b7130 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d40152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d40152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55676/0 (socket says 172.21.15.5:55676) 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 -- 172.21.15.5:0/2006752651 learned_addr learned my addr 172.21.15.5:0/2006752651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d3ffff640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d400b7130 0x7f1d400c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 -- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d400b7130 msgr2=0x7f1d400c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d400b7130 0x7f1d400c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 -- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4015de70 msgr2=0x7f1d400c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d457fa640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4015de70 0x7f1d400c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4015de70 0x7f1d400c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 -- 172.21.15.5:0/2006752651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400b4dc0 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.425+0000 7f1d44ff9640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d40152ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c820 tx=0x7f1d3000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.426+0000 7f1d3d7fa640 1 -- 172.21.15.5:0/2006752651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30015070 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.426+0000 7f1d3d7fa640 1 -- 172.21.15.5:0/2006752651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30004020 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.426+0000 7f1d3d7fa640 1 -- 172.21.15.5:0/2006752651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300043f0 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.426+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d400b4000 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.426+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d400b45c0 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.427+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4004ef20 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.427+0000 7f1d3d7fa640 1 -- 172.21.15.5:0/2006752651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d30007830 con 0x7f1d400b2cc0 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.427+0000 7f1d3d7fa640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d2c06b4d0 0x7f1d2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.428+0000 7f1d3d7fa640 1 -- 172.21.15.5:0/2006752651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d30089ff0 con 0x7f1d400b2cc0 2024-04-25T08:56:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.428+0000 7f1d3ffff640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d2c06b4d0 0x7f1d2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.428+0000 7f1d3ffff640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d2c06b4d0 0x7f1d2c06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d34034000 tx=0x7f1d3402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.432+0000 7f1d3d7fa640 1 -- 172.21.15.5:0/2006752651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d30058ea0 con 0x7f1d400b2cc0 2024-04-25T08:56:53.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.613+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d400d0720 con 0x7f1d400b2cc0 2024-04-25T08:56:53.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.614+0000 7f1d3d7fa640 1 -- 172.21.15.5:0/2006752651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f1d300587a0 con 0x7f1d400b2cc0 2024-04-25T08:56:53.604 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:53.605 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d2c06b4d0 msgr2=0x7f1d2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d2c06b4d0 0x7f1d2c06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d34034000 tx=0x7f1d3402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 msgr2=0x7f1d40152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d40152ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c820 tx=0x7f1d3000cce0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 shutdown_connections 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d2c06b4d0 0x7f1d2c06d990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4015de70 0x7f1d400c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d400b7130 0x7f1d400c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 --2- 172.21.15.5:0/2006752651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d400b2cc0 0x7f1d40152ea0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.616+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 >> 172.21.15.5:0/2006752651 conn(0x7f1d4006b000 msgr2=0x7f1d4015e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.617+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 shutdown_connections 2024-04-25T08:56:53.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.617+0000 7f1d4725d640 1 -- 172.21.15.5:0/2006752651 wait complete. 2024-04-25T08:56:53.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:53.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:53.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.732+0000 7f478cf5c640 1 Processor -- start 2024-04-25T08:56:53.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.732+0000 7f478cf5c640 1 -- start start 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f478cf5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47880d2f70 0x7f47880ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f478cf5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47880b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f478cf5c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47880d1ed0 con 0x7f478815df70 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f478cf5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880d1c80 con 0x7f47880d2f70 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f478cf5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880d2ae0 con 0x7f47880ced50 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4785d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47880d2f70 0x7f47880ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4785d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47880d2f70 0x7f47880ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55682/0 (socket says 172.21.15.5:55682) 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4785d9b640 1 -- 172.21.15.5:0/3518325407 learned_addr learned my addr 172.21.15.5:0/3518325407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4786d9d640 1 --2- 172.21.15.5:0/3518325407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47880b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4785d9b640 1 -- 172.21.15.5:0/3518325407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 msgr2=0x7f47880b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4785d9b640 1 --2- 172.21.15.5:0/3518325407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47880b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4785d9b640 1 -- 172.21.15.5:0/3518325407 >> v1:172.21.15.80:6789/0 conn(0x7f478815df70 legacy=0x7f47880b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.733+0000 7f4785d9b640 1 -- 172.21.15.5:0/3518325407 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880d21b0 con 0x7f47880d2f70 2024-04-25T08:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.734+0000 7f4785d9b640 1 --2- 172.21.15.5:0/3518325407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47880d2f70 0x7f47880ce810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f477c009870 tx=0x7f477c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c5e9a72fca123c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.734+0000 7f478559a640 1 -- 172.21.15.5:0/3518325407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c037070 con 0x7f47880d2f70 2024-04-25T08:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.734+0000 7f478559a640 1 -- 172.21.15.5:0/3518325407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c02ae50 con 0x7f47880d2f70 2024-04-25T08:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.734+0000 7f478559a640 1 -- 172.21.15.5:0/3518325407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c032860 con 0x7f47880d2f70 2024-04-25T08:56:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 -- 172.21.15.5:0/3518325407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47880d2f70 msgr2=0x7f47880ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 --2- 172.21.15.5:0/3518325407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47880d2f70 0x7f47880ce810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f477c009870 tx=0x7f477c02a300 comp rx=0 tx=0).stop 2024-04-25T08:56:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 -- 172.21.15.5:0/3518325407 shutdown_connections 2024-04-25T08:56:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 --2- 172.21.15.5:0/3518325407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47880b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 --2- 172.21.15.5:0/3518325407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47880d2f70 0x7f47880ce810 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 -- 172.21.15.5:0/3518325407 >> 172.21.15.5:0/3518325407 conn(0x7f478806b000 msgr2=0x7f478806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 -- 172.21.15.5:0/3518325407 shutdown_connections 2024-04-25T08:56:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.735+0000 7f478cf5c640 1 -- 172.21.15.5:0/3518325407 wait complete. 2024-04-25T08:56:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.736+0000 7f478cf5c640 1 Processor -- start 2024-04-25T08:56:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.736+0000 7f478cf5c640 1 -- start start 2024-04-25T08:56:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f478cf5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47881505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f478cf5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47880d2f70 0x7f478814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f478cf5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47881f3e20 0x7f47880c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f478cf5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880d3720 con 0x7f47881f3e20 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f478cf5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880d2770 con 0x7f47880d2f70 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f478cf5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880d38a0 con 0x7f47880ced50 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47881f3e20 0x7f47880c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47881f3e20 0x7f47880c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55698/0 (socket says 172.21.15.5:55698) 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 -- 172.21.15.5:0/1449691570 learned_addr learned my addr 172.21.15.5:0/1449691570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f478659c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47881505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4785d9b640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47880d2f70 0x7f478814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 -- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 msgr2=0x7f47881505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47881505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 -- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47880d2f70 msgr2=0x7f478814d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47880d2f70 0x7f478814d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.737+0000 7f4786d9d640 1 -- 172.21.15.5:0/1449691570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788150b20 con 0x7f47881f3e20 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.738+0000 7f4786d9d640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47881f3e20 0x7f47880c9240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f477800efc0 tx=0x7f477800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.738+0000 7f4776ffd640 1 -- 172.21.15.5:0/1449691570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778018020 con 0x7f47881f3e20 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.738+0000 7f4776ffd640 1 -- 172.21.15.5:0/1449691570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4778014480 con 0x7f47881f3e20 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.738+0000 7f4776ffd640 1 -- 172.21.15.5:0/1449691570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778014870 con 0x7f47881f3e20 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.738+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478814d860 con 0x7f47881f3e20 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.738+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47881f4650 con 0x7f47881f3e20 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.739+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478804ef20 con 0x7f47881f3e20 2024-04-25T08:56:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.739+0000 7f4776ffd640 1 -- 172.21.15.5:0/1449691570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4778005d10 con 0x7f47881f3e20 2024-04-25T08:56:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.740+0000 7f4776ffd640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f476806b4d0 0x7f476806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.740+0000 7f4776ffd640 1 -- 172.21.15.5:0/1449691570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f477808ac00 con 0x7f47881f3e20 2024-04-25T08:56:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.740+0000 7f478659c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f476806b4d0 0x7f476806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.740+0000 7f478659c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f476806b4d0 0x7f476806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f478815f120 tx=0x7f4780009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:53.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.744+0000 7f4776ffd640 1 -- 172.21.15.5:0/1449691570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4778022070 con 0x7f47881f3e20 2024-04-25T08:56:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.927+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47880c6400 con 0x7f47881f3e20 2024-04-25T08:56:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.927+0000 7f4776ffd640 1 -- 172.21.15.5:0/1449691570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f478814d860 con 0x7f47881f3e20 2024-04-25T08:56:53.917 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:56:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f476806b4d0 msgr2=0x7f476806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f476806b4d0 0x7f476806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f478815f120 tx=0x7f4780009040 comp rx=0 tx=0).stop 2024-04-25T08:56:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47881f3e20 msgr2=0x7f47880c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47881f3e20 0x7f47880c9240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f477800efc0 tx=0x7f477800c490 comp rx=0 tx=0).stop 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 shutdown_connections 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f476806b4d0 0x7f476806d990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47881f3e20 0x7f47880c9240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47880d2f70 0x7f478814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 --2- 172.21.15.5:0/1449691570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47880ced50 0x7f47881505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 >> 172.21.15.5:0/1449691570 conn(0x7f478806b000 msgr2=0x7f47880b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 shutdown_connections 2024-04-25T08:56:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:53.929+0000 7f478cf5c640 1 -- 172.21.15.5:0/1449691570 wait complete. 2024-04-25T08:56:53.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:56:54.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.044+0000 7f74cd85d640 1 Processor -- start 2024-04-25T08:56:54.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.044+0000 7f74cd85d640 1 -- start start 2024-04-25T08:56:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74cd85d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74c80ce6a0 0x7f74c80cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74cd85d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74cd85d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c80cd990 con 0x7f74c80d25d0 2024-04-25T08:56:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74cd85d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c80d0b80 con 0x7f74c80ce6a0 2024-04-25T08:56:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74cd85d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80cffe0 con 0x7f74c80cea80 2024-04-25T08:56:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74c80ce6a0 0x7f74c80cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74c80ce6a0 0x7f74c80cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55714/0 (socket says 172.21.15.5:55714) 2024-04-25T08:56:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c6ffd640 1 -- 172.21.15.5:0/2623429212 learned_addr learned my addr 172.21.15.5:0/2623429212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c77fe640 1 --2- 172.21.15.5:0/2623429212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c6ffd640 1 -- 172.21.15.5:0/2623429212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 msgr2=0x7f74c815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c6ffd640 1 --2- 172.21.15.5:0/2623429212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c815ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c6ffd640 1 -- 172.21.15.5:0/2623429212 >> v1:172.21.15.80:6789/0 conn(0x7f74c80d25d0 legacy=0x7f74c80d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.045+0000 7f74c6ffd640 1 -- 172.21.15.5:0/2623429212 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c80cf6b0 con 0x7f74c80ce6a0 2024-04-25T08:56:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.046+0000 7f74c6ffd640 1 --2- 172.21.15.5:0/2623429212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c80cd160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009870 tx=0x7f74b802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e7bb2753c3c6aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.046+0000 7f74c5ffb640 1 -- 172.21.15.5:0/2623429212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8037070 con 0x7f74c80ce6a0 2024-04-25T08:56:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.046+0000 7f74c5ffb640 1 -- 172.21.15.5:0/2623429212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8032440 con 0x7f74c80ce6a0 2024-04-25T08:56:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.046+0000 7f74c5ffb640 1 -- 172.21.15.5:0/2623429212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8032810 con 0x7f74c80ce6a0 2024-04-25T08:56:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 -- 172.21.15.5:0/2623429212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 msgr2=0x7f74c80cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 --2- 172.21.15.5:0/2623429212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c80cd160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009870 tx=0x7f74b802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 -- 172.21.15.5:0/2623429212 shutdown_connections 2024-04-25T08:56:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 --2- 172.21.15.5:0/2623429212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 --2- 172.21.15.5:0/2623429212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c80cd160 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 -- 172.21.15.5:0/2623429212 >> 172.21.15.5:0/2623429212 conn(0x7f74c80d1a40 msgr2=0x7f74c80d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 -- 172.21.15.5:0/2623429212 shutdown_connections 2024-04-25T08:56:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.047+0000 7f74cd85d640 1 -- 172.21.15.5:0/2623429212 wait complete. 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.048+0000 7f74cd85d640 1 Processor -- start 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.048+0000 7f74cd85d640 1 -- start start 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c815de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c80c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74c80d25d0 0x7f74c80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80cd6a0 con 0x7f74c80ce6a0 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80cfc70 con 0x7f74c80d25d0 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c815f380 con 0x7f74c80cea80 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c815de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55724/0 (socket says 172.21.15.5:55724) 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 -- 172.21.15.5:0/1026307105 learned_addr learned my addr 172.21.15.5:0/1026307105 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c67fc640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c80c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c77fe640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74c80d25d0 0x7f74c80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 -- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 msgr2=0x7f74c80c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c80c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 -- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74c80d25d0 msgr2=0x7f74c80c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74c80d25d0 0x7f74c80c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 -- 172.21.15.5:0/1026307105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c809f740 con 0x7f74c80ce6a0 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c67fc640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c80c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c77fe640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74c80d25d0 0x7f74c80c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74c6ffd640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c815de70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000c00 tx=0x7f74b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74affff640 1 -- 172.21.15.5:0/1026307105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8041020 con 0x7f74c80ce6a0 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74affff640 1 -- 172.21.15.5:0/1026307105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80306c0 con 0x7f74c80ce6a0 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c81f2060 con 0x7f74c80ce6a0 2024-04-25T08:56:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74affff640 1 -- 172.21.15.5:0/1026307105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8037040 con 0x7f74c80ce6a0 2024-04-25T08:56:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.049+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c81f2620 con 0x7f74c80ce6a0 2024-04-25T08:56:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.050+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c804ef20 con 0x7f74c80ce6a0 2024-04-25T08:56:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.051+0000 7f74affff640 1 -- 172.21.15.5:0/1026307105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74b8044020 con 0x7f74c80ce6a0 2024-04-25T08:56:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.051+0000 7f74affff640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74b406b4d0 0x7f74b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.052+0000 7f74affff640 1 -- 172.21.15.5:0/1026307105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74b80aa9d0 con 0x7f74c80ce6a0 2024-04-25T08:56:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.052+0000 7f74c67fc640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74b406b4d0 0x7f74b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.052+0000 7f74c67fc640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74b406b4d0 0x7f74b406d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f74c81e5bd0 tx=0x7f74bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.056+0000 7f74affff640 1 -- 172.21.15.5:0/1026307105 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74b804b030 con 0x7f74c80ce6a0 2024-04-25T08:56:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.234+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74c80b79c0 con 0x7f74c80ce6a0 2024-04-25T08:56:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.235+0000 7f74affff640 1 -- 172.21.15.5:0/1026307105 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74b8079850 con 0x7f74c80ce6a0 2024-04-25T08:56:54.225 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:56:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74b406b4d0 msgr2=0x7f74b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74b406b4d0 0x7f74b406d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f74c81e5bd0 tx=0x7f74bc009040 comp rx=0 tx=0).stop 2024-04-25T08:56:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 msgr2=0x7f74c815de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c815de70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000c00 tx=0x7f74b80046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 shutdown_connections 2024-04-25T08:56:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74b406b4d0 0x7f74b406d990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74c80d25d0 0x7f74c80c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74c80cea80 0x7f74c80c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 --2- 172.21.15.5:0/1026307105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c80ce6a0 0x7f74c815de70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 >> 172.21.15.5:0/1026307105 conn(0x7f74c80d1a40 msgr2=0x7f74c80b58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 shutdown_connections 2024-04-25T08:56:54.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.237+0000 7f74cd85d640 1 -- 172.21.15.5:0/1026307105 wait complete. 2024-04-25T08:56:54.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:56:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.351+0000 7fef5c2cb640 1 Processor -- start 2024-04-25T08:56:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.351+0000 7fef5c2cb640 1 -- start start 2024-04-25T08:56:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.352+0000 7fef5c2cb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef540d0610 0x7fef540b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.352+0000 7fef5c2cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540cdef0 con 0x7fef5415c0f0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.352+0000 7fef5c2cb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540cf7a0 con 0x7fef540b24b0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.352+0000 7fef5c2cb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540cd350 con 0x7fef540d0610 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.352+0000 7fef5a067640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef5415c0f0 0x7fef540cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38268/0 (socket says 172.21.15.5:38268) 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.352+0000 7fef5a067640 1 -- 172.21.15.5:0/3971107008 learned_addr learned my addr 172.21.15.5:0/3971107008 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.352+0000 7fef5a868640 1 --2- 172.21.15.5:0/3971107008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef540d0610 0x7fef540b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.353+0000 7fef59065640 1 -- 172.21.15.5:0/3971107008 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810002945 0 0) 0x7fef540cdef0 con 0x7fef5415c0f0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.353+0000 7fef59065640 1 -- 172.21.15.5:0/3971107008 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef40003520 con 0x7fef5415c0f0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.353+0000 7fef59065640 1 -- 172.21.15.5:0/3971107008 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724243638 0 0) 0x7fef540cf7a0 con 0x7fef540b24b0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.353+0000 7fef59065640 1 -- 172.21.15.5:0/3971107008 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef540cdef0 con 0x7fef540b24b0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.353+0000 7fef5a868640 1 -- 172.21.15.5:0/3971107008 >> v1:172.21.15.80:6789/0 conn(0x7fef540b24b0 legacy=0x7fef540cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.353+0000 7fef5a868640 1 -- 172.21.15.5:0/3971107008 >> v1:172.21.15.5:6789/0 conn(0x7fef5415c0f0 legacy=0x7fef540cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.353+0000 7fef5a868640 1 -- 172.21.15.5:0/3971107008 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540d24e0 con 0x7fef540d0610 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5a868640 1 --2- 172.21.15.5:0/3971107008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef540d0610 0x7fef540b2960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009dc0 tx=0x7fef4c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a29c9fe5271a97f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef59065640 1 -- 172.21.15.5:0/3971107008 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c007740 con 0x7fef540d0610 2024-04-25T08:56:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef59065640 1 -- 172.21.15.5:0/3971107008 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c0078e0 con 0x7fef540d0610 2024-04-25T08:56:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef59065640 1 -- 172.21.15.5:0/3971107008 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c007c90 con 0x7fef540d0610 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5c2cb640 1 -- 172.21.15.5:0/3971107008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef540d0610 msgr2=0x7fef540b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/3971107008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef540d0610 0x7fef540b2960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009dc0 tx=0x7fef4c02a6d0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5c2cb640 1 -- 172.21.15.5:0/3971107008 shutdown_connections 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/3971107008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef540d0610 0x7fef540b2960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5c2cb640 1 -- 172.21.15.5:0/3971107008 >> 172.21.15.5:0/3971107008 conn(0x7fef540d1920 msgr2=0x7fef540d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5c2cb640 1 -- 172.21.15.5:0/3971107008 shutdown_connections 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.354+0000 7fef5c2cb640 1 -- 172.21.15.5:0/3971107008 wait complete. 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 Processor -- start 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 -- start start 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef540b24b0 0x7fef540b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef540d0610 0x7fef540ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef5415c0f0 0x7fef54158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540cfa40 con 0x7fef540d0610 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540b3170 con 0x7fef540b24b0 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.356+0000 7fef5c2cb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540c5470 con 0x7fef5415c0f0 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef540d0610 0x7fef540ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef540d0610 0x7fef540ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55736/0 (socket says 172.21.15.5:55736) 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 -- 172.21.15.5:0/490427516 learned_addr learned my addr 172.21.15.5:0/490427516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef5a067640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef540b24b0 0x7fef540b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef5a868640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef5415c0f0 0x7fef54158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 -- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef5415c0f0 msgr2=0x7fef54158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef5415c0f0 0x7fef54158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 -- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef540b24b0 msgr2=0x7fef540b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef540b24b0 0x7fef540b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 -- 172.21.15.5:0/490427516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef541f5240 con 0x7fef540d0610 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef5a868640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef5415c0f0 0x7fef54158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef59866640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef540d0610 0x7fef540ae7e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c500 tx=0x7fef4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef4affd640 1 -- 172.21.15.5:0/490427516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440052d0 con 0x7fef540d0610 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef4affd640 1 -- 172.21.15.5:0/490427516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44005490 con 0x7fef540d0610 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef4affd640 1 -- 172.21.15.5:0/490427516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44012870 con 0x7fef540d0610 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef541f5520 con 0x7fef540d0610 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.357+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef541f5ae0 con 0x7fef540d0610 2024-04-25T08:56:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.358+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5404ef20 con 0x7fef540d0610 2024-04-25T08:56:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.359+0000 7fef4affd640 1 -- 172.21.15.5:0/490427516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef44012a10 con 0x7fef540d0610 2024-04-25T08:56:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.359+0000 7fef4affd640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef3806b4d0 0x7fef3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.359+0000 7fef4affd640 1 -- 172.21.15.5:0/490427516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef44089e50 con 0x7fef540d0610 2024-04-25T08:56:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.360+0000 7fef5a067640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef3806b4d0 0x7fef3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.360+0000 7fef5a067640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef3806b4d0 0x7fef3806d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef500011e0 tx=0x7fef50007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.364+0000 7fef4affd640 1 -- 172.21.15.5:0/490427516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef44058ce0 con 0x7fef540d0610 2024-04-25T08:56:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.544+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef540c78d0 con 0x7fef540d0610 2024-04-25T08:56:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.545+0000 7fef4affd640 1 -- 172.21.15.5:0/490427516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef440585e0 con 0x7fef540d0610 2024-04-25T08:56:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:56:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef3806b4d0 msgr2=0x7fef3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef3806b4d0 0x7fef3806d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef500011e0 tx=0x7fef50007d30 comp rx=0 tx=0).stop 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef540d0610 msgr2=0x7fef540ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef540d0610 0x7fef540ae7e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c500 tx=0x7fef4400c9c0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 shutdown_connections 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef3806b4d0 0x7fef3806d990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef5415c0f0 0x7fef54158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef540d0610 0x7fef540ae7e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 --2- 172.21.15.5:0/490427516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef540b24b0 0x7fef540b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 >> 172.21.15.5:0/490427516 conn(0x7fef540d1920 msgr2=0x7fef54159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 shutdown_connections 2024-04-25T08:56:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.546+0000 7fef5c2cb640 1 -- 172.21.15.5:0/490427516 wait complete. 2024-04-25T08:56:54.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:54.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.657+0000 7f073cda5640 1 Processor -- start 2024-04-25T08:56:54.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.657+0000 7f073cda5640 1 -- start start 2024-04-25T08:56:54.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f073cda5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f073815e0a0 0x7f07380d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f073cda5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07380d3990 0x7f07380d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f073cda5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f07380cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f073cda5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07380d4330 con 0x7f07380d3990 2024-04-25T08:56:54.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f073cda5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07380b29c0 con 0x7f073815e0a0 2024-04-25T08:56:54.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f073cda5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07380d2080 con 0x7f07380ce5e0 2024-04-25T08:56:54.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f0735d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07380d3990 0x7f07380d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f0735d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07380d3990 0x7f07380d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55746/0 (socket says 172.21.15.5:55746) 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f0735d9b640 1 -- 172.21.15.5:0/2030841840 learned_addr learned my addr 172.21.15.5:0/2030841840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f073659c640 1 --2- 172.21.15.5:0/2030841840 >> v2:172.21.15.80:3300/0 conn(0x7f073815e0a0 0x7f07380d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.658+0000 7f0736d9d640 1 --2- 172.21.15.5:0/2030841840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f07380cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f0735d9b640 1 -- 172.21.15.5:0/2030841840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 msgr2=0x7f07380cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f0735d9b640 1 --2- 172.21.15.5:0/2030841840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f07380cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f0735d9b640 1 -- 172.21.15.5:0/2030841840 >> v2:172.21.15.80:3300/0 conn(0x7f073815e0a0 msgr2=0x7f07380d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f0735d9b640 1 --2- 172.21.15.5:0/2030841840 >> v2:172.21.15.80:3300/0 conn(0x7f073815e0a0 0x7f07380d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f0735d9b640 1 -- 172.21.15.5:0/2030841840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380d2360 con 0x7f07380d3990 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f073659c640 1 --2- 172.21.15.5:0/2030841840 >> v2:172.21.15.80:3300/0 conn(0x7f073815e0a0 0x7f07380d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f0736d9d640 1 --2- 172.21.15.5:0/2030841840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f07380cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f0735d9b640 1 --2- 172.21.15.5:0/2030841840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07380d3990 0x7f07380d3df0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f07380b6680 tx=0x7f072002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb18c000bf6bd6fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f073559a640 1 -- 172.21.15.5:0/2030841840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720037070 con 0x7f07380d3990 2024-04-25T08:56:54.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f073559a640 1 -- 172.21.15.5:0/2030841840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0720032440 con 0x7f07380d3990 2024-04-25T08:56:54.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.659+0000 7f073559a640 1 -- 172.21.15.5:0/2030841840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720032810 con 0x7f07380d3990 2024-04-25T08:56:54.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 -- 172.21.15.5:0/2030841840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07380d3990 msgr2=0x7f07380d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 --2- 172.21.15.5:0/2030841840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07380d3990 0x7f07380d3df0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f07380b6680 tx=0x7f072002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 -- 172.21.15.5:0/2030841840 shutdown_connections 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 --2- 172.21.15.5:0/2030841840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f07380cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 --2- 172.21.15.5:0/2030841840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07380d3990 0x7f07380d3df0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 --2- 172.21.15.5:0/2030841840 >> v2:172.21.15.80:3300/0 conn(0x7f073815e0a0 0x7f07380d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 -- 172.21.15.5:0/2030841840 >> 172.21.15.5:0/2030841840 conn(0x7f07380668f0 msgr2=0x7f0738066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 -- 172.21.15.5:0/2030841840 shutdown_connections 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.660+0000 7f073cda5640 1 -- 172.21.15.5:0/2030841840 wait complete. 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.661+0000 7f073cda5640 1 Processor -- start 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.661+0000 7f073cda5640 1 -- start start 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f073cda5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f073815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f073cda5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07380d3990 0x7f07380b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f073cda5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073815e0a0 0x7f07380cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f073cda5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380d2c00 con 0x7f073815e0a0 2024-04-25T08:56:54.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f073cda5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380d2920 con 0x7f07380d3990 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f073cda5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073815e480 con 0x7f07380ce5e0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f0736d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073815e0a0 0x7f07380cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f0736d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073815e0a0 0x7f07380cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55748/0 (socket says 172.21.15.5:55748) 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f0736d9d640 1 -- 172.21.15.5:0/706830237 learned_addr learned my addr 172.21.15.5:0/706830237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f0735d9b640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07380d3990 0x7f07380b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.662+0000 7f073659c640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f073815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f0736d9d640 1 -- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 msgr2=0x7f073815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f0736d9d640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f073815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f0736d9d640 1 -- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07380d3990 msgr2=0x7f07380b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f0736d9d640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07380d3990 0x7f07380b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f0736d9d640 1 -- 172.21.15.5:0/706830237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380c8ca0 con 0x7f073815e0a0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f0736d9d640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073815e0a0 0x7f07380cc9b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0728007de0 tx=0x7f072800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f072effd640 1 -- 172.21.15.5:0/706830237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072801a070 con 0x7f073815e0a0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f072effd640 1 -- 172.21.15.5:0/706830237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0728003990 con 0x7f073815e0a0 2024-04-25T08:56:54.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07380b2490 con 0x7f073815e0a0 2024-04-25T08:56:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f072effd640 1 -- 172.21.15.5:0/706830237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728003d80 con 0x7f073815e0a0 2024-04-25T08:56:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.663+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07380cbed0 con 0x7f073815e0a0 2024-04-25T08:56:54.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.664+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073804ef20 con 0x7f073815e0a0 2024-04-25T08:56:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.664+0000 7f072effd640 1 -- 172.21.15.5:0/706830237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f072801d070 con 0x7f073815e0a0 2024-04-25T08:56:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.665+0000 7f072effd640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f071806b4d0 0x7f071806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.665+0000 7f072effd640 1 -- 172.21.15.5:0/706830237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f072808a330 con 0x7f073815e0a0 2024-04-25T08:56:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.665+0000 7f073659c640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f071806b4d0 0x7f071806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.665+0000 7f073659c640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f071806b4d0 0x7f071806d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0730006fd0 tx=0x7f0730008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.669+0000 7f072effd640 1 -- 172.21.15.5:0/706830237 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0728010070 con 0x7f073815e0a0 2024-04-25T08:56:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.885+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07380b67e0 con 0x7f073815e0a0 2024-04-25T08:56:54.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.885+0000 7f072effd640 1 -- 172.21.15.5:0/706830237 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7f0728058bf0 con 0x7f073815e0a0 2024-04-25T08:56:54.875 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:54.875 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:56:54.875 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:56:54.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f071806b4d0 msgr2=0x7f071806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f071806b4d0 0x7f071806d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0730006fd0 tx=0x7f0730008040 comp rx=0 tx=0).stop 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073815e0a0 msgr2=0x7f07380cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073815e0a0 0x7f07380cc9b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0728007de0 tx=0x7f072800d4a0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 shutdown_connections 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f071806b4d0 0x7f071806d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073815e0a0 0x7f07380cc9b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07380d3990 0x7f07380b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 --2- 172.21.15.5:0/706830237 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07380ce5e0 0x7f073815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 >> 172.21.15.5:0/706830237 conn(0x7f07380668f0 msgr2=0x7f07380b8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 shutdown_connections 2024-04-25T08:56:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:54.887+0000 7f073cda5640 1 -- 172.21.15.5:0/706830237 wait complete. 2024-04-25T08:56:54.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.000+0000 7f680a909640 1 Processor -- start 2024-04-25T08:56:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.000+0000 7f680a909640 1 -- start start 2024-04-25T08:56:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f680a909640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f680415e0a0 0x7f68040d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f680a909640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 0x7f68040cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f680a909640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040b7f60 con 0x7f68040d3990 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f680a909640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040b29c0 con 0x7f680415e0a0 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f680a909640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040d2080 con 0x7f68040d3df0 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f68037fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68040d3990 0x7f68040ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38276/0 (socket says 172.21.15.5:38276) 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f68037fe640 1 -- 172.21.15.5:0/1113684973 learned_addr learned my addr 172.21.15.5:0/1113684973 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f6808ea6640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 0x7f68040cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f6803fff640 1 --2- 172.21.15.5:0/1113684973 >> v2:172.21.15.80:3300/0 conn(0x7f680415e0a0 0x7f68040d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592626752 0 0) 0x7f68040b7f60 con 0x7f68040d3990 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.001+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f0003520 con 0x7f68040d3990 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1837386546 0 0) 0x7f67f0003520 con 0x7f68040d3990 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 msgr2=0x7f68040cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 0x7f68040cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 >> v2:172.21.15.80:3300/0 conn(0x7f680415e0a0 msgr2=0x7f68040d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 --2- 172.21.15.5:0/1113684973 >> v2:172.21.15.80:3300/0 conn(0x7f680415e0a0 0x7f68040d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040d2360 con 0x7f68040d3990 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f67ec001670 con 0x7f68040d3990 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 >> v1:172.21.15.5:6789/0 conn(0x7f68040d3990 legacy=0x7f68040ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 0x7f67f00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67f0003f30 0x7f67f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67f0004d40 0x7f67f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040b29c0 con 0x7f67f0004d40 2024-04-25T08:56:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040d2080 con 0x7f67f0003f30 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f000b9c0 con 0x7f68040d3df0 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6808ea6640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67f0004d40 0x7f67f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6803fff640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 0x7f67f00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f68037fe640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67f0003f30 0x7f67f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6808ea6640 1 -- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 msgr2=0x7f67f00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6808ea6640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68040d3df0 0x7f67f00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6808ea6640 1 -- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67f0003f30 msgr2=0x7f67f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6808ea6640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67f0003f30 0x7f67f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.002+0000 7f6808ea6640 1 -- 172.21.15.5:0/1113684973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0003520 con 0x7f67f0004d40 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.003+0000 7f6808ea6640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67f0004d40 0x7f67f00051c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009fc0 tx=0x7f67f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1196ae58b0c602c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.003+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc009c10 con 0x7f67f0004d40 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.003+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc036070 con 0x7f67f0004d40 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.003+0000 7f6802ffd640 1 -- 172.21.15.5:0/1113684973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc031670 con 0x7f67f0004d40 2024-04-25T08:56:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.004+0000 7f680a909640 1 -- 172.21.15.5:0/1113684973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67f0004d40 msgr2=0x7f67f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.004+0000 7f680a909640 1 --2- 172.21.15.5:0/1113684973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67f0004d40 0x7f67f00051c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009fc0 tx=0x7f67f0005830 comp rx=0 tx=0).stop 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.004+0000 7f6808ea6640 1 -- 172.21.15.5:0/1113684973 reap_dead start 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.004+0000 7f680a909640 1 -- 172.21.15.5:0/1113684973 shutdown_connections 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.004+0000 7f680a909640 1 -- 172.21.15.5:0/1113684973 >> 172.21.15.5:0/1113684973 conn(0x7f68040668f0 msgr2=0x7f6804066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.004+0000 7f680a909640 1 -- 172.21.15.5:0/1113684973 shutdown_connections 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.004+0000 7f680a909640 1 -- 172.21.15.5:0/1113684973 wait complete. 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.005+0000 7f680a909640 1 Processor -- start 2024-04-25T08:56:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.005+0000 7f680a909640 1 -- start start 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f680a909640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f67f0004d40 0x7f68040c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f680a909640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68040ca160 0x7f68040ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f680a909640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68040cf000 0x7f68041f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f680a909640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040d2c00 con 0x7f68040cf000 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f680a909640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040d2920 con 0x7f68040ca160 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f680a909640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040d4280 con 0x7f67f0004d40 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68040cf000 0x7f68041f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68040cf000 0x7f68041f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55758/0 (socket says 172.21.15.5:55758) 2024-04-25T08:56:55.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 -- 172.21.15.5:0/2773214553 learned_addr learned my addr 172.21.15.5:0/2773214553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6803fff640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f67f0004d40 0x7f68040c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f68037fe640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68040ca160 0x7f68040ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 -- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f67f0004d40 msgr2=0x7f68040c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f67f0004d40 0x7f68040c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 -- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68040ca160 msgr2=0x7f68040ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68040ca160 0x7f68040ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 -- 172.21.15.5:0/2773214553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680414cdb0 con 0x7f68040cf000 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6803fff640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f67f0004d40 0x7f68040c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f68037fe640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68040ca160 0x7f68040ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.006+0000 7f6808ea6640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68040cf000 0x7f68041f7370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f67fc033040 tx=0x7f67fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.007+0000 7f6800ff9640 1 -- 172.21.15.5:0/2773214553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc009c10 con 0x7f68040cf000 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.007+0000 7f6800ff9640 1 -- 172.21.15.5:0/2773214553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc031dd0 con 0x7f68040cf000 2024-04-25T08:56:55.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.007+0000 7f6800ff9640 1 -- 172.21.15.5:0/2773214553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc003bd0 con 0x7f68040cf000 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.007+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680414efe0 con 0x7f68040cf000 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.007+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680414f5a0 con 0x7f68040cf000 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.008+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68040cf480 con 0x7f68040cf000 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.008+0000 7f6800ff9640 1 -- 172.21.15.5:0/2773214553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f67fc005d10 con 0x7f68040cf000 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.009+0000 7f6800ff9640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f67e406b4d0 0x7f67e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.009+0000 7f6800ff9640 1 -- 172.21.15.5:0/2773214553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67fc0ab050 con 0x7f68040cf000 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.009+0000 7f6803fff640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f67e406b4d0 0x7f67e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.009+0000 7f6803fff640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f67e406b4d0 0x7f67e406d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68041f1520 tx=0x7f67f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.013+0000 7f6800ff9640 1 -- 172.21.15.5:0/2773214553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67fc079f60 con 0x7f68040cf000 2024-04-25T08:56:55.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.197+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f680404ef20 con 0x7f68040cf000 2024-04-25T08:56:55.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.198+0000 7f6800ff9640 1 -- 172.21.15.5:0/2773214553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f67fc079860 con 0x7f68040cf000 2024-04-25T08:56:55.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:55.188 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:55.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f67e406b4d0 msgr2=0x7f67e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f67e406b4d0 0x7f67e406d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68041f1520 tx=0x7f67f4008040 comp rx=0 tx=0).stop 2024-04-25T08:56:55.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68040cf000 msgr2=0x7f68041f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68040cf000 0x7f68041f7370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f67fc033040 tx=0x7f67fc009750 comp rx=0 tx=0).stop 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 shutdown_connections 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f67e406b4d0 0x7f67e406d990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68040cf000 0x7f68041f7370 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68040ca160 0x7f68040ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 --2- 172.21.15.5:0/2773214553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f67f0004d40 0x7f68040c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 >> 172.21.15.5:0/2773214553 conn(0x7f68040668f0 msgr2=0x7f680415f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 shutdown_connections 2024-04-25T08:56:55.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.200+0000 7f680a909640 1 -- 172.21.15.5:0/2773214553 wait complete. 2024-04-25T08:56:55.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:55.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.315+0000 7f9f381fe640 1 Processor -- start 2024-04-25T08:56:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.316+0000 7f9f381fe640 1 -- start start 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.316+0000 7f9f381fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 0x7f9f300b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.316+0000 7f9f381fe640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f30072690 con 0x7f9f300ce190 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.316+0000 7f9f381fe640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f300b2cb0 con 0x7f9f300b2850 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.316+0000 7f9f381fe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f30071ff0 con 0x7f9f300ae690 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.316+0000 7f9f3679b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f300ce190 0x7f9f300cefd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38280/0 (socket says 172.21.15.5:38280) 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f3679b640 1 -- 172.21.15.5:0/2538127299 learned_addr learned my addr 172.21.15.5:0/2538127299 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 0x7f9f300b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578233064 0 0) 0x7f9f30072690 con 0x7f9f300ce190 2024-04-25T08:56:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f18003520 con 0x7f9f300ce190 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841612376 0 0) 0x7f9f300b2cb0 con 0x7f9f300b2850 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f30072690 con 0x7f9f300b2850 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999257246 0 0) 0x7f9f18003520 con 0x7f9f300ce190 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 msgr2=0x7f9f300b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 0x7f9f300b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 >> v1:172.21.15.80:6789/0 conn(0x7f9f300b2850 legacy=0x7f9f300aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300b2f50 con 0x7f9f300ce190 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f9f200019f0 con 0x7f9f300ce190 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 0x7f9f300b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 >> v1:172.21.15.5:6789/0 conn(0x7f9f300ce190 legacy=0x7f9f300cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f18003b70 0x7f9f18003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 0x7f9f18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f18004d40 0x7f9f180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1800ba70 con 0x7f9f18003b70 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1800bc20 con 0x7f9f18004d40 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1800be20 con 0x7f9f300ae690 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f18003b70 0x7f9f18003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f3679b640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f18004d40 0x7f9f180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35799640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 0x7f9f18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 -- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 msgr2=0x7f9f18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f300ae690 0x7f9f18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 -- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f18004d40 msgr2=0x7f9f180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f18004d40 0x7f9f180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f35f9a640 1 -- 172.21.15.5:0/2538127299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18003520 con 0x7f9f18003b70 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.317+0000 7f9f3679b640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f18004d40 0x7f9f180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.318+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f18003b70 0x7f9f18003f70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009820 tx=0x7f9f18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523641d98762b04c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.318+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28036020 con 0x7f9f18003b70 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.318+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f280324c0 con 0x7f9f18003b70 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.318+0000 7f9f34f98640 1 -- 172.21.15.5:0/2538127299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28009860 con 0x7f9f18003b70 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.319+0000 7f9f381fe640 1 -- 172.21.15.5:0/2538127299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f18003b70 msgr2=0x7f9f18003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.319+0000 7f9f381fe640 1 --2- 172.21.15.5:0/2538127299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f18003b70 0x7f9f18003f70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009820 tx=0x7f9f18005830 comp rx=0 tx=0).stop 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.319+0000 7f9f3679b640 1 -- 172.21.15.5:0/2538127299 reap_dead start 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.319+0000 7f9f381fe640 1 -- 172.21.15.5:0/2538127299 shutdown_connections 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.319+0000 7f9f381fe640 1 -- 172.21.15.5:0/2538127299 >> 172.21.15.5:0/2538127299 conn(0x7f9f300b1550 msgr2=0x7f9f300b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.319+0000 7f9f381fe640 1 -- 172.21.15.5:0/2538127299 shutdown_connections 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.319+0000 7f9f381fe640 1 -- 172.21.15.5:0/2538127299 wait complete. 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.320+0000 7f9f381fe640 1 Processor -- start 2024-04-25T08:56:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.320+0000 7f9f381fe640 1 -- start start 2024-04-25T08:56:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f381fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f18003b70 0x7f9f3014fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f381fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f300702a0 0x7f9f30070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f381fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3015ad60 0x7f9f3015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f381fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cd990 con 0x7f9f3015ad60 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f381fe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cd6b0 con 0x7f9f300702a0 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f381fe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cdc70 con 0x7f9f18003b70 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3015ad60 0x7f9f3015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3015ad60 0x7f9f3015b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55768/0 (socket says 172.21.15.5:55768) 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 -- 172.21.15.5:0/2718904295 learned_addr learned my addr 172.21.15.5:0/2718904295 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f35799640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f300702a0 0x7f9f30070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f18003b70 0x7f9f3014fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 -- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f18003b70 msgr2=0x7f9f3014fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f18003b70 0x7f9f3014fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 -- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f300702a0 msgr2=0x7f9f30070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f300702a0 0x7f9f30070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 -- 172.21.15.5:0/2718904295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3015b940 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f3679b640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3015ad60 0x7f9f3015b1c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f20000f80 tx=0x7f9f20007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.321+0000 7f9f2e7fc640 1 -- 172.21.15.5:0/2718904295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000ea40 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.322+0000 7f9f2e7fc640 1 -- 172.21.15.5:0/2718904295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2000ebe0 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.322+0000 7f9f2e7fc640 1 -- 172.21.15.5:0/2718904295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000edd0 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.322+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3015bc20 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.322+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f30154370 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.322+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3004ef20 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.323+0000 7f9f2e7fc640 1 -- 172.21.15.5:0/2718904295 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f2001a020 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.323+0000 7f9f2e7fc640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f1c06b4d0 0x7f9f1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.323+0000 7f9f2e7fc640 1 -- 172.21.15.5:0/2718904295 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f20089b20 con 0x7f9f3015ad60 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.324+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f1c06b4d0 0x7f9f1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.324+0000 7f9f35f9a640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f1c06b4d0 0x7f9f1c06d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f28037000 tx=0x7f9f2803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.328+0000 7f9f2e7fc640 1 -- 172.21.15.5:0/2718904295 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f20021020 con 0x7f9f3015ad60 2024-04-25T08:56:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.509+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f30154140 con 0x7f9f3015ad60 2024-04-25T08:56:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.509+0000 7f9f2e7fc640 1 -- 172.21.15.5:0/2718904295 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f20058920 con 0x7f9f3015ad60 2024-04-25T08:56:55.499 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:56:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f1c06b4d0 msgr2=0x7f9f1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f1c06b4d0 0x7f9f1c06d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f28037000 tx=0x7f9f2803d040 comp rx=0 tx=0).stop 2024-04-25T08:56:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3015ad60 msgr2=0x7f9f3015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3015ad60 0x7f9f3015b1c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f20000f80 tx=0x7f9f20007b00 comp rx=0 tx=0).stop 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 shutdown_connections 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f1c06b4d0 0x7f9f1c06d990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f3015ad60 0x7f9f3015b1c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f300702a0 0x7f9f30070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 --2- 172.21.15.5:0/2718904295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f18003b70 0x7f9f3014fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 >> 172.21.15.5:0/2718904295 conn(0x7f9f300b1550 msgr2=0x7f9f300ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 shutdown_connections 2024-04-25T08:56:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.511+0000 7f9f381fe640 1 -- 172.21.15.5:0/2718904295 wait complete. 2024-04-25T08:56:55.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:56:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.625+0000 7f8385d3b640 1 Processor -- start 2024-04-25T08:56:55.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.625+0000 7f8385d3b640 1 -- start start 2024-04-25T08:56:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f8385d3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83800ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f8385d3b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8380162150 con 0x7f838015df10 2024-04-25T08:56:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f8385d3b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8380162430 con 0x7f83800cee10 2024-04-25T08:56:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f8385d3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83800d20d0 con 0x7f83800b6250 2024-04-25T08:56:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f838015df10 0x7f83801618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38288/0 (socket says 172.21.15.5:38288) 2024-04-25T08:56:55.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837f7fe640 1 -- 172.21.15.5:0/3821348214 learned_addr learned my addr 172.21.15.5:0/3821348214 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837effd640 1 --2- 172.21.15.5:0/3821348214 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83800ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414314717 0 0) 0x7f8380162150 con 0x7f838015df10 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8368003520 con 0x7f838015df10 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123052552 0 0) 0x7f8380162430 con 0x7f83800cee10 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8380162150 con 0x7f83800cee10 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837effd640 1 -- 172.21.15.5:0/3821348214 >> v1:172.21.15.80:6789/0 conn(0x7f83800cee10 legacy=0x7f83800d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837effd640 1 -- 172.21.15.5:0/3821348214 >> v1:172.21.15.5:6789/0 conn(0x7f838015df10 legacy=0x7f83801618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948454365 0 0) 0x7f8368003520 con 0x7f838015df10 2024-04-25T08:56:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.626+0000 7f837effd640 1 -- 172.21.15.5:0/3821348214 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380162710 con 0x7f83800b6250 2024-04-25T08:56:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.627+0000 7f837effd640 1 --2- 172.21.15.5:0/3821348214 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83800ce8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83740097d0 tx=0x7f837402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3d6643b1145df4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.627+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374037070 con 0x7f83800b6250 2024-04-25T08:56:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.627+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837402ac30 con 0x7f83800b6250 2024-04-25T08:56:55.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.627+0000 7f837e7fc640 1 -- 172.21.15.5:0/3821348214 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370001670 con 0x7f83800b6250 2024-04-25T08:56:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.628+0000 7f8385d3b640 1 -- 172.21.15.5:0/3821348214 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 msgr2=0x7f83800ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.628+0000 7f8385d3b640 1 --2- 172.21.15.5:0/3821348214 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83800ce8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83740097d0 tx=0x7f837402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.628+0000 7f8385d3b640 1 -- 172.21.15.5:0/3821348214 shutdown_connections 2024-04-25T08:56:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.628+0000 7f8385d3b640 1 --2- 172.21.15.5:0/3821348214 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83800ce8d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.628+0000 7f8385d3b640 1 -- 172.21.15.5:0/3821348214 >> 172.21.15.5:0/3821348214 conn(0x7f83800668f0 msgr2=0x7f8380066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.628+0000 7f8385d3b640 1 -- 172.21.15.5:0/3821348214 shutdown_connections 2024-04-25T08:56:55.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.628+0000 7f8385d3b640 1 -- 172.21.15.5:0/3821348214 wait complete. 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.629+0000 7f8385d3b640 1 Processor -- start 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.629+0000 7f8385d3b640 1 -- start start 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f8385d3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83801f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f8385d3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800cee10 0x7f83801603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f8385d3b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f838015df10 0x7f83800cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f8385d3b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83800d2df0 con 0x7f83800cee10 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f8385d3b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83800d2c70 con 0x7f838015df10 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f8385d3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83800d2f70 con 0x7f83800b6250 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800cee10 0x7f83801603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800cee10 0x7f83801603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55782/0 (socket says 172.21.15.5:55782) 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837effd640 1 -- 172.21.15.5:0/937298229 learned_addr learned my addr 172.21.15.5:0/937298229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837f7fe640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83801f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837ffff640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f838015df10 0x7f83800cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837effd640 1 -- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 msgr2=0x7f83801f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837effd640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83801f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837effd640 1 -- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f838015df10 msgr2=0x7f83800cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.630+0000 7f837effd640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f838015df10 0x7f83800cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.631+0000 7f837effd640 1 -- 172.21.15.5:0/937298229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83801f4490 con 0x7f83800cee10 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.631+0000 7f837effd640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800cee10 0x7f83801603f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8374035040 tx=0x7f83740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.631+0000 7f8367fff640 1 -- 172.21.15.5:0/937298229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374041020 con 0x7f83800cee10 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.631+0000 7f8367fff640 1 -- 172.21.15.5:0/937298229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837403d640 con 0x7f83800cee10 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.631+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83801f4770 con 0x7f83800cee10 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.631+0000 7f8367fff640 1 -- 172.21.15.5:0/937298229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374037040 con 0x7f83800cee10 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.631+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83801f5010 con 0x7f83800cee10 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.632+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838004ef20 con 0x7f83800cee10 2024-04-25T08:56:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.632+0000 7f8367fff640 1 -- 172.21.15.5:0/937298229 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8374044020 con 0x7f83800cee10 2024-04-25T08:56:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.633+0000 7f8367fff640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836c06b4d0 0x7f836c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.633+0000 7f8367fff640 1 -- 172.21.15.5:0/937298229 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83740aa710 con 0x7f83800cee10 2024-04-25T08:56:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.633+0000 7f837f7fe640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836c06b4d0 0x7f836c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.633+0000 7f837f7fe640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836c06b4d0 0x7f836c06d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83700011e0 tx=0x7f8370009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.637+0000 7f8367fff640 1 -- 172.21.15.5:0/937298229 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f837404b030 con 0x7f83800cee10 2024-04-25T08:56:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.814+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83800b3340 con 0x7f83800cee10 2024-04-25T08:56:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.815+0000 7f8367fff640 1 -- 172.21.15.5:0/937298229 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8374079590 con 0x7f83800cee10 2024-04-25T08:56:55.805 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:56:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836c06b4d0 msgr2=0x7f836c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836c06b4d0 0x7f836c06d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83700011e0 tx=0x7f8370009040 comp rx=0 tx=0).stop 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800cee10 msgr2=0x7f83801603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800cee10 0x7f83801603f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8374035040 tx=0x7f83740046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 shutdown_connections 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836c06b4d0 0x7f836c06d990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f838015df10 0x7f83800cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800cee10 0x7f83801603f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 --2- 172.21.15.5:0/937298229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b6250 0x7f83801f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 >> 172.21.15.5:0/937298229 conn(0x7f83800668f0 msgr2=0x7f8380161830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 shutdown_connections 2024-04-25T08:56:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.817+0000 7f8385d3b640 1 -- 172.21.15.5:0/937298229 wait complete. 2024-04-25T08:56:55.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.931+0000 7f7a5c038640 1 Processor -- start 2024-04-25T08:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.931+0000 7f7a5c038640 1 -- start start 2024-04-25T08:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a5c038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a540b96e0 0x7f7a540d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a5c038640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7a540d4060 0x7f7a540b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a5c038640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a540b9b20 con 0x7f7a541614b0 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a5c038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a540d44d0 con 0x7f7a540b96e0 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a5c038640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a540d2740 con 0x7f7a540d4060 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a595d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a540b96e0 0x7f7a540d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a595d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a540b96e0 0x7f7a540d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55788/0 (socket says 172.21.15.5:55788) 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a59dd4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a541614b0 0x7f7a540d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38292/0 (socket says 172.21.15.5:38292) 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a595d3640 1 -- 172.21.15.5:0/776402765 learned_addr learned my addr 172.21.15.5:0/776402765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a5a5d5640 1 --2- 172.21.15.5:0/776402765 >> v2:172.21.15.80:3300/0 conn(0x7f7a540d4060 0x7f7a540b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a595d3640 1 -- 172.21.15.5:0/776402765 >> v2:172.21.15.80:3300/0 conn(0x7f7a540d4060 msgr2=0x7f7a540b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a595d3640 1 --2- 172.21.15.5:0/776402765 >> v2:172.21.15.80:3300/0 conn(0x7f7a540d4060 0x7f7a540b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a595d3640 1 -- 172.21.15.5:0/776402765 >> v1:172.21.15.5:6789/0 conn(0x7f7a541614b0 legacy=0x7f7a540d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.932+0000 7f7a595d3640 1 -- 172.21.15.5:0/776402765 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a540d2a20 con 0x7f7a540b96e0 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.933+0000 7f7a595d3640 1 --2- 172.21.15.5:0/776402765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b96e0 0x7f7a540d3b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a540d4c70 tx=0x7f7a4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d81dea1fc77a0bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.933+0000 7f7a58dd2640 1 -- 172.21.15.5:0/776402765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44037070 con 0x7f7a540b96e0 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.933+0000 7f7a58dd2640 1 -- 172.21.15.5:0/776402765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a44032440 con 0x7f7a540b96e0 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.933+0000 7f7a58dd2640 1 -- 172.21.15.5:0/776402765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44032810 con 0x7f7a540b96e0 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 -- 172.21.15.5:0/776402765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b96e0 msgr2=0x7f7a540d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 --2- 172.21.15.5:0/776402765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b96e0 0x7f7a540d3b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a540d4c70 tx=0x7f7a4402a270 comp rx=0 tx=0).stop 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 -- 172.21.15.5:0/776402765 shutdown_connections 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 --2- 172.21.15.5:0/776402765 >> v2:172.21.15.80:3300/0 conn(0x7f7a540d4060 0x7f7a540b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 --2- 172.21.15.5:0/776402765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a540b96e0 0x7f7a540d3b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 -- 172.21.15.5:0/776402765 >> 172.21.15.5:0/776402765 conn(0x7f7a5406b000 msgr2=0x7f7a5406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 -- 172.21.15.5:0/776402765 shutdown_connections 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.934+0000 7f7a5c038640 1 -- 172.21.15.5:0/776402765 wait complete. 2024-04-25T08:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.935+0000 7f7a5c038640 1 Processor -- start 2024-04-25T08:56:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.935+0000 7f7a5c038640 1 -- start start 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5c038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7a540b96e0 0x7f7a541f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5c038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a540d4060 0x7f7a540c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5c038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a541614b0 0x7f7a540c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5c038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540d32c0 con 0x7f7a541614b0 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5c038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540d2fe0 con 0x7f7a540d4060 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5c038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540d37e0 con 0x7f7a540b96e0 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a541614b0 0x7f7a540c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a541614b0 0x7f7a540c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55794/0 (socket says 172.21.15.5:55794) 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 -- 172.21.15.5:0/3640956297 learned_addr learned my addr 172.21.15.5:0/3640956297 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a595d3640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a540d4060 0x7f7a540c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a59dd4640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7a540b96e0 0x7f7a541f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 -- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7a540b96e0 msgr2=0x7f7a541f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7a540b96e0 0x7f7a541f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 -- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a540d4060 msgr2=0x7f7a540c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a540d4060 0x7f7a540c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 -- 172.21.15.5:0/3640956297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a541f6d50 con 0x7f7a541614b0 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a595d3640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a540d4060 0x7f7a540c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a59dd4640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7a540b96e0 0x7f7a541f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5a5d5640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a541614b0 0x7f7a540c8610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c007e40 tx=0x7f7a4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a4a7fc640 1 -- 172.21.15.5:0/3640956297 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c014620 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a4a7fc640 1 -- 172.21.15.5:0/3640956297 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c019070 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a4a7fc640 1 -- 172.21.15.5:0/3640956297 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c014a20 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.936+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a540c8c70 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.937+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a540c9230 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.937+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5404ef20 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.938+0000 7f7a4a7fc640 1 -- 172.21.15.5:0/3640956297 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a4c014bc0 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.938+0000 7f7a4a7fc640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7a3806b4d0 0x7f7a3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.938+0000 7f7a4a7fc640 1 -- 172.21.15.5:0/3640956297 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a4c08aad0 con 0x7f7a541614b0 2024-04-25T08:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.939+0000 7f7a59dd4640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7a3806b4d0 0x7f7a3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.939+0000 7f7a59dd4640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7a3806b4d0 0x7f7a3806d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a50000f60 tx=0x7f7a50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:55.942+0000 7f7a4a7fc640 1 -- 172.21.15.5:0/3640956297 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a4c059950 con 0x7f7a541614b0 2024-04-25T08:56:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.124+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a540b7370 con 0x7f7a541614b0 2024-04-25T08:56:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.124+0000 7f7a4a7fc640 1 -- 172.21.15.5:0/3640956297 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a4c059250 con 0x7f7a541614b0 2024-04-25T08:56:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:56:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7a3806b4d0 msgr2=0x7f7a3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7a3806b4d0 0x7f7a3806d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a50000f60 tx=0x7f7a50009040 comp rx=0 tx=0).stop 2024-04-25T08:56:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a541614b0 msgr2=0x7f7a540c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a541614b0 0x7f7a540c8610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c007e40 tx=0x7f7a4c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 shutdown_connections 2024-04-25T08:56:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7a3806b4d0 0x7f7a3806d990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a541614b0 0x7f7a540c8610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a540d4060 0x7f7a540c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 --2- 172.21.15.5:0/3640956297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7a540b96e0 0x7f7a541f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 >> 172.21.15.5:0/3640956297 conn(0x7f7a5406b000 msgr2=0x7f7a54160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 shutdown_connections 2024-04-25T08:56:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.126+0000 7f7a5c038640 1 -- 172.21.15.5:0/3640956297 wait complete. 2024-04-25T08:56:56.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.237+0000 7fa3ab534640 1 Processor -- start 2024-04-25T08:56:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.238+0000 7fa3ab534640 1 -- start start 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.238+0000 7fa3ab534640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3a40d3990 0x7fa3a40d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.238+0000 7fa3ab534640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a40b29c0 con 0x7fa3a40b6f50 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.238+0000 7fa3ab534640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a40d2080 con 0x7fa3a415e0a0 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.238+0000 7fa3ab534640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40d4330 con 0x7fa3a40d3990 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.239+0000 7fa3a8acf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3a40d3990 0x7fa3a40d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.239+0000 7fa3a9ad1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa3a40b6f50 0x7fa3a40b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38296/0 (socket says 172.21.15.5:38296) 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.239+0000 7fa3a9ad1640 1 -- 172.21.15.5:0/1726361243 learned_addr learned my addr 172.21.15.5:0/1726361243 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.239+0000 7fa3a8acf640 1 -- 172.21.15.5:0/1726361243 >> v1:172.21.15.80:6789/0 conn(0x7fa3a415e0a0 legacy=0x7fa3a40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.239+0000 7fa3a8acf640 1 -- 172.21.15.5:0/1726361243 >> v1:172.21.15.5:6789/0 conn(0x7fa3a40b6f50 legacy=0x7fa3a40b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.239+0000 7fa3a3fff640 1 -- 172.21.15.5:0/1726361243 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584933322 0 0) 0x7fa3a40b29c0 con 0x7fa3a40b6f50 2024-04-25T08:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.239+0000 7fa3a8acf640 1 -- 172.21.15.5:0/1726361243 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40d2360 con 0x7fa3a40d3990 2024-04-25T08:56:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.240+0000 7fa3a8acf640 1 --2- 172.21.15.5:0/1726361243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a40d3df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa3980097a0 tx=0x7fa39802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d645aed7996908 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.240+0000 7fa3a3fff640 1 -- 172.21.15.5:0/1726361243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398037070 con 0x7fa3a40d3990 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.240+0000 7fa3a3fff640 1 -- 172.21.15.5:0/1726361243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398032440 con 0x7fa3a40d3990 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.240+0000 7fa3a3fff640 1 -- 172.21.15.5:0/1726361243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398032810 con 0x7fa3a40d3990 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.240+0000 7fa3ab534640 1 -- 172.21.15.5:0/1726361243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 msgr2=0x7fa3a40d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.240+0000 7fa3ab534640 1 --2- 172.21.15.5:0/1726361243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a40d3df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa3980097a0 tx=0x7fa39802a230 comp rx=0 tx=0).stop 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.241+0000 7fa3ab534640 1 -- 172.21.15.5:0/1726361243 shutdown_connections 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.241+0000 7fa3ab534640 1 --2- 172.21.15.5:0/1726361243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a40d3df0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.241+0000 7fa3ab534640 1 -- 172.21.15.5:0/1726361243 >> 172.21.15.5:0/1726361243 conn(0x7fa3a40668f0 msgr2=0x7fa3a4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.241+0000 7fa3ab534640 1 -- 172.21.15.5:0/1726361243 shutdown_connections 2024-04-25T08:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.241+0000 7fa3ab534640 1 -- 172.21.15.5:0/1726361243 wait complete. 2024-04-25T08:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 Processor -- start 2024-04-25T08:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 -- start start 2024-04-25T08:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3a40b6f50 0x7fa3a414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3a415e0a0 0x7fa3a414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40d2920 con 0x7fa3a40d3990 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40d1460 con 0x7fa3a415e0a0 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.242+0000 7fa3ab534640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40d2c00 con 0x7fa3a40b6f50 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a414eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55800/0 (socket says 172.21.15.5:55800) 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 -- 172.21.15.5:0/3572464767 learned_addr learned my addr 172.21.15.5:0/3572464767 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a9ad1640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3a415e0a0 0x7fa3a414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a92d0640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3a40b6f50 0x7fa3a414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 -- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3a40b6f50 msgr2=0x7fa3a414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3a40b6f50 0x7fa3a414e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 -- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3a415e0a0 msgr2=0x7fa3a414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3a415e0a0 0x7fa3a414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 -- 172.21.15.5:0/3572464767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a414dba0 con 0x7fa3a40d3990 2024-04-25T08:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a8acf640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a414eea0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa398035040 tx=0x7fa3980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a1ffb640 1 -- 172.21.15.5:0/3572464767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398037040 con 0x7fa3a40d3990 2024-04-25T08:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a1ffb640 1 -- 172.21.15.5:0/3572464767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398030770 con 0x7fa3a40d3990 2024-04-25T08:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a414de80 con 0x7fa3a40d3990 2024-04-25T08:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.243+0000 7fa3a1ffb640 1 -- 172.21.15.5:0/3572464767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398030b80 con 0x7fa3a40d3990 2024-04-25T08:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.244+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a414e440 con 0x7fa3a40d3990 2024-04-25T08:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.245+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a404ef20 con 0x7fa3a40d3990 2024-04-25T08:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.245+0000 7fa3a1ffb640 1 -- 172.21.15.5:0/3572464767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa398044020 con 0x7fa3a40d3990 2024-04-25T08:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.245+0000 7fa3a1ffb640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa39006b500 0x7fa39006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.245+0000 7fa3a1ffb640 1 -- 172.21.15.5:0/3572464767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3980aa5e0 con 0x7fa3a40d3990 2024-04-25T08:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.245+0000 7fa3a92d0640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa39006b500 0x7fa39006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.246+0000 7fa3a92d0640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa39006b500 0x7fa39006d9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa39c000f60 tx=0x7fa39c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.250+0000 7fa3a1ffb640 1 -- 172.21.15.5:0/3572464767 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa398032e20 con 0x7fa3a40d3990 2024-04-25T08:56:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.468+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a4066f70 con 0x7fa3a40d3990 2024-04-25T08:56:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.469+0000 7fa3a1ffb640 1 -- 172.21.15.5:0/3572464767 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7fa398078ea0 con 0x7fa3a40d3990 2024-04-25T08:56:56.459 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:56.459 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:56:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa39006b500 msgr2=0x7fa39006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa39006b500 0x7fa39006d9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa39c000f60 tx=0x7fa39c009040 comp rx=0 tx=0).stop 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 msgr2=0x7fa3a414eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a414eea0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa398035040 tx=0x7fa3980046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 shutdown_connections 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa39006b500 0x7fa39006d9c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3a415e0a0 0x7fa3a414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3a40d3990 0x7fa3a414eea0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 --2- 172.21.15.5:0/3572464767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3a40b6f50 0x7fa3a414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 >> 172.21.15.5:0/3572464767 conn(0x7fa3a40668f0 msgr2=0x7fa3a415d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 shutdown_connections 2024-04-25T08:56:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.471+0000 7fa3ab534640 1 -- 172.21.15.5:0/3572464767 wait complete. 2024-04-25T08:56:56.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:56.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.582+0000 7fe5d505d640 1 Processor -- start 2024-04-25T08:56:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.583+0000 7fe5d505d640 1 -- start start 2024-04-25T08:56:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.583+0000 7fe5d505d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d015def0 0x7fe5d00d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.583+0000 7fe5d505d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5d00d0400 0x7fe5d00d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.583+0000 7fe5d505d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d00d2550 con 0x7fe5d00b94c0 2024-04-25T08:56:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.583+0000 7fe5d505d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d015e2d0 con 0x7fe5d00d0400 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.583+0000 7fe5d505d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00d0d90 con 0x7fe5d015def0 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.583+0000 7fe5cf59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5d00d0400 0x7fe5d00d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5c7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5d00b94c0 0x7fe5d00d1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38304/0 (socket says 172.21.15.5:38304) 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5c7fff640 1 -- 172.21.15.5:0/945781475 learned_addr learned my addr 172.21.15.5:0/945781475 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5ced9d640 1 --2- 172.21.15.5:0/945781475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d015def0 0x7fe5d00d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5cf59e640 1 -- 172.21.15.5:0/945781475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d015def0 msgr2=0x7fe5d00d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5cf59e640 1 --2- 172.21.15.5:0/945781475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d015def0 0x7fe5d00d35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5cf59e640 1 -- 172.21.15.5:0/945781475 >> v1:172.21.15.5:6789/0 conn(0x7fe5d00b94c0 legacy=0x7fe5d00d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5cf59e640 1 -- 172.21.15.5:0/945781475 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d00d2830 con 0x7fe5d00d0400 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5ce59c640 1 -- 172.21.15.5:0/945781475 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736405323 0 0) 0x7fe5d00d2550 con 0x7fe5d00b94c0 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.584+0000 7fe5cf59e640 1 --2- 172.21.15.5:0/945781475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00d0400 0x7fe5d00d0850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009d90 tx=0x7fe5c802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb1bf6c3458fdb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5ce59c640 1 -- 172.21.15.5:0/945781475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8007740 con 0x7fe5d00d0400 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5ce59c640 1 -- 172.21.15.5:0/945781475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c80078e0 con 0x7fe5d00d0400 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5ce59c640 1 -- 172.21.15.5:0/945781475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8007cb0 con 0x7fe5d00d0400 2024-04-25T08:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 -- 172.21.15.5:0/945781475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00d0400 msgr2=0x7fe5d00d0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 --2- 172.21.15.5:0/945781475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00d0400 0x7fe5d00d0850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009d90 tx=0x7fe5c802a660 comp rx=0 tx=0).stop 2024-04-25T08:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 -- 172.21.15.5:0/945781475 shutdown_connections 2024-04-25T08:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 --2- 172.21.15.5:0/945781475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00d0400 0x7fe5d00d0850 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 --2- 172.21.15.5:0/945781475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d015def0 0x7fe5d00d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 -- 172.21.15.5:0/945781475 >> 172.21.15.5:0/945781475 conn(0x7fe5d006b000 msgr2=0x7fe5d006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 -- 172.21.15.5:0/945781475 shutdown_connections 2024-04-25T08:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.585+0000 7fe5d505d640 1 -- 172.21.15.5:0/945781475 wait complete. 2024-04-25T08:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 Processor -- start 2024-04-25T08:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 -- start start 2024-04-25T08:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00b94c0 0x7fe5d015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d00d0400 0x7fe5d015c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5d015def0 0x7fe5d00ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00d30d0 con 0x7fe5d00b94c0 2024-04-25T08:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00d2df0 con 0x7fe5d015def0 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5d505d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00b6c60 con 0x7fe5d00d0400 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00b94c0 0x7fe5d015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00b94c0 0x7fe5d015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55820/0 (socket says 172.21.15.5:55820) 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.587+0000 7fe5ced9d640 1 -- 172.21.15.5:0/736631704 learned_addr learned my addr 172.21.15.5:0/736631704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5c7fff640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d00d0400 0x7fe5d015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5cf59e640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5d015def0 0x7fe5d00ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5ced9d640 1 -- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d00d0400 msgr2=0x7fe5d015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5ced9d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d00d0400 0x7fe5d015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5ced9d640 1 -- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5d015def0 msgr2=0x7fe5d00ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5ced9d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5d015def0 0x7fe5d00ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5ced9d640 1 -- 172.21.15.5:0/736631704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d00aa830 con 0x7fe5d00b94c0 2024-04-25T08:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5cf59e640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5d015def0 0x7fe5d00ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5ced9d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00b94c0 0x7fe5d015bcf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000c7f0 tx=0x7fe5c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5c77fe640 1 -- 172.21.15.5:0/736631704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0015070 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5c77fe640 1 -- 172.21.15.5:0/736631704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0004220 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d00aab10 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5c77fe640 1 -- 172.21.15.5:0/736631704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0007620 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.588+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d00ab0d0 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.589+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d004ef20 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.590+0000 7fe5c77fe640 1 -- 172.21.15.5:0/736631704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5c00079d0 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.590+0000 7fe5c77fe640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5b006b4d0 0x7fe5b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.590+0000 7fe5c77fe640 1 -- 172.21.15.5:0/736631704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5c008a510 con 0x7fe5d00b94c0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.590+0000 7fe5c7fff640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5b006b4d0 0x7fe5b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.591+0000 7fe5c7fff640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5b006b4d0 0x7fe5b006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe5d01f4800 tx=0x7fe5b8007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.594+0000 7fe5c77fe640 1 -- 172.21.15.5:0/736631704 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5c0058d40 con 0x7fe5d00b94c0 2024-04-25T08:56:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.775+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5d015d580 con 0x7fe5d00b94c0 2024-04-25T08:56:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.776+0000 7fe5c77fe640 1 -- 172.21.15.5:0/736631704 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fe5c005cde0 con 0x7fe5d00b94c0 2024-04-25T08:56:56.766 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:56.766 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5b006b4d0 msgr2=0x7fe5b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5b006b4d0 0x7fe5b006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe5d01f4800 tx=0x7fe5b8007d50 comp rx=0 tx=0).stop 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00b94c0 msgr2=0x7fe5d015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00b94c0 0x7fe5d015bcf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000c7f0 tx=0x7fe5c000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 shutdown_connections 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5b006b4d0 0x7fe5b006d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5d015def0 0x7fe5d00ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5d00d0400 0x7fe5d015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 --2- 172.21.15.5:0/736631704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d00b94c0 0x7fe5d015bcf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 >> 172.21.15.5:0/736631704 conn(0x7fe5d006b000 msgr2=0x7fe5d00cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 shutdown_connections 2024-04-25T08:56:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.778+0000 7fe5d505d640 1 -- 172.21.15.5:0/736631704 wait complete. 2024-04-25T08:56:56.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.889+0000 7f026df1d640 1 Processor -- start 2024-04-25T08:56:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.889+0000 7f026df1d640 1 -- start start 2024-04-25T08:56:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f026df1d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f026815dc70 0x7f0268161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f026df1d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02680ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f026df1d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0268161fc0 con 0x7f02680ced90 2024-04-25T08:56:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f026df1d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680d2180 con 0x7f026815dc70 2024-04-25T08:56:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f026df1d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268161d90 con 0x7f02680b94a0 2024-04-25T08:56:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f0266ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02680ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f02677fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f026815dc70 0x7f0268161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f02677fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f026815dc70 0x7f0268161850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:36892/0 (socket says 172.21.15.5:36892) 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f02677fe640 1 -- 172.21.15.5:0/2589218261 learned_addr learned my addr 172.21.15.5:0/2589218261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f0266ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02680ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:51166/0 (socket says 172.21.15.5:51166) 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.890+0000 7f0267fff640 1 --1- 172.21.15.5:0/2589218261 >> v1:172.21.15.80:6789/0 conn(0x7f02680ced90 0x7f02680b5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:51696/0 (socket says 172.21.15.5:51696) 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.891+0000 7f02677fe640 1 -- 172.21.15.5:0/2589218261 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 msgr2=0x7f02680ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.891+0000 7f02677fe640 1 --2- 172.21.15.5:0/2589218261 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02680ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.891+0000 7f02677fe640 1 -- 172.21.15.5:0/2589218261 >> v1:172.21.15.80:6789/0 conn(0x7f02680ced90 legacy=0x7f02680b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.891+0000 7f02677fe640 1 -- 172.21.15.5:0/2589218261 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02681622a0 con 0x7f026815dc70 2024-04-25T08:56:56.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.891+0000 7f02677fe640 1 --2- 172.21.15.5:0/2589218261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026815dc70 0x7f0268161850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0258009870 tx=0x7f025802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae987a1b7e921ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.891+0000 7f02667fc640 1 -- 172.21.15.5:0/2589218261 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258037070 con 0x7f026815dc70 2024-04-25T08:56:56.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f02667fc640 1 -- 172.21.15.5:0/2589218261 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258032440 con 0x7f026815dc70 2024-04-25T08:56:56.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f02667fc640 1 -- 172.21.15.5:0/2589218261 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258032810 con 0x7f026815dc70 2024-04-25T08:56:56.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 -- 172.21.15.5:0/2589218261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026815dc70 msgr2=0x7f0268161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 --2- 172.21.15.5:0/2589218261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026815dc70 0x7f0268161850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0258009870 tx=0x7f025802a270 comp rx=0 tx=0).stop 2024-04-25T08:56:56.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 -- 172.21.15.5:0/2589218261 shutdown_connections 2024-04-25T08:56:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 --2- 172.21.15.5:0/2589218261 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02680ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 --2- 172.21.15.5:0/2589218261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026815dc70 0x7f0268161850 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 -- 172.21.15.5:0/2589218261 >> 172.21.15.5:0/2589218261 conn(0x7f02680668f0 msgr2=0x7f0268066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 -- 172.21.15.5:0/2589218261 shutdown_connections 2024-04-25T08:56:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.892+0000 7f026df1d640 1 -- 172.21.15.5:0/2589218261 wait complete. 2024-04-25T08:56:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.893+0000 7f026df1d640 1 Processor -- start 2024-04-25T08:56:56.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f026df1d640 1 -- start start 2024-04-25T08:56:56.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f026df1d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02681f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f026df1d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02680ced90 0x7f02681e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f026df1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f026815dc70 0x7f02681e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f026df1d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026815e050 con 0x7f026815dc70 2024-04-25T08:56:56.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f026df1d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680d11f0 con 0x7f02680ced90 2024-04-25T08:56:56.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f026df1d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026815e1d0 con 0x7f02680b94a0 2024-04-25T08:56:56.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f0267fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f026815dc70 0x7f02681e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f02677fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02681f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f0267fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f026815dc70 0x7f02681e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55830/0 (socket says 172.21.15.5:55830) 2024-04-25T08:56:56.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f0267fff640 1 -- 172.21.15.5:0/2664469447 learned_addr learned my addr 172.21.15.5:0/2664469447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:56.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.894+0000 7f0266ffd640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02680ced90 0x7f02681e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f0267fff640 1 -- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 msgr2=0x7f02681f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f0267fff640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02681f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f0267fff640 1 -- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02680ced90 msgr2=0x7f02681e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:56.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f0267fff640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02680ced90 0x7f02681e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:56.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f0267fff640 1 -- 172.21.15.5:0/2664469447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268160610 con 0x7f026815dc70 2024-04-25T08:56:56.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f0267fff640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f026815dc70 0x7f02681e7b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f026000c730 tx=0x7f026000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f024ffff640 1 -- 172.21.15.5:0/2664469447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260017070 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f024ffff640 1 -- 172.21.15.5:0/2664469447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000ce40 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02681608f0 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f024ffff640 1 -- 172.21.15.5:0/2664469447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000a7e0 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.895+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268160eb0 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.896+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026804ef20 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.897+0000 7f024ffff640 1 -- 172.21.15.5:0/2664469447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f026001a070 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.897+0000 7f024ffff640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f025406b4d0 0x7f025406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.897+0000 7f024ffff640 1 -- 172.21.15.5:0/2664469447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0260089660 con 0x7f026815dc70 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.897+0000 7f02677fe640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f025406b4d0 0x7f025406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:56.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.898+0000 7f02677fe640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f025406b4d0 0x7f025406d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0258034000 tx=0x7f025802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:56.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:56.901+0000 7f024ffff640 1 -- 172.21.15.5:0/2664469447 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0260057f20 con 0x7f026815dc70 2024-04-25T08:56:57.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.119+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02680b40b0 con 0x7f026815dc70 2024-04-25T08:56:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.119+0000 7f024ffff640 1 -- 172.21.15.5:0/2664469447 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7f026005bfc0 con 0x7f026815dc70 2024-04-25T08:56:57.109 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:56:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:56:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f025406b4d0 msgr2=0x7f025406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f025406b4d0 0x7f025406d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0258034000 tx=0x7f025802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f026815dc70 msgr2=0x7f02681e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f026815dc70 0x7f02681e7b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f026000c730 tx=0x7f026000cbf0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 shutdown_connections 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f025406b4d0 0x7f025406d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f026815dc70 0x7f02681e7b40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02680ced90 0x7f02681e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 --2- 172.21.15.5:0/2664469447 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02680b94a0 0x7f02681f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 >> 172.21.15.5:0/2664469447 conn(0x7f02680668f0 msgr2=0x7f02680c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 shutdown_connections 2024-04-25T08:56:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.122+0000 7f026df1d640 1 -- 172.21.15.5:0/2664469447 wait complete. 2024-04-25T08:56:57.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:56:44.561711+0000', 'modified': '2024-04-25T08:56:46.553083+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/4114119067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6836', 'nonce': 4114119067}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 4114119067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:56:57.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:56:57.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T08:56:57.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.638+0000 7febcf528640 1 Processor -- start 2024-04-25T08:56:57.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.639+0000 7febcf528640 1 -- start start 2024-04-25T08:56:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.639+0000 7febcf528640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febc815de70 0x7febc80b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.639+0000 7febcf528640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc80cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.639+0000 7febcf528640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc80cf1c0 con 0x7febc80b2cc0 2024-04-25T08:56:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.639+0000 7febcf528640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc80d2a10 con 0x7febc815de70 2024-04-25T08:56:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.639+0000 7febcf528640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80d20e0 con 0x7febc80ce7f0 2024-04-25T08:56:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febccac3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7febc80b2cc0 0x7febc80b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38308/0 (socket says 172.21.15.5:38308) 2024-04-25T08:56:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febccac3640 1 -- 172.21.15.5:0/546788452 learned_addr learned my addr 172.21.15.5:0/546788452 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febcdac5640 1 --2- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc80cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febcd2c4640 1 --2- 172.21.15.5:0/546788452 >> v2:172.21.15.80:3300/0 conn(0x7febc815de70 0x7febc80b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febc7fff640 1 -- 172.21.15.5:0/546788452 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568636009 0 0) 0x7febc80cf1c0 con 0x7febc80b2cc0 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febc7fff640 1 -- 172.21.15.5:0/546788452 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb0003520 con 0x7febc80b2cc0 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febcd2c4640 1 -- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 msgr2=0x7febc80cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febcd2c4640 1 --2- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc80cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febcd2c4640 1 -- 172.21.15.5:0/546788452 >> v1:172.21.15.5:6789/0 conn(0x7febc80b2cc0 legacy=0x7febc80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febcd2c4640 1 -- 172.21.15.5:0/546788452 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80d23c0 con 0x7febc815de70 2024-04-25T08:56:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.640+0000 7febcdac5640 1 --2- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc80cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.641+0000 7febcd2c4640 1 --2- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 0x7febc80b93e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7febc00097a0 tx=0x7febc002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d696e5d13f5365b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.641+0000 7febc7fff640 1 -- 172.21.15.5:0/546788452 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0037070 con 0x7febc815de70 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.641+0000 7febc7fff640 1 -- 172.21.15.5:0/546788452 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc0032440 con 0x7febc815de70 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.641+0000 7febc7fff640 1 -- 172.21.15.5:0/546788452 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0032810 con 0x7febc815de70 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.641+0000 7febcf528640 1 -- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 msgr2=0x7febc80b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.641+0000 7febcf528640 1 --2- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 0x7febc80b93e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7febc00097a0 tx=0x7febc002a180 comp rx=0 tx=0).stop 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.642+0000 7febcf528640 1 -- 172.21.15.5:0/546788452 shutdown_connections 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.642+0000 7febcf528640 1 --2- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc80cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.642+0000 7febcf528640 1 --2- 172.21.15.5:0/546788452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 0x7febc80b93e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.642+0000 7febcf528640 1 -- 172.21.15.5:0/546788452 >> 172.21.15.5:0/546788452 conn(0x7febc806b000 msgr2=0x7febc806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.642+0000 7febcf528640 1 -- 172.21.15.5:0/546788452 shutdown_connections 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.642+0000 7febcf528640 1 -- 172.21.15.5:0/546788452 wait complete. 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.643+0000 7febcf528640 1 Processor -- start 2024-04-25T08:56:57.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.643+0000 7febcf528640 1 -- start start 2024-04-25T08:56:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcf528640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc80b2cc0 0x7febc80c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcf528640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcf528640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 0x7febc81f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcf528640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80b7300 con 0x7febc80b2cc0 2024-04-25T08:56:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcf528640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80b9920 con 0x7febc815de70 2024-04-25T08:56:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcf528640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80d2ea0 con 0x7febc80ce7f0 2024-04-25T08:56:57.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc80b2cc0 0x7febc80c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc80b2cc0 0x7febc80c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55838/0 (socket says 172.21.15.5:55838) 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 -- 172.21.15.5:0/4010444946 learned_addr learned my addr 172.21.15.5:0/4010444946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcdac5640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 0x7febc81f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febccac3640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 -- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 msgr2=0x7febc814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc814de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 -- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 msgr2=0x7febc81f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 0x7febc81f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 -- 172.21.15.5:0/4010444946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80b49f0 con 0x7febc80b2cc0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febccac3640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcd2c4640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc80b2cc0 0x7febc80c7480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febc00098c0 tx=0x7febc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febc5ffb640 1 -- 172.21.15.5:0/4010444946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0041030 con 0x7febc80b2cc0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febc5ffb640 1 -- 172.21.15.5:0/4010444946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc003d4e0 con 0x7febc80b2cc0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc80b4cd0 con 0x7febc80b2cc0 2024-04-25T08:56:57.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.644+0000 7febc5ffb640 1 -- 172.21.15.5:0/4010444946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0037040 con 0x7febc80b2cc0 2024-04-25T08:56:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.645+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc80b52f0 con 0x7febc80b2cc0 2024-04-25T08:56:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.646+0000 7febc5ffb640 1 -- 172.21.15.5:0/4010444946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7febc0044070 con 0x7febc80b2cc0 2024-04-25T08:56:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.646+0000 7febc5ffb640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febb406b4d0 0x7febb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.647+0000 7febc5ffb640 1 -- 172.21.15.5:0/4010444946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febc00aa910 con 0x7febc80b2cc0 2024-04-25T08:56:57.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.647+0000 7febccac3640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febb406b4d0 0x7febb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.647+0000 7febccac3640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febb406b4d0 0x7febb406d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febc80c79c0 tx=0x7febbc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.647+0000 7febd221f740 1 Processor -- start 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.647+0000 7febd221f740 1 -- start start 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febd221f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3197230 0x55c0e3197610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e31b4ad0 0x55c0e31b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e316cf10 0x55c0e31b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febd221f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e30cfa10 con 0x55c0e3197230 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e3078b30 con 0x55c0e31b4ad0 2024-04-25T08:56:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0e30cbc50 con 0x55c0e316cf10 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3197230 0x55c0e3197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3197230 0x55c0e3197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55854/0 (socket says 172.21.15.5:55854) 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 -- 172.21.15.5:0/2220247613 learned_addr learned my addr 172.21.15.5:0/2220247613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febccac3640 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e31b4ad0 0x55c0e31b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcdac5640 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e316cf10 0x55c0e31b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 -- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e316cf10 msgr2=0x55c0e31b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e316cf10 0x55c0e31b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 -- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e31b4ad0 msgr2=0x55c0e31b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e31b4ad0 0x55c0e31b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 -- 172.21.15.5:0/2220247613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0e308de10 con 0x55c0e3197230 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febccac3640 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e31b4ad0 0x55c0e31b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.648+0000 7febcd2c4640 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3197230 0x55c0e3197610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7febc00790b0 tx=0x7febc0078d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d4a02f95714f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febaeffd640 1 -- 172.21.15.5:0/2220247613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc007d270 con 0x55c0e3197230 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febaeffd640 1 -- 172.21.15.5:0/2220247613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc008f030 con 0x55c0e3197230 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febaeffd640 1 -- 172.21.15.5:0/2220247613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0081830 con 0x55c0e3197230 2024-04-25T08:56:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 -- 172.21.15.5:0/2220247613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3197230 msgr2=0x55c0e3197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3197230 0x55c0e3197610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7febc00790b0 tx=0x7febc0078d20 comp rx=0 tx=0).stop 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 -- 172.21.15.5:0/2220247613 shutdown_connections 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e316cf10 0x55c0e31b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e31b4ad0 0x55c0e31b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 --2- 172.21.15.5:0/2220247613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3197230 0x55c0e3197610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 -- 172.21.15.5:0/2220247613 >> 172.21.15.5:0/2220247613 conn(0x55c0e3169840 msgr2=0x55c0e31b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 -- 172.21.15.5:0/2220247613 shutdown_connections 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.649+0000 7febd221f740 1 -- 172.21.15.5:0/2220247613 wait complete. 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.650+0000 7febd221f740 1 -- start start 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.650+0000 7febd221f740 1 Processor -- start 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febd221f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e31b4ad0 0x55c0e3189c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e3195120 0x55c0e3199f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febd221f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e3078b30 con 0x55c0e31b4ad0 2024-04-25T08:56:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e308c0c0 con 0x55c0e3197230 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0e30cfa10 con 0x55c0e3195120 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febd221f740 10 client.0 _ll_register_callbacks cb 0x55c0e307fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e31b4ad0 0x55c0e3189c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e31b4ad0 0x55c0e3189c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55862/0 (socket says 172.21.15.5:55862) 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 -- 172.21.15.5:0/3140496844 learned_addr learned my addr 172.21.15.5:0/3140496844 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febcd2c4640 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febcdac5640 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e3195120 0x55c0e3199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 -- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e3195120 msgr2=0x55c0e3199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e3195120 0x55c0e3199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 -- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 msgr2=0x55c0e31a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 -- 172.21.15.5:0/3140496844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0e2de42d0 con 0x55c0e31b4ad0 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7febccac3640 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e31b4ad0 0x55c0e3189c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7febbc007400 tx=0x7febbc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c3775dbe98afbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7feba7fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:56:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.651+0000 7feba7fff640 1 -- 172.21.15.5:0/3140496844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc026060 con 0x55c0e31b4ad0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7feba7fff640 1 -- 172.21.15.5:0/3140496844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febbc021a90 con 0x55c0e31b4ad0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febc008f030 con 0x55c0e31b4ad0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7feba7fff640 1 -- 172.21.15.5:0/3140496844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7febbc021c90 con 0x55c0e31b4ad0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 10 client.4641 fetch_fsmap learned FSMap version 6 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55c0e2eae6b0 con 0x55c0e31b4ad0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7feba7fff640 1 -- 172.21.15.5:0/3140496844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc008f030 con 0x55c0e31b4ad0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7feba7fff640 1 -- 172.21.15.5:0/3140496844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7febbc012410 con 0x55c0e31b4ad0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 10 client.4641 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 10 client.4641 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 20 client.4641 populate_metadata read hostname 'smithi005' 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e31aae10 0x55c0e31ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 4 client.4641 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 --> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0e312e920 con 0x55c0e31aae10 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.652+0000 7febcd2c4640 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e31aae10 0x55c0e31ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febcd2c4640 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e31aae10 0x55c0e31ab1f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8360844c5dd31a0 server_cookie=c7a4641954c1177f in_seq=0 out_seq=0 2024-04-25T08:56:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7feba7fff640 10 client.4641 ms_handle_connect on v2:172.21.15.80:6836/4114119067 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7feba7fff640 1 -- 172.21.15.5:0/3140496844 <== mds.0 v2:172.21.15.80:6836/4114119067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c0e312e920 con 0x55c0e31aae10 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7feba7fff640 10 client.4641 handle_command_reply: tid=0 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 client.4641 shutdown 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e31b4ad0 msgr2=0x55c0e3189c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e31b4ad0 0x55c0e3189c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7febbc007400 tx=0x7febbc000bc0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 shutdown_connections 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e3195120 0x55c0e3199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e31b4ad0 0x55c0e3189c80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e31aae10 0x55c0e31ab1f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 --2- 172.21.15.5:0/3140496844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7feba7fff640 0 client.4641 ms_handle_reset on v2:172.21.15.80:6836/4114119067 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.653+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 >> 172.21.15.5:0/3140496844 conn(0x55c0e316cf10 msgr2=0x55c0e31b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.654+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 shutdown_connections 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.654+0000 7febd221f740 1 -- 172.21.15.5:0/3140496844 wait complete. 2024-04-25T08:56:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.654+0000 7febd221f740 20 client.4641 trim_cache size 0 max 16384 2024-04-25T08:56:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.669+0000 7febd221f740 1 Processor -- start 2024-04-25T08:56:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.669+0000 7febd221f740 1 -- start start 2024-04-25T08:56:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febd221f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e31ac720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31959b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 0x55c0e319a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febd221f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc81ffe00 con 0x55c0e3195120 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80b4380 con 0x55c0e3197230 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80b3780 con 0x55c0e31b4ad0 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e31ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e31ac720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55870/0 (socket says 172.21.15.5:55870) 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 -- 172.21.15.5:0/2902209177 learned_addr learned my addr 172.21.15.5:0/2902209177 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 -- 172.21.15.5:0/2902209177 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 msgr2=0x55c0e319a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 --2- 172.21.15.5:0/2902209177 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 0x55c0e319a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 -- 172.21.15.5:0/2902209177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 msgr2=0x55c0e31959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 --2- 172.21.15.5:0/2902209177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.670+0000 7febcd2c4640 1 -- 172.21.15.5:0/2902209177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0e31ae1f0 con 0x55c0e3195120 2024-04-25T08:56:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febcd2c4640 1 --2- 172.21.15.5:0/2902209177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e31ac720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc00792e0 tx=0x7febc0008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d9bf0e85b653eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febae7fc640 1 -- 172.21.15.5:0/2902209177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0081830 con 0x55c0e3195120 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febae7fc640 1 -- 172.21.15.5:0/2902209177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc008f040 con 0x55c0e3195120 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febae7fc640 1 -- 172.21.15.5:0/2902209177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0075790 con 0x55c0e3195120 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 -- 172.21.15.5:0/2902209177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 msgr2=0x55c0e31ac720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 --2- 172.21.15.5:0/2902209177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e31ac720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc00792e0 tx=0x7febc0008000 comp rx=0 tx=0).stop 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 -- 172.21.15.5:0/2902209177 shutdown_connections 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 --2- 172.21.15.5:0/2902209177 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 0x55c0e319a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 --2- 172.21.15.5:0/2902209177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 --2- 172.21.15.5:0/2902209177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e31ac720 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 -- 172.21.15.5:0/2902209177 >> 172.21.15.5:0/2902209177 conn(0x55c0e316cf10 msgr2=0x55c0e3167da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 -- 172.21.15.5:0/2902209177 shutdown_connections 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.671+0000 7febd221f740 1 -- 172.21.15.5:0/2902209177 wait complete. 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.672+0000 7febd221f740 1 -- start start 2024-04-25T08:56:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.672+0000 7febd221f740 1 Processor -- start 2024-04-25T08:56:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febd221f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e32197e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febd221f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 0x55c0e319a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febd221f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0e31aa2a0 con 0x55c0e3195120 2024-04-25T08:56:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80b3d80 con 0x55c0e3197230 2024-04-25T08:56:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febd221f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0e31abab0 con 0x55c0e31b4ad0 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febd221f740 10 client.0 _ll_register_callbacks cb 0x55c0e3167c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e32197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e32197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55882/0 (socket says 172.21.15.5:55882) 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 -- 172.21.15.5:0/471640332 learned_addr learned my addr 172.21.15.5:0/471640332 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febccac3640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcdac5640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 0x55c0e319a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 -- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 msgr2=0x55c0e319a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 0x55c0e319a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 -- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 msgr2=0x55c0e31c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 -- 172.21.15.5:0/471640332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0e319a270 con 0x55c0e3195120 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febccac3640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7febcd2c4640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e32197e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7febc0078e20 tx=0x7febc0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d457569e12954df8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7feba7fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:56:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7feba7fff640 1 -- 172.21.15.5:0/471640332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0077420 con 0x55c0e3195120 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.673+0000 7feba7fff640 1 -- 172.21.15.5:0/471640332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febc0075790 con 0x55c0e3195120 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febc008f040 con 0x55c0e3195120 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7feba7fff640 1 -- 172.21.15.5:0/471640332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7febc00a8da0 con 0x55c0e3195120 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 10 client.4647 fetch_fsmap learned FSMap version 6 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55c0e319a270 con 0x55c0e3195120 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7feba7fff640 1 -- 172.21.15.5:0/471640332 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc008f040 con 0x55c0e3195120 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7feba7fff640 1 -- 172.21.15.5:0/471640332 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7febc008a070 con 0x55c0e3195120 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 10 client.4647 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 20 client.4647 populate_metadata read hostname 'smithi005' 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e321fa10 0x55c0e321fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 4 client.4647 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 --> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c0e30dcf50 con 0x55c0e321fa10 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febccac3640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e321fa10 0x55c0e321fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7febccac3640 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e321fa10 0x55c0e321fdf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52f715c8eb9382cd server_cookie=95e8cb1f753e3aeb in_seq=0 out_seq=0 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.674+0000 7feba7fff640 10 client.4647 ms_handle_connect on v2:172.21.15.80:6836/4114119067 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7feba7fff640 1 -- 172.21.15.5:0/471640332 <== mds.0 v2:172.21.15.80:6836/4114119067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c0e30dcf50 con 0x55c0e321fa10 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7feba7fff640 10 client.4647 handle_command_reply: tid=0 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 client.4647 shutdown 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 msgr2=0x55c0e32197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e32197e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7febc0078e20 tx=0x7febc0009190 comp rx=0 tx=0).stop 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 shutdown_connections 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0e31b4ad0 0x55c0e319a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:6836/4114119067,v1:172.21.15.80:6837/4114119067] conn(0x55c0e321fa10 0x55c0e321fdf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0e3197230 0x55c0e31c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 --2- 172.21.15.5:0/471640332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0e3195120 0x55c0e32197e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7feba7fff640 0 client.4647 ms_handle_reset on v2:172.21.15.80:6836/4114119067 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 >> 172.21.15.5:0/471640332 conn(0x55c0e316cf10 msgr2=0x55c0e3167da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 shutdown_connections 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 1 -- 172.21.15.5:0/471640332 wait complete. 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febd221f740 20 client.4647 trim_cache size 0 max 16384 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4300, 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 12.474407096, 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 6, 2024-04-25T08:56:57.671 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 20, 2024-04-25T08:56:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T08:56:57.672 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19.784536596999999 2024-04-25T08:56:57.672 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:56:57.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febb406b4d0 msgr2=0x7febb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.675+0000 7febcf528640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febb406b4d0 0x7febb406d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febc80c79c0 tx=0x7febbc009040 comp rx=0 tx=0).stop 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc80b2cc0 msgr2=0x7febc80c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc80b2cc0 0x7febc80c7480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febc00098c0 tx=0x7febc00046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 shutdown_connections 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febb406b4d0 0x7febb406d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febc815de70 0x7febc81f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febc80ce7f0 0x7febc814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 --2- 172.21.15.5:0/4010444946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc80b2cc0 0x7febc80c7480 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 >> 172.21.15.5:0/4010444946 conn(0x7febc806b000 msgr2=0x7febc815e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 shutdown_connections 2024-04-25T08:56:57.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:57.676+0000 7febcf528640 1 -- 172.21.15.5:0/4010444946 wait complete. 2024-04-25T08:56:57.676 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T08:56:57.699 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T08:56:57.699 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T08:56:57.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:57.699 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T08:56:57.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:57.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-25T08:56:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-04-25T08:56:57.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:56:57.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:57.782 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T08:56:57.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:57.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-25T08:56:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-04-25T08:56:57.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:56:57.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:57.903 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T08:56:57.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:57.921 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T08:56:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-04-25T08:56:57.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:56:57.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:57.993 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T08:56:58.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:58.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T08:56:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-04-25T08:56:58.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:56:58.119 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-25T08:56:58.119 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:56:58.119 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:58.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:56:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.231+0000 7f1e1e24d640 1 Processor -- start 2024-04-25T08:56:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.231+0000 7f1e1e24d640 1 -- start start 2024-04-25T08:56:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e1e24d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e180b2cc0 0x7f1e180b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e1e24d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e180b7130 0x7f1e180ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e1e24d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e180d20e0 con 0x7f1e1815de70 2024-04-25T08:56:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e1e24d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e180d2a10 con 0x7f1e180b2cc0 2024-04-25T08:56:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e1e24d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e180d23c0 con 0x7f1e180b7130 2024-04-25T08:56:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e16ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e180b2cc0 0x7f1e180b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:58.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e177fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e1815de70 0x7f1e180b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38316/0 (socket says 172.21.15.5:38316) 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e177fe640 1 -- 172.21.15.5:0/1274853540 learned_addr learned my addr 172.21.15.5:0/1274853540 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e16ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e180b2cc0 0x7f1e180b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55888/0 (socket says 172.21.15.5:55888) 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e17fff640 1 --2- 172.21.15.5:0/1274853540 >> v2:172.21.15.80:3300/0 conn(0x7f1e180b7130 0x7f1e180ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e16ffd640 1 -- 172.21.15.5:0/1274853540 >> v2:172.21.15.80:3300/0 conn(0x7f1e180b7130 msgr2=0x7f1e180ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e16ffd640 1 --2- 172.21.15.5:0/1274853540 >> v2:172.21.15.80:3300/0 conn(0x7f1e180b7130 0x7f1e180ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e16ffd640 1 -- 172.21.15.5:0/1274853540 >> v1:172.21.15.5:6789/0 conn(0x7f1e1815de70 legacy=0x7f1e180b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e167fc640 1 -- 172.21.15.5:0/1274853540 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766593346 0 0) 0x7f1e180d20e0 con 0x7f1e1815de70 2024-04-25T08:56:58.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.232+0000 7f1e16ffd640 1 -- 172.21.15.5:0/1274853540 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180d26a0 con 0x7f1e180b2cc0 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e16ffd640 1 --2- 172.21.15.5:0/1274853540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b2cc0 0x7f1e180b6bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0097a0 tx=0x7f1e0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef3b38c27553ab4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e167fc640 1 -- 172.21.15.5:0/1274853540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c037070 con 0x7f1e180b2cc0 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e167fc640 1 -- 172.21.15.5:0/1274853540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c032440 con 0x7f1e180b2cc0 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e167fc640 1 -- 172.21.15.5:0/1274853540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c032810 con 0x7f1e180b2cc0 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e1e24d640 1 -- 172.21.15.5:0/1274853540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b2cc0 msgr2=0x7f1e180b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/1274853540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b2cc0 0x7f1e180b6bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0097a0 tx=0x7f1e0c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e1e24d640 1 -- 172.21.15.5:0/1274853540 shutdown_connections 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/1274853540 >> v2:172.21.15.80:3300/0 conn(0x7f1e180b7130 0x7f1e180ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/1274853540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b2cc0 0x7f1e180b6bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.233+0000 7f1e1e24d640 1 -- 172.21.15.5:0/1274853540 >> 172.21.15.5:0/1274853540 conn(0x7f1e1806b000 msgr2=0x7f1e1806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.234+0000 7f1e1e24d640 1 -- 172.21.15.5:0/1274853540 shutdown_connections 2024-04-25T08:56:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.234+0000 7f1e1e24d640 1 -- 172.21.15.5:0/1274853540 wait complete. 2024-04-25T08:56:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.235+0000 7f1e1e24d640 1 Processor -- start 2024-04-25T08:56:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.235+0000 7f1e1e24d640 1 -- start start 2024-04-25T08:56:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180b2cc0 0x7f1e180ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b7130 0x7f1e180ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1815de70 0x7f1e180b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180cf0c0 con 0x7f1e180b7130 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180cef40 con 0x7f1e180b2cc0 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180b5a70 con 0x7f1e1815de70 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b7130 0x7f1e180ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b7130 0x7f1e180ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55902/0 (socket says 172.21.15.5:55902) 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 -- 172.21.15.5:0/3318699534 learned_addr learned my addr 172.21.15.5:0/3318699534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e177fe640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180b2cc0 0x7f1e180ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e17fff640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1815de70 0x7f1e180b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 -- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1815de70 msgr2=0x7f1e180b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1815de70 0x7f1e180b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 -- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180b2cc0 msgr2=0x7f1e180ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180b2cc0 0x7f1e180ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 -- 172.21.15.5:0/3318699534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180cd2d0 con 0x7f1e180b7130 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e16ffd640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b7130 0x7f1e180ccd90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1dfffff640 1 -- 172.21.15.5:0/3318699534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c037040 con 0x7f1e180b7130 2024-04-25T08:56:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1dfffff640 1 -- 172.21.15.5:0/3318699534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c042070 con 0x7f1e180b7130 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e180b4e60 con 0x7f1e180b7130 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1dfffff640 1 -- 172.21.15.5:0/3318699534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c030bb0 con 0x7f1e180b7130 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.236+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e180b5420 con 0x7f1e180b7130 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.237+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1804ef20 con 0x7f1e180b7130 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.238+0000 7f1dfffff640 1 -- 172.21.15.5:0/3318699534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e0c047460 con 0x7f1e180b7130 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.238+0000 7f1dfffff640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e0406b4d0 0x7f1e0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.238+0000 7f1dfffff640 1 -- 172.21.15.5:0/3318699534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e0c0aacb0 con 0x7f1e180b7130 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.239+0000 7f1e177fe640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e0406b4d0 0x7f1e0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.239+0000 7f1e177fe640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e0406b4d0 0x7f1e0406d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1e08007fd0 tx=0x7f1e08007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.243+0000 7f1dfffff640 1 -- 172.21.15.5:0/3318699534 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e0c032e20 con 0x7f1e180b7130 2024-04-25T08:56:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.463+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e180d43a0 con 0x7f1e180b7130 2024-04-25T08:56:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.463+0000 7f1dfffff640 1 -- 172.21.15.5:0/3318699534 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e0c0794e0 con 0x7f1e180b7130 2024-04-25T08:56:58.453 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e0406b4d0 msgr2=0x7f1e0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e0406b4d0 0x7f1e0406d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1e08007fd0 tx=0x7f1e08007de0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b7130 msgr2=0x7f1e180ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b7130 0x7f1e180ccd90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 shutdown_connections 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e0406b4d0 0x7f1e0406d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1815de70 0x7f1e180b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e180b7130 0x7f1e180ccd90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 --2- 172.21.15.5:0/3318699534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180b2cc0 0x7f1e180ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 >> 172.21.15.5:0/3318699534 conn(0x7f1e1806b000 msgr2=0x7f1e180ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 shutdown_connections 2024-04-25T08:56:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:56:58.465+0000 7f1e1e24d640 1 -- 172.21.15.5:0/3318699534 wait complete. 2024-04-25T08:56:58.465 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:56:58.466 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:56:58.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:58.466 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T08:56:58.481 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:56:58.481 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:56:58.481 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:56:58.482 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-04-25T08:56:58.483 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T08:56:58.483 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:58.483 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:56:58.483 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:58.483 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T08:56:58.483 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T08:56:58.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:58.483 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:56:58.483 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:56:58.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-04-25T08:56:58.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-04-25T08:56:58.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-04-25T08:56:58.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T08:56:58.484 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:56:58.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:58.624 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:56:58.648 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T08:56:58.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:58.649 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T08:56:58.811 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T08:56:58.811 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:56:58.811 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:56:58.811 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:56:58.812 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:56:58.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:58.812 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:56:58.812 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:56:58.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:56:58.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:56:58.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:56:58.812 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:56:58.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:58.999 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T08:56:59.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.015 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-04-25T08:56:59.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.071 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:56:59.071 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:56:59.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:56:59.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T08:56:59.072 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:56:59.150 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T08:56:59.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:56:59.151 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:56:59.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T08:56:59.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T08:56:59.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T08:56:59.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T08:56:59.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T08:56:59.151 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:56:59.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:56:59.302 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:56:59.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T08:56:59.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T08:56:59.302 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:56:59.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:56:59.339 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:59.397 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:56:59.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:56:59.397 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:59.452 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T08:56:59.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:56:59.546 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:56:59.546 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:56:59.667 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:56:59.667 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:56:59.667 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T08:56:59.667 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T08:56:59.667 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T08:56:59.668 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:56:59.668 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:56:59.668 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:56:59.668 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:56:59.668 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:56:59.670 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:56:59.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:59.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.696 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:56:59.759 INFO:teuthology.orchestra.run.smithi005.stdout:client4496 2024-04-25T08:56:59.759 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:56:59.759 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:59.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.816 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:56:59.879 INFO:teuthology.orchestra.run.smithi005.stdout:client4496 2024-04-25T08:56:59.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.880 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:56:59.943 INFO:teuthology.orchestra.run.smithi005.stdout:client4496 2024-04-25T08:56:59.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.943 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.client4496/status') 2024-04-25T08:57:00.013 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4496 (3)172.21.15.5:0/739606936 2024-04-25T08:57:00.013 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2024-04-25T08:57:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2024-04-25T08:57:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2024-04-25T08:57:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:68 bytes copied, 2.3699e-05 s, 2.9 MB/s 2024-04-25T08:57:00.014 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-25T08:57:00.015 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:57:00.015 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T08:57:00.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:57:00.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.166+0000 7f016d02a640 1 Processor -- start 2024-04-25T08:57:00.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.166+0000 7f016d02a640 1 -- start start 2024-04-25T08:57:00.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016d02a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016d02a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01680ce7f0 0x7f01680cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016d02a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680cf1c0 con 0x7f01680b2cc0 2024-04-25T08:57:00.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016d02a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680d2a10 con 0x7f01680ce7f0 2024-04-25T08:57:00.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016d02a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680d20e0 con 0x7f016815de70 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01680ce7f0 0x7f01680cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01680ce7f0 0x7f01680cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55910/0 (socket says 172.21.15.5:55910) 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016759e640 1 -- 172.21.15.5:0/2731665035 learned_addr learned my addr 172.21.15.5:0/2731665035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f0166d9d640 1 --2- 172.21.15.5:0/2731665035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016759e640 1 -- 172.21.15.5:0/2731665035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 msgr2=0x7f01680b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016759e640 1 --2- 172.21.15.5:0/2731665035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016759e640 1 -- 172.21.15.5:0/2731665035 >> v1:172.21.15.80:6789/0 conn(0x7f01680b2cc0 legacy=0x7f01680b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.167+0000 7f016759e640 1 -- 172.21.15.5:0/2731665035 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680d23c0 con 0x7f01680ce7f0 2024-04-25T08:57:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.168+0000 7f016759e640 1 --2- 172.21.15.5:0/2731665035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680cec80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0160009e50 tx=0x7f016002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d4a8892db8813f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.168+0000 7f016659c640 1 -- 172.21.15.5:0/2731665035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160036070 con 0x7f01680ce7f0 2024-04-25T08:57:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.168+0000 7f016659c640 1 -- 172.21.15.5:0/2731665035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0160031600 con 0x7f01680ce7f0 2024-04-25T08:57:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.168+0000 7f016659c640 1 -- 172.21.15.5:0/2731665035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600319d0 con 0x7f01680ce7f0 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 -- 172.21.15.5:0/2731665035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 msgr2=0x7f01680cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 --2- 172.21.15.5:0/2731665035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680cec80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0160009e50 tx=0x7f016002a710 comp rx=0 tx=0).stop 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 -- 172.21.15.5:0/2731665035 shutdown_connections 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 --2- 172.21.15.5:0/2731665035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680cec80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 --2- 172.21.15.5:0/2731665035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 -- 172.21.15.5:0/2731665035 >> 172.21.15.5:0/2731665035 conn(0x7f016806b000 msgr2=0x7f016806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 -- 172.21.15.5:0/2731665035 shutdown_connections 2024-04-25T08:57:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.169+0000 7f016d02a640 1 -- 172.21.15.5:0/2731665035 wait complete. 2024-04-25T08:57:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.170+0000 7f016d02a640 1 Processor -- start 2024-04-25T08:57:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.170+0000 7f016d02a640 1 -- start start 2024-04-25T08:57:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f016d02a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680b2cc0 0x7f0168149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f016d02a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f016d02a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f016d02a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680b7300 con 0x7f01680ce7f0 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f016d02a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680b9920 con 0x7f01680b2cc0 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f016d02a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680d2ea0 con 0x7f016815de70 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55916/0 (socket says 172.21.15.5:55916) 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 -- 172.21.15.5:0/3459262156 learned_addr learned my addr 172.21.15.5:0/3459262156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f0166d9d640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680b2cc0 0x7f0168149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f016759e640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 -- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 msgr2=0x7f01680cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 -- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680b2cc0 msgr2=0x7f0168149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680b2cc0 0x7f0168149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.171+0000 7f015ffff640 1 -- 172.21.15.5:0/3459262156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680b3660 con 0x7f01680ce7f0 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.172+0000 7f015ffff640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680b5e40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f015000c400 tx=0x7f015000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.172+0000 7f015f7fe640 1 -- 172.21.15.5:0/3459262156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01500052d0 con 0x7f01680ce7f0 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.172+0000 7f015f7fe640 1 -- 172.21.15.5:0/3459262156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150005490 con 0x7f01680ce7f0 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.172+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01680b3940 con 0x7f01680ce7f0 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.172+0000 7f015f7fe640 1 -- 172.21.15.5:0/3459262156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150007260 con 0x7f01680ce7f0 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.172+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01680b3f00 con 0x7f01680ce7f0 2024-04-25T08:57:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.173+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016804ef20 con 0x7f01680ce7f0 2024-04-25T08:57:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.173+0000 7f015f7fe640 1 -- 172.21.15.5:0/3459262156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0150007400 con 0x7f01680ce7f0 2024-04-25T08:57:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.174+0000 7f015f7fe640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.174+0000 7f015f7fe640 1 -- 172.21.15.5:0/3459262156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0150089730 con 0x7f01680ce7f0 2024-04-25T08:57:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.174+0000 7f0166d9d640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.174+0000 7f0166d9d640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0158006fd0 tx=0x7f0158008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.178+0000 7f015f7fe640 1 -- 172.21.15.5:0/3459262156 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f01500585b0 con 0x7f01680ce7f0 2024-04-25T08:57:00.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.399+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f01680b95e0 con 0x7f01680ce7f0 2024-04-25T08:57:00.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.399+0000 7f015f7fe640 1 -- 172.21.15.5:0/3459262156 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0150057eb0 con 0x7f01680ce7f0 2024-04-25T08:57:00.390 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:57:00.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 msgr2=0x7f014806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0158006fd0 tx=0x7f0158008040 comp rx=0 tx=0).stop 2024-04-25T08:57:00.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 msgr2=0x7f01680b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680b5e40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f015000c400 tx=0x7f015000c8c0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 shutdown_connections 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f016815de70 0x7f01680cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01680ce7f0 0x7f01680b5e40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 --2- 172.21.15.5:0/3459262156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680b2cc0 0x7f0168149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 >> 172.21.15.5:0/3459262156 conn(0x7f016806b000 msgr2=0x7f016815e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 shutdown_connections 2024-04-25T08:57:00.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:00.401+0000 7f016d02a640 1 -- 172.21.15.5:0/3459262156 wait complete. 2024-04-25T08:57:00.402 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:57:00.402 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:57:00.402 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T08:57:00.402 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T08:57:00.402 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T08:57:00.402 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:57:00.402 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:57:00.403 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:57:00.403 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T08:57:00.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.403 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:00.419 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-04-25T08:57:00.420 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:57:00.421 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:57:00.422 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link tentative 2024-04-25T08:57:00.422 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.422 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:57:00.482 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T08:57:00.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.484 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T08:57:00.540 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T08:57:00.540 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:57:00.540 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:57:00.540 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:57:00.540 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:57:00.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.541 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:57:00.541 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:57:00.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:57:00.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:57:00.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:57:00.541 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:57:00.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.627 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T08:57:00.642 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:57:00.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.646 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-04-25T08:57:00.698 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T08:57:00.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:57:00.699 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:57:00.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:57:00.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T08:57:00.699 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T08:57:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:00.839 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:e0:bc:e4:ea:73 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e4e0:bcff:fee4:ea73/64 scope link tentative 2024-04-25T08:57:00.840 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T08:57:00.905 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:e0:bc:e4:ea:73 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e4e0:bcff:fee4:ea73/64 scope link tentative 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:00.907 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T08:57:00.908 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:57:01.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:01.019 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:57:01.019 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:57:01.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2024-04-25T08:57:01.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T08:57:01.019 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:57:01.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:01.055 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T08:57:01.110 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T08:57:01.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:01.111 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T08:57:01.165 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-25T08:57:01.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:01.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:01.248 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:01.248 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:01.262 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:57:01.263 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:57:01.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:01.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T08:57:01.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:01.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:01.384 INFO:teuthology.orchestra.run.smithi005.stdout:client4665 2024-04-25T08:57:01.385 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:01.385 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:01.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:01.441 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:01.497 INFO:teuthology.orchestra.run.smithi005.stdout:client4665 2024-04-25T08:57:01.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:01.498 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:01.554 INFO:teuthology.orchestra.run.smithi005.stdout:client4665 2024-04-25T08:57:01.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:01.554 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.client4665/status') 2024-04-25T08:57:01.618 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4665 (3)192.168.0.2:0/2453111974 2024-04-25T08:57:01.618 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2024-04-25T08:57:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2024-04-25T08:57:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2024-04-25T08:57:01.618 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.6963e-05 s, 2.6 MB/s 2024-04-25T08:57:01.619 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-25T08:57:01.619 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:57:01.619 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T08:57:01.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:57:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.770+0000 7f26e3717640 1 Processor -- start 2024-04-25T08:57:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.770+0000 7f26e3717640 1 -- start start 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.770+0000 7f26e3717640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.770+0000 7f26e3717640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26dc0cbf40 0x7f26dc0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.770+0000 7f26e3717640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc06ba50 con 0x7f26dc0b0e30 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.770+0000 7f26e3717640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc06b800 con 0x7f26dc0cbf40 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.770+0000 7f26e3717640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc06bd30 con 0x7f26dc0b0a50 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e1cb4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26dc0cbf40 0x7f26dc0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e1cb4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26dc0cbf40 0x7f26dc0ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49918/0 (socket says 172.21.15.5:49918) 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e1cb4640 1 -- 172.21.15.5:0/3141289315 learned_addr learned my addr 172.21.15.5:0/3141289315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e14b3640 1 --2- 172.21.15.5:0/3141289315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e1cb4640 1 -- 172.21.15.5:0/3141289315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 msgr2=0x7f26dc0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e1cb4640 1 --2- 172.21.15.5:0/3141289315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e1cb4640 1 -- 172.21.15.5:0/3141289315 >> v1:172.21.15.80:6789/0 conn(0x7f26dc0b0e30 legacy=0x7f26dc0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.771+0000 7f26e1cb4640 1 -- 172.21.15.5:0/3141289315 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc06c010 con 0x7f26dc0cbf40 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26e1cb4640 1 --2- 172.21.15.5:0/3141289315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0cbf40 0x7f26dc0ce740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009e50 tx=0x7f26cc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29139301e3e33203 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26dbfff640 1 -- 172.21.15.5:0/3141289315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc036070 con 0x7f26dc0cbf40 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26dbfff640 1 -- 172.21.15.5:0/3141289315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc031600 con 0x7f26dc0cbf40 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26dbfff640 1 -- 172.21.15.5:0/3141289315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0319d0 con 0x7f26dc0cbf40 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26e3717640 1 -- 172.21.15.5:0/3141289315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0cbf40 msgr2=0x7f26dc0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26e3717640 1 --2- 172.21.15.5:0/3141289315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0cbf40 0x7f26dc0ce740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009e50 tx=0x7f26cc02a630 comp rx=0 tx=0).stop 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26e3717640 1 -- 172.21.15.5:0/3141289315 shutdown_connections 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26e3717640 1 --2- 172.21.15.5:0/3141289315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0cbf40 0x7f26dc0ce740 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.772+0000 7f26e3717640 1 --2- 172.21.15.5:0/3141289315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.773+0000 7f26e3717640 1 -- 172.21.15.5:0/3141289315 >> 172.21.15.5:0/3141289315 conn(0x7f26dc0d18f0 msgr2=0x7f26dc0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.773+0000 7f26e3717640 1 -- 172.21.15.5:0/3141289315 shutdown_connections 2024-04-25T08:57:01.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.773+0000 7f26e3717640 1 -- 172.21.15.5:0/3141289315 wait complete. 2024-04-25T08:57:01.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 Processor -- start 2024-04-25T08:57:01.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 -- start start 2024-04-25T08:57:01.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0b0e30 0x7f26dc15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc0cbf40 0x7f26dc15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0b2bf0 con 0x7f26dc0b0e30 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0cfd60 con 0x7f26dc0cbf40 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.774+0000 7f26e3717640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc160750 con 0x7f26dc0b0a50 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0b0e30 0x7f26dc15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0b0e30 0x7f26dc15e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49926/0 (socket says 172.21.15.5:49926) 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 -- 172.21.15.5:0/933636328 learned_addr learned my addr 172.21.15.5:0/933636328 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e14b3640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e1cb4640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc0cbf40 0x7f26dc15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:01.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 -- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 msgr2=0x7f26dc157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 -- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc0cbf40 msgr2=0x7f26dc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc0cbf40 0x7f26dc15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 -- 172.21.15.5:0/933636328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc0c8230 con 0x7f26dc0b0e30 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e0cb2640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0b0e30 0x7f26dc15e610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c430 tx=0x7f26d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26d9ffb640 1 -- 172.21.15.5:0/933636328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0011790 con 0x7f26dc0b0e30 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26d9ffb640 1 -- 172.21.15.5:0/933636328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d0017070 con 0x7f26dc0b0e30 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc15f500 con 0x7f26dc0b0e30 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26d9ffb640 1 -- 172.21.15.5:0/933636328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0011bb0 con 0x7f26dc0b0e30 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.775+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc1609a0 con 0x7f26dc0b0e30 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.776+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc06cd70 con 0x7f26dc0b0e30 2024-04-25T08:57:01.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.777+0000 7f26d9ffb640 1 -- 172.21.15.5:0/933636328 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f26d001c460 con 0x7f26dc0b0e30 2024-04-25T08:57:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.777+0000 7f26d9ffb640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f26c806b500 0x7f26c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.777+0000 7f26d9ffb640 1 -- 172.21.15.5:0/933636328 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26d008a090 con 0x7f26dc0b0e30 2024-04-25T08:57:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.777+0000 7f26e14b3640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f26c806b500 0x7f26c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.778+0000 7f26e14b3640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f26c806b500 0x7f26c806d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26d4006fd0 tx=0x7f26d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:01.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:01.781+0000 7f26d9ffb640 1 -- 172.21.15.5:0/933636328 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f26d0058f10 con 0x7f26dc0b0e30 2024-04-25T08:57:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.002+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f26dc04ef20 con 0x7f26dc0b0e30 2024-04-25T08:57:01.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.003+0000 7f26d9ffb640 1 -- 172.21.15.5:0/933636328 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f26d0058810 con 0x7f26dc0b0e30 2024-04-25T08:57:01.993 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.004+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f26c806b500 msgr2=0x7f26c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.004+0000 7f26e3717640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f26c806b500 0x7f26c806d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26d4006fd0 tx=0x7f26d4008040 comp rx=0 tx=0).stop 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.004+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0b0e30 msgr2=0x7f26dc15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.004+0000 7f26e3717640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0b0e30 0x7f26dc15e610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c430 tx=0x7f26d000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 shutdown_connections 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f26c806b500 0x7f26c806d9c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc0cbf40 0x7f26dc15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc0b0e30 0x7f26dc15e610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 --2- 172.21.15.5:0/933636328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26dc0b0a50 0x7f26dc157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 >> 172.21.15.5:0/933636328 conn(0x7f26dc0d18f0 msgr2=0x7f26dc068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 shutdown_connections 2024-04-25T08:57:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:02.005+0000 7f26e3717640 1 -- 172.21.15.5:0/933636328 wait complete. 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:57:02.005 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T08:57:02.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.006 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T08:57:02.023 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:57:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:57:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42754sec preferred_lft 42754sec 2024-04-25T08:57:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::4a41:3d99:6eef:1718/64 scope link noprefixroute 2024-04-25T08:57:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:02.025 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T08:57:02.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.025 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:02.025 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:02.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-04-25T08:57:02.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-04-25T08:57:02.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-04-25T08:57:02.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T08:57:02.026 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:02.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.169 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:57:02.192 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T08:57:02.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.194 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T08:57:02.261 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T08:57:02.261 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:57:02.261 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:57:02.262 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:57:02.262 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:57:02.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.262 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:02.262 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:02.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:57:02.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:57:02.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:57:02.262 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:02.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.483 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T08:57:02.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.499 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-25T08:57:02.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.556 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:02.556 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:02.556 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T08:57:02.556 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T08:57:02.556 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:02.633 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T08:57:02.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.633 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:02.633 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:02.633 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T08:57:02.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T08:57:02.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T08:57:02.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T08:57:02.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T08:57:02.634 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:02.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.753 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:02.753 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:02.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T08:57:02.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T08:57:02.754 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:02.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:02.789 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T08:57:02.845 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T08:57:02.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:02.845 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T08:57:02.900 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T08:57:02.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:02.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:02.990 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:02.991 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:03.095 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:03.095 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:03.095 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T08:57:03.095 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 1@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T08:57:03.098 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T08:57:03.099 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T08:57:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:57:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:57:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:57:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:57:03.099 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:57:03.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T08:57:03.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.123 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:03.179 INFO:teuthology.orchestra.run.smithi080.stdout:client4674 2024-04-25T08:57:03.180 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:03.180 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:03.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.235 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:03.291 INFO:teuthology.orchestra.run.smithi080.stdout:client4674 2024-04-25T08:57:03.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.291 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:03.347 INFO:teuthology.orchestra.run.smithi080.stdout:client4674 2024-04-25T08:57:03.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.348 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.client4674/status') 2024-04-25T08:57:03.411 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.4674 (3)172.21.15.80:0/2332676380 2024-04-25T08:57:03.411 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-04-25T08:57:03.412 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-04-25T08:57:03.412 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-04-25T08:57:03.412 INFO:teuthology.orchestra.run.smithi080.stderr:70 bytes copied, 2.2932e-05 s, 3.1 MB/s 2024-04-25T08:57:03.413 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-25T08:57:03.413 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:57:03.413 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T08:57:03.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:57:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.538+0000 7fc13cc7c640 1 Processor -- start 2024-04-25T08:57:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.538+0000 7fc13cc7c640 1 -- start start 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13cc7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13cc7c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1380d3710 0x7fc1380b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13cc7c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1380d0f10 con 0x7fc1380b9990 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13cc7c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1380d23c0 con 0x7fc1380d3710 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13cc7c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380d2670 con 0x7fc1380d05f0 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc136d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1380d3710 0x7fc1380b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc135d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1380b9990 0x7fc1380d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40284/0 (socket says 172.21.15.5:40284) 2024-04-25T08:57:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc135d9b640 1 -- 172.21.15.5:0/3577810101 learned_addr learned my addr 172.21.15.5:0/3577810101 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13659c640 1 --2- 172.21.15.5:0/3577810101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13559a640 1 -- 172.21.15.5:0/3577810101 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940785480 0 0) 0x7fc1380d0f10 con 0x7fc1380b9990 2024-04-25T08:57:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc13559a640 1 -- 172.21.15.5:0/3577810101 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc120003520 con 0x7fc1380b9990 2024-04-25T08:57:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc136d9d640 1 -- 172.21.15.5:0/3577810101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 msgr2=0x7fc1380d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc136d9d640 1 --2- 172.21.15.5:0/3577810101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc136d9d640 1 -- 172.21.15.5:0/3577810101 >> v1:172.21.15.5:6789/0 conn(0x7fc1380b9990 legacy=0x7fc1380d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.539+0000 7fc136d9d640 1 -- 172.21.15.5:0/3577810101 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1380d2950 con 0x7fc1380d3710 2024-04-25T08:57:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.540+0000 7fc136d9d640 1 --2- 172.21.15.5:0/3577810101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc1380b6c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc130009d90 tx=0x7fc13002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2da101c294ab6ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.540+0000 7fc13559a640 1 -- 172.21.15.5:0/3577810101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130007740 con 0x7fc1380d3710 2024-04-25T08:57:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.540+0000 7fc13559a640 1 -- 172.21.15.5:0/3577810101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300078e0 con 0x7fc1380d3710 2024-04-25T08:57:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.540+0000 7fc13559a640 1 -- 172.21.15.5:0/3577810101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130007cb0 con 0x7fc1380d3710 2024-04-25T08:57:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 -- 172.21.15.5:0/3577810101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 msgr2=0x7fc1380b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/3577810101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc1380b6c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc130009d90 tx=0x7fc13002a6f0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 -- 172.21.15.5:0/3577810101 shutdown_connections 2024-04-25T08:57:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/3577810101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc1380b6c50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/3577810101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 -- 172.21.15.5:0/3577810101 >> 172.21.15.5:0/3577810101 conn(0x7fc13806b000 msgr2=0x7fc13806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 -- 172.21.15.5:0/3577810101 shutdown_connections 2024-04-25T08:57:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.541+0000 7fc13cc7c640 1 -- 172.21.15.5:0/3577810101 wait complete. 2024-04-25T08:57:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.542+0000 7fc13cc7c640 1 Processor -- start 2024-04-25T08:57:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.542+0000 7fc13cc7c640 1 -- start start 2024-04-25T08:57:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc13cc7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc13cc7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc13814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc13cc7c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13815a410 0x7fc1380b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc13cc7c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13815e090 con 0x7fc1380d3710 2024-04-25T08:57:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc13cc7c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380d2f10 con 0x7fc13815a410 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc13cc7c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13815e210 con 0x7fc1380d05f0 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc13814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc13814fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49940/0 (socket says 172.21.15.5:49940) 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 -- 172.21.15.5:0/2306197294 learned_addr learned my addr 172.21.15.5:0/2306197294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc13659c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc136d9d640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13815a410 0x7fc1380b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 -- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 msgr2=0x7fc1380cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 -- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13815a410 msgr2=0x7fc1380b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13815a410 0x7fc1380b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.543+0000 7fc135d9b640 1 -- 172.21.15.5:0/2306197294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1380cc5a0 con 0x7fc1380d3710 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.544+0000 7fc135d9b640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc13814fe80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00c460 tx=0x7fc12c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.544+0000 7fc126ffd640 1 -- 172.21.15.5:0/2306197294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c017070 con 0x7fc1380d3710 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.544+0000 7fc126ffd640 1 -- 172.21.15.5:0/2306197294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c005ce0 con 0x7fc1380d3710 2024-04-25T08:57:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.544+0000 7fc126ffd640 1 -- 172.21.15.5:0/2306197294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c007290 con 0x7fc1380d3710 2024-04-25T08:57:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.544+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1380cc880 con 0x7fc1380d3710 2024-04-25T08:57:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.544+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1380cce40 con 0x7fc1380d3710 2024-04-25T08:57:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.545+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13804ef20 con 0x7fc1380d3710 2024-04-25T08:57:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.545+0000 7fc126ffd640 1 -- 172.21.15.5:0/2306197294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc12c01a070 con 0x7fc1380d3710 2024-04-25T08:57:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.546+0000 7fc126ffd640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc11806b4d0 0x7fc11806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.546+0000 7fc126ffd640 1 -- 172.21.15.5:0/2306197294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc12c089440 con 0x7fc1380d3710 2024-04-25T08:57:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.546+0000 7fc13659c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc11806b4d0 0x7fc11806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.546+0000 7fc13659c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc11806b4d0 0x7fc11806d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc128009b40 tx=0x7fc128009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.550+0000 7fc126ffd640 1 -- 172.21.15.5:0/2306197294 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc12c057d00 con 0x7fc1380d3710 2024-04-25T08:57:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.774+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1380b3320 con 0x7fc1380d3710 2024-04-25T08:57:03.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.774+0000 7fc126ffd640 1 -- 172.21.15.5:0/2306197294 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc12c05bda0 con 0x7fc1380d3710 2024-04-25T08:57:03.763 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:57:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc11806b4d0 msgr2=0x7fc11806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc11806b4d0 0x7fc11806d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc128009b40 tx=0x7fc128009190 comp rx=0 tx=0).stop 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 msgr2=0x7fc13814fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc13814fe80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00c460 tx=0x7fc12c00c920 comp rx=0 tx=0).stop 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 shutdown_connections 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc11806b4d0 0x7fc11806d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13815a410 0x7fc1380b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1380d3710 0x7fc13814fe80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 --2- 172.21.15.5:0/2306197294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1380d05f0 0x7fc1380cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.776+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 >> 172.21.15.5:0/2306197294 conn(0x7fc13806b000 msgr2=0x7fc1380c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.777+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 shutdown_connections 2024-04-25T08:57:03.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:03.777+0000 7fc13cc7c640 1 -- 172.21.15.5:0/2306197294 wait complete. 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:57:03.776 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T08:57:03.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.777 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:03.792 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42752sec preferred_lft 42752sec 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::4a41:3d99:6eef:1718/64 scope link noprefixroute 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether ea:c8:37:23:e6:61 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:03.793 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::947d:aaff:feee:f655/64 scope link 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run.smithi080.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether ea:c8:37:23:e6:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::e8c8:37ff:fe23:e661/64 scope link tentative 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:03.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.794 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:57:03.855 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T08:57:03.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.856 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T08:57:03.912 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T08:57:03.912 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:57:03.912 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:57:03.912 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:57:03.912 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:57:03.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.913 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:03.913 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:03.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:57:03.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:57:03.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:57:03.913 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:03.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:03.996 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T08:57:04.051 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T08:57:04.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.052 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-25T08:57:04.105 INFO:teuthology.orchestra.run.smithi080.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T08:57:04.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.106 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:04.106 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:04.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T08:57:04.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T08:57:04.106 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:04.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.180 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T08:57:04.244 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:2a:6f:cb:f0:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::942a:6fff:fecb:f09b/64 scope link 2024-04-25T08:57:04.245 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.247 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T08:57:04.310 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:2a:6f:cb:f0:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::942a:6fff:fecb:f09b/64 scope link 2024-04-25T08:57:04.328 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:04.329 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T08:57:04.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T08:57:04.330 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:04.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.437 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-04-25T08:57:04.437 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T08:57:04.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.1 up 2024-04-25T08:57:04.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T08:57:04.437 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T08:57:04.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:04.472 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T08:57:04.527 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T08:57:04.527 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:04.527 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T08:57:04.581 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-25T08:57:04.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.582 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:04.662 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:04.662 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:04.670 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:04.670 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:04.670 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T08:57:04.670 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 3@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T08:57:04.670 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T08:57:04.670 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T08:57:04.671 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:57:04.671 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:57:04.671 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:57:04.671 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:57:04.673 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:57:04.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.673 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T08:57:04.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.739 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:04.795 INFO:teuthology.orchestra.run.smithi080.stdout:client4686 2024-04-25T08:57:04.795 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:04.796 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:04.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.851 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:04.906 INFO:teuthology.orchestra.run.smithi080.stdout:client4686 2024-04-25T08:57:04.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.907 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:04.962 INFO:teuthology.orchestra.run.smithi080.stdout:client4686 2024-04-25T08:57:04.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:04.962 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.client4686/status') 2024-04-25T08:57:05.025 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.4686 (3)172.21.15.80:0/1466902617 2024-04-25T08:57:05.025 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-04-25T08:57:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-04-25T08:57:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-04-25T08:57:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:70 bytes copied, 3.8408e-05 s, 1.8 MB/s 2024-04-25T08:57:05.026 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T08:57:05.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.169+0000 7f011f5e2640 1 Processor -- start 2024-04-25T08:57:05.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.170+0000 7f011f5e2640 1 -- start start 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.170+0000 7f011f5e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.170+0000 7f011f5e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180b29c0 con 0x7f01180b6f50 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.170+0000 7f011f5e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180d2080 con 0x7f011815e0a0 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.170+0000 7f011f5e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180d4330 con 0x7f01180d3990 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f011db7f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01180b6f50 0x7f01180b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40296/0 (socket says 172.21.15.5:40296) 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f011db7f640 1 -- 172.21.15.5:0/4079166247 learned_addr learned my addr 172.21.15.5:0/4079166247 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f011cb7d640 1 --2- 172.21.15.5:0/4079166247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f0117fff640 1 -- 172.21.15.5:0/4079166247 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819697902 0 0) 0x7f01180b29c0 con 0x7f01180b6f50 2024-04-25T08:57:05.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f0117fff640 1 -- 172.21.15.5:0/4079166247 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0100003520 con 0x7f01180b6f50 2024-04-25T08:57:05.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f0117fff640 1 -- 172.21.15.5:0/4079166247 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412745737 0 0) 0x7f01180d2080 con 0x7f011815e0a0 2024-04-25T08:57:05.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f0117fff640 1 -- 172.21.15.5:0/4079166247 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01180b29c0 con 0x7f011815e0a0 2024-04-25T08:57:05.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f011cb7d640 1 -- 172.21.15.5:0/4079166247 >> v1:172.21.15.80:6789/0 conn(0x7f011815e0a0 legacy=0x7f01180d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f011cb7d640 1 -- 172.21.15.5:0/4079166247 >> v1:172.21.15.5:6789/0 conn(0x7f01180b6f50 legacy=0x7f01180b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.171+0000 7f011cb7d640 1 -- 172.21.15.5:0/4079166247 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180d2360 con 0x7f01180d3990 2024-04-25T08:57:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.172+0000 7f011cb7d640 1 --2- 172.21.15.5:0/4079166247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180d3df0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f010c0097d0 tx=0x7f010c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67ab5d60a85311fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.172+0000 7f0117fff640 1 -- 172.21.15.5:0/4079166247 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c037070 con 0x7f01180d3990 2024-04-25T08:57:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.172+0000 7f0117fff640 1 -- 172.21.15.5:0/4079166247 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c032440 con 0x7f01180d3990 2024-04-25T08:57:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.172+0000 7f0117fff640 1 -- 172.21.15.5:0/4079166247 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c032810 con 0x7f01180d3990 2024-04-25T08:57:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.173+0000 7f011f5e2640 1 -- 172.21.15.5:0/4079166247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 msgr2=0x7f01180d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.173+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4079166247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180d3df0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f010c0097d0 tx=0x7f010c02a210 comp rx=0 tx=0).stop 2024-04-25T08:57:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.173+0000 7f011f5e2640 1 -- 172.21.15.5:0/4079166247 shutdown_connections 2024-04-25T08:57:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.173+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4079166247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180d3df0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.173+0000 7f011f5e2640 1 -- 172.21.15.5:0/4079166247 >> 172.21.15.5:0/4079166247 conn(0x7f01180668f0 msgr2=0x7f0118066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.173+0000 7f011f5e2640 1 -- 172.21.15.5:0/4079166247 shutdown_connections 2024-04-25T08:57:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.173+0000 7f011f5e2640 1 -- 172.21.15.5:0/4079166247 wait complete. 2024-04-25T08:57:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.174+0000 7f011f5e2640 1 Processor -- start 2024-04-25T08:57:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.174+0000 7f011f5e2640 1 -- start start 2024-04-25T08:57:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011f5e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01180b6f50 0x7f011815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011f5e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011f5e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011815e0a0 0x7f011815c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011f5e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180d2920 con 0x7f01180b6f50 2024-04-25T08:57:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011f5e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180d1460 con 0x7f011815e0a0 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011f5e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180d2c00 con 0x7f01180d3990 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01180b6f50 0x7f011815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01180b6f50 0x7f011815fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49952/0 (socket says 172.21.15.5:49952) 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 -- 172.21.15.5:0/4221844337 learned_addr learned my addr 172.21.15.5:0/4221844337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011cb7d640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011db7f640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011815e0a0 0x7f011815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 -- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 msgr2=0x7f01180ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 -- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011815e0a0 msgr2=0x7f011815c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011815e0a0 0x7f011815c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.175+0000 7f011d37e640 1 -- 172.21.15.5:0/4221844337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011815c5a0 con 0x7f01180b6f50 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.176+0000 7f011d37e640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01180b6f50 0x7f011815fee0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f011000c530 tx=0x7f011000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.176+0000 7f0115ffb640 1 -- 172.21.15.5:0/4221844337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100052d0 con 0x7f01180b6f50 2024-04-25T08:57:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.176+0000 7f0115ffb640 1 -- 172.21.15.5:0/4221844337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110005490 con 0x7f01180b6f50 2024-04-25T08:57:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.176+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01181605c0 con 0x7f01180b6f50 2024-04-25T08:57:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.176+0000 7f0115ffb640 1 -- 172.21.15.5:0/4221844337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110012870 con 0x7f01180b6f50 2024-04-25T08:57:05.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.176+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0118160b80 con 0x7f01180b6f50 2024-04-25T08:57:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.177+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011804ef20 con 0x7f01180b6f50 2024-04-25T08:57:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.177+0000 7f0115ffb640 1 -- 172.21.15.5:0/4221844337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0110012a10 con 0x7f01180b6f50 2024-04-25T08:57:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.178+0000 7f0115ffb640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f010406b4d0 0x7f010406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.178+0000 7f0115ffb640 1 -- 172.21.15.5:0/4221844337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0110089ca0 con 0x7f01180b6f50 2024-04-25T08:57:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.178+0000 7f011cb7d640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f010406b4d0 0x7f010406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.178+0000 7f011cb7d640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f010406b4d0 0x7f010406d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f010c034000 tx=0x7f010c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.182+0000 7f0115ffb640 1 -- 172.21.15.5:0/4221844337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f011815c5a0 con 0x7f01180b6f50 2024-04-25T08:57:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.364+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f011815d7e0 con 0x7f01180b6f50 2024-04-25T08:57:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.365+0000 7f0115ffb640 1 -- 172.21.15.5:0/4221844337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f01100584e0 con 0x7f01180b6f50 2024-04-25T08:57:05.354 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f010406b4d0 msgr2=0x7f010406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f010406b4d0 0x7f010406d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f010c034000 tx=0x7f010c02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01180b6f50 msgr2=0x7f011815fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01180b6f50 0x7f011815fee0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f011000c530 tx=0x7f011000c9f0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 shutdown_connections 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f010406b4d0 0x7f010406d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011815e0a0 0x7f011815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01180d3990 0x7f01180ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 --2- 172.21.15.5:0/4221844337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01180b6f50 0x7f011815fee0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 >> 172.21.15.5:0/4221844337 conn(0x7f01180668f0 msgr2=0x7f01180b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 shutdown_connections 2024-04-25T08:57:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.367+0000 7f011f5e2640 1 -- 172.21.15.5:0/4221844337 wait complete. 2024-04-25T08:57:05.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:05.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:05.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.482+0000 7fc7135c8640 1 Processor -- start 2024-04-25T08:57:05.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.482+0000 7fc7135c8640 1 -- start start 2024-04-25T08:57:05.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc7135c8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc70c15df70 0x7fc70c0b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc7135c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc70c0d2f70 0x7fc70c0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc7135c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0ced50 0x7fc70c0b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc7135c8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c0d1c80 con 0x7fc70c0d2f70 2024-04-25T08:57:05.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc7135c8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c0d2ae0 con 0x7fc70c15df70 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc7135c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0d1ed0 con 0x7fc70c0ced50 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc70c0d2f70 0x7fc70c0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc70c0d2f70 0x7fc70c0ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49956/0 (socket says 172.21.15.5:49956) 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 -- 172.21.15.5:0/1773299531 learned_addr learned my addr 172.21.15.5:0/1773299531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc711b65640 1 --2- 172.21.15.5:0/1773299531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0ced50 0x7fc70c0b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc711364640 1 --2- 172.21.15.5:0/1773299531 >> v2:172.21.15.80:3300/0 conn(0x7fc70c15df70 0x7fc70c0b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 -- 172.21.15.5:0/1773299531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0ced50 msgr2=0x7fc70c0b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 --2- 172.21.15.5:0/1773299531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0ced50 0x7fc70c0b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 -- 172.21.15.5:0/1773299531 >> v2:172.21.15.80:3300/0 conn(0x7fc70c15df70 msgr2=0x7fc70c0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 --2- 172.21.15.5:0/1773299531 >> v2:172.21.15.80:3300/0 conn(0x7fc70c15df70 0x7fc70c0b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.483+0000 7fc710b63640 1 -- 172.21.15.5:0/1773299531 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0d21b0 con 0x7fc70c0d2f70 2024-04-25T08:57:05.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.484+0000 7fc710b63640 1 --2- 172.21.15.5:0/1773299531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0d2f70 0x7fc70c0ce810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0d1220 tx=0x7fc6fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d5b5618998b467 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.484+0000 7fc703fff640 1 -- 172.21.15.5:0/1773299531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc037070 con 0x7fc70c0d2f70 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.484+0000 7fc703fff640 1 -- 172.21.15.5:0/1773299531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc032440 con 0x7fc70c0d2f70 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.484+0000 7fc703fff640 1 -- 172.21.15.5:0/1773299531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc032810 con 0x7fc70c0d2f70 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.484+0000 7fc7135c8640 1 -- 172.21.15.5:0/1773299531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0d2f70 msgr2=0x7fc70c0ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.484+0000 7fc7135c8640 1 --2- 172.21.15.5:0/1773299531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0d2f70 0x7fc70c0ce810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0d1220 tx=0x7fc6fc02a270 comp rx=0 tx=0).stop 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.485+0000 7fc7135c8640 1 -- 172.21.15.5:0/1773299531 shutdown_connections 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.485+0000 7fc7135c8640 1 --2- 172.21.15.5:0/1773299531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0ced50 0x7fc70c0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.485+0000 7fc7135c8640 1 --2- 172.21.15.5:0/1773299531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0d2f70 0x7fc70c0ce810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.485+0000 7fc7135c8640 1 --2- 172.21.15.5:0/1773299531 >> v2:172.21.15.80:3300/0 conn(0x7fc70c15df70 0x7fc70c0b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.485+0000 7fc7135c8640 1 -- 172.21.15.5:0/1773299531 >> 172.21.15.5:0/1773299531 conn(0x7fc70c06b000 msgr2=0x7fc70c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.485+0000 7fc7135c8640 1 -- 172.21.15.5:0/1773299531 shutdown_connections 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.485+0000 7fc7135c8640 1 -- 172.21.15.5:0/1773299531 wait complete. 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.486+0000 7fc7135c8640 1 Processor -- start 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.486+0000 7fc7135c8640 1 -- start start 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.486+0000 7fc7135c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70c0ced50 0x7fc70c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.486+0000 7fc7135c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0d2f70 0x7fc70c1f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.486+0000 7fc7135c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0cc900 0x7fc70c0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc7135c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0b9a10 con 0x7fc70c0cc900 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc7135c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0d2770 con 0x7fc70c0ced50 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc7135c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0d3720 con 0x7fc70c0d2f70 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0cc900 0x7fc70c0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0cc900 0x7fc70c0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49972/0 (socket says 172.21.15.5:49972) 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 -- 172.21.15.5:0/4109216610 learned_addr learned my addr 172.21.15.5:0/4109216610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:05.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711364640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70c0ced50 0x7fc70c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc710b63640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0d2f70 0x7fc70c1f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 -- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0d2f70 msgr2=0x7fc70c1f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0d2f70 0x7fc70c1f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 -- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70c0ced50 msgr2=0x7fc70c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70c0ced50 0x7fc70c0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 -- 172.21.15.5:0/4109216610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0b5300 con 0x7fc70c0cc900 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711364640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70c0ced50 0x7fc70c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc711b65640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0cc900 0x7fc70c0ccd90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc70400ef00 tx=0x7fc70400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc701ffb640 1 -- 172.21.15.5:0/4109216610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704018020 con 0x7fc70c0cc900 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc701ffb640 1 -- 172.21.15.5:0/4109216610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70400bd20 con 0x7fc70c0cc900 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c0c8310 con 0x7fc70c0cc900 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.487+0000 7fc701ffb640 1 -- 172.21.15.5:0/4109216610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704014640 con 0x7fc70c0cc900 2024-04-25T08:57:05.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.488+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c0c88d0 con 0x7fc70c0cc900 2024-04-25T08:57:05.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.488+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c0c8dc0 con 0x7fc70c0cc900 2024-04-25T08:57:05.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.489+0000 7fc701ffb640 1 -- 172.21.15.5:0/4109216610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc704005d10 con 0x7fc70c0cc900 2024-04-25T08:57:05.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.489+0000 7fc701ffb640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc6f006b4d0 0x7fc6f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.490+0000 7fc701ffb640 1 -- 172.21.15.5:0/4109216610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc70408a800 con 0x7fc70c0cc900 2024-04-25T08:57:05.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.490+0000 7fc711364640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc6f006b4d0 0x7fc6f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.490+0000 7fc711364640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc6f006b4d0 0x7fc6f006d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc708009b90 tx=0x7fc708008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.494+0000 7fc701ffb640 1 -- 172.21.15.5:0/4109216610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc704022070 con 0x7fc70c0cc900 2024-04-25T08:57:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.676+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc70c04ef20 con 0x7fc70c0cc900 2024-04-25T08:57:05.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.676+0000 7fc701ffb640 1 -- 172.21.15.5:0/4109216610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc70c0b5300 con 0x7fc70c0cc900 2024-04-25T08:57:05.665 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:05.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc6f006b4d0 msgr2=0x7fc6f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc6f006b4d0 0x7fc6f006d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc708009b90 tx=0x7fc708008040 comp rx=0 tx=0).stop 2024-04-25T08:57:05.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0cc900 msgr2=0x7fc70c0ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0cc900 0x7fc70c0ccd90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc70400ef00 tx=0x7fc70400b480 comp rx=0 tx=0).stop 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 shutdown_connections 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc6f006b4d0 0x7fc6f006d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc70c0cc900 0x7fc70c0ccd90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc70c0d2f70 0x7fc70c1f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 --2- 172.21.15.5:0/4109216610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70c0ced50 0x7fc70c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 >> 172.21.15.5:0/4109216610 conn(0x7fc70c06b000 msgr2=0x7fc70c15f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 shutdown_connections 2024-04-25T08:57:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.678+0000 7fc7135c8640 1 -- 172.21.15.5:0/4109216610 wait complete. 2024-04-25T08:57:05.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.793+0000 7f12d5363640 1 Processor -- start 2024-04-25T08:57:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.793+0000 7f12d5363640 1 -- start start 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12d5363640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12d00ae690 0x7f12d00b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12d5363640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12d00ce190 0x7f12d00cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12d5363640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d00b2ce0 con 0x7f12d00b2850 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12d5363640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d0071ff0 con 0x7f12d00ae690 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12d5363640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d0072690 con 0x7f12d00ce190 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12ceffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12d00ae690 0x7f12d00b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12ceffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12d00ae690 0x7f12d00b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49982/0 (socket says 172.21.15.5:49982) 2024-04-25T08:57:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12ceffd640 1 -- 172.21.15.5:0/3380114278 learned_addr learned my addr 172.21.15.5:0/3380114278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12cf7fe640 1 --2- 172.21.15.5:0/3380114278 >> v2:172.21.15.80:3300/0 conn(0x7f12d00ce190 0x7f12d00cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12ceffd640 1 -- 172.21.15.5:0/3380114278 >> v2:172.21.15.80:3300/0 conn(0x7f12d00ce190 msgr2=0x7f12d00cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12ceffd640 1 --2- 172.21.15.5:0/3380114278 >> v2:172.21.15.80:3300/0 conn(0x7f12d00ce190 0x7f12d00cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12ceffd640 1 -- 172.21.15.5:0/3380114278 >> v1:172.21.15.80:6789/0 conn(0x7f12d00b2850 legacy=0x7f12d00aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12ceffd640 1 -- 172.21.15.5:0/3380114278 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00b2f50 con 0x7f12d00ae690 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.794+0000 7f12cf7fe640 1 --2- 172.21.15.5:0/3380114278 >> v2:172.21.15.80:3300/0 conn(0x7f12d00ce190 0x7f12d00cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.795+0000 7f12ceffd640 1 --2- 172.21.15.5:0/3380114278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d00b4550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12d006e430 tx=0x7f12c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411ceb1d1ead16c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.795+0000 7f12cdffb640 1 -- 172.21.15.5:0/3380114278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8037070 con 0x7f12d00ae690 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.795+0000 7f12cdffb640 1 -- 172.21.15.5:0/3380114278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8032440 con 0x7f12d00ae690 2024-04-25T08:57:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.795+0000 7f12cdffb640 1 -- 172.21.15.5:0/3380114278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8032810 con 0x7f12d00ae690 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 -- 172.21.15.5:0/3380114278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 msgr2=0x7f12d00b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 --2- 172.21.15.5:0/3380114278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d00b4550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12d006e430 tx=0x7f12c802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 -- 172.21.15.5:0/3380114278 shutdown_connections 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 --2- 172.21.15.5:0/3380114278 >> v2:172.21.15.80:3300/0 conn(0x7f12d00ce190 0x7f12d00cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 --2- 172.21.15.5:0/3380114278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d00b4550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 -- 172.21.15.5:0/3380114278 >> 172.21.15.5:0/3380114278 conn(0x7f12d00b1550 msgr2=0x7f12d00b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 -- 172.21.15.5:0/3380114278 shutdown_connections 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.796+0000 7f12d5363640 1 -- 172.21.15.5:0/3380114278 wait complete. 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.797+0000 7f12d5363640 1 Processor -- start 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.797+0000 7f12d5363640 1 -- start start 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12d5363640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d0149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12d5363640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12d00b2850 0x7f12d0152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12d5363640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12d00ce190 0x7f12d00a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12d5363640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00cd990 con 0x7f12d00ae690 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12d5363640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00cd6b0 con 0x7f12d00ce190 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12d5363640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00cdc70 con 0x7f12d00b2850 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d0149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d0149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49998/0 (socket says 172.21.15.5:49998) 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 -- 172.21.15.5:0/1610918291 learned_addr learned my addr 172.21.15.5:0/1610918291 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 -- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12d00b2850 msgr2=0x7f12d0152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12d00b2850 0x7f12d0152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 -- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12d00ce190 msgr2=0x7f12d00a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12d00ce190 0x7f12d00a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 -- 172.21.15.5:0/1610918291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d01496d0 con 0x7f12d00ae690 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.798+0000 7f12ceffd640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d0149190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12c8000c00 tx=0x7f12c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.799+0000 7f12b77fe640 1 -- 172.21.15.5:0/1610918291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8041020 con 0x7f12d00ae690 2024-04-25T08:57:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.799+0000 7f12b77fe640 1 -- 172.21.15.5:0/1610918291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8030970 con 0x7f12d00ae690 2024-04-25T08:57:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.799+0000 7f12b77fe640 1 -- 172.21.15.5:0/1610918291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8037040 con 0x7f12d00ae690 2024-04-25T08:57:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.799+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d00ac0e0 con 0x7f12d00ae690 2024-04-25T08:57:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.799+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d00ac6a0 con 0x7f12d00ae690 2024-04-25T08:57:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.800+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d004ef20 con 0x7f12d00ae690 2024-04-25T08:57:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.800+0000 7f12b77fe640 1 -- 172.21.15.5:0/1610918291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f12c8044020 con 0x7f12d00ae690 2024-04-25T08:57:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.801+0000 7f12b77fe640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12bc06b4d0 0x7f12bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.801+0000 7f12b77fe640 1 -- 172.21.15.5:0/1610918291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12c80aac40 con 0x7f12d00ae690 2024-04-25T08:57:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.801+0000 7f12ce7fc640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12bc06b4d0 0x7f12bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.801+0000 7f12ce7fc640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12bc06b4d0 0x7f12bc06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12d00cc1f0 tx=0x7f12c40079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.805+0000 7f12b77fe640 1 -- 172.21.15.5:0/1610918291 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f12c804b030 con 0x7f12d00ae690 2024-04-25T08:57:05.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.984+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12d0071720 con 0x7f12d00ae690 2024-04-25T08:57:05.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.984+0000 7f12b77fe640 1 -- 172.21.15.5:0/1610918291 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12c8079ac0 con 0x7f12d00ae690 2024-04-25T08:57:05.973 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12bc06b4d0 msgr2=0x7f12bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12bc06b4d0 0x7f12bc06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12d00cc1f0 tx=0x7f12c40079d0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 msgr2=0x7f12d0149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d0149190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12c8000c00 tx=0x7f12c80046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 shutdown_connections 2024-04-25T08:57:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12bc06b4d0 0x7f12bc06d990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12d00ce190 0x7f12d00a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12d00b2850 0x7f12d0152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 --2- 172.21.15.5:0/1610918291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00ae690 0x7f12d0149190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 >> 172.21.15.5:0/1610918291 conn(0x7f12d00b1550 msgr2=0x7f12d015d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 shutdown_connections 2024-04-25T08:57:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:05.986+0000 7f12d5363640 1 -- 172.21.15.5:0/1610918291 wait complete. 2024-04-25T08:57:05.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.101+0000 7ff92fb16640 1 Processor -- start 2024-04-25T08:57:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.101+0000 7ff92fb16640 1 -- start start 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92fb16640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff928152b90 0x7ff92815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92fb16640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92806b9d0 con 0x7ff92815fc30 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92fb16640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92806b130 con 0x7ff928067000 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92fb16640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92806b410 con 0x7ff928152b90 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92d8b2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff928152b90 0x7ff92815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92d8b2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff928152b90 0x7ff92815f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50004/0 (socket says 172.21.15.5:50004) 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92d0b1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff92815fc30 0x7ff9280668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40312/0 (socket says 172.21.15.5:40312) 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.102+0000 7ff92d8b2640 1 -- 172.21.15.5:0/3086370575 learned_addr learned my addr 172.21.15.5:0/3086370575 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:06.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92d8b2640 1 -- 172.21.15.5:0/3086370575 >> v1:172.21.15.80:6789/0 conn(0x7ff928067000 legacy=0x7ff92815c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92d8b2640 1 -- 172.21.15.5:0/3086370575 >> v1:172.21.15.5:6789/0 conn(0x7ff92815fc30 legacy=0x7ff9280668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92d8b2640 1 -- 172.21.15.5:0/3086370575 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92806b6f0 con 0x7ff928152b90 2024-04-25T08:57:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92c8b0640 1 -- 172.21.15.5:0/3086370575 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858201200 0 0) 0x7ff92806b9d0 con 0x7ff92815fc30 2024-04-25T08:57:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92d8b2640 1 --2- 172.21.15.5:0/3086370575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928152b90 0x7ff92815f6f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff920009870 tx=0x7ff92002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878fab3eb42ad229 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92c8b0640 1 -- 172.21.15.5:0/3086370575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920037070 con 0x7ff928152b90 2024-04-25T08:57:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92c8b0640 1 -- 172.21.15.5:0/3086370575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920032440 con 0x7ff928152b90 2024-04-25T08:57:06.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.103+0000 7ff92c8b0640 1 -- 172.21.15.5:0/3086370575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920032810 con 0x7ff928152b90 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.104+0000 7ff92fb16640 1 -- 172.21.15.5:0/3086370575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928152b90 msgr2=0x7ff92815f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.104+0000 7ff92fb16640 1 --2- 172.21.15.5:0/3086370575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928152b90 0x7ff92815f6f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff920009870 tx=0x7ff92002a2a0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.104+0000 7ff92fb16640 1 -- 172.21.15.5:0/3086370575 shutdown_connections 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.104+0000 7ff92fb16640 1 --2- 172.21.15.5:0/3086370575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928152b90 0x7ff92815f6f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.104+0000 7ff92fb16640 1 -- 172.21.15.5:0/3086370575 >> 172.21.15.5:0/3086370575 conn(0x7ff9280b2560 msgr2=0x7ff9280b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.104+0000 7ff92fb16640 1 -- 172.21.15.5:0/3086370575 shutdown_connections 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.104+0000 7ff92fb16640 1 -- 172.21.15.5:0/3086370575 wait complete. 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.105+0000 7ff92fb16640 1 Processor -- start 2024-04-25T08:57:06.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.105+0000 7ff92fb16640 1 -- start start 2024-04-25T08:57:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92fb16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928067000 0x7ff928149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92fb16640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff928152b90 0x7ff92815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92fb16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815fc30 0x7ff92815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92fb16640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280d0640 con 0x7ff928067000 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92fb16640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff928152f70 con 0x7ff92815fc30 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92fb16640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92815ce40 con 0x7ff928152b90 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928067000 0x7ff928149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928067000 0x7ff928149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50016/0 (socket says 172.21.15.5:50016) 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 -- 172.21.15.5:0/911577654 learned_addr learned my addr 172.21.15.5:0/911577654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92e0b3640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815fc30 0x7ff92815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d0b1640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff928152b90 0x7ff92815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 -- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff928152b90 msgr2=0x7ff92815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff928152b90 0x7ff92815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 -- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815fc30 msgr2=0x7ff92815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815fc30 0x7ff92815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d8b2640 1 -- 172.21.15.5:0/911577654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280b4570 con 0x7ff928067000 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92e0b3640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815fc30 0x7ff92815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.106+0000 7ff92d0b1640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff928152b90 0x7ff92815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.107+0000 7ff92d8b2640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928067000 0x7ff928149690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff920009870 tx=0x7ff9200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.107+0000 7ff9267fc640 1 -- 172.21.15.5:0/911577654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920041070 con 0x7ff928067000 2024-04-25T08:57:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.107+0000 7ff9267fc640 1 -- 172.21.15.5:0/911577654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92003c870 con 0x7ff928067000 2024-04-25T08:57:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.107+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9281f3c10 con 0x7ff928067000 2024-04-25T08:57:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.107+0000 7ff9267fc640 1 -- 172.21.15.5:0/911577654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920037040 con 0x7ff928067000 2024-04-25T08:57:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.107+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9281f46f0 con 0x7ff928067000 2024-04-25T08:57:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.108+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff928156490 con 0x7ff928067000 2024-04-25T08:57:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.108+0000 7ff9267fc640 1 -- 172.21.15.5:0/911577654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff920044070 con 0x7ff928067000 2024-04-25T08:57:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.109+0000 7ff9267fc640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91406b500 0x7ff91406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.109+0000 7ff9267fc640 1 -- 172.21.15.5:0/911577654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9200aafe0 con 0x7ff928067000 2024-04-25T08:57:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.109+0000 7ff92d0b1640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91406b500 0x7ff91406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.109+0000 7ff92d0b1640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91406b500 0x7ff91406d9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9280b2530 tx=0x7ff91c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.113+0000 7ff9267fc640 1 -- 172.21.15.5:0/911577654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff920079f80 con 0x7ff928067000 2024-04-25T08:57:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.293+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff92804ef20 con 0x7ff928067000 2024-04-25T08:57:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.293+0000 7ff9267fc640 1 -- 172.21.15.5:0/911577654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff920079880 con 0x7ff928067000 2024-04-25T08:57:06.282 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91406b500 msgr2=0x7ff91406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91406b500 0x7ff91406d9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9280b2530 tx=0x7ff91c009040 comp rx=0 tx=0).stop 2024-04-25T08:57:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928067000 msgr2=0x7ff928149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928067000 0x7ff928149690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff920009870 tx=0x7ff9200046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 shutdown_connections 2024-04-25T08:57:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91406b500 0x7ff91406d9c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815fc30 0x7ff92815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff928152b90 0x7ff92815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 --2- 172.21.15.5:0/911577654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff928067000 0x7ff928149690 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 >> 172.21.15.5:0/911577654 conn(0x7ff9280b2560 msgr2=0x7ff92815d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:06.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 shutdown_connections 2024-04-25T08:57:06.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.295+0000 7ff92fb16640 1 -- 172.21.15.5:0/911577654 wait complete. 2024-04-25T08:57:06.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.406+0000 7fb9cb742640 1 Processor -- start 2024-04-25T08:57:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.407+0000 7fb9cb742640 1 -- start start 2024-04-25T08:57:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.407+0000 7fb9cb742640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9c415e0a0 0x7fb9c40d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.407+0000 7fb9cb742640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3df0 0x7fb9c40cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.407+0000 7fb9cb742640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c40b7f60 con 0x7fb9c40d3990 2024-04-25T08:57:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.407+0000 7fb9cb742640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40b29c0 con 0x7fb9c415e0a0 2024-04-25T08:57:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.407+0000 7fb9cb742640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40d2080 con 0x7fb9c40d3df0 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c94de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9c415e0a0 0x7fb9c40d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c94de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9c415e0a0 0x7fb9c40d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50022/0 (socket says 172.21.15.5:50022) 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c94de640 1 -- 172.21.15.5:0/65529183 learned_addr learned my addr 172.21.15.5:0/65529183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c9cdf640 1 --2- 172.21.15.5:0/65529183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3df0 0x7fb9c40cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c94de640 1 -- 172.21.15.5:0/65529183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3df0 msgr2=0x7fb9c40cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c94de640 1 --2- 172.21.15.5:0/65529183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3df0 0x7fb9c40cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c94de640 1 -- 172.21.15.5:0/65529183 >> v1:172.21.15.80:6789/0 conn(0x7fb9c40d3990 legacy=0x7fb9c40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.408+0000 7fb9c94de640 1 -- 172.21.15.5:0/65529183 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c40d2360 con 0x7fb9c415e0a0 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9c94de640 1 --2- 172.21.15.5:0/65529183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c415e0a0 0x7fb9c40d0d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009870 tx=0x7fb9c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc03a2977557342 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9bbfff640 1 -- 172.21.15.5:0/65529183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0037070 con 0x7fb9c415e0a0 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9bbfff640 1 -- 172.21.15.5:0/65529183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c0032440 con 0x7fb9c415e0a0 2024-04-25T08:57:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9bbfff640 1 -- 172.21.15.5:0/65529183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0032810 con 0x7fb9c415e0a0 2024-04-25T08:57:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 -- 172.21.15.5:0/65529183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c415e0a0 msgr2=0x7fb9c40d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 --2- 172.21.15.5:0/65529183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c415e0a0 0x7fb9c40d0d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009870 tx=0x7fb9c002a270 comp rx=0 tx=0).stop 2024-04-25T08:57:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 -- 172.21.15.5:0/65529183 shutdown_connections 2024-04-25T08:57:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 --2- 172.21.15.5:0/65529183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3df0 0x7fb9c40cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 --2- 172.21.15.5:0/65529183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c415e0a0 0x7fb9c40d0d50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 -- 172.21.15.5:0/65529183 >> 172.21.15.5:0/65529183 conn(0x7fb9c40668f0 msgr2=0x7fb9c4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 -- 172.21.15.5:0/65529183 shutdown_connections 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.409+0000 7fb9cb742640 1 -- 172.21.15.5:0/65529183 wait complete. 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.410+0000 7fb9cb742640 1 Processor -- start 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.410+0000 7fb9cb742640 1 -- start start 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9cb742640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3990 0x7fb9c41e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9cb742640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c40d3df0 0x7fb9c414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9cb742640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c415e0a0 0x7fb9c40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9cb742640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40d2c00 con 0x7fb9c40d3df0 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9cb742640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40d2920 con 0x7fb9c415e0a0 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9cb742640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40d4280 con 0x7fb9c40d3990 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9c8cdd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c40d3df0 0x7fb9c414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9c8cdd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c40d3df0 0x7fb9c414fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50030/0 (socket says 172.21.15.5:50030) 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9c8cdd640 1 -- 172.21.15.5:0/4017539036 learned_addr learned my addr 172.21.15.5:0/4017539036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9c94de640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3990 0x7fb9c41e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.411+0000 7fb9c9cdf640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c415e0a0 0x7fb9c40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9c8cdd640 1 -- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3990 msgr2=0x7fb9c41e7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9c8cdd640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3990 0x7fb9c41e7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9c8cdd640 1 -- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c415e0a0 msgr2=0x7fb9c40b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9c8cdd640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c415e0a0 0x7fb9c40b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9c8cdd640 1 -- 172.21.15.5:0/4017539036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c40cba70 con 0x7fb9c40d3df0 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9c8cdd640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c40d3df0 0x7fb9c414fdc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c430 tx=0x7fb9b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9b9ffb640 1 -- 172.21.15.5:0/4017539036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4017070 con 0x7fb9c40d3df0 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9b9ffb640 1 -- 172.21.15.5:0/4017539036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40052d0 con 0x7fb9c40d3df0 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c41e6b30 con 0x7fb9c40d3df0 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9b9ffb640 1 -- 172.21.15.5:0/4017539036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4003830 con 0x7fb9c40d3df0 2024-04-25T08:57:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.412+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c41e6e10 con 0x7fb9c40d3df0 2024-04-25T08:57:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.414+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c404ef20 con 0x7fb9c40d3df0 2024-04-25T08:57:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.414+0000 7fb9b9ffb640 1 -- 172.21.15.5:0/4017539036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9b401a070 con 0x7fb9c40d3df0 2024-04-25T08:57:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.415+0000 7fb9b9ffb640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9a806b4d0 0x7fb9a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.415+0000 7fb9b9ffb640 1 -- 172.21.15.5:0/4017539036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9b40894d0 con 0x7fb9c40d3df0 2024-04-25T08:57:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.415+0000 7fb9c94de640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9a806b4d0 0x7fb9a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.415+0000 7fb9c94de640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9a806b4d0 0x7fb9a806d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0034000 tx=0x7fb9c002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.419+0000 7fb9b9ffb640 1 -- 172.21.15.5:0/4017539036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9b4057d00 con 0x7fb9c40d3df0 2024-04-25T08:57:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.603+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9c40cbc40 con 0x7fb9c40d3df0 2024-04-25T08:57:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.604+0000 7fb9b9ffb640 1 -- 172.21.15.5:0/4017539036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fb9c40cbc40 con 0x7fb9c40d3df0 2024-04-25T08:57:06.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:06.593 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9a806b4d0 msgr2=0x7fb9a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9a806b4d0 0x7fb9a806d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0034000 tx=0x7fb9c002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c40d3df0 msgr2=0x7fb9c414fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c40d3df0 0x7fb9c414fdc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c430 tx=0x7fb9b400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 shutdown_connections 2024-04-25T08:57:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9a806b4d0 0x7fb9a806d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c415e0a0 0x7fb9c40b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c40d3df0 0x7fb9c414fdc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 --2- 172.21.15.5:0/4017539036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9c40d3990 0x7fb9c41e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 >> 172.21.15.5:0/4017539036 conn(0x7fb9c40668f0 msgr2=0x7fb9c40d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 shutdown_connections 2024-04-25T08:57:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.606+0000 7fb9cb742640 1 -- 172.21.15.5:0/4017539036 wait complete. 2024-04-25T08:57:06.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:06.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:06.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.721+0000 7f9f092bd640 1 Processor -- start 2024-04-25T08:57:06.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.721+0000 7f9f092bd640 1 -- start start 2024-04-25T08:57:06.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f092bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040cefe0 0x7f9f04168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f092bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f04162150 con 0x7f9f040b6250 2024-04-25T08:57:06.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f092bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f04162430 con 0x7f9f0415df10 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f092bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040d20d0 con 0x7f9f040cefe0 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9efbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f040b6250 0x7f9f040ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40316/0 (socket says 172.21.15.5:40316) 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9efbfff640 1 -- 172.21.15.5:0/1420295384 learned_addr learned my addr 172.21.15.5:0/1420295384 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f037fe640 1 --2- 172.21.15.5:0/1420295384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040cefe0 0x7f9f04168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370715810 0 0) 0x7f9f04162150 con 0x7f9f040b6250 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef0003520 con 0x7f9f040b6250 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046157095 0 0) 0x7f9f04162430 con 0x7f9f0415df10 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f04162150 con 0x7f9f0415df10 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f037fe640 1 -- 172.21.15.5:0/1420295384 >> v1:172.21.15.80:6789/0 conn(0x7f9f0415df10 legacy=0x7f9f041618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f037fe640 1 -- 172.21.15.5:0/1420295384 >> v1:172.21.15.5:6789/0 conn(0x7f9f040b6250 legacy=0x7f9f040ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.722+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877706243 0 0) 0x7f9ef0003520 con 0x7f9f040b6250 2024-04-25T08:57:06.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.723+0000 7f9f037fe640 1 -- 172.21.15.5:0/1420295384 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04162710 con 0x7f9f040cefe0 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.723+0000 7f9f037fe640 1 --2- 172.21.15.5:0/1420295384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040cefe0 0x7f9f04168c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009dc0 tx=0x7f9efc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af096e916c512b4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.723+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec001670 con 0x7f9f040cefe0 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.723+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc007540 con 0x7f9f040cefe0 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.723+0000 7f9f027fc640 1 -- 172.21.15.5:0/1420295384 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0078f0 con 0x7f9f040cefe0 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.724+0000 7f9f092bd640 1 -- 172.21.15.5:0/1420295384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040cefe0 msgr2=0x7f9f04168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.724+0000 7f9f092bd640 1 --2- 172.21.15.5:0/1420295384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040cefe0 0x7f9f04168c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009dc0 tx=0x7f9efc02a660 comp rx=0 tx=0).stop 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.724+0000 7f9f092bd640 1 -- 172.21.15.5:0/1420295384 shutdown_connections 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.724+0000 7f9f092bd640 1 --2- 172.21.15.5:0/1420295384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040cefe0 0x7f9f04168c40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.724+0000 7f9f092bd640 1 -- 172.21.15.5:0/1420295384 >> 172.21.15.5:0/1420295384 conn(0x7f9f040668f0 msgr2=0x7f9f04066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.724+0000 7f9f092bd640 1 -- 172.21.15.5:0/1420295384 shutdown_connections 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.724+0000 7f9f092bd640 1 -- 172.21.15.5:0/1420295384 wait complete. 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.725+0000 7f9f092bd640 1 Processor -- start 2024-04-25T08:57:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.725+0000 7f9f092bd640 1 -- start start 2024-04-25T08:57:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9f092bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f040b6250 0x7f9f040c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9f092bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040cefe0 0x7f9f041f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9f092bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f0415df10 0x7f9f0414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9f092bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040d36f0 con 0x7f9f040cefe0 2024-04-25T08:57:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9f092bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040d3570 con 0x7f9f040b6250 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9f092bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040d3870 con 0x7f9f0415df10 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040cefe0 0x7f9f041f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040cefe0 0x7f9f041f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50044/0 (socket says 172.21.15.5:50044) 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 -- 172.21.15.5:0/3615042230 learned_addr learned my addr 172.21.15.5:0/3615042230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 -- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f0415df10 msgr2=0x7f9f0414c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f0415df10 0x7f9f0414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 -- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f040b6250 msgr2=0x7f9f040c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9f02ffd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f040b6250 0x7f9f040c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f040b6250 0x7f9f040c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.726+0000 7f9efbfff640 1 -- 172.21.15.5:0/3615042230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f041f55c0 con 0x7f9f040cefe0 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.727+0000 7f9efbfff640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040cefe0 0x7f9f041f5080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c5f0 tx=0x7f9eec00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.727+0000 7f9efb7fe640 1 -- 172.21.15.5:0/3615042230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec017070 con 0x7f9f040cefe0 2024-04-25T08:57:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.727+0000 7f9efb7fe640 1 -- 172.21.15.5:0/3615042230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec005d00 con 0x7f9f040cefe0 2024-04-25T08:57:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.727+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f040b3fb0 con 0x7f9f040cefe0 2024-04-25T08:57:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.727+0000 7f9efb7fe640 1 -- 172.21.15.5:0/3615042230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0072b0 con 0x7f9f040cefe0 2024-04-25T08:57:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.727+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f040b4570 con 0x7f9f040cefe0 2024-04-25T08:57:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.728+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0404ef20 con 0x7f9f040cefe0 2024-04-25T08:57:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.728+0000 7f9efb7fe640 1 -- 172.21.15.5:0/3615042230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9eec01a070 con 0x7f9f040cefe0 2024-04-25T08:57:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.729+0000 7f9efb7fe640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ee406b4d0 0x7f9ee406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.729+0000 7f9efb7fe640 1 -- 172.21.15.5:0/3615042230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eec089720 con 0x7f9f040cefe0 2024-04-25T08:57:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.729+0000 7f9f02ffd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ee406b4d0 0x7f9ee406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.730+0000 7f9f02ffd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ee406b4d0 0x7f9ee406d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40011e0 tx=0x7f9ef4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.733+0000 7f9efb7fe640 1 -- 172.21.15.5:0/3615042230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f041f55c0 con 0x7f9f040cefe0 2024-04-25T08:57:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.913+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f04168d00 con 0x7f9f040cefe0 2024-04-25T08:57:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.914+0000 7f9efb7fe640 1 -- 172.21.15.5:0/3615042230 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9eec058630 con 0x7f9f040cefe0 2024-04-25T08:57:06.902 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ee406b4d0 msgr2=0x7f9ee406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ee406b4d0 0x7f9ee406d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40011e0 tx=0x7f9ef4009040 comp rx=0 tx=0).stop 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040cefe0 msgr2=0x7f9f041f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040cefe0 0x7f9f041f5080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c5f0 tx=0x7f9eec00cab0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 shutdown_connections 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ee406b4d0 0x7f9ee406d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f0415df10 0x7f9f0414c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040cefe0 0x7f9f041f5080 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 --2- 172.21.15.5:0/3615042230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f040b6250 0x7f9f040c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 >> 172.21.15.5:0/3615042230 conn(0x7f9f040668f0 msgr2=0x7f9f04156150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 shutdown_connections 2024-04-25T08:57:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:06.915+0000 7f9f092bd640 1 -- 172.21.15.5:0/3615042230 wait complete. 2024-04-25T08:57:06.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:07.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.030+0000 7f9acf21f640 1 Processor -- start 2024-04-25T08:57:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.030+0000 7f9acf21f640 1 -- start start 2024-04-25T08:57:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.030+0000 7f9acf21f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ac815df70 0x7f9ac80b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.030+0000 7f9acf21f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80cef20 0x7f9ac80b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.030+0000 7f9acf21f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac80d1ed0 con 0x7f9ac80d2f70 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.030+0000 7f9acf21f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac80d1c80 con 0x7f9ac815df70 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.030+0000 7f9acf21f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80d2ae0 con 0x7f9ac80cef20 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9accfbb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ac815df70 0x7f9ac80b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9ac7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9ac80d2f70 0x7f9ac80ce810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40328/0 (socket says 172.21.15.5:40328) 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9ac7fff640 1 -- 172.21.15.5:0/2516883713 learned_addr learned my addr 172.21.15.5:0/2516883713 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9acd7bc640 1 --2- 172.21.15.5:0/2516883713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80cef20 0x7f9ac80b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9accfbb640 1 -- 172.21.15.5:0/2516883713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80cef20 msgr2=0x7f9ac80b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9accfbb640 1 --2- 172.21.15.5:0/2516883713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80cef20 0x7f9ac80b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9accfbb640 1 -- 172.21.15.5:0/2516883713 >> v1:172.21.15.5:6789/0 conn(0x7f9ac80d2f70 legacy=0x7f9ac80ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9accfbb640 1 -- 172.21.15.5:0/2516883713 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80d21b0 con 0x7f9ac815df70 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.031+0000 7f9ac77fe640 1 -- 172.21.15.5:0/2516883713 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043707422 0 0) 0x7f9ac80d1ed0 con 0x7f9ac80d2f70 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9accfbb640 1 --2- 172.21.15.5:0/2516883713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac815df70 0x7f9ac80b94d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097a0 tx=0x7f9abc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b7fd7905e6f376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9ac77fe640 1 -- 172.21.15.5:0/2516883713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc037070 con 0x7f9ac815df70 2024-04-25T08:57:07.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9ac77fe640 1 -- 172.21.15.5:0/2516883713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc032440 con 0x7f9ac815df70 2024-04-25T08:57:07.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9ac77fe640 1 -- 172.21.15.5:0/2516883713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc032810 con 0x7f9ac815df70 2024-04-25T08:57:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 -- 172.21.15.5:0/2516883713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac815df70 msgr2=0x7f9ac80b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 --2- 172.21.15.5:0/2516883713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac815df70 0x7f9ac80b94d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097a0 tx=0x7f9abc02a210 comp rx=0 tx=0).stop 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 -- 172.21.15.5:0/2516883713 shutdown_connections 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 --2- 172.21.15.5:0/2516883713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80cef20 0x7f9ac80b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 --2- 172.21.15.5:0/2516883713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac815df70 0x7f9ac80b94d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 -- 172.21.15.5:0/2516883713 >> 172.21.15.5:0/2516883713 conn(0x7f9ac806b000 msgr2=0x7f9ac806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 -- 172.21.15.5:0/2516883713 shutdown_connections 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.032+0000 7f9acf21f640 1 -- 172.21.15.5:0/2516883713 wait complete. 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 Processor -- start 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 -- start start 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ac80cef20 0x7f9ac80b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80d2f70 0x7f9ac80aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac80aaa10 0x7f9ac80ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80b9a10 con 0x7f9ac80aaa10 2024-04-25T08:57:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80d2770 con 0x7f9ac80cef20 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.034+0000 7f9acf21f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80d3720 con 0x7f9ac80d2f70 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac80aaa10 0x7f9ac80ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac80aaa10 0x7f9ac80ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50052/0 (socket says 172.21.15.5:50052) 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 -- 172.21.15.5:0/3338728713 learned_addr learned my addr 172.21.15.5:0/3338728713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9accfbb640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ac80cef20 0x7f9ac80b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9ac7fff640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80d2f70 0x7f9ac80aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 -- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80d2f70 msgr2=0x7f9ac80aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80d2f70 0x7f9ac80aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 -- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ac80cef20 msgr2=0x7f9ac80b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ac80cef20 0x7f9ac80b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 -- 172.21.15.5:0/3338728713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80ab6c0 con 0x7f9ac80aaa10 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acd7bc640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac80aaa10 0x7f9ac80ac180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0007e90 tx=0x7f9ac000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9ac57fa640 1 -- 172.21.15.5:0/3338728713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0014420 con 0x7f9ac80aaa10 2024-04-25T08:57:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9ac57fa640 1 -- 172.21.15.5:0/3338728713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac0019070 con 0x7f9ac80aaa10 2024-04-25T08:57:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac80ab0b0 con 0x7f9ac80aaa10 2024-04-25T08:57:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9ac57fa640 1 -- 172.21.15.5:0/3338728713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0014800 con 0x7f9ac80aaa10 2024-04-25T08:57:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.035+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac80ab980 con 0x7f9ac80aaa10 2024-04-25T08:57:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.036+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac804ef20 con 0x7f9ac80aaa10 2024-04-25T08:57:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.037+0000 7f9ac57fa640 1 -- 172.21.15.5:0/3338728713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ac00149a0 con 0x7f9ac80aaa10 2024-04-25T08:57:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.037+0000 7f9ac57fa640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9aac06b500 0x7f9aac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.037+0000 7f9ac57fa640 1 -- 172.21.15.5:0/3338728713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ac008a910 con 0x7f9ac80aaa10 2024-04-25T08:57:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.038+0000 7f9accfbb640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9aac06b500 0x7f9aac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.038+0000 7f9accfbb640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9aac06b500 0x7f9aac06d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9abc034000 tx=0x7f9abc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.042+0000 7f9ac57fa640 1 -- 172.21.15.5:0/3338728713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ac00590b0 con 0x7f9ac80aaa10 2024-04-25T08:57:07.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.220+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ac8071830 con 0x7f9ac80aaa10 2024-04-25T08:57:07.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.220+0000 7f9ac57fa640 1 -- 172.21.15.5:0/3338728713 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ac005d150 con 0x7f9ac80aaa10 2024-04-25T08:57:07.209 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:07.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9aac06b500 msgr2=0x7f9aac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9aac06b500 0x7f9aac06d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9abc034000 tx=0x7f9abc02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:07.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac80aaa10 msgr2=0x7f9ac80ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac80aaa10 0x7f9ac80ac180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0007e90 tx=0x7f9ac000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 shutdown_connections 2024-04-25T08:57:07.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9aac06b500 0x7f9aac06d9c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ac80aaa10 0x7f9ac80ac180 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ac80d2f70 0x7f9ac80aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 --2- 172.21.15.5:0/3338728713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ac80cef20 0x7f9ac80b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 >> 172.21.15.5:0/3338728713 conn(0x7f9ac806b000 msgr2=0x7f9ac815edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 shutdown_connections 2024-04-25T08:57:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.222+0000 7f9acf21f640 1 -- 172.21.15.5:0/3338728713 wait complete. 2024-04-25T08:57:07.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.338+0000 7f17fc29e640 1 Processor -- start 2024-04-25T08:57:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.338+0000 7f17fc29e640 1 -- start start 2024-04-25T08:57:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fc29e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f41618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fc29e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17f40cefe0 0x7f17f40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fc29e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f4162150 con 0x7f17f40b6250 2024-04-25T08:57:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fc29e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f40d20d0 con 0x7f17f40cefe0 2024-04-25T08:57:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fc29e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4162430 con 0x7f17f415df10 2024-04-25T08:57:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa83b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17f40cefe0 0x7f17f40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa83b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17f40cefe0 0x7f17f40d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50058/0 (socket says 172.21.15.5:50058) 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa83b640 1 -- 172.21.15.5:0/3018598533 learned_addr learned my addr 172.21.15.5:0/3018598533 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa03a640 1 --2- 172.21.15.5:0/3018598533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f41618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa83b640 1 -- 172.21.15.5:0/3018598533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 msgr2=0x7f17f41618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa83b640 1 --2- 172.21.15.5:0/3018598533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f41618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa83b640 1 -- 172.21.15.5:0/3018598533 >> v1:172.21.15.80:6789/0 conn(0x7f17f40b6250 legacy=0x7f17f40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa83b640 1 -- 172.21.15.5:0/3018598533 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4162710 con 0x7f17f40cefe0 2024-04-25T08:57:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.339+0000 7f17fa03a640 1 --2- 172.21.15.5:0/3018598533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f41618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.340+0000 7f17fa83b640 1 --2- 172.21.15.5:0/3018598533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cefe0 0x7f17f40d2560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009e80 tx=0x7f17e402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f1ed49c25e404a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.340+0000 7f17f9038640 1 -- 172.21.15.5:0/3018598533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4036070 con 0x7f17f40cefe0 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.340+0000 7f17f9038640 1 -- 172.21.15.5:0/3018598533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4031600 con 0x7f17f40cefe0 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.340+0000 7f17f9038640 1 -- 172.21.15.5:0/3018598533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e40319d0 con 0x7f17f40cefe0 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 -- 172.21.15.5:0/3018598533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cefe0 msgr2=0x7f17f40d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 --2- 172.21.15.5:0/3018598533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cefe0 0x7f17f40d2560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009e80 tx=0x7f17e402a750 comp rx=0 tx=0).stop 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 -- 172.21.15.5:0/3018598533 shutdown_connections 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 --2- 172.21.15.5:0/3018598533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cefe0 0x7f17f40d2560 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 --2- 172.21.15.5:0/3018598533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f41618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 -- 172.21.15.5:0/3018598533 >> 172.21.15.5:0/3018598533 conn(0x7f17f40668f0 msgr2=0x7f17f4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 -- 172.21.15.5:0/3018598533 shutdown_connections 2024-04-25T08:57:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.341+0000 7f17fc29e640 1 -- 172.21.15.5:0/3018598533 wait complete. 2024-04-25T08:57:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.342+0000 7f17fc29e640 1 Processor -- start 2024-04-25T08:57:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.342+0000 7f17fc29e640 1 -- start start 2024-04-25T08:57:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fc29e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40b6250 0x7f17f4152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fc29e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f40cefe0 0x7f17f415f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fc29e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fc29e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40d2aa0 con 0x7f17f40b6250 2024-04-25T08:57:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fc29e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4161e10 con 0x7f17f40cefe0 2024-04-25T08:57:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fc29e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40d2c20 con 0x7f17f415df10 2024-04-25T08:57:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40b6250 0x7f17f4152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40b6250 0x7f17f4152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50070/0 (socket says 172.21.15.5:50070) 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 -- 172.21.15.5:0/1130532315 learned_addr learned my addr 172.21.15.5:0/1130532315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17f9839640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f40cefe0 0x7f17f415f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa83b640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 -- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 msgr2=0x7f17f40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f40c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 -- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f40cefe0 msgr2=0x7f17f415f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f40cefe0 0x7f17f415f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 -- 172.21.15.5:0/1130532315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f415fc90 con 0x7f17f40b6250 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17f9839640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f40cefe0 0x7f17f415f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa83b640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f40c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17fa03a640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40b6250 0x7f17f4152660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d800 tx=0x7f17ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.343+0000 7f17f2ffd640 1 -- 172.21.15.5:0/1130532315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec004030 con 0x7f17f40b6250 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.344+0000 7f17f2ffd640 1 -- 172.21.15.5:0/1130532315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec0041d0 con 0x7f17f40b6250 2024-04-25T08:57:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.344+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f415ff70 con 0x7f17f40b6250 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.344+0000 7f17f2ffd640 1 -- 172.21.15.5:0/1130532315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0096a0 con 0x7f17f40b6250 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.344+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f4160250 con 0x7f17f40b6250 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.344+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f404ef20 con 0x7f17f40b6250 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.345+0000 7f17f2ffd640 1 -- 172.21.15.5:0/1130532315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f17ec009840 con 0x7f17f40b6250 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.345+0000 7f17f2ffd640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17e006b4d0 0x7f17e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.346+0000 7f17f2ffd640 1 -- 172.21.15.5:0/1130532315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17ec08a500 con 0x7f17f40b6250 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.346+0000 7f17f9839640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17e006b4d0 0x7f17e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.346+0000 7f17f9839640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17e006b4d0 0x7f17e006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17f41f7760 tx=0x7f17e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.350+0000 7f17f2ffd640 1 -- 172.21.15.5:0/1130532315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17ec059380 con 0x7f17f40b6250 2024-04-25T08:57:07.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.528+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17f40c6e60 con 0x7f17f40b6250 2024-04-25T08:57:07.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.529+0000 7f17f2ffd640 1 -- 172.21.15.5:0/1130532315 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17ec058c80 con 0x7f17f40b6250 2024-04-25T08:57:07.518 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17e006b4d0 msgr2=0x7f17e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17e006b4d0 0x7f17e006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17f41f7760 tx=0x7f17e8009040 comp rx=0 tx=0).stop 2024-04-25T08:57:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40b6250 msgr2=0x7f17f4152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40b6250 0x7f17f4152660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d800 tx=0x7f17ec00dcc0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 shutdown_connections 2024-04-25T08:57:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17e006b4d0 0x7f17e006d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17f415df10 0x7f17f40c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f40cefe0 0x7f17f415f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 --2- 172.21.15.5:0/1130532315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40b6250 0x7f17f4152660 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 >> 172.21.15.5:0/1130532315 conn(0x7f17f40668f0 msgr2=0x7f17f40b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 shutdown_connections 2024-04-25T08:57:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.531+0000 7f17fc29e640 1 -- 172.21.15.5:0/1130532315 wait complete. 2024-04-25T08:57:07.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.642+0000 7f4dc9b3b640 1 Processor -- start 2024-04-25T08:57:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.642+0000 7f4dc9b3b640 1 -- start start 2024-04-25T08:57:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc9b3b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4dc40b0a50 0x7f4dc40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc9b3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc9b3b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc406ba50 con 0x7f4dc40cbf40 2024-04-25T08:57:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc9b3b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc406b800 con 0x7f4dc40b0a50 2024-04-25T08:57:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc9b3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc406bd30 con 0x7f4dc40b0e30 2024-04-25T08:57:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4dc40b0a50 0x7f4dc40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4dc40b0a50 0x7f4dc40ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50084/0 (socket says 172.21.15.5:50084) 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2313571510 learned_addr learned my addr 172.21.15.5:0/2313571510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.643+0000 7f4dc2ffd640 1 --2- 172.21.15.5:0/2313571510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.644+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2313571510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 msgr2=0x7f4dc40ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.644+0000 7f4dc37fe640 1 --2- 172.21.15.5:0/2313571510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.644+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2313571510 >> v1:172.21.15.80:6789/0 conn(0x7f4dc40cbf40 legacy=0x7f4dc40d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.644+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2313571510 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc406c010 con 0x7f4dc40b0a50 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.644+0000 7f4dc37fe640 1 --2- 172.21.15.5:0/2313571510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc40ce200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009870 tx=0x7f4db402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01fed337f9f515c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc27fc640 1 -- 172.21.15.5:0/2313571510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4037070 con 0x7f4dc40b0a50 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc27fc640 1 -- 172.21.15.5:0/2313571510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4032440 con 0x7f4dc40b0a50 2024-04-25T08:57:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc27fc640 1 -- 172.21.15.5:0/2313571510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4032810 con 0x7f4dc40b0a50 2024-04-25T08:57:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2313571510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 msgr2=0x7f4dc40ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2313571510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc40ce200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009870 tx=0x7f4db402a1c0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2313571510 shutdown_connections 2024-04-25T08:57:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2313571510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2313571510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc40ce200 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2313571510 >> 172.21.15.5:0/2313571510 conn(0x7f4dc40d18f0 msgr2=0x7f4dc40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2313571510 shutdown_connections 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.645+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2313571510 wait complete. 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.646+0000 7f4dc9b3b640 1 Processor -- start 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc9b3b640 1 -- start start 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc9b3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc9b3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc9b3b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc40cbf40 0x7f4dc40b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc9b3b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40b2bf0 con 0x7f4dc40b0a50 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc9b3b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40cfd60 con 0x7f4dc40cbf40 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc9b3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c9a30 con 0x7f4dc40b0e30 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc415c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50086/0 (socket says 172.21.15.5:50086) 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.647+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2030579549 learned_addr learned my addr 172.21.15.5:0/2030579549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc2ffd640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc3fff640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc40cbf40 0x7f4dc40b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 msgr2=0x7f4dc40b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc37fe640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc40cbf40 msgr2=0x7f4dc40b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc37fe640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc40cbf40 0x7f4dc40b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc37fe640 1 -- 172.21.15.5:0/2030579549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40c9420 con 0x7f4dc40b0a50 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc2ffd640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc3fff640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc40cbf40 0x7f4dc40b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc37fe640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc415c0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4db4000c00 tx=0x7f4db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dabfff640 1 -- 172.21.15.5:0/2030579549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4037040 con 0x7f4dc40b0a50 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dabfff640 1 -- 172.21.15.5:0/2030579549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4042070 con 0x7f4dc40b0a50 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dabfff640 1 -- 172.21.15.5:0/2030579549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4030880 con 0x7f4dc40b0a50 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc40b4e50 con 0x7f4dc40b0a50 2024-04-25T08:57:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.648+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40c96c0 con 0x7f4dc40b0a50 2024-04-25T08:57:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.649+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc406cd70 con 0x7f4dc40b0a50 2024-04-25T08:57:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.649+0000 7f4dabfff640 1 -- 172.21.15.5:0/2030579549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4db402ad10 con 0x7f4dc40b0a50 2024-04-25T08:57:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.650+0000 7f4dabfff640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4db006b4d0 0x7f4db006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.650+0000 7f4dabfff640 1 -- 172.21.15.5:0/2030579549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4db40aa7b0 con 0x7f4dc40b0a50 2024-04-25T08:57:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.650+0000 7f4dc2ffd640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4db006b4d0 0x7f4db006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.651+0000 7f4dc2ffd640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4db006b4d0 0x7f4db006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40c7ee0 tx=0x7f4db8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.654+0000 7f4dabfff640 1 -- 172.21.15.5:0/2030579549 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4db4079750 con 0x7f4dc40b0a50 2024-04-25T08:57:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.836+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dc404ef20 con 0x7f4dc40b0a50 2024-04-25T08:57:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.837+0000 7f4dabfff640 1 -- 172.21.15.5:0/2030579549 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f4db4079050 con 0x7f4dc40b0a50 2024-04-25T08:57:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:07.826 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4db006b4d0 msgr2=0x7f4db006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4db006b4d0 0x7f4db006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40c7ee0 tx=0x7f4db8008040 comp rx=0 tx=0).stop 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 msgr2=0x7f4dc415c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc415c0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4db4000c00 tx=0x7f4db40046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 shutdown_connections 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4db006b4d0 0x7f4db006d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc40cbf40 0x7f4dc40b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4dc40b0e30 0x7f4dc40b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 --2- 172.21.15.5:0/2030579549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dc40b0a50 0x7f4dc415c0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 >> 172.21.15.5:0/2030579549 conn(0x7f4dc40d18f0 msgr2=0x7f4dc40b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 shutdown_connections 2024-04-25T08:57:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.839+0000 7f4dc9b3b640 1 -- 172.21.15.5:0/2030579549 wait complete. 2024-04-25T08:57:07.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:07.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:07.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.954+0000 7f57d8d5c640 1 Processor -- start 2024-04-25T08:57:07.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.954+0000 7f57d8d5c640 1 -- start start 2024-04-25T08:57:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d8d5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d41614b0 0x7f57d40b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d8d5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57d40d1f60 0x7f57d40d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d8d5c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d40d2740 con 0x7f57d40d4060 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d8d5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d40d2a20 con 0x7f57d40d1f60 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d8d5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40d2d00 con 0x7f57d41614b0 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d1d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57d40d1f60 0x7f57d40d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d2d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f57d40d4060 0x7f57d40b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40330/0 (socket says 172.21.15.5:40330) 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d1d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57d40d1f60 0x7f57d40d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50088/0 (socket says 172.21.15.5:50088) 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d2d9d640 1 -- 172.21.15.5:0/1770084907 learned_addr learned my addr 172.21.15.5:0/1770084907 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d259c640 1 --2- 172.21.15.5:0/1770084907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d41614b0 0x7f57d40b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d1d9b640 1 -- 172.21.15.5:0/1770084907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d41614b0 msgr2=0x7f57d40b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d1d9b640 1 --2- 172.21.15.5:0/1770084907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d41614b0 0x7f57d40b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d1d9b640 1 -- 172.21.15.5:0/1770084907 >> v1:172.21.15.5:6789/0 conn(0x7f57d40d4060 legacy=0x7f57d40b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.955+0000 7f57d159a640 1 -- 172.21.15.5:0/1770084907 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789939012 0 0) 0x7f57d40d2740 con 0x7f57d40d4060 2024-04-25T08:57:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.956+0000 7f57d1d9b640 1 -- 172.21.15.5:0/1770084907 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d40d2fe0 con 0x7f57d40d1f60 2024-04-25T08:57:07.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.956+0000 7f57d1d9b640 1 --2- 172.21.15.5:0/1770084907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d40d1f60 0x7f57d40d3b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57c80097a0 tx=0x7f57c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf4064b67c5d812 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.956+0000 7f57d159a640 1 -- 172.21.15.5:0/1770084907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8037070 con 0x7f57d40d1f60 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.956+0000 7f57d159a640 1 -- 172.21.15.5:0/1770084907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8032440 con 0x7f57d40d1f60 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.956+0000 7f57d159a640 1 -- 172.21.15.5:0/1770084907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8032810 con 0x7f57d40d1f60 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 -- 172.21.15.5:0/1770084907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d40d1f60 msgr2=0x7f57d40d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/1770084907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d40d1f60 0x7f57d40d3b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57c80097a0 tx=0x7f57c802a180 comp rx=0 tx=0).stop 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 -- 172.21.15.5:0/1770084907 shutdown_connections 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/1770084907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d40d1f60 0x7f57d40d3b20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/1770084907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d41614b0 0x7f57d40b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 -- 172.21.15.5:0/1770084907 >> 172.21.15.5:0/1770084907 conn(0x7f57d406b000 msgr2=0x7f57d406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 -- 172.21.15.5:0/1770084907 shutdown_connections 2024-04-25T08:57:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.957+0000 7f57d8d5c640 1 -- 172.21.15.5:0/1770084907 wait complete. 2024-04-25T08:57:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.958+0000 7f57d8d5c640 1 Processor -- start 2024-04-25T08:57:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.958+0000 7f57d8d5c640 1 -- start start 2024-04-25T08:57:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d8d5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d40d1f60 0x7f57d41f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d8d5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d40d4060 0x7f57d40b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d8d5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d41614b0 0x7f57d40b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d8d5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40d23a0 con 0x7f57d41614b0 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d8d5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40d37e0 con 0x7f57d40d4060 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d8d5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40d2520 con 0x7f57d40d1f60 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d41614b0 0x7f57d40b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d41614b0 0x7f57d40b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50092/0 (socket says 172.21.15.5:50092) 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d2d9d640 1 -- 172.21.15.5:0/339293427 learned_addr learned my addr 172.21.15.5:0/339293427 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d259c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d40d1f60 0x7f57d41f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d1d9b640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d40d4060 0x7f57d40b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d2d9d640 1 -- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d40d1f60 msgr2=0x7f57d41f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.959+0000 7f57d2d9d640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d40d1f60 0x7f57d41f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57d2d9d640 1 -- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d40d4060 msgr2=0x7f57d40b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57d2d9d640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d40d4060 0x7f57d40b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57d2d9d640 1 -- 172.21.15.5:0/339293427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d41f4690 con 0x7f57d41614b0 2024-04-25T08:57:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57d2d9d640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d41614b0 0x7f57d40b8d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c7a0 tx=0x7f57c400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57c2ffd640 1 -- 172.21.15.5:0/339293427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4018070 con 0x7f57d41614b0 2024-04-25T08:57:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57c2ffd640 1 -- 172.21.15.5:0/339293427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c400a640 con 0x7f57d41614b0 2024-04-25T08:57:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d40ca130 con 0x7f57d41614b0 2024-04-25T08:57:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57c2ffd640 1 -- 172.21.15.5:0/339293427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c400aab0 con 0x7f57d41614b0 2024-04-25T08:57:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.960+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d40c8740 con 0x7f57d41614b0 2024-04-25T08:57:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.961+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d404ef20 con 0x7f57d41614b0 2024-04-25T08:57:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.961+0000 7f57c2ffd640 1 -- 172.21.15.5:0/339293427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57c401b070 con 0x7f57d41614b0 2024-04-25T08:57:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.962+0000 7f57c2ffd640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57b406b500 0x7f57b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.962+0000 7f57c2ffd640 1 -- 172.21.15.5:0/339293427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57c4089760 con 0x7f57d41614b0 2024-04-25T08:57:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.962+0000 7f57d259c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57b406b500 0x7f57b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.962+0000 7f57d259c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57b406b500 0x7f57b406d9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f57cc006fd0 tx=0x7f57cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:07.966+0000 7f57c2ffd640 1 -- 172.21.15.5:0/339293427 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57c4058670 con 0x7f57d41614b0 2024-04-25T08:57:08.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.145+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57d40c8940 con 0x7f57d41614b0 2024-04-25T08:57:08.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.146+0000 7f57c2ffd640 1 -- 172.21.15.5:0/339293427 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57c4057f70 con 0x7f57d41614b0 2024-04-25T08:57:08.135 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57b406b500 msgr2=0x7f57b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57b406b500 0x7f57b406d9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f57cc006fd0 tx=0x7f57cc008040 comp rx=0 tx=0).stop 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d41614b0 msgr2=0x7f57d40b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d41614b0 0x7f57d40b8d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c7a0 tx=0x7f57c400cc60 comp rx=0 tx=0).stop 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 shutdown_connections 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57b406b500 0x7f57b406d9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d41614b0 0x7f57d40b8d20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d40d4060 0x7f57d40b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 --2- 172.21.15.5:0/339293427 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d40d1f60 0x7f57d41f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 >> 172.21.15.5:0/339293427 conn(0x7f57d406b000 msgr2=0x7f57d406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 shutdown_connections 2024-04-25T08:57:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.148+0000 7f57d8d5c640 1 -- 172.21.15.5:0/339293427 wait complete. 2024-04-25T08:57:08.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.263+0000 7fd0a161f640 1 Processor -- start 2024-04-25T08:57:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.263+0000 7fd0a161f640 1 -- start start 2024-04-25T08:57:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd0a161f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd09c15dc00 0x7fd09c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd0a161f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd0a161f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c0b3a00 con 0x7fd09c06abe0 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd0a161f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c067290 con 0x7fd09c15dc00 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd0a161f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c072410 con 0x7fd09c0668f0 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd09affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd09c15dc00 0x7fd09c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd09affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd09c15dc00 0x7fd09c0b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50096/0 (socket says 172.21.15.5:50096) 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd09affd640 1 -- 172.21.15.5:0/2129993908 learned_addr learned my addr 172.21.15.5:0/2129993908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.264+0000 7fd09b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd09c06abe0 0x7fd09c06b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40334/0 (socket says 172.21.15.5:40334) 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd09affd640 1 -- 172.21.15.5:0/2129993908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 msgr2=0x7fd09c066d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd09a7fc640 1 --2- 172.21.15.5:0/2129993908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd09affd640 1 --2- 172.21.15.5:0/2129993908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c066d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd09affd640 1 -- 172.21.15.5:0/2129993908 >> v1:172.21.15.5:6789/0 conn(0x7fd09c06abe0 legacy=0x7fd09c06b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd099ffb640 1 -- 172.21.15.5:0/2129993908 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127062670 0 0) 0x7fd09c0b3a00 con 0x7fd09c06abe0 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd09affd640 1 -- 172.21.15.5:0/2129993908 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0b3ce0 con 0x7fd09c15dc00 2024-04-25T08:57:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd09a7fc640 1 --2- 172.21.15.5:0/2129993908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c066d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd09affd640 1 --2- 172.21.15.5:0/2129993908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c0b5450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd094009870 tx=0x7fd09402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b0c32d6cfa6642 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd099ffb640 1 -- 172.21.15.5:0/2129993908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094037070 con 0x7fd09c15dc00 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd099ffb640 1 -- 172.21.15.5:0/2129993908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd094032440 con 0x7fd09c15dc00 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.265+0000 7fd099ffb640 1 -- 172.21.15.5:0/2129993908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094032810 con 0x7fd09c15dc00 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 -- 172.21.15.5:0/2129993908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 msgr2=0x7fd09c0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 --2- 172.21.15.5:0/2129993908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c0b5450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd094009870 tx=0x7fd09402a270 comp rx=0 tx=0).stop 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 -- 172.21.15.5:0/2129993908 shutdown_connections 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 --2- 172.21.15.5:0/2129993908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c066d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 --2- 172.21.15.5:0/2129993908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c0b5450 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 -- 172.21.15.5:0/2129993908 >> 172.21.15.5:0/2129993908 conn(0x7fd09c0b2560 msgr2=0x7fd09c0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 -- 172.21.15.5:0/2129993908 shutdown_connections 2024-04-25T08:57:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.266+0000 7fd0a161f640 1 -- 172.21.15.5:0/2129993908 wait complete. 2024-04-25T08:57:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.267+0000 7fd0a161f640 1 Processor -- start 2024-04-25T08:57:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.267+0000 7fd0a161f640 1 -- start start 2024-04-25T08:57:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd0a161f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd0a161f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd09c06abe0 0x7fd09c155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd0a161f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd0a161f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c06d450 con 0x7fd09c15dc00 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd0a161f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0af260 con 0x7fd09c06abe0 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd0a161f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c15dfe0 con 0x7fd09c0668f0 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50100/0 (socket says 172.21.15.5:50100) 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09b7fe640 1 -- 172.21.15.5:0/3741427090 learned_addr learned my addr 172.21.15.5:0/3741427090 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09a7fc640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd09c06abe0 0x7fd09c155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09affd640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09b7fe640 1 -- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 msgr2=0x7fd09c151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09b7fe640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09b7fe640 1 -- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd09c06abe0 msgr2=0x7fd09c155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.268+0000 7fd09b7fe640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd09c06abe0 0x7fd09c155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd09b7fe640 1 -- 172.21.15.5:0/3741427090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c153130 con 0x7fd09c15dc00 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd09a7fc640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd09c06abe0 0x7fd09c155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd09b7fe640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c156e30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00c7a0 tx=0x7fd08c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd0937fe640 1 -- 172.21.15.5:0/3741427090 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c018070 con 0x7fd09c15dc00 2024-04-25T08:57:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd0937fe640 1 -- 172.21.15.5:0/3741427090 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c00a640 con 0x7fd09c15dc00 2024-04-25T08:57:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c156560 con 0x7fd09c15dc00 2024-04-25T08:57:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd0937fe640 1 -- 172.21.15.5:0/3741427090 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00aa70 con 0x7fd09c15dc00 2024-04-25T08:57:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.269+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c1533d0 con 0x7fd09c15dc00 2024-04-25T08:57:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.270+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c04ef20 con 0x7fd09c15dc00 2024-04-25T08:57:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.270+0000 7fd0937fe640 1 -- 172.21.15.5:0/3741427090 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd08c01b070 con 0x7fd09c15dc00 2024-04-25T08:57:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.271+0000 7fd0937fe640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd07c06b4d0 0x7fd07c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.271+0000 7fd0937fe640 1 -- 172.21.15.5:0/3741427090 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd08c0897b0 con 0x7fd09c15dc00 2024-04-25T08:57:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.271+0000 7fd09affd640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd07c06b4d0 0x7fd07c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.272+0000 7fd09affd640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd07c06b4d0 0x7fd07c06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd094034000 tx=0x7fd09402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.275+0000 7fd0937fe640 1 -- 172.21.15.5:0/3741427090 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd08c058630 con 0x7fd09c15dc00 2024-04-25T08:57:08.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.456+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd09c06ead0 con 0x7fd09c15dc00 2024-04-25T08:57:08.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.457+0000 7fd0937fe640 1 -- 172.21.15.5:0/3741427090 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd08c057f30 con 0x7fd09c15dc00 2024-04-25T08:57:08.445 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd07c06b4d0 msgr2=0x7fd07c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd07c06b4d0 0x7fd07c06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd094034000 tx=0x7fd09402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 msgr2=0x7fd09c156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c156e30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00c7a0 tx=0x7fd08c00cc60 comp rx=0 tx=0).stop 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 shutdown_connections 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd07c06b4d0 0x7fd07c06d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c15dc00 0x7fd09c156e30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd09c06abe0 0x7fd09c155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 --2- 172.21.15.5:0/3741427090 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd09c0668f0 0x7fd09c151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.458+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 >> 172.21.15.5:0/3741427090 conn(0x7fd09c0b2560 msgr2=0x7fd09c0aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.459+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 shutdown_connections 2024-04-25T08:57:08.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.459+0000 7fd0a161f640 1 -- 172.21.15.5:0/3741427090 wait complete. 2024-04-25T08:57:08.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.573+0000 7f53165e0640 1 Processor -- start 2024-04-25T08:57:08.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.573+0000 7f53165e0640 1 -- start start 2024-04-25T08:57:08.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.573+0000 7f53165e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53101614b0 0x7f53100b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.573+0000 7f53165e0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53100d1f60 0x7f53100d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.573+0000 7f53165e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53100d2740 con 0x7f53100d4060 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.573+0000 7f53165e0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53100d44b0 con 0x7f53100d1f60 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.573+0000 7f53165e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53100d2a20 con 0x7f53101614b0 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53100d1f60 0x7f53100d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53100d1f60 0x7f53100d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50114/0 (socket says 172.21.15.5:50114) 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530f7fe640 1 -- 172.21.15.5:0/2864052116 learned_addr learned my addr 172.21.15.5:0/2864052116 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530ffff640 1 --2- 172.21.15.5:0/2864052116 >> v2:172.21.15.80:3300/0 conn(0x7f53101614b0 0x7f53100b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530f7fe640 1 -- 172.21.15.5:0/2864052116 >> v2:172.21.15.80:3300/0 conn(0x7f53101614b0 msgr2=0x7f53100b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530f7fe640 1 --2- 172.21.15.5:0/2864052116 >> v2:172.21.15.80:3300/0 conn(0x7f53101614b0 0x7f53100b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530f7fe640 1 -- 172.21.15.5:0/2864052116 >> v1:172.21.15.80:6789/0 conn(0x7f53100d4060 legacy=0x7f53100b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.574+0000 7f530f7fe640 1 -- 172.21.15.5:0/2864052116 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100d2d00 con 0x7f53100d1f60 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f530f7fe640 1 --2- 172.21.15.5:0/2864052116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d1f60 0x7f53100d3b20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f531008ca90 tx=0x7f530402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c546da62c83ee2d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f530effd640 1 -- 172.21.15.5:0/2864052116 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304037070 con 0x7f53100d1f60 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f530effd640 1 -- 172.21.15.5:0/2864052116 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304032440 con 0x7f53100d1f60 2024-04-25T08:57:08.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f530effd640 1 -- 172.21.15.5:0/2864052116 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304032810 con 0x7f53100d1f60 2024-04-25T08:57:08.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 -- 172.21.15.5:0/2864052116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d1f60 msgr2=0x7f53100d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 --2- 172.21.15.5:0/2864052116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d1f60 0x7f53100d3b20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f531008ca90 tx=0x7f530402a230 comp rx=0 tx=0).stop 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 -- 172.21.15.5:0/2864052116 shutdown_connections 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 --2- 172.21.15.5:0/2864052116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d1f60 0x7f53100d3b20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 --2- 172.21.15.5:0/2864052116 >> v2:172.21.15.80:3300/0 conn(0x7f53101614b0 0x7f53100b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 -- 172.21.15.5:0/2864052116 >> 172.21.15.5:0/2864052116 conn(0x7f531006b000 msgr2=0x7f531006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 -- 172.21.15.5:0/2864052116 shutdown_connections 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.575+0000 7f53165e0640 1 -- 172.21.15.5:0/2864052116 wait complete. 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.576+0000 7f53165e0640 1 Processor -- start 2024-04-25T08:57:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f53165e0640 1 -- start start 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f53165e0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53100d1f60 0x7f531015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f53165e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d4060 0x7f5310152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f53165e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53101614b0 0x7f53101574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f53165e0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53100d37e0 con 0x7f53100d4060 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f53165e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53100d32c0 con 0x7f53101614b0 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f53165e0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53100d23a0 con 0x7f53100d1f60 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.577+0000 7f530f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d4060 0x7f5310152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d4060 0x7f5310152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50118/0 (socket says 172.21.15.5:50118) 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 -- 172.21.15.5:0/2872245337 learned_addr learned my addr 172.21.15.5:0/2872245337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530ffff640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53100d1f60 0x7f531015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f5314b7d640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53101614b0 0x7f53101574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 -- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53100d1f60 msgr2=0x7f531015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53100d1f60 0x7f531015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 -- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53101614b0 msgr2=0x7f53101574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53101614b0 0x7f53101574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 -- 172.21.15.5:0/2872245337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531015b780 con 0x7f53100d4060 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530ffff640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53100d1f60 0x7f531015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530f7fe640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d4060 0x7f5310152d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5304000c00 tx=0x7f53040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530cff9640 1 -- 172.21.15.5:0/2872245337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304041020 con 0x7f53100d4060 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530cff9640 1 -- 172.21.15.5:0/2872245337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040306c0 con 0x7f53100d4060 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5310155b20 con 0x7f53100d4060 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f530cff9640 1 -- 172.21.15.5:0/2872245337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304037040 con 0x7f53100d4060 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.578+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53100b4360 con 0x7f53100d4060 2024-04-25T08:57:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.579+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531004ef20 con 0x7f53100d4060 2024-04-25T08:57:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.580+0000 7f530cff9640 1 -- 172.21.15.5:0/2872245337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5304044020 con 0x7f53100d4060 2024-04-25T08:57:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.580+0000 7f530cff9640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52fc06b4d0 0x7f52fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.580+0000 7f530cff9640 1 -- 172.21.15.5:0/2872245337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53040aa680 con 0x7f53100d4060 2024-04-25T08:57:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.580+0000 7f530ffff640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52fc06b4d0 0x7f52fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.581+0000 7f530ffff640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52fc06b4d0 0x7f52fc06d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5300006fd0 tx=0x7f5300008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.584+0000 7f530cff9640 1 -- 172.21.15.5:0/2872245337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f530404b070 con 0x7f53100d4060 2024-04-25T08:57:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.763+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f531015f870 con 0x7f53100d4060 2024-04-25T08:57:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.763+0000 7f530cff9640 1 -- 172.21.15.5:0/2872245337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5304079590 con 0x7f53100d4060 2024-04-25T08:57:08.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52fc06b4d0 msgr2=0x7f52fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52fc06b4d0 0x7f52fc06d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5300006fd0 tx=0x7f5300008040 comp rx=0 tx=0).stop 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d4060 msgr2=0x7f5310152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d4060 0x7f5310152d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5304000c00 tx=0x7f53040046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 shutdown_connections 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52fc06b4d0 0x7f52fc06d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53101614b0 0x7f53101574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53100d4060 0x7f5310152d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 --2- 172.21.15.5:0/2872245337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53100d1f60 0x7f531015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 >> 172.21.15.5:0/2872245337 conn(0x7f531006b000 msgr2=0x7f5310160430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 shutdown_connections 2024-04-25T08:57:08.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.765+0000 7f53165e0640 1 -- 172.21.15.5:0/2872245337 wait complete. 2024-04-25T08:57:08.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.877+0000 7f0d0b35c640 1 Processor -- start 2024-04-25T08:57:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.877+0000 7f0d0b35c640 1 -- start start 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.878+0000 7f0d0b35c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d0406bd00 0x7f0d040d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.878+0000 7f0d0b35c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0415ef10 con 0x7f0d040cea80 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.878+0000 7f0d0b35c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0415ff50 con 0x7f0d0406adf0 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.878+0000 7f0d0b35c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d040cfd60 con 0x7f0d0406bd00 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.878+0000 7f0d090f8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0d040cea80 0x7f0d0415f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40340/0 (socket says 172.21.15.5:40340) 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.878+0000 7f0d090f8640 1 -- 172.21.15.5:0/3566761122 learned_addr learned my addr 172.21.15.5:0/3566761122 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.878+0000 7f0d098f9640 1 --2- 172.21.15.5:0/3566761122 >> v2:172.21.15.80:3300/0 conn(0x7f0d0406bd00 0x7f0d040d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696865231 0 0) 0x7f0d0415ef10 con 0x7f0d040cea80 2024-04-25T08:57:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cec003520 con 0x7f0d040cea80 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4108477813 0 0) 0x7f0cec003520 con 0x7f0d040cea80 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 >> v2:172.21.15.80:3300/0 conn(0x7f0d0406bd00 msgr2=0x7f0d040d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 --2- 172.21.15.5:0/3566761122 >> v2:172.21.15.80:3300/0 conn(0x7f0d0406bd00 0x7f0d040d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 >> v1:172.21.15.80:6789/0 conn(0x7f0d0406adf0 legacy=0x7f0d0406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0415f1a0 con 0x7f0d040cea80 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f0cf40019f0 con 0x7f0d040cea80 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 >> v1:172.21.15.5:6789/0 conn(0x7f0d040cea80 legacy=0x7f0d0415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cec0039b0 0x7f0cec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec004800 0x7f0cec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cec0051c0 0x7f0cec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec00c030 con 0x7f0cec0051c0 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec00c1e0 con 0x7f0cec0039b0 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec00c3e0 con 0x7f0cec004800 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d098f9640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cec0051c0 0x7f0cec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d090f8640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cec0039b0 0x7f0cec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d088f7640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec004800 0x7f0cec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d098f9640 1 -- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec004800 msgr2=0x7f0cec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d098f9640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec004800 0x7f0cec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d098f9640 1 -- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cec0039b0 msgr2=0x7f0cec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d098f9640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cec0039b0 0x7f0cec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.879+0000 7f0d098f9640 1 -- 172.21.15.5:0/3566761122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec003520 con 0x7f0cec0051c0 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.880+0000 7f0d098f9640 1 -- 172.21.15.5:0/3566761122 reap_dead start 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.880+0000 7f0d098f9640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cec0051c0 0x7f0cec00b9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009ac0 tx=0x7f0cec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809610d475ffa8b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.880+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc009690 con 0x7f0cec0051c0 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.880+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc004020 con 0x7f0cec0051c0 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.880+0000 7f0d03fff640 1 -- 172.21.15.5:0/3566761122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc004410 con 0x7f0cec0051c0 2024-04-25T08:57:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.881+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3566761122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cec0051c0 msgr2=0x7f0cec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.881+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cec0051c0 0x7f0cec00b9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009ac0 tx=0x7f0cec005830 comp rx=0 tx=0).stop 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.881+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3566761122 shutdown_connections 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.881+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3566761122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cec0051c0 0x7f0cec00b9c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.881+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3566761122 >> 172.21.15.5:0/3566761122 conn(0x7f0d040d19f0 msgr2=0x7f0d040d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.881+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3566761122 shutdown_connections 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.881+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3566761122 wait complete. 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.882+0000 7f0d0b35c640 1 Processor -- start 2024-04-25T08:57:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.882+0000 7f0d0b35c640 1 -- start start 2024-04-25T08:57:08.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d0b35c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec0051c0 0x7f0d040c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d0b35c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040b1810 0x7f0d040c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d0b35c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d040c6e50 0x7f0d040c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d0b35c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040d0270 con 0x7f0d040b1810 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d0b35c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0415f480 con 0x7f0d040c6e50 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d0b35c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040d1660 con 0x7f0cec0051c0 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040b1810 0x7f0d040c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040b1810 0x7f0d040c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50140/0 (socket says 172.21.15.5:50140) 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 -- 172.21.15.5:0/3156521099 learned_addr learned my addr 172.21.15.5:0/3156521099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d098f9640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d040c6e50 0x7f0d040c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d090f8640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec0051c0 0x7f0d040c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 -- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec0051c0 msgr2=0x7f0d040c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec0051c0 0x7f0d040c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 -- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d040c6e50 msgr2=0x7f0d040c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d040c6e50 0x7f0d040c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 -- 172.21.15.5:0/3156521099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d040c7840 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d098f9640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d040c6e50 0x7f0d040c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d090f8640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec0051c0 0x7f0d040c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.883+0000 7f0d088f7640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040b1810 0x7f0d040c6910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800f620 tx=0x7f0cf800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.884+0000 7f0d01ffb640 1 -- 172.21.15.5:0/3156521099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80052e0 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.884+0000 7f0d01ffb640 1 -- 172.21.15.5:0/3156521099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8018070 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.884+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d040b1d40 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.884+0000 7f0d01ffb640 1 -- 172.21.15.5:0/3156521099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8003810 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.884+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d040b2300 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.885+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0404ef20 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.885+0000 7f0d01ffb640 1 -- 172.21.15.5:0/3156521099 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cf80039b0 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.885+0000 7f0d01ffb640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0cf006b4d0 0x7f0cf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.886+0000 7f0d01ffb640 1 -- 172.21.15.5:0/3156521099 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cf8089f20 con 0x7f0d040b1810 2024-04-25T08:57:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.886+0000 7f0d090f8640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0cf006b4d0 0x7f0cf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.886+0000 7f0d090f8640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0cf006b4d0 0x7f0cf006d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4001330 tx=0x7f0cf4006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:08.890+0000 7f0d01ffb640 1 -- 172.21.15.5:0/3156521099 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d040c7840 con 0x7f0d040b1810 2024-04-25T08:57:09.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.070+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d040cefa0 con 0x7f0d040b1810 2024-04-25T08:57:09.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.071+0000 7f0d01ffb640 1 -- 172.21.15.5:0/3156521099 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f0cf8058e30 con 0x7f0d040b1810 2024-04-25T08:57:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:09.061 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0cf006b4d0 msgr2=0x7f0cf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0cf006b4d0 0x7f0cf006d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4001330 tx=0x7f0cf4006040 comp rx=0 tx=0).stop 2024-04-25T08:57:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040b1810 msgr2=0x7f0d040c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040b1810 0x7f0d040c6910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800f620 tx=0x7f0cf800fae0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 shutdown_connections 2024-04-25T08:57:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0cf006b4d0 0x7f0cf006d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d040c6e50 0x7f0d040c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040b1810 0x7f0d040c6910 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 --2- 172.21.15.5:0/3156521099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cec0051c0 0x7f0d040c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 >> 172.21.15.5:0/3156521099 conn(0x7f0d040d19f0 msgr2=0x7f0d040b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 shutdown_connections 2024-04-25T08:57:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.073+0000 7f0d0b35c640 1 -- 172.21.15.5:0/3156521099 wait complete. 2024-04-25T08:57:09.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:09.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:09.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.189+0000 7efcaaab3640 1 Processor -- start 2024-04-25T08:57:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.189+0000 7efcaaab3640 1 -- start start 2024-04-25T08:57:09.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efcaaab3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efca415df10 0x7efca41618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efcaaab3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efca40cefe0 0x7efca40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efcaaab3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca4162150 con 0x7efca40b6250 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efcaaab3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40d20d0 con 0x7efca415df10 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efcaaab3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca4162430 con 0x7efca40cefe0 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efca884f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efca415df10 0x7efca41618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efca3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efca40b6250 0x7efca40ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40348/0 (socket says 172.21.15.5:40348) 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efca3fff640 1 -- 172.21.15.5:0/2605227029 learned_addr learned my addr 172.21.15.5:0/2605227029 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.190+0000 7efca884f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efca415df10 0x7efca41618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50154/0 (socket says 172.21.15.5:50154) 2024-04-25T08:57:09.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca884f640 1 -- 172.21.15.5:0/2605227029 >> v2:172.21.15.80:3300/0 conn(0x7efca40cefe0 msgr2=0x7efca40d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca9050640 1 --2- 172.21.15.5:0/2605227029 >> v2:172.21.15.80:3300/0 conn(0x7efca40cefe0 0x7efca40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca37fe640 1 -- 172.21.15.5:0/2605227029 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276023441 0 0) 0x7efca4162150 con 0x7efca40b6250 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca884f640 1 --2- 172.21.15.5:0/2605227029 >> v2:172.21.15.80:3300/0 conn(0x7efca40cefe0 0x7efca40d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca884f640 1 -- 172.21.15.5:0/2605227029 >> v1:172.21.15.5:6789/0 conn(0x7efca40b6250 legacy=0x7efca40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca884f640 1 -- 172.21.15.5:0/2605227029 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4162710 con 0x7efca415df10 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca9050640 1 --2- 172.21.15.5:0/2605227029 >> v2:172.21.15.80:3300/0 conn(0x7efca40cefe0 0x7efca40d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca884f640 1 --2- 172.21.15.5:0/2605227029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca415df10 0x7efca41618d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efca40b3610 tx=0x7efc9402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f1c0456f48efed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca37fe640 1 -- 172.21.15.5:0/2605227029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94037070 con 0x7efca415df10 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca37fe640 1 -- 172.21.15.5:0/2605227029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94032440 con 0x7efca415df10 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.191+0000 7efca37fe640 1 -- 172.21.15.5:0/2605227029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94032810 con 0x7efca415df10 2024-04-25T08:57:09.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 -- 172.21.15.5:0/2605227029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca415df10 msgr2=0x7efca41618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2605227029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca415df10 0x7efca41618d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efca40b3610 tx=0x7efc9402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 -- 172.21.15.5:0/2605227029 shutdown_connections 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2605227029 >> v2:172.21.15.80:3300/0 conn(0x7efca40cefe0 0x7efca40d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2605227029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca415df10 0x7efca41618d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 -- 172.21.15.5:0/2605227029 >> 172.21.15.5:0/2605227029 conn(0x7efca40668f0 msgr2=0x7efca4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 -- 172.21.15.5:0/2605227029 shutdown_connections 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.192+0000 7efcaaab3640 1 -- 172.21.15.5:0/2605227029 wait complete. 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.193+0000 7efcaaab3640 1 Processor -- start 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.193+0000 7efcaaab3640 1 -- start start 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efcaaab3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca40b6250 0x7efca41e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efcaaab3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca40cefe0 0x7efca415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efcaaab3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efca415df10 0x7efca415fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efcaaab3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40d2aa0 con 0x7efca40b6250 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efcaaab3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca4161e10 con 0x7efca40cefe0 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efcaaab3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40d2c20 con 0x7efca415df10 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca884f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca40b6250 0x7efca41e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca884f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca40b6250 0x7efca41e8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50164/0 (socket says 172.21.15.5:50164) 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca884f640 1 -- 172.21.15.5:0/2325082598 learned_addr learned my addr 172.21.15.5:0/2325082598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca9050640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efca415df10 0x7efca415fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca3fff640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca40cefe0 0x7efca415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca884f640 1 -- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efca415df10 msgr2=0x7efca415fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca884f640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efca415df10 0x7efca415fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca884f640 1 -- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca40cefe0 msgr2=0x7efca415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.194+0000 7efca884f640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca40cefe0 0x7efca415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efca884f640 1 -- 172.21.15.5:0/2325082598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca415ed70 con 0x7efca40b6250 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efca3fff640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca40cefe0 0x7efca415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efca884f640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca40b6250 0x7efca41e8df0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efca17fa640 1 -- 172.21.15.5:0/2325082598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94037040 con 0x7efca40b6250 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efca17fa640 1 -- 172.21.15.5:0/2325082598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94042070 con 0x7efca40b6250 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca415f050 con 0x7efca40b6250 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efca17fa640 1 -- 172.21.15.5:0/2325082598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94030bd0 con 0x7efca40b6250 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.195+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca415f8f0 con 0x7efca40b6250 2024-04-25T08:57:09.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.196+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca404ef20 con 0x7efca40b6250 2024-04-25T08:57:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.196+0000 7efca17fa640 1 -- 172.21.15.5:0/2325082598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc94047460 con 0x7efca40b6250 2024-04-25T08:57:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.197+0000 7efca17fa640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc9006b4d0 0x7efc9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.197+0000 7efca17fa640 1 -- 172.21.15.5:0/2325082598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc940aae60 con 0x7efca40b6250 2024-04-25T08:57:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.197+0000 7efca3fff640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc9006b4d0 0x7efc9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.198+0000 7efca3fff640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc9006b4d0 0x7efc9006d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efca4149aa0 tx=0x7efc98007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.201+0000 7efca17fa640 1 -- 172.21.15.5:0/2325082598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc94032e20 con 0x7efca40b6250 2024-04-25T08:57:09.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.385+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efca415f220 con 0x7efca40b6250 2024-04-25T08:57:09.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.385+0000 7efca17fa640 1 -- 172.21.15.5:0/2325082598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc94079ce0 con 0x7efca40b6250 2024-04-25T08:57:09.374 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc9006b4d0 msgr2=0x7efc9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc9006b4d0 0x7efc9006d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efca4149aa0 tx=0x7efc98007c10 comp rx=0 tx=0).stop 2024-04-25T08:57:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca40b6250 msgr2=0x7efca41e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca40b6250 0x7efca41e8df0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc940046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 shutdown_connections 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc9006b4d0 0x7efc9006d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efca415df10 0x7efca415fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca40cefe0 0x7efca415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 --2- 172.21.15.5:0/2325082598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca40b6250 0x7efca41e8df0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 >> 172.21.15.5:0/2325082598 conn(0x7efca40668f0 msgr2=0x7efca40b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 shutdown_connections 2024-04-25T08:57:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.387+0000 7efcaaab3640 1 -- 172.21.15.5:0/2325082598 wait complete. 2024-04-25T08:57:09.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.502+0000 7faf6c807640 1 Processor -- start 2024-04-25T08:57:09.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.502+0000 7faf6c807640 1 -- start start 2024-04-25T08:57:09.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.502+0000 7faf6c807640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf6815df10 0x7faf681618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.502+0000 7faf6c807640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf680cefe0 0x7faf680d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.502+0000 7faf6c807640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf68162150 con 0x7faf680b6250 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.502+0000 7faf6c807640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680d20d0 con 0x7faf680cefe0 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.502+0000 7faf6c807640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf68162430 con 0x7faf6815df10 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf66d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf680cefe0 0x7faf680d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf5dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf680b6250 0x7faf680ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40362/0 (socket says 172.21.15.5:40362) 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf66d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf680cefe0 0x7faf680d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50176/0 (socket says 172.21.15.5:50176) 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf5dd9b640 1 -- 172.21.15.5:0/151555915 learned_addr learned my addr 172.21.15.5:0/151555915 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf6659c640 1 --2- 172.21.15.5:0/151555915 >> v2:172.21.15.80:3300/0 conn(0x7faf6815df10 0x7faf681618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf66d9d640 1 -- 172.21.15.5:0/151555915 >> v2:172.21.15.80:3300/0 conn(0x7faf6815df10 msgr2=0x7faf681618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf66d9d640 1 --2- 172.21.15.5:0/151555915 >> v2:172.21.15.80:3300/0 conn(0x7faf6815df10 0x7faf681618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf66d9d640 1 -- 172.21.15.5:0/151555915 >> v1:172.21.15.5:6789/0 conn(0x7faf680b6250 legacy=0x7faf680ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf66d9d640 1 -- 172.21.15.5:0/151555915 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68162710 con 0x7faf680cefe0 2024-04-25T08:57:09.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.503+0000 7faf65d9b640 1 -- 172.21.15.5:0/151555915 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833494551 0 0) 0x7faf68162150 con 0x7faf680b6250 2024-04-25T08:57:09.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf66d9d640 1 --2- 172.21.15.5:0/151555915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf680cefe0 0x7faf680d2560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf68075080 tx=0x7faf6002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13089346e3d83cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf65d9b640 1 -- 172.21.15.5:0/151555915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60007740 con 0x7faf680cefe0 2024-04-25T08:57:09.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf65d9b640 1 -- 172.21.15.5:0/151555915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf600078e0 con 0x7faf680cefe0 2024-04-25T08:57:09.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf65d9b640 1 -- 172.21.15.5:0/151555915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60007cb0 con 0x7faf680cefe0 2024-04-25T08:57:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 -- 172.21.15.5:0/151555915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf680cefe0 msgr2=0x7faf680d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 --2- 172.21.15.5:0/151555915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf680cefe0 0x7faf680d2560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf68075080 tx=0x7faf6002a680 comp rx=0 tx=0).stop 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 -- 172.21.15.5:0/151555915 shutdown_connections 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 --2- 172.21.15.5:0/151555915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf680cefe0 0x7faf680d2560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 --2- 172.21.15.5:0/151555915 >> v2:172.21.15.80:3300/0 conn(0x7faf6815df10 0x7faf681618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 -- 172.21.15.5:0/151555915 >> 172.21.15.5:0/151555915 conn(0x7faf680668f0 msgr2=0x7faf68066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 -- 172.21.15.5:0/151555915 shutdown_connections 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.504+0000 7faf6c807640 1 -- 172.21.15.5:0/151555915 wait complete. 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.506+0000 7faf6c807640 1 Processor -- start 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.506+0000 7faf6c807640 1 -- start start 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6c807640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf680b6250 0x7faf6814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6c807640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf680cefe0 0x7faf68160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6c807640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf6815df10 0x7faf680cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6c807640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680d2aa0 con 0x7faf6815df10 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6c807640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68161e10 con 0x7faf680b6250 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6c807640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680d2c20 con 0x7faf680cefe0 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf6815df10 0x7faf680cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf6815df10 0x7faf680cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50192/0 (socket says 172.21.15.5:50192) 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 -- 172.21.15.5:0/2590104643 learned_addr learned my addr 172.21.15.5:0/2590104643 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6659c640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf680b6250 0x7faf6814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf5dd9b640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf680cefe0 0x7faf68160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 -- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf680cefe0 msgr2=0x7faf68160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf680cefe0 0x7faf68160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 -- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf680b6250 msgr2=0x7faf6814d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf680b6250 0x7faf6814d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 -- 172.21.15.5:0/2590104643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6815a6e0 con 0x7faf6815df10 2024-04-25T08:57:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf66d9d640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf6815df10 0x7faf680cc390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faf60009e50 tx=0x7faf60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf5f7fe640 1 -- 172.21.15.5:0/2590104643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60040070 con 0x7faf6815df10 2024-04-25T08:57:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf5f7fe640 1 -- 172.21.15.5:0/2590104643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf60031bf0 con 0x7faf6815df10 2024-04-25T08:57:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf5f7fe640 1 -- 172.21.15.5:0/2590104643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60009450 con 0x7faf6815df10 2024-04-25T08:57:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.507+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf680cd160 con 0x7faf6815df10 2024-04-25T08:57:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.508+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf680cd720 con 0x7faf6815df10 2024-04-25T08:57:09.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.508+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6804ef20 con 0x7faf6815df10 2024-04-25T08:57:09.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.509+0000 7faf5f7fe640 1 -- 172.21.15.5:0/2590104643 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf60039040 con 0x7faf6815df10 2024-04-25T08:57:09.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.509+0000 7faf5f7fe640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf4806b4d0 0x7faf4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.509+0000 7faf5f7fe640 1 -- 172.21.15.5:0/2590104643 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf600ab9a0 con 0x7faf6815df10 2024-04-25T08:57:09.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.509+0000 7faf6659c640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf4806b4d0 0x7faf4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.510+0000 7faf6659c640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf4806b4d0 0x7faf4806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf58009aa0 tx=0x7faf58009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.513+0000 7faf5f7fe640 1 -- 172.21.15.5:0/2590104643 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf6007a140 con 0x7faf6815df10 2024-04-25T08:57:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.692+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf680b3be0 con 0x7faf6815df10 2024-04-25T08:57:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.693+0000 7faf5f7fe640 1 -- 172.21.15.5:0/2590104643 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf6007e1e0 con 0x7faf6815df10 2024-04-25T08:57:09.681 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf4806b4d0 msgr2=0x7faf4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf4806b4d0 0x7faf4806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf58009aa0 tx=0x7faf58009190 comp rx=0 tx=0).stop 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf6815df10 msgr2=0x7faf680cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf6815df10 0x7faf680cc390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faf60009e50 tx=0x7faf60004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 shutdown_connections 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf4806b4d0 0x7faf4806d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf6815df10 0x7faf680cc390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf680cefe0 0x7faf68160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 --2- 172.21.15.5:0/2590104643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf680b6250 0x7faf6814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.694+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 >> 172.21.15.5:0/2590104643 conn(0x7faf680668f0 msgr2=0x7faf680b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.695+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 shutdown_connections 2024-04-25T08:57:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.695+0000 7faf6c807640 1 -- 172.21.15.5:0/2590104643 wait complete. 2024-04-25T08:57:09.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:09.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.808+0000 7f204f734640 1 Processor -- start 2024-04-25T08:57:09.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.808+0000 7f204f734640 1 -- start start 2024-04-25T08:57:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204f734640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f204815dc00 0x7f20480b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204f734640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20480668f0 0x7f2048066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204f734640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480b3a00 con 0x7f204806abe0 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204f734640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2048067290 con 0x7f20480668f0 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204f734640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2048072410 con 0x7f204815dc00 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204cccf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20480668f0 0x7f2048066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204dcd1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f204806abe0 0x7f204806b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40370/0 (socket says 172.21.15.5:40370) 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.809+0000 7f204dcd1640 1 -- 172.21.15.5:0/2299982456 learned_addr learned my addr 172.21.15.5:0/2299982456 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.810+0000 7f204d4d0640 1 --2- 172.21.15.5:0/2299982456 >> v2:172.21.15.80:3300/0 conn(0x7f204815dc00 0x7f20480b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.810+0000 7f204cccf640 1 -- 172.21.15.5:0/2299982456 >> v2:172.21.15.80:3300/0 conn(0x7f204815dc00 msgr2=0x7f20480b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.810+0000 7f204cccf640 1 --2- 172.21.15.5:0/2299982456 >> v2:172.21.15.80:3300/0 conn(0x7f204815dc00 0x7f20480b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.810+0000 7f204cccf640 1 -- 172.21.15.5:0/2299982456 >> v1:172.21.15.5:6789/0 conn(0x7f204806abe0 legacy=0x7f204806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.810+0000 7f2047fff640 1 -- 172.21.15.5:0/2299982456 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666847624 0 0) 0x7f20480b3a00 con 0x7f204806abe0 2024-04-25T08:57:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.810+0000 7f204cccf640 1 -- 172.21.15.5:0/2299982456 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480b3ce0 con 0x7f20480668f0 2024-04-25T08:57:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.810+0000 7f204cccf640 1 --2- 172.21.15.5:0/2299982456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480668f0 0x7f2048066d50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f20480717e0 tx=0x7f203c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18f35885bcdba67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f2047fff640 1 -- 172.21.15.5:0/2299982456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c037070 con 0x7f20480668f0 2024-04-25T08:57:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f2047fff640 1 -- 172.21.15.5:0/2299982456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c032440 con 0x7f20480668f0 2024-04-25T08:57:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f2047fff640 1 -- 172.21.15.5:0/2299982456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c032810 con 0x7f20480668f0 2024-04-25T08:57:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 -- 172.21.15.5:0/2299982456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480668f0 msgr2=0x7f2048066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 --2- 172.21.15.5:0/2299982456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480668f0 0x7f2048066d50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f20480717e0 tx=0x7f203c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 -- 172.21.15.5:0/2299982456 shutdown_connections 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 --2- 172.21.15.5:0/2299982456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480668f0 0x7f2048066d50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 --2- 172.21.15.5:0/2299982456 >> v2:172.21.15.80:3300/0 conn(0x7f204815dc00 0x7f20480b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 -- 172.21.15.5:0/2299982456 >> 172.21.15.5:0/2299982456 conn(0x7f20480b2560 msgr2=0x7f20480b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 -- 172.21.15.5:0/2299982456 shutdown_connections 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.811+0000 7f204f734640 1 -- 172.21.15.5:0/2299982456 wait complete. 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.812+0000 7f204f734640 1 Processor -- start 2024-04-25T08:57:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.812+0000 7f204f734640 1 -- start start 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204f734640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20480668f0 0x7f20480ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204f734640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f204806abe0 0x7f204814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204f734640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f204815dc00 0x7f2048160480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204f734640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204806d450 con 0x7f204815dc00 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204f734640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480af260 con 0x7f20480668f0 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204f734640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204815dfe0 con 0x7f204806abe0 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204dcd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f204815dc00 0x7f2048160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204dcd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f204815dc00 0x7f2048160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50224/0 (socket says 172.21.15.5:50224) 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204dcd1640 1 -- 172.21.15.5:0/2523662439 learned_addr learned my addr 172.21.15.5:0/2523662439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204d4d0640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20480668f0 0x7f20480ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204dcd1640 1 -- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f204806abe0 msgr2=0x7f204814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.813+0000 7f204dcd1640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f204806abe0 0x7f204814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f204dcd1640 1 -- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20480668f0 msgr2=0x7f20480ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f204dcd1640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20480668f0 0x7f20480ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f204dcd1640 1 -- 172.21.15.5:0/2523662439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480cecb0 con 0x7f204815dc00 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f204dcd1640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f204815dc00 0x7f2048160480 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f203800c7e0 tx=0x7f203800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f2045ffb640 1 -- 172.21.15.5:0/2523662439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038018070 con 0x7f204815dc00 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f2045ffb640 1 -- 172.21.15.5:0/2523662439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203800a640 con 0x7f204815dc00 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20480cef90 con 0x7f204815dc00 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f2045ffb640 1 -- 172.21.15.5:0/2523662439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203800aa30 con 0x7f204815dc00 2024-04-25T08:57:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.814+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20480cf550 con 0x7f204815dc00 2024-04-25T08:57:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.815+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204804ef20 con 0x7f204815dc00 2024-04-25T08:57:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.816+0000 7f2045ffb640 1 -- 172.21.15.5:0/2523662439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f203801b070 con 0x7f204815dc00 2024-04-25T08:57:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.816+0000 7f2045ffb640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f203406b4d0 0x7f203406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.816+0000 7f2045ffb640 1 -- 172.21.15.5:0/2523662439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2038089850 con 0x7f204815dc00 2024-04-25T08:57:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.816+0000 7f204d4d0640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f203406b4d0 0x7f203406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.817+0000 7f204d4d0640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f203406b4d0 0x7f203406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2040006fd0 tx=0x7f2040008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:09.820+0000 7f2045ffb640 1 -- 172.21.15.5:0/2523662439 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20380586d0 con 0x7f204815dc00 2024-04-25T08:57:09.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.002+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20480aee10 con 0x7f204815dc00 2024-04-25T08:57:09.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.002+0000 7f2045ffb640 1 -- 172.21.15.5:0/2523662439 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2038057fd0 con 0x7f204815dc00 2024-04-25T08:57:09.991 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:09.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f203406b4d0 msgr2=0x7f203406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f203406b4d0 0x7f203406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2040006fd0 tx=0x7f2040008040 comp rx=0 tx=0).stop 2024-04-25T08:57:09.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f204815dc00 msgr2=0x7f2048160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:09.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f204815dc00 0x7f2048160480 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f203800c7e0 tx=0x7f203800cca0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 shutdown_connections 2024-04-25T08:57:09.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f203406b4d0 0x7f203406d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f204815dc00 0x7f2048160480 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f204806abe0 0x7f204814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 --2- 172.21.15.5:0/2523662439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20480668f0 0x7f20480ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:09.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 >> 172.21.15.5:0/2523662439 conn(0x7f20480b2560 msgr2=0x7f204806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:09.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 shutdown_connections 2024-04-25T08:57:09.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.004+0000 7f204f734640 1 -- 172.21.15.5:0/2523662439 wait complete. 2024-04-25T08:57:10.016 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-04-25T08:57:10.016 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T08:57:10.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:10.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.129+0000 7f545da15640 1 Processor -- start 2024-04-25T08:57:10.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.129+0000 7f545da15640 1 -- start start 2024-04-25T08:57:10.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f545da15640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54580afe80 0x7f54580b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f545da15640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f545806e610 0x7f545806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f545da15640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f5458071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f545da15640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54580b0260 con 0x7f545806e610 2024-04-25T08:57:10.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f545da15640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545806f160 con 0x7f54580afe80 2024-04-25T08:57:10.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f545da15640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580b3820 con 0x7f54580713f0 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f54567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f545806e610 0x7f545806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f54567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f545806e610 0x7f545806ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50234/0 (socket says 172.21.15.5:50234) 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f54567fc640 1 -- 172.21.15.5:0/4293085699 learned_addr learned my addr 172.21.15.5:0/4293085699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f54577fe640 1 --2- 172.21.15.5:0/4293085699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f5458071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.130+0000 7f5456ffd640 1 --2- 172.21.15.5:0/4293085699 >> v2:172.21.15.80:3300/0 conn(0x7f54580afe80 0x7f54580b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.131+0000 7f54567fc640 1 -- 172.21.15.5:0/4293085699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 msgr2=0x7f5458071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.131+0000 7f54567fc640 1 --2- 172.21.15.5:0/4293085699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f5458071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.131+0000 7f54567fc640 1 -- 172.21.15.5:0/4293085699 >> v2:172.21.15.80:3300/0 conn(0x7f54580afe80 msgr2=0x7f54580b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.131+0000 7f54567fc640 1 --2- 172.21.15.5:0/4293085699 >> v2:172.21.15.80:3300/0 conn(0x7f54580afe80 0x7f54580b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.131+0000 7f54567fc640 1 -- 172.21.15.5:0/4293085699 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580b3b00 con 0x7f545806e610 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.131+0000 7f54567fc640 1 --2- 172.21.15.5:0/4293085699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f545806e610 0x7f545806ea50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5458072040 tx=0x7f544802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4370f905ce1717dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.131+0000 7f5455ffb640 1 -- 172.21.15.5:0/4293085699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448037070 con 0x7f545806e610 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f5455ffb640 1 -- 172.21.15.5:0/4293085699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5448032440 con 0x7f545806e610 2024-04-25T08:57:10.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f5455ffb640 1 -- 172.21.15.5:0/4293085699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448032810 con 0x7f545806e610 2024-04-25T08:57:10.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 -- 172.21.15.5:0/4293085699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f545806e610 msgr2=0x7f545806ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 --2- 172.21.15.5:0/4293085699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f545806e610 0x7f545806ea50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5458072040 tx=0x7f544802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 -- 172.21.15.5:0/4293085699 shutdown_connections 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 --2- 172.21.15.5:0/4293085699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f5458071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 --2- 172.21.15.5:0/4293085699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f545806e610 0x7f545806ea50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 --2- 172.21.15.5:0/4293085699 >> v2:172.21.15.80:3300/0 conn(0x7f54580afe80 0x7f54580b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 -- 172.21.15.5:0/4293085699 >> 172.21.15.5:0/4293085699 conn(0x7f54580d0870 msgr2=0x7f54580d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 -- 172.21.15.5:0/4293085699 shutdown_connections 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.132+0000 7f545da15640 1 -- 172.21.15.5:0/4293085699 wait complete. 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.134+0000 7f545da15640 1 Processor -- start 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.134+0000 7f545da15640 1 -- start start 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.134+0000 7f545da15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f545806e610 0x7f54581f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.134+0000 7f545da15640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f54580ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.134+0000 7f545da15640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580afe80 0x7f54580aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f545da15640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545815f2b0 con 0x7f54580afe80 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f545da15640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580b40c0 con 0x7f545806e610 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f545da15640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545806d3f0 con 0x7f54580713f0 2024-04-25T08:57:10.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580afe80 0x7f54580aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580afe80 0x7f54580aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50236/0 (socket says 172.21.15.5:50236) 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 -- 172.21.15.5:0/3252465312 learned_addr learned my addr 172.21.15.5:0/3252465312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54567fc640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f54580ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f5456ffd640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f545806e610 0x7f54581f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 -- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 msgr2=0x7f54580ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f54580ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 -- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f545806e610 msgr2=0x7f54581f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f545806e610 0x7f54581f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 -- 172.21.15.5:0/3252465312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580aa9c0 con 0x7f54580afe80 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f54577fe640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580afe80 0x7f54580aa480 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5450007e40 tx=0x7f545000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f543ffff640 1 -- 172.21.15.5:0/3252465312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450014620 con 0x7f54580afe80 2024-04-25T08:57:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f543ffff640 1 -- 172.21.15.5:0/3252465312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450019070 con 0x7f54580afe80 2024-04-25T08:57:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54580aac70 con 0x7f54580afe80 2024-04-25T08:57:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.135+0000 7f543ffff640 1 -- 172.21.15.5:0/3252465312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450014a20 con 0x7f54580afe80 2024-04-25T08:57:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.136+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54580ab230 con 0x7f54580afe80 2024-04-25T08:57:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.136+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545804ef20 con 0x7f54580afe80 2024-04-25T08:57:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.138+0000 7f543ffff640 1 -- 172.21.15.5:0/3252465312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5450014bc0 con 0x7f54580afe80 2024-04-25T08:57:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.138+0000 7f543ffff640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f544406b4d0 0x7f544406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.138+0000 7f543ffff640 1 -- 172.21.15.5:0/3252465312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f545008ab40 con 0x7f54580afe80 2024-04-25T08:57:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.138+0000 7f5456ffd640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f544406b4d0 0x7f544406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.139+0000 7f5456ffd640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f544406b4d0 0x7f544406d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f544c006fd0 tx=0x7f544c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.143+0000 7f543ffff640 1 -- 172.21.15.5:0/3252465312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54500599c0 con 0x7f54580afe80 2024-04-25T08:57:10.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.328+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54580cc660 con 0x7f54580afe80 2024-04-25T08:57:10.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.329+0000 7f543ffff640 1 -- 172.21.15.5:0/3252465312 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f54500592c0 con 0x7f54580afe80 2024-04-25T08:57:10.318 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:10.319 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f544406b4d0 msgr2=0x7f544406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f544406b4d0 0x7f544406d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f544c006fd0 tx=0x7f544c008040 comp rx=0 tx=0).stop 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580afe80 msgr2=0x7f54580aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580afe80 0x7f54580aa480 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5450007e40 tx=0x7f545000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 shutdown_connections 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f544406b4d0 0x7f544406d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580afe80 0x7f54580aa480 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54580713f0 0x7f54580ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 --2- 172.21.15.5:0/3252465312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f545806e610 0x7f54581f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.331+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 >> 172.21.15.5:0/3252465312 conn(0x7f54580d0870 msgr2=0x7f5458071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.332+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 shutdown_connections 2024-04-25T08:57:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.332+0000 7f545da15640 1 -- 172.21.15.5:0/3252465312 wait complete. 2024-04-25T08:57:10.331 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:10.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.448+0000 7f63d6fd5640 1 Processor -- start 2024-04-25T08:57:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.448+0000 7f63d6fd5640 1 -- start start 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.448+0000 7f63d6fd5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63d00d2dc0 0x7f63d00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.448+0000 7f63d6fd5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00d3720 con 0x7f63d00ce1c0 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.448+0000 7f63d6fd5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d015e260 con 0x7f63d015de80 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.448+0000 7f63d6fd5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00d1ef0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.448+0000 7f63d5572640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63d00d2dc0 0x7f63d00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.449+0000 7f63cffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f63d00ce1c0 0x7f63d00d2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40372/0 (socket says 172.21.15.5:40372) 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.449+0000 7f63cffff640 1 -- 172.21.15.5:0/2915364450 learned_addr learned my addr 172.21.15.5:0/2915364450 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.449+0000 7f63d5572640 1 -- 172.21.15.5:0/2915364450 >> v1:172.21.15.80:6789/0 conn(0x7f63d015de80 legacy=0x7f63d00ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.449+0000 7f63d5572640 1 -- 172.21.15.5:0/2915364450 >> v1:172.21.15.5:6789/0 conn(0x7f63d00ce1c0 legacy=0x7f63d00d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.449+0000 7f63d5572640 1 -- 172.21.15.5:0/2915364450 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00d18c0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d5572640 1 --2- 172.21.15.5:0/2915364450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00d31e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009d90 tx=0x7f63c802a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8a34abaee9a8cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63cf7fe640 1 -- 172.21.15.5:0/2915364450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8007740 con 0x7f63d00d2dc0 2024-04-25T08:57:10.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63cf7fe640 1 -- 172.21.15.5:0/2915364450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c80078e0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63cf7fe640 1 -- 172.21.15.5:0/2915364450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8007cb0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2915364450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 msgr2=0x7f63d00d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2915364450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00d31e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009d90 tx=0x7f63c802a510 comp rx=0 tx=0).stop 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2915364450 shutdown_connections 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2915364450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00d31e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2915364450 >> 172.21.15.5:0/2915364450 conn(0x7f63d006b000 msgr2=0x7f63d006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2915364450 shutdown_connections 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.450+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2915364450 wait complete. 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.451+0000 7f63d6fd5640 1 Processor -- start 2024-04-25T08:57:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.452+0000 7f63d6fd5640 1 -- start start 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.452+0000 7f63d6fd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63d00ce1c0 0x7f63d014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.452+0000 7f63d6fd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.452+0000 7f63d6fd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63d015de80 0x7f63d00c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.452+0000 7f63d6fd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00b6cf0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.452+0000 7f63d6fd5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00d1b80 con 0x7f63d00ce1c0 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.452+0000 7f63d6fd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00b6e70 con 0x7f63d015de80 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50258/0 (socket says 172.21.15.5:50258) 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 -- 172.21.15.5:0/2103935537 learned_addr learned my addr 172.21.15.5:0/2103935537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63d4d71640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63d00ce1c0 0x7f63d014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63d5572640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63d015de80 0x7f63d00c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 -- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63d015de80 msgr2=0x7f63d00c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63d015de80 0x7f63d00c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 -- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63d00ce1c0 msgr2=0x7f63d014c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63d00ce1c0 0x7f63d014c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 -- 172.21.15.5:0/2103935537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d014d180 con 0x7f63d00d2dc0 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63d4d71640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63d00ce1c0 0x7f63d014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cffff640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00c82e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00c780 tx=0x7f63bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cd7fa640 1 -- 172.21.15.5:0/2103935537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc017070 con 0x7f63d00d2dc0 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cd7fa640 1 -- 172.21.15.5:0/2103935537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc005ad0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d00aa500 con 0x7f63d00d2dc0 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63cd7fa640 1 -- 172.21.15.5:0/2103935537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc007070 con 0x7f63d00d2dc0 2024-04-25T08:57:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.453+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d014d420 con 0x7f63d00d2dc0 2024-04-25T08:57:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.454+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d004ef20 con 0x7f63d00d2dc0 2024-04-25T08:57:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.455+0000 7f63cd7fa640 1 -- 172.21.15.5:0/2103935537 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f63bc01a070 con 0x7f63d00d2dc0 2024-04-25T08:57:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.455+0000 7f63cd7fa640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63b406b500 0x7f63b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.455+0000 7f63cd7fa640 1 -- 172.21.15.5:0/2103935537 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63bc0896e0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.455+0000 7f63d4d71640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63b406b500 0x7f63b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.456+0000 7f63d4d71640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63b406b500 0x7f63b406d9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f63c4006fd0 tx=0x7f63c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.459+0000 7f63cd7fa640 1 -- 172.21.15.5:0/2103935537 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63bc058560 con 0x7f63d00d2dc0 2024-04-25T08:57:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.640+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63d00cf0b0 con 0x7f63d00d2dc0 2024-04-25T08:57:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.640+0000 7f63cd7fa640 1 -- 172.21.15.5:0/2103935537 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63bc057e60 con 0x7f63d00d2dc0 2024-04-25T08:57:10.629 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63b406b500 msgr2=0x7f63b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63b406b500 0x7f63b406d9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f63c4006fd0 tx=0x7f63c4008040 comp rx=0 tx=0).stop 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 msgr2=0x7f63d00c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00c82e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00c780 tx=0x7f63bc00cc40 comp rx=0 tx=0).stop 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 shutdown_connections 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63b406b500 0x7f63b406d9c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63d015de80 0x7f63d00c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63d00d2dc0 0x7f63d00c82e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 --2- 172.21.15.5:0/2103935537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63d00ce1c0 0x7f63d014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 >> 172.21.15.5:0/2103935537 conn(0x7f63d006b000 msgr2=0x7f63d00cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 shutdown_connections 2024-04-25T08:57:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.642+0000 7f63d6fd5640 1 -- 172.21.15.5:0/2103935537 wait complete. 2024-04-25T08:57:10.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.757+0000 7f6952f70640 1 Processor -- start 2024-04-25T08:57:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.757+0000 7f6952f70640 1 -- start start 2024-04-25T08:57:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.757+0000 7f6952f70640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f694c15df70 0x7f694c0b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.757+0000 7f6952f70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f694c0cef20 0x7f694c0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.757+0000 7f6952f70640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694c0d1ed0 con 0x7f694c0d2f70 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.757+0000 7f6952f70640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694c0d1c80 con 0x7f694c15df70 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.757+0000 7f6952f70640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694c0d2ae0 con 0x7f694c0cef20 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f6950d0c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f694c15df70 0x7f694c0b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f694bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f694c0d2f70 0x7f694c0ce810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42726/0 (socket says 172.21.15.5:42726) 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f6950d0c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f694c15df70 0x7f694c0b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39614/0 (socket says 172.21.15.5:39614) 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f694bfff640 1 -- 172.21.15.5:0/1378359177 learned_addr learned my addr 172.21.15.5:0/1378359177 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f6950d0c640 1 -- 172.21.15.5:0/1378359177 >> v2:172.21.15.80:3300/0 conn(0x7f694c0cef20 msgr2=0x7f694c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f695150d640 1 --2- 172.21.15.5:0/1378359177 >> v2:172.21.15.80:3300/0 conn(0x7f694c0cef20 0x7f694c0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f6950d0c640 1 --2- 172.21.15.5:0/1378359177 >> v2:172.21.15.80:3300/0 conn(0x7f694c0cef20 0x7f694c0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f694b7fe640 1 -- 172.21.15.5:0/1378359177 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074656112 0 0) 0x7f694c0d1ed0 con 0x7f694c0d2f70 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f6950d0c640 1 -- 172.21.15.5:0/1378359177 >> v1:172.21.15.5:6789/0 conn(0x7f694c0d2f70 legacy=0x7f694c0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f6950d0c640 1 -- 172.21.15.5:0/1378359177 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c0d21b0 con 0x7f694c15df70 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.758+0000 7f695150d640 1 --2- 172.21.15.5:0/1378359177 >> v2:172.21.15.80:3300/0 conn(0x7f694c0cef20 0x7f694c0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6950d0c640 1 --2- 172.21.15.5:0/1378359177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15df70 0x7f694c0b94d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f694c0d3b00 tx=0x7f694002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8b38eb3c61971 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f694b7fe640 1 -- 172.21.15.5:0/1378359177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940037070 con 0x7f694c15df70 2024-04-25T08:57:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f694b7fe640 1 -- 172.21.15.5:0/1378359177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940032440 con 0x7f694c15df70 2024-04-25T08:57:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f694b7fe640 1 -- 172.21.15.5:0/1378359177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940032810 con 0x7f694c15df70 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 -- 172.21.15.5:0/1378359177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15df70 msgr2=0x7f694c0b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 --2- 172.21.15.5:0/1378359177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15df70 0x7f694c0b94d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f694c0d3b00 tx=0x7f694002a230 comp rx=0 tx=0).stop 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 -- 172.21.15.5:0/1378359177 shutdown_connections 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 --2- 172.21.15.5:0/1378359177 >> v2:172.21.15.80:3300/0 conn(0x7f694c0cef20 0x7f694c0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 --2- 172.21.15.5:0/1378359177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15df70 0x7f694c0b94d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 -- 172.21.15.5:0/1378359177 >> 172.21.15.5:0/1378359177 conn(0x7f694c06b000 msgr2=0x7f694c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 -- 172.21.15.5:0/1378359177 shutdown_connections 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.759+0000 7f6952f70640 1 -- 172.21.15.5:0/1378359177 wait complete. 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.761+0000 7f6952f70640 1 Processor -- start 2024-04-25T08:57:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.761+0000 7f6952f70640 1 -- start start 2024-04-25T08:57:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.761+0000 7f6952f70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694c0cef20 0x7f694c0b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.761+0000 7f6952f70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f694c0d2f70 0x7f694c14db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.761+0000 7f6952f70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c1507b0 0x7f694c1f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f6952f70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0b9a10 con 0x7f694c1507b0 2024-04-25T08:57:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f6952f70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0d2770 con 0x7f694c0cef20 2024-04-25T08:57:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f6952f70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0d3720 con 0x7f694c0d2f70 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c1507b0 0x7f694c1f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c1507b0 0x7f694c1f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39630/0 (socket says 172.21.15.5:39630) 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 -- 172.21.15.5:0/2752989242 learned_addr learned my addr 172.21.15.5:0/2752989242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f6950d0c640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694c0cef20 0x7f694c0b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f694bfff640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f694c0d2f70 0x7f694c14db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 -- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f694c0d2f70 msgr2=0x7f694c14db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f694c0d2f70 0x7f694c14db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 -- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694c0cef20 msgr2=0x7f694c0b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694c0cef20 0x7f694c0b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 -- 172.21.15.5:0/2752989242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c14e4e0 con 0x7f694c1507b0 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f695150d640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c1507b0 0x7f694c1f3750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f694400cef0 tx=0x7f694400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f69497fa640 1 -- 172.21.15.5:0/2752989242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694401a070 con 0x7f694c1507b0 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f69497fa640 1 -- 172.21.15.5:0/2752989242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694400d860 con 0x7f694c1507b0 2024-04-25T08:57:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c14e7c0 con 0x7f694c1507b0 2024-04-25T08:57:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f69497fa640 1 -- 172.21.15.5:0/2752989242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694400dc50 con 0x7f694c1507b0 2024-04-25T08:57:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.762+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c14ed80 con 0x7f694c1507b0 2024-04-25T08:57:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.763+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c04ef20 con 0x7f694c1507b0 2024-04-25T08:57:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.764+0000 7f69497fa640 1 -- 172.21.15.5:0/2752989242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f694401d070 con 0x7f694c1507b0 2024-04-25T08:57:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.764+0000 7f69497fa640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f693006b4d0 0x7f693006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.764+0000 7f69497fa640 1 -- 172.21.15.5:0/2752989242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f694408a9d0 con 0x7f694c1507b0 2024-04-25T08:57:10.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.764+0000 7f6950d0c640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f693006b4d0 0x7f693006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:10.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.765+0000 7f6950d0c640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f693006b4d0 0x7f693006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6940034000 tx=0x7f694002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:10.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.768+0000 7f69497fa640 1 -- 172.21.15.5:0/2752989242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69440598e0 con 0x7f694c1507b0 2024-04-25T08:57:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.946+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f694c1610d0 con 0x7f694c1507b0 2024-04-25T08:57:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.946+0000 7f69497fa640 1 -- 172.21.15.5:0/2752989242 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69440591e0 con 0x7f694c1507b0 2024-04-25T08:57:10.935 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f693006b4d0 msgr2=0x7f693006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f693006b4d0 0x7f693006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6940034000 tx=0x7f694002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c1507b0 msgr2=0x7f694c1f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c1507b0 0x7f694c1f3750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f694400cef0 tx=0x7f694400a710 comp rx=0 tx=0).stop 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 shutdown_connections 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f693006b4d0 0x7f693006d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c1507b0 0x7f694c1f3750 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f694c0d2f70 0x7f694c14db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 --2- 172.21.15.5:0/2752989242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694c0cef20 0x7f694c0b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 >> 172.21.15.5:0/2752989242 conn(0x7f694c06b000 msgr2=0x7f694c15fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 shutdown_connections 2024-04-25T08:57:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:10.948+0000 7f6952f70640 1 -- 172.21.15.5:0/2752989242 wait complete. 2024-04-25T08:57:10.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:11.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.064+0000 7f8bf0a4d640 1 Processor -- start 2024-04-25T08:57:11.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.064+0000 7f8bf0a4d640 1 -- start start 2024-04-25T08:57:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.064+0000 7f8bf0a4d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bec15df70 0x7f8bec0b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.064+0000 7f8bf0a4d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bec0cef20 0x7f8bec0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.064+0000 7f8bf0a4d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec0d1ed0 con 0x7f8bec0d2f70 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.064+0000 7f8bf0a4d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0d1c80 con 0x7f8bec0cef20 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.064+0000 7f8bf0a4d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0d2ae0 con 0x7f8bec15df70 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bead9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bec0cef20 0x7f8bec0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bead9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bec0cef20 0x7f8bec0b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39642/0 (socket says 172.21.15.5:39642) 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bead9d640 1 -- 172.21.15.5:0/4059831719 learned_addr learned my addr 172.21.15.5:0/4059831719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bea59c640 1 --2- 172.21.15.5:0/4059831719 >> v2:172.21.15.80:3300/0 conn(0x7f8bec15df70 0x7f8bec0b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bead9d640 1 -- 172.21.15.5:0/4059831719 >> v2:172.21.15.80:3300/0 conn(0x7f8bec15df70 msgr2=0x7f8bec0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bead9d640 1 --2- 172.21.15.5:0/4059831719 >> v2:172.21.15.80:3300/0 conn(0x7f8bec15df70 0x7f8bec0b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bead9d640 1 -- 172.21.15.5:0/4059831719 >> v1:172.21.15.80:6789/0 conn(0x7f8bec0d2f70 legacy=0x7f8bec0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.065+0000 7f8bead9d640 1 -- 172.21.15.5:0/4059831719 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0d21b0 con 0x7f8bec0cef20 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bead9d640 1 --2- 172.21.15.5:0/4059831719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0cef20 0x7f8bec0b6c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0d1220 tx=0x7f8be402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579ea6bc032fc6d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8be9d9b640 1 -- 172.21.15.5:0/4059831719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4036070 con 0x7f8bec0cef20 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8be9d9b640 1 -- 172.21.15.5:0/4059831719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4031600 con 0x7f8bec0cef20 2024-04-25T08:57:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8be9d9b640 1 -- 172.21.15.5:0/4059831719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40319f0 con 0x7f8bec0cef20 2024-04-25T08:57:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/4059831719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0cef20 msgr2=0x7f8bec0b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/4059831719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0cef20 0x7f8bec0b6c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0d1220 tx=0x7f8be402a7c0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/4059831719 shutdown_connections 2024-04-25T08:57:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/4059831719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0cef20 0x7f8bec0b6c50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/4059831719 >> v2:172.21.15.80:3300/0 conn(0x7f8bec15df70 0x7f8bec0b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/4059831719 >> 172.21.15.5:0/4059831719 conn(0x7f8bec06b000 msgr2=0x7f8bec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/4059831719 shutdown_connections 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.066+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/4059831719 wait complete. 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 Processor -- start 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 -- start start 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8bec0cef20 0x7f8bec0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0d2f70 0x7f8bec1f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bec1f3cf0 0x7f8bec0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0b9a10 con 0x7f8bec0d2f70 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0d2770 con 0x7f8bec1f3cf0 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.068+0000 7f8bf0a4d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0d3720 con 0x7f8bec0cef20 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0d2f70 0x7f8bec1f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0d2f70 0x7f8bec1f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39656/0 (socket says 172.21.15.5:39656) 2024-04-25T08:57:11.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 -- 172.21.15.5:0/3776416073 learned_addr learned my addr 172.21.15.5:0/3776416073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8bea59c640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8bec0cef20 0x7f8bec0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8bead9d640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bec1f3cf0 0x7f8bec0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 -- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8bec0cef20 msgr2=0x7f8bec0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8bec0cef20 0x7f8bec0b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 -- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bec1f3cf0 msgr2=0x7f8bec0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bec1f3cf0 0x7f8bec0c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 -- 172.21.15.5:0/3776416073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec1f41e0 con 0x7f8bec0d2f70 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be3fff640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0d2f70 0x7f8bec1f37b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c400 tx=0x7f8bd400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be2ffd640 1 -- 172.21.15.5:0/3776416073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40052d0 con 0x7f8bec0d2f70 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be2ffd640 1 -- 172.21.15.5:0/3776416073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4005490 con 0x7f8bec0d2f70 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8be2ffd640 1 -- 172.21.15.5:0/3776416073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4007260 con 0x7f8bec0d2f70 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec1f44c0 con 0x7f8bec0d2f70 2024-04-25T08:57:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.069+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec0c8960 con 0x7f8bec0d2f70 2024-04-25T08:57:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.070+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec04ef20 con 0x7f8bec0d2f70 2024-04-25T08:57:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.071+0000 7f8be2ffd640 1 -- 172.21.15.5:0/3776416073 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8bd4007400 con 0x7f8bec0d2f70 2024-04-25T08:57:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.071+0000 7f8be2ffd640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.071+0000 7f8be2ffd640 1 -- 172.21.15.5:0/3776416073 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bd40896a0 con 0x7f8bec0d2f70 2024-04-25T08:57:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.071+0000 7f8bea59c640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.072+0000 7f8bea59c640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009aa0 tx=0x7f8bdc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.075+0000 7f8be2ffd640 1 -- 172.21.15.5:0/3776416073 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8bd4057ed0 con 0x7f8bec0d2f70 2024-04-25T08:57:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.253+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8bec0c8b60 con 0x7f8bec0d2f70 2024-04-25T08:57:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.253+0000 7f8be2ffd640 1 -- 172.21.15.5:0/3776416073 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8bd405bf70 con 0x7f8bec0d2f70 2024-04-25T08:57:11.242 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8bcc06b4d0 msgr2=0x7f8bcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009aa0 tx=0x7f8bdc009190 comp rx=0 tx=0).stop 2024-04-25T08:57:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0d2f70 msgr2=0x7f8bec1f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0d2f70 0x7f8bec1f37b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c400 tx=0x7f8bd400c8c0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 shutdown_connections 2024-04-25T08:57:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bec1f3cf0 0x7f8bec0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bec0d2f70 0x7f8bec1f37b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 --2- 172.21.15.5:0/3776416073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8bec0cef20 0x7f8bec0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 >> 172.21.15.5:0/3776416073 conn(0x7f8bec06b000 msgr2=0x7f8bec0b9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 shutdown_connections 2024-04-25T08:57:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.255+0000 7f8bf0a4d640 1 -- 172.21.15.5:0/3776416073 wait complete. 2024-04-25T08:57:11.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-04-25T08:57:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.368+0000 7fb4206fc640 1 Processor -- start 2024-04-25T08:57:11.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.368+0000 7fb4206fc640 1 -- start start 2024-04-25T08:57:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb4206fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4180d3990 0x7fb4180d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb4206fc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180b29c0 con 0x7fb41815e0a0 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb4206fc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180d2080 con 0x7fb4180b6f50 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb4206fc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180d4330 con 0x7fb4180d3990 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41e498640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb41815e0a0 0x7fb4180d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42734/0 (socket says 172.21.15.5:42734) 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41e498640 1 -- 172.21.15.5:0/225172184 learned_addr learned my addr 172.21.15.5:0/225172184 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316531913 0 0) 0x7fb4180b29c0 con 0x7fb41815e0a0 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41dc97640 1 --2- 172.21.15.5:0/225172184 >> v2:172.21.15.80:3300/0 conn(0x7fb4180d3990 0x7fb4180d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb404003520 con 0x7fb41815e0a0 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1768479642 0 0) 0x7fb404003520 con 0x7fb41815e0a0 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 >> v2:172.21.15.80:3300/0 conn(0x7fb4180d3990 msgr2=0x7fb4180d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 --2- 172.21.15.5:0/225172184 >> v2:172.21.15.80:3300/0 conn(0x7fb4180d3990 0x7fb4180d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 >> v1:172.21.15.80:6789/0 conn(0x7fb4180b6f50 legacy=0x7fb4180b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180d2360 con 0x7fb41815e0a0 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb4140019f0 con 0x7fb41815e0a0 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 >> v1:172.21.15.5:6789/0 conn(0x7fb41815e0a0 legacy=0x7fb4180d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4040039b0 0x7fb404003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404004800 0x7fb404004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040051c0 0x7fb40400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400c030 con 0x7fb404004800 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400c1e0 con 0x7fb4040051c0 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400c3e0 con 0x7fb4040039b0 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.369+0000 7fb41dc97640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404004800 0x7fb404004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41e498640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4040039b0 0x7fb404003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41ec99640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040051c0 0x7fb40400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41dc97640 1 -- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4040039b0 msgr2=0x7fb404003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41dc97640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4040039b0 0x7fb404003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41dc97640 1 -- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040051c0 msgr2=0x7fb40400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41dc97640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040051c0 0x7fb40400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41dc97640 1 -- 172.21.15.5:0/225172184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404003520 con 0x7fb404004800 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41ec99640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040051c0 0x7fb40400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41ec99640 1 -- 172.21.15.5:0/225172184 reap_dead start 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.370+0000 7fb41dc97640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404004800 0x7fb404004c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb408009ac0 tx=0x7fb404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c466503d20bf677 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408036070 con 0x7fb404004800 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408031400 con 0x7fb404004800 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb41d496640 1 -- 172.21.15.5:0/225172184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408009690 con 0x7fb404004800 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb4206fc640 1 -- 172.21.15.5:0/225172184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404004800 msgr2=0x7fb404004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb4206fc640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404004800 0x7fb404004c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb408009ac0 tx=0x7fb404005830 comp rx=0 tx=0).stop 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb4206fc640 1 -- 172.21.15.5:0/225172184 shutdown_connections 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb4206fc640 1 --2- 172.21.15.5:0/225172184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404004800 0x7fb404004c80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb4206fc640 1 -- 172.21.15.5:0/225172184 >> 172.21.15.5:0/225172184 conn(0x7fb4180668f0 msgr2=0x7fb418066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb4206fc640 1 -- 172.21.15.5:0/225172184 shutdown_connections 2024-04-25T08:57:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.371+0000 7fb4206fc640 1 -- 172.21.15.5:0/225172184 wait complete. 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.372+0000 7fb4206fc640 1 Processor -- start 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.372+0000 7fb4206fc640 1 -- start start 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb4206fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb404004800 0x7fb418156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb4206fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4180b61f0 0x7fb4180cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb4206fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41815a7b0 0x7fb4180cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb4206fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180d2c00 con 0x7fb41815a7b0 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb4206fc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180d2920 con 0x7fb404004800 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb4206fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41815e480 con 0x7fb4180b61f0 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb41ec99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41815a7b0 0x7fb4180cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb41ec99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41815a7b0 0x7fb4180cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39660/0 (socket says 172.21.15.5:39660) 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.373+0000 7fb41ec99640 1 -- 172.21.15.5:0/133583781 learned_addr learned my addr 172.21.15.5:0/133583781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb41e498640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb404004800 0x7fb418156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb41ec99640 1 -- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4180b61f0 msgr2=0x7fb4180cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb41ec99640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4180b61f0 0x7fb4180cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb41ec99640 1 -- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb404004800 msgr2=0x7fb418156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb41ec99640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb404004800 0x7fb418156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb41ec99640 1 -- 172.21.15.5:0/133583781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418157300 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb41ec99640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41815a7b0 0x7fb4180cc6d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb4180d3710 tx=0x7fb41000e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb40effd640 1 -- 172.21.15.5:0/133583781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410019070 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb40effd640 1 -- 172.21.15.5:0/133583781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4100050d0 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb418158330 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb40effd640 1 -- 172.21.15.5:0/133583781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100035f0 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.374+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb418157750 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.375+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41804ef20 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.375+0000 7fb40effd640 1 -- 172.21.15.5:0/133583781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb41001c070 con 0x7fb41815a7b0 2024-04-25T08:57:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.376+0000 7fb40effd640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.376+0000 7fb40effd640 1 -- 172.21.15.5:0/133583781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb410089370 con 0x7fb41815a7b0 2024-04-25T08:57:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.376+0000 7fb41e498640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.377+0000 7fb41e498640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb414004c40 tx=0x7fb414006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.380+0000 7fb40effd640 1 -- 172.21.15.5:0/133583781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb418157300 con 0x7fb41815a7b0 2024-04-25T08:57:11.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:11.629+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7fb418158850 con 0x7fb41815a7b0 2024-04-25T08:57:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.307+0000 7fb40effd640 1 -- 172.21.15.5:0/133583781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v49) v1 ==== 151+0+0 (secure 0 0 0) 0x7fb410058280 con 0x7fb41815a7b0 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 msgr2=0x7fb3fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb414004c40 tx=0x7fb414006040 comp rx=0 tx=0).stop 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41815a7b0 msgr2=0x7fb4180cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41815a7b0 0x7fb4180cc6d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb4180d3710 tx=0x7fb41000e5f0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 shutdown_connections 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41815a7b0 0x7fb4180cc6d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4180b61f0 0x7fb4180cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 --2- 172.21.15.5:0/133583781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb404004800 0x7fb418156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 >> 172.21.15.5:0/133583781 conn(0x7fb4180668f0 msgr2=0x7fb4180d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 shutdown_connections 2024-04-25T08:57:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.310+0000 7fb4206fc640 1 -- 172.21.15.5:0/133583781 wait complete. 2024-04-25T08:57:12.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:57:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.428+0000 7f69cf589640 1 Processor -- start 2024-04-25T08:57:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.429+0000 7f69cf589640 1 -- start start 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.429+0000 7f69cf589640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69c815df70 0x7f69c80b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.429+0000 7f69cf589640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80d2f70 0x7f69c80ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.429+0000 7f69cf589640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c80d1ed0 con 0x7f69c80ced50 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.429+0000 7f69cf589640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c80d1c80 con 0x7f69c815df70 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cf589640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c80d2ae0 con 0x7f69c80d2f70 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cd325640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69c815df70 0x7f69c80b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cdb26640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f69c80ced50 0x7f69c80b55e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42744/0 (socket says 172.21.15.5:42744) 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cdb26640 1 -- 172.21.15.5:0/3011849621 learned_addr learned my addr 172.21.15.5:0/3011849621 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cd325640 1 -- 172.21.15.5:0/3011849621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80d2f70 msgr2=0x7f69c80ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cd325640 1 --2- 172.21.15.5:0/3011849621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80d2f70 0x7f69c80ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cd325640 1 -- 172.21.15.5:0/3011849621 >> v1:172.21.15.5:6789/0 conn(0x7f69c80ced50 legacy=0x7f69c80b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69cd325640 1 -- 172.21.15.5:0/3011849621 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c80d21b0 con 0x7f69c815df70 2024-04-25T08:57:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.430+0000 7f69bffff640 1 -- 172.21.15.5:0/3011849621 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184154164 0 0) 0x7f69c80d1ed0 con 0x7f69c80ced50 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cd325640 1 --2- 172.21.15.5:0/3011849621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c815df70 0x7f69c80b94d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69c40097a0 tx=0x7f69c402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b77ccf37e839fc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69bffff640 1 -- 172.21.15.5:0/3011849621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4037070 con 0x7f69c815df70 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69bffff640 1 -- 172.21.15.5:0/3011849621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4032440 con 0x7f69c815df70 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69bffff640 1 -- 172.21.15.5:0/3011849621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4032810 con 0x7f69c815df70 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cf589640 1 -- 172.21.15.5:0/3011849621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c815df70 msgr2=0x7f69c80b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cf589640 1 --2- 172.21.15.5:0/3011849621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c815df70 0x7f69c80b94d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69c40097a0 tx=0x7f69c402a210 comp rx=0 tx=0).stop 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cf589640 1 -- 172.21.15.5:0/3011849621 shutdown_connections 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cf589640 1 --2- 172.21.15.5:0/3011849621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80d2f70 0x7f69c80ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cf589640 1 --2- 172.21.15.5:0/3011849621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c815df70 0x7f69c80b94d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cf589640 1 -- 172.21.15.5:0/3011849621 >> 172.21.15.5:0/3011849621 conn(0x7f69c806b000 msgr2=0x7f69c806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.431+0000 7f69cf589640 1 -- 172.21.15.5:0/3011849621 shutdown_connections 2024-04-25T08:57:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.432+0000 7f69cf589640 1 -- 172.21.15.5:0/3011849621 wait complete. 2024-04-25T08:57:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 Processor -- start 2024-04-25T08:57:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 -- start start 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c80ced50 0x7f69c8154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c80d2f70 0x7f69c80caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80cb0e0 0x7f69c80ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c80b9a10 con 0x7f69c80d2f70 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c80d2770 con 0x7f69c80ced50 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69cf589640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c80d3720 con 0x7f69c80cb0e0 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.433+0000 7f69ccb24640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c80d2f70 0x7f69c80caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c80d2f70 0x7f69c80caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39676/0 (socket says 172.21.15.5:39676) 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 -- 172.21.15.5:0/2697824500 learned_addr learned my addr 172.21.15.5:0/2697824500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69cdb26640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80cb0e0 0x7f69c80ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69cd325640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c80ced50 0x7f69c8154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 -- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80cb0e0 msgr2=0x7f69c80ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80cb0e0 0x7f69c80ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 -- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c80ced50 msgr2=0x7f69c8154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c80ced50 0x7f69c8154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 -- 172.21.15.5:0/2697824500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c80cb5f0 con 0x7f69c80d2f70 2024-04-25T08:57:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69ccb24640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c80d2f70 0x7f69c80caba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69b800b410 tx=0x7f69b800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69bdffb640 1 -- 172.21.15.5:0/2697824500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8015020 con 0x7f69c80d2f70 2024-04-25T08:57:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69bdffb640 1 -- 172.21.15.5:0/2697824500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b8011850 con 0x7f69c80d2f70 2024-04-25T08:57:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c80cb8d0 con 0x7f69c80d2f70 2024-04-25T08:57:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69bdffb640 1 -- 172.21.15.5:0/2697824500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8011c40 con 0x7f69c80d2f70 2024-04-25T08:57:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.434+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c80cbe90 con 0x7f69c80d2f70 2024-04-25T08:57:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.436+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c804ef20 con 0x7f69c80d2f70 2024-04-25T08:57:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.436+0000 7f69bdffb640 1 -- 172.21.15.5:0/2697824500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f69b8018020 con 0x7f69c80d2f70 2024-04-25T08:57:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.436+0000 7f69bdffb640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69ac06b4d0 0x7f69ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.436+0000 7f69bdffb640 1 -- 172.21.15.5:0/2697824500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69b808a120 con 0x7f69c80d2f70 2024-04-25T08:57:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.436+0000 7f69cd325640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69ac06b4d0 0x7f69ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.437+0000 7f69cd325640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69ac06b4d0 0x7f69ac06d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69c4034000 tx=0x7f69c402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.440+0000 7f69bdffb640 1 -- 172.21.15.5:0/2697824500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69b801f020 con 0x7f69c80d2f70 2024-04-25T08:57:12.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.619+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f69c80b2f00 con 0x7f69c80d2f70 2024-04-25T08:57:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.622+0000 7f69bdffb640 1 -- 172.21.15.5:0/2697824500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f69b80172c0 con 0x7f69c80d2f70 2024-04-25T08:57:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69ac06b4d0 msgr2=0x7f69ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69ac06b4d0 0x7f69ac06d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69c4034000 tx=0x7f69c402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c80d2f70 msgr2=0x7f69c80caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c80d2f70 0x7f69c80caba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69b800b410 tx=0x7f69b800b8d0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 shutdown_connections 2024-04-25T08:57:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69ac06b4d0 0x7f69ac06d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69c80cb0e0 0x7f69c80ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c80d2f70 0x7f69c80caba0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 --2- 172.21.15.5:0/2697824500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c80ced50 0x7f69c8154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 >> 172.21.15.5:0/2697824500 conn(0x7f69c806b000 msgr2=0x7f69c815f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 shutdown_connections 2024-04-25T08:57:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.624+0000 7f69cf589640 1 -- 172.21.15.5:0/2697824500 wait complete. 2024-04-25T08:57:12.624 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:57:12.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:57:12.663 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:57:12.706 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:57:12.706 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:12.706 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:12.722 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:12.722 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:12.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:12.778 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:12.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.986+0000 7f1d23bf4640 1 Processor -- start 2024-04-25T08:57:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.986+0000 7f1d23bf4640 1 -- start start 2024-04-25T08:57:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d23bf4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d1c0b9990 0x7f1d1c0d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d23bf4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d1c0d21f0 0x7f1d1c0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d23bf4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0d2670 con 0x7f1d1c0d05f0 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d23bf4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0d2950 con 0x7f1d1c0d21f0 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d23bf4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0d2c30 con 0x7f1d1c0b9990 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d22191640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d1c0d21f0 0x7f1d1c0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d22191640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d1c0d21f0 0x7f1d1c0b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39682/0 (socket says 172.21.15.5:39682) 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d22191640 1 -- 172.21.15.5:0/1831447498 learned_addr learned my addr 172.21.15.5:0/1831447498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.987+0000 7f1d2118f640 1 --2- 172.21.15.5:0/1831447498 >> v2:172.21.15.80:3300/0 conn(0x7f1d1c0b9990 0x7f1d1c0d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.988+0000 7f1d22191640 1 -- 172.21.15.5:0/1831447498 >> v2:172.21.15.80:3300/0 conn(0x7f1d1c0b9990 msgr2=0x7f1d1c0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.988+0000 7f1d22191640 1 --2- 172.21.15.5:0/1831447498 >> v2:172.21.15.80:3300/0 conn(0x7f1d1c0b9990 0x7f1d1c0d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.988+0000 7f1d22191640 1 -- 172.21.15.5:0/1831447498 >> v1:172.21.15.80:6789/0 conn(0x7f1d1c0d05f0 legacy=0x7f1d1c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.988+0000 7f1d22191640 1 -- 172.21.15.5:0/1831447498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0d2f10 con 0x7f1d1c0d21f0 2024-04-25T08:57:12.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.988+0000 7f1d22191640 1 --2- 172.21.15.5:0/1831447498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c0d21f0 0x7f1d1c0b6c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0ce3a0 tx=0x7f1d0c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76629208293a51a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:12.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.988+0000 7f1d2098e640 1 -- 172.21.15.5:0/1831447498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c036070 con 0x7f1d1c0d21f0 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d2098e640 1 -- 172.21.15.5:0/1831447498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c031600 con 0x7f1d1c0d21f0 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d2098e640 1 -- 172.21.15.5:0/1831447498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0319f0 con 0x7f1d1c0d21f0 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 -- 172.21.15.5:0/1831447498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c0d21f0 msgr2=0x7f1d1c0b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/1831447498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c0d21f0 0x7f1d1c0b6c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0ce3a0 tx=0x7f1d0c02a7c0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 -- 172.21.15.5:0/1831447498 shutdown_connections 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/1831447498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c0d21f0 0x7f1d1c0b6c50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/1831447498 >> v2:172.21.15.80:3300/0 conn(0x7f1d1c0b9990 0x7f1d1c0d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 -- 172.21.15.5:0/1831447498 >> 172.21.15.5:0/1831447498 conn(0x7f1d1c06b000 msgr2=0x7f1d1c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 -- 172.21.15.5:0/1831447498 shutdown_connections 2024-04-25T08:57:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.989+0000 7f1d23bf4640 1 -- 172.21.15.5:0/1831447498 wait complete. 2024-04-25T08:57:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.990+0000 7f1d23bf4640 1 Processor -- start 2024-04-25T08:57:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.990+0000 7f1d23bf4640 1 -- start start 2024-04-25T08:57:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d23bf4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d1c0d05f0 0x7f1d1c152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d23bf4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d1c0d21f0 0x7f1d1c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d23bf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c15f730 0x7f1d1c0b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d23bf4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0d3890 con 0x7f1d1c15f730 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d23bf4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0d3710 con 0x7f1d1c0d05f0 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d23bf4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0d3a10 con 0x7f1d1c0d21f0 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c15f730 0x7f1d1c0b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c15f730 0x7f1d1c0b7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39690/0 (socket says 172.21.15.5:39690) 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 -- 172.21.15.5:0/2167089265 learned_addr learned my addr 172.21.15.5:0/2167089265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d2118f640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d1c0d21f0 0x7f1d1c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d21990640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d1c0d05f0 0x7f1d1c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 -- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d1c0d21f0 msgr2=0x7f1d1c0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d1c0d21f0 0x7f1d1c0b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 -- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d1c0d05f0 msgr2=0x7f1d1c152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d1c0d05f0 0x7f1d1c152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.991+0000 7f1d22191640 1 -- 172.21.15.5:0/2167089265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0b5200 con 0x7f1d1c15f730 2024-04-25T08:57:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.992+0000 7f1d22191640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c15f730 0x7f1d1c0b7b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009f40 tx=0x7f1d0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.992+0000 7f1d1a7fc640 1 -- 172.21.15.5:0/2167089265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c036050 con 0x7f1d1c15f730 2024-04-25T08:57:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.992+0000 7f1d1a7fc640 1 -- 172.21.15.5:0/2167089265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c042070 con 0x7f1d1c15f730 2024-04-25T08:57:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.992+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c15e3b0 con 0x7f1d1c15f730 2024-04-25T08:57:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.992+0000 7f1d1a7fc640 1 -- 172.21.15.5:0/2167089265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c009510 con 0x7f1d1c15f730 2024-04-25T08:57:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.992+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c15e970 con 0x7f1d1c15f730 2024-04-25T08:57:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.993+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c04ef20 con 0x7f1d1c15f730 2024-04-25T08:57:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.993+0000 7f1d1a7fc640 1 -- 172.21.15.5:0/2167089265 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d0c004470 con 0x7f1d1c15f730 2024-04-25T08:57:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.994+0000 7f1d1a7fc640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d0806b500 0x7f1d0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.994+0000 7f1d1a7fc640 1 -- 172.21.15.5:0/2167089265 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d0c0aaf10 con 0x7f1d1c15f730 2024-04-25T08:57:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.994+0000 7f1d21990640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d0806b500 0x7f1d0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.994+0000 7f1d21990640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d0806b500 0x7f1d0806d9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d14000f60 tx=0x7f1d14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:12.998+0000 7f1d1a7fc640 1 -- 172.21.15.5:0/2167089265 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d0c04c020 con 0x7f1d1c15f730 2024-04-25T08:57:13.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.178+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d1c0d4400 con 0x7f1d1c15f730 2024-04-25T08:57:13.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.179+0000 7f1d1a7fc640 1 -- 172.21.15.5:0/2167089265 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f1d0c079cf0 con 0x7f1d1c15f730 2024-04-25T08:57:13.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:13.168 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d0806b500 msgr2=0x7f1d0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d0806b500 0x7f1d0806d9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d14000f60 tx=0x7f1d14009040 comp rx=0 tx=0).stop 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c15f730 msgr2=0x7f1d1c0b7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c15f730 0x7f1d1c0b7b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009f40 tx=0x7f1d0c004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 shutdown_connections 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d0806b500 0x7f1d0806d9c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d1c15f730 0x7f1d1c0b7b90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d1c0d21f0 0x7f1d1c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 --2- 172.21.15.5:0/2167089265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d1c0d05f0 0x7f1d1c152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 >> 172.21.15.5:0/2167089265 conn(0x7f1d1c06b000 msgr2=0x7f1d1c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 shutdown_connections 2024-04-25T08:57:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.181+0000 7f1d23bf4640 1 -- 172.21.15.5:0/2167089265 wait complete. 2024-04-25T08:57:13.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:13.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:13.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.295+0000 7f5211cea640 1 Processor -- start 2024-04-25T08:57:13.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.295+0000 7f5211cea640 1 -- start start 2024-04-25T08:57:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.296+0000 7f5211cea640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f520c15a9d0 0x7f520c071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.296+0000 7f5211cea640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c06e070 con 0x7f520c06dbe0 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.296+0000 7f5211cea640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c06e350 con 0x7f520c06b2f0 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.296+0000 7f5211cea640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c06e630 con 0x7f520c15a9d0 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.296+0000 7f520affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f520c06dbe0 0x7f520c06abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42748/0 (socket says 172.21.15.5:42748) 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.296+0000 7f520affd640 1 -- 172.21.15.5:0/2256713771 learned_addr learned my addr 172.21.15.5:0/2256713771 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712482530 0 0) 0x7f520c06e070 con 0x7f520c06dbe0 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8003520 con 0x7f520c06dbe0 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520b7fe640 1 --2- 172.21.15.5:0/2256713771 >> v2:172.21.15.80:3300/0 conn(0x7f520c15a9d0 0x7f520c071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3678875436 0 0) 0x7f51f8003520 con 0x7f520c06dbe0 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 >> v2:172.21.15.80:3300/0 conn(0x7f520c15a9d0 msgr2=0x7f520c071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 --2- 172.21.15.5:0/2256713771 >> v2:172.21.15.80:3300/0 conn(0x7f520c15a9d0 0x7f520c071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 >> v1:172.21.15.80:6789/0 conn(0x7f520c06b2f0 legacy=0x7f520c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c06e910 con 0x7f520c06dbe0 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f51fc001670 con 0x7f520c06dbe0 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 >> v1:172.21.15.5:6789/0 conn(0x7f520c06dbe0 legacy=0x7f520c06abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f80039b0 0x7f51f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51f8004800 0x7f51f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f51f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c06e630 con 0x7f51f80051c0 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f800c060 con 0x7f51f80039b0 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f800c260 con 0x7f51f8004800 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520bfff640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f51f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520b7fe640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f80039b0 0x7f51f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520affd640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51f8004800 0x7f51f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520bfff640 1 -- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51f8004800 msgr2=0x7f51f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520bfff640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51f8004800 0x7f51f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520bfff640 1 -- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f80039b0 msgr2=0x7f51f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520bfff640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f80039b0 0x7f51f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.297+0000 7f520bfff640 1 -- 172.21.15.5:0/2256713771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8003520 con 0x7f51f80051c0 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.298+0000 7f520bfff640 1 -- 172.21.15.5:0/2256713771 reap_dead start 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.298+0000 7f520bfff640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f51f800b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5204001e50 tx=0x7f51f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b068da92a630cdf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.298+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204001a70 con 0x7f51f80051c0 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.298+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204003970 con 0x7f51f80051c0 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.298+0000 7f520a7fc640 1 -- 172.21.15.5:0/2256713771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204003d60 con 0x7f51f80051c0 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.299+0000 7f5211cea640 1 -- 172.21.15.5:0/2256713771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 msgr2=0x7f51f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.299+0000 7f5211cea640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f51f800b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5204001e50 tx=0x7f51f8005830 comp rx=0 tx=0).stop 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.299+0000 7f5211cea640 1 -- 172.21.15.5:0/2256713771 shutdown_connections 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.299+0000 7f5211cea640 1 --2- 172.21.15.5:0/2256713771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f51f800b9c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.299+0000 7f5211cea640 1 -- 172.21.15.5:0/2256713771 >> 172.21.15.5:0/2256713771 conn(0x7f520c0b2560 msgr2=0x7f520c0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.299+0000 7f5211cea640 1 -- 172.21.15.5:0/2256713771 shutdown_connections 2024-04-25T08:57:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.299+0000 7f5211cea640 1 -- 172.21.15.5:0/2256713771 wait complete. 2024-04-25T08:57:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.300+0000 7f5211cea640 1 Processor -- start 2024-04-25T08:57:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.300+0000 7f5211cea640 1 -- start start 2024-04-25T08:57:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f5211cea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f520c1f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f5211cea640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f520c1f2970 0x7f520c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f5211cea640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f520c150000 0x7f520c150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f5211cea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c06abe0 con 0x7f51f80051c0 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f5211cea640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c15adb0 con 0x7f520c1f2970 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f5211cea640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c06ad60 con 0x7f520c150000 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f520c1f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f520c1f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39712/0 (socket says 172.21.15.5:39712) 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 -- 172.21.15.5:0/3279664490 learned_addr learned my addr 172.21.15.5:0/3279664490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520affd640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f520c1f2970 0x7f520c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520bfff640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f520c150000 0x7f520c150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 -- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f520c150000 msgr2=0x7f520c150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f520c150000 0x7f520c150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 -- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f520c1f2970 msgr2=0x7f520c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f520c1f2970 0x7f520c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520b7fe640 1 -- 172.21.15.5:0/3279664490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c15b060 con 0x7f51f80051c0 2024-04-25T08:57:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.301+0000 7f520affd640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f520c1f2970 0x7f520c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.302+0000 7f520b7fe640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f520c1f4610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51f40118e0 tx=0x7f51f4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.302+0000 7f5203fff640 1 -- 172.21.15.5:0/3279664490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f400faf0 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.302+0000 7f5203fff640 1 -- 172.21.15.5:0/3279664490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f400fc90 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.302+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c15b340 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.302+0000 7f5203fff640 1 -- 172.21.15.5:0/3279664490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4014440 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.302+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c15b900 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.303+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c04ef20 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.303+0000 7f5203fff640 1 -- 172.21.15.5:0/3279664490 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51f4012040 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.304+0000 7f5203fff640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51ec06b500 0x7f51ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.304+0000 7f5203fff640 1 -- 172.21.15.5:0/3279664490 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51f408a830 con 0x7f51f80051c0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.304+0000 7f520affd640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51ec06b500 0x7f51ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.304+0000 7f520affd640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51ec06b500 0x7f51ec06d9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f520c150990 tx=0x7f51fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.308+0000 7f5203fff640 1 -- 172.21.15.5:0/3279664490 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51f4019030 con 0x7f51f80051c0 2024-04-25T08:57:13.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.490+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f520c0b4350 con 0x7f51f80051c0 2024-04-25T08:57:13.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.490+0000 7f5203fff640 1 -- 172.21.15.5:0/3279664490 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51f40590f0 con 0x7f51f80051c0 2024-04-25T08:57:13.479 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51ec06b500 msgr2=0x7f51ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51ec06b500 0x7f51ec06d9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f520c150990 tx=0x7f51fc009040 comp rx=0 tx=0).stop 2024-04-25T08:57:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 msgr2=0x7f520c1f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f520c1f4610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51f40118e0 tx=0x7f51f4011da0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 shutdown_connections 2024-04-25T08:57:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51ec06b500 0x7f51ec06d9c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f520c150000 0x7f520c150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f520c1f2970 0x7f520c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 --2- 172.21.15.5:0/3279664490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f80051c0 0x7f520c1f4610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 >> 172.21.15.5:0/3279664490 conn(0x7f520c0b2560 msgr2=0x7f520c0b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 shutdown_connections 2024-04-25T08:57:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.492+0000 7f5211cea640 1 -- 172.21.15.5:0/3279664490 wait complete. 2024-04-25T08:57:13.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.606+0000 7ff6aa29c640 1 Processor -- start 2024-04-25T08:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.606+0000 7ff6aa29c640 1 -- start start 2024-04-25T08:57:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6aa29c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 0x7ff6a406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6aa29c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6a40cc780 0x7ff6a40ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6aa29c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a40d27f0 con 0x7ff6a415e0b0 2024-04-25T08:57:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6aa29c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a40cfee0 con 0x7ff6a40cc780 2024-04-25T08:57:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6aa29c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40d01c0 con 0x7ff6a40d0c80 2024-04-25T08:57:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff6a415e0b0 0x7ff6a40cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42764/0 (socket says 172.21.15.5:42764) 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a3fff640 1 -- 172.21.15.5:0/1066789062 learned_addr learned my addr 172.21.15.5:0/1066789062 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a37fe640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 0x7ff6a406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890141988 0 0) 0x7ff6a40d27f0 con 0x7ff6a415e0b0 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff68c003520 con 0x7ff6a415e0b0 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a8839640 1 --2- 172.21.15.5:0/1066789062 >> v2:172.21.15.80:3300/0 conn(0x7ff6a40cc780 0x7ff6a40ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570844596 0 0) 0x7ff68c003520 con 0x7ff6a415e0b0 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 msgr2=0x7ff6a406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 0x7ff6a406adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 >> v2:172.21.15.80:3300/0 conn(0x7ff6a40cc780 msgr2=0x7ff6a40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 --2- 172.21.15.5:0/1066789062 >> v2:172.21.15.80:3300/0 conn(0x7ff6a40cc780 0x7ff6a40ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a40d04a0 con 0x7ff6a415e0b0 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7ff698001670 con 0x7ff6a415e0b0 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 >> v1:172.21.15.5:6789/0 conn(0x7ff6a415e0b0 legacy=0x7ff6a40cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 0x7ff68c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68c003f30 0x7ff68c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff68c004d40 0x7ff68c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40cfee0 con 0x7ff68c004d40 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40d01c0 con 0x7ff68c003f30 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.607+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c00b9c0 con 0x7ff6a40d0c80 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a3fff640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 0x7ff68c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a8839640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff68c004d40 0x7ff68c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a37fe640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68c003f30 0x7ff68c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a8839640 1 -- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 msgr2=0x7ff68c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a8839640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6a40d0c80 0x7ff68c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a8839640 1 -- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68c003f30 msgr2=0x7ff68c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a8839640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68c003f30 0x7ff68c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.608+0000 7ff6a8839640 1 -- 172.21.15.5:0/1066789062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c003520 con 0x7ff68c004d40 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6a8839640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff68c004d40 0x7ff68c0051c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009fc0 tx=0x7ff68c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c6c9895abc6fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c009c10 con 0x7ff68c004d40 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c036070 con 0x7ff68c004d40 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6a2ffd640 1 -- 172.21.15.5:0/1066789062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c02d070 con 0x7ff68c004d40 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6aa29c640 1 -- 172.21.15.5:0/1066789062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff68c004d40 msgr2=0x7ff68c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6aa29c640 1 --2- 172.21.15.5:0/1066789062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff68c004d40 0x7ff68c0051c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009fc0 tx=0x7ff68c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6a8839640 1 -- 172.21.15.5:0/1066789062 reap_dead start 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6aa29c640 1 -- 172.21.15.5:0/1066789062 shutdown_connections 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6aa29c640 1 -- 172.21.15.5:0/1066789062 >> 172.21.15.5:0/1066789062 conn(0x7ff6a40d1a20 msgr2=0x7ff6a40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6aa29c640 1 -- 172.21.15.5:0/1066789062 shutdown_connections 2024-04-25T08:57:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.609+0000 7ff6aa29c640 1 -- 172.21.15.5:0/1066789062 wait complete. 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 Processor -- start 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 -- start start 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff68c004d40 0x7ff6a40cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6a4157e90 0x7ff6a41582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a4160300 0x7ff6a4160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40cfb90 con 0x7ff6a4160300 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a415e490 con 0x7ff6a4157e90 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.611+0000 7ff6aa29c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40ccc10 con 0x7ff68c004d40 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a4160300 0x7ff6a4160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a4160300 0x7ff6a4160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39726/0 (socket says 172.21.15.5:39726) 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 -- 172.21.15.5:0/2948528003 learned_addr learned my addr 172.21.15.5:0/2948528003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a3fff640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff68c004d40 0x7ff6a40cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a37fe640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6a4157e90 0x7ff6a41582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 -- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff68c004d40 msgr2=0x7ff6a40cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff68c004d40 0x7ff6a40cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 -- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6a4157e90 msgr2=0x7ff6a41582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6a4157e90 0x7ff6a41582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 -- 172.21.15.5:0/2948528003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a415e740 con 0x7ff6a4160300 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a8839640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a4160300 0x7ff6a4160780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff69c033040 tx=0x7ff69c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a0ff9640 1 -- 172.21.15.5:0/2948528003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c009c10 con 0x7ff6a4160300 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a0ff9640 1 -- 172.21.15.5:0/2948528003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c003990 con 0x7ff6a4160300 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a415ea20 con 0x7ff6a4160300 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6a0ff9640 1 -- 172.21.15.5:0/2948528003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c003d80 con 0x7ff6a4160300 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.612+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a415efe0 con 0x7ff6a4160300 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.613+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a404ef20 con 0x7ff6a4160300 2024-04-25T08:57:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.614+0000 7ff6a0ff9640 1 -- 172.21.15.5:0/2948528003 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff69c005d10 con 0x7ff6a4160300 2024-04-25T08:57:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.614+0000 7ff6a0ff9640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff69006b4d0 0x7ff69006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.614+0000 7ff6a0ff9640 1 -- 172.21.15.5:0/2948528003 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff69c0ab930 con 0x7ff6a4160300 2024-04-25T08:57:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.614+0000 7ff6a3fff640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff69006b4d0 0x7ff69006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.615+0000 7ff6a3fff640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff69006b4d0 0x7ff69006d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff698007fd0 tx=0x7ff698007970 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.618+0000 7ff6a0ff9640 1 -- 172.21.15.5:0/2948528003 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff69c04a060 con 0x7ff6a4160300 2024-04-25T08:57:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.795+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6a40b79a0 con 0x7ff6a4160300 2024-04-25T08:57:13.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.796+0000 7ff6a0ff9640 1 -- 172.21.15.5:0/2948528003 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff69c080030 con 0x7ff6a4160300 2024-04-25T08:57:13.785 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff69006b4d0 msgr2=0x7ff69006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff69006b4d0 0x7ff69006d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff698007fd0 tx=0x7ff698007970 comp rx=0 tx=0).stop 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a4160300 msgr2=0x7ff6a4160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a4160300 0x7ff6a4160780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff69c033040 tx=0x7ff69c009750 comp rx=0 tx=0).stop 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 shutdown_connections 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff69006b4d0 0x7ff69006d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a4160300 0x7ff6a4160780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6a4157e90 0x7ff6a41582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 --2- 172.21.15.5:0/2948528003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff68c004d40 0x7ff6a40cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 >> 172.21.15.5:0/2948528003 conn(0x7ff6a40d1a20 msgr2=0x7ff6a406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 shutdown_connections 2024-04-25T08:57:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.798+0000 7ff6aa29c640 1 -- 172.21.15.5:0/2948528003 wait complete. 2024-04-25T08:57:13.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.913+0000 7f17dbb49640 1 Processor -- start 2024-04-25T08:57:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.913+0000 7f17dbb49640 1 -- start start 2024-04-25T08:57:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17dbb49640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17d40d2f70 0x7f17d40ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17dbb49640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40d1ed0 con 0x7f17d415df70 2024-04-25T08:57:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17dbb49640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40d21b0 con 0x7f17d40ced50 2024-04-25T08:57:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17dbb49640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40d1c80 con 0x7f17d40d2f70 2024-04-25T08:57:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17d98e5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17d415df70 0x7f17d40b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42770/0 (socket says 172.21.15.5:42770) 2024-04-25T08:57:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17d98e5640 1 -- 172.21.15.5:0/2776959493 learned_addr learned my addr 172.21.15.5:0/2776959493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690721475 0 0) 0x7f17d40d1ed0 con 0x7f17d415df70 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17bc003520 con 0x7f17d415df70 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.914+0000 7f17d90e4640 1 --2- 172.21.15.5:0/2776959493 >> v2:172.21.15.80:3300/0 conn(0x7f17d40d2f70 0x7f17d40ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389359577 0 0) 0x7f17bc003520 con 0x7f17d415df70 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 >> v2:172.21.15.80:3300/0 conn(0x7f17d40d2f70 msgr2=0x7f17d40ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 --2- 172.21.15.5:0/2776959493 >> v2:172.21.15.80:3300/0 conn(0x7f17d40d2f70 0x7f17d40ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 >> v1:172.21.15.80:6789/0 conn(0x7f17d40ced50 legacy=0x7f17d40b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40d2490 con 0x7f17d415df70 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f17c40019f0 con 0x7f17d415df70 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 >> v1:172.21.15.5:6789/0 conn(0x7f17d415df70 legacy=0x7f17d40b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0039b0 0x7f17bc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17bc004800 0x7f17bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc0051c0 0x7f17bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40d1c80 con 0x7f17bc0051c0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc00c0d0 con 0x7f17bc004800 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc00c2d0 con 0x7f17bc0039b0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17da0e6640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc0051c0 0x7f17bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d90e4640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17bc004800 0x7f17bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17d98e5640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0039b0 0x7f17bc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17da0e6640 1 -- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0039b0 msgr2=0x7f17bc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17da0e6640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0039b0 0x7f17bc003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17da0e6640 1 -- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17bc004800 msgr2=0x7f17bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17da0e6640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17bc004800 0x7f17bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.915+0000 7f17da0e6640 1 -- 172.21.15.5:0/2776959493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc003520 con 0x7f17bc0051c0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.916+0000 7f17da0e6640 1 -- 172.21.15.5:0/2776959493 reap_dead start 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.916+0000 7f17da0e6640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc0051c0 0x7f17bc00b9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17cc003db0 tx=0x7f17bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459d547121b189ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.916+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc003980 con 0x7f17bc0051c0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.916+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc007240 con 0x7f17bc0051c0 2024-04-25T08:57:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.916+0000 7f17d88e3640 1 -- 172.21.15.5:0/2776959493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc007630 con 0x7f17bc0051c0 2024-04-25T08:57:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.916+0000 7f17dbb49640 1 -- 172.21.15.5:0/2776959493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc0051c0 msgr2=0x7f17bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.916+0000 7f17dbb49640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc0051c0 0x7f17bc00b9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17cc003db0 tx=0x7f17bc005830 comp rx=0 tx=0).stop 2024-04-25T08:57:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.917+0000 7f17dbb49640 1 -- 172.21.15.5:0/2776959493 shutdown_connections 2024-04-25T08:57:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.917+0000 7f17dbb49640 1 --2- 172.21.15.5:0/2776959493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17bc0051c0 0x7f17bc00b9c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.917+0000 7f17dbb49640 1 -- 172.21.15.5:0/2776959493 >> 172.21.15.5:0/2776959493 conn(0x7f17d406b000 msgr2=0x7f17d406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.917+0000 7f17dbb49640 1 -- 172.21.15.5:0/2776959493 shutdown_connections 2024-04-25T08:57:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.917+0000 7f17dbb49640 1 -- 172.21.15.5:0/2776959493 wait complete. 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 Processor -- start 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 -- start start 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0051c0 0x7f17d41580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d4156ae0 0x7f17d4154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40cc460 0x7f17d40cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40d3720 con 0x7f17d40cc460 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40d2ae0 con 0x7f17d4156ae0 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.918+0000 7f17dbb49640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40d38a0 con 0x7f17bc0051c0 2024-04-25T08:57:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40cc460 0x7f17d40cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40cc460 0x7f17d40cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39736/0 (socket says 172.21.15.5:39736) 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 -- 172.21.15.5:0/780733253 learned_addr learned my addr 172.21.15.5:0/780733253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17d98e5640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0051c0 0x7f17d41580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17d90e4640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d4156ae0 0x7f17d4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 -- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0051c0 msgr2=0x7f17d41580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0051c0 0x7f17d41580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 -- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d4156ae0 msgr2=0x7f17d4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d4156ae0 0x7f17d4154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 -- 172.21.15.5:0/780733253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4157000 con 0x7f17d40cc460 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17da0e6640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40cc460 0x7f17d40cc8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17cc007850 tx=0x7f17cc0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17d27fc640 1 -- 172.21.15.5:0/780733253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0069d0 con 0x7f17d40cc460 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17d27fc640 1 -- 172.21.15.5:0/780733253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc042070 con 0x7f17d40cc460 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d41572e0 con 0x7f17d40cc460 2024-04-25T08:57:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17d27fc640 1 -- 172.21.15.5:0/780733253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc006d90 con 0x7f17d40cc460 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.919+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d41578a0 con 0x7f17d40cc460 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.920+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d4068630 con 0x7f17d40cc460 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.921+0000 7f17d27fc640 1 -- 172.21.15.5:0/780733253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f17cc047460 con 0x7f17d40cc460 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.921+0000 7f17d27fc640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17c006b4d0 0x7f17c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.921+0000 7f17d27fc640 1 -- 172.21.15.5:0/780733253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17cc0aa310 con 0x7f17d40cc460 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.921+0000 7f17d98e5640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17c006b4d0 0x7f17c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.922+0000 7f17d98e5640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17c006b4d0 0x7f17c006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17c4004b60 tx=0x7f17c4006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:13.926+0000 7f17d27fc640 1 -- 172.21.15.5:0/780733253 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17d4068630 con 0x7f17d40cc460 2024-04-25T08:57:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.107+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17d406b3e0 con 0x7f17d40cc460 2024-04-25T08:57:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.107+0000 7f17d27fc640 1 -- 172.21.15.5:0/780733253 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17d406b3e0 con 0x7f17d40cc460 2024-04-25T08:57:14.096 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.109+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17c006b4d0 msgr2=0x7f17c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.109+0000 7f17dbb49640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17c006b4d0 0x7f17c006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17c4004b60 tx=0x7f17c4006040 comp rx=0 tx=0).stop 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.109+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40cc460 msgr2=0x7f17d40cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.109+0000 7f17dbb49640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40cc460 0x7f17d40cc8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17cc007850 tx=0x7f17cc0036f0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 shutdown_connections 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f17c006b4d0 0x7f17c006d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40cc460 0x7f17d40cc8f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d4156ae0 0x7f17d4154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 --2- 172.21.15.5:0/780733253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17bc0051c0 0x7f17d41580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 >> 172.21.15.5:0/780733253 conn(0x7f17d406b000 msgr2=0x7f17d40b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 shutdown_connections 2024-04-25T08:57:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.110+0000 7f17dbb49640 1 -- 172.21.15.5:0/780733253 wait complete. 2024-04-25T08:57:14.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:57:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.222+0000 7fab3ad9e640 1 Processor -- start 2024-04-25T08:57:14.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.222+0000 7fab3ad9e640 1 -- start start 2024-04-25T08:57:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab3ad9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 0x7fab3406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab3ad9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab340b4730 con 0x7fab3406bbb0 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab3ad9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab340d0da0 con 0x7fab3415e120 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab3ad9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab340cbf30 con 0x7fab3406b7d0 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fab3406bbb0 0x7fab3415da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42786/0 (socket says 172.21.15.5:42786) 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2bfff640 1 -- 172.21.15.5:0/3592178830 learned_addr learned my addr 172.21.15.5:0/3592178830 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab38b3a640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 0x7fab3406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153880983 0 0) 0x7fab24001110 con 0x7fab3406bbb0 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab1c003520 con 0x7fab3406bbb0 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883018860 0 0) 0x7fab1c003520 con 0x7fab3406bbb0 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 msgr2=0x7fab3406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 0x7fab3406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 >> v1:172.21.15.80:6789/0 conn(0x7fab3415e120 legacy=0x7fab340ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab340cc180 con 0x7fab3406bbb0 2024-04-25T08:57:14.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.223+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fab24001840 con 0x7fab3406bbb0 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 >> v1:172.21.15.5:6789/0 conn(0x7fab3406bbb0 legacy=0x7fab3415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2b7fe640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab1c0039e0 0x7fab1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2b7fe640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 0x7fab1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2b7fe640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c004d40 0x7fab1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340cbf30 con 0x7fab1c0039e0 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00b9c0 con 0x7fab1c004d40 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00bbc0 con 0x7fab3406b7d0 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab38b3a640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab1c0039e0 0x7fab1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab2bfff640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 0x7fab1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab3933b640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c004d40 0x7fab1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab38b3a640 1 -- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 msgr2=0x7fab1c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab38b3a640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab3406b7d0 0x7fab1c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab38b3a640 1 -- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c004d40 msgr2=0x7fab1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab38b3a640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c004d40 0x7fab1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab38b3a640 1 -- 172.21.15.5:0/3592178830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c003520 con 0x7fab1c0039e0 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.224+0000 7fab3933b640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c004d40 0x7fab1c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab38b3a640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab1c0039e0 0x7fab1c003dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab30009ac0 tx=0x7fab1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1049dfd8831268b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30036070 con 0x7fab1c0039e0 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30031400 con 0x7fab1c0039e0 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab2b7fe640 1 -- 172.21.15.5:0/3592178830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30009690 con 0x7fab1c0039e0 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab3ad9e640 1 -- 172.21.15.5:0/3592178830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab1c0039e0 msgr2=0x7fab1c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab3ad9e640 1 --2- 172.21.15.5:0/3592178830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab1c0039e0 0x7fab1c003dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab30009ac0 tx=0x7fab1c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab3933b640 1 -- 172.21.15.5:0/3592178830 reap_dead start 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab3ad9e640 1 -- 172.21.15.5:0/3592178830 shutdown_connections 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab3ad9e640 1 -- 172.21.15.5:0/3592178830 >> 172.21.15.5:0/3592178830 conn(0x7fab340d18e0 msgr2=0x7fab340d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab3ad9e640 1 -- 172.21.15.5:0/3592178830 shutdown_connections 2024-04-25T08:57:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.225+0000 7fab3ad9e640 1 -- 172.21.15.5:0/3592178830 wait complete. 2024-04-25T08:57:14.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.227+0000 7fab3ad9e640 1 Processor -- start 2024-04-25T08:57:14.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.227+0000 7fab3ad9e640 1 -- start start 2024-04-25T08:57:14.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.227+0000 7fab3ad9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c0039e0 0x7fab3415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.227+0000 7fab3ad9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab340c9310 0x7fab34152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab3ad9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab34161230 0x7fab3415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab3ad9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3406aef0 con 0x7fab340c9310 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab3ad9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340cc7d0 con 0x7fab1c0039e0 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab3ad9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3406b070 con 0x7fab34161230 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab340c9310 0x7fab34152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab340c9310 0x7fab34152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39750/0 (socket says 172.21.15.5:39750) 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 -- 172.21.15.5:0/2056240340 learned_addr learned my addr 172.21.15.5:0/2056240340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab38b3a640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c0039e0 0x7fab3415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab3933b640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab34161230 0x7fab3415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 -- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab34161230 msgr2=0x7fab3415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab34161230 0x7fab3415b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 -- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c0039e0 msgr2=0x7fab3415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c0039e0 0x7fab3415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 -- 172.21.15.5:0/2056240340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34160190 con 0x7fab340c9310 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab2bfff640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab340c9310 0x7fab34152460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab240019b0 tx=0x7fab240077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab297fa640 1 -- 172.21.15.5:0/2056240340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2400f9c0 con 0x7fab340c9310 2024-04-25T08:57:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab297fa640 1 -- 172.21.15.5:0/2056240340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab24018070 con 0x7fab340c9310 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab34160470 con 0x7fab340c9310 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab297fa640 1 -- 172.21.15.5:0/2056240340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2400fda0 con 0x7fab340c9310 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.228+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab34160a30 con 0x7fab340c9310 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.229+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab340cbd10 con 0x7fab340c9310 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.230+0000 7fab297fa640 1 -- 172.21.15.5:0/2056240340 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab2401d460 con 0x7fab340c9310 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.230+0000 7fab297fa640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab2006b500 0x7fab2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.230+0000 7fab297fa640 1 -- 172.21.15.5:0/2056240340 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab2408a220 con 0x7fab340c9310 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.231+0000 7fab38b3a640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab2006b500 0x7fab2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.231+0000 7fab38b3a640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab2006b500 0x7fab2006d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab30033000 tx=0x7fab30008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:14.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.235+0000 7fab297fa640 1 -- 172.21.15.5:0/2056240340 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab340cbd10 con 0x7fab340c9310 2024-04-25T08:57:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.427+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab340cfb10 con 0x7fab340c9310 2024-04-25T08:57:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.427+0000 7fab297fa640 1 -- 172.21.15.5:0/2056240340 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab340b4730 con 0x7fab340c9310 2024-04-25T08:57:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T08:57:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab2006b500 msgr2=0x7fab2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab2006b500 0x7fab2006d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab30033000 tx=0x7fab30008030 comp rx=0 tx=0).stop 2024-04-25T08:57:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab340c9310 msgr2=0x7fab34152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab340c9310 0x7fab34152460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab240019b0 tx=0x7fab240077a0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 shutdown_connections 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab2006b500 0x7fab2006d9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab34161230 0x7fab3415b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab340c9310 0x7fab34152460 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 --2- 172.21.15.5:0/2056240340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c0039e0 0x7fab3415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 >> 172.21.15.5:0/2056240340 conn(0x7fab340d18e0 msgr2=0x7fab340cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 shutdown_connections 2024-04-25T08:57:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.429+0000 7fab3ad9e640 1 -- 172.21.15.5:0/2056240340 wait complete. 2024-04-25T08:57:14.429 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:57:14.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:14.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T08:57:14.455 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:57:14.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:14.455 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:57:14.516 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:14.516 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:14.534 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:14.534 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:14.592 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:14.592 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:14.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:14.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.762+0000 7fc3cbe38640 1 Processor -- start 2024-04-25T08:57:14.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.762+0000 7fc3cbe38640 1 -- start start 2024-04-25T08:57:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.762+0000 7fc3cbe38640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3c40ce7f0 0x7fc3c40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.762+0000 7fc3cbe38640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40cf1c0 con 0x7fc3c415de70 2024-04-25T08:57:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.762+0000 7fc3cbe38640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40d20e0 con 0x7fc3c40b2cc0 2024-04-25T08:57:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3cbe38640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40d2a10 con 0x7fc3c40ce7f0 2024-04-25T08:57:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c9bd4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3c415de70 0x7fc3c40b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42802/0 (socket says 172.21.15.5:42802) 2024-04-25T08:57:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c9bd4640 1 -- 172.21.15.5:0/1126940947 learned_addr learned my addr 172.21.15.5:0/1126940947 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613213251 0 0) 0x7fc3c40cf1c0 con 0x7fc3c415de70 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b0003520 con 0x7fc3c415de70 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3ca3d5640 1 --2- 172.21.15.5:0/1126940947 >> v2:172.21.15.80:3300/0 conn(0x7fc3c40ce7f0 0x7fc3c40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2109768883 0 0) 0x7fc3b0003520 con 0x7fc3c415de70 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 >> v2:172.21.15.80:3300/0 conn(0x7fc3c40ce7f0 msgr2=0x7fc3c40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 --2- 172.21.15.5:0/1126940947 >> v2:172.21.15.80:3300/0 conn(0x7fc3c40ce7f0 0x7fc3c40cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 >> v1:172.21.15.80:6789/0 conn(0x7fc3c40b2cc0 legacy=0x7fc3c40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40d23c0 con 0x7fc3c415de70 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fc3c0001670 con 0x7fc3c415de70 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 >> v1:172.21.15.5:6789/0 conn(0x7fc3c415de70 legacy=0x7fc3c40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3b00039b0 0x7fc3b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b0004800 0x7fc3b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00051c0 0x7fc3b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40d2a10 con 0x7fc3b00039b0 2024-04-25T08:57:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b000c060 con 0x7fc3b00051c0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b000c260 con 0x7fc3b0004800 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.763+0000 7fc3c9bd4640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3b00039b0 0x7fc3b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3ca3d5640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00051c0 0x7fc3b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3c93d3640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b0004800 0x7fc3b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3c9bd4640 1 -- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b0004800 msgr2=0x7fc3b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3c9bd4640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b0004800 0x7fc3b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3c9bd4640 1 -- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00051c0 msgr2=0x7fc3b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3c9bd4640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3b00051c0 0x7fc3b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3ca3d5640 1 -- 172.21.15.5:0/1126940947 reap_dead start 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3c9bd4640 1 -- 172.21.15.5:0/1126940947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0003520 con 0x7fc3b00039b0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.764+0000 7fc3c9bd4640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3b00039b0 0x7fc3b0003dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fc0 tx=0x7fc3b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d203d1a2a96fb29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0007d10 con 0x7fc3b00039b0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c0037070 con 0x7fc3b00039b0 2024-04-25T08:57:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3c8bd2640 1 -- 172.21.15.5:0/1126940947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0033dd0 con 0x7fc3b00039b0 2024-04-25T08:57:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1126940947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3b00039b0 msgr2=0x7fc3b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3b00039b0 0x7fc3b0003dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fc0 tx=0x7fc3b0005830 comp rx=0 tx=0).stop 2024-04-25T08:57:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1126940947 shutdown_connections 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1126940947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3b00039b0 0x7fc3b0003dd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1126940947 >> 172.21.15.5:0/1126940947 conn(0x7fc3c406b000 msgr2=0x7fc3c406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1126940947 shutdown_connections 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.765+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1126940947 wait complete. 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 Processor -- start 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 -- start start 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b00039b0 0x7fc3c40c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c40b38f0 0x7fc3c40c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c415fa80 0x7fc3c415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40cee00 con 0x7fc3c415fa80 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40cec80 con 0x7fc3c40b38f0 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3cbe38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40cef80 con 0x7fc3b00039b0 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3ca3d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c415fa80 0x7fc3c415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3ca3d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c415fa80 0x7fc3c415ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39772/0 (socket says 172.21.15.5:39772) 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3ca3d5640 1 -- 172.21.15.5:0/1710809272 learned_addr learned my addr 172.21.15.5:0/1710809272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.767+0000 7fc3c9bd4640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b00039b0 0x7fc3c40c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3c93d3640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c40b38f0 0x7fc3c40c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ca3d5640 1 -- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b00039b0 msgr2=0x7fc3c40c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ca3d5640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b00039b0 0x7fc3c40c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ca3d5640 1 -- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c40b38f0 msgr2=0x7fc3c40c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ca3d5640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c40b38f0 0x7fc3c40c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ca3d5640 1 -- 172.21.15.5:0/1710809272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40b3d50 con 0x7fc3c415fa80 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ca3d5640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c415fa80 0x7fc3c415ff00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40ce0b0 tx=0x7fc3bc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ba7fc640 1 -- 172.21.15.5:0/1710809272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc00fce0 con 0x7fc3c415fa80 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ba7fc640 1 -- 172.21.15.5:0/1710809272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc01d070 con 0x7fc3c415fa80 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c40c9110 con 0x7fc3c415fa80 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3ba7fc640 1 -- 172.21.15.5:0/1710809272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc015670 con 0x7fc3c415fa80 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.768+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c40c96d0 con 0x7fc3c415fa80 2024-04-25T08:57:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.769+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c404ef20 con 0x7fc3c415fa80 2024-04-25T08:57:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.770+0000 7fc3ba7fc640 1 -- 172.21.15.5:0/1710809272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3bc015810 con 0x7fc3c415fa80 2024-04-25T08:57:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.770+0000 7fc3ba7fc640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3a806b4d0 0x7fc3a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.770+0000 7fc3ba7fc640 1 -- 172.21.15.5:0/1710809272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3bc08a9f0 con 0x7fc3c415fa80 2024-04-25T08:57:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.770+0000 7fc3c9bd4640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3a806b4d0 0x7fc3a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.771+0000 7fc3c9bd4640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3a806b4d0 0x7fc3a806d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc3c003b000 tx=0x7fc3c0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.774+0000 7fc3ba7fc640 1 -- 172.21.15.5:0/1710809272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3bc010040 con 0x7fc3c415fa80 2024-04-25T08:57:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.954+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3c415ba10 con 0x7fc3c415fa80 2024-04-25T08:57:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.955+0000 7fc3ba7fc640 1 -- 172.21.15.5:0/1710809272 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fc3bc059190 con 0x7fc3c415fa80 2024-04-25T08:57:14.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:14.945 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3a806b4d0 msgr2=0x7fc3a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3a806b4d0 0x7fc3a806d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc3c003b000 tx=0x7fc3c0009030 comp rx=0 tx=0).stop 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c415fa80 msgr2=0x7fc3c415ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c415fa80 0x7fc3c415ff00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40ce0b0 tx=0x7fc3bc00f1b0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 shutdown_connections 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3a806b4d0 0x7fc3a806d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c415fa80 0x7fc3c415ff00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.957+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c40b38f0 0x7fc3c40c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.958+0000 7fc3cbe38640 1 --2- 172.21.15.5:0/1710809272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3b00039b0 0x7fc3c40c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.958+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 >> 172.21.15.5:0/1710809272 conn(0x7fc3c406b000 msgr2=0x7fc3c415e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.958+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 shutdown_connections 2024-04-25T08:57:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:14.958+0000 7fc3cbe38640 1 -- 172.21.15.5:0/1710809272 wait complete. 2024-04-25T08:57:14.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:14.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.072+0000 7fbe60990640 1 Processor -- start 2024-04-25T08:57:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.072+0000 7fbe60990640 1 -- start start 2024-04-25T08:57:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe60990640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5c15e0b0 0x7fbe5c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe60990640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0d27f0 con 0x7fbe5c0cc780 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe60990640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0cfee0 con 0x7fbe5c0d0c80 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe60990640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0d01c0 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe5a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5c15e0b0 0x7fbe5c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe5ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe5c0cc780 0x7fbe5c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42816/0 (socket says 172.21.15.5:42816) 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe5a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe5c15e0b0 0x7fbe5c06adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39782/0 (socket says 172.21.15.5:39782) 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.073+0000 7fbe5ad9d640 1 -- 172.21.15.5:0/4230140652 learned_addr learned my addr 172.21.15.5:0/4230140652 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.074+0000 7fbe5a59c640 1 -- 172.21.15.5:0/4230140652 >> v1:172.21.15.80:6789/0 conn(0x7fbe5c0d0c80 legacy=0x7fbe5c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.074+0000 7fbe5a59c640 1 -- 172.21.15.5:0/4230140652 >> v1:172.21.15.5:6789/0 conn(0x7fbe5c0cc780 legacy=0x7fbe5c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.074+0000 7fbe5a59c640 1 -- 172.21.15.5:0/4230140652 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0d04a0 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.074+0000 7fbe5959a640 1 -- 172.21.15.5:0/4230140652 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574113014 0 0) 0x7fbe5c0d27f0 con 0x7fbe5c0cc780 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.075+0000 7fbe5a59c640 1 --2- 172.21.15.5:0/4230140652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c06adf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097d0 tx=0x7fbe5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8175c3c6afb693 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.075+0000 7fbe5959a640 1 -- 172.21.15.5:0/4230140652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54037070 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.075+0000 7fbe5959a640 1 -- 172.21.15.5:0/4230140652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54032440 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.075+0000 7fbe5959a640 1 -- 172.21.15.5:0/4230140652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54032810 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.075+0000 7fbe60990640 1 -- 172.21.15.5:0/4230140652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 msgr2=0x7fbe5c06adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.075+0000 7fbe60990640 1 --2- 172.21.15.5:0/4230140652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c06adf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097d0 tx=0x7fbe5402a270 comp rx=0 tx=0).stop 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.076+0000 7fbe60990640 1 -- 172.21.15.5:0/4230140652 shutdown_connections 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.076+0000 7fbe60990640 1 --2- 172.21.15.5:0/4230140652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c06adf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.076+0000 7fbe60990640 1 -- 172.21.15.5:0/4230140652 >> 172.21.15.5:0/4230140652 conn(0x7fbe5c0d1a20 msgr2=0x7fbe5c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.076+0000 7fbe60990640 1 -- 172.21.15.5:0/4230140652 shutdown_connections 2024-04-25T08:57:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.076+0000 7fbe60990640 1 -- 172.21.15.5:0/4230140652 wait complete. 2024-04-25T08:57:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.077+0000 7fbe60990640 1 Processor -- start 2024-04-25T08:57:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.077+0000 7fbe60990640 1 -- start start 2024-04-25T08:57:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe5c0cc780 0x7fbe5c1f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c0d0c80 0x7fbe5c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0cfb90 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c15e490 con 0x7fbe5c0d0c80 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0ccc30 con 0x7fbe5c0cc780 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39786/0 (socket says 172.21.15.5:39786) 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 -- 172.21.15.5:0/2614570066 learned_addr learned my addr 172.21.15.5:0/2614570066 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe59d9b640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c0d0c80 0x7fbe5c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5a59c640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe5c0cc780 0x7fbe5c1f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 -- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe5c0cc780 msgr2=0x7fbe5c1f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe5c0cc780 0x7fbe5c1f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 -- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c0d0c80 msgr2=0x7fbe5c159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c0d0c80 0x7fbe5c159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 -- 172.21.15.5:0/2614570066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0c8af0 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe59d9b640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c0d0c80 0x7fbe5c159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5a59c640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe5c0cc780 0x7fbe5c1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe5ad9d640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c0b5f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c7d0 tx=0x7fbe4c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe52ffd640 1 -- 172.21.15.5:0/2614570066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c018070 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe52ffd640 1 -- 172.21.15.5:0/2614570066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00a640 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe52ffd640 1 -- 172.21.15.5:0/2614570066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00aa70 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c15e960 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.078+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c15ef20 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.079+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c04ef20 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.080+0000 7fbe52ffd640 1 -- 172.21.15.5:0/2614570066 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe4c01b070 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.080+0000 7fbe52ffd640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe3c06b4d0 0x7fbe3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.080+0000 7fbe52ffd640 1 -- 172.21.15.5:0/2614570066 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe4c0897e0 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.081+0000 7fbe5a59c640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe3c06b4d0 0x7fbe3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.081+0000 7fbe5a59c640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe3c06b4d0 0x7fbe3c06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe54034000 tx=0x7fbe5402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.084+0000 7fbe52ffd640 1 -- 172.21.15.5:0/2614570066 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe4c058660 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.264+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe5c0b79a0 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.265+0000 7fbe52ffd640 1 -- 172.21.15.5:0/2614570066 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe4c057f60 con 0x7fbe5c15e0b0 2024-04-25T08:57:15.255 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe3c06b4d0 msgr2=0x7fbe3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe3c06b4d0 0x7fbe3c06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe54034000 tx=0x7fbe5402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 msgr2=0x7fbe5c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c0b5f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c7d0 tx=0x7fbe4c00cc90 comp rx=0 tx=0).stop 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 shutdown_connections 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe3c06b4d0 0x7fbe3c06d990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe5c15e0b0 0x7fbe5c0b5f80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c0d0c80 0x7fbe5c159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 --2- 172.21.15.5:0/2614570066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe5c0cc780 0x7fbe5c1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 >> 172.21.15.5:0/2614570066 conn(0x7fbe5c0d1a20 msgr2=0x7fbe5c15d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 shutdown_connections 2024-04-25T08:57:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.267+0000 7fbe60990640 1 -- 172.21.15.5:0/2614570066 wait complete. 2024-04-25T08:57:15.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.381+0000 7f9d627e0640 1 Processor -- start 2024-04-25T08:57:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.381+0000 7f9d627e0640 1 -- start start 2024-04-25T08:57:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d627e0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d627e0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d5c0d2dc0 0x7f9d5c0d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d627e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c15e260 con 0x7f9d5c15de80 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d627e0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0d1ef0 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d627e0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0d18c0 con 0x7f9d5c0ce1c0 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d60d7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d5c0d2dc0 0x7f9d5c0d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d60d7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d5c0d2dc0 0x7f9d5c0d3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39802/0 (socket says 172.21.15.5:39802) 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.382+0000 7f9d60d7d640 1 -- 172.21.15.5:0/70289980 learned_addr learned my addr 172.21.15.5:0/70289980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.383+0000 7f9d5b7fe640 1 --2- 172.21.15.5:0/70289980 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.383+0000 7f9d60d7d640 1 -- 172.21.15.5:0/70289980 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 msgr2=0x7f9d5c0d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.383+0000 7f9d60d7d640 1 --2- 172.21.15.5:0/70289980 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.383+0000 7f9d60d7d640 1 -- 172.21.15.5:0/70289980 >> v1:172.21.15.80:6789/0 conn(0x7f9d5c15de80 legacy=0x7f9d5c0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.383+0000 7f9d60d7d640 1 -- 172.21.15.5:0/70289980 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0ce780 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.383+0000 7f9d60d7d640 1 --2- 172.21.15.5:0/70289980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c0d3250 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009e50 tx=0x7f9d5402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a18e37ea7a712a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d5affd640 1 -- 172.21.15.5:0/70289980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54036070 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d5affd640 1 -- 172.21.15.5:0/70289980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54031600 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d5affd640 1 -- 172.21.15.5:0/70289980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540319d0 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 -- 172.21.15.5:0/70289980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 msgr2=0x7f9d5c0d3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 --2- 172.21.15.5:0/70289980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c0d3250 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009e50 tx=0x7f9d5402a6c0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 -- 172.21.15.5:0/70289980 shutdown_connections 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 --2- 172.21.15.5:0/70289980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c0d3250 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 --2- 172.21.15.5:0/70289980 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0d2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 -- 172.21.15.5:0/70289980 >> 172.21.15.5:0/70289980 conn(0x7f9d5c06b000 msgr2=0x7f9d5c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 -- 172.21.15.5:0/70289980 shutdown_connections 2024-04-25T08:57:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.384+0000 7f9d627e0640 1 -- 172.21.15.5:0/70289980 wait complete. 2024-04-25T08:57:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.385+0000 7f9d627e0640 1 Processor -- start 2024-04-25T08:57:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d627e0640 1 -- start start 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d627e0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d627e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d627e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d5c15de80 0x7f9d5c0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d627e0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b6cf0 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d627e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0d28c0 con 0x7f9d5c15de80 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d627e0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b6e70 con 0x7f9d5c0ce1c0 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c14afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39812/0 (socket says 172.21.15.5:39812) 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.386+0000 7f9d5b7fe640 1 -- 172.21.15.5:0/4075066754 learned_addr learned my addr 172.21.15.5:0/4075066754 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d5bfff640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d60d7d640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d5c15de80 0x7f9d5c0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d5b7fe640 1 -- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 msgr2=0x7f9d5c0b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d5b7fe640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d5b7fe640 1 -- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d5c15de80 msgr2=0x7f9d5c0c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d5b7fe640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d5c15de80 0x7f9d5c0c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d5b7fe640 1 -- 172.21.15.5:0/4075066754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c154370 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d5b7fe640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c14afa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d830 tx=0x7f9d4c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d58ff9640 1 -- 172.21.15.5:0/4075066754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00b6c0 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d58ff9640 1 -- 172.21.15.5:0/4075066754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c019070 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0c7da0 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d58ff9640 1 -- 172.21.15.5:0/4075066754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00ba80 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.387+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0c8360 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.388+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c04ef20 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.388+0000 7f9d58ff9640 1 -- 172.21.15.5:0/4075066754 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d4c01e460 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.389+0000 7f9d58ff9640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d3c06b500 0x7f9d3c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.389+0000 7f9d58ff9640 1 -- 172.21.15.5:0/4075066754 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d4c08a950 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.389+0000 7f9d5bfff640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d3c06b500 0x7f9d3c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.390+0000 7f9d5bfff640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d3c06b500 0x7f9d3c06d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006fd0 tx=0x7f9d44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.393+0000 7f9d58ff9640 1 -- 172.21.15.5:0/4075066754 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d5c154370 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.572+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d5c0b94e0 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.572+0000 7f9d58ff9640 1 -- 172.21.15.5:0/4075066754 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d4c059740 con 0x7f9d5c0d2dc0 2024-04-25T08:57:15.563 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d3c06b500 msgr2=0x7f9d3c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d3c06b500 0x7f9d3c06d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006fd0 tx=0x7f9d44008040 comp rx=0 tx=0).stop 2024-04-25T08:57:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 msgr2=0x7f9d5c14afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c14afa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d830 tx=0x7f9d4c00dcf0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 shutdown_connections 2024-04-25T08:57:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d3c06b500 0x7f9d3c06d9c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d5c15de80 0x7f9d5c0c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5c0d2dc0 0x7f9d5c14afa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 --2- 172.21.15.5:0/4075066754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d5c0ce1c0 0x7f9d5c0b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 >> 172.21.15.5:0/4075066754 conn(0x7f9d5c06b000 msgr2=0x7f9d5c0ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 shutdown_connections 2024-04-25T08:57:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.574+0000 7f9d627e0640 1 -- 172.21.15.5:0/4075066754 wait complete. 2024-04-25T08:57:15.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.688+0000 7f9f56dd5640 1 Processor -- start 2024-04-25T08:57:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.688+0000 7f9f56dd5640 1 -- start start 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f56dd5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f500cefe0 0x7f9f50168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f56dd5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f50162150 con 0x7f9f5015df10 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f56dd5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f50162430 con 0x7f9f500b6250 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f56dd5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500d20d0 con 0x7f9f500cefe0 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f55372640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f500cefe0 0x7f9f50168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f54b71640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f5015df10 0x7f9f501618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42824/0 (socket says 172.21.15.5:42824) 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f55372640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f500cefe0 0x7f9f50168c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39824/0 (socket says 172.21.15.5:39824) 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.689+0000 7f9f54b71640 1 -- 172.21.15.5:0/3851624861 learned_addr learned my addr 172.21.15.5:0/3851624861 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.690+0000 7f9f55372640 1 -- 172.21.15.5:0/3851624861 >> v1:172.21.15.80:6789/0 conn(0x7f9f500b6250 legacy=0x7f9f500ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.690+0000 7f9f55372640 1 -- 172.21.15.5:0/3851624861 >> v1:172.21.15.5:6789/0 conn(0x7f9f5015df10 legacy=0x7f9f501618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.690+0000 7f9f4f7fe640 1 -- 172.21.15.5:0/3851624861 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153529108 0 0) 0x7f9f50162150 con 0x7f9f5015df10 2024-04-25T08:57:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.690+0000 7f9f55372640 1 -- 172.21.15.5:0/3851624861 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50162710 con 0x7f9f500cefe0 2024-04-25T08:57:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.690+0000 7f9f55372640 1 --2- 172.21.15.5:0/3851624861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cefe0 0x7f9f50168c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9f400097a0 tx=0x7f9f4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e269d14398ba87a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f4f7fe640 1 -- 172.21.15.5:0/3851624861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40037070 con 0x7f9f500cefe0 2024-04-25T08:57:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f4f7fe640 1 -- 172.21.15.5:0/3851624861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40032440 con 0x7f9f500cefe0 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f4f7fe640 1 -- 172.21.15.5:0/3851624861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40032810 con 0x7f9f500cefe0 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f56dd5640 1 -- 172.21.15.5:0/3851624861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cefe0 msgr2=0x7f9f50168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/3851624861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cefe0 0x7f9f50168c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9f400097a0 tx=0x7f9f4002a230 comp rx=0 tx=0).stop 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f56dd5640 1 -- 172.21.15.5:0/3851624861 shutdown_connections 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/3851624861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cefe0 0x7f9f50168c40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f56dd5640 1 -- 172.21.15.5:0/3851624861 >> 172.21.15.5:0/3851624861 conn(0x7f9f500668f0 msgr2=0x7f9f50066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f56dd5640 1 -- 172.21.15.5:0/3851624861 shutdown_connections 2024-04-25T08:57:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.691+0000 7f9f56dd5640 1 -- 172.21.15.5:0/3851624861 wait complete. 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.692+0000 7f9f56dd5640 1 Processor -- start 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.692+0000 7f9f56dd5640 1 -- start start 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f56dd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f500b6250 0x7f9f50154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f56dd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f500cefe0 0x7f9f500c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f56dd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5015df10 0x7f9f50159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f56dd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500d36f0 con 0x7f9f5015df10 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f56dd5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500d3570 con 0x7f9f500b6250 2024-04-25T08:57:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f56dd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500d3870 con 0x7f9f500cefe0 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f55372640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5015df10 0x7f9f50159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f55372640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5015df10 0x7f9f50159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39838/0 (socket says 172.21.15.5:39838) 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f55372640 1 -- 172.21.15.5:0/1056198082 learned_addr learned my addr 172.21.15.5:0/1056198082 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.693+0000 7f9f54b71640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f500b6250 0x7f9f50154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f4ffff640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f500cefe0 0x7f9f500c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f55372640 1 -- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f500cefe0 msgr2=0x7f9f500c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f55372640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f500cefe0 0x7f9f500c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f55372640 1 -- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f500b6250 msgr2=0x7f9f50154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f55372640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f500b6250 0x7f9f50154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f55372640 1 -- 172.21.15.5:0/1056198082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50154ff0 con 0x7f9f5015df10 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f55372640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5015df10 0x7f9f50159ff0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9f400097a0 tx=0x7f9f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f4d7fa640 1 -- 172.21.15.5:0/1056198082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40037040 con 0x7f9f5015df10 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f4d7fa640 1 -- 172.21.15.5:0/1056198082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40042070 con 0x7f9f5015df10 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f4d7fa640 1 -- 172.21.15.5:0/1056198082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40030b30 con 0x7f9f5015df10 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f500c7c00 con 0x7f9f5015df10 2024-04-25T08:57:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.694+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500c81c0 con 0x7f9f5015df10 2024-04-25T08:57:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.695+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5004ef20 con 0x7f9f5015df10 2024-04-25T08:57:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.696+0000 7f9f4d7fa640 1 -- 172.21.15.5:0/1056198082 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f40030cd0 con 0x7f9f5015df10 2024-04-25T08:57:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.696+0000 7f9f4d7fa640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3c06b500 0x7f9f3c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.696+0000 7f9f4d7fa640 1 -- 172.21.15.5:0/1056198082 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f400aad00 con 0x7f9f5015df10 2024-04-25T08:57:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.696+0000 7f9f54b71640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3c06b500 0x7f9f3c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.697+0000 7f9f54b71640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3c06b500 0x7f9f3c06d9c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f48007f30 tx=0x7f9f48007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.700+0000 7f9f4d7fa640 1 -- 172.21.15.5:0/1056198082 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f40079530 con 0x7f9f5015df10 2024-04-25T08:57:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.880+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f50066f20 con 0x7f9f5015df10 2024-04-25T08:57:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.881+0000 7f9f4d7fa640 1 -- 172.21.15.5:0/1056198082 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f4007d5d0 con 0x7f9f5015df10 2024-04-25T08:57:15.871 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3c06b500 msgr2=0x7f9f3c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3c06b500 0x7f9f3c06d9c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f48007f30 tx=0x7f9f48007e80 comp rx=0 tx=0).stop 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5015df10 msgr2=0x7f9f50159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5015df10 0x7f9f50159ff0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9f400097a0 tx=0x7f9f400046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 shutdown_connections 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3c06b500 0x7f9f3c06d9c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5015df10 0x7f9f50159ff0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f500cefe0 0x7f9f500c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 --2- 172.21.15.5:0/1056198082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f500b6250 0x7f9f50154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 >> 172.21.15.5:0/1056198082 conn(0x7f9f500668f0 msgr2=0x7f9f500b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 shutdown_connections 2024-04-25T08:57:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.883+0000 7f9f56dd5640 1 -- 172.21.15.5:0/1056198082 wait complete. 2024-04-25T08:57:15.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:57:15.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.994+0000 7f0fbb73b640 1 Processor -- start 2024-04-25T08:57:15.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.995+0000 7f0fbb73b640 1 -- start start 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.995+0000 7f0fbb73b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0fb40b0a50 0x7f0fb40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.995+0000 7f0fbb73b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40cbf40 0x7f0fb40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.995+0000 7f0fbb73b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb406ba50 con 0x7f0fb40b0e30 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.995+0000 7f0fbb73b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb406b800 con 0x7f0fb40b0a50 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.995+0000 7f0fbb73b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb406bd30 con 0x7f0fb40cbf40 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb8cd6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0fb40b0e30 0x7f0fb40d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42832/0 (socket says 172.21.15.5:42832) 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb8cd6640 1 -- 172.21.15.5:0/2000426620 learned_addr learned my addr 172.21.15.5:0/2000426620 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb94d7640 1 --2- 172.21.15.5:0/2000426620 >> v2:172.21.15.80:3300/0 conn(0x7f0fb40b0a50 0x7f0fb40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb9cd8640 1 --2- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40cbf40 0x7f0fb40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fabfff640 1 -- 172.21.15.5:0/2000426620 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945659895 0 0) 0x7f0fb406ba50 con 0x7f0fb40b0e30 2024-04-25T08:57:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fabfff640 1 -- 172.21.15.5:0/2000426620 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa0003520 con 0x7f0fb40b0e30 2024-04-25T08:57:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb94d7640 1 -- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40cbf40 msgr2=0x7f0fb40ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb94d7640 1 --2- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40cbf40 0x7f0fb40ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb94d7640 1 -- 172.21.15.5:0/2000426620 >> v1:172.21.15.5:6789/0 conn(0x7f0fb40b0e30 legacy=0x7f0fb40d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.996+0000 7f0fb94d7640 1 -- 172.21.15.5:0/2000426620 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb406c010 con 0x7f0fb40b0a50 2024-04-25T08:57:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.997+0000 7f0fb94d7640 1 --2- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0a50 0x7f0fb40ce200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00097a0 tx=0x7f0fb002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20ec5aac76b8dec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.997+0000 7f0fabfff640 1 -- 172.21.15.5:0/2000426620 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0037070 con 0x7f0fb40b0a50 2024-04-25T08:57:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.997+0000 7f0fabfff640 1 -- 172.21.15.5:0/2000426620 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb002ae50 con 0x7f0fb40b0a50 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.997+0000 7f0fabfff640 1 -- 172.21.15.5:0/2000426620 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0032640 con 0x7f0fb40b0a50 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 -- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0a50 msgr2=0x7f0fb40ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0a50 0x7f0fb40ce200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00097a0 tx=0x7f0fb002a100 comp rx=0 tx=0).stop 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 -- 172.21.15.5:0/2000426620 shutdown_connections 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40cbf40 0x7f0fb40ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/2000426620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0a50 0x7f0fb40ce200 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 -- 172.21.15.5:0/2000426620 >> 172.21.15.5:0/2000426620 conn(0x7f0fb40d18f0 msgr2=0x7f0fb40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 -- 172.21.15.5:0/2000426620 shutdown_connections 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.998+0000 7f0fbb73b640 1 -- 172.21.15.5:0/2000426620 wait complete. 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.999+0000 7f0fbb73b640 1 Processor -- start 2024-04-25T08:57:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:15.999+0000 7f0fbb73b640 1 -- start start 2024-04-25T08:57:15.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fbb73b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40b0a50 0x7f0fb4157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fbb73b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0e30 0x7f0fb40ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fbb73b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cbf40 0x7f0fb40b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fbb73b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40b2bf0 con 0x7f0fb40cbf40 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fbb73b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40cfd60 con 0x7f0fb40b0e30 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fbb73b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c8eb0 con 0x7f0fb40b0a50 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cbf40 0x7f0fb40b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cbf40 0x7f0fb40b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39848/0 (socket says 172.21.15.5:39848) 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 -- 172.21.15.5:0/1126187462 learned_addr learned my addr 172.21.15.5:0/1126187462 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb8cd6640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0e30 0x7f0fb40ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb94d7640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40b0a50 0x7f0fb4157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 -- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40b0a50 msgr2=0x7f0fb4157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40b0a50 0x7f0fb4157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 -- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0e30 msgr2=0x7f0fb40ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0e30 0x7f0fb40ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 -- 172.21.15.5:0/1126187462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40b5380 con 0x7f0fb40cbf40 2024-04-25T08:57:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb8cd6640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0e30 0x7f0fb40ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb94d7640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40b0a50 0x7f0fb4157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fb9cd8640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cbf40 0x7f0fb40b5bc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00efc0 tx=0x7f0fac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fa9ffb640 1 -- 172.21.15.5:0/1126187462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac018020 con 0x7f0fb40cbf40 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fa9ffb640 1 -- 172.21.15.5:0/1126187462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac014480 con 0x7f0fb40cbf40 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb40b5660 con 0x7f0fb40cbf40 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.000+0000 7f0fa9ffb640 1 -- 172.21.15.5:0/1126187462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac014870 con 0x7f0fb40cbf40 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.001+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb40cada0 con 0x7f0fb40cbf40 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.002+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb406cd70 con 0x7f0fb40cbf40 2024-04-25T08:57:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.002+0000 7f0fa9ffb640 1 -- 172.21.15.5:0/1126187462 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0fac005d10 con 0x7f0fb40cbf40 2024-04-25T08:57:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.003+0000 7f0fa9ffb640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f9806b4d0 0x7f0f9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.003+0000 7f0fa9ffb640 1 -- 172.21.15.5:0/1126187462 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fac08aca0 con 0x7f0fb40cbf40 2024-04-25T08:57:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.003+0000 7f0fb94d7640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f9806b4d0 0x7f0f9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.003+0000 7f0fb94d7640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f9806b4d0 0x7f0f9806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0034000 tx=0x7f0fb002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:15.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.007+0000 7f0fa9ffb640 1 -- 172.21.15.5:0/1126187462 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0fac022070 con 0x7f0fb40cbf40 2024-04-25T08:57:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.198+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0fb404ef20 con 0x7f0fb40cbf40 2024-04-25T08:57:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.199+0000 7f0fa9ffb640 1 -- 172.21.15.5:0/1126187462 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0fac010040 con 0x7f0fb40cbf40 2024-04-25T08:57:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T08:57:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.200+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f9806b4d0 msgr2=0x7f0f9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.200+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f9806b4d0 0x7f0f9806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0034000 tx=0x7f0fb002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.200+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cbf40 msgr2=0x7f0fb40b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.200+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cbf40 0x7f0fb40b5bc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00efc0 tx=0x7f0fac00c490 comp rx=0 tx=0).stop 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 shutdown_connections 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f9806b4d0 0x7f0f9806d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cbf40 0x7f0fb40b5bc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fb40b0e30 0x7f0fb40ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 --2- 172.21.15.5:0/1126187462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fb40b0a50 0x7f0fb4157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 >> 172.21.15.5:0/1126187462 conn(0x7f0fb40d18f0 msgr2=0x7f0fb415ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 shutdown_connections 2024-04-25T08:57:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.201+0000 7f0fbb73b640 1 -- 172.21.15.5:0/1126187462 wait complete. 2024-04-25T08:57:16.201 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T08:57:16.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:16.201 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T08:57:16.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:57:16.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:16.232 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T08:57:16.295 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:16.295 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:16.311 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:16.312 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:16.367 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:16.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:16.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:57:16.410 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:57:16.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.610+0000 7fab72af5640 1 Processor -- start 2024-04-25T08:57:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.610+0000 7fab72af5640 1 -- start start 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab72af5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab6c154f10 0x7fab6c0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab72af5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab6c0cfc90 0x7fab6c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab72af5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0b3f30 con 0x7fab6c15bbd0 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab72af5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c15b0f0 con 0x7fab6c0cfc90 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab72af5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c15b3d0 con 0x7fab6c154f10 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab71092640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab6c0cfc90 0x7fab6c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab6bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fab6c15bbd0 0x7fab6c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42836/0 (socket says 172.21.15.5:42836) 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab6bfff640 1 -- 172.21.15.5:0/2371207105 learned_addr learned my addr 172.21.15.5:0/2371207105 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab70891640 1 --2- 172.21.15.5:0/2371207105 >> v2:172.21.15.80:3300/0 conn(0x7fab6c154f10 0x7fab6c0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab71092640 1 -- 172.21.15.5:0/2371207105 >> v2:172.21.15.80:3300/0 conn(0x7fab6c154f10 msgr2=0x7fab6c0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab71092640 1 --2- 172.21.15.5:0/2371207105 >> v2:172.21.15.80:3300/0 conn(0x7fab6c154f10 0x7fab6c0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab71092640 1 -- 172.21.15.5:0/2371207105 >> v1:172.21.15.5:6789/0 conn(0x7fab6c15bbd0 legacy=0x7fab6c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.611+0000 7fab71092640 1 -- 172.21.15.5:0/2371207105 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c1552f0 con 0x7fab6c0cfc90 2024-04-25T08:57:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.612+0000 7fab71092640 1 --2- 172.21.15.5:0/2371207105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c0cfc90 0x7fab6c070f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0b2610 tx=0x7fab6402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac948626e3977a7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.612+0000 7fab6b7fe640 1 -- 172.21.15.5:0/2371207105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64007740 con 0x7fab6c0cfc90 2024-04-25T08:57:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.612+0000 7fab6b7fe640 1 -- 172.21.15.5:0/2371207105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab640078e0 con 0x7fab6c0cfc90 2024-04-25T08:57:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.612+0000 7fab6b7fe640 1 -- 172.21.15.5:0/2371207105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64007cb0 con 0x7fab6c0cfc90 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 -- 172.21.15.5:0/2371207105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c0cfc90 msgr2=0x7fab6c070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 --2- 172.21.15.5:0/2371207105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c0cfc90 0x7fab6c070f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0b2610 tx=0x7fab6402a5f0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 -- 172.21.15.5:0/2371207105 shutdown_connections 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 --2- 172.21.15.5:0/2371207105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c0cfc90 0x7fab6c070f50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 --2- 172.21.15.5:0/2371207105 >> v2:172.21.15.80:3300/0 conn(0x7fab6c154f10 0x7fab6c0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 -- 172.21.15.5:0/2371207105 >> 172.21.15.5:0/2371207105 conn(0x7fab6c0668f0 msgr2=0x7fab6c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 -- 172.21.15.5:0/2371207105 shutdown_connections 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.613+0000 7fab72af5640 1 -- 172.21.15.5:0/2371207105 wait complete. 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.614+0000 7fab72af5640 1 Processor -- start 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.614+0000 7fab72af5640 1 -- start start 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab72af5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab6c0cfc90 0x7fab6c14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab72af5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6c154f10 0x7fab6c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab72af5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c15bbd0 0x7fab6c14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab72af5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0b3b30 con 0x7fab6c15bbd0 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab72af5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0b39b0 con 0x7fab6c154f10 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab72af5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0b3cb0 con 0x7fab6c0cfc90 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c15bbd0 0x7fab6c14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c15bbd0 0x7fab6c14dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39860/0 (socket says 172.21.15.5:39860) 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 -- 172.21.15.5:0/1912281344 learned_addr learned my addr 172.21.15.5:0/1912281344 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 -- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab6c0cfc90 msgr2=0x7fab6c14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab6c0cfc90 0x7fab6c14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 -- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6c154f10 msgr2=0x7fab6c14d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6c154f10 0x7fab6c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 -- 172.21.15.5:0/1912281344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c150ce0 con 0x7fab6c15bbd0 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.615+0000 7fab71092640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c15bbd0 0x7fab6c14dd00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab6402abe0 tx=0x7fab64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.616+0000 7fab697fa640 1 -- 172.21.15.5:0/1912281344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64040070 con 0x7fab6c15bbd0 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.616+0000 7fab697fa640 1 -- 172.21.15.5:0/1912281344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64031bc0 con 0x7fab6c15bbd0 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.616+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c150fa0 con 0x7fab6c15bbd0 2024-04-25T08:57:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.616+0000 7fab697fa640 1 -- 172.21.15.5:0/1912281344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64045460 con 0x7fab6c15bbd0 2024-04-25T08:57:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.616+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c151560 con 0x7fab6c15bbd0 2024-04-25T08:57:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.617+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c151d20 con 0x7fab6c15bbd0 2024-04-25T08:57:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.617+0000 7fab697fa640 1 -- 172.21.15.5:0/1912281344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab64039040 con 0x7fab6c15bbd0 2024-04-25T08:57:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.617+0000 7fab697fa640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab5006b4d0 0x7fab5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.618+0000 7fab697fa640 1 -- 172.21.15.5:0/1912281344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab640abb30 con 0x7fab6c15bbd0 2024-04-25T08:57:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.618+0000 7fab70891640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab5006b4d0 0x7fab5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.618+0000 7fab70891640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab5006b4d0 0x7fab5006d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab600098f0 tx=0x7fab60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.622+0000 7fab697fa640 1 -- 172.21.15.5:0/1912281344 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab6c151d20 con 0x7fab6c15bbd0 2024-04-25T08:57:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.805+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab6c04ef20 con 0x7fab6c15bbd0 2024-04-25T08:57:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.807+0000 7fab697fa640 1 -- 172.21.15.5:0/1912281344 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fab6407aad0 con 0x7fab6c15bbd0 2024-04-25T08:57:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:16.797 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.808+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab5006b4d0 msgr2=0x7fab5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.808+0000 7fab72af5640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab5006b4d0 0x7fab5006d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab600098f0 tx=0x7fab60008040 comp rx=0 tx=0).stop 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.808+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c15bbd0 msgr2=0x7fab6c14dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.808+0000 7fab72af5640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c15bbd0 0x7fab6c14dd00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab6402abe0 tx=0x7fab64004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 shutdown_connections 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fab5006b4d0 0x7fab5006d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab6c15bbd0 0x7fab6c14dd00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6c154f10 0x7fab6c14d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 --2- 172.21.15.5:0/1912281344 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fab6c0cfc90 0x7fab6c14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 >> 172.21.15.5:0/1912281344 conn(0x7fab6c0668f0 msgr2=0x7fab6c066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:16.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 shutdown_connections 2024-04-25T08:57:16.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.809+0000 7fab72af5640 1 -- 172.21.15.5:0/1912281344 wait complete. 2024-04-25T08:57:16.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:16.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.924+0000 7fc255342640 1 Processor -- start 2024-04-25T08:57:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.924+0000 7fc255342640 1 -- start start 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.924+0000 7fc255342640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc250154d80 0x7fc2500668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.924+0000 7fc255342640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc250066e30 0x7fc2500af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc255342640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25015e460 con 0x7fc2500afdf0 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc255342640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc250155160 con 0x7fc250066e30 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc255342640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25015f070 con 0x7fc250154d80 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc247fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc250066e30 0x7fc2500af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc247fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc250066e30 0x7fc2500af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39864/0 (socket says 172.21.15.5:39864) 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc247fff640 1 -- 172.21.15.5:0/788923640 learned_addr learned my addr 172.21.15.5:0/788923640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc24effd640 1 --2- 172.21.15.5:0/788923640 >> v2:172.21.15.80:3300/0 conn(0x7fc250154d80 0x7fc2500668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc247fff640 1 -- 172.21.15.5:0/788923640 >> v2:172.21.15.80:3300/0 conn(0x7fc250154d80 msgr2=0x7fc2500668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc247fff640 1 --2- 172.21.15.5:0/788923640 >> v2:172.21.15.80:3300/0 conn(0x7fc250154d80 0x7fc2500668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc247fff640 1 -- 172.21.15.5:0/788923640 >> v1:172.21.15.80:6789/0 conn(0x7fc2500afdf0 legacy=0x7fc2501619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.925+0000 7fc247fff640 1 -- 172.21.15.5:0/788923640 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25015e740 con 0x7fc250066e30 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc247fff640 1 --2- 172.21.15.5:0/788923640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500af8b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc25006c150 tx=0x7fc23802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1772bb0a7d0a555 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc24e7fc640 1 -- 172.21.15.5:0/788923640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc238037070 con 0x7fc250066e30 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc24e7fc640 1 -- 172.21.15.5:0/788923640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc238032440 con 0x7fc250066e30 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc24e7fc640 1 -- 172.21.15.5:0/788923640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc238032810 con 0x7fc250066e30 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc255342640 1 -- 172.21.15.5:0/788923640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 msgr2=0x7fc2500af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc255342640 1 --2- 172.21.15.5:0/788923640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500af8b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc25006c150 tx=0x7fc23802a270 comp rx=0 tx=0).stop 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc255342640 1 -- 172.21.15.5:0/788923640 shutdown_connections 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc255342640 1 --2- 172.21.15.5:0/788923640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500af8b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.926+0000 7fc255342640 1 --2- 172.21.15.5:0/788923640 >> v2:172.21.15.80:3300/0 conn(0x7fc250154d80 0x7fc2500668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.927+0000 7fc255342640 1 -- 172.21.15.5:0/788923640 >> 172.21.15.5:0/788923640 conn(0x7fc2500cd310 msgr2=0x7fc2500cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.927+0000 7fc255342640 1 -- 172.21.15.5:0/788923640 shutdown_connections 2024-04-25T08:57:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.927+0000 7fc255342640 1 -- 172.21.15.5:0/788923640 wait complete. 2024-04-25T08:57:16.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 Processor -- start 2024-04-25T08:57:16.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 -- start start 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2500afdf0 0x7fc2501472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc250154d80 0x7fc2500b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25015ed00 con 0x7fc250066e30 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500b0280 con 0x7fc2500afdf0 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.928+0000 7fc255342640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc250162100 con 0x7fc250154d80 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39876/0 (socket says 172.21.15.5:39876) 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 -- 172.21.15.5:0/1408419573 learned_addr learned my addr 172.21.15.5:0/1408419573 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24f7fe640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc250154d80 0x7fc2500b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc247fff640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2500afdf0 0x7fc2501472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 -- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc250154d80 msgr2=0x7fc2500b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc250154d80 0x7fc2500b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 -- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2500afdf0 msgr2=0x7fc2501472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2500afdf0 0x7fc2501472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 -- 172.21.15.5:0/1408419573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2501477f0 con 0x7fc250066e30 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc247fff640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2500afdf0 0x7fc2501472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc24effd640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500b6270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d5f0 tx=0x7fc24000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc2477fe640 1 -- 172.21.15.5:0/1408419573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400125f0 con 0x7fc250066e30 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc2477fe640 1 -- 172.21.15.5:0/1408419573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240019070 con 0x7fc250066e30 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2501e7f80 con 0x7fc250066e30 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc2477fe640 1 -- 172.21.15.5:0/1408419573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400129d0 con 0x7fc250066e30 2024-04-25T08:57:16.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.929+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2501e8540 con 0x7fc250066e30 2024-04-25T08:57:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.930+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2500746c0 con 0x7fc250066e30 2024-04-25T08:57:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.931+0000 7fc2477fe640 1 -- 172.21.15.5:0/1408419573 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc240012b70 con 0x7fc250066e30 2024-04-25T08:57:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.931+0000 7fc2477fe640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.931+0000 7fc2477fe640 1 -- 172.21.15.5:0/1408419573 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc24008a580 con 0x7fc250066e30 2024-04-25T08:57:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.931+0000 7fc247fff640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.932+0000 7fc247fff640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc23006b4d0 0x7fc23006d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc238034000 tx=0x7fc23802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:16.935+0000 7fc2477fe640 1 -- 172.21.15.5:0/1408419573 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2500746c0 con 0x7fc250066e30 2024-04-25T08:57:17.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.116+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc25004ef20 con 0x7fc250066e30 2024-04-25T08:57:17.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.116+0000 7fc2477fe640 1 -- 172.21.15.5:0/1408419573 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc240059490 con 0x7fc250066e30 2024-04-25T08:57:17.106 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc23006b4d0 msgr2=0x7fc23006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc23006b4d0 0x7fc23006d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc238034000 tx=0x7fc23802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 msgr2=0x7fc2500b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500b6270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d5f0 tx=0x7fc24000dab0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 shutdown_connections 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc250154d80 0x7fc2500b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2500afdf0 0x7fc2501472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 --2- 172.21.15.5:0/1408419573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc250066e30 0x7fc2500b6270 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 >> 172.21.15.5:0/1408419573 conn(0x7fc2500cd310 msgr2=0x7fc2500c9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 shutdown_connections 2024-04-25T08:57:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.118+0000 7fc255342640 1 -- 172.21.15.5:0/1408419573 wait complete. 2024-04-25T08:57:17.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.234+0000 7f984dc8f640 1 Processor -- start 2024-04-25T08:57:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.234+0000 7f984dc8f640 1 -- start start 2024-04-25T08:57:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f984dc8f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98480d2f70 0x7f98480ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f984dc8f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ced50 0x7f98480b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f984dc8f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98480d1ed0 con 0x7f984815df70 2024-04-25T08:57:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f984dc8f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480d1c80 con 0x7f98480d2f70 2024-04-25T08:57:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f984dc8f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480d2ae0 con 0x7f98480ced50 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f9846ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98480d2f70 0x7f98480ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f9847fff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ced50 0x7f98480b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f9846ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98480d2f70 0x7f98480ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:38736/0 (socket says 172.21.15.5:38736) 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f98477fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f984815df70 0x7f98480b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:36476/0 (socket says 172.21.15.5:36476) 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f9846ffd640 1 -- 172.21.15.5:0/4128524544 learned_addr learned my addr 172.21.15.5:0/4128524544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f98467fc640 1 -- 172.21.15.5:0/4128524544 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709993807 0 0) 0x7f98480d1ed0 con 0x7f984815df70 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.235+0000 7f98467fc640 1 -- 172.21.15.5:0/4128524544 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9830003520 con 0x7f984815df70 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.236+0000 7f9846ffd640 1 -- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ced50 msgr2=0x7f98480b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.236+0000 7f9846ffd640 1 --2- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ced50 0x7f98480b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.236+0000 7f9846ffd640 1 -- 172.21.15.5:0/4128524544 >> v1:172.21.15.80:6789/0 conn(0x7f984815df70 legacy=0x7f98480b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.236+0000 7f9846ffd640 1 -- 172.21.15.5:0/4128524544 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480d21b0 con 0x7f98480d2f70 2024-04-25T08:57:17.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.236+0000 7f9847fff640 1 --2- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ced50 0x7f98480b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.236+0000 7f9846ffd640 1 --2- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 0x7f98480ce810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f983c009870 tx=0x7f983c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a00986e52496ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.236+0000 7f98467fc640 1 -- 172.21.15.5:0/4128524544 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c037070 con 0x7f98480d2f70 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f98467fc640 1 -- 172.21.15.5:0/4128524544 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c02ae50 con 0x7f98480d2f70 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f98467fc640 1 -- 172.21.15.5:0/4128524544 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c032840 con 0x7f98480d2f70 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 -- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 msgr2=0x7f98480ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 --2- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 0x7f98480ce810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f983c009870 tx=0x7f983c02a300 comp rx=0 tx=0).stop 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 -- 172.21.15.5:0/4128524544 shutdown_connections 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 --2- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ced50 0x7f98480b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 --2- 172.21.15.5:0/4128524544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 0x7f98480ce810 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 -- 172.21.15.5:0/4128524544 >> 172.21.15.5:0/4128524544 conn(0x7f984806b000 msgr2=0x7f984806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 -- 172.21.15.5:0/4128524544 shutdown_connections 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.237+0000 7f984dc8f640 1 -- 172.21.15.5:0/4128524544 wait complete. 2024-04-25T08:57:17.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.238+0000 7f984dc8f640 1 Processor -- start 2024-04-25T08:57:17.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.238+0000 7f984dc8f640 1 -- start start 2024-04-25T08:57:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f984dc8f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480ced50 0x7f98480cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f984dc8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 0x7f98480aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f984dc8f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ab440 0x7f98480b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f984dc8f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480d3720 con 0x7f98480ced50 2024-04-25T08:57:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f984dc8f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480d2770 con 0x7f98480d2f70 2024-04-25T08:57:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f984dc8f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480d38a0 con 0x7f98480ab440 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f98477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480ced50 0x7f98480cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f98477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480ced50 0x7f98480cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39886/0 (socket says 172.21.15.5:39886) 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f98477fe640 1 -- 172.21.15.5:0/1558194169 learned_addr learned my addr 172.21.15.5:0/1558194169 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f98477fe640 1 -- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ab440 msgr2=0x7f98480b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f9846ffd640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 0x7f98480aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.239+0000 7f9847fff640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ab440 0x7f98480b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f98477fe640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ab440 0x7f98480b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f98477fe640 1 -- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 msgr2=0x7f98480aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f98477fe640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 0x7f98480aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f98477fe640 1 -- 172.21.15.5:0/1558194169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98481f4490 con 0x7f98480ced50 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f98477fe640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480ced50 0x7f98480cbe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f983800c460 tx=0x7f983800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f982ffff640 1 -- 172.21.15.5:0/1558194169 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838018070 con 0x7f98480ced50 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f982ffff640 1 -- 172.21.15.5:0/1558194169 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98380074a0 con 0x7f98480ced50 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f982ffff640 1 -- 172.21.15.5:0/1558194169 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838004a20 con 0x7f98480ced50 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98481f4770 con 0x7f98480ced50 2024-04-25T08:57:17.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.240+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98481f4d30 con 0x7f98480ced50 2024-04-25T08:57:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.241+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984804ef20 con 0x7f98480ced50 2024-04-25T08:57:17.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.241+0000 7f982ffff640 1 -- 172.21.15.5:0/1558194169 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9838004bc0 con 0x7f98480ced50 2024-04-25T08:57:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.242+0000 7f982ffff640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983406b500 0x7f983406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.242+0000 7f982ffff640 1 -- 172.21.15.5:0/1558194169 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9838089500 con 0x7f98480ced50 2024-04-25T08:57:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.242+0000 7f9846ffd640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983406b500 0x7f983406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.242+0000 7f9846ffd640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983406b500 0x7f983406d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f983c034000 tx=0x7f983c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.246+0000 7f982ffff640 1 -- 172.21.15.5:0/1558194169 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9838007650 con 0x7f98480ced50 2024-04-25T08:57:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.425+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98480b6820 con 0x7f98480ced50 2024-04-25T08:57:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.425+0000 7f982ffff640 1 -- 172.21.15.5:0/1558194169 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98380583c0 con 0x7f98480ced50 2024-04-25T08:57:17.417 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983406b500 msgr2=0x7f983406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983406b500 0x7f983406d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f983c034000 tx=0x7f983c02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480ced50 msgr2=0x7f98480cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480ced50 0x7f98480cbe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f983800c460 tx=0x7f983800c920 comp rx=0 tx=0).stop 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 shutdown_connections 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983406b500 0x7f983406d9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98480ab440 0x7f98480b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98480d2f70 0x7f98480aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 --2- 172.21.15.5:0/1558194169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98480ced50 0x7f98480cbe60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 >> 172.21.15.5:0/1558194169 conn(0x7f984806b000 msgr2=0x7f98480d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 shutdown_connections 2024-04-25T08:57:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.427+0000 7f984dc8f640 1 -- 172.21.15.5:0/1558194169 wait complete. 2024-04-25T08:57:17.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:17.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.542+0000 7f75d2e1f640 1 Processor -- start 2024-04-25T08:57:17.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.542+0000 7f75d2e1f640 1 -- start start 2024-04-25T08:57:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.542+0000 7f75d2e1f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f75cc0b96e0 0x7f75cc0d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d2e1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75cc0d4060 0x7f75cc0b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d2e1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0b9b20 con 0x7f75cc1614b0 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d2e1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0d44d0 con 0x7f75cc0d4060 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d2e1f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0d2740 con 0x7f75cc0b96e0 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d13bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75cc0d4060 0x7f75cc0b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d0bbb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75cc1614b0 0x7f75cc0d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42844/0 (socket says 172.21.15.5:42844) 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d0bbb640 1 -- 172.21.15.5:0/1760106324 learned_addr learned my addr 172.21.15.5:0/1760106324 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75cbfff640 1 --2- 172.21.15.5:0/1760106324 >> v2:172.21.15.80:3300/0 conn(0x7f75cc0b96e0 0x7f75cc0d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d13bc640 1 -- 172.21.15.5:0/1760106324 >> v2:172.21.15.80:3300/0 conn(0x7f75cc0b96e0 msgr2=0x7f75cc0d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d13bc640 1 --2- 172.21.15.5:0/1760106324 >> v2:172.21.15.80:3300/0 conn(0x7f75cc0b96e0 0x7f75cc0d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d13bc640 1 -- 172.21.15.5:0/1760106324 >> v1:172.21.15.5:6789/0 conn(0x7f75cc1614b0 legacy=0x7f75cc0d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75cb7fe640 1 -- 172.21.15.5:0/1760106324 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154698670 0 0) 0x7f75cc0b9b20 con 0x7f75cc1614b0 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75d13bc640 1 -- 172.21.15.5:0/1760106324 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0d2a20 con 0x7f75cc0d4060 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.543+0000 7f75cbfff640 1 --2- 172.21.15.5:0/1760106324 >> v2:172.21.15.80:3300/0 conn(0x7f75cc0b96e0 0x7f75cc0d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75d13bc640 1 --2- 172.21.15.5:0/1760106324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0d4060 0x7f75cc0b6cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0ce4e0 tx=0x7f75c402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7a7edb1e536f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75cb7fe640 1 -- 172.21.15.5:0/1760106324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4007740 con 0x7f75cc0d4060 2024-04-25T08:57:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75cb7fe640 1 -- 172.21.15.5:0/1760106324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c40078e0 con 0x7f75cc0d4060 2024-04-25T08:57:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75cb7fe640 1 -- 172.21.15.5:0/1760106324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4007cb0 con 0x7f75cc0d4060 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1760106324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0d4060 msgr2=0x7f75cc0b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1760106324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0d4060 0x7f75cc0b6cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0ce4e0 tx=0x7f75c402a680 comp rx=0 tx=0).stop 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1760106324 shutdown_connections 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1760106324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0d4060 0x7f75cc0b6cc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1760106324 >> v2:172.21.15.80:3300/0 conn(0x7f75cc0b96e0 0x7f75cc0d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.544+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1760106324 >> 172.21.15.5:0/1760106324 conn(0x7f75cc06b000 msgr2=0x7f75cc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.545+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1760106324 shutdown_connections 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.545+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1760106324 wait complete. 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.546+0000 7f75d2e1f640 1 Processor -- start 2024-04-25T08:57:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.546+0000 7f75d2e1f640 1 -- start start 2024-04-25T08:57:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d2e1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0b96e0 0x7f75cc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d2e1f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75cc0d4060 0x7f75cc0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d2e1f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75cc1614b0 0x7f75cc14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d2e1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0d32c0 con 0x7f75cc0b96e0 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d2e1f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0d2fe0 con 0x7f75cc1614b0 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d2e1f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0d37e0 con 0x7f75cc0d4060 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0b96e0 0x7f75cc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0b96e0 0x7f75cc0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39916/0 (socket says 172.21.15.5:39916) 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 -- 172.21.15.5:0/1619843252 learned_addr learned my addr 172.21.15.5:0/1619843252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d13bc640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75cc1614b0 0x7f75cc14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 -- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75cc0d4060 msgr2=0x7f75cc0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75cbfff640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75cc0d4060 0x7f75cc0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75cc0d4060 0x7f75cc0cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 -- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75cc1614b0 msgr2=0x7f75cc14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75cc1614b0 0x7f75cc14ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 -- 172.21.15.5:0/1619843252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0ca510 con 0x7f75cc0b96e0 2024-04-25T08:57:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d13bc640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75cc1614b0 0x7f75cc14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75cbfff640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75cc0d4060 0x7f75cc0cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d0bbb640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0b96e0 0x7f75cc0c9fd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c430 tx=0x7f75c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75c97fa640 1 -- 172.21.15.5:0/1619843252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0017070 con 0x7f75cc0b96e0 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75c97fa640 1 -- 172.21.15.5:0/1619843252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0005ce0 con 0x7f75cc0b96e0 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75c97fa640 1 -- 172.21.15.5:0/1619843252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0007310 con 0x7f75cc0b96e0 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.547+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc0c8c80 con 0x7f75cc0b96e0 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.548+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc0c9240 con 0x7f75cc0b96e0 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.548+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc0b6900 con 0x7f75cc0b96e0 2024-04-25T08:57:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.549+0000 7f75c97fa640 1 -- 172.21.15.5:0/1619843252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f75c001a070 con 0x7f75cc0b96e0 2024-04-25T08:57:17.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.549+0000 7f75c97fa640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75b006b4d0 0x7f75b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.549+0000 7f75c97fa640 1 -- 172.21.15.5:0/1619843252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75c00896c0 con 0x7f75cc0b96e0 2024-04-25T08:57:17.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.550+0000 7f75cbfff640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75b006b4d0 0x7f75b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.550+0000 7f75cbfff640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75b006b4d0 0x7f75b006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b8006fd0 tx=0x7f75b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.554+0000 7f75c97fa640 1 -- 172.21.15.5:0/1619843252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75cc0b6900 con 0x7f75cc0b96e0 2024-04-25T08:57:17.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.731+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75cc04ef20 con 0x7f75cc0b96e0 2024-04-25T08:57:17.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.732+0000 7f75c97fa640 1 -- 172.21.15.5:0/1619843252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75c00584a0 con 0x7f75cc0b96e0 2024-04-25T08:57:17.722 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:17.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.733+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75b006b4d0 msgr2=0x7f75b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.733+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75b006b4d0 0x7f75b006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b8006fd0 tx=0x7f75b8008040 comp rx=0 tx=0).stop 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.733+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0b96e0 msgr2=0x7f75cc0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.733+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0b96e0 0x7f75cc0c9fd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c430 tx=0x7f75c000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 shutdown_connections 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75b006b4d0 0x7f75b006d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75cc1614b0 0x7f75cc14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75cc0d4060 0x7f75cc0cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 --2- 172.21.15.5:0/1619843252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75cc0b96e0 0x7f75cc0c9fd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 >> 172.21.15.5:0/1619843252 conn(0x7f75cc06b000 msgr2=0x7f75cc15e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 shutdown_connections 2024-04-25T08:57:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.734+0000 7f75d2e1f640 1 -- 172.21.15.5:0/1619843252 wait complete. 2024-04-25T08:57:17.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:57:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.846+0000 7ff101e9e640 1 Processor -- start 2024-04-25T08:57:17.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.846+0000 7ff101e9e640 1 -- start start 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.847+0000 7ff101e9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.847+0000 7ff101e9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0fc0cd6e0 0x7ff0fc0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.847+0000 7ff101e9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0cdcb0 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.847+0000 7ff101e9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc0cec40 con 0x7ff0fc0cd6e0 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.847+0000 7ff101e9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0cdf90 con 0x7ff0fc15bdc0 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.847+0000 7ff0fbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff0fc0ce7d0 0x7ff0fc0cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42854/0 (socket says 172.21.15.5:42854) 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.847+0000 7ff0fbfff640 1 -- 172.21.15.5:0/2299393163 learned_addr learned my addr 172.21.15.5:0/2299393163 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0faffd640 1 --2- 172.21.15.5:0/2299393163 >> v2:172.21.15.80:3300/0 conn(0x7ff0fc0cd6e0 0x7ff0fc0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0fb7fe640 1 --2- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0fa7fc640 1 -- 172.21.15.5:0/2299393163 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806158268 0 0) 0x7ff0fc0cdcb0 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0fa7fc640 1 -- 172.21.15.5:0/2299393163 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e4003520 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0faffd640 1 -- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc15bdc0 msgr2=0x7ff0fc0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0faffd640 1 --2- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0faffd640 1 -- 172.21.15.5:0/2299393163 >> v1:172.21.15.5:6789/0 conn(0x7ff0fc0ce7d0 legacy=0x7ff0fc0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0faffd640 1 -- 172.21.15.5:0/2299393163 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0b47e0 con 0x7ff0fc0cd6e0 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.848+0000 7ff0fb7fe640 1 --2- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff0faffd640 1 --2- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc0cd6e0 0x7ff0fc0ce290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00097a0 tx=0x7ff0f002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e129e4cb8a198b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff0fa7fc640 1 -- 172.21.15.5:0/2299393163 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0037070 con 0x7ff0fc0cd6e0 2024-04-25T08:57:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff0fa7fc640 1 -- 172.21.15.5:0/2299393163 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f0032440 con 0x7ff0fc0cd6e0 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff0fa7fc640 1 -- 172.21.15.5:0/2299393163 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0032810 con 0x7ff0fc0cd6e0 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff101e9e640 1 -- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc0cd6e0 msgr2=0x7ff0fc0ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff101e9e640 1 --2- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc0cd6e0 0x7ff0fc0ce290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00097a0 tx=0x7ff0f002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff101e9e640 1 -- 172.21.15.5:0/2299393163 shutdown_connections 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff101e9e640 1 --2- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc0cd6e0 0x7ff0fc0ce290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff101e9e640 1 --2- 172.21.15.5:0/2299393163 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.849+0000 7ff101e9e640 1 -- 172.21.15.5:0/2299393163 >> 172.21.15.5:0/2299393163 conn(0x7ff0fc0d18f0 msgr2=0x7ff0fc0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.850+0000 7ff101e9e640 1 -- 172.21.15.5:0/2299393163 shutdown_connections 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.850+0000 7ff101e9e640 1 -- 172.21.15.5:0/2299393163 wait complete. 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.851+0000 7ff101e9e640 1 Processor -- start 2024-04-25T08:57:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.851+0000 7ff101e9e640 1 -- start start 2024-04-25T08:57:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc0cd6e0 0x7ff0fc151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0fc0ce7d0 0x7ff0fc150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0d09a0 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b4da0 con 0x7ff0fc15bdc0 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc15c1a0 con 0x7ff0fc0cd6e0 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0fc0ce7d0 0x7ff0fc150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0fc0ce7d0 0x7ff0fc150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39930/0 (socket says 172.21.15.5:39930) 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 -- 172.21.15.5:0/3204978265 learned_addr learned my addr 172.21.15.5:0/3204978265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0fbfff640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0fb7fe640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc0cd6e0 0x7ff0fc151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 -- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc0cd6e0 msgr2=0x7ff0fc151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc0cd6e0 0x7ff0fc151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 -- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc15bdc0 msgr2=0x7ff0fc0cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 -- 172.21.15.5:0/3204978265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc1521c0 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0fbfff640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0faffd640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0fc0ce7d0 0x7ff0fc150c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0035040 tx=0x7ff0f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0e3fff640 1 -- 172.21.15.5:0/3204978265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0041030 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0e3fff640 1 -- 172.21.15.5:0/3204978265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f003d4e0 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc0c7ca0 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff0e3fff640 1 -- 172.21.15.5:0/3204978265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0037040 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.852+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc0c7f20 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.853+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc04ef20 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.854+0000 7ff0e3fff640 1 -- 172.21.15.5:0/3204978265 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0f0044070 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.854+0000 7ff0e3fff640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.854+0000 7ff0e3fff640 1 -- 172.21.15.5:0/3204978265 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0f00aa880 con 0x7ff0fc0ce7d0 2024-04-25T08:57:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.855+0000 7ff0fb7fe640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.855+0000 7ff0fb7fe640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff0e806b4d0 0x7ff0e806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc15d750 tx=0x7ff0ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:17.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:17.859+0000 7ff0e3fff640 1 -- 172.21.15.5:0/3204978265 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0fc0c7ca0 con 0x7ff0fc0ce7d0 2024-04-25T08:57:18.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.051+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0fc0d1190 con 0x7ff0fc0ce7d0 2024-04-25T08:57:18.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.051+0000 7ff0e3fff640 1 -- 172.21.15.5:0/3204978265 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff0f0044e40 con 0x7ff0fc0ce7d0 2024-04-25T08:57:18.041 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T08:57:18.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff0e806b4d0 msgr2=0x7ff0e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff0e806b4d0 0x7ff0e806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc15d750 tx=0x7ff0ec008040 comp rx=0 tx=0).stop 2024-04-25T08:57:18.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0fc0ce7d0 msgr2=0x7ff0fc150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0fc0ce7d0 0x7ff0fc150c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0035040 tx=0x7ff0f00046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 shutdown_connections 2024-04-25T08:57:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0fc15bdc0 0x7ff0fc0cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0fc0ce7d0 0x7ff0fc150c50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 --2- 172.21.15.5:0/3204978265 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff0fc0cd6e0 0x7ff0fc151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 >> 172.21.15.5:0/3204978265 conn(0x7ff0fc0d18f0 msgr2=0x7ff0fc0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 shutdown_connections 2024-04-25T08:57:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.053+0000 7ff101e9e640 1 -- 172.21.15.5:0/3204978265 wait complete. 2024-04-25T08:57:18.054 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T08:57:18.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:18.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T08:57:18.079 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:57:18.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:18.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T08:57:18.135 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:18.135 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:18.153 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:18.153 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:18.211 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:57:18.211 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:18.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:18.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.381+0000 7f6bc9493640 1 Processor -- start 2024-04-25T08:57:18.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.381+0000 7f6bc9493640 1 -- start start 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc9493640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc9493640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6bc40d3990 0x7f6bc40d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc9493640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40b7f60 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc9493640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40d4330 con 0x7f6bc40d3990 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc9493640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40b29c0 con 0x7f6bc415e0a0 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc27fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6bc40d3990 0x7f6bc40d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc27fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6bc40d3990 0x7f6bc40d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39944/0 (socket says 172.21.15.5:39944) 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc27fc640 1 -- 172.21.15.5:0/1100379660 learned_addr learned my addr 172.21.15.5:0/1100379660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc37fe640 1 --1- 172.21.15.5:0/1100379660 >> v1:172.21.15.5:6789/0 conn(0x7f6bc40ce5e0 0x7f6bc40cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42858/0 (socket says 172.21.15.5:42858) 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc2ffd640 1 --2- 172.21.15.5:0/1100379660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc27fc640 1 -- 172.21.15.5:0/1100379660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 msgr2=0x7f6bc40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:18.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc27fc640 1 --2- 172.21.15.5:0/1100379660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc27fc640 1 -- 172.21.15.5:0/1100379660 >> v1:172.21.15.5:6789/0 conn(0x7f6bc40ce5e0 legacy=0x7f6bc40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc27fc640 1 -- 172.21.15.5:0/1100379660 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40d2080 con 0x7f6bc40d3990 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/1100379660 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972563993 0 0) 0x7f6bc40b7f60 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.382+0000 7f6bc2ffd640 1 --2- 172.21.15.5:0/1100379660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.383+0000 7f6bc27fc640 1 --2- 172.21.15.5:0/1100379660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40d3990 0x7f6bc40d3df0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009870 tx=0x7f6bb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b47d9cec77131b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.383+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/1100379660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8037070 con 0x7f6bc40d3990 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.383+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/1100379660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8032440 con 0x7f6bc40d3990 2024-04-25T08:57:18.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.383+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/1100379660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8032810 con 0x7f6bc40d3990 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 -- 172.21.15.5:0/1100379660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40d3990 msgr2=0x7f6bc40d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 --2- 172.21.15.5:0/1100379660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40d3990 0x7f6bc40d3df0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009870 tx=0x7f6bb802a270 comp rx=0 tx=0).stop 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 -- 172.21.15.5:0/1100379660 shutdown_connections 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 --2- 172.21.15.5:0/1100379660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40d3990 0x7f6bc40d3df0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 --2- 172.21.15.5:0/1100379660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 -- 172.21.15.5:0/1100379660 >> 172.21.15.5:0/1100379660 conn(0x7f6bc40668f0 msgr2=0x7f6bc4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 -- 172.21.15.5:0/1100379660 shutdown_connections 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.384+0000 7f6bc9493640 1 -- 172.21.15.5:0/1100379660 wait complete. 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.385+0000 7f6bc9493640 1 Processor -- start 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.385+0000 7f6bc9493640 1 -- start start 2024-04-25T08:57:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc9493640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40ce5e0 0x7f6bc414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc9493640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc40d3990 0x7f6bc41f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc9493640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc9493640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40d2920 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc9493640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40d2640 con 0x7f6bc40d3990 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc9493640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40d2c00 con 0x7f6bc415e0a0 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40ce5e0 0x7f6bc414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40ce5e0 0x7f6bc414ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39950/0 (socket says 172.21.15.5:39950) 2024-04-25T08:57:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 -- 172.21.15.5:0/3796400863 learned_addr learned my addr 172.21.15.5:0/3796400863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc27fc640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc40d3990 0x7f6bc41f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc37fe640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 -- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 msgr2=0x7f6bc40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 -- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc40d3990 msgr2=0x7f6bc41f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc40d3990 0x7f6bc41f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 -- 172.21.15.5:0/3796400863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc414f4d0 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.386+0000 7f6bc2ffd640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40ce5e0 0x7f6bc414ef90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400cf60 tx=0x7f6bb400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.387+0000 7f6bab7fe640 1 -- 172.21.15.5:0/3796400863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb401a070 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.387+0000 7f6bab7fe640 1 -- 172.21.15.5:0/3796400863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400d840 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.387+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc4161060 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.387+0000 7f6bab7fe640 1 -- 172.21.15.5:0/3796400863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400dc10 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.387+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc40caff0 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.388+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc404ef20 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.388+0000 7f6bab7fe640 1 -- 172.21.15.5:0/3796400863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6bb401d070 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.389+0000 7f6bab7fe640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bb006b4d0 0x7f6bb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.389+0000 7f6bab7fe640 1 -- 172.21.15.5:0/3796400863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bb408a8c0 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.389+0000 7f6bc27fc640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bb006b4d0 0x7f6bb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.389+0000 7f6bc27fc640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bb006b4d0 0x7f6bb006d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8034000 tx=0x7f6bb802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:18.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.393+0000 7f6bab7fe640 1 -- 172.21.15.5:0/3796400863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6bb4059180 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.574+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc415d670 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.575+0000 7f6bab7fe640 1 -- 172.21.15.5:0/3796400863 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f6bb405d220 con 0x7f6bc40ce5e0 2024-04-25T08:57:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:18.565 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bb006b4d0 msgr2=0x7f6bb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bb006b4d0 0x7f6bb006d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8034000 tx=0x7f6bb802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40ce5e0 msgr2=0x7f6bc414ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40ce5e0 0x7f6bc414ef90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400cf60 tx=0x7f6bb400cf90 comp rx=0 tx=0).stop 2024-04-25T08:57:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 shutdown_connections 2024-04-25T08:57:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bb006b4d0 0x7f6bb006d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6bc415e0a0 0x7f6bc40cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc40d3990 0x7f6bc41f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 --2- 172.21.15.5:0/3796400863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc40ce5e0 0x7f6bc414ef90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 >> 172.21.15.5:0/3796400863 conn(0x7f6bc40668f0 msgr2=0x7f6bc40cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 shutdown_connections 2024-04-25T08:57:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.577+0000 7f6bc9493640 1 -- 172.21.15.5:0/3796400863 wait complete. 2024-04-25T08:57:18.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:18.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.692+0000 7f1534e22640 1 Processor -- start 2024-04-25T08:57:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.692+0000 7f1534e22640 1 -- start start 2024-04-25T08:57:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f1534e22640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15300724a0 0x7f15301619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f1534e22640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153015e460 con 0x7f1530067000 2024-04-25T08:57:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f1534e22640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153015e740 con 0x7f1530154d80 2024-04-25T08:57:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f1534e22640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1530155160 con 0x7f15300724a0 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f152ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15300724a0 0x7f15301619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f152dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1530067000 0x7f15300af8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42864/0 (socket says 172.21.15.5:42864) 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f152dd9b640 1 -- 172.21.15.5:0/1884376559 learned_addr learned my addr 172.21.15.5:0/1884376559 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.693+0000 7f152ed9d640 1 --2- 172.21.15.5:0/1884376559 >> v2:172.21.15.5:3300/0 conn(0x7f15300724a0 0x7f15301619f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39960/0 (socket says 172.21.15.5:39960) 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.694+0000 7f152ed9d640 1 -- 172.21.15.5:0/1884376559 >> v1:172.21.15.80:6789/0 conn(0x7f1530154d80 legacy=0x7f15300668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.694+0000 7f152ed9d640 1 -- 172.21.15.5:0/1884376559 >> v1:172.21.15.5:6789/0 conn(0x7f1530067000 legacy=0x7f15300af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.694+0000 7f152ed9d640 1 -- 172.21.15.5:0/1884376559 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153015ea20 con 0x7f15300724a0 2024-04-25T08:57:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.694+0000 7f152d59a640 1 -- 172.21.15.5:0/1884376559 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339898112 0 0) 0x7f153015e460 con 0x7f1530067000 2024-04-25T08:57:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.694+0000 7f152ed9d640 1 --2- 172.21.15.5:0/1884376559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15301619f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1520009d90 tx=0x7f152002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddabcbd87cfc29f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.694+0000 7f152d59a640 1 -- 172.21.15.5:0/1884376559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520007740 con 0x7f15300724a0 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f152d59a640 1 -- 172.21.15.5:0/1884376559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15200078e0 con 0x7f15300724a0 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f152d59a640 1 -- 172.21.15.5:0/1884376559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520007cb0 con 0x7f15300724a0 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f1534e22640 1 -- 172.21.15.5:0/1884376559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 msgr2=0x7f15301619f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f1534e22640 1 --2- 172.21.15.5:0/1884376559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15301619f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1520009d90 tx=0x7f152002a6f0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f1534e22640 1 -- 172.21.15.5:0/1884376559 shutdown_connections 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f1534e22640 1 --2- 172.21.15.5:0/1884376559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15301619f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f1534e22640 1 -- 172.21.15.5:0/1884376559 >> 172.21.15.5:0/1884376559 conn(0x7f15300cd310 msgr2=0x7f15300cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f1534e22640 1 -- 172.21.15.5:0/1884376559 shutdown_connections 2024-04-25T08:57:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.695+0000 7f1534e22640 1 -- 172.21.15.5:0/1884376559 wait complete. 2024-04-25T08:57:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.696+0000 7f1534e22640 1 Processor -- start 2024-04-25T08:57:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f1534e22640 1 -- start start 2024-04-25T08:57:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f1534e22640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1530067000 0x7f153006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f1534e22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15300b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f1534e22640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1530154d80 0x7f1530155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f1534e22640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300affc0 con 0x7f15300724a0 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f1534e22640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300b0140 con 0x7f1530154d80 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f1534e22640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300b02c0 con 0x7f1530067000 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f152dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15300b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f152dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15300b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39962/0 (socket says 172.21.15.5:39962) 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.697+0000 7f152dd9b640 1 -- 172.21.15.5:0/1526272002 learned_addr learned my addr 172.21.15.5:0/1526272002 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152ed9d640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1530154d80 0x7f1530155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152e59c640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1530067000 0x7f153006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152dd9b640 1 -- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1530067000 msgr2=0x7f153006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152dd9b640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1530067000 0x7f153006e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152dd9b640 1 -- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1530154d80 msgr2=0x7f1530155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152dd9b640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1530154d80 0x7f1530155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152dd9b640 1 -- 172.21.15.5:0/1526272002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530155fd0 con 0x7f15300724a0 2024-04-25T08:57:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f152dd9b640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15300b3c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f151800c3f0 tx=0x7f151800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f1526ffd640 1 -- 172.21.15.5:0/1526272002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180074e0 con 0x7f15300724a0 2024-04-25T08:57:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f1526ffd640 1 -- 172.21.15.5:0/1526272002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15180047e0 con 0x7f15300724a0 2024-04-25T08:57:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153006eac0 con 0x7f15300724a0 2024-04-25T08:57:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f1526ffd640 1 -- 172.21.15.5:0/1526272002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518004c10 con 0x7f15300724a0 2024-04-25T08:57:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.698+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153006f080 con 0x7f15300724a0 2024-04-25T08:57:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.699+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153004ef20 con 0x7f15300724a0 2024-04-25T08:57:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.700+0000 7f1526ffd640 1 -- 172.21.15.5:0/1526272002 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1518011070 con 0x7f15300724a0 2024-04-25T08:57:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.700+0000 7f1526ffd640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f151006b4d0 0x7f151006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.700+0000 7f1526ffd640 1 -- 172.21.15.5:0/1526272002 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1518089b90 con 0x7f15300724a0 2024-04-25T08:57:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.700+0000 7f152e59c640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f151006b4d0 0x7f151006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.701+0000 7f152e59c640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f151006b4d0 0x7f151006d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1528000f60 tx=0x7f1528009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:18.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.705+0000 7f1526ffd640 1 -- 172.21.15.5:0/1526272002 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1518058450 con 0x7f15300724a0 2024-04-25T08:57:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.884+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15300cfe60 con 0x7f15300724a0 2024-04-25T08:57:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.885+0000 7f1526ffd640 1 -- 172.21.15.5:0/1526272002 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f151805c4f0 con 0x7f15300724a0 2024-04-25T08:57:18.875 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f151006b4d0 msgr2=0x7f151006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f151006b4d0 0x7f151006d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1528000f60 tx=0x7f1528009040 comp rx=0 tx=0).stop 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 msgr2=0x7f15300b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15300b3c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f151800c3f0 tx=0x7f151800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 shutdown_connections 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f151006b4d0 0x7f151006d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1530154d80 0x7f1530155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15300724a0 0x7f15300b3c50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 --2- 172.21.15.5:0/1526272002 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1530067000 0x7f153006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 >> 172.21.15.5:0/1526272002 conn(0x7f15300cd310 msgr2=0x7f1530153d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 shutdown_connections 2024-04-25T08:57:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:18.887+0000 7f1534e22640 1 -- 172.21.15.5:0/1526272002 wait complete. 2024-04-25T08:57:18.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.002+0000 7f64d66b5640 1 Processor -- start 2024-04-25T08:57:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.002+0000 7f64d66b5640 1 -- start start 2024-04-25T08:57:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64d66b5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64d015df70 0x7f64d00b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64d66b5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00cef20 0x7f64d00b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64d66b5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d00d1ed0 con 0x7f64d00d2f70 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64d66b5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d00d1c80 con 0x7f64d015df70 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64d66b5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00d2ae0 con 0x7f64d00cef20 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64cffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64d015df70 0x7f64d00b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64cffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64d015df70 0x7f64d00b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39974/0 (socket says 172.21.15.5:39974) 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64cffff640 1 -- 172.21.15.5:0/2162256006 learned_addr learned my addr 172.21.15.5:0/2162256006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64d4c52640 1 --2- 172.21.15.5:0/2162256006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00cef20 0x7f64d00b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64cffff640 1 -- 172.21.15.5:0/2162256006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00cef20 msgr2=0x7f64d00b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.003+0000 7f64cffff640 1 --2- 172.21.15.5:0/2162256006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00cef20 0x7f64d00b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.004+0000 7f64cffff640 1 -- 172.21.15.5:0/2162256006 >> v1:172.21.15.80:6789/0 conn(0x7f64d00d2f70 legacy=0x7f64d00ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.004+0000 7f64cffff640 1 -- 172.21.15.5:0/2162256006 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00d21b0 con 0x7f64d015df70 2024-04-25T08:57:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.004+0000 7f64cffff640 1 --2- 172.21.15.5:0/2162256006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d015df70 0x7f64d00b94d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009870 tx=0x7f64b802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea502e60c309448 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.004+0000 7f64ceffd640 1 -- 172.21.15.5:0/2162256006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8037070 con 0x7f64d015df70 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.004+0000 7f64ceffd640 1 -- 172.21.15.5:0/2162256006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b802ae50 con 0x7f64d015df70 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.004+0000 7f64ceffd640 1 -- 172.21.15.5:0/2162256006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8032860 con 0x7f64d015df70 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 -- 172.21.15.5:0/2162256006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d015df70 msgr2=0x7f64d00b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 --2- 172.21.15.5:0/2162256006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d015df70 0x7f64d00b94d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009870 tx=0x7f64b802a300 comp rx=0 tx=0).stop 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 -- 172.21.15.5:0/2162256006 shutdown_connections 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 --2- 172.21.15.5:0/2162256006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00cef20 0x7f64d00b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 --2- 172.21.15.5:0/2162256006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d015df70 0x7f64d00b94d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 -- 172.21.15.5:0/2162256006 >> 172.21.15.5:0/2162256006 conn(0x7f64d006b000 msgr2=0x7f64d006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 -- 172.21.15.5:0/2162256006 shutdown_connections 2024-04-25T08:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.005+0000 7f64d66b5640 1 -- 172.21.15.5:0/2162256006 wait complete. 2024-04-25T08:57:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.006+0000 7f64d66b5640 1 Processor -- start 2024-04-25T08:57:18.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.006+0000 7f64d66b5640 1 -- start start 2024-04-25T08:57:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64d66b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d00cef20 0x7f64d00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64d66b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64d00d2f70 0x7f64d0152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64d66b5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00ccc80 0x7f64d0145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64d66b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00b9a10 con 0x7f64d00cef20 2024-04-25T08:57:18.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64d66b5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00d2770 con 0x7f64d00d2f70 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64d66b5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00d3720 con 0x7f64d00ccc80 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d00cef20 0x7f64d00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d00cef20 0x7f64d00cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39990/0 (socket says 172.21.15.5:39990) 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64cffff640 1 -- 172.21.15.5:0/1225279133 learned_addr learned my addr 172.21.15.5:0/1225279133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64d4c52640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00ccc80 0x7f64d0145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.007+0000 7f64cf7fe640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64d00d2f70 0x7f64d0152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64cffff640 1 -- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00ccc80 msgr2=0x7f64d0145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64cffff640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00ccc80 0x7f64d0145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64cffff640 1 -- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64d00d2f70 msgr2=0x7f64d0152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64cffff640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64d00d2f70 0x7f64d0152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64cffff640 1 -- 172.21.15.5:0/1225279133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d01f4160 con 0x7f64d00cef20 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64d4c52640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00ccc80 0x7f64d0145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64cf7fe640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64d00d2f70 0x7f64d0152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64cffff640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d00cef20 0x7f64d00cb4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f64b802a340 tx=0x7f64b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64ccff9640 1 -- 172.21.15.5:0/1225279133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8041020 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64ccff9640 1 -- 172.21.15.5:0/1225279133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b803c670 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64ccff9640 1 -- 172.21.15.5:0/1225279133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8037040 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d00cbbe0 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.008+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d00cc1a0 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.009+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d004ef20 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.009+0000 7f64ccff9640 1 -- 172.21.15.5:0/1225279133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64b8044020 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.010+0000 7f64ccff9640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f64b006b4d0 0x7f64b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.010+0000 7f64ccff9640 1 -- 172.21.15.5:0/1225279133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b80aa990 con 0x7f64d00cef20 2024-04-25T08:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.010+0000 7f64cf7fe640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f64b006b4d0 0x7f64b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.011+0000 7f64cf7fe640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f64b006b4d0 0x7f64b006d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64d0149e20 tx=0x7f64c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.014+0000 7f64ccff9640 1 -- 172.21.15.5:0/1225279133 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64b804b030 con 0x7f64d00cef20 2024-04-25T08:57:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.198+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64d006b760 con 0x7f64d00cef20 2024-04-25T08:57:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.198+0000 7f64ccff9640 1 -- 172.21.15.5:0/1225279133 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64b8079770 con 0x7f64d00cef20 2024-04-25T08:57:19.188 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f64b006b4d0 msgr2=0x7f64b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f64b006b4d0 0x7f64b006d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64d0149e20 tx=0x7f64c0009040 comp rx=0 tx=0).stop 2024-04-25T08:57:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d00cef20 msgr2=0x7f64d00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d00cef20 0x7f64d00cb4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f64b802a340 tx=0x7f64b80046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 shutdown_connections 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f64b006b4d0 0x7f64b006d990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f64d00ccc80 0x7f64d0145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64d00d2f70 0x7f64d0152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 --2- 172.21.15.5:0/1225279133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64d00cef20 0x7f64d00cb4e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 >> 172.21.15.5:0/1225279133 conn(0x7f64d006b000 msgr2=0x7f64d015ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.200+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 shutdown_connections 2024-04-25T08:57:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.201+0000 7f64d66b5640 1 -- 172.21.15.5:0/1225279133 wait complete. 2024-04-25T08:57:19.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:19.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.316+0000 7fc7b6f9e640 1 Processor -- start 2024-04-25T08:57:19.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.316+0000 7fc7b6f9e640 1 -- start start 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.316+0000 7fc7b6f9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7b015df10 0x7fc7b01618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.316+0000 7fc7b6f9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b0162150 con 0x7fc7b00cefe0 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.316+0000 7fc7b6f9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b0162430 con 0x7fc7b00b6250 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.316+0000 7fc7b6f9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00d20d0 con 0x7fc7b015df10 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7b553b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc7b00cefe0 0x7fc7b00d2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42874/0 (socket says 172.21.15.5:42874) 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7b553b640 1 -- 172.21.15.5:0/3220830651 learned_addr learned my addr 172.21.15.5:0/3220830651 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7b4d3a640 1 --2- 172.21.15.5:0/3220830651 >> v2:172.21.15.80:3300/0 conn(0x7fc7b015df10 0x7fc7b01618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7af7fe640 1 -- 172.21.15.5:0/3220830651 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414844221 0 0) 0x7fc7b0162150 con 0x7fc7b00cefe0 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7af7fe640 1 -- 172.21.15.5:0/3220830651 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a0003520 con 0x7fc7b00cefe0 2024-04-25T08:57:19.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7b4d3a640 1 -- 172.21.15.5:0/3220830651 >> v1:172.21.15.80:6789/0 conn(0x7fc7b00b6250 legacy=0x7fc7b00ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7b4d3a640 1 -- 172.21.15.5:0/3220830651 >> v1:172.21.15.5:6789/0 conn(0x7fc7b00cefe0 legacy=0x7fc7b00d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.317+0000 7fc7b4d3a640 1 -- 172.21.15.5:0/3220830651 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0162710 con 0x7fc7b015df10 2024-04-25T08:57:19.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7b4d3a640 1 --2- 172.21.15.5:0/3220830651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b015df10 0x7fc7b01618d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40097a0 tx=0x7fc7a402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9fd871e5f716c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7af7fe640 1 -- 172.21.15.5:0/3220830651 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4037070 con 0x7fc7b015df10 2024-04-25T08:57:19.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7af7fe640 1 -- 172.21.15.5:0/3220830651 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4032440 con 0x7fc7b015df10 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7af7fe640 1 -- 172.21.15.5:0/3220830651 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40327f0 con 0x7fc7b015df10 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/3220830651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b015df10 msgr2=0x7fc7b01618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/3220830651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b015df10 0x7fc7b01618d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40097a0 tx=0x7fc7a402a230 comp rx=0 tx=0).stop 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/3220830651 shutdown_connections 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/3220830651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b015df10 0x7fc7b01618d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.318+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/3220830651 >> 172.21.15.5:0/3220830651 conn(0x7fc7b00668f0 msgr2=0x7fc7b0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.319+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/3220830651 shutdown_connections 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.319+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/3220830651 wait complete. 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.320+0000 7fc7b6f9e640 1 Processor -- start 2024-04-25T08:57:19.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.320+0000 7fc7b6f9e640 1 -- start start 2024-04-25T08:57:19.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b00b6250 0x7fc7b00c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7b00cefe0 0x7fc7b00c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b015df10 0x7fc7b01e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00d2c70 con 0x7fc7b015df10 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0161e10 con 0x7fc7b00b6250 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00d2df0 con 0x7fc7b00cefe0 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b015df10 0x7fc7b01e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b015df10 0x7fc7b01e8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39996/0 (socket says 172.21.15.5:39996) 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 -- 172.21.15.5:0/1588388520 learned_addr learned my addr 172.21.15.5:0/1588388520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b4d3a640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b00b6250 0x7fc7b00c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7affff640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7b00cefe0 0x7fc7b00c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 -- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7b00cefe0 msgr2=0x7fc7b00c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7b00cefe0 0x7fc7b00c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 -- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b00b6250 msgr2=0x7fc7b00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b00b6250 0x7fc7b00c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 -- 172.21.15.5:0/1588388520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00b5bd0 con 0x7fc7b015df10 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7affff640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7b00cefe0 0x7fc7b00c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b4d3a640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b00b6250 0x7fc7b00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b553b640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b015df10 0x7fc7b01e8400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800cbe0 tx=0x7fc7a800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7ad7fa640 1 -- 172.21.15.5:0/1588388520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8017070 con 0x7fc7b015df10 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7ad7fa640 1 -- 172.21.15.5:0/1588388520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800ad40 con 0x7fc7b015df10 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b00d4250 con 0x7fc7b015df10 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7ad7fa640 1 -- 172.21.15.5:0/1588388520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8012600 con 0x7fc7b015df10 2024-04-25T08:57:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.321+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b00b5860 con 0x7fc7b015df10 2024-04-25T08:57:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.322+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b004ef20 con 0x7fc7b015df10 2024-04-25T08:57:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.323+0000 7fc7ad7fa640 1 -- 172.21.15.5:0/1588388520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc7a801a070 con 0x7fc7b015df10 2024-04-25T08:57:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.323+0000 7fc7ad7fa640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc79406b4d0 0x7fc79406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.323+0000 7fc7ad7fa640 1 -- 172.21.15.5:0/1588388520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7a8089ef0 con 0x7fc7b015df10 2024-04-25T08:57:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.323+0000 7fc7b4d3a640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc79406b4d0 0x7fc79406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.324+0000 7fc7b4d3a640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc79406b4d0 0x7fc79406d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4034000 tx=0x7fc7a402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.327+0000 7fc7ad7fa640 1 -- 172.21.15.5:0/1588388520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc7a8058720 con 0x7fc7b015df10 2024-04-25T08:57:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.510+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7b00b3340 con 0x7fc7b015df10 2024-04-25T08:57:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.510+0000 7fc7ad7fa640 1 -- 172.21.15.5:0/1588388520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7a805c7c0 con 0x7fc7b015df10 2024-04-25T08:57:19.500 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc79406b4d0 msgr2=0x7fc79406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc79406b4d0 0x7fc79406d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4034000 tx=0x7fc7a402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b015df10 msgr2=0x7fc7b01e8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b015df10 0x7fc7b01e8400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800cbe0 tx=0x7fc7a800a430 comp rx=0 tx=0).stop 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 shutdown_connections 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc79406b4d0 0x7fc79406d990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b015df10 0x7fc7b01e8400 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7b00cefe0 0x7fc7b00c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 --2- 172.21.15.5:0/1588388520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7b00b6250 0x7fc7b00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 >> 172.21.15.5:0/1588388520 conn(0x7fc7b00668f0 msgr2=0x7fc7b00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 shutdown_connections 2024-04-25T08:57:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.512+0000 7fc7b6f9e640 1 -- 172.21.15.5:0/1588388520 wait complete. 2024-04-25T08:57:19.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:57:19.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.626+0000 7f1527fd5640 1 Processor -- start 2024-04-25T08:57:19.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.626+0000 7f1527fd5640 1 -- start start 2024-04-25T08:57:19.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1527fd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15200b2cc0 0x7f15200b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1527fd5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15200b7130 0x7f15200ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1527fd5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15200d20e0 con 0x7f152015de70 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1527fd5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200d2a10 con 0x7f15200b7130 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1527fd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200d23c0 con 0x7f15200b2cc0 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1525d71640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f152015de70 0x7f15200b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42880/0 (socket says 172.21.15.5:42880) 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1525d71640 1 -- 172.21.15.5:0/3131431663 learned_addr learned my addr 172.21.15.5:0/3131431663 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1526572640 1 --2- 172.21.15.5:0/3131431663 >> v2:172.21.15.80:3300/0 conn(0x7f15200b7130 0x7f15200ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.627+0000 7f1525570640 1 --2- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15200b2cc0 0x7f15200b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.628+0000 7f1524d6f640 1 -- 172.21.15.5:0/3131431663 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017652254 0 0) 0x7f15200d20e0 con 0x7f152015de70 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.628+0000 7f1524d6f640 1 -- 172.21.15.5:0/3131431663 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1508003520 con 0x7f152015de70 2024-04-25T08:57:19.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.628+0000 7f1526572640 1 -- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15200b2cc0 msgr2=0x7f15200b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:19.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.628+0000 7f1526572640 1 --2- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15200b2cc0 0x7f15200b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.628+0000 7f1526572640 1 -- 172.21.15.5:0/3131431663 >> v1:172.21.15.5:6789/0 conn(0x7f152015de70 legacy=0x7f15200b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.628+0000 7f1526572640 1 -- 172.21.15.5:0/3131431663 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200d26a0 con 0x7f15200b7130 2024-04-25T08:57:19.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.628+0000 7f1525570640 1 --2- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15200b2cc0 0x7f15200b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:19.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1526572640 1 --2- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 0x7f15200ce7f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1510009d90 tx=0x7f151002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea475ef6be3d5933 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1524d6f640 1 -- 172.21.15.5:0/3131431663 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510007740 con 0x7f15200b7130 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1524d6f640 1 -- 172.21.15.5:0/3131431663 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15100078e0 con 0x7f15200b7130 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1524d6f640 1 -- 172.21.15.5:0/3131431663 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510007c90 con 0x7f15200b7130 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 -- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 msgr2=0x7f15200ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 --2- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 0x7f15200ce7f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1510009d90 tx=0x7f151002a660 comp rx=0 tx=0).stop 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 -- 172.21.15.5:0/3131431663 shutdown_connections 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 --2- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 0x7f15200ce7f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 --2- 172.21.15.5:0/3131431663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15200b2cc0 0x7f15200b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 -- 172.21.15.5:0/3131431663 >> 172.21.15.5:0/3131431663 conn(0x7f152006b000 msgr2=0x7f152006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 -- 172.21.15.5:0/3131431663 shutdown_connections 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.629+0000 7f1527fd5640 1 -- 172.21.15.5:0/3131431663 wait complete. 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 Processor -- start 2024-04-25T08:57:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 -- start start 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15200b2cc0 0x7f15200c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 0x7f15200c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f152015de70 0x7f15201f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200cf0c0 con 0x7f15200b2cc0 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200cef40 con 0x7f15200b7130 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1527fd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200ca0c0 con 0x7f152015de70 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1525d71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15200b2cc0 0x7f15200c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1525d71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15200b2cc0 0x7f15200c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40010/0 (socket says 172.21.15.5:40010) 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.631+0000 7f1525d71640 1 -- 172.21.15.5:0/1962440371 learned_addr learned my addr 172.21.15.5:0/1962440371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1525570640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 0x7f15200c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1526572640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f152015de70 0x7f15201f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1525d71640 1 -- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f152015de70 msgr2=0x7f15201f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1525d71640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f152015de70 0x7f15201f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1525d71640 1 -- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 msgr2=0x7f15200c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1525d71640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 0x7f15200c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1525d71640 1 -- 172.21.15.5:0/1962440371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200c94b0 con 0x7f15200b2cc0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1525d71640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15200b2cc0 0x7f15200c8dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f151800c390 tx=0x7f151800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f151e7fc640 1 -- 172.21.15.5:0/1962440371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518017070 con 0x7f15200b2cc0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f151e7fc640 1 -- 172.21.15.5:0/1962440371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518005ce0 con 0x7f15200b2cc0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f151e7fc640 1 -- 172.21.15.5:0/1962440371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180072f0 con 0x7f15200b2cc0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15200c9790 con 0x7f15200b2cc0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.632+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15200c9d50 con 0x7f15200b2cc0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.633+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152004ef20 con 0x7f15200b2cc0 2024-04-25T08:57:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.634+0000 7f151e7fc640 1 -- 172.21.15.5:0/1962440371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f151801a070 con 0x7f15200b2cc0 2024-04-25T08:57:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.634+0000 7f151e7fc640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f150c06b500 0x7f150c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.634+0000 7f151e7fc640 1 -- 172.21.15.5:0/1962440371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1518089520 con 0x7f15200b2cc0 2024-04-25T08:57:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.635+0000 7f1525570640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f150c06b500 0x7f150c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.635+0000 7f1525570640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f150c06b500 0x7f150c06d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1514009560 tx=0x7f1514009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:19.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.639+0000 7f151e7fc640 1 -- 172.21.15.5:0/1962440371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1518057d50 con 0x7f15200b2cc0 2024-04-25T08:57:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.829+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f152006b580 con 0x7f15200b2cc0 2024-04-25T08:57:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.830+0000 7f151e7fc640 1 -- 172.21.15.5:0/1962440371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f151805bdf0 con 0x7f15200b2cc0 2024-04-25T08:57:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f150c06b500 msgr2=0x7f150c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f150c06b500 0x7f150c06d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1514009560 tx=0x7f1514009190 comp rx=0 tx=0).stop 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15200b2cc0 msgr2=0x7f15200c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15200b2cc0 0x7f15200c8dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f151800c390 tx=0x7f151800c850 comp rx=0 tx=0).stop 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 shutdown_connections 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f150c06b500 0x7f150c06d9c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f152015de70 0x7f15201f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200b7130 0x7f15200c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 --2- 172.21.15.5:0/1962440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15200b2cc0 0x7f15200c8dd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.831+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 >> 172.21.15.5:0/1962440371 conn(0x7f152006b000 msgr2=0x7f15200b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.832+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 shutdown_connections 2024-04-25T08:57:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:19.832+0000 7f1527fd5640 1 -- 172.21.15.5:0/1962440371 wait complete. 2024-04-25T08:57:19.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T08:57:19.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:19.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T08:57:19.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T08:57:19.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:19.863 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T08:57:19.921 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:57:19.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.033+0000 7f14dedf5640 1 Processor -- start 2024-04-25T08:57:20.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.033+0000 7f14dedf5640 1 -- start start 2024-04-25T08:57:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14dedf5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14d806dd20 0x7f14d80ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14dedf5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80b4bd0 con 0x7f14d80b3860 2024-04-25T08:57:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14dedf5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80b2aa0 con 0x7f14d8156250 2024-04-25T08:57:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14dedf5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80b2850 con 0x7f14d806dd20 2024-04-25T08:57:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14d7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14d806dd20 0x7f14d80ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14dd392640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f14d80b3860 0x7f14d815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42896/0 (socket says 172.21.15.5:42896) 2024-04-25T08:57:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14dd392640 1 -- 172.21.15.5:0/1036000402 learned_addr learned my addr 172.21.15.5:0/1036000402 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:20.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14d7fff640 1 -- 172.21.15.5:0/1036000402 >> v1:172.21.15.80:6789/0 conn(0x7f14d8156250 legacy=0x7f14d80b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14d7fff640 1 -- 172.21.15.5:0/1036000402 >> v1:172.21.15.5:6789/0 conn(0x7f14d80b3860 legacy=0x7f14d815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14d77fe640 1 -- 172.21.15.5:0/1036000402 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789138820 0 0) 0x7f14d0001490 con 0x7f14d80b3860 2024-04-25T08:57:20.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.034+0000 7f14d7fff640 1 -- 172.21.15.5:0/1036000402 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80b2d80 con 0x7f14d806dd20 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.035+0000 7f14d7fff640 1 --2- 172.21.15.5:0/1036000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d806dd20 0x7f14d80ae690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14c40097a0 tx=0x7f14c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e4267141a1a1e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.035+0000 7f14d77fe640 1 -- 172.21.15.5:0/1036000402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4037070 con 0x7f14d806dd20 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.035+0000 7f14d77fe640 1 -- 172.21.15.5:0/1036000402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c4032440 con 0x7f14d806dd20 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.035+0000 7f14d77fe640 1 -- 172.21.15.5:0/1036000402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4032810 con 0x7f14d806dd20 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.036+0000 7f14dedf5640 1 -- 172.21.15.5:0/1036000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d806dd20 msgr2=0x7f14d80ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.036+0000 7f14dedf5640 1 --2- 172.21.15.5:0/1036000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d806dd20 0x7f14d80ae690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14c40097a0 tx=0x7f14c402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.036+0000 7f14dedf5640 1 -- 172.21.15.5:0/1036000402 shutdown_connections 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.036+0000 7f14dedf5640 1 --2- 172.21.15.5:0/1036000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d806dd20 0x7f14d80ae690 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.036+0000 7f14dedf5640 1 -- 172.21.15.5:0/1036000402 >> 172.21.15.5:0/1036000402 conn(0x7f14d80668f0 msgr2=0x7f14d8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:20.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.036+0000 7f14dedf5640 1 -- 172.21.15.5:0/1036000402 shutdown_connections 2024-04-25T08:57:20.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.036+0000 7f14dedf5640 1 -- 172.21.15.5:0/1036000402 wait complete. 2024-04-25T08:57:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.037+0000 7f14dedf5640 1 Processor -- start 2024-04-25T08:57:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.037+0000 7f14dedf5640 1 -- start start 2024-04-25T08:57:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dedf5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14d80b3860 0x7f14d81f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dedf5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d8156250 0x7f14d806c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dedf5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d814ee50 0x7f14d8143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dedf5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80aebd0 con 0x7f14d814ee50 2024-04-25T08:57:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dedf5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80b3340 con 0x7f14d8156250 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dedf5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80aed50 con 0x7f14d80b3860 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d814ee50 0x7f14d8143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d814ee50 0x7f14d8143db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40028/0 (socket says 172.21.15.5:40028) 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 -- 172.21.15.5:0/4228222304 learned_addr learned my addr 172.21.15.5:0/4228222304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14d7fff640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d8156250 0x7f14d806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dcb91640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14d80b3860 0x7f14d81f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 -- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14d80b3860 msgr2=0x7f14d81f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14d80b3860 0x7f14d81f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 -- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d8156250 msgr2=0x7f14d806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d8156250 0x7f14d806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 -- 172.21.15.5:0/4228222304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d81f5c90 con 0x7f14d814ee50 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14d7fff640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d8156250 0x7f14d806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dcb91640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14d80b3860 0x7f14d81f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14dd392640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d814ee50 0x7f14d8143db0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f14d000c7f0 tx=0x7f14d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14d57fa640 1 -- 172.21.15.5:0/4228222304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0018070 con 0x7f14d814ee50 2024-04-25T08:57:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.038+0000 7f14d57fa640 1 -- 172.21.15.5:0/4228222304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d000a5e0 con 0x7f14d814ee50 2024-04-25T08:57:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.039+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d81f56d0 con 0x7f14d814ee50 2024-04-25T08:57:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.039+0000 7f14d57fa640 1 -- 172.21.15.5:0/4228222304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000a9d0 con 0x7f14d814ee50 2024-04-25T08:57:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.039+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80ce140 con 0x7f14d814ee50 2024-04-25T08:57:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.040+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d804ef20 con 0x7f14d814ee50 2024-04-25T08:57:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.040+0000 7f14d57fa640 1 -- 172.21.15.5:0/4228222304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f14d001b070 con 0x7f14d814ee50 2024-04-25T08:57:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.040+0000 7f14d57fa640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14bc06b4d0 0x7f14bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.041+0000 7f14d57fa640 1 -- 172.21.15.5:0/4228222304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14d0089790 con 0x7f14d814ee50 2024-04-25T08:57:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.041+0000 7f14dcb91640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14bc06b4d0 0x7f14bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.041+0000 7f14dcb91640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14bc06b4d0 0x7f14bc06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000f60 tx=0x7f14cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.045+0000 7f14d57fa640 1 -- 172.21.15.5:0/4228222304 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14d80b4bd0 con 0x7f14d814ee50 2024-04-25T08:57:20.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.261+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14d80cbe20 con 0x7f14d814ee50 2024-04-25T08:57:20.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.262+0000 7f14d57fa640 1 -- 172.21.15.5:0/4228222304 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7f14d0058610 con 0x7f14d814ee50 2024-04-25T08:57:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:20.251 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:57:20.252 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:57:20.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14bc06b4d0 msgr2=0x7f14bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14bc06b4d0 0x7f14bc06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000f60 tx=0x7f14cc009040 comp rx=0 tx=0).stop 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d814ee50 msgr2=0x7f14d8143db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d814ee50 0x7f14d8143db0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f14d000c7f0 tx=0x7f14d000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 shutdown_connections 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14bc06b4d0 0x7f14bc06d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14d814ee50 0x7f14d8143db0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d8156250 0x7f14d806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.263+0000 7f14dedf5640 1 --2- 172.21.15.5:0/4228222304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14d80b3860 0x7f14d81f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.264+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 >> 172.21.15.5:0/4228222304 conn(0x7f14d80668f0 msgr2=0x7f14d80b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.264+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 shutdown_connections 2024-04-25T08:57:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.264+0000 7f14dedf5640 1 -- 172.21.15.5:0/4228222304 wait complete. 2024-04-25T08:57:20.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.376+0000 7f90f9e76640 1 Processor -- start 2024-04-25T08:57:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.376+0000 7f90f9e76640 1 -- start start 2024-04-25T08:57:20.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f9e76640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90f40668f0 0x7f90f4066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f9e76640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f4161fe0 0x7f90f40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f9e76640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f4067210 con 0x7f90f40b3e10 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f9e76640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40b5740 con 0x7f90f40668f0 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f9e76640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b5a20 con 0x7f90f4161fe0 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90f40668f0 0x7f90f4066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90f40b3e10 0x7f90f406d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42912/0 (socket says 172.21.15.5:42912) 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f3fff640 1 -- 172.21.15.5:0/1492929153 learned_addr learned my addr 172.21.15.5:0/1492929153 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f2ffd640 1 --2- 172.21.15.5:0/1492929153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f4161fe0 0x7f90f40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f37fe640 1 -- 172.21.15.5:0/1492929153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f4161fe0 msgr2=0x7f90f40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f37fe640 1 --2- 172.21.15.5:0/1492929153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f4161fe0 0x7f90f40b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f37fe640 1 -- 172.21.15.5:0/1492929153 >> v1:172.21.15.5:6789/0 conn(0x7f90f40b3e10 legacy=0x7f90f406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f27fc640 1 -- 172.21.15.5:0/1492929153 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487063610 0 0) 0x7f90f4067210 con 0x7f90f40b3e10 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.377+0000 7f90f37fe640 1 -- 172.21.15.5:0/1492929153 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40b5d00 con 0x7f90f40668f0 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.378+0000 7f90f37fe640 1 --2- 172.21.15.5:0/1492929153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4066cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f90e80097d0 tx=0x7f90e802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8623cf5319a5bda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.378+0000 7f90f27fc640 1 -- 172.21.15.5:0/1492929153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8037070 con 0x7f90f40668f0 2024-04-25T08:57:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.378+0000 7f90f27fc640 1 -- 172.21.15.5:0/1492929153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e8032440 con 0x7f90f40668f0 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.378+0000 7f90f27fc640 1 -- 172.21.15.5:0/1492929153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8032810 con 0x7f90f40668f0 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 -- 172.21.15.5:0/1492929153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 msgr2=0x7f90f4066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1492929153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4066cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f90e80097d0 tx=0x7f90e802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 -- 172.21.15.5:0/1492929153 shutdown_connections 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1492929153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f4161fe0 0x7f90f40b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1492929153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4066cd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 -- 172.21.15.5:0/1492929153 >> 172.21.15.5:0/1492929153 conn(0x7f90f40b25d0 msgr2=0x7f90f40b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 -- 172.21.15.5:0/1492929153 shutdown_connections 2024-04-25T08:57:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.379+0000 7f90f9e76640 1 -- 172.21.15.5:0/1492929153 wait complete. 2024-04-25T08:57:20.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.380+0000 7f90f9e76640 1 Processor -- start 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.380+0000 7f90f9e76640 1 -- start start 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f9e76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4134d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f9e76640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f40b3e10 0x7f90f41f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f9e76640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f4161fe0 0x7f90f4158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f9e76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f406f030 con 0x7f90f40668f0 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f9e76640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4161ac0 con 0x7f90f4161fe0 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f9e76640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f406f1b0 con 0x7f90f40b3e10 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40054/0 (socket says 172.21.15.5:40054) 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 -- 172.21.15.5:0/1957039946 learned_addr learned my addr 172.21.15.5:0/1957039946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f3fff640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f4161fe0 0x7f90f4158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f2ffd640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f40b3e10 0x7f90f41f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 -- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f40b3e10 msgr2=0x7f90f41f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f40b3e10 0x7f90f41f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 -- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f4161fe0 msgr2=0x7f90f4158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f4161fe0 0x7f90f4158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 -- 172.21.15.5:0/1957039946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4135c80 con 0x7f90f40668f0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f3fff640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f4161fe0 0x7f90f4158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f2ffd640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f40b3e10 0x7f90f41f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.381+0000 7f90f37fe640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4134d20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.382+0000 7f90dbfff640 1 -- 172.21.15.5:0/1957039946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8037040 con 0x7f90f40668f0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.382+0000 7f90dbfff640 1 -- 172.21.15.5:0/1957039946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e8042070 con 0x7f90f40668f0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.382+0000 7f90dbfff640 1 -- 172.21.15.5:0/1957039946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8030bb0 con 0x7f90f40668f0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.382+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f41353e0 con 0x7f90f40668f0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.382+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f41359a0 con 0x7f90f40668f0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.383+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f404ef20 con 0x7f90f40668f0 2024-04-25T08:57:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.383+0000 7f90dbfff640 1 -- 172.21.15.5:0/1957039946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f90e8047460 con 0x7f90f40668f0 2024-04-25T08:57:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.383+0000 7f90dbfff640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f90e006b4d0 0x7f90e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.384+0000 7f90dbfff640 1 -- 172.21.15.5:0/1957039946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90e80aad80 con 0x7f90f40668f0 2024-04-25T08:57:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.384+0000 7f90f2ffd640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f90e006b4d0 0x7f90e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.384+0000 7f90f2ffd640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f90e006b4d0 0x7f90e006d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f90e4006fd0 tx=0x7f90e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.388+0000 7f90dbfff640 1 -- 172.21.15.5:0/1957039946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90e8032e20 con 0x7f90f40668f0 2024-04-25T08:57:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.568+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f4072140 con 0x7f90f40668f0 2024-04-25T08:57:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.569+0000 7f90dbfff640 1 -- 172.21.15.5:0/1957039946 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f90e8079c10 con 0x7f90f40668f0 2024-04-25T08:57:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:20.559 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f90e006b4d0 msgr2=0x7f90e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f90e006b4d0 0x7f90e006d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f90e4006fd0 tx=0x7f90e4008040 comp rx=0 tx=0).stop 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 msgr2=0x7f90f4134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4134d20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e80046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 shutdown_connections 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f90e006b4d0 0x7f90e006d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f4161fe0 0x7f90f4158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90f40b3e10 0x7f90f41f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 --2- 172.21.15.5:0/1957039946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f40668f0 0x7f90f4134d20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 >> 172.21.15.5:0/1957039946 conn(0x7f90f40b25d0 msgr2=0x7f90f4143370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:20.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 shutdown_connections 2024-04-25T08:57:20.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.571+0000 7f90f9e76640 1 -- 172.21.15.5:0/1957039946 wait complete. 2024-04-25T08:57:20.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:42.385900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:43.541546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:20.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.686+0000 7f17345f9640 1 Processor -- start 2024-04-25T08:57:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.686+0000 7f17345f9640 1 -- start start 2024-04-25T08:57:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f17345f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f172c154d80 0x7f172c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f17345f9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f172c0affc0 0x7f172c1619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f17345f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c15e460 con 0x7f172c066e30 2024-04-25T08:57:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f17345f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c155160 con 0x7f172c154d80 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f17345f9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c15f070 con 0x7f172c0affc0 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1732395640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f172c154d80 0x7f172c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1731b94640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f172c066e30 0x7f172c0af8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42920/0 (socket says 172.21.15.5:42920) 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1732395640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f172c154d80 0x7f172c0668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40056/0 (socket says 172.21.15.5:40056) 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1731b94640 1 -- 172.21.15.5:0/3479173429 learned_addr learned my addr 172.21.15.5:0/3479173429 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1732395640 1 -- 172.21.15.5:0/3479173429 >> v2:172.21.15.80:3300/0 conn(0x7f172c0affc0 msgr2=0x7f172c1619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1732b96640 1 --2- 172.21.15.5:0/3479173429 >> v2:172.21.15.80:3300/0 conn(0x7f172c0affc0 0x7f172c1619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1731393640 1 -- 172.21.15.5:0/3479173429 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709319911 0 0) 0x7f172c15e460 con 0x7f172c066e30 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1732395640 1 --2- 172.21.15.5:0/3479173429 >> v2:172.21.15.80:3300/0 conn(0x7f172c0affc0 0x7f172c1619f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1732395640 1 -- 172.21.15.5:0/3479173429 >> v1:172.21.15.5:6789/0 conn(0x7f172c066e30 legacy=0x7f172c0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.687+0000 7f1732395640 1 -- 172.21.15.5:0/3479173429 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c15e740 con 0x7f172c154d80 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.688+0000 7f1732395640 1 --2- 172.21.15.5:0/3479173429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c154d80 0x7f172c0668f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f172c0cae60 tx=0x7f172402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a915c07504909f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.688+0000 7f1731393640 1 -- 172.21.15.5:0/3479173429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724007740 con 0x7f172c154d80 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.688+0000 7f1731393640 1 -- 172.21.15.5:0/3479173429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17240078e0 con 0x7f172c154d80 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.688+0000 7f1731393640 1 -- 172.21.15.5:0/3479173429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724007cb0 con 0x7f172c154d80 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 -- 172.21.15.5:0/3479173429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c154d80 msgr2=0x7f172c0668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 --2- 172.21.15.5:0/3479173429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c154d80 0x7f172c0668f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f172c0cae60 tx=0x7f172402a680 comp rx=0 tx=0).stop 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 -- 172.21.15.5:0/3479173429 shutdown_connections 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 --2- 172.21.15.5:0/3479173429 >> v2:172.21.15.80:3300/0 conn(0x7f172c0affc0 0x7f172c1619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 --2- 172.21.15.5:0/3479173429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c154d80 0x7f172c0668f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 -- 172.21.15.5:0/3479173429 >> 172.21.15.5:0/3479173429 conn(0x7f172c0cd310 msgr2=0x7f172c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 -- 172.21.15.5:0/3479173429 shutdown_connections 2024-04-25T08:57:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.689+0000 7f17345f9640 1 -- 172.21.15.5:0/3479173429 wait complete. 2024-04-25T08:57:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.690+0000 7f17345f9640 1 Processor -- start 2024-04-25T08:57:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.690+0000 7f17345f9640 1 -- start start 2024-04-25T08:57:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f17345f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f172c066e30 0x7f172c13b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f17345f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c0affc0 0x7f172c0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f17345f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f172c154d80 0x7f172c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f17345f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c15ed00 con 0x7f172c0affc0 2024-04-25T08:57:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f17345f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c161f30 con 0x7f172c066e30 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f17345f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172c1620b0 con 0x7f172c154d80 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c0affc0 0x7f172c0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c0affc0 0x7f172c0b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40068/0 (socket says 172.21.15.5:40068) 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 -- 172.21.15.5:0/3257267150 learned_addr learned my addr 172.21.15.5:0/3257267150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 -- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f172c154d80 msgr2=0x7f172c0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f172c154d80 0x7f172c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 -- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f172c066e30 msgr2=0x7f172c13b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f172c066e30 0x7f172c13b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 -- 172.21.15.5:0/3257267150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c1e7800 con 0x7f172c0affc0 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.691+0000 7f1731b94640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c0affc0 0x7f172c0b5ba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f172000c4a0 tx=0x7f172000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.692+0000 7f172affd640 1 -- 172.21.15.5:0/3257267150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720018070 con 0x7f172c0affc0 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.692+0000 7f172affd640 1 -- 172.21.15.5:0/3257267150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17200074e0 con 0x7f172c0affc0 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.692+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c1e7ae0 con 0x7f172c0affc0 2024-04-25T08:57:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.692+0000 7f172affd640 1 -- 172.21.15.5:0/3257267150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720004a20 con 0x7f172c0affc0 2024-04-25T08:57:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.692+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c1e80a0 con 0x7f172c0affc0 2024-04-25T08:57:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.693+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c04ef20 con 0x7f172c0affc0 2024-04-25T08:57:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.693+0000 7f172affd640 1 -- 172.21.15.5:0/3257267150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f172001b070 con 0x7f172c0affc0 2024-04-25T08:57:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.693+0000 7f172affd640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.694+0000 7f172affd640 1 -- 172.21.15.5:0/3257267150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1720089530 con 0x7f172c0affc0 2024-04-25T08:57:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.694+0000 7f1732395640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.694+0000 7f1732395640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1724034000 tx=0x7f172402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.698+0000 7f172affd640 1 -- 172.21.15.5:0/3257267150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17200583b0 con 0x7f172c0affc0 2024-04-25T08:57:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.877+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f172c0cfe60 con 0x7f172c0affc0 2024-04-25T08:57:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.878+0000 7f172affd640 1 -- 172.21.15.5:0/3257267150 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1720057cb0 con 0x7f172c0affc0 2024-04-25T08:57:20.868 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 msgr2=0x7f171806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1724034000 tx=0x7f172402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c0affc0 msgr2=0x7f172c0b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c0affc0 0x7f172c0b5ba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f172000c4a0 tx=0x7f172000c960 comp rx=0 tx=0).stop 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 shutdown_connections 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f172c154d80 0x7f172c0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f172c0affc0 0x7f172c0b5ba0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 --2- 172.21.15.5:0/3257267150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f172c066e30 0x7f172c13b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 >> 172.21.15.5:0/3257267150 conn(0x7f172c0cd310 msgr2=0x7f172c0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 shutdown_connections 2024-04-25T08:57:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.880+0000 7f17345f9640 1 -- 172.21.15.5:0/3257267150 wait complete. 2024-04-25T08:57:20.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:20.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.994+0000 7f4d5c607640 1 Processor -- start 2024-04-25T08:57:20.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.994+0000 7f4d5c607640 1 -- start start 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.995+0000 7f4d5c607640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d540ce1c0 0x7f4d540d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.995+0000 7f4d5c607640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 0x7f4d540d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.995+0000 7f4d5c607640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5415e260 con 0x7f4d5415de80 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.995+0000 7f4d5c607640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540d3770 con 0x7f4d540ce1c0 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.995+0000 7f4d5c607640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540d1ef0 con 0x7f4d540d2dc0 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.995+0000 7f4d5a3a3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4d5415de80 0x7f4d540ceda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51872/0 (socket says 172.21.15.5:51872) 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.995+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1254126835 learned_addr learned my addr 172.21.15.5:0/1254126835 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5aba4640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 0x7f4d540d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659215554 0 0) 0x7f4d5415e260 con 0x7f4d5415de80 2024-04-25T08:57:20.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d59ba2640 1 --2- 172.21.15.5:0/1254126835 >> v2:172.21.15.80:3300/0 conn(0x7f4d540ce1c0 0x7f4d540d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40003520 con 0x7f4d5415de80 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157722906 0 0) 0x7f4d40003520 con 0x7f4d5415de80 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 msgr2=0x7f4d540d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 0x7f4d540d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 >> v2:172.21.15.80:3300/0 conn(0x7f4d540ce1c0 msgr2=0x7f4d540d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 --2- 172.21.15.5:0/1254126835 >> v2:172.21.15.80:3300/0 conn(0x7f4d540ce1c0 0x7f4d540d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540d18c0 con 0x7f4d5415de80 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f4d50001690 con 0x7f4d5415de80 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 >> v1:172.21.15.5:6789/0 conn(0x7f4d5415de80 legacy=0x7f4d540ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d40004800 0x7f4d40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 0x7f4d400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540d3770 con 0x7f4d400039b0 2024-04-25T08:57:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540d1ef0 con 0x7f4d40004800 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000b9c0 con 0x7f4d540d2dc0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5a3a3640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d59ba2640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d40004800 0x7f4d40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5aba4640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 0x7f4d400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 msgr2=0x7f4d400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5a3a3640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540d2dc0 0x7f4d400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d40004800 msgr2=0x7f4d40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5a3a3640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d40004800 0x7f4d40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.996+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1254126835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40003520 con 0x7f4d400039b0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.997+0000 7f4d5a3a3640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d40003dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c240 tx=0x7f4d40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b066f1c02b79e3a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.997+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50007d70 con 0x7f4d400039b0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.997+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50005af0 con 0x7f4d400039b0 2024-04-25T08:57:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.997+0000 7f4d593a1640 1 -- 172.21.15.5:0/1254126835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50007070 con 0x7f4d400039b0 2024-04-25T08:57:20.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.998+0000 7f4d5c607640 1 -- 172.21.15.5:0/1254126835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 msgr2=0x7f4d40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.998+0000 7f4d5c607640 1 --2- 172.21.15.5:0/1254126835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d40003dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c240 tx=0x7f4d40005830 comp rx=0 tx=0).stop 2024-04-25T08:57:20.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.998+0000 7f4d5aba4640 1 -- 172.21.15.5:0/1254126835 reap_dead start 2024-04-25T08:57:20.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.998+0000 7f4d5c607640 1 -- 172.21.15.5:0/1254126835 shutdown_connections 2024-04-25T08:57:20.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.998+0000 7f4d5c607640 1 -- 172.21.15.5:0/1254126835 >> 172.21.15.5:0/1254126835 conn(0x7f4d5406b000 msgr2=0x7f4d5406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:20.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.998+0000 7f4d5c607640 1 -- 172.21.15.5:0/1254126835 shutdown_connections 2024-04-25T08:57:20.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.998+0000 7f4d5c607640 1 -- 172.21.15.5:0/1254126835 wait complete. 2024-04-25T08:57:20.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.999+0000 7f4d5c607640 1 Processor -- start 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:20.999+0000 7f4d5c607640 1 -- start start 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5c607640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d54156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5c607640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d541f73e0 0x7f4d5415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5c607640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540cc650 0x7f4d540ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5c607640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540d28c0 con 0x7f4d400039b0 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5c607640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540d1b80 con 0x7f4d541f73e0 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5c607640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540d3230 con 0x7f4d540cc650 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d54156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d54156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41992/0 (socket says 172.21.15.5:41992) 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1931731213 learned_addr learned my addr 172.21.15.5:0/1931731213 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540cc650 msgr2=0x7f4d540ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540cc650 0x7f4d540ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d541f73e0 msgr2=0x7f4d5415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d541f73e0 0x7f4d5415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.000+0000 7f4d5a3a3640 1 -- 172.21.15.5:0/1931731213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d541f7930 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.001+0000 7f4d5a3a3640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d54156a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c360 tx=0x7f4d50001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.001+0000 7f4d4affd640 1 -- 172.21.15.5:0/1931731213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50042070 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.001+0000 7f4d4affd640 1 -- 172.21.15.5:0/1931731213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50007480 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.001+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d541f7c10 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.001+0000 7f4d4affd640 1 -- 172.21.15.5:0/1931731213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50007d70 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.001+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d541f81d0 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.002+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5404ef20 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.002+0000 7f4d4affd640 1 -- 172.21.15.5:0/1931731213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d50045070 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.003+0000 7f4d4affd640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d3806b4d0 0x7f4d3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.003+0000 7f4d4affd640 1 -- 172.21.15.5:0/1931731213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d500aacf0 con 0x7f4d400039b0 2024-04-25T08:57:20.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.003+0000 7f4d59ba2640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d3806b4d0 0x7f4d3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:20.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.003+0000 7f4d59ba2640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d3806b4d0 0x7f4d3806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d540b60e0 tx=0x7f4d44009d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:20.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.007+0000 7f4d4affd640 1 -- 172.21.15.5:0/1931731213 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d500af070 con 0x7f4d400039b0 2024-04-25T08:57:21.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.189+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d5415c720 con 0x7f4d400039b0 2024-04-25T08:57:21.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.189+0000 7f4d4affd640 1 -- 172.21.15.5:0/1931731213 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d50005ac0 con 0x7f4d400039b0 2024-04-25T08:57:21.179 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:57:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d3806b4d0 msgr2=0x7f4d3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d3806b4d0 0x7f4d3806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d540b60e0 tx=0x7f4d44009d30 comp rx=0 tx=0).stop 2024-04-25T08:57:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 msgr2=0x7f4d54156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d54156a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c360 tx=0x7f4d50001a60 comp rx=0 tx=0).stop 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 shutdown_connections 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d3806b4d0 0x7f4d3806d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d540cc650 0x7f4d540ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d541f73e0 0x7f4d5415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 --2- 172.21.15.5:0/1931731213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d400039b0 0x7f4d54156a50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 >> 172.21.15.5:0/1931731213 conn(0x7f4d5406b000 msgr2=0x7f4d540cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 shutdown_connections 2024-04-25T08:57:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.191+0000 7f4d5c607640 1 -- 172.21.15.5:0/1931731213 wait complete. 2024-04-25T08:57:21.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.306+0000 7fc1803f5640 1 Processor -- start 2024-04-25T08:57:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.306+0000 7fc1803f5640 1 -- start start 2024-04-25T08:57:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc1803f5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1780b96e0 0x7fc1780d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc1803f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1780b9b20 con 0x7fc1780d4060 2024-04-25T08:57:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc1803f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1780d2740 con 0x7fc1781614b0 2024-04-25T08:57:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc1803f5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1780d44d0 con 0x7fc1780b96e0 2024-04-25T08:57:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17e992640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1780d4060 0x7fc1780b6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51882/0 (socket says 172.21.15.5:51882) 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17e992640 1 -- 172.21.15.5:0/448574833 learned_addr learned my addr 172.21.15.5:0/448574833 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17d990640 1 --2- 172.21.15.5:0/448574833 >> v2:172.21.15.80:3300/0 conn(0x7fc1780b96e0 0x7fc1780d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17d18f640 1 -- 172.21.15.5:0/448574833 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370788790 0 0) 0x7fc1780b9b20 con 0x7fc1780d4060 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17d18f640 1 -- 172.21.15.5:0/448574833 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc164003520 con 0x7fc1780d4060 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17d990640 1 -- 172.21.15.5:0/448574833 >> v1:172.21.15.80:6789/0 conn(0x7fc1781614b0 legacy=0x7fc1780d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17d18f640 1 -- 172.21.15.5:0/448574833 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 368974950 0 0) 0x7fc164003520 con 0x7fc1780d4060 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17d990640 1 -- 172.21.15.5:0/448574833 >> v1:172.21.15.5:6789/0 conn(0x7fc1780d4060 legacy=0x7fc1780b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.307+0000 7fc17d990640 1 -- 172.21.15.5:0/448574833 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780d2a20 con 0x7fc1780b96e0 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.308+0000 7fc17d990640 1 --2- 172.21.15.5:0/448574833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc1780d3b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1680097a0 tx=0x7fc16802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b761cd080fdddd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.308+0000 7fc17d18f640 1 -- 172.21.15.5:0/448574833 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168037070 con 0x7fc1780b96e0 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.308+0000 7fc17d18f640 1 -- 172.21.15.5:0/448574833 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16802ac50 con 0x7fc1780b96e0 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.308+0000 7fc17d18f640 1 -- 172.21.15.5:0/448574833 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170001a10 con 0x7fc1780b96e0 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.309+0000 7fc1803f5640 1 -- 172.21.15.5:0/448574833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 msgr2=0x7fc1780d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.309+0000 7fc1803f5640 1 --2- 172.21.15.5:0/448574833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc1780d3b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1680097a0 tx=0x7fc16802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.309+0000 7fc1803f5640 1 -- 172.21.15.5:0/448574833 shutdown_connections 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.309+0000 7fc1803f5640 1 --2- 172.21.15.5:0/448574833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc1780d3b20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.309+0000 7fc1803f5640 1 -- 172.21.15.5:0/448574833 >> 172.21.15.5:0/448574833 conn(0x7fc17806b000 msgr2=0x7fc17806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.309+0000 7fc1803f5640 1 -- 172.21.15.5:0/448574833 shutdown_connections 2024-04-25T08:57:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.309+0000 7fc1803f5640 1 -- 172.21.15.5:0/448574833 wait complete. 2024-04-25T08:57:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.310+0000 7fc1803f5640 1 Processor -- start 2024-04-25T08:57:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.310+0000 7fc1803f5640 1 -- start start 2024-04-25T08:57:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc1803f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc17815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc1803f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780d4060 0x7fc17815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc1803f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1781614b0 0x7fc1780b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc1803f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780d32c0 con 0x7fc1780d4060 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc1803f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780d2fe0 con 0x7fc1780b96e0 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc1803f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780d37e0 con 0x7fc1781614b0 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780d4060 0x7fc17815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780d4060 0x7fc17815ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41996/0 (socket says 172.21.15.5:41996) 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 -- 172.21.15.5:0/1420549699 learned_addr learned my addr 172.21.15.5:0/1420549699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 -- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1781614b0 msgr2=0x7fc1780b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17e992640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1781614b0 0x7fc1780b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17e191640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc17815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1781614b0 0x7fc1780b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 -- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 msgr2=0x7fc17815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc17815be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 -- 172.21.15.5:0/1420549699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780ca4a0 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17e992640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1781614b0 0x7fc1780b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17e191640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc17815be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.311+0000 7fc17d990640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780d4060 0x7fc17815ae00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc1680098c0 tx=0x7fc1680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.312+0000 7fc16effd640 1 -- 172.21.15.5:0/1420549699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168041020 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.312+0000 7fc16effd640 1 -- 172.21.15.5:0/1420549699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1680044c0 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.312+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17815a040 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.312+0000 7fc16effd640 1 -- 172.21.15.5:0/1420549699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168037040 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.312+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17815a600 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.313+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17804ef20 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.313+0000 7fc16effd640 1 -- 172.21.15.5:0/1420549699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc168044020 con 0x7fc1780d4060 2024-04-25T08:57:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.314+0000 7fc16effd640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc15c06b4d0 0x7fc15c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.314+0000 7fc16effd640 1 -- 172.21.15.5:0/1420549699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1680aa600 con 0x7fc1780d4060 2024-04-25T08:57:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.314+0000 7fc17e191640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc15c06b4d0 0x7fc15c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.314+0000 7fc17e191640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc15c06b4d0 0x7fc15c06d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc174000f60 tx=0x7fc174009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.318+0000 7fc16effd640 1 -- 172.21.15.5:0/1420549699 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc16804b030 con 0x7fc1780d4060 2024-04-25T08:57:21.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.499+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1780b2fa0 con 0x7fc1780d4060 2024-04-25T08:57:21.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.499+0000 7fc16effd640 1 -- 172.21.15.5:0/1420549699 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc168079490 con 0x7fc1780d4060 2024-04-25T08:57:21.489 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc15c06b4d0 msgr2=0x7fc15c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc15c06b4d0 0x7fc15c06d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc174000f60 tx=0x7fc174009040 comp rx=0 tx=0).stop 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780d4060 msgr2=0x7fc17815ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780d4060 0x7fc17815ae00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc1680098c0 tx=0x7fc1680046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 shutdown_connections 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc15c06b4d0 0x7fc15c06d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1781614b0 0x7fc1780b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780d4060 0x7fc17815ae00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 --2- 172.21.15.5:0/1420549699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1780b96e0 0x7fc17815be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 >> 172.21.15.5:0/1420549699 conn(0x7fc17806b000 msgr2=0x7fc1780cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:21.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 shutdown_connections 2024-04-25T08:57:21.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.501+0000 7fc1803f5640 1 -- 172.21.15.5:0/1420549699 wait complete. 2024-04-25T08:57:21.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:21.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.613+0000 7f676a8ac640 1 Processor -- start 2024-04-25T08:57:21.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.613+0000 7f676a8ac640 1 -- start start 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f676a8ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67640d3df0 0x7f67640b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f676a8ac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640b29c0 con 0x7f676415e0a0 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f676a8ac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640d2080 con 0x7f67640d3990 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f676a8ac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640d1460 con 0x7f67640d3df0 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f6768e49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67640d3df0 0x7f67640b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f6763fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f676415e0a0 0x7f67640d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51886/0 (socket says 172.21.15.5:51886) 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f6763fff640 1 -- 172.21.15.5:0/574987134 learned_addr learned my addr 172.21.15.5:0/574987134 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f6768e49640 1 -- 172.21.15.5:0/574987134 >> v1:172.21.15.80:6789/0 conn(0x7f67640d3990 legacy=0x7f67640b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f6768e49640 1 -- 172.21.15.5:0/574987134 >> v1:172.21.15.5:6789/0 conn(0x7f676415e0a0 legacy=0x7f67640d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f6768e49640 1 -- 172.21.15.5:0/574987134 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640d2360 con 0x7f67640d3df0 2024-04-25T08:57:21.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.614+0000 7f6762ffd640 1 -- 172.21.15.5:0/574987134 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696051928 0 0) 0x7f67640b29c0 con 0x7f676415e0a0 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f6768e49640 1 --2- 172.21.15.5:0/574987134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3df0 0x7f67640b7660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f675c009d90 tx=0x7f675c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214eb7d6e8d48cf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f6762ffd640 1 -- 172.21.15.5:0/574987134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c007740 con 0x7f67640d3df0 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f6762ffd640 1 -- 172.21.15.5:0/574987134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c0078e0 con 0x7f67640d3df0 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f6762ffd640 1 -- 172.21.15.5:0/574987134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c007cb0 con 0x7f67640d3df0 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f676a8ac640 1 -- 172.21.15.5:0/574987134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3df0 msgr2=0x7f67640b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f676a8ac640 1 --2- 172.21.15.5:0/574987134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3df0 0x7f67640b7660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f675c009d90 tx=0x7f675c02a6a0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f676a8ac640 1 -- 172.21.15.5:0/574987134 shutdown_connections 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f676a8ac640 1 --2- 172.21.15.5:0/574987134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3df0 0x7f67640b7660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.615+0000 7f676a8ac640 1 -- 172.21.15.5:0/574987134 >> 172.21.15.5:0/574987134 conn(0x7f67640668f0 msgr2=0x7f6764066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.616+0000 7f676a8ac640 1 -- 172.21.15.5:0/574987134 shutdown_connections 2024-04-25T08:57:21.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.616+0000 7f676a8ac640 1 -- 172.21.15.5:0/574987134 wait complete. 2024-04-25T08:57:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.617+0000 7f676a8ac640 1 Processor -- start 2024-04-25T08:57:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.617+0000 7f676a8ac640 1 -- start start 2024-04-25T08:57:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f676a8ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3990 0x7f6764159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f676a8ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67640d3df0 0x7f67641f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f676a8ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f676415e0a0 0x7f67641f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f676a8ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640d2c00 con 0x7f67640d3990 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f676a8ac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640d2920 con 0x7f67640d3df0 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f676a8ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640d4280 con 0x7f676415e0a0 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3990 0x7f6764159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3990 0x7f6764159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42006/0 (socket says 172.21.15.5:42006) 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 -- 172.21.15.5:0/3790372238 learned_addr learned my addr 172.21.15.5:0/3790372238 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6768e49640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f676415e0a0 0x7f67641f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f67637fe640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67640d3df0 0x7f67641f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 -- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f676415e0a0 msgr2=0x7f67641f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f676415e0a0 0x7f67641f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 -- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67640d3df0 msgr2=0x7f67641f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67640d3df0 0x7f67641f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 -- 172.21.15.5:0/3790372238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67641f4070 con 0x7f67640d3990 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.618+0000 7f6763fff640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3990 0x7f6764159fd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f675800c500 tx=0x7f675800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.619+0000 7f6760ff9640 1 -- 172.21.15.5:0/3790372238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758018070 con 0x7f67640d3990 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.619+0000 7f6760ff9640 1 -- 172.21.15.5:0/3790372238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758007580 con 0x7f67640d3990 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.619+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67641f4350 con 0x7f67640d3990 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.619+0000 7f6760ff9640 1 -- 172.21.15.5:0/3790372238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758004a20 con 0x7f67640d3990 2024-04-25T08:57:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.619+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67640ca3a0 con 0x7f67640d3990 2024-04-25T08:57:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.620+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640b42e0 con 0x7f67640d3990 2024-04-25T08:57:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.620+0000 7f6760ff9640 1 -- 172.21.15.5:0/3790372238 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f675801b070 con 0x7f67640d3990 2024-04-25T08:57:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.621+0000 7f6760ff9640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f675006b4d0 0x7f675006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.621+0000 7f6760ff9640 1 -- 172.21.15.5:0/3790372238 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67580893f0 con 0x7f67640d3990 2024-04-25T08:57:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.621+0000 7f67637fe640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f675006b4d0 0x7f675006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.622+0000 7f67637fe640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f675006b4d0 0x7f675006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f67640b65c0 tx=0x7f6754009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.625+0000 7f6760ff9640 1 -- 172.21.15.5:0/3790372238 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6758057cb0 con 0x7f67640d3990 2024-04-25T08:57:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.846+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6764071750 con 0x7f67640d3990 2024-04-25T08:57:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.846+0000 7f6760ff9640 1 -- 172.21.15.5:0/3790372238 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7f675805bd50 con 0x7f67640d3990 2024-04-25T08:57:21.836 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:21.836 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:57:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f675006b4d0 msgr2=0x7f675006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f675006b4d0 0x7f675006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f67640b65c0 tx=0x7f6754009060 comp rx=0 tx=0).stop 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3990 msgr2=0x7f6764159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3990 0x7f6764159fd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f675800c500 tx=0x7f675800c9c0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 shutdown_connections 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f675006b4d0 0x7f675006d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f676415e0a0 0x7f67641f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67640d3df0 0x7f67641f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 --2- 172.21.15.5:0/3790372238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67640d3990 0x7f6764159fd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 >> 172.21.15.5:0/3790372238 conn(0x7f67640668f0 msgr2=0x7f67640cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 shutdown_connections 2024-04-25T08:57:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.849+0000 7f676a8ac640 1 -- 172.21.15.5:0/3790372238 wait complete. 2024-04-25T08:57:21.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.962+0000 7f34d8207640 1 Processor -- start 2024-04-25T08:57:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.962+0000 7f34d8207640 1 -- start start 2024-04-25T08:57:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d8207640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d8207640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d00d0f10 con 0x7f34d00b9990 2024-04-25T08:57:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d8207640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d00d23c0 con 0x7f34d00d3710 2024-04-25T08:57:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d8207640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00d2670 con 0x7f34d00d05f0 2024-04-25T08:57:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d57a2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f34d00b9990 0x7f34d00d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51898/0 (socket says 172.21.15.5:51898) 2024-04-25T08:57:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d57a2640 1 -- 172.21.15.5:0/326218311 learned_addr learned my addr 172.21.15.5:0/326218311 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d5fa3640 1 --2- 172.21.15.5:0/326218311 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d4fa1640 1 -- 172.21.15.5:0/326218311 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555219704 0 0) 0x7f34d00d0f10 con 0x7f34d00b9990 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d4fa1640 1 -- 172.21.15.5:0/326218311 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34bc003520 con 0x7f34d00b9990 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d4fa1640 1 -- 172.21.15.5:0/326218311 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548721387 0 0) 0x7f34d00d23c0 con 0x7f34d00d3710 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d4fa1640 1 -- 172.21.15.5:0/326218311 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d00d0f10 con 0x7f34d00d3710 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d5fa3640 1 -- 172.21.15.5:0/326218311 >> v1:172.21.15.80:6789/0 conn(0x7f34d00d3710 legacy=0x7f34d00b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d5fa3640 1 -- 172.21.15.5:0/326218311 >> v1:172.21.15.5:6789/0 conn(0x7f34d00b9990 legacy=0x7f34d00d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.963+0000 7f34d5fa3640 1 -- 172.21.15.5:0/326218311 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00d2950 con 0x7f34d00d05f0 2024-04-25T08:57:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.964+0000 7f34d5fa3640 1 --2- 172.21.15.5:0/326218311 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00d09d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097d0 tx=0x7f34cc02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e7860a3a84749b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.964+0000 7f34d4fa1640 1 -- 172.21.15.5:0/326218311 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc037070 con 0x7f34d00d05f0 2024-04-25T08:57:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.964+0000 7f34d4fa1640 1 -- 172.21.15.5:0/326218311 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc032440 con 0x7f34d00d05f0 2024-04-25T08:57:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.964+0000 7f34d4fa1640 1 -- 172.21.15.5:0/326218311 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0327f0 con 0x7f34d00d05f0 2024-04-25T08:57:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.965+0000 7f34d8207640 1 -- 172.21.15.5:0/326218311 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 msgr2=0x7f34d00d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.965+0000 7f34d8207640 1 --2- 172.21.15.5:0/326218311 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00d09d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097d0 tx=0x7f34cc02a290 comp rx=0 tx=0).stop 2024-04-25T08:57:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.965+0000 7f34d8207640 1 -- 172.21.15.5:0/326218311 shutdown_connections 2024-04-25T08:57:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.965+0000 7f34d8207640 1 --2- 172.21.15.5:0/326218311 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00d09d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.965+0000 7f34d8207640 1 -- 172.21.15.5:0/326218311 >> 172.21.15.5:0/326218311 conn(0x7f34d006b000 msgr2=0x7f34d006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.965+0000 7f34d8207640 1 -- 172.21.15.5:0/326218311 shutdown_connections 2024-04-25T08:57:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.965+0000 7f34d8207640 1 -- 172.21.15.5:0/326218311 wait complete. 2024-04-25T08:57:21.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.966+0000 7f34d8207640 1 Processor -- start 2024-04-25T08:57:21.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.966+0000 7f34d8207640 1 -- start start 2024-04-25T08:57:21.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d8207640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d8207640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00d3710 0x7f34d00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d8207640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d00b5130 0x7f34d00ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d8207640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d015e090 con 0x7f34d00b5130 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d8207640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00d2f10 con 0x7f34d00d3710 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d8207640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d015e210 con 0x7f34d00d05f0 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d00b5130 0x7f34d00ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d00b5130 0x7f34d00ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42012/0 (socket says 172.21.15.5:42012) 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 -- 172.21.15.5:0/318107680 learned_addr learned my addr 172.21.15.5:0/318107680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d57a2640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00d3710 0x7f34d00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d5fa3640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 -- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 msgr2=0x7f34d00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 -- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00d3710 msgr2=0x7f34d00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:21.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00d3710 0x7f34d00b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 -- 172.21.15.5:0/318107680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00cb920 con 0x7f34d00b5130 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d5fa3640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.967+0000 7f34d67a4640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d00b5130 0x7f34d00ccfd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c6e0 tx=0x7f34c800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.968+0000 7f34c67fc640 1 -- 172.21.15.5:0/318107680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8003b70 con 0x7f34d00b5130 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.968+0000 7f34c67fc640 1 -- 172.21.15.5:0/318107680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8003d10 con 0x7f34d00b5130 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.968+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d01f3930 con 0x7f34d00b5130 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.968+0000 7f34c67fc640 1 -- 172.21.15.5:0/318107680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80052d0 con 0x7f34d00b5130 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.968+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d01f3ef0 con 0x7f34d00b5130 2024-04-25T08:57:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.969+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d004ef20 con 0x7f34d00b5130 2024-04-25T08:57:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.969+0000 7f34c67fc640 1 -- 172.21.15.5:0/318107680 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34c8005470 con 0x7f34d00b5130 2024-04-25T08:57:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.969+0000 7f34c67fc640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34b406b4d0 0x7f34b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.970+0000 7f34c67fc640 1 -- 172.21.15.5:0/318107680 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34c808a0d0 con 0x7f34d00b5130 2024-04-25T08:57:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.970+0000 7f34d5fa3640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34b406b4d0 0x7f34b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.970+0000 7f34d5fa3640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34b406b4d0 0x7f34b406d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f34cc034000 tx=0x7f34cc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:21.974+0000 7f34c67fc640 1 -- 172.21.15.5:0/318107680 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34c8058f50 con 0x7f34d00b5130 2024-04-25T08:57:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.154+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34d00b3320 con 0x7f34d00b5130 2024-04-25T08:57:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.155+0000 7f34c67fc640 1 -- 172.21.15.5:0/318107680 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f34c8058850 con 0x7f34d00b5130 2024-04-25T08:57:22.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.157+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34b406b4d0 msgr2=0x7f34b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.157+0000 7f34d8207640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34b406b4d0 0x7f34b406d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f34cc034000 tx=0x7f34cc02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.157+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d00b5130 msgr2=0x7f34d00ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.157+0000 7f34d8207640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d00b5130 0x7f34d00ccfd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c6e0 tx=0x7f34c800cba0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.157+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 shutdown_connections 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.158+0000 7f34d8207640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34b406b4d0 0x7f34b406d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.158+0000 7f34d8207640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d00b5130 0x7f34d00ccfd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.158+0000 7f34d8207640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00d3710 0x7f34d00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.158+0000 7f34d8207640 1 --2- 172.21.15.5:0/318107680 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34d00d05f0 0x7f34d00cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.158+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 >> 172.21.15.5:0/318107680 conn(0x7f34d006b000 msgr2=0x7f34d00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.158+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 shutdown_connections 2024-04-25T08:57:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.158+0000 7f34d8207640 1 -- 172.21.15.5:0/318107680 wait complete. 2024-04-25T08:57:22.158 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:57:22.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.270+0000 7f3dd7838640 1 Processor -- start 2024-04-25T08:57:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.271+0000 7f3dd7838640 1 -- start start 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.271+0000 7f3dd7838640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd015e0a0 0x7f3dd00d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.271+0000 7f3dd7838640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3dd00d3990 0x7f3dd00d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.271+0000 7f3dd7838640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00b7f60 con 0x7f3dd00ce5e0 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.271+0000 7f3dd7838640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00d4330 con 0x7f3dd00d3990 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.271+0000 7f3dd7838640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00b29c0 con 0x7f3dd015e0a0 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd5dd5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3dd00ce5e0 0x7f3dd00cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51914/0 (socket says 172.21.15.5:51914) 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd5dd5640 1 -- 172.21.15.5:0/825680460 learned_addr learned my addr 172.21.15.5:0/825680460 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd55d4640 1 --2- 172.21.15.5:0/825680460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd015e0a0 0x7f3dd00d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd4dd3640 1 --2- 172.21.15.5:0/825680460 >> v2:172.21.15.80:3300/0 conn(0x7f3dd00d3990 0x7f3dd00d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dc7fff640 1 -- 172.21.15.5:0/825680460 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987937221 0 0) 0x7f3dd00b7f60 con 0x7f3dd00ce5e0 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dc7fff640 1 -- 172.21.15.5:0/825680460 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dbc003520 con 0x7f3dd00ce5e0 2024-04-25T08:57:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd55d4640 1 -- 172.21.15.5:0/825680460 >> v2:172.21.15.80:3300/0 conn(0x7f3dd00d3990 msgr2=0x7f3dd00d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd55d4640 1 --2- 172.21.15.5:0/825680460 >> v2:172.21.15.80:3300/0 conn(0x7f3dd00d3990 0x7f3dd00d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd55d4640 1 -- 172.21.15.5:0/825680460 >> v1:172.21.15.5:6789/0 conn(0x7f3dd00ce5e0 legacy=0x7f3dd00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.272+0000 7f3dd55d4640 1 -- 172.21.15.5:0/825680460 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00d2080 con 0x7f3dd015e0a0 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.273+0000 7f3dd55d4640 1 --2- 172.21.15.5:0/825680460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd015e0a0 0x7f3dd00d0d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00097a0 tx=0x7f3dc002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13938cd129b5fd25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.273+0000 7f3dc7fff640 1 -- 172.21.15.5:0/825680460 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0037070 con 0x7f3dd015e0a0 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.273+0000 7f3dc7fff640 1 -- 172.21.15.5:0/825680460 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0032440 con 0x7f3dd015e0a0 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.273+0000 7f3dc7fff640 1 -- 172.21.15.5:0/825680460 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc00327f0 con 0x7f3dd015e0a0 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 -- 172.21.15.5:0/825680460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd015e0a0 msgr2=0x7f3dd00d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 --2- 172.21.15.5:0/825680460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd015e0a0 0x7f3dd00d0d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00097a0 tx=0x7f3dc002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 -- 172.21.15.5:0/825680460 shutdown_connections 2024-04-25T08:57:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 --2- 172.21.15.5:0/825680460 >> v2:172.21.15.80:3300/0 conn(0x7f3dd00d3990 0x7f3dd00d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 --2- 172.21.15.5:0/825680460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd015e0a0 0x7f3dd00d0d50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 -- 172.21.15.5:0/825680460 >> 172.21.15.5:0/825680460 conn(0x7f3dd00668f0 msgr2=0x7f3dd0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 -- 172.21.15.5:0/825680460 shutdown_connections 2024-04-25T08:57:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.274+0000 7f3dd7838640 1 -- 172.21.15.5:0/825680460 wait complete. 2024-04-25T08:57:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.275+0000 7f3dd7838640 1 Processor -- start 2024-04-25T08:57:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.275+0000 7f3dd7838640 1 -- start start 2024-04-25T08:57:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd7838640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd00ce5e0 0x7f3dd0160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd7838640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd00d3990 0x7f3dd0157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd7838640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dd015e0a0 0x7f3dd0158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd7838640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00d2920 con 0x7f3dd015e0a0 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd7838640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00d2640 con 0x7f3dd00d3990 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd7838640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00d2c00 con 0x7f3dd00ce5e0 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dd015e0a0 0x7f3dd0158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dd015e0a0 0x7f3dd0158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42016/0 (socket says 172.21.15.5:42016) 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 -- 172.21.15.5:0/398517253 learned_addr learned my addr 172.21.15.5:0/398517253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd4dd3640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd00d3990 0x7f3dd0157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd55d4640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd00ce5e0 0x7f3dd0160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 -- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd00ce5e0 msgr2=0x7f3dd0160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd00ce5e0 0x7f3dd0160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 -- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd00d3990 msgr2=0x7f3dd0157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd00d3990 0x7f3dd0157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.276+0000 7f3dd5dd5640 1 -- 172.21.15.5:0/398517253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0158760 con 0x7f3dd015e0a0 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.277+0000 7f3dd5dd5640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dd015e0a0 0x7f3dd0158150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800caa0 tx=0x7f3dc800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.277+0000 7f3dc5ffb640 1 -- 172.21.15.5:0/398517253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8017070 con 0x7f3dd015e0a0 2024-04-25T08:57:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.277+0000 7f3dc5ffb640 1 -- 172.21.15.5:0/398517253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800ac00 con 0x7f3dd015e0a0 2024-04-25T08:57:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.277+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00acb30 con 0x7f3dd015e0a0 2024-04-25T08:57:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.277+0000 7f3dc5ffb640 1 -- 172.21.15.5:0/398517253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8012400 con 0x7f3dd015e0a0 2024-04-25T08:57:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.277+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd015e890 con 0x7f3dd015e0a0 2024-04-25T08:57:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.278+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd004ef20 con 0x7f3dd015e0a0 2024-04-25T08:57:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.279+0000 7f3dc5ffb640 1 -- 172.21.15.5:0/398517253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3dc801a070 con 0x7f3dd015e0a0 2024-04-25T08:57:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.279+0000 7f3dc5ffb640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3db406b4d0 0x7f3db406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.279+0000 7f3dc5ffb640 1 -- 172.21.15.5:0/398517253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3dc8089f20 con 0x7f3dd015e0a0 2024-04-25T08:57:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.279+0000 7f3dd55d4640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3db406b4d0 0x7f3db406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.280+0000 7f3dd55d4640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3db406b4d0 0x7f3db406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0034000 tx=0x7f3dc002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.283+0000 7f3dc5ffb640 1 -- 172.21.15.5:0/398517253 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3dc8058e30 con 0x7f3dd015e0a0 2024-04-25T08:57:22.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.502+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dd00b4a60 con 0x7f3dd015e0a0 2024-04-25T08:57:22.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.503+0000 7f3dc5ffb640 1 -- 172.21.15.5:0/398517253 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7f3dc8058730 con 0x7f3dd015e0a0 2024-04-25T08:57:22.493 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:22.493 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:57:22.493 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3db406b4d0 msgr2=0x7f3db406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3db406b4d0 0x7f3db406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0034000 tx=0x7f3dc002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dd015e0a0 msgr2=0x7f3dd0158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dd015e0a0 0x7f3dd0158150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800caa0 tx=0x7f3dc800cf60 comp rx=0 tx=0).stop 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 shutdown_connections 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3db406b4d0 0x7f3db406d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dd015e0a0 0x7f3dd0158150 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd00d3990 0x7f3dd0157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 --2- 172.21.15.5:0/398517253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3dd00ce5e0 0x7f3dd0160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 >> 172.21.15.5:0/398517253 conn(0x7f3dd00668f0 msgr2=0x7f3dd00cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 shutdown_connections 2024-04-25T08:57:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.505+0000 7f3dd7838640 1 -- 172.21.15.5:0/398517253 wait complete. 2024-04-25T08:57:22.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.618+0000 7fa2f4ab3640 1 Processor -- start 2024-04-25T08:57:22.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.618+0000 7fa2f4ab3640 1 -- start start 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.619+0000 7fa2f4ab3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2f00afe80 0x7fa2f00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.619+0000 7fa2f4ab3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2f006e610 0x7fa2f006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.619+0000 7fa2f4ab3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.619+0000 7fa2f4ab3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f00b0260 con 0x7fa2f00afe80 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.619+0000 7fa2f4ab3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f006f160 con 0x7fa2f006e610 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.619+0000 7fa2f4ab3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00b3820 con 0x7fa2f00713f0 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2f00afe80 0x7fa2f00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2f00afe80 0x7fa2f00b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42022/0 (socket says 172.21.15.5:42022) 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 -- 172.21.15.5:0/1477596443 learned_addr learned my addr 172.21.15.5:0/1477596443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:22.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2eed9d640 1 --2- 172.21.15.5:0/1477596443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2edd9b640 1 --2- 172.21.15.5:0/1477596443 >> v2:172.21.15.80:3300/0 conn(0x7fa2f006e610 0x7fa2f006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 -- 172.21.15.5:0/1477596443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 msgr2=0x7fa2f0071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 --2- 172.21.15.5:0/1477596443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 -- 172.21.15.5:0/1477596443 >> v2:172.21.15.80:3300/0 conn(0x7fa2f006e610 msgr2=0x7fa2f006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 --2- 172.21.15.5:0/1477596443 >> v2:172.21.15.80:3300/0 conn(0x7fa2f006e610 0x7fa2f006ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2ee59c640 1 -- 172.21.15.5:0/1477596443 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00b3b00 con 0x7fa2f00afe80 2024-04-25T08:57:22.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.620+0000 7fa2eed9d640 1 --2- 172.21.15.5:0/1477596443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.621+0000 7fa2ee59c640 1 --2- 172.21.15.5:0/1477596443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f00afe80 0x7fa2f00b45e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa2f006cc20 tx=0x7fa2e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6160f89cc5691cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.621+0000 7fa2ed59a640 1 -- 172.21.15.5:0/1477596443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037070 con 0x7fa2f00afe80 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.621+0000 7fa2ed59a640 1 -- 172.21.15.5:0/1477596443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0032440 con 0x7fa2f00afe80 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.621+0000 7fa2ed59a640 1 -- 172.21.15.5:0/1477596443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0032810 con 0x7fa2f00afe80 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.621+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/1477596443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f00afe80 msgr2=0x7fa2f00b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.621+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/1477596443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f00afe80 0x7fa2f00b45e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa2f006cc20 tx=0x7fa2e002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.622+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/1477596443 shutdown_connections 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.622+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/1477596443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.622+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/1477596443 >> v2:172.21.15.80:3300/0 conn(0x7fa2f006e610 0x7fa2f006ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.622+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/1477596443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f00afe80 0x7fa2f00b45e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.622+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/1477596443 >> 172.21.15.5:0/1477596443 conn(0x7fa2f00d0870 msgr2=0x7fa2f00d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.622+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/1477596443 shutdown_connections 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.622+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/1477596443 wait complete. 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.623+0000 7fa2f4ab3640 1 Processor -- start 2024-04-25T08:57:22.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.623+0000 7fa2f4ab3640 1 -- start start 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2f4ab3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f006e610 0x7fa2f014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2f4ab3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2f4ab3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00afe80 0x7fa2f01521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2f4ab3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f015f2b0 con 0x7fa2f006e610 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2f4ab3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00b40c0 con 0x7fa2f00afe80 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2f4ab3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f006d3f0 con 0x7fa2f00713f0 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f006e610 0x7fa2f014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f006e610 0x7fa2f014b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42034/0 (socket says 172.21.15.5:42034) 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 -- 172.21.15.5:0/4028763949 learned_addr learned my addr 172.21.15.5:0/4028763949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2eed9d640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00afe80 0x7fa2f01521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2edd9b640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 -- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 msgr2=0x7fa2f0151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 -- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00afe80 msgr2=0x7fa2f01521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00afe80 0x7fa2f01521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 -- 172.21.15.5:0/4028763949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f014a6c0 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.624+0000 7fa2ee59c640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f006e610 0x7fa2f014b740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2e002a220 tx=0x7fa2e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.625+0000 7fa2e6ffd640 1 -- 172.21.15.5:0/4028763949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037040 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.625+0000 7fa2e6ffd640 1 -- 172.21.15.5:0/4028763949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0042070 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.625+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f014ac60 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.625+0000 7fa2e6ffd640 1 -- 172.21.15.5:0/4028763949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0030bb0 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.625+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f014b220 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.626+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f004ef20 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.626+0000 7fa2e6ffd640 1 -- 172.21.15.5:0/4028763949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa2e0047460 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.627+0000 7fa2e6ffd640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.627+0000 7fa2e6ffd640 1 -- 172.21.15.5:0/4028763949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2e00aacd0 con 0x7fa2f006e610 2024-04-25T08:57:22.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.627+0000 7fa2edd9b640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.628+0000 7fa2edd9b640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2d006b4d0 0x7fa2d006d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0148d00 tx=0x7fa2d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.631+0000 7fa2e6ffd640 1 -- 172.21.15.5:0/4028763949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa2e0079500 con 0x7fa2f006e610 2024-04-25T08:57:22.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.848+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2f00b1c50 con 0x7fa2f006e610 2024-04-25T08:57:22.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.849+0000 7fa2e6ffd640 1 -- 172.21.15.5:0/4028763949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4923 (secure 0 0 0) 0x7fa2e007d5a0 con 0x7fa2f006e610 2024-04-25T08:57:22.839 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:22.839 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164076412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":164076412},{"type":"v1","addr":"172.21.15.5:6835","nonce":164076412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3761369424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3761369424},{"type":"v1","addr":"172.21.15.5:6834","nonce":3761369424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1685641856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1685641856},{"type":"v1","addr":"172.21.15.80:6835","nonce":1685641856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:44.561711+0000","modified":"2024-04-25T08:56:46.553083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4114119067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":4114119067},{"type":"v1","addr":"172.21.15.80:6837","nonce":4114119067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:57:22.839 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2d006b4d0 msgr2=0x7fa2d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2d006b4d0 0x7fa2d006d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0148d00 tx=0x7fa2d8008040 comp rx=0 tx=0).stop 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f006e610 msgr2=0x7fa2f014b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f006e610 0x7fa2f014b740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2e002a220 tx=0x7fa2e00046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 shutdown_connections 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00afe80 0x7fa2f01521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2f00713f0 0x7fa2f0151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 --2- 172.21.15.5:0/4028763949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2f006e610 0x7fa2f014b740 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 >> 172.21.15.5:0/4028763949 conn(0x7fa2f00d0870 msgr2=0x7fa2f006f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 shutdown_connections 2024-04-25T08:57:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.851+0000 7fa2f4ab3640 1 -- 172.21.15.5:0/4028763949 wait complete. 2024-04-25T08:57:22.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.965+0000 7f7061542640 1 Processor -- start 2024-04-25T08:57:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.965+0000 7f7061542640 1 -- start start 2024-04-25T08:57:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f7061542640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f705c0b0a50 0x7f705c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f7061542640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0cbf40 0x7f705c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f7061542640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c06ba50 con 0x7f705c0b0e30 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f7061542640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c06b800 con 0x7f705c0b0a50 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f7061542640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c06bd30 con 0x7f705c0cbf40 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f705b7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0cbf40 0x7f705c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f705affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f705c0b0a50 0x7f705c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f705b7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0cbf40 0x7f705c0ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:59806/0 (socket says 172.21.15.5:59806) 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f705b7fe640 1 -- 172.21.15.5:0/1525612955 learned_addr learned my addr 172.21.15.5:0/1525612955 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f705affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f705c0b0a50 0x7f705c0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:58102/0 (socket says 172.21.15.5:58102) 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.966+0000 7f705a7fc640 1 --1- 172.21.15.5:0/1525612955 >> v1:172.21.15.80:6789/0 conn(0x7f705c0b0e30 0x7f705c0d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:40622/0 (socket says 172.21.15.5:40622) 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.967+0000 7f705b7fe640 1 -- 172.21.15.5:0/1525612955 >> v2:172.21.15.80:3300/0 conn(0x7f705c0b0a50 msgr2=0x7f705c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.967+0000 7f705b7fe640 1 --2- 172.21.15.5:0/1525612955 >> v2:172.21.15.80:3300/0 conn(0x7f705c0b0a50 0x7f705c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.967+0000 7f705b7fe640 1 -- 172.21.15.5:0/1525612955 >> v1:172.21.15.80:6789/0 conn(0x7f705c0b0e30 legacy=0x7f705c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.967+0000 7f705b7fe640 1 -- 172.21.15.5:0/1525612955 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c06c010 con 0x7f705c0cbf40 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.967+0000 7f705b7fe640 1 --2- 172.21.15.5:0/1525612955 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0cbf40 0x7f705c0ce740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7054009e50 tx=0x7f705402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c793550f9520e22f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7059ffb640 1 -- 172.21.15.5:0/1525612955 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054036070 con 0x7f705c0cbf40 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7059ffb640 1 -- 172.21.15.5:0/1525612955 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054031600 con 0x7f705c0cbf40 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7059ffb640 1 -- 172.21.15.5:0/1525612955 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540319d0 con 0x7f705c0cbf40 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 -- 172.21.15.5:0/1525612955 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0cbf40 msgr2=0x7f705c0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 --2- 172.21.15.5:0/1525612955 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0cbf40 0x7f705c0ce740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7054009e50 tx=0x7f705402a680 comp rx=0 tx=0).stop 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 -- 172.21.15.5:0/1525612955 shutdown_connections 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 --2- 172.21.15.5:0/1525612955 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0cbf40 0x7f705c0ce740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 --2- 172.21.15.5:0/1525612955 >> v2:172.21.15.80:3300/0 conn(0x7f705c0b0a50 0x7f705c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 -- 172.21.15.5:0/1525612955 >> 172.21.15.5:0/1525612955 conn(0x7f705c0d18f0 msgr2=0x7f705c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 -- 172.21.15.5:0/1525612955 shutdown_connections 2024-04-25T08:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.968+0000 7f7061542640 1 -- 172.21.15.5:0/1525612955 wait complete. 2024-04-25T08:57:22.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.970+0000 7f7061542640 1 Processor -- start 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.970+0000 7f7061542640 1 -- start start 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.970+0000 7f7061542640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f705c0b0a50 0x7f705c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.970+0000 7f7061542640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0b0e30 0x7f705c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.970+0000 7f7061542640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705c0cbf40 0x7f705c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.970+0000 7f7061542640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b2bf0 con 0x7f705c0b0a50 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f7061542640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0cfd60 con 0x7f705c0cbf40 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f7061542640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0c8f00 con 0x7f705c0b0e30 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f705c0b0a50 0x7f705c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f705c0b0a50 0x7f705c1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42036/0 (socket says 172.21.15.5:42036) 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 -- 172.21.15.5:0/1828879775 learned_addr learned my addr 172.21.15.5:0/1828879775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705a7fc640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0b0e30 0x7f705c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705b7fe640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705c0cbf40 0x7f705c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 -- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0b0e30 msgr2=0x7f705c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0b0e30 0x7f705c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 -- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705c0cbf40 msgr2=0x7f705c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705c0cbf40 0x7f705c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 -- 172.21.15.5:0/1828879775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0c91a0 con 0x7f705c0b0a50 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705b7fe640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705c0cbf40 0x7f705c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f705affd640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f705c0b0a50 0x7f705c1583e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9b0 tx=0x7f705000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f70437fe640 1 -- 172.21.15.5:0/1828879775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050017070 con 0x7f705c0b0a50 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f70437fe640 1 -- 172.21.15.5:0/1828879775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705000c9a0 con 0x7f705c0b0a50 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c0c9480 con 0x7f705c0b0a50 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f70437fe640 1 -- 172.21.15.5:0/1828879775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000cd90 con 0x7f705c0b0a50 2024-04-25T08:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.971+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c0c9a40 con 0x7f705c0b0a50 2024-04-25T08:57:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.972+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c06cd70 con 0x7f705c0b0a50 2024-04-25T08:57:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.973+0000 7f70437fe640 1 -- 172.21.15.5:0/1828879775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f705001a070 con 0x7f705c0b0a50 2024-04-25T08:57:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.973+0000 7f70437fe640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f704806b4d0 0x7f704806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.973+0000 7f70437fe640 1 -- 172.21.15.5:0/1828879775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f705008a540 con 0x7f705c0b0a50 2024-04-25T08:57:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.974+0000 7f705a7fc640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f704806b4d0 0x7f704806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.974+0000 7f705a7fc640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f704806b4d0 0x7f704806d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f705c0b5710 tx=0x7f704c007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:22.977+0000 7f70437fe640 1 -- 172.21.15.5:0/1828879775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7050059450 con 0x7f705c0b0a50 2024-04-25T08:57:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.159+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f705c0cca60 con 0x7f705c0b0a50 2024-04-25T08:57:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.160+0000 7f70437fe640 1 -- 172.21.15.5:0/1828879775 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f705c0cca60 con 0x7f705c0b0a50 2024-04-25T08:57:23.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:23.150 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:56:46.198393+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:42.385900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:43.541546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f704806b4d0 msgr2=0x7f704806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f704806b4d0 0x7f704806d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f705c0b5710 tx=0x7f704c007cc0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f705c0b0a50 msgr2=0x7f705c1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f705c0b0a50 0x7f705c1583e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9b0 tx=0x7f705000ee70 comp rx=0 tx=0).stop 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 shutdown_connections 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f704806b4d0 0x7f704806d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705c0cbf40 0x7f705c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f705c0b0e30 0x7f705c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 --2- 172.21.15.5:0/1828879775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f705c0b0a50 0x7f705c1583e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 >> 172.21.15.5:0/1828879775 conn(0x7f705c0d18f0 msgr2=0x7f705c0cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 shutdown_connections 2024-04-25T08:57:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.162+0000 7f7061542640 1 -- 172.21.15.5:0/1828879775 wait complete. 2024-04-25T08:57:23.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:57:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.274+0000 7effad49e640 1 Processor -- start 2024-04-25T08:57:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.274+0000 7effad49e640 1 -- start start 2024-04-25T08:57:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effad49e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa81581e0 0x7effa80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effad49e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effa8067000 0x7effa8161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effad49e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa80ae5e0 con 0x7effa815ef00 2024-04-25T08:57:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effad49e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa80ae300 con 0x7effa8067000 2024-04-25T08:57:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effad49e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa815e420 con 0x7effa81581e0 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effa77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effa8067000 0x7effa8161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effa67fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7effa815ef00 0x7effa80668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51922/0 (socket says 172.21.15.5:51922) 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effa67fc640 1 -- 172.21.15.5:0/2847342687 learned_addr learned my addr 172.21.15.5:0/2847342687 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.275+0000 7effa6ffd640 1 --2- 172.21.15.5:0/2847342687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa81581e0 0x7effa80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.276+0000 7effa77fe640 1 -- 172.21.15.5:0/2847342687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa81581e0 msgr2=0x7effa80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.276+0000 7effa77fe640 1 --2- 172.21.15.5:0/2847342687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa81581e0 0x7effa80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.276+0000 7effa77fe640 1 -- 172.21.15.5:0/2847342687 >> v1:172.21.15.5:6789/0 conn(0x7effa815ef00 legacy=0x7effa80668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.276+0000 7effa5ffb640 1 -- 172.21.15.5:0/2847342687 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466702821 0 0) 0x7effa80ae5e0 con 0x7effa815ef00 2024-04-25T08:57:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.276+0000 7effa77fe640 1 -- 172.21.15.5:0/2847342687 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa815e700 con 0x7effa8067000 2024-04-25T08:57:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.276+0000 7effa77fe640 1 --2- 172.21.15.5:0/2847342687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa8067000 0x7effa8161800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7effa0009d90 tx=0x7effa002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca67d083a1c3f78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effa5ffb640 1 -- 172.21.15.5:0/2847342687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0031600 con 0x7effa8067000 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effa5ffb640 1 -- 172.21.15.5:0/2847342687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00317a0 con 0x7effa8067000 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effa5ffb640 1 -- 172.21.15.5:0/2847342687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0031b70 con 0x7effa8067000 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 -- 172.21.15.5:0/2847342687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa8067000 msgr2=0x7effa8161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 --2- 172.21.15.5:0/2847342687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa8067000 0x7effa8161800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7effa0009d90 tx=0x7effa002a5d0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 -- 172.21.15.5:0/2847342687 shutdown_connections 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 --2- 172.21.15.5:0/2847342687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa8067000 0x7effa8161800 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 --2- 172.21.15.5:0/2847342687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa81581e0 0x7effa80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 -- 172.21.15.5:0/2847342687 >> 172.21.15.5:0/2847342687 conn(0x7effa80d0870 msgr2=0x7effa80d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 -- 172.21.15.5:0/2847342687 shutdown_connections 2024-04-25T08:57:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.277+0000 7effad49e640 1 -- 172.21.15.5:0/2847342687 wait complete. 2024-04-25T08:57:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.278+0000 7effad49e640 1 Processor -- start 2024-04-25T08:57:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effad49e640 1 -- start start 2024-04-25T08:57:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effad49e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa8067000 0x7effa81f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effad49e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effa81581e0 0x7effa80ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effad49e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815ef00 0x7effa8145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effad49e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80afd50 con 0x7effa815ef00 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effad49e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81585c0 con 0x7effa81581e0 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effad49e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80add80 con 0x7effa8067000 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effa77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815ef00 0x7effa8145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effa77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815ef00 0x7effa8145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42058/0 (socket says 172.21.15.5:42058) 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.279+0000 7effa77fe640 1 -- 172.21.15.5:0/3981978915 learned_addr learned my addr 172.21.15.5:0/3981978915 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa6ffd640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa8067000 0x7effa81f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa67fc640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effa81581e0 0x7effa80ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa77fe640 1 -- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa8067000 msgr2=0x7effa81f7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa77fe640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa8067000 0x7effa81f7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa77fe640 1 -- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effa81581e0 msgr2=0x7effa80ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa77fe640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effa81581e0 0x7effa80ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa77fe640 1 -- 172.21.15.5:0/3981978915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80cf0f0 con 0x7effa815ef00 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effa77fe640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815ef00 0x7effa8145250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7effa002abc0 tx=0x7effa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7eff8f7fe640 1 -- 172.21.15.5:0/3981978915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0040070 con 0x7effa815ef00 2024-04-25T08:57:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7eff8f7fe640 1 -- 172.21.15.5:0/3981978915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0030b60 con 0x7effa815ef00 2024-04-25T08:57:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa80cf3d0 con 0x7effa815ef00 2024-04-25T08:57:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7eff8f7fe640 1 -- 172.21.15.5:0/3981978915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0009450 con 0x7effa815ef00 2024-04-25T08:57:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.280+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa80cf990 con 0x7effa815ef00 2024-04-25T08:57:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.282+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa80b5170 con 0x7effa815ef00 2024-04-25T08:57:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.282+0000 7eff8f7fe640 1 -- 172.21.15.5:0/3981978915 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effa0039040 con 0x7effa815ef00 2024-04-25T08:57:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.282+0000 7eff8f7fe640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff9406b4d0 0x7eff9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.282+0000 7eff8f7fe640 1 -- 172.21.15.5:0/3981978915 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effa00ab740 con 0x7effa815ef00 2024-04-25T08:57:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.282+0000 7effa6ffd640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff9406b4d0 0x7eff9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.283+0000 7effa6ffd640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff9406b4d0 0x7eff9406d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff98009b40 tx=0x7eff98009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.286+0000 7eff8f7fe640 1 -- 172.21.15.5:0/3981978915 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effa80b5170 con 0x7effa815ef00 2024-04-25T08:57:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.523+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7effa804ef20 con 0x7effa815ef00 2024-04-25T08:57:23.513 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T08:57:23.524+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:57:23.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.525+0000 7eff8f7fe640 1 -- 172.21.15.5:0/3981978915 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7effa007a000 con 0x7effa815ef00 2024-04-25T08:57:23.514 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:57:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff9406b4d0 msgr2=0x7eff9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff9406b4d0 0x7eff9406d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff98009b40 tx=0x7eff98009190 comp rx=0 tx=0).stop 2024-04-25T08:57:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815ef00 msgr2=0x7effa8145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815ef00 0x7effa8145250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7effa002abc0 tx=0x7effa0004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 shutdown_connections 2024-04-25T08:57:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff9406b4d0 0x7eff9406d990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815ef00 0x7effa8145250 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effa81581e0 0x7effa80ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 --2- 172.21.15.5:0/3981978915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effa8067000 0x7effa81f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 >> 172.21.15.5:0/3981978915 conn(0x7effa80d0870 msgr2=0x7effa8156850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 shutdown_connections 2024-04-25T08:57:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.527+0000 7effad49e640 1 -- 172.21.15.5:0/3981978915 wait complete. 2024-04-25T08:57:23.523 INFO:tasks.ceph.mds.b.smithi080.stderr: -6783> 2024-04-25T08:56:48.885+0000 7f55e17c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:57:23.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:57:23.555 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T08:57:23.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.641+0000 7f328c441640 1 Processor -- start 2024-04-25T08:57:23.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.641+0000 7f328c441640 1 -- start start 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328c441640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f328415bce0 0x7f328406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328c441640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328415c0c0 con 0x7f32840b3b90 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328c441640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3284070e90 con 0x7f32840cf790 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328c441640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3284071170 con 0x7f328415bce0 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328a1dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f328415bce0 0x7f328406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328a9de640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f32840b3b90 0x7f3284071c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51934/0 (socket says 172.21.15.5:51934) 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328a9de640 1 -- 172.21.15.5:0/891472488 learned_addr learned my addr 172.21.15.5:0/891472488 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:23.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328a1dd640 1 --2- 172.21.15.5:0/891472488 >> v2:172.21.15.5:3300/0 conn(0x7f328415bce0 0x7f328406c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42062/0 (socket says 172.21.15.5:42062) 2024-04-25T08:57:23.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328a1dd640 1 -- 172.21.15.5:0/891472488 >> v1:172.21.15.80:6789/0 conn(0x7f32840cf790 legacy=0x7f32840b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:23.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328a1dd640 1 -- 172.21.15.5:0/891472488 >> v1:172.21.15.5:6789/0 conn(0x7f32840b3b90 legacy=0x7f3284071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.642+0000 7f328a1dd640 1 -- 172.21.15.5:0/891472488 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284071450 con 0x7f328415bce0 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.643+0000 7f328a1dd640 1 --2- 172.21.15.5:0/891472488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f328406c400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f32800097a0 tx=0x7f328002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9605e31c649312 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.643+0000 7f32891db640 1 -- 172.21.15.5:0/891472488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280037070 con 0x7f328415bce0 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.643+0000 7f32891db640 1 -- 172.21.15.5:0/891472488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3280032440 con 0x7f328415bce0 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.643+0000 7f32891db640 1 -- 172.21.15.5:0/891472488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280032810 con 0x7f328415bce0 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.644+0000 7f328c441640 1 -- 172.21.15.5:0/891472488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 msgr2=0x7f328406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.644+0000 7f328c441640 1 --2- 172.21.15.5:0/891472488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f328406c400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f32800097a0 tx=0x7f328002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.644+0000 7f328c441640 1 -- 172.21.15.5:0/891472488 shutdown_connections 2024-04-25T08:57:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.644+0000 7f328c441640 1 --2- 172.21.15.5:0/891472488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f328406c400 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.644+0000 7f328c441640 1 -- 172.21.15.5:0/891472488 >> 172.21.15.5:0/891472488 conn(0x7f32840b1550 msgr2=0x7f32840b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:23.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.644+0000 7f328c441640 1 -- 172.21.15.5:0/891472488 shutdown_connections 2024-04-25T08:57:23.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.644+0000 7f328c441640 1 -- 172.21.15.5:0/891472488 wait complete. 2024-04-25T08:57:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.645+0000 7f328c441640 1 Processor -- start 2024-04-25T08:57:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.645+0000 7f328c441640 1 -- start start 2024-04-25T08:57:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328c441640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32840b3b90 0x7f3284149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328c441640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32840cf790 0x7f3284154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328c441640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f32840cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328c441640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328406c940 con 0x7f328415bce0 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328c441640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840b4140 con 0x7f32840cf790 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328c441640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328406cac0 con 0x7f32840b3b90 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f32840cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f32840cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42074/0 (socket says 172.21.15.5:42074) 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 -- 172.21.15.5:0/4272667740 learned_addr learned my addr 172.21.15.5:0/4272667740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a1dd640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32840b3b90 0x7f3284149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f32899dc640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32840cf790 0x7f3284154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 -- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32840b3b90 msgr2=0x7f3284149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32840b3b90 0x7f3284149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 -- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32840cf790 msgr2=0x7f3284154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32840cf790 0x7f3284154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 -- 172.21.15.5:0/4272667740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32841f6fa0 con 0x7f328415bce0 2024-04-25T08:57:23.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f328a9de640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f32840cda60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f327c00cbf0 tx=0x7f327c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:23.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.646+0000 7f327affd640 1 -- 172.21.15.5:0/4272667740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c017070 con 0x7f328415bce0 2024-04-25T08:57:23.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.647+0000 7f327affd640 1 -- 172.21.15.5:0/4272667740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c00ad40 con 0x7f328415bce0 2024-04-25T08:57:23.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.647+0000 7f327affd640 1 -- 172.21.15.5:0/4272667740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c012600 con 0x7f328415bce0 2024-04-25T08:57:23.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.647+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32841f3f20 con 0x7f328415bce0 2024-04-25T08:57:23.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.647+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32841f44e0 con 0x7f328415bce0 2024-04-25T08:57:23.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.648+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328404ef20 con 0x7f328415bce0 2024-04-25T08:57:23.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.648+0000 7f327affd640 1 -- 172.21.15.5:0/4272667740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f327c01a070 con 0x7f328415bce0 2024-04-25T08:57:23.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.648+0000 7f327affd640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f326806b4d0 0x7f326806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:23.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.649+0000 7f327affd640 1 -- 172.21.15.5:0/4272667740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f327c089eb0 con 0x7f328415bce0 2024-04-25T08:57:23.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.649+0000 7f328a1dd640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f326806b4d0 0x7f326806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:23.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.649+0000 7f328a1dd640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f326806b4d0 0x7f326806d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3280034000 tx=0x7f328002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:23.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.653+0000 7f327affd640 1 -- 172.21.15.5:0/4272667740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f327c058680 con 0x7f328415bce0 2024-04-25T08:57:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:23.877+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f32841f4880 con 0x7f328415bce0 2024-04-25T08:57:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.526+0000 7f327affd640 1 -- 172.21.15.5:0/4272667740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f327c05c720 con 0x7f328415bce0 2024-04-25T08:57:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f326806b4d0 msgr2=0x7f326806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f326806b4d0 0x7f326806d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3280034000 tx=0x7f328002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 msgr2=0x7f32840cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f32840cda60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f327c00cbf0 tx=0x7f327c00a430 comp rx=0 tx=0).stop 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 shutdown_connections 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f326806b4d0 0x7f326806d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f328415bce0 0x7f32840cda60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32840cf790 0x7f3284154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 --2- 172.21.15.5:0/4272667740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32840b3b90 0x7f3284149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 >> 172.21.15.5:0/4272667740 conn(0x7f32840b1550 msgr2=0x7f32840b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 shutdown_connections 2024-04-25T08:57:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.529+0000 7f328c441640 1 -- 172.21.15.5:0/4272667740 wait complete. 2024-04-25T08:57:24.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:57:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.653+0000 7f75f861f640 1 Processor -- start 2024-04-25T08:57:24.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.653+0000 7f75f861f640 1 -- start start 2024-04-25T08:57:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f861f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f75f00ceec0 0x7f75f0168b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f861f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f0162070 con 0x7f75f00b9470 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f861f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f0162350 con 0x7f75f015dbd0 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f861f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00d1c50 con 0x7f75f00ceec0 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f5bba640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75f00b9470 0x7f75f00ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51938/0 (socket says 172.21.15.5:51938) 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f5bba640 1 -- 172.21.15.5:0/2994639345 learned_addr learned my addr 172.21.15.5:0/2994639345 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f6bbc640 1 --2- 172.21.15.5:0/2994639345 >> v2:172.21.15.80:3300/0 conn(0x7f75f00ceec0 0x7f75f0168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778325748 0 0) 0x7f75f0162070 con 0x7f75f00b9470 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75dc003520 con 0x7f75f00b9470 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3722171385 0 0) 0x7f75dc003520 con 0x7f75f00b9470 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 >> v2:172.21.15.80:3300/0 conn(0x7f75f00ceec0 msgr2=0x7f75f0168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.654+0000 7f75f53b9640 1 --2- 172.21.15.5:0/2994639345 >> v2:172.21.15.80:3300/0 conn(0x7f75f00ceec0 0x7f75f0168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 >> v1:172.21.15.80:6789/0 conn(0x7f75f015dbd0 legacy=0x7f75f01617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00d1f30 con 0x7f75f00b9470 2024-04-25T08:57:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f75e0001670 con 0x7f75f00b9470 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 >> v1:172.21.15.5:6789/0 conn(0x7f75f00b9470 legacy=0x7f75f00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75dc004800 0x7f75dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75dc0051c0 0x7f75dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00d1c50 con 0x7f75dc0039b0 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc00c060 con 0x7f75dc004800 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc00c260 con 0x7f75dc0051c0 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f63bb640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f5bba640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75dc004800 0x7f75dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f6bbc640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75dc0051c0 0x7f75dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f63bb640 1 -- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75dc0051c0 msgr2=0x7f75dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f63bb640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75dc0051c0 0x7f75dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f63bb640 1 -- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75dc004800 msgr2=0x7f75dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f63bb640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75dc004800 0x7f75dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f63bb640 1 -- 172.21.15.5:0/2994639345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc003520 con 0x7f75dc0039b0 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f6bbc640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75dc0051c0 0x7f75dc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f5bba640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75dc004800 0x7f75dc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.655+0000 7f75f6bbc640 1 -- 172.21.15.5:0/2994639345 reap_dead start 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f63bb640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75dc003dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75ec001750 tx=0x7f75dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a46779447ad376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec001370 con 0x7f75dc0039b0 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec0052d0 con 0x7f75dc0039b0 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f53b9640 1 -- 172.21.15.5:0/2994639345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec02abc0 con 0x7f75dc0039b0 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f861f640 1 -- 172.21.15.5:0/2994639345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 msgr2=0x7f75dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f861f640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75dc003dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75ec001750 tx=0x7f75dc005830 comp rx=0 tx=0).stop 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f861f640 1 -- 172.21.15.5:0/2994639345 shutdown_connections 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f861f640 1 --2- 172.21.15.5:0/2994639345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75dc003dd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f861f640 1 -- 172.21.15.5:0/2994639345 >> 172.21.15.5:0/2994639345 conn(0x7f75f0066ad0 msgr2=0x7f75f0066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.656+0000 7f75f861f640 1 -- 172.21.15.5:0/2994639345 shutdown_connections 2024-04-25T08:57:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.657+0000 7f75f861f640 1 -- 172.21.15.5:0/2994639345 wait complete. 2024-04-25T08:57:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 Processor -- start 2024-04-25T08:57:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 -- start start 2024-04-25T08:57:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75f015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75f00c7e50 0x7f75f015f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f015ac40 0x7f75f0158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015e130 con 0x7f75dc0039b0 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015dfb0 con 0x7f75f015ac40 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.658+0000 7f75f861f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00ce7b0 con 0x7f75f00c7e50 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75f015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75f015e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42100/0 (socket says 172.21.15.5:42100) 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 -- 172.21.15.5:0/3346152665 learned_addr learned my addr 172.21.15.5:0/3346152665 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f5bba640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75f00c7e50 0x7f75f015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f6bbc640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f015ac40 0x7f75f0158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 -- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75f00c7e50 msgr2=0x7f75f015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75f00c7e50 0x7f75f015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 -- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f015ac40 msgr2=0x7f75f0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f015ac40 0x7f75f0158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 -- 172.21.15.5:0/3346152665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00c82d0 con 0x7f75dc0039b0 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f63bb640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75f015e2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75e6ffd640 1 -- 172.21.15.5:0/3346152665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec03f030 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75e6ffd640 1 -- 172.21.15.5:0/3346152665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec005480 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75e6ffd640 1 -- 172.21.15.5:0/3346152665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec037040 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f015e890 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.659+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f015ee50 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.660+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f015f570 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.661+0000 7f75e6ffd640 1 -- 172.21.15.5:0/3346152665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f75ec042070 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.661+0000 7f75e6ffd640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75d406b4d0 0x7f75d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.661+0000 7f75e6ffd640 1 -- 172.21.15.5:0/3346152665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f75ec0a9a40 con 0x7f75dc0039b0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.662+0000 7f75f5bba640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75d406b4d0 0x7f75d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.662+0000 7f75f5bba640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75d406b4d0 0x7f75d406d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f75f015bd30 tx=0x7f75e0007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.666+0000 7f75e6ffd640 1 -- 172.21.15.5:0/3346152665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75ec0782a0 con 0x7f75dc0039b0 2024-04-25T08:57:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:24.844+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75f004ef20 con 0x7f75dc0039b0 2024-04-25T08:57:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.356+0000 7f75e6ffd640 1 -- 172.21.15.5:0/3346152665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f75ec07c340 con 0x7f75dc0039b0 2024-04-25T08:57:25.346 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:57:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75d406b4d0 msgr2=0x7f75d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75d406b4d0 0x7f75d406d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f75f015bd30 tx=0x7f75e0007040 comp rx=0 tx=0).stop 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 msgr2=0x7f75f015e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75f015e2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec001120 comp rx=0 tx=0).stop 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 shutdown_connections 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75d406b4d0 0x7f75d406d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f015ac40 0x7f75f0158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75f00c7e50 0x7f75f015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 --2- 172.21.15.5:0/3346152665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75dc0039b0 0x7f75f015e2b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.359+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 >> 172.21.15.5:0/3346152665 conn(0x7f75f0066ad0 msgr2=0x7f75f00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.360+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 shutdown_connections 2024-04-25T08:57:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.360+0000 7f75f861f640 1 -- 172.21.15.5:0/3346152665 wait complete. 2024-04-25T08:57:25.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:57:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.488+0000 7f83a10e1640 1 Processor -- start 2024-04-25T08:57:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.488+0000 7f83a10e1640 1 -- start start 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f83a10e1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f839c15dbd0 0x7f839c1617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f83a10e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f83a10e1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839c162070 con 0x7f839c0cecf0 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f83a10e1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c0cf160 con 0x7f839c15dbd0 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f83a10e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c162350 con 0x7f839c0b9470 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839a59c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839ad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f839c15dbd0 0x7f839c1617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839b59e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f839c0cecf0 0x7f839c0b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:40654/0 (socket says 172.21.15.5:40654) 2024-04-25T08:57:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839b59e640 1 -- 172.21.15.5:0/4280636223 learned_addr learned my addr 172.21.15.5:0/4280636223 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839a59c640 1 -- 172.21.15.5:0/4280636223 >> v2:172.21.15.80:3300/0 conn(0x7f839c15dbd0 msgr2=0x7f839c1617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839a59c640 1 --2- 172.21.15.5:0/4280636223 >> v2:172.21.15.80:3300/0 conn(0x7f839c15dbd0 0x7f839c1617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839a59c640 1 -- 172.21.15.5:0/4280636223 >> v1:172.21.15.80:6789/0 conn(0x7f839c0cecf0 legacy=0x7f839c0b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.489+0000 7f839a59c640 1 -- 172.21.15.5:0/4280636223 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c0d1c50 con 0x7f839c0b9470 2024-04-25T08:57:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.490+0000 7f839a59c640 1 --2- 172.21.15.5:0/4280636223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c0ce7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83900097a0 tx=0x7f839002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9954fdfd508c8c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.490+0000 7f8399d9b640 1 -- 172.21.15.5:0/4280636223 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390037070 con 0x7f839c0b9470 2024-04-25T08:57:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.490+0000 7f8399d9b640 1 -- 172.21.15.5:0/4280636223 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8390032440 con 0x7f839c0b9470 2024-04-25T08:57:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.490+0000 7f8399d9b640 1 -- 172.21.15.5:0/4280636223 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390032810 con 0x7f839c0b9470 2024-04-25T08:57:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 -- 172.21.15.5:0/4280636223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 msgr2=0x7f839c0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 --2- 172.21.15.5:0/4280636223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c0ce7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83900097a0 tx=0x7f839002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 -- 172.21.15.5:0/4280636223 shutdown_connections 2024-04-25T08:57:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 --2- 172.21.15.5:0/4280636223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c0ce7b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 --2- 172.21.15.5:0/4280636223 >> v2:172.21.15.80:3300/0 conn(0x7f839c15dbd0 0x7f839c1617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 -- 172.21.15.5:0/4280636223 >> 172.21.15.5:0/4280636223 conn(0x7f839c066ad0 msgr2=0x7f839c066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 -- 172.21.15.5:0/4280636223 shutdown_connections 2024-04-25T08:57:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.491+0000 7f83a10e1640 1 -- 172.21.15.5:0/4280636223 wait complete. 2024-04-25T08:57:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.492+0000 7f83a10e1640 1 Processor -- start 2024-04-25T08:57:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.492+0000 7f83a10e1640 1 -- start start 2024-04-25T08:57:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f83a10e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f83a10e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f839c0cecf0 0x7f839c0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f83a10e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f839c15dbd0 0x7f839c0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f83a10e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c161cf0 con 0x7f839c0cecf0 2024-04-25T08:57:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f83a10e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c162630 con 0x7f839c15dbd0 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f83a10e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c15dfb0 con 0x7f839c0b9470 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f839c0cecf0 0x7f839c0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f839c0cecf0 0x7f839c0cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42104/0 (socket says 172.21.15.5:42104) 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 -- 172.21.15.5:0/408897749 learned_addr learned my addr 172.21.15.5:0/408897749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839ad9d640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839b59e640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f839c15dbd0 0x7f839c0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 -- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 msgr2=0x7f839c154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 -- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f839c15dbd0 msgr2=0x7f839c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f839c15dbd0 0x7f839c0cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839a59c640 1 -- 172.21.15.5:0/408897749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c0b4140 con 0x7f839c0cecf0 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.493+0000 7f839b59e640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f839c15dbd0 0x7f839c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.494+0000 7f839a59c640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f839c0cecf0 0x7f839c0cbc00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8390035040 tx=0x7f83900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.494+0000 7f83837fe640 1 -- 172.21.15.5:0/408897749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390037040 con 0x7f839c0cecf0 2024-04-25T08:57:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.494+0000 7f83837fe640 1 -- 172.21.15.5:0/408897749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8390030500 con 0x7f839c0cecf0 2024-04-25T08:57:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.494+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c0b4420 con 0x7f839c0cecf0 2024-04-25T08:57:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.494+0000 7f83837fe640 1 -- 172.21.15.5:0/408897749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900308d0 con 0x7f839c0cecf0 2024-04-25T08:57:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.494+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c0b49e0 con 0x7f839c0cecf0 2024-04-25T08:57:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.495+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c04ef20 con 0x7f839c0cecf0 2024-04-25T08:57:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.495+0000 7f83837fe640 1 -- 172.21.15.5:0/408897749 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8390044020 con 0x7f839c0cecf0 2024-04-25T08:57:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.496+0000 7f83837fe640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f838806b4d0 0x7f838806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.496+0000 7f83837fe640 1 -- 172.21.15.5:0/408897749 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f83900aa3e0 con 0x7f839c0cecf0 2024-04-25T08:57:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.496+0000 7f839ad9d640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f838806b4d0 0x7f838806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.496+0000 7f839ad9d640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f838806b4d0 0x7f838806d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f838c009aa0 tx=0x7f838c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.500+0000 7f83837fe640 1 -- 172.21.15.5:0/408897749 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83900792b0 con 0x7f839c0cecf0 2024-04-25T08:57:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:25.682+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f839c0d1760 con 0x7f839c0cecf0 2024-04-25T08:57:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.364+0000 7f83837fe640 1 -- 172.21.15.5:0/408897749 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8390078bb0 con 0x7f839c0cecf0 2024-04-25T08:57:26.354 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f838806b4d0 msgr2=0x7f838806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f838806b4d0 0x7f838806d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f838c009aa0 tx=0x7f838c009190 comp rx=0 tx=0).stop 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f839c0cecf0 msgr2=0x7f839c0cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f839c0cecf0 0x7f839c0cbc00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8390035040 tx=0x7f83900046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 shutdown_connections 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f838806b4d0 0x7f838806d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f839c15dbd0 0x7f839c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f839c0cecf0 0x7f839c0cbc00 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8390035040 tx=0x7f83900046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 --2- 172.21.15.5:0/408897749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f839c0b9470 0x7f839c154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.367+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 >> 172.21.15.5:0/408897749 conn(0x7f839c066ad0 msgr2=0x7f839c0d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.368+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 shutdown_connections 2024-04-25T08:57:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.370+0000 7f83a10e1640 1 -- 172.21.15.5:0/408897749 wait complete. 2024-04-25T08:57:26.379 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:57:26.379 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:57:26.380 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:57:26.380 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:26.380 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:57:26.380 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:57:26.380 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:57:26.380 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:26.380 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:57:26.380 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:57:26.381 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:57:26.381 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:26.381 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:57:26.381 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:57:26.381 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:57:26.381 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:26.392 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:57:26.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:57:26.393 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:57:26.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:57:26.394 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:57:26.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:57:26.395 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:57:26.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:57:26.435 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:57:26.435 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:26.436 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:57:26.437 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:26.438 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:57:26.438 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:26.438 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:57:26.439 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:26.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:57:26.514 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T08:57:26.515 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T08:57:26.519 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T08:57:26.519 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T08:57:26.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.563+0000 7f6a12038640 1 Processor -- start 2024-04-25T08:57:26.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.563+0000 7f6a12038640 1 -- start start 2024-04-25T08:57:26.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a12038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a0c0b0e30 0x7f6a0c0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:26.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a12038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0ce910 0x7f6a0c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a12038640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0c06ba50 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a12038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c06b800 con 0x7f6a0c0b0e30 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a12038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c06bd30 con 0x7f6a0c0ce910 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a0affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a0c0b0e30 0x7f6a0c0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a0affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a0c0b0e30 0x7f6a0c0b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42134/0 (socket says 172.21.15.5:42134) 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a0affd640 1 -- 172.21.15.5:0/3685853830 learned_addr learned my addr 172.21.15.5:0/3685853830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.564+0000 7f6a0bfff640 1 --2- 172.21.15.5:0/3685853830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0ce910 0x7f6a0c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.565+0000 7f6a0affd640 1 -- 172.21.15.5:0/3685853830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0ce910 msgr2=0x7f6a0c0b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.565+0000 7f6a0affd640 1 --2- 172.21.15.5:0/3685853830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0ce910 0x7f6a0c0b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.565+0000 7f6a0affd640 1 -- 172.21.15.5:0/3685853830 >> v1:172.21.15.80:6789/0 conn(0x7f6a0c0b0a50 legacy=0x7f6a0c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.565+0000 7f6a0affd640 1 -- 172.21.15.5:0/3685853830 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c06c010 con 0x7f6a0c0b0e30 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.565+0000 7f6a0affd640 1 --2- 172.21.15.5:0/3685853830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0e30 0x7f6a0c0b1230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01cecad557c468e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a0a7fc640 1 -- 172.21.15.5:0/3685853830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00037070 con 0x7f6a0c0b0e30 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a0a7fc640 1 -- 172.21.15.5:0/3685853830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00032440 con 0x7f6a0c0b0e30 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a0a7fc640 1 -- 172.21.15.5:0/3685853830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00032810 con 0x7f6a0c0b0e30 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 -- 172.21.15.5:0/3685853830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0e30 msgr2=0x7f6a0c0b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 --2- 172.21.15.5:0/3685853830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0e30 0x7f6a0c0b1230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 -- 172.21.15.5:0/3685853830 shutdown_connections 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 --2- 172.21.15.5:0/3685853830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0ce910 0x7f6a0c0b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 --2- 172.21.15.5:0/3685853830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0e30 0x7f6a0c0b1230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 -- 172.21.15.5:0/3685853830 >> 172.21.15.5:0/3685853830 conn(0x7f6a0c0d18f0 msgr2=0x7f6a0c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 -- 172.21.15.5:0/3685853830 shutdown_connections 2024-04-25T08:57:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.566+0000 7f6a12038640 1 -- 172.21.15.5:0/3685853830 wait complete. 2024-04-25T08:57:26.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.568+0000 7f6a12038640 1 Processor -- start 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.568+0000 7f6a12038640 1 -- start start 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a12038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0a50 0x7f6a0c1e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a12038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0b0e30 0x7f6a0c0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a12038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a0c0ce910 0x7f6a0c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a12038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b2bf0 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0a50 0x7f6a0c1e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a12038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0cfd60 con 0x7f6a0c0ce910 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a12038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b6100 con 0x7f6a0c0b0e30 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0a50 0x7f6a0c1e0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42138/0 (socket says 172.21.15.5:42138) 2024-04-25T08:57:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/3203422786 learned_addr learned my addr 172.21.15.5:0/3203422786 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0affd640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0b0e30 0x7f6a0c0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0bfff640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a0c0ce910 0x7f6a0c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0b0e30 msgr2=0x7f6a0c0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0b0e30 0x7f6a0c0b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a0c0ce910 msgr2=0x7f6a0c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a0c0ce910 0x7f6a0c0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/3203422786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0b63e0 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a0b7fe640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0a50 0x7f6a0c1e0e60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00c430 tx=0x7f69fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f69f3fff640 1 -- 172.21.15.5:0/3203422786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0052d0 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f69f3fff640 1 -- 172.21.15.5:0/3203422786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc005490 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f69f3fff640 1 -- 172.21.15.5:0/3203422786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc007260 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.569+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c0b66c0 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.570+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c0b6c80 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.571+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c06cd70 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.571+0000 7f69f3fff640 1 -- 172.21.15.5:0/3203422786 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f69fc007400 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.571+0000 7f69f3fff640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69f806b4d0 0x7f69f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.571+0000 7f69f3fff640 1 -- 172.21.15.5:0/3203422786 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f69fc0893e0 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.572+0000 7f6a0affd640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69f806b4d0 0x7f69f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.572+0000 7f6a0affd640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69f806b4d0 0x7f69f806d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a00034000 tx=0x7f6a0002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:26.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.576+0000 7f69f3fff640 1 -- 172.21.15.5:0/3203422786 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69fc057e70 con 0x7f6a0c0b0a50 2024-04-25T08:57:26.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:26.768+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6a0c0cc030 con 0x7f6a0c0b0a50 2024-04-25T08:57:27.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.372+0000 7f69f3fff640 1 -- 172.21.15.5:0/3203422786 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f69fc05bf10 con 0x7f6a0c0b0a50 2024-04-25T08:57:27.362 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69f806b4d0 msgr2=0x7f69f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69f806b4d0 0x7f69f806d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a00034000 tx=0x7f6a0002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0a50 msgr2=0x7f6a0c1e0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0a50 0x7f6a0c1e0e60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00c430 tx=0x7f69fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 shutdown_connections 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f69f806b4d0 0x7f69f806d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a0c0ce910 0x7f6a0c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a0c0b0e30 0x7f6a0c0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 --2- 172.21.15.5:0/3203422786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a0c0b0a50 0x7f6a0c1e0e60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 >> 172.21.15.5:0/3203422786 conn(0x7f6a0c0d18f0 msgr2=0x7f6a0c1e5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:27.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 shutdown_connections 2024-04-25T08:57:27.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.375+0000 7f6a12038640 1 -- 172.21.15.5:0/3203422786 wait complete. 2024-04-25T08:57:27.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:57:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.496+0000 7ff49c238640 1 Processor -- start 2024-04-25T08:57:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.496+0000 7ff49c238640 1 -- start start 2024-04-25T08:57:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.497+0000 7ff49c238640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff4940ce290 0x7ff4940ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.497+0000 7ff49c238640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940b52c0 0x7ff4940b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.497+0000 7ff49c238640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940cdcb0 con 0x7ff49415bdc0 2024-04-25T08:57:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.497+0000 7ff49c238640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940cdf90 con 0x7ff4940ce290 2024-04-25T08:57:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.497+0000 7ff49c238640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b47e0 con 0x7ff4940b52c0 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff49a7d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940b52c0 0x7ff4940b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff4997d3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff4940ce290 0x7ff4940ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff49a7d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940b52c0 0x7ff4940b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:59950/0 (socket says 172.21.15.5:59950) 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff49a7d5640 1 -- 172.21.15.5:0/3924868982 learned_addr learned my addr 172.21.15.5:0/3924868982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff499fd4640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff49415bdc0 0x7ff4940cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:40702/0 (socket says 172.21.15.5:40702) 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff498fd2640 1 -- 172.21.15.5:0/3924868982 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491121868 0 0) 0x7ff4940cdcb0 con 0x7ff49415bdc0 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff498fd2640 1 -- 172.21.15.5:0/3924868982 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff47c003520 con 0x7ff49415bdc0 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff49a7d5640 1 -- 172.21.15.5:0/3924868982 >> v2:172.21.15.80:3300/0 conn(0x7ff4940ce290 msgr2=0x7ff4940ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff49a7d5640 1 --2- 172.21.15.5:0/3924868982 >> v2:172.21.15.80:3300/0 conn(0x7ff4940ce290 0x7ff4940ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff49a7d5640 1 -- 172.21.15.5:0/3924868982 >> v1:172.21.15.80:6789/0 conn(0x7ff49415bdc0 legacy=0x7ff4940cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff49a7d5640 1 -- 172.21.15.5:0/3924868982 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940b4ac0 con 0x7ff4940b52c0 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.498+0000 7ff4997d3640 1 --2- 172.21.15.5:0/3924868982 >> v2:172.21.15.80:3300/0 conn(0x7ff4940ce290 0x7ff4940ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.499+0000 7ff49a7d5640 1 --2- 172.21.15.5:0/3924868982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940b52c0 0x7ff4940b5730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff484009e50 tx=0x7ff48402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f4bdf113f4fbc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.499+0000 7ff498fd2640 1 -- 172.21.15.5:0/3924868982 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484036070 con 0x7ff4940b52c0 2024-04-25T08:57:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.499+0000 7ff498fd2640 1 -- 172.21.15.5:0/3924868982 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff484031600 con 0x7ff4940b52c0 2024-04-25T08:57:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.499+0000 7ff498fd2640 1 -- 172.21.15.5:0/3924868982 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840319d0 con 0x7ff4940b52c0 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 -- 172.21.15.5:0/3924868982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940b52c0 msgr2=0x7ff4940b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 --2- 172.21.15.5:0/3924868982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940b52c0 0x7ff4940b5730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff484009e50 tx=0x7ff48402a710 comp rx=0 tx=0).stop 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 -- 172.21.15.5:0/3924868982 shutdown_connections 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 --2- 172.21.15.5:0/3924868982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940b52c0 0x7ff4940b5730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 --2- 172.21.15.5:0/3924868982 >> v2:172.21.15.80:3300/0 conn(0x7ff4940ce290 0x7ff4940ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 -- 172.21.15.5:0/3924868982 >> 172.21.15.5:0/3924868982 conn(0x7ff4940d18f0 msgr2=0x7ff4940d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 -- 172.21.15.5:0/3924868982 shutdown_connections 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.500+0000 7ff49c238640 1 -- 172.21.15.5:0/3924868982 wait complete. 2024-04-25T08:57:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.501+0000 7ff49c238640 1 Processor -- start 2024-04-25T08:57:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.501+0000 7ff49c238640 1 -- start start 2024-04-25T08:57:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff49c238640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4940b52c0 0x7ff494156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff49c238640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940ce290 0x7ff4940c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff49c238640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff49415bdc0 0x7ff4940c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff49c238640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940cd8b0 con 0x7ff4940b52c0 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff49c238640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940d09a0 con 0x7ff49415bdc0 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff49c238640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940cda30 con 0x7ff4940ce290 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4940b52c0 0x7ff494156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4940b52c0 0x7ff494156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42144/0 (socket says 172.21.15.5:42144) 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 -- 172.21.15.5:0/1318091061 learned_addr learned my addr 172.21.15.5:0/1318091061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff4997d3640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940ce290 0x7ff4940c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff49a7d5640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff49415bdc0 0x7ff4940c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 -- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940ce290 msgr2=0x7ff4940c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940ce290 0x7ff4940c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 -- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff49415bdc0 msgr2=0x7ff4940c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff49415bdc0 0x7ff4940c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.502+0000 7ff499fd4640 1 -- 172.21.15.5:0/1318091061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4941557a0 con 0x7ff4940b52c0 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.503+0000 7ff499fd4640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4940b52c0 0x7ff494156c70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c390 tx=0x7ff48c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.503+0000 7ff4927fc640 1 -- 172.21.15.5:0/1318091061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0074e0 con 0x7ff4940b52c0 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.503+0000 7ff4927fc640 1 -- 172.21.15.5:0/1318091061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c0047e0 con 0x7ff4940b52c0 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.503+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff494155a40 con 0x7ff4940b52c0 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.503+0000 7ff4927fc640 1 -- 172.21.15.5:0/1318091061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c004bd0 con 0x7ff4940b52c0 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.503+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4940c57a0 con 0x7ff4940b52c0 2024-04-25T08:57:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.504+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49404ef20 con 0x7ff4940b52c0 2024-04-25T08:57:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.504+0000 7ff4927fc640 1 -- 172.21.15.5:0/1318091061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff48c01a020 con 0x7ff4940b52c0 2024-04-25T08:57:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.505+0000 7ff4927fc640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff48006b4d0 0x7ff48006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.505+0000 7ff4927fc640 1 -- 172.21.15.5:0/1318091061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff48c089540 con 0x7ff4940b52c0 2024-04-25T08:57:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.505+0000 7ff4997d3640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff48006b4d0 0x7ff48006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.506+0000 7ff4997d3640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff48006b4d0 0x7ff48006d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff488009560 tx=0x7ff488009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:27.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.509+0000 7ff4927fc640 1 -- 172.21.15.5:0/1318091061 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff48c058180 con 0x7ff4940b52c0 2024-04-25T08:57:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.756+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff494073fc0 con 0x7ff4940b52c0 2024-04-25T08:57:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.756+0000 7ff4927fc640 1 -- 172.21.15.5:0/1318091061 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ff48c05c220 con 0x7ff4940b52c0 2024-04-25T08:57:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:27.746 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:57:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T08:57:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T08:57:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T08:57:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T08:57:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC0GipmAuPJEBAASLhgl7caHWeQtapFHQ97Cg==", 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC0Gipm4uvJEBAAjGUvR5rhFIE37babiY6IZg==", 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC0GipmwvPJEBAALeqKVmnAYCeBVYWumKNjXw==", 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC0GipmKPvJEBAADzKT9rBqFTWJeX4XOltR8g==", 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T08:57:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC0GipmwAPKEBAA0c9W6ARe3YVqUA6CEtxuaA==", 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQC0GipmlwvKEBAAePOIwmFmx135gsBpszFZtQ==", 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T08:57:27.761 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff48006b4d0 msgr2=0x7ff48006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff48006b4d0 0x7ff48006d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff488009560 tx=0x7ff488009190 comp rx=0 tx=0).stop 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4940b52c0 msgr2=0x7ff494156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4940b52c0 0x7ff494156c70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c390 tx=0x7ff48c00c850 comp rx=0 tx=0).stop 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 shutdown_connections 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff48006b4d0 0x7ff48006d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff49415bdc0 0x7ff4940c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4940ce290 0x7ff4940c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 --2- 172.21.15.5:0/1318091061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4940b52c0 0x7ff494156c70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 >> 172.21.15.5:0/1318091061 conn(0x7ff4940d18f0 msgr2=0x7ff4940cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 shutdown_connections 2024-04-25T08:57:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.758+0000 7ff49c238640 1 -- 172.21.15.5:0/1318091061 wait complete. 2024-04-25T08:57:27.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T08:57:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.875+0000 7f80ecb42640 1 Processor -- start 2024-04-25T08:57:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.875+0000 7f80ecb42640 1 -- start start 2024-04-25T08:57:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.876+0000 7f80ecb42640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80e80ce7f0 0x7f80e80cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.876+0000 7f80ecb42640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80cf1c0 con 0x7f80e815de70 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.876+0000 7f80ecb42640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80d20e0 con 0x7f80e80b2cc0 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.876+0000 7f80ecb42640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80d2a10 con 0x7f80e80ce7f0 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.876+0000 7f80e6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80e80ce7f0 0x7f80e80cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.876+0000 7f80e659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80e815de70 0x7f80e80b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51966/0 (socket says 172.21.15.5:51966) 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.876+0000 7f80e659c640 1 -- 172.21.15.5:0/1300696016 learned_addr learned my addr 172.21.15.5:0/1300696016 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.877+0000 7f80e6d9d640 1 -- 172.21.15.5:0/1300696016 >> v1:172.21.15.80:6789/0 conn(0x7f80e80b2cc0 legacy=0x7f80e80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.877+0000 7f80e6d9d640 1 -- 172.21.15.5:0/1300696016 >> v1:172.21.15.5:6789/0 conn(0x7f80e815de70 legacy=0x7f80e80b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.877+0000 7f80e559a640 1 -- 172.21.15.5:0/1300696016 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493172153 0 0) 0x7f80e80cf1c0 con 0x7f80e815de70 2024-04-25T08:57:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.877+0000 7f80e6d9d640 1 -- 172.21.15.5:0/1300696016 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80d23c0 con 0x7f80e80ce7f0 2024-04-25T08:57:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.877+0000 7f80e6d9d640 1 --2- 172.21.15.5:0/1300696016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e80ce7f0 0x7f80e80cec80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009d90 tx=0x7f80d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893eeed2606918ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80e559a640 1 -- 172.21.15.5:0/1300696016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8007740 con 0x7f80e80ce7f0 2024-04-25T08:57:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80e559a640 1 -- 172.21.15.5:0/1300696016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80078e0 con 0x7f80e80ce7f0 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80e559a640 1 -- 172.21.15.5:0/1300696016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8007cb0 con 0x7f80e80ce7f0 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80ecb42640 1 -- 172.21.15.5:0/1300696016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e80ce7f0 msgr2=0x7f80e80cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1300696016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e80ce7f0 0x7f80e80cec80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009d90 tx=0x7f80d802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80ecb42640 1 -- 172.21.15.5:0/1300696016 shutdown_connections 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1300696016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e80ce7f0 0x7f80e80cec80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80ecb42640 1 -- 172.21.15.5:0/1300696016 >> 172.21.15.5:0/1300696016 conn(0x7f80e806b000 msgr2=0x7f80e806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80ecb42640 1 -- 172.21.15.5:0/1300696016 shutdown_connections 2024-04-25T08:57:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.878+0000 7f80ecb42640 1 -- 172.21.15.5:0/1300696016 wait complete. 2024-04-25T08:57:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.879+0000 7f80ecb42640 1 Processor -- start 2024-04-25T08:57:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80ecb42640 1 -- start start 2024-04-25T08:57:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80ecb42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e80b2cc0 0x7f80e80cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80ecb42640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80e80ce7f0 0x7f80e81608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80ecb42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e815de70 0x7f80e814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80ecb42640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80d2ea0 con 0x7f80e815de70 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80ecb42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b7300 con 0x7f80e80b2cc0 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80ecb42640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80d3020 con 0x7f80e80ce7f0 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80e6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e815de70 0x7f80e814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80e6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e815de70 0x7f80e814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42170/0 (socket says 172.21.15.5:42170) 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80e6d9d640 1 -- 172.21.15.5:0/1961503548 learned_addr learned my addr 172.21.15.5:0/1961503548 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80e659c640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e80b2cc0 0x7f80e80cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.880+0000 7f80e5d9b640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80e80ce7f0 0x7f80e81608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80e6d9d640 1 -- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80e80ce7f0 msgr2=0x7f80e81608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80e6d9d640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80e80ce7f0 0x7f80e81608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80e6d9d640 1 -- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e80b2cc0 msgr2=0x7f80e80cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80e6d9d640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e80b2cc0 0x7f80e80cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80e6d9d640 1 -- 172.21.15.5:0/1961503548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80cbe70 con 0x7f80e815de70 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80e659c640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e80b2cc0 0x7f80e80cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80e6d9d640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e815de70 0x7f80e814db50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009eb0 tx=0x7f80d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80deffd640 1 -- 172.21.15.5:0/1961503548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8040070 con 0x7f80e815de70 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80deffd640 1 -- 172.21.15.5:0/1961503548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8031c90 con 0x7f80e815de70 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80cc110 con 0x7f80e815de70 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80deffd640 1 -- 172.21.15.5:0/1961503548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8045680 con 0x7f80e815de70 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.881+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80cc9b0 con 0x7f80e815de70 2024-04-25T08:57:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.882+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e804ef20 con 0x7f80e815de70 2024-04-25T08:57:27.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.882+0000 7f80deffd640 1 -- 172.21.15.5:0/1961503548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80d8039040 con 0x7f80e815de70 2024-04-25T08:57:27.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.883+0000 7f80deffd640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f80c806b4d0 0x7f80c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:27.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.883+0000 7f80deffd640 1 -- 172.21.15.5:0/1961503548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80d80ab840 con 0x7f80e815de70 2024-04-25T08:57:27.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.883+0000 7f80e659c640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f80c806b4d0 0x7f80c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:27.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.883+0000 7f80e659c640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f80c806b4d0 0x7f80c806d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f80e0000f60 tx=0x7f80e0007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:27.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:27.887+0000 7f80deffd640 1 -- 172.21.15.5:0/1961503548 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80d807ab60 con 0x7f80e815de70 2024-04-25T08:57:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.140+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f80e80cc2e0 con 0x7f80e815de70 2024-04-25T08:57:28.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.142+0000 7f80deffd640 1 -- 172.21.15.5:0/1961503548 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f80d807a460 con 0x7f80e815de70 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f80c806b4d0 msgr2=0x7f80c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f80c806b4d0 0x7f80c806d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f80e0000f60 tx=0x7f80e0007ca0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e815de70 msgr2=0x7f80e814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e815de70 0x7f80e814db50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009eb0 tx=0x7f80d8004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 shutdown_connections 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f80c806b4d0 0x7f80c806d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e815de70 0x7f80e814db50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80e80ce7f0 0x7f80e81608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 --2- 172.21.15.5:0/1961503548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e80b2cc0 0x7f80e80cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 >> 172.21.15.5:0/1961503548 conn(0x7f80e806b000 msgr2=0x7f80e815b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 shutdown_connections 2024-04-25T08:57:28.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.145+0000 7f80ecb42640 1 -- 172.21.15.5:0/1961503548 wait complete. 2024-04-25T08:57:28.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T08:57:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.257+0000 7f684af5c640 1 Processor -- start 2024-04-25T08:57:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.257+0000 7f684af5c640 1 -- start start 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f684af5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68440cea80 0x7f684415f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f684af5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f684406bd00 0x7f68440d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f684af5c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684415ef10 con 0x7f684415fd80 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f684af5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68440cfd60 con 0x7f68440cea80 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f684af5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684415f480 con 0x7f684406bd00 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f6848cf8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68440cea80 0x7f684415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f6848cf8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68440cea80 0x7f684415f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42172/0 (socket says 172.21.15.5:42172) 2024-04-25T08:57:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f6848cf8640 1 -- 172.21.15.5:0/1047248456 learned_addr learned my addr 172.21.15.5:0/1047248456 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f68494f9640 1 --2- 172.21.15.5:0/1047248456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f684406bd00 0x7f68440d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f6848cf8640 1 -- 172.21.15.5:0/1047248456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f684406bd00 msgr2=0x7f68440d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f6848cf8640 1 --2- 172.21.15.5:0/1047248456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f684406bd00 0x7f68440d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f6848cf8640 1 -- 172.21.15.5:0/1047248456 >> v1:172.21.15.80:6789/0 conn(0x7f684415fd80 legacy=0x7f684406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.258+0000 7f6848cf8640 1 -- 172.21.15.5:0/1047248456 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684415f1a0 con 0x7f68440cea80 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.259+0000 7f6848cf8640 1 --2- 172.21.15.5:0/1047248456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cea80 0x7f684415f840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6838009870 tx=0x7f683802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4c271a26094f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.259+0000 7f68437fe640 1 -- 172.21.15.5:0/1047248456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838037070 con 0x7f68440cea80 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.259+0000 7f68437fe640 1 -- 172.21.15.5:0/1047248456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838032440 con 0x7f68440cea80 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.259+0000 7f68437fe640 1 -- 172.21.15.5:0/1047248456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838032810 con 0x7f68440cea80 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 -- 172.21.15.5:0/1047248456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cea80 msgr2=0x7f684415f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 --2- 172.21.15.5:0/1047248456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cea80 0x7f684415f840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6838009870 tx=0x7f683802a270 comp rx=0 tx=0).stop 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 -- 172.21.15.5:0/1047248456 shutdown_connections 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 --2- 172.21.15.5:0/1047248456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f684406bd00 0x7f68440d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 --2- 172.21.15.5:0/1047248456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cea80 0x7f684415f840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 -- 172.21.15.5:0/1047248456 >> 172.21.15.5:0/1047248456 conn(0x7f68440d19f0 msgr2=0x7f68440d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 -- 172.21.15.5:0/1047248456 shutdown_connections 2024-04-25T08:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.260+0000 7f684af5c640 1 -- 172.21.15.5:0/1047248456 wait complete. 2024-04-25T08:57:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.261+0000 7f684af5c640 1 Processor -- start 2024-04-25T08:57:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.261+0000 7f684af5c640 1 -- start start 2024-04-25T08:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f684af5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684406bd00 0x7f684415dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f684af5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68440cea80 0x7f684409ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f684af5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684409f1d0 0x7f68440b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f684af5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440d1660 con 0x7f684409f1d0 2024-04-25T08:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f684af5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440d0270 con 0x7f684406bd00 2024-04-25T08:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f684af5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68440d17e0 con 0x7f68440cea80 2024-04-25T08:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684409f1d0 0x7f68440b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684409f1d0 0x7f68440b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42180/0 (socket says 172.21.15.5:42180) 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 -- 172.21.15.5:0/1031864057 learned_addr learned my addr 172.21.15.5:0/1031864057 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f6843fff640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68440cea80 0x7f684409ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f6848cf8640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684406bd00 0x7f684415dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 -- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68440cea80 msgr2=0x7f684409ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68440cea80 0x7f684409ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 -- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684406bd00 msgr2=0x7f684415dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684406bd00 0x7f684415dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 -- 172.21.15.5:0/1031864057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684415e500 con 0x7f684409f1d0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68494f9640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684409f1d0 0x7f68440b5250 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f683c007e70 tx=0x7f683c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.262+0000 7f68417fa640 1 -- 172.21.15.5:0/1031864057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c014620 con 0x7f684409f1d0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.263+0000 7f68417fa640 1 -- 172.21.15.5:0/1031864057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c019070 con 0x7f684409f1d0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.263+0000 7f68417fa640 1 -- 172.21.15.5:0/1031864057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c014a20 con 0x7f684409f1d0 2024-04-25T08:57:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.263+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6844160700 con 0x7f684409f1d0 2024-04-25T08:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.263+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6844160cc0 con 0x7f684409f1d0 2024-04-25T08:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.264+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684404ef20 con 0x7f684409f1d0 2024-04-25T08:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.264+0000 7f68417fa640 1 -- 172.21.15.5:0/1031864057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f683c014bc0 con 0x7f684409f1d0 2024-04-25T08:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.264+0000 7f68417fa640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f682806b500 0x7f682806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.264+0000 7f68417fa640 1 -- 172.21.15.5:0/1031864057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f683c08a610 con 0x7f684409f1d0 2024-04-25T08:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.265+0000 7f6848cf8640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f682806b500 0x7f682806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.265+0000 7f6848cf8640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f682806b500 0x7f682806d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.268+0000 7f68417fa640 1 -- 172.21.15.5:0/1031864057 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f684415e500 con 0x7f684409f1d0 2024-04-25T08:57:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.517+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f68440cefa0 con 0x7f684409f1d0 2024-04-25T08:57:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.519+0000 7f68417fa640 1 -- 172.21.15.5:0/1031864057 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f683c0591a0 con 0x7f684409f1d0 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f682806b500 msgr2=0x7f682806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f682806b500 0x7f682806d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684409f1d0 msgr2=0x7f68440b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684409f1d0 0x7f68440b5250 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f683c007e70 tx=0x7f683c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 shutdown_connections 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f682806b500 0x7f682806d9c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684409f1d0 0x7f68440b5250 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68440cea80 0x7f684409ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 --2- 172.21.15.5:0/1031864057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684406bd00 0x7f684415dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 >> 172.21.15.5:0/1031864057 conn(0x7f68440d19f0 msgr2=0x7f68440af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 shutdown_connections 2024-04-25T08:57:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.522+0000 7f684af5c640 1 -- 172.21.15.5:0/1031864057 wait complete. 2024-04-25T08:57:28.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T08:57:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.634+0000 7fcc8cefc640 1 Processor -- start 2024-04-25T08:57:28.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.634+0000 7fcc8cefc640 1 -- start start 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.635+0000 7fcc8cefc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc880cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.635+0000 7fcc8cefc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880c5440 con 0x7fcc880c6930 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.635+0000 7fcc8cefc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880cff70 con 0x7fcc8815f280 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.635+0000 7fcc8cefc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8815f660 con 0x7fcc880ce9f0 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.635+0000 7fcc86d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc880c6930 0x7fcc880cca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51976/0 (socket says 172.21.15.5:51976) 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.635+0000 7fcc86d9d640 1 -- 172.21.15.5:0/3818346504 learned_addr learned my addr 172.21.15.5:0/3818346504 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.635+0000 7fcc85d9b640 1 --2- 172.21.15.5:0/3818346504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc880cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414633 0 0) 0x7fcc880c5440 con 0x7fcc880c6930 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc74003520 con 0x7fcc880c6930 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330507447 0 0) 0x7fcc880cff70 con 0x7fcc8815f280 2024-04-25T08:57:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc880c5440 con 0x7fcc8815f280 2024-04-25T08:57:28.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542426516 0 0) 0x7fcc74003520 con 0x7fcc880c6930 2024-04-25T08:57:28.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc85d9b640 1 -- 172.21.15.5:0/3818346504 >> v1:172.21.15.80:6789/0 conn(0x7fcc8815f280 legacy=0x7fcc880ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc85d9b640 1 -- 172.21.15.5:0/3818346504 >> v1:172.21.15.5:6789/0 conn(0x7fcc880c6930 legacy=0x7fcc880cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.636+0000 7fcc85d9b640 1 -- 172.21.15.5:0/3818346504 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880d0230 con 0x7fcc880ce9f0 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc85d9b640 1 --2- 172.21.15.5:0/3818346504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc880cc500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc700097d0 tx=0x7fcc7002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9965f8fc85e59761 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70037070 con 0x7fcc880ce9f0 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7002ab90 con 0x7fcc880ce9f0 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8559a640 1 -- 172.21.15.5:0/3818346504 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780019f0 con 0x7fcc880ce9f0 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8cefc640 1 -- 172.21.15.5:0/3818346504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 msgr2=0x7fcc880cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/3818346504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc880cc500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc700097d0 tx=0x7fcc7002a100 comp rx=0 tx=0).stop 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8cefc640 1 -- 172.21.15.5:0/3818346504 shutdown_connections 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/3818346504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc880cc500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.637+0000 7fcc8cefc640 1 -- 172.21.15.5:0/3818346504 >> 172.21.15.5:0/3818346504 conn(0x7fcc880d18f0 msgr2=0x7fcc880d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:28.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.638+0000 7fcc8cefc640 1 -- 172.21.15.5:0/3818346504 shutdown_connections 2024-04-25T08:57:28.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.638+0000 7fcc8cefc640 1 -- 172.21.15.5:0/3818346504 wait complete. 2024-04-25T08:57:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.639+0000 7fcc8cefc640 1 Processor -- start 2024-04-25T08:57:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.639+0000 7fcc8cefc640 1 -- start start 2024-04-25T08:57:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8cefc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc880c6930 0x7fcc88147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8cefc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc8815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8cefc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8815f280 0x7fcc880cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8cefc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880cf190 con 0x7fcc880c6930 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8cefc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880d07f0 con 0x7fcc8815f280 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8cefc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880d2480 con 0x7fcc880ce9f0 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc880c6930 0x7fcc88147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc880c6930 0x7fcc88147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42188/0 (socket says 172.21.15.5:42188) 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 -- 172.21.15.5:0/2829338861 learned_addr learned my addr 172.21.15.5:0/2829338861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc85d9b640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc8815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc86d9d640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8815f280 0x7fcc880cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 -- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 msgr2=0x7fcc8815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc8815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 -- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8815f280 msgr2=0x7fcc880cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8815f280 0x7fcc880cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 -- 172.21.15.5:0/2829338861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8815af00 con 0x7fcc880c6930 2024-04-25T08:57:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8659c640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc880c6930 0x7fcc88147a30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000c430 tx=0x7fcc8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc7effd640 1 -- 172.21.15.5:0/2829338861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80017070 con 0x7fcc880c6930 2024-04-25T08:57:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc7effd640 1 -- 172.21.15.5:0/2829338861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc800052f0 con 0x7fcc880c6930 2024-04-25T08:57:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.640+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc88159920 con 0x7fcc880c6930 2024-04-25T08:57:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.641+0000 7fcc7effd640 1 -- 172.21.15.5:0/2829338861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80003830 con 0x7fcc880c6930 2024-04-25T08:57:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.641+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc88159ee0 con 0x7fcc880c6930 2024-04-25T08:57:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.642+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8804ef20 con 0x7fcc880c6930 2024-04-25T08:57:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.642+0000 7fcc7effd640 1 -- 172.21.15.5:0/2829338861 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc8001a070 con 0x7fcc880c6930 2024-04-25T08:57:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.642+0000 7fcc7effd640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc6806b500 0x7fcc6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.642+0000 7fcc7effd640 1 -- 172.21.15.5:0/2829338861 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcc80089220 con 0x7fcc880c6930 2024-04-25T08:57:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.643+0000 7fcc85d9b640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc6806b500 0x7fcc6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.643+0000 7fcc85d9b640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc6806b500 0x7fcc6806d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc70034000 tx=0x7fcc7002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:28.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.646+0000 7fcc7effd640 1 -- 172.21.15.5:0/2829338861 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc80057da0 con 0x7fcc880c6930 2024-04-25T08:57:28.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.896+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fcc880c8250 con 0x7fcc880c6930 2024-04-25T08:57:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.898+0000 7fcc7effd640 1 -- 172.21.15.5:0/2829338861 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcc8005be40 con 0x7fcc880c6930 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc6806b500 msgr2=0x7fcc6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc6806b500 0x7fcc6806d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc70034000 tx=0x7fcc7002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc880c6930 msgr2=0x7fcc88147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc880c6930 0x7fcc88147a30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000c430 tx=0x7fcc8000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 shutdown_connections 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc6806b500 0x7fcc6806d9c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8815f280 0x7fcc880cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc880ce9f0 0x7fcc8815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 --2- 172.21.15.5:0/2829338861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc880c6930 0x7fcc88147a30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:28.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 >> 172.21.15.5:0/2829338861 conn(0x7fcc880d18f0 msgr2=0x7fcc88068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:28.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 shutdown_connections 2024-04-25T08:57:28.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:28.900+0000 7fcc8cefc640 1 -- 172.21.15.5:0/2829338861 wait complete. 2024-04-25T08:57:28.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T08:57:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.013+0000 7f7ebfc41640 1 Processor -- start 2024-04-25T08:57:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.013+0000 7f7ebfc41640 1 -- start start 2024-04-25T08:57:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebfc41640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b2cc0 0x7f7eb80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebfc41640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7eb80b7130 0x7f7eb80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebfc41640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb80d20e0 con 0x7f7eb815de70 2024-04-25T08:57:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebfc41640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb80d2a10 con 0x7f7eb80b7130 2024-04-25T08:57:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebfc41640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb80d23c0 con 0x7f7eb80b2cc0 2024-04-25T08:57:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebe1de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7eb80b7130 0x7f7eb80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebd9dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7eb815de70 0x7f7eb80b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51992/0 (socket says 172.21.15.5:51992) 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebd9dd640 1 -- 172.21.15.5:0/1880013998 learned_addr learned my addr 172.21.15.5:0/1880013998 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebd1dc640 1 --2- 172.21.15.5:0/1880013998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b2cc0 0x7f7eb80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebe1de640 1 -- 172.21.15.5:0/1880013998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b2cc0 msgr2=0x7f7eb80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebe1de640 1 --2- 172.21.15.5:0/1880013998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b2cc0 0x7f7eb80b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebe1de640 1 -- 172.21.15.5:0/1880013998 >> v1:172.21.15.5:6789/0 conn(0x7f7eb815de70 legacy=0x7f7eb80b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebe1de640 1 -- 172.21.15.5:0/1880013998 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb80d26a0 con 0x7f7eb80b7130 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebc9db640 1 -- 172.21.15.5:0/1880013998 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095136089 0 0) 0x7f7eb80d20e0 con 0x7f7eb815de70 2024-04-25T08:57:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.014+0000 7f7ebd1dc640 1 --2- 172.21.15.5:0/1880013998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b2cc0 0x7f7eb80b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.015+0000 7f7ebe1de640 1 --2- 172.21.15.5:0/1880013998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb80b7130 0x7f7eb80ce7f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009d90 tx=0x7f7eb002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c6a0070d50a1bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.015+0000 7f7ebc9db640 1 -- 172.21.15.5:0/1880013998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0007740 con 0x7f7eb80b7130 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.015+0000 7f7ebc9db640 1 -- 172.21.15.5:0/1880013998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb00078e0 con 0x7f7eb80b7130 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.015+0000 7f7ebc9db640 1 -- 172.21.15.5:0/1880013998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0007cb0 con 0x7f7eb80b7130 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 -- 172.21.15.5:0/1880013998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb80b7130 msgr2=0x7f7eb80ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/1880013998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb80b7130 0x7f7eb80ce7f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009d90 tx=0x7f7eb002a660 comp rx=0 tx=0).stop 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 -- 172.21.15.5:0/1880013998 shutdown_connections 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/1880013998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb80b7130 0x7f7eb80ce7f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/1880013998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b2cc0 0x7f7eb80b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 -- 172.21.15.5:0/1880013998 >> 172.21.15.5:0/1880013998 conn(0x7f7eb806b000 msgr2=0x7f7eb806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 -- 172.21.15.5:0/1880013998 shutdown_connections 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.016+0000 7f7ebfc41640 1 -- 172.21.15.5:0/1880013998 wait complete. 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.017+0000 7f7ebfc41640 1 Processor -- start 2024-04-25T08:57:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.017+0000 7f7ebfc41640 1 -- start start 2024-04-25T08:57:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebfc41640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb80b2cc0 0x7f7eb81f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebfc41640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b7130 0x7f7eb8146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebfc41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb815de70 0x7f7eb8146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebfc41640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb80cf0c0 con 0x7f7eb815de70 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebfc41640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb80cef40 con 0x7f7eb80b2cc0 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebfc41640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb80cbd70 con 0x7f7eb80b7130 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb815de70 0x7f7eb8146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb815de70 0x7f7eb8146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42218/0 (socket says 172.21.15.5:42218) 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 -- 172.21.15.5:0/2386902405 learned_addr learned my addr 172.21.15.5:0/2386902405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebd1dc640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b7130 0x7f7eb8146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebd9dd640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb80b2cc0 0x7f7eb81f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 -- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b7130 msgr2=0x7f7eb8146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b7130 0x7f7eb8146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 -- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb80b2cc0 msgr2=0x7f7eb81f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb80b2cc0 0x7f7eb81f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebe1de640 1 -- 172.21.15.5:0/2386902405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8146c40 con 0x7f7eb815de70 2024-04-25T08:57:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebd1dc640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b7130 0x7f7eb8146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.018+0000 7f7ebd9dd640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb80b2cc0 0x7f7eb81f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.019+0000 7f7ebe1de640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb815de70 0x7f7eb8146660 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7eb002ac50 tx=0x7f7eb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.019+0000 7f7eae7fc640 1 -- 172.21.15.5:0/2386902405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0040070 con 0x7f7eb815de70 2024-04-25T08:57:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.019+0000 7f7eae7fc640 1 -- 172.21.15.5:0/2386902405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0031bc0 con 0x7f7eb815de70 2024-04-25T08:57:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.019+0000 7f7eae7fc640 1 -- 172.21.15.5:0/2386902405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0045460 con 0x7f7eb815de70 2024-04-25T08:57:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.019+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb8146f20 con 0x7f7eb815de70 2024-04-25T08:57:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.019+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb8144160 con 0x7f7eb815de70 2024-04-25T08:57:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.020+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb804ef20 con 0x7f7eb815de70 2024-04-25T08:57:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.020+0000 7f7eae7fc640 1 -- 172.21.15.5:0/2386902405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7eb0039040 con 0x7f7eb815de70 2024-04-25T08:57:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.021+0000 7f7eae7fc640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e9c06b4d0 0x7f7e9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.021+0000 7f7eae7fc640 1 -- 172.21.15.5:0/2386902405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7eb00ab850 con 0x7f7eb815de70 2024-04-25T08:57:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.021+0000 7f7ebd9dd640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e9c06b4d0 0x7f7e9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.021+0000 7f7ebd9dd640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e9c06b4d0 0x7f7e9c06d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4000f60 tx=0x7f7eb4007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.025+0000 7f7eae7fc640 1 -- 172.21.15.5:0/2386902405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7eb007aaa0 con 0x7f7eb815de70 2024-04-25T08:57:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.278+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7eb81470f0 con 0x7f7eb815de70 2024-04-25T08:57:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.280+0000 7f7eae7fc640 1 -- 172.21.15.5:0/2386902405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7eb007a3a0 con 0x7f7eb815de70 2024-04-25T08:57:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e9c06b4d0 msgr2=0x7f7e9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e9c06b4d0 0x7f7e9c06d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4000f60 tx=0x7f7eb4007ca0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb815de70 msgr2=0x7f7eb8146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb815de70 0x7f7eb8146660 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7eb002ac50 tx=0x7f7eb0004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 shutdown_connections 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e9c06b4d0 0x7f7e9c06d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7eb815de70 0x7f7eb8146660 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7eb80b7130 0x7f7eb8146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 --2- 172.21.15.5:0/2386902405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb80b2cc0 0x7f7eb81f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 >> 172.21.15.5:0/2386902405 conn(0x7f7eb806b000 msgr2=0x7f7eb80d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 shutdown_connections 2024-04-25T08:57:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.282+0000 7f7ebfc41640 1 -- 172.21.15.5:0/2386902405 wait complete. 2024-04-25T08:57:29.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T08:57:29.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.396+0000 7f2f3cf09640 1 Processor -- start 2024-04-25T08:57:29.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.396+0000 7f2f3cf09640 1 -- start start 2024-04-25T08:57:29.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3cf09640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 0x7f2f380b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3cf09640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f380b7130 0x7f2f380ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3cf09640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f380d20e0 con 0x7f2f3815de70 2024-04-25T08:57:29.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3cf09640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f380d2a10 con 0x7f2f380b7130 2024-04-25T08:57:29.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3cf09640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380d23c0 con 0x7f2f380b2cc0 2024-04-25T08:57:29.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f3815de70 0x7f2f380b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52002/0 (socket says 172.21.15.5:52002) 2024-04-25T08:57:29.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3659c640 1 -- 172.21.15.5:0/3165654294 learned_addr learned my addr 172.21.15.5:0/3165654294 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f35d9b640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 0x7f2f380b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721270552 0 0) 0x7f2f380d20e0 con 0x7f2f3815de70 2024-04-25T08:57:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f20003520 con 0x7f2f3815de70 2024-04-25T08:57:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f36d9d640 1 --2- 172.21.15.5:0/3165654294 >> v2:172.21.15.80:3300/0 conn(0x7f2f380b7130 0x7f2f380ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2690962027 0 0) 0x7f2f20003520 con 0x7f2f3815de70 2024-04-25T08:57:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.397+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 msgr2=0x7f2f380b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 0x7f2f380b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 >> v2:172.21.15.80:3300/0 conn(0x7f2f380b7130 msgr2=0x7f2f380ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 --2- 172.21.15.5:0/3165654294 >> v2:172.21.15.80:3300/0 conn(0x7f2f380b7130 0x7f2f380ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380d26a0 con 0x7f2f3815de70 2024-04-25T08:57:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2f28001670 con 0x7f2f3815de70 2024-04-25T08:57:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f36d9d640 1 --2- 172.21.15.5:0/3165654294 >> v2:172.21.15.80:3300/0 conn(0x7f2f380b7130 0x7f2f380ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f35d9b640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 0x7f2f380b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 >> v1:172.21.15.5:6789/0 conn(0x7f2f3815de70 legacy=0x7f2f380b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 0x7f2f20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f20004d40 0x7f2f200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380d2a10 con 0x7f2f200039b0 2024-04-25T08:57:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380d23c0 con 0x7f2f20004d40 2024-04-25T08:57:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2000ba40 con 0x7f2f380b2cc0 2024-04-25T08:57:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3659c640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f35d9b640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 0x7f2f20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f36d9d640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f20004d40 0x7f2f200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3659c640 1 -- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 msgr2=0x7f2f20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3659c640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f380b2cc0 0x7f2f20004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3659c640 1 -- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f20004d40 msgr2=0x7f2f200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3659c640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f20004d40 0x7f2f200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.398+0000 7f2f3659c640 1 -- 172.21.15.5:0/3165654294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20003520 con 0x7f2f200039b0 2024-04-25T08:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.399+0000 7f2f3659c640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f20003dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c290 tx=0x7f2f20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdba9ee9f768678 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.399+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28007d50 con 0x7f2f200039b0 2024-04-25T08:57:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.399+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28005af0 con 0x7f2f200039b0 2024-04-25T08:57:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.399+0000 7f2f3559a640 1 -- 172.21.15.5:0/3165654294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28007070 con 0x7f2f200039b0 2024-04-25T08:57:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.399+0000 7f2f3cf09640 1 -- 172.21.15.5:0/3165654294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 msgr2=0x7f2f20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.399+0000 7f2f3cf09640 1 --2- 172.21.15.5:0/3165654294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f20003dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c290 tx=0x7f2f20005830 comp rx=0 tx=0).stop 2024-04-25T08:57:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.399+0000 7f2f36d9d640 1 -- 172.21.15.5:0/3165654294 reap_dead start 2024-04-25T08:57:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.400+0000 7f2f3cf09640 1 -- 172.21.15.5:0/3165654294 shutdown_connections 2024-04-25T08:57:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.400+0000 7f2f3cf09640 1 -- 172.21.15.5:0/3165654294 >> 172.21.15.5:0/3165654294 conn(0x7f2f3806b000 msgr2=0x7f2f3806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.400+0000 7f2f3cf09640 1 -- 172.21.15.5:0/3165654294 shutdown_connections 2024-04-25T08:57:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.400+0000 7f2f3cf09640 1 -- 172.21.15.5:0/3165654294 wait complete. 2024-04-25T08:57:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.401+0000 7f2f3cf09640 1 Processor -- start 2024-04-25T08:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.401+0000 7f2f3cf09640 1 -- start start 2024-04-25T08:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3cf09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f380c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3cf09640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f3814e3c0 0x7f2f380b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3cf09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f380b7d20 0x7f2f380c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3cf09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380b6f80 con 0x7f2f200039b0 2024-04-25T08:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3cf09640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380b6e00 con 0x7f2f380b7d20 2024-04-25T08:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3cf09640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380ced30 con 0x7f2f3814e3c0 2024-04-25T08:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f380c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f380c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42236/0 (socket says 172.21.15.5:42236) 2024-04-25T08:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 -- 172.21.15.5:0/1521914307 learned_addr learned my addr 172.21.15.5:0/1521914307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f35d9b640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f3814e3c0 0x7f2f380b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f36d9d640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f380b7d20 0x7f2f380c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 -- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f3814e3c0 msgr2=0x7f2f380b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f3814e3c0 0x7f2f380b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 -- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f380b7d20 msgr2=0x7f2f380c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f380b7d20 0x7f2f380c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 -- 172.21.15.5:0/1521914307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380c9130 con 0x7f2f200039b0 2024-04-25T08:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f35d9b640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f3814e3c0 0x7f2f380b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f36d9d640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f380b7d20 0x7f2f380c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f3659c640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f380c87a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c3b0 tx=0x7f2f380d1970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f26ffd640 1 -- 172.21.15.5:0/1521914307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28042070 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.402+0000 7f2f26ffd640 1 -- 172.21.15.5:0/1521914307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28007480 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.403+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f380c9410 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.403+0000 7f2f26ffd640 1 -- 172.21.15.5:0/1521914307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28001c80 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.403+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f380c99d0 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.403+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3804ef20 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.404+0000 7f2f26ffd640 1 -- 172.21.15.5:0/1521914307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f28045070 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.404+0000 7f2f26ffd640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f1806b4d0 0x7f2f1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.405+0000 7f2f26ffd640 1 -- 172.21.15.5:0/1521914307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f280aaa90 con 0x7f2f200039b0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.405+0000 7f2f35d9b640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f1806b4d0 0x7f2f1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.405+0000 7f2f35d9b640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f1806b4d0 0x7f2f1806d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f3815aef0 tx=0x7f2f2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.409+0000 7f2f26ffd640 1 -- 172.21.15.5:0/1521914307 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f28005ac0 con 0x7f2f200039b0 2024-04-25T08:57:29.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.655+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f2f380b8100 con 0x7f2f200039b0 2024-04-25T08:57:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.657+0000 7f2f26ffd640 1 -- 172.21.15.5:0/1521914307 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2f28079610 con 0x7f2f200039b0 2024-04-25T08:57:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f1806b4d0 msgr2=0x7f2f1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f1806b4d0 0x7f2f1806d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f3815aef0 tx=0x7f2f2c008040 comp rx=0 tx=0).stop 2024-04-25T08:57:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 msgr2=0x7f2f380c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f380c87a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c3b0 tx=0x7f2f380d1970 comp rx=0 tx=0).stop 2024-04-25T08:57:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 shutdown_connections 2024-04-25T08:57:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f1806b4d0 0x7f2f1806d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f380b7d20 0x7f2f380c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2f3814e3c0 0x7f2f380b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 --2- 172.21.15.5:0/1521914307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f200039b0 0x7f2f380c87a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 >> 172.21.15.5:0/1521914307 conn(0x7f2f3806b000 msgr2=0x7f2f380d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 shutdown_connections 2024-04-25T08:57:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.660+0000 7f2f3cf09640 1 -- 172.21.15.5:0/1521914307 wait complete. 2024-04-25T08:57:29.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T08:57:29.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.773+0000 7f4b248ea640 1 Processor -- start 2024-04-25T08:57:29.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.773+0000 7f4b248ea640 1 -- start start 2024-04-25T08:57:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b248ea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2006adf0 0x7f4b2006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b248ea640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b248ea640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2006bf40 con 0x7f4b200cea80 2024-04-25T08:57:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b248ea640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200cfd60 con 0x7f4b2006adf0 2024-04-25T08:57:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b248ea640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2015f480 con 0x7f4b2006bb30 2024-04-25T08:57:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b17fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2006adf0 0x7f4b2006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b17fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2006adf0 0x7f4b2006b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42240/0 (socket says 172.21.15.5:42240) 2024-04-25T08:57:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b17fff640 1 -- 172.21.15.5:0/602296998 learned_addr learned my addr 172.21.15.5:0/602296998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b1ed9d640 1 --2- 172.21.15.5:0/602296998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b17fff640 1 -- 172.21.15.5:0/602296998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 msgr2=0x7f4b200d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b17fff640 1 --2- 172.21.15.5:0/602296998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b17fff640 1 -- 172.21.15.5:0/602296998 >> v1:172.21.15.80:6789/0 conn(0x7f4b200cea80 legacy=0x7f4b2015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:29.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.774+0000 7f4b17fff640 1 -- 172.21.15.5:0/602296998 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2015ef10 con 0x7f4b2006adf0 2024-04-25T08:57:29.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.775+0000 7f4b17fff640 1 --2- 172.21.15.5:0/602296998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2006adf0 0x7f4b2006b5f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009870 tx=0x7f4b0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f42143b39977d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.775+0000 7f4b1dd9b640 1 -- 172.21.15.5:0/602296998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08037070 con 0x7f4b2006adf0 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.775+0000 7f4b1dd9b640 1 -- 172.21.15.5:0/602296998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b08032440 con 0x7f4b2006adf0 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.775+0000 7f4b1dd9b640 1 -- 172.21.15.5:0/602296998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08032810 con 0x7f4b2006adf0 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 -- 172.21.15.5:0/602296998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2006adf0 msgr2=0x7f4b2006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 --2- 172.21.15.5:0/602296998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2006adf0 0x7f4b2006b5f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009870 tx=0x7f4b0802a270 comp rx=0 tx=0).stop 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 -- 172.21.15.5:0/602296998 shutdown_connections 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 --2- 172.21.15.5:0/602296998 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 --2- 172.21.15.5:0/602296998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2006adf0 0x7f4b2006b5f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 -- 172.21.15.5:0/602296998 >> 172.21.15.5:0/602296998 conn(0x7f4b200d19f0 msgr2=0x7f4b200d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 -- 172.21.15.5:0/602296998 shutdown_connections 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.776+0000 7f4b248ea640 1 -- 172.21.15.5:0/602296998 wait complete. 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.777+0000 7f4b248ea640 1 Processor -- start 2024-04-25T08:57:29.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.777+0000 7f4b248ea640 1 -- start start 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b248ea640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b2006adf0 0x7f4b2015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b248ea640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b248ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b200cea80 0x7f4b200b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b248ea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200cff90 con 0x7f4b200cea80 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b248ea640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2015f1a0 con 0x7f4b2006adf0 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b248ea640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200d0270 con 0x7f4b2006bb30 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b200cea80 0x7f4b200b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b200cea80 0x7f4b200b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42250/0 (socket says 172.21.15.5:42250) 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 -- 172.21.15.5:0/3596687363 learned_addr learned my addr 172.21.15.5:0/3596687363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b17fff640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1e59c640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b2006adf0 0x7f4b2015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 -- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 msgr2=0x7f4b200c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 -- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b2006adf0 msgr2=0x7f4b2015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b2006adf0 0x7f4b2015db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 -- 172.21.15.5:0/3596687363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200c6b70 con 0x7f4b200cea80 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.778+0000 7f4b1ed9d640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b200cea80 0x7f4b200b66b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b18007e40 tx=0x7f4b1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.779+0000 7f4b16ffd640 1 -- 172.21.15.5:0/3596687363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18014620 con 0x7f4b200cea80 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.779+0000 7f4b16ffd640 1 -- 172.21.15.5:0/3596687363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18019070 con 0x7f4b200cea80 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.779+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b200c6e50 con 0x7f4b200cea80 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.779+0000 7f4b16ffd640 1 -- 172.21.15.5:0/3596687363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18014a20 con 0x7f4b200cea80 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.779+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b200c7410 con 0x7f4b200cea80 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.780+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2004ef20 con 0x7f4b200cea80 2024-04-25T08:57:29.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.780+0000 7f4b16ffd640 1 -- 172.21.15.5:0/3596687363 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4b18014bc0 con 0x7f4b200cea80 2024-04-25T08:57:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.781+0000 7f4b16ffd640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b0006b4d0 0x7f4b0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.781+0000 7f4b16ffd640 1 -- 172.21.15.5:0/3596687363 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b1808a5d0 con 0x7f4b200cea80 2024-04-25T08:57:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.781+0000 7f4b1e59c640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b0006b4d0 0x7f4b0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.781+0000 7f4b1e59c640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b0006b4d0 0x7f4b0006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4b200c52f0 tx=0x7f4b10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:29.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:29.785+0000 7f4b16ffd640 1 -- 172.21.15.5:0/3596687363 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4b18059150 con 0x7f4b200cea80 2024-04-25T08:57:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.033+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4b200b7970 con 0x7f4b200cea80 2024-04-25T08:57:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.035+0000 7f4b16ffd640 1 -- 172.21.15.5:0/3596687363 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4b1805d1f0 con 0x7f4b200cea80 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b0006b4d0 msgr2=0x7f4b0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b0006b4d0 0x7f4b0006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4b200c52f0 tx=0x7f4b10009040 comp rx=0 tx=0).stop 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b200cea80 msgr2=0x7f4b200b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b200cea80 0x7f4b200b66b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b18007e40 tx=0x7f4b1800e4b0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 shutdown_connections 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b0006b4d0 0x7f4b0006d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b200cea80 0x7f4b200b66b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b2006bb30 0x7f4b200c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.036+0000 7f4b248ea640 1 --2- 172.21.15.5:0/3596687363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b2006adf0 0x7f4b2015db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.037+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 >> 172.21.15.5:0/3596687363 conn(0x7f4b200d19f0 msgr2=0x7f4b200b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.037+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 shutdown_connections 2024-04-25T08:57:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.037+0000 7f4b248ea640 1 -- 172.21.15.5:0/3596687363 wait complete. 2024-04-25T08:57:30.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.148+0000 7f238655c640 1 Processor -- start 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.149+0000 7f238655c640 1 -- start start 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.149+0000 7f238655c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f238015ef00 0x7f23800668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.149+0000 7f238655c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2380066e30 0x7f2380161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.149+0000 7f238655c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2380067240 con 0x7f23801581e0 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.149+0000 7f238655c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23800ae5e0 con 0x7f238015ef00 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.149+0000 7f238655c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23800ae300 con 0x7f2380066e30 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.149+0000 7f237f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f238015ef00 0x7f23800668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.150+0000 7f237f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f238015ef00 0x7f23800668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42252/0 (socket says 172.21.15.5:42252) 2024-04-25T08:57:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.150+0000 7f237f7fe640 1 -- 172.21.15.5:0/547629439 learned_addr learned my addr 172.21.15.5:0/547629439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.150+0000 7f2384af9640 1 --2- 172.21.15.5:0/547629439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2380066e30 0x7f2380161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.150+0000 7f237f7fe640 1 -- 172.21.15.5:0/547629439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2380066e30 msgr2=0x7f2380161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.150+0000 7f237f7fe640 1 --2- 172.21.15.5:0/547629439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2380066e30 0x7f2380161800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.150+0000 7f237f7fe640 1 -- 172.21.15.5:0/547629439 >> v1:172.21.15.80:6789/0 conn(0x7f23801581e0 legacy=0x7f23800ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.150+0000 7f237f7fe640 1 -- 172.21.15.5:0/547629439 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238015e420 con 0x7f238015ef00 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f237f7fe640 1 --2- 172.21.15.5:0/547629439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238015ef00 0x7f23800668f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2370009870 tx=0x7f237002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7482114e470c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f237effd640 1 -- 172.21.15.5:0/547629439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370037070 con 0x7f238015ef00 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f237effd640 1 -- 172.21.15.5:0/547629439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370032440 con 0x7f238015ef00 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f237effd640 1 -- 172.21.15.5:0/547629439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370032810 con 0x7f238015ef00 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 -- 172.21.15.5:0/547629439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238015ef00 msgr2=0x7f23800668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 --2- 172.21.15.5:0/547629439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238015ef00 0x7f23800668f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2370009870 tx=0x7f237002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 -- 172.21.15.5:0/547629439 shutdown_connections 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 --2- 172.21.15.5:0/547629439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2380066e30 0x7f2380161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 --2- 172.21.15.5:0/547629439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238015ef00 0x7f23800668f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 -- 172.21.15.5:0/547629439 >> 172.21.15.5:0/547629439 conn(0x7f23800d0870 msgr2=0x7f23800d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 -- 172.21.15.5:0/547629439 shutdown_connections 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.151+0000 7f238655c640 1 -- 172.21.15.5:0/547629439 wait complete. 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.152+0000 7f238655c640 1 Processor -- start 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f238655c640 1 -- start start 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f238655c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380066e30 0x7f2380152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f238655c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23801581e0 0x7f23801616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f238655c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f238015ef00 0x7f2380161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f238655c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23801585c0 con 0x7f2380066e30 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f238655c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238015e9e0 con 0x7f238015ef00 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f238655c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23800afd50 con 0x7f23801581e0 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f237ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380066e30 0x7f2380152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f237ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380066e30 0x7f2380152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42260/0 (socket says 172.21.15.5:42260) 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.153+0000 7f237ffff640 1 -- 172.21.15.5:0/2458874403 learned_addr learned my addr 172.21.15.5:0/2458874403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237f7fe640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23801581e0 0x7f23801616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f2384af9640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f238015ef00 0x7f2380161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237ffff640 1 -- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23801581e0 msgr2=0x7f23801616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237ffff640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23801581e0 0x7f23801616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237ffff640 1 -- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f238015ef00 msgr2=0x7f2380161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237ffff640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f238015ef00 0x7f2380161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237ffff640 1 -- 172.21.15.5:0/2458874403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380160fc0 con 0x7f2380066e30 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237ffff640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380066e30 0x7f2380152b20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f237400c430 tx=0x7f237400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237cff9640 1 -- 172.21.15.5:0/2458874403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374011790 con 0x7f2380066e30 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237cff9640 1 -- 172.21.15.5:0/2458874403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374017070 con 0x7f2380066e30 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238015ff20 con 0x7f2380066e30 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f237cff9640 1 -- 172.21.15.5:0/2458874403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374011bb0 con 0x7f2380066e30 2024-04-25T08:57:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.154+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23801604e0 con 0x7f2380066e30 2024-04-25T08:57:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.155+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238004ef20 con 0x7f2380066e30 2024-04-25T08:57:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.156+0000 7f237cff9640 1 -- 172.21.15.5:0/2458874403 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f237401c460 con 0x7f2380066e30 2024-04-25T08:57:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.156+0000 7f237cff9640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f236c06b4d0 0x7f236c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.156+0000 7f237cff9640 1 -- 172.21.15.5:0/2458874403 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2374089b60 con 0x7f2380066e30 2024-04-25T08:57:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.156+0000 7f237f7fe640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f236c06b4d0 0x7f236c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.157+0000 7f237f7fe640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f236c06b4d0 0x7f236c06d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2370034000 tx=0x7f237002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.160+0000 7f237cff9640 1 -- 172.21.15.5:0/2458874403 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2374058770 con 0x7f2380066e30 2024-04-25T08:57:30.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.341+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f238006c3b0 con 0x7f2380066e30 2024-04-25T08:57:30.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.342+0000 7f237cff9640 1 -- 172.21.15.5:0/2458874403 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12807 (secure 0 0 0) 0x7f237405c810 con 0x7f2380066e30 2024-04-25T08:57:30.331 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:57:27.380708+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.343+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f236c06b4d0 msgr2=0x7f236c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.343+0000 7f238655c640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f236c06b4d0 0x7f236c06d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2370034000 tx=0x7f237002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.343+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380066e30 msgr2=0x7f2380152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.343+0000 7f238655c640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380066e30 0x7f2380152b20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f237400c430 tx=0x7f237400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 shutdown_connections 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f236c06b4d0 0x7f236c06d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f238015ef00 0x7f2380161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23801581e0 0x7f23801616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 --2- 172.21.15.5:0/2458874403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380066e30 0x7f2380152b20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 >> 172.21.15.5:0/2458874403 conn(0x7f23800d0870 msgr2=0x7f23800b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 shutdown_connections 2024-04-25T08:57:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.344+0000 7f238655c640 1 -- 172.21.15.5:0/2458874403 wait complete. 2024-04-25T08:57:30.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:30.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.460+0000 7fd2f381f640 1 Processor -- start 2024-04-25T08:57:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.460+0000 7fd2f381f640 1 -- start start 2024-04-25T08:57:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f381f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2ec15e0b0 0x7fd2ec06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f381f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2ec0cc780 0x7fd2ec0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f381f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec0d27f0 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f381f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0cfee0 con 0x7fd2ec0cc780 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f381f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0d01c0 con 0x7fd2ec15e0b0 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f1dbc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2ec0cc780 0x7fd2ec0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f0dba640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd2ec0d0c80 0x7fd2ec0cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52004/0 (socket says 172.21.15.5:52004) 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f0dba640 1 -- 172.21.15.5:0/3641707984 learned_addr learned my addr 172.21.15.5:0/3641707984 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.461+0000 7fd2f15bb640 1 --2- 172.21.15.5:0/3641707984 >> v2:172.21.15.80:3300/0 conn(0x7fd2ec15e0b0 0x7fd2ec06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2f1dbc640 1 -- 172.21.15.5:0/3641707984 >> v2:172.21.15.80:3300/0 conn(0x7fd2ec15e0b0 msgr2=0x7fd2ec06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2f1dbc640 1 --2- 172.21.15.5:0/3641707984 >> v2:172.21.15.80:3300/0 conn(0x7fd2ec15e0b0 0x7fd2ec06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2f1dbc640 1 -- 172.21.15.5:0/3641707984 >> v1:172.21.15.5:6789/0 conn(0x7fd2ec0d0c80 legacy=0x7fd2ec0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2f1dbc640 1 -- 172.21.15.5:0/3641707984 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0d04a0 con 0x7fd2ec0cc780 2024-04-25T08:57:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2e3fff640 1 -- 172.21.15.5:0/3641707984 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487106186 0 0) 0x7fd2ec0d27f0 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2f1dbc640 1 --2- 172.21.15.5:0/3641707984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec0ce3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009d90 tx=0x7fd2e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f1d3f62f61f16b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2e3fff640 1 -- 172.21.15.5:0/3641707984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4007740 con 0x7fd2ec0cc780 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2e3fff640 1 -- 172.21.15.5:0/3641707984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e40078e0 con 0x7fd2ec0cc780 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.462+0000 7fd2e3fff640 1 -- 172.21.15.5:0/3641707984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4007cb0 con 0x7fd2ec0cc780 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 -- 172.21.15.5:0/3641707984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0cc780 msgr2=0x7fd2ec0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 --2- 172.21.15.5:0/3641707984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec0ce3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009d90 tx=0x7fd2e402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 -- 172.21.15.5:0/3641707984 shutdown_connections 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 --2- 172.21.15.5:0/3641707984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec0ce3b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 --2- 172.21.15.5:0/3641707984 >> v2:172.21.15.80:3300/0 conn(0x7fd2ec15e0b0 0x7fd2ec06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 -- 172.21.15.5:0/3641707984 >> 172.21.15.5:0/3641707984 conn(0x7fd2ec0d1a20 msgr2=0x7fd2ec0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 -- 172.21.15.5:0/3641707984 shutdown_connections 2024-04-25T08:57:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.463+0000 7fd2f381f640 1 -- 172.21.15.5:0/3641707984 wait complete. 2024-04-25T08:57:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.464+0000 7fd2f381f640 1 Processor -- start 2024-04-25T08:57:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.464+0000 7fd2f381f640 1 -- start start 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f381f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f381f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0d0c80 0x7fd2ec0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f381f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2ec15e0b0 0x7fd2ec0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f381f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0cfb90 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f381f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec15e490 con 0x7fd2ec0cc780 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f381f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0ccc30 con 0x7fd2ec15e0b0 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0d0c80 0x7fd2ec0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0d0c80 0x7fd2ec0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42266/0 (socket says 172.21.15.5:42266) 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 -- 172.21.15.5:0/170369036 learned_addr learned my addr 172.21.15.5:0/170369036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f15bb640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f1dbc640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2ec15e0b0 0x7fd2ec0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 -- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2ec15e0b0 msgr2=0x7fd2ec0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2ec15e0b0 0x7fd2ec0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 -- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2ec0cc780 msgr2=0x7fd2ec14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec14b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f0dba640 1 -- 172.21.15.5:0/170369036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0c6c80 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f15bb640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.465+0000 7fd2f1dbc640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2ec15e0b0 0x7fd2ec0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.466+0000 7fd2f0dba640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0d0c80 0x7fd2ec0b52c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c4d0 tx=0x7fd2dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.466+0000 7fd2e1ffb640 1 -- 172.21.15.5:0/170369036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc018070 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.466+0000 7fd2e1ffb640 1 -- 172.21.15.5:0/170369036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc007500 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.466+0000 7fd2e1ffb640 1 -- 172.21.15.5:0/170369036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc004a20 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.466+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec0cb6b0 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.466+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec0c7200 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.467+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec04ef20 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.467+0000 7fd2e1ffb640 1 -- 172.21.15.5:0/170369036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2dc01b070 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.468+0000 7fd2e1ffb640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2d006b4d0 0x7fd2d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.468+0000 7fd2e1ffb640 1 -- 172.21.15.5:0/170369036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2dc0890b0 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.468+0000 7fd2f15bb640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2d006b4d0 0x7fd2d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.469+0000 7fd2f15bb640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2d006b4d0 0x7fd2d006d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec1f7160 tx=0x7fd2e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.472+0000 7fd2e1ffb640 1 -- 172.21.15.5:0/170369036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2dc058310 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.651+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2ec0b2cf0 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.651+0000 7fd2e1ffb640 1 -- 172.21.15.5:0/170369036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2dc057c10 con 0x7fd2ec0d0c80 2024-04-25T08:57:30.641 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:57:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2d006b4d0 msgr2=0x7fd2d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2d006b4d0 0x7fd2d006d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec1f7160 tx=0x7fd2e8008040 comp rx=0 tx=0).stop 2024-04-25T08:57:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0d0c80 msgr2=0x7fd2ec0b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0d0c80 0x7fd2ec0b52c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c4d0 tx=0x7fd2dc00c990 comp rx=0 tx=0).stop 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 shutdown_connections 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2d006b4d0 0x7fd2d006d990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2ec15e0b0 0x7fd2ec0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ec0d0c80 0x7fd2ec0b52c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 --2- 172.21.15.5:0/170369036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2ec0cc780 0x7fd2ec14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 >> 172.21.15.5:0/170369036 conn(0x7fd2ec0d1a20 msgr2=0x7fd2ec06e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 shutdown_connections 2024-04-25T08:57:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.653+0000 7fd2f381f640 1 -- 172.21.15.5:0/170369036 wait complete. 2024-04-25T08:57:30.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:57:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.765+0000 7fd975d9e640 1 Processor -- start 2024-04-25T08:57:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.765+0000 7fd975d9e640 1 -- start start 2024-04-25T08:57:30.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd975d9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9700cee30 0x7fd9700d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd975d9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9700d0e50 0x7fd9700b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd975d9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700d1260 con 0x7fd97015dcb0 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd975d9e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9700d3060 con 0x7fd9700d0e50 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd975d9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9700d3340 con 0x7fd9700cee30 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd97559d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9700d0e50 0x7fd9700b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd974d9c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd97015dcb0 0x7fd9700d2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41622/0 (socket says 172.21.15.5:41622) 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd974d9c640 1 -- 172.21.15.5:0/4285919272 learned_addr learned my addr 172.21.15.5:0/4285919272 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd97559d640 1 -- 172.21.15.5:0/4285919272 >> v2:172.21.15.80:3300/0 conn(0x7fd9700cee30 msgr2=0x7fd9700d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd97559d640 1 --2- 172.21.15.5:0/4285919272 >> v2:172.21.15.80:3300/0 conn(0x7fd9700cee30 0x7fd9700d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd97559d640 1 -- 172.21.15.5:0/4285919272 >> v1:172.21.15.5:6789/0 conn(0x7fd97015dcb0 legacy=0x7fd9700d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd96f7fe640 1 -- 172.21.15.5:0/4285919272 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390420009 0 0) 0x7fd964001110 con 0x7fd97015dcb0 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.766+0000 7fd97559d640 1 -- 172.21.15.5:0/4285919272 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700d3620 con 0x7fd9700d0e50 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.767+0000 7fd97559d640 1 --2- 172.21.15.5:0/4285919272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9700d0e50 0x7fd9700b7440 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd9700b5a80 tx=0x7fd96802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201794e858046747 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.767+0000 7fd96f7fe640 1 -- 172.21.15.5:0/4285919272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968007740 con 0x7fd9700d0e50 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.767+0000 7fd96f7fe640 1 -- 172.21.15.5:0/4285919272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680078e0 con 0x7fd9700d0e50 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.767+0000 7fd96f7fe640 1 -- 172.21.15.5:0/4285919272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968007cb0 con 0x7fd9700d0e50 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 -- 172.21.15.5:0/4285919272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9700d0e50 msgr2=0x7fd9700b7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 --2- 172.21.15.5:0/4285919272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9700d0e50 0x7fd9700b7440 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd9700b5a80 tx=0x7fd96802a680 comp rx=0 tx=0).stop 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 -- 172.21.15.5:0/4285919272 shutdown_connections 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 --2- 172.21.15.5:0/4285919272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9700d0e50 0x7fd9700b7440 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 --2- 172.21.15.5:0/4285919272 >> v2:172.21.15.80:3300/0 conn(0x7fd9700cee30 0x7fd9700d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 -- 172.21.15.5:0/4285919272 >> 172.21.15.5:0/4285919272 conn(0x7fd97006b000 msgr2=0x7fd97006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 -- 172.21.15.5:0/4285919272 shutdown_connections 2024-04-25T08:57:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.768+0000 7fd975d9e640 1 -- 172.21.15.5:0/4285919272 wait complete. 2024-04-25T08:57:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.769+0000 7fd975d9e640 1 Processor -- start 2024-04-25T08:57:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.769+0000 7fd975d9e640 1 -- start start 2024-04-25T08:57:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd975d9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9700cee30 0x7fd970160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd975d9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9700d0e50 0x7fd9701f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd975d9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd97015dcb0 0x7fd9700c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd975d9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b6ce0 con 0x7fd97015dcb0 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd975d9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b6b60 con 0x7fd9700cee30 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd975d9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b7980 con 0x7fd9700d0e50 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd97015dcb0 0x7fd9700c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd97015dcb0 0x7fd9700c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52684/0 (socket says 172.21.15.5:52684) 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 -- 172.21.15.5:0/1935211005 learned_addr learned my addr 172.21.15.5:0/1935211005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd974d9c640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9700cee30 0x7fd970160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd96ffff640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9700d0e50 0x7fd9701f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 -- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9700d0e50 msgr2=0x7fd9701f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9700d0e50 0x7fd9701f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 -- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9700cee30 msgr2=0x7fd970160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9700cee30 0x7fd970160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.770+0000 7fd97559d640 1 -- 172.21.15.5:0/1935211005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700c97c0 con 0x7fd97015dcb0 2024-04-25T08:57:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.771+0000 7fd97559d640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd97015dcb0 0x7fd9700c8410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd968009e50 tx=0x7fd968004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.771+0000 7fd96d7fa640 1 -- 172.21.15.5:0/1935211005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968040070 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.771+0000 7fd96d7fa640 1 -- 172.21.15.5:0/1935211005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968031c70 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.771+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9700c8950 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.771+0000 7fd96d7fa640 1 -- 172.21.15.5:0/1935211005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96803c620 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.771+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9700c7930 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.772+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd970074f70 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.772+0000 7fd96d7fa640 1 -- 172.21.15.5:0/1935211005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd968039040 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.773+0000 7fd96d7fa640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd95406b500 0x7fd95406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.773+0000 7fd96d7fa640 1 -- 172.21.15.5:0/1935211005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd9680ab530 con 0x7fd97015dcb0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.773+0000 7fd974d9c640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd95406b500 0x7fd95406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.773+0000 7fd974d9c640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd95406b500 0x7fd95406d9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd964000f60 tx=0x7fd964007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.777+0000 7fd96d7fa640 1 -- 172.21.15.5:0/1935211005 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9700c97c0 con 0x7fd97015dcb0 2024-04-25T08:57:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.960+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd9700b9080 con 0x7fd97015dcb0 2024-04-25T08:57:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.960+0000 7fd96d7fa640 1 -- 172.21.15.5:0/1935211005 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd968038350 con 0x7fd97015dcb0 2024-04-25T08:57:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:30.950 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T08:57:30.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:57:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T08:57:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T08:57:30.951 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:57:30.951 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T08:57:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.962+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd95406b500 msgr2=0x7fd95406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.962+0000 7fd975d9e640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd95406b500 0x7fd95406d9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd964000f60 tx=0x7fd964007c00 comp rx=0 tx=0).stop 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.962+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd97015dcb0 msgr2=0x7fd9700c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.962+0000 7fd975d9e640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd97015dcb0 0x7fd9700c8410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd968009e50 tx=0x7fd968004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 shutdown_connections 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd95406b500 0x7fd95406d9c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd97015dcb0 0x7fd9700c8410 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9700d0e50 0x7fd9701f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 --2- 172.21.15.5:0/1935211005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9700cee30 0x7fd970160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 >> 172.21.15.5:0/1935211005 conn(0x7fd97006b000 msgr2=0x7fd9700d2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 shutdown_connections 2024-04-25T08:57:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:30.963+0000 7fd975d9e640 1 -- 172.21.15.5:0/1935211005 wait complete. 2024-04-25T08:57:30.963 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:57:30.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:57:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.078+0000 7fa1dbe4a640 1 Processor -- start 2024-04-25T08:57:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.078+0000 7fa1dbe4a640 1 -- start start 2024-04-25T08:57:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1dbe4a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa1d415dbd0 0x7fa1d41617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1dbe4a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1dbe4a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d4162070 con 0x7fa1d40cecf0 2024-04-25T08:57:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1dbe4a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d40cf160 con 0x7fa1d415dbd0 2024-04-25T08:57:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1dbe4a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4162350 con 0x7fa1d40b9470 2024-04-25T08:57:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1da3e7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa1d40cecf0 0x7fa1d40b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41636/0 (socket says 172.21.15.5:41636) 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1da3e7640 1 -- 172.21.15.5:0/3658185651 learned_addr learned my addr 172.21.15.5:0/3658185651 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d93e5640 1 --2- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d9be6640 1 --2- 172.21.15.5:0/3658185651 >> v2:172.21.15.80:3300/0 conn(0x7fa1d415dbd0 0x7fa1d41617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d8be4640 1 -- 172.21.15.5:0/3658185651 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561647461 0 0) 0x7fa1d4162070 con 0x7fa1d40cecf0 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d8be4640 1 -- 172.21.15.5:0/3658185651 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c0003520 con 0x7fa1d40cecf0 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d9be6640 1 -- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 msgr2=0x7fa1d40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d9be6640 1 --2- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d9be6640 1 -- 172.21.15.5:0/3658185651 >> v1:172.21.15.5:6789/0 conn(0x7fa1d40cecf0 legacy=0x7fa1d40b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d9be6640 1 -- 172.21.15.5:0/3658185651 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40d1c50 con 0x7fa1d415dbd0 2024-04-25T08:57:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.079+0000 7fa1d93e5640 1 --2- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:31.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.080+0000 7fa1d9be6640 1 --2- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d415dbd0 0x7fa1d41617b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00097a0 tx=0x7fa1d002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4242d4395a26c93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.080+0000 7fa1d8be4640 1 -- 172.21.15.5:0/3658185651 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0037070 con 0x7fa1d415dbd0 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.080+0000 7fa1d8be4640 1 -- 172.21.15.5:0/3658185651 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0032440 con 0x7fa1d415dbd0 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.080+0000 7fa1d8be4640 1 -- 172.21.15.5:0/3658185651 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0032810 con 0x7fa1d415dbd0 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d415dbd0 msgr2=0x7fa1d41617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d415dbd0 0x7fa1d41617b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00097a0 tx=0x7fa1d002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/3658185651 shutdown_connections 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/3658185651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d415dbd0 0x7fa1d41617b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/3658185651 >> 172.21.15.5:0/3658185651 conn(0x7fa1d4066ad0 msgr2=0x7fa1d4066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/3658185651 shutdown_connections 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.081+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/3658185651 wait complete. 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.082+0000 7fa1dbe4a640 1 Processor -- start 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.082+0000 7fa1dbe4a640 1 -- start start 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1dbe4a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1dbe4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d40cecf0 0x7fa1d415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1dbe4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1d415dbd0 0x7fa1d415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1dbe4a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4161cf0 con 0x7fa1d415dbd0 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1dbe4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4162630 con 0x7fa1d40cecf0 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1dbe4a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d415dfb0 con 0x7fa1d40b9470 2024-04-25T08:57:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1da3e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1d415dbd0 0x7fa1d415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1da3e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1d415dbd0 0x7fa1d415e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52692/0 (socket says 172.21.15.5:52692) 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1da3e7640 1 -- 172.21.15.5:0/967830273 learned_addr learned my addr 172.21.15.5:0/967830273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1d93e5640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d40cecf0 0x7fa1d415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1d9be6640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1da3e7640 1 -- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 msgr2=0x7fa1d40b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.083+0000 7fa1da3e7640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1da3e7640 1 -- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d40cecf0 msgr2=0x7fa1d415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1da3e7640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d40cecf0 0x7fa1d415b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1da3e7640 1 -- 172.21.15.5:0/967830273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40b6430 con 0x7fa1d415dbd0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1da3e7640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1d415dbd0 0x7fa1d415e270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00cb40 tx=0x7fa1cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1ca7fc640 1 -- 172.21.15.5:0/967830273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc017070 con 0x7fa1d415dbd0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1ca7fc640 1 -- 172.21.15.5:0/967830273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc00aca0 con 0x7fa1d415dbd0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d415c260 con 0x7fa1d415dbd0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1ca7fc640 1 -- 172.21.15.5:0/967830273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc012620 con 0x7fa1d415dbd0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.084+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d40cac50 con 0x7fa1d415dbd0 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.085+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d404ef20 con 0x7fa1d415dbd0 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.085+0000 7fa1ca7fc640 1 -- 172.21.15.5:0/967830273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa1cc01a070 con 0x7fa1d415dbd0 2024-04-25T08:57:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.086+0000 7fa1ca7fc640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa1b806b4d0 0x7fa1b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.086+0000 7fa1ca7fc640 1 -- 172.21.15.5:0/967830273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1cc089c00 con 0x7fa1d415dbd0 2024-04-25T08:57:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.086+0000 7fa1d9be6640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa1b806b4d0 0x7fa1b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.087+0000 7fa1d9be6640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa1b806b4d0 0x7fa1b806d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0034000 tx=0x7fa1d002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.090+0000 7fa1ca7fc640 1 -- 172.21.15.5:0/967830273 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa1cc090080 con 0x7fa1d415dbd0 2024-04-25T08:57:31.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.270+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa1d40d11c0 con 0x7fa1d415dbd0 2024-04-25T08:57:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.383+0000 7fa1ca7fc640 1 -- 172.21.15.5:0/967830273 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa1cc058780 con 0x7fa1d415dbd0 2024-04-25T08:57:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T08:57:31.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa1b806b4d0 msgr2=0x7fa1b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa1b806b4d0 0x7fa1b806d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0034000 tx=0x7fa1d002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1d415dbd0 msgr2=0x7fa1d415e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1d415dbd0 0x7fa1d415e270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00cb40 tx=0x7fa1cc00a060 comp rx=0 tx=0).stop 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 shutdown_connections 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa1b806b4d0 0x7fa1b806d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1d415dbd0 0x7fa1d415e270 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1d40cecf0 0x7fa1d415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 --2- 172.21.15.5:0/967830273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1d40b9470 0x7fa1d40b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 >> 172.21.15.5:0/967830273 conn(0x7fa1d4066ad0 msgr2=0x7fa1d40c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 shutdown_connections 2024-04-25T08:57:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.385+0000 7fa1dbe4a640 1 -- 172.21.15.5:0/967830273 wait complete. 2024-04-25T08:57:31.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:57:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.506+0000 7f6c20170640 1 Processor -- start 2024-04-25T08:57:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.507+0000 7f6c20170640 1 -- start start 2024-04-25T08:57:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.507+0000 7f6c20170640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c1815df10 0x7f6c181618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.507+0000 7f6c20170640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c180cefe0 0x7f6c180d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.507+0000 7f6c20170640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c18162150 con 0x7f6c180b6250 2024-04-25T08:57:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.507+0000 7f6c20170640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180d20d0 con 0x7f6c180cefe0 2024-04-25T08:57:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.507+0000 7f6c20170640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18162430 con 0x7f6c1815df10 2024-04-25T08:57:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1df0c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c1815df10 0x7f6c181618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1e70d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c180cefe0 0x7f6c180d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1d70b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6c180b6250 0x7f6c180ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:37118/0 (socket says 172.21.15.5:37118) 2024-04-25T08:57:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1d70b640 1 -- 172.21.15.5:0/1410855433 learned_addr learned my addr 172.21.15.5:0/1410855433 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1e70d640 1 -- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c1815df10 msgr2=0x7f6c181618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1e70d640 1 --2- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c1815df10 0x7f6c181618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1e70d640 1 -- 172.21.15.5:0/1410855433 >> v1:172.21.15.80:6789/0 conn(0x7f6c180b6250 legacy=0x7f6c180ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1e70d640 1 -- 172.21.15.5:0/1410855433 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18162710 con 0x7f6c180cefe0 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.508+0000 7f6c1df0c640 1 --2- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c1815df10 0x7f6c181618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.509+0000 7f6c1e70d640 1 --2- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180d2560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009dc0 tx=0x7f6c1002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf0fe550fd26647 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.509+0000 7f6c1cf0a640 1 -- 172.21.15.5:0/1410855433 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1002ae60 con 0x7f6c180cefe0 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.509+0000 7f6c1cf0a640 1 -- 172.21.15.5:0/1410855433 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10007740 con 0x7f6c180cefe0 2024-04-25T08:57:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.509+0000 7f6c1cf0a640 1 -- 172.21.15.5:0/1410855433 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10007b10 con 0x7f6c180cefe0 2024-04-25T08:57:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 -- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 msgr2=0x7f6c180d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 --2- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180d2560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009dc0 tx=0x7f6c1002a680 comp rx=0 tx=0).stop 2024-04-25T08:57:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 -- 172.21.15.5:0/1410855433 shutdown_connections 2024-04-25T08:57:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 --2- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180d2560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 --2- 172.21.15.5:0/1410855433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c1815df10 0x7f6c181618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 -- 172.21.15.5:0/1410855433 >> 172.21.15.5:0/1410855433 conn(0x7f6c180668f0 msgr2=0x7f6c18066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 -- 172.21.15.5:0/1410855433 shutdown_connections 2024-04-25T08:57:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.510+0000 7f6c20170640 1 -- 172.21.15.5:0/1410855433 wait complete. 2024-04-25T08:57:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.511+0000 7f6c20170640 1 Processor -- start 2024-04-25T08:57:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.511+0000 7f6c20170640 1 -- start start 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c20170640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c180b6250 0x7f6c180cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c20170640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c20170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c1815df10 0x7f6c180cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c20170640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180d2aa0 con 0x7f6c1815df10 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c20170640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18161e10 con 0x7f6c180cefe0 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c20170640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180d2c20 con 0x7f6c180b6250 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c1815df10 0x7f6c180cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c1815df10 0x7f6c180cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52694/0 (socket says 172.21.15.5:52694) 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 -- 172.21.15.5:0/1622986858 learned_addr learned my addr 172.21.15.5:0/1622986858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1d70b640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1df0c640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c180b6250 0x7f6c180cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 -- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c180b6250 msgr2=0x7f6c180cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c180b6250 0x7f6c180cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 -- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 msgr2=0x7f6c180cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1e70d640 1 -- 172.21.15.5:0/1622986858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180ccf50 con 0x7f6c1815df10 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1d70b640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.512+0000 7f6c1df0c640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c180b6250 0x7f6c180cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.513+0000 7f6c1e70d640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c1815df10 0x7f6c180cc6e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009ee0 tx=0x7f6c10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.513+0000 7f6c0e7fc640 1 -- 172.21.15.5:0/1622986858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10040070 con 0x7f6c1815df10 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.513+0000 7f6c0e7fc640 1 -- 172.21.15.5:0/1622986858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1002ae60 con 0x7f6c1815df10 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.513+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c180cd290 con 0x7f6c1815df10 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.513+0000 7f6c0e7fc640 1 -- 172.21.15.5:0/1622986858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10031be0 con 0x7f6c1815df10 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.513+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c180cdad0 con 0x7f6c1815df10 2024-04-25T08:57:31.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.514+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c180ccce0 con 0x7f6c1815df10 2024-04-25T08:57:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.515+0000 7f6c0e7fc640 1 -- 172.21.15.5:0/1622986858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c10039040 con 0x7f6c1815df10 2024-04-25T08:57:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.515+0000 7f6c0e7fc640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bfc06b4d0 0x7f6bfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.515+0000 7f6c0e7fc640 1 -- 172.21.15.5:0/1622986858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6c100ab690 con 0x7f6c1815df10 2024-04-25T08:57:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.515+0000 7f6c1df0c640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bfc06b4d0 0x7f6bfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.516+0000 7f6c1df0c640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bfc06b4d0 0x7f6bfc06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009a20 tx=0x7f6c14008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.520+0000 7f6c0e7fc640 1 -- 172.21.15.5:0/1622986858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c180cd290 con 0x7f6c1815df10 2024-04-25T08:57:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:31.702+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6c180cdcd0 con 0x7f6c1815df10 2024-04-25T08:57:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.385+0000 7f6c0e7fc640 1 -- 172.21.15.5:0/1622986858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6c180cdcd0 con 0x7f6c1815df10 2024-04-25T08:57:32.375 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T08:57:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.389+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bfc06b4d0 msgr2=0x7f6bfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.389+0000 7f6c20170640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bfc06b4d0 0x7f6bfc06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009a20 tx=0x7f6c14008040 comp rx=0 tx=0).stop 2024-04-25T08:57:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.389+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c1815df10 msgr2=0x7f6c180cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.389+0000 7f6c20170640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c1815df10 0x7f6c180cc6e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009ee0 tx=0x7f6c10004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:32.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.393+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 shutdown_connections 2024-04-25T08:57:32.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.393+0000 7f6c20170640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6bfc06b4d0 0x7f6bfc06d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.393+0000 7f6c20170640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c1815df10 0x7f6c180cc6e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.393+0000 7f6c20170640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c180cefe0 0x7f6c180cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.393+0000 7f6c20170640 1 --2- 172.21.15.5:0/1622986858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c180b6250 0x7f6c180cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.393+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 >> 172.21.15.5:0/1622986858 conn(0x7f6c180668f0 msgr2=0x7f6c180b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:32.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.394+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 shutdown_connections 2024-04-25T08:57:32.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.398+0000 7f6c20170640 1 -- 172.21.15.5:0/1622986858 wait complete. 2024-04-25T08:57:32.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:57:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.525+0000 7feafc95c640 1 Processor -- start 2024-04-25T08:57:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.525+0000 7feafc95c640 1 -- start start 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.526+0000 7feafc95c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf815df10 0x7feaf81618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.526+0000 7feafc95c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf80cefe0 0x7feaf80d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.526+0000 7feafc95c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf8162150 con 0x7feaf80b6250 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.526+0000 7feafc95c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80d20d0 con 0x7feaf815df10 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.526+0000 7feafc95c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8162430 con 0x7feaf80cefe0 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf815df10 0x7feaf81618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf5d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feaf80b6250 0x7feaf80ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41650/0 (socket says 172.21.15.5:41650) 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf5d9b640 1 -- 172.21.15.5:0/2703368421 learned_addr learned my addr 172.21.15.5:0/2703368421 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf6d9d640 1 --2- 172.21.15.5:0/2703368421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf80cefe0 0x7feaf80d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf659c640 1 -- 172.21.15.5:0/2703368421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf80cefe0 msgr2=0x7feaf80d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf659c640 1 --2- 172.21.15.5:0/2703368421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf80cefe0 0x7feaf80d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf659c640 1 -- 172.21.15.5:0/2703368421 >> v1:172.21.15.5:6789/0 conn(0x7feaf80b6250 legacy=0x7feaf80ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf659c640 1 -- 172.21.15.5:0/2703368421 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8162710 con 0x7feaf815df10 2024-04-25T08:57:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.527+0000 7feaf559a640 1 -- 172.21.15.5:0/2703368421 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500590894 0 0) 0x7feaf8162150 con 0x7feaf80b6250 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feaf659c640 1 --2- 172.21.15.5:0/2703368421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815df10 0x7feaf81618d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feaf00097a0 tx=0x7feaf002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553d58b1081f9432 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feaf559a640 1 -- 172.21.15.5:0/2703368421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0037070 con 0x7feaf815df10 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feaf559a640 1 -- 172.21.15.5:0/2703368421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0032440 con 0x7feaf815df10 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feaf559a640 1 -- 172.21.15.5:0/2703368421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0032810 con 0x7feaf815df10 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feafc95c640 1 -- 172.21.15.5:0/2703368421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815df10 msgr2=0x7feaf81618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feafc95c640 1 --2- 172.21.15.5:0/2703368421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815df10 0x7feaf81618d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feaf00097a0 tx=0x7feaf002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feafc95c640 1 -- 172.21.15.5:0/2703368421 shutdown_connections 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feafc95c640 1 --2- 172.21.15.5:0/2703368421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf80cefe0 0x7feaf80d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feafc95c640 1 --2- 172.21.15.5:0/2703368421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf815df10 0x7feaf81618d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feafc95c640 1 -- 172.21.15.5:0/2703368421 >> 172.21.15.5:0/2703368421 conn(0x7feaf80668f0 msgr2=0x7feaf8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.528+0000 7feafc95c640 1 -- 172.21.15.5:0/2703368421 shutdown_connections 2024-04-25T08:57:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.529+0000 7feafc95c640 1 -- 172.21.15.5:0/2703368421 wait complete. 2024-04-25T08:57:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.530+0000 7feafc95c640 1 Processor -- start 2024-04-25T08:57:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.530+0000 7feafc95c640 1 -- start start 2024-04-25T08:57:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.530+0000 7feafc95c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b6250 0x7feaf80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feafc95c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf80cefe0 0x7feaf8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feafc95c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf815df10 0x7feaf80c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feafc95c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80d2aa0 con 0x7feaf80b6250 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feafc95c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8161e10 con 0x7feaf80cefe0 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feafc95c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80d2c20 con 0x7feaf815df10 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b6250 0x7feaf80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b6250 0x7feaf80c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52710/0 (socket says 172.21.15.5:52710) 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 -- 172.21.15.5:0/4231103687 learned_addr learned my addr 172.21.15.5:0/4231103687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 -- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf815df10 msgr2=0x7feaf80c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf6d9d640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf815df10 0x7feaf80c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf815df10 0x7feaf80c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 -- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf80cefe0 msgr2=0x7feaf8159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf5d9b640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf80cefe0 0x7feaf8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf80cefe0 0x7feaf8159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 -- 172.21.15.5:0/4231103687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80c8700 con 0x7feaf80b6250 2024-04-25T08:57:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf6d9d640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf815df10 0x7feaf80c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf5d9b640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf80cefe0 0x7feaf8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaf659c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b6250 0x7feaf80c8110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feaf0035040 tx=0x7feaf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaeeffd640 1 -- 172.21.15.5:0/4231103687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0037050 con 0x7feaf80b6250 2024-04-25T08:57:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaeeffd640 1 -- 172.21.15.5:0/4231103687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0038040 con 0x7feaf80b6250 2024-04-25T08:57:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf80c89e0 con 0x7feaf80b6250 2024-04-25T08:57:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feaeeffd640 1 -- 172.21.15.5:0/4231103687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004470 con 0x7feaf80b6250 2024-04-25T08:57:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.531+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf80c8fa0 con 0x7feaf80b6250 2024-04-25T08:57:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.533+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf804ef20 con 0x7feaf80b6250 2024-04-25T08:57:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.533+0000 7feaeeffd640 1 -- 172.21.15.5:0/4231103687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feaf003c6d0 con 0x7feaf80b6250 2024-04-25T08:57:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.533+0000 7feaeeffd640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fead806b4d0 0x7fead806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.533+0000 7feaeeffd640 1 -- 172.21.15.5:0/4231103687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7feaf00aab30 con 0x7feaf80b6250 2024-04-25T08:57:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.533+0000 7feaf5d9b640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fead806b4d0 0x7fead806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.534+0000 7feaf5d9b640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fead806b4d0 0x7fead806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feaf8161d10 tx=0x7feae0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.538+0000 7feaeeffd640 1 -- 172.21.15.5:0/4231103687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feaf0079aa0 con 0x7feaf80b6250 2024-04-25T08:57:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:32.753+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feaf80c9ef0 con 0x7feaf80b6250 2024-04-25T08:57:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.394+0000 7feaeeffd640 1 -- 172.21.15.5:0/4231103687 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7feaf00793a0 con 0x7feaf80b6250 2024-04-25T08:57:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fead806b4d0 msgr2=0x7fead806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fead806b4d0 0x7fead806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feaf8161d10 tx=0x7feae0009040 comp rx=0 tx=0).stop 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b6250 msgr2=0x7feaf80c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b6250 0x7feaf80c8110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feaf0035040 tx=0x7feaf00046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 shutdown_connections 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fead806b4d0 0x7fead806d990 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feaf8161d10 tx=0x7feae0009040 comp rx=0 tx=0).stop 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feaf815df10 0x7feaf80c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaf80cefe0 0x7feaf8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 --2- 172.21.15.5:0/4231103687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf80b6250 0x7feaf80c8110 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 >> 172.21.15.5:0/4231103687 conn(0x7feaf80668f0 msgr2=0x7feaf80b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 shutdown_connections 2024-04-25T08:57:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.398+0000 7feafc95c640 1 -- 172.21.15.5:0/4231103687 wait complete. 2024-04-25T08:57:33.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.534+0000 7fb6fa8fc640 1 Processor -- start 2024-04-25T08:57:33.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.534+0000 7fb6fa8fc640 1 -- start start 2024-04-25T08:57:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.534+0000 7fb6fa8fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f415e120 0x7fb6f406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.534+0000 7fb6fa8fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6f406bbb0 0x7fb6f40d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.534+0000 7fb6fa8fc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f40b4730 con 0x7fb6f406b7d0 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.534+0000 7fb6fa8fc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f40d0b70 con 0x7fb6f406bbb0 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.534+0000 7fb6fa8fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40cbf30 con 0x7fb6f415e120 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f8e99640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6f406bbb0 0x7fb6f40d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb6f406b7d0 0x7fb6f415da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41662/0 (socket says 172.21.15.5:41662) 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f3fff640 1 -- 172.21.15.5:0/2921621896 learned_addr learned my addr 172.21.15.5:0/2921621896 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f37fe640 1 --2- 172.21.15.5:0/2921621896 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f415e120 0x7fb6f406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f8e99640 1 -- 172.21.15.5:0/2921621896 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f415e120 msgr2=0x7fb6f406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f8e99640 1 --2- 172.21.15.5:0/2921621896 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f415e120 0x7fb6f406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f8e99640 1 -- 172.21.15.5:0/2921621896 >> v1:172.21.15.5:6789/0 conn(0x7fb6f406b7d0 legacy=0x7fb6f415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f8e99640 1 -- 172.21.15.5:0/2921621896 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40d0da0 con 0x7fb6f406bbb0 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.535+0000 7fb6f37fe640 1 --2- 172.21.15.5:0/2921621896 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f415e120 0x7fb6f406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6f8e99640 1 --2- 172.21.15.5:0/2921621896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406bbb0 0x7fb6f40d0630 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009d90 tx=0x7fb6ec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7657227ecc14777 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6f2ffd640 1 -- 172.21.15.5:0/2921621896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec007740 con 0x7fb6f406bbb0 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6f2ffd640 1 -- 172.21.15.5:0/2921621896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0078e0 con 0x7fb6f406bbb0 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6f2ffd640 1 -- 172.21.15.5:0/2921621896 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec007cb0 con 0x7fb6f406bbb0 2024-04-25T08:57:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/2921621896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406bbb0 msgr2=0x7fb6f40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/2921621896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406bbb0 0x7fb6f40d0630 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009d90 tx=0x7fb6ec02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/2921621896 shutdown_connections 2024-04-25T08:57:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/2921621896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406bbb0 0x7fb6f40d0630 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/2921621896 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f415e120 0x7fb6f406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/2921621896 >> 172.21.15.5:0/2921621896 conn(0x7fb6f40d18e0 msgr2=0x7fb6f40d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/2921621896 shutdown_connections 2024-04-25T08:57:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.536+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/2921621896 wait complete. 2024-04-25T08:57:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.538+0000 7fb6fa8fc640 1 Processor -- start 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.538+0000 7fb6fa8fc640 1 -- start start 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406b7d0 0x7fb6f415ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f406bbb0 0x7fb6f4151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f415e120 0x7fb6f40d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40cc460 con 0x7fb6f406b7d0 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40cc7d0 con 0x7fb6f415e120 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40ccc60 con 0x7fb6f406bbb0 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406b7d0 0x7fb6f415ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406b7d0 0x7fb6f415ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52726/0 (socket says 172.21.15.5:52726) 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 -- 172.21.15.5:0/3227862567 learned_addr learned my addr 172.21.15.5:0/3227862567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f37fe640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f406bbb0 0x7fb6f4151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f8e99640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f415e120 0x7fb6f40d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 -- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f406bbb0 msgr2=0x7fb6f4151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f406bbb0 0x7fb6f4151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 -- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f415e120 msgr2=0x7fb6f40d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f415e120 0x7fb6f40d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 -- 172.21.15.5:0/3227862567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40c8a50 con 0x7fb6f406b7d0 2024-04-25T08:57:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f8e99640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f415e120 0x7fb6f40d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f37fe640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f406bbb0 0x7fb6f4151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f3fff640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406b7d0 0x7fb6f415ffb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c430 tx=0x7fb6e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f0ff9640 1 -- 172.21.15.5:0/3227862567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4017070 con 0x7fb6f406b7d0 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f0ff9640 1 -- 172.21.15.5:0/3227862567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e4005ce0 con 0x7fb6f406b7d0 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f4160720 con 0x7fb6f406b7d0 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6f0ff9640 1 -- 172.21.15.5:0/3227862567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40072f0 con 0x7fb6f406b7d0 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.539+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f4160ce0 con 0x7fb6f406b7d0 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.541+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f404ef20 con 0x7fb6f406b7d0 2024-04-25T08:57:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.541+0000 7fb6f0ff9640 1 -- 172.21.15.5:0/3227862567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb6e401a070 con 0x7fb6f406b7d0 2024-04-25T08:57:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.541+0000 7fb6f0ff9640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6e006b4d0 0x7fb6e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.541+0000 7fb6f0ff9640 1 -- 172.21.15.5:0/3227862567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6e4089620 con 0x7fb6f406b7d0 2024-04-25T08:57:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.542+0000 7fb6f37fe640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6e006b4d0 0x7fb6e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.542+0000 7fb6f37fe640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6e006b4d0 0x7fb6e006d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40d1610 tx=0x7fb6e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.546+0000 7fb6f0ff9640 1 -- 172.21.15.5:0/3227862567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6f40b4730 con 0x7fb6f406b7d0 2024-04-25T08:57:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.727+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6f40d1360 con 0x7fb6f406b7d0 2024-04-25T08:57:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.728+0000 7fb6f0ff9640 1 -- 172.21.15.5:0/3227862567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16598 (secure 0 0 0) 0x7fb6e40584a0 con 0x7fb6f406b7d0 2024-04-25T08:57:33.719 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:33.719 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:57:32.755256+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:31.301883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:31.733858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6e006b4d0 msgr2=0x7fb6e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6e006b4d0 0x7fb6e006d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40d1610 tx=0x7fb6e8008040 comp rx=0 tx=0).stop 2024-04-25T08:57:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406b7d0 msgr2=0x7fb6f415ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406b7d0 0x7fb6f415ffb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c430 tx=0x7fb6e400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 shutdown_connections 2024-04-25T08:57:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6e006b4d0 0x7fb6e006d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f415e120 0x7fb6f40d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6f406bbb0 0x7fb6f4151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 --2- 172.21.15.5:0/3227862567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f406b7d0 0x7fb6f415ffb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 >> 172.21.15.5:0/3227862567 conn(0x7fb6f40d18e0 msgr2=0x7fb6f40d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 shutdown_connections 2024-04-25T08:57:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.730+0000 7fb6fa8fc640 1 -- 172.21.15.5:0/3227862567 wait complete. 2024-04-25T08:57:33.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.842+0000 7f0e48641640 1 Processor -- start 2024-04-25T08:57:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.842+0000 7f0e48641640 1 -- start start 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.843+0000 7f0e48641640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e400ce7f0 0x7f0e400cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.843+0000 7f0e48641640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e400cf1c0 con 0x7f0e4015de70 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.843+0000 7f0e48641640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e400d20e0 con 0x7f0e400b2cc0 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.843+0000 7f0e48641640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e400d2a10 con 0x7f0e400ce7f0 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.843+0000 7f0e463dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0e4015de70 0x7f0e400b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41674/0 (socket says 172.21.15.5:41674) 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.843+0000 7f0e463dd640 1 -- 172.21.15.5:0/3068106066 learned_addr learned my addr 172.21.15.5:0/3068106066 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.843+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748879676 0 0) 0x7f0e400cf1c0 con 0x7f0e4015de70 2024-04-25T08:57:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e46bde640 1 --2- 172.21.15.5:0/3068106066 >> v2:172.21.15.80:3300/0 conn(0x7f0e400ce7f0 0x7f0e400cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c003520 con 0x7f0e4015de70 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1888772662 0 0) 0x7f0e2c003520 con 0x7f0e4015de70 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 >> v2:172.21.15.80:3300/0 conn(0x7f0e400ce7f0 msgr2=0x7f0e400cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 --2- 172.21.15.5:0/3068106066 >> v2:172.21.15.80:3300/0 conn(0x7f0e400ce7f0 0x7f0e400cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 >> v1:172.21.15.80:6789/0 conn(0x7f0e400b2cc0 legacy=0x7f0e400b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400d23c0 con 0x7f0e4015de70 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f0e38001670 con 0x7f0e4015de70 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 >> v1:172.21.15.5:6789/0 conn(0x7f0e4015de70 legacy=0x7f0e400b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c0039b0 0x7f0e2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c004800 0x7f0e2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e2c0051c0 0x7f0e2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400d2a10 con 0x7f0e2c0039b0 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c00c060 con 0x7f0e2c0051c0 2024-04-25T08:57:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c00c260 con 0x7f0e2c004800 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e463dd640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c0039b0 0x7f0e2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e46bde640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e2c0051c0 0x7f0e2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e45bdc640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c004800 0x7f0e2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e463dd640 1 -- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c004800 msgr2=0x7f0e2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e463dd640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c004800 0x7f0e2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e463dd640 1 -- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e2c0051c0 msgr2=0x7f0e2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e463dd640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e2c0051c0 0x7f0e2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e463dd640 1 -- 172.21.15.5:0/3068106066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c003520 con 0x7f0e2c0039b0 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.844+0000 7f0e46bde640 1 -- 172.21.15.5:0/3068106066 reap_dead start 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.845+0000 7f0e463dd640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c0039b0 0x7f0e2c003dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c240 tx=0x7f0e2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26a3f0070f74270 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.845+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38007d10 con 0x7f0e2c0039b0 2024-04-25T08:57:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.845+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38005ad0 con 0x7f0e2c0039b0 2024-04-25T08:57:33.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.845+0000 7f0e453db640 1 -- 172.21.15.5:0/3068106066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38007070 con 0x7f0e2c0039b0 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.846+0000 7f0e48641640 1 -- 172.21.15.5:0/3068106066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c0039b0 msgr2=0x7f0e2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.846+0000 7f0e48641640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c0039b0 0x7f0e2c003dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c240 tx=0x7f0e2c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.846+0000 7f0e48641640 1 -- 172.21.15.5:0/3068106066 shutdown_connections 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.846+0000 7f0e48641640 1 --2- 172.21.15.5:0/3068106066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c0039b0 0x7f0e2c003dd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.846+0000 7f0e48641640 1 -- 172.21.15.5:0/3068106066 >> 172.21.15.5:0/3068106066 conn(0x7f0e4006b000 msgr2=0x7f0e4006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.846+0000 7f0e48641640 1 -- 172.21.15.5:0/3068106066 shutdown_connections 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.846+0000 7f0e48641640 1 -- 172.21.15.5:0/3068106066 wait complete. 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.847+0000 7f0e48641640 1 Processor -- start 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.847+0000 7f0e48641640 1 -- start start 2024-04-25T08:57:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e48641640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c0039b0 0x7f0e40146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e48641640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e401f3c30 0x7f0e40148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e48641640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e401f4090 0x7f0e40149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e48641640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cee00 con 0x7f0e401f4090 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e48641640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cec80 con 0x7f0e401f3c30 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e48641640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cef80 con 0x7f0e2c0039b0 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e401f4090 0x7f0e40149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e401f4090 0x7f0e40149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52754/0 (socket says 172.21.15.5:52754) 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 -- 172.21.15.5:0/990423787 learned_addr learned my addr 172.21.15.5:0/990423787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e463dd640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c0039b0 0x7f0e40146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e45bdc640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e401f3c30 0x7f0e40148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 -- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c0039b0 msgr2=0x7f0e40146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c0039b0 0x7f0e40146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 -- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e401f3c30 msgr2=0x7f0e40148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e401f3c30 0x7f0e40148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 -- 172.21.15.5:0/990423787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400cc160 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.848+0000 7f0e46bde640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e401f4090 0x7f0e40149180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0e400b3590 tx=0x7f0e3c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.849+0000 7f0e36ffd640 1 -- 172.21.15.5:0/990423787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00fce0 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.849+0000 7f0e36ffd640 1 -- 172.21.15.5:0/990423787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00fe80 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.849+0000 7f0e36ffd640 1 -- 172.21.15.5:0/990423787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c015670 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.849+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e400cc400 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.849+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e400cc9c0 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.850+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4004ef20 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.850+0000 7f0e36ffd640 1 -- 172.21.15.5:0/990423787 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e3c015810 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.851+0000 7f0e36ffd640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e2406b500 0x7f0e2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.851+0000 7f0e36ffd640 1 -- 172.21.15.5:0/990423787 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e3c08af80 con 0x7f0e401f4090 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.851+0000 7f0e463dd640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e2406b500 0x7f0e2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.851+0000 7f0e463dd640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e2406b500 0x7f0e2406d9c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e38032000 tx=0x7f0e38034040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:33.855+0000 7f0e36ffd640 1 -- 172.21.15.5:0/990423787 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e3c019030 con 0x7f0e401f4090 2024-04-25T08:57:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.039+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e400b2550 con 0x7f0e401f4090 2024-04-25T08:57:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.040+0000 7f0e36ffd640 1 -- 172.21.15.5:0/990423787 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16598 (secure 0 0 0) 0x7f0e3c010040 con 0x7f0e401f4090 2024-04-25T08:57:34.030 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:34.030 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:57:32.755256+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:31.301883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:31.733858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e2406b500 msgr2=0x7f0e2406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e2406b500 0x7f0e2406d9c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e38032000 tx=0x7f0e38034040 comp rx=0 tx=0).stop 2024-04-25T08:57:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e401f4090 msgr2=0x7f0e40149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e401f4090 0x7f0e40149180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0e400b3590 tx=0x7f0e3c00f1b0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 shutdown_connections 2024-04-25T08:57:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e2406b500 0x7f0e2406d9c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e401f4090 0x7f0e40149180 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e401f3c30 0x7f0e40148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 --2- 172.21.15.5:0/990423787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e2c0039b0 0x7f0e40146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 >> 172.21.15.5:0/990423787 conn(0x7f0e4006b000 msgr2=0x7f0e400b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 shutdown_connections 2024-04-25T08:57:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.042+0000 7f0e48641640 1 -- 172.21.15.5:0/990423787 wait complete. 2024-04-25T08:57:34.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:57:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.157+0000 7f07c1fc1640 1 Processor -- start 2024-04-25T08:57:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.157+0000 7f07c1fc1640 1 -- start start 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.158+0000 7f07c1fc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc0b24b0 0x7f07bc0b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.158+0000 7f07c1fc1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07bc0cff00 0x7f07bc0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.158+0000 7f07c1fc1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07bc0cdef0 con 0x7f07bc15c0f0 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.158+0000 7f07c1fc1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07bc0cd350 con 0x7f07bc0cff00 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.158+0000 7f07c1fc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0cf7a0 con 0x7f07bc0b24b0 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.158+0000 7f07bb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f07bc15c0f0 0x7f07bc0cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41690/0 (socket says 172.21.15.5:41690) 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.158+0000 7f07bb7fe640 1 -- 172.21.15.5:0/2829827773 learned_addr learned my addr 172.21.15.5:0/2829827773 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07baffd640 1 --2- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc0b24b0 0x7f07bc0b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07bbfff640 1 --2- 172.21.15.5:0/2829827773 >> v2:172.21.15.80:3300/0 conn(0x7f07bc0cff00 0x7f07bc0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07ba7fc640 1 -- 172.21.15.5:0/2829827773 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974214100 0 0) 0x7f07bc0cdef0 con 0x7f07bc15c0f0 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07ba7fc640 1 -- 172.21.15.5:0/2829827773 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a4003520 con 0x7f07bc15c0f0 2024-04-25T08:57:34.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07ba7fc640 1 -- 172.21.15.5:0/2829827773 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3255897450 0 0) 0x7f07a4003520 con 0x7f07bc15c0f0 2024-04-25T08:57:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07bbfff640 1 -- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc0b24b0 msgr2=0x7f07bc0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07bbfff640 1 --2- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc0b24b0 0x7f07bc0b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07bbfff640 1 -- 172.21.15.5:0/2829827773 >> v1:172.21.15.5:6789/0 conn(0x7f07bc15c0f0 legacy=0x7f07bc0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.159+0000 7f07bbfff640 1 -- 172.21.15.5:0/2829827773 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0d24e0 con 0x7f07bc0cff00 2024-04-25T08:57:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07bbfff640 1 --2- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0cff00 0x7f07bc0d0390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009d90 tx=0x7f07b402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2624656e266d4638 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07ba7fc640 1 -- 172.21.15.5:0/2829827773 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac001670 con 0x7f07bc0cff00 2024-04-25T08:57:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07ba7fc640 1 -- 172.21.15.5:0/2829827773 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b4007540 con 0x7f07bc0cff00 2024-04-25T08:57:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07ba7fc640 1 -- 172.21.15.5:0/2829827773 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40078f0 con 0x7f07bc0cff00 2024-04-25T08:57:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0cff00 msgr2=0x7f07bc0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0cff00 0x7f07bc0d0390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009d90 tx=0x7f07b402a5f0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2829827773 shutdown_connections 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0cff00 0x7f07bc0d0390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2829827773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc0b24b0 0x7f07bc0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.160+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2829827773 >> 172.21.15.5:0/2829827773 conn(0x7f07bc0d1920 msgr2=0x7f07bc0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.161+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2829827773 shutdown_connections 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.161+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2829827773 wait complete. 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.162+0000 7f07c1fc1640 1 Processor -- start 2024-04-25T08:57:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.162+0000 7f07c1fc1640 1 -- start start 2024-04-25T08:57:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.162+0000 7f07c1fc1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0b24b0 0x7f07bc14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07c1fc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07bc0cff00 0x7f07bc1f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07c1fc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc15c0f0 0x7f07bc1eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07c1fc1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0cfa40 con 0x7f07bc0cff00 2024-04-25T08:57:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07c1fc1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0b3170 con 0x7f07bc0b24b0 2024-04-25T08:57:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07c1fc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0c5470 con 0x7f07bc15c0f0 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07bc0cff00 0x7f07bc1f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07bc0cff00 0x7f07bc1f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52760/0 (socket says 172.21.15.5:52760) 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 -- 172.21.15.5:0/2485759651 learned_addr learned my addr 172.21.15.5:0/2485759651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07bbfff640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc15c0f0 0x7f07bc1eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07bb7fe640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0b24b0 0x7f07bc14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 -- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc15c0f0 msgr2=0x7f07bc1eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc15c0f0 0x7f07bc1eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 -- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0b24b0 msgr2=0x7f07bc14a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0b24b0 0x7f07bc14a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 -- 172.21.15.5:0/2485759651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc1ef3a0 con 0x7f07bc0cff00 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07bb7fe640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0b24b0 0x7f07bc14a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07baffd640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07bc0cff00 0x7f07bc1f5980 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f07b000e9b0 tx=0x7f07b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07a3fff640 1 -- 172.21.15.5:0/2485759651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0017070 con 0x7f07bc0cff00 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07a3fff640 1 -- 172.21.15.5:0/2485759651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000c9a0 con 0x7f07bc0cff00 2024-04-25T08:57:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07a3fff640 1 -- 172.21.15.5:0/2485759651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000cd90 con 0x7f07bc0cff00 2024-04-25T08:57:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07bc14ae50 con 0x7f07bc0cff00 2024-04-25T08:57:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.163+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc14b410 con 0x7f07bc0cff00 2024-04-25T08:57:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.164+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07bc04ef20 con 0x7f07bc0cff00 2024-04-25T08:57:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.165+0000 7f07a3fff640 1 -- 172.21.15.5:0/2485759651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f07b001a070 con 0x7f07bc0cff00 2024-04-25T08:57:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.165+0000 7f07a3fff640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07a806b4d0 0x7f07a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.165+0000 7f07a3fff640 1 -- 172.21.15.5:0/2485759651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07b008a1e0 con 0x7f07bc0cff00 2024-04-25T08:57:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.165+0000 7f07bb7fe640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07a806b4d0 0x7f07a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.166+0000 7f07bb7fe640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07a806b4d0 0x7f07a806d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f07ac001eb0 tx=0x7f07ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.170+0000 7f07a3fff640 1 -- 172.21.15.5:0/2485759651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f07b0059070 con 0x7f07bc0cff00 2024-04-25T08:57:34.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.388+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f07bc0cfce0 con 0x7f07bc0cff00 2024-04-25T08:57:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.406+0000 7f07a3fff640 1 -- 172.21.15.5:0/2485759651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f07b0058970 con 0x7f07bc0cff00 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07a806b4d0 msgr2=0x7f07a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07a806b4d0 0x7f07a806d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f07ac001eb0 tx=0x7f07ac009040 comp rx=0 tx=0).stop 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07bc0cff00 msgr2=0x7f07bc1f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07bc0cff00 0x7f07bc1f5980 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f07b000e9b0 tx=0x7f07b000ee70 comp rx=0 tx=0).stop 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 shutdown_connections 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07a806b4d0 0x7f07a806d990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07bc15c0f0 0x7f07bc1eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07bc0cff00 0x7f07bc1f5980 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 --2- 172.21.15.5:0/2485759651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07bc0b24b0 0x7f07bc14a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 >> 172.21.15.5:0/2485759651 conn(0x7f07bc0d1920 msgr2=0x7f07bc0c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 shutdown_connections 2024-04-25T08:57:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.409+0000 7f07c1fc1640 1 -- 172.21.15.5:0/2485759651 wait complete. 2024-04-25T08:57:34.410 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:57:34.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:57:34.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.524+0000 7fe28f4b3640 1 Processor -- start 2024-04-25T08:57:34.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.524+0000 7fe28f4b3640 1 -- start start 2024-04-25T08:57:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.525+0000 7fe28f4b3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe28815dc00 0x7fe2880b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.525+0000 7fe28f4b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2880668f0 0x7fe288066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.525+0000 7fe28f4b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2880b3a00 con 0x7fe28806abe0 2024-04-25T08:57:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.525+0000 7fe28f4b3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe288067290 con 0x7fe28815dc00 2024-04-25T08:57:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.525+0000 7fe28f4b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe288072410 con 0x7fe2880668f0 2024-04-25T08:57:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28ca4e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2880668f0 0x7fe288066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28d24f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe28815dc00 0x7fe2880b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28da50640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe28806abe0 0x7fe28806b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:37134/0 (socket says 172.21.15.5:37134) 2024-04-25T08:57:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28da50640 1 -- 172.21.15.5:0/1189295705 learned_addr learned my addr 172.21.15.5:0/1189295705 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28ca4e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2880668f0 0x7fe288066d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:49650/0 (socket says 172.21.15.5:49650) 2024-04-25T08:57:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe287fff640 1 -- 172.21.15.5:0/1189295705 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918574404 0 0) 0x7fe2880b3a00 con 0x7fe28806abe0 2024-04-25T08:57:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe287fff640 1 -- 172.21.15.5:0/1189295705 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe270003520 con 0x7fe28806abe0 2024-04-25T08:57:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28ca4e640 1 -- 172.21.15.5:0/1189295705 >> v2:172.21.15.80:3300/0 conn(0x7fe28815dc00 msgr2=0x7fe2880b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28ca4e640 1 --2- 172.21.15.5:0/1189295705 >> v2:172.21.15.80:3300/0 conn(0x7fe28815dc00 0x7fe2880b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28ca4e640 1 -- 172.21.15.5:0/1189295705 >> v1:172.21.15.80:6789/0 conn(0x7fe28806abe0 legacy=0x7fe28806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28ca4e640 1 -- 172.21.15.5:0/1189295705 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2880b3ce0 con 0x7fe2880668f0 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.526+0000 7fe28d24f640 1 --2- 172.21.15.5:0/1189295705 >> v2:172.21.15.80:3300/0 conn(0x7fe28815dc00 0x7fe2880b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.527+0000 7fe28ca4e640 1 --2- 172.21.15.5:0/1189295705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2880668f0 0x7fe288066d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0097a0 tx=0x7fe27c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ffc11dc7c09340 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.527+0000 7fe287fff640 1 -- 172.21.15.5:0/1189295705 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c037070 con 0x7fe2880668f0 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.527+0000 7fe287fff640 1 -- 172.21.15.5:0/1189295705 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c032440 con 0x7fe2880668f0 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.527+0000 7fe287fff640 1 -- 172.21.15.5:0/1189295705 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0327f0 con 0x7fe2880668f0 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1189295705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2880668f0 msgr2=0x7fe288066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1189295705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2880668f0 0x7fe288066d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0097a0 tx=0x7fe27c02a180 comp rx=0 tx=0).stop 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1189295705 shutdown_connections 2024-04-25T08:57:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1189295705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2880668f0 0x7fe288066d50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1189295705 >> v2:172.21.15.80:3300/0 conn(0x7fe28815dc00 0x7fe2880b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1189295705 >> 172.21.15.5:0/1189295705 conn(0x7fe2880b2560 msgr2=0x7fe2880b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1189295705 shutdown_connections 2024-04-25T08:57:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.528+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1189295705 wait complete. 2024-04-25T08:57:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.529+0000 7fe28f4b3640 1 Processor -- start 2024-04-25T08:57:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.529+0000 7fe28f4b3640 1 -- start start 2024-04-25T08:57:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28f4b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2880668f0 0x7fe28813df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28f4b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe28806abe0 0x7fe28815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28f4b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28815dc00 0x7fe288160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28f4b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28806d450 con 0x7fe28815dc00 2024-04-25T08:57:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28f4b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880af260 con 0x7fe2880668f0 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28f4b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28815dfe0 con 0x7fe28806abe0 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28815dc00 0x7fe288160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28815dc00 0x7fe288160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52762/0 (socket says 172.21.15.5:52762) 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 -- 172.21.15.5:0/1157117889 learned_addr learned my addr 172.21.15.5:0/1157117889 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28d24f640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2880668f0 0x7fe28813df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28ca4e640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe28806abe0 0x7fe28815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 -- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe28806abe0 msgr2=0x7fe28815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe28806abe0 0x7fe28815ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 -- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2880668f0 msgr2=0x7fe28813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2880668f0 0x7fe28813df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 -- 172.21.15.5:0/1157117889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe288156320 con 0x7fe28815dc00 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28da50640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28815dc00 0x7fe288160460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe27800cb40 tx=0x7fe27800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe285ffb640 1 -- 172.21.15.5:0/1157117889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278017070 con 0x7fe28815dc00 2024-04-25T08:57:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe285ffb640 1 -- 172.21.15.5:0/1157117889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800aca0 con 0x7fe28815dc00 2024-04-25T08:57:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe288156040 con 0x7fe28815dc00 2024-04-25T08:57:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.530+0000 7fe285ffb640 1 -- 172.21.15.5:0/1157117889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278012620 con 0x7fe28815dc00 2024-04-25T08:57:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.531+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe288153360 con 0x7fe28815dc00 2024-04-25T08:57:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.532+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28804ef20 con 0x7fe28815dc00 2024-04-25T08:57:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.532+0000 7fe285ffb640 1 -- 172.21.15.5:0/1157117889 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe27801a070 con 0x7fe28815dc00 2024-04-25T08:57:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.532+0000 7fe285ffb640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe27406b4d0 0x7fe27406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.532+0000 7fe285ffb640 1 -- 172.21.15.5:0/1157117889 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe278089fb0 con 0x7fe28815dc00 2024-04-25T08:57:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.532+0000 7fe28d24f640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe27406b4d0 0x7fe27406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.533+0000 7fe28d24f640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe27406b4d0 0x7fe27406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe280009560 tx=0x7fe280009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.537+0000 7fe285ffb640 1 -- 172.21.15.5:0/1157117889 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2780587e0 con 0x7fe28815dc00 2024-04-25T08:57:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:34.755+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe28815bf60 con 0x7fe28815dc00 2024-04-25T08:57:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.411+0000 7fe285ffb640 1 -- 172.21.15.5:0/1157117889 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe27805c880 con 0x7fe28815dc00 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe27406b4d0 msgr2=0x7fe27406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe27406b4d0 0x7fe27406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe280009560 tx=0x7fe280009190 comp rx=0 tx=0).stop 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28815dc00 msgr2=0x7fe288160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28815dc00 0x7fe288160460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe27800cb40 tx=0x7fe27800a060 comp rx=0 tx=0).stop 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 shutdown_connections 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe27406b4d0 0x7fe27406d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28815dc00 0x7fe288160460 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe28806abe0 0x7fe28815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 --2- 172.21.15.5:0/1157117889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2880668f0 0x7fe28813df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 >> 172.21.15.5:0/1157117889 conn(0x7fe2880b2560 msgr2=0x7fe28806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 shutdown_connections 2024-04-25T08:57:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.414+0000 7fe28f4b3640 1 -- 172.21.15.5:0/1157117889 wait complete. 2024-04-25T08:57:35.417 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:57:35.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.534+0000 7fdf2c5e7640 1 Processor -- start 2024-04-25T08:57:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.534+0000 7fdf2c5e7640 1 -- start start 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2c5e7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2c5e7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf240b7130 0x7fdf240ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2c5e7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf240d20e0 con 0x7fdf2415de70 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2c5e7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf240d2a10 con 0x7fdf240b7130 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2c5e7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240d23c0 con 0x7fdf240b2cc0 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2ab84640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf240b7130 0x7fdf240ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2a383640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf2415de70 0x7fdf240b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41704/0 (socket says 172.21.15.5:41704) 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.535+0000 7fdf2a383640 1 -- 172.21.15.5:0/2616593558 learned_addr learned my addr 172.21.15.5:0/2616593558 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf29b82640 1 --2- 172.21.15.5:0/2616593558 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf29381640 1 -- 172.21.15.5:0/2616593558 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701573373 0 0) 0x7fdf240d20e0 con 0x7fdf2415de70 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf29381640 1 -- 172.21.15.5:0/2616593558 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf0c003520 con 0x7fdf2415de70 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf2ab84640 1 -- 172.21.15.5:0/2616593558 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 msgr2=0x7fdf240b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf2ab84640 1 --2- 172.21.15.5:0/2616593558 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf2ab84640 1 -- 172.21.15.5:0/2616593558 >> v1:172.21.15.5:6789/0 conn(0x7fdf2415de70 legacy=0x7fdf240b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf2ab84640 1 -- 172.21.15.5:0/2616593558 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240d26a0 con 0x7fdf240b7130 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.536+0000 7fdf2ab84640 1 --2- 172.21.15.5:0/2616593558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240ce7f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009d90 tx=0x7fdf1402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fbc557bac4d5bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf29381640 1 -- 172.21.15.5:0/2616593558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14007740 con 0x7fdf240b7130 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf29381640 1 -- 172.21.15.5:0/2616593558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf140078e0 con 0x7fdf240b7130 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf29381640 1 -- 172.21.15.5:0/2616593558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14007cb0 con 0x7fdf240b7130 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/2616593558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 msgr2=0x7fdf240ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/2616593558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240ce7f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009d90 tx=0x7fdf1402a660 comp rx=0 tx=0).stop 2024-04-25T08:57:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/2616593558 shutdown_connections 2024-04-25T08:57:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/2616593558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240ce7f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/2616593558 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/2616593558 >> 172.21.15.5:0/2616593558 conn(0x7fdf2406b000 msgr2=0x7fdf2406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/2616593558 shutdown_connections 2024-04-25T08:57:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.537+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/2616593558 wait complete. 2024-04-25T08:57:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 Processor -- start 2024-04-25T08:57:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 -- start start 2024-04-25T08:57:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf2415de70 0x7fdf240c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cf0c0 con 0x7fdf240b7130 2024-04-25T08:57:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cef40 con 0x7fdf2415de70 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf2c5e7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240b5b20 con 0x7fdf240b2cc0 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf29b82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf29b82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52768/0 (socket says 172.21.15.5:52768) 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.539+0000 7fdf29b82640 1 -- 172.21.15.5:0/1959377900 learned_addr learned my addr 172.21.15.5:0/1959377900 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf2a383640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf29b82640 1 -- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 msgr2=0x7fdf240b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf29b82640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf29b82640 1 -- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf2415de70 msgr2=0x7fdf240c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf2ab84640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf2415de70 0x7fdf240c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf29b82640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf2415de70 0x7fdf240c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf29b82640 1 -- 172.21.15.5:0/1959377900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240b5fb0 con 0x7fdf240b7130 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf2a383640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf29b82640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240c7480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800d800 tx=0x7fdf1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf22ffd640 1 -- 172.21.15.5:0/1959377900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800b660 con 0x7fdf240b7130 2024-04-25T08:57:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf22ffd640 1 -- 172.21.15.5:0/1959377900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18019070 con 0x7fdf240b7130 2024-04-25T08:57:35.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf240b4f10 con 0x7fdf240b7130 2024-04-25T08:57:35.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf22ffd640 1 -- 172.21.15.5:0/1959377900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800ba20 con 0x7fdf240b7130 2024-04-25T08:57:35.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.540+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf240b54d0 con 0x7fdf240b7130 2024-04-25T08:57:35.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.541+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2404ef20 con 0x7fdf240b7130 2024-04-25T08:57:35.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.542+0000 7fdf22ffd640 1 -- 172.21.15.5:0/1959377900 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf1800bbc0 con 0x7fdf240b7130 2024-04-25T08:57:35.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.542+0000 7fdf22ffd640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1006b500 0x7fdf1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.542+0000 7fdf22ffd640 1 -- 172.21.15.5:0/1959377900 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf1808a690 con 0x7fdf240b7130 2024-04-25T08:57:35.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.542+0000 7fdf2a383640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1006b500 0x7fdf1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.543+0000 7fdf2a383640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1006b500 0x7fdf1006d9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005880 tx=0x7fdf1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.546+0000 7fdf22ffd640 1 -- 172.21.15.5:0/1959377900 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf18059480 con 0x7fdf240b7130 2024-04-25T08:57:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.764+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf240b5ca0 con 0x7fdf240b7130 2024-04-25T08:57:35.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.764+0000 7fdf22ffd640 1 -- 172.21.15.5:0/1959377900 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fdf18058d80 con 0x7fdf240b7130 2024-04-25T08:57:35.754 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:35.754 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2510409846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2510409846},{"type":"v1","addr":"172.21.15.80:6837","nonce":2510409846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3426555717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3426555717},{"type":"v1","addr":"172.21.15.80:6836","nonce":3426555717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4918,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3729803264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3729803264},{"type":"v1","addr":"172.21.15.5:6835","nonce":3729803264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:32.755583+0000","modified":"2024-04-25T08:57:34.757541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3359008015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3359008015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3359008015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:57:35.755 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2024-04-25T08:57:35.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1006b500 msgr2=0x7fdf1006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1006b500 0x7fdf1006d9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005880 tx=0x7fdf1c009040 comp rx=0 tx=0).stop 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 msgr2=0x7fdf240c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240c7480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800d800 tx=0x7fdf1800dcc0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 shutdown_connections 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1006b500 0x7fdf1006d9c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf2415de70 0x7fdf240c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf240b7130 0x7fdf240c7480 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 --2- 172.21.15.5:0/1959377900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf240b2cc0 0x7fdf240b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 >> 172.21.15.5:0/1959377900 conn(0x7fdf2406b000 msgr2=0x7fdf24160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 shutdown_connections 2024-04-25T08:57:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.767+0000 7fdf2c5e7640 1 -- 172.21.15.5:0/1959377900 wait complete. 2024-04-25T08:57:35.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.878+0000 7f01529d5640 1 Processor -- start 2024-04-25T08:57:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.878+0000 7f01529d5640 1 -- start start 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.879+0000 7f01529d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f014c15e0a0 0x7f014c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.879+0000 7f01529d5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0b7f60 con 0x7f014c0d3df0 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.879+0000 7f01529d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0cf400 con 0x7f014c0d3990 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.879+0000 7f01529d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0b29c0 con 0x7f014c15e0a0 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.879+0000 7f0150f72640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f014c0d3df0 0x7f014c0cecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41716/0 (socket says 172.21.15.5:41716) 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.879+0000 7f0150f72640 1 -- 172.21.15.5:0/3138076236 learned_addr learned my addr 172.21.15.5:0/3138076236 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.879+0000 7f014bfff640 1 --2- 172.21.15.5:0/3138076236 >> v2:172.21.15.80:3300/0 conn(0x7f014c15e0a0 0x7f014c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.880+0000 7f014affd640 1 -- 172.21.15.5:0/3138076236 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019099069 0 0) 0x7f014c0b7f60 con 0x7f014c0d3df0 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.880+0000 7f014affd640 1 -- 172.21.15.5:0/3138076236 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138003520 con 0x7f014c0d3df0 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.880+0000 7f014affd640 1 -- 172.21.15.5:0/3138076236 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 58135025 0 0) 0x7f0138003520 con 0x7f014c0d3df0 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.880+0000 7f014bfff640 1 -- 172.21.15.5:0/3138076236 >> v1:172.21.15.80:6789/0 conn(0x7f014c0d3990 legacy=0x7f014c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.880+0000 7f014bfff640 1 -- 172.21.15.5:0/3138076236 >> v1:172.21.15.5:6789/0 conn(0x7f014c0d3df0 legacy=0x7f014c0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.880+0000 7f014bfff640 1 -- 172.21.15.5:0/3138076236 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0d2080 con 0x7f014c15e0a0 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f014bfff640 1 --2- 172.21.15.5:0/3138076236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 0x7f014c0d0d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f013c0097a0 tx=0x7f013c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82072c9341e46c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f014affd640 1 -- 172.21.15.5:0/3138076236 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c037070 con 0x7f014c15e0a0 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f014affd640 1 -- 172.21.15.5:0/3138076236 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c02ac50 con 0x7f014c15e0a0 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f014affd640 1 -- 172.21.15.5:0/3138076236 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440019f0 con 0x7f014c15e0a0 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f01529d5640 1 -- 172.21.15.5:0/3138076236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 msgr2=0x7f014c0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f01529d5640 1 --2- 172.21.15.5:0/3138076236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 0x7f014c0d0d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f013c0097a0 tx=0x7f013c02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f01529d5640 1 -- 172.21.15.5:0/3138076236 shutdown_connections 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.881+0000 7f01529d5640 1 --2- 172.21.15.5:0/3138076236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 0x7f014c0d0d50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.882+0000 7f01529d5640 1 -- 172.21.15.5:0/3138076236 >> 172.21.15.5:0/3138076236 conn(0x7f014c0668f0 msgr2=0x7f014c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.882+0000 7f01529d5640 1 -- 172.21.15.5:0/3138076236 shutdown_connections 2024-04-25T08:57:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.882+0000 7f01529d5640 1 -- 172.21.15.5:0/3138076236 wait complete. 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.883+0000 7f01529d5640 1 Processor -- start 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.883+0000 7f01529d5640 1 -- start start 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f01529d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f014c0d3990 0x7f014c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f01529d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f014c0d3df0 0x7f014c157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f01529d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 0x7f014c1f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f01529d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0d2920 con 0x7f014c0d3990 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f01529d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0d2640 con 0x7f014c15e0a0 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f01529d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0d2c00 con 0x7f014c0d3df0 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f014c0d3990 0x7f014c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f014c0d3990 0x7f014c0cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52774/0 (socket says 172.21.15.5:52774) 2024-04-25T08:57:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 -- 172.21.15.5:0/2284275328 learned_addr learned my addr 172.21.15.5:0/2284275328 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014b7fe640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f014c0d3df0 0x7f014c157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f0150f72640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 0x7f014c1f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 -- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f014c0d3df0 msgr2=0x7f014c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f014c0d3df0 0x7f014c157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 -- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 msgr2=0x7f014c1f2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 0x7f014c1f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 -- 172.21.15.5:0/2284275328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c1f3a90 con 0x7f014c0d3990 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f014bfff640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f014c0d3990 0x7f014c0cbd10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f013c0098c0 tx=0x7f013c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f0148ff9640 1 -- 172.21.15.5:0/2284275328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c040020 con 0x7f014c0d3990 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f0148ff9640 1 -- 172.21.15.5:0/2284275328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c038040 con 0x7f014c0d3990 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c1f3d70 con 0x7f014c0d3990 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.884+0000 7f0148ff9640 1 -- 172.21.15.5:0/2284275328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c037070 con 0x7f014c0d3990 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.885+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c1f4330 con 0x7f014c0d3990 2024-04-25T08:57:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.885+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c04ef20 con 0x7f014c0d3990 2024-04-25T08:57:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.886+0000 7f0148ff9640 1 -- 172.21.15.5:0/2284275328 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f013c043020 con 0x7f014c0d3990 2024-04-25T08:57:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.886+0000 7f0148ff9640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f012c06b500 0x7f012c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.886+0000 7f0148ff9640 1 -- 172.21.15.5:0/2284275328 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f013c0aa240 con 0x7f014c0d3990 2024-04-25T08:57:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.887+0000 7f014b7fe640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f012c06b500 0x7f012c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.887+0000 7f014b7fe640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f012c06b500 0x7f012c06d9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f014c0b9300 tx=0x7f0134009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:35.891+0000 7f0148ff9640 1 -- 172.21.15.5:0/2284275328 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f013c04a030 con 0x7f014c0d3990 2024-04-25T08:57:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.073+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f014c0ca0a0 con 0x7f014c0d3990 2024-04-25T08:57:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.074+0000 7f0148ff9640 1 -- 172.21.15.5:0/2284275328 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16585 (secure 0 0 0) 0x7f013c079020 con 0x7f014c0d3990 2024-04-25T08:57:36.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:36.064 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:57:34.402710+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:31.301883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:31.733858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f012c06b500 msgr2=0x7f012c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f012c06b500 0x7f012c06d9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f014c0b9300 tx=0x7f0134009040 comp rx=0 tx=0).stop 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f014c0d3990 msgr2=0x7f014c0cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f014c0d3990 0x7f014c0cbd10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f013c0098c0 tx=0x7f013c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 shutdown_connections 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f012c06b500 0x7f012c06d9c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f014c15e0a0 0x7f014c1f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f014c0d3df0 0x7f014c157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 --2- 172.21.15.5:0/2284275328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f014c0d3990 0x7f014c0cbd10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 >> 172.21.15.5:0/2284275328 conn(0x7f014c0668f0 msgr2=0x7f014c0b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 shutdown_connections 2024-04-25T08:57:36.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.076+0000 7f01529d5640 1 -- 172.21.15.5:0/2284275328 wait complete. 2024-04-25T08:57:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:57:36.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:36.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.190+0000 7fefa3c5a640 1 Processor -- start 2024-04-25T08:57:36.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.190+0000 7fefa3c5a640 1 -- start start 2024-04-25T08:57:36.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa3c5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef9c15de70 0x7fef9c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa3c5a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa3c5a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cf1c0 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa3c5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0d2a10 con 0x7fef9c15de70 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa3c5a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0d20e0 con 0x7fef9c0ce7f0 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa19f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef9c15de70 0x7fef9c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa19f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef9c15de70 0x7fef9c0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52790/0 (socket says 172.21.15.5:52790) 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa19f6640 1 -- 172.21.15.5:0/2372420156 learned_addr learned my addr 172.21.15.5:0/2372420156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa21f7640 1 --2- 172.21.15.5:0/2372420156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa19f6640 1 -- 172.21.15.5:0/2372420156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 msgr2=0x7fef9c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa19f6640 1 --2- 172.21.15.5:0/2372420156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa19f6640 1 -- 172.21.15.5:0/2372420156 >> v1:172.21.15.80:6789/0 conn(0x7fef9c0b2cc0 legacy=0x7fef9c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa19f6640 1 -- 172.21.15.5:0/2372420156 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0d23c0 con 0x7fef9c15de70 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.191+0000 7fefa21f7640 1 --2- 172.21.15.5:0/2372420156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:36.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.192+0000 7fefa19f6640 1 --2- 172.21.15.5:0/2372420156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c15de70 0x7fef9c0b93e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fef98009870 tx=0x7fef9802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba6a614852c53b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.192+0000 7fefa09f4640 1 -- 172.21.15.5:0/2372420156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98037070 con 0x7fef9c15de70 2024-04-25T08:57:36.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.192+0000 7fefa09f4640 1 -- 172.21.15.5:0/2372420156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98032440 con 0x7fef9c15de70 2024-04-25T08:57:36.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.192+0000 7fefa09f4640 1 -- 172.21.15.5:0/2372420156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98032810 con 0x7fef9c15de70 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 -- 172.21.15.5:0/2372420156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c15de70 msgr2=0x7fef9c0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/2372420156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c15de70 0x7fef9c0b93e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fef98009870 tx=0x7fef9802a210 comp rx=0 tx=0).stop 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 -- 172.21.15.5:0/2372420156 shutdown_connections 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/2372420156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/2372420156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c15de70 0x7fef9c0b93e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 -- 172.21.15.5:0/2372420156 >> 172.21.15.5:0/2372420156 conn(0x7fef9c06b000 msgr2=0x7fef9c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 -- 172.21.15.5:0/2372420156 shutdown_connections 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.193+0000 7fefa3c5a640 1 -- 172.21.15.5:0/2372420156 wait complete. 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.194+0000 7fefa3c5a640 1 Processor -- start 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.194+0000 7fefa3c5a640 1 -- start start 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa3c5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c0b2cc0 0x7fef9c0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa3c5a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa3c5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef9c15de70 0x7fef9c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa3c5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0b7300 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa3c5a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0b9920 con 0x7fef9c15de70 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa3c5a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0d2ea0 con 0x7fef9c0ce7f0 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c0b2cc0 0x7fef9c0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c0b2cc0 0x7fef9c0c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52792/0 (socket says 172.21.15.5:52792) 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 -- 172.21.15.5:0/1766818684 learned_addr learned my addr 172.21.15.5:0/1766818684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa11f5640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa21f7640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef9c15de70 0x7fef9c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 -- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 msgr2=0x7fef9c1590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c1590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 -- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef9c15de70 msgr2=0x7fef9c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef9c15de70 0x7fef9c0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 -- 172.21.15.5:0/1766818684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c159620 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa21f7640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef9c15de70 0x7fef9c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:36.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa19f6640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c0b2cc0 0x7fef9c0c8330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fef98009870 tx=0x7fef980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fef927fc640 1 -- 172.21.15.5:0/1766818684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98041020 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fef927fc640 1 -- 172.21.15.5:0/1766818684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98030970 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c0caf80 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.195+0000 7fef927fc640 1 -- 172.21.15.5:0/1766818684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98037040 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.196+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c0c9e10 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.197+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c04ef20 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.197+0000 7fef927fc640 1 -- 172.21.15.5:0/1766818684 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef98044020 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.197+0000 7fef927fc640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef8006b4d0 0x7fef8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.197+0000 7fef927fc640 1 -- 172.21.15.5:0/1766818684 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef980aab70 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.198+0000 7fefa11f5640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef8006b4d0 0x7fef8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.198+0000 7fefa11f5640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef8006b4d0 0x7fef8006d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0c7070 tx=0x7fef8c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.202+0000 7fef927fc640 1 -- 172.21.15.5:0/1766818684 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef9804b030 con 0x7fef9c0b2cc0 2024-04-25T08:57:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.382+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef9c0cb260 con 0x7fef8006b4d0 2024-04-25T08:57:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.388+0000 7fef927fc640 1 -- 172.21.15.5:0/1766818684 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239456 (secure 0 0 0) 0x7fef9c0cb260 con 0x7fef8006b4d0 2024-04-25T08:57:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:36.382 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef8006b4d0 msgr2=0x7fef8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef8006b4d0 0x7fef8006d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0c7070 tx=0x7fef8c009040 comp rx=0 tx=0).stop 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c0b2cc0 msgr2=0x7fef9c0c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c0b2cc0 0x7fef9c0c8330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fef98009870 tx=0x7fef980046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 shutdown_connections 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef8006b4d0 0x7fef8006d990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef9c15de70 0x7fef9c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef9c0ce7f0 0x7fef9c1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 --2- 172.21.15.5:0/1766818684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c0b2cc0 0x7fef9c0c8330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 >> 172.21.15.5:0/1766818684 conn(0x7fef9c06b000 msgr2=0x7fef9c068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 shutdown_connections 2024-04-25T08:57:36.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.391+0000 7fefa3c5a640 1 -- 172.21.15.5:0/1766818684 wait complete. 2024-04-25T08:57:36.392 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-25T08:57:34.409138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236332,"kb_used_data":3508,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738388,"statfs":{"total":773094113280,"available":772852109312,"internally_reserved":0,"allocated":3592192,"data_stored":2060881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.011980"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390159+0000","last_change":"2024-04-25T08:57:31.390159+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390159+0000","last_undegraded":"2024-04-25T08:57:31.390159+0000","last_fullsized":"2024-04-25T08:57:31.390159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389781+0000","last_change":"2024-04-25T08:57:31.389781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389781+0000","last_undegraded":"2024-04-25T08:57:31.389781+0000","last_fullsized":"2024-04-25T08:57:31.389781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387559+0000","last_change":"2024-04-25T08:57:31.387559+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387559+0000","last_undegraded":"2024-04-25T08:57:31.387559+0000","last_fullsized":"2024-04-25T08:57:31.387559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387541+0000","last_change":"2024-04-25T08:57:31.387541+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387541+0000","last_undegraded":"2024-04-25T08:57:31.387541+0000","last_fullsized":"2024-04-25T08:57:31.387541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386951+0000","last_change":"2024-04-25T08:57:31.386951+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386951+0000","last_undegraded":"2024-04-25T08:57:31.386951+0000","last_fullsized":"2024-04-25T08:57:31.386951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390648+0000","last_change":"2024-04-25T08:57:31.390648+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390648+0000","last_undegraded":"2024-04-25T08:57:31.390648+0000","last_fullsized":"2024-04-25T08:57:31.390648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387099+0000","last_change":"2024-04-25T08:57:31.387099+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387099+0000","last_undegraded":"2024-04-25T08:57:31.387099+0000","last_fullsized":"2024-04-25T08:57:31.387099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389871+0000","last_change":"2024-04-25T08:57:31.389871+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389871+0000","last_undegraded":"2024-04-25T08:57:31.389871+0000","last_fullsized":"2024-04-25T08:57:31.389871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388584+0000","last_change":"2024-04-25T08:57:31.388584+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388584+0000","last_undegraded":"2024-04-25T08:57:31.388584+0000","last_fullsized":"2024-04-25T08:57:31.388584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390599+0000","last_change":"2024-04-25T08:57:31.390599+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390599+0000","last_undegraded":"2024-04-25T08:57:31.390599+0000","last_fullsized":"2024-04-25T08:57:31.390599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386802+0000","last_change":"2024-04-25T08:57:31.386802+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386802+0000","last_undegraded":"2024-04-25T08:57:31.386802+0000","last_fullsized":"2024-04-25T08:57:31.386802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389808+0000","last_change":"2024-04-25T08:57:31.389808+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389808+0000","last_undegraded":"2024-04-25T08:57:31.389808+0000","last_fullsized":"2024-04-25T08:57:31.389808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390266+0000","last_change":"2024-04-25T08:57:31.390266+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390266+0000","last_undegraded":"2024-04-25T08:57:31.390266+0000","last_fullsized":"2024-04-25T08:57:31.390266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389819+0000","last_change":"2024-04-25T08:57:31.389819+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389819+0000","last_undegraded":"2024-04-25T08:57:31.389819+0000","last_fullsized":"2024-04-25T08:57:31.389819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386790+0000","last_change":"2024-04-25T08:57:31.386790+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386790+0000","last_undegraded":"2024-04-25T08:57:31.386790+0000","last_fullsized":"2024-04-25T08:57:31.386790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387252+0000","last_change":"2024-04-25T08:57:31.387252+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387252+0000","last_undegraded":"2024-04-25T08:57:31.387252+0000","last_fullsized":"2024-04-25T08:57:31.387252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387441+0000","last_change":"2024-04-25T08:57:31.387441+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387441+0000","last_undegraded":"2024-04-25T08:57:31.387441+0000","last_fullsized":"2024-04-25T08:57:31.387441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387342+0000","last_change":"2024-04-25T08:57:31.387342+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387342+0000","last_undegraded":"2024-04-25T08:57:31.387342+0000","last_fullsized":"2024-04-25T08:57:31.387342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388140+0000","last_change":"2024-04-25T08:57:31.388140+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388140+0000","last_undegraded":"2024-04-25T08:57:31.388140+0000","last_fullsized":"2024-04-25T08:57:31.388140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389392+0000","last_change":"2024-04-25T08:57:31.389392+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389392+0000","last_undegraded":"2024-04-25T08:57:31.389392+0000","last_fullsized":"2024-04-25T08:57:31.389392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389396+0000","last_change":"2024-04-25T08:57:31.389396+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389396+0000","last_undegraded":"2024-04-25T08:57:31.389396+0000","last_fullsized":"2024-04-25T08:57:31.389396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389377+0000","last_change":"2024-04-25T08:57:31.389377+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389377+0000","last_undegraded":"2024-04-25T08:57:31.389377+0000","last_fullsized":"2024-04-25T08:57:31.389377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386781+0000","last_change":"2024-04-25T08:57:31.386781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386781+0000","last_undegraded":"2024-04-25T08:57:31.386781+0000","last_fullsized":"2024-04-25T08:57:31.386781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389709+0000","last_change":"2024-04-25T08:57:31.389709+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389709+0000","last_undegraded":"2024-04-25T08:57:31.389709+0000","last_fullsized":"2024-04-25T08:57:31.389709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389969+0000","last_change":"2024-04-25T08:57:31.389969+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389969+0000","last_undegraded":"2024-04-25T08:57:31.389969+0000","last_fullsized":"2024-04-25T08:57:31.389969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T08:57:31.392128+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:57:31.392128+0000","last_peered":"2024-04-25T08:57:31.392128+0000","last_clean":"2024-04-25T08:57:31.392128+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:57:31.392128+0000","last_undegraded":"2024-04-25T08:57:31.392128+0000","last_fullsized":"2024-04-25T08:57:31.392128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:36.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:36.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.544+0000 7f10e7f3b640 1 Processor -- start 2024-04-25T08:57:36.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.544+0000 7f10e7f3b640 1 -- start start 2024-04-25T08:57:36.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e7f3b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10e00ce7f0 0x7f10e00cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e7f3b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00cf1c0 con 0x7f10e015de70 2024-04-25T08:57:36.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e7f3b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00d20e0 con 0x7f10e00b2cc0 2024-04-25T08:57:36.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e7f3b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e00d2a10 con 0x7f10e00ce7f0 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e5cd7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10e015de70 0x7f10e00b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41728/0 (socket says 172.21.15.5:41728) 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e5cd7640 1 -- 172.21.15.5:0/4115194479 learned_addr learned my addr 172.21.15.5:0/4115194479 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e64d8640 1 --2- 172.21.15.5:0/4115194479 >> v2:172.21.15.80:3300/0 conn(0x7f10e00ce7f0 0x7f10e00cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502169136 0 0) 0x7f10e00cf1c0 con 0x7f10e015de70 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.545+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c8003520 con 0x7f10e015de70 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981692287 0 0) 0x7f10c8003520 con 0x7f10e015de70 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 >> v2:172.21.15.80:3300/0 conn(0x7f10e00ce7f0 msgr2=0x7f10e00cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 --2- 172.21.15.5:0/4115194479 >> v2:172.21.15.80:3300/0 conn(0x7f10e00ce7f0 0x7f10e00cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 >> v1:172.21.15.80:6789/0 conn(0x7f10e00b2cc0 legacy=0x7f10e00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00d23c0 con 0x7f10e015de70 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f10d8001670 con 0x7f10e015de70 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 >> v1:172.21.15.5:6789/0 conn(0x7f10e015de70 legacy=0x7f10e00b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c80039b0 0x7f10c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c80043b0 0x7f10c8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c8005080 0x7f10c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00d2a10 con 0x7f10c8005080 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c800bfe0 con 0x7f10c80039b0 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c800c1e0 con 0x7f10c80043b0 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e64d8640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c8005080 0x7f10c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e5cd7640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c80039b0 0x7f10c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e54d6640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c80043b0 0x7f10c8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e64d8640 1 -- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c80043b0 msgr2=0x7f10c8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e64d8640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c80043b0 0x7f10c8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e64d8640 1 -- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c80039b0 msgr2=0x7f10c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e64d8640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c80039b0 0x7f10c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.546+0000 7f10e64d8640 1 -- 172.21.15.5:0/4115194479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8003520 con 0x7f10c8005080 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.547+0000 7f10e64d8640 1 -- 172.21.15.5:0/4115194479 reap_dead start 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.547+0000 7f10e64d8640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c8005080 0x7f10c800b9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009fc0 tx=0x7f10c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b50373831729ff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.547+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0035020 con 0x7f10c8005080 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.547+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0003bd0 con 0x7f10c8005080 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.547+0000 7f10e4cd5640 1 -- 172.21.15.5:0/4115194479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0009c10 con 0x7f10c8005080 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.547+0000 7f10e7f3b640 1 -- 172.21.15.5:0/4115194479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c8005080 msgr2=0x7f10c800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.548+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c8005080 0x7f10c800b9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009fc0 tx=0x7f10c8005830 comp rx=0 tx=0).stop 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.548+0000 7f10e7f3b640 1 -- 172.21.15.5:0/4115194479 shutdown_connections 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.548+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/4115194479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c8005080 0x7f10c800b9c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.548+0000 7f10e7f3b640 1 -- 172.21.15.5:0/4115194479 >> 172.21.15.5:0/4115194479 conn(0x7f10e006b000 msgr2=0x7f10e006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.548+0000 7f10e7f3b640 1 -- 172.21.15.5:0/4115194479 shutdown_connections 2024-04-25T08:57:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.548+0000 7f10e7f3b640 1 -- 172.21.15.5:0/4115194479 wait complete. 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.549+0000 7f10e7f3b640 1 Processor -- start 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.549+0000 7f10e7f3b640 1 -- start start 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e7f3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c8005080 0x7f10e00c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e7f3b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e00c9f10 0x7f10e00ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e7f3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e00caef0 0x7f10e00cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e7f3b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00cee00 con 0x7f10e00caef0 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e7f3b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00cec80 con 0x7f10e00c9f10 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e7f3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00cef80 con 0x7f10c8005080 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e00caef0 0x7f10e00cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e00caef0 0x7f10e00cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52812/0 (socket says 172.21.15.5:52812) 2024-04-25T08:57:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 -- 172.21.15.5:0/2004033750 learned_addr learned my addr 172.21.15.5:0/2004033750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e5cd7640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c8005080 0x7f10e00c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e54d6640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e00c9f10 0x7f10e00ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 -- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c8005080 msgr2=0x7f10e00c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c8005080 0x7f10e00c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 -- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e00c9f10 msgr2=0x7f10e00ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e00c9f10 0x7f10e00ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 -- 172.21.15.5:0/2004033750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00c87f0 con 0x7f10e00caef0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10e64d8640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e00caef0 0x7f10e00cb360 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f10d002af10 tx=0x7f10d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.550+0000 7f10de7fc640 1 -- 172.21.15.5:0/2004033750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0035030 con 0x7f10e00caef0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.551+0000 7f10de7fc640 1 -- 172.21.15.5:0/2004033750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0043070 con 0x7f10e00caef0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.551+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e00c8ad0 con 0x7f10e00caef0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.551+0000 7f10de7fc640 1 -- 172.21.15.5:0/2004033750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d002d070 con 0x7f10e00caef0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.551+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e00ab990 con 0x7f10e00caef0 2024-04-25T08:57:36.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.551+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e00abb90 con 0x7f10e00caef0 2024-04-25T08:57:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.552+0000 7f10de7fc640 1 -- 172.21.15.5:0/2004033750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10d0005d10 con 0x7f10e00caef0 2024-04-25T08:57:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.552+0000 7f10de7fc640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10cc06b4d0 0x7f10cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.553+0000 7f10de7fc640 1 -- 172.21.15.5:0/2004033750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10d00aae80 con 0x7f10e00caef0 2024-04-25T08:57:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.553+0000 7f10e5cd7640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10cc06b4d0 0x7f10cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.553+0000 7f10e5cd7640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10cc06b4d0 0x7f10cc06d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f10d8000c00 tx=0x7f10d8000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.557+0000 7f10de7fc640 1 -- 172.21.15.5:0/2004033750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10e00abb90 con 0x7f10e00caef0 2024-04-25T08:57:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.732+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10e004ef20 con 0x7f10cc06b4d0 2024-04-25T08:57:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.738+0000 7f10de7fc640 1 -- 172.21.15.5:0/2004033750 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239456 (secure 0 0 0) 0x7f10e004ef20 con 0x7f10cc06b4d0 2024-04-25T08:57:36.730 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10cc06b4d0 msgr2=0x7f10cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10cc06b4d0 0x7f10cc06d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f10d8000c00 tx=0x7f10d8000ed0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e00caef0 msgr2=0x7f10e00cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e00caef0 0x7f10e00cb360 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f10d002af10 tx=0x7f10d0009750 comp rx=0 tx=0).stop 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 shutdown_connections 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10cc06b4d0 0x7f10cc06d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e00caef0 0x7f10e00cb360 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e00c9f10 0x7f10e00ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 --2- 172.21.15.5:0/2004033750 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10c8005080 0x7f10e00c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 >> 172.21.15.5:0/2004033750 conn(0x7f10e006b000 msgr2=0x7f10e006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 shutdown_connections 2024-04-25T08:57:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.741+0000 7f10e7f3b640 1 -- 172.21.15.5:0/2004033750 wait complete. 2024-04-25T08:57:36.742 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-04-25T08:57:36.398541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236332,"kb_used_data":3508,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738388,"statfs":{"total":773094113280,"available":772852109312,"internally_reserved":0,"allocated":3592192,"data_stored":2060881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.013585"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390159+0000","last_change":"2024-04-25T08:57:31.390159+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390159+0000","last_undegraded":"2024-04-25T08:57:31.390159+0000","last_fullsized":"2024-04-25T08:57:31.390159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389781+0000","last_change":"2024-04-25T08:57:31.389781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389781+0000","last_undegraded":"2024-04-25T08:57:31.389781+0000","last_fullsized":"2024-04-25T08:57:31.389781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387559+0000","last_change":"2024-04-25T08:57:31.387559+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387559+0000","last_undegraded":"2024-04-25T08:57:31.387559+0000","last_fullsized":"2024-04-25T08:57:31.387559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387541+0000","last_change":"2024-04-25T08:57:31.387541+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387541+0000","last_undegraded":"2024-04-25T08:57:31.387541+0000","last_fullsized":"2024-04-25T08:57:31.387541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386951+0000","last_change":"2024-04-25T08:57:31.386951+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386951+0000","last_undegraded":"2024-04-25T08:57:31.386951+0000","last_fullsized":"2024-04-25T08:57:31.386951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390648+0000","last_change":"2024-04-25T08:57:31.390648+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390648+0000","last_undegraded":"2024-04-25T08:57:31.390648+0000","last_fullsized":"2024-04-25T08:57:31.390648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387099+0000","last_change":"2024-04-25T08:57:31.387099+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387099+0000","last_undegraded":"2024-04-25T08:57:31.387099+0000","last_fullsized":"2024-04-25T08:57:31.387099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389871+0000","last_change":"2024-04-25T08:57:31.389871+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389871+0000","last_undegraded":"2024-04-25T08:57:31.389871+0000","last_fullsized":"2024-04-25T08:57:31.389871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388584+0000","last_change":"2024-04-25T08:57:31.388584+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388584+0000","last_undegraded":"2024-04-25T08:57:31.388584+0000","last_fullsized":"2024-04-25T08:57:31.388584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390599+0000","last_change":"2024-04-25T08:57:31.390599+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390599+0000","last_undegraded":"2024-04-25T08:57:31.390599+0000","last_fullsized":"2024-04-25T08:57:31.390599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386802+0000","last_change":"2024-04-25T08:57:31.386802+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386802+0000","last_undegraded":"2024-04-25T08:57:31.386802+0000","last_fullsized":"2024-04-25T08:57:31.386802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389808+0000","last_change":"2024-04-25T08:57:31.389808+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389808+0000","last_undegraded":"2024-04-25T08:57:31.389808+0000","last_fullsized":"2024-04-25T08:57:31.389808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390266+0000","last_change":"2024-04-25T08:57:31.390266+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390266+0000","last_undegraded":"2024-04-25T08:57:31.390266+0000","last_fullsized":"2024-04-25T08:57:31.390266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389819+0000","last_change":"2024-04-25T08:57:31.389819+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389819+0000","last_undegraded":"2024-04-25T08:57:31.389819+0000","last_fullsized":"2024-04-25T08:57:31.389819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386790+0000","last_change":"2024-04-25T08:57:31.386790+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386790+0000","last_undegraded":"2024-04-25T08:57:31.386790+0000","last_fullsized":"2024-04-25T08:57:31.386790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387252+0000","last_change":"2024-04-25T08:57:31.387252+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387252+0000","last_undegraded":"2024-04-25T08:57:31.387252+0000","last_fullsized":"2024-04-25T08:57:31.387252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387441+0000","last_change":"2024-04-25T08:57:31.387441+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387441+0000","last_undegraded":"2024-04-25T08:57:31.387441+0000","last_fullsized":"2024-04-25T08:57:31.387441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387342+0000","last_change":"2024-04-25T08:57:31.387342+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387342+0000","last_undegraded":"2024-04-25T08:57:31.387342+0000","last_fullsized":"2024-04-25T08:57:31.387342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388140+0000","last_change":"2024-04-25T08:57:31.388140+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388140+0000","last_undegraded":"2024-04-25T08:57:31.388140+0000","last_fullsized":"2024-04-25T08:57:31.388140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389392+0000","last_change":"2024-04-25T08:57:31.389392+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389392+0000","last_undegraded":"2024-04-25T08:57:31.389392+0000","last_fullsized":"2024-04-25T08:57:31.389392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389396+0000","last_change":"2024-04-25T08:57:31.389396+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389396+0000","last_undegraded":"2024-04-25T08:57:31.389396+0000","last_fullsized":"2024-04-25T08:57:31.389396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389377+0000","last_change":"2024-04-25T08:57:31.389377+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389377+0000","last_undegraded":"2024-04-25T08:57:31.389377+0000","last_fullsized":"2024-04-25T08:57:31.389377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386781+0000","last_change":"2024-04-25T08:57:31.386781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386781+0000","last_undegraded":"2024-04-25T08:57:31.386781+0000","last_fullsized":"2024-04-25T08:57:31.386781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389709+0000","last_change":"2024-04-25T08:57:31.389709+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389709+0000","last_undegraded":"2024-04-25T08:57:31.389709+0000","last_fullsized":"2024-04-25T08:57:31.389709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389969+0000","last_change":"2024-04-25T08:57:31.389969+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389969+0000","last_undegraded":"2024-04-25T08:57:31.389969+0000","last_fullsized":"2024-04-25T08:57:31.389969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T08:57:31.392128+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:57:31.392128+0000","last_peered":"2024-04-25T08:57:31.392128+0000","last_clean":"2024-04-25T08:57:31.392128+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:57:31.392128+0000","last_undegraded":"2024-04-25T08:57:31.392128+0000","last_fullsized":"2024-04-25T08:57:31.392128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:36.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.894+0000 7fdaf0322640 1 Processor -- start 2024-04-25T08:57:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.894+0000 7fdaf0322640 1 -- start start 2024-04-25T08:57:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.895+0000 7fdaf0322640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdae815e0a0 0x7fdae80d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.895+0000 7fdaf0322640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae80d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.895+0000 7fdaf0322640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80b7f60 con 0x7fdae80ce5e0 2024-04-25T08:57:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.895+0000 7fdaf0322640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80d4330 con 0x7fdae815e0a0 2024-04-25T08:57:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.895+0000 7fdaf0322640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b29c0 con 0x7fdae80d3990 2024-04-25T08:57:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaee0be640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdae815e0a0 0x7fdae80d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaed8bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae80d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaee8bf640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdae80ce5e0 0x7fdae80cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:37186/0 (socket says 172.21.15.5:37186) 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaee8bf640 1 -- 172.21.15.5:0/4173977713 learned_addr learned my addr 172.21.15.5:0/4173977713 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaee0be640 1 -- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 msgr2=0x7fdae80d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaee0be640 1 --2- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae80d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaee0be640 1 -- 172.21.15.5:0/4173977713 >> v1:172.21.15.80:6789/0 conn(0x7fdae80ce5e0 legacy=0x7fdae80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaee0be640 1 -- 172.21.15.5:0/4173977713 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80d2080 con 0x7fdae815e0a0 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaed0bc640 1 -- 172.21.15.5:0/4173977713 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813471011 0 0) 0x7fdae80b7f60 con 0x7fdae80ce5e0 2024-04-25T08:57:36.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.896+0000 7fdaed8bd640 1 --2- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae80d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.897+0000 7fdaee0be640 1 --2- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae815e0a0 0x7fdae80d0d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdae00097a0 tx=0x7fdae002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04a7d75f3bf1caa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.897+0000 7fdaed0bc640 1 -- 172.21.15.5:0/4173977713 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0037070 con 0x7fdae815e0a0 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.897+0000 7fdaed0bc640 1 -- 172.21.15.5:0/4173977713 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0032440 con 0x7fdae815e0a0 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.897+0000 7fdaed0bc640 1 -- 172.21.15.5:0/4173977713 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0032810 con 0x7fdae815e0a0 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 -- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae815e0a0 msgr2=0x7fdae80d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 --2- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae815e0a0 0x7fdae80d0d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdae00097a0 tx=0x7fdae002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 -- 172.21.15.5:0/4173977713 shutdown_connections 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 --2- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae80d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 --2- 172.21.15.5:0/4173977713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae815e0a0 0x7fdae80d0d50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 -- 172.21.15.5:0/4173977713 >> 172.21.15.5:0/4173977713 conn(0x7fdae80668f0 msgr2=0x7fdae8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 -- 172.21.15.5:0/4173977713 shutdown_connections 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.898+0000 7fdaf0322640 1 -- 172.21.15.5:0/4173977713 wait complete. 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.899+0000 7fdaf0322640 1 Processor -- start 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.899+0000 7fdaf0322640 1 -- start start 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaf0322640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae80ce5e0 0x7fdae8158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaf0322640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae8156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaf0322640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdae815e0a0 0x7fdae80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaf0322640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80d2920 con 0x7fdae815e0a0 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaf0322640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80d2640 con 0x7fdae80ce5e0 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaf0322640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80d2c00 con 0x7fdae80d3990 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdae815e0a0 0x7fdae80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdae815e0a0 0x7fdae80cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52816/0 (socket says 172.21.15.5:52816) 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 -- 172.21.15.5:0/3530101574 learned_addr learned my addr 172.21.15.5:0/3530101574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaed8bd640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae8156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee0be640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae80ce5e0 0x7fdae8158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 -- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 msgr2=0x7fdae8156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae8156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 -- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae80ce5e0 msgr2=0x7fdae8158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae80ce5e0 0x7fdae8158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 -- 172.21.15.5:0/3530101574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8157530 con 0x7fdae815e0a0 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee0be640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae80ce5e0 0x7fdae8158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.900+0000 7fdaee8bf640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdae815e0a0 0x7fdae80cb5b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c700 tx=0x7fdad800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.901+0000 7fdae6ffd640 1 -- 172.21.15.5:0/3530101574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8018070 con 0x7fdae815e0a0 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.901+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae80cbaf0 con 0x7fdae815e0a0 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.901+0000 7fdae6ffd640 1 -- 172.21.15.5:0/3530101574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad800ce10 con 0x7fdae815e0a0 2024-04-25T08:57:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.901+0000 7fdae6ffd640 1 -- 172.21.15.5:0/3530101574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800a860 con 0x7fdae815e0a0 2024-04-25T08:57:36.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.901+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80cc080 con 0x7fdae815e0a0 2024-04-25T08:57:36.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.902+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae804ef20 con 0x7fdae815e0a0 2024-04-25T08:57:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.902+0000 7fdae6ffd640 1 -- 172.21.15.5:0/3530101574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdad800aa00 con 0x7fdae815e0a0 2024-04-25T08:57:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.902+0000 7fdae6ffd640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdad406b4d0 0x7fdad406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.903+0000 7fdae6ffd640 1 -- 172.21.15.5:0/3530101574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdad8089740 con 0x7fdae815e0a0 2024-04-25T08:57:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.903+0000 7fdaee0be640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdad406b4d0 0x7fdad406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.903+0000 7fdaee0be640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdad406b4d0 0x7fdad406d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdae0034000 tx=0x7fdae002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:36.907+0000 7fdae6ffd640 1 -- 172.21.15.5:0/3530101574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdad8057f80 con 0x7fdae815e0a0 2024-04-25T08:57:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.082+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdae80b3830 con 0x7fdad406b4d0 2024-04-25T08:57:37.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.088+0000 7fdae6ffd640 1 -- 172.21.15.5:0/3530101574 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239456 (secure 0 0 0) 0x7fdae80b3830 con 0x7fdad406b4d0 2024-04-25T08:57:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:37.081 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdad406b4d0 msgr2=0x7fdad406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdad406b4d0 0x7fdad406d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdae0034000 tx=0x7fdae002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdae815e0a0 msgr2=0x7fdae80cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdae815e0a0 0x7fdae80cb5b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c700 tx=0x7fdad800cbc0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 shutdown_connections 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdad406b4d0 0x7fdad406d990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdae815e0a0 0x7fdae80cb5b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdae80d3990 0x7fdae8156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 --2- 172.21.15.5:0/3530101574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdae80ce5e0 0x7fdae8158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 >> 172.21.15.5:0/3530101574 conn(0x7fdae80668f0 msgr2=0x7fdae8066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 shutdown_connections 2024-04-25T08:57:37.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.091+0000 7fdaf0322640 1 -- 172.21.15.5:0/3530101574 wait complete. 2024-04-25T08:57:37.092 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-04-25T08:57:36.398541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236332,"kb_used_data":3508,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738388,"statfs":{"total":773094113280,"available":772852109312,"internally_reserved":0,"allocated":3592192,"data_stored":2060881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.013585"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390159+0000","last_change":"2024-04-25T08:57:31.390159+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390159+0000","last_undegraded":"2024-04-25T08:57:31.390159+0000","last_fullsized":"2024-04-25T08:57:31.390159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389781+0000","last_change":"2024-04-25T08:57:31.389781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389781+0000","last_undegraded":"2024-04-25T08:57:31.389781+0000","last_fullsized":"2024-04-25T08:57:31.389781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387559+0000","last_change":"2024-04-25T08:57:31.387559+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387559+0000","last_undegraded":"2024-04-25T08:57:31.387559+0000","last_fullsized":"2024-04-25T08:57:31.387559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387541+0000","last_change":"2024-04-25T08:57:31.387541+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387541+0000","last_undegraded":"2024-04-25T08:57:31.387541+0000","last_fullsized":"2024-04-25T08:57:31.387541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386951+0000","last_change":"2024-04-25T08:57:31.386951+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386951+0000","last_undegraded":"2024-04-25T08:57:31.386951+0000","last_fullsized":"2024-04-25T08:57:31.386951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390648+0000","last_change":"2024-04-25T08:57:31.390648+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390648+0000","last_undegraded":"2024-04-25T08:57:31.390648+0000","last_fullsized":"2024-04-25T08:57:31.390648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387099+0000","last_change":"2024-04-25T08:57:31.387099+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387099+0000","last_undegraded":"2024-04-25T08:57:31.387099+0000","last_fullsized":"2024-04-25T08:57:31.387099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389871+0000","last_change":"2024-04-25T08:57:31.389871+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389871+0000","last_undegraded":"2024-04-25T08:57:31.389871+0000","last_fullsized":"2024-04-25T08:57:31.389871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388584+0000","last_change":"2024-04-25T08:57:31.388584+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388584+0000","last_undegraded":"2024-04-25T08:57:31.388584+0000","last_fullsized":"2024-04-25T08:57:31.388584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390599+0000","last_change":"2024-04-25T08:57:31.390599+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390599+0000","last_undegraded":"2024-04-25T08:57:31.390599+0000","last_fullsized":"2024-04-25T08:57:31.390599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386802+0000","last_change":"2024-04-25T08:57:31.386802+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386802+0000","last_undegraded":"2024-04-25T08:57:31.386802+0000","last_fullsized":"2024-04-25T08:57:31.386802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389808+0000","last_change":"2024-04-25T08:57:31.389808+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389808+0000","last_undegraded":"2024-04-25T08:57:31.389808+0000","last_fullsized":"2024-04-25T08:57:31.389808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390266+0000","last_change":"2024-04-25T08:57:31.390266+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390266+0000","last_undegraded":"2024-04-25T08:57:31.390266+0000","last_fullsized":"2024-04-25T08:57:31.390266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389819+0000","last_change":"2024-04-25T08:57:31.389819+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389819+0000","last_undegraded":"2024-04-25T08:57:31.389819+0000","last_fullsized":"2024-04-25T08:57:31.389819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386790+0000","last_change":"2024-04-25T08:57:31.386790+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386790+0000","last_undegraded":"2024-04-25T08:57:31.386790+0000","last_fullsized":"2024-04-25T08:57:31.386790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387252+0000","last_change":"2024-04-25T08:57:31.387252+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387252+0000","last_undegraded":"2024-04-25T08:57:31.387252+0000","last_fullsized":"2024-04-25T08:57:31.387252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387441+0000","last_change":"2024-04-25T08:57:31.387441+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387441+0000","last_undegraded":"2024-04-25T08:57:31.387441+0000","last_fullsized":"2024-04-25T08:57:31.387441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387342+0000","last_change":"2024-04-25T08:57:31.387342+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387342+0000","last_undegraded":"2024-04-25T08:57:31.387342+0000","last_fullsized":"2024-04-25T08:57:31.387342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388140+0000","last_change":"2024-04-25T08:57:31.388140+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388140+0000","last_undegraded":"2024-04-25T08:57:31.388140+0000","last_fullsized":"2024-04-25T08:57:31.388140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389392+0000","last_change":"2024-04-25T08:57:31.389392+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389392+0000","last_undegraded":"2024-04-25T08:57:31.389392+0000","last_fullsized":"2024-04-25T08:57:31.389392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389396+0000","last_change":"2024-04-25T08:57:31.389396+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389396+0000","last_undegraded":"2024-04-25T08:57:31.389396+0000","last_fullsized":"2024-04-25T08:57:31.389396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389377+0000","last_change":"2024-04-25T08:57:31.389377+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389377+0000","last_undegraded":"2024-04-25T08:57:31.389377+0000","last_fullsized":"2024-04-25T08:57:31.389377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386781+0000","last_change":"2024-04-25T08:57:31.386781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386781+0000","last_undegraded":"2024-04-25T08:57:31.386781+0000","last_fullsized":"2024-04-25T08:57:31.386781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389709+0000","last_change":"2024-04-25T08:57:31.389709+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389709+0000","last_undegraded":"2024-04-25T08:57:31.389709+0000","last_fullsized":"2024-04-25T08:57:31.389709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389969+0000","last_change":"2024-04-25T08:57:31.389969+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389969+0000","last_undegraded":"2024-04-25T08:57:31.389969+0000","last_fullsized":"2024-04-25T08:57:31.389969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T08:57:31.392128+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:57:31.392128+0000","last_peered":"2024-04-25T08:57:31.392128+0000","last_clean":"2024-04-25T08:57:31.392128+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:57:31.392128+0000","last_undegraded":"2024-04-25T08:57:31.392128+0000","last_fullsized":"2024-04-25T08:57:31.392128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:37.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-25T08:57:37.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-25T08:57:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-25T08:57:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-25T08:57:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-25T08:57:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-25T08:57:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.390159+0000', 'last_change': '2024-04-25T08:57:31.390159+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.390159+0000', 'last_undegraded': '2024-04-25T08:57:31.390159+0000', 'last_fullsized': '2024-04-25T08:57:31.390159+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:31.380516+0000', 'last_change': '2024-04-25T08:57:31.380516+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.380516+0000', 'last_undegraded': '2024-04-25T08:57:31.380516+0000', 'last_fullsized': '2024-04-25T08:57:31.380516+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389781+0000', 'last_change': '2024-04-25T08:57:31.389781+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389781+0000', 'last_undegraded': '2024-04-25T08:57:31.389781+0000', 'last_fullsized': '2024-04-25T08:57:31.389781+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T08:57:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.387559+0000', 'last_change': '2024-04-25T08:57:31.387559+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.387559+0000', 'last_undegraded': '2024-04-25T08:57:31.387559+0000', 'last_fullsized': '2024-04-25T08:57:31.387559+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.387541+0000', 'last_change': '2024-04-25T08:57:31.387541+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.387541+0000', 'last_undegraded': '2024-04-25T08:57:31.387541+0000', 'last_fullsized': '2024-04-25T08:57:31.387541+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.386951+0000', 'last_change': '2024-04-25T08:57:31.386951+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.386951+0000', 'last_undegraded': '2024-04-25T08:57:31.386951+0000', 'last_fullsized': '2024-04-25T08:57:31.386951+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.390648+0000', 'last_change': '2024-04-25T08:57:31.390648+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.390648+0000', 'last_undegraded': '2024-04-25T08:57:31.390648+0000', 'last_fullsized': '2024-04-25T08:57:31.390648+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.387099+0000', 'last_change': '2024-04-25T08:57:31.387099+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.387099+0000', 'last_undegraded': '2024-04-25T08:57:31.387099+0000', 'last_fullsized': '2024-04-25T08:57:31.387099+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389871+0000', 'last_change': '2024-04-25T08:57:31.389871+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389871+0000', 'last_undegraded': '2024-04-25T08:57:31.389871+0000', 'last_fullsized': '2024-04-25T08:57:31.389871+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-25T08:57:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:31.380516+0000', 'last_change': '2024-04-25T08:57:31.380516+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.380516+0000', 'last_undegraded': '2024-04-25T08:57:31.380516+0000', 'last_fullsized': '2024-04-25T08:57:31.380516+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.388584+0000', 'last_change': '2024-04-25T08:57:31.388584+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.388584+0000', 'last_undegraded': '2024-04-25T08:57:31.388584+0000', 'last_fullsized': '2024-04-25T08:57:31.388584+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.390599+0000', 'last_change': '2024-04-25T08:57:31.390599+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.390599+0000', 'last_undegraded': '2024-04-25T08:57:31.390599+0000', 'last_fullsized': '2024-04-25T08:57:31.390599+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.386802+0000', 'last_change': '2024-04-25T08:57:31.386802+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.386802+0000', 'last_undegraded': '2024-04-25T08:57:31.386802+0000', 'last_fullsized': '2024-04-25T08:57:31.386802+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389808+0000', 'last_change': '2024-04-25T08:57:31.389808+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389808+0000', 'last_undegraded': '2024-04-25T08:57:31.389808+0000', 'last_fullsized': '2024-04-25T08:57:31.389808+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T08:57:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.390266+0000', 'last_change': '2024-04-25T08:57:31.390266+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.390266+0000', 'last_undegraded': '2024-04-25T08:57:31.390266+0000', 'last_fullsized': '2024-04-25T08:57:31.390266+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.390167+0000', 'last_change': '2024-04-25T08:57:31.390167+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.390167+0000', 'last_undegraded': '2024-04-25T08:57:31.390167+0000', 'last_fullsized': '2024-04-25T08:57:31.390167+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389819+0000', 'last_change': '2024-04-25T08:57:31.389819+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389819+0000', 'last_undegraded': '2024-04-25T08:57:31.389819+0000', 'last_fullsized': '2024-04-25T08:57:31.389819+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-25T08:57:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.386790+0000', 'last_change': '2024-04-25T08:57:31.386790+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.386790+0000', 'last_undegraded': '2024-04-25T08:57:31.386790+0000', 'last_fullsized': '2024-04-25T08:57:31.386790+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.387252+0000', 'last_change': '2024-04-25T08:57:31.387252+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.387252+0000', 'last_undegraded': '2024-04-25T08:57:31.387252+0000', 'last_fullsized': '2024-04-25T08:57:31.387252+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.387441+0000', 'last_change': '2024-04-25T08:57:31.387441+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.387441+0000', 'last_undegraded': '2024-04-25T08:57:31.387441+0000', 'last_fullsized': '2024-04-25T08:57:31.387441+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-25T08:57:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:31.380516+0000', 'last_change': '2024-04-25T08:57:31.380516+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.380516+0000', 'last_undegraded': '2024-04-25T08:57:31.380516+0000', 'last_fullsized': '2024-04-25T08:57:31.380516+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.390167+0000', 'last_change': '2024-04-25T08:57:31.390167+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.390167+0000', 'last_undegraded': '2024-04-25T08:57:31.390167+0000', 'last_fullsized': '2024-04-25T08:57:31.390167+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.387342+0000', 'last_change': '2024-04-25T08:57:31.387342+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.387342+0000', 'last_undegraded': '2024-04-25T08:57:31.387342+0000', 'last_fullsized': '2024-04-25T08:57:31.387342+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.388140+0000', 'last_change': '2024-04-25T08:57:31.388140+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.388140+0000', 'last_undegraded': '2024-04-25T08:57:31.388140+0000', 'last_fullsized': '2024-04-25T08:57:31.388140+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389392+0000', 'last_change': '2024-04-25T08:57:31.389392+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389392+0000', 'last_undegraded': '2024-04-25T08:57:31.389392+0000', 'last_fullsized': '2024-04-25T08:57:31.389392+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:31.380516+0000', 'last_change': '2024-04-25T08:57:31.380516+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.380516+0000', 'last_undegraded': '2024-04-25T08:57:31.380516+0000', 'last_fullsized': '2024-04-25T08:57:31.380516+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389396+0000', 'last_change': '2024-04-25T08:57:31.389396+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389396+0000', 'last_undegraded': '2024-04-25T08:57:31.389396+0000', 'last_fullsized': '2024-04-25T08:57:31.389396+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:31.380516+0000', 'last_change': '2024-04-25T08:57:31.380516+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.380516+0000', 'last_undegraded': '2024-04-25T08:57:31.380516+0000', 'last_fullsized': '2024-04-25T08:57:31.380516+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389377+0000', 'last_change': '2024-04-25T08:57:31.389377+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389377+0000', 'last_undegraded': '2024-04-25T08:57:31.389377+0000', 'last_fullsized': '2024-04-25T08:57:31.389377+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.386781+0000', 'last_change': '2024-04-25T08:57:31.386781+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.386781+0000', 'last_undegraded': '2024-04-25T08:57:31.386781+0000', 'last_fullsized': '2024-04-25T08:57:31.386781+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389709+0000', 'last_change': '2024-04-25T08:57:31.389709+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389709+0000', 'last_undegraded': '2024-04-25T08:57:31.389709+0000', 'last_fullsized': '2024-04-25T08:57:31.389709+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:57:32.384244+0000', 'last_change': '2024-04-25T08:57:32.384244+0000', 'last_active': '2024-04-25T08:57:32.384244+0000', 'last_peered': '2024-04-25T08:57:32.384244+0000', 'last_clean': '2024-04-25T08:57:32.384244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:32.384244+0000', 'last_undegraded': '2024-04-25T08:57:32.384244+0000', 'last_fullsized': '2024-04-25T08:57:32.384244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:32.384244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:57:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T08:57:37.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:31.389969+0000', 'last_change': '2024-04-25T08:57:31.389969+0000', 'last_active': '2024-04-25T08:57:31.380516+0000', 'last_peered': '2024-04-25T08:57:31.380516+0000', 'last_clean': '2024-04-25T08:57:31.380516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:31.389969+0000', 'last_undegraded': '2024-04-25T08:57:31.389969+0000', 'last_fullsized': '2024-04-25T08:57:31.389969+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:31.380516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:37.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:57:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.242+0000 7f04b4310640 1 Processor -- start 2024-04-25T08:57:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.242+0000 7f04b4310640 1 -- start start 2024-04-25T08:57:37.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.243+0000 7f04b4310640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.243+0000 7f04b4310640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 0x7f04ac0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.243+0000 7f04b4310640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac0d20e0 con 0x7f04ac0b7130 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.243+0000 7f04b4310640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0d2a10 con 0x7f04ac0b2cc0 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.243+0000 7f04b4310640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0d23c0 con 0x7f04ac15de70 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b20ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b18ab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 0x7f04ac0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b28ad640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f04ac0b7130 0x7f04ac0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:37194/0 (socket says 172.21.15.5:37194) 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b20ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:49738/0 (socket says 172.21.15.5:49738) 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b28ad640 1 -- 172.21.15.5:0/2019023609 learned_addr learned my addr 172.21.15.5:0/2019023609 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b20ac640 1 -- 172.21.15.5:0/2019023609 >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 msgr2=0x7f04ac0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b20ac640 1 --2- 172.21.15.5:0/2019023609 >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 0x7f04ac0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b20ac640 1 -- 172.21.15.5:0/2019023609 >> v1:172.21.15.80:6789/0 conn(0x7f04ac0b7130 legacy=0x7f04ac0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.244+0000 7f04b20ac640 1 -- 172.21.15.5:0/2019023609 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0d26a0 con 0x7f04ac15de70 2024-04-25T08:57:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.245+0000 7f04b20ac640 1 --2- 172.21.15.5:0/2019023609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f04a80097a0 tx=0x7f04a802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72fba17e009e2a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.245+0000 7f04b10aa640 1 -- 172.21.15.5:0/2019023609 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8037070 con 0x7f04ac15de70 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.245+0000 7f04b10aa640 1 -- 172.21.15.5:0/2019023609 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8032440 con 0x7f04ac15de70 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.245+0000 7f04b10aa640 1 -- 172.21.15.5:0/2019023609 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8032810 con 0x7f04ac15de70 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.245+0000 7f04b4310640 1 -- 172.21.15.5:0/2019023609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 msgr2=0x7f04ac0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.245+0000 7f04b4310640 1 --2- 172.21.15.5:0/2019023609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f04a80097a0 tx=0x7f04a802a180 comp rx=0 tx=0).stop 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.246+0000 7f04b4310640 1 -- 172.21.15.5:0/2019023609 shutdown_connections 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.246+0000 7f04b4310640 1 --2- 172.21.15.5:0/2019023609 >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 0x7f04ac0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.246+0000 7f04b4310640 1 --2- 172.21.15.5:0/2019023609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.246+0000 7f04b4310640 1 -- 172.21.15.5:0/2019023609 >> 172.21.15.5:0/2019023609 conn(0x7f04ac06b000 msgr2=0x7f04ac06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.246+0000 7f04b4310640 1 -- 172.21.15.5:0/2019023609 shutdown_connections 2024-04-25T08:57:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.246+0000 7f04b4310640 1 -- 172.21.15.5:0/2019023609 wait complete. 2024-04-25T08:57:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.247+0000 7f04b4310640 1 Processor -- start 2024-04-25T08:57:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.247+0000 7f04b4310640 1 -- start start 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b4310640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b4310640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b7130 0x7f04ac0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b4310640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b4310640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0cf080 con 0x7f04ac0b7130 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b4310640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0cef00 con 0x7f04ac0b2cc0 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b4310640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0cf200 con 0x7f04ac15de70 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b7130 0x7f04ac0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b7130 0x7f04ac0c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52822/0 (socket says 172.21.15.5:52822) 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 -- 172.21.15.5:0/2333483972 learned_addr learned my addr 172.21.15.5:0/2333483972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b20ac640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b28ad640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 -- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 msgr2=0x7f04ac154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 -- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac0b2cc0 msgr2=0x7f04ac0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 -- 172.21.15.5:0/2333483972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0b4890 con 0x7f04ac0b7130 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04b18ab640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b7130 0x7f04ac0c9f80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f049c00e9b0 tx=0x7f049c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04a2ffd640 1 -- 172.21.15.5:0/2333483972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c017070 con 0x7f04ac0b7130 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.248+0000 7f04a2ffd640 1 -- 172.21.15.5:0/2333483972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c00c9a0 con 0x7f04ac0b7130 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.249+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac0b3ad0 con 0x7f04ac0b7130 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.249+0000 7f04a2ffd640 1 -- 172.21.15.5:0/2333483972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00cd90 con 0x7f04ac0b7130 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.249+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac0b4090 con 0x7f04ac0b7130 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.249+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac04ef20 con 0x7f04ac0b7130 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.250+0000 7f04a2ffd640 1 -- 172.21.15.5:0/2333483972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f049c01a070 con 0x7f04ac0b7130 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.250+0000 7f04a2ffd640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.250+0000 7f04a2ffd640 1 -- 172.21.15.5:0/2333483972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f049c08a1b0 con 0x7f04ac0b7130 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.251+0000 7f04b20ac640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.251+0000 7f04b20ac640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04a8034000 tx=0x7f04a802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.255+0000 7f04a2ffd640 1 -- 172.21.15.5:0/2333483972 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04ac0b4890 con 0x7f04ac0b7130 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.506+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f04ac160cb0 con 0x7f04ac0b7130 2024-04-25T08:57:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.506+0000 7f04a2ffd640 1 -- 172.21.15.5:0/2333483972 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1656 (secure 0 0 0) 0x7f049c058950 con 0x7f04ac0b7130 2024-04-25T08:57:37.496 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:37.496 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":77,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":69},{"state_name":"creating+peering","count":27},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242003968,"bytes_avail":772852109312,"bytes_total":773094113280,"unknown_pgs_ratio":0.71134018898010254,"inactive_pgs_ratio":0.27835050225257874},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5112}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-25T08:57:32.397683+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:57:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 msgr2=0x7f049006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04a8034000 tx=0x7f04a802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b7130 msgr2=0x7f04ac0c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b7130 0x7f04ac0c9f80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f049c00e9b0 tx=0x7f049c00ee70 comp rx=0 tx=0).stop 2024-04-25T08:57:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 shutdown_connections 2024-04-25T08:57:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac15de70 0x7f04ac154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b7130 0x7f04ac0c9f80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 --2- 172.21.15.5:0/2333483972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 >> 172.21.15.5:0/2333483972 conn(0x7f04ac06b000 msgr2=0x7f04ac15a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 shutdown_connections 2024-04-25T08:57:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.508+0000 7f04b4310640 1 -- 172.21.15.5:0/2333483972 wait complete. 2024-04-25T08:57:37.510 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:57:37.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:37.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.621+0000 7fb906f53640 1 Processor -- start 2024-04-25T08:57:37.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.621+0000 7fb906f53640 1 -- start start 2024-04-25T08:57:37.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb906f53640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb90015de70 0x7fb9000b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb906f53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb906f53640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9000d20e0 con 0x7fb9000b7130 2024-04-25T08:57:37.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb906f53640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9000d2a10 con 0x7fb90015de70 2024-04-25T08:57:37.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb906f53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000d23c0 con 0x7fb9000b2cc0 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb904cef640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb90015de70 0x7fb9000b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb904cef640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb90015de70 0x7fb9000b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52838/0 (socket says 172.21.15.5:52838) 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb904cef640 1 -- 172.21.15.5:0/558999712 learned_addr learned my addr 172.21.15.5:0/558999712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb8fffff640 1 --2- 172.21.15.5:0/558999712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb904cef640 1 -- 172.21.15.5:0/558999712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 msgr2=0x7fb9000b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb904cef640 1 --2- 172.21.15.5:0/558999712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb904cef640 1 -- 172.21.15.5:0/558999712 >> v1:172.21.15.80:6789/0 conn(0x7fb9000b7130 legacy=0x7fb9000ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.622+0000 7fb904cef640 1 -- 172.21.15.5:0/558999712 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000d26a0 con 0x7fb90015de70 2024-04-25T08:57:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.623+0000 7fb904cef640 1 --2- 172.21.15.5:0/558999712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb9000b93e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009870 tx=0x7fb8f002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed02e83e7fb2e2d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.623+0000 7fb8ff7fe640 1 -- 172.21.15.5:0/558999712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0037070 con 0x7fb90015de70 2024-04-25T08:57:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.623+0000 7fb8ff7fe640 1 -- 172.21.15.5:0/558999712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0032440 con 0x7fb90015de70 2024-04-25T08:57:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.623+0000 7fb8ff7fe640 1 -- 172.21.15.5:0/558999712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0032810 con 0x7fb90015de70 2024-04-25T08:57:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 -- 172.21.15.5:0/558999712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 msgr2=0x7fb9000b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 --2- 172.21.15.5:0/558999712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb9000b93e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009870 tx=0x7fb8f002a210 comp rx=0 tx=0).stop 2024-04-25T08:57:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 -- 172.21.15.5:0/558999712 shutdown_connections 2024-04-25T08:57:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 --2- 172.21.15.5:0/558999712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 --2- 172.21.15.5:0/558999712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb9000b93e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 -- 172.21.15.5:0/558999712 >> 172.21.15.5:0/558999712 conn(0x7fb90006b000 msgr2=0x7fb90006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 -- 172.21.15.5:0/558999712 shutdown_connections 2024-04-25T08:57:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.624+0000 7fb906f53640 1 -- 172.21.15.5:0/558999712 wait complete. 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.625+0000 7fb906f53640 1 Processor -- start 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.625+0000 7fb906f53640 1 -- start start 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb906f53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb906f53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9000b7130 0x7fb90014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb906f53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb90014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb906f53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000cf080 con 0x7fb90015de70 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb906f53640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000cef00 con 0x7fb9000b7130 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb906f53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000cf200 con 0x7fb9000b2cc0 2024-04-25T08:57:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb90014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb90014c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52844/0 (socket says 172.21.15.5:52844) 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 -- 172.21.15.5:0/2107712548 learned_addr learned my addr 172.21.15.5:0/2107712548 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb8fffff640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9000b7130 0x7fb90014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb904cef640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 -- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 msgr2=0x7fb9000c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 -- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9000b7130 msgr2=0x7fb90014c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9000b7130 0x7fb90014c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb9054f0640 1 -- 172.21.15.5:0/2107712548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9001e6710 con 0x7fb90015de70 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb904cef640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.626+0000 7fb8fffff640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9000b7130 0x7fb90014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.627+0000 7fb9054f0640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb90014c630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800c780 tx=0x7fb8f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.627+0000 7fb8fd7fa640 1 -- 172.21.15.5:0/2107712548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8004b60 con 0x7fb90015de70 2024-04-25T08:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.627+0000 7fb8fd7fa640 1 -- 172.21.15.5:0/2107712548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f8004d00 con 0x7fb90015de70 2024-04-25T08:57:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.627+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9000c7600 con 0x7fb90015de70 2024-04-25T08:57:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.627+0000 7fb8fd7fa640 1 -- 172.21.15.5:0/2107712548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800aa90 con 0x7fb90015de70 2024-04-25T08:57:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.627+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90014a1d0 con 0x7fb90015de70 2024-04-25T08:57:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.628+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90015f070 con 0x7fb90015de70 2024-04-25T08:57:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.628+0000 7fb8fd7fa640 1 -- 172.21.15.5:0/2107712548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8f800ac30 con 0x7fb90015de70 2024-04-25T08:57:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.629+0000 7fb8fd7fa640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8e006b4d0 0x7fb8e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.629+0000 7fb8fd7fa640 1 -- 172.21.15.5:0/2107712548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8f808a770 con 0x7fb90015de70 2024-04-25T08:57:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.629+0000 7fb904cef640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8e006b4d0 0x7fb8e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.630+0000 7fb904cef640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8e006b4d0 0x7fb8e006d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0034000 tx=0x7fb8f002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.633+0000 7fb8fd7fa640 1 -- 172.21.15.5:0/2107712548 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb90015f070 con 0x7fb90015de70 2024-04-25T08:57:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.810+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb90014a3d0 con 0x7fb8e006b4d0 2024-04-25T08:57:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.817+0000 7fb8fd7fa640 1 -- 172.21.15.5:0/2107712548 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239456 (secure 0 0 0) 0x7fb90014a3d0 con 0x7fb8e006b4d0 2024-04-25T08:57:37.808 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8e006b4d0 msgr2=0x7fb8e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8e006b4d0 0x7fb8e006d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0034000 tx=0x7fb8f002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 msgr2=0x7fb90014c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb90014c630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800c780 tx=0x7fb8f800cc40 comp rx=0 tx=0).stop 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 shutdown_connections 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8e006b4d0 0x7fb8e006d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb90015de70 0x7fb90014c630 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9000b7130 0x7fb90014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 --2- 172.21.15.5:0/2107712548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9000b2cc0 0x7fb9000c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 >> 172.21.15.5:0/2107712548 conn(0x7fb90006b000 msgr2=0x7fb9000b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 shutdown_connections 2024-04-25T08:57:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:37.819+0000 7fb906f53640 1 -- 172.21.15.5:0/2107712548 wait complete. 2024-04-25T08:57:37.821 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-04-25T08:57:36.398541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236332,"kb_used_data":3508,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738388,"statfs":{"total":773094113280,"available":772852109312,"internally_reserved":0,"allocated":3592192,"data_stored":2060881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.013585"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390159+0000","last_change":"2024-04-25T08:57:31.390159+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390159+0000","last_undegraded":"2024-04-25T08:57:31.390159+0000","last_fullsized":"2024-04-25T08:57:31.390159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389781+0000","last_change":"2024-04-25T08:57:31.389781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389781+0000","last_undegraded":"2024-04-25T08:57:31.389781+0000","last_fullsized":"2024-04-25T08:57:31.389781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387559+0000","last_change":"2024-04-25T08:57:31.387559+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387559+0000","last_undegraded":"2024-04-25T08:57:31.387559+0000","last_fullsized":"2024-04-25T08:57:31.387559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387541+0000","last_change":"2024-04-25T08:57:31.387541+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387541+0000","last_undegraded":"2024-04-25T08:57:31.387541+0000","last_fullsized":"2024-04-25T08:57:31.387541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386951+0000","last_change":"2024-04-25T08:57:31.386951+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386951+0000","last_undegraded":"2024-04-25T08:57:31.386951+0000","last_fullsized":"2024-04-25T08:57:31.386951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390648+0000","last_change":"2024-04-25T08:57:31.390648+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390648+0000","last_undegraded":"2024-04-25T08:57:31.390648+0000","last_fullsized":"2024-04-25T08:57:31.390648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387099+0000","last_change":"2024-04-25T08:57:31.387099+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387099+0000","last_undegraded":"2024-04-25T08:57:31.387099+0000","last_fullsized":"2024-04-25T08:57:31.387099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389871+0000","last_change":"2024-04-25T08:57:31.389871+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389871+0000","last_undegraded":"2024-04-25T08:57:31.389871+0000","last_fullsized":"2024-04-25T08:57:31.389871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388584+0000","last_change":"2024-04-25T08:57:31.388584+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388584+0000","last_undegraded":"2024-04-25T08:57:31.388584+0000","last_fullsized":"2024-04-25T08:57:31.388584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390599+0000","last_change":"2024-04-25T08:57:31.390599+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390599+0000","last_undegraded":"2024-04-25T08:57:31.390599+0000","last_fullsized":"2024-04-25T08:57:31.390599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386802+0000","last_change":"2024-04-25T08:57:31.386802+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386802+0000","last_undegraded":"2024-04-25T08:57:31.386802+0000","last_fullsized":"2024-04-25T08:57:31.386802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389808+0000","last_change":"2024-04-25T08:57:31.389808+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389808+0000","last_undegraded":"2024-04-25T08:57:31.389808+0000","last_fullsized":"2024-04-25T08:57:31.389808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390266+0000","last_change":"2024-04-25T08:57:31.390266+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390266+0000","last_undegraded":"2024-04-25T08:57:31.390266+0000","last_fullsized":"2024-04-25T08:57:31.390266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389819+0000","last_change":"2024-04-25T08:57:31.389819+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389819+0000","last_undegraded":"2024-04-25T08:57:31.389819+0000","last_fullsized":"2024-04-25T08:57:31.389819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386790+0000","last_change":"2024-04-25T08:57:31.386790+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386790+0000","last_undegraded":"2024-04-25T08:57:31.386790+0000","last_fullsized":"2024-04-25T08:57:31.386790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387252+0000","last_change":"2024-04-25T08:57:31.387252+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387252+0000","last_undegraded":"2024-04-25T08:57:31.387252+0000","last_fullsized":"2024-04-25T08:57:31.387252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387441+0000","last_change":"2024-04-25T08:57:31.387441+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387441+0000","last_undegraded":"2024-04-25T08:57:31.387441+0000","last_fullsized":"2024-04-25T08:57:31.387441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.390167+0000","last_change":"2024-04-25T08:57:31.390167+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.390167+0000","last_undegraded":"2024-04-25T08:57:31.390167+0000","last_fullsized":"2024-04-25T08:57:31.390167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.387342+0000","last_change":"2024-04-25T08:57:31.387342+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.387342+0000","last_undegraded":"2024-04-25T08:57:31.387342+0000","last_fullsized":"2024-04-25T08:57:31.387342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.388140+0000","last_change":"2024-04-25T08:57:31.388140+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.388140+0000","last_undegraded":"2024-04-25T08:57:31.388140+0000","last_fullsized":"2024-04-25T08:57:31.388140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389392+0000","last_change":"2024-04-25T08:57:31.389392+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389392+0000","last_undegraded":"2024-04-25T08:57:31.389392+0000","last_fullsized":"2024-04-25T08:57:31.389392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389396+0000","last_change":"2024-04-25T08:57:31.389396+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389396+0000","last_undegraded":"2024-04-25T08:57:31.389396+0000","last_fullsized":"2024-04-25T08:57:31.389396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:31.380516+0000","last_change":"2024-04-25T08:57:31.380516+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.380516+0000","last_undegraded":"2024-04-25T08:57:31.380516+0000","last_fullsized":"2024-04-25T08:57:31.380516+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389377+0000","last_change":"2024-04-25T08:57:31.389377+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389377+0000","last_undegraded":"2024-04-25T08:57:31.389377+0000","last_fullsized":"2024-04-25T08:57:31.389377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.386781+0000","last_change":"2024-04-25T08:57:31.386781+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.386781+0000","last_undegraded":"2024-04-25T08:57:31.386781+0000","last_fullsized":"2024-04-25T08:57:31.386781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389709+0000","last_change":"2024-04-25T08:57:31.389709+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389709+0000","last_undegraded":"2024-04-25T08:57:31.389709+0000","last_fullsized":"2024-04-25T08:57:31.389709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:57:32.384244+0000","last_change":"2024-04-25T08:57:32.384244+0000","last_active":"2024-04-25T08:57:32.384244+0000","last_peered":"2024-04-25T08:57:32.384244+0000","last_clean":"2024-04-25T08:57:32.384244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:32.384244+0000","last_undegraded":"2024-04-25T08:57:32.384244+0000","last_fullsized":"2024-04-25T08:57:32.384244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-25T08:57:31.389969+0000","last_change":"2024-04-25T08:57:31.389969+0000","last_active":"2024-04-25T08:57:31.380516+0000","last_peered":"2024-04-25T08:57:31.380516+0000","last_clean":"2024-04-25T08:57:31.380516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:31.389969+0000","last_undegraded":"2024-04-25T08:57:31.389969+0000","last_fullsized":"2024-04-25T08:57:31.389969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T08:57:31.392128+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:57:31.392128+0000","last_peered":"2024-04-25T08:57:31.392128+0000","last_clean":"2024-04-25T08:57:31.392128+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:57:31.392128+0000","last_undegraded":"2024-04-25T08:57:31.392128+0000","last_fullsized":"2024-04-25T08:57:31.392128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":109291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":699659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:38.368 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-04-25T08:57:38.378+0000 7ffbb0159640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:57:40.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.951+0000 7f7c26b61640 1 Processor -- start 2024-04-25T08:57:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.951+0000 7f7c26b61640 1 -- start start 2024-04-25T08:57:40.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.951+0000 7f7c26b61640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c20154f10 0x7f7c200b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.951+0000 7f7c26b61640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c2015bbd0 0x7f7c200cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c26b61640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c200b39b0 0x7f7c200cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c26b61640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200b3f30 con 0x7f7c2015bbd0 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c26b61640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2015b0f0 con 0x7f7c20154f10 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c26b61640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2015b3d0 con 0x7f7c200b39b0 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c2015bbd0 0x7f7c200cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c2015bbd0 0x7f7c200cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50286/0 (socket says 172.21.15.5:50286) 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 -- 172.21.15.5:0/698999417 learned_addr learned my addr 172.21.15.5:0/698999417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c250fe640 1 --2- 172.21.15.5:0/698999417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c200b39b0 0x7f7c200cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c248fd640 1 --2- 172.21.15.5:0/698999417 >> v2:172.21.15.80:3300/0 conn(0x7f7c20154f10 0x7f7c200b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 -- 172.21.15.5:0/698999417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c200b39b0 msgr2=0x7f7c200cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 --2- 172.21.15.5:0/698999417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c200b39b0 0x7f7c200cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 -- 172.21.15.5:0/698999417 >> v2:172.21.15.80:3300/0 conn(0x7f7c20154f10 msgr2=0x7f7c200b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 --2- 172.21.15.5:0/698999417 >> v2:172.21.15.80:3300/0 conn(0x7f7c20154f10 0x7f7c200b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c1ffff640 1 -- 172.21.15.5:0/698999417 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c201552f0 con 0x7f7c2015bbd0 2024-04-25T08:57:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.952+0000 7f7c248fd640 1 --2- 172.21.15.5:0/698999417 >> v2:172.21.15.80:3300/0 conn(0x7f7c20154f10 0x7f7c200b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.953+0000 7f7c1ffff640 1 --2- 172.21.15.5:0/698999417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c2015bbd0 0x7f7c200cf580 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7c200b2610 tx=0x7f7c0c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6158181337ca5a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.953+0000 7f7c1f7fe640 1 -- 172.21.15.5:0/698999417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c037070 con 0x7f7c2015bbd0 2024-04-25T08:57:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.953+0000 7f7c1f7fe640 1 -- 172.21.15.5:0/698999417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c032440 con 0x7f7c2015bbd0 2024-04-25T08:57:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.953+0000 7f7c1f7fe640 1 -- 172.21.15.5:0/698999417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c032810 con 0x7f7c2015bbd0 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 -- 172.21.15.5:0/698999417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c2015bbd0 msgr2=0x7f7c200cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 --2- 172.21.15.5:0/698999417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c2015bbd0 0x7f7c200cf580 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7c200b2610 tx=0x7f7c0c02a140 comp rx=0 tx=0).stop 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 -- 172.21.15.5:0/698999417 shutdown_connections 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 --2- 172.21.15.5:0/698999417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c200b39b0 0x7f7c200cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 --2- 172.21.15.5:0/698999417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c2015bbd0 0x7f7c200cf580 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 --2- 172.21.15.5:0/698999417 >> v2:172.21.15.80:3300/0 conn(0x7f7c20154f10 0x7f7c200b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 -- 172.21.15.5:0/698999417 >> 172.21.15.5:0/698999417 conn(0x7f7c200668f0 msgr2=0x7f7c20066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 -- 172.21.15.5:0/698999417 shutdown_connections 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.954+0000 7f7c26b61640 1 -- 172.21.15.5:0/698999417 wait complete. 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.955+0000 7f7c26b61640 1 Processor -- start 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.955+0000 7f7c26b61640 1 -- start start 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c26b61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c200b39b0 0x7f7c20147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c26b61640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c20154f10 0x7f7c2013ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c26b61640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c2015bbd0 0x7f7c201420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c26b61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200710d0 con 0x7f7c200b39b0 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c26b61640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20070f50 con 0x7f7c2015bbd0 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c26b61640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20071250 con 0x7f7c20154f10 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c200b39b0 0x7f7c20147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c200b39b0 0x7f7c20147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50292/0 (socket says 172.21.15.5:50292) 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 -- 172.21.15.5:0/826280504 learned_addr learned my addr 172.21.15.5:0/826280504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c1ffff640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c20154f10 0x7f7c2013ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c250fe640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c2015bbd0 0x7f7c201420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 -- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c20154f10 msgr2=0x7f7c2013ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c20154f10 0x7f7c2013ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 -- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c2015bbd0 msgr2=0x7f7c201420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c2015bbd0 0x7f7c201420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c248fd640 1 -- 172.21.15.5:0/826280504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c201429b0 con 0x7f7c200b39b0 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.956+0000 7f7c250fe640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c2015bbd0 0x7f7c201420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.957+0000 7f7c248fd640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c200b39b0 0x7f7c20147b70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c7f0 tx=0x7f7c1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.957+0000 7f7c1d7fa640 1 -- 172.21.15.5:0/826280504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14015070 con 0x7f7c200b39b0 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.957+0000 7f7c1d7fa640 1 -- 172.21.15.5:0/826280504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14007a30 con 0x7f7c200b39b0 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.957+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20142c90 con 0x7f7c200b39b0 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.957+0000 7f7c1d7fa640 1 -- 172.21.15.5:0/826280504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14007e00 con 0x7f7c200b39b0 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.957+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c20143250 con 0x7f7c200b39b0 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.958+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2004ef20 con 0x7f7c200b39b0 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.958+0000 7f7c1d7fa640 1 -- 172.21.15.5:0/826280504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c14018070 con 0x7f7c200b39b0 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.959+0000 7f7c1d7fa640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c0406b4d0 0x7f7c0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.959+0000 7f7c1d7fa640 1 -- 172.21.15.5:0/826280504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c1408a170 con 0x7f7c200b39b0 2024-04-25T08:57:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.959+0000 7f7c1ffff640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c0406b4d0 0x7f7c0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.960+0000 7f7c1ffff640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c0406b4d0 0x7f7c0406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c034000 tx=0x7f7c0c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:40.963+0000 7f7c1d7fa640 1 -- 172.21.15.5:0/826280504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c14058ff0 con 0x7f7c200b39b0 2024-04-25T08:57:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.141+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c20070d30 con 0x7f7c0406b4d0 2024-04-25T08:57:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.147+0000 7f7c1d7fa640 1 -- 172.21.15.5:0/826280504 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251949 (secure 0 0 0) 0x7f7c20070d30 con 0x7f7c0406b4d0 2024-04-25T08:57:41.140 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:41.141 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c0406b4d0 msgr2=0x7f7c0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c0406b4d0 0x7f7c0406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c034000 tx=0x7f7c0c02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c200b39b0 msgr2=0x7f7c20147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c200b39b0 0x7f7c20147b70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c7f0 tx=0x7f7c1400cbf0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 shutdown_connections 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c0406b4d0 0x7f7c0406d990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c2015bbd0 0x7f7c201420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c20154f10 0x7f7c2013ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 --2- 172.21.15.5:0/826280504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c200b39b0 0x7f7c20147b70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 >> 172.21.15.5:0/826280504 conn(0x7f7c200668f0 msgr2=0x7f7c2006c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 shutdown_connections 2024-04-25T08:57:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.150+0000 7f7c26b61640 1 -- 172.21.15.5:0/826280504 wait complete. 2024-04-25T08:57:41.151 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T08:57:40.399528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236776,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737944,"statfs":{"total":773094113280,"available":772851654656,"internally_reserved":0,"allocated":4038656,"data_stored":2261156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001905"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407871+0000","last_change":"2024-04-25T08:57:33.410639+0000","last_active":"2024-04-25T08:57:35.407871+0000","last_peered":"2024-04-25T08:57:35.407871+0000","last_clean":"2024-04-25T08:57:35.407871+0000","last_became_active":"2024-04-25T08:57:33.410384+0000","last_became_peered":"2024-04-25T08:57:33.410384+0000","last_unstale":"2024-04-25T08:57:35.407871+0000","last_undegraded":"2024-04-25T08:57:35.407871+0000","last_fullsized":"2024-04-25T08:57:35.407871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:39.038212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407908+0000","last_change":"2024-04-25T08:57:33.426274+0000","last_active":"2024-04-25T08:57:35.407908+0000","last_peered":"2024-04-25T08:57:35.407908+0000","last_clean":"2024-04-25T08:57:35.407908+0000","last_became_active":"2024-04-25T08:57:33.426041+0000","last_became_peered":"2024-04-25T08:57:33.426041+0000","last_unstale":"2024-04-25T08:57:35.407908+0000","last_undegraded":"2024-04-25T08:57:35.407908+0000","last_fullsized":"2024-04-25T08:57:35.407908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:40.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412700+0000","last_change":"2024-04-25T08:57:33.418992+0000","last_active":"2024-04-25T08:57:34.412700+0000","last_peered":"2024-04-25T08:57:34.412700+0000","last_clean":"2024-04-25T08:57:34.412700+0000","last_became_active":"2024-04-25T08:57:33.418350+0000","last_became_peered":"2024-04-25T08:57:33.418350+0000","last_unstale":"2024-04-25T08:57:34.412700+0000","last_undegraded":"2024-04-25T08:57:34.412700+0000","last_fullsized":"2024-04-25T08:57:34.412700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:02.870402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402057+0000","last_change":"2024-04-25T08:57:33.420585+0000","last_active":"2024-04-25T08:57:35.402057+0000","last_peered":"2024-04-25T08:57:35.402057+0000","last_clean":"2024-04-25T08:57:35.402057+0000","last_became_active":"2024-04-25T08:57:33.420329+0000","last_became_peered":"2024-04-25T08:57:33.420329+0000","last_unstale":"2024-04-25T08:57:35.402057+0000","last_undegraded":"2024-04-25T08:57:35.402057+0000","last_fullsized":"2024-04-25T08:57:35.402057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:24.642901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409673+0000","last_change":"2024-04-25T08:57:33.415762+0000","last_active":"2024-04-25T08:57:34.409673+0000","last_peered":"2024-04-25T08:57:34.409673+0000","last_clean":"2024-04-25T08:57:34.409673+0000","last_became_active":"2024-04-25T08:57:33.415457+0000","last_became_peered":"2024-04-25T08:57:33.415457+0000","last_unstale":"2024-04-25T08:57:34.409673+0000","last_undegraded":"2024-04-25T08:57:34.409673+0000","last_fullsized":"2024-04-25T08:57:34.409673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:29.919758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407430+0000","last_change":"2024-04-25T08:57:33.421490+0000","last_active":"2024-04-25T08:57:35.407430+0000","last_peered":"2024-04-25T08:57:35.407430+0000","last_clean":"2024-04-25T08:57:35.407430+0000","last_became_active":"2024-04-25T08:57:33.421222+0000","last_became_peered":"2024-04-25T08:57:33.421222+0000","last_unstale":"2024-04-25T08:57:35.407430+0000","last_undegraded":"2024-04-25T08:57:35.407430+0000","last_fullsized":"2024-04-25T08:57:35.407430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:20.297006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408350+0000","last_change":"2024-04-25T08:57:33.413641+0000","last_active":"2024-04-25T08:57:35.408350+0000","last_peered":"2024-04-25T08:57:35.408350+0000","last_clean":"2024-04-25T08:57:35.408350+0000","last_became_active":"2024-04-25T08:57:33.413345+0000","last_became_peered":"2024-04-25T08:57:33.413345+0000","last_unstale":"2024-04-25T08:57:35.408350+0000","last_undegraded":"2024-04-25T08:57:35.408350+0000","last_fullsized":"2024-04-25T08:57:35.408350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:02.870402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407787+0000","last_change":"2024-04-25T08:57:33.415330+0000","last_active":"2024-04-25T08:57:35.407787+0000","last_peered":"2024-04-25T08:57:35.407787+0000","last_clean":"2024-04-25T08:57:35.407787+0000","last_became_active":"2024-04-25T08:57:33.414890+0000","last_became_peered":"2024-04-25T08:57:33.414890+0000","last_unstale":"2024-04-25T08:57:35.407787+0000","last_undegraded":"2024-04-25T08:57:35.407787+0000","last_fullsized":"2024-04-25T08:57:35.407787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:35.927969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412086+0000","last_change":"2024-04-25T08:57:33.419153+0000","last_active":"2024-04-25T08:57:34.412086+0000","last_peered":"2024-04-25T08:57:34.412086+0000","last_clean":"2024-04-25T08:57:34.412086+0000","last_became_active":"2024-04-25T08:57:33.418855+0000","last_became_peered":"2024-04-25T08:57:33.418855+0000","last_unstale":"2024-04-25T08:57:34.412086+0000","last_undegraded":"2024-04-25T08:57:34.412086+0000","last_fullsized":"2024-04-25T08:57:34.412086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:12.553723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402348+0000","last_change":"2024-04-25T08:57:33.421194+0000","last_active":"2024-04-25T08:57:35.402348+0000","last_peered":"2024-04-25T08:57:35.402348+0000","last_clean":"2024-04-25T08:57:35.402348+0000","last_became_active":"2024-04-25T08:57:33.420906+0000","last_became_peered":"2024-04-25T08:57:33.420906+0000","last_unstale":"2024-04-25T08:57:35.402348+0000","last_undegraded":"2024-04-25T08:57:35.402348+0000","last_fullsized":"2024-04-25T08:57:35.402348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:17.854863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408492+0000","last_change":"2024-04-25T08:57:33.421593+0000","last_active":"2024-04-25T08:57:35.408492+0000","last_peered":"2024-04-25T08:57:35.408492+0000","last_clean":"2024-04-25T08:57:35.408492+0000","last_became_active":"2024-04-25T08:57:33.420653+0000","last_became_peered":"2024-04-25T08:57:33.420653+0000","last_unstale":"2024-04-25T08:57:35.408492+0000","last_undegraded":"2024-04-25T08:57:35.408492+0000","last_fullsized":"2024-04-25T08:57:35.408492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:43.622144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412631+0000","last_change":"2024-04-25T08:57:33.417218+0000","last_active":"2024-04-25T08:57:34.412631+0000","last_peered":"2024-04-25T08:57:34.412631+0000","last_clean":"2024-04-25T08:57:34.412631+0000","last_became_active":"2024-04-25T08:57:33.416895+0000","last_became_peered":"2024-04-25T08:57:33.416895+0000","last_unstale":"2024-04-25T08:57:34.412631+0000","last_undegraded":"2024-04-25T08:57:34.412631+0000","last_fullsized":"2024-04-25T08:57:34.412631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:53.234804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409686+0000","last_change":"2024-04-25T08:57:33.418138+0000","last_active":"2024-04-25T08:57:34.409686+0000","last_peered":"2024-04-25T08:57:34.409686+0000","last_clean":"2024-04-25T08:57:34.409686+0000","last_became_active":"2024-04-25T08:57:33.417865+0000","last_became_peered":"2024-04-25T08:57:33.417865+0000","last_unstale":"2024-04-25T08:57:34.409686+0000","last_undegraded":"2024-04-25T08:57:34.409686+0000","last_fullsized":"2024-04-25T08:57:34.409686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:32.240933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407402+0000","last_change":"2024-04-25T08:57:33.417939+0000","last_active":"2024-04-25T08:57:35.407402+0000","last_peered":"2024-04-25T08:57:35.407402+0000","last_clean":"2024-04-25T08:57:35.407402+0000","last_became_active":"2024-04-25T08:57:33.416614+0000","last_became_peered":"2024-04-25T08:57:33.416614+0000","last_unstale":"2024-04-25T08:57:35.407402+0000","last_undegraded":"2024-04-25T08:57:35.407402+0000","last_fullsized":"2024-04-25T08:57:35.407402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:18.580390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412418+0000","last_change":"2024-04-25T08:57:33.410207+0000","last_active":"2024-04-25T08:57:34.412418+0000","last_peered":"2024-04-25T08:57:34.412418+0000","last_clean":"2024-04-25T08:57:34.412418+0000","last_became_active":"2024-04-25T08:57:33.409921+0000","last_became_peered":"2024-04-25T08:57:33.409921+0000","last_unstale":"2024-04-25T08:57:34.412418+0000","last_undegraded":"2024-04-25T08:57:34.412418+0000","last_fullsized":"2024-04-25T08:57:34.412418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:18.580390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408257+0000","last_change":"2024-04-25T08:57:33.423002+0000","last_active":"2024-04-25T08:57:35.408257+0000","last_peered":"2024-04-25T08:57:35.408257+0000","last_clean":"2024-04-25T08:57:35.408257+0000","last_became_active":"2024-04-25T08:57:33.422736+0000","last_became_peered":"2024-04-25T08:57:33.422736+0000","last_unstale":"2024-04-25T08:57:35.408257+0000","last_undegraded":"2024-04-25T08:57:35.408257+0000","last_fullsized":"2024-04-25T08:57:35.408257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:35.823654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408190+0000","last_change":"2024-04-25T08:57:33.417098+0000","last_active":"2024-04-25T08:57:35.408190+0000","last_peered":"2024-04-25T08:57:35.408190+0000","last_clean":"2024-04-25T08:57:35.408190+0000","last_became_active":"2024-04-25T08:57:33.416731+0000","last_became_peered":"2024-04-25T08:57:33.416731+0000","last_unstale":"2024-04-25T08:57:35.408190+0000","last_undegraded":"2024-04-25T08:57:35.408190+0000","last_fullsized":"2024-04-25T08:57:35.408190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:53.234804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407969+0000","last_change":"2024-04-25T08:57:33.429083+0000","last_active":"2024-04-25T08:57:35.407969+0000","last_peered":"2024-04-25T08:57:35.407969+0000","last_clean":"2024-04-25T08:57:35.407969+0000","last_became_active":"2024-04-25T08:57:33.428693+0000","last_became_peered":"2024-04-25T08:57:33.428693+0000","last_unstale":"2024-04-25T08:57:35.407969+0000","last_undegraded":"2024-04-25T08:57:35.407969+0000","last_fullsized":"2024-04-25T08:57:35.407969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:02.870402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407705+0000","last_change":"2024-04-25T08:57:33.421220+0000","last_active":"2024-04-25T08:57:35.407705+0000","last_peered":"2024-04-25T08:57:35.407705+0000","last_clean":"2024-04-25T08:57:35.407705+0000","last_became_active":"2024-04-25T08:57:33.420906+0000","last_became_peered":"2024-04-25T08:57:33.420906+0000","last_unstale":"2024-04-25T08:57:35.407705+0000","last_undegraded":"2024-04-25T08:57:35.407705+0000","last_fullsized":"2024-04-25T08:57:35.407705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:35.823654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409702+0000","last_change":"2024-04-25T08:57:33.402980+0000","last_active":"2024-04-25T08:57:34.409702+0000","last_peered":"2024-04-25T08:57:34.409702+0000","last_clean":"2024-04-25T08:57:34.409702+0000","last_became_active":"2024-04-25T08:57:33.402636+0000","last_became_peered":"2024-04-25T08:57:33.402636+0000","last_unstale":"2024-04-25T08:57:34.409702+0000","last_undegraded":"2024-04-25T08:57:34.409702+0000","last_fullsized":"2024-04-25T08:57:34.409702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:49.627508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411331+0000","last_change":"2024-04-25T08:57:33.420273+0000","last_active":"2024-04-25T08:57:34.411331+0000","last_peered":"2024-04-25T08:57:34.411331+0000","last_clean":"2024-04-25T08:57:34.411331+0000","last_became_active":"2024-04-25T08:57:33.419985+0000","last_became_peered":"2024-04-25T08:57:33.419985+0000","last_unstale":"2024-04-25T08:57:34.411331+0000","last_undegraded":"2024-04-25T08:57:34.411331+0000","last_fullsized":"2024-04-25T08:57:34.411331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:24.642901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411377+0000","last_change":"2024-04-25T08:57:33.415085+0000","last_active":"2024-04-25T08:57:34.411377+0000","last_peered":"2024-04-25T08:57:34.411377+0000","last_clean":"2024-04-25T08:57:34.411377+0000","last_became_active":"2024-04-25T08:57:33.414814+0000","last_became_peered":"2024-04-25T08:57:33.414814+0000","last_unstale":"2024-04-25T08:57:34.411377+0000","last_undegraded":"2024-04-25T08:57:34.411377+0000","last_fullsized":"2024-04-25T08:57:34.411377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:18.159367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906491+0000","last_change":"2024-04-25T08:57:33.425216+0000","last_active":"2024-04-25T08:57:34.906491+0000","last_peered":"2024-04-25T08:57:34.906491+0000","last_clean":"2024-04-25T08:57:34.906491+0000","last_became_active":"2024-04-25T08:57:33.424943+0000","last_became_peered":"2024-04-25T08:57:33.424943+0000","last_unstale":"2024-04-25T08:57:34.906491+0000","last_undegraded":"2024-04-25T08:57:34.906491+0000","last_fullsized":"2024-04-25T08:57:34.906491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:11.021127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412006+0000","last_change":"2024-04-25T08:57:33.404069+0000","last_active":"2024-04-25T08:57:34.412006+0000","last_peered":"2024-04-25T08:57:34.412006+0000","last_clean":"2024-04-25T08:57:34.412006+0000","last_became_active":"2024-04-25T08:57:33.402557+0000","last_became_peered":"2024-04-25T08:57:33.402557+0000","last_unstale":"2024-04-25T08:57:34.412006+0000","last_undegraded":"2024-04-25T08:57:34.412006+0000","last_fullsized":"2024-04-25T08:57:34.412006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:55.699310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402438+0000","last_change":"2024-04-25T08:57:33.417784+0000","last_active":"2024-04-25T08:57:35.402438+0000","last_peered":"2024-04-25T08:57:35.402438+0000","last_clean":"2024-04-25T08:57:35.402438+0000","last_became_active":"2024-04-25T08:57:33.417492+0000","last_became_peered":"2024-04-25T08:57:33.417492+0000","last_unstale":"2024-04-25T08:57:35.402438+0000","last_undegraded":"2024-04-25T08:57:35.402438+0000","last_fullsized":"2024-04-25T08:57:35.402438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:12.793150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408035+0000","last_change":"2024-04-25T08:57:33.414985+0000","last_active":"2024-04-25T08:57:35.408035+0000","last_peered":"2024-04-25T08:57:35.408035+0000","last_clean":"2024-04-25T08:57:35.408035+0000","last_became_active":"2024-04-25T08:57:33.414711+0000","last_became_peered":"2024-04-25T08:57:33.414711+0000","last_unstale":"2024-04-25T08:57:35.408035+0000","last_undegraded":"2024-04-25T08:57:35.408035+0000","last_fullsized":"2024-04-25T08:57:35.408035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:43.622144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402564+0000","last_change":"2024-04-25T08:57:33.423449+0000","last_active":"2024-04-25T08:57:35.402564+0000","last_peered":"2024-04-25T08:57:35.402564+0000","last_clean":"2024-04-25T08:57:35.402564+0000","last_became_active":"2024-04-25T08:57:33.422541+0000","last_became_peered":"2024-04-25T08:57:33.422541+0000","last_unstale":"2024-04-25T08:57:35.402564+0000","last_undegraded":"2024-04-25T08:57:35.402564+0000","last_fullsized":"2024-04-25T08:57:35.402564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:14.648430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412673+0000","last_change":"2024-04-25T08:57:33.422197+0000","last_active":"2024-04-25T08:57:34.412673+0000","last_peered":"2024-04-25T08:57:34.412673+0000","last_clean":"2024-04-25T08:57:34.412673+0000","last_became_active":"2024-04-25T08:57:33.421907+0000","last_became_peered":"2024-04-25T08:57:33.421907+0000","last_unstale":"2024-04-25T08:57:34.412673+0000","last_undegraded":"2024-04-25T08:57:34.412673+0000","last_fullsized":"2024-04-25T08:57:34.412673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:35.823654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411482+0000","last_change":"2024-04-25T08:57:33.421246+0000","last_active":"2024-04-25T08:57:34.411482+0000","last_peered":"2024-04-25T08:57:34.411482+0000","last_clean":"2024-04-25T08:57:34.411482+0000","last_became_active":"2024-04-25T08:57:33.420839+0000","last_became_peered":"2024-04-25T08:57:33.420839+0000","last_unstale":"2024-04-25T08:57:34.411482+0000","last_undegraded":"2024-04-25T08:57:34.411482+0000","last_fullsized":"2024-04-25T08:57:34.411482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.258296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408021+0000","last_change":"2024-04-25T08:57:33.414319+0000","last_active":"2024-04-25T08:57:35.408021+0000","last_peered":"2024-04-25T08:57:35.408021+0000","last_clean":"2024-04-25T08:57:35.408021+0000","last_became_active":"2024-04-25T08:57:33.414020+0000","last_became_peered":"2024-04-25T08:57:33.414020+0000","last_unstale":"2024-04-25T08:57:35.408021+0000","last_undegraded":"2024-04-25T08:57:35.408021+0000","last_fullsized":"2024-04-25T08:57:35.408021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:20.297006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407831+0000","last_change":"2024-04-25T08:57:33.408734+0000","last_active":"2024-04-25T08:57:35.407831+0000","last_peered":"2024-04-25T08:57:35.407831+0000","last_clean":"2024-04-25T08:57:35.407831+0000","last_became_active":"2024-04-25T08:57:33.408415+0000","last_became_peered":"2024-04-25T08:57:33.408415+0000","last_unstale":"2024-04-25T08:57:35.407831+0000","last_undegraded":"2024-04-25T08:57:35.407831+0000","last_fullsized":"2024-04-25T08:57:35.407831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:43.559367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408095+0000","last_change":"2024-04-25T08:57:33.419023+0000","last_active":"2024-04-25T08:57:35.408095+0000","last_peered":"2024-04-25T08:57:35.408095+0000","last_clean":"2024-04-25T08:57:35.408095+0000","last_became_active":"2024-04-25T08:57:33.418099+0000","last_became_peered":"2024-04-25T08:57:33.418099+0000","last_unstale":"2024-04-25T08:57:35.408095+0000","last_undegraded":"2024-04-25T08:57:35.408095+0000","last_fullsized":"2024-04-25T08:57:35.408095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:18.580390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906630+0000","last_change":"2024-04-25T08:57:33.422219+0000","last_active":"2024-04-25T08:57:34.906630+0000","last_peered":"2024-04-25T08:57:34.906630+0000","last_clean":"2024-04-25T08:57:34.906630+0000","last_became_active":"2024-04-25T08:57:33.421900+0000","last_became_peered":"2024-04-25T08:57:33.421900+0000","last_unstale":"2024-04-25T08:57:34.906630+0000","last_undegraded":"2024-04-25T08:57:34.906630+0000","last_fullsized":"2024-04-25T08:57:34.906630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:39.038212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407927+0000","last_change":"2024-04-25T08:57:32.411102+0000","last_active":"2024-04-25T08:57:35.407927+0000","last_peered":"2024-04-25T08:57:35.407927+0000","last_clean":"2024-04-25T08:57:35.407927+0000","last_became_active":"2024-04-25T08:57:32.410851+0000","last_became_peered":"2024-04-25T08:57:32.410851+0000","last_unstale":"2024-04-25T08:57:35.407927+0000","last_undegraded":"2024-04-25T08:57:35.407927+0000","last_fullsized":"2024-04-25T08:57:35.407927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:14.097263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407868+0000","last_change":"2024-04-25T08:57:33.415649+0000","last_active":"2024-04-25T08:57:35.407868+0000","last_peered":"2024-04-25T08:57:35.407868+0000","last_clean":"2024-04-25T08:57:35.407868+0000","last_became_active":"2024-04-25T08:57:33.415351+0000","last_became_peered":"2024-04-25T08:57:33.415351+0000","last_unstale":"2024-04-25T08:57:35.407868+0000","last_undegraded":"2024-04-25T08:57:35.407868+0000","last_fullsized":"2024-04-25T08:57:35.407868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:42.513746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906674+0000","last_change":"2024-04-25T08:57:32.409282+0000","last_active":"2024-04-25T08:57:34.906674+0000","last_peered":"2024-04-25T08:57:34.906674+0000","last_clean":"2024-04-25T08:57:34.906674+0000","last_became_active":"2024-04-25T08:57:32.408912+0000","last_became_peered":"2024-04-25T08:57:32.408912+0000","last_unstale":"2024-04-25T08:57:34.906674+0000","last_undegraded":"2024-04-25T08:57:34.906674+0000","last_fullsized":"2024-04-25T08:57:34.906674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:48.623780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411879+0000","last_change":"2024-04-25T08:57:33.421639+0000","last_active":"2024-04-25T08:57:34.411879+0000","last_peered":"2024-04-25T08:57:34.411879+0000","last_clean":"2024-04-25T08:57:34.411879+0000","last_became_active":"2024-04-25T08:57:33.421341+0000","last_became_peered":"2024-04-25T08:57:33.421341+0000","last_unstale":"2024-04-25T08:57:34.411879+0000","last_undegraded":"2024-04-25T08:57:34.411879+0000","last_fullsized":"2024-04-25T08:57:34.411879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:12.793150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407563+0000","last_change":"2024-04-25T08:57:32.404294+0000","last_active":"2024-04-25T08:57:35.407563+0000","last_peered":"2024-04-25T08:57:35.407563+0000","last_clean":"2024-04-25T08:57:35.407563+0000","last_became_active":"2024-04-25T08:57:32.403994+0000","last_became_peered":"2024-04-25T08:57:32.403994+0000","last_unstale":"2024-04-25T08:57:35.407563+0000","last_undegraded":"2024-04-25T08:57:35.407563+0000","last_fullsized":"2024-04-25T08:57:35.407563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:38.983891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402545+0000","last_change":"2024-04-25T08:57:33.419801+0000","last_active":"2024-04-25T08:57:35.402545+0000","last_peered":"2024-04-25T08:57:35.402545+0000","last_clean":"2024-04-25T08:57:35.402545+0000","last_became_active":"2024-04-25T08:57:33.419033+0000","last_became_peered":"2024-04-25T08:57:33.419033+0000","last_unstale":"2024-04-25T08:57:35.402545+0000","last_undegraded":"2024-04-25T08:57:35.402545+0000","last_fullsized":"2024-04-25T08:57:35.402545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:12.553723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409876+0000","last_change":"2024-04-25T08:57:32.402367+0000","last_active":"2024-04-25T08:57:34.409876+0000","last_peered":"2024-04-25T08:57:34.409876+0000","last_clean":"2024-04-25T08:57:34.409876+0000","last_became_active":"2024-04-25T08:57:32.402079+0000","last_became_peered":"2024-04-25T08:57:32.402079+0000","last_unstale":"2024-04-25T08:57:34.409876+0000","last_undegraded":"2024-04-25T08:57:34.409876+0000","last_fullsized":"2024-04-25T08:57:34.409876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:26.014318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408321+0000","last_change":"2024-04-25T08:57:33.418798+0000","last_active":"2024-04-25T08:57:35.408321+0000","last_peered":"2024-04-25T08:57:35.408321+0000","last_clean":"2024-04-25T08:57:35.408321+0000","last_became_active":"2024-04-25T08:57:33.418540+0000","last_became_peered":"2024-04-25T08:57:33.418540+0000","last_unstale":"2024-04-25T08:57:35.408321+0000","last_undegraded":"2024-04-25T08:57:35.408321+0000","last_fullsized":"2024-04-25T08:57:35.408321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:40.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411536+0000","last_change":"2024-04-25T08:57:32.405069+0000","last_active":"2024-04-25T08:57:34.411536+0000","last_peered":"2024-04-25T08:57:34.411536+0000","last_clean":"2024-04-25T08:57:34.411536+0000","last_became_active":"2024-04-25T08:57:32.404678+0000","last_became_peered":"2024-04-25T08:57:32.404678+0000","last_unstale":"2024-04-25T08:57:34.411536+0000","last_undegraded":"2024-04-25T08:57:34.411536+0000","last_fullsized":"2024-04-25T08:57:34.411536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:39.179006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412398+0000","last_change":"2024-04-25T08:57:33.422314+0000","last_active":"2024-04-25T08:57:34.412398+0000","last_peered":"2024-04-25T08:57:34.412398+0000","last_clean":"2024-04-25T08:57:34.412398+0000","last_became_active":"2024-04-25T08:57:33.422021+0000","last_became_peered":"2024-04-25T08:57:33.422021+0000","last_unstale":"2024-04-25T08:57:34.412398+0000","last_undegraded":"2024-04-25T08:57:34.412398+0000","last_fullsized":"2024-04-25T08:57:34.412398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:20.297006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411438+0000","last_change":"2024-04-25T08:57:32.401534+0000","last_active":"2024-04-25T08:57:34.411438+0000","last_peered":"2024-04-25T08:57:34.411438+0000","last_clean":"2024-04-25T08:57:34.411438+0000","last_became_active":"2024-04-25T08:57:32.401111+0000","last_became_peered":"2024-04-25T08:57:32.401111+0000","last_unstale":"2024-04-25T08:57:34.411438+0000","last_undegraded":"2024-04-25T08:57:34.411438+0000","last_fullsized":"2024-04-25T08:57:34.411438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:31.237205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411193+0000","last_change":"2024-04-25T08:57:33.409484+0000","last_active":"2024-04-25T08:57:34.411193+0000","last_peered":"2024-04-25T08:57:34.411193+0000","last_clean":"2024-04-25T08:57:34.411193+0000","last_became_active":"2024-04-25T08:57:33.409219+0000","last_became_peered":"2024-04-25T08:57:33.409219+0000","last_unstale":"2024-04-25T08:57:34.411193+0000","last_undegraded":"2024-04-25T08:57:34.411193+0000","last_fullsized":"2024-04-25T08:57:34.411193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:58.093319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407156+0000","last_change":"2024-04-25T08:57:32.404453+0000","last_active":"2024-04-25T08:57:35.407156+0000","last_peered":"2024-04-25T08:57:35.407156+0000","last_clean":"2024-04-25T08:57:35.407156+0000","last_became_active":"2024-04-25T08:57:32.404133+0000","last_became_peered":"2024-04-25T08:57:32.404133+0000","last_unstale":"2024-04-25T08:57:35.407156+0000","last_undegraded":"2024-04-25T08:57:35.407156+0000","last_fullsized":"2024-04-25T08:57:35.407156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:42.555638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402020+0000","last_change":"2024-04-25T08:57:33.416641+0000","last_active":"2024-04-25T08:57:35.402020+0000","last_peered":"2024-04-25T08:57:35.402020+0000","last_clean":"2024-04-25T08:57:35.402020+0000","last_became_active":"2024-04-25T08:57:33.416338+0000","last_became_peered":"2024-04-25T08:57:33.416338+0000","last_unstale":"2024-04-25T08:57:35.402020+0000","last_undegraded":"2024-04-25T08:57:35.402020+0000","last_fullsized":"2024-04-25T08:57:35.402020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:58.093319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411050+0000","last_change":"2024-04-25T08:57:32.408635+0000","last_active":"2024-04-25T08:57:34.411050+0000","last_peered":"2024-04-25T08:57:34.411050+0000","last_clean":"2024-04-25T08:57:34.411050+0000","last_became_active":"2024-04-25T08:57:32.408346+0000","last_became_peered":"2024-04-25T08:57:32.408346+0000","last_unstale":"2024-04-25T08:57:34.411050+0000","last_undegraded":"2024-04-25T08:57:34.411050+0000","last_fullsized":"2024-04-25T08:57:34.411050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:23.546782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412753+0000","last_change":"2024-04-25T08:57:33.417536+0000","last_active":"2024-04-25T08:57:34.412753+0000","last_peered":"2024-04-25T08:57:34.412753+0000","last_clean":"2024-04-25T08:57:34.412753+0000","last_became_active":"2024-04-25T08:57:33.417159+0000","last_became_peered":"2024-04-25T08:57:33.417159+0000","last_unstale":"2024-04-25T08:57:34.412753+0000","last_undegraded":"2024-04-25T08:57:34.412753+0000","last_fullsized":"2024-04-25T08:57:34.412753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:40.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407904+0000","last_change":"2024-04-25T08:57:32.406795+0000","last_active":"2024-04-25T08:57:35.407904+0000","last_peered":"2024-04-25T08:57:35.407904+0000","last_clean":"2024-04-25T08:57:35.407904+0000","last_became_active":"2024-04-25T08:57:32.406498+0000","last_became_peered":"2024-04-25T08:57:32.406498+0000","last_unstale":"2024-04-25T08:57:35.407904+0000","last_undegraded":"2024-04-25T08:57:35.407904+0000","last_fullsized":"2024-04-25T08:57:35.407904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:12.367390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408098+0000","last_change":"2024-04-25T08:57:33.425687+0000","last_active":"2024-04-25T08:57:35.408098+0000","last_peered":"2024-04-25T08:57:35.408098+0000","last_clean":"2024-04-25T08:57:35.408098+0000","last_became_active":"2024-04-25T08:57:33.425440+0000","last_became_peered":"2024-04-25T08:57:33.425440+0000","last_unstale":"2024-04-25T08:57:35.408098+0000","last_undegraded":"2024-04-25T08:57:35.408098+0000","last_fullsized":"2024-04-25T08:57:35.408098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:58.152288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906690+0000","last_change":"2024-04-25T08:57:32.407182+0000","last_active":"2024-04-25T08:57:34.906690+0000","last_peered":"2024-04-25T08:57:34.906690+0000","last_clean":"2024-04-25T08:57:34.906690+0000","last_became_active":"2024-04-25T08:57:32.406889+0000","last_became_peered":"2024-04-25T08:57:32.406889+0000","last_unstale":"2024-04-25T08:57:34.906690+0000","last_undegraded":"2024-04-25T08:57:34.906690+0000","last_fullsized":"2024-04-25T08:57:34.906690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:18.569826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407612+0000","last_change":"2024-04-25T08:57:33.414721+0000","last_active":"2024-04-25T08:57:35.407612+0000","last_peered":"2024-04-25T08:57:35.407612+0000","last_clean":"2024-04-25T08:57:35.407612+0000","last_became_active":"2024-04-25T08:57:33.414382+0000","last_became_peered":"2024-04-25T08:57:33.414382+0000","last_unstale":"2024-04-25T08:57:35.407612+0000","last_undegraded":"2024-04-25T08:57:35.407612+0000","last_fullsized":"2024-04-25T08:57:35.407612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:20.153674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412783+0000","last_change":"2024-04-25T08:57:32.405786+0000","last_active":"2024-04-25T08:57:34.412783+0000","last_peered":"2024-04-25T08:57:34.412783+0000","last_clean":"2024-04-25T08:57:34.412783+0000","last_became_active":"2024-04-25T08:57:32.405512+0000","last_became_peered":"2024-04-25T08:57:32.405512+0000","last_unstale":"2024-04-25T08:57:34.412783+0000","last_undegraded":"2024-04-25T08:57:34.412783+0000","last_fullsized":"2024-04-25T08:57:34.412783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:57.089590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412753+0000","last_change":"2024-04-25T08:57:33.419216+0000","last_active":"2024-04-25T08:57:34.412753+0000","last_peered":"2024-04-25T08:57:34.412753+0000","last_clean":"2024-04-25T08:57:34.412753+0000","last_became_active":"2024-04-25T08:57:33.418718+0000","last_became_peered":"2024-04-25T08:57:33.418718+0000","last_unstale":"2024-04-25T08:57:34.412753+0000","last_undegraded":"2024-04-25T08:57:34.412753+0000","last_fullsized":"2024-04-25T08:57:34.412753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:43.622144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407746+0000","last_change":"2024-04-25T08:57:32.403511+0000","last_active":"2024-04-25T08:57:35.407746+0000","last_peered":"2024-04-25T08:57:35.407746+0000","last_clean":"2024-04-25T08:57:35.407746+0000","last_became_active":"2024-04-25T08:57:32.403244+0000","last_became_peered":"2024-04-25T08:57:32.403244+0000","last_unstale":"2024-04-25T08:57:35.407746+0000","last_undegraded":"2024-04-25T08:57:35.407746+0000","last_fullsized":"2024-04-25T08:57:35.407746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:57.089590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402169+0000","last_change":"2024-04-25T08:57:33.422314+0000","last_active":"2024-04-25T08:57:35.402169+0000","last_peered":"2024-04-25T08:57:35.402169+0000","last_clean":"2024-04-25T08:57:35.402169+0000","last_became_active":"2024-04-25T08:57:33.422026+0000","last_became_peered":"2024-04-25T08:57:33.422026+0000","last_unstale":"2024-04-25T08:57:35.402169+0000","last_undegraded":"2024-04-25T08:57:35.402169+0000","last_fullsized":"2024-04-25T08:57:35.402169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:18.159367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411750+0000","last_change":"2024-04-25T08:57:32.408517+0000","last_active":"2024-04-25T08:57:34.411750+0000","last_peered":"2024-04-25T08:57:34.411750+0000","last_clean":"2024-04-25T08:57:34.411750+0000","last_became_active":"2024-04-25T08:57:32.408219+0000","last_became_peered":"2024-04-25T08:57:32.408219+0000","last_unstale":"2024-04-25T08:57:34.411750+0000","last_undegraded":"2024-04-25T08:57:34.411750+0000","last_fullsized":"2024-04-25T08:57:34.411750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:49.108690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407612+0000","last_change":"2024-04-25T08:57:33.423255+0000","last_active":"2024-04-25T08:57:35.407612+0000","last_peered":"2024-04-25T08:57:35.407612+0000","last_clean":"2024-04-25T08:57:35.407612+0000","last_became_active":"2024-04-25T08:57:33.422981+0000","last_became_peered":"2024-04-25T08:57:33.422981+0000","last_unstale":"2024-04-25T08:57:35.407612+0000","last_undegraded":"2024-04-25T08:57:35.407612+0000","last_fullsized":"2024-04-25T08:57:35.407612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:53.234804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.401816+0000","last_change":"2024-04-25T08:57:32.408405+0000","last_active":"2024-04-25T08:57:35.401816+0000","last_peered":"2024-04-25T08:57:35.401816+0000","last_clean":"2024-04-25T08:57:35.401816+0000","last_became_active":"2024-04-25T08:57:32.408095+0000","last_became_peered":"2024-04-25T08:57:32.408095+0000","last_unstale":"2024-04-25T08:57:35.401816+0000","last_undegraded":"2024-04-25T08:57:35.401816+0000","last_fullsized":"2024-04-25T08:57:35.401816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:48.623780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407977+0000","last_change":"2024-04-25T08:57:33.418747+0000","last_active":"2024-04-25T08:57:35.407977+0000","last_peered":"2024-04-25T08:57:35.407977+0000","last_clean":"2024-04-25T08:57:35.407977+0000","last_became_active":"2024-04-25T08:57:33.418139+0000","last_became_peered":"2024-04-25T08:57:33.418139+0000","last_unstale":"2024-04-25T08:57:35.407977+0000","last_undegraded":"2024-04-25T08:57:35.407977+0000","last_fullsized":"2024-04-25T08:57:35.407977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:55.699310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407286+0000","last_change":"2024-04-25T08:57:32.405702+0000","last_active":"2024-04-25T08:57:35.407286+0000","last_peered":"2024-04-25T08:57:35.407286+0000","last_clean":"2024-04-25T08:57:35.407286+0000","last_became_active":"2024-04-25T08:57:32.404926+0000","last_became_peered":"2024-04-25T08:57:32.404926+0000","last_unstale":"2024-04-25T08:57:35.407286+0000","last_undegraded":"2024-04-25T08:57:35.407286+0000","last_fullsized":"2024-04-25T08:57:35.407286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:38.034483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407639+0000","last_change":"2024-04-25T08:57:33.415440+0000","last_active":"2024-04-25T08:57:35.407639+0000","last_peered":"2024-04-25T08:57:35.407639+0000","last_clean":"2024-04-25T08:57:35.407639+0000","last_became_active":"2024-04-25T08:57:33.415135+0000","last_became_peered":"2024-04-25T08:57:33.415135+0000","last_unstale":"2024-04-25T08:57:35.407639+0000","last_undegraded":"2024-04-25T08:57:35.407639+0000","last_fullsized":"2024-04-25T08:57:35.407639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:11.021127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407143+0000","last_change":"2024-04-25T08:57:32.402149+0000","last_active":"2024-04-25T08:57:35.407143+0000","last_peered":"2024-04-25T08:57:35.407143+0000","last_clean":"2024-04-25T08:57:35.407143+0000","last_became_active":"2024-04-25T08:57:32.401871+0000","last_became_peered":"2024-04-25T08:57:32.401871+0000","last_unstale":"2024-04-25T08:57:35.407143+0000","last_undegraded":"2024-04-25T08:57:35.407143+0000","last_fullsized":"2024-04-25T08:57:35.407143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:10.017398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411854+0000","last_change":"2024-04-25T08:57:33.411121+0000","last_active":"2024-04-25T08:57:34.411854+0000","last_peered":"2024-04-25T08:57:34.411854+0000","last_clean":"2024-04-25T08:57:34.411854+0000","last_became_active":"2024-04-25T08:57:33.410814+0000","last_became_peered":"2024-04-25T08:57:33.410814+0000","last_unstale":"2024-04-25T08:57:34.411854+0000","last_undegraded":"2024-04-25T08:57:34.411854+0000","last_fullsized":"2024-04-25T08:57:34.411854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:17.854863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402416+0000","last_change":"2024-04-25T08:57:32.404495+0000","last_active":"2024-04-25T08:57:35.402416+0000","last_peered":"2024-04-25T08:57:35.402416+0000","last_clean":"2024-04-25T08:57:35.402416+0000","last_became_active":"2024-04-25T08:57:32.404186+0000","last_became_peered":"2024-04-25T08:57:32.404186+0000","last_unstale":"2024-04-25T08:57:35.402416+0000","last_undegraded":"2024-04-25T08:57:35.402416+0000","last_fullsized":"2024-04-25T08:57:35.402416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:39.179006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412672+0000","last_change":"2024-04-25T08:57:33.413569+0000","last_active":"2024-04-25T08:57:34.412672+0000","last_peered":"2024-04-25T08:57:34.412672+0000","last_clean":"2024-04-25T08:57:34.412672+0000","last_became_active":"2024-04-25T08:57:33.413307+0000","last_became_peered":"2024-04-25T08:57:33.413307+0000","last_unstale":"2024-04-25T08:57:34.412672+0000","last_undegraded":"2024-04-25T08:57:34.412672+0000","last_fullsized":"2024-04-25T08:57:34.412672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:20.153674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411722+0000","last_change":"2024-04-25T08:57:32.408381+0000","last_active":"2024-04-25T08:57:34.411722+0000","last_peered":"2024-04-25T08:57:34.411722+0000","last_clean":"2024-04-25T08:57:34.411722+0000","last_became_active":"2024-04-25T08:57:32.407933+0000","last_became_peered":"2024-04-25T08:57:32.407933+0000","last_unstale":"2024-04-25T08:57:34.411722+0000","last_undegraded":"2024-04-25T08:57:34.411722+0000","last_fullsized":"2024-04-25T08:57:34.411722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:28.916029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402134+0000","last_change":"2024-04-25T08:57:33.421722+0000","last_active":"2024-04-25T08:57:35.402134+0000","last_peered":"2024-04-25T08:57:35.402134+0000","last_clean":"2024-04-25T08:57:35.402134+0000","last_became_active":"2024-04-25T08:57:33.419968+0000","last_became_peered":"2024-04-25T08:57:33.419968+0000","last_unstale":"2024-04-25T08:57:35.402134+0000","last_undegraded":"2024-04-25T08:57:35.402134+0000","last_fullsized":"2024-04-25T08:57:35.402134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.258296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412061+0000","last_change":"2024-04-25T08:57:32.394801+0000","last_active":"2024-04-25T08:57:34.412061+0000","last_peered":"2024-04-25T08:57:34.412061+0000","last_clean":"2024-04-25T08:57:34.412061+0000","last_became_active":"2024-04-25T08:57:32.394534+0000","last_became_peered":"2024-04-25T08:57:32.394534+0000","last_unstale":"2024-04-25T08:57:34.412061+0000","last_undegraded":"2024-04-25T08:57:34.412061+0000","last_fullsized":"2024-04-25T08:57:34.412061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:14.032937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409826+0000","last_change":"2024-04-25T08:57:33.413478+0000","last_active":"2024-04-25T08:57:34.409826+0000","last_peered":"2024-04-25T08:57:34.409826+0000","last_clean":"2024-04-25T08:57:34.409826+0000","last_became_active":"2024-04-25T08:57:33.413201+0000","last_became_peered":"2024-04-25T08:57:33.413201+0000","last_unstale":"2024-04-25T08:57:34.409826+0000","last_undegraded":"2024-04-25T08:57:34.409826+0000","last_fullsized":"2024-04-25T08:57:34.409826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:15.100992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411940+0000","last_change":"2024-04-25T08:57:32.404632+0000","last_active":"2024-04-25T08:57:34.411940+0000","last_peered":"2024-04-25T08:57:34.411940+0000","last_clean":"2024-04-25T08:57:34.411940+0000","last_became_active":"2024-04-25T08:57:32.404279+0000","last_became_peered":"2024-04-25T08:57:32.404279+0000","last_unstale":"2024-04-25T08:57:34.411940+0000","last_undegraded":"2024-04-25T08:57:34.411940+0000","last_fullsized":"2024-04-25T08:57:34.411940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:48.623780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409674+0000","last_change":"2024-04-25T08:57:33.412052+0000","last_active":"2024-04-25T08:57:34.409674+0000","last_peered":"2024-04-25T08:57:34.409674+0000","last_clean":"2024-04-25T08:57:34.409674+0000","last_became_active":"2024-04-25T08:57:33.411761+0000","last_became_peered":"2024-04-25T08:57:33.411761+0000","last_unstale":"2024-04-25T08:57:34.409674+0000","last_undegraded":"2024-04-25T08:57:34.409674+0000","last_fullsized":"2024-04-25T08:57:34.409674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:15.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906620+0000","last_change":"2024-04-25T08:57:32.410128+0000","last_active":"2024-04-25T08:57:34.906620+0000","last_peered":"2024-04-25T08:57:34.906620+0000","last_clean":"2024-04-25T08:57:34.906620+0000","last_became_active":"2024-04-25T08:57:32.409737+0000","last_became_peered":"2024-04-25T08:57:32.409737+0000","last_unstale":"2024-04-25T08:57:34.906620+0000","last_undegraded":"2024-04-25T08:57:34.906620+0000","last_fullsized":"2024-04-25T08:57:34.906620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:39.179006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409836+0000","last_change":"2024-04-25T08:57:33.419172+0000","last_active":"2024-04-25T08:57:34.409836+0000","last_peered":"2024-04-25T08:57:34.409836+0000","last_clean":"2024-04-25T08:57:34.409836+0000","last_became_active":"2024-04-25T08:57:33.418891+0000","last_became_peered":"2024-04-25T08:57:33.418891+0000","last_unstale":"2024-04-25T08:57:34.409836+0000","last_undegraded":"2024-04-25T08:57:34.409836+0000","last_fullsized":"2024-04-25T08:57:34.409836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:40.182734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407586+0000","last_change":"2024-04-25T08:57:32.410565+0000","last_active":"2024-04-25T08:57:35.407586+0000","last_peered":"2024-04-25T08:57:35.407586+0000","last_clean":"2024-04-25T08:57:35.407586+0000","last_became_active":"2024-04-25T08:57:32.410250+0000","last_became_peered":"2024-04-25T08:57:32.410250+0000","last_unstale":"2024-04-25T08:57:35.407586+0000","last_undegraded":"2024-04-25T08:57:35.407586+0000","last_fullsized":"2024-04-25T08:57:35.407586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:39.179006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409799+0000","last_change":"2024-04-25T08:57:33.419906+0000","last_active":"2024-04-25T08:57:34.409799+0000","last_peered":"2024-04-25T08:57:34.409799+0000","last_clean":"2024-04-25T08:57:34.409799+0000","last_became_active":"2024-04-25T08:57:33.419639+0000","last_became_peered":"2024-04-25T08:57:33.419639+0000","last_unstale":"2024-04-25T08:57:34.409799+0000","last_undegraded":"2024-04-25T08:57:34.409799+0000","last_fullsized":"2024-04-25T08:57:34.409799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:19.573555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411203+0000","last_change":"2024-04-25T08:57:32.402252+0000","last_active":"2024-04-25T08:57:34.411203+0000","last_peered":"2024-04-25T08:57:34.411203+0000","last_clean":"2024-04-25T08:57:34.411203+0000","last_became_active":"2024-04-25T08:57:32.401947+0000","last_became_peered":"2024-04-25T08:57:32.401947+0000","last_unstale":"2024-04-25T08:57:34.411203+0000","last_undegraded":"2024-04-25T08:57:34.411203+0000","last_fullsized":"2024-04-25T08:57:34.411203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:18.569826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407727+0000","last_change":"2024-04-25T08:57:33.412844+0000","last_active":"2024-04-25T08:57:35.407727+0000","last_peered":"2024-04-25T08:57:35.407727+0000","last_clean":"2024-04-25T08:57:35.407727+0000","last_became_active":"2024-04-25T08:57:33.412558+0000","last_became_peered":"2024-04-25T08:57:33.412558+0000","last_unstale":"2024-04-25T08:57:35.407727+0000","last_undegraded":"2024-04-25T08:57:35.407727+0000","last_fullsized":"2024-04-25T08:57:35.407727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:28.130739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412083+0000","last_change":"2024-04-25T08:57:32.405681+0000","last_active":"2024-04-25T08:57:34.412083+0000","last_peered":"2024-04-25T08:57:34.412083+0000","last_clean":"2024-04-25T08:57:34.412083+0000","last_became_active":"2024-04-25T08:57:32.405191+0000","last_became_peered":"2024-04-25T08:57:32.405191+0000","last_unstale":"2024-04-25T08:57:34.412083+0000","last_undegraded":"2024-04-25T08:57:34.412083+0000","last_fullsized":"2024-04-25T08:57:34.412083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:38.034483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.409904+0000","last_change":"2024-04-25T08:57:33.410313+0000","last_active":"2024-04-25T08:57:34.409904+0000","last_peered":"2024-04-25T08:57:34.409904+0000","last_clean":"2024-04-25T08:57:34.409904+0000","last_became_active":"2024-04-25T08:57:33.409996+0000","last_became_peered":"2024-04-25T08:57:33.409996+0000","last_unstale":"2024-04-25T08:57:34.409904+0000","last_undegraded":"2024-04-25T08:57:34.409904+0000","last_fullsized":"2024-04-25T08:57:34.409904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:50.112418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402501+0000","last_change":"2024-04-25T08:57:32.401057+0000","last_active":"2024-04-25T08:57:35.402501+0000","last_peered":"2024-04-25T08:57:35.402501+0000","last_clean":"2024-04-25T08:57:35.402501+0000","last_became_active":"2024-04-25T08:57:32.400745+0000","last_became_peered":"2024-04-25T08:57:32.400745+0000","last_unstale":"2024-04-25T08:57:35.402501+0000","last_undegraded":"2024-04-25T08:57:35.402501+0000","last_fullsized":"2024-04-25T08:57:35.402501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:49.108690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.412813+0000","last_change":"2024-04-25T08:57:33.418908+0000","last_active":"2024-04-25T08:57:34.412813+0000","last_peered":"2024-04-25T08:57:34.412813+0000","last_clean":"2024-04-25T08:57:34.412813+0000","last_became_active":"2024-04-25T08:57:33.418492+0000","last_became_peered":"2024-04-25T08:57:33.418492+0000","last_unstale":"2024-04-25T08:57:34.412813+0000","last_undegraded":"2024-04-25T08:57:34.412813+0000","last_fullsized":"2024-04-25T08:57:34.412813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:58.152288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.401252+0000","last_change":"2024-04-25T08:57:32.406450+0000","last_active":"2024-04-25T08:57:35.401252+0000","last_peered":"2024-04-25T08:57:35.401252+0000","last_clean":"2024-04-25T08:57:35.401252+0000","last_became_active":"2024-04-25T08:57:32.406141+0000","last_became_peered":"2024-04-25T08:57:32.406141+0000","last_unstale":"2024-04-25T08:57:35.401252+0000","last_undegraded":"2024-04-25T08:57:35.401252+0000","last_fullsized":"2024-04-25T08:57:35.401252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:14.097263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906619+0000","last_change":"2024-04-25T08:57:33.424028+0000","last_active":"2024-04-25T08:57:34.906619+0000","last_peered":"2024-04-25T08:57:34.906619+0000","last_clean":"2024-04-25T08:57:34.906619+0000","last_became_active":"2024-04-25T08:57:33.423739+0000","last_became_peered":"2024-04-25T08:57:33.423739+0000","last_unstale":"2024-04-25T08:57:34.906619+0000","last_undegraded":"2024-04-25T08:57:34.906619+0000","last_fullsized":"2024-04-25T08:57:34.906619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:42.513746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402122+0000","last_change":"2024-04-25T08:57:32.394789+0000","last_active":"2024-04-25T08:57:35.402122+0000","last_peered":"2024-04-25T08:57:35.402122+0000","last_clean":"2024-04-25T08:57:35.402122+0000","last_became_active":"2024-04-25T08:57:32.394474+0000","last_became_peered":"2024-04-25T08:57:32.394474+0000","last_unstale":"2024-04-25T08:57:35.402122+0000","last_undegraded":"2024-04-25T08:57:35.402122+0000","last_fullsized":"2024-04-25T08:57:35.402122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:14.097263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407570+0000","last_change":"2024-04-25T08:57:33.419172+0000","last_active":"2024-04-25T08:57:35.407570+0000","last_peered":"2024-04-25T08:57:35.407570+0000","last_clean":"2024-04-25T08:57:35.407570+0000","last_became_active":"2024-04-25T08:57:33.418911+0000","last_became_peered":"2024-04-25T08:57:33.418911+0000","last_unstale":"2024-04-25T08:57:35.407570+0000","last_undegraded":"2024-04-25T08:57:35.407570+0000","last_fullsized":"2024-04-25T08:57:35.407570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:13.371118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906719+0000","last_change":"2024-04-25T08:57:32.408457+0000","last_active":"2024-04-25T08:57:34.906719+0000","last_peered":"2024-04-25T08:57:34.906719+0000","last_clean":"2024-04-25T08:57:34.906719+0000","last_became_active":"2024-04-25T08:57:32.408156+0000","last_became_peered":"2024-04-25T08:57:32.408156+0000","last_unstale":"2024-04-25T08:57:34.906719+0000","last_undegraded":"2024-04-25T08:57:34.906719+0000","last_fullsized":"2024-04-25T08:57:34.906719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:49.108690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.906603+0000","last_change":"2024-04-25T08:57:33.421976+0000","last_active":"2024-04-25T08:57:34.906603+0000","last_peered":"2024-04-25T08:57:34.906603+0000","last_clean":"2024-04-25T08:57:34.906603+0000","last_became_active":"2024-04-25T08:57:33.421662+0000","last_became_peered":"2024-04-25T08:57:33.421662+0000","last_unstale":"2024-04-25T08:57:34.906603+0000","last_undegraded":"2024-04-25T08:57:34.906603+0000","last_fullsized":"2024-04-25T08:57:34.906603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:43.559367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.402018+0000","last_change":"2024-04-25T08:57:32.401666+0000","last_active":"2024-04-25T08:57:35.402018+0000","last_peered":"2024-04-25T08:57:35.402018+0000","last_clean":"2024-04-25T08:57:35.402018+0000","last_became_active":"2024-04-25T08:57:32.401412+0000","last_became_peered":"2024-04-25T08:57:32.401412+0000","last_unstale":"2024-04-25T08:57:35.402018+0000","last_undegraded":"2024-04-25T08:57:35.402018+0000","last_fullsized":"2024-04-25T08:57:35.402018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:18.569826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407208+0000","last_change":"2024-04-25T08:57:33.427561+0000","last_active":"2024-04-25T08:57:35.407208+0000","last_peered":"2024-04-25T08:57:35.407208+0000","last_clean":"2024-04-25T08:57:35.407208+0000","last_became_active":"2024-04-25T08:57:33.427275+0000","last_became_peered":"2024-04-25T08:57:33.427275+0000","last_unstale":"2024-04-25T08:57:35.407208+0000","last_undegraded":"2024-04-25T08:57:35.407208+0000","last_fullsized":"2024-04-25T08:57:35.407208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:55.699310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411307+0000","last_change":"2024-04-25T08:57:32.405546+0000","last_active":"2024-04-25T08:57:34.411307+0000","last_peered":"2024-04-25T08:57:34.411307+0000","last_clean":"2024-04-25T08:57:34.411307+0000","last_became_active":"2024-04-25T08:57:32.405162+0000","last_became_peered":"2024-04-25T08:57:32.405162+0000","last_unstale":"2024-04-25T08:57:34.411307+0000","last_undegraded":"2024-04-25T08:57:34.411307+0000","last_fullsized":"2024-04-25T08:57:34.411307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:14.097263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:34.411127+0000","last_change":"2024-04-25T08:57:33.416131+0000","last_active":"2024-04-25T08:57:34.411127+0000","last_peered":"2024-04-25T08:57:34.411127+0000","last_clean":"2024-04-25T08:57:34.411127+0000","last_became_active":"2024-04-25T08:57:33.415835+0000","last_became_peered":"2024-04-25T08:57:33.415835+0000","last_unstale":"2024-04-25T08:57:34.411127+0000","last_undegraded":"2024-04-25T08:57:34.411127+0000","last_fullsized":"2024-04-25T08:57:34.411127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:39.038212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407321+0000","last_change":"2024-04-25T08:57:32.406934+0000","last_active":"2024-04-25T08:57:35.407321+0000","last_peered":"2024-04-25T08:57:35.407321+0000","last_clean":"2024-04-25T08:57:35.407321+0000","last_became_active":"2024-04-25T08:57:32.406610+0000","last_became_peered":"2024-04-25T08:57:32.406610+0000","last_unstale":"2024-04-25T08:57:35.407321+0000","last_undegraded":"2024-04-25T08:57:35.407321+0000","last_fullsized":"2024-04-25T08:57:35.407321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:41.510017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408234+0000","last_change":"2024-04-25T08:57:33.420126+0000","last_active":"2024-04-25T08:57:35.408234+0000","last_peered":"2024-04-25T08:57:35.408234+0000","last_clean":"2024-04-25T08:57:35.408234+0000","last_became_active":"2024-04-25T08:57:33.419870+0000","last_became_peered":"2024-04-25T08:57:33.419870+0000","last_unstale":"2024-04-25T08:57:35.408234+0000","last_undegraded":"2024-04-25T08:57:35.408234+0000","last_fullsized":"2024-04-25T08:57:35.408234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:32.384244+0000","last_clean_scrub_stamp":"2024-04-25T08:57:32.384244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:20.153674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.407556+0000","last_change":"2024-04-25T08:57:32.410802+0000","last_active":"2024-04-25T08:57:35.407556+0000","last_peered":"2024-04-25T08:57:35.407556+0000","last_clean":"2024-04-25T08:57:35.407556+0000","last_became_active":"2024-04-25T08:57:32.410523+0000","last_became_peered":"2024-04-25T08:57:32.410523+0000","last_unstale":"2024-04-25T08:57:35.407556+0000","last_undegraded":"2024-04-25T08:57:35.407556+0000","last_fullsized":"2024-04-25T08:57:35.407556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:31.380516+0000","last_clean_scrub_stamp":"2024-04-25T08:57:31.380516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:18.569826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T08:57:35.408138+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:57:35.408138+0000","last_peered":"2024-04-25T08:57:35.408138+0000","last_clean":"2024-04-25T08:57:35.408138+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:57:35.408138+0000","last_undegraded":"2024-04-25T08:57:35.408138+0000","last_fullsized":"2024-04-25T08:57:35.408138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":724908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":135066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":135122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":134520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":724818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:41.154 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:57:41.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:57:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.310+0000 7fd9b38b6640 1 Processor -- start 2024-04-25T08:57:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b38b6640 1 -- start start 2024-04-25T08:57:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b38b6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9ac0b72b0 0x7fd9ac0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b38b6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0d0d20 0x7fd9ac0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b38b6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac0cc010 con 0x7fd9ac0ce6e0 2024-04-25T08:57:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b38b6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac0cdde0 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b38b6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0cc2f0 con 0x7fd9ac0d0d20 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b1652640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9ac0b72b0 0x7fd9ac0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.311+0000 7fd9b1e53640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9ac0ce6e0 0x7fd9ac06b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38950/0 (socket says 172.21.15.5:38950) 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9b1e53640 1 -- 172.21.15.5:0/3932316925 learned_addr learned my addr 172.21.15.5:0/3932316925 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9b0e51640 1 --2- 172.21.15.5:0/3932316925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0d0d20 0x7fd9ac0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9b1652640 1 -- 172.21.15.5:0/3932316925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0d0d20 msgr2=0x7fd9ac0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9b1652640 1 --2- 172.21.15.5:0/3932316925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0d0d20 0x7fd9ac0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9b1652640 1 -- 172.21.15.5:0/3932316925 >> v1:172.21.15.5:6789/0 conn(0x7fd9ac0ce6e0 legacy=0x7fd9ac06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9b1652640 1 -- 172.21.15.5:0/3932316925 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0cc5d0 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9a3fff640 1 -- 172.21.15.5:0/3932316925 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295773300 0 0) 0x7fd9ac0cc010 con 0x7fd9ac0ce6e0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.312+0000 7fd9b1652640 1 --2- 172.21.15.5:0/3932316925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac0cfd70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097a0 tx=0x7fd9a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b0a41f570cf962 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9a3fff640 1 -- 172.21.15.5:0/3932316925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8037070 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9a3fff640 1 -- 172.21.15.5:0/3932316925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8032440 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9a3fff640 1 -- 172.21.15.5:0/3932316925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8032810 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 -- 172.21.15.5:0/3932316925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 msgr2=0x7fd9ac0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/3932316925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac0cfd70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097a0 tx=0x7fd9a802a180 comp rx=0 tx=0).stop 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 -- 172.21.15.5:0/3932316925 shutdown_connections 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/3932316925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0d0d20 0x7fd9ac0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/3932316925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac0cfd70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 -- 172.21.15.5:0/3932316925 >> 172.21.15.5:0/3932316925 conn(0x7fd9ac0d1920 msgr2=0x7fd9ac0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 -- 172.21.15.5:0/3932316925 shutdown_connections 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.313+0000 7fd9b38b6640 1 -- 172.21.15.5:0/3932316925 wait complete. 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.314+0000 7fd9b38b6640 1 Processor -- start 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b38b6640 1 -- start start 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b38b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b38b6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0ce6e0 0x7fd9ac0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b38b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9ac0d0d20 0x7fd9ac14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b38b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0d1550 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b38b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0b4770 con 0x7fd9ac0d0d20 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b38b6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0d1180 con 0x7fd9ac0ce6e0 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b1652640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b1652640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50312/0 (socket says 172.21.15.5:50312) 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.315+0000 7fd9b1652640 1 -- 172.21.15.5:0/139985929 learned_addr learned my addr 172.21.15.5:0/139985929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b0e51640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0ce6e0 0x7fd9ac0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1e53640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9ac0d0d20 0x7fd9ac14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1652640 1 -- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0ce6e0 msgr2=0x7fd9ac0b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1652640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0ce6e0 0x7fd9ac0b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1652640 1 -- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9ac0d0d20 msgr2=0x7fd9ac14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1652640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9ac0d0d20 0x7fd9ac14fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1652640 1 -- 172.21.15.5:0/139985929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac14ebb0 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1e53640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9ac0d0d20 0x7fd9ac14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b1652640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac151ce0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097a0 tx=0x7fd9a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9a1ffb640 1 -- 172.21.15.5:0/139985929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8037050 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9a1ffb640 1 -- 172.21.15.5:0/139985929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8038040 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac14ee90 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9a1ffb640 1 -- 172.21.15.5:0/139985929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8004470 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.316+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac14f450 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.317+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac04ef20 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.318+0000 7fd9a1ffb640 1 -- 172.21.15.5:0/139985929 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9a8030900 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.318+0000 7fd9a1ffb640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd99006b4d0 0x7fd99006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.318+0000 7fd9a1ffb640 1 -- 172.21.15.5:0/139985929 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9a80aadd0 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.318+0000 7fd9b0e51640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd99006b4d0 0x7fd99006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.319+0000 7fd9b0e51640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd99006b4d0 0x7fd99006d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0b5160 tx=0x7fd99c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.322+0000 7fd9a1ffb640 1 -- 172.21.15.5:0/139985929 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9a8079d70 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.579+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd9ac0d21f0 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.581+0000 7fd9a1ffb640 1 -- 172.21.15.5:0/139985929 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd9a80ac0e0 con 0x7fd9ac0b72b0 2024-04-25T08:57:41.571 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T08:57:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T08:57:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T08:57:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T08:57:41.571 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:57:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T08:57:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd99006b4d0 msgr2=0x7fd99006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd99006b4d0 0x7fd99006d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0b5160 tx=0x7fd99c008040 comp rx=0 tx=0).stop 2024-04-25T08:57:41.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 msgr2=0x7fd9ac151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac151ce0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097a0 tx=0x7fd9a80046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 shutdown_connections 2024-04-25T08:57:41.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd99006b4d0 0x7fd99006d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9ac0d0d20 0x7fd9ac14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9ac0ce6e0 0x7fd9ac0b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 --2- 172.21.15.5:0/139985929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9ac0b72b0 0x7fd9ac151ce0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.583+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 >> 172.21.15.5:0/139985929 conn(0x7fd9ac0d1920 msgr2=0x7fd9ac0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.584+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 shutdown_connections 2024-04-25T08:57:41.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.584+0000 7fd9b38b6640 1 -- 172.21.15.5:0/139985929 wait complete. 2024-04-25T08:57:41.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:41.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.697+0000 7f862d807640 1 Processor -- start 2024-04-25T08:57:41.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.697+0000 7f862d807640 1 -- start start 2024-04-25T08:57:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f862d807640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86280ce7f0 0x7f86280cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f862d807640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280cf1c0 con 0x7f86280b2cc0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f862d807640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280d20e0 con 0x7f862815de70 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f862d807640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280d2a10 con 0x7f86280ce7f0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f86267fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86280b2cc0 0x7f86280b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38966/0 (socket says 172.21.15.5:38966) 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f86267fc640 1 -- 172.21.15.5:0/2571595490 learned_addr learned my addr 172.21.15.5:0/2571595490 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f86277fe640 1 --2- 172.21.15.5:0/2571595490 >> v2:172.21.15.80:3300/0 conn(0x7f86280ce7f0 0x7f86280cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518338002 0 0) 0x7f86280cf1c0 con 0x7f86280b2cc0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8614003520 con 0x7f86280b2cc0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309055171 0 0) 0x7f8614003520 con 0x7f86280b2cc0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 >> v2:172.21.15.80:3300/0 conn(0x7f86280ce7f0 msgr2=0x7f86280cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 --2- 172.21.15.5:0/2571595490 >> v2:172.21.15.80:3300/0 conn(0x7f86280ce7f0 0x7f86280cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 >> v1:172.21.15.80:6789/0 conn(0x7f862815de70 legacy=0x7f86280b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280d23c0 con 0x7f86280b2cc0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f8610001670 con 0x7f86280b2cc0 2024-04-25T08:57:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 >> v1:172.21.15.5:6789/0 conn(0x7f86280b2cc0 legacy=0x7f86280b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.698+0000 7f8625ffb640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86140039b0 0x7f8614003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f8625ffb640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8614004800 0x7f8614004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f8625ffb640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86140051c0 0x7f861400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280d2a10 con 0x7f86140051c0 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861400c060 con 0x7f8614004800 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861400c260 con 0x7f86140039b0 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f86277fe640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86140051c0 0x7f861400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f86267fc640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8614004800 0x7f8614004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f8626ffd640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86140039b0 0x7f8614003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f86277fe640 1 -- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86140039b0 msgr2=0x7f8614003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f86277fe640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86140039b0 0x7f8614003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f86277fe640 1 -- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8614004800 msgr2=0x7f8614004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f86277fe640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8614004800 0x7f8614004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f86277fe640 1 -- 172.21.15.5:0/2571595490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614003520 con 0x7f86140051c0 2024-04-25T08:57:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.699+0000 7f8626ffd640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86140039b0 0x7f8614003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f86277fe640 1 -- 172.21.15.5:0/2571595490 reap_dead start 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f86277fe640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86140051c0 0x7f861400b9c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8618009fc0 tx=0x7f8614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ebc623468eddb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618035020 con 0x7f86140051c0 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8618003bd0 con 0x7f86140051c0 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f8625ffb640 1 -- 172.21.15.5:0/2571595490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618009c10 con 0x7f86140051c0 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f862d807640 1 -- 172.21.15.5:0/2571595490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86140051c0 msgr2=0x7f861400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f862d807640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86140051c0 0x7f861400b9c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8618009fc0 tx=0x7f8614005830 comp rx=0 tx=0).stop 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f862d807640 1 -- 172.21.15.5:0/2571595490 shutdown_connections 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f862d807640 1 --2- 172.21.15.5:0/2571595490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86140051c0 0x7f861400b9c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f862d807640 1 -- 172.21.15.5:0/2571595490 >> 172.21.15.5:0/2571595490 conn(0x7f862806b000 msgr2=0x7f862806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f862d807640 1 -- 172.21.15.5:0/2571595490 shutdown_connections 2024-04-25T08:57:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.700+0000 7f862d807640 1 -- 172.21.15.5:0/2571595490 wait complete. 2024-04-25T08:57:41.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 Processor -- start 2024-04-25T08:57:41.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 -- start start 2024-04-25T08:57:41.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86140051c0 0x7f86280cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86280cbc60 0x7f86280c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8628154090 0x7f86280c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280cee00 con 0x7f86280cbc60 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280cec80 con 0x7f86140051c0 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.702+0000 7f862d807640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280cef80 con 0x7f8628154090 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86280cbc60 0x7f86280c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86280cbc60 0x7f86280c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50324/0 (socket says 172.21.15.5:50324) 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 -- 172.21.15.5:0/2669563596 learned_addr learned my addr 172.21.15.5:0/2669563596 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f8626ffd640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86140051c0 0x7f86280cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86277fe640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8628154090 0x7f86280c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 -- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8628154090 msgr2=0x7f86280c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8628154090 0x7f86280c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 -- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86140051c0 msgr2=0x7f86280cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86140051c0 0x7f86280cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 -- 172.21.15.5:0/2669563596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280ca050 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f86267fc640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86280cbc60 0x7f86280c9200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8610004f00 tx=0x7f8610007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f861ffff640 1 -- 172.21.15.5:0/2669563596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861001a070 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f861ffff640 1 -- 172.21.15.5:0/2669563596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861000f750 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86280c9d70 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f861ffff640 1 -- 172.21.15.5:0/2669563596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000fb40 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.703+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86280caf20 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.704+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862804ef20 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.705+0000 7f861ffff640 1 -- 172.21.15.5:0/2669563596 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f861001d070 con 0x7f86280cbc60 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.705+0000 7f861ffff640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f860806b500 0x7f860806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.705+0000 7f861ffff640 1 -- 172.21.15.5:0/2669563596 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8610089950 con 0x7f86280cbc60 2024-04-25T08:57:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.705+0000 7f8626ffd640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f860806b500 0x7f860806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.706+0000 7f8626ffd640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f860806b500 0x7f860806d9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8620007fd0 tx=0x7f8620009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.709+0000 7f861ffff640 1 -- 172.21.15.5:0/2669563596 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8610058180 con 0x7f86280cbc60 2024-04-25T08:57:41.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.926+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86280b8dc0 con 0x7f86280cbc60 2024-04-25T08:57:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.927+0000 7f861ffff640 1 -- 172.21.15.5:0/2669563596 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f861005c220 con 0x7f86280cbc60 2024-04-25T08:57:41.917 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:57:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2510409846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2510409846},{"type":"v1","addr":"172.21.15.80:6837","nonce":2510409846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3426555717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3426555717},{"type":"v1","addr":"172.21.15.80:6836","nonce":3426555717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4918,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3729803264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3729803264},{"type":"v1","addr":"172.21.15.5:6835","nonce":3729803264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:32.755583+0000","modified":"2024-04-25T08:57:34.757541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3359008015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3359008015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3359008015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:57:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2024-04-25T08:57:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f860806b500 msgr2=0x7f860806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f860806b500 0x7f860806d9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8620007fd0 tx=0x7f8620009040 comp rx=0 tx=0).stop 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86280cbc60 msgr2=0x7f86280c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86280cbc60 0x7f86280c9200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8610004f00 tx=0x7f8610007430 comp rx=0 tx=0).stop 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 shutdown_connections 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f860806b500 0x7f860806d9c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8628154090 0x7f86280c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86280cbc60 0x7f86280c9200 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 --2- 172.21.15.5:0/2669563596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86140051c0 0x7f86280cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 >> 172.21.15.5:0/2669563596 conn(0x7f862806b000 msgr2=0x7f86280d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 shutdown_connections 2024-04-25T08:57:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:41.929+0000 7f862d807640 1 -- 172.21.15.5:0/2669563596 wait complete. 2024-04-25T08:57:42.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:57:32.755583+0000', 'modified': '2024-04-25T08:57:34.757541+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5112}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5112': {'gid': 5112, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/3359008015', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 3359008015}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 3359008015}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:57:42.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:57:42.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T08:57:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.451+0000 7f213526f640 1 Processor -- start 2024-04-25T08:57:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.451+0000 7f213526f640 1 -- start start 2024-04-25T08:57:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.452+0000 7f213526f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21301581e0 0x7f21300ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.452+0000 7f213526f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300ae5e0 con 0x7f2130067000 2024-04-25T08:57:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.452+0000 7f213526f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300ae300 con 0x7f213015ef00 2024-04-25T08:57:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.452+0000 7f213526f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213015e420 con 0x7f21301581e0 2024-04-25T08:57:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.452+0000 7f212f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2130067000 0x7f2130161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38980/0 (socket says 172.21.15.5:38980) 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.452+0000 7f212f7fe640 1 -- 172.21.15.5:0/1643656905 learned_addr learned my addr 172.21.15.5:0/1643656905 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212effd640 1 --2- 172.21.15.5:0/1643656905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21301581e0 0x7f21300ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212dffb640 1 -- 172.21.15.5:0/1643656905 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34586501 0 0) 0x7f21300ae5e0 con 0x7f2130067000 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212dffb640 1 -- 172.21.15.5:0/1643656905 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f211c003520 con 0x7f2130067000 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212dffb640 1 -- 172.21.15.5:0/1643656905 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186705247 0 0) 0x7f21300ae300 con 0x7f213015ef00 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212dffb640 1 -- 172.21.15.5:0/1643656905 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21300ae5e0 con 0x7f213015ef00 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212effd640 1 -- 172.21.15.5:0/1643656905 >> v1:172.21.15.80:6789/0 conn(0x7f213015ef00 legacy=0x7f21300668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212effd640 1 -- 172.21.15.5:0/1643656905 >> v1:172.21.15.5:6789/0 conn(0x7f2130067000 legacy=0x7f2130161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.453+0000 7f212effd640 1 -- 172.21.15.5:0/1643656905 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213015e700 con 0x7f21301581e0 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f212effd640 1 --2- 172.21.15.5:0/1643656905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21301581e0 0x7f21300ad840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2120009dc0 tx=0x7f212002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2abf5a6446c4c28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f212dffb640 1 -- 172.21.15.5:0/1643656905 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212002ae60 con 0x7f21301581e0 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f212dffb640 1 -- 172.21.15.5:0/1643656905 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120007740 con 0x7f21301581e0 2024-04-25T08:57:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f212dffb640 1 -- 172.21.15.5:0/1643656905 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120007af0 con 0x7f21301581e0 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f213526f640 1 -- 172.21.15.5:0/1643656905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21301581e0 msgr2=0x7f21300ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f213526f640 1 --2- 172.21.15.5:0/1643656905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21301581e0 0x7f21300ad840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2120009dc0 tx=0x7f212002a640 comp rx=0 tx=0).stop 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f213526f640 1 -- 172.21.15.5:0/1643656905 shutdown_connections 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f213526f640 1 --2- 172.21.15.5:0/1643656905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21301581e0 0x7f21300ad840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f213526f640 1 -- 172.21.15.5:0/1643656905 >> 172.21.15.5:0/1643656905 conn(0x7f21300d0870 msgr2=0x7f21300d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.454+0000 7f213526f640 1 -- 172.21.15.5:0/1643656905 shutdown_connections 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.455+0000 7f213526f640 1 -- 172.21.15.5:0/1643656905 wait complete. 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.456+0000 7f213526f640 1 Processor -- start 2024-04-25T08:57:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.456+0000 7f213526f640 1 -- start start 2024-04-25T08:57:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2130067000 0x7f21300cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21301581e0 0x7f2130154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f213015ef00 0x7f21300cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300afd50 con 0x7f21301581e0 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21301585c0 con 0x7f2130067000 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21300add80 con 0x7f213015ef00 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21301581e0 0x7f2130154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21301581e0 0x7f2130154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50338/0 (socket says 172.21.15.5:50338) 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 -- 172.21.15.5:0/1031153417 learned_addr learned my addr 172.21.15.5:0/1031153417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212f7fe640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f213015ef00 0x7f21300cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212effd640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2130067000 0x7f21300cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 -- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f213015ef00 msgr2=0x7f21300cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f213015ef00 0x7f21300cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 -- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2130067000 msgr2=0x7f21300cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2130067000 0x7f21300cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 -- 172.21.15.5:0/1031153417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300cd9f0 con 0x7f21301581e0 2024-04-25T08:57:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212effd640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2130067000 0x7f21300cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f212e7fc640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21301581e0 0x7f2130154230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f211800c460 tx=0x7f211800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f21277fe640 1 -- 172.21.15.5:0/1031153417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118017070 con 0x7f21301581e0 2024-04-25T08:57:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f21277fe640 1 -- 172.21.15.5:0/1031153417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180052f0 con 0x7f21301581e0 2024-04-25T08:57:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21300cdcd0 con 0x7f21301581e0 2024-04-25T08:57:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f21277fe640 1 -- 172.21.15.5:0/1031153417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118003830 con 0x7f21301581e0 2024-04-25T08:57:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.457+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213015fde0 con 0x7f21301581e0 2024-04-25T08:57:42.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.459+0000 7f21277fe640 1 -- 172.21.15.5:0/1031153417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f211801a070 con 0x7f21301581e0 2024-04-25T08:57:42.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.460+0000 7f21277fe640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f211006b4d0 0x7f211006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.460+0000 7f21277fe640 1 -- 172.21.15.5:0/1031153417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21180895a0 con 0x7f21301581e0 2024-04-25T08:57:42.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.460+0000 7f212effd640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f211006b4d0 0x7f211006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.461+0000 7f2137f73740 1 Processor -- start 2024-04-25T08:57:42.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.461+0000 7f2137f73740 1 -- start start 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.461+0000 7f212effd640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f211006b4d0 0x7f211006d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2120034000 tx=0x7f212002f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.461+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b354610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.461+0000 7f2137f73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b371ad0 0x55a81b372020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.461+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b329f10 0x55a81b370190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f2137f73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81b28ca10 con 0x55a81b371ad0 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81b235b30 con 0x55a81b329f10 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81b288c50 con 0x55a81b354230 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b371ad0 0x55a81b372020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212effd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b354610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b371ad0 0x55a81b372020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50348/0 (socket says 172.21.15.5:50348) 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 -- 172.21.15.5:0/2598520045 learned_addr learned my addr 172.21.15.5:0/2598520045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212f7fe640 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b329f10 0x55a81b370190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 -- 172.21.15.5:0/2598520045 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 msgr2=0x55a81b354610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b354610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 -- 172.21.15.5:0/2598520045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b329f10 msgr2=0x55a81b370190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b329f10 0x55a81b370190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 -- 172.21.15.5:0/2598520045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a81b24ae10 con 0x55a81b371ad0 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f212e7fc640 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b371ad0 0x55a81b372020 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f211805fe80 tx=0x7f211805bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc971faa58f7a59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f2124ff9640 1 -- 172.21.15.5:0/2598520045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211805e0c0 con 0x55a81b371ad0 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f2124ff9640 1 -- 172.21.15.5:0/2598520045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180543c0 con 0x55a81b371ad0 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.462+0000 7f2124ff9640 1 -- 172.21.15.5:0/2598520045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180892d0 con 0x55a81b371ad0 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 -- 172.21.15.5:0/2598520045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b371ad0 msgr2=0x55a81b372020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b371ad0 0x55a81b372020 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f211805fe80 tx=0x7f211805bf30 comp rx=0 tx=0).stop 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 -- 172.21.15.5:0/2598520045 shutdown_connections 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b329f10 0x55a81b370190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b371ad0 0x55a81b372020 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 --2- 172.21.15.5:0/2598520045 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b354610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 -- 172.21.15.5:0/2598520045 >> 172.21.15.5:0/2598520045 conn(0x55a81b326840 msgr2=0x55a81b36f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 -- 172.21.15.5:0/2598520045 shutdown_connections 2024-04-25T08:57:42.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.463+0000 7f2137f73740 1 -- 172.21.15.5:0/2598520045 wait complete. 2024-04-25T08:57:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 -- start start 2024-04-25T08:57:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 Processor -- start 2024-04-25T08:57:42.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b354230 0x55a81b37f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b371ad0 0x55a81b383650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81b32acb0 con 0x55a81b367f00 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81b2490c0 con 0x55a81b354230 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81b324770 con 0x55a81b371ad0 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.464+0000 7f2137f73740 10 client.0 _ll_register_callbacks cb 0x55a81b23cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50362/0 (socket says 172.21.15.5:50362) 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 -- 172.21.15.5:0/3838916208 learned_addr learned my addr 172.21.15.5:0/3838916208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212effd640 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b354230 0x55a81b37f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212e7fc640 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b371ad0 0x55a81b383650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 -- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b371ad0 msgr2=0x55a81b383650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b371ad0 0x55a81b383650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 -- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b354230 msgr2=0x55a81b37f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b354230 0x55a81b37f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 -- 172.21.15.5:0/3838916208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a81afa12d0 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f212f7fe640 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3234a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2128007700 tx=0x7f21280016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc87f86f9371eef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f210dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f210dffb640 1 -- 172.21.15.5:0/3838916208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128019020 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f210dffb640 1 -- 172.21.15.5:0/3838916208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2128015650 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21180543c0 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f210dffb640 1 -- 172.21.15.5:0/3838916208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2128023050 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f2137f73740 10 client.5304 fetch_fsmap learned FSMap version 13 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.465+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55a81b06b6b0 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f210dffb640 1 -- 172.21.15.5:0/3838916208 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180543c0 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f210dffb640 1 -- 172.21.15.5:0/3838916208 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2128026020 con 0x55a81b367f00 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f2137f73740 10 client.5304 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f2137f73740 10 client.5304 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:57:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f2137f73740 20 client.5304 populate_metadata read hostname 'smithi005' 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f2137f73740 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b380030 0x55a81b356540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f2137f73740 4 client.5304 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a81b2eb920 con 0x55a81b380030 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f212effd640 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b380030 0x55a81b356540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f212effd640 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b380030 0x55a81b356540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62d961d5d00f307 server_cookie=173198511547d3db in_seq=0 out_seq=0 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.466+0000 7f210dffb640 10 client.5304 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f210dffb640 1 -- 172.21.15.5:0/3838916208 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a81b2eb920 con 0x55a81b380030 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f210dffb640 10 client.5304 handle_command_reply: tid=0 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 client.5304 shutdown 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 msgr2=0x55a81b3234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3234a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2128007700 tx=0x7f21280016a0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 shutdown_connections 2024-04-25T08:57:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b380030 0x55a81b356540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3234a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b371ad0 0x55a81b383650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 --2- 172.21.15.5:0/3838916208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b354230 0x55a81b37f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 >> 172.21.15.5:0/3838916208 conn(0x55a81b329f10 msgr2=0x55a81b372e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f210dffb640 0 client.5304 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 shutdown_connections 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 1 -- 172.21.15.5:0/3838916208 wait complete. 2024-04-25T08:57:42.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.467+0000 7f2137f73740 20 client.5304 trim_cache size 0 max 16384 2024-04-25T08:57:42.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.483+0000 7f2137f73740 1 Processor -- start 2024-04-25T08:57:42.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.483+0000 7f2137f73740 1 -- start start 2024-04-25T08:57:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.483+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b3835c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.483+0000 7f2137f73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b356510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b356a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f2137f73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130161900 con 0x55a81b367f00 2024-04-25T08:57:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21301e94a0 con 0x55a81b371ad0 2024-04-25T08:57:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2130161300 con 0x55a81b354230 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b356510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b356510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50368/0 (socket says 172.21.15.5:50368) 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 -- 172.21.15.5:0/2058919763 learned_addr learned my addr 172.21.15.5:0/2058919763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212effd640 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b3835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212f7fe640 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b356a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 -- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 msgr2=0x55a81b3835c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b3835c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 -- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 msgr2=0x55a81b356a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b356a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 -- 172.21.15.5:0/2058919763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a81b323810 con 0x55a81b367f00 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212effd640 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b3835c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f212e7fc640 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b356510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2118087b20 tx=0x7f211805e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd56901006da48e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f210ffff640 1 -- 172.21.15.5:0/2058919763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118086070 con 0x55a81b367f00 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f210ffff640 1 -- 172.21.15.5:0/2058919763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118075240 con 0x55a81b367f00 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.484+0000 7f210ffff640 1 -- 172.21.15.5:0/2058919763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211805e0c0 con 0x55a81b367f00 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 -- 172.21.15.5:0/2058919763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 msgr2=0x55a81b356510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b356510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2118087b20 tx=0x7f211805e050 comp rx=0 tx=0).stop 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 -- 172.21.15.5:0/2058919763 shutdown_connections 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b356a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b356510 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 --2- 172.21.15.5:0/2058919763 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b3835c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 -- 172.21.15.5:0/2058919763 >> 172.21.15.5:0/2058919763 conn(0x55a81b329f10 msgr2=0x55a81b371380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 -- 172.21.15.5:0/2058919763 shutdown_connections 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 -- 172.21.15.5:0/2058919763 wait complete. 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 -- start start 2024-04-25T08:57:42.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.485+0000 7f2137f73740 1 Processor -- start 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b356890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f2137f73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3649d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f2137f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b364f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f2137f73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81b37feb0 con 0x55a81b367f00 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a81b368bc0 con 0x55a81b371ad0 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f2137f73740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81b3804b0 con 0x55a81b354230 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f2137f73740 10 client.0 _ll_register_callbacks cb 0x55a81b324c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50376/0 (socket says 172.21.15.5:50376) 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f212e7fc640 1 -- 172.21.15.5:0/1987757863 learned_addr learned my addr 172.21.15.5:0/1987757863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f212effd640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b356890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f212f7fe640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b364f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f212e7fc640 1 -- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 msgr2=0x55a81b356890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.486+0000 7f212e7fc640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b356890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f212e7fc640 1 -- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 msgr2=0x55a81b364f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f212e7fc640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b364f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f212e7fc640 1 -- 172.21.15.5:0/1987757863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a81b3674a0 con 0x55a81b367f00 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f212f7fe640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b364f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f212e7fc640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3649d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2118057ce0 tx=0x7f2118005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1c8ffce9f6bb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f210dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f210dffb640 1 -- 172.21.15.5:0/1987757863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118086070 con 0x55a81b367f00 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f210dffb640 1 -- 172.21.15.5:0/1987757863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21180892d0 con 0x55a81b367f00 2024-04-25T08:57:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2118075240 con 0x55a81b367f00 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f210dffb640 1 -- 172.21.15.5:0/1987757863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f211805e0b0 con 0x55a81b367f00 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 10 client.5310 fetch_fsmap learned FSMap version 13 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55a81b3674a0 con 0x55a81b367f00 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f210dffb640 1 -- 172.21.15.5:0/1987757863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118075240 con 0x55a81b367f00 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f210dffb640 1 -- 172.21.15.5:0/1987757863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f21180571a0 con 0x55a81b367f00 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 10 client.5310 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 10 client.5310 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 20 client.5310 populate_metadata read hostname 'smithi005' 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b3290f0 0x55a81b354ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 4 client.5310 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a81b299f50 con 0x55a81b3290f0 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.487+0000 7f212effd640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b3290f0 0x55a81b354ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f212effd640 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b3290f0 0x55a81b354ef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a9e42c8cded9d10 server_cookie=3f29d98aac6bc745 in_seq=0 out_seq=0 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f210dffb640 10 client.5310 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f210dffb640 1 -- 172.21.15.5:0/1987757863 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a81b299f50 con 0x55a81b3290f0 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f210dffb640 10 client.5310 handle_command_reply: tid=0 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 client.5310 shutdown 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 msgr2=0x55a81b3649d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3649d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2118057ce0 tx=0x7f2118005040 comp rx=0 tx=0).stop 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 shutdown_connections 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55a81b3290f0 0x55a81b354ef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a81b371ad0 0x55a81b364f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a81b367f00 0x55a81b3649d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 --2- 172.21.15.5:0/1987757863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a81b354230 0x55a81b356890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f210dffb640 0 client.5310 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 >> 172.21.15.5:0/1987757863 conn(0x55a81b329f10 msgr2=0x55a81b37f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 shutdown_connections 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 1 -- 172.21.15.5:0/1987757863 wait complete. 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.488+0000 7f2137f73740 20 client.5310 trim_cache size 0 max 16384 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5112, 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 9.0933873740000006, 2024-04-25T08:57:42.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 13, 2024-04-25T08:57:42.486 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 31, 2024-04-25T08:57:42.486 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 31, 2024-04-25T08:57:42.486 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.956466325999999 2024-04-25T08:57:42.486 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:57:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f211006b4d0 msgr2=0x7f211006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f211006b4d0 0x7f211006d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2120034000 tx=0x7f212002f000 comp rx=0 tx=0).stop 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21301581e0 msgr2=0x7f2130154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21301581e0 0x7f2130154230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f211800c460 tx=0x7f211800c920 comp rx=0 tx=0).stop 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 shutdown_connections 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f211006b4d0 0x7f211006d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f213015ef00 0x7f21300cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21301581e0 0x7f2130154230 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 --2- 172.21.15.5:0/1031153417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2130067000 0x7f21300cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 >> 172.21.15.5:0/1031153417 conn(0x7f21300d0870 msgr2=0x7f213006d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 shutdown_connections 2024-04-25T08:57:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.489+0000 7f213526f640 1 -- 172.21.15.5:0/1031153417 wait complete. 2024-04-25T08:57:42.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:57:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.601+0000 7fb421a37640 1 Processor -- start 2024-04-25T08:57:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.601+0000 7fb421a37640 1 -- start start 2024-04-25T08:57:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.602+0000 7fb421a37640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb41c0cd2f0 0x7fb41c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.602+0000 7fb421a37640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c159a90 con 0x7fb41c1596b0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.602+0000 7fb421a37640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c15c100 con 0x7fb41c066e30 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.602+0000 7fb421a37640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41c15c3c0 con 0x7fb41c0cd2f0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.602+0000 7fb41affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb41c1596b0 0x7fb41c06f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38994/0 (socket says 172.21.15.5:38994) 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.602+0000 7fb41affd640 1 -- 172.21.15.5:0/4203505765 learned_addr learned my addr 172.21.15.5:0/4203505765 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41a7fc640 1 --2- 172.21.15.5:0/4203505765 >> v2:172.21.15.80:3300/0 conn(0x7fb41c0cd2f0 0x7fb41c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535810593 0 0) 0x7fb41c159a90 con 0x7fb41c1596b0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb408003520 con 0x7fb41c1596b0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 635151399 0 0) 0x7fb408003520 con 0x7fb41c1596b0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 >> v2:172.21.15.80:3300/0 conn(0x7fb41c0cd2f0 msgr2=0x7fb41c0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 --2- 172.21.15.5:0/4203505765 >> v2:172.21.15.80:3300/0 conn(0x7fb41c0cd2f0 0x7fb41c0668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 >> v1:172.21.15.80:6789/0 conn(0x7fb41c066e30 legacy=0x7fb41c15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c15c6a0 con 0x7fb41c1596b0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb414001670 con 0x7fb41c1596b0 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 >> v1:172.21.15.5:6789/0 conn(0x7fb41c1596b0 legacy=0x7fb41c06f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4080039b0 0x7fb408003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4080043b0 0x7fb408004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb408005080 0x7fb40800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c15c3c0 con 0x7fb4080039b0 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40800bfe0 con 0x7fb408005080 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40800c1e0 con 0x7fb4080043b0 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41affd640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4080039b0 0x7fb408003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41a7fc640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4080043b0 0x7fb408004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41b7fe640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb408005080 0x7fb40800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41affd640 1 -- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4080043b0 msgr2=0x7fb408004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41affd640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4080043b0 0x7fb408004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41affd640 1 -- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb408005080 msgr2=0x7fb40800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41affd640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb408005080 0x7fb40800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41b7fe640 1 -- 172.21.15.5:0/4203505765 reap_dead start 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41affd640 1 -- 172.21.15.5:0/4203505765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408003520 con 0x7fb4080039b0 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.603+0000 7fb41a7fc640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4080043b0 0x7fb408004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.604+0000 7fb41affd640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4080039b0 0x7fb408003d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c210 tx=0x7fb408005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873f87b29acfe75f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.604+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414007d30 con 0x7fb4080039b0 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.604+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414033070 con 0x7fb4080039b0 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.604+0000 7fb419ffb640 1 -- 172.21.15.5:0/4203505765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414005d70 con 0x7fb4080039b0 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.605+0000 7fb421a37640 1 -- 172.21.15.5:0/4203505765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4080039b0 msgr2=0x7fb408003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.605+0000 7fb421a37640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4080039b0 0x7fb408003d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c210 tx=0x7fb408005830 comp rx=0 tx=0).stop 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.605+0000 7fb421a37640 1 -- 172.21.15.5:0/4203505765 shutdown_connections 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.605+0000 7fb421a37640 1 --2- 172.21.15.5:0/4203505765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4080039b0 0x7fb408003d90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.605+0000 7fb421a37640 1 -- 172.21.15.5:0/4203505765 >> 172.21.15.5:0/4203505765 conn(0x7fb41c0d0870 msgr2=0x7fb41c0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.605+0000 7fb421a37640 1 -- 172.21.15.5:0/4203505765 shutdown_connections 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.605+0000 7fb421a37640 1 -- 172.21.15.5:0/4203505765 wait complete. 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.606+0000 7fb421a37640 1 Processor -- start 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.606+0000 7fb421a37640 1 -- start start 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb421a37640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4080039b0 0x7fb41c13f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb421a37640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb41c152310 0x7fb41c142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb421a37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41c1401b0 0x7fb41c140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb421a37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c06da40 con 0x7fb41c1401b0 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb421a37640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c06d8c0 con 0x7fb4080039b0 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb421a37640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0668f0 con 0x7fb41c152310 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41c1401b0 0x7fb41c140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41c1401b0 0x7fb41c140630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50384/0 (socket says 172.21.15.5:50384) 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 -- 172.21.15.5:0/1336309006 learned_addr learned my addr 172.21.15.5:0/1336309006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41affd640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4080039b0 0x7fb41c13f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41a7fc640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb41c152310 0x7fb41c142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 -- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb41c152310 msgr2=0x7fb41c142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb41c152310 0x7fb41c142210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 -- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4080039b0 msgr2=0x7fb41c13f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4080039b0 0x7fb41c13f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.607+0000 7fb41b7fe640 1 -- 172.21.15.5:0/1336309006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c13fee0 con 0x7fb41c1401b0 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.608+0000 7fb41b7fe640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41c1401b0 0x7fb41c140630 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb41c071050 tx=0x7fb40c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.608+0000 7fb413fff640 1 -- 172.21.15.5:0/1336309006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c003970 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.608+0000 7fb413fff640 1 -- 172.21.15.5:0/1336309006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c018070 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.608+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c142b40 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.608+0000 7fb413fff640 1 -- 172.21.15.5:0/1336309006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c003d50 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.608+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c143100 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.609+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c06f850 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.609+0000 7fb413fff640 1 -- 172.21.15.5:0/1336309006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb40c0050d0 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.610+0000 7fb413fff640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.610+0000 7fb413fff640 1 -- 172.21.15.5:0/1336309006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb40c089fe0 con 0x7fb41c1401b0 2024-04-25T08:57:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.610+0000 7fb41affd640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.611+0000 7fb41affd640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb414037000 tx=0x7fb41403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.614+0000 7fb413fff640 1 -- 172.21.15.5:0/1336309006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb41c06f850 con 0x7fb41c1401b0 2024-04-25T08:57:42.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.831+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb41c0d14d0 con 0x7fb41c1401b0 2024-04-25T08:57:42.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.832+0000 7fb413fff640 1 -- 172.21.15.5:0/1336309006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb40c058eb0 con 0x7fb41c1401b0 2024-04-25T08:57:42.821 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:57:42.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.833+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 msgr2=0x7fb3fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.833+0000 7fb421a37640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb414037000 tx=0x7fb41403c040 comp rx=0 tx=0).stop 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.833+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41c1401b0 msgr2=0x7fb41c140630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.833+0000 7fb421a37640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41c1401b0 0x7fb41c140630 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb41c071050 tx=0x7fb40c00eb90 comp rx=0 tx=0).stop 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 shutdown_connections 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3fc06b500 0x7fb3fc06d9c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb41c1401b0 0x7fb41c140630 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb41c152310 0x7fb41c142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 --2- 172.21.15.5:0/1336309006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4080039b0 0x7fb41c13f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 >> 172.21.15.5:0/1336309006 conn(0x7fb41c0d0870 msgr2=0x7fb41c15a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 shutdown_connections 2024-04-25T08:57:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:42.834+0000 7fb421a37640 1 -- 172.21.15.5:0/1336309006 wait complete. 2024-04-25T08:57:42.834 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:57:42.834 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:57:42.834 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T08:57:42.834 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:57:42.834 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:57:42.835 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:57:42.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:57:42.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:57:42.835 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:57:42.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:42.835 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T08:57:42.850 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:42.851 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42697sec preferred_lft 42697sec 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:57:42.852 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:57:42.853 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T08:57:42.853 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:42.853 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:57:42.853 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:57:42.853 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T08:57:42.853 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:42.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:42.853 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:57:42.915 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T08:57:42.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:42.916 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T08:57:42.974 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T08:57:42.974 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:57:42.974 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:57:42.974 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:57:42.974 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:57:42.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:42.974 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:57:42.975 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:57:42.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:57:42.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:57:42.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:57:42.975 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:57:43.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:43.061 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T08:57:43.076 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:57:43.076 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:57:43.076 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:57:43.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:43.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T08:57:43.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:43.142 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:57:43.196 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:57:43.197 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:43.197 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:57:43.252 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T08:57:43.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:43.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:43.335 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:43.335 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:43.343 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:57:43.343 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:57:43.343 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T08:57:43.343 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T08:57:43.343 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T08:57:43.344 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:57:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:57:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:57:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:57:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:57:43.346 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:57:43.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:43.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:57:43.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:43.412 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:57:43.472 INFO:teuthology.orchestra.run.smithi005.stdout:client5077 2024-04-25T08:57:43.472 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:43.473 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:43.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-04-25T08:57:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.685+0000 7fe8bab5c640 1 Processor -- start 2024-04-25T08:57:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.685+0000 7fe8bab5c640 1 -- start start 2024-04-25T08:57:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8bab5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8bab5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8b415fbf0 0x7fe8b4160060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8bab5c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b415c6b0 con 0x7fe8b40b44d0 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8bab5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b415cf50 con 0x7fe8b415fbf0 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8bab5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b415c990 con 0x7fe8b4155f50 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8b90f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8b415fbf0 0x7fe8b4160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8b3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe8b40b44d0 0x7fe8b406c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38998/0 (socket says 172.21.15.5:38998) 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.686+0000 7fe8b3fff640 1 -- 172.21.15.5:0/2640511449 learned_addr learned my addr 172.21.15.5:0/2640511449 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.687+0000 7fe8b88f8640 1 --2- 172.21.15.5:0/2640511449 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.687+0000 7fe8b90f9640 1 -- 172.21.15.5:0/2640511449 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 msgr2=0x7fe8b415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.687+0000 7fe8b90f9640 1 --2- 172.21.15.5:0/2640511449 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.687+0000 7fe8b90f9640 1 -- 172.21.15.5:0/2640511449 >> v1:172.21.15.5:6789/0 conn(0x7fe8b40b44d0 legacy=0x7fe8b406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.687+0000 7fe8b90f9640 1 -- 172.21.15.5:0/2640511449 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b415cc70 con 0x7fe8b415fbf0 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.687+0000 7fe8b90f9640 1 --2- 172.21.15.5:0/2640511449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4160060 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0097a0 tx=0x7fe89c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b21739075d8b71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.687+0000 7fe8b37fe640 1 -- 172.21.15.5:0/2640511449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c037070 con 0x7fe8b415fbf0 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8b37fe640 1 -- 172.21.15.5:0/2640511449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c02ae50 con 0x7fe8b415fbf0 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8b37fe640 1 -- 172.21.15.5:0/2640511449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c032660 con 0x7fe8b415fbf0 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 -- 172.21.15.5:0/2640511449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b415fbf0 msgr2=0x7fe8b4160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/2640511449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4160060 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0097a0 tx=0x7fe89c02a100 comp rx=0 tx=0).stop 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 -- 172.21.15.5:0/2640511449 shutdown_connections 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/2640511449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4160060 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/2640511449 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 -- 172.21.15.5:0/2640511449 >> 172.21.15.5:0/2640511449 conn(0x7fe8b40668f0 msgr2=0x7fe8b4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 -- 172.21.15.5:0/2640511449 shutdown_connections 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.688+0000 7fe8bab5c640 1 -- 172.21.15.5:0/2640511449 wait complete. 2024-04-25T08:57:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.689+0000 7fe8bab5c640 1 Processor -- start 2024-04-25T08:57:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.689+0000 7fe8bab5c640 1 -- start start 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8bab5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b40b44d0 0x7fe8b41e7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8bab5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8bab5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8bab5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b406c870 con 0x7fe8b40b44d0 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8bab5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40b4950 con 0x7fe8b415fbf0 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8bab5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41e61f0 con 0x7fe8b4155f50 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8b88f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b40b44d0 0x7fe8b41e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8b88f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b40b44d0 0x7fe8b41e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50394/0 (socket says 172.21.15.5:50394) 2024-04-25T08:57:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8b88f8640 1 -- 172.21.15.5:0/1963880425 learned_addr learned my addr 172.21.15.5:0/1963880425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8b3fff640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.690+0000 7fe8b90f9640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b88f8640 1 -- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 msgr2=0x7fe8b415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b88f8640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b88f8640 1 -- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b415fbf0 msgr2=0x7fe8b4143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b88f8640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b88f8640 1 -- 172.21.15.5:0/1963880425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b41e5340 con 0x7fe8b40b44d0 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b90f9640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b3fff640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b88f8640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b40b44d0 0x7fe8b41e7590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac007f20 tx=0x7fe8ac00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b17fa640 1 -- 172.21.15.5:0/1963880425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac014620 con 0x7fe8b40b44d0 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b17fa640 1 -- 172.21.15.5:0/1963880425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac019070 con 0x7fe8b40b44d0 2024-04-25T08:57:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b41e55e0 con 0x7fe8b40b44d0 2024-04-25T08:57:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8b17fa640 1 -- 172.21.15.5:0/1963880425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac014a00 con 0x7fe8b40b44d0 2024-04-25T08:57:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.691+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b41e5ba0 con 0x7fe8b40b44d0 2024-04-25T08:57:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.692+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b404ef20 con 0x7fe8b40b44d0 2024-04-25T08:57:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.692+0000 7fe8b17fa640 1 -- 172.21.15.5:0/1963880425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe8ac014ba0 con 0x7fe8b40b44d0 2024-04-25T08:57:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.693+0000 7fe8b17fa640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe89406b4d0 0x7fe89406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.693+0000 7fe8b17fa640 1 -- 172.21.15.5:0/1963880425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8ac08ab20 con 0x7fe8b40b44d0 2024-04-25T08:57:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.693+0000 7fe8b3fff640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe89406b4d0 0x7fe89406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.694+0000 7fe8b3fff640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe89406b4d0 0x7fe89406d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4151960 tx=0x7fe8a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.697+0000 7fe8b17fa640 1 -- 172.21.15.5:0/1963880425 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8ac0599a0 con 0x7fe8b40b44d0 2024-04-25T08:57:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:43.914+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe8b40b4160 con 0x7fe8b40b44d0 2024-04-25T08:57:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.589+0000 7fe8b17fa640 1 -- 172.21.15.5:0/1963880425 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v14) v1 ==== 167+0+0 (secure 0 0 0) 0x7fe8ac0592a0 con 0x7fe8b40b44d0 2024-04-25T08:57:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:enabled new snapshots 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe89406b4d0 msgr2=0x7fe89406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe89406b4d0 0x7fe89406d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4151960 tx=0x7fe8a4009040 comp rx=0 tx=0).stop 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b40b44d0 msgr2=0x7fe8b41e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b40b44d0 0x7fe8b41e7590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac007f20 tx=0x7fe8ac00e570 comp rx=0 tx=0).stop 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 shutdown_connections 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe89406b4d0 0x7fe89406d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b415fbf0 0x7fe8b4143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe8b4155f50 0x7fe8b415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 --2- 172.21.15.5:0/1963880425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b40b44d0 0x7fe8b41e7590 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 >> 172.21.15.5:0/1963880425 conn(0x7fe8b40668f0 msgr2=0x7fe8b40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:44.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 shutdown_connections 2024-04-25T08:57:44.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:57:44.592+0000 7fe8bab5c640 1 -- 172.21.15.5:0/1963880425 wait complete. 2024-04-25T08:57:44.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:44.595 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-04-25T08:57:44.617 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:57:44.617 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:44.675 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-04-25T08:57:44.675 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-25T08:57:44.675 DEBUG:teuthology.orchestra.run.smithi005:> import uuid 2024-04-25T08:57:44.675 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> n = 2000 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = False 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> if 3 > 0: 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = True 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> dpath = os.path.dirname(path) 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> fnameprefix = os.path.basename(path) 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> os.makedirs(dpath, exist_ok=True) 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> for i in range(n): 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> with open(fpath, '"'"'w'"'"') as f: 2024-04-25T08:57:44.676 DEBUG:teuthology.orchestra.run.smithi005:> f.write(f"{i}") 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> f.flush() 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(f.fileno()) 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> os.unlink(fpath) 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> if create_hard_links: 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> for j in range(3): 2024-04-25T08:57:44.677 DEBUG:teuthology.orchestra.run.smithi005:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-25T08:57:44.678 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T08:57:44.678 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-04-25T08:57:44.678 DEBUG:teuthology.orchestra.run.smithi005:> finally: 2024-04-25T08:57:44.678 DEBUG:teuthology.orchestra.run.smithi005:> os.close(dirfd) 2024-04-25T08:57:44.678 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-25T08:57:46.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:57:46.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:02.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:58:02.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:02.473 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:02.533 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-04-25T08:58:16.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:16.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:27.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:27.892 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T08:58:27.948 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:58:27.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-04-25T08:58:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.061+0000 7f1ef18bd640 1 Processor -- start 2024-04-25T08:58:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.061+0000 7f1ef18bd640 1 -- start start 2024-04-25T08:58:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1ef18bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 0x7f1eec1619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1ef18bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec15e460 con 0x7f1eec154d80 2024-04-25T08:58:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1ef18bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec15e740 con 0x7f1eec067000 2024-04-25T08:58:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1ef18bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec155160 con 0x7f1eec0724a0 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1eeaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1eec154d80 0x7f1eec0668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50642/0 (socket says 172.21.15.5:50642) 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1eeaffd640 1 -- 172.21.15.5:0/465014526 learned_addr learned my addr 172.21.15.5:0/465014526 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654626937 0 0) 0x7f1eec15e460 con 0x7f1eec154d80 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed8003520 con 0x7f1eec154d80 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.062+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 0x7f1eec1619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940592106 0 0) 0x7f1ed8003520 con 0x7f1eec154d80 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 msgr2=0x7f1eec1619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 0x7f1eec1619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 >> v1:172.21.15.80:6789/0 conn(0x7f1eec067000 legacy=0x7f1eec0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec15ea20 con 0x7f1eec154d80 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1edc0019f0 con 0x7f1eec154d80 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 >> v1:172.21.15.5:6789/0 conn(0x7f1eec154d80 legacy=0x7f1eec0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed80039e0 0x7f1ed8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 0x7f1ed8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8004d40 0x7f1ed80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec155160 con 0x7f1ed8004d40 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800bad0 con 0x7f1ed80039e0 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800bcd0 con 0x7f1eec0724a0 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8004d40 0x7f1ed80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed80039e0 0x7f1ed8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 0x7f1ed8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 msgr2=0x7f1ed8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec0724a0 0x7f1ed8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed80039e0 msgr2=0x7f1ed8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed80039e0 0x7f1ed8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.063+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/465014526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8003520 con 0x7f1ed8004d40 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.064+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8004d40 0x7f1ed80051c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1eec072930 tx=0x7f1ed8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d176d5de5def05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.064+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4036070 con 0x7f1ed8004d40 2024-04-25T08:58:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.064+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4031400 con 0x7f1ed8004d40 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.064+0000 7f1ee9ffb640 1 -- 172.21.15.5:0/465014526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4009690 con 0x7f1ed8004d40 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.065+0000 7f1ef18bd640 1 -- 172.21.15.5:0/465014526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8004d40 msgr2=0x7f1ed80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.065+0000 7f1ef18bd640 1 --2- 172.21.15.5:0/465014526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8004d40 0x7f1ed80051c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1eec072930 tx=0x7f1ed8005830 comp rx=0 tx=0).stop 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.065+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/465014526 reap_dead start 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.065+0000 7f1ef18bd640 1 -- 172.21.15.5:0/465014526 shutdown_connections 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.065+0000 7f1ef18bd640 1 -- 172.21.15.5:0/465014526 >> 172.21.15.5:0/465014526 conn(0x7f1eec0cd310 msgr2=0x7f1eec0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.065+0000 7f1ef18bd640 1 -- 172.21.15.5:0/465014526 shutdown_connections 2024-04-25T08:58:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.065+0000 7f1ef18bd640 1 -- 172.21.15.5:0/465014526 wait complete. 2024-04-25T08:58:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.066+0000 7f1ef18bd640 1 Processor -- start 2024-04-25T08:58:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.066+0000 7f1ef18bd640 1 -- start start 2024-04-25T08:58:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1ef18bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed8004d40 0x7f1eec1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1ef18bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eec0b3590 0x7f1eec0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1ef18bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec15fcc0 0x7f1eec160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1ef18bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0affc0 con 0x7f1eec0b3590 2024-04-25T08:58:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1ef18bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0b0140 con 0x7f1ed8004d40 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1ef18bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0b02c0 con 0x7f1eec15fcc0 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eec0b3590 0x7f1eec0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eec0b3590 0x7f1eec0b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45240/0 (socket says 172.21.15.5:45240) 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2598388051 learned_addr learned my addr 172.21.15.5:0/2598388051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec15fcc0 0x7f1eec160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed8004d40 0x7f1eec1424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec15fcc0 msgr2=0x7f1eec160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec15fcc0 0x7f1eec160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed8004d40 msgr2=0x7f1eec1424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed8004d40 0x7f1eec1424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.067+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2598388051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec142a10 con 0x7f1eec0b3590 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.068+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eec0b3590 0x7f1eec0b39f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400f5f0 tx=0x7f1ed400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.068+0000 7f1ee3fff640 1 -- 172.21.15.5:0/2598388051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40052e0 con 0x7f1eec0b3590 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.068+0000 7f1ee3fff640 1 -- 172.21.15.5:0/2598388051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed4018070 con 0x7f1eec0b3590 2024-04-25T08:58:28.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.068+0000 7f1ee3fff640 1 -- 172.21.15.5:0/2598388051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4003810 con 0x7f1eec0b3590 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.068+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec0b3fe0 con 0x7f1eec0b3590 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.068+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec0b45a0 con 0x7f1eec0b3590 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.069+0000 7f1ee3fff640 1 -- 172.21.15.5:0/2598388051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ed40039b0 con 0x7f1eec0b3590 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.070+0000 7f1ee3fff640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1ecc06b4d0 0x7f1ecc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.070+0000 7f1ee3fff640 1 -- 172.21.15.5:0/2598388051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed4089d80 con 0x7f1eec0b3590 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.070+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1ecc06b4d0 0x7f1ecc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.070+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1ecc06b4d0 0x7f1ecc06d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1edc004de0 tx=0x7f1edc006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 Processor -- start 2024-04-25T08:58:28.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 -- start start 2024-04-25T08:58:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349e5370 0x560d349a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3490bb90 con 0x560d349d3760 2024-04-25T08:58:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d348b4e40 con 0x560d349e5370 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.071+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d34907c30 con 0x560d349a8ca0 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349d3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45256/0 (socket says 172.21.15.5:45256) 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/1446856586 learned_addr learned my addr 172.21.15.5:0/1446856586 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349e5370 0x560d349a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 msgr2=0x560d349aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349e5370 msgr2=0x560d349a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349e5370 0x560d349a9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/1446856586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d346ea7d0 con 0x560d349d3760 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349d3be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009b80 tx=0x7f1ee402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e737df066d8b2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1ee17fa640 1 -- 172.21.15.5:0/1446856586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4036040 con 0x560d349d3760 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1ee17fa640 1 -- 172.21.15.5:0/1446856586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4005b90 con 0x560d349d3760 2024-04-25T08:58:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.072+0000 7f1ee17fa640 1 -- 172.21.15.5:0/1446856586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4009750 con 0x560d349d3760 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 -- 172.21.15.5:0/1446856586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 msgr2=0x560d349d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349d3be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009b80 tx=0x7f1ee402e000 comp rx=0 tx=0).stop 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 -- 172.21.15.5:0/1446856586 shutdown_connections 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349d3be0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349e5370 0x560d349a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/1446856586 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 -- 172.21.15.5:0/1446856586 >> 172.21.15.5:0/1446856586 conn(0x560d34970870 msgr2=0x560d349ee760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 -- 172.21.15.5:0/1446856586 shutdown_connections 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.073+0000 7f1ef45c2740 1 -- 172.21.15.5:0/1446856586 wait complete. 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.074+0000 7f1ef45c2740 1 -- start start 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.074+0000 7f1ef45c2740 1 Processor -- start 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.074+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349a8ca0 0x560d349bc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.074+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.074+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349e5370 0x560d349f0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.074+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d348c83e0 con 0x560d349d3760 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.074+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d349d12b0 con 0x560d349a8ca0 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d349bdb30 con 0x560d349e5370 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1ef45c2740 10 client.0 _ll_register_callbacks cb 0x560d348c7db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349e5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45262/0 (socket says 172.21.15.5:45262) 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2697371088 learned_addr learned my addr 172.21.15.5:0/2697371088 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349a8ca0 0x560d349bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349e5370 0x560d349f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349e5370 msgr2=0x560d349f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349e5370 0x560d349f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349a8ca0 msgr2=0x560d349bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349a8ca0 0x560d349bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 -- 172.21.15.5:0/2697371088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d345e00f0 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349e5370 0x560d349f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349e5cb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4088360 tx=0x7f1ed4058830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7116c35c568e8a7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eca7fc640 1 -- 172.21.15.5:0/2697371088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4057b50 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eca7fc640 1 -- 172.21.15.5:0/2697371088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed4057cf0 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ee4005b90 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eca7fc640 1 -- 172.21.15.5:0/2697371088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ed4077080 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1ef45c2740 10 client.5337 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x560d3474af60 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.075+0000 7f1eca7fc640 1 -- 172.21.15.5:0/2697371088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4005b90 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1eca7fc640 1 -- 172.21.15.5:0/2697371088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ed4054450 con 0x560d349d3760 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1ef45c2740 10 client.5337 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1ef45c2740 10 client.5337 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1ef45c2740 20 client.5337 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349ce270 0x560d349bcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1ef45c2740 4 client.5337 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d349190d0 con 0x560d349ce270 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349ce270 0x560d349bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1eca7fc640 10 client.5337 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.076+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349ce270 0x560d349bcb20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52dda273de33ad21 server_cookie=5fd7168644b4bf49 in_seq=0 out_seq=0 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1eca7fc640 1 -- 172.21.15.5:0/2697371088 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d349190d0 con 0x560d349ce270 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1eca7fc640 10 client.5337 handle_command_reply: tid=0 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 client.5337 shutdown 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 msgr2=0x560d349e5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349e5cb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4088360 tx=0x7f1ed4058830 comp rx=0 tx=0).stop 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 shutdown_connections 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349ce270 0x560d349bcb20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349e5370 0x560d349f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349d3760 0x560d349e5cb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/2697371088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349a8ca0 0x560d349bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 >> 172.21.15.5:0/2697371088 conn(0x560d34970870 msgr2=0x560d349f1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1eca7fc640 0 client.5337 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 shutdown_connections 2024-04-25T08:58:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 1 -- 172.21.15.5:0/2697371088 wait complete. 2024-04-25T08:58:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.077+0000 7f1ef45c2740 20 client.5337 trim_cache size 0 max 16384 2024-04-25T08:58:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.091+0000 7f1ef45c2740 1 Processor -- start 2024-04-25T08:58:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.091+0000 7f1ef45c2740 1 -- start start 2024-04-25T08:58:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d349ee970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec2006a0 con 0x560d349e5370 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec157a70 con 0x560d349d3760 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec155f90 con 0x560d349a8ca0 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349d2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45272/0 (socket says 172.21.15.5:45272) 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/3733550806 learned_addr learned my addr 172.21.15.5:0/3733550806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.092+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d349ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 msgr2=0x560d349bc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349bc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 msgr2=0x560d349ee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d349ee970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/3733550806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d349a7000 con 0x560d349e5370 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349d2be0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402ab50 tx=0x7f1ee402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bfdebe0e73f0a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1ee0ff9640 1 -- 172.21.15.5:0/3733550806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee404b070 con 0x560d349e5370 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1ee0ff9640 1 -- 172.21.15.5:0/3733550806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4005b90 con 0x560d349e5370 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1ee0ff9640 1 -- 172.21.15.5:0/3733550806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4042040 con 0x560d349e5370 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1ef45c2740 1 -- 172.21.15.5:0/3733550806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 msgr2=0x560d349d2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.093+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349d2be0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402ab50 tx=0x7f1ee402f000 comp rx=0 tx=0).stop 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 -- 172.21.15.5:0/3733550806 shutdown_connections 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349d2be0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d349ee970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/3733550806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d349bc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 -- 172.21.15.5:0/3733550806 >> 172.21.15.5:0/3733550806 conn(0x560d34970870 msgr2=0x560d34a00ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 -- 172.21.15.5:0/3733550806 shutdown_connections 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 -- 172.21.15.5:0/3733550806 wait complete. 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 -- start start 2024-04-25T08:58:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.094+0000 7f1ef45c2740 1 Processor -- start 2024-04-25T08:58:28.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d34a41bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d34a10bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1ef45c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d349a2be0 con 0x560d349e5370 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec157470 con 0x560d349d3760 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1ef45c2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d349169b0 con 0x560d349a8ca0 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1ef45c2740 10 client.0 _ll_register_callbacks cb 0x7f1ed400f540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349bc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45278/0 (socket says 172.21.15.5:45278) 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/259161527 learned_addr learned my addr 172.21.15.5:0/259161527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d34a41bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d34a10bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 msgr2=0x560d34a41bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d34a41bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 msgr2=0x560d34a10bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d34a10bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eeb7fe640 1 -- 172.21.15.5:0/259161527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d349bbc40 con 0x560d349e5370 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.095+0000 7f1eea7fc640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d34a10bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eeb7fe640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349bc270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4034040 tx=0x7f1ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9930e2c64c2f898f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eca7fc640 1 -- 172.21.15.5:0/259161527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4042070 con 0x560d349e5370 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eca7fc640 1 -- 172.21.15.5:0/259161527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ee4005d40 con 0x560d349e5370 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ee4005b90 con 0x560d349e5370 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eca7fc640 1 -- 172.21.15.5:0/259161527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ee405c050 con 0x560d349e5370 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 10 client.5343 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x560d345b91b0 con 0x560d349e5370 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eca7fc640 1 -- 172.21.15.5:0/259161527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4005b90 con 0x560d349e5370 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eca7fc640 1 -- 172.21.15.5:0/259161527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ee405f020 con 0x560d349e5370 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 10 client.5343 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 10 client.5343 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 20 client.5343 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349bc7b0 0x560d349a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 4 client.5343 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x560d34913420 con 0x560d349bc7b0 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.096+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349bc7b0 0x560d349a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1eca7fc640 10 client.5343 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1eeaffd640 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349bc7b0 0x560d349a78b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=826853bc1503b9a7 server_cookie=9474278459ce9d9f in_seq=0 out_seq=0 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1eca7fc640 1 -- 172.21.15.5:0/259161527 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17919 (crc 0 0 0) 0x560d34913420 con 0x560d349bc7b0 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1eca7fc640 10 client.5343 handle_command_reply: tid=0 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 client.5343 shutdown 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 msgr2=0x560d349bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349bc270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4034040 tx=0x7f1ee40046c0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 shutdown_connections 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x560d349bc7b0 0x560d349a78b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d349e5370 0x560d349bc270 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d349d3760 0x560d34a10bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1eca7fc640 0 client.5343 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 --2- 172.21.15.5:0/259161527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560d349a8ca0 0x560d34a41bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 >> 172.21.15.5:0/259161527 conn(0x560d34970870 msgr2=0x560d349a37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 shutdown_connections 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 1 -- 172.21.15.5:0/259161527 wait complete. 2024-04-25T08:58:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.097+0000 7f1ef45c2740 20 client.5343 trim_cache size 0 max 16384 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1660, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1661, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 417199, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 38063507, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 9, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 3, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.261384365, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.151888445, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.037553900, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.059010037, 2024-04-25T08:58:28.094 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1660, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.295492384, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000178007 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000125, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000062 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.095 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 27776, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 49864, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 9199902, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 43281757, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 3.516125644, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 2.445012090, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.535574158, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.036428885, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 49863, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.263891098, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000025347 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.096 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 72869, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.009692850, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000133 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 104960 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2078, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2071, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 814359, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 29113389, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T08:58:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.239424215, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.117292127, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.050581457, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.063323720, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2071, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.340921153, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000164616 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 116816, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 18288 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1557, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.108077940, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.010345586 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1826, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.047739605, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000573789 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 25637, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 25637, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 25637, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 270.269273053, 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.010542156 2024-04-25T08:58:28.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 19856, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 19856, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 19856, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 86, 2024-04-25T08:58:28.101 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 86, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 46683, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 46152, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 126, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-04-25T08:58:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2024-04-25T08:58:28.103 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 1256, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4042, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 3262, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2127, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 50, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 14024 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-04-25T08:58:28.104 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 2000, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 97, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4091, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 1819, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2210, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-04-25T08:58:28.105 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 24839, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 24839, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 36, 2024-04-25T08:58:28.106 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 36, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 94380536, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2600, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 77.101374571, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.029654374 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-04-25T08:58:28.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 2014, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2014, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 0, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 19856, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19857, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 1, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 86, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 7057, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 6971, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 115508, 2024-04-25T08:58:28.108 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 215396 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 28623, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 25637, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 3, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.334066105, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000667033 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-04-25T08:58:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003900570, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000134502 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.957803415, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001326300 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-04-25T08:58:28.110 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7385, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 6.781503698, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000918280 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-04-25T08:58:28.111 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000039821, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000039821 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.112 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.002466088, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002466088 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-04-25T08:58:28.113 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.039410054, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.039410054 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.214328225, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.026791028 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.114 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2210, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 237.687907064, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.107551089 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.040297737, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.040297737 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:28.116 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000258983, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000258983 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.117 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-04-25T08:58:28.118 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.207291293, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002025911 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-04-25T08:58:28.119 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18790, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18790, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 43, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T08:58:28.120 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T08:58:28.121 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-04-25T08:58:28.122 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 16920460, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 6250, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 440, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 5, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5312, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 75, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-04-25T08:58:28.123 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 21180156, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 881377, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 4639, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 90656542, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 37, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 4639, 2024-04-25T08:58:28.124 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4639, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 20.747579142, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.004472424 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4639, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 4731 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 4639, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 45, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 4594, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-04-25T08:58:28.125 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 45, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2645, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 29, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1819, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 33, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 0, 2024-04-25T08:58:28.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-04-25T08:58:28.127 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 31, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 1, 2024-04-25T08:58:28.128 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 100, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 27 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-04-25T08:58:28.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 1819, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 1819, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 31508, 2024-04-25T08:58:28.130 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 7590727, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 31508, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 31508, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 7590727, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:28.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4639, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 90854813, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4639, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 90854813, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4639, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 4639, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4639, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 4639, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.133 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 1819, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 198271, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 1819, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 45, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 198271, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x5623bd5686e0": { 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 84, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 24839, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 90186232, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:28.135 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 24839, 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2600, 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 90186148, 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.136 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1ecc06b4d0 msgr2=0x7f1ecc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1ecc06b4d0 0x7f1ecc06d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1edc004de0 tx=0x7f1edc006040 comp rx=0 tx=0).stop 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eec0b3590 msgr2=0x7f1eec0b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eec0b3590 0x7f1eec0b39f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400f5f0 tx=0x7f1ed400fab0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 shutdown_connections 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1ecc06b4d0 0x7f1ecc06d990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1eec15fcc0 0x7f1eec160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eec0b3590 0x7f1eec0b39f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 --2- 172.21.15.5:0/2598388051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ed8004d40 0x7f1eec1424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 >> 172.21.15.5:0/2598388051 conn(0x7f1eec0cd310 msgr2=0x7f1eec0af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 shutdown_connections 2024-04-25T08:58:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.098+0000 7f1ef18bd640 1 -- 172.21.15.5:0/2598388051 wait complete. 2024-04-25T08:58:28.139 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-04-25T08:58:28.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:28.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-04-25T08:58:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.254+0000 7fca3c710640 1 Processor -- start 2024-04-25T08:58:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.254+0000 7fca3c710640 1 -- start start 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3c710640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca34161970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3c710640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca34162530 0x7fca34161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3c710640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca340b0e80 con 0x7fca3415dc50 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3c710640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3406be20 con 0x7fca34162530 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3c710640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca340b1120 con 0x7fca3415e030 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3acad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca34162530 0x7fca34161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3acad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca34162530 0x7fca34161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45290/0 (socket says 172.21.15.5:45290) 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3acad640 1 -- 172.21.15.5:0/3826457195 learned_addr learned my addr 172.21.15.5:0/3826457195 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca39cab640 1 --2- 172.21.15.5:0/3826457195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca34161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3acad640 1 -- 172.21.15.5:0/3826457195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 msgr2=0x7fca34161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3acad640 1 --2- 172.21.15.5:0/3826457195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca34161970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3acad640 1 -- 172.21.15.5:0/3826457195 >> v1:172.21.15.80:6789/0 conn(0x7fca3415dc50 legacy=0x7fca3406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca394aa640 1 -- 172.21.15.5:0/3826457195 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970951860 0 0) 0x7fca340b0e80 con 0x7fca3415dc50 2024-04-25T08:58:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.255+0000 7fca3acad640 1 -- 172.21.15.5:0/3826457195 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340b1400 con 0x7fca34162530 2024-04-25T08:58:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.256+0000 7fca3acad640 1 --2- 172.21.15.5:0/3826457195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca34161eb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009e50 tx=0x7fca2c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f636d210b95b3a9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.256+0000 7fca394aa640 1 -- 172.21.15.5:0/3826457195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c036070 con 0x7fca34162530 2024-04-25T08:58:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.256+0000 7fca394aa640 1 -- 172.21.15.5:0/3826457195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c031600 con 0x7fca34162530 2024-04-25T08:58:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.256+0000 7fca394aa640 1 -- 172.21.15.5:0/3826457195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0319d0 con 0x7fca34162530 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 -- 172.21.15.5:0/3826457195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 msgr2=0x7fca34161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 --2- 172.21.15.5:0/3826457195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca34161eb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009e50 tx=0x7fca2c02a710 comp rx=0 tx=0).stop 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 -- 172.21.15.5:0/3826457195 shutdown_connections 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 --2- 172.21.15.5:0/3826457195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca34161eb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 --2- 172.21.15.5:0/3826457195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca34161970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 -- 172.21.15.5:0/3826457195 >> 172.21.15.5:0/3826457195 conn(0x7fca340b34a0 msgr2=0x7fca340b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 -- 172.21.15.5:0/3826457195 shutdown_connections 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.257+0000 7fca3c710640 1 -- 172.21.15.5:0/3826457195 wait complete. 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.258+0000 7fca3c710640 1 Processor -- start 2024-04-25T08:58:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.258+0000 7fca3c710640 1 -- start start 2024-04-25T08:58:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca3415dc50 0x7fca3414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca341f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca341f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340b1d80 con 0x7fca34162530 2024-04-25T08:58:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340b1c00 con 0x7fca3415dc50 2024-04-25T08:58:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca340b1f00 con 0x7fca3415e030 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca341f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca341f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45302/0 (socket says 172.21.15.5:45302) 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 -- 172.21.15.5:0/3015584233 learned_addr learned my addr 172.21.15.5:0/3015584233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca39cab640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca341f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca3415dc50 0x7fca3414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 -- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 msgr2=0x7fca341f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca341f7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 -- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca3415dc50 msgr2=0x7fca3414ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca3415dc50 0x7fca3414ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 -- 172.21.15.5:0/3015584233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca341f7d60 con 0x7fca34162530 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca39cab640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca341f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca3415dc50 0x7fca3414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3acad640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca341f4780 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca2c034040 tx=0x7fca2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca2affd640 1 -- 172.21.15.5:0/3015584233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c03f020 con 0x7fca34162530 2024-04-25T08:58:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca2affd640 1 -- 172.21.15.5:0/3015584233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c037040 con 0x7fca34162530 2024-04-25T08:58:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca341f8040 con 0x7fca34162530 2024-04-25T08:58:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca2affd640 1 -- 172.21.15.5:0/3015584233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c036070 con 0x7fca34162530 2024-04-25T08:58:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.259+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca341f3f80 con 0x7fca34162530 2024-04-25T08:58:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.261+0000 7fca2affd640 1 -- 172.21.15.5:0/3015584233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca2c042020 con 0x7fca34162530 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.261+0000 7fca2affd640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1806b4d0 0x7fca1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.261+0000 7fca2affd640 1 -- 172.21.15.5:0/3015584233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca2c0aa590 con 0x7fca34162530 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.262+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1806b4d0 0x7fca1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.262+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1806b4d0 0x7fca1806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca30000f60 tx=0x7fca30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.262+0000 7fca3f40e740 1 Processor -- start 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.262+0000 7fca3f40e740 1 -- start start 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1710 0x56191e1e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1af0 0x56191e1e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1b4370 0x56191e1b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3f40e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56191e11cbc0 con 0x56191e1e1af0 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56191e0c5e70 con 0x56191e1b4370 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56191e118c60 con 0x56191e1e1710 2024-04-25T08:58:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca39cab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1af0 0x56191e1e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca39cab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1af0 0x56191e1e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45308/0 (socket says 172.21.15.5:45308) 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca39cab640 1 -- 172.21.15.5:0/2463822960 learned_addr learned my addr 172.21.15.5:0/2463822960 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1710 0x56191e1e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.263+0000 7fca3acad640 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1b4370 0x56191e1b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca39cab640 1 -- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1710 msgr2=0x56191e1e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca39cab640 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1710 0x56191e1e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca39cab640 1 -- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1b4370 msgr2=0x56191e1b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca39cab640 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1b4370 0x56191e1b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca39cab640 1 -- 172.21.15.5:0/2463822960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56191e0e6ad0 con 0x56191e1e1af0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca39cab640 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1af0 0x56191e1e4460 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca24009c10 tx=0x7fca24009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c42f4e84eaed7e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca17fff640 1 -- 172.21.15.5:0/2463822960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400f040 con 0x56191e1e1af0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca17fff640 1 -- 172.21.15.5:0/2463822960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24009e20 con 0x56191e1e1af0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.264+0000 7fca17fff640 1 -- 172.21.15.5:0/2463822960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24004250 con 0x56191e1e1af0 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 -- 172.21.15.5:0/2463822960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1af0 msgr2=0x56191e1e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1af0 0x56191e1e4460 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca24009c10 tx=0x7fca24009190 comp rx=0 tx=0).stop 2024-04-25T08:58:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 -- 172.21.15.5:0/2463822960 shutdown_connections 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1b4370 0x56191e1b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1af0 0x56191e1e4460 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2463822960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1710 0x56191e1e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 -- 172.21.15.5:0/2463822960 >> 172.21.15.5:0/2463822960 conn(0x56191e1b65e0 msgr2=0x56191e1fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 -- 172.21.15.5:0/2463822960 shutdown_connections 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 -- 172.21.15.5:0/2463822960 wait complete. 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 -- start start 2024-04-25T08:58:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.265+0000 7fca3f40e740 1 Processor -- start 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e1dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e2035f0 0x56191e203a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3f40e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56191e1b9790 con 0x56191e1e1710 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56191e0bb4e0 con 0x56191e2035f0 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56191e1b9a70 con 0x56191e1e1af0 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3f40e740 10 client.0 _ll_register_callbacks cb 0x56191e0d8de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3a4ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e1dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3a4ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e1dbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45324/0 (socket says 172.21.15.5:45324) 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca3a4ac640 1 -- 172.21.15.5:0/2599876685 learned_addr learned my addr 172.21.15.5:0/2599876685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.266+0000 7fca39cab640 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3acad640 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e2035f0 0x56191e203a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3a4ac640 1 -- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 msgr2=0x56191e1e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3a4ac640 1 -- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e2035f0 msgr2=0x56191e203a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e2035f0 0x56191e203a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3a4ac640 1 -- 172.21.15.5:0/2599876685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56191defd940 con 0x56191e1e1710 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e1dbf40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ddb0 tx=0x7fca30001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a88f9664338ad0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca157fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca157fa640 1 -- 172.21.15.5:0/2599876685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30026060 con 0x56191e1e1710 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca157fa640 1 -- 172.21.15.5:0/2599876685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca30021aa0 con 0x56191e1e1710 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca24009e20 con 0x56191e1e1710 2024-04-25T08:58:28.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca157fa640 1 -- 172.21.15.5:0/2599876685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca3000dea0 con 0x56191e1e1710 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 10 client.5355 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56191df5e0d0 con 0x56191e1e1710 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca157fa640 1 -- 172.21.15.5:0/2599876685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24009e20 con 0x56191e1e1710 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca157fa640 1 -- 172.21.15.5:0/2599876685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fca30021ca0 con 0x56191e1e1710 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 10 client.5355 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 10 client.5355 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 20 client.5355 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2128c0 0x56191e212cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 4 client.5355 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.267+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56191e12a100 con 0x56191e2128c0 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.268+0000 7fca39cab640 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2128c0 0x56191e212cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.268+0000 7fca157fa640 10 client.5355 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.268+0000 7fca39cab640 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2128c0 0x56191e212cf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3478ba34f4d3a5 server_cookie=d36906705aaad75d in_seq=0 out_seq=0 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.268+0000 7fca157fa640 1 -- 172.21.15.5:0/2599876685 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56191e12a100 con 0x56191e2128c0 2024-04-25T08:58:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.268+0000 7fca157fa640 10 client.5355 handle_command_reply: tid=0 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.268+0000 7fca3f40e740 1 client.5355 shutdown 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 msgr2=0x56191e1dbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e1dbf40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ddb0 tx=0x7fca30001080 comp rx=0 tx=0).stop 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 shutdown_connections 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2128c0 0x56191e212cf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e2035f0 0x56191e203a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 --2- 172.21.15.5:0/2599876685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e1dbf40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca157fa640 0 client.5355 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 >> 172.21.15.5:0/2599876685 conn(0x56191e1b4370 msgr2=0x56191e1e4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 shutdown_connections 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 1 -- 172.21.15.5:0/2599876685 wait complete. 2024-04-25T08:58:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.269+0000 7fca3f40e740 20 client.5355 trim_cache size 0 max 16384 2024-04-25T08:58:28.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.284+0000 7fca3f40e740 1 Processor -- start 2024-04-25T08:58:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.284+0000 7fca3f40e740 1 -- start start 2024-04-25T08:58:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1710 0x56191e1b9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e2035f0 0x56191e1fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3f40e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca341fff20 con 0x56191e2035f0 2024-04-25T08:58:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340c5e20 con 0x56191e1e1710 2024-04-25T08:58:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca341601b0 con 0x56191e1e1af0 2024-04-25T08:58:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e2035f0 0x56191e1fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e2035f0 0x56191e1fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45336/0 (socket says 172.21.15.5:45336) 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 -- 172.21.15.5:0/364032945 learned_addr learned my addr 172.21.15.5:0/364032945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca39cab640 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1710 0x56191e1b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 -- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 msgr2=0x56191e1fc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1fc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 -- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1710 msgr2=0x56191e1b9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1710 0x56191e1b9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 -- 172.21.15.5:0/364032945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56191e203de0 con 0x56191e2035f0 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca39cab640 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca3acad640 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e2035f0 0x56191e1fccf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca2c078b50 tx=0x7fca2c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61fd31d0e3e3919 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca177fe640 1 -- 172.21.15.5:0/364032945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c07c070 con 0x56191e2035f0 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca177fe640 1 -- 172.21.15.5:0/364032945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c07cef0 con 0x56191e2035f0 2024-04-25T08:58:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.285+0000 7fca177fe640 1 -- 172.21.15.5:0/364032945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0814b0 con 0x56191e2035f0 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 -- 172.21.15.5:0/364032945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e2035f0 msgr2=0x56191e1fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e2035f0 0x56191e1fccf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca2c078b50 tx=0x7fca2c009810 comp rx=0 tx=0).stop 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 -- 172.21.15.5:0/364032945 shutdown_connections 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e2035f0 0x56191e1fccf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e1e1af0 0x56191e1fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 --2- 172.21.15.5:0/364032945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1710 0x56191e1b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 -- 172.21.15.5:0/364032945 >> 172.21.15.5:0/364032945 conn(0x56191e1b4370 msgr2=0x56191e1e4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 -- 172.21.15.5:0/364032945 shutdown_connections 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 -- 172.21.15.5:0/364032945 wait complete. 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.286+0000 7fca3f40e740 1 -- start start 2024-04-25T08:58:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 1 Processor -- start 2024-04-25T08:58:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e269650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1af0 0x56191e203fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e2035f0 0x56191e1e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56191e2050a0 con 0x56191e1e1710 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340c5820 con 0x56191e1e1af0 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56191e1ff300 con 0x56191e2035f0 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3f40e740 10 client.0 _ll_register_callbacks cb 0x7fca3000d9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.287+0000 7fca3a4ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e269650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e269650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45342/0 (socket says 172.21.15.5:45342) 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 -- 172.21.15.5:0/4023230350 learned_addr learned my addr 172.21.15.5:0/4023230350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca39cab640 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1af0 0x56191e203fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3acad640 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e2035f0 0x56191e1e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 -- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e2035f0 msgr2=0x56191e1e4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e2035f0 0x56191e1e4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 -- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1af0 msgr2=0x56191e203fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1af0 0x56191e203fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 -- 172.21.15.5:0/4023230350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56191e1dc2b0 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3a4ac640 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e269650 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca300011e0 tx=0x7fca30012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d257fea7d4c486c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca157fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca157fa640 1 -- 172.21.15.5:0/4023230350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30003db0 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca157fa640 1 -- 172.21.15.5:0/4023230350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca30035430 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca2c07cef0 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca157fa640 1 -- 172.21.15.5:0/4023230350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca30035630 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3f40e740 10 client.5361 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56191ddf1230 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.288+0000 7fca157fa640 1 -- 172.21.15.5:0/4023230350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c07cef0 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca157fa640 1 -- 172.21.15.5:0/4023230350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fca300357d0 con 0x56191e1e1710 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca3f40e740 10 client.5361 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca3f40e740 10 client.5361 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca3f40e740 20 client.5361 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca3f40e740 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2065d0 0x56191e1b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca3f40e740 4 client.5361 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-04-25T08:58:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) v1 -- 0x56191e124450 con 0x56191e2065d0 2024-04-25T08:58:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca39cab640 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2065d0 0x56191e1b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca157fa640 10 client.5361 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.289+0000 7fca39cab640 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2065d0 0x56191e1b82f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca68ef0ab4aad8a5 server_cookie=d21a0e0f10bd2556 in_seq=0 out_seq=0 2024-04-25T08:58:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca157fa640 1 -- 172.21.15.5:0/4023230350 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56191e124450 con 0x56191e2065d0 2024-04-25T08:58:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca157fa640 10 client.5361 handle_command_reply: tid=0 2024-04-25T08:58:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 client.5361 shutdown 2024-04-25T08:58:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 msgr2=0x56191e269650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e269650 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca300011e0 tx=0x7fca30012000 comp rx=0 tx=0).stop 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 shutdown_connections 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x56191e2065d0 0x56191e1b82f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56191e2035f0 0x56191e1e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56191e1e1af0 0x56191e203fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 --2- 172.21.15.5:0/4023230350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56191e1e1710 0x56191e269650 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca157fa640 0 client.5361 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 >> 172.21.15.5:0/4023230350 conn(0x56191e1b4370 msgr2=0x56191e1e4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 shutdown_connections 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 1 -- 172.21.15.5:0/4023230350 wait complete. 2024-04-25T08:58:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.294+0000 7fca3f40e740 20 client.5361 trim_cache size 0 max 16384 2024-04-25T08:58:28.287 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:58:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:58:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "54f34ae5-e4ff-4a4e-9272-8c2b8e294906", 2024-04-25T08:58:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:58:28.287 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1806b4d0 msgr2=0x7fca1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1806b4d0 0x7fca1806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca30000f60 tx=0x7fca30009040 comp rx=0 tx=0).stop 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 msgr2=0x7fca341f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca341f4780 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca2c034040 tx=0x7fca2c004a40 comp rx=0 tx=0).stop 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 shutdown_connections 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1806b4d0 0x7fca1806d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca34162530 0x7fca341f4780 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca3415e030 0x7fca341f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 --2- 172.21.15.5:0/3015584233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca3415dc50 0x7fca3414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 >> 172.21.15.5:0/3015584233 conn(0x7fca340b34a0 msgr2=0x7fca3406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 shutdown_connections 2024-04-25T08:58:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.295+0000 7fca3c710640 1 -- 172.21.15.5:0/3015584233 wait complete. 2024-04-25T08:58:28.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:28.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-04-25T08:58:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.435+0000 7fa096541640 1 Processor -- start 2024-04-25T08:58:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.435+0000 7fa096541640 1 -- start start 2024-04-25T08:58:28.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa096541640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0901622e0 0x7fa0900b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa096541640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0900c5000 0x7fa09016be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa096541640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0901626c0 con 0x7fa0900b2e70 2024-04-25T08:58:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa096541640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900ce1a0 con 0x7fa0901622e0 2024-04-25T08:58:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa096541640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900d2820 con 0x7fa0900c5000 2024-04-25T08:58:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa08ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0901622e0 0x7fa0900b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa094ade640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0900c5000 0x7fa09016be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa08ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0901622e0 0x7fa0900b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45352/0 (socket says 172.21.15.5:45352) 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa08ffff640 1 -- 172.21.15.5:0/2227598620 learned_addr learned my addr 172.21.15.5:0/2227598620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.436+0000 7fa08f7fe640 1 --1- 172.21.15.5:0/2227598620 >> v1:172.21.15.80:6789/0 conn(0x7fa0900b2e70 0x7fa0900c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:42142/0 (socket says 172.21.15.5:42142) 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.437+0000 7fa08effd640 1 -- 172.21.15.5:0/2227598620 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188064350 0 0) 0x7fa07c001110 con 0x7fa0900b2e70 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.437+0000 7fa08effd640 1 -- 172.21.15.5:0/2227598620 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa074003520 con 0x7fa0900b2e70 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.437+0000 7fa08ffff640 1 -- 172.21.15.5:0/2227598620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0900c5000 msgr2=0x7fa09016be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.437+0000 7fa08ffff640 1 --2- 172.21.15.5:0/2227598620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0900c5000 0x7fa09016be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.437+0000 7fa08ffff640 1 -- 172.21.15.5:0/2227598620 >> v1:172.21.15.80:6789/0 conn(0x7fa0900b2e70 legacy=0x7fa0900c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.437+0000 7fa08ffff640 1 -- 172.21.15.5:0/2227598620 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900ce3f0 con 0x7fa0901622e0 2024-04-25T08:58:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.437+0000 7fa094ade640 1 --2- 172.21.15.5:0/2227598620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0900c5000 0x7fa09016be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.438+0000 7fa08ffff640 1 --2- 172.21.15.5:0/2227598620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0901622e0 0x7fa0900b2930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa08802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9fa9a6adfb0488 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.438+0000 7fa08effd640 1 -- 172.21.15.5:0/2227598620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088036070 con 0x7fa0901622e0 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.438+0000 7fa08effd640 1 -- 172.21.15.5:0/2227598620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088031600 con 0x7fa0901622e0 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.438+0000 7fa08effd640 1 -- 172.21.15.5:0/2227598620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880319d0 con 0x7fa0901622e0 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 -- 172.21.15.5:0/2227598620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0901622e0 msgr2=0x7fa0900b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 --2- 172.21.15.5:0/2227598620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0901622e0 0x7fa0900b2930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa08802a710 comp rx=0 tx=0).stop 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 -- 172.21.15.5:0/2227598620 shutdown_connections 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 --2- 172.21.15.5:0/2227598620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0900c5000 0x7fa09016be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 --2- 172.21.15.5:0/2227598620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0901622e0 0x7fa0900b2930 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 -- 172.21.15.5:0/2227598620 >> 172.21.15.5:0/2227598620 conn(0x7fa0900d1920 msgr2=0x7fa0900d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 -- 172.21.15.5:0/2227598620 shutdown_connections 2024-04-25T08:58:28.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.439+0000 7fa096541640 1 -- 172.21.15.5:0/2227598620 wait complete. 2024-04-25T08:58:28.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.441+0000 7fa096541640 1 Processor -- start 2024-04-25T08:58:28.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.441+0000 7fa096541640 1 -- start start 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa096541640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0900b2e70 0x7fa0900b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa096541640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0900c5000 0x7fa0901fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa096541640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0901622e0 0x7fa0901fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa096541640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900cec90 con 0x7fa0900c5000 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa096541640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900ce9b0 con 0x7fa0900b2e70 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa096541640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900cef70 con 0x7fa0901622e0 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa08f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0900c5000 0x7fa0901fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa08f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0900c5000 0x7fa0901fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45366/0 (socket says 172.21.15.5:45366) 2024-04-25T08:58:28.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0900b2e70 0x7fa0900b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa08f7fe640 1 -- 172.21.15.5:0/1779204391 learned_addr learned my addr 172.21.15.5:0/1779204391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.442+0000 7fa094ade640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0901622e0 0x7fa0901fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.443+0000 7fa08ffff640 1 -- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0901622e0 msgr2=0x7fa0901fbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.443+0000 7fa08ffff640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0901622e0 0x7fa0901fbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.443+0000 7fa08ffff640 1 -- 172.21.15.5:0/1779204391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0900c5000 msgr2=0x7fa0901fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.443+0000 7fa08ffff640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0900c5000 0x7fa0901fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.443+0000 7fa08ffff640 1 -- 172.21.15.5:0/1779204391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0901553c0 con 0x7fa0900b2e70 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.443+0000 7fa08ffff640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0900b2e70 0x7fa0900b4500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa088030000 tx=0x7fa088004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.443+0000 7fa08cff9640 1 -- 172.21.15.5:0/1779204391 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088036050 con 0x7fa0900b2e70 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.444+0000 7fa08cff9640 1 -- 172.21.15.5:0/1779204391 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088042070 con 0x7fa0900b2e70 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.444+0000 7fa08cff9640 1 -- 172.21.15.5:0/1779204391 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088009510 con 0x7fa0900b2e70 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.444+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0900b6c10 con 0x7fa0900b2e70 2024-04-25T08:58:28.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.444+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0900b71d0 con 0x7fa0900b2e70 2024-04-25T08:58:28.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.446+0000 7fa08cff9640 1 -- 172.21.15.5:0/1779204391 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa088007c70 con 0x7fa0900b2e70 2024-04-25T08:58:28.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.447+0000 7fa08cff9640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa07806b520 0x7fa07806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.447+0000 7fa08cff9640 1 -- 172.21.15.5:0/1779204391 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0880aace0 con 0x7fa0900b2e70 2024-04-25T08:58:28.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.447+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa07806b520 0x7fa07806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.447+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa07806b520 0x7fa07806d9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa0901fba00 tx=0x7fa07c007bb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.449+0000 7fa09923d740 1 Processor -- start 2024-04-25T08:58:28.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.449+0000 7fa09923d740 1 -- start start 2024-04-25T08:58:28.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa09923d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bdb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bdb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bab770 0x55b3f3baef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa09923d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3b14da0 con 0x55b3f3bd8b10 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa09923d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3abdb80 con 0x55b3f3bab770 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa09923d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3b10e40 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bdb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bdb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35574/0 (socket says 172.21.15.5:35574) 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 -- 172.21.15.5:0/2241522761 learned_addr learned my addr 172.21.15.5:0/2241522761 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08ffff640 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bdb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa094ade640 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bab770 0x55b3f3baef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 -- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bab770 msgr2=0x55b3f3baef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bab770 0x55b3f3baef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 -- 172.21.15.5:0/2241522761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8b10 msgr2=0x55b3f3bdb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bdb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.450+0000 7fa08f7fe640 1 -- 172.21.15.5:0/2241522761 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3f3ac7f10 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.451+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bdb860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa07c004e00 tx=0x7fa07c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9322c0b0d0a8a8a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.451+0000 7fa085ffb640 1 -- 172.21.15.5:0/2241522761 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c026070 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.451+0000 7fa085ffb640 1 -- 172.21.15.5:0/2241522761 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c004e30 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.451+0000 7fa085ffb640 1 -- 172.21.15.5:0/2241522761 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c013d00 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.451+0000 7fa09923d740 1 -- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 msgr2=0x55b3f3bdb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.451+0000 7fa09923d740 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bdb860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa07c004e00 tx=0x7fa07c013000 comp rx=0 tx=0).stop 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.451+0000 7fa09923d740 1 -- 172.21.15.5:0/2241522761 shutdown_connections 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.452+0000 7fa09923d740 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bab770 0x55b3f3baef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.452+0000 7fa09923d740 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bdb860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.452+0000 7fa09923d740 1 --2- 172.21.15.5:0/2241522761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bdb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.452+0000 7fa09923d740 1 -- 172.21.15.5:0/2241522761 >> 172.21.15.5:0/2241522761 conn(0x55b3f3bad9e0 msgr2=0x55b3f3bf6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.452+0000 7fa09923d740 1 -- 172.21.15.5:0/2241522761 shutdown_connections 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.452+0000 7fa09923d740 1 -- 172.21.15.5:0/2241522761 wait complete. 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.452+0000 7fa09923d740 1 -- start start 2024-04-25T08:58:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.453+0000 7fa09923d740 1 Processor -- start 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3bf1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa09923d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bf3180 0x55b3f3bd1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa09923d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3bb0b90 con 0x55b3f3bf3180 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa09923d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3ab34b0 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa09923d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3bb0e70 con 0x55b3f3bd8b10 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3bf1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3bf1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35582/0 (socket says 172.21.15.5:35582) 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa08ffff640 1 -- 172.21.15.5:0/1645164662 learned_addr learned my addr 172.21.15.5:0/1645164662 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa094ade640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bf3180 0x55b3f3bd1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa09923d740 10 client.0 _ll_register_callbacks cb 0x55b3f3af3180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.454+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa08ffff640 1 -- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8ef0 msgr2=0x55b3f3bf2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa08ffff640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa08ffff640 1 -- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bf3180 msgr2=0x55b3f3bd1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa08ffff640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bf3180 0x55b3f3bd1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa08ffff640 1 -- 172.21.15.5:0/1645164662 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3f38f37d0 con 0x55b3f3bd8b10 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa094ade640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bf3180 0x55b3f3bd1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa08ffff640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3bf1360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa088000f80 tx=0x7fa088079140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be9dbc29d1068c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa06affd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3301/0 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa06affd640 1 -- 172.21.15.5:0/1645164662 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880a7060 con 0x55b3f3bd8b10 2024-04-25T08:58:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa06affd640 1 -- 172.21.15.5:0/1645164662 <== mon.2 v2:172.21.15.80:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa08807d150 con 0x55b3f3bd8b10 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.455+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa07c004e30 con 0x55b3f3bd8b10 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa06affd640 1 -- 172.21.15.5:0/1645164662 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa088091070 con 0x55b3f3bd8b10 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa09923d740 10 client.4904 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55b3f38293f0 con 0x55b3f3bd8b10 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa06affd640 1 -- 172.21.15.5:0/1645164662 <== mon.2 v2:172.21.15.80:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088037040 con 0x55b3f3bd8b10 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa06affd640 1 -- 172.21.15.5:0/1645164662 <== mon.2 v2:172.21.15.80:3301/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa088075290 con 0x55b3f3bd8b10 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa09923d740 10 client.4904 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa09923d740 10 client.4904 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.456+0000 7fa09923d740 20 client.4904 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.457+0000 7fa09923d740 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bd2ac0 0x55b3f3bcebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.457+0000 7fa09923d740 4 client.4904 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.457+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa07c004e30 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.457+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bd2ac0 0x55b3f3bcebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.457+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bd2ac0 0x55b3f3bcebc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722351e5111f9884 server_cookie=48986678f87edb0a in_seq=0 out_seq=0 2024-04-25T08:58:28.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.457+0000 7fa06affd640 10 client.4904 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.458+0000 7fa06affd640 1 -- 172.21.15.5:0/1645164662 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7fa07c004e30 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.458+0000 7fa06affd640 10 client.4904 handle_command_reply: tid=0 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.458+0000 7fa09923d740 1 client.4904 shutdown 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 msgr2=0x55b3f3bf1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3bf1360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa088000f80 tx=0x7fa088079140 comp rx=0 tx=0).stop 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 shutdown_connections 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bd2ac0 0x55b3f3bcebc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa06affd640 0 client.4904 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bf3180 0x55b3f3bd1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 --2- 172.21.15.5:0/1645164662 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3bf1360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 >> 172.21.15.5:0/1645164662 conn(0x55b3f3bab770 msgr2=0x55b3f3bd7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 shutdown_connections 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 1 -- 172.21.15.5:0/1645164662 wait complete. 2024-04-25T08:58:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.459+0000 7fa09923d740 20 client.4904 trim_cache size 0 max 16384 2024-04-25T08:58:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.491+0000 7fa09923d740 1 Processor -- start 2024-04-25T08:58:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.492+0000 7fa09923d740 1 -- start start 2024-04-25T08:58:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa09923d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3c189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bf2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3c189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3c189a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45404/0 (socket says 172.21.15.5:45404) 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa08ffff640 1 -- 172.21.15.5:0/2636201480 learned_addr learned my addr 172.21.15.5:0/2636201480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa090204430 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa090203630 con 0x55b3f3bd8b10 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900c7390 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa094ade640 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bf2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa08ffff640 1 -- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 msgr2=0x55b3f3bf2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.493+0000 7fa08ffff640 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa08ffff640 1 -- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8b10 msgr2=0x55b3f3bf2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa08ffff640 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bf2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa08ffff640 1 -- 172.21.15.5:0/2636201480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3f37e90f0 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bf2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa08ffff640 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3c189a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa08807d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e120f4d7f0d4c5da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa0857fa640 1 -- 172.21.15.5:0/2636201480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088079310 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa0857fa640 1 -- 172.21.15.5:0/2636201480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08807d690 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.494+0000 7fa0857fa640 1 -- 172.21.15.5:0/2636201480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088081c50 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd2ac0 msgr2=0x55b3f3c189a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3c189a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa08807d000 comp rx=0 tx=0).stop 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 shutdown_connections 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8ef0 0x55b3f3bf2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd8b10 0x55b3f3bf2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 --2- 172.21.15.5:0/2636201480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3c189a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 >> 172.21.15.5:0/2636201480 conn(0x55b3f3bab770 msgr2=0x55b3f3bf9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 shutdown_connections 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.495+0000 7fa09923d740 1 -- 172.21.15.5:0/2636201480 wait complete. 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.496+0000 7fa09923d740 1 -- start start 2024-04-25T08:58:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.496+0000 7fa09923d740 1 Processor -- start 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3bf6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa09923d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3baaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa09923d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3bf6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08f7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3baaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3bf6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:52568/0 (socket says 172.21.15.5:52568) 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08f7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3baaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:35600/0 (socket says 172.21.15.5:35600) 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa094ade640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa094ade640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bec330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45412/0 (socket says 172.21.15.5:45412) 2024-04-25T08:58:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa09923d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3bfea10 con 0x55b3f3bd8ef0 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa09923d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa090203030 con 0x55b3f3bd2ac0 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa09923d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b3f3bb18d0 con 0x55b3f3bd8b10 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08ffff640 1 -- 172.21.15.5:0/237018252 learned_addr learned my addr 172.21.15.5:0/237018252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08f7fe640 1 -- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd2ac0 msgr2=0x55b3f3bf6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3bf6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.498+0000 7fa08f7fe640 1 -- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8ef0 msgr2=0x55b3f3bec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa09923d740 10 client.0 _ll_register_callbacks cb 0x7fa07c007180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa08f7fe640 1 -- 172.21.15.5:0/237018252 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3f3baaf40 con 0x55b3f3bd8b10 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa08ffff640 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3bf6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa094ade640 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa08807d690 con 0x55b3f3bd8b10 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa08f7fe640 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3baaa00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa07c007310 tx=0x7fa07c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c1f6808b3767cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.499+0000 7fa06affd640 10 client.4910 ms_handle_connect on v2:172.21.15.80:3301/0 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa06affd640 1 -- 172.21.15.5:0/237018252 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c026040 con 0x55b3f3bd8b10 2024-04-25T08:58:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa06affd640 1 -- 172.21.15.5:0/237018252 <== mon.2 v2:172.21.15.80:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa07c007600 con 0x55b3f3bd8b10 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa06affd640 1 -- 172.21.15.5:0/237018252 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa07c004e30 con 0x55b3f3bd8b10 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 10 client.4910 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({fsmap=14}) v3 -- 0x55b3f3bef6e0 con 0x55b3f3bd8b10 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa06affd640 1 -- 172.21.15.5:0/237018252 <== mon.2 v2:172.21.15.80:3301/0 4 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa07c02c420 con 0x55b3f3bd8b10 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 10 client.4910 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 10 client.4910 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 20 client.4910 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bf3180 0x55b3f3bcebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 4 client.4910 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:58:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.500+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b3f3bb0b60 con 0x55b3f3bf3180 2024-04-25T08:58:28.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.501+0000 7fa08ffff640 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bf3180 0x55b3f3bcebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:28.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.501+0000 7fa08ffff640 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bf3180 0x55b3f3bcebc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbcc289c61ffabe server_cookie=6d0fb0968deb5e4 in_seq=0 out_seq=0 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.501+0000 7fa06affd640 10 client.4910 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa06affd640 1 -- 172.21.15.5:0/237018252 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+274 (crc 0 0 0) 0x55b3f3bb0b60 con 0x55b3f3bf3180 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa06affd640 10 client.4910 handle_command_reply: tid=0 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 client.4910 shutdown 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 msgr2=0x55b3f3baaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3baaa00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa07c007310 tx=0x7fa07c012000 comp rx=0 tx=0).stop 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 shutdown_connections 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55b3f3bf3180 0x55b3f3bcebc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b3f3bd8ef0 0x55b3f3bec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b3f3bd8b10 0x55b3f3baaa00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 --2- 172.21.15.5:0/237018252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3f3bd2ac0 0x55b3f3bf6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa06affd640 0 client.4910 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 >> 172.21.15.5:0/237018252 conn(0x55b3f3bab770 msgr2=0x55b3f3bf25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 shutdown_connections 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 1 -- 172.21.15.5:0/237018252 wait complete. 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.502+0000 7fa09923d740 20 client.4910 trim_cache size 0 max 16384 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "scrub active (640 inodes in the stack)", 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout: "54f34ae5-e4ff-4a4e-9272-8c2b8e294906": { 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "54f34ae5-e4ff-4a4e-9272-8c2b8e294906", 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,scrub_mdsdir" 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:28.496 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa07806b520 msgr2=0x7fa07806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa07806b520 0x7fa07806d9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa0901fba00 tx=0x7fa07c007bb0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0900b2e70 msgr2=0x7fa0900b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0900b2e70 0x7fa0900b4500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa088030000 tx=0x7fa088004a40 comp rx=0 tx=0).stop 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 shutdown_connections 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa07806b520 0x7fa07806d9e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0901622e0 0x7fa0901fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0900c5000 0x7fa0901fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 --2- 172.21.15.5:0/1779204391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0900b2e70 0x7fa0900b4500 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 >> 172.21.15.5:0/1779204391 conn(0x7fa0900d1920 msgr2=0x7fa0900d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.503+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 shutdown_connections 2024-04-25T08:58:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:28.504+0000 7fa096541640 1 -- 172.21.15.5:0/1779204391 wait complete. 2024-04-25T08:58:28.508 INFO:tasks.cephfs.filesystem:scrub status for tag:54f34ae5-e4ff-4a4e-9272-8c2b8e294906 - {'path': '/', 'tag': '54f34ae5-e4ff-4a4e-9272-8c2b8e294906', 'options': 'recursive,scrub_mdsdir'} 2024-04-25T08:58:46.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:46.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:58.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:58.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-04-25T08:58:58.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.635+0000 7f49eac2c640 1 Processor -- start 2024-04-25T08:58:58.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.635+0000 7f49eac2c640 1 -- start start 2024-04-25T08:58:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49eac2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49e415df10 0x7f49e41618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49eac2c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e40b6250 0x7f49e40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49eac2c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e40d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49eac2c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e40d20d0 con 0x7f49e415df10 2024-04-25T08:58:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49eac2c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e4162150 con 0x7f49e40b6250 2024-04-25T08:58:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49eac2c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4162430 con 0x7f49e40cee10 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49e415df10 0x7f49e41618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49e415df10 0x7f49e41618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51236/0 (socket says 172.21.15.5:51236) 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 -- 172.21.15.5:0/3458203603 learned_addr learned my addr 172.21.15.5:0/3458203603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e3fff640 1 --2- 172.21.15.5:0/3458203603 >> v2:172.21.15.80:3300/0 conn(0x7f49e40b6250 0x7f49e40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e91c9640 1 --2- 172.21.15.5:0/3458203603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e40d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 -- 172.21.15.5:0/3458203603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 msgr2=0x7f49e40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 --2- 172.21.15.5:0/3458203603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e40d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 -- 172.21.15.5:0/3458203603 >> v2:172.21.15.80:3300/0 conn(0x7f49e40b6250 msgr2=0x7f49e40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 --2- 172.21.15.5:0/3458203603 >> v2:172.21.15.80:3300/0 conn(0x7f49e40b6250 0x7f49e40ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e89c8640 1 -- 172.21.15.5:0/3458203603 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4162710 con 0x7f49e415df10 2024-04-25T08:58:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.636+0000 7f49e3fff640 1 --2- 172.21.15.5:0/3458203603 >> v2:172.21.15.80:3300/0 conn(0x7f49e40b6250 0x7f49e40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.637+0000 7f49e89c8640 1 --2- 172.21.15.5:0/3458203603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e41618d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b9d70 tx=0x7f49d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92d49ca33ddc5c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.637+0000 7f49e37fe640 1 -- 172.21.15.5:0/3458203603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4037070 con 0x7f49e415df10 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.637+0000 7f49e37fe640 1 -- 172.21.15.5:0/3458203603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4032440 con 0x7f49e415df10 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.637+0000 7f49e37fe640 1 -- 172.21.15.5:0/3458203603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4032810 con 0x7f49e415df10 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 -- 172.21.15.5:0/3458203603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 msgr2=0x7f49e41618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 --2- 172.21.15.5:0/3458203603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e41618d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b9d70 tx=0x7f49d402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 -- 172.21.15.5:0/3458203603 shutdown_connections 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 --2- 172.21.15.5:0/3458203603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e40d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 --2- 172.21.15.5:0/3458203603 >> v2:172.21.15.80:3300/0 conn(0x7f49e40b6250 0x7f49e40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 --2- 172.21.15.5:0/3458203603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e41618d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 -- 172.21.15.5:0/3458203603 >> 172.21.15.5:0/3458203603 conn(0x7f49e40668f0 msgr2=0x7f49e4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 -- 172.21.15.5:0/3458203603 shutdown_connections 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.638+0000 7f49eac2c640 1 -- 172.21.15.5:0/3458203603 wait complete. 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.639+0000 7f49eac2c640 1 Processor -- start 2024-04-25T08:58:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.639+0000 7f49eac2c640 1 -- start start 2024-04-25T08:58:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49eac2c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40b6250 0x7f49e40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49eac2c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49eac2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49eac2c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40d0980 con 0x7f49e415df10 2024-04-25T08:58:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49eac2c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4161e10 con 0x7f49e40b6250 2024-04-25T08:58:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49eac2c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40d0b00 con 0x7f49e40cee10 2024-04-25T08:58:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49e91c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49e91c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e414f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51248/0 (socket says 172.21.15.5:51248) 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.640+0000 7f49e91c9640 1 -- 172.21.15.5:0/2897344633 learned_addr learned my addr 172.21.15.5:0/2897344633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e89c8640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40b6250 0x7f49e40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e3fff640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e91c9640 1 -- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 msgr2=0x7f49e414ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e91c9640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e414ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e91c9640 1 -- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40b6250 msgr2=0x7f49e40b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e91c9640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40b6250 0x7f49e40b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e91c9640 1 -- 172.21.15.5:0/2897344633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4160db0 con 0x7f49e415df10 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e91c9640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e414f4b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00cd70 tx=0x7f49dc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e17fa640 1 -- 172.21.15.5:0/2897344633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc003b90 con 0x7f49e415df10 2024-04-25T08:58:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e17fa640 1 -- 172.21.15.5:0/2897344633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc003d30 con 0x7f49e415df10 2024-04-25T08:58:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e4160ad0 con 0x7f49e415df10 2024-04-25T08:58:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49e17fa640 1 -- 172.21.15.5:0/2897344633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc004240 con 0x7f49e415df10 2024-04-25T08:58:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.641+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e414d2f0 con 0x7f49e415df10 2024-04-25T08:58:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.643+0000 7f49e17fa640 1 -- 172.21.15.5:0/2897344633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49dc0043e0 con 0x7f49e415df10 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.643+0000 7f49e17fa640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49d006b500 0x7f49d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.643+0000 7f49e17fa640 1 -- 172.21.15.5:0/2897344633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f49dc08ab20 con 0x7f49e415df10 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.643+0000 7f49e89c8640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49d006b500 0x7f49d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.644+0000 7f49e89c8640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49d006b500 0x7f49d006d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f49d4034000 tx=0x7f49d402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.644+0000 7f49eda05740 1 Processor -- start 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.644+0000 7f49eda05740 1 -- start start 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fd3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49eda05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fd3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fa3770 0x564691fa6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49eda05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564691f0cda0 con 0x564691fd0ef0 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564691eb5b80 con 0x564691fa3770 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564691f08e40 con 0x564691fd0b10 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fd3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fd3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51256/0 (socket says 172.21.15.5:51256) 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 -- 172.21.15.5:0/1683670325 learned_addr learned my addr 172.21.15.5:0/1683670325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e89c8640 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fd3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e91c9640 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fa3770 0x564691fa6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 -- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 msgr2=0x564691fd3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fd3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 -- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fa3770 msgr2=0x564691fa6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fa3770 0x564691fa6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 -- 172.21.15.5:0/1683670325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564691ebff10 con 0x564691fd0ef0 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49e3fff640 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fd3860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f49d800ab10 tx=0x7f49d800f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99858a95b6bcd2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.645+0000 7f49ca7fc640 1 -- 172.21.15.5:0/1683670325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800fdf0 con 0x564691fd0ef0 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49ca7fc640 1 -- 172.21.15.5:0/1683670325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8013440 con 0x564691fd0ef0 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49ca7fc640 1 -- 172.21.15.5:0/1683670325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80137f0 con 0x564691fd0ef0 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 -- 172.21.15.5:0/1683670325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 msgr2=0x564691fd3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fd3860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f49d800ab10 tx=0x7f49d800f240 comp rx=0 tx=0).stop 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 -- 172.21.15.5:0/1683670325 shutdown_connections 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fa3770 0x564691fa6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fd3860 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 --2- 172.21.15.5:0/1683670325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fd3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 -- 172.21.15.5:0/1683670325 >> 172.21.15.5:0/1683670325 conn(0x564691fa59e0 msgr2=0x564691fee320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 -- 172.21.15.5:0/1683670325 shutdown_connections 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.646+0000 7f49eda05740 1 -- 172.21.15.5:0/1683670325 wait complete. 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.647+0000 7f49eda05740 1 -- start start 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.647+0000 7f49eda05740 1 Processor -- start 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691ff29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691ff2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49eda05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fff1d0 0x564691ff1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49eda05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564691fa8b90 con 0x564691fff1d0 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564691eab4b0 con 0x564691fd0ef0 2024-04-25T08:58:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564691fa8e70 con 0x564691fd0b10 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49eda05740 10 client.0 _ll_register_callbacks cb 0x564691eeb180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fff1d0 0x564691ff1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fff1d0 0x564691ff1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51264/0 (socket says 172.21.15.5:51264) 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 -- 172.21.15.5:0/1719915281 learned_addr learned my addr 172.21.15.5:0/1719915281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e89c8640 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691ff29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e3fff640 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691ff2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 -- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 msgr2=0x564691ff29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691ff29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 -- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 msgr2=0x564691ff2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691ff2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.648+0000 7f49e91c9640 1 -- 172.21.15.5:0/1719915281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564691ceb7d0 con 0x564691fff1d0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49e91c9640 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fff1d0 0x564691ff1cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0592c0 tx=0x7f49dc0593f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb622cb30743e5da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49c37fe640 1 -- 172.21.15.5:0/1719915281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc086070 con 0x564691fff1d0 2024-04-25T08:58:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49c37fe640 1 -- 172.21.15.5:0/1719915281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f49dc0559a0 con 0x564691fff1d0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49d8013440 con 0x564691fff1d0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49c37fe640 1 -- 172.21.15.5:0/1719915281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49dc061500 con 0x564691fff1d0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 10 client.5391 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x564691c213f0 con 0x564691fff1d0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49c37fe640 1 -- 172.21.15.5:0/1719915281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8013440 con 0x564691fff1d0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49c37fe640 1 -- 172.21.15.5:0/1719915281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f49dc05f040 con 0x564691fff1d0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 10 client.5391 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 10 client.5391 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 20 client.5391 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691ff5790 0x564691ff5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 4 client.5391 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564691f1a2e0 con 0x564691ff5790 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.649+0000 7f49e89c8640 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691ff5790 0x564691ff5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49e89c8640 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691ff5790 0x564691ff5b70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb83756cf919860a server_cookie=d21f4c30410c3f8b in_seq=0 out_seq=0 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49c37fe640 10 client.5391 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49c37fe640 1 -- 172.21.15.5:0/1719915281 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564691f1a2e0 con 0x564691ff5790 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49c37fe640 10 client.5391 handle_command_reply: tid=0 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 client.5391 shutdown 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fff1d0 msgr2=0x564691ff1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fff1d0 0x564691ff1cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0592c0 tx=0x7f49dc0593f0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 shutdown_connections 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691ff5790 0x564691ff5b70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fff1d0 0x564691ff1cf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49c37fe640 0 client.5391 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691ff2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 --2- 172.21.15.5:0/1719915281 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691ff29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.650+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 >> 172.21.15.5:0/1719915281 conn(0x564691fa3770 msgr2=0x564691fa2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.651+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 shutdown_connections 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.651+0000 7f49eda05740 1 -- 172.21.15.5:0/1719915281 wait complete. 2024-04-25T08:58:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.651+0000 7f49eda05740 20 client.5391 trim_cache size 0 max 16384 2024-04-25T08:58:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.666+0000 7f49eda05740 1 Processor -- start 2024-04-25T08:58:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.666+0000 7f49eda05740 1 -- start start 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49eda05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0b10 0x564691fa2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691fa2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fff1d0 0x564691fa3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49eda05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41ffda0 con 0x564691fd0b10 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41fef40 con 0x564691fd0ef0 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41fe340 con 0x564691fff1d0 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0b10 0x564691fa2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0b10 0x564691fa2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51272/0 (socket says 172.21.15.5:51272) 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 -- 172.21.15.5:0/3300586735 learned_addr learned my addr 172.21.15.5:0/3300586735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e3fff640 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691fa2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e91c9640 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fff1d0 0x564691fa3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 -- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fff1d0 msgr2=0x564691fa3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fff1d0 0x564691fa3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 -- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 msgr2=0x564691fa2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691fa2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 -- 172.21.15.5:0/3300586735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564691be10f0 con 0x564691fd0b10 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49e89c8640 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0b10 0x564691fa2600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49d40090b0 tx=0x7f49d402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766ac69fde830bf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49c9ffb640 1 -- 172.21.15.5:0/3300586735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4037040 con 0x564691fd0b10 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49c9ffb640 1 -- 172.21.15.5:0/3300586735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4055070 con 0x564691fd0b10 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.667+0000 7f49c9ffb640 1 -- 172.21.15.5:0/3300586735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d404f490 con 0x564691fd0b10 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 -- 172.21.15.5:0/3300586735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0b10 msgr2=0x564691fa2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0b10 0x564691fa2600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49d40090b0 tx=0x7f49d402c000 comp rx=0 tx=0).stop 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 -- 172.21.15.5:0/3300586735 shutdown_connections 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fff1d0 0x564691fa3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fd0ef0 0x564691fa2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 --2- 172.21.15.5:0/3300586735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0b10 0x564691fa2600 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 -- 172.21.15.5:0/3300586735 >> 172.21.15.5:0/3300586735 conn(0x564691fa3770 msgr2=0x564691f9eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 -- 172.21.15.5:0/3300586735 shutdown_connections 2024-04-25T08:58:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 -- 172.21.15.5:0/3300586735 wait complete. 2024-04-25T08:58:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.668+0000 7f49eda05740 1 -- start start 2024-04-25T08:58:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 1 Processor -- start 2024-04-25T08:58:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fa3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fa4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fff1d0 0x564691fe3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41fe940 con 0x564691fd0ef0 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564691f0f240 con 0x564691fff1d0 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564691ff0110 con 0x564691fd0b10 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.669+0000 7f49eda05740 10 client.0 _ll_register_callbacks cb 0x7f49d800a550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fa4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fa4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51274/0 (socket says 172.21.15.5:51274) 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 -- 172.21.15.5:0/2240019787 learned_addr learned my addr 172.21.15.5:0/2240019787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e89c8640 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fa3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e91c9640 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fff1d0 0x564691fe3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 -- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 msgr2=0x564691fa3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fa3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 -- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fff1d0 msgr2=0x564691fe3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fff1d0 0x564691fe3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 -- 172.21.15.5:0/2240019787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564692010a10 con 0x564691fd0ef0 2024-04-25T08:58:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49e3fff640 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fa4440 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a120 tx=0x7f49d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a82516b59ad9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49c37fe640 1 -- 172.21.15.5:0/2240019787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d802d060 con 0x564691fd0ef0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49c37fe640 1 -- 172.21.15.5:0/2240019787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f49d8013850 con 0x564691fd0ef0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49d4055070 con 0x564691fd0ef0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49c37fe640 1 -- 172.21.15.5:0/2240019787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49d8013a70 con 0x564691fd0ef0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49eda05740 10 client.5397 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.670+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x564691fa9340 con 0x564691fd0ef0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49c37fe640 1 -- 172.21.15.5:0/2240019787 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4055070 con 0x564691fd0ef0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49c37fe640 1 -- 172.21.15.5:0/2240019787 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f49d8013c10 con 0x564691fd0ef0 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 10 client.5397 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 10 client.5397 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 20 client.5397 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691fe41f0 0x564691fe45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 4 client.5397 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:58:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564691f14630 con 0x564691fe41f0 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49e89c8640 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691fe41f0 0x564691fe45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49c37fe640 10 client.5397 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49e89c8640 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691fe41f0 0x564691fe45d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e59b0f4237a4ecbb server_cookie=4cbf08fd70d3a719 in_seq=0 out_seq=0 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49c37fe640 1 -- 172.21.15.5:0/2240019787 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564691f14630 con 0x564691fe41f0 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49c37fe640 10 client.5397 handle_command_reply: tid=0 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 1 client.5397 shutdown 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 msgr2=0x564691fa4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.671+0000 7f49eda05740 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fa4440 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a120 tx=0x7f49d8004730 comp rx=0 tx=0).stop 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 shutdown_connections 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x564691fe41f0 0x564691fe45d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564691fff1d0 0x564691fe3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564691fd0ef0 0x564691fa4440 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49c37fe640 0 client.5397 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 --2- 172.21.15.5:0/2240019787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564691fd0b10 0x564691fa3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 >> 172.21.15.5:0/2240019787 conn(0x564691fa3770 msgr2=0x564691feb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 shutdown_connections 2024-04-25T08:58:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 1 -- 172.21.15.5:0/2240019787 wait complete. 2024-04-25T08:58:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eda05740 20 client.5397 trim_cache size 0 max 16384 2024-04-25T08:58:58.667 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:58:58.667 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-04-25T08:58:58.667 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T08:58:58.667 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49d006b500 msgr2=0x7f49d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49d006b500 0x7f49d006d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f49d4034000 tx=0x7f49d402e000 comp rx=0 tx=0).stop 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 msgr2=0x7f49e414f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e414f4b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00cd70 tx=0x7f49dc00a660 comp rx=0 tx=0).stop 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 shutdown_connections 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49d006b500 0x7f49d006d9c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e415df10 0x7f49e414f4b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49e40cee10 0x7f49e414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 --2- 172.21.15.5:0/2897344633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40b6250 0x7f49e40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 >> 172.21.15.5:0/2897344633 conn(0x7f49e40668f0 msgr2=0x7f49e40b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 shutdown_connections 2024-04-25T08:58:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.672+0000 7f49eac2c640 1 -- 172.21.15.5:0/2897344633 wait complete. 2024-04-25T08:58:58.673 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:58:58.673 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:58:58.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-04-25T08:58:58.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.786+0000 7fec9bfb0640 1 Processor -- start 2024-04-25T08:58:58.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.787+0000 7fec9bfb0640 1 -- start start 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.787+0000 7fec9bfb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 0x7fec940ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.787+0000 7fec9bfb0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec940d1ed0 con 0x7fec9415df70 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.787+0000 7fec9bfb0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec940d21b0 con 0x7fec940ced50 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.787+0000 7fec9bfb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec940d1c80 con 0x7fec940d2f70 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.787+0000 7fec99d4c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec9415df70 0x7fec940b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47588/0 (socket says 172.21.15.5:47588) 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.787+0000 7fec99d4c640 1 -- 172.21.15.5:0/2358610810 learned_addr learned my addr 172.21.15.5:0/2358610810 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec9954b640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 0x7fec940ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542358406 0 0) 0x7fec940d1ed0 con 0x7fec9415df70 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec80003520 con 0x7fec9415df70 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196502139 0 0) 0x7fec80003520 con 0x7fec9415df70 2024-04-25T08:58:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 msgr2=0x7fec940ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 0x7fec940ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 >> v1:172.21.15.80:6789/0 conn(0x7fec940ced50 legacy=0x7fec940b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940d2490 con 0x7fec9415df70 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fec8c001670 con 0x7fec9415df70 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 >> v1:172.21.15.5:6789/0 conn(0x7fec9415df70 legacy=0x7fec940b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec800039e0 0x7fec80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 0x7fec80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec80004d40 0x7fec800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940d1c80 con 0x7fec800039e0 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8000b9c0 con 0x7fec80004d40 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8000bbc0 con 0x7fec940d2f70 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec99d4c640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec800039e0 0x7fec80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec9954b640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 0x7fec80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.788+0000 7fec9a54d640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec80004d40 0x7fec800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec99d4c640 1 -- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 msgr2=0x7fec80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec99d4c640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec940d2f70 0x7fec80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec99d4c640 1 -- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec80004d40 msgr2=0x7fec800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec99d4c640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec80004d40 0x7fec800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec99d4c640 1 -- 172.21.15.5:0/2358610810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80003520 con 0x7fec800039e0 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec99d4c640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec800039e0 0x7fec80003dc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00c290 tx=0x7fec80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980dd0e405e5756b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c007d50 con 0x7fec800039e0 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c005af0 con 0x7fec800039e0 2024-04-25T08:58:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.789+0000 7fec98d4a640 1 -- 172.21.15.5:0/2358610810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c007070 con 0x7fec800039e0 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.790+0000 7fec9bfb0640 1 -- 172.21.15.5:0/2358610810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec800039e0 msgr2=0x7fec80003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.790+0000 7fec9bfb0640 1 --2- 172.21.15.5:0/2358610810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec800039e0 0x7fec80003dc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00c290 tx=0x7fec80005830 comp rx=0 tx=0).stop 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.790+0000 7fec9a54d640 1 -- 172.21.15.5:0/2358610810 reap_dead start 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.790+0000 7fec9bfb0640 1 -- 172.21.15.5:0/2358610810 shutdown_connections 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.790+0000 7fec9bfb0640 1 -- 172.21.15.5:0/2358610810 >> 172.21.15.5:0/2358610810 conn(0x7fec9406b000 msgr2=0x7fec9406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.790+0000 7fec9bfb0640 1 -- 172.21.15.5:0/2358610810 shutdown_connections 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.790+0000 7fec9bfb0640 1 -- 172.21.15.5:0/2358610810 wait complete. 2024-04-25T08:58:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.791+0000 7fec9bfb0640 1 Processor -- start 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.791+0000 7fec9bfb0640 1 -- start start 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9bfb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec800039e0 0x7fec940cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9bfb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec94153f60 0x7fec94145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9bfb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec941543e0 0x7fec94146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9bfb0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940d3720 con 0x7fec941543e0 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9bfb0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940d2ae0 con 0x7fec800039e0 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9bfb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec940d38a0 con 0x7fec94153f60 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9a54d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec941543e0 0x7fec94146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9a54d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec941543e0 0x7fec94146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51284/0 (socket says 172.21.15.5:51284) 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9a54d640 1 -- 172.21.15.5:0/1623330851 learned_addr learned my addr 172.21.15.5:0/1623330851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec9954b640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec94153f60 0x7fec94145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.792+0000 7fec99d4c640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec800039e0 0x7fec940cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9a54d640 1 -- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec94153f60 msgr2=0x7fec94145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9a54d640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec94153f60 0x7fec94145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9a54d640 1 -- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec800039e0 msgr2=0x7fec940cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9a54d640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec800039e0 0x7fec940cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9a54d640 1 -- 172.21.15.5:0/1623330851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940cbfd0 con 0x7fec941543e0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9954b640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec94153f60 0x7fec94145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec99d4c640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec800039e0 0x7fec940cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9a54d640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec941543e0 0x7fec94146510 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fec940d43c0 tx=0x7fec9000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec8a7fc640 1 -- 172.21.15.5:0/1623330851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90019070 con 0x7fec941543e0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec8a7fc640 1 -- 172.21.15.5:0/1623330851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90006d60 con 0x7fec941543e0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec8a7fc640 1 -- 172.21.15.5:0/1623330851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90003bb0 con 0x7fec941543e0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec940cc2b0 con 0x7fec941543e0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.793+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec940cc870 con 0x7fec941543e0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.794+0000 7fec8a7fc640 1 -- 172.21.15.5:0/1623330851 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fec9001c070 con 0x7fec941543e0 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.795+0000 7fec8a7fc640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fec7806b4d0 0x7fec7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.795+0000 7fec8a7fc640 1 -- 172.21.15.5:0/1623330851 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fec900895b0 con 0x7fec941543e0 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.795+0000 7fec99d4c640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fec7806b4d0 0x7fec7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.796+0000 7fec99d4c640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fec7806b4d0 0x7fec7806d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec8c032000 tx=0x7fec8c02d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.796+0000 7fec9ed93740 1 Processor -- start 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.796+0000 7fec9ed93740 1 -- start start 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b3e2ca0 0x55645b3e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b41f370 0x55645b3e3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b40dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9ed93740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55645b345b90 con 0x55645b40d760 2024-04-25T08:58:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55645b2eee40 con 0x55645b41f370 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55645b341c30 con 0x55645b3e2ca0 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b40dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b40dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51290/0 (socket says 172.21.15.5:51290) 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 -- 172.21.15.5:0/661066611 learned_addr learned my addr 172.21.15.5:0/661066611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9954b640 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b41f370 0x55645b3e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec99d4c640 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b3e2ca0 0x55645b3e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 -- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b3e2ca0 msgr2=0x55645b3e4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b3e2ca0 0x55645b3e4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 -- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b41f370 msgr2=0x55645b3e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b41f370 0x55645b3e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 -- 172.21.15.5:0/661066611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55645b1247d0 con 0x55645b40d760 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9954b640 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b41f370 0x55645b3e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec9a54d640 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b40dbe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fec9005fe50 tx=0x7fec900584b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a7cba041b76677 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec777fe640 1 -- 172.21.15.5:0/661066611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90060380 con 0x55645b40d760 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec777fe640 1 -- 172.21.15.5:0/661066611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90055d10 con 0x55645b40d760 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.797+0000 7fec777fe640 1 -- 172.21.15.5:0/661066611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900542e0 con 0x55645b40d760 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 -- 172.21.15.5:0/661066611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 msgr2=0x55645b40dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b40dbe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fec9005fe50 tx=0x7fec900584b0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 -- 172.21.15.5:0/661066611 shutdown_connections 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b40dbe0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b41f370 0x55645b3e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 --2- 172.21.15.5:0/661066611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b3e2ca0 0x55645b3e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 -- 172.21.15.5:0/661066611 >> 172.21.15.5:0/661066611 conn(0x55645b3aa870 msgr2=0x55645b428760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 -- 172.21.15.5:0/661066611 shutdown_connections 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.798+0000 7fec9ed93740 1 -- 172.21.15.5:0/661066611 wait complete. 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.799+0000 7fec9ed93740 1 -- start start 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.799+0000 7fec9ed93740 1 Processor -- start 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b3e2ca0 0x55645b3fd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b424f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b3fd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55645b345b90 con 0x55645b40d760 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55645b3023e0 con 0x55645b3e2ca0 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55645b3fe550 con 0x55645b41f370 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 10 client.0 _ll_register_callbacks cb 0x55645b301db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b424f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b424f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51304/0 (socket says 172.21.15.5:51304) 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 -- 172.21.15.5:0/1051393831 learned_addr learned my addr 172.21.15.5:0/1051393831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec99d4c640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b3e2ca0 0x55645b3fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9a54d640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b3fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 -- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 msgr2=0x55645b3fd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b3fd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 -- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b3e2ca0 msgr2=0x55645b3fd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b3e2ca0 0x55645b3fd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 -- 172.21.15.5:0/1051393831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55645b01a0f0 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9a54d640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b3fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9954b640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b424f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fec84004650 tx=0x7fec84015b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f51dc5a716d6a08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec74ff9640 1 -- 172.21.15.5:0/1051393831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84023060 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec74ff9640 1 -- 172.21.15.5:0/1051393831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fec84013920 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec90055d10 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.800+0000 7fec74ff9640 1 -- 172.21.15.5:0/1051393831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec84013b20 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 10 client.5409 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55645b184f60 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec74ff9640 1 -- 172.21.15.5:0/1051393831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90055d10 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec74ff9640 1 -- 172.21.15.5:0/1051393831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fec8402c080 con 0x55645b40d760 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 10 client.5409 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 10 client.5409 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 20 client.5409 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3fde80 0x55645b425b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 4 client.5409 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55645b3530d0 con 0x55645b3fde80 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec99d4c640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3fde80 0x55645b425b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec99d4c640 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3fde80 0x55645b425b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22ab7851c42322eb server_cookie=609c32125ac75a8b in_seq=0 out_seq=0 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.801+0000 7fec74ff9640 10 client.5409 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec74ff9640 1 -- 172.21.15.5:0/1051393831 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55645b3530d0 con 0x55645b3fde80 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec74ff9640 10 client.5409 handle_command_reply: tid=0 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 client.5409 shutdown 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 msgr2=0x55645b424f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b424f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fec84004650 tx=0x7fec84015b50 comp rx=0 tx=0).stop 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 shutdown_connections 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3fde80 0x55645b425b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b3fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b40d760 0x55645b424f20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec74ff9640 0 client.5409 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 --2- 172.21.15.5:0/1051393831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b3e2ca0 0x55645b3fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 >> 172.21.15.5:0/1051393831 conn(0x55645b3aa870 msgr2=0x55645b42bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 shutdown_connections 2024-04-25T08:58:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 1 -- 172.21.15.5:0/1051393831 wait complete. 2024-04-25T08:58:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.802+0000 7fec9ed93740 20 client.5409 trim_cache size 0 max 16384 2024-04-25T08:58:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.816+0000 7fec9ed93740 1 Processor -- start 2024-04-25T08:58:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.816+0000 7fec9ed93740 1 -- start start 2024-04-25T08:58:58.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b426e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 0x55645b40a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b40be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec9ed93740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94200450 con 0x55645b3e2ca0 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec941ff650 con 0x55645b40d760 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec94156980 con 0x55645b41f370 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b426e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b426e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51316/0 (socket says 172.21.15.5:51316) 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 -- 172.21.15.5:0/3588488113 learned_addr learned my addr 172.21.15.5:0/3588488113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 -- 172.21.15.5:0/3588488113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 msgr2=0x55645b40be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 --2- 172.21.15.5:0/3588488113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b40be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 -- 172.21.15.5:0/3588488113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 msgr2=0x55645b40a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 --2- 172.21.15.5:0/3588488113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 0x55645b40a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.817+0000 7fec99d4c640 1 -- 172.21.15.5:0/3588488113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55645aff31b0 con 0x55645b3e2ca0 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec99d4c640 1 --2- 172.21.15.5:0/3588488113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b426e30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fec8c001970 tx=0x7fec8c009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb206a5aee051e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec76ffd640 1 -- 172.21.15.5:0/3588488113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c005c80 con 0x55645b3e2ca0 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec76ffd640 1 -- 172.21.15.5:0/3588488113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c005e20 con 0x55645b3e2ca0 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec76ffd640 1 -- 172.21.15.5:0/3588488113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0074c0 con 0x55645b3e2ca0 2024-04-25T08:58:58.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 -- 172.21.15.5:0/3588488113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 msgr2=0x55645b426e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3588488113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b426e30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fec8c001970 tx=0x7fec8c009030 comp rx=0 tx=0).stop 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 -- 172.21.15.5:0/3588488113 shutdown_connections 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3588488113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b40be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3588488113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 0x55645b40a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3588488113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b426e30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 -- 172.21.15.5:0/3588488113 >> 172.21.15.5:0/3588488113 conn(0x55645b3aa870 msgr2=0x55645b3e3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 -- 172.21.15.5:0/3588488113 shutdown_connections 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.818+0000 7fec9ed93740 1 -- 172.21.15.5:0/3588488113 wait complete. 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.819+0000 7fec9ed93740 1 -- start start 2024-04-25T08:58:58.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.819+0000 7fec9ed93740 1 Processor -- start 2024-04-25T08:58:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b441800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 0x55645b441d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9ed93740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b429d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9ed93740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55645b3fca30 con 0x55645b3e2ca0 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94156f80 con 0x55645b40d760 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9ed93740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55645b3dc870 con 0x55645b41f370 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9ed93740 10 client.0 _ll_register_callbacks cb 0x7fec84006c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b441800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b441800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51326/0 (socket says 172.21.15.5:51326) 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 -- 172.21.15.5:0/3279582383 learned_addr learned my addr 172.21.15.5:0/3279582383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9a54d640 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b429d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec9954b640 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 0x55645b441d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 -- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 msgr2=0x55645b429d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b429d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 -- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 msgr2=0x55645b441d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 0x55645b441d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 -- 172.21.15.5:0/3279582383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55645b439cb0 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec99d4c640 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b441800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec8c001970 tx=0x7fec8c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194fa453121c549b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.820+0000 7fec74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec74ff9640 1 -- 172.21.15.5:0/3279582383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c05e020 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec74ff9640 1 -- 172.21.15.5:0/3279582383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fec8c037040 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec8c005e20 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec74ff9640 1 -- 172.21.15.5:0/3279582383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec8c007580 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 10 client.5415 fetch_fsmap learned FSMap version 14 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55645b3fc2b0 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec74ff9640 1 -- 172.21.15.5:0/3279582383 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c005e20 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec74ff9640 1 -- 172.21.15.5:0/3279582383 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fec8c03d040 con 0x55645b3e2ca0 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 10 client.5415 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 10 client.5415 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 20 client.5415 populate_metadata read hostname 'smithi005' 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3dcae0 0x55645b42a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 4 client.5415 mds_command: new command op to 5112 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 --> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55645b34d420 con 0x55645b3dcae0 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.821+0000 7fec9954b640 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3dcae0 0x55645b42a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec74ff9640 10 client.5415 ms_handle_connect on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9954b640 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3dcae0 0x55645b42a240 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa4f0367a9bad03 server_cookie=1bb380b4dcc03163 in_seq=0 out_seq=0 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec74ff9640 1 -- 172.21.15.5:0/3279582383 <== mds.0 v2:172.21.15.5:6833/3359008015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17932 (crc 0 0 0) 0x55645b34d420 con 0x55645b3dcae0 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec74ff9640 10 client.5415 handle_command_reply: tid=0 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 client.5415 shutdown 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 msgr2=0x55645b441800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b441800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec8c001970 tx=0x7fec8c02c000 comp rx=0 tx=0).stop 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 shutdown_connections 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:6833/3359008015,v1:172.21.15.5:6834/3359008015] conn(0x55645b3dcae0 0x55645b42a240 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55645b41f370 0x55645b429d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55645b40d760 0x55645b441d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec74ff9640 0 client.5415 ms_handle_reset on v2:172.21.15.5:6833/3359008015 2024-04-25T08:58:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 --2- 172.21.15.5:0/3279582383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55645b3e2ca0 0x55645b441800 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 >> 172.21.15.5:0/3279582383 conn(0x55645b3aa870 msgr2=0x55645b423e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 shutdown_connections 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.822+0000 7fec9ed93740 1 -- 172.21.15.5:0/3279582383 wait complete. 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9ed93740 20 client.5415 trim_cache size 0 max 16384 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 3201, 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 3202, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 808835, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 38664047, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 17, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 6, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.364842376, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.192003805, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.062666895, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.091007647, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3201, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.386927932, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000120877 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:58:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 10, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000001090, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000109 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 28820, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 50883, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 9471826, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 44838743, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 3.600673148, 2024-04-25T08:58:58.820 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 2.482539850, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.552896384, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.061250559, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 50882, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.339761176, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000026330 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 72905, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.009699670, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000133 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 117552 2024-04-25T08:58:58.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 3597, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 3590, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 1403163, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 29816979, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.327744930, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.144072994, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.071613211, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.097288614, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3590, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.444762449, 2024-04-25T08:58:58.822 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000123889 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 121120, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 25296 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.823 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2930, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.550762785, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.005648724 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3858, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.262395627, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000327215 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.824 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 25637, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 25637, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 25637, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 270.269273053, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.010542156 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-04-25T08:58:58.825 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 17856, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 17856, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 17856, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 2, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 2, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 46684, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 46153, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-04-25T08:58:58.826 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 126, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 2013, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 2013, 2024-04-25T08:58:58.827 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 13, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 2, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 11, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 2000, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 1256, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4042, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 3262, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2127, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 51, 2024-04-25T08:58:58.828 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 14024 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4091, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 3819, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2210, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-04-25T08:58:58.829 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 1, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 26846, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 26846, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 38, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 38, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 95592374, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-04-25T08:58:58.831 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2604, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 77.135800411, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.029622043 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 14, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2016, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 2002, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 17856, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19857, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 2001, 2024-04-25T08:58:58.832 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 2, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 7057, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 7055, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 108468, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 215396 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 28623, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 25637, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 5, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.334066105, 2024-04-25T08:58:58.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000667033 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003900570, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000134502 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.957803415, 2024-04-25T08:58:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001326300 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7385, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 6.781503698, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000918280 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000039821, 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000039821 2024-04-25T08:58:58.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.002466088, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002466088 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.039410054, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.039410054 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.214328225, 2024-04-25T08:58:58.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.026791028 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2210, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 237.687907064, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.107551089 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.040297737, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.040297737 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.840 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000258983, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000258983 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.842 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.207291293, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002025911 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-04-25T08:58:58.843 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18790, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18790, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 73, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-04-25T08:58:58.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T08:58:58.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T08:58:58.846 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 250091, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 92, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 440, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 5, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5416, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 77, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-04-25T08:58:58.847 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 13446173, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 661140, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 8686, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 92083290, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 37, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 8686, 2024-04-25T08:58:58.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8686, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 31.206367029, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003592720 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8686, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 8781 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 8686, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 2071, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 6615, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-04-25T08:58:58.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 56, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2658, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 33, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1819, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 2033, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 2015, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-04-25T08:58:58.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-04-25T08:58:58.851 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 33, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 3, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-04-25T08:58:58.852 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 105, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 29 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-04-25T08:58:58.853 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 3819, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 3819, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 35612, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 8473016, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:58.854 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 35612, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 35612, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8473016, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:58.855 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8686, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 92483561, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8686, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 92483561, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8686, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 8686, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8686, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8686, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3819, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 400271, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3819, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 54, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 400271, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x5623bd5686e0": { 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 26846, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 91398070, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 26846, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2604, 2024-04-25T08:58:58.859 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 91398070, 2024-04-25T08:58:58.860 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T08:58:58.860 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T08:58:58.860 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T08:58:58.860 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T08:58:58.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:58:58.860 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:58:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fec7806b4d0 msgr2=0x7fec7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fec7806b4d0 0x7fec7806d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec8c032000 tx=0x7fec8c02d000 comp rx=0 tx=0).stop 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec941543e0 msgr2=0x7fec94146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec941543e0 0x7fec94146510 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fec940d43c0 tx=0x7fec9000ff70 comp rx=0 tx=0).stop 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 shutdown_connections 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fec7806b4d0 0x7fec7806d990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec941543e0 0x7fec94146510 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec94153f60 0x7fec94145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 --2- 172.21.15.5:0/1623330851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec800039e0 0x7fec940cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 >> 172.21.15.5:0/1623330851 conn(0x7fec9406b000 msgr2=0x7fec940b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 shutdown_connections 2024-04-25T08:58:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:58.823+0000 7fec9bfb0640 1 -- 172.21.15.5:0/1623330851 wait complete. 2024-04-25T08:58:58.863 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:58:58.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:58:58.903 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:58:58.951 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:58:58.951 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:58:58.951 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:58.970 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:58:58.970 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:59.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:58:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.177+0000 7ff5b7929640 1 Processor -- start 2024-04-25T08:58:59.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.177+0000 7ff5b7929640 1 -- start start 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.178+0000 7ff5b7929640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5b015bdc0 0x7ff5b00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.178+0000 7ff5b7929640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b00cdcb0 con 0x7ff5b00ce9a0 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.178+0000 7ff5b7929640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b00cdf90 con 0x7ff5b00cd6e0 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.178+0000 7ff5b7929640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00b47e0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.178+0000 7ff5b56c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5b015bdc0 0x7ff5b00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.178+0000 7ff5b5ec6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5b00ce9a0 0x7ff5b00b52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47596/0 (socket says 172.21.15.5:47596) 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.178+0000 7ff5b5ec6640 1 -- 172.21.15.5:0/1816854094 learned_addr learned my addr 172.21.15.5:0/1816854094 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:58:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.179+0000 7ff5b56c5640 1 -- 172.21.15.5:0/1816854094 >> v1:172.21.15.80:6789/0 conn(0x7ff5b00cd6e0 legacy=0x7ff5b00ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.179+0000 7ff5b56c5640 1 -- 172.21.15.5:0/1816854094 >> v1:172.21.15.5:6789/0 conn(0x7ff5b00ce9a0 legacy=0x7ff5b00b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.179+0000 7ff5b56c5640 1 -- 172.21.15.5:0/1816854094 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00b4ac0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.179+0000 7ff5b56c5640 1 --2- 172.21.15.5:0/1816854094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b00cd1a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009d90 tx=0x7ff5a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972ea22510763450 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.179+0000 7ff5affff640 1 -- 172.21.15.5:0/1816854094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0007740 con 0x7ff5b015bdc0 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.179+0000 7ff5affff640 1 -- 172.21.15.5:0/1816854094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a00078e0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5affff640 1 -- 172.21.15.5:0/1816854094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0007cb0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5b7929640 1 -- 172.21.15.5:0/1816854094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 msgr2=0x7ff5b00cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1816854094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b00cd1a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009d90 tx=0x7ff5a002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5b7929640 1 -- 172.21.15.5:0/1816854094 shutdown_connections 2024-04-25T08:58:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1816854094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b00cd1a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5b7929640 1 -- 172.21.15.5:0/1816854094 >> 172.21.15.5:0/1816854094 conn(0x7ff5b00d18f0 msgr2=0x7ff5b00d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5b7929640 1 -- 172.21.15.5:0/1816854094 shutdown_connections 2024-04-25T08:58:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.180+0000 7ff5b7929640 1 -- 172.21.15.5:0/1816854094 wait complete. 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.181+0000 7ff5b7929640 1 Processor -- start 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.181+0000 7ff5b7929640 1 -- start start 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b7929640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b00cd6e0 0x7ff5b015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b7929640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5b00ce9a0 0x7ff5b00c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b7929640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b7929640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015c1a0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b7929640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00d09a0 con 0x7ff5b00cd6e0 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b7929640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015c320 con 0x7ff5b00ce9a0 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b5ec6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b5ec6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b015cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51348/0 (socket says 172.21.15.5:51348) 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.182+0000 7ff5b5ec6640 1 -- 172.21.15.5:0/1694360166 learned_addr learned my addr 172.21.15.5:0/1694360166 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b56c5640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b00cd6e0 0x7ff5b015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b4ec4640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5b00ce9a0 0x7ff5b00c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b5ec6640 1 -- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5b00ce9a0 msgr2=0x7ff5b00c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b5ec6640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5b00ce9a0 0x7ff5b00c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b5ec6640 1 -- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b00cd6e0 msgr2=0x7ff5b015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b5ec6640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b00cd6e0 0x7ff5b015c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b5ec6640 1 -- 172.21.15.5:0/1694360166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b015cbd0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b4ec4640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5b00ce9a0 0x7ff5b00c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b5ec6640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b015cde0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8001eb0 tx=0x7ff5a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5adffb640 1 -- 172.21.15.5:0/1694360166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8017070 con 0x7ff5b015bdc0 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5adffb640 1 -- 172.21.15.5:0/1694360166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8005d00 con 0x7ff5b015bdc0 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b00cb5c0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5adffb640 1 -- 172.21.15.5:0/1694360166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8007310 con 0x7ff5b015bdc0 2024-04-25T08:58:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.183+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b00cb860 con 0x7ff5b015bdc0 2024-04-25T08:58:59.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.184+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b006adc0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.185+0000 7ff5adffb640 1 -- 172.21.15.5:0/1694360166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff5a801a070 con 0x7ff5b015bdc0 2024-04-25T08:58:59.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.185+0000 7ff5adffb640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59c06b4d0 0x7ff59c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.185+0000 7ff5adffb640 1 -- 172.21.15.5:0/1694360166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff5a8089510 con 0x7ff5b015bdc0 2024-04-25T08:58:59.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.186+0000 7ff5b56c5640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59c06b4d0 0x7ff59c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.186+0000 7ff5b56c5640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59c06b4d0 0x7ff59c06d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0034000 tx=0x7ff5a002f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.190+0000 7ff5adffb640 1 -- 172.21.15.5:0/1694360166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5b006adc0 con 0x7ff5b015bdc0 2024-04-25T08:58:59.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.370+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5b004ef20 con 0x7ff5b015bdc0 2024-04-25T08:58:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.371+0000 7ff5adffb640 1 -- 172.21.15.5:0/1694360166 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16650 (secure 0 0 0) 0x7ff5a8058400 con 0x7ff5b015bdc0 2024-04-25T08:58:59.361 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:58:59.361 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:58:40.086289+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:31.301883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:31.733858+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59c06b4d0 msgr2=0x7ff59c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59c06b4d0 0x7ff59c06d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0034000 tx=0x7ff5a002f000 comp rx=0 tx=0).stop 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 msgr2=0x7ff5b015cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b015cde0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8001eb0 tx=0x7ff5a800c890 comp rx=0 tx=0).stop 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 shutdown_connections 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59c06b4d0 0x7ff59c06d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b015bdc0 0x7ff5b015cde0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5b00ce9a0 0x7ff5b00c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 --2- 172.21.15.5:0/1694360166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b00cd6e0 0x7ff5b015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 >> 172.21.15.5:0/1694360166 conn(0x7ff5b00d18f0 msgr2=0x7ff5b00b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 shutdown_connections 2024-04-25T08:58:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.373+0000 7ff5b7929640 1 -- 172.21.15.5:0/1694360166 wait complete. 2024-04-25T08:58:59.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:57:31.301883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:57:31.733858+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 32, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:58:59.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:58:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.488+0000 7f03bf1b7640 1 Processor -- start 2024-04-25T08:58:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.488+0000 7f03bf1b7640 1 -- start start 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bf1b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 0x7f03b806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bf1b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03b80cc780 0x7f03b80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bf1b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b80d27f0 con 0x7f03b815e0b0 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bf1b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b80cfee0 con 0x7f03b80cc780 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bf1b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80d01c0 con 0x7f03b80d0c80 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bcf53640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03b815e0b0 0x7f03b80cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47602/0 (socket says 172.21.15.5:47602) 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bcf53640 1 -- 172.21.15.5:0/850224732 learned_addr learned my addr 172.21.15.5:0/850224732 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03bd754640 1 --2- 172.21.15.5:0/850224732 >> v2:172.21.15.80:3300/0 conn(0x7f03b80cc780 0x7f03b80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b7fff640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 0x7f03b806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420575375 0 0) 0x7f03b80d27f0 con 0x7f03b815e0b0 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a8003520 con 0x7f03b815e0b0 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420976673 0 0) 0x7f03a8003520 con 0x7f03b815e0b0 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 msgr2=0x7f03b806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 0x7f03b806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 >> v2:172.21.15.80:3300/0 conn(0x7f03b80cc780 msgr2=0x7f03b80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 --2- 172.21.15.5:0/850224732 >> v2:172.21.15.80:3300/0 conn(0x7f03b80cc780 0x7f03b80ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b80d04a0 con 0x7f03b815e0b0 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f03ac001670 con 0x7f03b815e0b0 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 >> v1:172.21.15.5:6789/0 conn(0x7f03b815e0b0 legacy=0x7f03b80cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a80039b0 0x7f03a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a8004800 0x7f03a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 0x7f03a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80cfee0 con 0x7f03a80039b0 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80d01c0 con 0x7f03a8004800 2024-04-25T08:58:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.489+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a800b9c0 con 0x7f03b80d0c80 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03bcf53640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a80039b0 0x7f03a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03b7fff640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a8004800 0x7f03a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03bd754640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 0x7f03a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03bcf53640 1 -- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 msgr2=0x7f03a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03bcf53640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80d0c80 0x7f03a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03bcf53640 1 -- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a8004800 msgr2=0x7f03a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03bcf53640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a8004800 0x7f03a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.490+0000 7f03bcf53640 1 -- 172.21.15.5:0/850224732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8003520 con 0x7f03a80039b0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bcf53640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a80039b0 0x7f03a8003dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f03ac001050 tx=0x7f03a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45ee015501df2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac02e070 con 0x7f03a80039b0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac005af0 con 0x7f03a80039b0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03b77fe640 1 -- 172.21.15.5:0/850224732 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac007d70 con 0x7f03a80039b0 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bf1b7640 1 -- 172.21.15.5:0/850224732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a80039b0 msgr2=0x7f03a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bf1b7640 1 --2- 172.21.15.5:0/850224732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a80039b0 0x7f03a8003dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f03ac001050 tx=0x7f03a8005830 comp rx=0 tx=0).stop 2024-04-25T08:58:59.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bd754640 1 -- 172.21.15.5:0/850224732 reap_dead start 2024-04-25T08:58:59.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bf1b7640 1 -- 172.21.15.5:0/850224732 shutdown_connections 2024-04-25T08:58:59.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bf1b7640 1 -- 172.21.15.5:0/850224732 >> 172.21.15.5:0/850224732 conn(0x7f03b80d1a20 msgr2=0x7f03b80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:59.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bf1b7640 1 -- 172.21.15.5:0/850224732 shutdown_connections 2024-04-25T08:58:59.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.491+0000 7f03bf1b7640 1 -- 172.21.15.5:0/850224732 wait complete. 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.492+0000 7f03bf1b7640 1 Processor -- start 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.492+0000 7f03bf1b7640 1 -- start start 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03bf1b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80039b0 0x7f03b8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03bf1b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b8157590 0x7f03b80c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03bf1b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80c59e0 0x7f03b81f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03bf1b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80cfb90 con 0x7f03b8157590 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03bf1b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b815e490 con 0x7f03a80039b0 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03bf1b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80ccc10 con 0x7f03b80c59e0 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b8157590 0x7f03b80c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b8157590 0x7f03b80c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51370/0 (socket says 172.21.15.5:51370) 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.493+0000 7f03b7fff640 1 -- 172.21.15.5:0/2254503795 learned_addr learned my addr 172.21.15.5:0/2254503795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03bd754640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80c59e0 0x7f03b81f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03bcf53640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80039b0 0x7f03b8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b7fff640 1 -- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80c59e0 msgr2=0x7f03b81f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b7fff640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80c59e0 0x7f03b81f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b7fff640 1 -- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80039b0 msgr2=0x7f03b8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b7fff640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80039b0 0x7f03b8157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b7fff640 1 -- 172.21.15.5:0/2254503795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b81f8120 con 0x7f03b8157590 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b7fff640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b8157590 0x7f03b80c54a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f03a40118e0 tx=0x7f03a4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b57fa640 1 -- 172.21.15.5:0/2254503795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400faf0 con 0x7f03b8157590 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b57fa640 1 -- 172.21.15.5:0/2254503795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a400fc90 con 0x7f03b8157590 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b8157a80 con 0x7f03b8157590 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03b57fa640 1 -- 172.21.15.5:0/2254503795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4014440 con 0x7f03b8157590 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.494+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b8158040 con 0x7f03b8157590 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.495+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b804ef20 con 0x7f03b8157590 2024-04-25T08:58:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.496+0000 7f03b57fa640 1 -- 172.21.15.5:0/2254503795 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f03a4012040 con 0x7f03b8157590 2024-04-25T08:58:59.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.496+0000 7f03b57fa640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f039c06b4d0 0x7f039c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.496+0000 7f03b57fa640 1 -- 172.21.15.5:0/2254503795 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f03a408a7e0 con 0x7f03b8157590 2024-04-25T08:58:59.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.496+0000 7f03bcf53640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f039c06b4d0 0x7f039c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.497+0000 7f03bcf53640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f039c06b4d0 0x7f039c06d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f03ac033000 tx=0x7f03ac009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.500+0000 7f03b57fa640 1 -- 172.21.15.5:0/2254503795 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03b81f8120 con 0x7f03b8157590 2024-04-25T08:58:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.679+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03b80ce8f0 con 0x7f03b8157590 2024-04-25T08:58:59.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.679+0000 7f03b57fa640 1 -- 172.21.15.5:0/2254503795 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03a4019030 con 0x7f03b8157590 2024-04-25T08:58:59.669 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:58:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.681+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f039c06b4d0 msgr2=0x7f039c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.681+0000 7f03bf1b7640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f039c06b4d0 0x7f039c06d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f03ac033000 tx=0x7f03ac009030 comp rx=0 tx=0).stop 2024-04-25T08:58:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.681+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b8157590 msgr2=0x7f03b80c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.681+0000 7f03bf1b7640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b8157590 0x7f03b80c54a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f03a40118e0 tx=0x7f03a4011da0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 shutdown_connections 2024-04-25T08:58:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f039c06b4d0 0x7f039c06d990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f03b80c59e0 0x7f03b81f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b8157590 0x7f03b80c54a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 --2- 172.21.15.5:0/2254503795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80039b0 0x7f03b8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 >> 172.21.15.5:0/2254503795 conn(0x7f03b80d1a20 msgr2=0x7f03b806fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 shutdown_connections 2024-04-25T08:58:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.682+0000 7f03bf1b7640 1 -- 172.21.15.5:0/2254503795 wait complete. 2024-04-25T08:58:59.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:58:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.796+0000 7f9d40130640 1 Processor -- start 2024-04-25T08:58:59.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.796+0000 7f9d40130640 1 -- start start 2024-04-25T08:58:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d40130640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d3815e0b0 0x7f9d3806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d40130640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d380cc780 0x7f9d380ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d40130640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380d27f0 con 0x7f9d380d0c80 2024-04-25T08:58:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d40130640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380cfee0 con 0x7f9d380cc780 2024-04-25T08:58:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d40130640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380d01c0 con 0x7f9d3815e0b0 2024-04-25T08:58:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3e6cd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d380cc780 0x7f9d380ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3d6cb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9d380d0c80 0x7f9d380cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47610/0 (socket says 172.21.15.5:47610) 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3d6cb640 1 -- 172.21.15.5:0/1722421675 learned_addr learned my addr 172.21.15.5:0/1722421675 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3decc640 1 --2- 172.21.15.5:0/1722421675 >> v2:172.21.15.80:3300/0 conn(0x7f9d3815e0b0 0x7f9d3806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3e6cd640 1 -- 172.21.15.5:0/1722421675 >> v2:172.21.15.80:3300/0 conn(0x7f9d3815e0b0 msgr2=0x7f9d3806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3e6cd640 1 --2- 172.21.15.5:0/1722421675 >> v2:172.21.15.80:3300/0 conn(0x7f9d3815e0b0 0x7f9d3806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3e6cd640 1 -- 172.21.15.5:0/1722421675 >> v1:172.21.15.5:6789/0 conn(0x7f9d380d0c80 legacy=0x7f9d380cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.797+0000 7f9d3e6cd640 1 -- 172.21.15.5:0/1722421675 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380d04a0 con 0x7f9d380cc780 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.798+0000 7f9d3e6cd640 1 --2- 172.21.15.5:0/1722421675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d380cc780 0x7f9d380ce3b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009d90 tx=0x7f9d2802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2508a0f41f09b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.798+0000 7f9d3ceca640 1 -- 172.21.15.5:0/1722421675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28007740 con 0x7f9d380cc780 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.798+0000 7f9d3ceca640 1 -- 172.21.15.5:0/1722421675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d280078e0 con 0x7f9d380cc780 2024-04-25T08:58:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.798+0000 7f9d3ceca640 1 -- 172.21.15.5:0/1722421675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28007cb0 con 0x7f9d380cc780 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 -- 172.21.15.5:0/1722421675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d380cc780 msgr2=0x7f9d380ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 --2- 172.21.15.5:0/1722421675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d380cc780 0x7f9d380ce3b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009d90 tx=0x7f9d2802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 -- 172.21.15.5:0/1722421675 shutdown_connections 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 --2- 172.21.15.5:0/1722421675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d380cc780 0x7f9d380ce3b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 --2- 172.21.15.5:0/1722421675 >> v2:172.21.15.80:3300/0 conn(0x7f9d3815e0b0 0x7f9d3806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 -- 172.21.15.5:0/1722421675 >> 172.21.15.5:0/1722421675 conn(0x7f9d380d1a20 msgr2=0x7f9d380d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 -- 172.21.15.5:0/1722421675 shutdown_connections 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.799+0000 7f9d40130640 1 -- 172.21.15.5:0/1722421675 wait complete. 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.800+0000 7f9d40130640 1 Processor -- start 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.800+0000 7f9d40130640 1 -- start start 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d40130640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d380cc780 0x7f9d381f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d40130640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d380d0c80 0x7f9d3815ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d40130640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d3815e0b0 0x7f9d380cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d40130640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380cfb90 con 0x7f9d3815e0b0 2024-04-25T08:58:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d40130640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3815e490 con 0x7f9d380d0c80 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d40130640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380ccc30 con 0x7f9d380cc780 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d3815e0b0 0x7f9d380cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d3815e0b0 0x7f9d380cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51394/0 (socket says 172.21.15.5:51394) 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 -- 172.21.15.5:0/248269080 learned_addr learned my addr 172.21.15.5:0/248269080 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3decc640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d380cc780 0x7f9d381f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3d6cb640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d380d0c80 0x7f9d3815ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 -- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d380cc780 msgr2=0x7f9d381f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d380cc780 0x7f9d381f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 -- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d380d0c80 msgr2=0x7f9d3815ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d380d0c80 0x7f9d3815ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3e6cd640 1 -- 172.21.15.5:0/248269080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d381f4430 con 0x7f9d3815e0b0 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.801+0000 7f9d3d6cb640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d380d0c80 0x7f9d3815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.802+0000 7f9d3e6cd640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d3815e0b0 0x7f9d380cb0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9d2802ac90 tx=0x7f9d28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.802+0000 7f9d367fc640 1 -- 172.21.15.5:0/248269080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28040070 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.802+0000 7f9d367fc640 1 -- 172.21.15.5:0/248269080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d28031bc0 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.802+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d381f4710 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.802+0000 7f9d367fc640 1 -- 172.21.15.5:0/248269080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28045460 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.802+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d381f4cd0 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.803+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3804ef20 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.803+0000 7f9d367fc640 1 -- 172.21.15.5:0/248269080 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d28039040 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.804+0000 7f9d367fc640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d2406b500 0x7f9d2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.804+0000 7f9d367fc640 1 -- 172.21.15.5:0/248269080 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9d280abbc0 con 0x7f9d3815e0b0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.804+0000 7f9d3decc640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d2406b500 0x7f9d2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.804+0000 7f9d3decc640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d2406b500 0x7f9d2406d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d30006fd0 tx=0x7f9d30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.808+0000 7f9d367fc640 1 -- 172.21.15.5:0/248269080 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d2807a980 con 0x7f9d3815e0b0 2024-04-25T08:58:59.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.986+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d380b79a0 con 0x7f9d3815e0b0 2024-04-25T08:58:59.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.987+0000 7f9d367fc640 1 -- 172.21.15.5:0/248269080 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d2807a280 con 0x7f9d3815e0b0 2024-04-25T08:58:59.977 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:58:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d2406b500 msgr2=0x7f9d2406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d2406b500 0x7f9d2406d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d30006fd0 tx=0x7f9d30008040 comp rx=0 tx=0).stop 2024-04-25T08:58:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d3815e0b0 msgr2=0x7f9d380cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d3815e0b0 0x7f9d380cb0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9d2802ac90 tx=0x7f9d28004a40 comp rx=0 tx=0).stop 2024-04-25T08:58:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 shutdown_connections 2024-04-25T08:58:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9d2406b500 0x7f9d2406d9c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d3815e0b0 0x7f9d380cb0a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d380d0c80 0x7f9d3815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 --2- 172.21.15.5:0/248269080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9d380cc780 0x7f9d381f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 >> 172.21.15.5:0/248269080 conn(0x7f9d380d1a20 msgr2=0x7f9d38068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 shutdown_connections 2024-04-25T08:58:59.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:58:59.989+0000 7f9d40130640 1 -- 172.21.15.5:0/248269080 wait complete. 2024-04-25T08:58:59.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:59:00.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.103+0000 7f4e6c83f640 1 Processor -- start 2024-04-25T08:59:00.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.104+0000 7f4e6c83f640 1 -- start start 2024-04-25T08:59:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.104+0000 7f4e6c83f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e680b6250 0x7f4e680ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.104+0000 7f4e6c83f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e680cee10 0x7f4e680d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.104+0000 7f4e6c83f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e68162150 con 0x7f4e6815df10 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.104+0000 7f4e6c83f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e680cf260 con 0x7f4e680cee10 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.104+0000 7f4e6c83f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e680d20d0 con 0x7f4e680b6250 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e66d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e680cee10 0x7f4e680d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e66d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e680cee10 0x7f4e680d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51402/0 (socket says 172.21.15.5:51402) 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e66d9d640 1 -- 172.21.15.5:0/338086384 learned_addr learned my addr 172.21.15.5:0/338086384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e65d9b640 1 --2- 172.21.15.5:0/338086384 >> v2:172.21.15.80:3300/0 conn(0x7f4e680b6250 0x7f4e680ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e66d9d640 1 -- 172.21.15.5:0/338086384 >> v2:172.21.15.80:3300/0 conn(0x7f4e680b6250 msgr2=0x7f4e680ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e66d9d640 1 --2- 172.21.15.5:0/338086384 >> v2:172.21.15.80:3300/0 conn(0x7f4e680b6250 0x7f4e680ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e66d9d640 1 -- 172.21.15.5:0/338086384 >> v1:172.21.15.80:6789/0 conn(0x7f4e6815df10 legacy=0x7f4e681618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:00.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.105+0000 7f4e66d9d640 1 -- 172.21.15.5:0/338086384 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68162430 con 0x7f4e680cee10 2024-04-25T08:59:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e66d9d640 1 --2- 172.21.15.5:0/338086384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e680d2560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b9d70 tx=0x7f4e6002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780cb1b4b29cc0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6559a640 1 -- 172.21.15.5:0/338086384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60036070 con 0x7f4e680cee10 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6559a640 1 -- 172.21.15.5:0/338086384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60031600 con 0x7f4e680cee10 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6559a640 1 -- 172.21.15.5:0/338086384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600319d0 con 0x7f4e680cee10 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6c83f640 1 -- 172.21.15.5:0/338086384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 msgr2=0x7f4e680d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/338086384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e680d2560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b9d70 tx=0x7f4e6002a730 comp rx=0 tx=0).stop 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6c83f640 1 -- 172.21.15.5:0/338086384 shutdown_connections 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/338086384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e680d2560 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/338086384 >> v2:172.21.15.80:3300/0 conn(0x7f4e680b6250 0x7f4e680ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.106+0000 7f4e6c83f640 1 -- 172.21.15.5:0/338086384 >> 172.21.15.5:0/338086384 conn(0x7f4e680668f0 msgr2=0x7f4e68066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.107+0000 7f4e6c83f640 1 -- 172.21.15.5:0/338086384 shutdown_connections 2024-04-25T08:59:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.107+0000 7f4e6c83f640 1 -- 172.21.15.5:0/338086384 wait complete. 2024-04-25T08:59:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 Processor -- start 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 -- start start 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680b6250 0x7f4e68160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e6814b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e6815df10 0x7f4e6814a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d2aa0 con 0x7f4e680cee10 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d1d60 con 0x7f4e680b6250 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.108+0000 7f4e6c83f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d2c20 con 0x7f4e6815df10 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e6814b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e6814b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51408/0 (socket says 172.21.15.5:51408) 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 -- 172.21.15.5:0/3389677950 learned_addr learned my addr 172.21.15.5:0/3389677950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e66d9d640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e6815df10 0x7f4e6814a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e6659c640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680b6250 0x7f4e68160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 -- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e6815df10 msgr2=0x7f4e6814a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e6815df10 0x7f4e6814a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 -- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680b6250 msgr2=0x7f4e68160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680b6250 0x7f4e68160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 -- 172.21.15.5:0/3389677950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68149440 con 0x7f4e680cee10 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e6659c640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680b6250 0x7f4e68160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e66d9d640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e6815df10 0x7f4e6814a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e65d9b640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e6814b180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00d830 tx=0x7f4e5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e56ffd640 1 -- 172.21.15.5:0/3389677950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00b6c0 con 0x7f4e680cee10 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e56ffd640 1 -- 172.21.15.5:0/3389677950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c019070 con 0x7f4e680cee10 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e68149720 con 0x7f4e680cee10 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e56ffd640 1 -- 172.21.15.5:0/3389677950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00ba80 con 0x7f4e680cee10 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.109+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e68149fc0 con 0x7f4e680cee10 2024-04-25T08:59:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.110+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6804ef20 con 0x7f4e680cee10 2024-04-25T08:59:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.111+0000 7f4e56ffd640 1 -- 172.21.15.5:0/3389677950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e5c01e460 con 0x7f4e680cee10 2024-04-25T08:59:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.111+0000 7f4e56ffd640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4e4806b4d0 0x7f4e4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.111+0000 7f4e56ffd640 1 -- 172.21.15.5:0/3389677950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4e5c08a890 con 0x7f4e680cee10 2024-04-25T08:59:00.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.111+0000 7f4e6659c640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4e4806b4d0 0x7f4e4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.112+0000 7f4e6659c640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4e4806b4d0 0x7f4e4806d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b26c0 tx=0x7f4e58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.115+0000 7f4e56ffd640 1 -- 172.21.15.5:0/3389677950 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e5c059780 con 0x7f4e680cee10 2024-04-25T08:59:00.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.294+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e680b3340 con 0x7f4e680cee10 2024-04-25T08:59:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.294+0000 7f4e56ffd640 1 -- 172.21.15.5:0/3389677950 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e5c059080 con 0x7f4e680cee10 2024-04-25T08:59:00.284 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4e4806b4d0 msgr2=0x7f4e4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4e4806b4d0 0x7f4e4806d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b26c0 tx=0x7f4e58009040 comp rx=0 tx=0).stop 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 msgr2=0x7f4e6814b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e6814b180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00d830 tx=0x7f4e5c00dcf0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 shutdown_connections 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4e4806b4d0 0x7f4e4806d990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e6815df10 0x7f4e6814a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e680cee10 0x7f4e6814b180 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 --2- 172.21.15.5:0/3389677950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680b6250 0x7f4e68160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 >> 172.21.15.5:0/3389677950 conn(0x7f4e680668f0 msgr2=0x7f4e6815c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 shutdown_connections 2024-04-25T08:59:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.296+0000 7f4e6c83f640 1 -- 172.21.15.5:0/3389677950 wait complete. 2024-04-25T08:59:00.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:59:00.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.409+0000 7f904a276640 1 Processor -- start 2024-04-25T08:59:00.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.409+0000 7f904a276640 1 -- start start 2024-04-25T08:59:00.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f904a276640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f904415e0a0 0x7f90440d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f904a276640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90440d3df0 0x7f90440cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f904a276640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90440b7f60 con 0x7f90440d3990 2024-04-25T08:59:00.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f904a276640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90440b29c0 con 0x7f90440d3df0 2024-04-25T08:59:00.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f904a276640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90440d2080 con 0x7f904415e0a0 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f90437fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90440d3990 0x7f90440ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47612/0 (socket says 172.21.15.5:47612) 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f90437fe640 1 -- 172.21.15.5:0/818909015 learned_addr learned my addr 172.21.15.5:0/818909015 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f9043fff640 1 --2- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f904415e0a0 0x7f90440d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f9048813640 1 --2- 172.21.15.5:0/818909015 >> v2:172.21.15.80:3300/0 conn(0x7f90440d3df0 0x7f90440cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f9042ffd640 1 -- 172.21.15.5:0/818909015 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735055211 0 0) 0x7f90440b7f60 con 0x7f90440d3990 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.410+0000 7f9042ffd640 1 -- 172.21.15.5:0/818909015 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9030003520 con 0x7f90440d3990 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.411+0000 7f9048813640 1 -- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f904415e0a0 msgr2=0x7f90440d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.411+0000 7f9048813640 1 --2- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f904415e0a0 0x7f90440d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.411+0000 7f9042ffd640 1 -- 172.21.15.5:0/818909015 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 117796078 0 0) 0x7f9030003520 con 0x7f90440d3990 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.411+0000 7f9048813640 1 -- 172.21.15.5:0/818909015 >> v1:172.21.15.5:6789/0 conn(0x7f90440d3990 legacy=0x7f90440ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.411+0000 7f9048813640 1 -- 172.21.15.5:0/818909015 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440d2360 con 0x7f90440d3df0 2024-04-25T08:59:00.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.411+0000 7f9043fff640 1 --2- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f904415e0a0 0x7f90440d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:00.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.411+0000 7f9048813640 1 --2- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 0x7f90440cecf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f903c009d90 tx=0x7f903c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d340f7dc4fa0e46c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f9042ffd640 1 -- 172.21.15.5:0/818909015 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c001670 con 0x7f90440d3df0 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f9042ffd640 1 -- 172.21.15.5:0/818909015 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c007540 con 0x7f90440d3df0 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f9042ffd640 1 -- 172.21.15.5:0/818909015 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c007910 con 0x7f90440d3df0 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 -- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 msgr2=0x7f90440cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 --2- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 0x7f90440cecf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f903c009d90 tx=0x7f903c02a5f0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 -- 172.21.15.5:0/818909015 shutdown_connections 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 --2- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 0x7f90440cecf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 --2- 172.21.15.5:0/818909015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f904415e0a0 0x7f90440d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 -- 172.21.15.5:0/818909015 >> 172.21.15.5:0/818909015 conn(0x7f90440668f0 msgr2=0x7f9044066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 -- 172.21.15.5:0/818909015 shutdown_connections 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.412+0000 7f904a276640 1 -- 172.21.15.5:0/818909015 wait complete. 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.413+0000 7f904a276640 1 Processor -- start 2024-04-25T08:59:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f904a276640 1 -- start start 2024-04-25T08:59:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f904a276640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90440d3990 0x7f90441f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f904a276640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 0x7f90440cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f904a276640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904415e0a0 0x7f90441f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f904a276640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440d2c00 con 0x7f904415e0a0 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f904a276640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440d2920 con 0x7f90440d3df0 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f904a276640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90440d4280 con 0x7f90440d3990 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f9048813640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904415e0a0 0x7f90441f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f9048813640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904415e0a0 0x7f90441f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51414/0 (socket says 172.21.15.5:51414) 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f9048813640 1 -- 172.21.15.5:0/1323454780 learned_addr learned my addr 172.21.15.5:0/1323454780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.414+0000 7f9043fff640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90440d3990 0x7f90441f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f90437fe640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 0x7f90440cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9048813640 1 -- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90440d3990 msgr2=0x7f90441f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9048813640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90440d3990 0x7f90441f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9048813640 1 -- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 msgr2=0x7f90440cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9048813640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 0x7f90440cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9048813640 1 -- 172.21.15.5:0/1323454780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440ac980 con 0x7f904415e0a0 2024-04-25T08:59:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9048813640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904415e0a0 0x7f90441f3000 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f903c009eb0 tx=0x7f903c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9040ff9640 1 -- 172.21.15.5:0/1323454780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c03f070 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9040ff9640 1 -- 172.21.15.5:0/1323454780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c031bc0 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90440acc60 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f9040ff9640 1 -- 172.21.15.5:0/1323454780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c009450 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.415+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90440ad220 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.416+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904404ef20 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.416+0000 7f9040ff9640 1 -- 172.21.15.5:0/1323454780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f903c03b410 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.417+0000 7f9040ff9640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f902406b4d0 0x7f902406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.417+0000 7f9040ff9640 1 -- 172.21.15.5:0/1323454780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f903c0ab500 con 0x7f904415e0a0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.417+0000 7f9043fff640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f902406b4d0 0x7f902406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.418+0000 7f9043fff640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f902406b4d0 0x7f902406d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9034009560 tx=0x7f9034008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.421+0000 7f9040ff9640 1 -- 172.21.15.5:0/1323454780 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f903c07a360 con 0x7f904415e0a0 2024-04-25T08:59:00.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.615+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90440b37a0 con 0x7f904415e0a0 2024-04-25T08:59:00.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.616+0000 7f9040ff9640 1 -- 172.21.15.5:0/1323454780 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7f903c079c60 con 0x7f904415e0a0 2024-04-25T08:59:00.605 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T08:59:00.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.617+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f902406b4d0 msgr2=0x7f902406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.617+0000 7f904a276640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f902406b4d0 0x7f902406d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9034009560 tx=0x7f9034008040 comp rx=0 tx=0).stop 2024-04-25T08:59:00.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.617+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904415e0a0 msgr2=0x7f90441f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.617+0000 7f904a276640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904415e0a0 0x7f90441f3000 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f903c009eb0 tx=0x7f903c004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 shutdown_connections 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f902406b4d0 0x7f902406d990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904415e0a0 0x7f90441f3000 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90440d3df0 0x7f90440cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 --2- 172.21.15.5:0/1323454780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90440d3990 0x7f90441f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 >> 172.21.15.5:0/1323454780 conn(0x7f90440668f0 msgr2=0x7f90440d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 shutdown_connections 2024-04-25T08:59:00.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.618+0000 7f904a276640 1 -- 172.21.15.5:0/1323454780 wait complete. 2024-04-25T08:59:00.618 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:59:00.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:00.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:00.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:59:00.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:00.655 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:59:00.711 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:59:00.711 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:00.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:00.729 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:00.729 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:00.766 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:59:00.767 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:59:00.767 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:00.786 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:00.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.918+0000 7f3f2fe9a640 1 Processor -- start 2024-04-25T08:59:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.918+0000 7f3f2fe9a640 1 -- start start 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2fe9a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f2815de70 0x7f3f280b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2fe9a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f280ce7f0 0x7f3f280cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2fe9a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f280cf1c0 con 0x7f3f280b2cc0 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2fe9a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f280d2a10 con 0x7f3f2815de70 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2fe9a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f280d20e0 con 0x7f3f280ce7f0 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2dc36640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f2815de70 0x7f3f280b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2dc36640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f2815de70 0x7f3f280b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44076/0 (socket says 172.21.15.5:44076) 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.919+0000 7f3f2dc36640 1 -- 172.21.15.5:0/435806413 learned_addr learned my addr 172.21.15.5:0/435806413 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.920+0000 7f3f2e437640 1 --2- 172.21.15.5:0/435806413 >> v2:172.21.15.80:3300/0 conn(0x7f3f280ce7f0 0x7f3f280cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.920+0000 7f3f2dc36640 1 -- 172.21.15.5:0/435806413 >> v2:172.21.15.80:3300/0 conn(0x7f3f280ce7f0 msgr2=0x7f3f280cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.920+0000 7f3f2dc36640 1 --2- 172.21.15.5:0/435806413 >> v2:172.21.15.80:3300/0 conn(0x7f3f280ce7f0 0x7f3f280cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.920+0000 7f3f2dc36640 1 -- 172.21.15.5:0/435806413 >> v1:172.21.15.80:6789/0 conn(0x7f3f280b2cc0 legacy=0x7f3f280b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.920+0000 7f3f2dc36640 1 -- 172.21.15.5:0/435806413 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280d23c0 con 0x7f3f2815de70 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.920+0000 7f3f2dc36640 1 --2- 172.21.15.5:0/435806413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f2815de70 0x7f3f280b93e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f280d1970 tx=0x7f3f1802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8be56d8cd9c53f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2cc34640 1 -- 172.21.15.5:0/435806413 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18036070 con 0x7f3f2815de70 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2cc34640 1 -- 172.21.15.5:0/435806413 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18031600 con 0x7f3f2815de70 2024-04-25T08:59:00.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2cc34640 1 -- 172.21.15.5:0/435806413 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180319d0 con 0x7f3f2815de70 2024-04-25T08:59:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/435806413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f2815de70 msgr2=0x7f3f280b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/435806413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f2815de70 0x7f3f280b93e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f280d1970 tx=0x7f3f1802a730 comp rx=0 tx=0).stop 2024-04-25T08:59:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/435806413 shutdown_connections 2024-04-25T08:59:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/435806413 >> v2:172.21.15.80:3300/0 conn(0x7f3f280ce7f0 0x7f3f280cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/435806413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f2815de70 0x7f3f280b93e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/435806413 >> 172.21.15.5:0/435806413 conn(0x7f3f2806b000 msgr2=0x7f3f2806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:00.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/435806413 shutdown_connections 2024-04-25T08:59:00.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.921+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/435806413 wait complete. 2024-04-25T08:59:00.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.922+0000 7f3f2fe9a640 1 Processor -- start 2024-04-25T08:59:00.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.922+0000 7f3f2fe9a640 1 -- start start 2024-04-25T08:59:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2fe9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f280b2cc0 0x7f3f280caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2fe9a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f280ce7f0 0x7f3f280b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2fe9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f2815de70 0x7f3f280c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2fe9a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280b7300 con 0x7f3f280b2cc0 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2fe9a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280b9920 con 0x7f3f2815de70 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2fe9a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280d2ea0 con 0x7f3f280ce7f0 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2dc36640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f280b2cc0 0x7f3f280caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2dc36640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f280b2cc0 0x7f3f280caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44084/0 (socket says 172.21.15.5:44084) 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2dc36640 1 -- 172.21.15.5:0/2811225364 learned_addr learned my addr 172.21.15.5:0/2811225364 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.923+0000 7f3f2e437640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f2815de70 0x7f3f280c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2d435640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f280ce7f0 0x7f3f280b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2dc36640 1 -- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f280ce7f0 msgr2=0x7f3f280b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2dc36640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f280ce7f0 0x7f3f280b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2dc36640 1 -- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f2815de70 msgr2=0x7f3f280c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2dc36640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f2815de70 0x7f3f280c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2dc36640 1 -- 172.21.15.5:0/2811225364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280cb0e0 con 0x7f3f280b2cc0 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2dc36640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f280b2cc0 0x7f3f280caba0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009f40 tx=0x7f3f18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f267fc640 1 -- 172.21.15.5:0/2811225364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1803f020 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f267fc640 1 -- 172.21.15.5:0/2811225364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18037040 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f280c8eb0 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f267fc640 1 -- 172.21.15.5:0/2811225364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18036070 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.924+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f280c9470 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.925+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2804ef20 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.925+0000 7f3f267fc640 1 -- 172.21.15.5:0/2811225364 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f18042020 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.926+0000 7f3f267fc640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1406b4d0 0x7f3f1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.926+0000 7f3f267fc640 1 -- 172.21.15.5:0/2811225364 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f3f180aa630 con 0x7f3f280b2cc0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.926+0000 7f3f2d435640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1406b4d0 0x7f3f1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.927+0000 7f3f2d435640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1406b4d0 0x7f3f1406d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3f2815b1a0 tx=0x7f3f1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:00.930+0000 7f3f267fc640 1 -- 172.21.15.5:0/2811225364 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f18049030 con 0x7f3f280b2cc0 2024-04-25T08:59:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.147+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f28068b00 con 0x7f3f280b2cc0 2024-04-25T08:59:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.147+0000 7f3f267fc640 1 -- 172.21.15.5:0/2811225364 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f3f18079520 con 0x7f3f280b2cc0 2024-04-25T08:59:01.137 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:01.137 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2510409846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2510409846},{"type":"v1","addr":"172.21.15.80:6837","nonce":2510409846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3426555717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3426555717},{"type":"v1","addr":"172.21.15.80:6836","nonce":3426555717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4918,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3729803264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3729803264},{"type":"v1","addr":"172.21.15.5:6835","nonce":3729803264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:57:32.755583+0000","modified":"2024-04-25T08:57:43.916564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3359008015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3359008015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3359008015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:59:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 14 2024-04-25T08:59:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1406b4d0 msgr2=0x7f3f1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1406b4d0 0x7f3f1406d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3f2815b1a0 tx=0x7f3f1c009040 comp rx=0 tx=0).stop 2024-04-25T08:59:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f280b2cc0 msgr2=0x7f3f280caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f280b2cc0 0x7f3f280caba0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009f40 tx=0x7f3f18004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 shutdown_connections 2024-04-25T08:59:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1406b4d0 0x7f3f1406d990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f2815de70 0x7f3f280c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f280ce7f0 0x7f3f280b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 --2- 172.21.15.5:0/2811225364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f280b2cc0 0x7f3f280caba0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 >> 172.21.15.5:0/2811225364 conn(0x7f3f2806b000 msgr2=0x7f3f280cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 shutdown_connections 2024-04-25T08:59:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.149+0000 7f3f2fe9a640 1 -- 172.21.15.5:0/2811225364 wait complete. 2024-04-25T08:59:01.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.261+0000 7ff896390640 1 Processor -- start 2024-04-25T08:59:01.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.261+0000 7ff896390640 1 -- start start 2024-04-25T08:59:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.261+0000 7ff896390640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8900ce7f0 0x7ff8900cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.261+0000 7ff896390640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900cf1c0 con 0x7ff89015de70 2024-04-25T08:59:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.261+0000 7ff896390640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900d20e0 con 0x7ff8900b2cc0 2024-04-25T08:59:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.261+0000 7ff896390640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8900d2a10 con 0x7ff8900ce7f0 2024-04-25T08:59:01.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff88ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff89015de70 0x7ff8900b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46624/0 (socket says 172.21.15.5:46624) 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff88ffff640 1 -- 172.21.15.5:0/3486659686 learned_addr learned my addr 172.21.15.5:0/3486659686 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff89492d640 1 --2- 172.21.15.5:0/3486659686 >> v2:172.21.15.5:3300/0 conn(0x7ff8900ce7f0 0x7ff8900cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff88effd640 1 -- 172.21.15.5:0/3486659686 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994849878 0 0) 0x7ff8900cf1c0 con 0x7ff89015de70 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff88effd640 1 -- 172.21.15.5:0/3486659686 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff878003520 con 0x7ff89015de70 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff89492d640 1 -- 172.21.15.5:0/3486659686 >> v1:172.21.15.80:6789/0 conn(0x7ff8900b2cc0 legacy=0x7ff8900b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff89492d640 1 -- 172.21.15.5:0/3486659686 >> v1:172.21.15.5:6789/0 conn(0x7ff89015de70 legacy=0x7ff8900b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.262+0000 7ff89492d640 1 -- 172.21.15.5:0/3486659686 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900d23c0 con 0x7ff8900ce7f0 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff89492d640 1 --2- 172.21.15.5:0/3486659686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900ce7f0 0x7ff8900cec80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff888009d90 tx=0x7ff88802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ac7b1172d5dd64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff88effd640 1 -- 172.21.15.5:0/3486659686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888007740 con 0x7ff8900ce7f0 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff88effd640 1 -- 172.21.15.5:0/3486659686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8880078e0 con 0x7ff8900ce7f0 2024-04-25T08:59:01.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff88effd640 1 -- 172.21.15.5:0/3486659686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888007cb0 con 0x7ff8900ce7f0 2024-04-25T08:59:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff896390640 1 -- 172.21.15.5:0/3486659686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900ce7f0 msgr2=0x7ff8900cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff896390640 1 --2- 172.21.15.5:0/3486659686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900ce7f0 0x7ff8900cec80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff888009d90 tx=0x7ff88802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff896390640 1 -- 172.21.15.5:0/3486659686 shutdown_connections 2024-04-25T08:59:01.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff896390640 1 --2- 172.21.15.5:0/3486659686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900ce7f0 0x7ff8900cec80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff896390640 1 -- 172.21.15.5:0/3486659686 >> 172.21.15.5:0/3486659686 conn(0x7ff89006b000 msgr2=0x7ff89006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff896390640 1 -- 172.21.15.5:0/3486659686 shutdown_connections 2024-04-25T08:59:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.263+0000 7ff896390640 1 -- 172.21.15.5:0/3486659686 wait complete. 2024-04-25T08:59:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.264+0000 7ff896390640 1 Processor -- start 2024-04-25T08:59:01.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff896390640 1 -- start start 2024-04-25T08:59:01.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff896390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900b2cc0 0x7ff890153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff896390640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8900ce7f0 0x7ff8901606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff896390640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff89015de70 0x7ff890160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff896390640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900d2ea0 con 0x7ff8900b2cc0 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff896390640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900b7300 con 0x7ff89015de70 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff896390640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900d3020 con 0x7ff8900ce7f0 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.265+0000 7ff88ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900b2cc0 0x7ff890153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900b2cc0 0x7ff890153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44098/0 (socket says 172.21.15.5:44098) 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 -- 172.21.15.5:0/718930770 learned_addr learned my addr 172.21.15.5:0/718930770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88f7fe640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8900ce7f0 0x7ff8901606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff89492d640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff89015de70 0x7ff890160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 -- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8900ce7f0 msgr2=0x7ff8901606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8900ce7f0 0x7ff8901606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 -- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff89015de70 msgr2=0x7ff890160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff89015de70 0x7ff890160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 -- 172.21.15.5:0/718930770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900cd500 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88f7fe640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8900ce7f0 0x7ff8901606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff89492d640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff89015de70 0x7ff890160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88ffff640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900b2cc0 0x7ff890153b70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c410 tx=0x7ff88000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88cff9640 1 -- 172.21.15.5:0/718930770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880017070 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88cff9640 1 -- 172.21.15.5:0/718930770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff880005ce0 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8900c7480 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff88cff9640 1 -- 172.21.15.5:0/718930770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800072f0 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.266+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8900c7d20 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.267+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8900c7870 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.268+0000 7ff88cff9640 1 -- 172.21.15.5:0/718930770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff88001a070 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.268+0000 7ff88cff9640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff87c06b4d0 0x7ff87c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.268+0000 7ff88cff9640 1 -- 172.21.15.5:0/718930770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff8800896e0 con 0x7ff8900b2cc0 2024-04-25T08:59:01.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.268+0000 7ff88f7fe640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff87c06b4d0 0x7ff87c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.269+0000 7ff88f7fe640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff87c06b4d0 0x7ff87c06d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff89015aa50 tx=0x7ff884009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.272+0000 7ff88cff9640 1 -- 172.21.15.5:0/718930770 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff880058600 con 0x7ff8900b2cc0 2024-04-25T08:59:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.456+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8900c7650 con 0x7ff8900b2cc0 2024-04-25T08:59:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.457+0000 7ff88cff9640 1 -- 172.21.15.5:0/718930770 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16650 (secure 0 0 0) 0x7ff880057f00 con 0x7ff8900b2cc0 2024-04-25T08:59:01.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:01.447 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:58:40.086289+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:31.301883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:31.733858+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff87c06b4d0 msgr2=0x7ff87c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff87c06b4d0 0x7ff87c06d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff89015aa50 tx=0x7ff884009040 comp rx=0 tx=0).stop 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900b2cc0 msgr2=0x7ff890153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900b2cc0 0x7ff890153b70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c410 tx=0x7ff88000c8d0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 shutdown_connections 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff87c06b4d0 0x7ff87c06d990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff89015de70 0x7ff890160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8900ce7f0 0x7ff8901606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 --2- 172.21.15.5:0/718930770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900b2cc0 0x7ff890153b70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 >> 172.21.15.5:0/718930770 conn(0x7ff89006b000 msgr2=0x7ff8900b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 shutdown_connections 2024-04-25T08:59:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.459+0000 7ff896390640 1 -- 172.21.15.5:0/718930770 wait complete. 2024-04-25T08:59:01.460 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:57:31.301883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:57:31.733858+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 32, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:01.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.574+0000 7ffb77dd5640 1 Processor -- start 2024-04-25T08:59:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.575+0000 7ffb77dd5640 1 -- start start 2024-04-25T08:59:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.575+0000 7ffb77dd5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb700b6250 0x7ffb700ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.575+0000 7ffb77dd5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb70162150 con 0x7ffb7015df10 2024-04-25T08:59:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.575+0000 7ffb77dd5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb70162430 con 0x7ffb700cee10 2024-04-25T08:59:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.575+0000 7ffb77dd5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700cf260 con 0x7ffb700b6250 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.575+0000 7ffb75b71640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb7015df10 0x7ffb701618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46626/0 (socket says 172.21.15.5:46626) 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.575+0000 7ffb75b71640 1 -- 172.21.15.5:0/2642001895 learned_addr learned my addr 172.21.15.5:0/2642001895 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.576+0000 7ffb75370640 1 --2- 172.21.15.5:0/2642001895 >> v2:172.21.15.5:3300/0 conn(0x7ffb700b6250 0x7ffb700ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.576+0000 7ffb74b6f640 1 -- 172.21.15.5:0/2642001895 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416627231 0 0) 0x7ffb70162150 con 0x7ffb7015df10 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.576+0000 7ffb74b6f640 1 -- 172.21.15.5:0/2642001895 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003520 con 0x7ffb7015df10 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.576+0000 7ffb75370640 1 -- 172.21.15.5:0/2642001895 >> v1:172.21.15.80:6789/0 conn(0x7ffb700cee10 legacy=0x7ffb700d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.576+0000 7ffb75370640 1 -- 172.21.15.5:0/2642001895 >> v1:172.21.15.5:6789/0 conn(0x7ffb7015df10 legacy=0x7ffb701618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.576+0000 7ffb75370640 1 -- 172.21.15.5:0/2642001895 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70162710 con 0x7ffb700b6250 2024-04-25T08:59:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb75370640 1 --2- 172.21.15.5:0/2642001895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb700b6250 0x7ffb700ce8d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffb600097a0 tx=0x7ffb6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a350e5c99afb3d75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb74b6f640 1 -- 172.21.15.5:0/2642001895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60037070 con 0x7ffb700b6250 2024-04-25T08:59:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb74b6f640 1 -- 172.21.15.5:0/2642001895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60032440 con 0x7ffb700b6250 2024-04-25T08:59:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb74b6f640 1 -- 172.21.15.5:0/2642001895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60032810 con 0x7ffb700b6250 2024-04-25T08:59:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb77dd5640 1 -- 172.21.15.5:0/2642001895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb700b6250 msgr2=0x7ffb700ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/2642001895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb700b6250 0x7ffb700ce8d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffb600097a0 tx=0x7ffb6002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb77dd5640 1 -- 172.21.15.5:0/2642001895 shutdown_connections 2024-04-25T08:59:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/2642001895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb700b6250 0x7ffb700ce8d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb77dd5640 1 -- 172.21.15.5:0/2642001895 >> 172.21.15.5:0/2642001895 conn(0x7ffb700668f0 msgr2=0x7ffb70066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb77dd5640 1 -- 172.21.15.5:0/2642001895 shutdown_connections 2024-04-25T08:59:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.577+0000 7ffb77dd5640 1 -- 172.21.15.5:0/2642001895 wait complete. 2024-04-25T08:59:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.578+0000 7ffb77dd5640 1 Processor -- start 2024-04-25T08:59:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb77dd5640 1 -- start start 2024-04-25T08:59:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb77dd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb700b6250 0x7ffb700cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb77dd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb700cee10 0x7ffb7015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb77dd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015df10 0x7ffb7015f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb77dd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700d2c70 con 0x7ffb7015df10 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb77dd5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700d20d0 con 0x7ffb700cee10 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb77dd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700d2df0 con 0x7ffb700b6250 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb76372640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015df10 0x7ffb7015f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb76372640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015df10 0x7ffb7015f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44112/0 (socket says 172.21.15.5:44112) 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.579+0000 7ffb76372640 1 -- 172.21.15.5:0/3816687296 learned_addr learned my addr 172.21.15.5:0/3816687296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb75b71640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb700b6250 0x7ffb700cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb75370640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb700cee10 0x7ffb7015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb76372640 1 -- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb700b6250 msgr2=0x7ffb700cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb76372640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb700b6250 0x7ffb700cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb76372640 1 -- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb700cee10 msgr2=0x7ffb7015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb76372640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb700cee10 0x7ffb7015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb76372640 1 -- 172.21.15.5:0/3816687296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70159660 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb76372640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015df10 0x7ffb7015f240 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800c780 tx=0x7ffb6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb667fc640 1 -- 172.21.15.5:0/3816687296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68004b60 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb667fc640 1 -- 172.21.15.5:0/3816687296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68004d00 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7015f8e0 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb667fc640 1 -- 172.21.15.5:0/3816687296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800aa90 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.580+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb701e7d70 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.581+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb701e78c0 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.582+0000 7ffb667fc640 1 -- 172.21.15.5:0/3816687296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb6800ac30 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.582+0000 7ffb667fc640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffb5406b4d0 0x7ffb5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.582+0000 7ffb667fc640 1 -- 172.21.15.5:0/3816687296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ffb6808a480 con 0x7ffb7015df10 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.582+0000 7ffb75b71640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffb5406b4d0 0x7ffb5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.583+0000 7ffb75b71640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffb5406b4d0 0x7ffb5406d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005880 tx=0x7ffb6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.586+0000 7ffb667fc640 1 -- 172.21.15.5:0/3816687296 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb68020070 con 0x7ffb7015df10 2024-04-25T08:59:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.768+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb700b3340 con 0x7ffb7015df10 2024-04-25T08:59:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.769+0000 7ffb667fc640 1 -- 172.21.15.5:0/3816687296 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb70159660 con 0x7ffb7015df10 2024-04-25T08:59:01.758 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:59:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffb5406b4d0 msgr2=0x7ffb5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffb5406b4d0 0x7ffb5406d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005880 tx=0x7ffb6c009040 comp rx=0 tx=0).stop 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015df10 msgr2=0x7ffb7015f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015df10 0x7ffb7015f240 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800c780 tx=0x7ffb6800cc40 comp rx=0 tx=0).stop 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 shutdown_connections 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffb5406b4d0 0x7ffb5406d990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015df10 0x7ffb7015f240 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb700cee10 0x7ffb7015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 --2- 172.21.15.5:0/3816687296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb700b6250 0x7ffb700cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 >> 172.21.15.5:0/3816687296 conn(0x7ffb700668f0 msgr2=0x7ffb70161830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 shutdown_connections 2024-04-25T08:59:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.771+0000 7ffb77dd5640 1 -- 172.21.15.5:0/3816687296 wait complete. 2024-04-25T08:59:01.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:59:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.885+0000 7fa31f88f640 1 Processor -- start 2024-04-25T08:59:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.885+0000 7fa31f88f640 1 -- start start 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.886+0000 7fa31f88f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 0x7fa3180b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.886+0000 7fa31f88f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180cdef0 con 0x7fa31815c0f0 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.886+0000 7fa31f88f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180cf7a0 con 0x7fa3180cff00 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.886+0000 7fa31f88f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180cd350 con 0x7fa3180b24b0 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.886+0000 7fa31d62b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa31815c0f0 0x7fa3180cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46628/0 (socket says 172.21.15.5:46628) 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.886+0000 7fa31d62b640 1 -- 172.21.15.5:0/754454248 learned_addr learned my addr 172.21.15.5:0/754454248 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 0x7fa3180b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143974193 0 0) 0x7fa3180cdef0 con 0x7fa31815c0f0 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa304003520 con 0x7fa31815c0f0 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350920986 0 0) 0x7fa3180cf7a0 con 0x7fa3180cff00 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3180cdef0 con 0x7fa3180cff00 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450386158 0 0) 0x7fa304003520 con 0x7fa31815c0f0 2024-04-25T08:59:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 msgr2=0x7fa3180b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 0x7fa3180b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 >> v1:172.21.15.80:6789/0 conn(0x7fa3180cff00 legacy=0x7fa3180c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180d24e0 con 0x7fa31815c0f0 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fa310001670 con 0x7fa31815c0f0 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 0x7fa3180b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 >> v1:172.21.15.5:6789/0 conn(0x7fa31815c0f0 legacy=0x7fa3180cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa304003b70 0x7fa304003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa304004800 0x7fa304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 0x7fa3040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180cd350 con 0x7fa304004800 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30400ba70 con 0x7fa304003b70 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30400bc70 con 0x7fa3180b24b0 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa304004800 0x7fa304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa31d62b640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa304003b70 0x7fa304003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.887+0000 7fa31de2c640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 0x7fa3040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa31ce2a640 1 -- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 msgr2=0x7fa3040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3180b24b0 0x7fa3040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa31ce2a640 1 -- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa304003b70 msgr2=0x7fa304003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa304003b70 0x7fa304003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa31ce2a640 1 -- 172.21.15.5:0/754454248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304003520 con 0x7fa304004800 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa304004800 0x7fa304004c80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa308009c60 tx=0x7fa304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5b986b9d79c052 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308036070 con 0x7fa304004800 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308031400 con 0x7fa304004800 2024-04-25T08:59:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.888+0000 7fa30ffff640 1 -- 172.21.15.5:0/754454248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308009860 con 0x7fa304004800 2024-04-25T08:59:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.889+0000 7fa31f88f640 1 -- 172.21.15.5:0/754454248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa304004800 msgr2=0x7fa304004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.889+0000 7fa31f88f640 1 --2- 172.21.15.5:0/754454248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa304004800 0x7fa304004c80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa308009c60 tx=0x7fa304005830 comp rx=0 tx=0).stop 2024-04-25T08:59:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.889+0000 7fa31de2c640 1 -- 172.21.15.5:0/754454248 reap_dead start 2024-04-25T08:59:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.889+0000 7fa31f88f640 1 -- 172.21.15.5:0/754454248 shutdown_connections 2024-04-25T08:59:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.889+0000 7fa31f88f640 1 -- 172.21.15.5:0/754454248 >> 172.21.15.5:0/754454248 conn(0x7fa3180d1920 msgr2=0x7fa3180d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.889+0000 7fa31f88f640 1 -- 172.21.15.5:0/754454248 shutdown_connections 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.889+0000 7fa31f88f640 1 -- 172.21.15.5:0/754454248 wait complete. 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.890+0000 7fa31f88f640 1 Processor -- start 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.890+0000 7fa31f88f640 1 -- start start 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31f88f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa304004800 0x7fa318152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31f88f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3181e7a10 0x7fa3180cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31f88f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3181e7e90 0x7fa3180cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31f88f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180cfa40 con 0x7fa3181e7e90 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31f88f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b3170 con 0x7fa3181e7a10 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31f88f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180c5b80 con 0x7fa304004800 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3181e7e90 0x7fa3180cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3181e7e90 0x7fa3180cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44122/0 (socket says 172.21.15.5:44122) 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 -- 172.21.15.5:0/828598376 learned_addr learned my addr 172.21.15.5:0/828598376 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3181e7a10 0x7fa3180cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31d62b640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa304004800 0x7fa318152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 -- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa304004800 msgr2=0x7fa318152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa304004800 0x7fa318152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 -- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3181e7a10 msgr2=0x7fa3180cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3181e7a10 0x7fa3180cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31de2c640 1 -- 172.21.15.5:0/828598376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31815cf80 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.891+0000 7fa31ce2a640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3181e7a10 0x7fa3180cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.892+0000 7fa31de2c640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3181e7e90 0x7fa3180cb230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa31815fa50 tx=0x7fa31400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.892+0000 7fa30dffb640 1 -- 172.21.15.5:0/828598376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314019070 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.892+0000 7fa30dffb640 1 -- 172.21.15.5:0/828598376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314006e20 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.892+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31815d260 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.892+0000 7fa30dffb640 1 -- 172.21.15.5:0/828598376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314003b90 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.892+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31815d820 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.893+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31804ef20 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.893+0000 7fa30dffb640 1 -- 172.21.15.5:0/828598376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa31401c070 con 0x7fa3181e7e90 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.894+0000 7fa30dffb640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2fc06b4d0 0x7fa2fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.894+0000 7fa30dffb640 1 -- 172.21.15.5:0/828598376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa3140897f0 con 0x7fa3181e7e90 2024-04-25T08:59:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.894+0000 7fa31d62b640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2fc06b4d0 0x7fa2fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.894+0000 7fa31d62b640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2fc06b4d0 0x7fa2fc06d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa310001050 tx=0x7fa310009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:01.898+0000 7fa30dffb640 1 -- 172.21.15.5:0/828598376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa314058640 con 0x7fa3181e7e90 2024-04-25T08:59:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.080+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3180cfce0 con 0x7fa3181e7e90 2024-04-25T08:59:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.080+0000 7fa30dffb640 1 -- 172.21.15.5:0/828598376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa314057f40 con 0x7fa3181e7e90 2024-04-25T08:59:02.070 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:59:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2fc06b4d0 msgr2=0x7fa2fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2fc06b4d0 0x7fa2fc06d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa310001050 tx=0x7fa310009040 comp rx=0 tx=0).stop 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3181e7e90 msgr2=0x7fa3180cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3181e7e90 0x7fa3180cb230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa31815fa50 tx=0x7fa31400ff70 comp rx=0 tx=0).stop 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 shutdown_connections 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2fc06b4d0 0x7fa2fc06d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3181e7e90 0x7fa3180cb230 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3181e7a10 0x7fa3180cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 --2- 172.21.15.5:0/828598376 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa304004800 0x7fa318152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 >> 172.21.15.5:0/828598376 conn(0x7fa3180d1920 msgr2=0x7fa3180d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 shutdown_connections 2024-04-25T08:59:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.083+0000 7fa31f88f640 1 -- 172.21.15.5:0/828598376 wait complete. 2024-04-25T08:59:02.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:59:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.197+0000 7f57235a9640 1 Processor -- start 2024-04-25T08:59:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.198+0000 7f57235a9640 1 -- start start 2024-04-25T08:59:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.198+0000 7f57235a9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f571c06dbe0 0x7f571c06abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.198+0000 7f57235a9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f571c06b120 0x7f571c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.198+0000 7f57235a9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c06e070 con 0x7f571c15a9d0 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.198+0000 7f57235a9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c06e350 con 0x7f571c06dbe0 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.198+0000 7f57235a9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c06e630 con 0x7f571c06b120 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.198+0000 7f5720b44640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f571c06dbe0 0x7f571c06abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.199+0000 7f5720b44640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f571c06dbe0 0x7f571c06abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44126/0 (socket says 172.21.15.5:44126) 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.199+0000 7f5720b44640 1 -- 172.21.15.5:0/967159250 learned_addr learned my addr 172.21.15.5:0/967159250 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.199+0000 7f5721b46640 1 --2- 172.21.15.5:0/967159250 >> v2:172.21.15.80:3300/0 conn(0x7f571c06b120 0x7f571c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.199+0000 7f5720b44640 1 -- 172.21.15.5:0/967159250 >> v2:172.21.15.80:3300/0 conn(0x7f571c06b120 msgr2=0x7f571c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.199+0000 7f5720b44640 1 --2- 172.21.15.5:0/967159250 >> v2:172.21.15.80:3300/0 conn(0x7f571c06b120 0x7f571c0b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.199+0000 7f5720b44640 1 -- 172.21.15.5:0/967159250 >> v1:172.21.15.80:6789/0 conn(0x7f571c15a9d0 legacy=0x7f571c071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.199+0000 7f5720b44640 1 -- 172.21.15.5:0/967159250 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c06e910 con 0x7f571c06dbe0 2024-04-25T08:59:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f5720b44640 1 --2- 172.21.15.5:0/967159250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06dbe0 0x7f571c06abe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f571c06f450 tx=0x7f570c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd0b27b3fac0c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f5713fff640 1 -- 172.21.15.5:0/967159250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c036020 con 0x7f571c06dbe0 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f5713fff640 1 -- 172.21.15.5:0/967159250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c032640 con 0x7f571c06dbe0 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f5713fff640 1 -- 172.21.15.5:0/967159250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c032a10 con 0x7f571c06dbe0 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 -- 172.21.15.5:0/967159250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06dbe0 msgr2=0x7f571c06abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 --2- 172.21.15.5:0/967159250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06dbe0 0x7f571c06abe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f571c06f450 tx=0x7f570c02c940 comp rx=0 tx=0).stop 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 -- 172.21.15.5:0/967159250 shutdown_connections 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 --2- 172.21.15.5:0/967159250 >> v2:172.21.15.80:3300/0 conn(0x7f571c06b120 0x7f571c0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 --2- 172.21.15.5:0/967159250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06dbe0 0x7f571c06abe0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 -- 172.21.15.5:0/967159250 >> 172.21.15.5:0/967159250 conn(0x7f571c0b2560 msgr2=0x7f571c0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 -- 172.21.15.5:0/967159250 shutdown_connections 2024-04-25T08:59:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.200+0000 7f57235a9640 1 -- 172.21.15.5:0/967159250 wait complete. 2024-04-25T08:59:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.201+0000 7f57235a9640 1 Processor -- start 2024-04-25T08:59:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f57235a9640 1 -- start start 2024-04-25T08:59:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f57235a9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06b120 0x7f571c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f57235a9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f571c15a9d0 0x7f571c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f57235a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c0ce940 0x7f571c0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f57235a9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0b3fa0 con 0x7f571c06b120 2024-04-25T08:59:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f57235a9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c15adb0 con 0x7f571c0ce940 2024-04-25T08:59:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f57235a9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0b4120 con 0x7f571c15a9d0 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f5721345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06b120 0x7f571c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f5721345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06b120 0x7f571c154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44130/0 (socket says 172.21.15.5:44130) 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f5721345640 1 -- 172.21.15.5:0/2478418331 learned_addr learned my addr 172.21.15.5:0/2478418331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f5721b46640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c0ce940 0x7f571c0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.202+0000 7f5720b44640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f571c15a9d0 0x7f571c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5721345640 1 -- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f571c15a9d0 msgr2=0x7f571c0aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5721345640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f571c15a9d0 0x7f571c0aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5721345640 1 -- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c0ce940 msgr2=0x7f571c0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5721345640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c0ce940 0x7f571c0cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5721345640 1 -- 172.21.15.5:0/2478418331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c153be0 con 0x7f571c06b120 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5721345640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06b120 0x7f571c154dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f571800c3f0 tx=0x7f571800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5711ffb640 1 -- 172.21.15.5:0/2478418331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180052d0 con 0x7f571c06b120 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5711ffb640 1 -- 172.21.15.5:0/2478418331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718005490 con 0x7f571c06b120 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c0af1a0 con 0x7f571c06b120 2024-04-25T08:59:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f5711ffb640 1 -- 172.21.15.5:0/2478418331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718007260 con 0x7f571c06b120 2024-04-25T08:59:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.203+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c1f4ab0 con 0x7f571c06b120 2024-04-25T08:59:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.204+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c04ef20 con 0x7f571c06b120 2024-04-25T08:59:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.204+0000 7f5711ffb640 1 -- 172.21.15.5:0/2478418331 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5718007400 con 0x7f571c06b120 2024-04-25T08:59:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.205+0000 7f5711ffb640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f570006b4d0 0x7f570006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.205+0000 7f5711ffb640 1 -- 172.21.15.5:0/2478418331 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f57180896b0 con 0x7f571c06b120 2024-04-25T08:59:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.205+0000 7f5720b44640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f570006b4d0 0x7f570006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.206+0000 7f5720b44640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f570006b4d0 0x7f570006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f570c037000 tx=0x7f570c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.209+0000 7f5711ffb640 1 -- 172.21.15.5:0/2478418331 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f571c153be0 con 0x7f571c06b120 2024-04-25T08:59:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.389+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f571c0cca50 con 0x7f571c06b120 2024-04-25T08:59:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.390+0000 7f5711ffb640 1 -- 172.21.15.5:0/2478418331 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5718057e20 con 0x7f571c06b120 2024-04-25T08:59:02.379 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f570006b4d0 msgr2=0x7f570006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f570006b4d0 0x7f570006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f570c037000 tx=0x7f570c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06b120 msgr2=0x7f571c154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06b120 0x7f571c154dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f571800c3f0 tx=0x7f571800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 shutdown_connections 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f570006b4d0 0x7f570006d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c0ce940 0x7f571c0cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f571c15a9d0 0x7f571c0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 --2- 172.21.15.5:0/2478418331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571c06b120 0x7f571c154dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 >> 172.21.15.5:0/2478418331 conn(0x7f571c0b2560 msgr2=0x7f571c0713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 shutdown_connections 2024-04-25T08:59:02.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.392+0000 7f57235a9640 1 -- 172.21.15.5:0/2478418331 wait complete. 2024-04-25T08:59:02.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.503+0000 7f8d315fe640 1 Processor -- start 2024-04-25T08:59:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.503+0000 7f8d315fe640 1 -- start start 2024-04-25T08:59:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d315fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d315fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d2c0d3df0 0x7f8d2c0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d315fe640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c0b7f60 con 0x7f8d2c0d3990 2024-04-25T08:59:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d315fe640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c0b29c0 con 0x7f8d2c0d3df0 2024-04-25T08:59:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d315fe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0d2080 con 0x7f8d2c15e0a0 2024-04-25T08:59:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d2affd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d2b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d2c0d3df0 0x7f8d2c0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.504+0000 7f8d2affd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:37662/0 (socket says 172.21.15.5:37662) 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.505+0000 7f8d2affd640 1 -- 172.21.15.5:0/3413508721 learned_addr learned my addr 172.21.15.5:0/3413508721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.505+0000 7f8d2b7fe640 1 -- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 msgr2=0x7f8d2c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.505+0000 7f8d2b7fe640 1 --2- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.505+0000 7f8d2b7fe640 1 -- 172.21.15.5:0/3413508721 >> v1:172.21.15.80:6789/0 conn(0x7f8d2c0d3990 legacy=0x7f8d2c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.505+0000 7f8d29ffb640 1 -- 172.21.15.5:0/3413508721 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495445372 0 0) 0x7f8d2c0b7f60 con 0x7f8d2c0d3990 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.505+0000 7f8d2b7fe640 1 -- 172.21.15.5:0/3413508721 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0d2360 con 0x7f8d2c0d3df0 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.505+0000 7f8d2affd640 1 --2- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d2b7fe640 1 --2- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 0x7f8d2c0cecf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009d90 tx=0x7f8d1c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d6a08b983421b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d29ffb640 1 -- 172.21.15.5:0/3413508721 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c007740 con 0x7f8d2c0d3df0 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d29ffb640 1 -- 172.21.15.5:0/3413508721 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0078e0 con 0x7f8d2c0d3df0 2024-04-25T08:59:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d29ffb640 1 -- 172.21.15.5:0/3413508721 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c007cb0 con 0x7f8d2c0d3df0 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 -- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 msgr2=0x7f8d2c0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 0x7f8d2c0cecf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009d90 tx=0x7f8d1c02a660 comp rx=0 tx=0).stop 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 -- 172.21.15.5:0/3413508721 shutdown_connections 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 0x7f8d2c0cecf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3413508721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 -- 172.21.15.5:0/3413508721 >> 172.21.15.5:0/3413508721 conn(0x7f8d2c0668f0 msgr2=0x7f8d2c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 -- 172.21.15.5:0/3413508721 shutdown_connections 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.506+0000 7f8d315fe640 1 -- 172.21.15.5:0/3413508721 wait complete. 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 Processor -- start 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 -- start start 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d2c0d3990 0x7f8d2c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 0x7f8d2c14d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0d2c00 con 0x7f8d2c0d3990 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0d2920 con 0x7f8d2c0d3df0 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.508+0000 7f8d315fe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0d4280 con 0x7f8d2c15e0a0 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d2c0d3990 0x7f8d2c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d2c0d3990 0x7f8d2c0cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44138/0 (socket says 172.21.15.5:44138) 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 -- 172.21.15.5:0/3463205977 learned_addr learned my addr 172.21.15.5:0/3463205977 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2a7fc640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 0x7f8d2c14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2b7fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 -- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 msgr2=0x7f8d2c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 -- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 msgr2=0x7f8d2c14d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 0x7f8d2c14d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 -- 172.21.15.5:0/3463205977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0cc940 con 0x7f8d2c0d3990 2024-04-25T08:59:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d2affd640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d2c0d3990 0x7f8d2c0cd9e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400e9d0 tx=0x7f8d2400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d237fe640 1 -- 172.21.15.5:0/3463205977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24017070 con 0x7f8d2c0d3990 2024-04-25T08:59:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d237fe640 1 -- 172.21.15.5:0/3463205977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2400ca00 con 0x7f8d2c0d3990 2024-04-25T08:59:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d237fe640 1 -- 172.21.15.5:0/3463205977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400cdb0 con 0x7f8d2c0d3990 2024-04-25T08:59:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c0ccc20 con 0x7f8d2c0d3990 2024-04-25T08:59:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.509+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c0cd1e0 con 0x7f8d2c0d3990 2024-04-25T08:59:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.510+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c0d4570 con 0x7f8d2c0d3990 2024-04-25T08:59:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.511+0000 7f8d237fe640 1 -- 172.21.15.5:0/3463205977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d2401a070 con 0x7f8d2c0d3990 2024-04-25T08:59:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.511+0000 7f8d237fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d0c06b4d0 0x7f8d0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.511+0000 7f8d237fe640 1 -- 172.21.15.5:0/3463205977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8d2408a590 con 0x7f8d2c0d3990 2024-04-25T08:59:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.511+0000 7f8d2a7fc640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d0c06b4d0 0x7f8d0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.512+0000 7f8d2a7fc640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d0c06b4d0 0x7f8d0c06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d14007fd0 tx=0x7f8d14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.516+0000 7f8d237fe640 1 -- 172.21.15.5:0/3463205977 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d2c0d4570 con 0x7f8d2c0d3990 2024-04-25T08:59:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.736+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d2c04ef20 con 0x7f8d2c0d3990 2024-04-25T08:59:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.737+0000 7f8d237fe640 1 -- 172.21.15.5:0/3463205977 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f8d24059370 con 0x7f8d2c0d3990 2024-04-25T08:59:02.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:02.727 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2510409846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2510409846},{"type":"v1","addr":"172.21.15.80:6837","nonce":2510409846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3426555717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3426555717},{"type":"v1","addr":"172.21.15.80:6836","nonce":3426555717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4918,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3729803264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3729803264},{"type":"v1","addr":"172.21.15.5:6835","nonce":3729803264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:57:32.755583+0000","modified":"2024-04-25T08:57:43.916564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3359008015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3359008015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3359008015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:59:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 14 2024-04-25T08:59:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d0c06b4d0 msgr2=0x7f8d0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d0c06b4d0 0x7f8d0c06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d14007fd0 tx=0x7f8d14009040 comp rx=0 tx=0).stop 2024-04-25T08:59:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d2c0d3990 msgr2=0x7f8d2c0cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d2c0d3990 0x7f8d2c0cd9e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400e9d0 tx=0x7f8d2400ee90 comp rx=0 tx=0).stop 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 shutdown_connections 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d0c06b4d0 0x7f8d0c06d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d2c15e0a0 0x7f8d2c0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d2c0d3df0 0x7f8d2c14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 --2- 172.21.15.5:0/3463205977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d2c0d3990 0x7f8d2c0cd9e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 >> 172.21.15.5:0/3463205977 conn(0x7f8d2c0668f0 msgr2=0x7f8d2c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 shutdown_connections 2024-04-25T08:59:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.739+0000 7f8d315fe640 1 -- 172.21.15.5:0/3463205977 wait complete. 2024-04-25T08:59:02.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.850+0000 7f239b7b7640 1 Processor -- start 2024-04-25T08:59:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.850+0000 7f239b7b7640 1 -- start start 2024-04-25T08:59:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f239b7b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 0x7f23941688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f239b7b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940d23c0 con 0x7f23940d05f0 2024-04-25T08:59:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f239b7b7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940d2670 con 0x7f23940b9990 2024-04-25T08:59:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f239b7b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940d2950 con 0x7f23940d3710 2024-04-25T08:59:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f2399553640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23940d05f0 0x7f23940d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46638/0 (socket says 172.21.15.5:46638) 2024-04-25T08:59:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f2399553640 1 -- 172.21.15.5:0/2627196912 learned_addr learned my addr 172.21.15.5:0/2627196912 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f2399d54640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 0x7f23941688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257800437 0 0) 0x7f23940d23c0 con 0x7f23940d05f0 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2380003520 con 0x7f23940d05f0 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238286472 0 0) 0x7f2380003520 con 0x7f23940d05f0 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 msgr2=0x7f23941688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 0x7f23941688f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 >> v1:172.21.15.80:6789/0 conn(0x7f23940b9990 legacy=0x7f23940d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940d2c30 con 0x7f23940d05f0 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2390001670 con 0x7f23940d05f0 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 >> v1:172.21.15.5:6789/0 conn(0x7f23940d05f0 legacy=0x7f23940d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23800039e0 0x7f2380003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 0x7f2380004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.851+0000 7f238bfff640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380004d40 0x7f23800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940d2950 con 0x7f2380004d40 2024-04-25T08:59:02.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238000bb00 con 0x7f23800039e0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238000bd00 con 0x7f23940d3710 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399d54640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380004d40 0x7f23800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399553640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23800039e0 0x7f2380003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2398d52640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 0x7f2380004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399553640 1 -- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 msgr2=0x7f2380004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399553640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940d3710 0x7f2380004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399553640 1 -- 172.21.15.5:0/2627196912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380004d40 msgr2=0x7f23800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399553640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380004d40 0x7f23800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399553640 1 -- 172.21.15.5:0/2627196912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380003520 con 0x7f23800039e0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.852+0000 7f2399d54640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2380004d40 0x7f23800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f2399553640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23800039e0 0x7f2380003e00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2390001eb0 tx=0x7f2380005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d712b094bbc9cb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390007d30 con 0x7f23800039e0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23900058d0 con 0x7f23800039e0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f238bfff640 1 -- 172.21.15.5:0/2627196912 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390005ce0 con 0x7f23800039e0 2024-04-25T08:59:02.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f239b7b7640 1 -- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23800039e0 msgr2=0x7f2380003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f239b7b7640 1 --2- 172.21.15.5:0/2627196912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23800039e0 0x7f2380003e00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2390001eb0 tx=0x7f2380005830 comp rx=0 tx=0).stop 2024-04-25T08:59:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f2399d54640 1 -- 172.21.15.5:0/2627196912 reap_dead start 2024-04-25T08:59:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f239b7b7640 1 -- 172.21.15.5:0/2627196912 shutdown_connections 2024-04-25T08:59:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.853+0000 7f239b7b7640 1 -- 172.21.15.5:0/2627196912 >> 172.21.15.5:0/2627196912 conn(0x7f239406b000 msgr2=0x7f239406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.854+0000 7f239b7b7640 1 -- 172.21.15.5:0/2627196912 shutdown_connections 2024-04-25T08:59:02.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.854+0000 7f239b7b7640 1 -- 172.21.15.5:0/2627196912 wait complete. 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 Processor -- start 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 -- start start 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23800039e0 0x7f2394165e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940cc680 0x7f23940ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2394161840 0x7f2394161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239415e210 con 0x7f23800039e0 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239415e090 con 0x7f2394161840 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.855+0000 7f239b7b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23941668e0 con 0x7f23940cc680 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23800039e0 0x7f2394165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23800039e0 0x7f2394165e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44150/0 (socket says 172.21.15.5:44150) 2024-04-25T08:59:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 -- 172.21.15.5:0/1396606783 learned_addr learned my addr 172.21.15.5:0/1396606783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399d54640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2394161840 0x7f2394161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2398d52640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940cc680 0x7f23940ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 -- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940cc680 msgr2=0x7f23940ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940cc680 0x7f23940ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 -- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2394161840 msgr2=0x7f2394161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2394161840 0x7f2394161cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 -- 172.21.15.5:0/1396606783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940cd1f0 con 0x7f23800039e0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2398d52640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940cc680 0x7f23940ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2399553640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23800039e0 0x7f2394165e40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f239000c300 tx=0x7f2390001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2389ffb640 1 -- 172.21.15.5:0/1396606783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390042020 con 0x7f23800039e0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2389ffb640 1 -- 172.21.15.5:0/1396606783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390007d10 con 0x7f23800039e0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f2389ffb640 1 -- 172.21.15.5:0/1396606783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900074e0 con 0x7f23800039e0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23940cd4d0 con 0x7f23800039e0 2024-04-25T08:59:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.856+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239415edf0 con 0x7f23800039e0 2024-04-25T08:59:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.857+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239404ef20 con 0x7f23800039e0 2024-04-25T08:59:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.858+0000 7f2389ffb640 1 -- 172.21.15.5:0/1396606783 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2390045020 con 0x7f23800039e0 2024-04-25T08:59:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.858+0000 7f2389ffb640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f237806b4d0 0x7f237806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.858+0000 7f2389ffb640 1 -- 172.21.15.5:0/1396606783 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f23900aaab0 con 0x7f23800039e0 2024-04-25T08:59:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.858+0000 7f2398d52640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f237806b4d0 0x7f237806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.859+0000 7f2398d52640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f237806b4d0 0x7f237806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23941614d0 tx=0x7f2384009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:02.862+0000 7f2389ffb640 1 -- 172.21.15.5:0/1396606783 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f239004c020 con 0x7f23800039e0 2024-04-25T08:59:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.043+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23940b2df0 con 0x7f23800039e0 2024-04-25T08:59:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.044+0000 7f2389ffb640 1 -- 172.21.15.5:0/1396606783 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16650 (secure 0 0 0) 0x7f23900058a0 con 0x7f23800039e0 2024-04-25T08:59:03.034 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:03.034 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:58:40.086289+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:31.301883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:31.733858+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f237806b4d0 msgr2=0x7f237806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f237806b4d0 0x7f237806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23941614d0 tx=0x7f2384009040 comp rx=0 tx=0).stop 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23800039e0 msgr2=0x7f2394165e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23800039e0 0x7f2394165e40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f239000c300 tx=0x7f2390001a40 comp rx=0 tx=0).stop 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 shutdown_connections 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f237806b4d0 0x7f237806d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2394161840 0x7f2394161cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23940cc680 0x7f23940ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 --2- 172.21.15.5:0/1396606783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23800039e0 0x7f2394165e40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 >> 172.21.15.5:0/1396606783 conn(0x7f239406b000 msgr2=0x7f23940b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 shutdown_connections 2024-04-25T08:59:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.046+0000 7f239b7b7640 1 -- 172.21.15.5:0/1396606783 wait complete. 2024-04-25T08:59:03.046 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:59:03.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.159+0000 7fc087189640 1 Processor -- start 2024-04-25T08:59:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.159+0000 7fc087189640 1 -- start start 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc087189640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc08006b7d0 0x7fc08006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc087189640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc08015e120 0x7fc0800d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc087189640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800b4730 con 0x7fc08006bbb0 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc087189640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0800d0b70 con 0x7fc08015e120 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc087189640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0800cbf30 con 0x7fc08006b7d0 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc085726640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc08015e120 0x7fc0800d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc085726640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc08015e120 0x7fc0800d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44154/0 (socket says 172.21.15.5:44154) 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc085726640 1 -- 172.21.15.5:0/3509354265 learned_addr learned my addr 172.21.15.5:0/3509354265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc085726640 1 -- 172.21.15.5:0/3509354265 >> v2:172.21.15.80:3300/0 conn(0x7fc08006b7d0 msgr2=0x7fc08006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc085726640 1 --2- 172.21.15.5:0/3509354265 >> v2:172.21.15.80:3300/0 conn(0x7fc08006b7d0 0x7fc08006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc085726640 1 -- 172.21.15.5:0/3509354265 >> v1:172.21.15.80:6789/0 conn(0x7fc08006bbb0 legacy=0x7fc08015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.160+0000 7fc085726640 1 -- 172.21.15.5:0/3509354265 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800d0da0 con 0x7fc08015e120 2024-04-25T08:59:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.161+0000 7fc085726640 1 --2- 172.21.15.5:0/3509354265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08015e120 0x7fc0800d0630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc0800b4400 tx=0x7fc07802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649a45ce065246fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.161+0000 7fc07f7fe640 1 -- 172.21.15.5:0/3509354265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078036070 con 0x7fc08015e120 2024-04-25T08:59:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.161+0000 7fc07f7fe640 1 -- 172.21.15.5:0/3509354265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078031600 con 0x7fc08015e120 2024-04-25T08:59:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.161+0000 7fc07f7fe640 1 -- 172.21.15.5:0/3509354265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780319d0 con 0x7fc08015e120 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 -- 172.21.15.5:0/3509354265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08015e120 msgr2=0x7fc0800d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 --2- 172.21.15.5:0/3509354265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08015e120 0x7fc0800d0630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc0800b4400 tx=0x7fc07802a780 comp rx=0 tx=0).stop 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 -- 172.21.15.5:0/3509354265 shutdown_connections 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 --2- 172.21.15.5:0/3509354265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08015e120 0x7fc0800d0630 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 --2- 172.21.15.5:0/3509354265 >> v2:172.21.15.80:3300/0 conn(0x7fc08006b7d0 0x7fc08006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 -- 172.21.15.5:0/3509354265 >> 172.21.15.5:0/3509354265 conn(0x7fc0800d18e0 msgr2=0x7fc0800d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 -- 172.21.15.5:0/3509354265 shutdown_connections 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.162+0000 7fc087189640 1 -- 172.21.15.5:0/3509354265 wait complete. 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.163+0000 7fc087189640 1 Processor -- start 2024-04-25T08:59:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.163+0000 7fc087189640 1 -- start start 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc087189640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08006b7d0 0x7fc080152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc087189640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc08006bbb0 0x7fc080154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc087189640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08015e120 0x7fc0801f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc087189640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800cc460 con 0x7fc08006b7d0 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc087189640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800cc7d0 con 0x7fc08015e120 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc087189640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800ccc60 con 0x7fc08006bbb0 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc084f25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08006b7d0 0x7fc080152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc084f25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08006b7d0 0x7fc080152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44164/0 (socket says 172.21.15.5:44164) 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc084f25640 1 -- 172.21.15.5:0/1648750297 learned_addr learned my addr 172.21.15.5:0/1648750297 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc085726640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08015e120 0x7fc0801f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc07ffff640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc08006bbb0 0x7fc080154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc084f25640 1 -- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc08006bbb0 msgr2=0x7fc080154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc084f25640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc08006bbb0 0x7fc080154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.164+0000 7fc084f25640 1 -- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08015e120 msgr2=0x7fc0801f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc084f25640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08015e120 0x7fc0801f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc084f25640 1 -- 172.21.15.5:0/1648750297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080152e80 con 0x7fc08006b7d0 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc085726640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08015e120 0x7fc0801f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc084f25640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08006b7d0 0x7fc080152940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc07000b4a0 tx=0x7fc07000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc07d7fa640 1 -- 172.21.15.5:0/1648750297 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070014070 con 0x7fc08006b7d0 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc07d7fa640 1 -- 172.21.15.5:0/1648750297 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070010610 con 0x7fc08006b7d0 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0801f4ae0 con 0x7fc08006b7d0 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc07d7fa640 1 -- 172.21.15.5:0/1648750297 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070010a00 con 0x7fc08006b7d0 2024-04-25T08:59:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.165+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc080153a50 con 0x7fc08006b7d0 2024-04-25T08:59:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.166+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0800ce740 con 0x7fc08006b7d0 2024-04-25T08:59:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.166+0000 7fc07d7fa640 1 -- 172.21.15.5:0/1648750297 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc070017070 con 0x7fc08006b7d0 2024-04-25T08:59:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.167+0000 7fc07d7fa640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc06c06b4d0 0x7fc06c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.167+0000 7fc07d7fa640 1 -- 172.21.15.5:0/1648750297 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc070089bb0 con 0x7fc08006b7d0 2024-04-25T08:59:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.167+0000 7fc07ffff640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc06c06b4d0 0x7fc06c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.168+0000 7fc07ffff640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc06c06b4d0 0x7fc06c06d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc074007fd0 tx=0x7fc074009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.171+0000 7fc07d7fa640 1 -- 172.21.15.5:0/1648750297 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc0800ce740 con 0x7fc08006b7d0 2024-04-25T08:59:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.388+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc080153840 con 0x7fc08006b7d0 2024-04-25T08:59:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.389+0000 7fc07d7fa640 1 -- 172.21.15.5:0/1648750297 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fc070058aa0 con 0x7fc08006b7d0 2024-04-25T08:59:03.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:03.379 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2510409846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2510409846},{"type":"v1","addr":"172.21.15.80:6837","nonce":2510409846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3426555717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3426555717},{"type":"v1","addr":"172.21.15.80:6836","nonce":3426555717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4918,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3729803264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3729803264},{"type":"v1","addr":"172.21.15.5:6835","nonce":3729803264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:57:32.755583+0000","modified":"2024-04-25T08:57:43.916564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3359008015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3359008015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3359008015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:59:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 14 2024-04-25T08:59:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc06c06b4d0 msgr2=0x7fc06c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc06c06b4d0 0x7fc06c06d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc074007fd0 tx=0x7fc074009040 comp rx=0 tx=0).stop 2024-04-25T08:59:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08006b7d0 msgr2=0x7fc080152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08006b7d0 0x7fc080152940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc07000b4a0 tx=0x7fc07000b960 comp rx=0 tx=0).stop 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 shutdown_connections 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc06c06b4d0 0x7fc06c06d990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08015e120 0x7fc0801f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc08006bbb0 0x7fc080154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 --2- 172.21.15.5:0/1648750297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc08006b7d0 0x7fc080152940 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 >> 172.21.15.5:0/1648750297 conn(0x7fc0800d18e0 msgr2=0x7fc0800b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 shutdown_connections 2024-04-25T08:59:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.391+0000 7fc087189640 1 -- 172.21.15.5:0/1648750297 wait complete. 2024-04-25T08:59:03.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:03.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.502+0000 7f537f415640 1 Processor -- start 2024-04-25T08:59:03.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.502+0000 7f537f415640 1 -- start start 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.503+0000 7f537f415640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53780ce910 0x7f5378168b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.503+0000 7f537f415640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537806ba50 con 0x7f53780b0e30 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.503+0000 7f537f415640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537806bd30 con 0x7f53780b0a50 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.503+0000 7f537f415640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537806b800 con 0x7f53780ce910 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.503+0000 7f537d9b2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53780ce910 0x7f5378168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.503+0000 7f537c9b0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f53780b0e30 0x7f53780b1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46646/0 (socket says 172.21.15.5:46646) 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.503+0000 7f537c9b0640 1 -- 172.21.15.5:0/434745240 learned_addr learned my addr 172.21.15.5:0/434745240 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:03.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.504+0000 7f537d9b2640 1 -- 172.21.15.5:0/434745240 >> v1:172.21.15.80:6789/0 conn(0x7f53780b0a50 legacy=0x7f53780ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.504+0000 7f537d9b2640 1 -- 172.21.15.5:0/434745240 >> v1:172.21.15.5:6789/0 conn(0x7f53780b0e30 legacy=0x7f53780b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.504+0000 7f537d9b2640 1 -- 172.21.15.5:0/434745240 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537806c010 con 0x7f53780ce910 2024-04-25T08:59:03.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.504+0000 7f536ffff640 1 -- 172.21.15.5:0/434745240 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242062025 0 0) 0x7f537806ba50 con 0x7f53780b0e30 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.504+0000 7f537d9b2640 1 --2- 172.21.15.5:0/434745240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780ce910 0x7f5378168b90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5374009d90 tx=0x7f537402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc9fbbb6c36577 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f536ffff640 1 -- 172.21.15.5:0/434745240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374007740 con 0x7f53780ce910 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f536ffff640 1 -- 172.21.15.5:0/434745240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53740078e0 con 0x7f53780ce910 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f536ffff640 1 -- 172.21.15.5:0/434745240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374007cb0 con 0x7f53780ce910 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f537f415640 1 -- 172.21.15.5:0/434745240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780ce910 msgr2=0x7f5378168b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f537f415640 1 --2- 172.21.15.5:0/434745240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780ce910 0x7f5378168b90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5374009d90 tx=0x7f537402a660 comp rx=0 tx=0).stop 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f537f415640 1 -- 172.21.15.5:0/434745240 shutdown_connections 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f537f415640 1 --2- 172.21.15.5:0/434745240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780ce910 0x7f5378168b90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f537f415640 1 -- 172.21.15.5:0/434745240 >> 172.21.15.5:0/434745240 conn(0x7f53780d18f0 msgr2=0x7f53780d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:03.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f537f415640 1 -- 172.21.15.5:0/434745240 shutdown_connections 2024-04-25T08:59:03.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.505+0000 7f537f415640 1 -- 172.21.15.5:0/434745240 wait complete. 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.506+0000 7f537f415640 1 Processor -- start 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.506+0000 7f537f415640 1 -- start start 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537f415640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53780b0a50 0x7f5378158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537f415640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780b0e30 0x7f53780c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537f415640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53780ce910 0x7f537815fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537f415640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53780b2bf0 con 0x7f53780b0e30 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537f415640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53780cfd60 con 0x7f53780ce910 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537f415640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5378160850 con 0x7f53780b0a50 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537c9b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780b0e30 0x7f53780c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537c9b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780b0e30 0x7f53780c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44182/0 (socket says 172.21.15.5:44182) 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537c9b0640 1 -- 172.21.15.5:0/3314583292 learned_addr learned my addr 172.21.15.5:0/3314583292 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537d9b2640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53780ce910 0x7f537815fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.507+0000 7f537d1b1640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53780b0a50 0x7f5378158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537c9b0640 1 -- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53780b0a50 msgr2=0x7f5378158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537c9b0640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53780b0a50 0x7f5378158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537c9b0640 1 -- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53780ce910 msgr2=0x7f537815fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537c9b0640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53780ce910 0x7f537815fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537c9b0640 1 -- 172.21.15.5:0/3314583292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378160b30 con 0x7f53780b0e30 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537c9b0640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780b0e30 0x7f53780c7c60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f536800c460 tx=0x7f536800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f536dffb640 1 -- 172.21.15.5:0/3314583292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368018070 con 0x7f53780b0e30 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f536dffb640 1 -- 172.21.15.5:0/3314583292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53680074e0 con 0x7f53780b0e30 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f536dffb640 1 -- 172.21.15.5:0/3314583292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368004a20 con 0x7f53780b0e30 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5378160e10 con 0x7f53780b0e30 2024-04-25T08:59:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.508+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53781613d0 con 0x7f53780b0e30 2024-04-25T08:59:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.509+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537804ef20 con 0x7f53780b0e30 2024-04-25T08:59:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.509+0000 7f536dffb640 1 -- 172.21.15.5:0/3314583292 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f536801b070 con 0x7f53780b0e30 2024-04-25T08:59:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.510+0000 7f536dffb640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535c06b500 0x7f535c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.510+0000 7f536dffb640 1 -- 172.21.15.5:0/3314583292 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f5368089330 con 0x7f53780b0e30 2024-04-25T08:59:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.510+0000 7f537d1b1640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535c06b500 0x7f535c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.511+0000 7f537d1b1640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535c06b500 0x7f535c06d9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5370000f60 tx=0x7f5370009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.514+0000 7f536dffb640 1 -- 172.21.15.5:0/3314583292 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5368057bd0 con 0x7f53780b0e30 2024-04-25T08:59:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.730+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5378161850 con 0x7f53780b0e30 2024-04-25T08:59:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.730+0000 7f536dffb640 1 -- 172.21.15.5:0/3314583292 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f536805bc70 con 0x7f53780b0e30 2024-04-25T08:59:03.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:03.720 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2510409846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2510409846},{"type":"v1","addr":"172.21.15.80:6837","nonce":2510409846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3426555717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3426555717},{"type":"v1","addr":"172.21.15.80:6836","nonce":3426555717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4918,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3729803264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3729803264},{"type":"v1","addr":"172.21.15.5:6835","nonce":3729803264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:57:32.755583+0000","modified":"2024-04-25T08:57:43.916564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/3359008015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3359008015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3359008015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:59:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 14 2024-04-25T08:59:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535c06b500 msgr2=0x7f535c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535c06b500 0x7f535c06d9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5370000f60 tx=0x7f5370009040 comp rx=0 tx=0).stop 2024-04-25T08:59:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780b0e30 msgr2=0x7f53780c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780b0e30 0x7f53780c7c60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f536800c460 tx=0x7f536800c920 comp rx=0 tx=0).stop 2024-04-25T08:59:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 shutdown_connections 2024-04-25T08:59:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535c06b500 0x7f535c06d9c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53780ce910 0x7f537815fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53780b0e30 0x7f53780c7c60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 --2- 172.21.15.5:0/3314583292 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53780b0a50 0x7f5378158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 >> 172.21.15.5:0/3314583292 conn(0x7f53780d18f0 msgr2=0x7f53780b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.732+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 shutdown_connections 2024-04-25T08:59:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.733+0000 7f537f415640 1 -- 172.21.15.5:0/3314583292 wait complete. 2024-04-25T08:59:03.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:03.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.844+0000 7fbb38038640 1 Processor -- start 2024-04-25T08:59:03.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.844+0000 7fbb38038640 1 -- start start 2024-04-25T08:59:03.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb38038640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb3015e120 0x7fbb3006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb38038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb3006bbb0 0x7fbb300d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb38038640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb300b4730 con 0x7fbb3006b7d0 2024-04-25T08:59:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb38038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb300d0b70 con 0x7fbb3006bbb0 2024-04-25T08:59:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb38038640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb300cbf30 con 0x7fbb3015e120 2024-04-25T08:59:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb365d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb3006bbb0 0x7fbb300d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb365d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb3006bbb0 0x7fbb300d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44190/0 (socket says 172.21.15.5:44190) 2024-04-25T08:59:03.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb365d5640 1 -- 172.21.15.5:0/1433066974 learned_addr learned my addr 172.21.15.5:0/1433066974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb355d3640 1 --2- 172.21.15.5:0/1433066974 >> v2:172.21.15.80:3300/0 conn(0x7fbb3015e120 0x7fbb3006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb365d5640 1 -- 172.21.15.5:0/1433066974 >> v2:172.21.15.80:3300/0 conn(0x7fbb3015e120 msgr2=0x7fbb3006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb365d5640 1 --2- 172.21.15.5:0/1433066974 >> v2:172.21.15.80:3300/0 conn(0x7fbb3015e120 0x7fbb3006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb365d5640 1 -- 172.21.15.5:0/1433066974 >> v1:172.21.15.80:6789/0 conn(0x7fbb3006b7d0 legacy=0x7fbb3015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.845+0000 7fbb365d5640 1 -- 172.21.15.5:0/1433066974 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300d0da0 con 0x7fbb3006bbb0 2024-04-25T08:59:03.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.846+0000 7fbb365d5640 1 --2- 172.21.15.5:0/1433066974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006bbb0 0x7fbb300d0630 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbb30072970 tx=0x7fbb2802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f8f6fd025b834e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.846+0000 7fbb34dd2640 1 -- 172.21.15.5:0/1433066974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28036070 con 0x7fbb3006bbb0 2024-04-25T08:59:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.846+0000 7fbb34dd2640 1 -- 172.21.15.5:0/1433066974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28031600 con 0x7fbb3006bbb0 2024-04-25T08:59:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.846+0000 7fbb34dd2640 1 -- 172.21.15.5:0/1433066974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb280319d0 con 0x7fbb3006bbb0 2024-04-25T08:59:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 -- 172.21.15.5:0/1433066974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006bbb0 msgr2=0x7fbb300d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 --2- 172.21.15.5:0/1433066974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006bbb0 0x7fbb300d0630 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbb30072970 tx=0x7fbb2802a780 comp rx=0 tx=0).stop 2024-04-25T08:59:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 -- 172.21.15.5:0/1433066974 shutdown_connections 2024-04-25T08:59:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 --2- 172.21.15.5:0/1433066974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006bbb0 0x7fbb300d0630 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 --2- 172.21.15.5:0/1433066974 >> v2:172.21.15.80:3300/0 conn(0x7fbb3015e120 0x7fbb3006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 -- 172.21.15.5:0/1433066974 >> 172.21.15.5:0/1433066974 conn(0x7fbb300d18e0 msgr2=0x7fbb300d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 -- 172.21.15.5:0/1433066974 shutdown_connections 2024-04-25T08:59:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.847+0000 7fbb38038640 1 -- 172.21.15.5:0/1433066974 wait complete. 2024-04-25T08:59:03.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.848+0000 7fbb38038640 1 Processor -- start 2024-04-25T08:59:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.848+0000 7fbb38038640 1 -- start start 2024-04-25T08:59:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb38038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006b7d0 0x7fbb300d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb38038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006bbb0 0x7fbb300d2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb38038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb3015e120 0x7fbb300b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb38038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb300cc460 con 0x7fbb3006b7d0 2024-04-25T08:59:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb38038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb300cc7d0 con 0x7fbb3006bbb0 2024-04-25T08:59:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb38038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb300ccc60 con 0x7fbb3015e120 2024-04-25T08:59:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006b7d0 0x7fbb300d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006b7d0 0x7fbb300d1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44196/0 (socket says 172.21.15.5:44196) 2024-04-25T08:59:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 -- 172.21.15.5:0/3851430569 learned_addr learned my addr 172.21.15.5:0/3851430569 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb355d3640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006bbb0 0x7fbb300d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb365d5640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb3015e120 0x7fbb300b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 -- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb3015e120 msgr2=0x7fbb300b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb3015e120 0x7fbb300b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 -- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006bbb0 msgr2=0x7fbb300d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006bbb0 0x7fbb300d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 -- 172.21.15.5:0/3851430569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30161430 con 0x7fbb3006b7d0 2024-04-25T08:59:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb35dd4640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006b7d0 0x7fbb300d1cc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00c460 tx=0x7fbb2c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.849+0000 7fbb267fc640 1 -- 172.21.15.5:0/3851430569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c016020 con 0x7fbb3006b7d0 2024-04-25T08:59:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.850+0000 7fbb267fc640 1 -- 172.21.15.5:0/3851430569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c012870 con 0x7fbb3006b7d0 2024-04-25T08:59:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.850+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb30160e70 con 0x7fbb3006b7d0 2024-04-25T08:59:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.850+0000 7fbb267fc640 1 -- 172.21.15.5:0/3851430569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c012c60 con 0x7fbb3006b7d0 2024-04-25T08:59:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.850+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb30153bc0 con 0x7fbb3006b7d0 2024-04-25T08:59:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.850+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3004ef20 con 0x7fbb3006b7d0 2024-04-25T08:59:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.851+0000 7fbb267fc640 1 -- 172.21.15.5:0/3851430569 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb2c019020 con 0x7fbb3006b7d0 2024-04-25T08:59:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.851+0000 7fbb267fc640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb1406b4d0 0x7fbb1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.852+0000 7fbb267fc640 1 -- 172.21.15.5:0/3851430569 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fbb2c089c10 con 0x7fbb3006b7d0 2024-04-25T08:59:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.852+0000 7fbb355d3640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb1406b4d0 0x7fbb1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.852+0000 7fbb355d3640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb1406b4d0 0x7fbb1406d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb20006fd0 tx=0x7fbb20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:03.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:03.856+0000 7fbb267fc640 1 -- 172.21.15.5:0/3851430569 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb2c020070 con 0x7fbb3006b7d0 2024-04-25T08:59:04.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.036+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb300ceda0 con 0x7fbb3006b7d0 2024-04-25T08:59:04.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.038+0000 7fbb267fc640 1 -- 172.21.15.5:0/3851430569 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16650 (secure 0 0 0) 0x7fbb2c058b00 con 0x7fbb3006b7d0 2024-04-25T08:59:04.028 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:04.028 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:58:40.086289+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:31.301883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:31.733858+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:04.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb1406b4d0 msgr2=0x7fbb1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb1406b4d0 0x7fbb1406d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb20006fd0 tx=0x7fbb20008040 comp rx=0 tx=0).stop 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006b7d0 msgr2=0x7fbb300d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006b7d0 0x7fbb300d1cc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00c460 tx=0x7fbb2c00c920 comp rx=0 tx=0).stop 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 shutdown_connections 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb1406b4d0 0x7fbb1406d990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb3015e120 0x7fbb300b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006bbb0 0x7fbb300d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 --2- 172.21.15.5:0/3851430569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb3006b7d0 0x7fbb300d1cc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 >> 172.21.15.5:0/3851430569 conn(0x7fbb300d18e0 msgr2=0x7fbb300ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:04.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 shutdown_connections 2024-04-25T08:59:04.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.040+0000 7fbb38038640 1 -- 172.21.15.5:0/3851430569 wait complete. 2024-04-25T08:59:04.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:59:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.154+0000 7f557ea74640 1 Processor -- start 2024-04-25T08:59:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.154+0000 7f557ea74640 1 -- start start 2024-04-25T08:59:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f557ea74640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 0x7f55780b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f557ea74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780d20e0 con 0x7f55780b2cc0 2024-04-25T08:59:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f557ea74640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780d23c0 con 0x7f55780ce7f0 2024-04-25T08:59:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f557ea74640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780d2a10 con 0x7f557815de70 2024-04-25T08:59:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f5577fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f55780b2cc0 0x7f55780b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46652/0 (socket says 172.21.15.5:46652) 2024-04-25T08:59:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f5577fff640 1 -- 172.21.15.5:0/1383929356 learned_addr learned my addr 172.21.15.5:0/1383929356 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f557c810640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 0x7f55780b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469115233 0 0) 0x7f55780d20e0 con 0x7f55780b2cc0 2024-04-25T08:59:04.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5568003520 con 0x7f55780b2cc0 2024-04-25T08:59:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132579290 0 0) 0x7f55780d23c0 con 0x7f55780ce7f0 2024-04-25T08:59:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55780d20e0 con 0x7f55780ce7f0 2024-04-25T08:59:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.155+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134391072 0 0) 0x7f5568003520 con 0x7f55780b2cc0 2024-04-25T08:59:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 msgr2=0x7f55780b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 0x7f55780b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 >> v1:172.21.15.80:6789/0 conn(0x7f55780ce7f0 legacy=0x7f55780cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780d26a0 con 0x7f55780b2cc0 2024-04-25T08:59:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f5564001670 con 0x7f55780b2cc0 2024-04-25T08:59:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 >> v1:172.21.15.5:6789/0 conn(0x7f55780b2cc0 legacy=0x7f55780b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568003b70 0x7f5568003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568004800 0x7f5568004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 0x7f55680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780d2a10 con 0x7f5568003b70 2024-04-25T08:59:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556800ba70 con 0x7f5568004800 2024-04-25T08:59:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556800bc70 con 0x7f557815de70 2024-04-25T08:59:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557c810640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568003b70 0x7f5568003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f5577fff640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568004800 0x7f5568004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557d011640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 0x7f55680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557c810640 1 -- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 msgr2=0x7f55680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557c810640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 0x7f55680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557c810640 1 -- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568004800 msgr2=0x7f5568004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557c810640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568004800 0x7f5568004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557c810640 1 -- 172.21.15.5:0/1383929356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568003520 con 0x7f5568003b70 2024-04-25T08:59:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.156+0000 7f557d011640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f557815de70 0x7f55680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557c810640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568003b70 0x7f5568003f70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f556c009ac0 tx=0x7f5568005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab39e4b41eedef7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c036070 con 0x7f5568003b70 2024-04-25T08:59:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c031400 con 0x7f5568003b70 2024-04-25T08:59:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f55777fe640 1 -- 172.21.15.5:0/1383929356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c009690 con 0x7f5568003b70 2024-04-25T08:59:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557ea74640 1 -- 172.21.15.5:0/1383929356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568003b70 msgr2=0x7f5568003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557ea74640 1 --2- 172.21.15.5:0/1383929356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5568003b70 0x7f5568003f70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f556c009ac0 tx=0x7f5568005830 comp rx=0 tx=0).stop 2024-04-25T08:59:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557d011640 1 -- 172.21.15.5:0/1383929356 reap_dead start 2024-04-25T08:59:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557ea74640 1 -- 172.21.15.5:0/1383929356 shutdown_connections 2024-04-25T08:59:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557ea74640 1 -- 172.21.15.5:0/1383929356 >> 172.21.15.5:0/1383929356 conn(0x7f557806b000 msgr2=0x7f557806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557ea74640 1 -- 172.21.15.5:0/1383929356 shutdown_connections 2024-04-25T08:59:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.157+0000 7f557ea74640 1 -- 172.21.15.5:0/1383929356 wait complete. 2024-04-25T08:59:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.159+0000 7f557ea74640 1 Processor -- start 2024-04-25T08:59:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.159+0000 7f557ea74640 1 -- start start 2024-04-25T08:59:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568003b70 0x7f5578151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55780c7480 0x7f55780b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55780b5550 0x7f55780cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780b9560 con 0x7f55780b5550 2024-04-25T08:59:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780b93e0 con 0x7f5568003b70 2024-04-25T08:59:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780b96e0 con 0x7f55780c7480 2024-04-25T08:59:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55780b5550 0x7f55780cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55780b5550 0x7f55780cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44224/0 (socket says 172.21.15.5:44224) 2024-04-25T08:59:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 -- 172.21.15.5:0/3583567971 learned_addr learned my addr 172.21.15.5:0/3583567971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557c810640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568003b70 0x7f5578151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f5577fff640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55780c7480 0x7f55780b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 -- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55780c7480 msgr2=0x7f55780b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55780c7480 0x7f55780b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 -- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568003b70 msgr2=0x7f5578151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568003b70 0x7f5578151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 -- 172.21.15.5:0/3583567971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578153790 con 0x7f55780b5550 2024-04-25T08:59:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557d011640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55780b5550 0x7f55780cb7e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f557000e790 tx=0x7f557000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f55757fa640 1 -- 172.21.15.5:0/3583567971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000eea0 con 0x7f55780b5550 2024-04-25T08:59:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f55757fa640 1 -- 172.21.15.5:0/3583567971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570003b80 con 0x7f55780b5550 2024-04-25T08:59:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5578152660 con 0x7f55780b5550 2024-04-25T08:59:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f55757fa640 1 -- 172.21.15.5:0/3583567971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570003d70 con 0x7f55780b5550 2024-04-25T08:59:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.160+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5578152c20 con 0x7f55780b5550 2024-04-25T08:59:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.161+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557804ef20 con 0x7f55780b5550 2024-04-25T08:59:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.162+0000 7f55757fa640 1 -- 172.21.15.5:0/3583567971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f557001a020 con 0x7f55780b5550 2024-04-25T08:59:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.162+0000 7f55757fa640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f555c06b500 0x7f555c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.162+0000 7f55757fa640 1 -- 172.21.15.5:0/3583567971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f5570089780 con 0x7f55780b5550 2024-04-25T08:59:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.162+0000 7f557c810640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f555c06b500 0x7f555c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.163+0000 7f557c810640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f555c06b500 0x7f555c06d9c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f556c033000 tx=0x7f556c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.166+0000 7f55757fa640 1 -- 172.21.15.5:0/3583567971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5570021020 con 0x7f55780b5550 2024-04-25T08:59:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.384+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f55780b6840 con 0x7f55780b5550 2024-04-25T08:59:04.374 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T08:59:04.384+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:59:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.386+0000 7f55757fa640 1 -- 172.21.15.5:0/3583567971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7f55700585e0 con 0x7f55780b5550 2024-04-25T08:59:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:59:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f555c06b500 msgr2=0x7f555c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f555c06b500 0x7f555c06d9c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f556c033000 tx=0x7f556c008030 comp rx=0 tx=0).stop 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55780b5550 msgr2=0x7f55780cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55780b5550 0x7f55780cb7e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f557000e790 tx=0x7f557000ec50 comp rx=0 tx=0).stop 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 shutdown_connections 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f555c06b500 0x7f555c06d9c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55780b5550 0x7f55780cb7e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55780c7480 0x7f55780b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 --2- 172.21.15.5:0/3583567971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5568003b70 0x7f5578151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 >> 172.21.15.5:0/3583567971 conn(0x7f557806b000 msgr2=0x7f55780b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 shutdown_connections 2024-04-25T08:59:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.389+0000 7f557ea74640 1 -- 172.21.15.5:0/3583567971 wait complete. 2024-04-25T08:59:04.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:59:04.417 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T08:59:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.504+0000 7f60a664d640 1 Processor -- start 2024-04-25T08:59:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.504+0000 7f60a664d640 1 -- start start 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f60a664d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60a01614b0 0x7f60a00b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f60a664d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60a00d4230 0x7f60a00b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f60a664d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00d2740 con 0x7f60a00d1f60 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f60a664d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00d2a20 con 0x7f60a01614b0 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f60a664d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00d2d00 con 0x7f60a00d4230 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60a01614b0 0x7f60a00b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f60a00d1f60 0x7f60a00d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46678/0 (socket says 172.21.15.5:46678) 2024-04-25T08:59:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609f7fe640 1 -- 172.21.15.5:0/3725551836 learned_addr learned my addr 172.21.15.5:0/3725551836 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f60a4bea640 1 --2- 172.21.15.5:0/3725551836 >> v2:172.21.15.80:3300/0 conn(0x7f60a00d4230 0x7f60a00b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609ffff640 1 -- 172.21.15.5:0/3725551836 >> v2:172.21.15.80:3300/0 conn(0x7f60a00d4230 msgr2=0x7f60a00b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609ffff640 1 --2- 172.21.15.5:0/3725551836 >> v2:172.21.15.80:3300/0 conn(0x7f60a00d4230 0x7f60a00b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609ffff640 1 -- 172.21.15.5:0/3725551836 >> v1:172.21.15.5:6789/0 conn(0x7f60a00d1f60 legacy=0x7f60a00d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609effd640 1 -- 172.21.15.5:0/3725551836 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398733047 0 0) 0x7f60a00d2740 con 0x7f60a00d1f60 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.505+0000 7f609ffff640 1 -- 172.21.15.5:0/3725551836 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00d2fe0 con 0x7f60a01614b0 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.506+0000 7f609ffff640 1 --2- 172.21.15.5:0/3725551836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a01614b0 0x7f60a00b96e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f60a00cabf0 tx=0x7f609002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00f088c35bb71f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.506+0000 7f609effd640 1 -- 172.21.15.5:0/3725551836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090037070 con 0x7f60a01614b0 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.506+0000 7f609effd640 1 -- 172.21.15.5:0/3725551836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6090032440 con 0x7f60a01614b0 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.506+0000 7f609effd640 1 -- 172.21.15.5:0/3725551836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090032810 con 0x7f60a01614b0 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 -- 172.21.15.5:0/3725551836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a01614b0 msgr2=0x7f60a00b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 --2- 172.21.15.5:0/3725551836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a01614b0 0x7f60a00b96e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f60a00cabf0 tx=0x7f609002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 -- 172.21.15.5:0/3725551836 shutdown_connections 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 --2- 172.21.15.5:0/3725551836 >> v2:172.21.15.80:3300/0 conn(0x7f60a00d4230 0x7f60a00b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 --2- 172.21.15.5:0/3725551836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a01614b0 0x7f60a00b96e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 -- 172.21.15.5:0/3725551836 >> 172.21.15.5:0/3725551836 conn(0x7f60a006b000 msgr2=0x7f60a006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 -- 172.21.15.5:0/3725551836 shutdown_connections 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.507+0000 7f60a664d640 1 -- 172.21.15.5:0/3725551836 wait complete. 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.508+0000 7f60a664d640 1 Processor -- start 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.508+0000 7f60a664d640 1 -- start start 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a664d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60a00d1f60 0x7f60a014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a664d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a00d4230 0x7f60a00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a664d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a01614b0 0x7f60a00b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a664d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00d23a0 con 0x7f60a00d4230 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a664d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00d37e0 con 0x7f60a01614b0 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a664d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00d2520 con 0x7f60a00d1f60 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a00d4230 0x7f60a00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a00d4230 0x7f60a00b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44246/0 (socket says 172.21.15.5:44246) 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 -- 172.21.15.5:0/3348099445 learned_addr learned my addr 172.21.15.5:0/3348099445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a4bea640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a01614b0 0x7f60a00b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609ffff640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60a00d1f60 0x7f60a014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 -- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60a00d1f60 msgr2=0x7f60a014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60a00d1f60 0x7f60a014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 -- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a01614b0 msgr2=0x7f60a00b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a01614b0 0x7f60a00b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 -- 172.21.15.5:0/3348099445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00b3b10 con 0x7f60a00d4230 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f60a4bea640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a01614b0 0x7f60a00b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609ffff640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60a00d1f60 0x7f60a014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.509+0000 7f609f7fe640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a00d4230 0x7f60a00b47d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f609400c4d0 tx=0x7f609400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.510+0000 7f609cff9640 1 -- 172.21.15.5:0/3348099445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094017070 con 0x7f60a00d4230 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.510+0000 7f609cff9640 1 -- 172.21.15.5:0/3348099445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094005d00 con 0x7f60a00d4230 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.510+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a00c7760 con 0x7f60a00d4230 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.510+0000 7f609cff9640 1 -- 172.21.15.5:0/3348099445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940072b0 con 0x7f60a00d4230 2024-04-25T08:59:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.510+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a00b3df0 con 0x7f60a00d4230 2024-04-25T08:59:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.511+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a004ef20 con 0x7f60a00d4230 2024-04-25T08:59:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.511+0000 7f609cff9640 1 -- 172.21.15.5:0/3348099445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f609401a070 con 0x7f60a00d4230 2024-04-25T08:59:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.512+0000 7f609cff9640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f608c06b500 0x7f608c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.512+0000 7f609cff9640 1 -- 172.21.15.5:0/3348099445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f60940895c0 con 0x7f60a00d4230 2024-04-25T08:59:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.512+0000 7f609ffff640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f608c06b500 0x7f608c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.512+0000 7f609ffff640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f608c06b500 0x7f608c06d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6090034000 tx=0x7f609002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.516+0000 7f609cff9640 1 -- 172.21.15.5:0/3348099445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6094058470 con 0x7f60a00d4230 2024-04-25T08:59:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:04.733+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f60a00d1980 con 0x7f60a00d4230 2024-04-25T08:59:05.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.391+0000 7f609cff9640 1 -- 172.21.15.5:0/3348099445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6094057d70 con 0x7f60a00d4230 2024-04-25T08:59:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.393+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f608c06b500 msgr2=0x7f608c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.393+0000 7f60a664d640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f608c06b500 0x7f608c06d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6090034000 tx=0x7f609002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.393+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a00d4230 msgr2=0x7f60a00b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.393+0000 7f60a664d640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a00d4230 0x7f60a00b47d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f609400c4d0 tx=0x7f609400c990 comp rx=0 tx=0).stop 2024-04-25T08:59:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 shutdown_connections 2024-04-25T08:59:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f608c06b500 0x7f608c06d9c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a01614b0 0x7f60a00b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60a00d4230 0x7f60a00b47d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 --2- 172.21.15.5:0/3348099445 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60a00d1f60 0x7f60a014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 >> 172.21.15.5:0/3348099445 conn(0x7f60a006b000 msgr2=0x7f60a0067040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 shutdown_connections 2024-04-25T08:59:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.394+0000 7f60a664d640 1 -- 172.21.15.5:0/3348099445 wait complete. 2024-04-25T08:59:05.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:59:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.561+0000 7f7c74902640 1 Processor -- start 2024-04-25T08:59:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.561+0000 7f7c74902640 1 -- start start 2024-04-25T08:59:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c74902640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c700b3e70 0x7f7c7015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c74902640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c7006ca80 0x7f7c700b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c74902640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c70070fe0 con 0x7f7c70072080 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c74902640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700aefc0 con 0x7f7c700b3e70 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c74902640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700712c0 con 0x7f7c7006ca80 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c700b3e70 0x7f7c7015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c67fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7c70072080 0x7f7c7006c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46688/0 (socket says 172.21.15.5:46688) 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c67fff640 1 -- 172.21.15.5:0/244085332 learned_addr learned my addr 172.21.15.5:0/244085332 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6ed9d640 1 --2- 172.21.15.5:0/244085332 >> v2:172.21.15.80:3300/0 conn(0x7f7c7006ca80 0x7f7c700b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6e59c640 1 -- 172.21.15.5:0/244085332 >> v2:172.21.15.80:3300/0 conn(0x7f7c7006ca80 msgr2=0x7f7c700b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6e59c640 1 --2- 172.21.15.5:0/244085332 >> v2:172.21.15.80:3300/0 conn(0x7f7c7006ca80 0x7f7c700b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6e59c640 1 -- 172.21.15.5:0/244085332 >> v1:172.21.15.5:6789/0 conn(0x7f7c70072080 legacy=0x7f7c7006c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6e59c640 1 -- 172.21.15.5:0/244085332 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700715a0 con 0x7f7c700b3e70 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6dd9b640 1 -- 172.21.15.5:0/244085332 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471625712 0 0) 0x7f7c70070fe0 con 0x7f7c70072080 2024-04-25T08:59:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.562+0000 7f7c6ed9d640 1 --2- 172.21.15.5:0/244085332 >> v2:172.21.15.80:3300/0 conn(0x7f7c7006ca80 0x7f7c700b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.563+0000 7f7c6e59c640 1 --2- 172.21.15.5:0/244085332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c7015b1b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7c700d0490 tx=0x7f7c6002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e82378e743e773 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.563+0000 7f7c6dd9b640 1 -- 172.21.15.5:0/244085332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60037070 con 0x7f7c700b3e70 2024-04-25T08:59:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.563+0000 7f7c6dd9b640 1 -- 172.21.15.5:0/244085332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c60032440 con 0x7f7c700b3e70 2024-04-25T08:59:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.563+0000 7f7c6dd9b640 1 -- 172.21.15.5:0/244085332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60032810 con 0x7f7c700b3e70 2024-04-25T08:59:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 -- 172.21.15.5:0/244085332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 msgr2=0x7f7c7015b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 --2- 172.21.15.5:0/244085332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c7015b1b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7c700d0490 tx=0x7f7c6002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 -- 172.21.15.5:0/244085332 shutdown_connections 2024-04-25T08:59:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 --2- 172.21.15.5:0/244085332 >> v2:172.21.15.80:3300/0 conn(0x7f7c7006ca80 0x7f7c700b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 --2- 172.21.15.5:0/244085332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c7015b1b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 -- 172.21.15.5:0/244085332 >> 172.21.15.5:0/244085332 conn(0x7f7c700668f0 msgr2=0x7f7c70066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 -- 172.21.15.5:0/244085332 shutdown_connections 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.564+0000 7f7c74902640 1 -- 172.21.15.5:0/244085332 wait complete. 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.565+0000 7f7c74902640 1 Processor -- start 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.565+0000 7f7c74902640 1 -- start start 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c74902640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c7006ca80 0x7f7c70153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c74902640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c70072080 0x7f7c7015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c74902640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c701587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c74902640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700b4250 con 0x7f7c700b3e70 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c74902640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70071b60 con 0x7f7c70072080 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c74902640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700b43d0 con 0x7f7c7006ca80 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c701587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c701587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44262/0 (socket says 172.21.15.5:44262) 2024-04-25T08:59:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 -- 172.21.15.5:0/3521238389 learned_addr learned my addr 172.21.15.5:0/3521238389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6e59c640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c7006ca80 0x7f7c70153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 -- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c7006ca80 msgr2=0x7f7c70153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c7006ca80 0x7f7c70153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 -- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c70072080 msgr2=0x7f7c7015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c67fff640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c70072080 0x7f7c7015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c70072080 0x7f7c7015dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.566+0000 7f7c6ed9d640 1 -- 172.21.15.5:0/3521238389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700a95d0 con 0x7f7c700b3e70 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.567+0000 7f7c6ed9d640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c701587e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7c68007ef0 tx=0x7f7c6800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.567+0000 7f7c66ffd640 1 -- 172.21.15.5:0/3521238389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6801a070 con 0x7f7c700b3e70 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.567+0000 7f7c66ffd640 1 -- 172.21.15.5:0/3521238389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68003b90 con 0x7f7c700b3e70 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.567+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c700a98b0 con 0x7f7c700b3e70 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.567+0000 7f7c66ffd640 1 -- 172.21.15.5:0/3521238389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68004030 con 0x7f7c700b3e70 2024-04-25T08:59:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.567+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7015c470 con 0x7f7c700b3e70 2024-04-25T08:59:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.568+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7004ef20 con 0x7f7c700b3e70 2024-04-25T08:59:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.568+0000 7f7c66ffd640 1 -- 172.21.15.5:0/3521238389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c6801d070 con 0x7f7c700b3e70 2024-04-25T08:59:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.569+0000 7f7c66ffd640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c5006b4d0 0x7f7c5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.569+0000 7f7c66ffd640 1 -- 172.21.15.5:0/3521238389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7c6808a480 con 0x7f7c700b3e70 2024-04-25T08:59:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.569+0000 7f7c6e59c640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c5006b4d0 0x7f7c5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.570+0000 7f7c6e59c640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c5006b4d0 0x7f7c5006d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034000 tx=0x7f7c6002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.573+0000 7f7c66ffd640 1 -- 172.21.15.5:0/3521238389 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c68010070 con 0x7f7c700b3e70 2024-04-25T08:59:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:05.752+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c70070d20 con 0x7f7c700b3e70 2024-04-25T08:59:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.392+0000 7f7c66ffd640 1 -- 172.21.15.5:0/3521238389 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7c68058c40 con 0x7f7c700b3e70 2024-04-25T08:59:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c5006b4d0 msgr2=0x7f7c5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c5006b4d0 0x7f7c5006d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034000 tx=0x7f7c6002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 msgr2=0x7f7c701587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c701587e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7c68007ef0 tx=0x7f7c6800d4a0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 shutdown_connections 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c5006b4d0 0x7f7c5006d990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700b3e70 0x7f7c701587e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c70072080 0x7f7c7015dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 --2- 172.21.15.5:0/3521238389 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c7006ca80 0x7f7c70153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 >> 172.21.15.5:0/3521238389 conn(0x7f7c700668f0 msgr2=0x7f7c70159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 shutdown_connections 2024-04-25T08:59:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.395+0000 7f7c74902640 1 -- 172.21.15.5:0/3521238389 wait complete. 2024-04-25T08:59:06.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:59:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.520+0000 7ff2042bd640 1 Processor -- start 2024-04-25T08:59:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.520+0000 7ff2042bd640 1 -- start start 2024-04-25T08:59:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff2042bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc0b9470 0x7ff1fc0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff2042bd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc0cecf0 0x7ff1fc0d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff2042bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc162070 con 0x7ff1fc15dbd0 2024-04-25T08:59:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff2042bd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc0cf160 con 0x7ff1fc0cecf0 2024-04-25T08:59:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff2042bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc162350 con 0x7ff1fc0b9470 2024-04-25T08:59:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff201858640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc0b9470 0x7ff1fc0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff20285a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc0cecf0 0x7ff1fc0d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff202059640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff1fc15dbd0 0x7ff1fc1617b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:60550/0 (socket says 172.21.15.5:60550) 2024-04-25T08:59:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.521+0000 7ff202059640 1 -- 172.21.15.5:0/2250542919 learned_addr learned my addr 172.21.15.5:0/2250542919 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.522+0000 7ff201057640 1 -- 172.21.15.5:0/2250542919 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17124621 0 0) 0x7ff1fc162070 con 0x7ff1fc15dbd0 2024-04-25T08:59:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.522+0000 7ff201858640 1 -- 172.21.15.5:0/2250542919 >> v2:172.21.15.80:3300/0 conn(0x7ff1fc0cecf0 msgr2=0x7ff1fc0d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.522+0000 7ff201858640 1 --2- 172.21.15.5:0/2250542919 >> v2:172.21.15.80:3300/0 conn(0x7ff1fc0cecf0 0x7ff1fc0d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.522+0000 7ff201858640 1 -- 172.21.15.5:0/2250542919 >> v1:172.21.15.80:6789/0 conn(0x7ff1fc15dbd0 legacy=0x7ff1fc1617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.522+0000 7ff201858640 1 -- 172.21.15.5:0/2250542919 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0d1c50 con 0x7ff1fc0b9470 2024-04-25T08:59:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff201858640 1 --2- 172.21.15.5:0/2250542919 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc0b9470 0x7ff1fc0ce7b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00097a0 tx=0x7ff1f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a66f7c1728c513a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff201057640 1 -- 172.21.15.5:0/2250542919 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0037070 con 0x7ff1fc0b9470 2024-04-25T08:59:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff201057640 1 -- 172.21.15.5:0/2250542919 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f0032440 con 0x7ff1fc0b9470 2024-04-25T08:59:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff201057640 1 -- 172.21.15.5:0/2250542919 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0032810 con 0x7ff1fc0b9470 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 -- 172.21.15.5:0/2250542919 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc0b9470 msgr2=0x7ff1fc0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 --2- 172.21.15.5:0/2250542919 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc0b9470 0x7ff1fc0ce7b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00097a0 tx=0x7ff1f002a180 comp rx=0 tx=0).stop 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 -- 172.21.15.5:0/2250542919 shutdown_connections 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 --2- 172.21.15.5:0/2250542919 >> v2:172.21.15.80:3300/0 conn(0x7ff1fc0cecf0 0x7ff1fc0d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 --2- 172.21.15.5:0/2250542919 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc0b9470 0x7ff1fc0ce7b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 -- 172.21.15.5:0/2250542919 >> 172.21.15.5:0/2250542919 conn(0x7ff1fc066ad0 msgr2=0x7ff1fc066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 -- 172.21.15.5:0/2250542919 shutdown_connections 2024-04-25T08:59:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.523+0000 7ff2042bd640 1 -- 172.21.15.5:0/2250542919 wait complete. 2024-04-25T08:59:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.524+0000 7ff2042bd640 1 Processor -- start 2024-04-25T08:59:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff2042bd640 1 -- start start 2024-04-25T08:59:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff2042bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1fc0b9470 0x7ff1fc0cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff2042bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc0cecf0 0x7ff1fc157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff2042bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc15dbd0 0x7ff1fc0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff2042bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc15dfb0 con 0x7ff1fc0b9470 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff2042bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc162630 con 0x7ff1fc0cecf0 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff2042bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc15e130 con 0x7ff1fc15dbd0 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff202059640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1fc0b9470 0x7ff1fc0cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff202059640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1fc0b9470 0x7ff1fc0cdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44270/0 (socket says 172.21.15.5:44270) 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff202059640 1 -- 172.21.15.5:0/4109284964 learned_addr learned my addr 172.21.15.5:0/4109284964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.525+0000 7ff20285a640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc15dbd0 0x7ff1fc0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff201858640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc0cecf0 0x7ff1fc157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff202059640 1 -- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc15dbd0 msgr2=0x7ff1fc0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff202059640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc15dbd0 0x7ff1fc0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff202059640 1 -- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc0cecf0 msgr2=0x7ff1fc157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff202059640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc0cecf0 0x7ff1fc157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff202059640 1 -- 172.21.15.5:0/4109284964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0cb0b0 con 0x7ff1fc0b9470 2024-04-25T08:59:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff202059640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1fc0b9470 0x7ff1fc0cdc70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c430 tx=0x7ff1f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff1faffd640 1 -- 172.21.15.5:0/4109284964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f40074e0 con 0x7ff1fc0b9470 2024-04-25T08:59:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff1faffd640 1 -- 172.21.15.5:0/4109284964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f40047e0 con 0x7ff1fc0b9470 2024-04-25T08:59:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc0cb390 con 0x7ff1fc0b9470 2024-04-25T08:59:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff1faffd640 1 -- 172.21.15.5:0/4109284964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4004bd0 con 0x7ff1fc0b9470 2024-04-25T08:59:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.526+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc0cb950 con 0x7ff1fc0b9470 2024-04-25T08:59:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.527+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc04ef20 con 0x7ff1fc0b9470 2024-04-25T08:59:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.527+0000 7ff1faffd640 1 -- 172.21.15.5:0/4109284964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1f4011070 con 0x7ff1fc0b9470 2024-04-25T08:59:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.528+0000 7ff1faffd640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1e806b500 0x7ff1e806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.528+0000 7ff1faffd640 1 -- 172.21.15.5:0/4109284964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5357+0+0 (secure 0 0 0) 0x7ff1f4089be0 con 0x7ff1fc0b9470 2024-04-25T08:59:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.528+0000 7ff201858640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1e806b500 0x7ff1e806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.529+0000 7ff201858640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1e806b500 0x7ff1e806d9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0034000 tx=0x7ff1f002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.532+0000 7ff1faffd640 1 -- 172.21.15.5:0/4109284964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff1f4058bc0 con 0x7ff1fc0b9470 2024-04-25T08:59:06.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:06.725+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1fc1612e0 con 0x7ff1fc0b9470 2024-04-25T08:59:07.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.397+0000 7ff1faffd640 1 -- 172.21.15.5:0/4109284964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff1f40584c0 con 0x7ff1fc0b9470 2024-04-25T08:59:07.387 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1e806b500 msgr2=0x7ff1e806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1e806b500 0x7ff1e806d9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0034000 tx=0x7ff1f002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1fc0b9470 msgr2=0x7ff1fc0cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1fc0b9470 0x7ff1fc0cdc70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c430 tx=0x7ff1f400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 shutdown_connections 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1e806b500 0x7ff1e806d9c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1fc15dbd0 0x7ff1fc0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc0cecf0 0x7ff1fc157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 --2- 172.21.15.5:0/4109284964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1fc0b9470 0x7ff1fc0cdc70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 >> 172.21.15.5:0/4109284964 conn(0x7ff1fc066ad0 msgr2=0x7ff1fc0c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 shutdown_connections 2024-04-25T08:59:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.401+0000 7ff2042bd640 1 -- 172.21.15.5:0/4109284964 wait complete. 2024-04-25T08:59:07.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:59:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.534+0000 7f38a9514640 1 Processor -- start 2024-04-25T08:59:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.534+0000 7f38a9514640 1 -- start start 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a9514640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38a415dc00 0x7f38a40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a9514640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38a4066d50 0x7f38a406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a9514640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a40b3a00 con 0x7f38a40668f0 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a9514640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a4072410 con 0x7f38a415dc00 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a9514640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a40af260 con 0x7f38a4066d50 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38a415dc00 0x7f38a40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a27fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38a40668f0 0x7f38a406abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46704/0 (socket says 172.21.15.5:46704) 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.535+0000 7f38a27fc640 1 -- 172.21.15.5:0/3496685466 learned_addr learned my addr 172.21.15.5:0/3496685466 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.536+0000 7f38a37fe640 1 --2- 172.21.15.5:0/3496685466 >> v2:172.21.15.80:3300/0 conn(0x7f38a4066d50 0x7f38a406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.536+0000 7f38a2ffd640 1 -- 172.21.15.5:0/3496685466 >> v2:172.21.15.80:3300/0 conn(0x7f38a4066d50 msgr2=0x7f38a406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.536+0000 7f38a2ffd640 1 --2- 172.21.15.5:0/3496685466 >> v2:172.21.15.80:3300/0 conn(0x7f38a4066d50 0x7f38a406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.536+0000 7f38a2ffd640 1 -- 172.21.15.5:0/3496685466 >> v1:172.21.15.5:6789/0 conn(0x7f38a40668f0 legacy=0x7f38a406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.536+0000 7f38a1ffb640 1 -- 172.21.15.5:0/3496685466 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189651044 0 0) 0x7f38a40b3a00 con 0x7f38a40668f0 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.536+0000 7f38a2ffd640 1 -- 172.21.15.5:0/3496685466 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40b3ce0 con 0x7f38a415dc00 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.536+0000 7f38a2ffd640 1 --2- 172.21.15.5:0/3496685466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a415dc00 0x7f38a40b5450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f38a4067960 tx=0x7f388c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df89927183b820bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a1ffb640 1 -- 172.21.15.5:0/3496685466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c037070 con 0x7f38a415dc00 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a1ffb640 1 -- 172.21.15.5:0/3496685466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c032440 con 0x7f38a415dc00 2024-04-25T08:59:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a1ffb640 1 -- 172.21.15.5:0/3496685466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c032810 con 0x7f38a415dc00 2024-04-25T08:59:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 -- 172.21.15.5:0/3496685466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a415dc00 msgr2=0x7f38a40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 --2- 172.21.15.5:0/3496685466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a415dc00 0x7f38a40b5450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f38a4067960 tx=0x7f388c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 -- 172.21.15.5:0/3496685466 shutdown_connections 2024-04-25T08:59:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 --2- 172.21.15.5:0/3496685466 >> v2:172.21.15.80:3300/0 conn(0x7f38a4066d50 0x7f38a406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 --2- 172.21.15.5:0/3496685466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a415dc00 0x7f38a40b5450 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 -- 172.21.15.5:0/3496685466 >> 172.21.15.5:0/3496685466 conn(0x7f38a40b2560 msgr2=0x7f38a40b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 -- 172.21.15.5:0/3496685466 shutdown_connections 2024-04-25T08:59:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.537+0000 7f38a9514640 1 -- 172.21.15.5:0/3496685466 wait complete. 2024-04-25T08:59:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 Processor -- start 2024-04-25T08:59:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 -- start start 2024-04-25T08:59:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38a40668f0 0x7f38a4142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a4066d50 0x7f38a40cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a415dc00 0x7f38a40cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a406d450 con 0x7f38a4066d50 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a4067180 con 0x7f38a415dc00 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a9514640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a415dfe0 con 0x7f38a40668f0 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a4066d50 0x7f38a40cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a4066d50 0x7f38a40cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44282/0 (socket says 172.21.15.5:44282) 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.539+0000 7f38a27fc640 1 -- 172.21.15.5:0/3999436288 learned_addr learned my addr 172.21.15.5:0/3999436288 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a37fe640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a415dc00 0x7f38a40cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a2ffd640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38a40668f0 0x7f38a4142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a27fc640 1 -- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38a40668f0 msgr2=0x7f38a4142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a27fc640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38a40668f0 0x7f38a4142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a27fc640 1 -- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a415dc00 msgr2=0x7f38a40cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a27fc640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a415dc00 0x7f38a40cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a27fc640 1 -- 172.21.15.5:0/3999436288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40cfba0 con 0x7f38a4066d50 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a27fc640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a4066d50 0x7f38a40cea90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f389400c430 tx=0x7f389400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f389b7fe640 1 -- 172.21.15.5:0/3999436288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940074e0 con 0x7f38a4066d50 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f389b7fe640 1 -- 172.21.15.5:0/3999436288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38940047e0 con 0x7f38a4066d50 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a40cf5e0 con 0x7f38a4066d50 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f389b7fe640 1 -- 172.21.15.5:0/3999436288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894004bd0 con 0x7f38a4066d50 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.540+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a415aea0 con 0x7f38a4066d50 2024-04-25T08:59:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.541+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a40b3a00 con 0x7f38a4066d50 2024-04-25T08:59:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.542+0000 7f389b7fe640 1 -- 172.21.15.5:0/3999436288 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3894011070 con 0x7f38a4066d50 2024-04-25T08:59:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.542+0000 7f389b7fe640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f388406b500 0x7f388406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.542+0000 7f389b7fe640 1 -- 172.21.15.5:0/3999436288 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3894089950 con 0x7f38a4066d50 2024-04-25T08:59:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.542+0000 7f38a2ffd640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f388406b500 0x7f388406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.543+0000 7f38a2ffd640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f388406b500 0x7f388406d9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f388c034000 tx=0x7f388c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.546+0000 7f389b7fe640 1 -- 172.21.15.5:0/3999436288 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38a40b3a00 con 0x7f38a4066d50 2024-04-25T08:59:07.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.725+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f38a40b5410 con 0x7f38a4066d50 2024-04-25T08:59:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.728+0000 7f389b7fe640 1 -- 172.21.15.5:0/3999436288 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f38a40b5410 con 0x7f38a4066d50 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f388406b500 msgr2=0x7f388406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f388406b500 0x7f388406d9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f388c034000 tx=0x7f388c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a4066d50 msgr2=0x7f38a40cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a4066d50 0x7f38a40cea90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f389400c430 tx=0x7f389400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 shutdown_connections 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f388406b500 0x7f388406d9c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a415dc00 0x7f38a40cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a4066d50 0x7f38a40cea90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 --2- 172.21.15.5:0/3999436288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38a40668f0 0x7f38a4142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 >> 172.21.15.5:0/3999436288 conn(0x7f38a40b2560 msgr2=0x7f38a40b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 shutdown_connections 2024-04-25T08:59:07.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.730+0000 7f38a9514640 1 -- 172.21.15.5:0/3999436288 wait complete. 2024-04-25T08:59:07.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-04-25T08:59:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.843+0000 7f4887693640 1 Processor -- start 2024-04-25T08:59:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.843+0000 7f4887693640 1 -- start start 2024-04-25T08:59:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4887693640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4880154f10 0x7f48800b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4887693640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48800cfc90 0x7f4880070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4887693640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48800b3f30 con 0x7f488015bbd0 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4887693640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488015b0f0 con 0x7f48800cfc90 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4887693640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488015b3d0 con 0x7f4880154f10 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4885c30640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48800cfc90 0x7f4880070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4884c2e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f488015bbd0 0x7f48800cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46710/0 (socket says 172.21.15.5:46710) 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4884c2e640 1 -- 172.21.15.5:0/526120223 learned_addr learned my addr 172.21.15.5:0/526120223 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f488542f640 1 --2- 172.21.15.5:0/526120223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4880154f10 0x7f48800b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4885c30640 1 -- 172.21.15.5:0/526120223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4880154f10 msgr2=0x7f48800b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4885c30640 1 --2- 172.21.15.5:0/526120223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4880154f10 0x7f48800b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4885c30640 1 -- 172.21.15.5:0/526120223 >> v1:172.21.15.5:6789/0 conn(0x7f488015bbd0 legacy=0x7f48800cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4877fff640 1 -- 172.21.15.5:0/526120223 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993527324 0 0) 0x7f48800b3f30 con 0x7f488015bbd0 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.844+0000 7f4885c30640 1 -- 172.21.15.5:0/526120223 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48801552f0 con 0x7f48800cfc90 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.845+0000 7f4885c30640 1 --2- 172.21.15.5:0/526120223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48800cfc90 0x7f4880070f50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4878009d90 tx=0x7f487802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aa2fcbb9a84161 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.845+0000 7f4877fff640 1 -- 172.21.15.5:0/526120223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878031600 con 0x7f48800cfc90 2024-04-25T08:59:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.845+0000 7f4877fff640 1 -- 172.21.15.5:0/526120223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48780317a0 con 0x7f48800cfc90 2024-04-25T08:59:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.845+0000 7f4877fff640 1 -- 172.21.15.5:0/526120223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878031b70 con 0x7f48800cfc90 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.845+0000 7f4887693640 1 -- 172.21.15.5:0/526120223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48800cfc90 msgr2=0x7f4880070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.845+0000 7f4887693640 1 --2- 172.21.15.5:0/526120223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48800cfc90 0x7f4880070f50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4878009d90 tx=0x7f487802a5d0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.846+0000 7f4887693640 1 -- 172.21.15.5:0/526120223 shutdown_connections 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.846+0000 7f4887693640 1 --2- 172.21.15.5:0/526120223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48800cfc90 0x7f4880070f50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.846+0000 7f4887693640 1 --2- 172.21.15.5:0/526120223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4880154f10 0x7f48800b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.846+0000 7f4887693640 1 -- 172.21.15.5:0/526120223 >> 172.21.15.5:0/526120223 conn(0x7f48800668f0 msgr2=0x7f4880066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.846+0000 7f4887693640 1 -- 172.21.15.5:0/526120223 shutdown_connections 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.846+0000 7f4887693640 1 -- 172.21.15.5:0/526120223 wait complete. 2024-04-25T08:59:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 Processor -- start 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 -- start start 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48800cfc90 0x7f488014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4880154f10 0x7f488006c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f488015bbd0 0x7f488006c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48800b3b30 con 0x7f4880154f10 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48800b39b0 con 0x7f48800cfc90 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.847+0000 7f4887693640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48800b3cb0 con 0x7f488015bbd0 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4880154f10 0x7f488006c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4880154f10 0x7f488006c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44302/0 (socket says 172.21.15.5:44302) 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 -- 172.21.15.5:0/170952154 learned_addr learned my addr 172.21.15.5:0/170952154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f488542f640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48800cfc90 0x7f488014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4885c30640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f488015bbd0 0x7f488006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 -- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f488015bbd0 msgr2=0x7f488006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f488015bbd0 0x7f488006c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 -- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48800cfc90 msgr2=0x7f488014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48800cfc90 0x7f488014fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 -- 172.21.15.5:0/170952154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800c4940 con 0x7f4880154f10 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f488542f640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48800cfc90 0x7f488014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4884c2e640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4880154f10 0x7f488006c420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f487000c430 tx=0x7f487000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4875ffb640 1 -- 172.21.15.5:0/170952154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700074e0 con 0x7f4880154f10 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4875ffb640 1 -- 172.21.15.5:0/170952154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48700047e0 con 0x7f4880154f10 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48800c4c20 con 0x7f4880154f10 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4875ffb640 1 -- 172.21.15.5:0/170952154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870004bd0 con 0x7f4880154f10 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.848+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48800c51e0 con 0x7f4880154f10 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.849+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488004ef20 con 0x7f4880154f10 2024-04-25T08:59:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.850+0000 7f4875ffb640 1 -- 172.21.15.5:0/170952154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4870011070 con 0x7f4880154f10 2024-04-25T08:59:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.850+0000 7f4875ffb640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486406b4d0 0x7f486406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.850+0000 7f4875ffb640 1 -- 172.21.15.5:0/170952154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4870089bc0 con 0x7f4880154f10 2024-04-25T08:59:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.850+0000 7f488542f640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486406b4d0 0x7f486406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.851+0000 7f488542f640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486406b4d0 0x7f486406d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f487c00a9d0 tx=0x7f487c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:07.854+0000 7f4875ffb640 1 -- 172.21.15.5:0/170952154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4870058d40 con 0x7f4880154f10 2024-04-25T08:59:08.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.103+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f4880070870 con 0x7f4880154f10 2024-04-25T08:59:08.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.399+0000 7f4875ffb640 1 -- 172.21.15.5:0/170952154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v129) v1 ==== 148+0+0 (secure 0 0 0) 0x7f4870058640 con 0x7f4880154f10 2024-04-25T08:59:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486406b4d0 msgr2=0x7f486406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486406b4d0 0x7f486406d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f487c00a9d0 tx=0x7f487c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4880154f10 msgr2=0x7f488006c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4880154f10 0x7f488006c420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f487000c430 tx=0x7f487000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 shutdown_connections 2024-04-25T08:59:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486406b4d0 0x7f486406d990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f488015bbd0 0x7f488006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4880154f10 0x7f488006c420 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 --2- 172.21.15.5:0/170952154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48800cfc90 0x7f488014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 >> 172.21.15.5:0/170952154 conn(0x7f48800668f0 msgr2=0x7f48800cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 shutdown_connections 2024-04-25T08:59:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.401+0000 7f4887693640 1 -- 172.21.15.5:0/170952154 wait complete. 2024-04-25T08:59:08.403 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-04-25T08:59:08.403 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T08:59:08.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.517+0000 7fe53cfc8640 1 Processor -- start 2024-04-25T08:59:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.517+0000 7fe53cfc8640 1 -- start start 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53cfc8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe53806b7d0 0x7fe53806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53cfc8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe53806bbb0 0x7fe5380d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53cfc8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53815da10 0x7fe53815dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53cfc8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5380d0b70 con 0x7fe53806b7d0 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53cfc8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5380cbf30 con 0x7fe53806bbb0 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53cfc8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380cc7d0 con 0x7fe53815da10 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe53806b7d0 0x7fe53806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe53806b7d0 0x7fe53806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44310/0 (socket says 172.21.15.5:44310) 2024-04-25T08:59:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 -- 172.21.15.5:0/1562932605 learned_addr learned my addr 172.21.15.5:0/1562932605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:08.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 -- 172.21.15.5:0/1562932605 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53815da10 msgr2=0x7fe53815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:08.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 --2- 172.21.15.5:0/1562932605 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53815da10 0x7fe53815dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 -- 172.21.15.5:0/1562932605 >> v2:172.21.15.80:3300/0 conn(0x7fe53806bbb0 msgr2=0x7fe5380d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:08.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 --2- 172.21.15.5:0/1562932605 >> v2:172.21.15.80:3300/0 conn(0x7fe53806bbb0 0x7fe5380d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.518+0000 7fe53659c640 1 -- 172.21.15.5:0/1562932605 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380b4730 con 0x7fe53806b7d0 2024-04-25T08:59:08.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.519+0000 7fe53659c640 1 --2- 172.21.15.5:0/1562932605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe53806aef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe538072970 tx=0x7fe52802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8137360d1aa096d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:08.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.519+0000 7fe53559a640 1 -- 172.21.15.5:0/1562932605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528037070 con 0x7fe53806b7d0 2024-04-25T08:59:08.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.519+0000 7fe53559a640 1 -- 172.21.15.5:0/1562932605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528032440 con 0x7fe53806b7d0 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.519+0000 7fe53559a640 1 -- 172.21.15.5:0/1562932605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528032810 con 0x7fe53806b7d0 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 -- 172.21.15.5:0/1562932605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 msgr2=0x7fe53806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/1562932605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe53806aef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe538072970 tx=0x7fe52802a270 comp rx=0 tx=0).stop 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 -- 172.21.15.5:0/1562932605 shutdown_connections 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/1562932605 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53815da10 0x7fe53815dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/1562932605 >> v2:172.21.15.80:3300/0 conn(0x7fe53806bbb0 0x7fe5380d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/1562932605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe53806aef0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 -- 172.21.15.5:0/1562932605 >> 172.21.15.5:0/1562932605 conn(0x7fe5380d18e0 msgr2=0x7fe5380d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 -- 172.21.15.5:0/1562932605 shutdown_connections 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.520+0000 7fe53cfc8640 1 -- 172.21.15.5:0/1562932605 wait complete. 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.521+0000 7fe53cfc8640 1 Processor -- start 2024-04-25T08:59:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.521+0000 7fe53cfc8640 1 -- start start 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53cfc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe5380c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53cfc8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53806bbb0 0x7fe53806f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53cfc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe53815da10 0x7fe5380ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53cfc8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380cc180 con 0x7fe53806b7d0 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53cfc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53815e3e0 con 0x7fe53815da10 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53cfc8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380cc460 con 0x7fe53806bbb0 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe5380c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe5380c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44318/0 (socket says 172.21.15.5:44318) 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 -- 172.21.15.5:0/555101035 learned_addr learned my addr 172.21.15.5:0/555101035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 -- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53806bbb0 msgr2=0x7fe53806f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53806bbb0 0x7fe53806f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 -- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe53815da10 msgr2=0x7fe5380ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe53815da10 0x7fe5380ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 -- 172.21.15.5:0/555101035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53815f530 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.522+0000 7fe53659c640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe5380c9e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe52802a2b0 tx=0x7fe5280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.523+0000 7fe526ffd640 1 -- 172.21.15.5:0/555101035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528041070 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.523+0000 7fe526ffd640 1 -- 172.21.15.5:0/555101035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52803c890 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.523+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53815f810 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.523+0000 7fe526ffd640 1 -- 172.21.15.5:0/555101035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528037040 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.523+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53815fdd0 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.524+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53804ef20 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.524+0000 7fe526ffd640 1 -- 172.21.15.5:0/555101035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe528044070 con 0x7fe53806b7d0 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.524+0000 7fe526ffd640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe51806b4d0 0x7fe51806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.525+0000 7fe526ffd640 1 -- 172.21.15.5:0/555101035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5280aacc0 con 0x7fe53806b7d0 2024-04-25T08:59:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.525+0000 7fe535d9b640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe51806b4d0 0x7fe51806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.525+0000 7fe535d9b640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe51806b4d0 0x7fe51806d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5381f7090 tx=0x7fe52c006c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.529+0000 7fe526ffd640 1 -- 172.21.15.5:0/555101035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5380b4730 con 0x7fe53806b7d0 2024-04-25T08:59:08.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.710+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe53815d260 con 0x7fe53806b7d0 2024-04-25T08:59:08.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.711+0000 7fe526ffd640 1 -- 172.21.15.5:0/555101035 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+12934 (secure 0 0 0) 0x7fe528079ff0 con 0x7fe53806b7d0 2024-04-25T08:59:08.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:08.701 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:07.393828+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6834/3359008015":"2024-04-26T08:59:04.385766+0000","172.21.15.5:6833/3359008015":"2024-04-26T08:59:04.385766+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe51806b4d0 msgr2=0x7fe51806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe51806b4d0 0x7fe51806d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5381f7090 tx=0x7fe52c006c90 comp rx=0 tx=0).stop 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 msgr2=0x7fe5380c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe5380c9e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe52802a2b0 tx=0x7fe5280046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 shutdown_connections 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe51806b4d0 0x7fe51806d990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe53815da10 0x7fe5380ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe53806bbb0 0x7fe53806f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 --2- 172.21.15.5:0/555101035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe53806b7d0 0x7fe5380c9e20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 >> 172.21.15.5:0/555101035 conn(0x7fe5380d18e0 msgr2=0x7fe5380d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 shutdown_connections 2024-04-25T08:59:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.713+0000 7fe53cfc8640 1 -- 172.21.15.5:0/555101035 wait complete. 2024-04-25T08:59:08.713 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:08.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.828+0000 7fcbcea3f640 1 Processor -- start 2024-04-25T08:59:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.828+0000 7fcbcea3f640 1 -- start start 2024-04-25T08:59:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbcea3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbc815df10 0x7fcbc81618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbcea3f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc80b6250 0x7fcbc80ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbcea3f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc8162150 con 0x7fcbc80cee10 2024-04-25T08:59:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbcea3f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc80d20d0 con 0x7fcbc815df10 2024-04-25T08:59:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbcea3f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8162430 con 0x7fcbc80b6250 2024-04-25T08:59:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbc815df10 0x7fcbc81618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbc815df10 0x7fcbc81618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44320/0 (socket says 172.21.15.5:44320) 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc7fff640 1 -- 172.21.15.5:0/2597661795 learned_addr learned my addr 172.21.15.5:0/2597661795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc77fe640 1 --2- 172.21.15.5:0/2597661795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc80b6250 0x7fcbc80ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc7fff640 1 -- 172.21.15.5:0/2597661795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc80b6250 msgr2=0x7fcbc80ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc7fff640 1 --2- 172.21.15.5:0/2597661795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc80b6250 0x7fcbc80ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc7fff640 1 -- 172.21.15.5:0/2597661795 >> v1:172.21.15.80:6789/0 conn(0x7fcbc80cee10 legacy=0x7fcbc80d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc7fff640 1 -- 172.21.15.5:0/2597661795 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8162710 con 0x7fcbc815df10 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.829+0000 7fcbc77fe640 1 --2- 172.21.15.5:0/2597661795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc80b6250 0x7fcbc80ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.830+0000 7fcbc7fff640 1 --2- 172.21.15.5:0/2597661795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc815df10 0x7fcbc81618d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009870 tx=0x7fcbb002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55da92efaa63bbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:08.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.830+0000 7fcbc6ffd640 1 -- 172.21.15.5:0/2597661795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0037070 con 0x7fcbc815df10 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.830+0000 7fcbc6ffd640 1 -- 172.21.15.5:0/2597661795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0032440 con 0x7fcbc815df10 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.830+0000 7fcbc6ffd640 1 -- 172.21.15.5:0/2597661795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0032810 con 0x7fcbc815df10 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2597661795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc815df10 msgr2=0x7fcbc81618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2597661795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc815df10 0x7fcbc81618d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009870 tx=0x7fcbb002a200 comp rx=0 tx=0).stop 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2597661795 shutdown_connections 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2597661795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc80b6250 0x7fcbc80ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2597661795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc815df10 0x7fcbc81618d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2597661795 >> 172.21.15.5:0/2597661795 conn(0x7fcbc80668f0 msgr2=0x7fcbc8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2597661795 shutdown_connections 2024-04-25T08:59:08.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.831+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2597661795 wait complete. 2024-04-25T08:59:08.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.832+0000 7fcbcea3f640 1 Processor -- start 2024-04-25T08:59:08.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.832+0000 7fcbcea3f640 1 -- start start 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbcea3f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc80b6250 0x7fcbc8151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbcea3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc80cee10 0x7fcbc8157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbcea3f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc815df10 0x7fcbc8159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbcea3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80d3570 con 0x7fcbc80cee10 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbcea3f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8161e10 con 0x7fcbc80b6250 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbcea3f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80d36f0 con 0x7fcbc815df10 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc80cee10 0x7fcbc8157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc80cee10 0x7fcbc8157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44326/0 (socket says 172.21.15.5:44326) 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 -- 172.21.15.5:0/2642743892 learned_addr learned my addr 172.21.15.5:0/2642743892 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:08.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc7fff640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc80b6250 0x7fcbc8151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbccfdc640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc815df10 0x7fcbc8159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 -- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc815df10 msgr2=0x7fcbc8159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc815df10 0x7fcbc8159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 -- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc80b6250 msgr2=0x7fcbc8151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc80b6250 0x7fcbc8151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 -- 172.21.15.5:0/2642743892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc815a860 con 0x7fcbc80cee10 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbccfdc640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc815df10 0x7fcbc8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc7fff640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc80b6250 0x7fcbc8151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc77fe640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc80cee10 0x7fcbc8157e60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c7f0 tx=0x7fcbb800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc4ff9640 1 -- 172.21.15.5:0/2642743892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8015070 con 0x7fcbc80cee10 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbc4ff9640 1 -- 172.21.15.5:0/2642743892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb8007a30 con 0x7fcbc80cee10 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.833+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc815ab70 con 0x7fcbc80cee10 2024-04-25T08:59:08.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.834+0000 7fcbc4ff9640 1 -- 172.21.15.5:0/2642743892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8007e00 con 0x7fcbc80cee10 2024-04-25T08:59:08.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.834+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc8151910 con 0x7fcbc80cee10 2024-04-25T08:59:08.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.835+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc8151b10 con 0x7fcbc80cee10 2024-04-25T08:59:08.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.835+0000 7fcbc4ff9640 1 -- 172.21.15.5:0/2642743892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcbb8018070 con 0x7fcbc80cee10 2024-04-25T08:59:08.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.835+0000 7fcbc4ff9640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcba806b4d0 0x7fcba806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:08.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.835+0000 7fcbc4ff9640 1 -- 172.21.15.5:0/2642743892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcbb8089e70 con 0x7fcbc80cee10 2024-04-25T08:59:08.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.836+0000 7fcbc7fff640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcba806b4d0 0x7fcba806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:08.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.836+0000 7fcbc7fff640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcba806b4d0 0x7fcba806d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0034000 tx=0x7fcbb002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:08.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:08.840+0000 7fcbc4ff9640 1 -- 172.21.15.5:0/2642743892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcbc8151b10 con 0x7fcbc80cee10 2024-04-25T08:59:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.019+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbc8151700 con 0x7fcbc80cee10 2024-04-25T08:59:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.020+0000 7fcbc4ff9640 1 -- 172.21.15.5:0/2642743892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbc815ab70 con 0x7fcbc80cee10 2024-04-25T08:59:09.009 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:59:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.021+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcba806b4d0 msgr2=0x7fcba806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.021+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcba806b4d0 0x7fcba806d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0034000 tx=0x7fcbb002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.021+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc80cee10 msgr2=0x7fcbc8157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.021+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc80cee10 0x7fcbc8157e60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c7f0 tx=0x7fcbb800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 shutdown_connections 2024-04-25T08:59:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcba806b4d0 0x7fcba806d990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbc815df10 0x7fcbc8159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbc80cee10 0x7fcbc8157e60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 --2- 172.21.15.5:0/2642743892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc80b6250 0x7fcbc8151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 >> 172.21.15.5:0/2642743892 conn(0x7fcbc80668f0 msgr2=0x7fcbc80c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 shutdown_connections 2024-04-25T08:59:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.022+0000 7fcbcea3f640 1 -- 172.21.15.5:0/2642743892 wait complete. 2024-04-25T08:59:09.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-04-25T08:59:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.133+0000 7f6ee7fcf640 1 Processor -- start 2024-04-25T08:59:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.133+0000 7f6ee7fcf640 1 -- start start 2024-04-25T08:59:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.134+0000 7f6ee7fcf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee00af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.134+0000 7f6ee7fcf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ee015edc0 0x7f6ee00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.134+0000 7f6ee7fcf640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee00ae070 con 0x7f6ee00668f0 2024-04-25T08:59:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.134+0000 7f6ee7fcf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee015e930 con 0x7f6ee015edc0 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.134+0000 7f6ee7fcf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00ae350 con 0x7f6ee015de80 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.134+0000 7f6ee556a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ee015edc0 0x7f6ee00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.134+0000 7f6ee556a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ee015edc0 0x7f6ee00ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44332/0 (socket says 172.21.15.5:44332) 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.135+0000 7f6ee556a640 1 -- 172.21.15.5:0/2996550989 learned_addr learned my addr 172.21.15.5:0/2996550989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.135+0000 7f6ee5d6b640 1 --2- 172.21.15.5:0/2996550989 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee00af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.135+0000 7f6ee556a640 1 -- 172.21.15.5:0/2996550989 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 msgr2=0x7f6ee00af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.135+0000 7f6ee556a640 1 --2- 172.21.15.5:0/2996550989 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee00af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.135+0000 7f6ee556a640 1 -- 172.21.15.5:0/2996550989 >> v1:172.21.15.80:6789/0 conn(0x7f6ee00668f0 legacy=0x7f6ee0071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.135+0000 7f6ee556a640 1 -- 172.21.15.5:0/2996550989 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee015e5c0 con 0x7f6ee015edc0 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee556a640 1 --2- 172.21.15.5:0/2996550989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee015edc0 0x7f6ee00ad840 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009e50 tx=0x7f6ed402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec8715037edb678 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee4d69640 1 -- 172.21.15.5:0/2996550989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4036070 con 0x7f6ee015edc0 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee4d69640 1 -- 172.21.15.5:0/2996550989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4031600 con 0x7f6ee015edc0 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee4d69640 1 -- 172.21.15.5:0/2996550989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40319d0 con 0x7f6ee015edc0 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/2996550989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee015edc0 msgr2=0x7f6ee00ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/2996550989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee015edc0 0x7f6ee00ad840 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009e50 tx=0x7f6ed402a6c0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/2996550989 shutdown_connections 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/2996550989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee015edc0 0x7f6ee00ad840 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/2996550989 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee00af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/2996550989 >> 172.21.15.5:0/2996550989 conn(0x7f6ee00b24f0 msgr2=0x7f6ee00b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/2996550989 shutdown_connections 2024-04-25T08:59:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.136+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/2996550989 wait complete. 2024-04-25T08:59:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.137+0000 7f6ee7fcf640 1 Processor -- start 2024-04-25T08:59:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee7fcf640 1 -- start start 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee7fcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00668f0 0x7f6ee0153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee7fcf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee01484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee7fcf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee015edc0 0x7f6ee0155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee7fcf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee015f200 con 0x7f6ee00668f0 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee7fcf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee015e260 con 0x7f6ee015edc0 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee7fcf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0066d80 con 0x7f6ee015de80 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee5d6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00668f0 0x7f6ee0153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee5d6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00668f0 0x7f6ee0153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44346/0 (socket says 172.21.15.5:44346) 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee5d6b640 1 -- 172.21.15.5:0/1014359384 learned_addr learned my addr 172.21.15.5:0/1014359384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee556a640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee01484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.138+0000 7f6ee656c640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee015edc0 0x7f6ee0155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee5d6b640 1 -- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 msgr2=0x7f6ee01484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee5d6b640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee01484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee5d6b640 1 -- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee015edc0 msgr2=0x7f6ee0155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee5d6b640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee015edc0 0x7f6ee0155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee5d6b640 1 -- 172.21.15.5:0/1014359384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee01547e0 con 0x7f6ee00668f0 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee556a640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee01484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee5d6b640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00668f0 0x7f6ee0153f90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800d800 tx=0x7f6ed800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ede7fc640 1 -- 172.21.15.5:0/1014359384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800b6c0 con 0x7f6ee00668f0 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ede7fc640 1 -- 172.21.15.5:0/1014359384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8019070 con 0x7f6ee00668f0 2024-04-25T08:59:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee0154ac0 con 0x7f6ee00668f0 2024-04-25T08:59:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ede7fc640 1 -- 172.21.15.5:0/1014359384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800ba80 con 0x7f6ee00668f0 2024-04-25T08:59:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.139+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee00ce850 con 0x7f6ee00668f0 2024-04-25T08:59:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.140+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee00ce360 con 0x7f6ee00668f0 2024-04-25T08:59:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.141+0000 7f6ede7fc640 1 -- 172.21.15.5:0/1014359384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ed800bc20 con 0x7f6ee00668f0 2024-04-25T08:59:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.141+0000 7f6ede7fc640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6ecc06b4d0 0x7f6ecc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.141+0000 7f6ede7fc640 1 -- 172.21.15.5:0/1014359384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ed808a3b0 con 0x7f6ee00668f0 2024-04-25T08:59:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.141+0000 7f6ee556a640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6ecc06b4d0 0x7f6ecc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.142+0000 7f6ee556a640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6ecc06b4d0 0x7f6ecc06d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4033000 tx=0x7f6ed4009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.145+0000 7f6ede7fc640 1 -- 172.21.15.5:0/1014359384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ed8059530 con 0x7f6ee00668f0 2024-04-25T08:59:09.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:09.400+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7f6ee004ef20 con 0x7f6ee00668f0 2024-04-25T08:59:10.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.404+0000 7f6ede7fc640 1 -- 172.21.15.5:0/1014359384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v131) v1 ==== 146+0+0 (secure 0 0 0) 0x7f6ed8058e30 con 0x7f6ee00668f0 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6ecc06b4d0 msgr2=0x7f6ecc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6ecc06b4d0 0x7f6ecc06d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4033000 tx=0x7f6ed4009000 comp rx=0 tx=0).stop 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00668f0 msgr2=0x7f6ee0153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00668f0 0x7f6ee0153f90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800d800 tx=0x7f6ed800dcc0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 shutdown_connections 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6ecc06b4d0 0x7f6ecc06d990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee015edc0 0x7f6ee0155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ee015de80 0x7f6ee01484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 --2- 172.21.15.5:0/1014359384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00668f0 0x7f6ee0153f90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 >> 172.21.15.5:0/1014359384 conn(0x7f6ee00b24f0 msgr2=0x7f6ee006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:10.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 shutdown_connections 2024-04-25T08:59:10.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.408+0000 7f6ee7fcf640 1 -- 172.21.15.5:0/1014359384 wait complete. 2024-04-25T08:59:10.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:59:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.532+0000 7ff707846640 1 Processor -- start 2024-04-25T08:59:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.532+0000 7ff707846640 1 -- start start 2024-04-25T08:59:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff707846640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7000b2340 0x7ff7000b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff707846640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7000b18c0 0x7ff7000b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff707846640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70006ae90 con 0x7ff7000b2c60 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff707846640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7000d03c0 con 0x7ff7000b18c0 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff707846640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7000cfdb0 con 0x7ff7000b2340 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff704de1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7000b18c0 0x7ff7000b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff704de1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7000b18c0 0x7ff7000b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44354/0 (socket says 172.21.15.5:44354) 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff704de1640 1 -- 172.21.15.5:0/2349921104 learned_addr learned my addr 172.21.15.5:0/2349921104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff7055e2640 1 --2- 172.21.15.5:0/2349921104 >> v2:172.21.15.80:3300/0 conn(0x7ff7000b2340 0x7ff7000b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff704de1640 1 -- 172.21.15.5:0/2349921104 >> v2:172.21.15.80:3300/0 conn(0x7ff7000b2340 msgr2=0x7ff7000b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff704de1640 1 --2- 172.21.15.5:0/2349921104 >> v2:172.21.15.80:3300/0 conn(0x7ff7000b2340 0x7ff7000b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff704de1640 1 -- 172.21.15.5:0/2349921104 >> v1:172.21.15.80:6789/0 conn(0x7ff7000b2c60 legacy=0x7ff7000d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.533+0000 7ff704de1640 1 -- 172.21.15.5:0/2349921104 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70006b130 con 0x7ff7000b18c0 2024-04-25T08:59:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.534+0000 7ff704de1640 1 --2- 172.21.15.5:0/2349921104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b18c0 0x7ff7000b2720 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff7000d0540 tx=0x7ff6f002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deab0403e080aa0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.534+0000 7ff6f7fff640 1 -- 172.21.15.5:0/2349921104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0037070 con 0x7ff7000b18c0 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.534+0000 7ff6f7fff640 1 -- 172.21.15.5:0/2349921104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0032440 con 0x7ff7000b18c0 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.534+0000 7ff6f7fff640 1 -- 172.21.15.5:0/2349921104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0032810 con 0x7ff7000b18c0 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 -- 172.21.15.5:0/2349921104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b18c0 msgr2=0x7ff7000b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 --2- 172.21.15.5:0/2349921104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b18c0 0x7ff7000b2720 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff7000d0540 tx=0x7ff6f002a210 comp rx=0 tx=0).stop 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 -- 172.21.15.5:0/2349921104 shutdown_connections 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 --2- 172.21.15.5:0/2349921104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b18c0 0x7ff7000b2720 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 --2- 172.21.15.5:0/2349921104 >> v2:172.21.15.80:3300/0 conn(0x7ff7000b2340 0x7ff7000b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 -- 172.21.15.5:0/2349921104 >> 172.21.15.5:0/2349921104 conn(0x7ff7000d1a40 msgr2=0x7ff7000d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 -- 172.21.15.5:0/2349921104 shutdown_connections 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.535+0000 7ff707846640 1 -- 172.21.15.5:0/2349921104 wait complete. 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.536+0000 7ff707846640 1 Processor -- start 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.536+0000 7ff707846640 1 -- start start 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff707846640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7000b18c0 0x7ff7001f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff707846640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2340 0x7ff7000ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff707846640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b2c60 0x7ff7000ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff707846640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000d1830 con 0x7ff7000b2340 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff707846640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000d16b0 con 0x7ff7000b18c0 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff707846640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000d0f60 con 0x7ff7000b2c60 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2340 0x7ff7000ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2340 0x7ff7000ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44366/0 (socket says 172.21.15.5:44366) 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 -- 172.21.15.5:0/1356331197 learned_addr learned my addr 172.21.15.5:0/1356331197 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff7055e2640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7000b18c0 0x7ff7001f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff705de3640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b2c60 0x7ff7000ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 -- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b2c60 msgr2=0x7ff7000ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b2c60 0x7ff7000ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 -- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7000b18c0 msgr2=0x7ff7001f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7000b18c0 0x7ff7001f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff704de1640 1 -- 172.21.15.5:0/1356331197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7001f3d80 con 0x7ff7000b2340 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.537+0000 7ff705de3640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b2c60 0x7ff7000ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.538+0000 7ff704de1640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2340 0x7ff7000ce060 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0000c00 tx=0x7ff6f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.538+0000 7ff6f5ffb640 1 -- 172.21.15.5:0/1356331197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0041020 con 0x7ff7000b2340 2024-04-25T08:59:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.538+0000 7ff6f5ffb640 1 -- 172.21.15.5:0/1356331197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0030970 con 0x7ff7000b2340 2024-04-25T08:59:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.538+0000 7ff6f5ffb640 1 -- 172.21.15.5:0/1356331197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0037040 con 0x7ff7000b2340 2024-04-25T08:59:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.538+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7001f4060 con 0x7ff7000b2340 2024-04-25T08:59:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.538+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7001f4620 con 0x7ff7000b2340 2024-04-25T08:59:10.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.539+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70004ef20 con 0x7ff7000b2340 2024-04-25T08:59:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.540+0000 7ff6f5ffb640 1 -- 172.21.15.5:0/1356331197 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff6f0044020 con 0x7ff7000b2340 2024-04-25T08:59:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.540+0000 7ff6f5ffb640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b4d0 0x7ff6e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.540+0000 7ff6f5ffb640 1 -- 172.21.15.5:0/1356331197 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff6f00aa850 con 0x7ff7000b2340 2024-04-25T08:59:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.540+0000 7ff7055e2640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b4d0 0x7ff6e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.541+0000 7ff7055e2640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b4d0 0x7ff6e406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00aac0 tx=0x7ff6fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.544+0000 7ff6f5ffb640 1 -- 172.21.15.5:0/1356331197 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff6f004b030 con 0x7ff7000b2340 2024-04-25T08:59:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.725+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff7000b79c0 con 0x7ff7000b2340 2024-04-25T08:59:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.728+0000 7ff6f5ffb640 1 -- 172.21.15.5:0/1356331197 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff6f0079a60 con 0x7ff7000b2340 2024-04-25T08:59:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b4d0 msgr2=0x7ff6e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b4d0 0x7ff6e406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00aac0 tx=0x7ff6fc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2340 msgr2=0x7ff7000ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2340 0x7ff7000ce060 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0000c00 tx=0x7ff6f00046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 shutdown_connections 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b4d0 0x7ff6e406d990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b2c60 0x7ff7000ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7000b2340 0x7ff7000ce060 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 --2- 172.21.15.5:0/1356331197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7000b18c0 0x7ff7001f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 >> 172.21.15.5:0/1356331197 conn(0x7ff7000d1a40 msgr2=0x7ff7000d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 shutdown_connections 2024-04-25T08:59:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:10.730+0000 7ff707846640 1 -- 172.21.15.5:0/1356331197 wait complete. 2024-04-25T08:59:10.730 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:59:10.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:10.775 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:10.815 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:59:10.816 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:10.816 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:10.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:59:10.834 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:59:10.834 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:10.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:10.875 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:10.875 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:10.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:59:10.890 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:59:10.890 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:10.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:10.933 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:59:10.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:11.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.044+0000 7fb8777c8640 1 Processor -- start 2024-04-25T08:59:11.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.044+0000 7fb8777c8640 1 -- start start 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb8777c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb870154f10 0x7fb8700b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb8777c8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700b3f30 con 0x7fb87015bbd0 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb8777c8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87015b0f0 con 0x7fb8700cfc90 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb8777c8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87015b3d0 con 0x7fb870154f10 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb875564640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb870154f10 0x7fb8700b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb874d63640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb87015bbd0 0x7fb8700cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37808/0 (socket says 172.21.15.5:37808) 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb874d63640 1 -- 172.21.15.5:0/486661868 learned_addr learned my addr 172.21.15.5:0/486661868 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb875564640 1 -- 172.21.15.5:0/486661868 >> v1:172.21.15.80:6789/0 conn(0x7fb8700cfc90 legacy=0x7fb870070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb875564640 1 -- 172.21.15.5:0/486661868 >> v1:172.21.15.5:6789/0 conn(0x7fb87015bbd0 legacy=0x7fb8700cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb875564640 1 -- 172.21.15.5:0/486661868 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8701552f0 con 0x7fb870154f10 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.045+0000 7fb867fff640 1 -- 172.21.15.5:0/486661868 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901251822 0 0) 0x7fb8700b3f30 con 0x7fb87015bbd0 2024-04-25T08:59:11.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.046+0000 7fb875564640 1 --2- 172.21.15.5:0/486661868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb8700b3470 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009d90 tx=0x7fb86c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe61801fecc34051 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.046+0000 7fb867fff640 1 -- 172.21.15.5:0/486661868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c031600 con 0x7fb870154f10 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.046+0000 7fb867fff640 1 -- 172.21.15.5:0/486661868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c0317a0 con 0x7fb870154f10 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.046+0000 7fb867fff640 1 -- 172.21.15.5:0/486661868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c031b70 con 0x7fb870154f10 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.047+0000 7fb8777c8640 1 -- 172.21.15.5:0/486661868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 msgr2=0x7fb8700b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.047+0000 7fb8777c8640 1 --2- 172.21.15.5:0/486661868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb8700b3470 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009d90 tx=0x7fb86c02a610 comp rx=0 tx=0).stop 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.047+0000 7fb8777c8640 1 -- 172.21.15.5:0/486661868 shutdown_connections 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.047+0000 7fb8777c8640 1 --2- 172.21.15.5:0/486661868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb8700b3470 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.047+0000 7fb8777c8640 1 -- 172.21.15.5:0/486661868 >> 172.21.15.5:0/486661868 conn(0x7fb8700668f0 msgr2=0x7fb870066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.047+0000 7fb8777c8640 1 -- 172.21.15.5:0/486661868 shutdown_connections 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.047+0000 7fb8777c8640 1 -- 172.21.15.5:0/486661868 wait complete. 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.048+0000 7fb8777c8640 1 Processor -- start 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.048+0000 7fb8777c8640 1 -- start start 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb8777c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8700cfc90 0x7fb870145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb8777c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb87014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb8777c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb87015bbd0 0x7fb87014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb8777c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b3b30 con 0x7fb870154f10 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb8777c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b39b0 con 0x7fb87015bbd0 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb8777c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b3cb0 con 0x7fb8700cfc90 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb87014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb87014de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39766/0 (socket says 172.21.15.5:39766) 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 -- 172.21.15.5:0/1938471835 learned_addr learned my addr 172.21.15.5:0/1938471835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb875d65640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb87015bbd0 0x7fb87014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb875564640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8700cfc90 0x7fb870145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 -- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8700cfc90 msgr2=0x7fb870145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8700cfc90 0x7fb870145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 -- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb87015bbd0 msgr2=0x7fb87014f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb87015bbd0 0x7fb87014f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 -- 172.21.15.5:0/1938471835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8701e4390 con 0x7fb870154f10 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb875d65640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb87015bbd0 0x7fb87014f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb874d63640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb87014de10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c410 tx=0x7fb86000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb865ffb640 1 -- 172.21.15.5:0/1938471835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600074e0 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb865ffb640 1 -- 172.21.15.5:0/1938471835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8600047e0 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8701e4670 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.049+0000 7fb865ffb640 1 -- 172.21.15.5:0/1938471835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860004bd0 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.050+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8701e4c30 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.051+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87006ce30 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.051+0000 7fb865ffb640 1 -- 172.21.15.5:0/1938471835 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb860011070 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.051+0000 7fb865ffb640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb85406b4d0 0x7fb85406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.051+0000 7fb865ffb640 1 -- 172.21.15.5:0/1938471835 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb860089b10 con 0x7fb870154f10 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.052+0000 7fb875564640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb85406b4d0 0x7fb85406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.052+0000 7fb875564640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb85406b4d0 0x7fb85406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb86c034000 tx=0x7fb86c02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:11.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.056+0000 7fb865ffb640 1 -- 172.21.15.5:0/1938471835 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb87006ce30 con 0x7fb870154f10 2024-04-25T08:59:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.272+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb87004ef20 con 0x7fb870154f10 2024-04-25T08:59:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.273+0000 7fb865ffb640 1 -- 172.21.15.5:0/1938471835 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3692 (secure 0 0 0) 0x7fb86000e280 con 0x7fb870154f10 2024-04-25T08:59:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:11.263 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2510409846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2510409846},{"type":"v1","addr":"172.21.15.80:6837","nonce":2510409846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3426555717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3426555717},{"type":"v1","addr":"172.21.15.80:6836","nonce":3426555717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4918,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3729803264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3729803264},{"type":"v1","addr":"172.21.15.5:6835","nonce":3729803264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4210730493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4210730493},{"type":"v1","addr":"172.21.15.5:6834","nonce":4210730493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[]} 2024-04-25T08:59:11.263 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb85406b4d0 msgr2=0x7fb85406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb85406b4d0 0x7fb85406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb86c034000 tx=0x7fb86c02f000 comp rx=0 tx=0).stop 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 msgr2=0x7fb87014de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb87014de10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c410 tx=0x7fb86000c8d0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 shutdown_connections 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb85406b4d0 0x7fb85406d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb87015bbd0 0x7fb87014f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb870154f10 0x7fb87014de10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 --2- 172.21.15.5:0/1938471835 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8700cfc90 0x7fb870145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 >> 172.21.15.5:0/1938471835 conn(0x7fb8700668f0 msgr2=0x7fb87006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 shutdown_connections 2024-04-25T08:59:11.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.275+0000 7fb8777c8640 1 -- 172.21.15.5:0/1938471835 wait complete. 2024-04-25T08:59:11.276 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:59:11.276 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:59:11.276 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:59:11.276 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:11.276 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:59:11.276 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:59:11.277 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:59:11.277 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:11.277 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:59:11.277 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:59:11.277 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:59:11.277 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:11.277 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:59:11.277 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:59:11.278 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:59:11.278 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:11.286 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:59:11.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:59:11.287 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:59:11.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:59:11.290 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:59:11.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:59:11.291 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:59:11.291 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:59:11.329 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:59:11.329 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:11.330 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:59:11.330 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:11.332 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:59:11.333 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:11.333 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:59:11.333 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:11.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:59:11.405 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T08:59:11.405 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T08:59:11.416 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T08:59:11.416 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T08:59:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.453+0000 7f27f635a640 1 Processor -- start 2024-04-25T08:59:11.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.453+0000 7f27f635a640 1 -- start start 2024-04-25T08:59:11.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27f635a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f015e0a0 0x7f27f00d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27f635a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f00d3df0 0x7f27f00cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27f635a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00b7f60 con 0x7f27f00d3990 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27f635a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00b29c0 con 0x7f27f015e0a0 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27f635a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00d2080 con 0x7f27f00d3df0 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f015e0a0 0x7f27f00d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f015e0a0 0x7f27f00d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39804/0 (socket says 172.21.15.5:39804) 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27effff640 1 -- 172.21.15.5:0/2092620818 learned_addr learned my addr 172.21.15.5:0/2092620818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27f48f7640 1 --2- 172.21.15.5:0/2092620818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f00d3df0 0x7f27f00cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27effff640 1 -- 172.21.15.5:0/2092620818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f00d3df0 msgr2=0x7f27f00cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27effff640 1 --2- 172.21.15.5:0/2092620818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f00d3df0 0x7f27f00cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27effff640 1 -- 172.21.15.5:0/2092620818 >> v1:172.21.15.80:6789/0 conn(0x7f27f00d3990 legacy=0x7f27f00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27effff640 1 -- 172.21.15.5:0/2092620818 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00d2360 con 0x7f27f015e0a0 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.454+0000 7f27f48f7640 1 --2- 172.21.15.5:0/2092620818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f00d3df0 0x7f27f00cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.455+0000 7f27effff640 1 --2- 172.21.15.5:0/2092620818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f015e0a0 0x7f27f00d0d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009870 tx=0x7f27e002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cd4954e7e011a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.455+0000 7f27eeffd640 1 -- 172.21.15.5:0/2092620818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0037070 con 0x7f27f015e0a0 2024-04-25T08:59:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.455+0000 7f27eeffd640 1 -- 172.21.15.5:0/2092620818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0032440 con 0x7f27f015e0a0 2024-04-25T08:59:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.455+0000 7f27eeffd640 1 -- 172.21.15.5:0/2092620818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0032810 con 0x7f27f015e0a0 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 -- 172.21.15.5:0/2092620818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f015e0a0 msgr2=0x7f27f00d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 --2- 172.21.15.5:0/2092620818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f015e0a0 0x7f27f00d0d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009870 tx=0x7f27e002a250 comp rx=0 tx=0).stop 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 -- 172.21.15.5:0/2092620818 shutdown_connections 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 --2- 172.21.15.5:0/2092620818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f00d3df0 0x7f27f00cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 --2- 172.21.15.5:0/2092620818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f015e0a0 0x7f27f00d0d50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 -- 172.21.15.5:0/2092620818 >> 172.21.15.5:0/2092620818 conn(0x7f27f00668f0 msgr2=0x7f27f0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 -- 172.21.15.5:0/2092620818 shutdown_connections 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.456+0000 7f27f635a640 1 -- 172.21.15.5:0/2092620818 wait complete. 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.457+0000 7f27f635a640 1 Processor -- start 2024-04-25T08:59:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.457+0000 7f27f635a640 1 -- start start 2024-04-25T08:59:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27f635a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f00d3990 0x7f27f01f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27f635a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f00d3df0 0x7f27f01f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27f635a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f015e0a0 0x7f27f00aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27f635a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00d2c00 con 0x7f27f00d3990 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27f635a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00d2920 con 0x7f27f00d3df0 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27f635a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00d4280 con 0x7f27f015e0a0 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f00d3990 0x7f27f01f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f00d3990 0x7f27f01f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39808/0 (socket says 172.21.15.5:39808) 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 -- 172.21.15.5:0/177906468 learned_addr learned my addr 172.21.15.5:0/177906468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27ef7fe640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f00d3df0 0x7f27f01f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27f48f7640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f015e0a0 0x7f27f00aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 -- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f015e0a0 msgr2=0x7f27f00aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f015e0a0 0x7f27f00aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 -- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f00d3df0 msgr2=0x7f27f01f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f00d3df0 0x7f27f01f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.458+0000 7f27effff640 1 -- 172.21.15.5:0/177906468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00c8870 con 0x7f27f00d3990 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.459+0000 7f27effff640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f00d3990 0x7f27f01f3a90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f27e0000c00 tx=0x7f27e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.459+0000 7f27ecff9640 1 -- 172.21.15.5:0/177906468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0041020 con 0x7f27f00d3990 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.459+0000 7f27ecff9640 1 -- 172.21.15.5:0/177906468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00306c0 con 0x7f27f00d3990 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.459+0000 7f27ecff9640 1 -- 172.21.15.5:0/177906468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0037040 con 0x7f27f00d3990 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.459+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f00c8b50 con 0x7f27f00d3990 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.459+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00c9110 con 0x7f27f00d3990 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.460+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f004ef20 con 0x7f27f00d3990 2024-04-25T08:59:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.460+0000 7f27ecff9640 1 -- 172.21.15.5:0/177906468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f27e0044020 con 0x7f27f00d3990 2024-04-25T08:59:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.461+0000 7f27ecff9640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27dc06b4d0 0x7f27dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.461+0000 7f27ecff9640 1 -- 172.21.15.5:0/177906468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f27e00aa540 con 0x7f27f00d3990 2024-04-25T08:59:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.461+0000 7f27ef7fe640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27dc06b4d0 0x7f27dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.461+0000 7f27ef7fe640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27dc06b4d0 0x7f27dc06d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27f00c8310 tx=0x7f27e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:11.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.465+0000 7f27ecff9640 1 -- 172.21.15.5:0/177906468 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f27e004b030 con 0x7f27f00d3990 2024-04-25T08:59:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:11.656+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f27f0071750 con 0x7f27f00d3990 2024-04-25T08:59:12.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.421+0000 7f27ecff9640 1 -- 172.21.15.5:0/177906468 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7f27e0079100 con 0x7f27f00d3990 2024-04-25T08:59:12.410 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T08:59:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27dc06b4d0 msgr2=0x7f27dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27dc06b4d0 0x7f27dc06d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27f00c8310 tx=0x7f27e4009040 comp rx=0 tx=0).stop 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f00d3990 msgr2=0x7f27f01f3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f00d3990 0x7f27f01f3a90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f27e0000c00 tx=0x7f27e00046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 shutdown_connections 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f27dc06b4d0 0x7f27dc06d990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f27f015e0a0 0x7f27f00aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f00d3df0 0x7f27f01f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 --2- 172.21.15.5:0/177906468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f00d3990 0x7f27f01f3a90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.424+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 >> 172.21.15.5:0/177906468 conn(0x7f27f00668f0 msgr2=0x7f27f00b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.425+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 shutdown_connections 2024-04-25T08:59:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.425+0000 7f27f635a640 1 -- 172.21.15.5:0/177906468 wait complete. 2024-04-25T08:59:12.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:59:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.547+0000 7f3d91f22640 1 Processor -- start 2024-04-25T08:59:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.547+0000 7f3d91f22640 1 -- start start 2024-04-25T08:59:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d91f22640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d8c06b7d0 0x7f3d8c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d91f22640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d8c06bbb0 0x7f3d8c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d91f22640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0b4730 con 0x7f3d8c15da10 2024-04-25T08:59:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d91f22640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0d0b70 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d91f22640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cbf30 con 0x7f3d8c06bbb0 2024-04-25T08:59:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d8b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d8c06b7d0 0x7f3d8c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d8b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d8c06b7d0 0x7f3d8c06aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39818/0 (socket says 172.21.15.5:39818) 2024-04-25T08:59:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.548+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/3889254084 learned_addr learned my addr 172.21.15.5:0/3889254084 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.549+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/3889254084 >> v2:172.21.15.80:3300/0 conn(0x7f3d8c06bbb0 msgr2=0x7f3d8c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.549+0000 7f3d8b7fe640 1 --2- 172.21.15.5:0/3889254084 >> v2:172.21.15.80:3300/0 conn(0x7f3d8c06bbb0 0x7f3d8c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.549+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/3889254084 >> v1:172.21.15.80:6789/0 conn(0x7f3d8c15da10 legacy=0x7f3d8c15de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.549+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/3889254084 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0d0da0 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.549+0000 7f3d8b7fe640 1 --2- 172.21.15.5:0/3889254084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c06aef0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c072970 tx=0x7f3d7c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce3e1087607cbd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.549+0000 7f3d8a7fc640 1 -- 172.21.15.5:0/3889254084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c037070 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.549+0000 7f3d8a7fc640 1 -- 172.21.15.5:0/3889254084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c032440 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d8a7fc640 1 -- 172.21.15.5:0/3889254084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c032810 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 -- 172.21.15.5:0/3889254084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 msgr2=0x7f3d8c06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 --2- 172.21.15.5:0/3889254084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c06aef0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c072970 tx=0x7f3d7c02a2c0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 -- 172.21.15.5:0/3889254084 shutdown_connections 2024-04-25T08:59:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 --2- 172.21.15.5:0/3889254084 >> v2:172.21.15.80:3300/0 conn(0x7f3d8c06bbb0 0x7f3d8c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 --2- 172.21.15.5:0/3889254084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c06aef0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 -- 172.21.15.5:0/3889254084 >> 172.21.15.5:0/3889254084 conn(0x7f3d8c0d18e0 msgr2=0x7f3d8c0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 -- 172.21.15.5:0/3889254084 shutdown_connections 2024-04-25T08:59:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.550+0000 7f3d91f22640 1 -- 172.21.15.5:0/3889254084 wait complete. 2024-04-25T08:59:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.551+0000 7f3d91f22640 1 Processor -- start 2024-04-25T08:59:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.551+0000 7f3d91f22640 1 -- start start 2024-04-25T08:59:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d91f22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d91f22640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d8c06bbb0 0x7f3d8c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d91f22640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d8c15da10 0x7f3d8c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d91f22640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cc460 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d91f22640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cc7d0 con 0x7f3d8c15da10 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d91f22640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0ccc60 con 0x7f3d8c06bbb0 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c1530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39832/0 (socket says 172.21.15.5:39832) 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.552+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/2039962511 learned_addr learned my addr 172.21.15.5:0/2039962511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8bfff640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d8c15da10 0x7f3d8c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8affd640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d8c06bbb0 0x7f3d8c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d8c06bbb0 msgr2=0x7f3d8c154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8b7fe640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d8c06bbb0 0x7f3d8c154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d8c15da10 msgr2=0x7f3d8c0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8b7fe640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d8c15da10 0x7f3d8c0c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8b7fe640 1 -- 172.21.15.5:0/2039962511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c154d40 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d8b7fe640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c1530b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d73fff640 1 -- 172.21.15.5:0/2039962511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c041070 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d73fff640 1 -- 172.21.15.5:0/2039962511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c03c870 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0c8370 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d73fff640 1 -- 172.21.15.5:0/2039962511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c037040 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.553+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c15ec70 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.554+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c04ef20 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.555+0000 7f3d73fff640 1 -- 172.21.15.5:0/2039962511 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d7c044070 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.555+0000 7f3d73fff640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d7806b4d0 0x7f3d7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.555+0000 7f3d73fff640 1 -- 172.21.15.5:0/2039962511 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d7c0aaa50 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.555+0000 7f3d8affd640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d7806b4d0 0x7f3d7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.556+0000 7f3d8affd640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d7806b4d0 0x7f3d7806d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c1567b0 tx=0x7f3d80008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.559+0000 7f3d73fff640 1 -- 172.21.15.5:0/2039962511 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d8c0b4730 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.808+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3d8c160ff0 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.809+0000 7f3d73fff640 1 -- 172.21.15.5:0/2039962511 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3d7c079d50 con 0x7f3d8c06b7d0 2024-04-25T08:59:12.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:12.798 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:12.798 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.801 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T08:59:12.802 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.803 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T08:59:12.804 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.806 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.807 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T08:59:12.808 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T08:59:12.809 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T08:59:12.810 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T08:59:12.811 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T08:59:12.811 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T08:59:12.811 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T08:59:12.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:12.811 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T08:59:12.811 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d7806b4d0 msgr2=0x7f3d7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d7806b4d0 0x7f3d7806d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c1567b0 tx=0x7f3d80008040 comp rx=0 tx=0).stop 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 msgr2=0x7f3d8c1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c1530b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 shutdown_connections 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d7806b4d0 0x7f3d7806d990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d8c15da10 0x7f3d8c0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d8c06bbb0 0x7f3d8c154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 --2- 172.21.15.5:0/2039962511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c06b7d0 0x7f3d8c1530b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 >> 172.21.15.5:0/2039962511 conn(0x7f3d8c0d18e0 msgr2=0x7f3d8c0b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 shutdown_connections 2024-04-25T08:59:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.811+0000 7f3d91f22640 1 -- 172.21.15.5:0/2039962511 wait complete. 2024-04-25T08:59:12.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:12.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.925+0000 7f912adc4640 1 Processor -- start 2024-04-25T08:59:12.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.925+0000 7f912adc4640 1 -- start start 2024-04-25T08:59:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f912adc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 0x7f91240b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f912adc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f912415bbd0 0x7f91240cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f912adc4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91240b3f30 con 0x7f91240b39b0 2024-04-25T08:59:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f912adc4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912415b0f0 con 0x7f912415bbd0 2024-04-25T08:59:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f912adc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912415b3d0 con 0x7f9124154f10 2024-04-25T08:59:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f9129361640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91240b39b0 0x7f912406d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37824/0 (socket says 172.21.15.5:37824) 2024-04-25T08:59:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f9129361640 1 -- 172.21.15.5:0/1610070008 learned_addr learned my addr 172.21.15.5:0/1610070008 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f9128b60640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 0x7f91240b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f9123fff640 1 --2- 172.21.15.5:0/1610070008 >> v2:172.21.15.80:3300/0 conn(0x7f912415bbd0 0x7f91240cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826064580 0 0) 0x7f91240b3f30 con 0x7f91240b39b0 2024-04-25T08:59:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9114003520 con 0x7f91240b39b0 2024-04-25T08:59:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3733100000 0 0) 0x7f9114003520 con 0x7f91240b39b0 2024-04-25T08:59:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 msgr2=0x7f91240b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 0x7f91240b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 >> v2:172.21.15.80:3300/0 conn(0x7f912415bbd0 msgr2=0x7f91240cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 --2- 172.21.15.5:0/1610070008 >> v2:172.21.15.80:3300/0 conn(0x7f912415bbd0 0x7f91240cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91241552f0 con 0x7f91240b39b0 2024-04-25T08:59:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f911c0019f0 con 0x7f91240b39b0 2024-04-25T08:59:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.926+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 >> v1:172.21.15.5:6789/0 conn(0x7f91240b39b0 legacy=0x7f912406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f91237fe640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91140039b0 0x7f9114003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f91237fe640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 0x7f9114004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f91237fe640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114004d40 0x7f91140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912415b0f0 con 0x7f9114004d40 2024-04-25T08:59:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912415b3d0 con 0x7f91140039b0 2024-04-25T08:59:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911400b9c0 con 0x7f9124154f10 2024-04-25T08:59:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9129361640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114004d40 0x7f91140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9128b60640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91140039b0 0x7f9114003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9123fff640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 0x7f9114004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9129361640 1 -- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 msgr2=0x7f9114004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9129361640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9124154f10 0x7f9114004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9129361640 1 -- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91140039b0 msgr2=0x7f9114003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9129361640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91140039b0 0x7f9114003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.927+0000 7f9129361640 1 -- 172.21.15.5:0/1610070008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114003520 con 0x7f9114004d40 2024-04-25T08:59:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f9129361640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114004d40 0x7f91140051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f911c00a920 tx=0x7f9114005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0eda6fdc1290219 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00a4c0 con 0x7f9114004d40 2024-04-25T08:59:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c02f070 con 0x7f9114004d40 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f91237fe640 1 -- 172.21.15.5:0/1610070008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c02bd00 con 0x7f9114004d40 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f912adc4640 1 -- 172.21.15.5:0/1610070008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114004d40 msgr2=0x7f91140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f912adc4640 1 --2- 172.21.15.5:0/1610070008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114004d40 0x7f91140051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f911c00a920 tx=0x7f9114005830 comp rx=0 tx=0).stop 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f9129361640 1 -- 172.21.15.5:0/1610070008 reap_dead start 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f912adc4640 1 -- 172.21.15.5:0/1610070008 shutdown_connections 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f912adc4640 1 -- 172.21.15.5:0/1610070008 >> 172.21.15.5:0/1610070008 conn(0x7f91240668f0 msgr2=0x7f9124066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f912adc4640 1 -- 172.21.15.5:0/1610070008 shutdown_connections 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.928+0000 7f912adc4640 1 -- 172.21.15.5:0/1610070008 wait complete. 2024-04-25T08:59:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 Processor -- start 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 -- start start 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912413da50 0x7f912413f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912414f150 0x7f912413df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912413e4b0 0x7f912406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240b35f0 con 0x7f912414f150 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240b3470 con 0x7f912413da50 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.930+0000 7f912adc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240b3770 con 0x7f912413e4b0 2024-04-25T08:59:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912414f150 0x7f912413df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912414f150 0x7f912413df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39840/0 (socket says 172.21.15.5:39840) 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 -- 172.21.15.5:0/3950814105 learned_addr learned my addr 172.21.15.5:0/3950814105 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9128b60640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912413da50 0x7f912413f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9129361640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912413e4b0 0x7f912406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 -- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912413e4b0 msgr2=0x7f912406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912413e4b0 0x7f912406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 -- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912413da50 msgr2=0x7f912413f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912413da50 0x7f912413f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 -- 172.21.15.5:0/3950814105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912413e950 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f9123fff640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912414f150 0x7f912413df70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9110011a70 tx=0x7f9110011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f91217fa640 1 -- 172.21.15.5:0/3950814105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000fa90 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f91217fa640 1 -- 172.21.15.5:0/3950814105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911000fc30 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f91217fa640 1 -- 172.21.15.5:0/3950814105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110014440 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912413ec30 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.931+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912413f1f0 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.932+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912404ef20 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.933+0000 7f91217fa640 1 -- 172.21.15.5:0/3950814105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9110012040 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.933+0000 7f91217fa640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910806b410 0x7f910806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.933+0000 7f91217fa640 1 -- 172.21.15.5:0/3950814105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f911008a550 con 0x7f912414f150 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.933+0000 7f9128b60640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910806b410 0x7f910806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.934+0000 7f9128b60640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910806b410 0x7f910806d8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9118009b40 tx=0x7f9118009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:12.937+0000 7f91217fa640 1 -- 172.21.15.5:0/3950814105 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9110019030 con 0x7f912414f150 2024-04-25T08:59:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.117+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9124070d30 con 0x7f912414f150 2024-04-25T08:59:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.118+0000 7f91217fa640 1 -- 172.21.15.5:0/3950814105 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12807 (secure 0 0 0) 0x7f9110059720 con 0x7f912414f150 2024-04-25T08:59:13.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:13.108 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:12.429116+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910806b410 msgr2=0x7f910806d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910806b410 0x7f910806d8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9118009b40 tx=0x7f9118009190 comp rx=0 tx=0).stop 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912414f150 msgr2=0x7f912413df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912414f150 0x7f912413df70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9110011a70 tx=0x7f9110011e70 comp rx=0 tx=0).stop 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 shutdown_connections 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910806b410 0x7f910806d8d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912413e4b0 0x7f912406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912414f150 0x7f912413df70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 --2- 172.21.15.5:0/3950814105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912413da50 0x7f912413f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 >> 172.21.15.5:0/3950814105 conn(0x7f91240668f0 msgr2=0x7f912415c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 shutdown_connections 2024-04-25T08:59:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.120+0000 7f912adc4640 1 -- 172.21.15.5:0/3950814105 wait complete. 2024-04-25T08:59:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:13.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:13.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.235+0000 7fc3d71e2640 1 Processor -- start 2024-04-25T08:59:13.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.235+0000 7fc3d71e2640 1 -- start start 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d71e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d00d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d71e2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3d0160540 0x7fc3d00b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d71e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d00cc530 con 0x7fc3d00b4db0 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d71e2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d00d0930 con 0x7fc3d0160540 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d71e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00d0370 con 0x7fc3d015f1b0 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3cffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3d0160540 0x7fc3d00b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d4f7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d00d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d577f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc3d00b4db0 0x7fc3d00ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:36174/0 (socket says 172.21.15.5:36174) 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d577f640 1 -- 172.21.15.5:0/3459005703 learned_addr learned my addr 172.21.15.5:0/3459005703 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d4f7e640 1 -- 172.21.15.5:0/3459005703 >> v2:172.21.15.80:3300/0 conn(0x7fc3d0160540 msgr2=0x7fc3d00b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d4f7e640 1 --2- 172.21.15.5:0/3459005703 >> v2:172.21.15.80:3300/0 conn(0x7fc3d0160540 0x7fc3d00b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d4f7e640 1 -- 172.21.15.5:0/3459005703 >> v1:172.21.15.80:6789/0 conn(0x7fc3d00b4db0 legacy=0x7fc3d00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3cf7fe640 1 -- 172.21.15.5:0/3459005703 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275138402 0 0) 0x7fc3d00cc530 con 0x7fc3d00b4db0 2024-04-25T08:59:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.236+0000 7fc3d4f7e640 1 -- 172.21.15.5:0/3459005703 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00d0650 con 0x7fc3d015f1b0 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.237+0000 7fc3d4f7e640 1 --2- 172.21.15.5:0/3459005703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d00d2540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40097a0 tx=0x7fc3c402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74651ff564979d1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.237+0000 7fc3cf7fe640 1 -- 172.21.15.5:0/3459005703 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4037070 con 0x7fc3d015f1b0 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.237+0000 7fc3cf7fe640 1 -- 172.21.15.5:0/3459005703 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c4032440 con 0x7fc3d015f1b0 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.237+0000 7fc3cf7fe640 1 -- 172.21.15.5:0/3459005703 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4032810 con 0x7fc3d015f1b0 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 -- 172.21.15.5:0/3459005703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 msgr2=0x7fc3d00d2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/3459005703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d00d2540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40097a0 tx=0x7fc3c402a210 comp rx=0 tx=0).stop 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 -- 172.21.15.5:0/3459005703 shutdown_connections 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/3459005703 >> v2:172.21.15.80:3300/0 conn(0x7fc3d0160540 0x7fc3d00b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/3459005703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d00d2540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 -- 172.21.15.5:0/3459005703 >> 172.21.15.5:0/3459005703 conn(0x7fc3d00d1a20 msgr2=0x7fc3d00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 -- 172.21.15.5:0/3459005703 shutdown_connections 2024-04-25T08:59:13.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.238+0000 7fc3d71e2640 1 -- 172.21.15.5:0/3459005703 wait complete. 2024-04-25T08:59:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.239+0000 7fc3d71e2640 1 Processor -- start 2024-04-25T08:59:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.239+0000 7fc3d71e2640 1 -- start start 2024-04-25T08:59:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d71e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d00b4db0 0x7fc3d00b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d71e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d71e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d0160540 0x7fc3d006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d71e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00d0000 con 0x7fc3d0160540 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d71e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00ccab0 con 0x7fc3d00b4db0 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d71e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d015f590 con 0x7fc3d015f1b0 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d0160540 0x7fc3d006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d0160540 0x7fc3d006bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39842/0 (socket says 172.21.15.5:39842) 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 -- 172.21.15.5:0/964605302 learned_addr learned my addr 172.21.15.5:0/964605302 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3cffff640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d4f7e640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d00b4db0 0x7fc3d00b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 -- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 msgr2=0x7fc3d014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 -- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d00b4db0 msgr2=0x7fc3d00b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d00b4db0 0x7fc3d00b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.240+0000 7fc3d577f640 1 -- 172.21.15.5:0/964605302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00c8f80 con 0x7fc3d0160540 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.241+0000 7fc3d577f640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d0160540 0x7fc3d006bd20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c7b0 tx=0x7fc3c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.241+0000 7fc3cd7fa640 1 -- 172.21.15.5:0/964605302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8018070 con 0x7fc3d0160540 2024-04-25T08:59:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.241+0000 7fc3cd7fa640 1 -- 172.21.15.5:0/964605302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c800a640 con 0x7fc3d0160540 2024-04-25T08:59:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.241+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d00b7330 con 0x7fc3d0160540 2024-04-25T08:59:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.241+0000 7fc3cd7fa640 1 -- 172.21.15.5:0/964605302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800aa70 con 0x7fc3d0160540 2024-04-25T08:59:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.241+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d006b800 con 0x7fc3d0160540 2024-04-25T08:59:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.242+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d006b5f0 con 0x7fc3d0160540 2024-04-25T08:59:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.242+0000 7fc3cd7fa640 1 -- 172.21.15.5:0/964605302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3c801b070 con 0x7fc3d0160540 2024-04-25T08:59:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.243+0000 7fc3cd7fa640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3b406b4d0 0x7fc3b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.243+0000 7fc3cd7fa640 1 -- 172.21.15.5:0/964605302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3c80893e0 con 0x7fc3d0160540 2024-04-25T08:59:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.243+0000 7fc3d4f7e640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3b406b4d0 0x7fc3b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.243+0000 7fc3d4f7e640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3b406b4d0 0x7fc3b406d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4034000 tx=0x7fc3c402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.247+0000 7fc3cd7fa640 1 -- 172.21.15.5:0/964605302 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3c8057f60 con 0x7fc3d0160540 2024-04-25T08:59:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.427+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3d006b9d0 con 0x7fc3d0160540 2024-04-25T08:59:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.428+0000 7fc3cd7fa640 1 -- 172.21.15.5:0/964605302 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3c805c000 con 0x7fc3d0160540 2024-04-25T08:59:13.417 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3b406b4d0 msgr2=0x7fc3b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3b406b4d0 0x7fc3b406d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4034000 tx=0x7fc3c402e000 comp rx=0 tx=0).stop 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d0160540 msgr2=0x7fc3d006bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d0160540 0x7fc3d006bd20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c7b0 tx=0x7fc3c800cc70 comp rx=0 tx=0).stop 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 shutdown_connections 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3b406b4d0 0x7fc3b406d990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d0160540 0x7fc3d006bd20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3d015f1b0 0x7fc3d014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 --2- 172.21.15.5:0/964605302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d00b4db0 0x7fc3d00b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 >> 172.21.15.5:0/964605302 conn(0x7fc3d00d1a20 msgr2=0x7fc3d015f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 shutdown_connections 2024-04-25T08:59:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.430+0000 7fc3d71e2640 1 -- 172.21.15.5:0/964605302 wait complete. 2024-04-25T08:59:13.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:59:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.542+0000 7f231ff3b640 1 Processor -- start 2024-04-25T08:59:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.542+0000 7f231ff3b640 1 -- start start 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.543+0000 7f231ff3b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f231806dd20 0x7f23180ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.543+0000 7f231ff3b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180b4bd0 con 0x7f23180b3860 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.543+0000 7f231ff3b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180b2aa0 con 0x7f2318156250 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.543+0000 7f231ff3b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180b2850 con 0x7f231806dd20 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.543+0000 7f231e4d8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23180b3860 0x7f231815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37830/0 (socket says 172.21.15.5:37830) 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.543+0000 7f231e4d8640 1 -- 172.21.15.5:0/1251202972 learned_addr learned my addr 172.21.15.5:0/1251202972 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.543+0000 7f231d4d6640 1 --2- 172.21.15.5:0/1251202972 >> v2:172.21.15.80:3300/0 conn(0x7f231806dd20 0x7f23180ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147102490 0 0) 0x7f2308001110 con 0x7f23180b3860 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2300003520 con 0x7f23180b3860 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729210957 0 0) 0x7f2300003520 con 0x7f23180b3860 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 >> v2:172.21.15.80:3300/0 conn(0x7f231806dd20 msgr2=0x7f23180ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 --2- 172.21.15.5:0/1251202972 >> v2:172.21.15.80:3300/0 conn(0x7f231806dd20 0x7f23180ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 >> v1:172.21.15.80:6789/0 conn(0x7f2318156250 legacy=0x7f23180b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180b2d80 con 0x7f23180b3860 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2308001840 con 0x7f23180b3860 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 >> v1:172.21.15.5:6789/0 conn(0x7f23180b3860 legacy=0x7f231815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2300004800 0x7f2300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180b2850 con 0x7f23000039b0 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230000c160 con 0x7f23000051c0 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230000c360 con 0x7f2300004800 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231dcd7640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231d4d6640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2300004800 0x7f2300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231e4d8640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231dcd7640 1 -- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2300004800 msgr2=0x7f2300004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231dcd7640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2300004800 0x7f2300004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231dcd7640 1 -- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23000051c0 msgr2=0x7f230000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231dcd7640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231dcd7640 1 -- 172.21.15.5:0/1251202972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300003520 con 0x7f23000039b0 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.544+0000 7f231e4d8640 1 -- 172.21.15.5:0/1251202972 reap_dead start 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.545+0000 7f231dcd7640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2310001e50 tx=0x7f2300005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b3101c53019399 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.545+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310001a70 con 0x7f23000039b0 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.545+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231002ae40 con 0x7f23000039b0 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.545+0000 7f231ccd5640 1 -- 172.21.15.5:0/1251202972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310003bb0 con 0x7f23000039b0 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.546+0000 7f231ff3b640 1 -- 172.21.15.5:0/1251202972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 msgr2=0x7f2300003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.546+0000 7f231ff3b640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2310001e50 tx=0x7f2300005830 comp rx=0 tx=0).stop 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.546+0000 7f231ff3b640 1 -- 172.21.15.5:0/1251202972 shutdown_connections 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.546+0000 7f231ff3b640 1 --2- 172.21.15.5:0/1251202972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.546+0000 7f231ff3b640 1 -- 172.21.15.5:0/1251202972 >> 172.21.15.5:0/1251202972 conn(0x7f23180668f0 msgr2=0x7f2318066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.546+0000 7f231ff3b640 1 -- 172.21.15.5:0/1251202972 shutdown_connections 2024-04-25T08:59:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.546+0000 7f231ff3b640 1 -- 172.21.15.5:0/1251202972 wait complete. 2024-04-25T08:59:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.547+0000 7f231ff3b640 1 Processor -- start 2024-04-25T08:59:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.547+0000 7f231ff3b640 1 -- start start 2024-04-25T08:59:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231ff3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2318156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231ff3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23180cf7a0 0x7f2318148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231ff3b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231815acf0 0x7f231815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231ff3b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180b44c0 con 0x7f23000039b0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231ff3b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180b3340 con 0x7f231815acf0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231ff3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180b4640 con 0x7f23180cf7a0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2318156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2318156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39860/0 (socket says 172.21.15.5:39860) 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 -- 172.21.15.5:0/2600535326 learned_addr learned my addr 172.21.15.5:0/2600535326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231e4d8640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231815acf0 0x7f231815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231d4d6640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23180cf7a0 0x7f2318148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 -- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23180cf7a0 msgr2=0x7f2318148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23180cf7a0 0x7f2318148220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 -- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231815acf0 msgr2=0x7f231815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231815acf0 0x7f231815b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 -- 172.21.15.5:0/2600535326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318158d60 con 0x7f23000039b0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f231dcd7640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2318156630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2310000f80 tx=0x7f23100014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.548+0000 7f23167fc640 1 -- 172.21.15.5:0/2600535326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310040030 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.549+0000 7f23167fc640 1 -- 172.21.15.5:0/2600535326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231002ac40 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.549+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318156c10 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.549+0000 7f23167fc640 1 -- 172.21.15.5:0/2600535326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310007db0 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.549+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23181592e0 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.550+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231804ef20 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.550+0000 7f23167fc640 1 -- 172.21.15.5:0/2600535326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2310043070 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.550+0000 7f23167fc640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f230406b500 0x7f230406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.551+0000 7f23167fc640 1 -- 172.21.15.5:0/2600535326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23100a9940 con 0x7f23000039b0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.551+0000 7f231d4d6640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f230406b500 0x7f230406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.551+0000 7f231d4d6640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f230406b500 0x7f230406d9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f23181551f0 tx=0x7f230c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.555+0000 7f23167fc640 1 -- 172.21.15.5:0/2600535326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f231004b020 con 0x7f23000039b0 2024-04-25T08:59:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.735+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f23180b0e20 con 0x7f23000039b0 2024-04-25T08:59:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.735+0000 7f23167fc640 1 -- 172.21.15.5:0/2600535326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2310078b40 con 0x7f23000039b0 2024-04-25T08:59:13.725 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:13.725 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T08:59:13.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:13.725 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T08:59:13.725 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T08:59:13.725 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:13.725 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f230406b500 msgr2=0x7f230406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f230406b500 0x7f230406d9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f23181551f0 tx=0x7f230c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 msgr2=0x7f2318156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2318156630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2310000f80 tx=0x7f23100014a0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 shutdown_connections 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f230406b500 0x7f230406d9c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231815acf0 0x7f231815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f23180cf7a0 0x7f2318148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 --2- 172.21.15.5:0/2600535326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000039b0 0x7f2318156630 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 >> 172.21.15.5:0/2600535326 conn(0x7f23180668f0 msgr2=0x7f23180cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 shutdown_connections 2024-04-25T08:59:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.737+0000 7f231ff3b640 1 -- 172.21.15.5:0/2600535326 wait complete. 2024-04-25T08:59:13.737 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:59:13.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:59:13.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.852+0000 7f221fb6a640 1 Processor -- start 2024-04-25T08:59:13.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.853+0000 7f221fb6a640 1 -- start start 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.853+0000 7f221fb6a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f221815dbd0 0x7f22181617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.853+0000 7f221fb6a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22180ceec0 0x7f22180d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.853+0000 7f221fb6a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2218162070 con 0x7f22180b9470 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.853+0000 7f221fb6a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2218162350 con 0x7f22180ceec0 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.853+0000 7f221fb6a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22180d1c50 con 0x7f221815dbd0 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221e107640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22180ceec0 0x7f22180d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221d906640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f221815dbd0 0x7f22181617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221d105640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f22180b9470 0x7f22180ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:36196/0 (socket says 172.21.15.5:36196) 2024-04-25T08:59:13.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221d105640 1 -- 172.21.15.5:0/2019519015 learned_addr learned my addr 172.21.15.5:0/2019519015 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:13.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221e107640 1 -- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f221815dbd0 msgr2=0x7f22181617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221e107640 1 --2- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f221815dbd0 0x7f22181617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221e107640 1 -- 172.21.15.5:0/2019519015 >> v1:172.21.15.80:6789/0 conn(0x7f22180b9470 legacy=0x7f22180ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221e107640 1 -- 172.21.15.5:0/2019519015 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180d1f30 con 0x7f22180ceec0 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.854+0000 7f221d906640 1 --2- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f221815dbd0 0x7f22181617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.855+0000 7f221e107640 1 --2- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180ceec0 0x7f22180d2450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2208009d90 tx=0x7f220802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891151cafbdeddd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.855+0000 7f221c904640 1 -- 172.21.15.5:0/2019519015 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208007740 con 0x7f22180ceec0 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.855+0000 7f221c904640 1 -- 172.21.15.5:0/2019519015 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22080078e0 con 0x7f22180ceec0 2024-04-25T08:59:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.855+0000 7f221c904640 1 -- 172.21.15.5:0/2019519015 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208007cb0 con 0x7f22180ceec0 2024-04-25T08:59:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 -- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180ceec0 msgr2=0x7f22180d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 --2- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180ceec0 0x7f22180d2450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2208009d90 tx=0x7f220802a660 comp rx=0 tx=0).stop 2024-04-25T08:59:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 -- 172.21.15.5:0/2019519015 shutdown_connections 2024-04-25T08:59:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 --2- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180ceec0 0x7f22180d2450 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 --2- 172.21.15.5:0/2019519015 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f221815dbd0 0x7f22181617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 -- 172.21.15.5:0/2019519015 >> 172.21.15.5:0/2019519015 conn(0x7f2218066ad0 msgr2=0x7f2218066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 -- 172.21.15.5:0/2019519015 shutdown_connections 2024-04-25T08:59:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.856+0000 7f221fb6a640 1 -- 172.21.15.5:0/2019519015 wait complete. 2024-04-25T08:59:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.857+0000 7f221fb6a640 1 Processor -- start 2024-04-25T08:59:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.857+0000 7f221fb6a640 1 -- start start 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221fb6a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180b9470 0x7f221815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221fb6a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22180ceec0 0x7f22180cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221fb6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f221815dbd0 0x7f221814e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221fb6a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221815dfb0 con 0x7f221815dbd0 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221fb6a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2218161cf0 con 0x7f22180b9470 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221fb6a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221815e130 con 0x7f22180ceec0 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f221815dbd0 0x7f221814e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f221815dbd0 0x7f221814e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39868/0 (socket says 172.21.15.5:39868) 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 -- 172.21.15.5:0/3070035391 learned_addr learned my addr 172.21.15.5:0/3070035391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221d906640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180b9470 0x7f221815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221d105640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22180ceec0 0x7f22180cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 -- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22180ceec0 msgr2=0x7f22180cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22180ceec0 0x7f22180cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 -- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180b9470 msgr2=0x7f221815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180b9470 0x7f221815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 -- 172.21.15.5:0/3070035391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180cb210 con 0x7f221815dbd0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221d105640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22180ceec0 0x7f22180cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f221e107640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f221815dbd0 0x7f221814e850 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f220802ac50 tx=0x7f2208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.858+0000 7f22167fc640 1 -- 172.21.15.5:0/3070035391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208040070 con 0x7f221815dbd0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.859+0000 7f22167fc640 1 -- 172.21.15.5:0/3070035391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208031bc0 con 0x7f221815dbd0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.859+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2218160240 con 0x7f221815dbd0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.859+0000 7f22167fc640 1 -- 172.21.15.5:0/3070035391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208009450 con 0x7f221815dbd0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.859+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2218160800 con 0x7f221815dbd0 2024-04-25T08:59:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.859+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22180cb7d0 con 0x7f221815dbd0 2024-04-25T08:59:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.860+0000 7f22167fc640 1 -- 172.21.15.5:0/3070035391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2208039040 con 0x7f221815dbd0 2024-04-25T08:59:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.860+0000 7f22167fc640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f220406b4d0 0x7f220406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.861+0000 7f22167fc640 1 -- 172.21.15.5:0/3070035391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22080ab690 con 0x7f221815dbd0 2024-04-25T08:59:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.861+0000 7f221d906640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f220406b4d0 0x7f220406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.861+0000 7f221d906640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f220406b4d0 0x7f220406d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2210009a30 tx=0x7f2210008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:13.865+0000 7f22167fc640 1 -- 172.21.15.5:0/3070035391 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f22180cb7d0 con 0x7f221815dbd0 2024-04-25T08:59:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.045+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f22180d1760 con 0x7f221815dbd0 2024-04-25T08:59:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.436+0000 7f22167fc640 1 -- 172.21.15.5:0/3070035391 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f220807a870 con 0x7f221815dbd0 2024-04-25T08:59:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T08:59:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f220406b4d0 msgr2=0x7f220406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f220406b4d0 0x7f220406d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2210009a30 tx=0x7f2210008040 comp rx=0 tx=0).stop 2024-04-25T08:59:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f221815dbd0 msgr2=0x7f221814e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f221815dbd0 0x7f221814e850 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f220802ac50 tx=0x7f2208004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 shutdown_connections 2024-04-25T08:59:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f220406b4d0 0x7f220406d990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f221815dbd0 0x7f221814e850 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f22180ceec0 0x7f22180cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 --2- 172.21.15.5:0/3070035391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22180b9470 0x7f221815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 >> 172.21.15.5:0/3070035391 conn(0x7f2218066ad0 msgr2=0x7f22180b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.438+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 shutdown_connections 2024-04-25T08:59:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.439+0000 7f221fb6a640 1 -- 172.21.15.5:0/3070035391 wait complete. 2024-04-25T08:59:14.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:59:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.563+0000 7fca5645a640 1 Processor -- start 2024-04-25T08:59:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.563+0000 7fca5645a640 1 -- start start 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca5645a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca5015f1b0 0x7fca500d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca5645a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500cc530 con 0x7fca50160540 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca5645a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500d0930 con 0x7fca500ccfd0 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca5645a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca500d0370 con 0x7fca5015f1b0 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca50160540 0x7fca500b4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37846/0 (socket says 172.21.15.5:37846) 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4f7fe640 1 -- 172.21.15.5:0/198657990 learned_addr learned my addr 172.21.15.5:0/198657990 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4ffff640 1 --2- 172.21.15.5:0/198657990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca5015f1b0 0x7fca500d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682453475 0 0) 0x7fca500cc530 con 0x7fca50160540 2024-04-25T08:59:14.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca38003520 con 0x7fca50160540 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875511776 0 0) 0x7fca500d0930 con 0x7fca500ccfd0 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca500cc530 con 0x7fca500ccfd0 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1540147294 0 0) 0x7fca38003520 con 0x7fca50160540 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4ffff640 1 -- 172.21.15.5:0/198657990 >> v1:172.21.15.80:6789/0 conn(0x7fca500ccfd0 legacy=0x7fca5015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4ffff640 1 -- 172.21.15.5:0/198657990 >> v1:172.21.15.5:6789/0 conn(0x7fca50160540 legacy=0x7fca500b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.564+0000 7fca4ffff640 1 -- 172.21.15.5:0/198657990 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500d0650 con 0x7fca5015f1b0 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.565+0000 7fca4ffff640 1 --2- 172.21.15.5:0/198657990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca5015f1b0 0x7fca500d2540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca400097d0 tx=0x7fca4002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eeafc792f21962d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.565+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40037070 con 0x7fca5015f1b0 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.565+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4002acc0 con 0x7fca5015f1b0 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.565+0000 7fca4effd640 1 -- 172.21.15.5:0/198657990 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440015f0 con 0x7fca5015f1b0 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.566+0000 7fca5645a640 1 -- 172.21.15.5:0/198657990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca5015f1b0 msgr2=0x7fca500d2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.566+0000 7fca5645a640 1 --2- 172.21.15.5:0/198657990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca5015f1b0 0x7fca500d2540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca400097d0 tx=0x7fca4002a230 comp rx=0 tx=0).stop 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.566+0000 7fca5645a640 1 -- 172.21.15.5:0/198657990 shutdown_connections 2024-04-25T08:59:14.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.566+0000 7fca5645a640 1 --2- 172.21.15.5:0/198657990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca5015f1b0 0x7fca500d2540 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.566+0000 7fca5645a640 1 -- 172.21.15.5:0/198657990 >> 172.21.15.5:0/198657990 conn(0x7fca500d1a20 msgr2=0x7fca500d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.566+0000 7fca5645a640 1 -- 172.21.15.5:0/198657990 shutdown_connections 2024-04-25T08:59:14.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.566+0000 7fca5645a640 1 -- 172.21.15.5:0/198657990 wait complete. 2024-04-25T08:59:14.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.567+0000 7fca5645a640 1 Processor -- start 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.567+0000 7fca5645a640 1 -- start start 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca5645a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca500ccfd0 0x7fca5015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca5645a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5015f1b0 0x7fca5006b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca5645a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca50160540 0x7fca500c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca5645a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca500b4f80 con 0x7fca500ccfd0 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca5645a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca500ccab0 con 0x7fca5015f1b0 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca5645a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca500d0000 con 0x7fca50160540 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca500ccfd0 0x7fca5015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca500ccfd0 0x7fca5015bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39880/0 (socket says 172.21.15.5:39880) 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 -- 172.21.15.5:0/2114228724 learned_addr learned my addr 172.21.15.5:0/2114228724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4f7fe640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5015f1b0 0x7fca5006b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca549f7640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca50160540 0x7fca500c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 -- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca50160540 msgr2=0x7fca500c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca50160540 0x7fca500c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 -- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5015f1b0 msgr2=0x7fca5006b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5015f1b0 0x7fca5006b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca4ffff640 1 -- 172.21.15.5:0/2114228724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca501f3f60 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.568+0000 7fca549f7640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca50160540 0x7fca500c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.569+0000 7fca4ffff640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca500ccfd0 0x7fca5015bb10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fca40035040 tx=0x7fca400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.569+0000 7fca4cff9640 1 -- 172.21.15.5:0/2114228724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40041020 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.569+0000 7fca4cff9640 1 -- 172.21.15.5:0/2114228724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4003d640 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.569+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca500cae40 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.569+0000 7fca4cff9640 1 -- 172.21.15.5:0/2114228724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40037040 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.569+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca500cb400 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.570+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5009f920 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.570+0000 7fca4cff9640 1 -- 172.21.15.5:0/2114228724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca40044020 con 0x7fca500ccfd0 2024-04-25T08:59:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.571+0000 7fca4cff9640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca3c06b4d0 0x7fca3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.571+0000 7fca4cff9640 1 -- 172.21.15.5:0/2114228724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fca400aa4c0 con 0x7fca500ccfd0 2024-04-25T08:59:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.571+0000 7fca4f7fe640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca3c06b4d0 0x7fca3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.572+0000 7fca4f7fe640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca3c06b4d0 0x7fca3c06d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca44001200 tx=0x7fca44001110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.575+0000 7fca4cff9640 1 -- 172.21.15.5:0/2114228724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca5009f920 con 0x7fca500ccfd0 2024-04-25T08:59:14.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:14.756+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fca501f4140 con 0x7fca500ccfd0 2024-04-25T08:59:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.442+0000 7fca4cff9640 1 -- 172.21.15.5:0/2114228724 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7fca4004b030 con 0x7fca500ccfd0 2024-04-25T08:59:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca3c06b4d0 msgr2=0x7fca3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca3c06b4d0 0x7fca3c06d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca44001200 tx=0x7fca44001110 comp rx=0 tx=0).stop 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca500ccfd0 msgr2=0x7fca5015bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca500ccfd0 0x7fca5015bb10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fca40035040 tx=0x7fca400046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 shutdown_connections 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca3c06b4d0 0x7fca3c06d990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca50160540 0x7fca500c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5015f1b0 0x7fca5006b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 --2- 172.21.15.5:0/2114228724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca500ccfd0 0x7fca5015bb10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.445+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 >> 172.21.15.5:0/2114228724 conn(0x7fca500d1a20 msgr2=0x7fca500cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.446+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 shutdown_connections 2024-04-25T08:59:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.446+0000 7fca5645a640 1 -- 172.21.15.5:0/2114228724 wait complete. 2024-04-25T08:59:15.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:59:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.582+0000 7ff3075c1640 1 Processor -- start 2024-04-25T08:59:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.582+0000 7ff3075c1640 1 -- start start 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff3075c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3001614b0 0x7ff3000b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff3075c1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3000d1f60 0x7ff3000d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff3075c1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3000d2740 con 0x7ff3000d4060 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff3075c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3000d44b0 con 0x7ff3001614b0 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff3075c1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3000d2a20 con 0x7ff3000d1f60 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff30535d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3001614b0 0x7ff3000b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff305b5e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff3000d4060 0x7ff3000b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37848/0 (socket says 172.21.15.5:37848) 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff30535d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3001614b0 0x7ff3000b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39892/0 (socket says 172.21.15.5:39892) 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff305b5e640 1 -- 172.21.15.5:0/3538862154 learned_addr learned my addr 172.21.15.5:0/3538862154 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff304b5c640 1 --2- 172.21.15.5:0/3538862154 >> v2:172.21.15.80:3300/0 conn(0x7ff3000d1f60 0x7ff3000d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff30535d640 1 -- 172.21.15.5:0/3538862154 >> v2:172.21.15.80:3300/0 conn(0x7ff3000d1f60 msgr2=0x7ff3000d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff30535d640 1 --2- 172.21.15.5:0/3538862154 >> v2:172.21.15.80:3300/0 conn(0x7ff3000d1f60 0x7ff3000d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff30535d640 1 -- 172.21.15.5:0/3538862154 >> v1:172.21.15.5:6789/0 conn(0x7ff3000d4060 legacy=0x7ff3000b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff2f7fff640 1 -- 172.21.15.5:0/3538862154 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510709650 0 0) 0x7ff3000d2740 con 0x7ff3000d4060 2024-04-25T08:59:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.583+0000 7ff30535d640 1 -- 172.21.15.5:0/3538862154 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000d2d00 con 0x7ff3001614b0 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.584+0000 7ff30535d640 1 --2- 172.21.15.5:0/3538862154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b96e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff3000b66e0 tx=0x7ff2fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dec763686d9243 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.584+0000 7ff2f7fff640 1 -- 172.21.15.5:0/3538862154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc037070 con 0x7ff3001614b0 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.584+0000 7ff2f7fff640 1 -- 172.21.15.5:0/3538862154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc032440 con 0x7ff3001614b0 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.584+0000 7ff2f7fff640 1 -- 172.21.15.5:0/3538862154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc032810 con 0x7ff3001614b0 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 -- 172.21.15.5:0/3538862154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 msgr2=0x7ff3000b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3538862154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b96e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff3000b66e0 tx=0x7ff2fc02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 -- 172.21.15.5:0/3538862154 shutdown_connections 2024-04-25T08:59:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3538862154 >> v2:172.21.15.80:3300/0 conn(0x7ff3000d1f60 0x7ff3000d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3538862154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b96e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 -- 172.21.15.5:0/3538862154 >> 172.21.15.5:0/3538862154 conn(0x7ff30006b000 msgr2=0x7ff30006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 -- 172.21.15.5:0/3538862154 shutdown_connections 2024-04-25T08:59:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.585+0000 7ff3075c1640 1 -- 172.21.15.5:0/3538862154 wait complete. 2024-04-25T08:59:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.586+0000 7ff3075c1640 1 Processor -- start 2024-04-25T08:59:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.586+0000 7ff3075c1640 1 -- start start 2024-04-25T08:59:15.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff3075c1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3000d1f60 0x7ff300151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff3075c1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3000d4060 0x7ff3000b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff3075c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff3075c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000d37e0 con 0x7ff3001614b0 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff3075c1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000d32c0 con 0x7ff3000d1f60 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff3075c1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000d23a0 con 0x7ff3000d4060 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39906/0 (socket says 172.21.15.5:39906) 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 -- 172.21.15.5:0/3839146809 learned_addr learned my addr 172.21.15.5:0/3839146809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff30535d640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3000d1f60 0x7ff300151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff304b5c640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3000d4060 0x7ff3000b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 -- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3000d4060 msgr2=0x7ff3000b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3000d4060 0x7ff3000b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 -- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3000d1f60 msgr2=0x7ff300151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3000d1f60 0x7ff300151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 -- 172.21.15.5:0/3839146809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000b5df0 con 0x7ff3001614b0 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff305b5e640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b3d10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c7a0 tx=0x7ff2f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff2f5ffb640 1 -- 172.21.15.5:0/3839146809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8018070 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff2f5ffb640 1 -- 172.21.15.5:0/3839146809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f800a5e0 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.587+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3001597d0 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.588+0000 7ff2f5ffb640 1 -- 172.21.15.5:0/3839146809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f800aa50 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.588+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff300156880 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.589+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3000d0cc0 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.589+0000 7ff2f5ffb640 1 -- 172.21.15.5:0/3839146809 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2f801b070 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.589+0000 7ff2f5ffb640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff2e406b500 0x7ff2e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.589+0000 7ff2f5ffb640 1 -- 172.21.15.5:0/3839146809 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff2f8089610 con 0x7ff3001614b0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.590+0000 7ff30535d640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff2e406b500 0x7ff2e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.590+0000 7ff30535d640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff2e406b500 0x7ff2e406d9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc034000 tx=0x7ff2fc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.594+0000 7ff2f5ffb640 1 -- 172.21.15.5:0/3839146809 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff3000d0cc0 con 0x7ff3001614b0 2024-04-25T08:59:15.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:15.810+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff30004ef20 con 0x7ff3001614b0 2024-04-25T08:59:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.450+0000 7ff2f5ffb640 1 -- 172.21.15.5:0/3839146809 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff2f8057f30 con 0x7ff3001614b0 2024-04-25T08:59:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 6 and data pool 7 2024-04-25T08:59:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.460+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff2e406b500 msgr2=0x7ff2e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.460+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff2e406b500 0x7ff2e406d9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc034000 tx=0x7ff2fc02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.460+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 msgr2=0x7ff3000b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.460+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b3d10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c7a0 tx=0x7ff2f800cc60 comp rx=0 tx=0).stop 2024-04-25T08:59:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.467+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 shutdown_connections 2024-04-25T08:59:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.467+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff2e406b500 0x7ff2e406d9c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.467+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3001614b0 0x7ff3000b3d10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.467+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3000d4060 0x7ff3000b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.467+0000 7ff3075c1640 1 --2- 172.21.15.5:0/3839146809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3000d1f60 0x7ff300151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.467+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 >> 172.21.15.5:0/3839146809 conn(0x7ff30006b000 msgr2=0x7ff3000cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.469+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 shutdown_connections 2024-04-25T08:59:16.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.469+0000 7ff3075c1640 1 -- 172.21.15.5:0/3839146809 wait complete. 2024-04-25T08:59:16.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.589+0000 7fe3eaf70640 1 Processor -- start 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.589+0000 7fe3eaf70640 1 -- start start 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3eaf70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3e415bbd0 0x7fe3e40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3eaf70640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3e40cfac0 0x7fe3e4070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3eaf70640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e40b3f30 con 0x7fe3e4154f10 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3eaf70640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e40cff30 con 0x7fe3e40cfac0 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3eaf70640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e415b0f0 con 0x7fe3e415bbd0 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3e950d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3e40cfac0 0x7fe3e4070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3e950d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3e40cfac0 0x7fe3e4070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39920/0 (socket says 172.21.15.5:39920) 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3e950d640 1 -- 172.21.15.5:0/3937480362 learned_addr learned my addr 172.21.15.5:0/3937480362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3e3fff640 1 --2- 172.21.15.5:0/3937480362 >> v2:172.21.15.80:3300/0 conn(0x7fe3e415bbd0 0x7fe3e40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3e950d640 1 -- 172.21.15.5:0/3937480362 >> v2:172.21.15.80:3300/0 conn(0x7fe3e415bbd0 msgr2=0x7fe3e40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3e950d640 1 --2- 172.21.15.5:0/3937480362 >> v2:172.21.15.80:3300/0 conn(0x7fe3e415bbd0 0x7fe3e40cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.590+0000 7fe3e950d640 1 -- 172.21.15.5:0/3937480362 >> v1:172.21.15.5:6789/0 conn(0x7fe3e4154f10 legacy=0x7fe3e40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.591+0000 7fe3e37fe640 1 -- 172.21.15.5:0/3937480362 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038972682 0 0) 0x7fe3e40b3f30 con 0x7fe3e4154f10 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.591+0000 7fe3e950d640 1 -- 172.21.15.5:0/3937480362 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e415b3d0 con 0x7fe3e40cfac0 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.591+0000 7fe3e950d640 1 --2- 172.21.15.5:0/3937480362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e40cfac0 0x7fe3e4070f50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40727d0 tx=0x7fe3d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d3b5eaa75565 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.591+0000 7fe3e37fe640 1 -- 172.21.15.5:0/3937480362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4037070 con 0x7fe3e40cfac0 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.591+0000 7fe3e37fe640 1 -- 172.21.15.5:0/3937480362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d4032440 con 0x7fe3e40cfac0 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.591+0000 7fe3e37fe640 1 -- 172.21.15.5:0/3937480362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4032810 con 0x7fe3e40cfac0 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3937480362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e40cfac0 msgr2=0x7fe3e4070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3937480362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e40cfac0 0x7fe3e4070f50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40727d0 tx=0x7fe3d402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3937480362 shutdown_connections 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3937480362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e40cfac0 0x7fe3e4070f50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3937480362 >> v2:172.21.15.80:3300/0 conn(0x7fe3e415bbd0 0x7fe3e40cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3937480362 >> 172.21.15.5:0/3937480362 conn(0x7fe3e40668f0 msgr2=0x7fe3e4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3937480362 shutdown_connections 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.592+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3937480362 wait complete. 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.593+0000 7fe3eaf70640 1 Processor -- start 2024-04-25T08:59:16.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.593+0000 7fe3eaf70640 1 -- start start 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3eaf70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe3e40cfac0 0x7fe3e4136890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3eaf70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4154f10 0x7fe3e41e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3eaf70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3e415bbd0 0x7fe3e4138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3eaf70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e40b3b80 con 0x7fe3e4154f10 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3eaf70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e415f290 con 0x7fe3e415bbd0 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3eaf70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e4137760 con 0x7fe3e40cfac0 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4154f10 0x7fe3e41e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4154f10 0x7fe3e41e44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39928/0 (socket says 172.21.15.5:39928) 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 -- 172.21.15.5:0/3314007030 learned_addr learned my addr 172.21.15.5:0/3314007030 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e950d640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3e415bbd0 0x7fe3e4138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e8d0c640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe3e40cfac0 0x7fe3e4136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 -- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe3e40cfac0 msgr2=0x7fe3e4136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe3e40cfac0 0x7fe3e4136890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 -- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3e415bbd0 msgr2=0x7fe3e4138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3e415bbd0 0x7fe3e4138800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e3fff640 1 -- 172.21.15.5:0/3314007030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4137a40 con 0x7fe3e4154f10 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e8d0c640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe3e40cfac0 0x7fe3e4136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.594+0000 7fe3e950d640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3e415bbd0 0x7fe3e4138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.595+0000 7fe3e3fff640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4154f10 0x7fe3e41e44b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00d5d0 tx=0x7fe3cc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.595+0000 7fe3e17fa640 1 -- 172.21.15.5:0/3314007030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0125f0 con 0x7fe3e4154f10 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.595+0000 7fe3e17fa640 1 -- 172.21.15.5:0/3314007030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc019070 con 0x7fe3e4154f10 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.595+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e4137d20 con 0x7fe3e4154f10 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.595+0000 7fe3e17fa640 1 -- 172.21.15.5:0/3314007030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0129b0 con 0x7fe3e4154f10 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.595+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e4136dd0 con 0x7fe3e4154f10 2024-04-25T08:59:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.596+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e404ef20 con 0x7fe3e4154f10 2024-04-25T08:59:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.596+0000 7fe3e17fa640 1 -- 172.21.15.5:0/3314007030 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe3cc012b50 con 0x7fe3e4154f10 2024-04-25T08:59:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.597+0000 7fe3e17fa640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe3c406b4d0 0x7fe3c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.597+0000 7fe3e17fa640 1 -- 172.21.15.5:0/3314007030 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3cc08a670 con 0x7fe3e4154f10 2024-04-25T08:59:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.597+0000 7fe3e8d0c640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe3c406b4d0 0x7fe3c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.597+0000 7fe3e8d0c640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe3c406b4d0 0x7fe3c406d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0012e0 tx=0x7fe3dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.601+0000 7fe3e17fa640 1 -- 172.21.15.5:0/3314007030 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe3cc059460 con 0x7fe3e4154f10 2024-04-25T08:59:16.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:16.642 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:16.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.782+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3e40cbf30 con 0x7fe3e4154f10 2024-04-25T08:59:16.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.783+0000 7fe3e17fa640 1 -- 172.21.15.5:0/3314007030 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fe3cc058d60 con 0x7fe3e4154f10 2024-04-25T08:59:16.773 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:16.773 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:15.812585+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:14.076773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:14.788001+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe3c406b4d0 msgr2=0x7fe3c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe3c406b4d0 0x7fe3c406d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0012e0 tx=0x7fe3dc009040 comp rx=0 tx=0).stop 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4154f10 msgr2=0x7fe3e41e44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4154f10 0x7fe3e41e44b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00d5d0 tx=0x7fe3cc00da90 comp rx=0 tx=0).stop 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 shutdown_connections 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe3c406b4d0 0x7fe3c406d990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3e415bbd0 0x7fe3e4138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4154f10 0x7fe3e41e44b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 --2- 172.21.15.5:0/3314007030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe3e40cfac0 0x7fe3e4136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 >> 172.21.15.5:0/3314007030 conn(0x7fe3e40668f0 msgr2=0x7fe3e40b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 shutdown_connections 2024-04-25T08:59:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.785+0000 7fe3eaf70640 1 -- 172.21.15.5:0/3314007030 wait complete. 2024-04-25T08:59:16.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:16.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.897+0000 7efc98ecd640 1 Processor -- start 2024-04-25T08:59:16.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.897+0000 7efc98ecd640 1 -- start start 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc98ecd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 0x7efc94161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc98ecd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc94161fc0 con 0x7efc940b94a0 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc98ecd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc941622a0 con 0x7efc9415dc70 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc98ecd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc940d2180 con 0x7efc940cef60 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc92d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc940b94a0 0x7efc940d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37858/0 (socket says 172.21.15.5:37858) 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc92d9d640 1 -- 172.21.15.5:0/461699792 learned_addr learned my addr 172.21.15.5:0/461699792 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc89d9b640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 0x7efc94161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294165938 0 0) 0x7efc94161fc0 con 0x7efc940b94a0 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc80003520 con 0x7efc940b94a0 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1538095074 0 0) 0x7efc80003520 con 0x7efc940b94a0 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 msgr2=0x7efc94161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 0x7efc94161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 >> v1:172.21.15.80:6789/0 conn(0x7efc9415dc70 legacy=0x7efc940ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94162580 con 0x7efc940b94a0 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7efc8c0019f0 con 0x7efc940b94a0 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 >> v1:172.21.15.5:6789/0 conn(0x7efc940b94a0 legacy=0x7efc940d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.898+0000 7efc91d9b640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc800039e0 0x7efc80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc91d9b640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80004390 0x7efc80004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc91d9b640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 0x7efc800050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8000b9c0 con 0x7efc80004390 2024-04-25T08:59:16.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8000bb40 con 0x7efc800039e0 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8000bd40 con 0x7efc940cef60 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc89d9b640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80004390 0x7efc80004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc92d9d640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 0x7efc800050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc9259c640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc800039e0 0x7efc80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc92d9d640 1 -- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc800039e0 msgr2=0x7efc80003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc92d9d640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc800039e0 0x7efc80003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc92d9d640 1 -- 172.21.15.5:0/461699792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80004390 msgr2=0x7efc80004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc92d9d640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80004390 0x7efc80004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc92d9d640 1 -- 172.21.15.5:0/461699792 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80003520 con 0x7efc940cef60 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.899+0000 7efc89d9b640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80004390 0x7efc80004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.900+0000 7efc92d9d640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 0x7efc800050c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00a8b0 tx=0x7efc80005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b57016e7ce221e5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.900+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00a4a0 con 0x7efc940cef60 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.900+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c02f070 con 0x7efc940cef60 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.900+0000 7efc91d9b640 1 -- 172.21.15.5:0/461699792 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c02bcc0 con 0x7efc940cef60 2024-04-25T08:59:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.901+0000 7efc98ecd640 1 -- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 msgr2=0x7efc800050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.901+0000 7efc98ecd640 1 --2- 172.21.15.5:0/461699792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc940cef60 0x7efc800050c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00a8b0 tx=0x7efc80005830 comp rx=0 tx=0).stop 2024-04-25T08:59:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.901+0000 7efc92d9d640 1 -- 172.21.15.5:0/461699792 reap_dead start 2024-04-25T08:59:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.901+0000 7efc98ecd640 1 -- 172.21.15.5:0/461699792 shutdown_connections 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.901+0000 7efc98ecd640 1 -- 172.21.15.5:0/461699792 >> 172.21.15.5:0/461699792 conn(0x7efc940668f0 msgr2=0x7efc94066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.901+0000 7efc98ecd640 1 -- 172.21.15.5:0/461699792 shutdown_connections 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.901+0000 7efc98ecd640 1 -- 172.21.15.5:0/461699792 wait complete. 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.902+0000 7efc98ecd640 1 Processor -- start 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.902+0000 7efc98ecd640 1 -- start start 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc98ecd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc940cef60 0x7efc9415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc98ecd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc941f3c40 0x7efc940aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc98ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc941f40a0 0x7efc940aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc98ecd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94161850 con 0x7efc940cef60 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc98ecd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940d11f0 con 0x7efc941f40a0 2024-04-25T08:59:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc98ecd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc941619d0 con 0x7efc941f3c40 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc940cef60 0x7efc9415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc940cef60 0x7efc9415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39934/0 (socket says 172.21.15.5:39934) 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 -- 172.21.15.5:0/354003905 learned_addr learned my addr 172.21.15.5:0/354003905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc92d9d640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc941f40a0 0x7efc940aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc89d9b640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc941f3c40 0x7efc940aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 -- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc941f3c40 msgr2=0x7efc940aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc941f3c40 0x7efc940aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 -- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc941f40a0 msgr2=0x7efc940aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc941f40a0 0x7efc940aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc9259c640 1 -- 172.21.15.5:0/354003905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9415d330 con 0x7efc940cef60 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc89d9b640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc941f3c40 0x7efc940aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.903+0000 7efc92d9d640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc941f40a0 0x7efc940aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.904+0000 7efc9259c640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc940cef60 0x7efc9415cdf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efc8400f820 tx=0x7efc8400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.904+0000 7efc8b7fe640 1 -- 172.21.15.5:0/354003905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840052e0 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.904+0000 7efc8b7fe640 1 -- 172.21.15.5:0/354003905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84018070 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.904+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc940b3e30 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.904+0000 7efc8b7fe640 1 -- 172.21.15.5:0/354003905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400d910 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.904+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc940b43f0 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.905+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9404ef20 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.905+0000 7efc8b7fe640 1 -- 172.21.15.5:0/354003905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc8400dab0 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.906+0000 7efc8b7fe640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc7406b4d0 0x7efc7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.906+0000 7efc8b7fe640 1 -- 172.21.15.5:0/354003905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc8408a130 con 0x7efc940cef60 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.906+0000 7efc89d9b640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc7406b4d0 0x7efc7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.907+0000 7efc89d9b640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc7406b4d0 0x7efc7406d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efc9415d810 tx=0x7efc7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:16.910+0000 7efc8b7fe640 1 -- 172.21.15.5:0/354003905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc84058fb0 con 0x7efc940cef60 2024-04-25T08:59:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.092+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc940d3620 con 0x7efc940cef60 2024-04-25T08:59:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.093+0000 7efc8b7fe640 1 -- 172.21.15.5:0/354003905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16542 (secure 0 0 0) 0x7efc840588b0 con 0x7efc940cef60 2024-04-25T08:59:17.083 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:17.083 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:15.812585+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:14.076773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:14.788001+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc7406b4d0 msgr2=0x7efc7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc7406b4d0 0x7efc7406d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efc9415d810 tx=0x7efc7c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc940cef60 msgr2=0x7efc9415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc940cef60 0x7efc9415cdf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efc8400f820 tx=0x7efc8400fce0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 shutdown_connections 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc7406b4d0 0x7efc7406d990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc941f40a0 0x7efc940aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc941f3c40 0x7efc940aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 --2- 172.21.15.5:0/354003905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc940cef60 0x7efc9415cdf0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 >> 172.21.15.5:0/354003905 conn(0x7efc940668f0 msgr2=0x7efc940d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 shutdown_connections 2024-04-25T08:59:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.095+0000 7efc98ecd640 1 -- 172.21.15.5:0/354003905 wait complete. 2024-04-25T08:59:17.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:59:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.211+0000 7f2e7e5f9640 1 Processor -- start 2024-04-25T08:59:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.211+0000 7f2e7e5f9640 1 -- start start 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7e5f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e780ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7e5f9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e780ced50 0x7f2e780b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7e5f9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e780d1ed0 con 0x7f2e7815df70 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7e5f9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e780d1c80 con 0x7f2e780ced50 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7e5f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780d2ae0 con 0x7f2e780d2f70 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e777fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e780ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7cb96640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e780ced50 0x7f2e780b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e777fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e780ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:56258/0 (socket says 172.21.15.5:56258) 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7cb96640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e780ced50 0x7f2e780b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:45654/0 (socket says 172.21.15.5:45654) 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e777fe640 1 -- 172.21.15.5:0/1775295202 learned_addr learned my addr 172.21.15.5:0/1775295202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e77fff640 1 --1- 172.21.15.5:0/1775295202 >> v1:172.21.15.80:6789/0 conn(0x7f2e7815df70 0x7f2e780b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:36222/0 (socket says 172.21.15.5:36222) 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7cb96640 1 -- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 msgr2=0x7f2e780ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7cb96640 1 --2- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e780ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7cb96640 1 -- 172.21.15.5:0/1775295202 >> v1:172.21.15.80:6789/0 conn(0x7f2e7815df70 legacy=0x7f2e780b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e7cb96640 1 -- 172.21.15.5:0/1775295202 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780d21b0 con 0x7f2e780ced50 2024-04-25T08:59:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.212+0000 7f2e777fe640 1 --2- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e780ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.213+0000 7f2e7cb96640 1 --2- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e780ced50 0x7f2e780b6c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009d90 tx=0x7f2e7002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8234167c4acf0ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.213+0000 7f2e76ffd640 1 -- 172.21.15.5:0/1775295202 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70007740 con 0x7f2e780ced50 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.213+0000 7f2e76ffd640 1 -- 172.21.15.5:0/1775295202 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e700078e0 con 0x7f2e780ced50 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.213+0000 7f2e76ffd640 1 -- 172.21.15.5:0/1775295202 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70007cb0 con 0x7f2e780ced50 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e780ced50 msgr2=0x7f2e780b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e780ced50 0x7f2e780b6c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009d90 tx=0x7f2e7002a6f0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/1775295202 shutdown_connections 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e780ced50 0x7f2e780b6c50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/1775295202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e780ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/1775295202 >> 172.21.15.5:0/1775295202 conn(0x7f2e7806b000 msgr2=0x7f2e7806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/1775295202 shutdown_connections 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.214+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/1775295202 wait complete. 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.215+0000 7f2e7e5f9640 1 Processor -- start 2024-04-25T08:59:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.215+0000 7f2e7e5f9640 1 -- start start 2024-04-25T08:59:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7e5f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e780ced50 0x7f2e781545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7e5f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e781f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7e5f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e78154c30 0x7f2e780cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7e5f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780d3720 con 0x7f2e780ced50 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7e5f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780d2770 con 0x7f2e78154c30 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7e5f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780d38a0 con 0x7f2e780d2f70 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e780ced50 0x7f2e781545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e780ced50 0x7f2e781545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39942/0 (socket says 172.21.15.5:39942) 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 -- 172.21.15.5:0/3933525681 learned_addr learned my addr 172.21.15.5:0/3933525681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7cb96640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e78154c30 0x7f2e780cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e777fe640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e781f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 -- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 msgr2=0x7f2e781f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e781f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 -- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e78154c30 msgr2=0x7f2e780cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e78154c30 0x7f2e780cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e77fff640 1 -- 172.21.15.5:0/3933525681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e781f82e0 con 0x7f2e780ced50 2024-04-25T08:59:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e7cb96640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e78154c30 0x7f2e780cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.216+0000 7f2e777fe640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e781f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.217+0000 7f2e77fff640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e780ced50 0x7f2e781545e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c400 tx=0x7f2e6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.217+0000 7f2e74ff9640 1 -- 172.21.15.5:0/3933525681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680074e0 con 0x7f2e780ced50 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.217+0000 7f2e74ff9640 1 -- 172.21.15.5:0/3933525681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68007680 con 0x7f2e780ced50 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.217+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e78160710 con 0x7f2e780ced50 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.217+0000 7f2e74ff9640 1 -- 172.21.15.5:0/3933525681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68004a00 con 0x7f2e780ced50 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.217+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7815e4e0 con 0x7f2e780ced50 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.218+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7804ef20 con 0x7f2e780ced50 2024-04-25T08:59:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.218+0000 7f2e74ff9640 1 -- 172.21.15.5:0/3933525681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e6801a020 con 0x7f2e780ced50 2024-04-25T08:59:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.219+0000 7f2e74ff9640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6406b4d0 0x7f2e6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.219+0000 7f2e74ff9640 1 -- 172.21.15.5:0/3933525681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e68089990 con 0x7f2e780ced50 2024-04-25T08:59:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.219+0000 7f2e777fe640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6406b4d0 0x7f2e6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.219+0000 7f2e777fe640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6406b4d0 0x7f2e6406d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2e78160590 tx=0x7f2e6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.223+0000 7f2e74ff9640 1 -- 172.21.15.5:0/3933525681 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e781f82e0 con 0x7f2e780ced50 2024-04-25T08:59:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.444+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e780c8f10 con 0x7f2e780ced50 2024-04-25T08:59:17.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.450+0000 7f2e74ff9640 1 -- 172.21.15.5:0/3933525681 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e680588a0 con 0x7f2e780ced50 2024-04-25T08:59:17.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6406b4d0 msgr2=0x7f2e6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6406b4d0 0x7f2e6406d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2e78160590 tx=0x7f2e6c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:17.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e780ced50 msgr2=0x7f2e781545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e780ced50 0x7f2e781545e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c400 tx=0x7f2e6800c8c0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 shutdown_connections 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6406b4d0 0x7f2e6406d990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e78154c30 0x7f2e780cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e780d2f70 0x7f2e781f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 --2- 172.21.15.5:0/3933525681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e780ced50 0x7f2e781545e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 >> 172.21.15.5:0/3933525681 conn(0x7f2e7806b000 msgr2=0x7f2e780c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 shutdown_connections 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.453+0000 7f2e7e5f9640 1 -- 172.21.15.5:0/3933525681 wait complete. 2024-04-25T08:59:17.455 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:59:17.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:59:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.568+0000 7f49205d5640 1 Processor -- start 2024-04-25T08:59:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.568+0000 7f49205d5640 1 -- start start 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.569+0000 7f49205d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 0x7f49181618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.569+0000 7f49205d5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4918162150 con 0x7f49180b6250 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.569+0000 7f49205d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4918162430 con 0x7f49180cefe0 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.569+0000 7f49205d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49180d20d0 con 0x7f491815df10 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.569+0000 7f491db70640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49180b6250 0x7f49180ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37866/0 (socket says 172.21.15.5:37866) 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.569+0000 7f491db70640 1 -- 172.21.15.5:0/3694624607 learned_addr learned my addr 172.21.15.5:0/3694624607 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576446874 0 0) 0x7f4918162150 con 0x7f49180b6250 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4900003520 con 0x7f49180b6250 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491e371640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 0x7f49181618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2841921574 0 0) 0x7f4900003520 con 0x7f49180b6250 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 msgr2=0x7f49181618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 0x7f49181618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 >> v1:172.21.15.80:6789/0 conn(0x7f49180cefe0 legacy=0x7f49180d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4918162710 con 0x7f49180b6250 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f490c001670 con 0x7f49180b6250 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 >> v1:172.21.15.5:6789/0 conn(0x7f49180b6250 legacy=0x7f49180ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49000039e0 0x7f4900003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 0x7f4900004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4900004d40 0x7f49000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180d20d0 con 0x7f49000039e0 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490000bb50 con 0x7f4900004d40 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490000bd20 con 0x7f491815df10 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491e371640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49000039e0 0x7f4900003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491db70640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 0x7f4900004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491eb72640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4900004d40 0x7f49000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491e371640 1 -- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 msgr2=0x7f4900004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491e371640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f491815df10 0x7f4900004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491e371640 1 -- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4900004d40 msgr2=0x7f49000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491e371640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4900004d40 0x7f49000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.570+0000 7f491e371640 1 -- 172.21.15.5:0/3694624607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4900003520 con 0x7f49000039e0 2024-04-25T08:59:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.571+0000 7f491e371640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49000039e0 0x7f4900003e00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4908007390 tx=0x7f4900005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3aecab7024dcbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.571+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908009be0 con 0x7f49000039e0 2024-04-25T08:59:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.571+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490802e620 con 0x7f49000039e0 2024-04-25T08:59:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.571+0000 7f491d36f640 1 -- 172.21.15.5:0/3694624607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490802e9f0 con 0x7f49000039e0 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.572+0000 7f49205d5640 1 -- 172.21.15.5:0/3694624607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49000039e0 msgr2=0x7f4900003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.572+0000 7f49205d5640 1 --2- 172.21.15.5:0/3694624607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49000039e0 0x7f4900003e00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4908007390 tx=0x7f4900005830 comp rx=0 tx=0).stop 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.572+0000 7f491eb72640 1 -- 172.21.15.5:0/3694624607 reap_dead start 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.572+0000 7f49205d5640 1 -- 172.21.15.5:0/3694624607 shutdown_connections 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.572+0000 7f49205d5640 1 -- 172.21.15.5:0/3694624607 >> 172.21.15.5:0/3694624607 conn(0x7f49180668f0 msgr2=0x7f4918066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.572+0000 7f49205d5640 1 -- 172.21.15.5:0/3694624607 shutdown_connections 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.572+0000 7f49205d5640 1 -- 172.21.15.5:0/3694624607 wait complete. 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.573+0000 7f49205d5640 1 Processor -- start 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.573+0000 7f49205d5640 1 -- start start 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f49205d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49000039e0 0x7f4918160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f49205d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4918156d30 0x7f49181565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f49205d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49180cc6f0 0x7f49180ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f49205d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918161a50 con 0x7f49180cc6f0 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f49205d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49181618d0 con 0x7f49000039e0 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f49205d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4918161bd0 con 0x7f4918156d30 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49180cc6f0 0x7f49180ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49180cc6f0 0x7f49180ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39962/0 (socket says 172.21.15.5:39962) 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 -- 172.21.15.5:0/3209777564 learned_addr learned my addr 172.21.15.5:0/3209777564 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491e371640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49000039e0 0x7f4918160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491db70640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4918156d30 0x7f49181565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 -- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4918156d30 msgr2=0x7f49181565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4918156d30 0x7f49181565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 -- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49000039e0 msgr2=0x7f4918160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49000039e0 0x7f4918160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 -- 172.21.15.5:0/3209777564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49181575b0 con 0x7f49180cc6f0 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491e371640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49000039e0 0x7f4918160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491db70640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4918156d30 0x7f49181565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.574+0000 7f491eb72640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49180cc6f0 0x7f49180ccb70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4918072dc0 tx=0x7f491000f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.575+0000 7f4916ffd640 1 -- 172.21.15.5:0/3209777564 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49100053a0 con 0x7f49180cc6f0 2024-04-25T08:59:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.575+0000 7f4916ffd640 1 -- 172.21.15.5:0/3209777564 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910018070 con 0x7f49180cc6f0 2024-04-25T08:59:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.575+0000 7f4916ffd640 1 -- 172.21.15.5:0/3209777564 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910003830 con 0x7f49180cc6f0 2024-04-25T08:59:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.575+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4918161160 con 0x7f49180cc6f0 2024-04-25T08:59:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.575+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4918160e80 con 0x7f49180cc6f0 2024-04-25T08:59:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.576+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491804ef20 con 0x7f49180cc6f0 2024-04-25T08:59:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.576+0000 7f4916ffd640 1 -- 172.21.15.5:0/3209777564 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49100039d0 con 0x7f49180cc6f0 2024-04-25T08:59:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.576+0000 7f4916ffd640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f490406b500 0x7f490406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.577+0000 7f4916ffd640 1 -- 172.21.15.5:0/3209777564 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4910089ce0 con 0x7f49180cc6f0 2024-04-25T08:59:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.577+0000 7f491e371640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f490406b500 0x7f490406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.577+0000 7f491e371640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f490406b500 0x7f490406d9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4908035000 tx=0x7f4908038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.581+0000 7f4916ffd640 1 -- 172.21.15.5:0/3209777564 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49181575b0 con 0x7f49180cc6f0 2024-04-25T08:59:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:17.798+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49180b8560 con 0x7f49180cc6f0 2024-04-25T08:59:18.418 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-04-25T08:59:18.428+0000 7f6f4e368640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:59:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.459+0000 7f4916ffd640 1 -- 172.21.15.5:0/3209777564 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4910058b60 con 0x7f49180cc6f0 2024-04-25T08:59:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f490406b500 msgr2=0x7f490406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f490406b500 0x7f490406d9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4908035000 tx=0x7f4908038040 comp rx=0 tx=0).stop 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49180cc6f0 msgr2=0x7f49180ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49180cc6f0 0x7f49180ccb70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4918072dc0 tx=0x7f491000f920 comp rx=0 tx=0).stop 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 shutdown_connections 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f490406b500 0x7f490406d9c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49180cc6f0 0x7f49180ccb70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4918156d30 0x7f49181565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 --2- 172.21.15.5:0/3209777564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49000039e0 0x7f4918160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 >> 172.21.15.5:0/3209777564 conn(0x7f49180668f0 msgr2=0x7f49180d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 shutdown_connections 2024-04-25T08:59:18.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.462+0000 7f49205d5640 1 -- 172.21.15.5:0/3209777564 wait complete. 2024-04-25T08:59:18.465 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:59:18.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.583+0000 7f5a31bc4640 1 Processor -- start 2024-04-25T08:59:18.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.583+0000 7f5a31bc4640 1 -- start start 2024-04-25T08:59:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a31bc4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a2c15e0a0 0x7f5a2c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a31bc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a2c0d3990 0x7f5a2c0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a31bc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a31bc4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0d4330 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a31bc4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0b29c0 con 0x7f5a2c0d3990 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a31bc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0d2080 con 0x7f5a2c0ce5e0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a2c15e0a0 0x7f5a2c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a2c15e0a0 0x7f5a2c0d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39968/0 (socket says 172.21.15.5:39968) 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 -- 172.21.15.5:0/2586562550 learned_addr learned my addr 172.21.15.5:0/2586562550 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2affd640 1 --2- 172.21.15.5:0/2586562550 >> v2:172.21.15.80:3300/0 conn(0x7f5a2c0d3990 0x7f5a2c0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2bfff640 1 --2- 172.21.15.5:0/2586562550 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 -- 172.21.15.5:0/2586562550 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0ce5e0 msgr2=0x7f5a2c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 --2- 172.21.15.5:0/2586562550 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 -- 172.21.15.5:0/2586562550 >> v2:172.21.15.80:3300/0 conn(0x7f5a2c0d3990 msgr2=0x7f5a2c0d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 --2- 172.21.15.5:0/2586562550 >> v2:172.21.15.80:3300/0 conn(0x7f5a2c0d3990 0x7f5a2c0d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.584+0000 7f5a2b7fe640 1 -- 172.21.15.5:0/2586562550 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0d2360 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.585+0000 7f5a2b7fe640 1 --2- 172.21.15.5:0/2586562550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c0d0d50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0676e0 tx=0x7f5a1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f877b5b717d26b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.585+0000 7f5a2a7fc640 1 -- 172.21.15.5:0/2586562550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c037070 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.585+0000 7f5a2a7fc640 1 -- 172.21.15.5:0/2586562550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c032440 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.585+0000 7f5a2a7fc640 1 -- 172.21.15.5:0/2586562550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c032810 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 -- 172.21.15.5:0/2586562550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 msgr2=0x7f5a2c0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/2586562550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c0d0d50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0676e0 tx=0x7f5a1c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 -- 172.21.15.5:0/2586562550 shutdown_connections 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/2586562550 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/2586562550 >> v2:172.21.15.80:3300/0 conn(0x7f5a2c0d3990 0x7f5a2c0d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/2586562550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c0d0d50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 -- 172.21.15.5:0/2586562550 >> 172.21.15.5:0/2586562550 conn(0x7f5a2c0668f0 msgr2=0x7f5a2c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 -- 172.21.15.5:0/2586562550 shutdown_connections 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.586+0000 7f5a31bc4640 1 -- 172.21.15.5:0/2586562550 wait complete. 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.587+0000 7f5a31bc4640 1 Processor -- start 2024-04-25T08:59:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.587+0000 7f5a31bc4640 1 -- start start 2024-04-25T08:59:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a31bc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a31bc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0d3990 0x7f5a2c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a31bc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a31bc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0d2c00 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a31bc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0d2920 con 0x7f5a2c0ce5e0 2024-04-25T08:59:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a31bc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c15e480 con 0x7f5a2c0d3990 2024-04-25T08:59:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39984/0 (socket says 172.21.15.5:39984) 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 -- 172.21.15.5:0/3133492386 learned_addr learned my addr 172.21.15.5:0/3133492386 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2b7fe640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2affd640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0d3990 0x7f5a2c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 -- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0d3990 msgr2=0x7f5a2c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0d3990 0x7f5a2c0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 -- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a2c0ce5e0 msgr2=0x7f5a2c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2bfff640 1 -- 172.21.15.5:0/3133492386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0b5280 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.588+0000 7f5a2affd640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0d3990 0x7f5a2c0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.589+0000 7f5a2bfff640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c159a60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007d50 tx=0x7f5a2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.589+0000 7f5a13fff640 1 -- 172.21.15.5:0/3133492386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24014420 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.589+0000 7f5a13fff640 1 -- 172.21.15.5:0/3133492386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24019070 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.589+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c1f7140 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.589+0000 7f5a13fff640 1 -- 172.21.15.5:0/3133492386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24014820 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.589+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c0ce310 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.590+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c04ef20 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.590+0000 7f5a13fff640 1 -- 172.21.15.5:0/3133492386 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a240149c0 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.591+0000 7f5a13fff640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5a1806b4d0 0x7f5a1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.591+0000 7f5a13fff640 1 -- 172.21.15.5:0/3133492386 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a2408aa10 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.591+0000 7f5a2b7fe640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5a1806b4d0 0x7f5a1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.591+0000 7f5a2b7fe640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5a1806b4d0 0x7f5a1806d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c034000 tx=0x7f5a1c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.595+0000 7f5a13fff640 1 -- 172.21.15.5:0/3133492386 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a24059890 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.811+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a2c159fa0 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.811+0000 7f5a13fff640 1 -- 172.21.15.5:0/3133492386 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f5a24059190 con 0x7f5a2c15e0a0 2024-04-25T08:59:18.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:18.801 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:18.801 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5a1806b4d0 msgr2=0x7f5a1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5a1806b4d0 0x7f5a1806d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c034000 tx=0x7f5a1c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 msgr2=0x7f5a2c159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c159a60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007d50 tx=0x7f5a2400e4b0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 shutdown_connections 2024-04-25T08:59:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5a1806b4d0 0x7f5a1806d990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2c15e0a0 0x7f5a2c159a60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5a2c0d3990 0x7f5a2c0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 --2- 172.21.15.5:0/3133492386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a2c0ce5e0 0x7f5a2c0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 >> 172.21.15.5:0/3133492386 conn(0x7f5a2c0668f0 msgr2=0x7f5a2c15e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 shutdown_connections 2024-04-25T08:59:18.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.813+0000 7f5a31bc4640 1 -- 172.21.15.5:0/3133492386 wait complete. 2024-04-25T08:59:18.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:18.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.925+0000 7ff219769640 1 Processor -- start 2024-04-25T08:59:18.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.925+0000 7ff219769640 1 -- start start 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff219769640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2140cfd80 0x7ff21415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff219769640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff21415c620 0x7ff2140b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff219769640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21406d280 con 0x7ff2140cc120 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff219769640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21406c4c0 con 0x7ff2140cfd80 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff219769640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21406c7a0 con 0x7ff21415c620 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff2127fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2140cfd80 0x7ff21415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff212ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2140cc120 0x7ff2140cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37874/0 (socket says 172.21.15.5:37874) 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff212ffd640 1 -- 172.21.15.5:0/454470448 learned_addr learned my addr 172.21.15.5:0/454470448 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff2127fc640 1 -- 172.21.15.5:0/454470448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff21415c620 msgr2=0x7ff2140b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff2137fe640 1 --2- 172.21.15.5:0/454470448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff21415c620 0x7ff2140b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff2127fc640 1 --2- 172.21.15.5:0/454470448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff21415c620 0x7ff2140b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff2127fc640 1 -- 172.21.15.5:0/454470448 >> v1:172.21.15.5:6789/0 conn(0x7ff2140cc120 legacy=0x7ff2140cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff211ffb640 1 -- 172.21.15.5:0/454470448 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241432831 0 0) 0x7ff21406d280 con 0x7ff2140cc120 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff2127fc640 1 -- 172.21.15.5:0/454470448 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21406ca80 con 0x7ff2140cfd80 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.926+0000 7ff2137fe640 1 --2- 172.21.15.5:0/454470448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff21415c620 0x7ff2140b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.927+0000 7ff2127fc640 1 --2- 172.21.15.5:0/454470448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2140cfd80 0x7ff21415c0e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff2080097a0 tx=0x7ff20802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd160c3830cd2e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.927+0000 7ff211ffb640 1 -- 172.21.15.5:0/454470448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208037070 con 0x7ff2140cfd80 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.927+0000 7ff211ffb640 1 -- 172.21.15.5:0/454470448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208032440 con 0x7ff2140cfd80 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.927+0000 7ff211ffb640 1 -- 172.21.15.5:0/454470448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208032810 con 0x7ff2140cfd80 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 -- 172.21.15.5:0/454470448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2140cfd80 msgr2=0x7ff21415c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 --2- 172.21.15.5:0/454470448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2140cfd80 0x7ff21415c0e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff2080097a0 tx=0x7ff20802a180 comp rx=0 tx=0).stop 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 -- 172.21.15.5:0/454470448 shutdown_connections 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 --2- 172.21.15.5:0/454470448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff21415c620 0x7ff2140b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 --2- 172.21.15.5:0/454470448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2140cfd80 0x7ff21415c0e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 -- 172.21.15.5:0/454470448 >> 172.21.15.5:0/454470448 conn(0x7ff2140668f0 msgr2=0x7ff214066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 -- 172.21.15.5:0/454470448 shutdown_connections 2024-04-25T08:59:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.928+0000 7ff219769640 1 -- 172.21.15.5:0/454470448 wait complete. 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.929+0000 7ff219769640 1 Processor -- start 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.929+0000 7ff219769640 1 -- start start 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff219769640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2140cc120 0x7ff21413d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff219769640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff2140cfd80 0x7ff2141f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff219769640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff21415c620 0x7ff2141f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff219769640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140cc500 con 0x7ff21415c620 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff219769640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21415ce50 con 0x7ff2140cc120 2024-04-25T08:59:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff219769640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140cc680 con 0x7ff2140cfd80 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff21415c620 0x7ff2141f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff21415c620 0x7ff2141f3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40010/0 (socket says 172.21.15.5:40010) 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 -- 172.21.15.5:0/3245136603 learned_addr learned my addr 172.21.15.5:0/3245136603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff212ffd640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2140cc120 0x7ff21413d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2127fc640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff2140cfd80 0x7ff2141f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 -- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff2140cfd80 msgr2=0x7ff2141f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff2140cfd80 0x7ff2141f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 -- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2140cc120 msgr2=0x7ff21413d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2140cc120 0x7ff21413d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff2137fe640 1 -- 172.21.15.5:0/3245136603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2141f4110 con 0x7ff21415c620 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.930+0000 7ff212ffd640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2140cc120 0x7ff21413d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.931+0000 7ff2137fe640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff21415c620 0x7ff2141f3af0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff20400cf20 tx=0x7ff20400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.931+0000 7ff1fb7fe640 1 -- 172.21.15.5:0/3245136603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20401a070 con 0x7ff21415c620 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.931+0000 7ff1fb7fe640 1 -- 172.21.15.5:0/3245136603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400d840 con 0x7ff21415c620 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.931+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2141f43f0 con 0x7ff21415c620 2024-04-25T08:59:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.931+0000 7ff1fb7fe640 1 -- 172.21.15.5:0/3245136603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400dc30 con 0x7ff21415c620 2024-04-25T08:59:18.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.931+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2141f4cb0 con 0x7ff21415c620 2024-04-25T08:59:18.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.932+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2141f47e0 con 0x7ff21415c620 2024-04-25T08:59:18.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.932+0000 7ff1fb7fe640 1 -- 172.21.15.5:0/3245136603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff20401d070 con 0x7ff21415c620 2024-04-25T08:59:18.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.933+0000 7ff1fb7fe640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20006b4d0 0x7ff20006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.933+0000 7ff1fb7fe640 1 -- 172.21.15.5:0/3245136603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff20408ab30 con 0x7ff21415c620 2024-04-25T08:59:18.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.933+0000 7ff212ffd640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20006b4d0 0x7ff20006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.933+0000 7ff212ffd640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20006b4d0 0x7ff20006d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000f60 tx=0x7ff20c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:18.937+0000 7ff1fb7fe640 1 -- 172.21.15.5:0/3245136603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2040599a0 con 0x7ff21415c620 2024-04-25T08:59:19.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.118+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff21404ef20 con 0x7ff21415c620 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.119+0000 7ff1fb7fe640 1 -- 172.21.15.5:0/3245136603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16529 (secure 0 0 0) 0x7ff2040592a0 con 0x7ff21415c620 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":44,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:17.451178+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:14.076773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:14.788001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20006b4d0 msgr2=0x7ff20006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20006b4d0 0x7ff20006d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000f60 tx=0x7ff20c009040 comp rx=0 tx=0).stop 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff21415c620 msgr2=0x7ff2141f3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff21415c620 0x7ff2141f3af0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff20400cf20 tx=0x7ff20400a7d0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 shutdown_connections 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20006b4d0 0x7ff20006d990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff21415c620 0x7ff2141f3af0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff2140cfd80 0x7ff2141f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 --2- 172.21.15.5:0/3245136603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2140cc120 0x7ff21413d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 >> 172.21.15.5:0/3245136603 conn(0x7ff2140668f0 msgr2=0x7ff2140cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 shutdown_connections 2024-04-25T08:59:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.121+0000 7ff219769640 1 -- 172.21.15.5:0/3245136603 wait complete. 2024-04-25T08:59:19.122 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:59:19.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:19.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.233+0000 7f86e526b640 1 Processor -- start 2024-04-25T08:59:19.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.233+0000 7f86e526b640 1 -- start start 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86e526b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e00afe80 0x7f86e00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86e526b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e006f160 con 0x7f86e0071b00 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86e526b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00b3820 con 0x7f86e006e610 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86e526b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00b0260 con 0x7f86e00afe80 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86deffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e00afe80 0x7f86e00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86df7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86e0071b00 0x7f86e00cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37880/0 (socket says 172.21.15.5:37880) 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86df7fe640 1 -- 172.21.15.5:0/3289483913 learned_addr learned my addr 172.21.15.5:0/3289483913 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.234+0000 7f86deffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86e00afe80 0x7f86e00b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40024/0 (socket says 172.21.15.5:40024) 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86deffd640 1 -- 172.21.15.5:0/3289483913 >> v1:172.21.15.80:6789/0 conn(0x7f86e006e610 legacy=0x7f86e00713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:19.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86deffd640 1 -- 172.21.15.5:0/3289483913 >> v1:172.21.15.5:6789/0 conn(0x7f86e0071b00 legacy=0x7f86e00cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86ddffb640 1 -- 172.21.15.5:0/3289483913 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062040634 0 0) 0x7f86e006f160 con 0x7f86e0071b00 2024-04-25T08:59:19.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86deffd640 1 -- 172.21.15.5:0/3289483913 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00b3b00 con 0x7f86e00afe80 2024-04-25T08:59:19.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86deffd640 1 --2- 172.21.15.5:0/3289483913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e00afe80 0x7f86e00b45e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f86d800ba40 tx=0x7f86d802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774bcd764612618 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86ddffb640 1 -- 172.21.15.5:0/3289483913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8032770 con 0x7f86e00afe80 2024-04-25T08:59:19.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86ddffb640 1 -- 172.21.15.5:0/3289483913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8038070 con 0x7f86e00afe80 2024-04-25T08:59:19.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.235+0000 7f86ddffb640 1 -- 172.21.15.5:0/3289483913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8032b30 con 0x7f86e00afe80 2024-04-25T08:59:19.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.236+0000 7f86e526b640 1 -- 172.21.15.5:0/3289483913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e00afe80 msgr2=0x7f86e00b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.236+0000 7f86e526b640 1 --2- 172.21.15.5:0/3289483913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e00afe80 0x7f86e00b45e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f86d800ba40 tx=0x7f86d802c8b0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.236+0000 7f86e526b640 1 -- 172.21.15.5:0/3289483913 shutdown_connections 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.236+0000 7f86e526b640 1 --2- 172.21.15.5:0/3289483913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e00afe80 0x7f86e00b45e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.236+0000 7f86e526b640 1 -- 172.21.15.5:0/3289483913 >> 172.21.15.5:0/3289483913 conn(0x7f86e00d0870 msgr2=0x7f86e00d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.236+0000 7f86e526b640 1 -- 172.21.15.5:0/3289483913 shutdown_connections 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.236+0000 7f86e526b640 1 -- 172.21.15.5:0/3289483913 wait complete. 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.237+0000 7f86e526b640 1 Processor -- start 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.237+0000 7f86e526b640 1 -- start start 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86e526b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86e006e610 0x7f86e014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86e526b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e0071b00 0x7f86e015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86e526b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00afe80 0x7f86e015d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86e526b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015f2b0 con 0x7f86e0071b00 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86e526b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b40c0 con 0x7f86e00afe80 2024-04-25T08:59:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86e526b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e006ea50 con 0x7f86e006e610 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e0071b00 0x7f86e015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e0071b00 0x7f86e015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40030/0 (socket says 172.21.15.5:40030) 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 -- 172.21.15.5:0/771524614 learned_addr learned my addr 172.21.15.5:0/771524614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 -- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86e006e610 msgr2=0x7f86e014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86df7fe640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00afe80 0x7f86e015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86e006e610 0x7f86e014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 -- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00afe80 msgr2=0x7f86e015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00afe80 0x7f86e015d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.238+0000 7f86de7fc640 1 -- 172.21.15.5:0/771524614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0151ff0 con 0x7f86e0071b00 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.239+0000 7f86de7fc640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e0071b00 0x7f86e015d250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c460 tx=0x7f86d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.239+0000 7f86c77fe640 1 -- 172.21.15.5:0/771524614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4016020 con 0x7f86e0071b00 2024-04-25T08:59:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.239+0000 7f86c77fe640 1 -- 172.21.15.5:0/771524614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4012870 con 0x7f86e0071b00 2024-04-25T08:59:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.239+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e0150f50 con 0x7f86e0071b00 2024-04-25T08:59:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.239+0000 7f86c77fe640 1 -- 172.21.15.5:0/771524614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4012c60 con 0x7f86e0071b00 2024-04-25T08:59:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.239+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e0151510 con 0x7f86e0071b00 2024-04-25T08:59:19.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.240+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e004ef20 con 0x7f86e0071b00 2024-04-25T08:59:19.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.240+0000 7f86c77fe640 1 -- 172.21.15.5:0/771524614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f86d4019020 con 0x7f86e0071b00 2024-04-25T08:59:19.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.241+0000 7f86c77fe640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86cc06b4d0 0x7f86cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.241+0000 7f86c77fe640 1 -- 172.21.15.5:0/771524614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86d4089c50 con 0x7f86e0071b00 2024-04-25T08:59:19.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.241+0000 7f86deffd640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86cc06b4d0 0x7f86cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.241+0000 7f86deffd640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86cc06b4d0 0x7f86cc06d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86d8037000 tx=0x7f86d8031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.245+0000 7f86c77fe640 1 -- 172.21.15.5:0/771524614 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f86d408f020 con 0x7f86e0071b00 2024-04-25T08:59:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.425+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86e015a8c0 con 0x7f86cc06b4d0 2024-04-25T08:59:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.431+0000 7f86c77fe640 1 -- 172.21.15.5:0/771524614 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246640 (secure 0 0 0) 0x7f86e015a8c0 con 0x7f86cc06b4d0 2024-04-25T08:59:19.424 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:19.426 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86cc06b4d0 msgr2=0x7f86cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86cc06b4d0 0x7f86cc06d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86d8037000 tx=0x7f86d8031000 comp rx=0 tx=0).stop 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e0071b00 msgr2=0x7f86e015d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e0071b00 0x7f86e015d250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c460 tx=0x7f86d400c920 comp rx=0 tx=0).stop 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 shutdown_connections 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86cc06b4d0 0x7f86cc06d990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00afe80 0x7f86e015d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e0071b00 0x7f86e015d250 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 --2- 172.21.15.5:0/771524614 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86e006e610 0x7f86e014dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 >> 172.21.15.5:0/771524614 conn(0x7f86e00d0870 msgr2=0x7f86e00d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 shutdown_connections 2024-04-25T08:59:19.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.435+0000 7f86e526b640 1 -- 172.21.15.5:0/771524614 wait complete. 2024-04-25T08:59:19.435 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-04-25T08:59:18.421424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":296076,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754678644,"statfs":{"total":773094113280,"available":772790931456,"internally_reserved":0,"allocated":5120000,"data_stored":2756064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000898"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450204+0000","last_change":"2024-04-25T08:59:15.450204+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450204+0000","last_undegraded":"2024-04-25T08:59:15.450204+0000","last_fullsized":"2024-04-25T08:59:15.450204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447164+0000","last_change":"2024-04-25T08:59:15.447164+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447164+0000","last_undegraded":"2024-04-25T08:59:15.447164+0000","last_fullsized":"2024-04-25T08:59:15.447164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447632+0000","last_change":"2024-04-25T08:59:15.447632+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447632+0000","last_undegraded":"2024-04-25T08:59:15.447632+0000","last_fullsized":"2024-04-25T08:59:15.447632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455436+0000","last_change":"2024-04-25T08:59:15.455436+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455436+0000","last_undegraded":"2024-04-25T08:59:15.455436+0000","last_fullsized":"2024-04-25T08:59:15.455436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446623+0000","last_change":"2024-04-25T08:59:15.446623+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446623+0000","last_undegraded":"2024-04-25T08:59:15.446623+0000","last_fullsized":"2024-04-25T08:59:15.446623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450196+0000","last_change":"2024-04-25T08:59:15.450196+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450196+0000","last_undegraded":"2024-04-25T08:59:15.450196+0000","last_fullsized":"2024-04-25T08:59:15.450196+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450609+0000","last_change":"2024-04-25T08:59:15.450609+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450609+0000","last_undegraded":"2024-04-25T08:59:15.450609+0000","last_fullsized":"2024-04-25T08:59:15.450609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458814+0000","last_change":"2024-04-25T08:59:15.458814+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458814+0000","last_undegraded":"2024-04-25T08:59:15.458814+0000","last_fullsized":"2024-04-25T08:59:15.458814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457592+0000","last_change":"2024-04-25T08:59:15.457592+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457592+0000","last_undegraded":"2024-04-25T08:59:15.457592+0000","last_fullsized":"2024-04-25T08:59:15.457592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458127+0000","last_change":"2024-04-25T08:59:15.458127+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458127+0000","last_undegraded":"2024-04-25T08:59:15.458127+0000","last_fullsized":"2024-04-25T08:59:15.458127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453510+0000","last_change":"2024-04-25T08:59:15.453510+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453510+0000","last_undegraded":"2024-04-25T08:59:15.453510+0000","last_fullsized":"2024-04-25T08:59:15.453510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449347+0000","last_change":"2024-04-25T08:59:15.449347+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449347+0000","last_undegraded":"2024-04-25T08:59:15.449347+0000","last_fullsized":"2024-04-25T08:59:15.449347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448863+0000","last_change":"2024-04-25T08:59:15.448863+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448863+0000","last_undegraded":"2024-04-25T08:59:15.448863+0000","last_fullsized":"2024-04-25T08:59:15.448863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457670+0000","last_change":"2024-04-25T08:59:15.457670+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457670+0000","last_undegraded":"2024-04-25T08:59:15.457670+0000","last_fullsized":"2024-04-25T08:59:15.457670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451968+0000","last_change":"2024-04-25T08:59:15.451968+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451968+0000","last_undegraded":"2024-04-25T08:59:15.451968+0000","last_fullsized":"2024-04-25T08:59:15.451968+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451484+0000","last_change":"2024-04-25T08:59:15.451484+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451484+0000","last_undegraded":"2024-04-25T08:59:15.451484+0000","last_fullsized":"2024-04-25T08:59:15.451484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447622+0000","last_change":"2024-04-25T08:59:15.447622+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447622+0000","last_undegraded":"2024-04-25T08:59:15.447622+0000","last_fullsized":"2024-04-25T08:59:15.447622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448174+0000","last_change":"2024-04-25T08:59:15.448174+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448174+0000","last_undegraded":"2024-04-25T08:59:15.448174+0000","last_fullsized":"2024-04-25T08:59:15.448174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453485+0000","last_change":"2024-04-25T08:59:15.453485+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453485+0000","last_undegraded":"2024-04-25T08:59:15.453485+0000","last_fullsized":"2024-04-25T08:59:15.453485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448909+0000","last_change":"2024-04-25T08:59:15.448909+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448909+0000","last_undegraded":"2024-04-25T08:59:15.448909+0000","last_fullsized":"2024-04-25T08:59:15.448909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453849+0000","last_change":"2024-04-25T08:59:15.453849+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453849+0000","last_undegraded":"2024-04-25T08:59:15.453849+0000","last_fullsized":"2024-04-25T08:59:15.453849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453681+0000","last_change":"2024-04-25T08:59:15.453681+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453681+0000","last_undegraded":"2024-04-25T08:59:15.453681+0000","last_fullsized":"2024-04-25T08:59:15.453681+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451908+0000","last_change":"2024-04-25T08:59:15.451908+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451908+0000","last_undegraded":"2024-04-25T08:59:15.451908+0000","last_fullsized":"2024-04-25T08:59:15.451908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450940+0000","last_change":"2024-04-25T08:59:15.450940+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450940+0000","last_undegraded":"2024-04-25T08:59:15.450940+0000","last_fullsized":"2024-04-25T08:59:15.450940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455830+0000","last_change":"2024-04-25T08:59:15.455830+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455830+0000","last_undegraded":"2024-04-25T08:59:15.455830+0000","last_fullsized":"2024-04-25T08:59:15.455830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448526+0000","last_change":"2024-04-25T08:59:15.448526+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448526+0000","last_undegraded":"2024-04-25T08:59:15.448526+0000","last_fullsized":"2024-04-25T08:59:15.448526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446067+0000","last_change":"2024-04-25T08:59:15.446067+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446067+0000","last_undegraded":"2024-04-25T08:59:15.446067+0000","last_fullsized":"2024-04-25T08:59:15.446067+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448874+0000","last_change":"2024-04-25T08:59:15.448874+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448874+0000","last_undegraded":"2024-04-25T08:59:15.448874+0000","last_fullsized":"2024-04-25T08:59:15.448874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452130+0000","last_change":"2024-04-25T08:59:15.452130+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452130+0000","last_undegraded":"2024-04-25T08:59:15.452130+0000","last_fullsized":"2024-04-25T08:59:15.452130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448605+0000","last_change":"2024-04-25T08:59:15.448605+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448605+0000","last_undegraded":"2024-04-25T08:59:15.448605+0000","last_fullsized":"2024-04-25T08:59:15.448605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451461+0000","last_change":"2024-04-25T08:59:15.451461+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451461+0000","last_undegraded":"2024-04-25T08:59:15.451461+0000","last_fullsized":"2024-04-25T08:59:15.451461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448014+0000","last_change":"2024-04-25T08:59:15.448014+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448014+0000","last_undegraded":"2024-04-25T08:59:15.448014+0000","last_fullsized":"2024-04-25T08:59:15.448014+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450414+0000","last_change":"2024-04-25T08:59:15.450414+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450414+0000","last_undegraded":"2024-04-25T08:59:15.450414+0000","last_fullsized":"2024-04-25T08:59:15.450414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463903+0000","last_change":"2024-04-25T08:59:15.459021+0000","last_active":"2024-04-25T08:59:15.463903+0000","last_peered":"2024-04-25T08:59:15.463903+0000","last_clean":"2024-04-25T08:59:15.463903+0000","last_became_active":"2024-04-25T08:59:15.458664+0000","last_became_peered":"2024-04-25T08:59:15.458664+0000","last_unstale":"2024-04-25T08:59:15.463903+0000","last_undegraded":"2024-04-25T08:59:15.463903+0000","last_fullsized":"2024-04-25T08:59:15.463903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455388+0000","last_change":"2024-04-25T08:59:15.455388+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455388+0000","last_undegraded":"2024-04-25T08:59:15.455388+0000","last_fullsized":"2024-04-25T08:59:15.455388+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461311+0000","last_change":"2024-04-25T08:59:15.454182+0000","last_active":"2024-04-25T08:59:15.461311+0000","last_peered":"2024-04-25T08:59:15.461311+0000","last_clean":"2024-04-25T08:59:15.461311+0000","last_became_active":"2024-04-25T08:59:15.453926+0000","last_became_peered":"2024-04-25T08:59:15.453926+0000","last_unstale":"2024-04-25T08:59:15.461311+0000","last_undegraded":"2024-04-25T08:59:15.461311+0000","last_fullsized":"2024-04-25T08:59:15.461311+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:46.631288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448409+0000","last_change":"2024-04-25T08:59:15.448409+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448409+0000","last_undegraded":"2024-04-25T08:59:15.448409+0000","last_fullsized":"2024-04-25T08:59:15.448409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464204+0000","last_change":"2024-04-25T08:59:15.462158+0000","last_active":"2024-04-25T08:59:15.464204+0000","last_peered":"2024-04-25T08:59:15.464204+0000","last_clean":"2024-04-25T08:59:15.464204+0000","last_became_active":"2024-04-25T08:59:15.461680+0000","last_became_peered":"2024-04-25T08:59:15.461680+0000","last_unstale":"2024-04-25T08:59:15.464204+0000","last_undegraded":"2024-04-25T08:59:15.464204+0000","last_fullsized":"2024-04-25T08:59:15.464204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453550+0000","last_change":"2024-04-25T08:59:15.453550+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453550+0000","last_undegraded":"2024-04-25T08:59:15.453550+0000","last_fullsized":"2024-04-25T08:59:15.453550+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461312+0000","last_change":"2024-04-25T08:59:15.458383+0000","last_active":"2024-04-25T08:59:15.461312+0000","last_peered":"2024-04-25T08:59:15.461312+0000","last_clean":"2024-04-25T08:59:15.461312+0000","last_became_active":"2024-04-25T08:59:15.457899+0000","last_became_peered":"2024-04-25T08:59:15.457899+0000","last_unstale":"2024-04-25T08:59:15.461312+0000","last_undegraded":"2024-04-25T08:59:15.461312+0000","last_fullsized":"2024-04-25T08:59:15.461312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448124+0000","last_change":"2024-04-25T08:59:15.448124+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448124+0000","last_undegraded":"2024-04-25T08:59:15.448124+0000","last_fullsized":"2024-04-25T08:59:15.448124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463836+0000","last_change":"2024-04-25T08:59:15.459763+0000","last_active":"2024-04-25T08:59:15.463836+0000","last_peered":"2024-04-25T08:59:15.463836+0000","last_clean":"2024-04-25T08:59:15.463836+0000","last_became_active":"2024-04-25T08:59:15.459423+0000","last_became_peered":"2024-04-25T08:59:15.459423+0000","last_unstale":"2024-04-25T08:59:15.463836+0000","last_undegraded":"2024-04-25T08:59:15.463836+0000","last_fullsized":"2024-04-25T08:59:15.463836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.461126+0000","last_change":"2024-04-25T08:59:15.461126+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.461126+0000","last_undegraded":"2024-04-25T08:59:15.461126+0000","last_fullsized":"2024-04-25T08:59:15.461126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461500+0000","last_change":"2024-04-25T08:59:15.453202+0000","last_active":"2024-04-25T08:59:15.461500+0000","last_peered":"2024-04-25T08:59:15.461500+0000","last_clean":"2024-04-25T08:59:15.461500+0000","last_became_active":"2024-04-25T08:59:15.452856+0000","last_became_peered":"2024-04-25T08:59:15.452856+0000","last_unstale":"2024-04-25T08:59:15.461500+0000","last_undegraded":"2024-04-25T08:59:15.461500+0000","last_fullsized":"2024-04-25T08:59:15.461500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458101+0000","last_change":"2024-04-25T08:59:15.458101+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458101+0000","last_undegraded":"2024-04-25T08:59:15.458101+0000","last_fullsized":"2024-04-25T08:59:15.458101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454396+0000","last_change":"2024-04-25T08:59:15.453050+0000","last_active":"2024-04-25T08:59:15.454396+0000","last_peered":"2024-04-25T08:59:15.454396+0000","last_clean":"2024-04-25T08:59:15.454396+0000","last_became_active":"2024-04-25T08:59:15.452771+0000","last_became_peered":"2024-04-25T08:59:15.452771+0000","last_unstale":"2024-04-25T08:59:15.454396+0000","last_undegraded":"2024-04-25T08:59:15.454396+0000","last_fullsized":"2024-04-25T08:59:15.454396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456295+0000","last_change":"2024-04-25T08:59:15.456295+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456295+0000","last_undegraded":"2024-04-25T08:59:15.456295+0000","last_fullsized":"2024-04-25T08:59:15.456295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466373+0000","last_change":"2024-04-25T08:59:15.465229+0000","last_active":"2024-04-25T08:59:15.466373+0000","last_peered":"2024-04-25T08:59:15.466373+0000","last_clean":"2024-04-25T08:59:15.466373+0000","last_became_active":"2024-04-25T08:59:15.464721+0000","last_became_peered":"2024-04-25T08:59:15.464721+0000","last_unstale":"2024-04-25T08:59:15.466373+0000","last_undegraded":"2024-04-25T08:59:15.466373+0000","last_fullsized":"2024-04-25T08:59:15.466373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:16.843489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447689+0000","last_change":"2024-04-25T08:59:15.447689+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447689+0000","last_undegraded":"2024-04-25T08:59:15.447689+0000","last_fullsized":"2024-04-25T08:59:15.447689+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461098+0000","last_change":"2024-04-25T08:59:15.450651+0000","last_active":"2024-04-25T08:59:15.461098+0000","last_peered":"2024-04-25T08:59:15.461098+0000","last_clean":"2024-04-25T08:59:15.461098+0000","last_became_active":"2024-04-25T08:59:15.450157+0000","last_became_peered":"2024-04-25T08:59:15.450157+0000","last_unstale":"2024-04-25T08:59:15.461098+0000","last_undegraded":"2024-04-25T08:59:15.461098+0000","last_fullsized":"2024-04-25T08:59:15.461098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448619+0000","last_change":"2024-04-25T08:59:15.448619+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448619+0000","last_undegraded":"2024-04-25T08:59:15.448619+0000","last_fullsized":"2024-04-25T08:59:15.448619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468358+0000","last_change":"2024-04-25T08:59:15.467758+0000","last_active":"2024-04-25T08:59:15.468358+0000","last_peered":"2024-04-25T08:59:15.468358+0000","last_clean":"2024-04-25T08:59:15.468358+0000","last_became_active":"2024-04-25T08:59:15.467423+0000","last_became_peered":"2024-04-25T08:59:15.467423+0000","last_unstale":"2024-04-25T08:59:15.468358+0000","last_undegraded":"2024-04-25T08:59:15.468358+0000","last_fullsized":"2024-04-25T08:59:15.468358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:40.158535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449032+0000","last_change":"2024-04-25T08:59:15.449032+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449032+0000","last_undegraded":"2024-04-25T08:59:15.449032+0000","last_fullsized":"2024-04-25T08:59:15.449032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466976+0000","last_change":"2024-04-25T08:59:15.462089+0000","last_active":"2024-04-25T08:59:15.466976+0000","last_peered":"2024-04-25T08:59:15.466976+0000","last_clean":"2024-04-25T08:59:15.466976+0000","last_became_active":"2024-04-25T08:59:15.461797+0000","last_became_peered":"2024-04-25T08:59:15.461797+0000","last_unstale":"2024-04-25T08:59:15.466976+0000","last_undegraded":"2024-04-25T08:59:15.466976+0000","last_fullsized":"2024-04-25T08:59:15.466976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450150+0000","last_change":"2024-04-25T08:59:15.450150+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450150+0000","last_undegraded":"2024-04-25T08:59:15.450150+0000","last_fullsized":"2024-04-25T08:59:15.450150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454699+0000","last_change":"2024-04-25T08:59:15.452741+0000","last_active":"2024-04-25T08:59:15.454699+0000","last_peered":"2024-04-25T08:59:15.454699+0000","last_clean":"2024-04-25T08:59:15.454699+0000","last_became_active":"2024-04-25T08:59:15.452336+0000","last_became_peered":"2024-04-25T08:59:15.452336+0000","last_unstale":"2024-04-25T08:59:15.454699+0000","last_undegraded":"2024-04-25T08:59:15.454699+0000","last_fullsized":"2024-04-25T08:59:15.454699+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:02.452298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453056+0000","last_change":"2024-04-25T08:59:15.453056+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453056+0000","last_undegraded":"2024-04-25T08:59:15.453056+0000","last_fullsized":"2024-04-25T08:59:15.453056+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466780+0000","last_change":"2024-04-25T08:59:15.466415+0000","last_active":"2024-04-25T08:59:15.466780+0000","last_peered":"2024-04-25T08:59:15.466780+0000","last_clean":"2024-04-25T08:59:15.466780+0000","last_became_active":"2024-04-25T08:59:15.466019+0000","last_became_peered":"2024-04-25T08:59:15.466019+0000","last_unstale":"2024-04-25T08:59:15.466780+0000","last_undegraded":"2024-04-25T08:59:15.466780+0000","last_fullsized":"2024-04-25T08:59:15.466780+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.981461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454441+0000","last_change":"2024-04-25T08:59:15.454441+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454441+0000","last_undegraded":"2024-04-25T08:59:15.454441+0000","last_fullsized":"2024-04-25T08:59:15.454441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.458635+0000","last_change":"2024-04-25T08:59:15.455994+0000","last_active":"2024-04-25T08:59:15.458635+0000","last_peered":"2024-04-25T08:59:15.458635+0000","last_clean":"2024-04-25T08:59:15.458635+0000","last_became_active":"2024-04-25T08:59:15.455710+0000","last_became_peered":"2024-04-25T08:59:15.455710+0000","last_unstale":"2024-04-25T08:59:15.458635+0000","last_undegraded":"2024-04-25T08:59:15.458635+0000","last_fullsized":"2024-04-25T08:59:15.458635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.241831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451616+0000","last_change":"2024-04-25T08:59:15.451616+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451616+0000","last_undegraded":"2024-04-25T08:59:15.451616+0000","last_fullsized":"2024-04-25T08:59:15.451616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.465456+0000","last_change":"2024-04-25T08:59:15.464258+0000","last_active":"2024-04-25T08:59:15.465456+0000","last_peered":"2024-04-25T08:59:15.465456+0000","last_clean":"2024-04-25T08:59:15.465456+0000","last_became_active":"2024-04-25T08:59:15.463915+0000","last_became_peered":"2024-04-25T08:59:15.463915+0000","last_unstale":"2024-04-25T08:59:15.465456+0000","last_undegraded":"2024-04-25T08:59:15.465456+0000","last_fullsized":"2024-04-25T08:59:15.465456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448919+0000","last_change":"2024-04-25T08:59:15.448919+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448919+0000","last_undegraded":"2024-04-25T08:59:15.448919+0000","last_fullsized":"2024-04-25T08:59:15.448919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467998+0000","last_change":"2024-04-25T08:59:15.467372+0000","last_active":"2024-04-25T08:59:15.467998+0000","last_peered":"2024-04-25T08:59:15.467998+0000","last_clean":"2024-04-25T08:59:15.467998+0000","last_became_active":"2024-04-25T08:59:15.467151+0000","last_became_peered":"2024-04-25T08:59:15.467151+0000","last_unstale":"2024-04-25T08:59:15.467998+0000","last_undegraded":"2024-04-25T08:59:15.467998+0000","last_fullsized":"2024-04-25T08:59:15.467998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:40.462959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448015+0000","last_change":"2024-04-25T08:59:15.448015+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448015+0000","last_undegraded":"2024-04-25T08:59:15.448015+0000","last_fullsized":"2024-04-25T08:59:15.448015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.456952+0000","last_change":"2024-04-25T08:59:15.455569+0000","last_active":"2024-04-25T08:59:15.456952+0000","last_peered":"2024-04-25T08:59:15.456952+0000","last_clean":"2024-04-25T08:59:15.456952+0000","last_became_active":"2024-04-25T08:59:15.455293+0000","last_became_peered":"2024-04-25T08:59:15.455293+0000","last_unstale":"2024-04-25T08:59:15.456952+0000","last_undegraded":"2024-04-25T08:59:15.456952+0000","last_fullsized":"2024-04-25T08:59:15.456952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:07.263160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457095+0000","last_change":"2024-04-25T08:59:15.457095+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457095+0000","last_undegraded":"2024-04-25T08:59:15.457095+0000","last_fullsized":"2024-04-25T08:59:15.457095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461154+0000","last_change":"2024-04-25T08:59:15.453157+0000","last_active":"2024-04-25T08:59:15.461154+0000","last_peered":"2024-04-25T08:59:15.461154+0000","last_clean":"2024-04-25T08:59:15.461154+0000","last_became_active":"2024-04-25T08:59:15.452867+0000","last_became_peered":"2024-04-25T08:59:15.452867+0000","last_unstale":"2024-04-25T08:59:15.461154+0000","last_undegraded":"2024-04-25T08:59:15.461154+0000","last_fullsized":"2024-04-25T08:59:15.461154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452085+0000","last_change":"2024-04-25T08:59:15.452085+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452085+0000","last_undegraded":"2024-04-25T08:59:15.452085+0000","last_fullsized":"2024-04-25T08:59:15.452085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461202+0000","last_change":"2024-04-25T08:59:15.458063+0000","last_active":"2024-04-25T08:59:15.461202+0000","last_peered":"2024-04-25T08:59:15.461202+0000","last_clean":"2024-04-25T08:59:15.461202+0000","last_became_active":"2024-04-25T08:59:15.457790+0000","last_became_peered":"2024-04-25T08:59:15.457790+0000","last_unstale":"2024-04-25T08:59:15.461202+0000","last_undegraded":"2024-04-25T08:59:15.461202+0000","last_fullsized":"2024-04-25T08:59:15.461202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454036+0000","last_change":"2024-04-25T08:59:15.454036+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454036+0000","last_undegraded":"2024-04-25T08:59:15.454036+0000","last_fullsized":"2024-04-25T08:59:15.454036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463863+0000","last_change":"2024-04-25T08:59:15.459026+0000","last_active":"2024-04-25T08:59:15.463863+0000","last_peered":"2024-04-25T08:59:15.463863+0000","last_clean":"2024-04-25T08:59:15.463863+0000","last_became_active":"2024-04-25T08:59:15.458727+0000","last_became_peered":"2024-04-25T08:59:15.458727+0000","last_unstale":"2024-04-25T08:59:15.463863+0000","last_undegraded":"2024-04-25T08:59:15.463863+0000","last_fullsized":"2024-04-25T08:59:15.463863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449794+0000","last_change":"2024-04-25T08:59:15.449794+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449794+0000","last_undegraded":"2024-04-25T08:59:15.449794+0000","last_fullsized":"2024-04-25T08:59:15.449794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463580+0000","last_change":"2024-04-25T08:59:15.458236+0000","last_active":"2024-04-25T08:59:15.463580+0000","last_peered":"2024-04-25T08:59:15.463580+0000","last_clean":"2024-04-25T08:59:15.463580+0000","last_became_active":"2024-04-25T08:59:15.457948+0000","last_became_peered":"2024-04-25T08:59:15.457948+0000","last_unstale":"2024-04-25T08:59:15.463580+0000","last_undegraded":"2024-04-25T08:59:15.463580+0000","last_fullsized":"2024-04-25T08:59:15.463580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449832+0000","last_change":"2024-04-25T08:59:15.449832+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449832+0000","last_undegraded":"2024-04-25T08:59:15.449832+0000","last_fullsized":"2024-04-25T08:59:15.449832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464100+0000","last_change":"2024-04-25T08:59:15.458975+0000","last_active":"2024-04-25T08:59:15.464100+0000","last_peered":"2024-04-25T08:59:15.464100+0000","last_clean":"2024-04-25T08:59:15.464100+0000","last_became_active":"2024-04-25T08:59:15.458706+0000","last_became_peered":"2024-04-25T08:59:15.458706+0000","last_unstale":"2024-04-25T08:59:15.464100+0000","last_undegraded":"2024-04-25T08:59:15.464100+0000","last_fullsized":"2024-04-25T08:59:15.464100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447404+0000","last_change":"2024-04-25T08:59:15.447404+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447404+0000","last_undegraded":"2024-04-25T08:59:15.447404+0000","last_fullsized":"2024-04-25T08:59:15.447404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468165+0000","last_change":"2024-04-25T08:59:15.467679+0000","last_active":"2024-04-25T08:59:15.468165+0000","last_peered":"2024-04-25T08:59:15.468165+0000","last_clean":"2024-04-25T08:59:15.468165+0000","last_became_active":"2024-04-25T08:59:15.467367+0000","last_became_peered":"2024-04-25T08:59:15.467367+0000","last_unstale":"2024-04-25T08:59:15.468165+0000","last_undegraded":"2024-04-25T08:59:15.468165+0000","last_fullsized":"2024-04-25T08:59:15.468165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:01.090235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453663+0000","last_change":"2024-04-25T08:59:15.453663+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453663+0000","last_undegraded":"2024-04-25T08:59:15.453663+0000","last_fullsized":"2024-04-25T08:59:15.453663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461326+0000","last_change":"2024-04-25T08:59:15.457106+0000","last_active":"2024-04-25T08:59:15.461326+0000","last_peered":"2024-04-25T08:59:15.461326+0000","last_clean":"2024-04-25T08:59:15.461326+0000","last_became_active":"2024-04-25T08:59:15.456818+0000","last_became_peered":"2024-04-25T08:59:15.456818+0000","last_unstale":"2024-04-25T08:59:15.461326+0000","last_undegraded":"2024-04-25T08:59:15.461326+0000","last_fullsized":"2024-04-25T08:59:15.461326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454964+0000","last_change":"2024-04-25T08:59:15.454964+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454964+0000","last_undegraded":"2024-04-25T08:59:15.454964+0000","last_fullsized":"2024-04-25T08:59:15.454964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466053+0000","last_change":"2024-04-25T08:59:15.465453+0000","last_active":"2024-04-25T08:59:15.466053+0000","last_peered":"2024-04-25T08:59:15.466053+0000","last_clean":"2024-04-25T08:59:15.466053+0000","last_became_active":"2024-04-25T08:59:15.464640+0000","last_became_peered":"2024-04-25T08:59:15.464640+0000","last_unstale":"2024-04-25T08:59:15.466053+0000","last_undegraded":"2024-04-25T08:59:15.466053+0000","last_fullsized":"2024-04-25T08:59:15.466053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:51.190507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453809+0000","last_change":"2024-04-25T08:59:15.453809+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453809+0000","last_undegraded":"2024-04-25T08:59:15.453809+0000","last_fullsized":"2024-04-25T08:59:15.453809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467003+0000","last_change":"2024-04-25T08:59:15.462152+0000","last_active":"2024-04-25T08:59:15.467003+0000","last_peered":"2024-04-25T08:59:15.467003+0000","last_clean":"2024-04-25T08:59:15.467003+0000","last_became_active":"2024-04-25T08:59:15.461867+0000","last_became_peered":"2024-04-25T08:59:15.461867+0000","last_unstale":"2024-04-25T08:59:15.467003+0000","last_undegraded":"2024-04-25T08:59:15.467003+0000","last_fullsized":"2024-04-25T08:59:15.467003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448611+0000","last_change":"2024-04-25T08:59:15.448611+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448611+0000","last_undegraded":"2024-04-25T08:59:15.448611+0000","last_fullsized":"2024-04-25T08:59:15.448611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.459723+0000","last_change":"2024-04-25T08:59:15.458322+0000","last_active":"2024-04-25T08:59:15.459723+0000","last_peered":"2024-04-25T08:59:15.459723+0000","last_clean":"2024-04-25T08:59:15.459723+0000","last_became_active":"2024-04-25T08:59:15.458007+0000","last_became_peered":"2024-04-25T08:59:15.458007+0000","last_unstale":"2024-04-25T08:59:15.459723+0000","last_undegraded":"2024-04-25T08:59:15.459723+0000","last_fullsized":"2024-04-25T08:59:15.459723+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449096+0000","last_change":"2024-04-25T08:59:15.449096+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449096+0000","last_undegraded":"2024-04-25T08:59:15.449096+0000","last_fullsized":"2024-04-25T08:59:15.449096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466992+0000","last_change":"2024-04-25T08:59:15.462685+0000","last_active":"2024-04-25T08:59:15.466992+0000","last_peered":"2024-04-25T08:59:15.466992+0000","last_clean":"2024-04-25T08:59:15.466992+0000","last_became_active":"2024-04-25T08:59:15.462425+0000","last_became_peered":"2024-04-25T08:59:15.462425+0000","last_unstale":"2024-04-25T08:59:15.466992+0000","last_undegraded":"2024-04-25T08:59:15.466992+0000","last_fullsized":"2024-04-25T08:59:15.466992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453454+0000","last_change":"2024-04-25T08:59:15.453454+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453454+0000","last_undegraded":"2024-04-25T08:59:15.453454+0000","last_fullsized":"2024-04-25T08:59:15.453454+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463983+0000","last_change":"2024-04-25T08:59:15.455921+0000","last_active":"2024-04-25T08:59:15.463983+0000","last_peered":"2024-04-25T08:59:15.463983+0000","last_clean":"2024-04-25T08:59:15.463983+0000","last_became_active":"2024-04-25T08:59:15.455572+0000","last_became_peered":"2024-04-25T08:59:15.455572+0000","last_unstale":"2024-04-25T08:59:15.463983+0000","last_undegraded":"2024-04-25T08:59:15.463983+0000","last_fullsized":"2024-04-25T08:59:15.463983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:01.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447058+0000","last_change":"2024-04-25T08:59:15.447058+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447058+0000","last_undegraded":"2024-04-25T08:59:15.447058+0000","last_fullsized":"2024-04-25T08:59:15.447058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464342+0000","last_change":"2024-04-25T08:59:15.462240+0000","last_active":"2024-04-25T08:59:15.464342+0000","last_peered":"2024-04-25T08:59:15.464342+0000","last_clean":"2024-04-25T08:59:15.464342+0000","last_became_active":"2024-04-25T08:59:15.461770+0000","last_became_peered":"2024-04-25T08:59:15.461770+0000","last_unstale":"2024-04-25T08:59:15.464342+0000","last_undegraded":"2024-04-25T08:59:15.464342+0000","last_fullsized":"2024-04-25T08:59:15.464342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446244+0000","last_change":"2024-04-25T08:59:15.446244+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446244+0000","last_undegraded":"2024-04-25T08:59:15.446244+0000","last_fullsized":"2024-04-25T08:59:15.446244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466349+0000","last_change":"2024-04-25T08:59:15.464867+0000","last_active":"2024-04-25T08:59:15.466349+0000","last_peered":"2024-04-25T08:59:15.466349+0000","last_clean":"2024-04-25T08:59:15.466349+0000","last_became_active":"2024-04-25T08:59:15.464561+0000","last_became_peered":"2024-04-25T08:59:15.464561+0000","last_unstale":"2024-04-25T08:59:15.466349+0000","last_undegraded":"2024-04-25T08:59:15.466349+0000","last_fullsized":"2024-04-25T08:59:15.466349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:57.546490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456285+0000","last_change":"2024-04-25T08:59:15.456285+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456285+0000","last_undegraded":"2024-04-25T08:59:15.456285+0000","last_fullsized":"2024-04-25T08:59:15.456285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461218+0000","last_change":"2024-04-25T08:59:15.457085+0000","last_active":"2024-04-25T08:59:15.461218+0000","last_peered":"2024-04-25T08:59:15.461218+0000","last_clean":"2024-04-25T08:59:15.461218+0000","last_became_active":"2024-04-25T08:59:15.456462+0000","last_became_peered":"2024-04-25T08:59:15.456462+0000","last_unstale":"2024-04-25T08:59:15.461218+0000","last_undegraded":"2024-04-25T08:59:15.461218+0000","last_fullsized":"2024-04-25T08:59:15.461218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.452386+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:59:15.452386+0000","last_peered":"2024-04-25T08:59:15.452386+0000","last_clean":"2024-04-25T08:59:15.452386+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:59:15.452386+0000","last_undegraded":"2024-04-25T08:59:15.452386+0000","last_fullsized":"2024-04-25T08:59:15.452386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335432,"statfs":{"total":96636764160,"available":96599482368,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35832,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:19.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.587+0000 7f0dfdeb3640 1 Processor -- start 2024-04-25T08:59:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.587+0000 7f0dfdeb3640 1 -- start start 2024-04-25T08:59:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0dfdeb3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0df80ce7f0 0x7f0df80cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0dfdeb3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df80cf1c0 con 0x7f0df80b2cc0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0dfdeb3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df80d20e0 con 0x7f0df815de70 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0dfdeb3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df80d2a10 con 0x7f0df80ce7f0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0df7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0df80ce7f0 0x7f0df80cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0df6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0df80b2cc0 0x7f0df80b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37894/0 (socket says 172.21.15.5:37894) 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0df6ffd640 1 -- 172.21.15.5:0/356378817 learned_addr learned my addr 172.21.15.5:0/356378817 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0df7fff640 1 -- 172.21.15.5:0/356378817 >> v1:172.21.15.80:6789/0 conn(0x7f0df815de70 legacy=0x7f0df80b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0df7fff640 1 -- 172.21.15.5:0/356378817 >> v1:172.21.15.5:6789/0 conn(0x7f0df80b2cc0 legacy=0x7f0df80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0df67fc640 1 -- 172.21.15.5:0/356378817 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432528115 0 0) 0x7f0df80cf1c0 con 0x7f0df80b2cc0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.588+0000 7f0df7fff640 1 -- 172.21.15.5:0/356378817 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80d23c0 con 0x7f0df80ce7f0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.589+0000 7f0df7fff640 1 --2- 172.21.15.5:0/356378817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cec80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009d90 tx=0x7f0df002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a7093f5a07fc0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.589+0000 7f0df67fc640 1 -- 172.21.15.5:0/356378817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0007740 con 0x7f0df80ce7f0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.589+0000 7f0df67fc640 1 -- 172.21.15.5:0/356378817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df00078e0 con 0x7f0df80ce7f0 2024-04-25T08:59:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.589+0000 7f0df67fc640 1 -- 172.21.15.5:0/356378817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0007cb0 con 0x7f0df80ce7f0 2024-04-25T08:59:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.590+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/356378817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 msgr2=0x7f0df80cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.590+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/356378817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cec80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009d90 tx=0x7f0df002a6f0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.590+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/356378817 shutdown_connections 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.590+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/356378817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cec80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.590+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/356378817 >> 172.21.15.5:0/356378817 conn(0x7f0df806b000 msgr2=0x7f0df806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.590+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/356378817 shutdown_connections 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.590+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/356378817 wait complete. 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.591+0000 7f0dfdeb3640 1 Processor -- start 2024-04-25T08:59:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.591+0000 7f0dfdeb3640 1 -- start start 2024-04-25T08:59:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0dfdeb3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0df80b2cc0 0x7f0df80c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0dfdeb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0dfdeb3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df815de70 0x7f0df81f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0dfdeb3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80d2ea0 con 0x7f0df80ce7f0 2024-04-25T08:59:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0dfdeb3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80b7300 con 0x7f0df815de70 2024-04-25T08:59:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0dfdeb3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80d3020 con 0x7f0df80b2cc0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40048/0 (socket says 172.21.15.5:40048) 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 -- 172.21.15.5:0/2811352131 learned_addr learned my addr 172.21.15.5:0/2811352131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df7fff640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df815de70 0x7f0df81f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df77fe640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0df80b2cc0 0x7f0df80c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 -- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0df80b2cc0 msgr2=0x7f0df80c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0df80b2cc0 0x7f0df80c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 -- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df815de70 msgr2=0x7f0df81f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df815de70 0x7f0df81f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 -- 172.21.15.5:0/2811352131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80cd140 con 0x7f0df80ce7f0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.592+0000 7f0df6ffd640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cc9a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c4a0 tx=0x7f0dec00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.593+0000 7f0ddffff640 1 -- 172.21.15.5:0/2811352131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec018070 con 0x7f0df80ce7f0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.593+0000 7f0ddffff640 1 -- 172.21.15.5:0/2811352131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec0074e0 con 0x7f0df80ce7f0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.593+0000 7f0ddffff640 1 -- 172.21.15.5:0/2811352131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec004a20 con 0x7f0df80ce7f0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.593+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df80cd420 con 0x7f0df80ce7f0 2024-04-25T08:59:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.593+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df80cd9e0 con 0x7f0df80ce7f0 2024-04-25T08:59:19.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.594+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df804ef20 con 0x7f0df80ce7f0 2024-04-25T08:59:19.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.594+0000 7f0ddffff640 1 -- 172.21.15.5:0/2811352131 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0dec01b070 con 0x7f0df80ce7f0 2024-04-25T08:59:19.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.594+0000 7f0ddffff640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0de406b4d0 0x7f0de406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.595+0000 7f0ddffff640 1 -- 172.21.15.5:0/2811352131 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dec089400 con 0x7f0df80ce7f0 2024-04-25T08:59:19.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.595+0000 7f0df77fe640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0de406b4d0 0x7f0de406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.595+0000 7f0df77fe640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0de406b4d0 0x7f0de406d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0de8000f60 tx=0x7f0de8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.599+0000 7f0ddffff640 1 -- 172.21.15.5:0/2811352131 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0dec058310 con 0x7f0df80ce7f0 2024-04-25T08:59:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.775+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0df80ccee0 con 0x7f0de406b4d0 2024-04-25T08:59:19.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.782+0000 7f0ddffff640 1 -- 172.21.15.5:0/2811352131 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246640 (secure 0 0 0) 0x7f0de80050d0 con 0x7f0de406b4d0 2024-04-25T08:59:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:19.775 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:59:19.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0de406b4d0 msgr2=0x7f0de406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0de406b4d0 0x7f0de406d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0de8000f60 tx=0x7f0de8009040 comp rx=0 tx=0).stop 2024-04-25T08:59:19.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 msgr2=0x7f0df80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cc9a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c4a0 tx=0x7f0dec00c960 comp rx=0 tx=0).stop 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 shutdown_connections 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0de406b4d0 0x7f0de406d990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df815de70 0x7f0df81f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0df80ce7f0 0x7f0df80cc9a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 --2- 172.21.15.5:0/2811352131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0df80b2cc0 0x7f0df80c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 >> 172.21.15.5:0/2811352131 conn(0x7f0df806b000 msgr2=0x7f0df815ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.784+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 shutdown_connections 2024-04-25T08:59:19.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.785+0000 7f0dfdeb3640 1 -- 172.21.15.5:0/2811352131 wait complete. 2024-04-25T08:59:19.785 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-04-25T08:59:18.421424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":296076,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754678644,"statfs":{"total":773094113280,"available":772790931456,"internally_reserved":0,"allocated":5120000,"data_stored":2756064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000898"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450204+0000","last_change":"2024-04-25T08:59:15.450204+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450204+0000","last_undegraded":"2024-04-25T08:59:15.450204+0000","last_fullsized":"2024-04-25T08:59:15.450204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447164+0000","last_change":"2024-04-25T08:59:15.447164+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447164+0000","last_undegraded":"2024-04-25T08:59:15.447164+0000","last_fullsized":"2024-04-25T08:59:15.447164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447632+0000","last_change":"2024-04-25T08:59:15.447632+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447632+0000","last_undegraded":"2024-04-25T08:59:15.447632+0000","last_fullsized":"2024-04-25T08:59:15.447632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455436+0000","last_change":"2024-04-25T08:59:15.455436+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455436+0000","last_undegraded":"2024-04-25T08:59:15.455436+0000","last_fullsized":"2024-04-25T08:59:15.455436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446623+0000","last_change":"2024-04-25T08:59:15.446623+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446623+0000","last_undegraded":"2024-04-25T08:59:15.446623+0000","last_fullsized":"2024-04-25T08:59:15.446623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450196+0000","last_change":"2024-04-25T08:59:15.450196+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450196+0000","last_undegraded":"2024-04-25T08:59:15.450196+0000","last_fullsized":"2024-04-25T08:59:15.450196+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450609+0000","last_change":"2024-04-25T08:59:15.450609+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450609+0000","last_undegraded":"2024-04-25T08:59:15.450609+0000","last_fullsized":"2024-04-25T08:59:15.450609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458814+0000","last_change":"2024-04-25T08:59:15.458814+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458814+0000","last_undegraded":"2024-04-25T08:59:15.458814+0000","last_fullsized":"2024-04-25T08:59:15.458814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457592+0000","last_change":"2024-04-25T08:59:15.457592+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457592+0000","last_undegraded":"2024-04-25T08:59:15.457592+0000","last_fullsized":"2024-04-25T08:59:15.457592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458127+0000","last_change":"2024-04-25T08:59:15.458127+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458127+0000","last_undegraded":"2024-04-25T08:59:15.458127+0000","last_fullsized":"2024-04-25T08:59:15.458127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453510+0000","last_change":"2024-04-25T08:59:15.453510+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453510+0000","last_undegraded":"2024-04-25T08:59:15.453510+0000","last_fullsized":"2024-04-25T08:59:15.453510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449347+0000","last_change":"2024-04-25T08:59:15.449347+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449347+0000","last_undegraded":"2024-04-25T08:59:15.449347+0000","last_fullsized":"2024-04-25T08:59:15.449347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448863+0000","last_change":"2024-04-25T08:59:15.448863+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448863+0000","last_undegraded":"2024-04-25T08:59:15.448863+0000","last_fullsized":"2024-04-25T08:59:15.448863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457670+0000","last_change":"2024-04-25T08:59:15.457670+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457670+0000","last_undegraded":"2024-04-25T08:59:15.457670+0000","last_fullsized":"2024-04-25T08:59:15.457670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451968+0000","last_change":"2024-04-25T08:59:15.451968+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451968+0000","last_undegraded":"2024-04-25T08:59:15.451968+0000","last_fullsized":"2024-04-25T08:59:15.451968+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451484+0000","last_change":"2024-04-25T08:59:15.451484+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451484+0000","last_undegraded":"2024-04-25T08:59:15.451484+0000","last_fullsized":"2024-04-25T08:59:15.451484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447622+0000","last_change":"2024-04-25T08:59:15.447622+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447622+0000","last_undegraded":"2024-04-25T08:59:15.447622+0000","last_fullsized":"2024-04-25T08:59:15.447622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448174+0000","last_change":"2024-04-25T08:59:15.448174+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448174+0000","last_undegraded":"2024-04-25T08:59:15.448174+0000","last_fullsized":"2024-04-25T08:59:15.448174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453485+0000","last_change":"2024-04-25T08:59:15.453485+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453485+0000","last_undegraded":"2024-04-25T08:59:15.453485+0000","last_fullsized":"2024-04-25T08:59:15.453485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448909+0000","last_change":"2024-04-25T08:59:15.448909+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448909+0000","last_undegraded":"2024-04-25T08:59:15.448909+0000","last_fullsized":"2024-04-25T08:59:15.448909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453849+0000","last_change":"2024-04-25T08:59:15.453849+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453849+0000","last_undegraded":"2024-04-25T08:59:15.453849+0000","last_fullsized":"2024-04-25T08:59:15.453849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453681+0000","last_change":"2024-04-25T08:59:15.453681+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453681+0000","last_undegraded":"2024-04-25T08:59:15.453681+0000","last_fullsized":"2024-04-25T08:59:15.453681+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451908+0000","last_change":"2024-04-25T08:59:15.451908+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451908+0000","last_undegraded":"2024-04-25T08:59:15.451908+0000","last_fullsized":"2024-04-25T08:59:15.451908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450940+0000","last_change":"2024-04-25T08:59:15.450940+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450940+0000","last_undegraded":"2024-04-25T08:59:15.450940+0000","last_fullsized":"2024-04-25T08:59:15.450940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455830+0000","last_change":"2024-04-25T08:59:15.455830+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455830+0000","last_undegraded":"2024-04-25T08:59:15.455830+0000","last_fullsized":"2024-04-25T08:59:15.455830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448526+0000","last_change":"2024-04-25T08:59:15.448526+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448526+0000","last_undegraded":"2024-04-25T08:59:15.448526+0000","last_fullsized":"2024-04-25T08:59:15.448526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446067+0000","last_change":"2024-04-25T08:59:15.446067+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446067+0000","last_undegraded":"2024-04-25T08:59:15.446067+0000","last_fullsized":"2024-04-25T08:59:15.446067+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448874+0000","last_change":"2024-04-25T08:59:15.448874+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448874+0000","last_undegraded":"2024-04-25T08:59:15.448874+0000","last_fullsized":"2024-04-25T08:59:15.448874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452130+0000","last_change":"2024-04-25T08:59:15.452130+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452130+0000","last_undegraded":"2024-04-25T08:59:15.452130+0000","last_fullsized":"2024-04-25T08:59:15.452130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448605+0000","last_change":"2024-04-25T08:59:15.448605+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448605+0000","last_undegraded":"2024-04-25T08:59:15.448605+0000","last_fullsized":"2024-04-25T08:59:15.448605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451461+0000","last_change":"2024-04-25T08:59:15.451461+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451461+0000","last_undegraded":"2024-04-25T08:59:15.451461+0000","last_fullsized":"2024-04-25T08:59:15.451461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448014+0000","last_change":"2024-04-25T08:59:15.448014+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448014+0000","last_undegraded":"2024-04-25T08:59:15.448014+0000","last_fullsized":"2024-04-25T08:59:15.448014+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450414+0000","last_change":"2024-04-25T08:59:15.450414+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450414+0000","last_undegraded":"2024-04-25T08:59:15.450414+0000","last_fullsized":"2024-04-25T08:59:15.450414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463903+0000","last_change":"2024-04-25T08:59:15.459021+0000","last_active":"2024-04-25T08:59:15.463903+0000","last_peered":"2024-04-25T08:59:15.463903+0000","last_clean":"2024-04-25T08:59:15.463903+0000","last_became_active":"2024-04-25T08:59:15.458664+0000","last_became_peered":"2024-04-25T08:59:15.458664+0000","last_unstale":"2024-04-25T08:59:15.463903+0000","last_undegraded":"2024-04-25T08:59:15.463903+0000","last_fullsized":"2024-04-25T08:59:15.463903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455388+0000","last_change":"2024-04-25T08:59:15.455388+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455388+0000","last_undegraded":"2024-04-25T08:59:15.455388+0000","last_fullsized":"2024-04-25T08:59:15.455388+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461311+0000","last_change":"2024-04-25T08:59:15.454182+0000","last_active":"2024-04-25T08:59:15.461311+0000","last_peered":"2024-04-25T08:59:15.461311+0000","last_clean":"2024-04-25T08:59:15.461311+0000","last_became_active":"2024-04-25T08:59:15.453926+0000","last_became_peered":"2024-04-25T08:59:15.453926+0000","last_unstale":"2024-04-25T08:59:15.461311+0000","last_undegraded":"2024-04-25T08:59:15.461311+0000","last_fullsized":"2024-04-25T08:59:15.461311+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:46.631288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448409+0000","last_change":"2024-04-25T08:59:15.448409+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448409+0000","last_undegraded":"2024-04-25T08:59:15.448409+0000","last_fullsized":"2024-04-25T08:59:15.448409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464204+0000","last_change":"2024-04-25T08:59:15.462158+0000","last_active":"2024-04-25T08:59:15.464204+0000","last_peered":"2024-04-25T08:59:15.464204+0000","last_clean":"2024-04-25T08:59:15.464204+0000","last_became_active":"2024-04-25T08:59:15.461680+0000","last_became_peered":"2024-04-25T08:59:15.461680+0000","last_unstale":"2024-04-25T08:59:15.464204+0000","last_undegraded":"2024-04-25T08:59:15.464204+0000","last_fullsized":"2024-04-25T08:59:15.464204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453550+0000","last_change":"2024-04-25T08:59:15.453550+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453550+0000","last_undegraded":"2024-04-25T08:59:15.453550+0000","last_fullsized":"2024-04-25T08:59:15.453550+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461312+0000","last_change":"2024-04-25T08:59:15.458383+0000","last_active":"2024-04-25T08:59:15.461312+0000","last_peered":"2024-04-25T08:59:15.461312+0000","last_clean":"2024-04-25T08:59:15.461312+0000","last_became_active":"2024-04-25T08:59:15.457899+0000","last_became_peered":"2024-04-25T08:59:15.457899+0000","last_unstale":"2024-04-25T08:59:15.461312+0000","last_undegraded":"2024-04-25T08:59:15.461312+0000","last_fullsized":"2024-04-25T08:59:15.461312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448124+0000","last_change":"2024-04-25T08:59:15.448124+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448124+0000","last_undegraded":"2024-04-25T08:59:15.448124+0000","last_fullsized":"2024-04-25T08:59:15.448124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463836+0000","last_change":"2024-04-25T08:59:15.459763+0000","last_active":"2024-04-25T08:59:15.463836+0000","last_peered":"2024-04-25T08:59:15.463836+0000","last_clean":"2024-04-25T08:59:15.463836+0000","last_became_active":"2024-04-25T08:59:15.459423+0000","last_became_peered":"2024-04-25T08:59:15.459423+0000","last_unstale":"2024-04-25T08:59:15.463836+0000","last_undegraded":"2024-04-25T08:59:15.463836+0000","last_fullsized":"2024-04-25T08:59:15.463836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.461126+0000","last_change":"2024-04-25T08:59:15.461126+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.461126+0000","last_undegraded":"2024-04-25T08:59:15.461126+0000","last_fullsized":"2024-04-25T08:59:15.461126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461500+0000","last_change":"2024-04-25T08:59:15.453202+0000","last_active":"2024-04-25T08:59:15.461500+0000","last_peered":"2024-04-25T08:59:15.461500+0000","last_clean":"2024-04-25T08:59:15.461500+0000","last_became_active":"2024-04-25T08:59:15.452856+0000","last_became_peered":"2024-04-25T08:59:15.452856+0000","last_unstale":"2024-04-25T08:59:15.461500+0000","last_undegraded":"2024-04-25T08:59:15.461500+0000","last_fullsized":"2024-04-25T08:59:15.461500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458101+0000","last_change":"2024-04-25T08:59:15.458101+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458101+0000","last_undegraded":"2024-04-25T08:59:15.458101+0000","last_fullsized":"2024-04-25T08:59:15.458101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454396+0000","last_change":"2024-04-25T08:59:15.453050+0000","last_active":"2024-04-25T08:59:15.454396+0000","last_peered":"2024-04-25T08:59:15.454396+0000","last_clean":"2024-04-25T08:59:15.454396+0000","last_became_active":"2024-04-25T08:59:15.452771+0000","last_became_peered":"2024-04-25T08:59:15.452771+0000","last_unstale":"2024-04-25T08:59:15.454396+0000","last_undegraded":"2024-04-25T08:59:15.454396+0000","last_fullsized":"2024-04-25T08:59:15.454396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456295+0000","last_change":"2024-04-25T08:59:15.456295+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456295+0000","last_undegraded":"2024-04-25T08:59:15.456295+0000","last_fullsized":"2024-04-25T08:59:15.456295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466373+0000","last_change":"2024-04-25T08:59:15.465229+0000","last_active":"2024-04-25T08:59:15.466373+0000","last_peered":"2024-04-25T08:59:15.466373+0000","last_clean":"2024-04-25T08:59:15.466373+0000","last_became_active":"2024-04-25T08:59:15.464721+0000","last_became_peered":"2024-04-25T08:59:15.464721+0000","last_unstale":"2024-04-25T08:59:15.466373+0000","last_undegraded":"2024-04-25T08:59:15.466373+0000","last_fullsized":"2024-04-25T08:59:15.466373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:16.843489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447689+0000","last_change":"2024-04-25T08:59:15.447689+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447689+0000","last_undegraded":"2024-04-25T08:59:15.447689+0000","last_fullsized":"2024-04-25T08:59:15.447689+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461098+0000","last_change":"2024-04-25T08:59:15.450651+0000","last_active":"2024-04-25T08:59:15.461098+0000","last_peered":"2024-04-25T08:59:15.461098+0000","last_clean":"2024-04-25T08:59:15.461098+0000","last_became_active":"2024-04-25T08:59:15.450157+0000","last_became_peered":"2024-04-25T08:59:15.450157+0000","last_unstale":"2024-04-25T08:59:15.461098+0000","last_undegraded":"2024-04-25T08:59:15.461098+0000","last_fullsized":"2024-04-25T08:59:15.461098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448619+0000","last_change":"2024-04-25T08:59:15.448619+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448619+0000","last_undegraded":"2024-04-25T08:59:15.448619+0000","last_fullsized":"2024-04-25T08:59:15.448619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468358+0000","last_change":"2024-04-25T08:59:15.467758+0000","last_active":"2024-04-25T08:59:15.468358+0000","last_peered":"2024-04-25T08:59:15.468358+0000","last_clean":"2024-04-25T08:59:15.468358+0000","last_became_active":"2024-04-25T08:59:15.467423+0000","last_became_peered":"2024-04-25T08:59:15.467423+0000","last_unstale":"2024-04-25T08:59:15.468358+0000","last_undegraded":"2024-04-25T08:59:15.468358+0000","last_fullsized":"2024-04-25T08:59:15.468358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:40.158535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449032+0000","last_change":"2024-04-25T08:59:15.449032+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449032+0000","last_undegraded":"2024-04-25T08:59:15.449032+0000","last_fullsized":"2024-04-25T08:59:15.449032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466976+0000","last_change":"2024-04-25T08:59:15.462089+0000","last_active":"2024-04-25T08:59:15.466976+0000","last_peered":"2024-04-25T08:59:15.466976+0000","last_clean":"2024-04-25T08:59:15.466976+0000","last_became_active":"2024-04-25T08:59:15.461797+0000","last_became_peered":"2024-04-25T08:59:15.461797+0000","last_unstale":"2024-04-25T08:59:15.466976+0000","last_undegraded":"2024-04-25T08:59:15.466976+0000","last_fullsized":"2024-04-25T08:59:15.466976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450150+0000","last_change":"2024-04-25T08:59:15.450150+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450150+0000","last_undegraded":"2024-04-25T08:59:15.450150+0000","last_fullsized":"2024-04-25T08:59:15.450150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454699+0000","last_change":"2024-04-25T08:59:15.452741+0000","last_active":"2024-04-25T08:59:15.454699+0000","last_peered":"2024-04-25T08:59:15.454699+0000","last_clean":"2024-04-25T08:59:15.454699+0000","last_became_active":"2024-04-25T08:59:15.452336+0000","last_became_peered":"2024-04-25T08:59:15.452336+0000","last_unstale":"2024-04-25T08:59:15.454699+0000","last_undegraded":"2024-04-25T08:59:15.454699+0000","last_fullsized":"2024-04-25T08:59:15.454699+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:02.452298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453056+0000","last_change":"2024-04-25T08:59:15.453056+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453056+0000","last_undegraded":"2024-04-25T08:59:15.453056+0000","last_fullsized":"2024-04-25T08:59:15.453056+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466780+0000","last_change":"2024-04-25T08:59:15.466415+0000","last_active":"2024-04-25T08:59:15.466780+0000","last_peered":"2024-04-25T08:59:15.466780+0000","last_clean":"2024-04-25T08:59:15.466780+0000","last_became_active":"2024-04-25T08:59:15.466019+0000","last_became_peered":"2024-04-25T08:59:15.466019+0000","last_unstale":"2024-04-25T08:59:15.466780+0000","last_undegraded":"2024-04-25T08:59:15.466780+0000","last_fullsized":"2024-04-25T08:59:15.466780+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.981461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454441+0000","last_change":"2024-04-25T08:59:15.454441+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454441+0000","last_undegraded":"2024-04-25T08:59:15.454441+0000","last_fullsized":"2024-04-25T08:59:15.454441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.458635+0000","last_change":"2024-04-25T08:59:15.455994+0000","last_active":"2024-04-25T08:59:15.458635+0000","last_peered":"2024-04-25T08:59:15.458635+0000","last_clean":"2024-04-25T08:59:15.458635+0000","last_became_active":"2024-04-25T08:59:15.455710+0000","last_became_peered":"2024-04-25T08:59:15.455710+0000","last_unstale":"2024-04-25T08:59:15.458635+0000","last_undegraded":"2024-04-25T08:59:15.458635+0000","last_fullsized":"2024-04-25T08:59:15.458635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.241831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451616+0000","last_change":"2024-04-25T08:59:15.451616+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451616+0000","last_undegraded":"2024-04-25T08:59:15.451616+0000","last_fullsized":"2024-04-25T08:59:15.451616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.465456+0000","last_change":"2024-04-25T08:59:15.464258+0000","last_active":"2024-04-25T08:59:15.465456+0000","last_peered":"2024-04-25T08:59:15.465456+0000","last_clean":"2024-04-25T08:59:15.465456+0000","last_became_active":"2024-04-25T08:59:15.463915+0000","last_became_peered":"2024-04-25T08:59:15.463915+0000","last_unstale":"2024-04-25T08:59:15.465456+0000","last_undegraded":"2024-04-25T08:59:15.465456+0000","last_fullsized":"2024-04-25T08:59:15.465456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448919+0000","last_change":"2024-04-25T08:59:15.448919+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448919+0000","last_undegraded":"2024-04-25T08:59:15.448919+0000","last_fullsized":"2024-04-25T08:59:15.448919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467998+0000","last_change":"2024-04-25T08:59:15.467372+0000","last_active":"2024-04-25T08:59:15.467998+0000","last_peered":"2024-04-25T08:59:15.467998+0000","last_clean":"2024-04-25T08:59:15.467998+0000","last_became_active":"2024-04-25T08:59:15.467151+0000","last_became_peered":"2024-04-25T08:59:15.467151+0000","last_unstale":"2024-04-25T08:59:15.467998+0000","last_undegraded":"2024-04-25T08:59:15.467998+0000","last_fullsized":"2024-04-25T08:59:15.467998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:40.462959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448015+0000","last_change":"2024-04-25T08:59:15.448015+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448015+0000","last_undegraded":"2024-04-25T08:59:15.448015+0000","last_fullsized":"2024-04-25T08:59:15.448015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.456952+0000","last_change":"2024-04-25T08:59:15.455569+0000","last_active":"2024-04-25T08:59:15.456952+0000","last_peered":"2024-04-25T08:59:15.456952+0000","last_clean":"2024-04-25T08:59:15.456952+0000","last_became_active":"2024-04-25T08:59:15.455293+0000","last_became_peered":"2024-04-25T08:59:15.455293+0000","last_unstale":"2024-04-25T08:59:15.456952+0000","last_undegraded":"2024-04-25T08:59:15.456952+0000","last_fullsized":"2024-04-25T08:59:15.456952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:07.263160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457095+0000","last_change":"2024-04-25T08:59:15.457095+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457095+0000","last_undegraded":"2024-04-25T08:59:15.457095+0000","last_fullsized":"2024-04-25T08:59:15.457095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461154+0000","last_change":"2024-04-25T08:59:15.453157+0000","last_active":"2024-04-25T08:59:15.461154+0000","last_peered":"2024-04-25T08:59:15.461154+0000","last_clean":"2024-04-25T08:59:15.461154+0000","last_became_active":"2024-04-25T08:59:15.452867+0000","last_became_peered":"2024-04-25T08:59:15.452867+0000","last_unstale":"2024-04-25T08:59:15.461154+0000","last_undegraded":"2024-04-25T08:59:15.461154+0000","last_fullsized":"2024-04-25T08:59:15.461154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452085+0000","last_change":"2024-04-25T08:59:15.452085+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452085+0000","last_undegraded":"2024-04-25T08:59:15.452085+0000","last_fullsized":"2024-04-25T08:59:15.452085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461202+0000","last_change":"2024-04-25T08:59:15.458063+0000","last_active":"2024-04-25T08:59:15.461202+0000","last_peered":"2024-04-25T08:59:15.461202+0000","last_clean":"2024-04-25T08:59:15.461202+0000","last_became_active":"2024-04-25T08:59:15.457790+0000","last_became_peered":"2024-04-25T08:59:15.457790+0000","last_unstale":"2024-04-25T08:59:15.461202+0000","last_undegraded":"2024-04-25T08:59:15.461202+0000","last_fullsized":"2024-04-25T08:59:15.461202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454036+0000","last_change":"2024-04-25T08:59:15.454036+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454036+0000","last_undegraded":"2024-04-25T08:59:15.454036+0000","last_fullsized":"2024-04-25T08:59:15.454036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463863+0000","last_change":"2024-04-25T08:59:15.459026+0000","last_active":"2024-04-25T08:59:15.463863+0000","last_peered":"2024-04-25T08:59:15.463863+0000","last_clean":"2024-04-25T08:59:15.463863+0000","last_became_active":"2024-04-25T08:59:15.458727+0000","last_became_peered":"2024-04-25T08:59:15.458727+0000","last_unstale":"2024-04-25T08:59:15.463863+0000","last_undegraded":"2024-04-25T08:59:15.463863+0000","last_fullsized":"2024-04-25T08:59:15.463863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449794+0000","last_change":"2024-04-25T08:59:15.449794+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449794+0000","last_undegraded":"2024-04-25T08:59:15.449794+0000","last_fullsized":"2024-04-25T08:59:15.449794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463580+0000","last_change":"2024-04-25T08:59:15.458236+0000","last_active":"2024-04-25T08:59:15.463580+0000","last_peered":"2024-04-25T08:59:15.463580+0000","last_clean":"2024-04-25T08:59:15.463580+0000","last_became_active":"2024-04-25T08:59:15.457948+0000","last_became_peered":"2024-04-25T08:59:15.457948+0000","last_unstale":"2024-04-25T08:59:15.463580+0000","last_undegraded":"2024-04-25T08:59:15.463580+0000","last_fullsized":"2024-04-25T08:59:15.463580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449832+0000","last_change":"2024-04-25T08:59:15.449832+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449832+0000","last_undegraded":"2024-04-25T08:59:15.449832+0000","last_fullsized":"2024-04-25T08:59:15.449832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464100+0000","last_change":"2024-04-25T08:59:15.458975+0000","last_active":"2024-04-25T08:59:15.464100+0000","last_peered":"2024-04-25T08:59:15.464100+0000","last_clean":"2024-04-25T08:59:15.464100+0000","last_became_active":"2024-04-25T08:59:15.458706+0000","last_became_peered":"2024-04-25T08:59:15.458706+0000","last_unstale":"2024-04-25T08:59:15.464100+0000","last_undegraded":"2024-04-25T08:59:15.464100+0000","last_fullsized":"2024-04-25T08:59:15.464100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447404+0000","last_change":"2024-04-25T08:59:15.447404+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447404+0000","last_undegraded":"2024-04-25T08:59:15.447404+0000","last_fullsized":"2024-04-25T08:59:15.447404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468165+0000","last_change":"2024-04-25T08:59:15.467679+0000","last_active":"2024-04-25T08:59:15.468165+0000","last_peered":"2024-04-25T08:59:15.468165+0000","last_clean":"2024-04-25T08:59:15.468165+0000","last_became_active":"2024-04-25T08:59:15.467367+0000","last_became_peered":"2024-04-25T08:59:15.467367+0000","last_unstale":"2024-04-25T08:59:15.468165+0000","last_undegraded":"2024-04-25T08:59:15.468165+0000","last_fullsized":"2024-04-25T08:59:15.468165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:01.090235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453663+0000","last_change":"2024-04-25T08:59:15.453663+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453663+0000","last_undegraded":"2024-04-25T08:59:15.453663+0000","last_fullsized":"2024-04-25T08:59:15.453663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461326+0000","last_change":"2024-04-25T08:59:15.457106+0000","last_active":"2024-04-25T08:59:15.461326+0000","last_peered":"2024-04-25T08:59:15.461326+0000","last_clean":"2024-04-25T08:59:15.461326+0000","last_became_active":"2024-04-25T08:59:15.456818+0000","last_became_peered":"2024-04-25T08:59:15.456818+0000","last_unstale":"2024-04-25T08:59:15.461326+0000","last_undegraded":"2024-04-25T08:59:15.461326+0000","last_fullsized":"2024-04-25T08:59:15.461326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454964+0000","last_change":"2024-04-25T08:59:15.454964+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454964+0000","last_undegraded":"2024-04-25T08:59:15.454964+0000","last_fullsized":"2024-04-25T08:59:15.454964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466053+0000","last_change":"2024-04-25T08:59:15.465453+0000","last_active":"2024-04-25T08:59:15.466053+0000","last_peered":"2024-04-25T08:59:15.466053+0000","last_clean":"2024-04-25T08:59:15.466053+0000","last_became_active":"2024-04-25T08:59:15.464640+0000","last_became_peered":"2024-04-25T08:59:15.464640+0000","last_unstale":"2024-04-25T08:59:15.466053+0000","last_undegraded":"2024-04-25T08:59:15.466053+0000","last_fullsized":"2024-04-25T08:59:15.466053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:51.190507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453809+0000","last_change":"2024-04-25T08:59:15.453809+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453809+0000","last_undegraded":"2024-04-25T08:59:15.453809+0000","last_fullsized":"2024-04-25T08:59:15.453809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467003+0000","last_change":"2024-04-25T08:59:15.462152+0000","last_active":"2024-04-25T08:59:15.467003+0000","last_peered":"2024-04-25T08:59:15.467003+0000","last_clean":"2024-04-25T08:59:15.467003+0000","last_became_active":"2024-04-25T08:59:15.461867+0000","last_became_peered":"2024-04-25T08:59:15.461867+0000","last_unstale":"2024-04-25T08:59:15.467003+0000","last_undegraded":"2024-04-25T08:59:15.467003+0000","last_fullsized":"2024-04-25T08:59:15.467003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448611+0000","last_change":"2024-04-25T08:59:15.448611+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448611+0000","last_undegraded":"2024-04-25T08:59:15.448611+0000","last_fullsized":"2024-04-25T08:59:15.448611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.459723+0000","last_change":"2024-04-25T08:59:15.458322+0000","last_active":"2024-04-25T08:59:15.459723+0000","last_peered":"2024-04-25T08:59:15.459723+0000","last_clean":"2024-04-25T08:59:15.459723+0000","last_became_active":"2024-04-25T08:59:15.458007+0000","last_became_peered":"2024-04-25T08:59:15.458007+0000","last_unstale":"2024-04-25T08:59:15.459723+0000","last_undegraded":"2024-04-25T08:59:15.459723+0000","last_fullsized":"2024-04-25T08:59:15.459723+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449096+0000","last_change":"2024-04-25T08:59:15.449096+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449096+0000","last_undegraded":"2024-04-25T08:59:15.449096+0000","last_fullsized":"2024-04-25T08:59:15.449096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466992+0000","last_change":"2024-04-25T08:59:15.462685+0000","last_active":"2024-04-25T08:59:15.466992+0000","last_peered":"2024-04-25T08:59:15.466992+0000","last_clean":"2024-04-25T08:59:15.466992+0000","last_became_active":"2024-04-25T08:59:15.462425+0000","last_became_peered":"2024-04-25T08:59:15.462425+0000","last_unstale":"2024-04-25T08:59:15.466992+0000","last_undegraded":"2024-04-25T08:59:15.466992+0000","last_fullsized":"2024-04-25T08:59:15.466992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453454+0000","last_change":"2024-04-25T08:59:15.453454+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453454+0000","last_undegraded":"2024-04-25T08:59:15.453454+0000","last_fullsized":"2024-04-25T08:59:15.453454+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463983+0000","last_change":"2024-04-25T08:59:15.455921+0000","last_active":"2024-04-25T08:59:15.463983+0000","last_peered":"2024-04-25T08:59:15.463983+0000","last_clean":"2024-04-25T08:59:15.463983+0000","last_became_active":"2024-04-25T08:59:15.455572+0000","last_became_peered":"2024-04-25T08:59:15.455572+0000","last_unstale":"2024-04-25T08:59:15.463983+0000","last_undegraded":"2024-04-25T08:59:15.463983+0000","last_fullsized":"2024-04-25T08:59:15.463983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:01.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447058+0000","last_change":"2024-04-25T08:59:15.447058+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447058+0000","last_undegraded":"2024-04-25T08:59:15.447058+0000","last_fullsized":"2024-04-25T08:59:15.447058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464342+0000","last_change":"2024-04-25T08:59:15.462240+0000","last_active":"2024-04-25T08:59:15.464342+0000","last_peered":"2024-04-25T08:59:15.464342+0000","last_clean":"2024-04-25T08:59:15.464342+0000","last_became_active":"2024-04-25T08:59:15.461770+0000","last_became_peered":"2024-04-25T08:59:15.461770+0000","last_unstale":"2024-04-25T08:59:15.464342+0000","last_undegraded":"2024-04-25T08:59:15.464342+0000","last_fullsized":"2024-04-25T08:59:15.464342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446244+0000","last_change":"2024-04-25T08:59:15.446244+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446244+0000","last_undegraded":"2024-04-25T08:59:15.446244+0000","last_fullsized":"2024-04-25T08:59:15.446244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466349+0000","last_change":"2024-04-25T08:59:15.464867+0000","last_active":"2024-04-25T08:59:15.466349+0000","last_peered":"2024-04-25T08:59:15.466349+0000","last_clean":"2024-04-25T08:59:15.466349+0000","last_became_active":"2024-04-25T08:59:15.464561+0000","last_became_peered":"2024-04-25T08:59:15.464561+0000","last_unstale":"2024-04-25T08:59:15.466349+0000","last_undegraded":"2024-04-25T08:59:15.466349+0000","last_fullsized":"2024-04-25T08:59:15.466349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:57.546490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456285+0000","last_change":"2024-04-25T08:59:15.456285+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456285+0000","last_undegraded":"2024-04-25T08:59:15.456285+0000","last_fullsized":"2024-04-25T08:59:15.456285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461218+0000","last_change":"2024-04-25T08:59:15.457085+0000","last_active":"2024-04-25T08:59:15.461218+0000","last_peered":"2024-04-25T08:59:15.461218+0000","last_clean":"2024-04-25T08:59:15.461218+0000","last_became_active":"2024-04-25T08:59:15.456462+0000","last_became_peered":"2024-04-25T08:59:15.456462+0000","last_unstale":"2024-04-25T08:59:15.461218+0000","last_undegraded":"2024-04-25T08:59:15.461218+0000","last_fullsized":"2024-04-25T08:59:15.461218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.452386+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:59:15.452386+0000","last_peered":"2024-04-25T08:59:15.452386+0000","last_clean":"2024-04-25T08:59:15.452386+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:59:15.452386+0000","last_undegraded":"2024-04-25T08:59:15.452386+0000","last_fullsized":"2024-04-25T08:59:15.452386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335432,"statfs":{"total":96636764160,"available":96599482368,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35832,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:19.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:19.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.936+0000 7fb351334640 1 Processor -- start 2024-04-25T08:59:19.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.937+0000 7fb351334640 1 -- start start 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.937+0000 7fb351334640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb34c15de70 0x7fb34c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.937+0000 7fb351334640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb34c0ce7f0 0x7fb34c0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.937+0000 7fb351334640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0cf1c0 con 0x7fb34c0b2cc0 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.937+0000 7fb351334640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0d2a10 con 0x7fb34c15de70 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.937+0000 7fb351334640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0d20e0 con 0x7fb34c0ce7f0 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb34c15de70 0x7fb34c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34a7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb34c0b2cc0 0x7fb34c0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37896/0 (socket says 172.21.15.5:37896) 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb34c15de70 0x7fb34c0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40050/0 (socket says 172.21.15.5:40050) 2024-04-25T08:59:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34a7fc640 1 -- 172.21.15.5:0/2056696459 learned_addr learned my addr 172.21.15.5:0/2056696459 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34b7fe640 1 --2- 172.21.15.5:0/2056696459 >> v2:172.21.15.80:3300/0 conn(0x7fb34c0ce7f0 0x7fb34c0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34affd640 1 -- 172.21.15.5:0/2056696459 >> v2:172.21.15.80:3300/0 conn(0x7fb34c0ce7f0 msgr2=0x7fb34c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34affd640 1 --2- 172.21.15.5:0/2056696459 >> v2:172.21.15.80:3300/0 conn(0x7fb34c0ce7f0 0x7fb34c0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34affd640 1 -- 172.21.15.5:0/2056696459 >> v1:172.21.15.5:6789/0 conn(0x7fb34c0b2cc0 legacy=0x7fb34c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.938+0000 7fb34affd640 1 -- 172.21.15.5:0/2056696459 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0d23c0 con 0x7fb34c15de70 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb34affd640 1 --2- 172.21.15.5:0/2056696459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0b93e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0d1970 tx=0x7fb34402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb343576d4772d35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb349ffb640 1 -- 172.21.15.5:0/2056696459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344037070 con 0x7fb34c15de70 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb349ffb640 1 -- 172.21.15.5:0/2056696459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344032440 con 0x7fb34c15de70 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb349ffb640 1 -- 172.21.15.5:0/2056696459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344032810 con 0x7fb34c15de70 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 -- 172.21.15.5:0/2056696459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 msgr2=0x7fb34c0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 --2- 172.21.15.5:0/2056696459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0b93e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0d1970 tx=0x7fb34402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 -- 172.21.15.5:0/2056696459 shutdown_connections 2024-04-25T08:59:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 --2- 172.21.15.5:0/2056696459 >> v2:172.21.15.80:3300/0 conn(0x7fb34c0ce7f0 0x7fb34c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 --2- 172.21.15.5:0/2056696459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0b93e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 -- 172.21.15.5:0/2056696459 >> 172.21.15.5:0/2056696459 conn(0x7fb34c06b000 msgr2=0x7fb34c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 -- 172.21.15.5:0/2056696459 shutdown_connections 2024-04-25T08:59:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.939+0000 7fb351334640 1 -- 172.21.15.5:0/2056696459 wait complete. 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 Processor -- start 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 -- start start 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34c0b2cc0 0x7fb34c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb34c0ce7f0 0x7fb34c1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0b7300 con 0x7fb34c15de70 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0b9920 con 0x7fb34c0b2cc0 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.941+0000 7fb351334640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0d2ea0 con 0x7fb34c0ce7f0 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40052/0 (socket says 172.21.15.5:40052) 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 -- 172.21.15.5:0/485329413 learned_addr learned my addr 172.21.15.5:0/485329413 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34affd640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34c0b2cc0 0x7fb34c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34a7fc640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb34c0ce7f0 0x7fb34c1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 -- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb34c0ce7f0 msgr2=0x7fb34c1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb34c0ce7f0 0x7fb34c1548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 -- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34c0b2cc0 msgr2=0x7fb34c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34c0b2cc0 0x7fb34c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 -- 172.21.15.5:0/485329413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0c7690 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34a7fc640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb34c0ce7f0 0x7fb34c1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb34b7fe640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0c90f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009dd0 tx=0x7fb33c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb3337fe640 1 -- 172.21.15.5:0/485329413 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c018020 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb3337fe640 1 -- 172.21.15.5:0/485329413 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c014480 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0c7970 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb3337fe640 1 -- 172.21.15.5:0/485329413 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c014870 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.942+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0c7f30 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.943+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c0c8130 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.944+0000 7fb3337fe640 1 -- 172.21.15.5:0/485329413 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb33c005d10 con 0x7fb34c15de70 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.944+0000 7fb3337fe640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb33806b4d0 0x7fb33806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.944+0000 7fb3337fe640 1 -- 172.21.15.5:0/485329413 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb33c08b130 con 0x7fb34c15de70 2024-04-25T08:59:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.944+0000 7fb34affd640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb33806b4d0 0x7fb33806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.945+0000 7fb34affd640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb33806b4d0 0x7fb33806d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb344034000 tx=0x7fb34402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:19.948+0000 7fb3337fe640 1 -- 172.21.15.5:0/485329413 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb34c0c8130 con 0x7fb34c15de70 2024-04-25T08:59:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.123+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb34c04ef20 con 0x7fb33806b4d0 2024-04-25T08:59:20.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.130+0000 7fb3337fe640 1 -- 172.21.15.5:0/485329413 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246640 (secure 0 0 0) 0x7fb34c04ef20 con 0x7fb33806b4d0 2024-04-25T08:59:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:59:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb33806b4d0 msgr2=0x7fb33806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb33806b4d0 0x7fb33806d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb344034000 tx=0x7fb34402e000 comp rx=0 tx=0).stop 2024-04-25T08:59:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 msgr2=0x7fb34c0c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0c90f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009dd0 tx=0x7fb33c00c490 comp rx=0 tx=0).stop 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 shutdown_connections 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb33806b4d0 0x7fb33806d990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb34c15de70 0x7fb34c0c90f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb34c0ce7f0 0x7fb34c1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 --2- 172.21.15.5:0/485329413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34c0b2cc0 0x7fb34c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 >> 172.21.15.5:0/485329413 conn(0x7fb34c06b000 msgr2=0x7fb34c0d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 shutdown_connections 2024-04-25T08:59:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.132+0000 7fb351334640 1 -- 172.21.15.5:0/485329413 wait complete. 2024-04-25T08:59:20.133 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-04-25T08:59:18.421424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":296076,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754678644,"statfs":{"total":773094113280,"available":772790931456,"internally_reserved":0,"allocated":5120000,"data_stored":2756064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000898"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450204+0000","last_change":"2024-04-25T08:59:15.450204+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450204+0000","last_undegraded":"2024-04-25T08:59:15.450204+0000","last_fullsized":"2024-04-25T08:59:15.450204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447164+0000","last_change":"2024-04-25T08:59:15.447164+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447164+0000","last_undegraded":"2024-04-25T08:59:15.447164+0000","last_fullsized":"2024-04-25T08:59:15.447164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447632+0000","last_change":"2024-04-25T08:59:15.447632+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447632+0000","last_undegraded":"2024-04-25T08:59:15.447632+0000","last_fullsized":"2024-04-25T08:59:15.447632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455436+0000","last_change":"2024-04-25T08:59:15.455436+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455436+0000","last_undegraded":"2024-04-25T08:59:15.455436+0000","last_fullsized":"2024-04-25T08:59:15.455436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446623+0000","last_change":"2024-04-25T08:59:15.446623+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446623+0000","last_undegraded":"2024-04-25T08:59:15.446623+0000","last_fullsized":"2024-04-25T08:59:15.446623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450196+0000","last_change":"2024-04-25T08:59:15.450196+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450196+0000","last_undegraded":"2024-04-25T08:59:15.450196+0000","last_fullsized":"2024-04-25T08:59:15.450196+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450609+0000","last_change":"2024-04-25T08:59:15.450609+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450609+0000","last_undegraded":"2024-04-25T08:59:15.450609+0000","last_fullsized":"2024-04-25T08:59:15.450609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458814+0000","last_change":"2024-04-25T08:59:15.458814+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458814+0000","last_undegraded":"2024-04-25T08:59:15.458814+0000","last_fullsized":"2024-04-25T08:59:15.458814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457592+0000","last_change":"2024-04-25T08:59:15.457592+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457592+0000","last_undegraded":"2024-04-25T08:59:15.457592+0000","last_fullsized":"2024-04-25T08:59:15.457592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458127+0000","last_change":"2024-04-25T08:59:15.458127+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458127+0000","last_undegraded":"2024-04-25T08:59:15.458127+0000","last_fullsized":"2024-04-25T08:59:15.458127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453510+0000","last_change":"2024-04-25T08:59:15.453510+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453510+0000","last_undegraded":"2024-04-25T08:59:15.453510+0000","last_fullsized":"2024-04-25T08:59:15.453510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449347+0000","last_change":"2024-04-25T08:59:15.449347+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449347+0000","last_undegraded":"2024-04-25T08:59:15.449347+0000","last_fullsized":"2024-04-25T08:59:15.449347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448863+0000","last_change":"2024-04-25T08:59:15.448863+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448863+0000","last_undegraded":"2024-04-25T08:59:15.448863+0000","last_fullsized":"2024-04-25T08:59:15.448863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457670+0000","last_change":"2024-04-25T08:59:15.457670+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457670+0000","last_undegraded":"2024-04-25T08:59:15.457670+0000","last_fullsized":"2024-04-25T08:59:15.457670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451968+0000","last_change":"2024-04-25T08:59:15.451968+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451968+0000","last_undegraded":"2024-04-25T08:59:15.451968+0000","last_fullsized":"2024-04-25T08:59:15.451968+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451484+0000","last_change":"2024-04-25T08:59:15.451484+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451484+0000","last_undegraded":"2024-04-25T08:59:15.451484+0000","last_fullsized":"2024-04-25T08:59:15.451484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447622+0000","last_change":"2024-04-25T08:59:15.447622+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447622+0000","last_undegraded":"2024-04-25T08:59:15.447622+0000","last_fullsized":"2024-04-25T08:59:15.447622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448174+0000","last_change":"2024-04-25T08:59:15.448174+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448174+0000","last_undegraded":"2024-04-25T08:59:15.448174+0000","last_fullsized":"2024-04-25T08:59:15.448174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453485+0000","last_change":"2024-04-25T08:59:15.453485+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453485+0000","last_undegraded":"2024-04-25T08:59:15.453485+0000","last_fullsized":"2024-04-25T08:59:15.453485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448909+0000","last_change":"2024-04-25T08:59:15.448909+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448909+0000","last_undegraded":"2024-04-25T08:59:15.448909+0000","last_fullsized":"2024-04-25T08:59:15.448909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453849+0000","last_change":"2024-04-25T08:59:15.453849+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453849+0000","last_undegraded":"2024-04-25T08:59:15.453849+0000","last_fullsized":"2024-04-25T08:59:15.453849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453681+0000","last_change":"2024-04-25T08:59:15.453681+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453681+0000","last_undegraded":"2024-04-25T08:59:15.453681+0000","last_fullsized":"2024-04-25T08:59:15.453681+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451908+0000","last_change":"2024-04-25T08:59:15.451908+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451908+0000","last_undegraded":"2024-04-25T08:59:15.451908+0000","last_fullsized":"2024-04-25T08:59:15.451908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450940+0000","last_change":"2024-04-25T08:59:15.450940+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450940+0000","last_undegraded":"2024-04-25T08:59:15.450940+0000","last_fullsized":"2024-04-25T08:59:15.450940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455830+0000","last_change":"2024-04-25T08:59:15.455830+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455830+0000","last_undegraded":"2024-04-25T08:59:15.455830+0000","last_fullsized":"2024-04-25T08:59:15.455830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448526+0000","last_change":"2024-04-25T08:59:15.448526+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448526+0000","last_undegraded":"2024-04-25T08:59:15.448526+0000","last_fullsized":"2024-04-25T08:59:15.448526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446067+0000","last_change":"2024-04-25T08:59:15.446067+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446067+0000","last_undegraded":"2024-04-25T08:59:15.446067+0000","last_fullsized":"2024-04-25T08:59:15.446067+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448874+0000","last_change":"2024-04-25T08:59:15.448874+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448874+0000","last_undegraded":"2024-04-25T08:59:15.448874+0000","last_fullsized":"2024-04-25T08:59:15.448874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452130+0000","last_change":"2024-04-25T08:59:15.452130+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452130+0000","last_undegraded":"2024-04-25T08:59:15.452130+0000","last_fullsized":"2024-04-25T08:59:15.452130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448605+0000","last_change":"2024-04-25T08:59:15.448605+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448605+0000","last_undegraded":"2024-04-25T08:59:15.448605+0000","last_fullsized":"2024-04-25T08:59:15.448605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451461+0000","last_change":"2024-04-25T08:59:15.451461+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451461+0000","last_undegraded":"2024-04-25T08:59:15.451461+0000","last_fullsized":"2024-04-25T08:59:15.451461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448014+0000","last_change":"2024-04-25T08:59:15.448014+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448014+0000","last_undegraded":"2024-04-25T08:59:15.448014+0000","last_fullsized":"2024-04-25T08:59:15.448014+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450414+0000","last_change":"2024-04-25T08:59:15.450414+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450414+0000","last_undegraded":"2024-04-25T08:59:15.450414+0000","last_fullsized":"2024-04-25T08:59:15.450414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463903+0000","last_change":"2024-04-25T08:59:15.459021+0000","last_active":"2024-04-25T08:59:15.463903+0000","last_peered":"2024-04-25T08:59:15.463903+0000","last_clean":"2024-04-25T08:59:15.463903+0000","last_became_active":"2024-04-25T08:59:15.458664+0000","last_became_peered":"2024-04-25T08:59:15.458664+0000","last_unstale":"2024-04-25T08:59:15.463903+0000","last_undegraded":"2024-04-25T08:59:15.463903+0000","last_fullsized":"2024-04-25T08:59:15.463903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455388+0000","last_change":"2024-04-25T08:59:15.455388+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455388+0000","last_undegraded":"2024-04-25T08:59:15.455388+0000","last_fullsized":"2024-04-25T08:59:15.455388+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461311+0000","last_change":"2024-04-25T08:59:15.454182+0000","last_active":"2024-04-25T08:59:15.461311+0000","last_peered":"2024-04-25T08:59:15.461311+0000","last_clean":"2024-04-25T08:59:15.461311+0000","last_became_active":"2024-04-25T08:59:15.453926+0000","last_became_peered":"2024-04-25T08:59:15.453926+0000","last_unstale":"2024-04-25T08:59:15.461311+0000","last_undegraded":"2024-04-25T08:59:15.461311+0000","last_fullsized":"2024-04-25T08:59:15.461311+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:46.631288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448409+0000","last_change":"2024-04-25T08:59:15.448409+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448409+0000","last_undegraded":"2024-04-25T08:59:15.448409+0000","last_fullsized":"2024-04-25T08:59:15.448409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464204+0000","last_change":"2024-04-25T08:59:15.462158+0000","last_active":"2024-04-25T08:59:15.464204+0000","last_peered":"2024-04-25T08:59:15.464204+0000","last_clean":"2024-04-25T08:59:15.464204+0000","last_became_active":"2024-04-25T08:59:15.461680+0000","last_became_peered":"2024-04-25T08:59:15.461680+0000","last_unstale":"2024-04-25T08:59:15.464204+0000","last_undegraded":"2024-04-25T08:59:15.464204+0000","last_fullsized":"2024-04-25T08:59:15.464204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453550+0000","last_change":"2024-04-25T08:59:15.453550+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453550+0000","last_undegraded":"2024-04-25T08:59:15.453550+0000","last_fullsized":"2024-04-25T08:59:15.453550+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461312+0000","last_change":"2024-04-25T08:59:15.458383+0000","last_active":"2024-04-25T08:59:15.461312+0000","last_peered":"2024-04-25T08:59:15.461312+0000","last_clean":"2024-04-25T08:59:15.461312+0000","last_became_active":"2024-04-25T08:59:15.457899+0000","last_became_peered":"2024-04-25T08:59:15.457899+0000","last_unstale":"2024-04-25T08:59:15.461312+0000","last_undegraded":"2024-04-25T08:59:15.461312+0000","last_fullsized":"2024-04-25T08:59:15.461312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448124+0000","last_change":"2024-04-25T08:59:15.448124+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448124+0000","last_undegraded":"2024-04-25T08:59:15.448124+0000","last_fullsized":"2024-04-25T08:59:15.448124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463836+0000","last_change":"2024-04-25T08:59:15.459763+0000","last_active":"2024-04-25T08:59:15.463836+0000","last_peered":"2024-04-25T08:59:15.463836+0000","last_clean":"2024-04-25T08:59:15.463836+0000","last_became_active":"2024-04-25T08:59:15.459423+0000","last_became_peered":"2024-04-25T08:59:15.459423+0000","last_unstale":"2024-04-25T08:59:15.463836+0000","last_undegraded":"2024-04-25T08:59:15.463836+0000","last_fullsized":"2024-04-25T08:59:15.463836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.461126+0000","last_change":"2024-04-25T08:59:15.461126+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.461126+0000","last_undegraded":"2024-04-25T08:59:15.461126+0000","last_fullsized":"2024-04-25T08:59:15.461126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461500+0000","last_change":"2024-04-25T08:59:15.453202+0000","last_active":"2024-04-25T08:59:15.461500+0000","last_peered":"2024-04-25T08:59:15.461500+0000","last_clean":"2024-04-25T08:59:15.461500+0000","last_became_active":"2024-04-25T08:59:15.452856+0000","last_became_peered":"2024-04-25T08:59:15.452856+0000","last_unstale":"2024-04-25T08:59:15.461500+0000","last_undegraded":"2024-04-25T08:59:15.461500+0000","last_fullsized":"2024-04-25T08:59:15.461500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458101+0000","last_change":"2024-04-25T08:59:15.458101+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458101+0000","last_undegraded":"2024-04-25T08:59:15.458101+0000","last_fullsized":"2024-04-25T08:59:15.458101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454396+0000","last_change":"2024-04-25T08:59:15.453050+0000","last_active":"2024-04-25T08:59:15.454396+0000","last_peered":"2024-04-25T08:59:15.454396+0000","last_clean":"2024-04-25T08:59:15.454396+0000","last_became_active":"2024-04-25T08:59:15.452771+0000","last_became_peered":"2024-04-25T08:59:15.452771+0000","last_unstale":"2024-04-25T08:59:15.454396+0000","last_undegraded":"2024-04-25T08:59:15.454396+0000","last_fullsized":"2024-04-25T08:59:15.454396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456295+0000","last_change":"2024-04-25T08:59:15.456295+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456295+0000","last_undegraded":"2024-04-25T08:59:15.456295+0000","last_fullsized":"2024-04-25T08:59:15.456295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466373+0000","last_change":"2024-04-25T08:59:15.465229+0000","last_active":"2024-04-25T08:59:15.466373+0000","last_peered":"2024-04-25T08:59:15.466373+0000","last_clean":"2024-04-25T08:59:15.466373+0000","last_became_active":"2024-04-25T08:59:15.464721+0000","last_became_peered":"2024-04-25T08:59:15.464721+0000","last_unstale":"2024-04-25T08:59:15.466373+0000","last_undegraded":"2024-04-25T08:59:15.466373+0000","last_fullsized":"2024-04-25T08:59:15.466373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:16.843489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447689+0000","last_change":"2024-04-25T08:59:15.447689+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447689+0000","last_undegraded":"2024-04-25T08:59:15.447689+0000","last_fullsized":"2024-04-25T08:59:15.447689+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461098+0000","last_change":"2024-04-25T08:59:15.450651+0000","last_active":"2024-04-25T08:59:15.461098+0000","last_peered":"2024-04-25T08:59:15.461098+0000","last_clean":"2024-04-25T08:59:15.461098+0000","last_became_active":"2024-04-25T08:59:15.450157+0000","last_became_peered":"2024-04-25T08:59:15.450157+0000","last_unstale":"2024-04-25T08:59:15.461098+0000","last_undegraded":"2024-04-25T08:59:15.461098+0000","last_fullsized":"2024-04-25T08:59:15.461098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448619+0000","last_change":"2024-04-25T08:59:15.448619+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448619+0000","last_undegraded":"2024-04-25T08:59:15.448619+0000","last_fullsized":"2024-04-25T08:59:15.448619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468358+0000","last_change":"2024-04-25T08:59:15.467758+0000","last_active":"2024-04-25T08:59:15.468358+0000","last_peered":"2024-04-25T08:59:15.468358+0000","last_clean":"2024-04-25T08:59:15.468358+0000","last_became_active":"2024-04-25T08:59:15.467423+0000","last_became_peered":"2024-04-25T08:59:15.467423+0000","last_unstale":"2024-04-25T08:59:15.468358+0000","last_undegraded":"2024-04-25T08:59:15.468358+0000","last_fullsized":"2024-04-25T08:59:15.468358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:40.158535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449032+0000","last_change":"2024-04-25T08:59:15.449032+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449032+0000","last_undegraded":"2024-04-25T08:59:15.449032+0000","last_fullsized":"2024-04-25T08:59:15.449032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466976+0000","last_change":"2024-04-25T08:59:15.462089+0000","last_active":"2024-04-25T08:59:15.466976+0000","last_peered":"2024-04-25T08:59:15.466976+0000","last_clean":"2024-04-25T08:59:15.466976+0000","last_became_active":"2024-04-25T08:59:15.461797+0000","last_became_peered":"2024-04-25T08:59:15.461797+0000","last_unstale":"2024-04-25T08:59:15.466976+0000","last_undegraded":"2024-04-25T08:59:15.466976+0000","last_fullsized":"2024-04-25T08:59:15.466976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450150+0000","last_change":"2024-04-25T08:59:15.450150+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450150+0000","last_undegraded":"2024-04-25T08:59:15.450150+0000","last_fullsized":"2024-04-25T08:59:15.450150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454699+0000","last_change":"2024-04-25T08:59:15.452741+0000","last_active":"2024-04-25T08:59:15.454699+0000","last_peered":"2024-04-25T08:59:15.454699+0000","last_clean":"2024-04-25T08:59:15.454699+0000","last_became_active":"2024-04-25T08:59:15.452336+0000","last_became_peered":"2024-04-25T08:59:15.452336+0000","last_unstale":"2024-04-25T08:59:15.454699+0000","last_undegraded":"2024-04-25T08:59:15.454699+0000","last_fullsized":"2024-04-25T08:59:15.454699+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:02.452298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453056+0000","last_change":"2024-04-25T08:59:15.453056+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453056+0000","last_undegraded":"2024-04-25T08:59:15.453056+0000","last_fullsized":"2024-04-25T08:59:15.453056+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466780+0000","last_change":"2024-04-25T08:59:15.466415+0000","last_active":"2024-04-25T08:59:15.466780+0000","last_peered":"2024-04-25T08:59:15.466780+0000","last_clean":"2024-04-25T08:59:15.466780+0000","last_became_active":"2024-04-25T08:59:15.466019+0000","last_became_peered":"2024-04-25T08:59:15.466019+0000","last_unstale":"2024-04-25T08:59:15.466780+0000","last_undegraded":"2024-04-25T08:59:15.466780+0000","last_fullsized":"2024-04-25T08:59:15.466780+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.981461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454441+0000","last_change":"2024-04-25T08:59:15.454441+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454441+0000","last_undegraded":"2024-04-25T08:59:15.454441+0000","last_fullsized":"2024-04-25T08:59:15.454441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.458635+0000","last_change":"2024-04-25T08:59:15.455994+0000","last_active":"2024-04-25T08:59:15.458635+0000","last_peered":"2024-04-25T08:59:15.458635+0000","last_clean":"2024-04-25T08:59:15.458635+0000","last_became_active":"2024-04-25T08:59:15.455710+0000","last_became_peered":"2024-04-25T08:59:15.455710+0000","last_unstale":"2024-04-25T08:59:15.458635+0000","last_undegraded":"2024-04-25T08:59:15.458635+0000","last_fullsized":"2024-04-25T08:59:15.458635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.241831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451616+0000","last_change":"2024-04-25T08:59:15.451616+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451616+0000","last_undegraded":"2024-04-25T08:59:15.451616+0000","last_fullsized":"2024-04-25T08:59:15.451616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.465456+0000","last_change":"2024-04-25T08:59:15.464258+0000","last_active":"2024-04-25T08:59:15.465456+0000","last_peered":"2024-04-25T08:59:15.465456+0000","last_clean":"2024-04-25T08:59:15.465456+0000","last_became_active":"2024-04-25T08:59:15.463915+0000","last_became_peered":"2024-04-25T08:59:15.463915+0000","last_unstale":"2024-04-25T08:59:15.465456+0000","last_undegraded":"2024-04-25T08:59:15.465456+0000","last_fullsized":"2024-04-25T08:59:15.465456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448919+0000","last_change":"2024-04-25T08:59:15.448919+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448919+0000","last_undegraded":"2024-04-25T08:59:15.448919+0000","last_fullsized":"2024-04-25T08:59:15.448919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467998+0000","last_change":"2024-04-25T08:59:15.467372+0000","last_active":"2024-04-25T08:59:15.467998+0000","last_peered":"2024-04-25T08:59:15.467998+0000","last_clean":"2024-04-25T08:59:15.467998+0000","last_became_active":"2024-04-25T08:59:15.467151+0000","last_became_peered":"2024-04-25T08:59:15.467151+0000","last_unstale":"2024-04-25T08:59:15.467998+0000","last_undegraded":"2024-04-25T08:59:15.467998+0000","last_fullsized":"2024-04-25T08:59:15.467998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:40.462959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448015+0000","last_change":"2024-04-25T08:59:15.448015+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448015+0000","last_undegraded":"2024-04-25T08:59:15.448015+0000","last_fullsized":"2024-04-25T08:59:15.448015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.456952+0000","last_change":"2024-04-25T08:59:15.455569+0000","last_active":"2024-04-25T08:59:15.456952+0000","last_peered":"2024-04-25T08:59:15.456952+0000","last_clean":"2024-04-25T08:59:15.456952+0000","last_became_active":"2024-04-25T08:59:15.455293+0000","last_became_peered":"2024-04-25T08:59:15.455293+0000","last_unstale":"2024-04-25T08:59:15.456952+0000","last_undegraded":"2024-04-25T08:59:15.456952+0000","last_fullsized":"2024-04-25T08:59:15.456952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:07.263160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457095+0000","last_change":"2024-04-25T08:59:15.457095+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457095+0000","last_undegraded":"2024-04-25T08:59:15.457095+0000","last_fullsized":"2024-04-25T08:59:15.457095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461154+0000","last_change":"2024-04-25T08:59:15.453157+0000","last_active":"2024-04-25T08:59:15.461154+0000","last_peered":"2024-04-25T08:59:15.461154+0000","last_clean":"2024-04-25T08:59:15.461154+0000","last_became_active":"2024-04-25T08:59:15.452867+0000","last_became_peered":"2024-04-25T08:59:15.452867+0000","last_unstale":"2024-04-25T08:59:15.461154+0000","last_undegraded":"2024-04-25T08:59:15.461154+0000","last_fullsized":"2024-04-25T08:59:15.461154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452085+0000","last_change":"2024-04-25T08:59:15.452085+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452085+0000","last_undegraded":"2024-04-25T08:59:15.452085+0000","last_fullsized":"2024-04-25T08:59:15.452085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461202+0000","last_change":"2024-04-25T08:59:15.458063+0000","last_active":"2024-04-25T08:59:15.461202+0000","last_peered":"2024-04-25T08:59:15.461202+0000","last_clean":"2024-04-25T08:59:15.461202+0000","last_became_active":"2024-04-25T08:59:15.457790+0000","last_became_peered":"2024-04-25T08:59:15.457790+0000","last_unstale":"2024-04-25T08:59:15.461202+0000","last_undegraded":"2024-04-25T08:59:15.461202+0000","last_fullsized":"2024-04-25T08:59:15.461202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454036+0000","last_change":"2024-04-25T08:59:15.454036+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454036+0000","last_undegraded":"2024-04-25T08:59:15.454036+0000","last_fullsized":"2024-04-25T08:59:15.454036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463863+0000","last_change":"2024-04-25T08:59:15.459026+0000","last_active":"2024-04-25T08:59:15.463863+0000","last_peered":"2024-04-25T08:59:15.463863+0000","last_clean":"2024-04-25T08:59:15.463863+0000","last_became_active":"2024-04-25T08:59:15.458727+0000","last_became_peered":"2024-04-25T08:59:15.458727+0000","last_unstale":"2024-04-25T08:59:15.463863+0000","last_undegraded":"2024-04-25T08:59:15.463863+0000","last_fullsized":"2024-04-25T08:59:15.463863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449794+0000","last_change":"2024-04-25T08:59:15.449794+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449794+0000","last_undegraded":"2024-04-25T08:59:15.449794+0000","last_fullsized":"2024-04-25T08:59:15.449794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463580+0000","last_change":"2024-04-25T08:59:15.458236+0000","last_active":"2024-04-25T08:59:15.463580+0000","last_peered":"2024-04-25T08:59:15.463580+0000","last_clean":"2024-04-25T08:59:15.463580+0000","last_became_active":"2024-04-25T08:59:15.457948+0000","last_became_peered":"2024-04-25T08:59:15.457948+0000","last_unstale":"2024-04-25T08:59:15.463580+0000","last_undegraded":"2024-04-25T08:59:15.463580+0000","last_fullsized":"2024-04-25T08:59:15.463580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449832+0000","last_change":"2024-04-25T08:59:15.449832+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449832+0000","last_undegraded":"2024-04-25T08:59:15.449832+0000","last_fullsized":"2024-04-25T08:59:15.449832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464100+0000","last_change":"2024-04-25T08:59:15.458975+0000","last_active":"2024-04-25T08:59:15.464100+0000","last_peered":"2024-04-25T08:59:15.464100+0000","last_clean":"2024-04-25T08:59:15.464100+0000","last_became_active":"2024-04-25T08:59:15.458706+0000","last_became_peered":"2024-04-25T08:59:15.458706+0000","last_unstale":"2024-04-25T08:59:15.464100+0000","last_undegraded":"2024-04-25T08:59:15.464100+0000","last_fullsized":"2024-04-25T08:59:15.464100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447404+0000","last_change":"2024-04-25T08:59:15.447404+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447404+0000","last_undegraded":"2024-04-25T08:59:15.447404+0000","last_fullsized":"2024-04-25T08:59:15.447404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468165+0000","last_change":"2024-04-25T08:59:15.467679+0000","last_active":"2024-04-25T08:59:15.468165+0000","last_peered":"2024-04-25T08:59:15.468165+0000","last_clean":"2024-04-25T08:59:15.468165+0000","last_became_active":"2024-04-25T08:59:15.467367+0000","last_became_peered":"2024-04-25T08:59:15.467367+0000","last_unstale":"2024-04-25T08:59:15.468165+0000","last_undegraded":"2024-04-25T08:59:15.468165+0000","last_fullsized":"2024-04-25T08:59:15.468165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:01.090235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453663+0000","last_change":"2024-04-25T08:59:15.453663+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453663+0000","last_undegraded":"2024-04-25T08:59:15.453663+0000","last_fullsized":"2024-04-25T08:59:15.453663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461326+0000","last_change":"2024-04-25T08:59:15.457106+0000","last_active":"2024-04-25T08:59:15.461326+0000","last_peered":"2024-04-25T08:59:15.461326+0000","last_clean":"2024-04-25T08:59:15.461326+0000","last_became_active":"2024-04-25T08:59:15.456818+0000","last_became_peered":"2024-04-25T08:59:15.456818+0000","last_unstale":"2024-04-25T08:59:15.461326+0000","last_undegraded":"2024-04-25T08:59:15.461326+0000","last_fullsized":"2024-04-25T08:59:15.461326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454964+0000","last_change":"2024-04-25T08:59:15.454964+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454964+0000","last_undegraded":"2024-04-25T08:59:15.454964+0000","last_fullsized":"2024-04-25T08:59:15.454964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466053+0000","last_change":"2024-04-25T08:59:15.465453+0000","last_active":"2024-04-25T08:59:15.466053+0000","last_peered":"2024-04-25T08:59:15.466053+0000","last_clean":"2024-04-25T08:59:15.466053+0000","last_became_active":"2024-04-25T08:59:15.464640+0000","last_became_peered":"2024-04-25T08:59:15.464640+0000","last_unstale":"2024-04-25T08:59:15.466053+0000","last_undegraded":"2024-04-25T08:59:15.466053+0000","last_fullsized":"2024-04-25T08:59:15.466053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:51.190507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453809+0000","last_change":"2024-04-25T08:59:15.453809+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453809+0000","last_undegraded":"2024-04-25T08:59:15.453809+0000","last_fullsized":"2024-04-25T08:59:15.453809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467003+0000","last_change":"2024-04-25T08:59:15.462152+0000","last_active":"2024-04-25T08:59:15.467003+0000","last_peered":"2024-04-25T08:59:15.467003+0000","last_clean":"2024-04-25T08:59:15.467003+0000","last_became_active":"2024-04-25T08:59:15.461867+0000","last_became_peered":"2024-04-25T08:59:15.461867+0000","last_unstale":"2024-04-25T08:59:15.467003+0000","last_undegraded":"2024-04-25T08:59:15.467003+0000","last_fullsized":"2024-04-25T08:59:15.467003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448611+0000","last_change":"2024-04-25T08:59:15.448611+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448611+0000","last_undegraded":"2024-04-25T08:59:15.448611+0000","last_fullsized":"2024-04-25T08:59:15.448611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.459723+0000","last_change":"2024-04-25T08:59:15.458322+0000","last_active":"2024-04-25T08:59:15.459723+0000","last_peered":"2024-04-25T08:59:15.459723+0000","last_clean":"2024-04-25T08:59:15.459723+0000","last_became_active":"2024-04-25T08:59:15.458007+0000","last_became_peered":"2024-04-25T08:59:15.458007+0000","last_unstale":"2024-04-25T08:59:15.459723+0000","last_undegraded":"2024-04-25T08:59:15.459723+0000","last_fullsized":"2024-04-25T08:59:15.459723+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449096+0000","last_change":"2024-04-25T08:59:15.449096+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449096+0000","last_undegraded":"2024-04-25T08:59:15.449096+0000","last_fullsized":"2024-04-25T08:59:15.449096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466992+0000","last_change":"2024-04-25T08:59:15.462685+0000","last_active":"2024-04-25T08:59:15.466992+0000","last_peered":"2024-04-25T08:59:15.466992+0000","last_clean":"2024-04-25T08:59:15.466992+0000","last_became_active":"2024-04-25T08:59:15.462425+0000","last_became_peered":"2024-04-25T08:59:15.462425+0000","last_unstale":"2024-04-25T08:59:15.466992+0000","last_undegraded":"2024-04-25T08:59:15.466992+0000","last_fullsized":"2024-04-25T08:59:15.466992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453454+0000","last_change":"2024-04-25T08:59:15.453454+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453454+0000","last_undegraded":"2024-04-25T08:59:15.453454+0000","last_fullsized":"2024-04-25T08:59:15.453454+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463983+0000","last_change":"2024-04-25T08:59:15.455921+0000","last_active":"2024-04-25T08:59:15.463983+0000","last_peered":"2024-04-25T08:59:15.463983+0000","last_clean":"2024-04-25T08:59:15.463983+0000","last_became_active":"2024-04-25T08:59:15.455572+0000","last_became_peered":"2024-04-25T08:59:15.455572+0000","last_unstale":"2024-04-25T08:59:15.463983+0000","last_undegraded":"2024-04-25T08:59:15.463983+0000","last_fullsized":"2024-04-25T08:59:15.463983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:01.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447058+0000","last_change":"2024-04-25T08:59:15.447058+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447058+0000","last_undegraded":"2024-04-25T08:59:15.447058+0000","last_fullsized":"2024-04-25T08:59:15.447058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464342+0000","last_change":"2024-04-25T08:59:15.462240+0000","last_active":"2024-04-25T08:59:15.464342+0000","last_peered":"2024-04-25T08:59:15.464342+0000","last_clean":"2024-04-25T08:59:15.464342+0000","last_became_active":"2024-04-25T08:59:15.461770+0000","last_became_peered":"2024-04-25T08:59:15.461770+0000","last_unstale":"2024-04-25T08:59:15.464342+0000","last_undegraded":"2024-04-25T08:59:15.464342+0000","last_fullsized":"2024-04-25T08:59:15.464342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446244+0000","last_change":"2024-04-25T08:59:15.446244+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446244+0000","last_undegraded":"2024-04-25T08:59:15.446244+0000","last_fullsized":"2024-04-25T08:59:15.446244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466349+0000","last_change":"2024-04-25T08:59:15.464867+0000","last_active":"2024-04-25T08:59:15.466349+0000","last_peered":"2024-04-25T08:59:15.466349+0000","last_clean":"2024-04-25T08:59:15.466349+0000","last_became_active":"2024-04-25T08:59:15.464561+0000","last_became_peered":"2024-04-25T08:59:15.464561+0000","last_unstale":"2024-04-25T08:59:15.466349+0000","last_undegraded":"2024-04-25T08:59:15.466349+0000","last_fullsized":"2024-04-25T08:59:15.466349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:57.546490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456285+0000","last_change":"2024-04-25T08:59:15.456285+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456285+0000","last_undegraded":"2024-04-25T08:59:15.456285+0000","last_fullsized":"2024-04-25T08:59:15.456285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461218+0000","last_change":"2024-04-25T08:59:15.457085+0000","last_active":"2024-04-25T08:59:15.461218+0000","last_peered":"2024-04-25T08:59:15.461218+0000","last_clean":"2024-04-25T08:59:15.461218+0000","last_became_active":"2024-04-25T08:59:15.456462+0000","last_became_peered":"2024-04-25T08:59:15.456462+0000","last_unstale":"2024-04-25T08:59:15.461218+0000","last_undegraded":"2024-04-25T08:59:15.461218+0000","last_fullsized":"2024-04-25T08:59:15.461218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.452386+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:59:15.452386+0000","last_peered":"2024-04-25T08:59:15.452386+0000","last_clean":"2024-04-25T08:59:15.452386+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:59:15.452386+0000","last_undegraded":"2024-04-25T08:59:15.452386+0000","last_fullsized":"2024-04-25T08:59:15.452386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335432,"statfs":{"total":96636764160,"available":96599482368,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35832,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:20.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.450204+0000', 'last_change': '2024-04-25T08:59:15.450204+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.450204+0000', 'last_undegraded': '2024-04-25T08:59:15.450204+0000', 'last_fullsized': '2024-04-25T08:59:15.450204+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.447164+0000', 'last_change': '2024-04-25T08:59:15.447164+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.447164+0000', 'last_undegraded': '2024-04-25T08:59:15.447164+0000', 'last_fullsized': '2024-04-25T08:59:15.447164+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.447632+0000', 'last_change': '2024-04-25T08:59:15.447632+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.447632+0000', 'last_undegraded': '2024-04-25T08:59:15.447632+0000', 'last_fullsized': '2024-04-25T08:59:15.447632+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.455436+0000', 'last_change': '2024-04-25T08:59:15.455436+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.455436+0000', 'last_undegraded': '2024-04-25T08:59:15.455436+0000', 'last_fullsized': '2024-04-25T08:59:15.455436+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.446623+0000', 'last_change': '2024-04-25T08:59:15.446623+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.446623+0000', 'last_undegraded': '2024-04-25T08:59:15.446623+0000', 'last_fullsized': '2024-04-25T08:59:15.446623+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-04-25T08:59:20.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.450196+0000', 'last_change': '2024-04-25T08:59:15.450196+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.450196+0000', 'last_undegraded': '2024-04-25T08:59:15.450196+0000', 'last_fullsized': '2024-04-25T08:59:15.450196+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.450609+0000', 'last_change': '2024-04-25T08:59:15.450609+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.450609+0000', 'last_undegraded': '2024-04-25T08:59:15.450609+0000', 'last_fullsized': '2024-04-25T08:59:15.450609+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.458814+0000', 'last_change': '2024-04-25T08:59:15.458814+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.458814+0000', 'last_undegraded': '2024-04-25T08:59:15.458814+0000', 'last_fullsized': '2024-04-25T08:59:15.458814+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.457592+0000', 'last_change': '2024-04-25T08:59:15.457592+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.457592+0000', 'last_undegraded': '2024-04-25T08:59:15.457592+0000', 'last_fullsized': '2024-04-25T08:59:15.457592+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.458127+0000', 'last_change': '2024-04-25T08:59:15.458127+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.458127+0000', 'last_undegraded': '2024-04-25T08:59:15.458127+0000', 'last_fullsized': '2024-04-25T08:59:15.458127+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453510+0000', 'last_change': '2024-04-25T08:59:15.453510+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453510+0000', 'last_undegraded': '2024-04-25T08:59:15.453510+0000', 'last_fullsized': '2024-04-25T08:59:15.453510+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.449347+0000', 'last_change': '2024-04-25T08:59:15.449347+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.449347+0000', 'last_undegraded': '2024-04-25T08:59:15.449347+0000', 'last_fullsized': '2024-04-25T08:59:15.449347+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448863+0000', 'last_change': '2024-04-25T08:59:15.448863+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448863+0000', 'last_undegraded': '2024-04-25T08:59:15.448863+0000', 'last_fullsized': '2024-04-25T08:59:15.448863+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.457670+0000', 'last_change': '2024-04-25T08:59:15.457670+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.457670+0000', 'last_undegraded': '2024-04-25T08:59:15.457670+0000', 'last_fullsized': '2024-04-25T08:59:15.457670+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.451968+0000', 'last_change': '2024-04-25T08:59:15.451968+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.451968+0000', 'last_undegraded': '2024-04-25T08:59:15.451968+0000', 'last_fullsized': '2024-04-25T08:59:15.451968+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.451484+0000', 'last_change': '2024-04-25T08:59:15.451484+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.451484+0000', 'last_undegraded': '2024-04-25T08:59:15.451484+0000', 'last_fullsized': '2024-04-25T08:59:15.451484+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.447622+0000', 'last_change': '2024-04-25T08:59:15.447622+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.447622+0000', 'last_undegraded': '2024-04-25T08:59:15.447622+0000', 'last_fullsized': '2024-04-25T08:59:15.447622+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448174+0000', 'last_change': '2024-04-25T08:59:15.448174+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448174+0000', 'last_undegraded': '2024-04-25T08:59:15.448174+0000', 'last_fullsized': '2024-04-25T08:59:15.448174+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453485+0000', 'last_change': '2024-04-25T08:59:15.453485+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453485+0000', 'last_undegraded': '2024-04-25T08:59:15.453485+0000', 'last_fullsized': '2024-04-25T08:59:15.453485+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448909+0000', 'last_change': '2024-04-25T08:59:15.448909+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448909+0000', 'last_undegraded': '2024-04-25T08:59:15.448909+0000', 'last_fullsized': '2024-04-25T08:59:15.448909+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453849+0000', 'last_change': '2024-04-25T08:59:15.453849+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453849+0000', 'last_undegraded': '2024-04-25T08:59:15.453849+0000', 'last_fullsized': '2024-04-25T08:59:15.453849+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453681+0000', 'last_change': '2024-04-25T08:59:15.453681+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453681+0000', 'last_undegraded': '2024-04-25T08:59:15.453681+0000', 'last_fullsized': '2024-04-25T08:59:15.453681+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.451908+0000', 'last_change': '2024-04-25T08:59:15.451908+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.451908+0000', 'last_undegraded': '2024-04-25T08:59:15.451908+0000', 'last_fullsized': '2024-04-25T08:59:15.451908+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.450940+0000', 'last_change': '2024-04-25T08:59:15.450940+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.450940+0000', 'last_undegraded': '2024-04-25T08:59:15.450940+0000', 'last_fullsized': '2024-04-25T08:59:15.450940+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.455830+0000', 'last_change': '2024-04-25T08:59:15.455830+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.455830+0000', 'last_undegraded': '2024-04-25T08:59:15.455830+0000', 'last_fullsized': '2024-04-25T08:59:15.455830+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448526+0000', 'last_change': '2024-04-25T08:59:15.448526+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448526+0000', 'last_undegraded': '2024-04-25T08:59:15.448526+0000', 'last_fullsized': '2024-04-25T08:59:15.448526+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.446067+0000', 'last_change': '2024-04-25T08:59:15.446067+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.446067+0000', 'last_undegraded': '2024-04-25T08:59:15.446067+0000', 'last_fullsized': '2024-04-25T08:59:15.446067+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448874+0000', 'last_change': '2024-04-25T08:59:15.448874+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448874+0000', 'last_undegraded': '2024-04-25T08:59:15.448874+0000', 'last_fullsized': '2024-04-25T08:59:15.448874+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.452130+0000', 'last_change': '2024-04-25T08:59:15.452130+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.452130+0000', 'last_undegraded': '2024-04-25T08:59:15.452130+0000', 'last_fullsized': '2024-04-25T08:59:15.452130+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-04-25T08:59:20.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448605+0000', 'last_change': '2024-04-25T08:59:15.448605+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448605+0000', 'last_undegraded': '2024-04-25T08:59:15.448605+0000', 'last_fullsized': '2024-04-25T08:59:15.448605+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.451461+0000', 'last_change': '2024-04-25T08:59:15.451461+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.451461+0000', 'last_undegraded': '2024-04-25T08:59:15.451461+0000', 'last_fullsized': '2024-04-25T08:59:15.451461+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448014+0000', 'last_change': '2024-04-25T08:59:15.448014+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448014+0000', 'last_undegraded': '2024-04-25T08:59:15.448014+0000', 'last_fullsized': '2024-04-25T08:59:15.448014+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.450414+0000', 'last_change': '2024-04-25T08:59:15.450414+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.450414+0000', 'last_undegraded': '2024-04-25T08:59:15.450414+0000', 'last_fullsized': '2024-04-25T08:59:15.450414+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.455388+0000', 'last_change': '2024-04-25T08:59:15.455388+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.455388+0000', 'last_undegraded': '2024-04-25T08:59:15.455388+0000', 'last_fullsized': '2024-04-25T08:59:15.455388+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448409+0000', 'last_change': '2024-04-25T08:59:15.448409+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448409+0000', 'last_undegraded': '2024-04-25T08:59:15.448409+0000', 'last_fullsized': '2024-04-25T08:59:15.448409+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:59:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453550+0000', 'last_change': '2024-04-25T08:59:15.453550+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453550+0000', 'last_undegraded': '2024-04-25T08:59:15.453550+0000', 'last_fullsized': '2024-04-25T08:59:15.453550+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448124+0000', 'last_change': '2024-04-25T08:59:15.448124+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448124+0000', 'last_undegraded': '2024-04-25T08:59:15.448124+0000', 'last_fullsized': '2024-04-25T08:59:15.448124+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.461126+0000', 'last_change': '2024-04-25T08:59:15.461126+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.461126+0000', 'last_undegraded': '2024-04-25T08:59:15.461126+0000', 'last_fullsized': '2024-04-25T08:59:15.461126+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.458101+0000', 'last_change': '2024-04-25T08:59:15.458101+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.458101+0000', 'last_undegraded': '2024-04-25T08:59:15.458101+0000', 'last_fullsized': '2024-04-25T08:59:15.458101+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.456295+0000', 'last_change': '2024-04-25T08:59:15.456295+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.456295+0000', 'last_undegraded': '2024-04-25T08:59:15.456295+0000', 'last_fullsized': '2024-04-25T08:59:15.456295+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.447689+0000', 'last_change': '2024-04-25T08:59:15.447689+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.447689+0000', 'last_undegraded': '2024-04-25T08:59:15.447689+0000', 'last_fullsized': '2024-04-25T08:59:15.447689+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448619+0000', 'last_change': '2024-04-25T08:59:15.448619+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448619+0000', 'last_undegraded': '2024-04-25T08:59:15.448619+0000', 'last_fullsized': '2024-04-25T08:59:15.448619+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.449032+0000', 'last_change': '2024-04-25T08:59:15.449032+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.449032+0000', 'last_undegraded': '2024-04-25T08:59:15.449032+0000', 'last_fullsized': '2024-04-25T08:59:15.449032+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.450150+0000', 'last_change': '2024-04-25T08:59:15.450150+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.450150+0000', 'last_undegraded': '2024-04-25T08:59:15.450150+0000', 'last_fullsized': '2024-04-25T08:59:15.450150+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453056+0000', 'last_change': '2024-04-25T08:59:15.453056+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453056+0000', 'last_undegraded': '2024-04-25T08:59:15.453056+0000', 'last_fullsized': '2024-04-25T08:59:15.453056+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.454441+0000', 'last_change': '2024-04-25T08:59:15.454441+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.454441+0000', 'last_undegraded': '2024-04-25T08:59:15.454441+0000', 'last_fullsized': '2024-04-25T08:59:15.454441+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.451616+0000', 'last_change': '2024-04-25T08:59:15.451616+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.451616+0000', 'last_undegraded': '2024-04-25T08:59:15.451616+0000', 'last_fullsized': '2024-04-25T08:59:15.451616+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448919+0000', 'last_change': '2024-04-25T08:59:15.448919+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448919+0000', 'last_undegraded': '2024-04-25T08:59:15.448919+0000', 'last_fullsized': '2024-04-25T08:59:15.448919+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448015+0000', 'last_change': '2024-04-25T08:59:15.448015+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448015+0000', 'last_undegraded': '2024-04-25T08:59:15.448015+0000', 'last_fullsized': '2024-04-25T08:59:15.448015+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.457095+0000', 'last_change': '2024-04-25T08:59:15.457095+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.457095+0000', 'last_undegraded': '2024-04-25T08:59:15.457095+0000', 'last_fullsized': '2024-04-25T08:59:15.457095+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.452085+0000', 'last_change': '2024-04-25T08:59:15.452085+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.452085+0000', 'last_undegraded': '2024-04-25T08:59:15.452085+0000', 'last_fullsized': '2024-04-25T08:59:15.452085+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.454036+0000', 'last_change': '2024-04-25T08:59:15.454036+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.454036+0000', 'last_undegraded': '2024-04-25T08:59:15.454036+0000', 'last_fullsized': '2024-04-25T08:59:15.454036+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.449794+0000', 'last_change': '2024-04-25T08:59:15.449794+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.449794+0000', 'last_undegraded': '2024-04-25T08:59:15.449794+0000', 'last_fullsized': '2024-04-25T08:59:15.449794+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.449832+0000', 'last_change': '2024-04-25T08:59:15.449832+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.449832+0000', 'last_undegraded': '2024-04-25T08:59:15.449832+0000', 'last_fullsized': '2024-04-25T08:59:15.449832+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.447404+0000', 'last_change': '2024-04-25T08:59:15.447404+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.447404+0000', 'last_undegraded': '2024-04-25T08:59:15.447404+0000', 'last_fullsized': '2024-04-25T08:59:15.447404+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453663+0000', 'last_change': '2024-04-25T08:59:15.453663+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453663+0000', 'last_undegraded': '2024-04-25T08:59:15.453663+0000', 'last_fullsized': '2024-04-25T08:59:15.453663+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-25T08:59:20.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.454964+0000', 'last_change': '2024-04-25T08:59:15.454964+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.454964+0000', 'last_undegraded': '2024-04-25T08:59:15.454964+0000', 'last_fullsized': '2024-04-25T08:59:15.454964+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453809+0000', 'last_change': '2024-04-25T08:59:15.453809+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453809+0000', 'last_undegraded': '2024-04-25T08:59:15.453809+0000', 'last_fullsized': '2024-04-25T08:59:15.453809+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.448611+0000', 'last_change': '2024-04-25T08:59:15.448611+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.448611+0000', 'last_undegraded': '2024-04-25T08:59:15.448611+0000', 'last_fullsized': '2024-04-25T08:59:15.448611+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.449096+0000', 'last_change': '2024-04-25T08:59:15.449096+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.449096+0000', 'last_undegraded': '2024-04-25T08:59:15.449096+0000', 'last_fullsized': '2024-04-25T08:59:15.449096+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.453454+0000', 'last_change': '2024-04-25T08:59:15.453454+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.453454+0000', 'last_undegraded': '2024-04-25T08:59:15.453454+0000', 'last_fullsized': '2024-04-25T08:59:15.453454+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.447058+0000', 'last_change': '2024-04-25T08:59:15.447058+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.447058+0000', 'last_undegraded': '2024-04-25T08:59:15.447058+0000', 'last_fullsized': '2024-04-25T08:59:15.447058+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-25T08:59:20.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.446244+0000', 'last_change': '2024-04-25T08:59:15.446244+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.446244+0000', 'last_undegraded': '2024-04-25T08:59:15.446244+0000', 'last_fullsized': '2024-04-25T08:59:15.446244+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:59:20.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-25T08:59:20.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:15.456285+0000', 'last_change': '2024-04-25T08:59:15.456285+0000', 'last_active': '2024-04-25T08:59:15.437724+0000', 'last_peered': '2024-04-25T08:59:15.437724+0000', 'last_clean': '2024-04-25T08:59:15.437724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:15.456285+0000', 'last_undegraded': '2024-04-25T08:59:15.456285+0000', 'last_fullsized': '2024-04-25T08:59:15.456285+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:15.437724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:59:20.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:59:20.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.284+0000 7f32ca66b640 1 Processor -- start 2024-04-25T08:59:20.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.284+0000 7f32ca66b640 1 -- start start 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32ca66b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f32c40d3df0 0x7f32c40b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32ca66b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40b29c0 con 0x7f32c40d3990 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32ca66b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40d2080 con 0x7f32c415e0a0 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32ca66b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c40d1460 con 0x7f32c40d3df0 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f32c40d3990 0x7f32c40b6f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37910/0 (socket says 172.21.15.5:37910) 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c37fe640 1 -- 172.21.15.5:0/3039287624 learned_addr learned my addr 172.21.15.5:0/3039287624 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c8c08640 1 --2- 172.21.15.5:0/3039287624 >> v2:172.21.15.80:3300/0 conn(0x7f32c40d3df0 0x7f32c40b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508639661 0 0) 0x7f32c40b29c0 con 0x7f32c40d3990 2024-04-25T08:59:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b0003520 con 0x7f32c40d3990 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236307784 0 0) 0x7f32c40d2080 con 0x7f32c415e0a0 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c40b29c0 con 0x7f32c415e0a0 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145585984 0 0) 0x7f32b0003520 con 0x7f32c40d3990 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c8c08640 1 -- 172.21.15.5:0/3039287624 >> v1:172.21.15.80:6789/0 conn(0x7f32c415e0a0 legacy=0x7f32c40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.285+0000 7f32c8c08640 1 -- 172.21.15.5:0/3039287624 >> v1:172.21.15.5:6789/0 conn(0x7f32c40d3990 legacy=0x7f32c40b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.286+0000 7f32c8c08640 1 -- 172.21.15.5:0/3039287624 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40d2360 con 0x7f32c40d3df0 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.286+0000 7f32c8c08640 1 --2- 172.21.15.5:0/3039287624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c40d3df0 0x7f32c40b7660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009d90 tx=0x7f32bc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b6f9b554ac0677b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.286+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4001670 con 0x7f32c40d3df0 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.286+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc007540 con 0x7f32c40d3df0 2024-04-25T08:59:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32c2ffd640 1 -- 172.21.15.5:0/3039287624 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc007910 con 0x7f32c40d3df0 2024-04-25T08:59:20.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32ca66b640 1 -- 172.21.15.5:0/3039287624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c40d3df0 msgr2=0x7f32c40b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32ca66b640 1 --2- 172.21.15.5:0/3039287624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c40d3df0 0x7f32c40b7660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009d90 tx=0x7f32bc02a680 comp rx=0 tx=0).stop 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32ca66b640 1 -- 172.21.15.5:0/3039287624 shutdown_connections 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32ca66b640 1 --2- 172.21.15.5:0/3039287624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c40d3df0 0x7f32c40b7660 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32ca66b640 1 -- 172.21.15.5:0/3039287624 >> 172.21.15.5:0/3039287624 conn(0x7f32c40668f0 msgr2=0x7f32c4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32ca66b640 1 -- 172.21.15.5:0/3039287624 shutdown_connections 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.287+0000 7f32ca66b640 1 -- 172.21.15.5:0/3039287624 wait complete. 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.288+0000 7f32ca66b640 1 Processor -- start 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32ca66b640 1 -- start start 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32ca66b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c40d3990 0x7f32c415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32ca66b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c40d3df0 0x7f32c40acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32ca66b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c415e0a0 0x7f32c40ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32ca66b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40d2c00 con 0x7f32c40d3df0 2024-04-25T08:59:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32ca66b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40d2920 con 0x7f32c415e0a0 2024-04-25T08:59:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32ca66b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40d4280 con 0x7f32c40d3990 2024-04-25T08:59:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c40d3df0 0x7f32c40acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c40d3df0 0x7f32c40acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40062/0 (socket says 172.21.15.5:40062) 2024-04-25T08:59:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.289+0000 7f32c37fe640 1 -- 172.21.15.5:0/18053370 learned_addr learned my addr 172.21.15.5:0/18053370 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c8c08640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c415e0a0 0x7f32c40ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c3fff640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c40d3990 0x7f32c415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c37fe640 1 -- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c40d3990 msgr2=0x7f32c415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c37fe640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c40d3990 0x7f32c415bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c37fe640 1 -- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c415e0a0 msgr2=0x7f32c40ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c37fe640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c415e0a0 0x7f32c40ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c37fe640 1 -- 172.21.15.5:0/18053370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40b50c0 con 0x7f32c40d3df0 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c8c08640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c415e0a0 0x7f32c40ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c37fe640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c40d3df0 0x7f32c40acb70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f32b400c750 tx=0x7f32b400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c0ff9640 1 -- 172.21.15.5:0/18053370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4005ad0 con 0x7f32c40d3df0 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c0ff9640 1 -- 172.21.15.5:0/18053370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4005c70 con 0x7f32c40d3df0 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c40b53a0 con 0x7f32c40d3df0 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32c0ff9640 1 -- 172.21.15.5:0/18053370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4005e60 con 0x7f32c40d3df0 2024-04-25T08:59:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.290+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c40b5960 con 0x7f32c40d3df0 2024-04-25T08:59:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.291+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c40b5b60 con 0x7f32c40d3df0 2024-04-25T08:59:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.292+0000 7f32c0ff9640 1 -- 172.21.15.5:0/18053370 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f32b40072b0 con 0x7f32c40d3df0 2024-04-25T08:59:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.292+0000 7f32c0ff9640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a406b4d0 0x7f32a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.292+0000 7f32c0ff9640 1 -- 172.21.15.5:0/18053370 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32b4089fb0 con 0x7f32c40d3df0 2024-04-25T08:59:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.292+0000 7f32c3fff640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a406b4d0 0x7f32a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.293+0000 7f32c3fff640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a406b4d0 0x7f32a406d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f32ac001650 tx=0x7f32ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.296+0000 7f32c0ff9640 1 -- 172.21.15.5:0/18053370 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f32b4058ef0 con 0x7f32c40d3df0 2024-04-25T08:59:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.552+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f32c415d850 con 0x7f32c40d3df0 2024-04-25T08:59:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.553+0000 7f32c0ff9640 1 -- 172.21.15.5:0/18053370 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1034 (secure 0 0 0) 0x7f32b40587f0 con 0x7f32c40d3df0 2024-04-25T08:59:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:20.543 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":180,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":303181824,"bytes_avail":772790931456,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":21,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5616}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-04-25T08:59:04.418264+0000","services":{}},"progress_events":{}} 2024-04-25T08:59:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a406b4d0 msgr2=0x7f32a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a406b4d0 0x7f32a406d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f32ac001650 tx=0x7f32ac009040 comp rx=0 tx=0).stop 2024-04-25T08:59:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c40d3df0 msgr2=0x7f32c40acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c40d3df0 0x7f32c40acb70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f32b400c750 tx=0x7f32b400cc10 comp rx=0 tx=0).stop 2024-04-25T08:59:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 shutdown_connections 2024-04-25T08:59:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a406b4d0 0x7f32a406d990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c415e0a0 0x7f32c40ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c40d3df0 0x7f32c40acb70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 --2- 172.21.15.5:0/18053370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c40d3990 0x7f32c415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 >> 172.21.15.5:0/18053370 conn(0x7f32c40668f0 msgr2=0x7f32c40b8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 shutdown_connections 2024-04-25T08:59:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.555+0000 7f32ca66b640 1 -- 172.21.15.5:0/18053370 wait complete. 2024-04-25T08:59:20.556 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:59:20.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:20.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.667+0000 7fa81a89e640 1 Processor -- start 2024-04-25T08:59:20.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.667+0000 7fa81a89e640 1 -- start start 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.667+0000 7fa81a89e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa81415e0a0 0x7fa8140d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.667+0000 7fa81a89e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140d3990 0x7fa8140d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.667+0000 7fa81a89e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140b7f60 con 0x7fa8140ce5e0 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.667+0000 7fa81a89e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8140d4330 con 0x7fa81415e0a0 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.667+0000 7fa81a89e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140b29c0 con 0x7fa8140d3990 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa8137fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140d3990 0x7fa8140d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa813fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa81415e0a0 0x7fa8140d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa818e3b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa8140ce5e0 0x7fa8140cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:36244/0 (socket says 172.21.15.5:36244) 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa8137fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140d3990 0x7fa8140d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:56368/0 (socket says 172.21.15.5:56368) 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa818e3b640 1 -- 172.21.15.5:0/489465878 learned_addr learned my addr 172.21.15.5:0/489465878 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa813fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa81415e0a0 0x7fa8140d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:45794/0 (socket says 172.21.15.5:45794) 2024-04-25T08:59:20.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa813fff640 1 -- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140d3990 msgr2=0x7fa8140d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:20.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa813fff640 1 --2- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140d3990 0x7fa8140d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa813fff640 1 -- 172.21.15.5:0/489465878 >> v1:172.21.15.80:6789/0 conn(0x7fa8140ce5e0 legacy=0x7fa8140cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa813fff640 1 -- 172.21.15.5:0/489465878 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140d2080 con 0x7fa81415e0a0 2024-04-25T08:59:20.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa812ffd640 1 -- 172.21.15.5:0/489465878 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266863977 0 0) 0x7fa8140b7f60 con 0x7fa8140ce5e0 2024-04-25T08:59:20.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.668+0000 7fa8137fe640 1 --2- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140d3990 0x7fa8140d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:20.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.669+0000 7fa813fff640 1 --2- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 0x7fa8140d0d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f54065b858ae9e89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.669+0000 7fa812ffd640 1 -- 172.21.15.5:0/489465878 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808037070 con 0x7fa81415e0a0 2024-04-25T08:59:20.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.669+0000 7fa812ffd640 1 -- 172.21.15.5:0/489465878 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808032440 con 0x7fa81415e0a0 2024-04-25T08:59:20.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.669+0000 7fa812ffd640 1 -- 172.21.15.5:0/489465878 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808032810 con 0x7fa81415e0a0 2024-04-25T08:59:20.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 -- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 msgr2=0x7fa8140d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 --2- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 0x7fa8140d0d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802a180 comp rx=0 tx=0).stop 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 -- 172.21.15.5:0/489465878 shutdown_connections 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 --2- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140d3990 0x7fa8140d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 --2- 172.21.15.5:0/489465878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 0x7fa8140d0d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 -- 172.21.15.5:0/489465878 >> 172.21.15.5:0/489465878 conn(0x7fa8140668f0 msgr2=0x7fa814066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 -- 172.21.15.5:0/489465878 shutdown_connections 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.670+0000 7fa81a89e640 1 -- 172.21.15.5:0/489465878 wait complete. 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.671+0000 7fa81a89e640 1 Processor -- start 2024-04-25T08:59:20.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.671+0000 7fa81a89e640 1 -- start start 2024-04-25T08:59:20.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa81a89e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140ce5e0 0x7fa814159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa81a89e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8140d3990 0x7fa8140aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa81a89e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 0x7fa8141f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa81a89e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140d2920 con 0x7fa8140d3990 2024-04-25T08:59:20.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa81a89e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140d2640 con 0x7fa81415e0a0 2024-04-25T08:59:20.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa81a89e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140d2c00 con 0x7fa8140ce5e0 2024-04-25T08:59:20.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8140d3990 0x7fa8140aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8140d3990 0x7fa8140aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40074/0 (socket says 172.21.15.5:40074) 2024-04-25T08:59:20.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 -- 172.21.15.5:0/1792454614 learned_addr learned my addr 172.21.15.5:0/1792454614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:20.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa818e3b640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 0x7fa8141f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa813fff640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140ce5e0 0x7fa814159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 -- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140ce5e0 msgr2=0x7fa814159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140ce5e0 0x7fa814159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 -- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 msgr2=0x7fa8141f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 0x7fa8141f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 -- 172.21.15.5:0/1792454614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140ab8a0 con 0x7fa8140d3990 2024-04-25T08:59:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa8137fe640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8140d3990 0x7fa8140aaf30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa80400ec10 tx=0x7fa80400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.672+0000 7fa810ff9640 1 -- 172.21.15.5:0/1792454614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804017070 con 0x7fa8140d3990 2024-04-25T08:59:20.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.673+0000 7fa810ff9640 1 -- 172.21.15.5:0/1792454614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400cc30 con 0x7fa8140d3990 2024-04-25T08:59:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.673+0000 7fa810ff9640 1 -- 172.21.15.5:0/1792454614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804013470 con 0x7fa8140d3990 2024-04-25T08:59:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.673+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8140abb80 con 0x7fa8140d3990 2024-04-25T08:59:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.673+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8140ac140 con 0x7fa8140d3990 2024-04-25T08:59:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.674+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81404ef20 con 0x7fa8140d3990 2024-04-25T08:59:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.674+0000 7fa810ff9640 1 -- 172.21.15.5:0/1792454614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa80401a070 con 0x7fa8140d3990 2024-04-25T08:59:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.674+0000 7fa810ff9640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa80006b4d0 0x7fa80006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.675+0000 7fa810ff9640 1 -- 172.21.15.5:0/1792454614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa80408a180 con 0x7fa8140d3990 2024-04-25T08:59:20.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.675+0000 7fa813fff640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa80006b4d0 0x7fa80006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.675+0000 7fa813fff640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa80006b4d0 0x7fa80006d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa808034000 tx=0x7fa80802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.679+0000 7fa810ff9640 1 -- 172.21.15.5:0/1792454614 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa804058930 con 0x7fa8140d3990 2024-04-25T08:59:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.854+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8140b5ff0 con 0x7fa80006b4d0 2024-04-25T08:59:20.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.860+0000 7fa810ff9640 1 -- 172.21.15.5:0/1792454614 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246640 (secure 0 0 0) 0x7fa8140b5ff0 con 0x7fa80006b4d0 2024-04-25T08:59:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:20.853 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:59:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.862+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa80006b4d0 msgr2=0x7fa80006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.862+0000 7fa81a89e640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa80006b4d0 0x7fa80006d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa808034000 tx=0x7fa80802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.862+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8140d3990 msgr2=0x7fa8140aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.862+0000 7fa81a89e640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8140d3990 0x7fa8140aaf30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa80400ec10 tx=0x7fa80400c520 comp rx=0 tx=0).stop 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 shutdown_connections 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa80006b4d0 0x7fa80006d990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa81415e0a0 0x7fa8141f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8140d3990 0x7fa8140aaf30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 --2- 172.21.15.5:0/1792454614 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8140ce5e0 0x7fa814159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 >> 172.21.15.5:0/1792454614 conn(0x7fa8140668f0 msgr2=0x7fa814066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 shutdown_connections 2024-04-25T08:59:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:20.863+0000 7fa81a89e640 1 -- 172.21.15.5:0/1792454614 wait complete. 2024-04-25T08:59:20.863 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-04-25T08:59:20.421845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":296076,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754678644,"statfs":{"total":773094113280,"available":772790931456,"internally_reserved":0,"allocated":5120000,"data_stored":2756064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.979461"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450204+0000","last_change":"2024-04-25T08:59:15.450204+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450204+0000","last_undegraded":"2024-04-25T08:59:15.450204+0000","last_fullsized":"2024-04-25T08:59:15.450204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447164+0000","last_change":"2024-04-25T08:59:15.447164+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447164+0000","last_undegraded":"2024-04-25T08:59:15.447164+0000","last_fullsized":"2024-04-25T08:59:15.447164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447632+0000","last_change":"2024-04-25T08:59:15.447632+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447632+0000","last_undegraded":"2024-04-25T08:59:15.447632+0000","last_fullsized":"2024-04-25T08:59:15.447632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455436+0000","last_change":"2024-04-25T08:59:15.455436+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455436+0000","last_undegraded":"2024-04-25T08:59:15.455436+0000","last_fullsized":"2024-04-25T08:59:15.455436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446623+0000","last_change":"2024-04-25T08:59:15.446623+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446623+0000","last_undegraded":"2024-04-25T08:59:15.446623+0000","last_fullsized":"2024-04-25T08:59:15.446623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450196+0000","last_change":"2024-04-25T08:59:15.450196+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450196+0000","last_undegraded":"2024-04-25T08:59:15.450196+0000","last_fullsized":"2024-04-25T08:59:15.450196+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450609+0000","last_change":"2024-04-25T08:59:15.450609+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450609+0000","last_undegraded":"2024-04-25T08:59:15.450609+0000","last_fullsized":"2024-04-25T08:59:15.450609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458814+0000","last_change":"2024-04-25T08:59:15.458814+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458814+0000","last_undegraded":"2024-04-25T08:59:15.458814+0000","last_fullsized":"2024-04-25T08:59:15.458814+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457592+0000","last_change":"2024-04-25T08:59:15.457592+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457592+0000","last_undegraded":"2024-04-25T08:59:15.457592+0000","last_fullsized":"2024-04-25T08:59:15.457592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458127+0000","last_change":"2024-04-25T08:59:15.458127+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458127+0000","last_undegraded":"2024-04-25T08:59:15.458127+0000","last_fullsized":"2024-04-25T08:59:15.458127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453510+0000","last_change":"2024-04-25T08:59:15.453510+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453510+0000","last_undegraded":"2024-04-25T08:59:15.453510+0000","last_fullsized":"2024-04-25T08:59:15.453510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449347+0000","last_change":"2024-04-25T08:59:15.449347+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449347+0000","last_undegraded":"2024-04-25T08:59:15.449347+0000","last_fullsized":"2024-04-25T08:59:15.449347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448863+0000","last_change":"2024-04-25T08:59:15.448863+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448863+0000","last_undegraded":"2024-04-25T08:59:15.448863+0000","last_fullsized":"2024-04-25T08:59:15.448863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457670+0000","last_change":"2024-04-25T08:59:15.457670+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457670+0000","last_undegraded":"2024-04-25T08:59:15.457670+0000","last_fullsized":"2024-04-25T08:59:15.457670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451968+0000","last_change":"2024-04-25T08:59:15.451968+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451968+0000","last_undegraded":"2024-04-25T08:59:15.451968+0000","last_fullsized":"2024-04-25T08:59:15.451968+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451484+0000","last_change":"2024-04-25T08:59:15.451484+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451484+0000","last_undegraded":"2024-04-25T08:59:15.451484+0000","last_fullsized":"2024-04-25T08:59:15.451484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447622+0000","last_change":"2024-04-25T08:59:15.447622+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447622+0000","last_undegraded":"2024-04-25T08:59:15.447622+0000","last_fullsized":"2024-04-25T08:59:15.447622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448174+0000","last_change":"2024-04-25T08:59:15.448174+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448174+0000","last_undegraded":"2024-04-25T08:59:15.448174+0000","last_fullsized":"2024-04-25T08:59:15.448174+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453485+0000","last_change":"2024-04-25T08:59:15.453485+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453485+0000","last_undegraded":"2024-04-25T08:59:15.453485+0000","last_fullsized":"2024-04-25T08:59:15.453485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448909+0000","last_change":"2024-04-25T08:59:15.448909+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448909+0000","last_undegraded":"2024-04-25T08:59:15.448909+0000","last_fullsized":"2024-04-25T08:59:15.448909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453849+0000","last_change":"2024-04-25T08:59:15.453849+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453849+0000","last_undegraded":"2024-04-25T08:59:15.453849+0000","last_fullsized":"2024-04-25T08:59:15.453849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453681+0000","last_change":"2024-04-25T08:59:15.453681+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453681+0000","last_undegraded":"2024-04-25T08:59:15.453681+0000","last_fullsized":"2024-04-25T08:59:15.453681+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451908+0000","last_change":"2024-04-25T08:59:15.451908+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451908+0000","last_undegraded":"2024-04-25T08:59:15.451908+0000","last_fullsized":"2024-04-25T08:59:15.451908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450940+0000","last_change":"2024-04-25T08:59:15.450940+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450940+0000","last_undegraded":"2024-04-25T08:59:15.450940+0000","last_fullsized":"2024-04-25T08:59:15.450940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455830+0000","last_change":"2024-04-25T08:59:15.455830+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455830+0000","last_undegraded":"2024-04-25T08:59:15.455830+0000","last_fullsized":"2024-04-25T08:59:15.455830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448526+0000","last_change":"2024-04-25T08:59:15.448526+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448526+0000","last_undegraded":"2024-04-25T08:59:15.448526+0000","last_fullsized":"2024-04-25T08:59:15.448526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446067+0000","last_change":"2024-04-25T08:59:15.446067+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446067+0000","last_undegraded":"2024-04-25T08:59:15.446067+0000","last_fullsized":"2024-04-25T08:59:15.446067+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448874+0000","last_change":"2024-04-25T08:59:15.448874+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448874+0000","last_undegraded":"2024-04-25T08:59:15.448874+0000","last_fullsized":"2024-04-25T08:59:15.448874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452130+0000","last_change":"2024-04-25T08:59:15.452130+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452130+0000","last_undegraded":"2024-04-25T08:59:15.452130+0000","last_fullsized":"2024-04-25T08:59:15.452130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448605+0000","last_change":"2024-04-25T08:59:15.448605+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448605+0000","last_undegraded":"2024-04-25T08:59:15.448605+0000","last_fullsized":"2024-04-25T08:59:15.448605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451461+0000","last_change":"2024-04-25T08:59:15.451461+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451461+0000","last_undegraded":"2024-04-25T08:59:15.451461+0000","last_fullsized":"2024-04-25T08:59:15.451461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448014+0000","last_change":"2024-04-25T08:59:15.448014+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448014+0000","last_undegraded":"2024-04-25T08:59:15.448014+0000","last_fullsized":"2024-04-25T08:59:15.448014+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450414+0000","last_change":"2024-04-25T08:59:15.450414+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450414+0000","last_undegraded":"2024-04-25T08:59:15.450414+0000","last_fullsized":"2024-04-25T08:59:15.450414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463903+0000","last_change":"2024-04-25T08:59:15.459021+0000","last_active":"2024-04-25T08:59:15.463903+0000","last_peered":"2024-04-25T08:59:15.463903+0000","last_clean":"2024-04-25T08:59:15.463903+0000","last_became_active":"2024-04-25T08:59:15.458664+0000","last_became_peered":"2024-04-25T08:59:15.458664+0000","last_unstale":"2024-04-25T08:59:15.463903+0000","last_undegraded":"2024-04-25T08:59:15.463903+0000","last_fullsized":"2024-04-25T08:59:15.463903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.455388+0000","last_change":"2024-04-25T08:59:15.455388+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.455388+0000","last_undegraded":"2024-04-25T08:59:15.455388+0000","last_fullsized":"2024-04-25T08:59:15.455388+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461311+0000","last_change":"2024-04-25T08:59:15.454182+0000","last_active":"2024-04-25T08:59:15.461311+0000","last_peered":"2024-04-25T08:59:15.461311+0000","last_clean":"2024-04-25T08:59:15.461311+0000","last_became_active":"2024-04-25T08:59:15.453926+0000","last_became_peered":"2024-04-25T08:59:15.453926+0000","last_unstale":"2024-04-25T08:59:15.461311+0000","last_undegraded":"2024-04-25T08:59:15.461311+0000","last_fullsized":"2024-04-25T08:59:15.461311+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:46.631288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448409+0000","last_change":"2024-04-25T08:59:15.448409+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448409+0000","last_undegraded":"2024-04-25T08:59:15.448409+0000","last_fullsized":"2024-04-25T08:59:15.448409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464204+0000","last_change":"2024-04-25T08:59:15.462158+0000","last_active":"2024-04-25T08:59:15.464204+0000","last_peered":"2024-04-25T08:59:15.464204+0000","last_clean":"2024-04-25T08:59:15.464204+0000","last_became_active":"2024-04-25T08:59:15.461680+0000","last_became_peered":"2024-04-25T08:59:15.461680+0000","last_unstale":"2024-04-25T08:59:15.464204+0000","last_undegraded":"2024-04-25T08:59:15.464204+0000","last_fullsized":"2024-04-25T08:59:15.464204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453550+0000","last_change":"2024-04-25T08:59:15.453550+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453550+0000","last_undegraded":"2024-04-25T08:59:15.453550+0000","last_fullsized":"2024-04-25T08:59:15.453550+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461312+0000","last_change":"2024-04-25T08:59:15.458383+0000","last_active":"2024-04-25T08:59:15.461312+0000","last_peered":"2024-04-25T08:59:15.461312+0000","last_clean":"2024-04-25T08:59:15.461312+0000","last_became_active":"2024-04-25T08:59:15.457899+0000","last_became_peered":"2024-04-25T08:59:15.457899+0000","last_unstale":"2024-04-25T08:59:15.461312+0000","last_undegraded":"2024-04-25T08:59:15.461312+0000","last_fullsized":"2024-04-25T08:59:15.461312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448124+0000","last_change":"2024-04-25T08:59:15.448124+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448124+0000","last_undegraded":"2024-04-25T08:59:15.448124+0000","last_fullsized":"2024-04-25T08:59:15.448124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463836+0000","last_change":"2024-04-25T08:59:15.459763+0000","last_active":"2024-04-25T08:59:15.463836+0000","last_peered":"2024-04-25T08:59:15.463836+0000","last_clean":"2024-04-25T08:59:15.463836+0000","last_became_active":"2024-04-25T08:59:15.459423+0000","last_became_peered":"2024-04-25T08:59:15.459423+0000","last_unstale":"2024-04-25T08:59:15.463836+0000","last_undegraded":"2024-04-25T08:59:15.463836+0000","last_fullsized":"2024-04-25T08:59:15.463836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.461126+0000","last_change":"2024-04-25T08:59:15.461126+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.461126+0000","last_undegraded":"2024-04-25T08:59:15.461126+0000","last_fullsized":"2024-04-25T08:59:15.461126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461500+0000","last_change":"2024-04-25T08:59:15.453202+0000","last_active":"2024-04-25T08:59:15.461500+0000","last_peered":"2024-04-25T08:59:15.461500+0000","last_clean":"2024-04-25T08:59:15.461500+0000","last_became_active":"2024-04-25T08:59:15.452856+0000","last_became_peered":"2024-04-25T08:59:15.452856+0000","last_unstale":"2024-04-25T08:59:15.461500+0000","last_undegraded":"2024-04-25T08:59:15.461500+0000","last_fullsized":"2024-04-25T08:59:15.461500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.458101+0000","last_change":"2024-04-25T08:59:15.458101+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.458101+0000","last_undegraded":"2024-04-25T08:59:15.458101+0000","last_fullsized":"2024-04-25T08:59:15.458101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454396+0000","last_change":"2024-04-25T08:59:15.453050+0000","last_active":"2024-04-25T08:59:15.454396+0000","last_peered":"2024-04-25T08:59:15.454396+0000","last_clean":"2024-04-25T08:59:15.454396+0000","last_became_active":"2024-04-25T08:59:15.452771+0000","last_became_peered":"2024-04-25T08:59:15.452771+0000","last_unstale":"2024-04-25T08:59:15.454396+0000","last_undegraded":"2024-04-25T08:59:15.454396+0000","last_fullsized":"2024-04-25T08:59:15.454396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456295+0000","last_change":"2024-04-25T08:59:15.456295+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456295+0000","last_undegraded":"2024-04-25T08:59:15.456295+0000","last_fullsized":"2024-04-25T08:59:15.456295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466373+0000","last_change":"2024-04-25T08:59:15.465229+0000","last_active":"2024-04-25T08:59:15.466373+0000","last_peered":"2024-04-25T08:59:15.466373+0000","last_clean":"2024-04-25T08:59:15.466373+0000","last_became_active":"2024-04-25T08:59:15.464721+0000","last_became_peered":"2024-04-25T08:59:15.464721+0000","last_unstale":"2024-04-25T08:59:15.466373+0000","last_undegraded":"2024-04-25T08:59:15.466373+0000","last_fullsized":"2024-04-25T08:59:15.466373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:16.843489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447689+0000","last_change":"2024-04-25T08:59:15.447689+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447689+0000","last_undegraded":"2024-04-25T08:59:15.447689+0000","last_fullsized":"2024-04-25T08:59:15.447689+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461098+0000","last_change":"2024-04-25T08:59:15.450651+0000","last_active":"2024-04-25T08:59:15.461098+0000","last_peered":"2024-04-25T08:59:15.461098+0000","last_clean":"2024-04-25T08:59:15.461098+0000","last_became_active":"2024-04-25T08:59:15.450157+0000","last_became_peered":"2024-04-25T08:59:15.450157+0000","last_unstale":"2024-04-25T08:59:15.461098+0000","last_undegraded":"2024-04-25T08:59:15.461098+0000","last_fullsized":"2024-04-25T08:59:15.461098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448619+0000","last_change":"2024-04-25T08:59:15.448619+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448619+0000","last_undegraded":"2024-04-25T08:59:15.448619+0000","last_fullsized":"2024-04-25T08:59:15.448619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468358+0000","last_change":"2024-04-25T08:59:15.467758+0000","last_active":"2024-04-25T08:59:15.468358+0000","last_peered":"2024-04-25T08:59:15.468358+0000","last_clean":"2024-04-25T08:59:15.468358+0000","last_became_active":"2024-04-25T08:59:15.467423+0000","last_became_peered":"2024-04-25T08:59:15.467423+0000","last_unstale":"2024-04-25T08:59:15.468358+0000","last_undegraded":"2024-04-25T08:59:15.468358+0000","last_fullsized":"2024-04-25T08:59:15.468358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:40.158535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449032+0000","last_change":"2024-04-25T08:59:15.449032+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449032+0000","last_undegraded":"2024-04-25T08:59:15.449032+0000","last_fullsized":"2024-04-25T08:59:15.449032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466976+0000","last_change":"2024-04-25T08:59:15.462089+0000","last_active":"2024-04-25T08:59:15.466976+0000","last_peered":"2024-04-25T08:59:15.466976+0000","last_clean":"2024-04-25T08:59:15.466976+0000","last_became_active":"2024-04-25T08:59:15.461797+0000","last_became_peered":"2024-04-25T08:59:15.461797+0000","last_unstale":"2024-04-25T08:59:15.466976+0000","last_undegraded":"2024-04-25T08:59:15.466976+0000","last_fullsized":"2024-04-25T08:59:15.466976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.450150+0000","last_change":"2024-04-25T08:59:15.450150+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.450150+0000","last_undegraded":"2024-04-25T08:59:15.450150+0000","last_fullsized":"2024-04-25T08:59:15.450150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.454699+0000","last_change":"2024-04-25T08:59:15.452741+0000","last_active":"2024-04-25T08:59:15.454699+0000","last_peered":"2024-04-25T08:59:15.454699+0000","last_clean":"2024-04-25T08:59:15.454699+0000","last_became_active":"2024-04-25T08:59:15.452336+0000","last_became_peered":"2024-04-25T08:59:15.452336+0000","last_unstale":"2024-04-25T08:59:15.454699+0000","last_undegraded":"2024-04-25T08:59:15.454699+0000","last_fullsized":"2024-04-25T08:59:15.454699+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:02.452298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453056+0000","last_change":"2024-04-25T08:59:15.453056+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453056+0000","last_undegraded":"2024-04-25T08:59:15.453056+0000","last_fullsized":"2024-04-25T08:59:15.453056+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466780+0000","last_change":"2024-04-25T08:59:15.466415+0000","last_active":"2024-04-25T08:59:15.466780+0000","last_peered":"2024-04-25T08:59:15.466780+0000","last_clean":"2024-04-25T08:59:15.466780+0000","last_became_active":"2024-04-25T08:59:15.466019+0000","last_became_peered":"2024-04-25T08:59:15.466019+0000","last_unstale":"2024-04-25T08:59:15.466780+0000","last_undegraded":"2024-04-25T08:59:15.466780+0000","last_fullsized":"2024-04-25T08:59:15.466780+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.981461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454441+0000","last_change":"2024-04-25T08:59:15.454441+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454441+0000","last_undegraded":"2024-04-25T08:59:15.454441+0000","last_fullsized":"2024-04-25T08:59:15.454441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.458635+0000","last_change":"2024-04-25T08:59:15.455994+0000","last_active":"2024-04-25T08:59:15.458635+0000","last_peered":"2024-04-25T08:59:15.458635+0000","last_clean":"2024-04-25T08:59:15.458635+0000","last_became_active":"2024-04-25T08:59:15.455710+0000","last_became_peered":"2024-04-25T08:59:15.455710+0000","last_unstale":"2024-04-25T08:59:15.458635+0000","last_undegraded":"2024-04-25T08:59:15.458635+0000","last_fullsized":"2024-04-25T08:59:15.458635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.241831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.451616+0000","last_change":"2024-04-25T08:59:15.451616+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.451616+0000","last_undegraded":"2024-04-25T08:59:15.451616+0000","last_fullsized":"2024-04-25T08:59:15.451616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.465456+0000","last_change":"2024-04-25T08:59:15.464258+0000","last_active":"2024-04-25T08:59:15.465456+0000","last_peered":"2024-04-25T08:59:15.465456+0000","last_clean":"2024-04-25T08:59:15.465456+0000","last_became_active":"2024-04-25T08:59:15.463915+0000","last_became_peered":"2024-04-25T08:59:15.463915+0000","last_unstale":"2024-04-25T08:59:15.465456+0000","last_undegraded":"2024-04-25T08:59:15.465456+0000","last_fullsized":"2024-04-25T08:59:15.465456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448919+0000","last_change":"2024-04-25T08:59:15.448919+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448919+0000","last_undegraded":"2024-04-25T08:59:15.448919+0000","last_fullsized":"2024-04-25T08:59:15.448919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467998+0000","last_change":"2024-04-25T08:59:15.467372+0000","last_active":"2024-04-25T08:59:15.467998+0000","last_peered":"2024-04-25T08:59:15.467998+0000","last_clean":"2024-04-25T08:59:15.467998+0000","last_became_active":"2024-04-25T08:59:15.467151+0000","last_became_peered":"2024-04-25T08:59:15.467151+0000","last_unstale":"2024-04-25T08:59:15.467998+0000","last_undegraded":"2024-04-25T08:59:15.467998+0000","last_fullsized":"2024-04-25T08:59:15.467998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:40.462959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448015+0000","last_change":"2024-04-25T08:59:15.448015+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448015+0000","last_undegraded":"2024-04-25T08:59:15.448015+0000","last_fullsized":"2024-04-25T08:59:15.448015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.456952+0000","last_change":"2024-04-25T08:59:15.455569+0000","last_active":"2024-04-25T08:59:15.456952+0000","last_peered":"2024-04-25T08:59:15.456952+0000","last_clean":"2024-04-25T08:59:15.456952+0000","last_became_active":"2024-04-25T08:59:15.455293+0000","last_became_peered":"2024-04-25T08:59:15.455293+0000","last_unstale":"2024-04-25T08:59:15.456952+0000","last_undegraded":"2024-04-25T08:59:15.456952+0000","last_fullsized":"2024-04-25T08:59:15.456952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:07.263160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.457095+0000","last_change":"2024-04-25T08:59:15.457095+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.457095+0000","last_undegraded":"2024-04-25T08:59:15.457095+0000","last_fullsized":"2024-04-25T08:59:15.457095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461154+0000","last_change":"2024-04-25T08:59:15.453157+0000","last_active":"2024-04-25T08:59:15.461154+0000","last_peered":"2024-04-25T08:59:15.461154+0000","last_clean":"2024-04-25T08:59:15.461154+0000","last_became_active":"2024-04-25T08:59:15.452867+0000","last_became_peered":"2024-04-25T08:59:15.452867+0000","last_unstale":"2024-04-25T08:59:15.461154+0000","last_undegraded":"2024-04-25T08:59:15.461154+0000","last_fullsized":"2024-04-25T08:59:15.461154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.452085+0000","last_change":"2024-04-25T08:59:15.452085+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.452085+0000","last_undegraded":"2024-04-25T08:59:15.452085+0000","last_fullsized":"2024-04-25T08:59:15.452085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461202+0000","last_change":"2024-04-25T08:59:15.458063+0000","last_active":"2024-04-25T08:59:15.461202+0000","last_peered":"2024-04-25T08:59:15.461202+0000","last_clean":"2024-04-25T08:59:15.461202+0000","last_became_active":"2024-04-25T08:59:15.457790+0000","last_became_peered":"2024-04-25T08:59:15.457790+0000","last_unstale":"2024-04-25T08:59:15.461202+0000","last_undegraded":"2024-04-25T08:59:15.461202+0000","last_fullsized":"2024-04-25T08:59:15.461202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454036+0000","last_change":"2024-04-25T08:59:15.454036+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454036+0000","last_undegraded":"2024-04-25T08:59:15.454036+0000","last_fullsized":"2024-04-25T08:59:15.454036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463863+0000","last_change":"2024-04-25T08:59:15.459026+0000","last_active":"2024-04-25T08:59:15.463863+0000","last_peered":"2024-04-25T08:59:15.463863+0000","last_clean":"2024-04-25T08:59:15.463863+0000","last_became_active":"2024-04-25T08:59:15.458727+0000","last_became_peered":"2024-04-25T08:59:15.458727+0000","last_unstale":"2024-04-25T08:59:15.463863+0000","last_undegraded":"2024-04-25T08:59:15.463863+0000","last_fullsized":"2024-04-25T08:59:15.463863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:08.074505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449794+0000","last_change":"2024-04-25T08:59:15.449794+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449794+0000","last_undegraded":"2024-04-25T08:59:15.449794+0000","last_fullsized":"2024-04-25T08:59:15.449794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463580+0000","last_change":"2024-04-25T08:59:15.458236+0000","last_active":"2024-04-25T08:59:15.463580+0000","last_peered":"2024-04-25T08:59:15.463580+0000","last_clean":"2024-04-25T08:59:15.463580+0000","last_became_active":"2024-04-25T08:59:15.457948+0000","last_became_peered":"2024-04-25T08:59:15.457948+0000","last_unstale":"2024-04-25T08:59:15.463580+0000","last_undegraded":"2024-04-25T08:59:15.463580+0000","last_fullsized":"2024-04-25T08:59:15.463580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449832+0000","last_change":"2024-04-25T08:59:15.449832+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449832+0000","last_undegraded":"2024-04-25T08:59:15.449832+0000","last_fullsized":"2024-04-25T08:59:15.449832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464100+0000","last_change":"2024-04-25T08:59:15.458975+0000","last_active":"2024-04-25T08:59:15.464100+0000","last_peered":"2024-04-25T08:59:15.464100+0000","last_clean":"2024-04-25T08:59:15.464100+0000","last_became_active":"2024-04-25T08:59:15.458706+0000","last_became_peered":"2024-04-25T08:59:15.458706+0000","last_unstale":"2024-04-25T08:59:15.464100+0000","last_undegraded":"2024-04-25T08:59:15.464100+0000","last_fullsized":"2024-04-25T08:59:15.464100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447404+0000","last_change":"2024-04-25T08:59:15.447404+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447404+0000","last_undegraded":"2024-04-25T08:59:15.447404+0000","last_fullsized":"2024-04-25T08:59:15.447404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.468165+0000","last_change":"2024-04-25T08:59:15.467679+0000","last_active":"2024-04-25T08:59:15.468165+0000","last_peered":"2024-04-25T08:59:15.468165+0000","last_clean":"2024-04-25T08:59:15.468165+0000","last_became_active":"2024-04-25T08:59:15.467367+0000","last_became_peered":"2024-04-25T08:59:15.467367+0000","last_unstale":"2024-04-25T08:59:15.468165+0000","last_undegraded":"2024-04-25T08:59:15.468165+0000","last_fullsized":"2024-04-25T08:59:15.468165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:01.090235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453663+0000","last_change":"2024-04-25T08:59:15.453663+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453663+0000","last_undegraded":"2024-04-25T08:59:15.453663+0000","last_fullsized":"2024-04-25T08:59:15.453663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461326+0000","last_change":"2024-04-25T08:59:15.457106+0000","last_active":"2024-04-25T08:59:15.461326+0000","last_peered":"2024-04-25T08:59:15.461326+0000","last_clean":"2024-04-25T08:59:15.461326+0000","last_became_active":"2024-04-25T08:59:15.456818+0000","last_became_peered":"2024-04-25T08:59:15.456818+0000","last_unstale":"2024-04-25T08:59:15.461326+0000","last_undegraded":"2024-04-25T08:59:15.461326+0000","last_fullsized":"2024-04-25T08:59:15.461326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:02.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.454964+0000","last_change":"2024-04-25T08:59:15.454964+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.454964+0000","last_undegraded":"2024-04-25T08:59:15.454964+0000","last_fullsized":"2024-04-25T08:59:15.454964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466053+0000","last_change":"2024-04-25T08:59:15.465453+0000","last_active":"2024-04-25T08:59:15.466053+0000","last_peered":"2024-04-25T08:59:15.466053+0000","last_clean":"2024-04-25T08:59:15.466053+0000","last_became_active":"2024-04-25T08:59:15.464640+0000","last_became_peered":"2024-04-25T08:59:15.464640+0000","last_unstale":"2024-04-25T08:59:15.466053+0000","last_undegraded":"2024-04-25T08:59:15.466053+0000","last_fullsized":"2024-04-25T08:59:15.466053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:51.190507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453809+0000","last_change":"2024-04-25T08:59:15.453809+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453809+0000","last_undegraded":"2024-04-25T08:59:15.453809+0000","last_fullsized":"2024-04-25T08:59:15.453809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.467003+0000","last_change":"2024-04-25T08:59:15.462152+0000","last_active":"2024-04-25T08:59:15.467003+0000","last_peered":"2024-04-25T08:59:15.467003+0000","last_clean":"2024-04-25T08:59:15.467003+0000","last_became_active":"2024-04-25T08:59:15.461867+0000","last_became_peered":"2024-04-25T08:59:15.461867+0000","last_unstale":"2024-04-25T08:59:15.467003+0000","last_undegraded":"2024-04-25T08:59:15.467003+0000","last_fullsized":"2024-04-25T08:59:15.467003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.568439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.448611+0000","last_change":"2024-04-25T08:59:15.448611+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.448611+0000","last_undegraded":"2024-04-25T08:59:15.448611+0000","last_fullsized":"2024-04-25T08:59:15.448611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.459723+0000","last_change":"2024-04-25T08:59:15.458322+0000","last_active":"2024-04-25T08:59:15.459723+0000","last_peered":"2024-04-25T08:59:15.459723+0000","last_clean":"2024-04-25T08:59:15.459723+0000","last_became_active":"2024-04-25T08:59:15.458007+0000","last_became_peered":"2024-04-25T08:59:15.458007+0000","last_unstale":"2024-04-25T08:59:15.459723+0000","last_undegraded":"2024-04-25T08:59:15.459723+0000","last_fullsized":"2024-04-25T08:59:15.459723+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.449096+0000","last_change":"2024-04-25T08:59:15.449096+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.449096+0000","last_undegraded":"2024-04-25T08:59:15.449096+0000","last_fullsized":"2024-04-25T08:59:15.449096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466992+0000","last_change":"2024-04-25T08:59:15.462685+0000","last_active":"2024-04-25T08:59:15.466992+0000","last_peered":"2024-04-25T08:59:15.466992+0000","last_clean":"2024-04-25T08:59:15.466992+0000","last_became_active":"2024-04-25T08:59:15.462425+0000","last_became_peered":"2024-04-25T08:59:15.462425+0000","last_unstale":"2024-04-25T08:59:15.466992+0000","last_undegraded":"2024-04-25T08:59:15.466992+0000","last_fullsized":"2024-04-25T08:59:15.466992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.453454+0000","last_change":"2024-04-25T08:59:15.453454+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.453454+0000","last_undegraded":"2024-04-25T08:59:15.453454+0000","last_fullsized":"2024-04-25T08:59:15.453454+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.463983+0000","last_change":"2024-04-25T08:59:15.455921+0000","last_active":"2024-04-25T08:59:15.463983+0000","last_peered":"2024-04-25T08:59:15.463983+0000","last_clean":"2024-04-25T08:59:15.463983+0000","last_became_active":"2024-04-25T08:59:15.455572+0000","last_became_peered":"2024-04-25T08:59:15.455572+0000","last_unstale":"2024-04-25T08:59:15.463983+0000","last_undegraded":"2024-04-25T08:59:15.463983+0000","last_fullsized":"2024-04-25T08:59:15.463983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:01.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.447058+0000","last_change":"2024-04-25T08:59:15.447058+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.447058+0000","last_undegraded":"2024-04-25T08:59:15.447058+0000","last_fullsized":"2024-04-25T08:59:15.447058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.464342+0000","last_change":"2024-04-25T08:59:15.462240+0000","last_active":"2024-04-25T08:59:15.464342+0000","last_peered":"2024-04-25T08:59:15.464342+0000","last_clean":"2024-04-25T08:59:15.464342+0000","last_became_active":"2024-04-25T08:59:15.461770+0000","last_became_peered":"2024-04-25T08:59:15.461770+0000","last_unstale":"2024-04-25T08:59:15.464342+0000","last_undegraded":"2024-04-25T08:59:15.464342+0000","last_fullsized":"2024-04-25T08:59:15.464342+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.446244+0000","last_change":"2024-04-25T08:59:15.446244+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.446244+0000","last_undegraded":"2024-04-25T08:59:15.446244+0000","last_fullsized":"2024-04-25T08:59:15.446244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.466349+0000","last_change":"2024-04-25T08:59:15.464867+0000","last_active":"2024-04-25T08:59:15.466349+0000","last_peered":"2024-04-25T08:59:15.466349+0000","last_clean":"2024-04-25T08:59:15.466349+0000","last_became_active":"2024-04-25T08:59:15.464561+0000","last_became_peered":"2024-04-25T08:59:15.464561+0000","last_unstale":"2024-04-25T08:59:15.466349+0000","last_undegraded":"2024-04-25T08:59:15.466349+0000","last_fullsized":"2024-04-25T08:59:15.466349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:57.546490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-04-25T08:59:15.456285+0000","last_change":"2024-04-25T08:59:15.456285+0000","last_active":"2024-04-25T08:59:15.437724+0000","last_peered":"2024-04-25T08:59:15.437724+0000","last_clean":"2024-04-25T08:59:15.437724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:15.456285+0000","last_undegraded":"2024-04-25T08:59:15.456285+0000","last_fullsized":"2024-04-25T08:59:15.456285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.461218+0000","last_change":"2024-04-25T08:59:15.457085+0000","last_active":"2024-04-25T08:59:15.461218+0000","last_peered":"2024-04-25T08:59:15.461218+0000","last_clean":"2024-04-25T08:59:15.461218+0000","last_became_active":"2024-04-25T08:59:15.456462+0000","last_became_peered":"2024-04-25T08:59:15.456462+0000","last_unstale":"2024-04-25T08:59:15.461218+0000","last_undegraded":"2024-04-25T08:59:15.461218+0000","last_fullsized":"2024-04-25T08:59:15.461218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:22.168419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T08:59:15.452386+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:59:15.452386+0000","last_peered":"2024-04-25T08:59:15.452386+0000","last_clean":"2024-04-25T08:59:15.452386+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:59:15.452386+0000","last_undegraded":"2024-04-25T08:59:15.452386+0000","last_fullsized":"2024-04-25T08:59:15.452386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335432,"statfs":{"total":96636764160,"available":96599482368,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35832,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35824,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336016,"statfs":{"total":96636764160,"available":96600080384,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":196916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1085440,"data_stored":787284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:23.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.992+0000 7f9331970640 1 Processor -- start 2024-04-25T08:59:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.992+0000 7f9331970640 1 -- start start 2024-04-25T08:59:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9331970640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f932c0d05f0 0x7f932c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9331970640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0d0f10 con 0x7f932c0b9990 2024-04-25T08:59:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9331970640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0d23c0 con 0x7f932c0d3710 2024-04-25T08:59:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9331970640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0d2670 con 0x7f932c0d05f0 2024-04-25T08:59:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f932a7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f932c0b9990 0x7f932c0d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54008/0 (socket says 172.21.15.5:54008) 2024-04-25T08:59:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f932a7fc640 1 -- 172.21.15.5:0/3630506806 learned_addr learned my addr 172.21.15.5:0/3630506806 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f932affd640 1 --2- 172.21.15.5:0/3630506806 >> v2:172.21.15.80:3300/0 conn(0x7f932c0d05f0 0x7f932c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9329ffb640 1 -- 172.21.15.5:0/3630506806 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110763271 0 0) 0x7f932c0d0f10 con 0x7f932c0b9990 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9329ffb640 1 -- 172.21.15.5:0/3630506806 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9318003520 con 0x7f932c0b9990 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9329ffb640 1 -- 172.21.15.5:0/3630506806 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932412042 0 0) 0x7f932c0d23c0 con 0x7f932c0d3710 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.993+0000 7f9329ffb640 1 -- 172.21.15.5:0/3630506806 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f932c0d0f10 con 0x7f932c0d3710 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.994+0000 7f932affd640 1 -- 172.21.15.5:0/3630506806 >> v1:172.21.15.80:6789/0 conn(0x7f932c0d3710 legacy=0x7f932c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.994+0000 7f932affd640 1 -- 172.21.15.5:0/3630506806 >> v1:172.21.15.5:6789/0 conn(0x7f932c0b9990 legacy=0x7f932c0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.994+0000 7f932affd640 1 -- 172.21.15.5:0/3630506806 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0d2950 con 0x7f932c0d05f0 2024-04-25T08:59:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.994+0000 7f932affd640 1 --2- 172.21.15.5:0/3630506806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c0d05f0 0x7f932c0d09d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f93240097a0 tx=0x7f932402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed281e9a9545ad8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9329ffb640 1 -- 172.21.15.5:0/3630506806 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324037070 con 0x7f932c0d05f0 2024-04-25T08:59:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9329ffb640 1 -- 172.21.15.5:0/3630506806 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9324032640 con 0x7f932c0d05f0 2024-04-25T08:59:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9329ffb640 1 -- 172.21.15.5:0/3630506806 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324032a10 con 0x7f932c0d05f0 2024-04-25T08:59:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9331970640 1 -- 172.21.15.5:0/3630506806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c0d05f0 msgr2=0x7f932c0d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9331970640 1 --2- 172.21.15.5:0/3630506806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c0d05f0 0x7f932c0d09d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f93240097a0 tx=0x7f932402a2c0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9331970640 1 -- 172.21.15.5:0/3630506806 shutdown_connections 2024-04-25T08:59:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9331970640 1 --2- 172.21.15.5:0/3630506806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c0d05f0 0x7f932c0d09d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9331970640 1 -- 172.21.15.5:0/3630506806 >> 172.21.15.5:0/3630506806 conn(0x7f932c06b000 msgr2=0x7f932c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9331970640 1 -- 172.21.15.5:0/3630506806 shutdown_connections 2024-04-25T08:59:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.995+0000 7f9331970640 1 -- 172.21.15.5:0/3630506806 wait complete. 2024-04-25T08:59:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.996+0000 7f9331970640 1 Processor -- start 2024-04-25T08:59:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.997+0000 7f9331970640 1 -- start start 2024-04-25T08:59:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.997+0000 7f9331970640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f932c0d05f0 0x7f932c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.997+0000 7f9331970640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f932c0d3710 0x7f932c1e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.997+0000 7f9331970640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c15f550 0x7f932c15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.997+0000 7f9331970640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c15e090 con 0x7f932c0d05f0 2024-04-25T08:59:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.997+0000 7f9331970640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c0d2f10 con 0x7f932c15f550 2024-04-25T08:59:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.997+0000 7f9331970640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c15e210 con 0x7f932c0d3710 2024-04-25T08:59:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f932c0d05f0 0x7f932c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f932c0d05f0 0x7f932c15c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44032/0 (socket says 172.21.15.5:44032) 2024-04-25T08:59:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 -- 172.21.15.5:0/1218122417 learned_addr learned my addr 172.21.15.5:0/1218122417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932b7fe640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c15f550 0x7f932c15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932a7fc640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f932c0d3710 0x7f932c1e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 -- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f932c0d3710 msgr2=0x7f932c1e6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f932c0d3710 0x7f932c1e6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 -- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c15f550 msgr2=0x7f932c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c15f550 0x7f932c15fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 -- 172.21.15.5:0/1218122417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c1612c0 con 0x7f932c0d05f0 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932a7fc640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f932c0d3710 0x7f932c1e6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f932affd640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f932c0d05f0 0x7f932c15c9e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9324035040 tx=0x7f93240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f9323fff640 1 -- 172.21.15.5:0/1218122417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324037040 con 0x7f932c0d05f0 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f9323fff640 1 -- 172.21.15.5:0/1218122417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9324032440 con 0x7f932c0d05f0 2024-04-25T08:59:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c160220 con 0x7f932c0d05f0 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f9323fff640 1 -- 172.21.15.5:0/1218122417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324030990 con 0x7f932c0d05f0 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.998+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c1607e0 con 0x7f932c0d05f0 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:23.999+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c04ef20 con 0x7f932c0d05f0 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.000+0000 7f9323fff640 1 -- 172.21.15.5:0/1218122417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9324044020 con 0x7f932c0d05f0 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.000+0000 7f9323fff640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f930c06b4d0 0x7f930c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.000+0000 7f9323fff640 1 -- 172.21.15.5:0/1218122417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93240aa440 con 0x7f932c0d05f0 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.001+0000 7f932a7fc640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f930c06b4d0 0x7f930c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.001+0000 7f932a7fc640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f930c06b4d0 0x7f930c06d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f93140011e0 tx=0x7f9314009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.005+0000 7f9323fff640 1 -- 172.21.15.5:0/1218122417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9324079350 con 0x7f932c0d05f0 2024-04-25T08:59:24.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.182+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f932c15ff40 con 0x7f930c06b4d0 2024-04-25T08:59:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.188+0000 7f9323fff640 1 -- 172.21.15.5:0/1218122417 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251960 (secure 0 0 0) 0x7f932c15ff40 con 0x7f930c06b4d0 2024-04-25T08:59:24.183 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:24.184 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T08:59:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f930c06b4d0 msgr2=0x7f930c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f930c06b4d0 0x7f930c06d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f93140011e0 tx=0x7f9314009040 comp rx=0 tx=0).stop 2024-04-25T08:59:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f932c0d05f0 msgr2=0x7f932c15c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f932c0d05f0 0x7f932c15c9e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9324035040 tx=0x7f93240046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 shutdown_connections 2024-04-25T08:59:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f930c06b4d0 0x7f930c06d990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f932c15f550 0x7f932c15fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f932c0d3710 0x7f932c1e6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 --2- 172.21.15.5:0/1218122417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f932c0d05f0 0x7f932c15c9e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.191+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 >> 172.21.15.5:0/1218122417 conn(0x7f932c06b000 msgr2=0x7f932c0c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.192+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 shutdown_connections 2024-04-25T08:59:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.192+0000 7f9331970640 1 -- 172.21.15.5:0/1218122417 wait complete. 2024-04-25T08:59:24.192 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-25T08:59:22.422337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":296308,"kb_used_data":5256,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754678412,"statfs":{"total":773094113280,"available":772790693888,"internally_reserved":0,"allocated":5382144,"data_stored":2865484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.978312"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462661+0000","last_change":"2024-04-25T08:59:16.469983+0000","last_active":"2024-04-25T08:59:17.462661+0000","last_peered":"2024-04-25T08:59:17.462661+0000","last_clean":"2024-04-25T08:59:17.462661+0000","last_became_active":"2024-04-25T08:59:16.469714+0000","last_became_peered":"2024-04-25T08:59:16.469714+0000","last_unstale":"2024-04-25T08:59:17.462661+0000","last_undegraded":"2024-04-25T08:59:17.462661+0000","last_fullsized":"2024-04-25T08:59:17.462661+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:42.251114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.461961+0000","last_change":"2024-04-25T08:59:16.471469+0000","last_active":"2024-04-25T08:59:17.461961+0000","last_peered":"2024-04-25T08:59:17.461961+0000","last_clean":"2024-04-25T08:59:17.461961+0000","last_became_active":"2024-04-25T08:59:16.471185+0000","last_became_peered":"2024-04-25T08:59:16.471185+0000","last_unstale":"2024-04-25T08:59:17.461961+0000","last_undegraded":"2024-04-25T08:59:17.461961+0000","last_fullsized":"2024-04-25T08:59:17.461961+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:48.008628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467161+0000","last_change":"2024-04-25T08:59:16.451450+0000","last_active":"2024-04-25T08:59:17.467161+0000","last_peered":"2024-04-25T08:59:17.467161+0000","last_clean":"2024-04-25T08:59:17.467161+0000","last_became_active":"2024-04-25T08:59:16.451205+0000","last_became_peered":"2024-04-25T08:59:16.451205+0000","last_unstale":"2024-04-25T08:59:17.467161+0000","last_undegraded":"2024-04-25T08:59:17.467161+0000","last_fullsized":"2024-04-25T08:59:17.467161+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:16.575676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095334+0000","last_change":"2024-04-25T08:59:16.461482+0000","last_active":"2024-04-25T08:59:19.095334+0000","last_peered":"2024-04-25T08:59:19.095334+0000","last_clean":"2024-04-25T08:59:19.095334+0000","last_became_active":"2024-04-25T08:59:16.461130+0000","last_became_peered":"2024-04-25T08:59:16.461130+0000","last_unstale":"2024-04-25T08:59:19.095334+0000","last_undegraded":"2024-04-25T08:59:19.095334+0000","last_fullsized":"2024-04-25T08:59:19.095334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:53.461632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462289+0000","last_change":"2024-04-25T08:59:16.468817+0000","last_active":"2024-04-25T08:59:17.462289+0000","last_peered":"2024-04-25T08:59:17.462289+0000","last_clean":"2024-04-25T08:59:17.462289+0000","last_became_active":"2024-04-25T08:59:16.468473+0000","last_became_peered":"2024-04-25T08:59:16.468473+0000","last_unstale":"2024-04-25T08:59:17.462289+0000","last_undegraded":"2024-04-25T08:59:17.462289+0000","last_fullsized":"2024-04-25T08:59:17.462289+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:07.354742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.464961+0000","last_change":"2024-04-25T08:59:16.471857+0000","last_active":"2024-04-25T08:59:17.464961+0000","last_peered":"2024-04-25T08:59:17.464961+0000","last_clean":"2024-04-25T08:59:17.464961+0000","last_became_active":"2024-04-25T08:59:16.471566+0000","last_became_peered":"2024-04-25T08:59:16.471566+0000","last_unstale":"2024-04-25T08:59:17.464961+0000","last_undegraded":"2024-04-25T08:59:17.464961+0000","last_fullsized":"2024-04-25T08:59:17.464961+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:05.117391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.461843+0000","last_change":"2024-04-25T08:59:16.470624+0000","last_active":"2024-04-25T08:59:17.461843+0000","last_peered":"2024-04-25T08:59:17.461843+0000","last_clean":"2024-04-25T08:59:17.461843+0000","last_became_active":"2024-04-25T08:59:16.470341+0000","last_became_peered":"2024-04-25T08:59:16.470341+0000","last_unstale":"2024-04-25T08:59:17.461843+0000","last_undegraded":"2024-04-25T08:59:17.461843+0000","last_fullsized":"2024-04-25T08:59:17.461843+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:35.541792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095058+0000","last_change":"2024-04-25T08:59:16.466544+0000","last_active":"2024-04-25T08:59:19.095058+0000","last_peered":"2024-04-25T08:59:19.095058+0000","last_clean":"2024-04-25T08:59:19.095058+0000","last_became_active":"2024-04-25T08:59:16.462232+0000","last_became_peered":"2024-04-25T08:59:16.462232+0000","last_unstale":"2024-04-25T08:59:19.095058+0000","last_undegraded":"2024-04-25T08:59:19.095058+0000","last_fullsized":"2024-04-25T08:59:19.095058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.182087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095593+0000","last_change":"2024-04-25T08:59:16.468475+0000","last_active":"2024-04-25T08:59:19.095593+0000","last_peered":"2024-04-25T08:59:19.095593+0000","last_clean":"2024-04-25T08:59:19.095593+0000","last_became_active":"2024-04-25T08:59:16.468109+0000","last_became_peered":"2024-04-25T08:59:16.468109+0000","last_unstale":"2024-04-25T08:59:19.095593+0000","last_undegraded":"2024-04-25T08:59:19.095593+0000","last_fullsized":"2024-04-25T08:59:19.095593+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:44.716726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095430+0000","last_change":"2024-04-25T08:59:16.463356+0000","last_active":"2024-04-25T08:59:19.095430+0000","last_peered":"2024-04-25T08:59:19.095430+0000","last_clean":"2024-04-25T08:59:19.095430+0000","last_became_active":"2024-04-25T08:59:16.461881+0000","last_became_peered":"2024-04-25T08:59:16.461881+0000","last_unstale":"2024-04-25T08:59:19.095430+0000","last_undegraded":"2024-04-25T08:59:19.095430+0000","last_fullsized":"2024-04-25T08:59:19.095430+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:38.857472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.096028+0000","last_change":"2024-04-25T08:59:16.472966+0000","last_active":"2024-04-25T08:59:19.096028+0000","last_peered":"2024-04-25T08:59:19.096028+0000","last_clean":"2024-04-25T08:59:19.096028+0000","last_became_active":"2024-04-25T08:59:16.472707+0000","last_became_peered":"2024-04-25T08:59:16.472707+0000","last_unstale":"2024-04-25T08:59:19.096028+0000","last_undegraded":"2024-04-25T08:59:19.096028+0000","last_fullsized":"2024-04-25T08:59:19.096028+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:35.153941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462493+0000","last_change":"2024-04-25T08:59:16.463809+0000","last_active":"2024-04-25T08:59:17.462493+0000","last_peered":"2024-04-25T08:59:17.462493+0000","last_clean":"2024-04-25T08:59:17.462493+0000","last_became_active":"2024-04-25T08:59:16.463537+0000","last_became_peered":"2024-04-25T08:59:16.463537+0000","last_unstale":"2024-04-25T08:59:17.462493+0000","last_undegraded":"2024-04-25T08:59:17.462493+0000","last_fullsized":"2024-04-25T08:59:17.462493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:35.541792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.457052+0000","last_change":"2024-04-25T08:59:16.472565+0000","last_active":"2024-04-25T08:59:17.457052+0000","last_peered":"2024-04-25T08:59:17.457052+0000","last_clean":"2024-04-25T08:59:17.457052+0000","last_became_active":"2024-04-25T08:59:16.472286+0000","last_became_peered":"2024-04-25T08:59:16.472286+0000","last_unstale":"2024-04-25T08:59:17.457052+0000","last_undegraded":"2024-04-25T08:59:17.457052+0000","last_fullsized":"2024-04-25T08:59:17.457052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:17.152368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095178+0000","last_change":"2024-04-25T08:59:16.467237+0000","last_active":"2024-04-25T08:59:19.095178+0000","last_peered":"2024-04-25T08:59:19.095178+0000","last_clean":"2024-04-25T08:59:19.095178+0000","last_became_active":"2024-04-25T08:59:16.466953+0000","last_became_peered":"2024-04-25T08:59:16.466953+0000","last_unstale":"2024-04-25T08:59:19.095178+0000","last_undegraded":"2024-04-25T08:59:19.095178+0000","last_fullsized":"2024-04-25T08:59:19.095178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:09.081742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.464926+0000","last_change":"2024-04-25T08:59:16.460917+0000","last_active":"2024-04-25T08:59:17.464926+0000","last_peered":"2024-04-25T08:59:17.464926+0000","last_clean":"2024-04-25T08:59:17.464926+0000","last_became_active":"2024-04-25T08:59:16.460651+0000","last_became_peered":"2024-04-25T08:59:16.460651+0000","last_unstale":"2024-04-25T08:59:17.464926+0000","last_undegraded":"2024-04-25T08:59:17.464926+0000","last_fullsized":"2024-04-25T08:59:17.464926+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.004619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202058+0000","last_change":"2024-04-25T08:59:16.475279+0000","last_active":"2024-04-25T08:59:18.202058+0000","last_peered":"2024-04-25T08:59:18.202058+0000","last_clean":"2024-04-25T08:59:18.202058+0000","last_became_active":"2024-04-25T08:59:16.474971+0000","last_became_peered":"2024-04-25T08:59:16.474971+0000","last_unstale":"2024-04-25T08:59:18.202058+0000","last_undegraded":"2024-04-25T08:59:18.202058+0000","last_fullsized":"2024-04-25T08:59:18.202058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:10.966893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467482+0000","last_change":"2024-04-25T08:59:16.466703+0000","last_active":"2024-04-25T08:59:17.467482+0000","last_peered":"2024-04-25T08:59:17.467482+0000","last_clean":"2024-04-25T08:59:17.467482+0000","last_became_active":"2024-04-25T08:59:16.466139+0000","last_became_peered":"2024-04-25T08:59:16.466139+0000","last_unstale":"2024-04-25T08:59:17.467482+0000","last_undegraded":"2024-04-25T08:59:17.467482+0000","last_fullsized":"2024-04-25T08:59:17.467482+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:19.494104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467296+0000","last_change":"2024-04-25T08:59:16.453295+0000","last_active":"2024-04-25T08:59:17.467296+0000","last_peered":"2024-04-25T08:59:17.467296+0000","last_clean":"2024-04-25T08:59:17.467296+0000","last_became_active":"2024-04-25T08:59:16.453074+0000","last_became_peered":"2024-04-25T08:59:16.453074+0000","last_unstale":"2024-04-25T08:59:17.467296+0000","last_undegraded":"2024-04-25T08:59:17.467296+0000","last_fullsized":"2024-04-25T08:59:17.467296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:52.197744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202579+0000","last_change":"2024-04-25T08:59:16.475247+0000","last_active":"2024-04-25T08:59:18.202579+0000","last_peered":"2024-04-25T08:59:18.202579+0000","last_clean":"2024-04-25T08:59:18.202579+0000","last_became_active":"2024-04-25T08:59:16.474975+0000","last_became_peered":"2024-04-25T08:59:16.474975+0000","last_unstale":"2024-04-25T08:59:18.202579+0000","last_undegraded":"2024-04-25T08:59:18.202579+0000","last_fullsized":"2024-04-25T08:59:18.202579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:23.175656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.457150+0000","last_change":"2024-04-25T08:59:16.452369+0000","last_active":"2024-04-25T08:59:17.457150+0000","last_peered":"2024-04-25T08:59:17.457150+0000","last_clean":"2024-04-25T08:59:17.457150+0000","last_became_active":"2024-04-25T08:59:16.451883+0000","last_became_peered":"2024-04-25T08:59:16.451883+0000","last_unstale":"2024-04-25T08:59:17.457150+0000","last_undegraded":"2024-04-25T08:59:17.457150+0000","last_fullsized":"2024-04-25T08:59:17.457150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:10.056222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465127+0000","last_change":"2024-04-25T08:59:16.464798+0000","last_active":"2024-04-25T08:59:17.465127+0000","last_peered":"2024-04-25T08:59:17.465127+0000","last_clean":"2024-04-25T08:59:17.465127+0000","last_became_active":"2024-04-25T08:59:16.464468+0000","last_became_peered":"2024-04-25T08:59:16.464468+0000","last_unstale":"2024-04-25T08:59:17.465127+0000","last_undegraded":"2024-04-25T08:59:17.465127+0000","last_fullsized":"2024-04-25T08:59:17.465127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:58.171200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095342+0000","last_change":"2024-04-25T08:59:16.463628+0000","last_active":"2024-04-25T08:59:19.095342+0000","last_peered":"2024-04-25T08:59:19.095342+0000","last_clean":"2024-04-25T08:59:19.095342+0000","last_became_active":"2024-04-25T08:59:16.462188+0000","last_became_peered":"2024-04-25T08:59:16.462188+0000","last_unstale":"2024-04-25T08:59:19.095342+0000","last_undegraded":"2024-04-25T08:59:19.095342+0000","last_fullsized":"2024-04-25T08:59:19.095342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:52.197744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202254+0000","last_change":"2024-04-25T08:59:16.464098+0000","last_active":"2024-04-25T08:59:18.202254+0000","last_peered":"2024-04-25T08:59:18.202254+0000","last_clean":"2024-04-25T08:59:18.202254+0000","last_became_active":"2024-04-25T08:59:16.463593+0000","last_became_peered":"2024-04-25T08:59:16.463593+0000","last_unstale":"2024-04-25T08:59:18.202254+0000","last_undegraded":"2024-04-25T08:59:18.202254+0000","last_fullsized":"2024-04-25T08:59:18.202254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:32.602673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202062+0000","last_change":"2024-04-25T08:59:16.463921+0000","last_active":"2024-04-25T08:59:18.202062+0000","last_peered":"2024-04-25T08:59:18.202062+0000","last_clean":"2024-04-25T08:59:18.202062+0000","last_became_active":"2024-04-25T08:59:16.463609+0000","last_became_peered":"2024-04-25T08:59:16.463609+0000","last_unstale":"2024-04-25T08:59:18.202062+0000","last_undegraded":"2024-04-25T08:59:18.202062+0000","last_fullsized":"2024-04-25T08:59:18.202062+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:22.310119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202505+0000","last_change":"2024-04-25T08:59:16.471070+0000","last_active":"2024-04-25T08:59:18.202505+0000","last_peered":"2024-04-25T08:59:18.202505+0000","last_clean":"2024-04-25T08:59:18.202505+0000","last_became_active":"2024-04-25T08:59:16.469726+0000","last_became_peered":"2024-04-25T08:59:16.469726+0000","last_unstale":"2024-04-25T08:59:18.202505+0000","last_undegraded":"2024-04-25T08:59:18.202505+0000","last_fullsized":"2024-04-25T08:59:18.202505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:35.153865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.457207+0000","last_change":"2024-04-25T08:59:16.459275+0000","last_active":"2024-04-25T08:59:17.457207+0000","last_peered":"2024-04-25T08:59:17.457207+0000","last_clean":"2024-04-25T08:59:17.457207+0000","last_became_active":"2024-04-25T08:59:16.458938+0000","last_became_peered":"2024-04-25T08:59:16.458938+0000","last_unstale":"2024-04-25T08:59:17.457207+0000","last_undegraded":"2024-04-25T08:59:17.457207+0000","last_fullsized":"2024-04-25T08:59:17.457207+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:02.970887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467245+0000","last_change":"2024-04-25T08:59:16.466188+0000","last_active":"2024-04-25T08:59:17.467245+0000","last_peered":"2024-04-25T08:59:17.467245+0000","last_clean":"2024-04-25T08:59:17.467245+0000","last_became_active":"2024-04-25T08:59:16.465897+0000","last_became_peered":"2024-04-25T08:59:16.465897+0000","last_unstale":"2024-04-25T08:59:17.467245+0000","last_undegraded":"2024-04-25T08:59:17.467245+0000","last_fullsized":"2024-04-25T08:59:17.467245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:53.461632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462567+0000","last_change":"2024-04-25T08:59:16.463462+0000","last_active":"2024-04-25T08:59:17.462567+0000","last_peered":"2024-04-25T08:59:17.462567+0000","last_clean":"2024-04-25T08:59:17.462567+0000","last_became_active":"2024-04-25T08:59:16.463107+0000","last_became_peered":"2024-04-25T08:59:16.463107+0000","last_unstale":"2024-04-25T08:59:17.462567+0000","last_undegraded":"2024-04-25T08:59:17.462567+0000","last_fullsized":"2024-04-25T08:59:17.462567+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:46.300355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202309+0000","last_change":"2024-04-25T08:59:16.466448+0000","last_active":"2024-04-25T08:59:18.202309+0000","last_peered":"2024-04-25T08:59:18.202309+0000","last_clean":"2024-04-25T08:59:18.202309+0000","last_became_active":"2024-04-25T08:59:16.466168+0000","last_became_peered":"2024-04-25T08:59:16.466168+0000","last_unstale":"2024-04-25T08:59:18.202309+0000","last_undegraded":"2024-04-25T08:59:18.202309+0000","last_fullsized":"2024-04-25T08:59:18.202309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.957976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467078+0000","last_change":"2024-04-25T08:59:16.463287+0000","last_active":"2024-04-25T08:59:17.467078+0000","last_peered":"2024-04-25T08:59:17.467078+0000","last_clean":"2024-04-25T08:59:17.467078+0000","last_became_active":"2024-04-25T08:59:16.461999+0000","last_became_peered":"2024-04-25T08:59:16.461999+0000","last_unstale":"2024-04-25T08:59:17.467078+0000","last_undegraded":"2024-04-25T08:59:17.467078+0000","last_fullsized":"2024-04-25T08:59:17.467078+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:23.175656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.464926+0000","last_change":"2024-04-25T08:59:16.462174+0000","last_active":"2024-04-25T08:59:17.464926+0000","last_peered":"2024-04-25T08:59:17.464926+0000","last_clean":"2024-04-25T08:59:17.464926+0000","last_became_active":"2024-04-25T08:59:16.461862+0000","last_became_peered":"2024-04-25T08:59:16.461862+0000","last_unstale":"2024-04-25T08:59:17.464926+0000","last_undegraded":"2024-04-25T08:59:17.464926+0000","last_fullsized":"2024-04-25T08:59:17.464926+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:09.783624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.457135+0000","last_change":"2024-04-25T08:59:16.464334+0000","last_active":"2024-04-25T08:59:17.457135+0000","last_peered":"2024-04-25T08:59:17.457135+0000","last_clean":"2024-04-25T08:59:17.457135+0000","last_became_active":"2024-04-25T08:59:16.464063+0000","last_became_peered":"2024-04-25T08:59:16.464063+0000","last_unstale":"2024-04-25T08:59:17.457135+0000","last_undegraded":"2024-04-25T08:59:17.457135+0000","last_fullsized":"2024-04-25T08:59:17.457135+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:51.733007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095596+0000","last_change":"2024-04-25T08:59:16.473113+0000","last_active":"2024-04-25T08:59:19.095596+0000","last_peered":"2024-04-25T08:59:19.095596+0000","last_clean":"2024-04-25T08:59:19.095596+0000","last_became_active":"2024-04-25T08:59:16.472860+0000","last_became_peered":"2024-04-25T08:59:16.472860+0000","last_unstale":"2024-04-25T08:59:19.095596+0000","last_undegraded":"2024-04-25T08:59:19.095596+0000","last_fullsized":"2024-04-25T08:59:19.095596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:37.176676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465219+0000","last_change":"2024-04-25T08:59:15.459021+0000","last_active":"2024-04-25T08:59:17.465219+0000","last_peered":"2024-04-25T08:59:17.465219+0000","last_clean":"2024-04-25T08:59:17.465219+0000","last_became_active":"2024-04-25T08:59:15.458664+0000","last_became_peered":"2024-04-25T08:59:15.458664+0000","last_unstale":"2024-04-25T08:59:17.465219+0000","last_undegraded":"2024-04-25T08:59:17.465219+0000","last_fullsized":"2024-04-25T08:59:17.465219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:18.486867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202527+0000","last_change":"2024-04-25T08:59:16.461795+0000","last_active":"2024-04-25T08:59:18.202527+0000","last_peered":"2024-04-25T08:59:18.202527+0000","last_clean":"2024-04-25T08:59:18.202527+0000","last_became_active":"2024-04-25T08:59:16.461494+0000","last_became_peered":"2024-04-25T08:59:16.461494+0000","last_unstale":"2024-04-25T08:59:18.202527+0000","last_undegraded":"2024-04-25T08:59:18.202527+0000","last_fullsized":"2024-04-25T08:59:18.202527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:16.249068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467385+0000","last_change":"2024-04-25T08:59:15.454182+0000","last_active":"2024-04-25T08:59:17.467385+0000","last_peered":"2024-04-25T08:59:17.467385+0000","last_clean":"2024-04-25T08:59:17.467385+0000","last_became_active":"2024-04-25T08:59:15.453926+0000","last_became_peered":"2024-04-25T08:59:15.453926+0000","last_unstale":"2024-04-25T08:59:17.467385+0000","last_undegraded":"2024-04-25T08:59:17.467385+0000","last_fullsized":"2024-04-25T08:59:17.467385+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:54.493794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462639+0000","last_change":"2024-04-25T08:59:16.461182+0000","last_active":"2024-04-25T08:59:17.462639+0000","last_peered":"2024-04-25T08:59:17.462639+0000","last_clean":"2024-04-25T08:59:17.462639+0000","last_became_active":"2024-04-25T08:59:16.460836+0000","last_became_peered":"2024-04-25T08:59:16.460836+0000","last_unstale":"2024-04-25T08:59:17.462639+0000","last_undegraded":"2024-04-25T08:59:17.462639+0000","last_fullsized":"2024-04-25T08:59:17.462639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:47.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.096004+0000","last_change":"2024-04-25T08:59:15.462158+0000","last_active":"2024-04-25T08:59:19.096004+0000","last_peered":"2024-04-25T08:59:19.096004+0000","last_clean":"2024-04-25T08:59:19.096004+0000","last_became_active":"2024-04-25T08:59:15.461680+0000","last_became_peered":"2024-04-25T08:59:15.461680+0000","last_unstale":"2024-04-25T08:59:19.096004+0000","last_undegraded":"2024-04-25T08:59:19.096004+0000","last_fullsized":"2024-04-25T08:59:19.096004+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:21.139829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095909+0000","last_change":"2024-04-25T08:59:16.474229+0000","last_active":"2024-04-25T08:59:19.095909+0000","last_peered":"2024-04-25T08:59:19.095909+0000","last_clean":"2024-04-25T08:59:19.095909+0000","last_became_active":"2024-04-25T08:59:16.473960+0000","last_became_peered":"2024-04-25T08:59:16.473960+0000","last_unstale":"2024-04-25T08:59:19.095909+0000","last_undegraded":"2024-04-25T08:59:19.095909+0000","last_fullsized":"2024-04-25T08:59:19.095909+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:37.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462009+0000","last_change":"2024-04-25T08:59:15.458383+0000","last_active":"2024-04-25T08:59:17.462009+0000","last_peered":"2024-04-25T08:59:17.462009+0000","last_clean":"2024-04-25T08:59:17.462009+0000","last_became_active":"2024-04-25T08:59:15.457899+0000","last_became_peered":"2024-04-25T08:59:15.457899+0000","last_unstale":"2024-04-25T08:59:17.462009+0000","last_undegraded":"2024-04-25T08:59:17.462009+0000","last_fullsized":"2024-04-25T08:59:17.462009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:51.190507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467115+0000","last_change":"2024-04-25T08:59:16.463959+0000","last_active":"2024-04-25T08:59:17.467115+0000","last_peered":"2024-04-25T08:59:17.467115+0000","last_clean":"2024-04-25T08:59:17.467115+0000","last_became_active":"2024-04-25T08:59:16.463684+0000","last_became_peered":"2024-04-25T08:59:16.463684+0000","last_unstale":"2024-04-25T08:59:17.467115+0000","last_undegraded":"2024-04-25T08:59:17.467115+0000","last_fullsized":"2024-04-25T08:59:17.467115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:09.081742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465233+0000","last_change":"2024-04-25T08:59:15.459763+0000","last_active":"2024-04-25T08:59:17.465233+0000","last_peered":"2024-04-25T08:59:17.465233+0000","last_clean":"2024-04-25T08:59:17.465233+0000","last_became_active":"2024-04-25T08:59:15.459423+0000","last_became_peered":"2024-04-25T08:59:15.459423+0000","last_unstale":"2024-04-25T08:59:17.465233+0000","last_undegraded":"2024-04-25T08:59:17.465233+0000","last_fullsized":"2024-04-25T08:59:17.465233+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:32.432060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095700+0000","last_change":"2024-04-25T08:59:16.453994+0000","last_active":"2024-04-25T08:59:19.095700+0000","last_peered":"2024-04-25T08:59:19.095700+0000","last_clean":"2024-04-25T08:59:19.095700+0000","last_became_active":"2024-04-25T08:59:16.453770+0000","last_became_peered":"2024-04-25T08:59:16.453770+0000","last_unstale":"2024-04-25T08:59:19.095700+0000","last_undegraded":"2024-04-25T08:59:19.095700+0000","last_fullsized":"2024-04-25T08:59:19.095700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:33.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467215+0000","last_change":"2024-04-25T08:59:15.453202+0000","last_active":"2024-04-25T08:59:17.467215+0000","last_peered":"2024-04-25T08:59:17.467215+0000","last_clean":"2024-04-25T08:59:17.467215+0000","last_became_active":"2024-04-25T08:59:15.452856+0000","last_became_peered":"2024-04-25T08:59:15.452856+0000","last_unstale":"2024-04-25T08:59:17.467215+0000","last_undegraded":"2024-04-25T08:59:17.467215+0000","last_fullsized":"2024-04-25T08:59:17.467215+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:09.959656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095070+0000","last_change":"2024-04-25T08:59:16.465807+0000","last_active":"2024-04-25T08:59:19.095070+0000","last_peered":"2024-04-25T08:59:19.095070+0000","last_clean":"2024-04-25T08:59:19.095070+0000","last_became_active":"2024-04-25T08:59:16.463571+0000","last_became_peered":"2024-04-25T08:59:16.463571+0000","last_unstale":"2024-04-25T08:59:19.095070+0000","last_undegraded":"2024-04-25T08:59:19.095070+0000","last_fullsized":"2024-04-25T08:59:19.095070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:23.175656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.461787+0000","last_change":"2024-04-25T08:59:15.453050+0000","last_active":"2024-04-25T08:59:17.461787+0000","last_peered":"2024-04-25T08:59:17.461787+0000","last_clean":"2024-04-25T08:59:17.461787+0000","last_became_active":"2024-04-25T08:59:15.452771+0000","last_became_peered":"2024-04-25T08:59:15.452771+0000","last_unstale":"2024-04-25T08:59:17.461787+0000","last_undegraded":"2024-04-25T08:59:17.461787+0000","last_fullsized":"2024-04-25T08:59:17.461787+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:51.190507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202131+0000","last_change":"2024-04-25T08:59:16.462386+0000","last_active":"2024-04-25T08:59:18.202131+0000","last_peered":"2024-04-25T08:59:18.202131+0000","last_clean":"2024-04-25T08:59:18.202131+0000","last_became_active":"2024-04-25T08:59:16.462065+0000","last_became_peered":"2024-04-25T08:59:16.462065+0000","last_unstale":"2024-04-25T08:59:18.202131+0000","last_undegraded":"2024-04-25T08:59:18.202131+0000","last_fullsized":"2024-04-25T08:59:18.202131+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:37.176676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095165+0000","last_change":"2024-04-25T08:59:15.465229+0000","last_active":"2024-04-25T08:59:19.095165+0000","last_peered":"2024-04-25T08:59:19.095165+0000","last_clean":"2024-04-25T08:59:19.095165+0000","last_became_active":"2024-04-25T08:59:15.464721+0000","last_became_peered":"2024-04-25T08:59:15.464721+0000","last_unstale":"2024-04-25T08:59:19.095165+0000","last_undegraded":"2024-04-25T08:59:19.095165+0000","last_fullsized":"2024-04-25T08:59:19.095165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:50.725770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467316+0000","last_change":"2024-04-25T08:59:16.452925+0000","last_active":"2024-04-25T08:59:17.467316+0000","last_peered":"2024-04-25T08:59:17.467316+0000","last_clean":"2024-04-25T08:59:17.467316+0000","last_became_active":"2024-04-25T08:59:16.452685+0000","last_became_peered":"2024-04-25T08:59:16.452685+0000","last_unstale":"2024-04-25T08:59:17.467316+0000","last_undegraded":"2024-04-25T08:59:17.467316+0000","last_fullsized":"2024-04-25T08:59:17.467316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:18.988698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467493+0000","last_change":"2024-04-25T08:59:15.450651+0000","last_active":"2024-04-25T08:59:17.467493+0000","last_peered":"2024-04-25T08:59:17.467493+0000","last_clean":"2024-04-25T08:59:17.467493+0000","last_became_active":"2024-04-25T08:59:15.450157+0000","last_became_peered":"2024-04-25T08:59:15.450157+0000","last_unstale":"2024-04-25T08:59:17.467493+0000","last_undegraded":"2024-04-25T08:59:17.467493+0000","last_fullsized":"2024-04-25T08:59:17.467493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:21.139829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462662+0000","last_change":"2024-04-25T08:59:16.467627+0000","last_active":"2024-04-25T08:59:17.462662+0000","last_peered":"2024-04-25T08:59:17.462662+0000","last_clean":"2024-04-25T08:59:17.462662+0000","last_became_active":"2024-04-25T08:59:16.467337+0000","last_became_peered":"2024-04-25T08:59:16.467337+0000","last_unstale":"2024-04-25T08:59:17.462662+0000","last_undegraded":"2024-04-25T08:59:17.462662+0000","last_fullsized":"2024-04-25T08:59:17.462662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:48.044651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095629+0000","last_change":"2024-04-25T08:59:15.467758+0000","last_active":"2024-04-25T08:59:19.095629+0000","last_peered":"2024-04-25T08:59:19.095629+0000","last_clean":"2024-04-25T08:59:19.095629+0000","last_became_active":"2024-04-25T08:59:15.467423+0000","last_became_peered":"2024-04-25T08:59:15.467423+0000","last_unstale":"2024-04-25T08:59:19.095629+0000","last_undegraded":"2024-04-25T08:59:19.095629+0000","last_fullsized":"2024-04-25T08:59:19.095629+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:16.145131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465335+0000","last_change":"2024-04-25T08:59:16.457411+0000","last_active":"2024-04-25T08:59:17.465335+0000","last_peered":"2024-04-25T08:59:17.465335+0000","last_clean":"2024-04-25T08:59:17.465335+0000","last_became_active":"2024-04-25T08:59:16.457099+0000","last_became_peered":"2024-04-25T08:59:16.457099+0000","last_unstale":"2024-04-25T08:59:17.465335+0000","last_undegraded":"2024-04-25T08:59:17.465335+0000","last_fullsized":"2024-04-25T08:59:17.465335+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:07.382006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462479+0000","last_change":"2024-04-25T08:59:15.462089+0000","last_active":"2024-04-25T08:59:17.462479+0000","last_peered":"2024-04-25T08:59:17.462479+0000","last_clean":"2024-04-25T08:59:17.462479+0000","last_became_active":"2024-04-25T08:59:15.461797+0000","last_became_peered":"2024-04-25T08:59:15.461797+0000","last_unstale":"2024-04-25T08:59:17.462479+0000","last_undegraded":"2024-04-25T08:59:17.462479+0000","last_fullsized":"2024-04-25T08:59:17.462479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.981461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462230+0000","last_change":"2024-04-25T08:59:16.472034+0000","last_active":"2024-04-25T08:59:17.462230+0000","last_peered":"2024-04-25T08:59:17.462230+0000","last_clean":"2024-04-25T08:59:17.462230+0000","last_became_active":"2024-04-25T08:59:16.471627+0000","last_became_peered":"2024-04-25T08:59:16.471627+0000","last_unstale":"2024-04-25T08:59:17.462230+0000","last_undegraded":"2024-04-25T08:59:17.462230+0000","last_fullsized":"2024-04-25T08:59:17.462230+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:46.300355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.457167+0000","last_change":"2024-04-25T08:59:15.452741+0000","last_active":"2024-04-25T08:59:17.457167+0000","last_peered":"2024-04-25T08:59:17.457167+0000","last_clean":"2024-04-25T08:59:17.457167+0000","last_became_active":"2024-04-25T08:59:15.452336+0000","last_became_peered":"2024-04-25T08:59:15.452336+0000","last_unstale":"2024-04-25T08:59:17.457167+0000","last_undegraded":"2024-04-25T08:59:17.457167+0000","last_fullsized":"2024-04-25T08:59:17.457167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:57.546490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202287+0000","last_change":"2024-04-25T08:59:16.470011+0000","last_active":"2024-04-25T08:59:18.202287+0000","last_peered":"2024-04-25T08:59:18.202287+0000","last_clean":"2024-04-25T08:59:18.202287+0000","last_became_active":"2024-04-25T08:59:16.469350+0000","last_became_peered":"2024-04-25T08:59:16.469350+0000","last_unstale":"2024-04-25T08:59:18.202287+0000","last_undegraded":"2024-04-25T08:59:18.202287+0000","last_fullsized":"2024-04-25T08:59:18.202287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:03.825301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465268+0000","last_change":"2024-04-25T08:59:15.466415+0000","last_active":"2024-04-25T08:59:17.465268+0000","last_peered":"2024-04-25T08:59:17.465268+0000","last_clean":"2024-04-25T08:59:17.465268+0000","last_became_active":"2024-04-25T08:59:15.466019+0000","last_became_peered":"2024-04-25T08:59:15.466019+0000","last_unstale":"2024-04-25T08:59:17.465268+0000","last_undegraded":"2024-04-25T08:59:17.465268+0000","last_fullsized":"2024-04-25T08:59:17.465268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:10.706108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095837+0000","last_change":"2024-04-25T08:59:16.465557+0000","last_active":"2024-04-25T08:59:19.095837+0000","last_peered":"2024-04-25T08:59:19.095837+0000","last_clean":"2024-04-25T08:59:19.095837+0000","last_became_active":"2024-04-25T08:59:16.464675+0000","last_became_peered":"2024-04-25T08:59:16.464675+0000","last_unstale":"2024-04-25T08:59:19.095837+0000","last_undegraded":"2024-04-25T08:59:19.095837+0000","last_fullsized":"2024-04-25T08:59:19.095837+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:31.295354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.461880+0000","last_change":"2024-04-25T08:59:15.455994+0000","last_active":"2024-04-25T08:59:17.461880+0000","last_peered":"2024-04-25T08:59:17.461880+0000","last_clean":"2024-04-25T08:59:17.461880+0000","last_became_active":"2024-04-25T08:59:15.455710+0000","last_became_peered":"2024-04-25T08:59:15.455710+0000","last_unstale":"2024-04-25T08:59:17.461880+0000","last_undegraded":"2024-04-25T08:59:17.461880+0000","last_fullsized":"2024-04-25T08:59:17.461880+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:43.709489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.464932+0000","last_change":"2024-04-25T08:59:16.457471+0000","last_active":"2024-04-25T08:59:17.464932+0000","last_peered":"2024-04-25T08:59:17.464932+0000","last_clean":"2024-04-25T08:59:17.464932+0000","last_became_active":"2024-04-25T08:59:16.457186+0000","last_became_peered":"2024-04-25T08:59:16.457186+0000","last_unstale":"2024-04-25T08:59:17.464932+0000","last_undegraded":"2024-04-25T08:59:17.464932+0000","last_fullsized":"2024-04-25T08:59:17.464932+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:49.123529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465129+0000","last_change":"2024-04-25T08:59:15.464258+0000","last_active":"2024-04-25T08:59:17.465129+0000","last_peered":"2024-04-25T08:59:17.465129+0000","last_clean":"2024-04-25T08:59:17.465129+0000","last_became_active":"2024-04-25T08:59:15.463915+0000","last_became_peered":"2024-04-25T08:59:15.463915+0000","last_unstale":"2024-04-25T08:59:17.465129+0000","last_undegraded":"2024-04-25T08:59:17.465129+0000","last_fullsized":"2024-04-25T08:59:17.465129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:43.709489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462010+0000","last_change":"2024-04-25T08:59:16.461875+0000","last_active":"2024-04-25T08:59:17.462010+0000","last_peered":"2024-04-25T08:59:17.462010+0000","last_clean":"2024-04-25T08:59:17.462010+0000","last_became_active":"2024-04-25T08:59:16.461567+0000","last_became_peered":"2024-04-25T08:59:16.461567+0000","last_unstale":"2024-04-25T08:59:17.462010+0000","last_undegraded":"2024-04-25T08:59:17.462010+0000","last_fullsized":"2024-04-25T08:59:17.462010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:42.947218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095277+0000","last_change":"2024-04-25T08:59:15.467372+0000","last_active":"2024-04-25T08:59:19.095277+0000","last_peered":"2024-04-25T08:59:19.095277+0000","last_clean":"2024-04-25T08:59:19.095277+0000","last_became_active":"2024-04-25T08:59:15.467151+0000","last_became_peered":"2024-04-25T08:59:15.467151+0000","last_unstale":"2024-04-25T08:59:19.095277+0000","last_undegraded":"2024-04-25T08:59:19.095277+0000","last_fullsized":"2024-04-25T08:59:19.095277+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:09.048985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.457307+0000","last_change":"2024-04-25T08:59:16.461177+0000","last_active":"2024-04-25T08:59:17.457307+0000","last_peered":"2024-04-25T08:59:17.457307+0000","last_clean":"2024-04-25T08:59:17.457307+0000","last_became_active":"2024-04-25T08:59:16.460887+0000","last_became_peered":"2024-04-25T08:59:16.460887+0000","last_unstale":"2024-04-25T08:59:17.457307+0000","last_undegraded":"2024-04-25T08:59:17.457307+0000","last_fullsized":"2024-04-25T08:59:17.457307+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:47.638525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.457129+0000","last_change":"2024-04-25T08:59:15.455569+0000","last_active":"2024-04-25T08:59:17.457129+0000","last_peered":"2024-04-25T08:59:17.457129+0000","last_clean":"2024-04-25T08:59:17.457129+0000","last_became_active":"2024-04-25T08:59:15.455293+0000","last_became_peered":"2024-04-25T08:59:15.455293+0000","last_unstale":"2024-04-25T08:59:17.457129+0000","last_undegraded":"2024-04-25T08:59:17.457129+0000","last_fullsized":"2024-04-25T08:59:17.457129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:44.716464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095746+0000","last_change":"2024-04-25T08:59:16.461330+0000","last_active":"2024-04-25T08:59:19.095746+0000","last_peered":"2024-04-25T08:59:19.095746+0000","last_clean":"2024-04-25T08:59:19.095746+0000","last_became_active":"2024-04-25T08:59:16.460432+0000","last_became_peered":"2024-04-25T08:59:16.460432+0000","last_unstale":"2024-04-25T08:59:19.095746+0000","last_undegraded":"2024-04-25T08:59:19.095746+0000","last_fullsized":"2024-04-25T08:59:19.095746+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:11.713345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467398+0000","last_change":"2024-04-25T08:59:15.453157+0000","last_active":"2024-04-25T08:59:17.467398+0000","last_peered":"2024-04-25T08:59:17.467398+0000","last_clean":"2024-04-25T08:59:17.467398+0000","last_became_active":"2024-04-25T08:59:15.452867+0000","last_became_peered":"2024-04-25T08:59:15.452867+0000","last_unstale":"2024-04-25T08:59:17.467398+0000","last_undegraded":"2024-04-25T08:59:17.467398+0000","last_fullsized":"2024-04-25T08:59:17.467398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:16.174803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202224+0000","last_change":"2024-04-25T08:59:16.465085+0000","last_active":"2024-04-25T08:59:18.202224+0000","last_peered":"2024-04-25T08:59:18.202224+0000","last_clean":"2024-04-25T08:59:18.202224+0000","last_became_active":"2024-04-25T08:59:16.464807+0000","last_became_peered":"2024-04-25T08:59:16.464807+0000","last_unstale":"2024-04-25T08:59:18.202224+0000","last_undegraded":"2024-04-25T08:59:18.202224+0000","last_fullsized":"2024-04-25T08:59:18.202224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:37.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462256+0000","last_change":"2024-04-25T08:59:15.458063+0000","last_active":"2024-04-25T08:59:17.462256+0000","last_peered":"2024-04-25T08:59:17.462256+0000","last_clean":"2024-04-25T08:59:17.462256+0000","last_became_active":"2024-04-25T08:59:15.457790+0000","last_became_peered":"2024-04-25T08:59:15.457790+0000","last_unstale":"2024-04-25T08:59:17.462256+0000","last_undegraded":"2024-04-25T08:59:17.462256+0000","last_fullsized":"2024-04-25T08:59:17.462256+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.981461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202543+0000","last_change":"2024-04-25T08:59:16.471688+0000","last_active":"2024-04-25T08:59:18.202543+0000","last_peered":"2024-04-25T08:59:18.202543+0000","last_clean":"2024-04-25T08:59:18.202543+0000","last_became_active":"2024-04-25T08:59:16.471423+0000","last_became_peered":"2024-04-25T08:59:16.471423+0000","last_unstale":"2024-04-25T08:59:18.202543+0000","last_undegraded":"2024-04-25T08:59:18.202543+0000","last_fullsized":"2024-04-25T08:59:18.202543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.182087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465326+0000","last_change":"2024-04-25T08:59:15.459026+0000","last_active":"2024-04-25T08:59:17.465326+0000","last_peered":"2024-04-25T08:59:17.465326+0000","last_clean":"2024-04-25T08:59:17.465326+0000","last_became_active":"2024-04-25T08:59:15.458727+0000","last_became_peered":"2024-04-25T08:59:15.458727+0000","last_unstale":"2024-04-25T08:59:17.465326+0000","last_undegraded":"2024-04-25T08:59:17.465326+0000","last_fullsized":"2024-04-25T08:59:17.465326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:37.850235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.464969+0000","last_change":"2024-04-25T08:59:16.461920+0000","last_active":"2024-04-25T08:59:17.464969+0000","last_peered":"2024-04-25T08:59:17.464969+0000","last_clean":"2024-04-25T08:59:17.464969+0000","last_became_active":"2024-04-25T08:59:16.461627+0000","last_became_peered":"2024-04-25T08:59:16.461627+0000","last_unstale":"2024-04-25T08:59:17.464969+0000","last_undegraded":"2024-04-25T08:59:17.464969+0000","last_fullsized":"2024-04-25T08:59:17.464969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:06.288458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465399+0000","last_change":"2024-04-25T08:59:15.458236+0000","last_active":"2024-04-25T08:59:17.465399+0000","last_peered":"2024-04-25T08:59:17.465399+0000","last_clean":"2024-04-25T08:59:17.465399+0000","last_became_active":"2024-04-25T08:59:15.457948+0000","last_became_peered":"2024-04-25T08:59:15.457948+0000","last_unstale":"2024-04-25T08:59:17.465399+0000","last_undegraded":"2024-04-25T08:59:17.465399+0000","last_fullsized":"2024-04-25T08:59:17.465399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:34.146704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095404+0000","last_change":"2024-04-25T08:59:16.466355+0000","last_active":"2024-04-25T08:59:19.095404+0000","last_peered":"2024-04-25T08:59:19.095404+0000","last_clean":"2024-04-25T08:59:19.095404+0000","last_became_active":"2024-04-25T08:59:16.466071+0000","last_became_peered":"2024-04-25T08:59:16.466071+0000","last_unstale":"2024-04-25T08:59:19.095404+0000","last_undegraded":"2024-04-25T08:59:19.095404+0000","last_fullsized":"2024-04-25T08:59:19.095404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:22.310119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.461999+0000","last_change":"2024-04-25T08:59:15.458975+0000","last_active":"2024-04-25T08:59:17.461999+0000","last_peered":"2024-04-25T08:59:17.461999+0000","last_clean":"2024-04-25T08:59:17.461999+0000","last_became_active":"2024-04-25T08:59:15.458706+0000","last_became_peered":"2024-04-25T08:59:15.458706+0000","last_unstale":"2024-04-25T08:59:17.461999+0000","last_undegraded":"2024-04-25T08:59:17.461999+0000","last_fullsized":"2024-04-25T08:59:17.461999+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:52.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.456979+0000","last_change":"2024-04-25T08:59:16.463504+0000","last_active":"2024-04-25T08:59:17.456979+0000","last_peered":"2024-04-25T08:59:17.456979+0000","last_clean":"2024-04-25T08:59:17.456979+0000","last_became_active":"2024-04-25T08:59:16.463227+0000","last_became_peered":"2024-04-25T08:59:16.463227+0000","last_unstale":"2024-04-25T08:59:17.456979+0000","last_undegraded":"2024-04-25T08:59:17.456979+0000","last_fullsized":"2024-04-25T08:59:17.456979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:02.016332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095292+0000","last_change":"2024-04-25T08:59:15.467679+0000","last_active":"2024-04-25T08:59:19.095292+0000","last_peered":"2024-04-25T08:59:19.095292+0000","last_clean":"2024-04-25T08:59:19.095292+0000","last_became_active":"2024-04-25T08:59:15.467367+0000","last_became_peered":"2024-04-25T08:59:15.467367+0000","last_unstale":"2024-04-25T08:59:19.095292+0000","last_undegraded":"2024-04-25T08:59:19.095292+0000","last_fullsized":"2024-04-25T08:59:19.095292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:01.009095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095190+0000","last_change":"2024-04-25T08:59:16.467306+0000","last_active":"2024-04-25T08:59:19.095190+0000","last_peered":"2024-04-25T08:59:19.095190+0000","last_clean":"2024-04-25T08:59:19.095190+0000","last_became_active":"2024-04-25T08:59:16.467012+0000","last_became_peered":"2024-04-25T08:59:16.467012+0000","last_unstale":"2024-04-25T08:59:19.095190+0000","last_undegraded":"2024-04-25T08:59:19.095190+0000","last_fullsized":"2024-04-25T08:59:19.095190+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:16.575676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.461613+0000","last_change":"2024-04-25T08:59:15.457106+0000","last_active":"2024-04-25T08:59:17.461613+0000","last_peered":"2024-04-25T08:59:17.461613+0000","last_clean":"2024-04-25T08:59:17.461613+0000","last_became_active":"2024-04-25T08:59:15.456818+0000","last_became_peered":"2024-04-25T08:59:15.456818+0000","last_unstale":"2024-04-25T08:59:17.461613+0000","last_undegraded":"2024-04-25T08:59:17.461613+0000","last_fullsized":"2024-04-25T08:59:17.461613+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:32.432060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:18.202635+0000","last_change":"2024-04-25T08:59:16.472359+0000","last_active":"2024-04-25T08:59:18.202635+0000","last_peered":"2024-04-25T08:59:18.202635+0000","last_clean":"2024-04-25T08:59:18.202635+0000","last_became_active":"2024-04-25T08:59:16.470594+0000","last_became_peered":"2024-04-25T08:59:16.470594+0000","last_unstale":"2024-04-25T08:59:18.202635+0000","last_undegraded":"2024-04-25T08:59:18.202635+0000","last_fullsized":"2024-04-25T08:59:18.202635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:09.081742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465347+0000","last_change":"2024-04-25T08:59:15.465453+0000","last_active":"2024-04-25T08:59:17.465347+0000","last_peered":"2024-04-25T08:59:17.465347+0000","last_clean":"2024-04-25T08:59:17.465347+0000","last_became_active":"2024-04-25T08:59:15.464640+0000","last_became_peered":"2024-04-25T08:59:15.464640+0000","last_unstale":"2024-04-25T08:59:17.465347+0000","last_undegraded":"2024-04-25T08:59:17.465347+0000","last_fullsized":"2024-04-25T08:59:17.465347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:30.288117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095522+0000","last_change":"2024-04-25T08:59:16.464305+0000","last_active":"2024-04-25T08:59:19.095522+0000","last_peered":"2024-04-25T08:59:19.095522+0000","last_clean":"2024-04-25T08:59:19.095522+0000","last_became_active":"2024-04-25T08:59:16.463985+0000","last_became_peered":"2024-04-25T08:59:16.463985+0000","last_unstale":"2024-04-25T08:59:19.095522+0000","last_undegraded":"2024-04-25T08:59:19.095522+0000","last_fullsized":"2024-04-25T08:59:19.095522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:18.988698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462588+0000","last_change":"2024-04-25T08:59:15.462152+0000","last_active":"2024-04-25T08:59:17.462588+0000","last_peered":"2024-04-25T08:59:17.462588+0000","last_clean":"2024-04-25T08:59:17.462588+0000","last_became_active":"2024-04-25T08:59:15.461867+0000","last_became_peered":"2024-04-25T08:59:15.461867+0000","last_unstale":"2024-04-25T08:59:17.462588+0000","last_undegraded":"2024-04-25T08:59:17.462588+0000","last_fullsized":"2024-04-25T08:59:17.462588+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:18.486867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462384+0000","last_change":"2024-04-25T08:59:16.463790+0000","last_active":"2024-04-25T08:59:17.462384+0000","last_peered":"2024-04-25T08:59:17.462384+0000","last_clean":"2024-04-25T08:59:17.462384+0000","last_became_active":"2024-04-25T08:59:16.463510+0000","last_became_peered":"2024-04-25T08:59:16.463510+0000","last_unstale":"2024-04-25T08:59:17.462384+0000","last_undegraded":"2024-04-25T08:59:17.462384+0000","last_fullsized":"2024-04-25T08:59:17.462384+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:47.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095506+0000","last_change":"2024-04-25T08:59:15.458322+0000","last_active":"2024-04-25T08:59:19.095506+0000","last_peered":"2024-04-25T08:59:19.095506+0000","last_clean":"2024-04-25T08:59:19.095506+0000","last_became_active":"2024-04-25T08:59:15.458007+0000","last_became_peered":"2024-04-25T08:59:15.458007+0000","last_unstale":"2024-04-25T08:59:19.095506+0000","last_undegraded":"2024-04-25T08:59:19.095506+0000","last_fullsized":"2024-04-25T08:59:19.095506+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:01.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465231+0000","last_change":"2024-04-25T08:59:16.470422+0000","last_active":"2024-04-25T08:59:17.465231+0000","last_peered":"2024-04-25T08:59:17.465231+0000","last_clean":"2024-04-25T08:59:17.465231+0000","last_became_active":"2024-04-25T08:59:16.470094+0000","last_became_peered":"2024-04-25T08:59:16.470094+0000","last_unstale":"2024-04-25T08:59:17.465231+0000","last_undegraded":"2024-04-25T08:59:17.465231+0000","last_fullsized":"2024-04-25T08:59:17.465231+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:58.982544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462304+0000","last_change":"2024-04-25T08:59:15.462685+0000","last_active":"2024-04-25T08:59:17.462304+0000","last_peered":"2024-04-25T08:59:17.462304+0000","last_clean":"2024-04-25T08:59:17.462304+0000","last_became_active":"2024-04-25T08:59:15.462425+0000","last_became_peered":"2024-04-25T08:59:15.462425+0000","last_unstale":"2024-04-25T08:59:17.462304+0000","last_undegraded":"2024-04-25T08:59:17.462304+0000","last_fullsized":"2024-04-25T08:59:17.462304+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:37.850235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.465154+0000","last_change":"2024-04-25T08:59:16.463015+0000","last_active":"2024-04-25T08:59:17.465154+0000","last_peered":"2024-04-25T08:59:17.465154+0000","last_clean":"2024-04-25T08:59:17.465154+0000","last_became_active":"2024-04-25T08:59:16.462597+0000","last_became_peered":"2024-04-25T08:59:16.462597+0000","last_unstale":"2024-04-25T08:59:17.465154+0000","last_undegraded":"2024-04-25T08:59:17.465154+0000","last_fullsized":"2024-04-25T08:59:17.465154+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:19.637623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467248+0000","last_change":"2024-04-25T08:59:15.455921+0000","last_active":"2024-04-25T08:59:17.467248+0000","last_peered":"2024-04-25T08:59:17.467248+0000","last_clean":"2024-04-25T08:59:17.467248+0000","last_became_active":"2024-04-25T08:59:15.455572+0000","last_became_peered":"2024-04-25T08:59:15.455572+0000","last_unstale":"2024-04-25T08:59:17.467248+0000","last_undegraded":"2024-04-25T08:59:17.467248+0000","last_fullsized":"2024-04-25T08:59:17.467248+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:34.817010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462009+0000","last_change":"2024-04-25T08:59:16.467668+0000","last_active":"2024-04-25T08:59:17.462009+0000","last_peered":"2024-04-25T08:59:17.462009+0000","last_clean":"2024-04-25T08:59:17.462009+0000","last_became_active":"2024-04-25T08:59:16.467200+0000","last_became_peered":"2024-04-25T08:59:16.467200+0000","last_unstale":"2024-04-25T08:59:17.462009+0000","last_undegraded":"2024-04-25T08:59:17.462009+0000","last_fullsized":"2024-04-25T08:59:17.462009+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:25.913832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095676+0000","last_change":"2024-04-25T08:59:15.462240+0000","last_active":"2024-04-25T08:59:19.095676+0000","last_peered":"2024-04-25T08:59:19.095676+0000","last_clean":"2024-04-25T08:59:19.095676+0000","last_became_active":"2024-04-25T08:59:15.461770+0000","last_became_peered":"2024-04-25T08:59:15.461770+0000","last_unstale":"2024-04-25T08:59:19.095676+0000","last_undegraded":"2024-04-25T08:59:19.095676+0000","last_fullsized":"2024-04-25T08:59:19.095676+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:34.817010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.467073+0000","last_change":"2024-04-25T08:59:16.458680+0000","last_active":"2024-04-25T08:59:17.467073+0000","last_peered":"2024-04-25T08:59:17.467073+0000","last_clean":"2024-04-25T08:59:17.467073+0000","last_became_active":"2024-04-25T08:59:16.458395+0000","last_became_peered":"2024-04-25T08:59:16.458395+0000","last_unstale":"2024-04-25T08:59:17.467073+0000","last_undegraded":"2024-04-25T08:59:17.467073+0000","last_fullsized":"2024-04-25T08:59:17.467073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.182087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095388+0000","last_change":"2024-04-25T08:59:15.464867+0000","last_active":"2024-04-25T08:59:19.095388+0000","last_peered":"2024-04-25T08:59:19.095388+0000","last_clean":"2024-04-25T08:59:19.095388+0000","last_became_active":"2024-04-25T08:59:15.464561+0000","last_became_peered":"2024-04-25T08:59:15.464561+0000","last_unstale":"2024-04-25T08:59:19.095388+0000","last_undegraded":"2024-04-25T08:59:19.095388+0000","last_fullsized":"2024-04-25T08:59:19.095388+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:46.631288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:19.095539+0000","last_change":"2024-04-25T08:59:16.463356+0000","last_active":"2024-04-25T08:59:19.095539+0000","last_peered":"2024-04-25T08:59:19.095539+0000","last_clean":"2024-04-25T08:59:19.095539+0000","last_became_active":"2024-04-25T08:59:16.463017+0000","last_became_peered":"2024-04-25T08:59:16.463017+0000","last_unstale":"2024-04-25T08:59:19.095539+0000","last_undegraded":"2024-04-25T08:59:19.095539+0000","last_fullsized":"2024-04-25T08:59:19.095539+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:15.437724+0000","last_clean_scrub_stamp":"2024-04-25T08:59:15.437724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:19.494104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462301+0000","last_change":"2024-04-25T08:59:15.457085+0000","last_active":"2024-04-25T08:59:17.462301+0000","last_peered":"2024-04-25T08:59:17.462301+0000","last_clean":"2024-04-25T08:59:17.462301+0000","last_became_active":"2024-04-25T08:59:15.456462+0000","last_became_peered":"2024-04-25T08:59:15.456462+0000","last_unstale":"2024-04-25T08:59:17.462301+0000","last_undegraded":"2024-04-25T08:59:17.462301+0000","last_fullsized":"2024-04-25T08:59:17.462301+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:14.430487+0000","last_clean_scrub_stamp":"2024-04-25T08:59:14.430487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:18.486867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T08:59:17.462460+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T08:59:17.462460+0000","last_peered":"2024-04-25T08:59:17.462460+0000","last_clean":"2024-04-25T08:59:17.462460+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T08:59:17.462460+0000","last_undegraded":"2024-04-25T08:59:17.462460+0000","last_fullsized":"2024-04-25T08:59:17.462460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":524288,"data_stored":210663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35860,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335980,"statfs":{"total":96636764160,"available":96600043520,"internally_reserved":0,"allocated":528384,"data_stored":211603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40020,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331820,"statfs":{"total":96636764160,"available":96595783680,"internally_reserved":0,"allocated":528384,"data_stored":210629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35860,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335980,"statfs":{"total":96636764160,"available":96600043520,"internally_reserved":0,"allocated":532480,"data_stored":211625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40008,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331832,"statfs":{"total":96636764160,"available":96595795968,"internally_reserved":0,"allocated":520192,"data_stored":210061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1114112,"data_stored":800393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:24.198 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:59:24.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:59:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.351+0000 7feeb27cf640 1 Processor -- start 2024-04-25T08:59:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.351+0000 7feeb27cf640 1 -- start start 2024-04-25T08:59:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeb27cf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac147310 0x7feeac15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeb27cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feeac1476f0 0x7feeac0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeb27cf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feeac0ae2c0 0x7feeac066e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeb27cf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0b3b60 con 0x7feeac1476f0 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeb27cf640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac15eac0 con 0x7feeac0ae2c0 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeb27cf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15eda0 con 0x7feeac147310 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feeac1476f0 0x7feeac0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feeac1476f0 0x7feeac0668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44038/0 (socket says 172.21.15.5:44038) 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 -- 172.21.15.5:0/824335054 learned_addr learned my addr 172.21.15.5:0/824335054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeabfff640 1 --2- 172.21.15.5:0/824335054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac147310 0x7feeac15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeb0d6c640 1 --2- 172.21.15.5:0/824335054 >> v2:172.21.15.80:3300/0 conn(0x7feeac0ae2c0 0x7feeac066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 -- 172.21.15.5:0/824335054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac147310 msgr2=0x7feeac15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 --2- 172.21.15.5:0/824335054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac147310 0x7feeac15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 -- 172.21.15.5:0/824335054 >> v2:172.21.15.80:3300/0 conn(0x7feeac0ae2c0 msgr2=0x7feeac066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 --2- 172.21.15.5:0/824335054 >> v2:172.21.15.80:3300/0 conn(0x7feeac0ae2c0 0x7feeac066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.352+0000 7feeab7fe640 1 -- 172.21.15.5:0/824335054 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac15f080 con 0x7feeac1476f0 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.353+0000 7feeab7fe640 1 --2- 172.21.15.5:0/824335054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac1476f0 0x7feeac0668f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7feeac15efb0 tx=0x7feea002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739c1a6fcca8b335 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.353+0000 7feeaaffd640 1 -- 172.21.15.5:0/824335054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0037070 con 0x7feeac1476f0 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.353+0000 7feeaaffd640 1 -- 172.21.15.5:0/824335054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0032440 con 0x7feeac1476f0 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.353+0000 7feeaaffd640 1 -- 172.21.15.5:0/824335054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0032810 con 0x7feeac1476f0 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 -- 172.21.15.5:0/824335054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac1476f0 msgr2=0x7feeac0668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 --2- 172.21.15.5:0/824335054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac1476f0 0x7feeac0668f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7feeac15efb0 tx=0x7feea002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 -- 172.21.15.5:0/824335054 shutdown_connections 2024-04-25T08:59:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 --2- 172.21.15.5:0/824335054 >> v2:172.21.15.80:3300/0 conn(0x7feeac0ae2c0 0x7feeac066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 --2- 172.21.15.5:0/824335054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac1476f0 0x7feeac0668f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 --2- 172.21.15.5:0/824335054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac147310 0x7feeac15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 -- 172.21.15.5:0/824335054 >> 172.21.15.5:0/824335054 conn(0x7feeac0b2d70 msgr2=0x7feeac0d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 -- 172.21.15.5:0/824335054 shutdown_connections 2024-04-25T08:59:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.354+0000 7feeb27cf640 1 -- 172.21.15.5:0/824335054 wait complete. 2024-04-25T08:59:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.355+0000 7feeb27cf640 1 Processor -- start 2024-04-25T08:59:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.355+0000 7feeb27cf640 1 -- start start 2024-04-25T08:59:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb27cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac0ae2c0 0x7feeac142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb27cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac147310 0x7feeac06e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb27cf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac1476f0 0x7feeac06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb27cf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac071440 con 0x7feeac0ae2c0 2024-04-25T08:59:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb27cf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15e730 con 0x7feeac147310 2024-04-25T08:59:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb27cf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0715c0 con 0x7feeac1476f0 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac0ae2c0 0x7feeac142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac0ae2c0 0x7feeac142aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44044/0 (socket says 172.21.15.5:44044) 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 -- 172.21.15.5:0/2735641226 learned_addr learned my addr 172.21.15.5:0/2735641226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeab7fe640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac147310 0x7feeac06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb0d6c640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac1476f0 0x7feeac06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 -- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac1476f0 msgr2=0x7feeac06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac1476f0 0x7feeac06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 -- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac147310 msgr2=0x7feeac06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac147310 0x7feeac06e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 -- 172.21.15.5:0/2735641226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac143580 con 0x7feeac0ae2c0 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeab7fe640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac147310 0x7feeac06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb0d6c640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac1476f0 0x7feeac06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeabfff640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac0ae2c0 0x7feeac142aa0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e9b0 tx=0x7fee9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feea8ff9640 1 -- 172.21.15.5:0/2735641226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c017070 con 0x7feeac0ae2c0 2024-04-25T08:59:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feea8ff9640 1 -- 172.21.15.5:0/2735641226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00c9a0 con 0x7feeac0ae2c0 2024-04-25T08:59:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac1e79f0 con 0x7feeac0ae2c0 2024-04-25T08:59:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.356+0000 7feea8ff9640 1 -- 172.21.15.5:0/2735641226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00cd90 con 0x7feeac0ae2c0 2024-04-25T08:59:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.357+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac1e7fb0 con 0x7feeac0ae2c0 2024-04-25T08:59:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.358+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac04ef20 con 0x7feeac0ae2c0 2024-04-25T08:59:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.358+0000 7feea8ff9640 1 -- 172.21.15.5:0/2735641226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee9c01a070 con 0x7feeac0ae2c0 2024-04-25T08:59:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.359+0000 7feea8ff9640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fee9806b4d0 0x7fee9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.359+0000 7feea8ff9640 1 -- 172.21.15.5:0/2735641226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee9c08a100 con 0x7feeac0ae2c0 2024-04-25T08:59:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.359+0000 7feeab7fe640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fee9806b4d0 0x7fee9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.359+0000 7feeab7fe640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fee9806b4d0 0x7fee9806d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feea0034000 tx=0x7feea002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.363+0000 7feea8ff9640 1 -- 172.21.15.5:0/2735641226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feeac143580 con 0x7feeac0ae2c0 2024-04-25T08:59:24.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.615+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7feeac146900 con 0x7feeac0ae2c0 2024-04-25T08:59:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.617+0000 7feea8ff9640 1 -- 172.21.15.5:0/2735641226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7fee9c059010 con 0x7feeac0ae2c0 2024-04-25T08:59:24.606 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T08:59:24.607 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T08:59:24.607 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T08:59:24.607 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T08:59:24.607 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:59:24.607 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fee9806b4d0 msgr2=0x7fee9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fee9806b4d0 0x7fee9806d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feea0034000 tx=0x7feea002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac0ae2c0 msgr2=0x7feeac142aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac0ae2c0 0x7feeac142aa0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e9b0 tx=0x7fee9c00ee70 comp rx=0 tx=0).stop 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 shutdown_connections 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fee9806b4d0 0x7fee9806d990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feeac1476f0 0x7feeac06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac147310 0x7feeac06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 --2- 172.21.15.5:0/2735641226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeac0ae2c0 0x7feeac142aa0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 >> 172.21.15.5:0/2735641226 conn(0x7feeac0b2d70 msgr2=0x7feeac0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 shutdown_connections 2024-04-25T08:59:24.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.619+0000 7feeb27cf640 1 -- 172.21.15.5:0/2735641226 wait complete. 2024-04-25T08:59:24.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.731+0000 7ff4d21ce640 1 Processor -- start 2024-04-25T08:59:24.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.731+0000 7ff4d21ce640 1 -- start start 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4d21ce640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cc120 0x7ff4cc0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4d21ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff4cc0cfbb0 0x7ff4cc15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4d21ce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4cc15c620 0x7ff4cc15f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4d21ce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc0d0010 con 0x7ff4cc15c620 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4d21ce640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc06d280 con 0x7ff4cc0cfbb0 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4d21ce640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc06c4c0 con 0x7ff4cc0cc120 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4cc15c620 0x7ff4cc15f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4cc15c620 0x7ff4cc15f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44060/0 (socket says 172.21.15.5:44060) 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 -- 172.21.15.5:0/1985512005 learned_addr learned my addr 172.21.15.5:0/1985512005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4caffd640 1 --2- 172.21.15.5:0/1985512005 >> v2:172.21.15.80:3300/0 conn(0x7ff4cc0cfbb0 0x7ff4cc15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cb7fe640 1 --2- 172.21.15.5:0/1985512005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cc120 0x7ff4cc0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 -- 172.21.15.5:0/1985512005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cc120 msgr2=0x7ff4cc0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 --2- 172.21.15.5:0/1985512005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cc120 0x7ff4cc0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 -- 172.21.15.5:0/1985512005 >> v2:172.21.15.80:3300/0 conn(0x7ff4cc0cfbb0 msgr2=0x7ff4cc15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 --2- 172.21.15.5:0/1985512005 >> v2:172.21.15.80:3300/0 conn(0x7ff4cc0cfbb0 0x7ff4cc15c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.732+0000 7ff4cbfff640 1 -- 172.21.15.5:0/1985512005 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc06c7a0 con 0x7ff4cc15c620 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.733+0000 7ff4cbfff640 1 --2- 172.21.15.5:0/1985512005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc15f5f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc072650 tx=0x7ff4c402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ff241a553a68d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.733+0000 7ff4ca7fc640 1 -- 172.21.15.5:0/1985512005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4036070 con 0x7ff4cc15c620 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.733+0000 7ff4ca7fc640 1 -- 172.21.15.5:0/1985512005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c4031600 con 0x7ff4cc15c620 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.733+0000 7ff4ca7fc640 1 -- 172.21.15.5:0/1985512005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40319d0 con 0x7ff4cc15c620 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 -- 172.21.15.5:0/1985512005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 msgr2=0x7ff4cc15f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/1985512005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc15f5f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc072650 tx=0x7ff4c402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 -- 172.21.15.5:0/1985512005 shutdown_connections 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/1985512005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc15f5f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/1985512005 >> v2:172.21.15.80:3300/0 conn(0x7ff4cc0cfbb0 0x7ff4cc15c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/1985512005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cc120 0x7ff4cc0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 -- 172.21.15.5:0/1985512005 >> 172.21.15.5:0/1985512005 conn(0x7ff4cc0668f0 msgr2=0x7ff4cc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 -- 172.21.15.5:0/1985512005 shutdown_connections 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.734+0000 7ff4d21ce640 1 -- 172.21.15.5:0/1985512005 wait complete. 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.735+0000 7ff4d21ce640 1 Processor -- start 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.735+0000 7ff4d21ce640 1 -- start start 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4cc0cc120 0x7ff4cc157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cfbb0 0x7ff4cc143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc15ce50 con 0x7ff4cc15c620 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc06cd60 con 0x7ff4cc0cc120 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc0cc500 con 0x7ff4cc0cfbb0 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44064/0 (socket says 172.21.15.5:44064) 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 -- 172.21.15.5:0/4136164307 learned_addr learned my addr 172.21.15.5:0/4136164307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 -- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cfbb0 msgr2=0x7ff4cc143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cfbb0 0x7ff4cc143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 -- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4cc0cc120 msgr2=0x7ff4cc157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4cc0cc120 0x7ff4cc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 -- 172.21.15.5:0/4136164307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc157cb0 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4cbfff640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc158460 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009f40 tx=0x7ff4c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4b3fff640 1 -- 172.21.15.5:0/4136164307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4036050 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4b3fff640 1 -- 172.21.15.5:0/4136164307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c4042070 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4cc143760 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4b3fff640 1 -- 172.21.15.5:0/4136164307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4009510 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.736+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc1569b0 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.737+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc04ef20 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.738+0000 7ff4b3fff640 1 -- 172.21.15.5:0/4136164307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff4c4007bd0 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.738+0000 7ff4b3fff640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff4b806b500 0x7ff4b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.738+0000 7ff4b3fff640 1 -- 172.21.15.5:0/4136164307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4c40aaff0 con 0x7ff4cc15c620 2024-04-25T08:59:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.739+0000 7ff4cb7fe640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff4b806b500 0x7ff4b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.739+0000 7ff4cb7fe640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff4b806b500 0x7ff4b806d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00b7f0 tx=0x7ff4bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.743+0000 7ff4b3fff640 1 -- 172.21.15.5:0/4136164307 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff4c4079f00 con 0x7ff4cc15c620 2024-04-25T08:59:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.962+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4cc067050 con 0x7ff4cc15c620 2024-04-25T08:59:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.962+0000 7ff4b3fff640 1 -- 172.21.15.5:0/4136164307 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7ff4c4079800 con 0x7ff4cc15c620 2024-04-25T08:59:24.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:24.952 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.964+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff4b806b500 msgr2=0x7ff4b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.964+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff4b806b500 0x7ff4b806d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00b7f0 tx=0x7ff4bc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.964+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 msgr2=0x7ff4cc158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.964+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc158460 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009f40 tx=0x7ff4c4004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.964+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 shutdown_connections 2024-04-25T08:59:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.965+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff4b806b500 0x7ff4b806d9c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.965+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4cc15c620 0x7ff4cc158460 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.965+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff4cc0cfbb0 0x7ff4cc143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.965+0000 7ff4d21ce640 1 --2- 172.21.15.5:0/4136164307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4cc0cc120 0x7ff4cc157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.965+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 >> 172.21.15.5:0/4136164307 conn(0x7ff4cc0668f0 msgr2=0x7ff4cc15fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.965+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 shutdown_connections 2024-04-25T08:59:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:24.965+0000 7ff4d21ce640 1 -- 172.21.15.5:0/4136164307 wait complete. 2024-04-25T08:59:25.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:15.812891+0000', 'modified': '2024-04-25T08:59:17.799735+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5616}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5616': {'gid': 5616, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/2992823124', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 2992823124}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 2992823124}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:59:25.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:59:25.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T08:59:25.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.485+0000 7f70a899e640 1 Processor -- start 2024-04-25T08:59:25.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.485+0000 7f70a899e640 1 -- start start 2024-04-25T08:59:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a899e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70a415de70 0x7f70a40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a899e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70a40ce7f0 0x7f70a40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a899e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a40cf1c0 con 0x7f70a40b2cc0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a899e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a40d2a10 con 0x7f70a40ce7f0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a899e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a40d20e0 con 0x7f70a415de70 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70a40ce7f0 0x7f70a40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f709bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70a40b2cc0 0x7f70a40b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54020/0 (socket says 172.21.15.5:54020) 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f709bfff640 1 -- 172.21.15.5:0/818123097 learned_addr learned my addr 172.21.15.5:0/818123097 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a259c640 1 --2- 172.21.15.5:0/818123097 >> v2:172.21.15.80:3300/0 conn(0x7f70a415de70 0x7f70a40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a2d9d640 1 -- 172.21.15.5:0/818123097 >> v2:172.21.15.80:3300/0 conn(0x7f70a415de70 msgr2=0x7f70a40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/818123097 >> v2:172.21.15.80:3300/0 conn(0x7f70a415de70 0x7f70a40b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a2d9d640 1 -- 172.21.15.5:0/818123097 >> v1:172.21.15.5:6789/0 conn(0x7f70a40b2cc0 legacy=0x7f70a40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a1d9b640 1 -- 172.21.15.5:0/818123097 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740684388 0 0) 0x7f70a40cf1c0 con 0x7f70a40b2cc0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.486+0000 7f70a2d9d640 1 -- 172.21.15.5:0/818123097 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40d23c0 con 0x7f70a40ce7f0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.487+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/818123097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40ce7f0 0x7f70a40cec80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f70a40d1650 tx=0x7f709c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92f5fc9c5b8d989 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.487+0000 7f70a1d9b640 1 -- 172.21.15.5:0/818123097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c007740 con 0x7f70a40ce7f0 2024-04-25T08:59:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.487+0000 7f70a1d9b640 1 -- 172.21.15.5:0/818123097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c0078e0 con 0x7f70a40ce7f0 2024-04-25T08:59:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.487+0000 7f70a1d9b640 1 -- 172.21.15.5:0/818123097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c007cb0 con 0x7f70a40ce7f0 2024-04-25T08:59:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 -- 172.21.15.5:0/818123097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40ce7f0 msgr2=0x7f70a40cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 --2- 172.21.15.5:0/818123097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40ce7f0 0x7f70a40cec80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f70a40d1650 tx=0x7f709c02a680 comp rx=0 tx=0).stop 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 -- 172.21.15.5:0/818123097 shutdown_connections 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 --2- 172.21.15.5:0/818123097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40ce7f0 0x7f70a40cec80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 --2- 172.21.15.5:0/818123097 >> v2:172.21.15.80:3300/0 conn(0x7f70a415de70 0x7f70a40b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 -- 172.21.15.5:0/818123097 >> 172.21.15.5:0/818123097 conn(0x7f70a406b000 msgr2=0x7f70a406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 -- 172.21.15.5:0/818123097 shutdown_connections 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.488+0000 7f70a899e640 1 -- 172.21.15.5:0/818123097 wait complete. 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.489+0000 7f70a899e640 1 Processor -- start 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.489+0000 7f70a899e640 1 -- start start 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a899e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2cc0 0x7f70a40cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a899e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a40ce7f0 0x7f70a40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a899e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70a415de70 0x7f70a40c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a899e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40b7300 con 0x7f70a40b2cc0 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a899e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40b9920 con 0x7f70a40ce7f0 2024-04-25T08:59:25.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a899e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40d2ea0 con 0x7f70a415de70 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2cc0 0x7f70a40cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2cc0 0x7f70a40cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44082/0 (socket says 172.21.15.5:44082) 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 -- 172.21.15.5:0/3753436780 learned_addr learned my addr 172.21.15.5:0/3753436780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f709bfff640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a40ce7f0 0x7f70a40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70a415de70 0x7f70a40c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 -- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70a415de70 msgr2=0x7f70a40c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70a415de70 0x7f70a40c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 -- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a40ce7f0 msgr2=0x7f70a40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a40ce7f0 0x7f70a40b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 -- 172.21.15.5:0/3753436780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40b4010 con 0x7f70a40b2cc0 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70a415de70 0x7f70a40c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f70a259c640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2cc0 0x7f70a40cb140 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f709400d5f0 tx=0x7f709400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.490+0000 7f709affd640 1 -- 172.21.15.5:0/3753436780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940125f0 con 0x7f70a40b2cc0 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.491+0000 7f709affd640 1 -- 172.21.15.5:0/3753436780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094019070 con 0x7f70a40b2cc0 2024-04-25T08:59:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.491+0000 7f709affd640 1 -- 172.21.15.5:0/3753436780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940129d0 con 0x7f70a40b2cc0 2024-04-25T08:59:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.491+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a40c8720 con 0x7f70a40b2cc0 2024-04-25T08:59:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.491+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a40c8ce0 con 0x7f70a40b2cc0 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.492+0000 7f709affd640 1 -- 172.21.15.5:0/3753436780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7094012b70 con 0x7f70a40b2cc0 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.492+0000 7f709affd640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f708406b4d0 0x7f708406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.493+0000 7f709affd640 1 -- 172.21.15.5:0/3753436780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f709408a490 con 0x7f70a40b2cc0 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.493+0000 7f709bfff640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f708406b4d0 0x7f708406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.493+0000 7f709bfff640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f708406b4d0 0x7f708406d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f70a40b8e30 tx=0x7f708c007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.493+0000 7f70ab77f740 1 Processor -- start 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.494+0000 7f70ab77f740 1 -- start start 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.494+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff74c230 0x5607ff74c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.494+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff769ad0 0x5607ff76a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.494+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff721f10 0x5607ff768190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.494+0000 7f70ab77f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607ff684a10 con 0x5607ff74c230 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.494+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607ff62db30 con 0x5607ff721f10 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.494+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607ff680c50 con 0x5607ff769ad0 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff74c230 0x5607ff74c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff721f10 0x5607ff768190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff74c230 0x5607ff74c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44092/0 (socket says 172.21.15.5:44092) 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 -- 172.21.15.5:0/3117131840 learned_addr learned my addr 172.21.15.5:0/3117131840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f709bfff640 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff769ad0 0x5607ff76a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 -- 172.21.15.5:0/3117131840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff769ad0 msgr2=0x5607ff76a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff769ad0 0x5607ff76a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 -- 172.21.15.5:0/3117131840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff721f10 msgr2=0x5607ff768190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff721f10 0x5607ff768190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 -- 172.21.15.5:0/3117131840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607ff642e10 con 0x5607ff74c230 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f70a259c640 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff74c230 0x5607ff74c610 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7094088a70 tx=0x7f7094059460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52848a8fad74975 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f7083fff640 1 -- 172.21.15.5:0/3117131840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709405f0d0 con 0x5607ff74c230 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f7083fff640 1 -- 172.21.15.5:0/3117131840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70940613b0 con 0x5607ff74c230 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.495+0000 7f7083fff640 1 -- 172.21.15.5:0/3117131840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094055310 con 0x5607ff74c230 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 -- 172.21.15.5:0/3117131840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff74c230 msgr2=0x5607ff74c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff74c230 0x5607ff74c610 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7094088a70 tx=0x7f7094059460 comp rx=0 tx=0).stop 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 -- 172.21.15.5:0/3117131840 shutdown_connections 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff721f10 0x5607ff768190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff769ad0 0x5607ff76a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 --2- 172.21.15.5:0/3117131840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff74c230 0x5607ff74c610 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 -- 172.21.15.5:0/3117131840 >> 172.21.15.5:0/3117131840 conn(0x5607ff71e840 msgr2=0x5607ff767040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 -- 172.21.15.5:0/3117131840 shutdown_connections 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 -- 172.21.15.5:0/3117131840 wait complete. 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.496+0000 7f70ab77f740 1 -- start start 2024-04-25T08:59:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 1 Processor -- start 2024-04-25T08:59:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff77a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff760360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff7608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607ff722cb0 con 0x5607ff769ad0 2024-04-25T08:59:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607ff6410c0 con 0x5607ff74c230 2024-04-25T08:59:25.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607ff71c770 con 0x5607ff75ef90 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.497+0000 7f70ab77f740 10 client.0 _ll_register_callbacks cb 0x5607ff634ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff760360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff760360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44094/0 (socket says 172.21.15.5:44094) 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 -- 172.21.15.5:0/1121063952 learned_addr learned my addr 172.21.15.5:0/1121063952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff7608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70a259c640 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff77a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 -- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 msgr2=0x5607ff7608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff7608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 -- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 msgr2=0x5607ff77a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff77a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 -- 172.21.15.5:0/1121063952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607ff3992d0 con 0x5607ff769ad0 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f709bfff640 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff760360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f70a415c4b0 tx=0x7f708c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2427f7d8e8d9c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70817fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70817fa640 1 -- 172.21.15.5:0/1121063952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c020640 con 0x5607ff769ad0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70817fa640 1 -- 172.21.15.5:0/1121063952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f708c0207e0 con 0x5607ff769ad0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70940613b0 con 0x5607ff769ad0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70817fa640 1 -- 172.21.15.5:0/1121063952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f708c02e050 con 0x5607ff769ad0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70ab77f740 10 client.5781 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.498+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x5607ff4636b0 con 0x5607ff769ad0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70817fa640 1 -- 172.21.15.5:0/1121063952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70940613b0 con 0x5607ff769ad0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70817fa640 1 -- 172.21.15.5:0/1121063952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f708c031020 con 0x5607ff769ad0 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70ab77f740 10 client.5781 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70ab77f740 10 client.5781 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70ab77f740 20 client.5781 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70ab77f740 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff77ae80 0x5607ff77b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70ab77f740 4 client.5781 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607ff6e3920 con 0x5607ff77ae80 2024-04-25T08:59:25.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70a259c640 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff77ae80 0x5607ff77b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70817fa640 10 client.5781 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.499+0000 7f70a259c640 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff77ae80 0x5607ff77b260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b02de73a6c359b server_cookie=65662bbb97eb46f4 in_seq=0 out_seq=0 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70817fa640 1 -- 172.21.15.5:0/1121063952 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5607ff6e3920 con 0x5607ff77ae80 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70817fa640 10 client.5781 handle_command_reply: tid=0 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 client.5781 shutdown 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 msgr2=0x5607ff760360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff760360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f70a415c4b0 tx=0x7f708c000ed0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 shutdown_connections 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff77ae80 0x5607ff77b260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff7608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff760360 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 --2- 172.21.15.5:0/1121063952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff77a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70817fa640 0 client.5781 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 >> 172.21.15.5:0/1121063952 conn(0x5607ff721f10 msgr2=0x5607ff76a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 shutdown_connections 2024-04-25T08:59:25.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 1 -- 172.21.15.5:0/1121063952 wait complete. 2024-04-25T08:59:25.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.500+0000 7f70ab77f740 20 client.5781 trim_cache size 0 max 16384 2024-04-25T08:59:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.516+0000 7f70ab77f740 1 Processor -- start 2024-04-25T08:59:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.516+0000 7f70ab77f740 1 -- start start 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.516+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff75cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff74a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff7224e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70ab77f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a41ffdd0 con 0x5607ff769ad0 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40cd830 con 0x5607ff74c230 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40ccc30 con 0x5607ff75ef90 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff7224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff7224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44104/0 (socket says 172.21.15.5:44104) 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 -- 172.21.15.5:0/302766463 learned_addr learned my addr 172.21.15.5:0/302766463 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a259c640 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff75cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 -- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 msgr2=0x5607ff74a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f709bfff640 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff74a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff74a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 -- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 msgr2=0x5607ff75cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff75cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 -- 172.21.15.5:0/302766463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607ff718550 con 0x5607ff769ad0 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a259c640 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff75cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f709bfff640 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff74a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff7224e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f709c007810 tx=0x7f709c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2741f9301c7e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70837fe640 1 -- 172.21.15.5:0/302766463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c007c30 con 0x5607ff769ad0 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70837fe640 1 -- 172.21.15.5:0/302766463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c04d070 con 0x5607ff769ad0 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.517+0000 7f70837fe640 1 -- 172.21.15.5:0/302766463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c048460 con 0x5607ff769ad0 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 -- 172.21.15.5:0/302766463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 msgr2=0x5607ff7224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff7224e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f709c007810 tx=0x7f709c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 -- 172.21.15.5:0/302766463 shutdown_connections 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff7224e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff75ef90 0x5607ff74a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 --2- 172.21.15.5:0/302766463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff74c230 0x5607ff75cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 -- 172.21.15.5:0/302766463 >> 172.21.15.5:0/302766463 conn(0x5607ff721f10 msgr2=0x5607ff761030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 -- 172.21.15.5:0/302766463 shutdown_connections 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 -- 172.21.15.5:0/302766463 wait complete. 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.518+0000 7f70ab77f740 1 -- start start 2024-04-25T08:59:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 1 Processor -- start 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff74c230 0x5607ff75fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff75ef90 0x5607ff720f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff74aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607ff74d650 con 0x5607ff769ad0 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40cd230 con 0x5607ff75ef90 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607ff777760 con 0x5607ff74c230 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.519+0000 7f70ab77f740 10 client.0 _ll_register_callbacks cb 0x5607ff71cc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff74aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff74aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44108/0 (socket says 172.21.15.5:44108) 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 -- 172.21.15.5:0/673783660 learned_addr learned my addr 172.21.15.5:0/673783660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f709bfff640 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff75ef90 0x5607ff720f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a259c640 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff74c230 0x5607ff75fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 -- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff74c230 msgr2=0x5607ff75fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff74c230 0x5607ff75fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 -- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff75ef90 msgr2=0x5607ff720f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff75ef90 0x5607ff720f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 -- 172.21.15.5:0/673783660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607ff781110 con 0x5607ff769ad0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70a2d9d640 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff74aba0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f709c007840 tx=0x7f709c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ad9e10281495b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70817fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70817fa640 1 -- 172.21.15.5:0/673783660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c048870 con 0x5607ff769ad0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70817fa640 1 -- 172.21.15.5:0/673783660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f709c048a10 con 0x5607ff769ad0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f709c04d070 con 0x5607ff769ad0 2024-04-25T08:59:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70817fa640 1 -- 172.21.15.5:0/673783660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f709c061050 con 0x5607ff769ad0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70ab77f740 10 client.5787 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.520+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x5607ff74b870 con 0x5607ff769ad0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70817fa640 1 -- 172.21.15.5:0/673783660 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c04d070 con 0x5607ff769ad0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70817fa640 1 -- 172.21.15.5:0/673783660 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f709c064020 con 0x5607ff769ad0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70ab77f740 10 client.5787 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70ab77f740 10 client.5787 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70ab77f740 20 client.5787 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70ab77f740 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff74b0e0 0x5607ff767f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70ab77f740 4 client.5787 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5607ff691f50 con 0x5607ff74b0e0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70a259c640 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff74b0e0 0x5607ff767f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70817fa640 10 client.5787 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70a259c640 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff74b0e0 0x5607ff767f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfca45fe124c9b0d server_cookie=6a6eddd97f9422ca in_seq=0 out_seq=0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70817fa640 1 -- 172.21.15.5:0/673783660 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5607ff691f50 con 0x5607ff74b0e0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70817fa640 10 client.5787 handle_command_reply: tid=0 2024-04-25T08:59:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.521+0000 7f70ab77f740 1 client.5787 shutdown 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 msgr2=0x5607ff74aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff74aba0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f709c007840 tx=0x7f709c004ab0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 shutdown_connections 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5607ff74b0e0 0x5607ff767f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5607ff769ad0 0x5607ff74aba0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607ff75ef90 0x5607ff720f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70817fa640 0 client.5787 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 --2- 172.21.15.5:0/673783660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5607ff74c230 0x5607ff75fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 >> 172.21.15.5:0/673783660 conn(0x5607ff721f10 msgr2=0x5607ff789ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 shutdown_connections 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 1 -- 172.21.15.5:0/673783660 wait complete. 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70ab77f740 20 client.5787 trim_cache size 0 max 16384 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5616, 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 9.0670957629999993, 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 21, 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 44, 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 44, 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 14.103946895 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f708406b4d0 msgr2=0x7f708406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f708406b4d0 0x7f708406d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f70a40b8e30 tx=0x7f708c007d50 comp rx=0 tx=0).stop 2024-04-25T08:59:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2cc0 msgr2=0x7f70a40cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2cc0 0x7f70a40cb140 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f709400d5f0 tx=0x7f709400dab0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 shutdown_connections 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f708406b4d0 0x7f708406d990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70a415de70 0x7f70a40c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a40ce7f0 0x7f70a40b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 --2- 172.21.15.5:0/3753436780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2cc0 0x7f70a40cb140 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 >> 172.21.15.5:0/3753436780 conn(0x7f70a406b000 msgr2=0x7f70a415ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.522+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 shutdown_connections 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.523+0000 7f70a899e640 1 -- 172.21.15.5:0/3753436780 wait complete. 2024-04-25T08:59:25.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:59:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.636+0000 7fa4859ed640 1 Processor -- start 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.636+0000 7fa4859ed640 1 -- start start 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa4859ed640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4800b2cc0 0x7fa4800b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa4859ed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4800b7130 0x7fa4800ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa4859ed640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4800d20e0 con 0x7fa48015de70 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa4859ed640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4800d2a10 con 0x7fa4800b7130 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa4859ed640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4800d23c0 con 0x7fa4800b2cc0 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4800b7130 0x7fa4800ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa48015de70 0x7fa4800b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54024/0 (socket says 172.21.15.5:54024) 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47effd640 1 -- 172.21.15.5:0/3358711221 learned_addr learned my addr 172.21.15.5:0/3358711221 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa477fff640 1 --2- 172.21.15.5:0/3358711221 >> v2:172.21.15.80:3300/0 conn(0x7fa4800b2cc0 0x7fa4800b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47f7fe640 1 -- 172.21.15.5:0/3358711221 >> v2:172.21.15.80:3300/0 conn(0x7fa4800b2cc0 msgr2=0x7fa4800b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47f7fe640 1 --2- 172.21.15.5:0/3358711221 >> v2:172.21.15.80:3300/0 conn(0x7fa4800b2cc0 0x7fa4800b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47f7fe640 1 -- 172.21.15.5:0/3358711221 >> v1:172.21.15.5:6789/0 conn(0x7fa48015de70 legacy=0x7fa4800b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47f7fe640 1 -- 172.21.15.5:0/3358711221 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800d26a0 con 0x7fa4800b7130 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.637+0000 7fa47e7fc640 1 -- 172.21.15.5:0/3358711221 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814119108 0 0) 0x7fa4800d20e0 con 0x7fa48015de70 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.638+0000 7fa47f7fe640 1 --2- 172.21.15.5:0/3358711221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b7130 0x7fa4800ce7f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa478009d90 tx=0x7fa47802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316fb675f4a9d61e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.638+0000 7fa47e7fc640 1 -- 172.21.15.5:0/3358711221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478007740 con 0x7fa4800b7130 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.638+0000 7fa47e7fc640 1 -- 172.21.15.5:0/3358711221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4780078e0 con 0x7fa4800b7130 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.638+0000 7fa47e7fc640 1 -- 172.21.15.5:0/3358711221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478007cb0 con 0x7fa4800b7130 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 -- 172.21.15.5:0/3358711221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b7130 msgr2=0x7fa4800ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3358711221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b7130 0x7fa4800ce7f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa478009d90 tx=0x7fa47802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 -- 172.21.15.5:0/3358711221 shutdown_connections 2024-04-25T08:59:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3358711221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b7130 0x7fa4800ce7f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3358711221 >> v2:172.21.15.80:3300/0 conn(0x7fa4800b2cc0 0x7fa4800b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 -- 172.21.15.5:0/3358711221 >> 172.21.15.5:0/3358711221 conn(0x7fa48006b000 msgr2=0x7fa48006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 -- 172.21.15.5:0/3358711221 shutdown_connections 2024-04-25T08:59:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.639+0000 7fa4859ed640 1 -- 172.21.15.5:0/3358711221 wait complete. 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.640+0000 7fa4859ed640 1 Processor -- start 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.640+0000 7fa4859ed640 1 -- start start 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b2cc0 0x7fa4800c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4800b7130 0x7fa4800cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa48015de70 0x7fa4800b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800cf0c0 con 0x7fa4800b2cc0 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800cef40 con 0x7fa4800b7130 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800cc500 con 0x7fa48015de70 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b2cc0 0x7fa4800c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b2cc0 0x7fa4800c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44116/0 (socket says 172.21.15.5:44116) 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 -- 172.21.15.5:0/3801360715 learned_addr learned my addr 172.21.15.5:0/3801360715 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa477fff640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4800b7130 0x7fa4800cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 -- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa48015de70 msgr2=0x7fa4800b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa48015de70 0x7fa4800b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 -- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4800b7130 msgr2=0x7fa4800cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4800b7130 0x7fa4800cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 -- 172.21.15.5:0/3801360715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800cc220 con 0x7fa4800b2cc0 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa477fff640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4800b7130 0x7fa4800cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47effd640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b2cc0 0x7fa4800c9ef0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c430 tx=0x7fa47000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47cff9640 1 -- 172.21.15.5:0/3801360715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700074e0 con 0x7fa4800b2cc0 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47cff9640 1 -- 172.21.15.5:0/3801360715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700047e0 con 0x7fa4800b2cc0 2024-04-25T08:59:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4801f7480 con 0x7fa4800b2cc0 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa47cff9640 1 -- 172.21.15.5:0/3801360715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470004bd0 con 0x7fa4800b2cc0 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.641+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4801f7a40 con 0x7fa4800b2cc0 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.642+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4801f7c40 con 0x7fa4800b2cc0 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.643+0000 7fa47cff9640 1 -- 172.21.15.5:0/3801360715 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa470011070 con 0x7fa4800b2cc0 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.643+0000 7fa47cff9640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa46006b4d0 0x7fa46006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.644+0000 7fa47cff9640 1 -- 172.21.15.5:0/3801360715 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa470089f20 con 0x7fa4800b2cc0 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.644+0000 7fa477fff640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa46006b4d0 0x7fa46006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.644+0000 7fa477fff640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa46006b4d0 0x7fa46006d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa4800c8860 tx=0x7fa468008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.648+0000 7fa47cff9640 1 -- 172.21.15.5:0/3801360715 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa470058d40 con 0x7fa4800b2cc0 2024-04-25T08:59:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.865+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa48004ef20 con 0x7fa4800b2cc0 2024-04-25T08:59:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.865+0000 7fa47cff9640 1 -- 172.21.15.5:0/3801360715 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa470058640 con 0x7fa4800b2cc0 2024-04-25T08:59:25.855 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:59:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa46006b4d0 msgr2=0x7fa46006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa46006b4d0 0x7fa46006d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa4800c8860 tx=0x7fa468008040 comp rx=0 tx=0).stop 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b2cc0 msgr2=0x7fa4800c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b2cc0 0x7fa4800c9ef0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c430 tx=0x7fa47000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 shutdown_connections 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa46006b4d0 0x7fa46006d990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa48015de70 0x7fa4800b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4800b7130 0x7fa4800cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 --2- 172.21.15.5:0/3801360715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800b2cc0 0x7fa4800c9ef0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 >> 172.21.15.5:0/3801360715 conn(0x7fa48006b000 msgr2=0x7fa4800d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 shutdown_connections 2024-04-25T08:59:25.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:25.867+0000 7fa4859ed640 1 -- 172.21.15.5:0/3801360715 wait complete. 2024-04-25T08:59:25.867 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:59:25.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:59:25.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T08:59:25.868 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:59:25.868 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:25.868 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:59:25.868 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:59:25.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:59:25.868 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:25.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:25.868 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T08:59:25.884 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:59:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:59:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:59:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T08:59:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42594sec preferred_lft 42594sec 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:59:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T08:59:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:25.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:25.887 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:59:25.947 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T08:59:25.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:25.949 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T08:59:26.006 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T08:59:26.006 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:59:26.006 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:59:26.006 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:59:26.006 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:59:26.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.006 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T08:59:26.006 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T08:59:26.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:59:26.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:59:26.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:59:26.007 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T08:59:26.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.092 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T08:59:26.107 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:59:26.107 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:59:26.107 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:26.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T08:59:26.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:26.172 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:26.228 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:26.229 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:26.229 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:26.284 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T08:59:26.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:59:26.366 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:59:26.367 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:59:26.378 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T08:59:26.378 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T08:59:26.378 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T08:59:26.378 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T08:59:26.378 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T08:59:26.379 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:59:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:59:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:59:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:59:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:59:26.381 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:59:26.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:26.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.446 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:59:26.507 INFO:teuthology.orchestra.run.smithi005.stdout:client5123 2024-04-25T08:59:26.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:26.507 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:26.563 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:26.564 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-04-25T08:59:26.564 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-04-25T08:59:26.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> import json 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> import sys 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> except OSError as e: 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> sys.exit(e.errno) 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> print(json.dumps( 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T08:59:26.624 DEBUG:teuthology.orchestra.run.smithi005:> indent=2)) 2024-04-25T08:59:26.625 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-25T08:59:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:26 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T08:59:26.741 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T08:59:26.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:26.741 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-04-25T08:59:26.799 INFO:teuthology.orchestra.run.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-04-25T08:59:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-04-25T08:59:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:Updating files: 54% (760/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-04-25T08:59:29.534 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-04-25T08:59:29.534 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-04-25T08:59:29.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.686+0000 7fcd0f970640 1 Processor -- start 2024-04-25T08:59:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.686+0000 7fcd0f970640 1 -- start start 2024-04-25T08:59:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.686+0000 7fcd0f970640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd0806b7d0 0x7fcd0806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.686+0000 7fcd0f970640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd0806bbb0 0x7fcd080d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.686+0000 7fcd0f970640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd080b4730 con 0x7fcd0815da10 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.686+0000 7fcd0f970640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080d0b70 con 0x7fcd0806b7d0 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.686+0000 7fcd0f970640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080cbf30 con 0x7fcd0806bbb0 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0d70c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd0806b7d0 0x7fcd0806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0d70c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd0806b7d0 0x7fcd0806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44124/0 (socket says 172.21.15.5:44124) 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0d70c640 1 -- 172.21.15.5:0/1949208617 learned_addr learned my addr 172.21.15.5:0/1949208617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0cf0b640 1 --2- 172.21.15.5:0/1949208617 >> v2:172.21.15.80:3300/0 conn(0x7fcd0806bbb0 0x7fcd080d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0d70c640 1 -- 172.21.15.5:0/1949208617 >> v2:172.21.15.80:3300/0 conn(0x7fcd0806bbb0 msgr2=0x7fcd080d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0d70c640 1 --2- 172.21.15.5:0/1949208617 >> v2:172.21.15.80:3300/0 conn(0x7fcd0806bbb0 0x7fcd080d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0d70c640 1 -- 172.21.15.5:0/1949208617 >> v1:172.21.15.80:6789/0 conn(0x7fcd0815da10 legacy=0x7fcd0815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.687+0000 7fcd0d70c640 1 -- 172.21.15.5:0/1949208617 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080d0da0 con 0x7fcd0806b7d0 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0d70c640 1 --2- 172.21.15.5:0/1949208617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd0806aef0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcd08072970 tx=0x7fcd0402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3433595e5d93e9a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fccfffff640 1 -- 172.21.15.5:0/1949208617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04037070 con 0x7fcd0806b7d0 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fccfffff640 1 -- 172.21.15.5:0/1949208617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0402ae50 con 0x7fcd0806b7d0 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fccfffff640 1 -- 172.21.15.5:0/1949208617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04032860 con 0x7fcd0806b7d0 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 -- 172.21.15.5:0/1949208617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 msgr2=0x7fcd0806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 --2- 172.21.15.5:0/1949208617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd0806aef0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcd08072970 tx=0x7fcd0402a300 comp rx=0 tx=0).stop 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 -- 172.21.15.5:0/1949208617 shutdown_connections 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 --2- 172.21.15.5:0/1949208617 >> v2:172.21.15.80:3300/0 conn(0x7fcd0806bbb0 0x7fcd080d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 --2- 172.21.15.5:0/1949208617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd0806aef0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 -- 172.21.15.5:0/1949208617 >> 172.21.15.5:0/1949208617 conn(0x7fcd080d18e0 msgr2=0x7fcd080d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 -- 172.21.15.5:0/1949208617 shutdown_connections 2024-04-25T08:59:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.688+0000 7fcd0f970640 1 -- 172.21.15.5:0/1949208617 wait complete. 2024-04-25T08:59:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 Processor -- start 2024-04-25T08:59:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 -- start start 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd08156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcd0806bbb0 0x7fcd080c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0815da10 0x7fcd0815f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080cc460 con 0x7fcd0806b7d0 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080cc7d0 con 0x7fcd0815da10 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0f970640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080ccc60 con 0x7fcd0806bbb0 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0d70c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd08156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0d70c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd08156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44136/0 (socket says 172.21.15.5:44136) 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.690+0000 7fcd0d70c640 1 -- 172.21.15.5:0/538483529 learned_addr learned my addr 172.21.15.5:0/538483529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0df0d640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0815da10 0x7fcd0815f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0cf0b640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcd0806bbb0 0x7fcd080c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0d70c640 1 -- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcd0806bbb0 msgr2=0x7fcd080c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0d70c640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcd0806bbb0 0x7fcd080c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0d70c640 1 -- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0815da10 msgr2=0x7fcd0815f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0d70c640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0815da10 0x7fcd0815f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0d70c640 1 -- 172.21.15.5:0/538483529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08153a40 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0df0d640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0815da10 0x7fcd0815f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0d70c640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd08156100 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcd0402a340 tx=0x7fcd040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fccfdffb640 1 -- 172.21.15.5:0/538483529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04041020 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fccfdffb640 1 -- 172.21.15.5:0/538483529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0403c670 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fccfdffb640 1 -- 172.21.15.5:0/538483529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04037040 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd08153cb0 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.691+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd08154270 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.692+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd08154470 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.693+0000 7fccfdffb640 1 -- 172.21.15.5:0/538483529 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd04044020 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.693+0000 7fccfdffb640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fccec06b4d0 0x7fccec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.693+0000 7fccfdffb640 1 -- 172.21.15.5:0/538483529 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcd040aa930 con 0x7fcd0806b7d0 2024-04-25T08:59:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.694+0000 7fcd0cf0b640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fccec06b4d0 0x7fccec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.694+0000 7fcd0cf0b640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fccec06b4d0 0x7fccec06d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcd0815cb00 tx=0x7fccf8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.698+0000 7fccfdffb640 1 -- 172.21.15.5:0/538483529 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd08154470 con 0x7fcd0806b7d0 2024-04-25T08:59:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.912+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd0804ef20 con 0x7fcd0806b7d0 2024-04-25T08:59:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.912+0000 7fccfdffb640 1 -- 172.21.15.5:0/538483529 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fcd0404b030 con 0x7fcd0806b7d0 2024-04-25T08:59:29.902 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:29.902 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fccec06b4d0 msgr2=0x7fccec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fccec06b4d0 0x7fccec06d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcd0815cb00 tx=0x7fccf8008040 comp rx=0 tx=0).stop 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 msgr2=0x7fcd08156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd08156100 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcd0402a340 tx=0x7fcd040046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 shutdown_connections 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fccec06b4d0 0x7fccec06d990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd0815da10 0x7fcd0815f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcd0806bbb0 0x7fcd080c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 --2- 172.21.15.5:0/538483529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0806b7d0 0x7fcd08156100 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 >> 172.21.15.5:0/538483529 conn(0x7fcd080d18e0 msgr2=0x7fcd0806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 shutdown_connections 2024-04-25T08:59:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:29.915+0000 7fcd0f970640 1 -- 172.21.15.5:0/538483529 wait complete. 2024-04-25T08:59:29.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/i/dont/exist 2024-04-25T08:59:30.022 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:30.022 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-04-25T08:59:30.022 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:30.031 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-04-25T08:59:30.031 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-04-25T08:59:30.031 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:30.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-04-25T08:59:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.146+0000 7f9ece2fc640 1 Processor -- start 2024-04-25T08:59:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.147+0000 7f9ece2fc640 1 -- start start 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.147+0000 7f9ece2fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec8160540 0x7f9ec80d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.147+0000 7f9ece2fc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80cc530 con 0x7f9ec80ccfd0 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.147+0000 7f9ece2fc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80d0930 con 0x7f9ec815f1b0 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.147+0000 7f9ece2fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80d0370 con 0x7f9ec8160540 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.147+0000 7f9ecc899640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9ec80ccfd0 0x7f9ec815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54036/0 (socket says 172.21.15.5:54036) 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ecc899640 1 -- 172.21.15.5:0/2311060993 learned_addr learned my addr 172.21.15.5:0/2311060993 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec8160540 0x7f9ec80d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106768797 0 0) 0x7f9ec80cc530 con 0x7f9ec80ccfd0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb4003520 con 0x7f9ec80ccfd0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665842145 0 0) 0x7f9ec80d0930 con 0x7f9ec815f1b0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec80cc530 con 0x7f9ec815f1b0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250285197 0 0) 0x7f9eb4003520 con 0x7f9ec80ccfd0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec8160540 msgr2=0x7f9ec80d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec8160540 0x7f9ec80d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 >> v1:172.21.15.80:6789/0 conn(0x7f9ec815f1b0 legacy=0x7f9ec80b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80d0650 con 0x7f9ec80ccfd0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f9ec00019f0 con 0x7f9ec80ccfd0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 >> v1:172.21.15.5:6789/0 conn(0x7f9ec80ccfd0 legacy=0x7f9ec815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9eb4003b70 0x7f9eb4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9eb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eb40051c0 0x7f9eb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80d0370 con 0x7f9eb4004800 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb400bf30 con 0x7f9eb40051c0 2024-04-25T08:59:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb400c130 con 0x7f9eb4003b70 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec8160540 0x7f9ec80d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ecc899640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eb40051c0 0x7f9eb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9eb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.148+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9eb4003b70 0x7f9eb4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.149+0000 7f9ec77fe640 1 -- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9eb4003b70 msgr2=0x7f9eb4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.149+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9eb4003b70 0x7f9eb4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.149+0000 7f9ec77fe640 1 -- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eb40051c0 msgr2=0x7f9eb400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.149+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eb40051c0 0x7f9eb400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.149+0000 7f9ec77fe640 1 -- 172.21.15.5:0/2311060993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4003520 con 0x7f9eb4004800 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.149+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9eb4004c80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80c5130 tx=0x7f9eb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f7f137c81ec907 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.149+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8036070 con 0x7f9eb4004800 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8004030 con 0x7f9eb4004800 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ec6ffd640 1 -- 172.21.15.5:0/2311060993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80097d0 con 0x7f9eb4004800 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ece2fc640 1 -- 172.21.15.5:0/2311060993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 msgr2=0x7f9eb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ece2fc640 1 --2- 172.21.15.5:0/2311060993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9eb4004c80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80c5130 tx=0x7f9eb4005830 comp rx=0 tx=0).stop 2024-04-25T08:59:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ecc899640 1 -- 172.21.15.5:0/2311060993 reap_dead start 2024-04-25T08:59:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ece2fc640 1 -- 172.21.15.5:0/2311060993 shutdown_connections 2024-04-25T08:59:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ece2fc640 1 -- 172.21.15.5:0/2311060993 >> 172.21.15.5:0/2311060993 conn(0x7f9ec80d1a20 msgr2=0x7f9ec80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ece2fc640 1 -- 172.21.15.5:0/2311060993 shutdown_connections 2024-04-25T08:59:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.150+0000 7f9ece2fc640 1 -- 172.21.15.5:0/2311060993 wait complete. 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.151+0000 7f9ece2fc640 1 Processor -- start 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ece2fc640 1 -- start start 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ece2fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9ec81f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ece2fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec80c5550 0x7f9ec809c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ece2fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec809ccb0 0x7f9ec81f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ece2fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80b4f80 con 0x7f9eb4004800 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9ec81f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9ec81f2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44158/0 (socket says 172.21.15.5:44158) 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.152+0000 7f9ec7fff640 1 -- 172.21.15.5:0/1919976223 learned_addr learned my addr 172.21.15.5:0/1919976223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec80c5550 0x7f9ec809c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ecc899640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec809ccb0 0x7f9ec81f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80ccab0 con 0x7f9ec80c5550 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80d0000 con 0x7f9ec809ccb0 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec7fff640 1 -- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec809ccb0 msgr2=0x7f9ec81f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec809ccb0 0x7f9ec81f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec7fff640 1 -- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec80c5550 msgr2=0x7f9ec809c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec80c5550 0x7f9ec809c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec7fff640 1 -- 172.21.15.5:0/1919976223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec81f2c60 con 0x7f9eb4004800 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9ec81f2720 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000f820 tx=0x7f9eb000fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec4ff9640 1 -- 172.21.15.5:0/1919976223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb001a070 con 0x7f9eb4004800 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec4ff9640 1 -- 172.21.15.5:0/1919976223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb0005110 con 0x7f9eb4004800 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ec4ff9640 1 -- 172.21.15.5:0/1919976223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0007050 con 0x7f9eb4004800 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec81f2f30 con 0x7f9eb4004800 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.153+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec81f34f0 con 0x7f9eb4004800 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.155+0000 7f9ec4ff9640 1 -- 172.21.15.5:0/1919976223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9eb001d070 con 0x7f9eb4004800 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.155+0000 7f9ec4ff9640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ea806b500 0x7f9ea806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.155+0000 7f9ec4ff9640 1 -- 172.21.15.5:0/1919976223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9eb0089970 con 0x7f9eb4004800 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.155+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ea806b500 0x7f9ea806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.156+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ea806b500 0x7f9ea806d9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8033000 tx=0x7f9eb8008070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.156+0000 7f9ed1003740 1 Processor -- start 2024-04-25T08:59:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.156+0000 7f9ed1003740 1 -- start start 2024-04-25T08:59:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb18e390 0x55b1cb1d4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ed1003740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb0f0c60 con 0x55b1cb18e390 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb099ee0 con 0x55b1cb1b86b0 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb0ecd00 con 0x55b1cb1d5f50 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb18e390 0x55b1cb1d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb18e390 0x55b1cb1d4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44166/0 (socket says 172.21.15.5:44166) 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 -- 172.21.15.5:0/780797397 learned_addr learned my addr 172.21.15.5:0/780797397 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 -- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 msgr2=0x55b1cb1d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 -- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 msgr2=0x55b1cb1b8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1b8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 -- 172.21.15.5:0/780797397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1caed19f0 con 0x55b1cb18e390 2024-04-25T08:59:30.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.157+0000 7f9ecc899640 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb18e390 0x55b1cb1d4610 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80d0cf0 tx=0x7f9ec0001eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741cfb1be4e1a971 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ebdffb640 1 -- 172.21.15.5:0/780797397 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec001a030 con 0x55b1cb18e390 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ebdffb640 1 -- 172.21.15.5:0/780797397 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec0015440 con 0x55b1cb18e390 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ebdffb640 1 -- 172.21.15.5:0/780797397 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec00155f0 con 0x55b1cb18e390 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 -- 172.21.15.5:0/780797397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb18e390 msgr2=0x55b1cb1d4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb18e390 0x55b1cb1d4610 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80d0cf0 tx=0x7f9ec0001eb0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 -- 172.21.15.5:0/780797397 shutdown_connections 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb18e390 0x55b1cb1d4610 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 --2- 172.21.15.5:0/780797397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 -- 172.21.15.5:0/780797397 >> 172.21.15.5:0/780797397 conn(0x55b1cb18acc0 msgr2=0x55b1cb1d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 -- 172.21.15.5:0/780797397 shutdown_connections 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.158+0000 7f9ed1003740 1 -- 172.21.15.5:0/780797397 wait complete. 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.159+0000 7f9ed1003740 1 -- start start 2024-04-25T08:59:30.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.159+0000 7f9ed1003740 1 Processor -- start 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb1cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ed1003740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb18f130 con 0x55b1cb1b86b0 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb0ad470 con 0x55b1cb1d5f50 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb188bf0 con 0x55b1cb1aa480 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ed1003740 10 client.0 _ll_register_callbacks cb 0x55b1cb0797d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1badd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44180/0 (socket says 172.21.15.5:44180) 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 -- 172.21.15.5:0/4190173670 learned_addr learned my addr 172.21.15.5:0/4190173670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ecc899640 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb1cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 -- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 msgr2=0x55b1cb1cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb1cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 -- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1d5f50 msgr2=0x55b1cb1ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 -- 172.21.15.5:0/4190173670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1cadc52e0 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1badd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00545c0 tx=0x7f9eb0058220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baad3e781d0e8502 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.160+0000 7f9ea6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4190173670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb005e3c0 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4190173670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9eb0015b40 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ec0015440 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4190173670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9eb0015d40 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 10 client.5814 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55b1caf32180 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4190173670 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec0015440 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4190173670 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9eb00575b0 con 0x55b1cb1b86b0 2024-04-25T08:59:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 10 client.5814 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 20 client.5814 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1a9ed0 0x55b1cb1e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 4 client.5814 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1cb0fe1a0 con 0x55b1cb1a9ed0 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1a9ed0 0x55b1cb1e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ea6ffd640 10 client.5814 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.161+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1a9ed0 0x55b1cb1e71a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82d54249f293177d server_cookie=99fd6ec5b2f3c0bc in_seq=0 out_seq=0 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4190173670 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b1cb0fe1a0 con 0x55b1cb1a9ed0 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ea6ffd640 10 client.5814 handle_command_reply: tid=0 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 client.5814 shutdown 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1b86b0 msgr2=0x55b1cb1badd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1badd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00545c0 tx=0x7f9eb0058220 comp rx=0 tx=0).stop 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 shutdown_connections 2024-04-25T08:59:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1a9ed0 0x55b1cb1e71a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb1cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4190173670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1badd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ea6ffd640 0 client.5814 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 >> 172.21.15.5:0/4190173670 conn(0x55b1cb18e390 msgr2=0x55b1cb1d72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 shutdown_connections 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 1 -- 172.21.15.5:0/4190173670 wait complete. 2024-04-25T08:59:30.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.162+0000 7f9ed1003740 20 client.5814 trim_cache size 0 max 16384 2024-04-25T08:59:30.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 Processor -- start 2024-04-25T08:59:30.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 -- start start 2024-04-25T08:59:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1aa480 0x55b1cb1cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81fe5e0 con 0x55b1cb1aa480 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec809f100 con 0x55b1cb1b86b0 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec815c3e0 con 0x55b1cb1d5f50 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1aa480 0x55b1cb1cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1aa480 0x55b1cb1cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44198/0 (socket says 172.21.15.5:44198) 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.178+0000 7f9ec7fff640 1 -- 172.21.15.5:0/3520616920 learned_addr learned my addr 172.21.15.5:0/3520616920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ec7fff640 1 -- 172.21.15.5:0/3520616920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 msgr2=0x55b1cb1ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ec7fff640 1 -- 172.21.15.5:0/3520616920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 msgr2=0x55b1cb1ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1ed1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ec7fff640 1 -- 172.21.15.5:0/3520616920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1cad9e3a0 con 0x55b1cb1aa480 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1aa480 0x55b1cb1cd8c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00580f0 tx=0x7f9eb0005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c59bb1e1cb217a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ebd7fa640 1 -- 172.21.15.5:0/3520616920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb005c200 con 0x55b1cb1aa480 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ebd7fa640 1 -- 172.21.15.5:0/3520616920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb00575b0 con 0x55b1cb1aa480 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ebd7fa640 1 -- 172.21.15.5:0/3520616920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb005e3e0 con 0x55b1cb1aa480 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ed1003740 1 -- 172.21.15.5:0/3520616920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1aa480 msgr2=0x55b1cb1cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.179+0000 7f9ed1003740 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1aa480 0x55b1cb1cd8c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00580f0 tx=0x7f9eb0005050 comp rx=0 tx=0).stop 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 -- 172.21.15.5:0/3520616920 shutdown_connections 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1d5f50 0x55b1cb1ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb1ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 --2- 172.21.15.5:0/3520616920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1aa480 0x55b1cb1cd8c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 -- 172.21.15.5:0/3520616920 >> 172.21.15.5:0/3520616920 conn(0x55b1cb18e390 msgr2=0x55b1cb1e29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 -- 172.21.15.5:0/3520616920 shutdown_connections 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 -- 172.21.15.5:0/3520616920 wait complete. 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 -- start start 2024-04-25T08:59:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.180+0000 7f9ed1003740 1 Processor -- start 2024-04-25T08:59:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb23e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb23eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ed1003740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1d40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ed1003740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb184330 con 0x55b1cb1d5f50 2024-04-25T08:59:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec809eb00 con 0x55b1cb1b86b0 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ed1003740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1cb23f3d0 con 0x55b1cb1aa480 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ed1003740 10 client.0 _ll_register_callbacks cb 0x55b1cb1890d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ecc899640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1d40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ecc899640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1d40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44212/0 (socket says 172.21.15.5:44212) 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ecc899640 1 -- 172.21.15.5:0/4146069756 learned_addr learned my addr 172.21.15.5:0/4146069756 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb23e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.181+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb23eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ecc899640 1 -- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 msgr2=0x55b1cb23e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ecc899640 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb23e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ecc899640 1 -- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 msgr2=0x55b1cb23eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ecc899640 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb23eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ecc899640 1 -- 172.21.15.5:0/4146069756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1cb18d6f0 con 0x55b1cb1d5f50 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ecc899640 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1d40d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0002000 tx=0x7f9ec0001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e183e511ae5be504 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ea6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4146069756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0020450 con 0x55b1cb1d5f50 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4146069756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9ec00205f0 con 0x55b1cb1d5f50 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9eb00575b0 con 0x55b1cb1d5f50 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4146069756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ec0030050 con 0x55b1cb1d5f50 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 10 client.5820 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55b1cb23f110 con 0x55b1cb1d5f50 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4146069756 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb00575b0 con 0x55b1cb1d5f50 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4146069756 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9ec0033020 con 0x55b1cb1d5f50 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 10 client.5820 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 20 client.5820 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1d5ad0 0x55b1cb1d4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 4 client.5820 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.182+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x55b1cb0f84f0 con 0x55b1cb1d5ad0 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1d5ad0 0x55b1cb1d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1d5ad0 0x55b1cb1d4610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bccc5e3b274ec04 server_cookie=c4a7d6253b1c2fe7 in_seq=0 out_seq=0 2024-04-25T08:59:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ea6ffd640 10 client.5820 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ea6ffd640 1 -- 172.21.15.5:0/4146069756 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x55b1cb0f84f0 con 0x55b1cb1d5ad0 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ea6ffd640 10 client.5820 handle_command_reply: tid=0 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 client.5820 shutdown 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1d5f50 msgr2=0x55b1cb1d40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1d40d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0002000 tx=0x7f9ec0001d40 comp rx=0 tx=0).stop 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 shutdown_connections 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1cb1d5ad0 0x55b1cb1d4610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1cb1d5f50 0x55b1cb1d40d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1cb1b86b0 0x55b1cb23eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ea6ffd640 0 client.5820 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 --2- 172.21.15.5:0/4146069756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1cb1aa480 0x55b1cb23e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 >> 172.21.15.5:0/4146069756 conn(0x55b1cb18e390 msgr2=0x55b1cb1cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 shutdown_connections 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 1 -- 172.21.15.5:0/4146069756 wait complete. 2024-04-25T08:59:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.183+0000 7f9ed1003740 20 client.5820 trim_cache size 0 max 16384 2024-04-25T08:59:30.178 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:30.178 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-04-25T08:59:30.178 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ea806b500 msgr2=0x7f9ea806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ea806b500 0x7f9ea806d9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8033000 tx=0x7f9eb8008070 comp rx=0 tx=0).stop 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 msgr2=0x7f9ec81f2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9ec81f2720 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000f820 tx=0x7f9eb000fc20 comp rx=0 tx=0).stop 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 shutdown_connections 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ea806b500 0x7f9ea806d9c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9ec809ccb0 0x7f9ec81f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec80c5550 0x7f9ec809c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 --2- 172.21.15.5:0/1919976223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eb4004800 0x7f9ec81f2720 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 >> 172.21.15.5:0/1919976223 conn(0x7f9ec80d1a20 msgr2=0x7f9ec806ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 shutdown_connections 2024-04-25T08:59:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.184+0000 7f9ece2fc640 1 -- 172.21.15.5:0/1919976223 wait complete. 2024-04-25T08:59:30.183 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-04-25T08:59:30.183 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:59:30.183 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T08:59:30.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.295+0000 7f00350cd640 1 Processor -- start 2024-04-25T08:59:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.295+0000 7f00350cd640 1 -- start start 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f00350cd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00300cea80 0x7f003015f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f00350cd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f003006bd00 0x7f00300d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f00350cd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003015ef10 con 0x7f003015fd80 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f00350cd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00300cfd60 con 0x7f003006bd00 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f00350cd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003015f480 con 0x7f00300cea80 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f003006bd00 0x7f00300d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f003006bd00 0x7f00300d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44226/0 (socket says 172.21.15.5:44226) 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002f59e640 1 -- 172.21.15.5:0/3862757474 learned_addr learned my addr 172.21.15.5:0/3862757474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002ed9d640 1 --2- 172.21.15.5:0/3862757474 >> v2:172.21.15.80:3300/0 conn(0x7f00300cea80 0x7f003015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002f59e640 1 -- 172.21.15.5:0/3862757474 >> v2:172.21.15.80:3300/0 conn(0x7f00300cea80 msgr2=0x7f003015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002f59e640 1 --2- 172.21.15.5:0/3862757474 >> v2:172.21.15.80:3300/0 conn(0x7f00300cea80 0x7f003015f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002f59e640 1 -- 172.21.15.5:0/3862757474 >> v1:172.21.15.80:6789/0 conn(0x7f003015fd80 legacy=0x7f003006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.296+0000 7f002f59e640 1 -- 172.21.15.5:0/3862757474 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003015f1a0 con 0x7f003006bd00 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.297+0000 7f002f59e640 1 --2- 172.21.15.5:0/3862757474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003006bd00 0x7f00300d0770 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0030075080 tx=0x7f002002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bac344c5e916d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.297+0000 7f002dd9b640 1 -- 172.21.15.5:0/3862757474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020036070 con 0x7f003006bd00 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.297+0000 7f002dd9b640 1 -- 172.21.15.5:0/3862757474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020031600 con 0x7f003006bd00 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.297+0000 7f002dd9b640 1 -- 172.21.15.5:0/3862757474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200319d0 con 0x7f003006bd00 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 -- 172.21.15.5:0/3862757474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003006bd00 msgr2=0x7f00300d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 --2- 172.21.15.5:0/3862757474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003006bd00 0x7f00300d0770 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0030075080 tx=0x7f002002a730 comp rx=0 tx=0).stop 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 -- 172.21.15.5:0/3862757474 shutdown_connections 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 --2- 172.21.15.5:0/3862757474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003006bd00 0x7f00300d0770 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 --2- 172.21.15.5:0/3862757474 >> v2:172.21.15.80:3300/0 conn(0x7f00300cea80 0x7f003015f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 -- 172.21.15.5:0/3862757474 >> 172.21.15.5:0/3862757474 conn(0x7f00300d19f0 msgr2=0x7f00300d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 -- 172.21.15.5:0/3862757474 shutdown_connections 2024-04-25T08:59:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.298+0000 7f00350cd640 1 -- 172.21.15.5:0/3862757474 wait complete. 2024-04-25T08:59:30.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.299+0000 7f00350cd640 1 Processor -- start 2024-04-25T08:59:30.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.299+0000 7f00350cd640 1 -- start start 2024-04-25T08:59:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f00350cd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f003006bd00 0x7f00300c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f00350cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00300cea80 0x7f003009b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f00350cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003009bdd0 0x7f00301f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f00350cd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300d1660 con 0x7f003009bdd0 2024-04-25T08:59:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f00350cd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300d0270 con 0x7f00300cea80 2024-04-25T08:59:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f00350cd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300d17e0 con 0x7f003006bd00 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f002f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003009bdd0 0x7f00301f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f002f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003009bdd0 0x7f00301f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44238/0 (socket says 172.21.15.5:44238) 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f002f59e640 1 -- 172.21.15.5:0/3084273400 learned_addr learned my addr 172.21.15.5:0/3084273400 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f002e59c640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00300cea80 0x7f003009b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.300+0000 7f002ed9d640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f003006bd00 0x7f00300c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f002f59e640 1 -- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f003006bd00 msgr2=0x7f00300c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f002f59e640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f003006bd00 0x7f00300c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f002f59e640 1 -- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00300cea80 msgr2=0x7f003009b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f002f59e640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00300cea80 0x7f003009b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f002f59e640 1 -- 172.21.15.5:0/3084273400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300c6e70 con 0x7f003009bdd0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f002f59e640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003009bdd0 0x7f00301f45f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0020009f40 tx=0x7f0020004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f00277fe640 1 -- 172.21.15.5:0/3084273400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020036050 con 0x7f003009bdd0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f00277fe640 1 -- 172.21.15.5:0/3084273400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020042070 con 0x7f003009bdd0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00300c7150 con 0x7f003009bdd0 2024-04-25T08:59:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f00277fe640 1 -- 172.21.15.5:0/3084273400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020009510 con 0x7f003009bdd0 2024-04-25T08:59:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.301+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00300c7710 con 0x7f003009bdd0 2024-04-25T08:59:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.302+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0030068610 con 0x7f003009bdd0 2024-04-25T08:59:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.303+0000 7f00277fe640 1 -- 172.21.15.5:0/3084273400 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0020007bf0 con 0x7f003009bdd0 2024-04-25T08:59:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.303+0000 7f00277fe640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f001006b4d0 0x7f001006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.303+0000 7f00277fe640 1 -- 172.21.15.5:0/3084273400 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f00200aadf0 con 0x7f003009bdd0 2024-04-25T08:59:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.303+0000 7f002ed9d640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f001006b4d0 0x7f001006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.304+0000 7f002ed9d640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f001006b4d0 0x7f001006d990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0028009b40 tx=0x7f0028009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.307+0000 7f00277fe640 1 -- 172.21.15.5:0/3084273400 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0030068610 con 0x7f003009bdd0 2024-04-25T08:59:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.524+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0030067ef0 con 0x7f003009bdd0 2024-04-25T08:59:30.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.524+0000 7f00277fe640 1 -- 172.21.15.5:0/3084273400 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f0030067ef0 con 0x7f003009bdd0 2024-04-25T08:59:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:30.513 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:30.513 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f001006b4d0 msgr2=0x7f001006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f001006b4d0 0x7f001006d990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0028009b40 tx=0x7f0028009190 comp rx=0 tx=0).stop 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003009bdd0 msgr2=0x7f00301f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003009bdd0 0x7f00301f45f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0020009f40 tx=0x7f0020004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 shutdown_connections 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f001006b4d0 0x7f001006d990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f003009bdd0 0x7f00301f45f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00300cea80 0x7f003009b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 --2- 172.21.15.5:0/3084273400 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f003006bd00 0x7f00300c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 >> 172.21.15.5:0/3084273400 conn(0x7f00300d19f0 msgr2=0x7f0030160170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 shutdown_connections 2024-04-25T08:59:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.526+0000 7f00350cd640 1 -- 172.21.15.5:0/3084273400 wait complete. 2024-04-25T08:59:30.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:59:30.702 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:30.702 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:30.711 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:30.711 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T08:59:30.712 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:30.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:59:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.828+0000 7f1d6eeb3640 1 Processor -- start 2024-04-25T08:59:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.828+0000 7f1d6eeb3640 1 -- start start 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d6eeb3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d680cefe0 0x7f1d68168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d6eeb3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d68162150 con 0x7f1d680b6250 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d6eeb3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d68162430 con 0x7f1d6815df10 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d6eeb3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d680d20d0 con 0x7f1d680cefe0 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d67fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1d680b6250 0x7f1d680ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60396/0 (socket says 172.21.15.5:60396) 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d67fff640 1 -- 172.21.15.5:0/3815103212 learned_addr learned my addr 172.21.15.5:0/3815103212 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d6d450640 1 --2- 172.21.15.5:0/3815103212 >> v2:172.21.15.80:3300/0 conn(0x7f1d680cefe0 0x7f1d68168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364705222 0 0) 0x7f1d68162150 con 0x7f1d680b6250 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d50003520 con 0x7f1d680b6250 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609123798 0 0) 0x7f1d50003520 con 0x7f1d680b6250 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 >> v2:172.21.15.80:3300/0 conn(0x7f1d680cefe0 msgr2=0x7f1d68168c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 --2- 172.21.15.5:0/3815103212 >> v2:172.21.15.80:3300/0 conn(0x7f1d680cefe0 0x7f1d68168c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 >> v1:172.21.15.80:6789/0 conn(0x7f1d6815df10 legacy=0x7f1d681618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68162710 con 0x7f1d680b6250 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1d5c001670 con 0x7f1d680b6250 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d6d450640 1 --2- 172.21.15.5:0/3815103212 >> v2:172.21.15.80:3300/0 conn(0x7f1d680cefe0 0x7f1d68168c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 >> v1:172.21.15.5:6789/0 conn(0x7f1d680b6250 legacy=0x7f1d680ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d500039b0 0x7f1d50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d500043b0 0x7f1d50004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d50005080 0x7f1d5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680d20d0 con 0x7f1d50005080 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5000bfe0 con 0x7f1d500043b0 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.829+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5000c1e0 con 0x7f1d500039b0 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6d450640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d50005080 0x7f1d5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d67fff640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d500043b0 0x7f1d50004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d500039b0 0x7f1d50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6d450640 1 -- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d500039b0 msgr2=0x7f1d50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6d450640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d500039b0 0x7f1d50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6d450640 1 -- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d500043b0 msgr2=0x7f1d50004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6d450640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d500043b0 0x7f1d50004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6d450640 1 -- 172.21.15.5:0/3815103212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50003520 con 0x7f1d50005080 2024-04-25T08:59:30.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d67fff640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d500043b0 0x7f1d50004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.830+0000 7f1d6d450640 1 -- 172.21.15.5:0/3815103212 reap_dead start 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6d450640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d50005080 0x7f1d5000b9c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009c60 tx=0x7f1d50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3fdb45a1ada7ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c007d30 con 0x7f1d50005080 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58004020 con 0x7f1d50005080 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d677fe640 1 -- 172.21.15.5:0/3815103212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58009860 con 0x7f1d50005080 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/3815103212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d50005080 msgr2=0x7f1d5000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d50005080 0x7f1d5000b9c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009c60 tx=0x7f1d50005830 comp rx=0 tx=0).stop 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/3815103212 shutdown_connections 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/3815103212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d50005080 0x7f1d5000b9c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/3815103212 >> 172.21.15.5:0/3815103212 conn(0x7f1d680668f0 msgr2=0x7f1d68066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/3815103212 shutdown_connections 2024-04-25T08:59:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.831+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/3815103212 wait complete. 2024-04-25T08:59:30.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.832+0000 7f1d6eeb3640 1 Processor -- start 2024-04-25T08:59:30.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.833+0000 7f1d6eeb3640 1 -- start start 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.833+0000 7f1d6eeb3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d50005080 0x7f1d68147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.833+0000 7f1d6eeb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d6815e2f0 0x7f1d680c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.833+0000 7f1d6eeb3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d680cc520 0x7f1d680cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.833+0000 7f1d6eeb3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680cea50 con 0x7f1d6815e2f0 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.833+0000 7f1d6eeb3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680ce8d0 con 0x7f1d50005080 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.833+0000 7f1d6eeb3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680cebd0 con 0x7f1d680cc520 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d6815e2f0 0x7f1d680c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d6815e2f0 0x7f1d680c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43778/0 (socket says 172.21.15.5:43778) 2024-04-25T08:59:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 -- 172.21.15.5:0/1381481161 learned_addr learned my addr 172.21.15.5:0/1381481161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d50005080 0x7f1d68147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d6d450640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d680cc520 0x7f1d680cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 -- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d680cc520 msgr2=0x7f1d680cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d680cc520 0x7f1d680cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 -- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d50005080 msgr2=0x7f1d68147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d50005080 0x7f1d68147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 -- 172.21.15.5:0/1381481161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680c91d0 con 0x7f1d6815e2f0 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d67fff640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d6815e2f0 0x7f1d680c8c90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0072c0 tx=0x7f1d5c0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d657fa640 1 -- 172.21.15.5:0/1381481161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c01a070 con 0x7f1d6815e2f0 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d657fa640 1 -- 172.21.15.5:0/1381481161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00f8e0 con 0x7f1d6815e2f0 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d657fa640 1 -- 172.21.15.5:0/1381481161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00fc90 con 0x7f1d6815e2f0 2024-04-25T08:59:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d680ca540 con 0x7f1d6815e2f0 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.834+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d680c9780 con 0x7f1d6815e2f0 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.836+0000 7f1d657fa640 1 -- 172.21.15.5:0/1381481161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d5c01d070 con 0x7f1d6815e2f0 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.836+0000 7f1d657fa640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d5406b4d0 0x7f1d5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.836+0000 7f1d657fa640 1 -- 172.21.15.5:0/1381481161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d5c089c10 con 0x7f1d6815e2f0 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.836+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d5406b4d0 0x7f1d5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.837+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d5406b4d0 0x7f1d5406d990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d60001f90 tx=0x7f1d60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.837+0000 7f1d71bbc740 1 Processor -- start 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.837+0000 7f1d71bbc740 1 -- start start 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fae75e0 0x55ea1faab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fad59d0 0x55ea1fad5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea1f9dcfe0 con 0x55ea1faaaf10 2024-04-25T08:59:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea1fa0ed20 con 0x55ea1fae75e0 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea1f9b7fa0 con 0x55ea1fad59d0 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43792/0 (socket says 172.21.15.5:43792) 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2702543431 learned_addr learned my addr 172.21.15.5:0/2702543431 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fae75e0 0x55ea1faab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6d450640 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fad59d0 0x55ea1fad5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fad59d0 msgr2=0x55ea1fad5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fad59d0 0x55ea1fad5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fae75e0 msgr2=0x55ea1faab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fae75e0 0x55ea1faab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2702543431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea1f7efb00 con 0x55ea1faaaf10 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faad070 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1d60006ba0 tx=0x7f1d60015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0beb120abc69df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.838+0000 7f1d4e7fc640 1 -- 172.21.15.5:0/2702543431 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60028070 con 0x55ea1faaaf10 2024-04-25T08:59:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d4e7fc640 1 -- 172.21.15.5:0/2702543431 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d600075b0 con 0x55ea1faaaf10 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d4e7fc640 1 -- 172.21.15.5:0/2702543431 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60007960 con 0x55ea1faaaf10 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2702543431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 msgr2=0x55ea1faad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faad070 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1d60006ba0 tx=0x7f1d60015000 comp rx=0 tx=0).stop 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2702543431 shutdown_connections 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fad59d0 0x55ea1fad5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fae75e0 0x55ea1faab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2702543431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faad070 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2702543431 >> 172.21.15.5:0/2702543431 conn(0x55ea1fa73100 msgr2=0x55ea1faf09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2702543431 shutdown_connections 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.839+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2702543431 wait complete. 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.840+0000 7f1d71bbc740 1 -- start start 2024-04-25T08:59:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.840+0000 7f1d71bbc740 1 Processor -- start 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faeed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faeaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea1f9ad750 con 0x55ea1faaaf10 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea1fa0adc0 con 0x55ea1fad59d0 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea1fae80a0 con 0x55ea1fae75e0 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d71bbc740 10 client.0 _ll_register_callbacks cb 0x55ea1f9c5ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faeed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faeed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43800/0 (socket says 172.21.15.5:43800) 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/1846483225 learned_addr learned my addr 172.21.15.5:0/1846483225 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6d450640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d67fff640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faeaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 msgr2=0x55ea1faeb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 msgr2=0x55ea1faeaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faeaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/1846483225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea1f6e33f0 con 0x55ea1faaaf10 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d67fff640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faeaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faeed20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1d60026040 tx=0x7f1d600015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6f5cda2ab66d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.841+0000 7f1d477fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d477fe640 1 -- 172.21.15.5:0/1846483225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60028070 con 0x55ea1faaaf10 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d477fe640 1 -- 172.21.15.5:0/1846483225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d60015c80 con 0x55ea1faaaf10 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d600075b0 con 0x55ea1faaaf10 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d477fe640 1 -- 172.21.15.5:0/1846483225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d60039050 con 0x55ea1faaaf10 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 10 client.5838 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55ea1f850290 con 0x55ea1faaaf10 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d477fe640 1 -- 172.21.15.5:0/1846483225 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d600075b0 con 0x55ea1faaaf10 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d477fe640 1 -- 172.21.15.5:0/1846483225 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d6003c020 con 0x55ea1faaaf10 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 10 client.5838 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:30.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 10 client.5838 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 20 client.5838 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faec640 0x55ea1faeca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 4 client.5838 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea1fa1c260 con 0x55ea1faec640 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d67fff640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faec640 0x55ea1faeca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d67fff640 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faec640 0x55ea1faeca60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4fed17276d98d91 server_cookie=e2c6d3b6cbd35101 in_seq=0 out_seq=0 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.842+0000 7f1d477fe640 10 client.5838 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d477fe640 1 -- 172.21.15.5:0/1846483225 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ea1fa1c260 con 0x55ea1faec640 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d477fe640 10 client.5838 handle_command_reply: tid=0 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 client.5838 shutdown 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 msgr2=0x55ea1faeed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faeed20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1d60026040 tx=0x7f1d600015b0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 shutdown_connections 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faec640 0x55ea1faeca60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faeaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/1846483225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faeed20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d477fe640 0 client.5838 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 >> 172.21.15.5:0/1846483225 conn(0x55ea1fa73100 msgr2=0x55ea1faf47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 shutdown_connections 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 1 -- 172.21.15.5:0/1846483225 wait complete. 2024-04-25T08:59:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.843+0000 7f1d71bbc740 20 client.5838 trim_cache size 0 max 16384 2024-04-25T08:59:30.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.858+0000 7f1d71bbc740 1 Processor -- start 2024-04-25T08:59:30.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.858+0000 7f1d71bbc740 1 -- start start 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faacf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faa52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68200310 con 0x55ea1faaaf10 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681ff560 con 0x55ea1fad59d0 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680c84d0 con 0x55ea1fae75e0 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faacf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faacf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43804/0 (socket says 172.21.15.5:43804) 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/3527539078 learned_addr learned my addr 172.21.15.5:0/3527539078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d6d450640 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.859+0000 7f1d67fff640 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faa52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 msgr2=0x55ea1faeac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 msgr2=0x55ea1faa52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faa52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/3527539078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea1f6bc4b0 con 0x55ea1faaaf10 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faacf50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1d60012bc0 tx=0x7f1d6002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3849b729fe0a2d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d4dffb640 1 -- 172.21.15.5:0/3527539078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60015a80 con 0x55ea1faaaf10 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d4dffb640 1 -- 172.21.15.5:0/3527539078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60015c20 con 0x55ea1faaaf10 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d4dffb640 1 -- 172.21.15.5:0/3527539078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60022660 con 0x55ea1faaaf10 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 -- 172.21.15.5:0/3527539078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 msgr2=0x55ea1faacf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faacf50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1d60012bc0 tx=0x7f1d6002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 -- 172.21.15.5:0/3527539078 shutdown_connections 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1faeac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1faa52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/3527539078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faacf50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 -- 172.21.15.5:0/3527539078 >> 172.21.15.5:0/3527539078 conn(0x55ea1fa73100 msgr2=0x55ea1faf47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.860+0000 7f1d71bbc740 1 -- 172.21.15.5:0/3527539078 shutdown_connections 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.861+0000 7f1d71bbc740 1 -- 172.21.15.5:0/3527539078 wait complete. 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.861+0000 7f1d71bbc740 1 -- start start 2024-04-25T08:59:30.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.861+0000 7f1d71bbc740 1 Processor -- start 2024-04-25T08:59:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faa8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1fb59a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d71bbc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1fb11da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea1faf2280 con 0x55ea1faaaf10 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681f4ab0 con 0x55ea1fad59d0 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d71bbc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea1faf1fb0 con 0x55ea1fae75e0 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d71bbc740 10 client.0 _ll_register_callbacks cb 0x7f1d60001cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faa8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faa8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43814/0 (socket says 172.21.15.5:43814) 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2311873101 learned_addr learned my addr 172.21.15.5:0/2311873101 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1fb59a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6d450640 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1fb11da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 msgr2=0x55ea1fb11da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1fb11da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 msgr2=0x55ea1fb59a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1fb59a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.862+0000 7f1d6cc4f640 1 -- 172.21.15.5:0/2311873101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea1fae73f0 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d6cc4f640 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faa8e60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1d600014e0 tx=0x7f1d6000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae6db4f48f72bdb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d477fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d477fe640 1 -- 172.21.15.5:0/2311873101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60004980 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d477fe640 1 -- 172.21.15.5:0/2311873101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d60004b20 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d60015c20 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d477fe640 1 -- 172.21.15.5:0/2311873101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d60054050 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 10 client.5844 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55ea1fb09310 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d477fe640 1 -- 172.21.15.5:0/2311873101 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60015c20 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d477fe640 1 -- 172.21.15.5:0/2311873101 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d60057020 con 0x55ea1faaaf10 2024-04-25T08:59:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 10 client.5844 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 10 client.5844 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 20 client.5844 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faeab50 0x55ea1faeaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 4 client.5844 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x55ea1fa165b0 con 0x55ea1faeab50 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.863+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faeab50 0x55ea1faeaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d477fe640 10 client.5844 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faeab50 0x55ea1faeaf30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee38e2cbf8935e1 server_cookie=978a53a416cb8064 in_seq=0 out_seq=0 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d477fe640 1 -- 172.21.15.5:0/2311873101 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ea1fa165b0 con 0x55ea1faeab50 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d477fe640 10 client.5844 handle_command_reply: tid=0 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 client.5844 shutdown 2024-04-25T08:59:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 msgr2=0x55ea1faa8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faa8e60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1d600014e0 tx=0x7f1d6000c000 comp rx=0 tx=0).stop 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 shutdown_connections 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55ea1faeab50 0x55ea1faeaf30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ea1fae75e0 0x55ea1fb11da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ea1fad59d0 0x55ea1fb59a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 --2- 172.21.15.5:0/2311873101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ea1faaaf10 0x55ea1faa8e60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 >> 172.21.15.5:0/2311873101 conn(0x55ea1fa73100 msgr2=0x55ea1faf1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.864+0000 7f1d477fe640 0 client.5844 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 shutdown_connections 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d71bbc740 1 -- 172.21.15.5:0/2311873101 wait complete. 2024-04-25T08:59:30.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d71bbc740 20 client.5844 trim_cache size 0 max 16384 2024-04-25T08:59:30.861 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "38804ddb-0990-41db-83a2-47c674e32290", 2024-04-25T08:59:30.861 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:30.861 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d5406b4d0 msgr2=0x7f1d5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d5406b4d0 0x7f1d5406d990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d60001f90 tx=0x7f1d60009040 comp rx=0 tx=0).stop 2024-04-25T08:59:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d6815e2f0 msgr2=0x7f1d680c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d6815e2f0 0x7f1d680c8c90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0072c0 tx=0x7f1d5c0076c0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 shutdown_connections 2024-04-25T08:59:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d5406b4d0 0x7f1d5406d990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d680cc520 0x7f1d680cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d6815e2f0 0x7f1d680c8c90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 --2- 172.21.15.5:0/1381481161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d50005080 0x7f1d68147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 >> 172.21.15.5:0/1381481161 conn(0x7f1d680668f0 msgr2=0x7f1d680b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 shutdown_connections 2024-04-25T08:59:30.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.865+0000 7f1d6eeb3640 1 -- 172.21.15.5:0/1381481161 wait complete. 2024-04-25T08:59:30.864 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '38804ddb-0990-41db-83a2-47c674e32290', 'mode': 'asynchronous'}' 2024-04-25T08:59:30.864 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:59:30.864 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T08:59:30.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.976+0000 7fee0de53640 1 Processor -- start 2024-04-25T08:59:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.976+0000 7fee0de53640 1 -- start start 2024-04-25T08:59:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.977+0000 7fee0de53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee0815dc70 0x7fee08161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.977+0000 7fee0de53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee08161fc0 con 0x7fee080b94a0 2024-04-25T08:59:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.977+0000 7fee0de53640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee081622a0 con 0x7fee080cef60 2024-04-25T08:59:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.977+0000 7fee0de53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee080d2180 con 0x7fee0815dc70 2024-04-25T08:59:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.977+0000 7fee06ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee080b94a0 0x7fee080ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60408/0 (socket says 172.21.15.5:60408) 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.977+0000 7fee06ffd640 1 -- 172.21.15.5:0/1575973808 learned_addr learned my addr 172.21.15.5:0/1575973808 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.978+0000 7fee077fe640 1 --2- 172.21.15.5:0/1575973808 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee0815dc70 0x7fee08161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.978+0000 7fee067fc640 1 -- 172.21.15.5:0/1575973808 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988588611 0 0) 0x7fee08161fc0 con 0x7fee080b94a0 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.978+0000 7fee067fc640 1 -- 172.21.15.5:0/1575973808 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf0003520 con 0x7fee080b94a0 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.978+0000 7fee067fc640 1 -- 172.21.15.5:0/1575973808 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018560216 0 0) 0x7fee081622a0 con 0x7fee080cef60 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.978+0000 7fee077fe640 1 -- 172.21.15.5:0/1575973808 >> v1:172.21.15.80:6789/0 conn(0x7fee080cef60 legacy=0x7fee080d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.978+0000 7fee077fe640 1 -- 172.21.15.5:0/1575973808 >> v1:172.21.15.5:6789/0 conn(0x7fee080b94a0 legacy=0x7fee080ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.978+0000 7fee077fe640 1 -- 172.21.15.5:0/1575973808 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08162580 con 0x7fee0815dc70 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee077fe640 1 --2- 172.21.15.5:0/1575973808 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee0815dc70 0x7fee08161850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fedf80097d0 tx=0x7fedf802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58119d7478ab821c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee067fc640 1 -- 172.21.15.5:0/1575973808 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8037070 con 0x7fee0815dc70 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee067fc640 1 -- 172.21.15.5:0/1575973808 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf802ac10 con 0x7fee0815dc70 2024-04-25T08:59:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee067fc640 1 -- 172.21.15.5:0/1575973808 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc001670 con 0x7fee0815dc70 2024-04-25T08:59:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee0de53640 1 -- 172.21.15.5:0/1575973808 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee0815dc70 msgr2=0x7fee08161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee0de53640 1 --2- 172.21.15.5:0/1575973808 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee0815dc70 0x7fee08161850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fedf80097d0 tx=0x7fedf802a180 comp rx=0 tx=0).stop 2024-04-25T08:59:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee0de53640 1 -- 172.21.15.5:0/1575973808 shutdown_connections 2024-04-25T08:59:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee0de53640 1 --2- 172.21.15.5:0/1575973808 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee0815dc70 0x7fee08161850 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.979+0000 7fee0de53640 1 -- 172.21.15.5:0/1575973808 >> 172.21.15.5:0/1575973808 conn(0x7fee080668f0 msgr2=0x7fee08066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.980+0000 7fee0de53640 1 -- 172.21.15.5:0/1575973808 shutdown_connections 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.980+0000 7fee0de53640 1 -- 172.21.15.5:0/1575973808 wait complete. 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.981+0000 7fee0de53640 1 Processor -- start 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.981+0000 7fee0de53640 1 -- start start 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee080b94a0 0x7fee0814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee080cef60 0x7fee080cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0815dc70 0x7fee080aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee080d11f0 con 0x7fee0815dc70 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee080d2d20 con 0x7fee080cef60 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee080d2ea0 con 0x7fee080b94a0 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0815dc70 0x7fee080aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0815dc70 0x7fee080aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43818/0 (socket says 172.21.15.5:43818) 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 -- 172.21.15.5:0/3121502331 learned_addr learned my addr 172.21.15.5:0/3121502331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee077fe640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee080b94a0 0x7fee0814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee06ffd640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee080cef60 0x7fee080cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 -- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee080b94a0 msgr2=0x7fee0814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee080b94a0 0x7fee0814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 -- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee080cef60 msgr2=0x7fee080cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee080cef60 0x7fee080cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 -- 172.21.15.5:0/3121502331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0814d290 con 0x7fee0815dc70 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee06ffd640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee080cef60 0x7fee080cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee07fff640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0815dc70 0x7fee080aa570 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fee0000c750 tx=0x7fee0000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fedeffff640 1 -- 172.21.15.5:0/3121502331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00003ba0 con 0x7fee0815dc70 2024-04-25T08:59:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fedeffff640 1 -- 172.21.15.5:0/3121502331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00003d40 con 0x7fee0815dc70 2024-04-25T08:59:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0814d570 con 0x7fee0815dc70 2024-04-25T08:59:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fedeffff640 1 -- 172.21.15.5:0/3121502331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00005270 con 0x7fee0815dc70 2024-04-25T08:59:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.982+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0814db30 con 0x7fee0815dc70 2024-04-25T08:59:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.983+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0804ef20 con 0x7fee0815dc70 2024-04-25T08:59:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.984+0000 7fedeffff640 1 -- 172.21.15.5:0/3121502331 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee00005410 con 0x7fee0815dc70 2024-04-25T08:59:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.984+0000 7fedeffff640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fedf406b4d0 0x7fedf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.984+0000 7fedeffff640 1 -- 172.21.15.5:0/3121502331 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fee0008a090 con 0x7fee0815dc70 2024-04-25T08:59:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.985+0000 7fee077fe640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fedf406b4d0 0x7fedf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.985+0000 7fee077fe640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fedf406b4d0 0x7fedf406d990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fedf8034000 tx=0x7fedf802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:30.989+0000 7fedeffff640 1 -- 172.21.15.5:0/3121502331 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee00058e40 con 0x7fee0815dc70 2024-04-25T08:59:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.208+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee080b8af0 con 0x7fee0815dc70 2024-04-25T08:59:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.208+0000 7fedeffff640 1 -- 172.21.15.5:0/3121502331 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fee00058740 con 0x7fee0815dc70 2024-04-25T08:59:31.197 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:31.197 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fedf406b4d0 msgr2=0x7fedf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fedf406b4d0 0x7fedf406d990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fedf8034000 tx=0x7fedf802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0815dc70 msgr2=0x7fee080aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0815dc70 0x7fee080aa570 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fee0000c750 tx=0x7fee0000cc10 comp rx=0 tx=0).stop 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 shutdown_connections 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fedf406b4d0 0x7fedf406d990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee0815dc70 0x7fee080aa570 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee080cef60 0x7fee080cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 --2- 172.21.15.5:0/3121502331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fee080b94a0 0x7fee0814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 >> 172.21.15.5:0/3121502331 conn(0x7fee080668f0 msgr2=0x7fee080ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 shutdown_connections 2024-04-25T08:59:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.210+0000 7fee0de53640 1 -- 172.21.15.5:0/3121502331 wait complete. 2024-04-25T08:59:31.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:59:31.319 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:31.320 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:31.320 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:31.328 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:31.328 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T08:59:31.329 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:31.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:59:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.444+0000 7f96e9ebc640 1 Processor -- start 2024-04-25T08:59:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.444+0000 7f96e9ebc640 1 -- start start 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e9ebc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96e40b6250 0x7f96e40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e9ebc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e40cee10 0x7f96e40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e9ebc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e4162150 con 0x7f96e415df10 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e9ebc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e40d20d0 con 0x7f96e40b6250 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e9ebc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4162430 con 0x7f96e40cee10 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96e40b6250 0x7f96e40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96e40b6250 0x7f96e40ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43832/0 (socket says 172.21.15.5:43832) 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.445+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2813664355 learned_addr learned my addr 172.21.15.5:0/2813664355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.446+0000 7f96e3fff640 1 --2- 172.21.15.5:0/2813664355 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e40cee10 0x7f96e40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.446+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2813664355 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e40cee10 msgr2=0x7f96e40d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.446+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/2813664355 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e40cee10 0x7f96e40d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.446+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2813664355 >> v1:172.21.15.80:6789/0 conn(0x7f96e415df10 legacy=0x7f96e41618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.446+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2813664355 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4162710 con 0x7f96e40b6250 2024-04-25T08:59:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.446+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/2813664355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40ce8d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009870 tx=0x7f96d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c3e7fc8859feca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e27fc640 1 -- 172.21.15.5:0/2813664355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8037070 con 0x7f96e40b6250 2024-04-25T08:59:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e27fc640 1 -- 172.21.15.5:0/2813664355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8032440 con 0x7f96e40b6250 2024-04-25T08:59:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e27fc640 1 -- 172.21.15.5:0/2813664355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8032810 con 0x7f96e40b6250 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 -- 172.21.15.5:0/2813664355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 msgr2=0x7f96e40ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/2813664355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40ce8d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009870 tx=0x7f96d802a270 comp rx=0 tx=0).stop 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 -- 172.21.15.5:0/2813664355 shutdown_connections 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/2813664355 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e40cee10 0x7f96e40d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/2813664355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40ce8d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 -- 172.21.15.5:0/2813664355 >> 172.21.15.5:0/2813664355 conn(0x7f96e40668f0 msgr2=0x7f96e4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 -- 172.21.15.5:0/2813664355 shutdown_connections 2024-04-25T08:59:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.447+0000 7f96e9ebc640 1 -- 172.21.15.5:0/2813664355 wait complete. 2024-04-25T08:59:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.448+0000 7f96e9ebc640 1 Processor -- start 2024-04-25T08:59:31.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e9ebc640 1 -- start start 2024-04-25T08:59:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e9ebc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e9ebc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96e40cee10 0x7f96e40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e9ebc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e415df10 0x7f96e40ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e9ebc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40d2c20 con 0x7f96e40b6250 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e9ebc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40d2aa0 con 0x7f96e40cee10 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e9ebc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40d2da0 con 0x7f96e415df10 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43840/0 (socket says 172.21.15.5:43840) 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.449+0000 7f96e37fe640 1 -- 172.21.15.5:0/3046785795 learned_addr learned my addr 172.21.15.5:0/3046785795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96e40cee10 0x7f96e40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e3fff640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e415df10 0x7f96e40ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e37fe640 1 -- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e415df10 msgr2=0x7f96e40ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e37fe640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e415df10 0x7f96e40ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e37fe640 1 -- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96e40cee10 msgr2=0x7f96e40caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e37fe640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96e40cee10 0x7f96e40caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e37fe640 1 -- 172.21.15.5:0/3046785795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e40ca580 con 0x7f96e40b6250 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e3fff640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e415df10 0x7f96e40ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e37fe640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40c89a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c3f0 tx=0x7f96d400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96cbfff640 1 -- 172.21.15.5:0/3046785795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d40052d0 con 0x7f96e40b6250 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96cbfff640 1 -- 172.21.15.5:0/3046785795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4005490 con 0x7f96e40b6250 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e40c8fa0 con 0x7f96e40b6250 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96cbfff640 1 -- 172.21.15.5:0/3046785795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4007260 con 0x7f96e40b6250 2024-04-25T08:59:31.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.450+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e40c9560 con 0x7f96e40b6250 2024-04-25T08:59:31.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.452+0000 7f96cbfff640 1 -- 172.21.15.5:0/3046785795 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f96d4007400 con 0x7f96e40b6250 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.452+0000 7f96cbfff640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f96d006b4d0 0x7f96d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.452+0000 7f96cbfff640 1 -- 172.21.15.5:0/3046785795 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f96d4089720 con 0x7f96e40b6250 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.452+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f96d006b4d0 0x7f96d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.453+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f96d006b4d0 0x7f96d006d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f96d8034000 tx=0x7f96d802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.453+0000 7f96ecbb7740 1 Processor -- start 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.453+0000 7f96ecbb7740 1 -- start start 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1eb5a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb16130 0x55da1eb5c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb3caf0 0x55da1eb59590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1ea78e60 con 0x55da1eb16130 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1ea22120 con 0x55da1eb5bf60 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da1ea74f00 con 0x55da1eb3caf0 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb16130 0x55da1eb5c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb16130 0x55da1eb5c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43846/0 (socket says 172.21.15.5:43846) 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96e2ffd640 1 -- 172.21.15.5:0/415988226 learned_addr learned my addr 172.21.15.5:0/415988226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96e3fff640 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb3caf0 0x55da1eb59590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.454+0000 7f96e37fe640 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1eb5a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96e2ffd640 1 -- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb3caf0 msgr2=0x55da1eb59590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb3caf0 0x55da1eb59590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96e2ffd640 1 -- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 msgr2=0x55da1eb5a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1eb5a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96e2ffd640 1 -- 172.21.15.5:0/415988226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da1e859f00 con 0x55da1eb16130 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb16130 0x55da1eb5c340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f96d8000c00 tx=0x7f96d802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9491c4078bcd7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96c97fa640 1 -- 172.21.15.5:0/415988226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d804e070 con 0x55da1eb16130 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96c97fa640 1 -- 172.21.15.5:0/415988226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8032d90 con 0x55da1eb16130 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.455+0000 7f96c97fa640 1 -- 172.21.15.5:0/415988226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8037040 con 0x55da1eb16130 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 -- 172.21.15.5:0/415988226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb16130 msgr2=0x55da1eb5c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb16130 0x55da1eb5c340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f96d8000c00 tx=0x7f96d802c000 comp rx=0 tx=0).stop 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 -- 172.21.15.5:0/415988226 shutdown_connections 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb3caf0 0x55da1eb59590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb16130 0x55da1eb5c340 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/415988226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1eb5a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 -- 172.21.15.5:0/415988226 >> 172.21.15.5:0/415988226 conn(0x55da1eadcf70 msgr2=0x55da1eb13150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 -- 172.21.15.5:0/415988226 shutdown_connections 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 -- 172.21.15.5:0/415988226 wait complete. 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 -- start start 2024-04-25T08:59:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.456+0000 7f96ecbb7740 1 Processor -- start 2024-04-25T08:59:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb3fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb3f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb41a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1eb5b760 con 0x55da1eb3caf0 2024-04-25T08:59:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1ea17cd0 con 0x55da1eb16130 2024-04-25T08:59:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da1eb5b480 con 0x55da1eb5bf60 2024-04-25T08:59:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96ecbb7740 10 client.0 _ll_register_callbacks cb 0x55da1e78d2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb3f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb3f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43850/0 (socket says 172.21.15.5:43850) 2024-04-25T08:59:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2056421304 learned_addr learned my addr 172.21.15.5:0/2056421304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96e37fe640 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb3fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.457+0000 7f96e3fff640 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb41a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 msgr2=0x55da1eb41a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb41a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 msgr2=0x55da1eb3fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb3fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96e2ffd640 1 -- 172.21.15.5:0/2056421304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da1e74d7f0 con 0x55da1eb3caf0 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb3f040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009990 tx=0x7f96d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc76e460513e33e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96c27fc640 1 -- 172.21.15.5:0/2056421304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d804e070 con 0x55da1eb3caf0 2024-04-25T08:59:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96c27fc640 1 -- 172.21.15.5:0/2056421304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f96d803e9d0 con 0x55da1eb3caf0 2024-04-25T08:59:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96d8032d90 con 0x55da1eb3caf0 2024-04-25T08:59:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96c27fc640 1 -- 172.21.15.5:0/2056421304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96d805c050 con 0x55da1eb3caf0 2024-04-25T08:59:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96ecbb7740 10 client.5862 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55da1e8ba690 con 0x55da1eb3caf0 2024-04-25T08:59:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.458+0000 7f96c27fc640 1 -- 172.21.15.5:0/2056421304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8032d90 con 0x55da1eb3caf0 2024-04-25T08:59:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96c27fc640 1 -- 172.21.15.5:0/2056421304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f96d805f020 con 0x55da1eb3caf0 2024-04-25T08:59:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96ecbb7740 10 client.5862 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96ecbb7740 10 client.5862 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96ecbb7740 20 client.5862 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3dcc0 0x55da1eb3e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96ecbb7740 4 client.5862 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da1ea863a0 con 0x55da1eb3dcc0 2024-04-25T08:59:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96e37fe640 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3dcc0 0x55da1eb3e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96c27fc640 10 client.5862 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.459+0000 7f96e37fe640 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3dcc0 0x55da1eb3e0d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67aff19e01816446 server_cookie=6d840ec13bbabf5e in_seq=0 out_seq=0 2024-04-25T08:59:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96c27fc640 1 -- 172.21.15.5:0/2056421304 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55da1ea863a0 con 0x55da1eb3dcc0 2024-04-25T08:59:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96c27fc640 10 client.5862 handle_command_reply: tid=0 2024-04-25T08:59:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 client.5862 shutdown 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 msgr2=0x55da1eb3f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb3f040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009990 tx=0x7f96d8004730 comp rx=0 tx=0).stop 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 shutdown_connections 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3dcc0 0x55da1eb3e0d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb41a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb3f040 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/2056421304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb3fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96c27fc640 0 client.5862 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 >> 172.21.15.5:0/2056421304 conn(0x55da1eadcf70 msgr2=0x55da1eb5ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 shutdown_connections 2024-04-25T08:59:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 1 -- 172.21.15.5:0/2056421304 wait complete. 2024-04-25T08:59:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.460+0000 7f96ecbb7740 20 client.5862 trim_cache size 0 max 16384 2024-04-25T08:59:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.476+0000 7f96ecbb7740 1 Processor -- start 2024-04-25T08:59:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.476+0000 7f96ecbb7740 1 -- start start 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb5ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb73dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb74310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4200050 con 0x55da1eb3caf0 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40c7e50 con 0x55da1eb16130 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e415ec00 con 0x55da1eb5bf60 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb73dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb73dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43854/0 (socket says 172.21.15.5:43854) 2024-04-25T08:59:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 -- 172.21.15.5:0/3052856642 learned_addr learned my addr 172.21.15.5:0/3052856642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e37fe640 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb5ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 -- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 msgr2=0x55da1eb74310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e3fff640 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb74310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb74310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 -- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 msgr2=0x55da1eb5ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb5ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e2ffd640 1 -- 172.21.15.5:0/3052856642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da1e7268b0 con 0x55da1eb3caf0 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.477+0000 7f96e37fe640 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb5ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.478+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb73dd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f96d8032fb0 tx=0x7f96d8041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd5c112f79850c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.478+0000 7f96c8ff9640 1 -- 172.21.15.5:0/3052856642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8037040 con 0x55da1eb3caf0 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.478+0000 7f96c8ff9640 1 -- 172.21.15.5:0/3052856642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8050070 con 0x55da1eb3caf0 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.478+0000 7f96c8ff9640 1 -- 172.21.15.5:0/3052856642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d803e970 con 0x55da1eb3caf0 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.478+0000 7f96ecbb7740 1 -- 172.21.15.5:0/3052856642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 msgr2=0x55da1eb73dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.478+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb73dd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f96d8032fb0 tx=0x7f96d8041000 comp rx=0 tx=0).stop 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 -- 172.21.15.5:0/3052856642 shutdown_connections 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb5bf60 0x55da1eb74310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1eb73dd0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/3052856642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb16130 0x55da1eb5ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 -- 172.21.15.5:0/3052856642 >> 172.21.15.5:0/3052856642 conn(0x55da1eadcf70 msgr2=0x55da1eb0b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 -- 172.21.15.5:0/3052856642 shutdown_connections 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 -- 172.21.15.5:0/3052856642 wait complete. 2024-04-25T08:59:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 -- start start 2024-04-25T08:59:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.479+0000 7f96ecbb7740 1 Processor -- start 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb16130 0x55da1ebc3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1ebc7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96ecbb7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1ebc7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1eb40870 con 0x55da1eb3caf0 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40c7850 con 0x55da1eb5bf60 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96ecbb7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da1eb13da0 con 0x55da1eb16130 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96ecbb7740 10 client.0 _ll_register_callbacks cb 0x7f96d8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1ebc7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e37fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb16130 0x55da1ebc3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1ebc7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43858/0 (socket says 172.21.15.5:43858) 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 -- 172.21.15.5:0/605587530 learned_addr learned my addr 172.21.15.5:0/605587530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e3fff640 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1ebc7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 -- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb16130 msgr2=0x55da1ebc3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb16130 0x55da1ebc3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 -- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 msgr2=0x55da1ebc7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1ebc7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e2ffd640 1 -- 172.21.15.5:0/605587530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da1eb73dd0 con 0x55da1eb3caf0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.480+0000 7f96e37fe640 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb16130 0x55da1ebc3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96e2ffd640 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1ebc7890 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f96d802a860 tx=0x7f96d8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89419968be792a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96c27fc640 1 -- 172.21.15.5:0/605587530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8037040 con 0x55da1eb3caf0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96c27fc640 1 -- 172.21.15.5:0/605587530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f96d8044040 con 0x55da1eb3caf0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96d8050070 con 0x55da1eb3caf0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96c27fc640 1 -- 172.21.15.5:0/605587530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96d806c050 con 0x55da1eb3caf0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 10 client.5868 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55da1eb5d1f0 con 0x55da1eb3caf0 2024-04-25T08:59:31.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96c27fc640 1 -- 172.21.15.5:0/605587530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8050070 con 0x55da1eb3caf0 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96c27fc640 1 -- 172.21.15.5:0/605587530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f96d806f020 con 0x55da1eb3caf0 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 10 client.5868 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 10 client.5868 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 20 client.5868 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3bf70 0x55da1ebc8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 4 client.5868 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x55da1ea806f0 con 0x55da1eb3bf70 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.481+0000 7f96e37fe640 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3bf70 0x55da1ebc8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96c27fc640 10 client.5868 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96e37fe640 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3bf70 0x55da1ebc8310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23ae7cb71a4259cc server_cookie=bf5c8f752e2d69f2 in_seq=0 out_seq=0 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96c27fc640 1 -- 172.21.15.5:0/605587530 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55da1ea806f0 con 0x55da1eb3bf70 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96c27fc640 10 client.5868 handle_command_reply: tid=0 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 client.5868 shutdown 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 msgr2=0x55da1ebc7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1ebc7890 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f96d802a860 tx=0x7f96d8008030 comp rx=0 tx=0).stop 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 shutdown_connections 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55da1eb3bf70 0x55da1ebc8310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96c27fc640 0 client.5868 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da1eb5bf60 0x55da1ebc7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55da1eb3caf0 0x55da1ebc7890 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 --2- 172.21.15.5:0/605587530 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55da1eb16130 0x55da1ebc3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.482+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 >> 172.21.15.5:0/605587530 conn(0x55da1eadcf70 msgr2=0x55da1eb40a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 shutdown_connections 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96ecbb7740 1 -- 172.21.15.5:0/605587530 wait complete. 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96ecbb7740 20 client.5868 trim_cache size 0 max 16384 2024-04-25T08:59:31.477 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:31.478 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:31.478 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "5ef9fabf-3036-4582-9f7c-60b5ecbfcae7", 2024-04-25T08:59:31.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:31.478 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f96d006b4d0 msgr2=0x7f96d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f96d006b4d0 0x7f96d006d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f96d8034000 tx=0x7f96d802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 msgr2=0x7f96e40c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40c89a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c3f0 tx=0x7f96d400c8b0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 shutdown_connections 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f96d006b4d0 0x7f96d006d990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96e415df10 0x7f96e40ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96e40cee10 0x7f96e40caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 --2- 172.21.15.5:0/3046785795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b6250 0x7f96e40c89a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 >> 172.21.15.5:0/3046785795 conn(0x7f96e40668f0 msgr2=0x7f96e40ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 shutdown_connections 2024-04-25T08:59:31.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.483+0000 7f96e9ebc640 1 -- 172.21.15.5:0/3046785795 wait complete. 2024-04-25T08:59:31.482 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '5ef9fabf-3036-4582-9f7c-60b5ecbfcae7', 'mode': 'asynchronous'}' 2024-04-25T08:59:31.482 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-04-25T08:59:31.482 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T08:59:31.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.594+0000 7f664e9e7640 1 Processor -- start 2024-04-25T08:59:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.594+0000 7f664e9e7640 1 -- start start 2024-04-25T08:59:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664e9e7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480d3990 0x7f66480d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664e9e7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66480b6f50 0x7f66480b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664e9e7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66480b29c0 con 0x7f664815e0a0 2024-04-25T08:59:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664e9e7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66480d4330 con 0x7f66480b6f50 2024-04-25T08:59:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664e9e7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66480d1460 con 0x7f66480d3990 2024-04-25T08:59:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664cf84640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66480b6f50 0x7f66480b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664cf84640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66480b6f50 0x7f66480b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43872/0 (socket says 172.21.15.5:43872) 2024-04-25T08:59:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.595+0000 7f664cf84640 1 -- 172.21.15.5:0/2365127221 learned_addr learned my addr 172.21.15.5:0/2365127221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.596+0000 7f66477fe640 1 --2- 172.21.15.5:0/2365127221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480d3990 0x7f66480d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.596+0000 7f664cf84640 1 -- 172.21.15.5:0/2365127221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480d3990 msgr2=0x7f66480d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.596+0000 7f664cf84640 1 --2- 172.21.15.5:0/2365127221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480d3990 0x7f66480d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.596+0000 7f664cf84640 1 -- 172.21.15.5:0/2365127221 >> v1:172.21.15.80:6789/0 conn(0x7f664815e0a0 legacy=0x7f66480d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.596+0000 7f664cf84640 1 -- 172.21.15.5:0/2365127221 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480d2080 con 0x7f66480b6f50 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.596+0000 7f664cf84640 1 --2- 172.21.15.5:0/2365127221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66480b6f50 0x7f66480b73e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6640009e50 tx=0x7f664002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1369fa1ed7d71eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f6646ffd640 1 -- 172.21.15.5:0/2365127221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640036070 con 0x7f66480b6f50 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f6646ffd640 1 -- 172.21.15.5:0/2365127221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6640031600 con 0x7f66480b6f50 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f6646ffd640 1 -- 172.21.15.5:0/2365127221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66400319d0 con 0x7f66480b6f50 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 -- 172.21.15.5:0/2365127221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66480b6f50 msgr2=0x7f66480b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 --2- 172.21.15.5:0/2365127221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66480b6f50 0x7f66480b73e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6640009e50 tx=0x7f664002a710 comp rx=0 tx=0).stop 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 -- 172.21.15.5:0/2365127221 shutdown_connections 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 --2- 172.21.15.5:0/2365127221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66480b6f50 0x7f66480b73e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 --2- 172.21.15.5:0/2365127221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480d3990 0x7f66480d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 -- 172.21.15.5:0/2365127221 >> 172.21.15.5:0/2365127221 conn(0x7f66480668f0 msgr2=0x7f6648066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 -- 172.21.15.5:0/2365127221 shutdown_connections 2024-04-25T08:59:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.597+0000 7f664e9e7640 1 -- 172.21.15.5:0/2365127221 wait complete. 2024-04-25T08:59:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.598+0000 7f664e9e7640 1 Processor -- start 2024-04-25T08:59:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664e9e7640 1 -- start start 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664e9e7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480b6f50 0x7f66481f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664e9e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66480d3990 0x7f66481e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664e9e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f664815e0a0 0x7f66481e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664e9e7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480d2920 con 0x7f664815e0a0 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664e9e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480d2640 con 0x7f66480d3990 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664e9e7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66480d2c00 con 0x7f66480b6f50 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664cf84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f664815e0a0 0x7f66481e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664cf84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f664815e0a0 0x7f66481e84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43886/0 (socket says 172.21.15.5:43886) 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.599+0000 7f664cf84640 1 -- 172.21.15.5:0/692169688 learned_addr learned my addr 172.21.15.5:0/692169688 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f66477fe640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66480d3990 0x7f66481e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f6647fff640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480b6f50 0x7f66481f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664cf84640 1 -- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480b6f50 msgr2=0x7f66481f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664cf84640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480b6f50 0x7f66481f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664cf84640 1 -- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66480d3990 msgr2=0x7f66481e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664cf84640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66480d3990 0x7f66481e7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664cf84640 1 -- 172.21.15.5:0/692169688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480cbf00 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f66477fe640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66480d3990 0x7f66481e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664cf84640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f664815e0a0 0x7f66481e84e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6640034040 tx=0x7f6640004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f6644ff9640 1 -- 172.21.15.5:0/692169688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664003f020 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f6644ff9640 1 -- 172.21.15.5:0/692169688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6640037040 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66481e6f00 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f6644ff9640 1 -- 172.21.15.5:0/692169688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640036070 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.600+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66481e74c0 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.601+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66480cf7c0 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.602+0000 7f6644ff9640 1 -- 172.21.15.5:0/692169688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6640042020 con 0x7f664815e0a0 2024-04-25T08:59:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.602+0000 7f6644ff9640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663406b4d0 0x7f663406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.602+0000 7f6644ff9640 1 -- 172.21.15.5:0/692169688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f66400aa610 con 0x7f664815e0a0 2024-04-25T08:59:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.602+0000 7f6647fff640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663406b4d0 0x7f663406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.603+0000 7f6647fff640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663406b4d0 0x7f663406d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6638007fd0 tx=0x7f6638009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.606+0000 7f6644ff9640 1 -- 172.21.15.5:0/692169688 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f66480cf7c0 con 0x7f664815e0a0 2024-04-25T08:59:31.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.826+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f664804ef20 con 0x7f664815e0a0 2024-04-25T08:59:31.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.826+0000 7f6644ff9640 1 -- 172.21.15.5:0/692169688 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f6640049030 con 0x7f664815e0a0 2024-04-25T08:59:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:31.816 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:31.816 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.828+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663406b4d0 msgr2=0x7f663406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.828+0000 7f664e9e7640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663406b4d0 0x7f663406d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6638007fd0 tx=0x7f6638009040 comp rx=0 tx=0).stop 2024-04-25T08:59:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.828+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f664815e0a0 msgr2=0x7f66481e84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.828+0000 7f664e9e7640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f664815e0a0 0x7f66481e84e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6640034040 tx=0x7f6640004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.828+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 shutdown_connections 2024-04-25T08:59:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.828+0000 7f664e9e7640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663406b4d0 0x7f663406d990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.829+0000 7f664e9e7640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f664815e0a0 0x7f66481e84e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.829+0000 7f664e9e7640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66480d3990 0x7f66481e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.829+0000 7f664e9e7640 1 --2- 172.21.15.5:0/692169688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66480b6f50 0x7f66481f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.829+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 >> 172.21.15.5:0/692169688 conn(0x7f66480668f0 msgr2=0x7f66480cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.829+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 shutdown_connections 2024-04-25T08:59:31.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:31.829+0000 7f664e9e7640 1 -- 172.21.15.5:0/692169688 wait complete. 2024-04-25T08:59:31.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path / 2024-04-25T08:59:31.936 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:31.936 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:31.937 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:31.945 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:31.945 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-04-25T08:59:31.945 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:31.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-04-25T08:59:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.061+0000 7fd7f3d14640 1 Processor -- start 2024-04-25T08:59:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.061+0000 7fd7f3d14640 1 -- start start 2024-04-25T08:59:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f3d14640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7ec15bce0 0x7fd7ec06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f3d14640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7ec0cf790 0x7fd7ec0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f3d14640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b3480 0x7fd7ec0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f3d14640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec15c0c0 con 0x7fd7ec0cf790 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f3d14640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec070e90 con 0x7fd7ec15bce0 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f3d14640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec071170 con 0x7fd7ec0b3480 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7ec0cf790 0x7fd7ec0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7ec0cf790 0x7fd7ec0cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43898/0 (socket says 172.21.15.5:43898) 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 -- 172.21.15.5:0/920920228 learned_addr learned my addr 172.21.15.5:0/920920228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/920920228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b3480 0x7fd7ec0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/920920228 >> v2:172.21.15.80:3300/0 conn(0x7fd7ec15bce0 0x7fd7ec06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 -- 172.21.15.5:0/920920228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b3480 msgr2=0x7fd7ec0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 --2- 172.21.15.5:0/920920228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b3480 0x7fd7ec0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 -- 172.21.15.5:0/920920228 >> v2:172.21.15.80:3300/0 conn(0x7fd7ec15bce0 msgr2=0x7fd7ec06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 --2- 172.21.15.5:0/920920228 >> v2:172.21.15.80:3300/0 conn(0x7fd7ec15bce0 0x7fd7ec06c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.062+0000 7fd7f12af640 1 -- 172.21.15.5:0/920920228 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec071450 con 0x7fd7ec0cf790 2024-04-25T08:59:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.063+0000 7fd7f12af640 1 --2- 172.21.15.5:0/920920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec0cfc20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec06ac50 tx=0x7fd7dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a66a2f3e70eb5bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.063+0000 7fd7f0aae640 1 -- 172.21.15.5:0/920920228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc037070 con 0x7fd7ec0cf790 2024-04-25T08:59:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.063+0000 7fd7f0aae640 1 -- 172.21.15.5:0/920920228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc032440 con 0x7fd7ec0cf790 2024-04-25T08:59:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.063+0000 7fd7f0aae640 1 -- 172.21.15.5:0/920920228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc032810 con 0x7fd7ec0cf790 2024-04-25T08:59:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 -- 172.21.15.5:0/920920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 msgr2=0x7fd7ec0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/920920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec0cfc20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec06ac50 tx=0x7fd7dc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 -- 172.21.15.5:0/920920228 shutdown_connections 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/920920228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b3480 0x7fd7ec0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/920920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec0cfc20 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/920920228 >> v2:172.21.15.80:3300/0 conn(0x7fd7ec15bce0 0x7fd7ec06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 -- 172.21.15.5:0/920920228 >> 172.21.15.5:0/920920228 conn(0x7fd7ec0b1550 msgr2=0x7fd7ec0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 -- 172.21.15.5:0/920920228 shutdown_connections 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.064+0000 7fd7f3d14640 1 -- 172.21.15.5:0/920920228 wait complete. 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.065+0000 7fd7f3d14640 1 Processor -- start 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.065+0000 7fd7f3d14640 1 -- start start 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f3d14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0b3480 0x7fd7ec15c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f3d14640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f3d14640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec15bce0 0x7fd7ec1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f3d14640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b3dd0 con 0x7fd7ec0cf790 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f3d14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b4140 con 0x7fd7ec0b3480 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f3d14640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec06c940 con 0x7fd7ec15bce0 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec15cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43906/0 (socket says 172.21.15.5:43906) 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 -- 172.21.15.5:0/177495580 learned_addr learned my addr 172.21.15.5:0/177495580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec15bce0 0x7fd7ec1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 -- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec15bce0 msgr2=0x7fd7ec1f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec15bce0 0x7fd7ec1f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0b3480 0x7fd7ec15c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 -- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0b3480 msgr2=0x7fd7ec15c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0b3480 0x7fd7ec15c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 -- 172.21.15.5:0/177495580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec1f5b20 con 0x7fd7ec0cf790 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.066+0000 7fd7f12af640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec15cf30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc000c00 tx=0x7fd7dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.067+0000 7fd7e27fc640 1 -- 172.21.15.5:0/177495580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc037040 con 0x7fd7ec0cf790 2024-04-25T08:59:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.067+0000 7fd7e27fc640 1 -- 172.21.15.5:0/177495580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc042070 con 0x7fd7ec0cf790 2024-04-25T08:59:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.067+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec1f4fa0 con 0x7fd7ec0cf790 2024-04-25T08:59:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.067+0000 7fd7e27fc640 1 -- 172.21.15.5:0/177495580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc030bb0 con 0x7fd7ec0cf790 2024-04-25T08:59:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.067+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec1f5560 con 0x7fd7ec0cf790 2024-04-25T08:59:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.068+0000 7fd7e27fc640 1 -- 172.21.15.5:0/177495580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd7dc047460 con 0x7fd7ec0cf790 2024-04-25T08:59:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.069+0000 7fd7e27fc640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d006b4d0 0x7fd7d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.069+0000 7fd7e27fc640 1 -- 172.21.15.5:0/177495580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd7dc0aade0 con 0x7fd7ec0cf790 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.069+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d006b4d0 0x7fd7d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.069+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d006b4d0 0x7fd7d006d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec06d270 tx=0x7fd7e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 Processor -- start 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 -- start start 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44a0c40 0x561ae44a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae4409a50 con 0x561ae44a0c40 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae43b2d40 con 0x561ae44cdfe0 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.070+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae4405af0 con 0x561ae44ce3c0 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44a0c40 0x561ae44a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44a0c40 0x561ae44a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43908/0 (socket says 172.21.15.5:43908) 2024-04-25T08:59:32.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 -- 172.21.15.5:0/1152487834 learned_addr learned my addr 172.21.15.5:0/1152487834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f12af640 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 -- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 msgr2=0x561ae44d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44d0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 -- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 msgr2=0x561ae44d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 -- 172.21.15.5:0/1152487834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae41ea690 con 0x561ae44a0c40 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44a0c40 0x561ae44a4450 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4008f00 tx=0x7fd7e400d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629291547ebded48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7cf7fe640 1 -- 172.21.15.5:0/1152487834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4003da0 con 0x561ae44a0c40 2024-04-25T08:59:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7cf7fe640 1 -- 172.21.15.5:0/1152487834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4004030 con 0x561ae44a0c40 2024-04-25T08:59:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.071+0000 7fd7cf7fe640 1 -- 172.21.15.5:0/1152487834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4004400 con 0x561ae44a0c40 2024-04-25T08:59:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 -- 172.21.15.5:0/1152487834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44a0c40 msgr2=0x561ae44a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44a0c40 0x561ae44a4450 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4008f00 tx=0x7fd7e400d750 comp rx=0 tx=0).stop 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 -- 172.21.15.5:0/1152487834 shutdown_connections 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44a0c40 0x561ae44a4450 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/1152487834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 -- 172.21.15.5:0/1152487834 >> 172.21.15.5:0/1152487834 conn(0x561ae44a2eb0 msgr2=0x561ae44eb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 -- 172.21.15.5:0/1152487834 shutdown_connections 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 -- 172.21.15.5:0/1152487834 wait complete. 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.072+0000 7fd7f6a18740 1 -- start start 2024-04-25T08:59:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.073+0000 7fd7f6a18740 1 Processor -- start 2024-04-25T08:59:32.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.073+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.073+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.073+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ec920 0x561ae44ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.073+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae44a6060 con 0x561ae44cdfe0 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.073+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae43a8340 con 0x561ae44ec920 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.073+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae44a6340 con 0x561ae44ce3c0 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f6a18740 10 client.0 _ll_register_callbacks cb 0x561ae43c5cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43920/0 (socket says 172.21.15.5:43920) 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2914992936 learned_addr learned my addr 172.21.15.5:0/2914992936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 msgr2=0x561ae44c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ec920 0x561ae44ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ec920 msgr2=0x561ae44ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ec920 0x561ae44ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2914992936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ae424ae20 con 0x561ae44cdfe0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c5400 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80126f0 tx=0x7fd7e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae2938af701942 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2914992936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8023020 con 0x561ae44cdfe0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2914992936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd7e8004440 con 0x561ae44cdfe0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7e4004030 con 0x561ae44cdfe0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2914992936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e802d050 con 0x561ae44cdfe0 2024-04-25T08:59:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f6a18740 10 client.5886 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x561ae40ddf80 con 0x561ae44cdfe0 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.074+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2914992936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4004030 con 0x561ae44cdfe0 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2914992936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd7e8030020 con 0x561ae44cdfe0 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f6a18740 10 client.5886 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f6a18740 10 client.5886 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f6a18740 20 client.5886 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae44ee110 0x561ae44eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f6a18740 4 client.5886 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ae4416f90 con 0x561ae44ee110 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae44ee110 0x561ae44eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7ccff9640 10 client.5886 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.075+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae44ee110 0x561ae44eeae0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5028b053fe0053c server_cookie=39c5b6325f6340a8 in_seq=0 out_seq=0 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2914992936 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561ae4416f90 con 0x561ae44ee110 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7ccff9640 10 client.5886 handle_command_reply: tid=0 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 client.5886 shutdown 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 msgr2=0x561ae44c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c5400 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80126f0 tx=0x7fd7e80046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 shutdown_connections 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae44ee110 0x561ae44eeae0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ec920 0x561ae44ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ce3c0 0x561ae44c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2914992936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c5400 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7ccff9640 0 client.5886 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 >> 172.21.15.5:0/2914992936 conn(0x561ae44a0c40 msgr2=0x561ae44cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 shutdown_connections 2024-04-25T08:59:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2914992936 wait complete. 2024-04-25T08:59:32.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.076+0000 7fd7f6a18740 20 client.5886 trim_cache size 0 max 16384 2024-04-25T08:59:32.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.091+0000 7fd7f6a18740 1 Processor -- start 2024-04-25T08:59:32.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.091+0000 7fd7f6a18740 1 -- start start 2024-04-25T08:59:32.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae44a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1fdf10 con 0x561ae44cdfe0 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1fd0b0 con 0x561ae44ce3c0 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1f1c10 con 0x561ae44ec920 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43926/0 (socket says 172.21.15.5:43926) 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2772116483 learned_addr learned my addr 172.21.15.5:0/2772116483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 msgr2=0x561ae44a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae44a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae44a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ce3c0 msgr2=0x561ae44c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f1ab0640 1 -- 172.21.15.5:0/2772116483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae44c9540 con 0x561ae44cdfe0 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.092+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bdb0 tx=0x7fd7e8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34f09f9a6f749eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7ceffd640 1 -- 172.21.15.5:0/2772116483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8023050 con 0x561ae44cdfe0 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7ceffd640 1 -- 172.21.15.5:0/2772116483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8035070 con 0x561ae44cdfe0 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7ceffd640 1 -- 172.21.15.5:0/2772116483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8019040 con 0x561ae44cdfe0 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2772116483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 msgr2=0x561ae44c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bdb0 tx=0x7fd7e8020000 comp rx=0 tx=0).stop 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2772116483 shutdown_connections 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae44a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2772116483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2772116483 >> 172.21.15.5:0/2772116483 conn(0x561ae44a0c40 msgr2=0x561ae44eb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2772116483 shutdown_connections 2024-04-25T08:59:32.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.093+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2772116483 wait complete. 2024-04-25T08:59:32.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.094+0000 7fd7f6a18740 1 -- start start 2024-04-25T08:59:32.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.094+0000 7fd7f6a18740 1 Processor -- start 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f6a18740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae455a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae44cc780 con 0x561ae44ce3c0 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1f2210 con 0x561ae44cdfe0 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f6a18740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae44eb090 con 0x561ae44ec920 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f6a18740 10 client.0 _ll_register_callbacks cb 0x7fd7e800be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43936/0 (socket says 172.21.15.5:43936) 2024-04-25T08:59:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 -- 172.21.15.5:0/2169259340 learned_addr learned my addr 172.21.15.5:0/2169259340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f22b1640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae455a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 -- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 msgr2=0x561ae455a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae455a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 -- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 msgr2=0x561ae44c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 -- 172.21.15.5:0/2169259340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ae44d3560 con 0x561ae44ce3c0 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7f12af640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ab100 tx=0x7fd7dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1991e5cb0cfe631 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.095+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2169259340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0a6020 con 0x561ae44ce3c0 2024-04-25T08:59:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2169259340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd7dc030d50 con 0x561ae44ce3c0 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7e8035070 con 0x561ae44ce3c0 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2169259340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7dc07d700 con 0x561ae44ce3c0 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 10 client.5892 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x561ae44c6bf0 con 0x561ae44ce3c0 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2169259340 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8035070 con 0x561ae44ce3c0 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2169259340 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd7dc03a030 con 0x561ae44ce3c0 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 10 client.5892 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 10 client.5892 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 20 client.5892 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae450ebe0 0x561ae455a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 4 client.5892 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-04-25T08:59:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x561ae44c98f0 con 0x561ae450ebe0 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae450ebe0 0x561ae455a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7f1ab0640 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae450ebe0 0x561ae455a830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c1429816f2cd12 server_cookie=58484ff305d1d665 in_seq=0 out_seq=0 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.096+0000 7fd7ccff9640 10 client.5892 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7ccff9640 1 -- 172.21.15.5:0/2169259340 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561ae44c98f0 con 0x561ae450ebe0 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7ccff9640 10 client.5892 handle_command_reply: tid=0 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 client.5892 shutdown 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44ce3c0 msgr2=0x561ae44c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ab100 tx=0x7fd7dc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 shutdown_connections 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561ae450ebe0 0x561ae455a830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561ae44ec920 0x561ae455a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ae44ce3c0 0x561ae44c7cf0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7ccff9640 0 client.5892 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 --2- 172.21.15.5:0/2169259340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ae44cdfe0 0x561ae44c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 >> 172.21.15.5:0/2169259340 conn(0x561ae44a0c40 msgr2=0x561ae44c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 shutdown_connections 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 1 -- 172.21.15.5:0/2169259340 wait complete. 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.097+0000 7fd7f6a18740 20 client.5892 trim_cache size 0 max 16384 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "577ff95f-768b-4445-9578-349e458d1bee", 2024-04-25T08:59:32.093 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:32.094 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d006b4d0 msgr2=0x7fd7d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d006b4d0 0x7fd7d006d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec06d270 tx=0x7fd7e8008040 comp rx=0 tx=0).stop 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 msgr2=0x7fd7ec15cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec15cf30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc000c00 tx=0x7fd7dc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 shutdown_connections 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d006b4d0 0x7fd7d006d990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec15bce0 0x7fd7ec1f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0cf790 0x7fd7ec15cf30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 --2- 172.21.15.5:0/177495580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0b3480 0x7fd7ec15c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 >> 172.21.15.5:0/177495580 conn(0x7fd7ec0b1550 msgr2=0x7fd7ec0af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 shutdown_connections 2024-04-25T08:59:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.098+0000 7fd7f3d14640 1 -- 172.21.15.5:0/177495580 wait complete. 2024-04-25T08:59:32.098 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '577ff95f-768b-4445-9578-349e458d1bee', 'mode': 'asynchronous'}' 2024-04-25T08:59:32.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:32.098 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-04-25T08:59:32.115 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-04-25T08:59:32.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.268+0000 7fef3b815640 1 Processor -- start 2024-04-25T08:59:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.268+0000 7fef3b815640 1 -- start start 2024-04-25T08:59:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef3b815640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef340b2cc0 0x7fef340b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef3b815640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340d20e0 con 0x7fef340b7130 2024-04-25T08:59:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef3b815640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340d23c0 con 0x7fef3415de70 2024-04-25T08:59:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef3b815640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef340d2a10 con 0x7fef340b2cc0 2024-04-25T08:59:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef39db2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef340b7130 0x7fef340ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60416/0 (socket says 172.21.15.5:60416) 2024-04-25T08:59:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef39db2640 1 -- 172.21.15.5:0/2932272765 learned_addr learned my addr 172.21.15.5:0/2932272765 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef38db0640 1 --2- 172.21.15.5:0/2932272765 >> v2:172.21.15.80:3300/0 conn(0x7fef340b2cc0 0x7fef340b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef2bfff640 1 -- 172.21.15.5:0/2932272765 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061931122 0 0) 0x7fef340d20e0 con 0x7fef340b7130 2024-04-25T08:59:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.269+0000 7fef2bfff640 1 -- 172.21.15.5:0/2932272765 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef20003520 con 0x7fef340b7130 2024-04-25T08:59:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.270+0000 7fef38db0640 1 -- 172.21.15.5:0/2932272765 >> v1:172.21.15.80:6789/0 conn(0x7fef3415de70 legacy=0x7fef340b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.270+0000 7fef38db0640 1 -- 172.21.15.5:0/2932272765 >> v1:172.21.15.5:6789/0 conn(0x7fef340b7130 legacy=0x7fef340ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.270+0000 7fef38db0640 1 -- 172.21.15.5:0/2932272765 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340d26a0 con 0x7fef340b2cc0 2024-04-25T08:59:32.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.270+0000 7fef38db0640 1 --2- 172.21.15.5:0/2932272765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef340b2cc0 0x7fef340b6bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef240097d0 tx=0x7fef2402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac1dd9b08708fc42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.270+0000 7fef2bfff640 1 -- 172.21.15.5:0/2932272765 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24037070 con 0x7fef340b2cc0 2024-04-25T08:59:32.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef2bfff640 1 -- 172.21.15.5:0/2932272765 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24032440 con 0x7fef340b2cc0 2024-04-25T08:59:32.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef2bfff640 1 -- 172.21.15.5:0/2932272765 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240327f0 con 0x7fef340b2cc0 2024-04-25T08:59:32.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef3b815640 1 -- 172.21.15.5:0/2932272765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef340b2cc0 msgr2=0x7fef340b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef3b815640 1 --2- 172.21.15.5:0/2932272765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef340b2cc0 0x7fef340b6bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef240097d0 tx=0x7fef2402a270 comp rx=0 tx=0).stop 2024-04-25T08:59:32.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef3b815640 1 -- 172.21.15.5:0/2932272765 shutdown_connections 2024-04-25T08:59:32.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef3b815640 1 --2- 172.21.15.5:0/2932272765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef340b2cc0 0x7fef340b6bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef3b815640 1 -- 172.21.15.5:0/2932272765 >> 172.21.15.5:0/2932272765 conn(0x7fef3406b000 msgr2=0x7fef3406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef3b815640 1 -- 172.21.15.5:0/2932272765 shutdown_connections 2024-04-25T08:59:32.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.271+0000 7fef3b815640 1 -- 172.21.15.5:0/2932272765 wait complete. 2024-04-25T08:59:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.272+0000 7fef3b815640 1 Processor -- start 2024-04-25T08:59:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.272+0000 7fef3b815640 1 -- start start 2024-04-25T08:59:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef3b815640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef340b2cc0 0x7fef3414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef3b815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef340b7130 0x7fef341f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef3b815640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3415de70 0x7fef340cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef3b815640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340d2ea0 con 0x7fef340b7130 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef3b815640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340cf110 con 0x7fef3415de70 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef3b815640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef340d3020 con 0x7fef340b2cc0 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef38db0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef340b7130 0x7fef341f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef38db0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef340b7130 0x7fef341f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43948/0 (socket says 172.21.15.5:43948) 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef38db0640 1 -- 172.21.15.5:0/1681633125 learned_addr learned my addr 172.21.15.5:0/1681633125 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef39db2640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3415de70 0x7fef340cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.273+0000 7fef395b1640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef340b2cc0 0x7fef3414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef38db0640 1 -- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef340b2cc0 msgr2=0x7fef3414ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef38db0640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef340b2cc0 0x7fef3414ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef38db0640 1 -- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3415de70 msgr2=0x7fef340cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef38db0640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3415de70 0x7fef340cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef38db0640 1 -- 172.21.15.5:0/1681633125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340cd3f0 con 0x7fef340b7130 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef38db0640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef340b7130 0x7fef341f64a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fef240097d0 tx=0x7fef240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef29ffb640 1 -- 172.21.15.5:0/1681633125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24037050 con 0x7fef340b7130 2024-04-25T08:59:32.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef29ffb640 1 -- 172.21.15.5:0/1681633125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24038040 con 0x7fef340b7130 2024-04-25T08:59:32.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef29ffb640 1 -- 172.21.15.5:0/1681633125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24004470 con 0x7fef340b7130 2024-04-25T08:59:32.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef340cd6d0 con 0x7fef340b7130 2024-04-25T08:59:32.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.274+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef340b4820 con 0x7fef340b7130 2024-04-25T08:59:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.275+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef340b4610 con 0x7fef340b7130 2024-04-25T08:59:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.276+0000 7fef29ffb640 1 -- 172.21.15.5:0/1681633125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef2403c6d0 con 0x7fef340b7130 2024-04-25T08:59:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.276+0000 7fef29ffb640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef1806b500 0x7fef1806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.276+0000 7fef29ffb640 1 -- 172.21.15.5:0/1681633125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fef240aacb0 con 0x7fef340b7130 2024-04-25T08:59:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.276+0000 7fef395b1640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef1806b500 0x7fef1806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.277+0000 7fef395b1640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef1806b500 0x7fef1806d9c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fef30007fd0 tx=0x7fef30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.280+0000 7fef29ffb640 1 -- 172.21.15.5:0/1681633125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef24079a70 con 0x7fef340b7130 2024-04-25T08:59:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.500+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef3404ef20 con 0x7fef340b7130 2024-04-25T08:59:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.500+0000 7fef29ffb640 1 -- 172.21.15.5:0/1681633125 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fef24079370 con 0x7fef340b7130 2024-04-25T08:59:32.489 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:32.489 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:32.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef1806b500 msgr2=0x7fef1806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef1806b500 0x7fef1806d9c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fef30007fd0 tx=0x7fef30009040 comp rx=0 tx=0).stop 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef340b7130 msgr2=0x7fef341f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef340b7130 0x7fef341f64a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fef240097d0 tx=0x7fef240046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 shutdown_connections 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef1806b500 0x7fef1806d9c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3415de70 0x7fef340cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef340b7130 0x7fef341f64a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 --2- 172.21.15.5:0/1681633125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef340b2cc0 0x7fef3414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 >> 172.21.15.5:0/1681633125 conn(0x7fef3406b000 msgr2=0x7fef340ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 shutdown_connections 2024-04-25T08:59:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.503+0000 7fef3b815640 1 -- 172.21.15.5:0/1681633125 wait complete. 2024-04-25T08:59:32.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-04-25T08:59:32.612 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:32.612 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:32.613 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:32.621 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:32.622 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:32.622 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:32.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:32.638 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-04-25T08:59:32.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T08:59:32.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T08:59:32.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756982 s, 139 MB/s 2024-04-25T08:59:32.702 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-04-25T08:59:32.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.854+0000 7efca00e1640 1 Processor -- start 2024-04-25T08:59:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.854+0000 7efca00e1640 1 -- start start 2024-04-25T08:59:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.855+0000 7efca00e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 0x7efc9815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.855+0000 7efca00e1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9815be80 con 0x7efc98071de0 2024-04-25T08:59:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.855+0000 7efca00e1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc98072290 con 0x7efc98158b60 2024-04-25T08:59:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.855+0000 7efca00e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815b5e0 con 0x7efc98154f80 2024-04-25T08:59:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.855+0000 7efc9d67c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc98071de0 0x7efc9815eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60432/0 (socket says 172.21.15.5:60432) 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.855+0000 7efc9d67c640 1 -- 172.21.15.5:0/238977872 learned_addr learned my addr 172.21.15.5:0/238977872 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.855+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758375251 0 0) 0x7efc9815be80 con 0x7efc98071de0 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc80003520 con 0x7efc98071de0 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9de7d640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 0x7efc9815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564111173 0 0) 0x7efc80003520 con 0x7efc98071de0 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 msgr2=0x7efc9815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 0x7efc9815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 >> v1:172.21.15.80:6789/0 conn(0x7efc98158b60 legacy=0x7efc980b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9815b8c0 con 0x7efc98071de0 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7efc8c001670 con 0x7efc98071de0 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9de7d640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 0x7efc9815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 >> v1:172.21.15.5:6789/0 conn(0x7efc98071de0 legacy=0x7efc9815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 0x7efc800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80003fd0 0x7efc80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc80004d40 0x7efc800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815b5e0 con 0x7efc80003fd0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8000bbb0 con 0x7efc80004d40 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8000bdb0 con 0x7efc98154f80 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9d67c640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80003fd0 0x7efc80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9de7d640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 0x7efc800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9e67e640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc80004d40 0x7efc800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9d67c640 1 -- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 msgr2=0x7efc800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9d67c640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc98154f80 0x7efc800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9d67c640 1 -- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc80004d40 msgr2=0x7efc800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9d67c640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc80004d40 0x7efc800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.856+0000 7efc9d67c640 1 -- 172.21.15.5:0/238977872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80003520 con 0x7efc80003fd0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.857+0000 7efc9d67c640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80003fd0 0x7efc80004800 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c240 tx=0x7efc80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa14b297e1633a98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.857+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007d10 con 0x7efc80003fd0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.857+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c005ad0 con 0x7efc80003fd0 2024-04-25T08:59:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.857+0000 7efc9ce7b640 1 -- 172.21.15.5:0/238977872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007070 con 0x7efc80003fd0 2024-04-25T08:59:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.858+0000 7efca00e1640 1 -- 172.21.15.5:0/238977872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80003fd0 msgr2=0x7efc80004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.858+0000 7efca00e1640 1 --2- 172.21.15.5:0/238977872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc80003fd0 0x7efc80004800 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c240 tx=0x7efc80005830 comp rx=0 tx=0).stop 2024-04-25T08:59:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.858+0000 7efc9e67e640 1 -- 172.21.15.5:0/238977872 reap_dead start 2024-04-25T08:59:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.858+0000 7efca00e1640 1 -- 172.21.15.5:0/238977872 shutdown_connections 2024-04-25T08:59:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.858+0000 7efca00e1640 1 -- 172.21.15.5:0/238977872 >> 172.21.15.5:0/238977872 conn(0x7efc980668f0 msgr2=0x7efc98066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.858+0000 7efca00e1640 1 -- 172.21.15.5:0/238977872 shutdown_connections 2024-04-25T08:59:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.858+0000 7efca00e1640 1 -- 172.21.15.5:0/238977872 wait complete. 2024-04-25T08:59:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.859+0000 7efca00e1640 1 Processor -- start 2024-04-25T08:59:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.859+0000 7efca00e1640 1 -- start start 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efca00e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc80003fd0 0x7efc981f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efca00e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc98157030 0x7efc981452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efca00e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc98153030 0x7efc981534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efca00e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98155360 con 0x7efc98153030 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efca00e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815e640 con 0x7efc98157030 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efca00e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815f250 con 0x7efc80003fd0 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc98153030 0x7efc981534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc98153030 0x7efc981534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43958/0 (socket says 172.21.15.5:43958) 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 -- 172.21.15.5:0/2463537882 learned_addr learned my addr 172.21.15.5:0/2463537882 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9d67c640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc98157030 0x7efc981452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9de7d640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc80003fd0 0x7efc981f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 -- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc80003fd0 msgr2=0x7efc981f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc80003fd0 0x7efc981f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 -- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc98157030 msgr2=0x7efc981452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc98157030 0x7efc981452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 -- 172.21.15.5:0/2463537882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc981574b0 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9d67c640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc98157030 0x7efc981452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc9e67e640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc98153030 0x7efc981534b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efc980cc4f0 tx=0x7efc9000f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc967fc640 1 -- 172.21.15.5:0/2463537882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900052e0 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc967fc640 1 -- 172.21.15.5:0/2463537882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc90018070 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efc967fc640 1 -- 172.21.15.5:0/2463537882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90003830 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.860+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc981f7aa0 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.861+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc981f8060 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.861+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9804ef20 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.862+0000 7efc967fc640 1 -- 172.21.15.5:0/2463537882 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc900039d0 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.862+0000 7efc967fc640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc8406b4d0 0x7efc8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.862+0000 7efc967fc640 1 -- 172.21.15.5:0/2463537882 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efc90089d30 con 0x7efc98153030 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.862+0000 7efc9de7d640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc8406b4d0 0x7efc8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.863+0000 7efc9de7d640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc8406b4d0 0x7efc8406d990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc880095c0 tx=0x7efc88009820 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:32.866+0000 7efc967fc640 1 -- 172.21.15.5:0/2463537882 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc90058ad0 con 0x7efc98153030 2024-04-25T08:59:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.084+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc9806dec0 con 0x7efc98153030 2024-04-25T08:59:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.084+0000 7efc967fc640 1 -- 172.21.15.5:0/2463537882 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7efc900583d0 con 0x7efc98153030 2024-04-25T08:59:33.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:33.074 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:17.799735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.086+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc8406b4d0 msgr2=0x7efc8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.086+0000 7efca00e1640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc8406b4d0 0x7efc8406d990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc880095c0 tx=0x7efc88009820 comp rx=0 tx=0).stop 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.086+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc98153030 msgr2=0x7efc981534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.086+0000 7efca00e1640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc98153030 0x7efc981534b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efc980cc4f0 tx=0x7efc9000f920 comp rx=0 tx=0).stop 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.086+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 shutdown_connections 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.087+0000 7efca00e1640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc8406b4d0 0x7efc8406d990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.087+0000 7efca00e1640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc98153030 0x7efc981534b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.087+0000 7efca00e1640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc98157030 0x7efc981452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.087+0000 7efca00e1640 1 --2- 172.21.15.5:0/2463537882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc80003fd0 0x7efc981f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.087+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 >> 172.21.15.5:0/2463537882 conn(0x7efc980668f0 msgr2=0x7efc980711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.087+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 shutdown_connections 2024-04-25T08:59:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.087+0000 7efca00e1640 1 -- 172.21.15.5:0/2463537882 wait complete. 2024-04-25T08:59:33.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-04-25T08:59:33.196 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:33.196 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:33.196 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:33.205 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:33.205 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-04-25T08:59:33.206 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-25T08:59:33.206 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-04-25T08:59:33.206 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:59:33.206 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-04-25T08:59:33.206 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-25T08:59:33.273 INFO:teuthology.orchestra.run.smithi005.stdout:1099511630186 2024-04-25T08:59:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:59:33.282 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:33.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:59:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.436+0000 7fd2f68ac640 1 Processor -- start 2024-04-25T08:59:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.437+0000 7fd2f68ac640 1 -- start start 2024-04-25T08:59:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.437+0000 7fd2f68ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00cfd70 0x7fd2f00ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.437+0000 7fd2f68ac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f00cc010 con 0x7fd2f00ce6e0 2024-04-25T08:59:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.437+0000 7fd2f68ac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f00cc2f0 con 0x7fd2f00b72b0 2024-04-25T08:59:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.437+0000 7fd2f68ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00d01d0 con 0x7fd2f00cfd70 2024-04-25T08:59:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.437+0000 7fd2f4e49640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd2f00ce6e0 0x7fd2f00ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60438/0 (socket says 172.21.15.5:60438) 2024-04-25T08:59:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.437+0000 7fd2f4e49640 1 -- 172.21.15.5:0/1327014645 learned_addr learned my addr 172.21.15.5:0/1327014645 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/1327014645 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00cfd70 0x7fd2f00ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2eeffd640 1 -- 172.21.15.5:0/1327014645 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628240513 0 0) 0x7fd2f00cc010 con 0x7fd2f00ce6e0 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2eeffd640 1 -- 172.21.15.5:0/1327014645 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d8003520 con 0x7fd2f00ce6e0 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2eeffd640 1 -- 172.21.15.5:0/1327014645 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103791853 0 0) 0x7fd2f00cc2f0 con 0x7fd2f00b72b0 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2eeffd640 1 -- 172.21.15.5:0/1327014645 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f00cc010 con 0x7fd2f00b72b0 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/1327014645 >> v1:172.21.15.80:6789/0 conn(0x7fd2f00b72b0 legacy=0x7fd2f00d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/1327014645 >> v1:172.21.15.5:6789/0 conn(0x7fd2f00ce6e0 legacy=0x7fd2f00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.438+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/1327014645 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00cc5d0 con 0x7fd2f00cfd70 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/1327014645 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00cfd70 0x7fd2f00ce1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097d0 tx=0x7fd2e402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6607129a9c92210f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2eeffd640 1 -- 172.21.15.5:0/1327014645 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4037070 con 0x7fd2f00cfd70 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2eeffd640 1 -- 172.21.15.5:0/1327014645 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e4032440 con 0x7fd2f00cfd70 2024-04-25T08:59:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2eeffd640 1 -- 172.21.15.5:0/1327014645 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40327f0 con 0x7fd2f00cfd70 2024-04-25T08:59:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1327014645 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00cfd70 msgr2=0x7fd2f00ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1327014645 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00cfd70 0x7fd2f00ce1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097d0 tx=0x7fd2e402a210 comp rx=0 tx=0).stop 2024-04-25T08:59:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1327014645 shutdown_connections 2024-04-25T08:59:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1327014645 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00cfd70 0x7fd2f00ce1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1327014645 >> 172.21.15.5:0/1327014645 conn(0x7fd2f00d1920 msgr2=0x7fd2f00d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1327014645 shutdown_connections 2024-04-25T08:59:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.439+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1327014645 wait complete. 2024-04-25T08:59:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.441+0000 7fd2f68ac640 1 Processor -- start 2024-04-25T08:59:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.441+0000 7fd2f68ac640 1 -- start start 2024-04-25T08:59:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.441+0000 7fd2f68ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2f00b72b0 0x7fd2f015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.441+0000 7fd2f68ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00ce6e0 0x7fd2f015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2f68ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2f00cfd70 0x7fd2f00c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2f68ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00d1550 con 0x7fd2f00b72b0 2024-04-25T08:59:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2f68ac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00b4770 con 0x7fd2f00cfd70 2024-04-25T08:59:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2f68ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00b7690 con 0x7fd2f00ce6e0 2024-04-25T08:59:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2f00b72b0 0x7fd2f015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2f00b72b0 0x7fd2f015ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43966/0 (socket says 172.21.15.5:43966) 2024-04-25T08:59:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 -- 172.21.15.5:0/1844947676 learned_addr learned my addr 172.21.15.5:0/1844947676 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00ce6e0 0x7fd2f015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2f4e49640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2f00cfd70 0x7fd2f00c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 -- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00ce6e0 msgr2=0x7fd2f015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00ce6e0 0x7fd2f015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 -- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2f00cfd70 msgr2=0x7fd2f00c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2f00cfd70 0x7fd2f00c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 -- 172.21.15.5:0/1844947676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00c6950 con 0x7fd2f00b72b0 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00ce6e0 0x7fd2f015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2effff640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2f00b72b0 0x7fd2f015ca40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000c430 tx=0x7fd2e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2ecff9640 1 -- 172.21.15.5:0/1844947676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0017070 con 0x7fd2f00b72b0 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2ecff9640 1 -- 172.21.15.5:0/1844947676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00052f0 con 0x7fd2f00b72b0 2024-04-25T08:59:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f00c6670 con 0x7fd2f00b72b0 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2ecff9640 1 -- 172.21.15.5:0/1844947676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0003830 con 0x7fd2f00b72b0 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.442+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f00c9e50 con 0x7fd2f00b72b0 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.444+0000 7fd2ecff9640 1 -- 172.21.15.5:0/1844947676 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2e001a070 con 0x7fd2f00b72b0 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.444+0000 7fd2ecff9640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2dc06b500 0x7fd2dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.444+0000 7fd2ecff9640 1 -- 172.21.15.5:0/1844947676 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd2e0089470 con 0x7fd2f00b72b0 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.444+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2dc06b500 0x7fd2dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.445+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2dc06b500 0x7fd2dc06d9c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4034000 tx=0x7fd2e402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.445+0000 7fd2f95af740 1 Processor -- start 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.445+0000 7fd2f95af740 1 -- start start 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7aa0 0x557b27eda2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eda7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27eaa700 0x557b27eadf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f95af740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b27e13e00 con 0x557b27eaa700 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b27dbcd20 con 0x557b27ed7e80 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b27e0fea0 con 0x557b27ed7aa0 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27eaa700 0x557b27eadf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27eaa700 0x557b27eadf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43972/0 (socket says 172.21.15.5:43972) 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 -- 172.21.15.5:0/2136930391 learned_addr learned my addr 172.21.15.5:0/2136930391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eda7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2effff640 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7aa0 0x557b27eda2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 -- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7aa0 msgr2=0x557b27eda2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7aa0 0x557b27eda2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 -- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 msgr2=0x557b27eda7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eda7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.446+0000 7fd2f4e49640 1 -- 172.21.15.5:0/2136930391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b27ddedf0 con 0x557b27eaa700 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f4e49640 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27eaa700 0x557b27eadf10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8002030 tx=0x7fd2e8007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b48a6af104d1fd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2d5ffb640 1 -- 172.21.15.5:0/2136930391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8007ac0 con 0x557b27eaa700 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2d5ffb640 1 -- 172.21.15.5:0/2136930391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8018070 con 0x557b27eaa700 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2d5ffb640 1 -- 172.21.15.5:0/2136930391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80127a0 con 0x557b27eaa700 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 -- 172.21.15.5:0/2136930391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27eaa700 msgr2=0x557b27eadf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27eaa700 0x557b27eadf10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8002030 tx=0x7fd2e8007410 comp rx=0 tx=0).stop 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 -- 172.21.15.5:0/2136930391 shutdown_connections 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27eaa700 0x557b27eadf10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eda7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2136930391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7aa0 0x557b27eda2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 -- 172.21.15.5:0/2136930391 >> 172.21.15.5:0/2136930391 conn(0x557b27eac970 msgr2=0x557b27ef52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 -- 172.21.15.5:0/2136930391 shutdown_connections 2024-04-25T08:59:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.447+0000 7fd2f95af740 1 -- 172.21.15.5:0/2136930391 wait complete. 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.448+0000 7fd2f95af740 1 -- start start 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.448+0000 7fd2f95af740 1 Processor -- start 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7e80 0x557b27ef8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f95af740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b27eafb20 con 0x557b27ed7e80 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b27db2590 con 0x557b27ed7aa0 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b27eafe00 con 0x557b27ed1750 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f95af740 10 client.0 _ll_register_callbacks cb 0x557b27dbee30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7e80 0x557b27ef8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7e80 0x557b27ef8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43984/0 (socket says 172.21.15.5:43984) 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/2337971221 learned_addr learned my addr 172.21.15.5:0/2337971221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2f4e49640 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2effff640 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 msgr2=0x557b27ed1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 msgr2=0x557b27ed4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/2337971221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b27b283f0 con 0x557b27ed7e80 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7e80 0x557b27ef8d00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4035040 tx=0x7fd2e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9a49acec4f934c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.449+0000 7fd2ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2ceffd640 1 -- 172.21.15.5:0/2337971221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4037040 con 0x557b27ed7e80 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2ceffd640 1 -- 172.21.15.5:0/2337971221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd2e403ed40 con 0x557b27ed7e80 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2e8018070 con 0x557b27ed7e80 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2ceffd640 1 -- 172.21.15.5:0/2337971221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e4057050 con 0x557b27ed7e80 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 10 client.5916 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x557b27bf27d0 con 0x557b27ed7e80 2024-04-25T08:59:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2ceffd640 1 -- 172.21.15.5:0/2337971221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8018070 con 0x557b27ed7e80 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2ceffd640 1 -- 172.21.15.5:0/2337971221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd2e405a020 con 0x557b27ed7e80 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 10 client.5916 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 10 client.5916 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 20 client.5916 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27f09040 0x557b27f09480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 4 client.5916 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b27e21340 con 0x557b27f09040 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.450+0000 7fd2effff640 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27f09040 0x557b27f09480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2effff640 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27f09040 0x557b27f09480 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fdcbf91cbd8d131 server_cookie=99059cdb1ae5d0cf in_seq=0 out_seq=0 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2ceffd640 10 client.5916 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2ceffd640 1 -- 172.21.15.5:0/2337971221 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557b27e21340 con 0x557b27f09040 2024-04-25T08:59:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2ceffd640 10 client.5916 handle_command_reply: tid=0 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 client.5916 shutdown 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7e80 msgr2=0x557b27ef8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7e80 0x557b27ef8d00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4035040 tx=0x7fd2e4004730 comp rx=0 tx=0).stop 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 shutdown_connections 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27f09040 0x557b27f09480 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7e80 0x557b27ef8d00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2ceffd640 0 client.5916 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 --2- 172.21.15.5:0/2337971221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 >> 172.21.15.5:0/2337971221 conn(0x557b27eaa700 msgr2=0x557b27ed2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 shutdown_connections 2024-04-25T08:59:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.451+0000 7fd2f95af740 1 -- 172.21.15.5:0/2337971221 wait complete. 2024-04-25T08:59:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.452+0000 7fd2f95af740 20 client.5916 trim_cache size 0 max 16384 2024-04-25T08:59:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.463+0000 7fd2f95af740 1 Processor -- start 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.463+0000 7fd2f95af740 1 -- start start 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed1750 0x557b27ed4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7e80 0x557b27f07c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2f95af740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01ffef0 con 0x557b27ed1750 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01ff0b0 con 0x557b27ed7aa0 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00c7fe0 con 0x557b27ed7e80 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed1750 0x557b27ed4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed1750 0x557b27ed4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43988/0 (socket says 172.21.15.5:43988) 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 -- 172.21.15.5:0/462159085 learned_addr learned my addr 172.21.15.5:0/462159085 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2f4e49640 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7e80 0x557b27f07c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 -- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7e80 msgr2=0x557b27f07c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7e80 0x557b27f07c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 -- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 msgr2=0x557b27ed50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2effff640 1 -- 172.21.15.5:0/462159085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b27ef7f90 con 0x557b27ed1750 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.464+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2effff640 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed1750 0x557b27ed4ba0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00579f0 tx=0x7fd2e00878c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e894836f3a45c0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2d57fa640 1 -- 172.21.15.5:0/462159085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0055ff0 con 0x557b27ed1750 2024-04-25T08:59:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2d57fa640 1 -- 172.21.15.5:0/462159085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0054360 con 0x557b27ed1750 2024-04-25T08:59:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2d57fa640 1 -- 172.21.15.5:0/462159085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00892b0 con 0x557b27ed1750 2024-04-25T08:59:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 -- 172.21.15.5:0/462159085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed1750 msgr2=0x557b27ed4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed1750 0x557b27ed4ba0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00579f0 tx=0x7fd2e00878c0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 -- 172.21.15.5:0/462159085 shutdown_connections 2024-04-25T08:59:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed7e80 0x557b27f07c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7aa0 0x557b27ed50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 --2- 172.21.15.5:0/462159085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed1750 0x557b27ed4ba0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 -- 172.21.15.5:0/462159085 >> 172.21.15.5:0/462159085 conn(0x557b27eaa700 msgr2=0x557b27ef81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 -- 172.21.15.5:0/462159085 shutdown_connections 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.465+0000 7fd2f95af740 1 -- 172.21.15.5:0/462159085 wait complete. 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.466+0000 7fd2f95af740 1 -- start start 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.466+0000 7fd2f95af740 1 Processor -- start 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7aa0 0x557b27eaefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f95af740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eaf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f95af740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b27ef5320 con 0x557b27ed7aa0 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00cafc0 con 0x557b27ed7e80 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f95af740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b27ea6690 con 0x557b27ed1750 2024-04-25T08:59:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f95af740 10 client.0 _ll_register_callbacks cb 0x7fd2e8006d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7aa0 0x557b27eaefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7aa0 0x557b27eaefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44000/0 (socket says 172.21.15.5:44000) 2024-04-25T08:59:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/3802621306 learned_addr learned my addr 172.21.15.5:0/3802621306 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2effff640 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2f4e49640 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eaf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 msgr2=0x557b27ed0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 msgr2=0x557b27eaf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eaf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 -- 172.21.15.5:0/3802621306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b27ede4e0 con 0x557b27ed7aa0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ef7fe640 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7aa0 0x557b27eaefb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4035040 tx=0x7fd2e4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ab660b6cc6bf20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.467+0000 7fd2ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2ceffd640 1 -- 172.21.15.5:0/3802621306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4037040 con 0x557b27ed7aa0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2ceffd640 1 -- 172.21.15.5:0/3802621306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd2e4004250 con 0x557b27ed7aa0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2e0054360 con 0x557b27ed7aa0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2ceffd640 1 -- 172.21.15.5:0/3802621306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e4067050 con 0x557b27ed7aa0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 10 client.5922 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x557b27ed0f50 con 0x557b27ed7aa0 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2ceffd640 1 -- 172.21.15.5:0/3802621306 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0054360 con 0x557b27ed7aa0 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2ceffd640 1 -- 172.21.15.5:0/3802621306 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd2e406a020 con 0x557b27ed7aa0 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 10 client.5922 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 10 client.5922 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 20 client.5922 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27eda300 0x557b27f605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 4 client.5922 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557b27e1b690 con 0x557b27eda300 2024-04-25T08:59:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.468+0000 7fd2effff640 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27eda300 0x557b27f605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2effff640 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27eda300 0x557b27f605a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814932fc54420100 server_cookie=c1d4c0e566384881 in_seq=0 out_seq=0 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2ceffd640 10 client.5922 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2ceffd640 1 -- 172.21.15.5:0/3802621306 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557b27e1b690 con 0x557b27eda300 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2ceffd640 10 client.5922 handle_command_reply: tid=0 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 client.5922 shutdown 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7aa0 msgr2=0x557b27eaefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7aa0 0x557b27eaefb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4035040 tx=0x7fd2e4009190 comp rx=0 tx=0).stop 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 shutdown_connections 2024-04-25T08:59:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x557b27eda300 0x557b27f605a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557b27ed7e80 0x557b27eaf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557b27ed7aa0 0x557b27eaefb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2ceffd640 0 client.5922 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 --2- 172.21.15.5:0/3802621306 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557b27ed1750 0x557b27ed0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 >> 172.21.15.5:0/3802621306 conn(0x557b27eaa700 msgr2=0x557b27ed4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 shutdown_connections 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 1 -- 172.21.15.5:0/3802621306 wait complete. 2024-04-25T08:59:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.469+0000 7fd2f95af740 20 client.5922 trim_cache size 0 max 16384 2024-04-25T08:59:33.470 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-04-25T08:59:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2dc06b500 msgr2=0x7fd2dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2dc06b500 0x7fd2dc06d9c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4034000 tx=0x7fd2e402e000 comp rx=0 tx=0).stop 2024-04-25T08:59:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2f00b72b0 msgr2=0x7fd2f015ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2f00b72b0 0x7fd2f015ca40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000c430 tx=0x7fd2e000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 shutdown_connections 2024-04-25T08:59:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2dc06b500 0x7fd2dc06d9c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2f00cfd70 0x7fd2f00c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2f00ce6e0 0x7fd2f015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 --2- 172.21.15.5:0/1844947676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2f00b72b0 0x7fd2f015ca40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 >> 172.21.15.5:0/1844947676 conn(0x7fd2f00d1920 msgr2=0x7fd2f00cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 shutdown_connections 2024-04-25T08:59:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.470+0000 7fd2f68ac640 1 -- 172.21.15.5:0/1844947676 wait complete. 2024-04-25T08:59:33.474 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096a.00000000 parent 2024-04-25T08:59:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.529+0000 7f9ca3416f40 1 Processor -- start 2024-04-25T08:59:33.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.529+0000 7f9ca3416f40 1 -- start start 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca3416f40 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f055f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca3416f40 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 0x561e3f170ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca3416f40 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f00e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca3416f40 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3f038dc0 con 0x561e3f03d540 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca3416f40 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3efb5df0 con 0x561e3f058ef0 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca3416f40 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e3f0e33f0 con 0x561e3f0e3f80 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f055f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f055f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44022/0 (socket says 172.21.15.5:44022) 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 -- 172.21.15.5:0/1219159710 learned_addr learned my addr 172.21.15.5:0/1219159710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca0aa7640 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f00e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9c9faa5640 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 0x561e3f170ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 -- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 msgr2=0x561e3f00e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f00e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 -- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 msgr2=0x561e3f170ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 0x561e3f170ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 -- 172.21.15.5:0/1219159710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3ef3bc50 con 0x561e3f03d540 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca0aa7640 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f00e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9ca02a6640 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f055f40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000a4b0 tx=0x7f9c90050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b44aa734551709 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9c9eaa3640 1 -- 172.21.15.5:0/1219159710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90055070 con 0x561e3f03d540 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9c9eaa3640 1 -- 172.21.15.5:0/1219159710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90051bb0 con 0x561e3f03d540 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.530+0000 7f9c9eaa3640 1 -- 172.21.15.5:0/1219159710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90064440 con 0x561e3f03d540 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 -- 172.21.15.5:0/1219159710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 msgr2=0x561e3f055f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f055f40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000a4b0 tx=0x7f9c90050000 comp rx=0 tx=0).stop 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 -- 172.21.15.5:0/1219159710 shutdown_connections 2024-04-25T08:59:33.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f00e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 0x561e3f170ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/1219159710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f055f40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 -- 172.21.15.5:0/1219159710 >> 172.21.15.5:0/1219159710 conn(0x561e3f0109d0 msgr2=0x561e3f010db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 -- 172.21.15.5:0/1219159710 shutdown_connections 2024-04-25T08:59:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.531+0000 7f9ca3416f40 1 -- 172.21.15.5:0/1219159710 wait complete. 2024-04-25T08:59:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 Processor -- start 2024-04-25T08:59:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 -- start start 2024-04-25T08:59:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f03aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 0x561e3f179c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f17a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3f0e1ac0 con 0x561e3f03d540 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3f0e1870 con 0x561e3f058ef0 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca3416f40 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e3f0e30a0 con 0x561e3f0e3f80 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca02a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f03aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca02a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f03aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44024/0 (socket says 172.21.15.5:44024) 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca02a6640 1 -- 172.21.15.5:0/2512759305 learned_addr learned my addr 172.21.15.5:0/2512759305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9ca0aa7640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f17a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.532+0000 7f9c9faa5640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 0x561e3f179c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca02a6640 1 -- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 msgr2=0x561e3f17a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca02a6640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561e3f0e3f80 0x561e3f17a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca02a6640 1 -- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 msgr2=0x561e3f179c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca02a6640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561e3f058ef0 0x561e3f179c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca02a6640 1 -- 172.21.15.5:0/2512759305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3f17d130 con 0x561e3f03d540 2024-04-25T08:59:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca02a6640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f03aa40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c900058f0 tx=0x7f9c90003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9c9daa1640 1 -- 172.21.15.5:0/2512759305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90055070 con 0x561e3f03d540 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9c9daa1640 1 -- 172.21.15.5:0/2512759305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90051d60 con 0x561e3f03d540 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e3f17d410 con 0x561e3f03d540 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9c9daa1640 1 -- 172.21.15.5:0/2512759305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90064d80 con 0x561e3f03d540 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.533+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3f17d9d0 con 0x561e3f03d540 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.534+0000 7f9c9daa1640 1 -- 172.21.15.5:0/2512759305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c90058020 con 0x561e3f03d540 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.535+0000 7f9c9daa1640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c80069ee0 0x7f9c8006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.535+0000 7f9c9daa1640 1 -- 172.21.15.5:0/2512759305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9c900cd2c0 con 0x561e3f03d540 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.535+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x561e3f0e0180 0x561e3f0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.535+0000 7f9c9faa5640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c80069ee0 0x7f9c8006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.535+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 --> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] -- osd_op(unknown.0.0:1 7.11 7:88e5eea5:::1000000096a.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v9 -- 0x561e3f0caa50 con 0x561e3f0e0180 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.535+0000 7f9ca0aa7640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x561e3f0e0180 0x561e3f0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.536+0000 7f9c9faa5640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c80069ee0 0x7f9c8006c3a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561e3f0e7190 tx=0x7f9c88001830 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.536+0000 7f9ca0aa7640 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x561e3f0e0180 0x561e3f0ca510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca0aa7640 1 -- 172.21.15.5:0/2512759305 <== osd.7 v2:172.21.15.80:6800/4179945280 1 ==== osd_op_reply(1 1000000096a.00000000 [rmxattr] v46'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c98009970 con 0x561e3f0e0180 2024-04-25T08:59:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x561e3f0e0180 msgr2=0x561e3f0ca510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x561e3f0e0180 0x561e3f0ca510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c80069ee0 msgr2=0x7f9c8006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c80069ee0 0x7f9c8006c3a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561e3f0e7190 tx=0x7f9c88001830 comp rx=0 tx=0).stop 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 msgr2=0x561e3f03aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 --2- 172.21.15.5:0/2512759305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e3f03d540 0x561e3f03aa40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c900058f0 tx=0x7f9c90003330 comp rx=0 tx=0).stop 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca0aa7640 1 -- 172.21.15.5:0/2512759305 reap_dead start 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 shutdown_connections 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 >> 172.21.15.5:0/2512759305 conn(0x561e3f0109d0 msgr2=0x561e3f010db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 shutdown_connections 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.537+0000 7f9ca3416f40 1 -- 172.21.15.5:0/2512759305 wait complete. 2024-04-25T08:59:33.529 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-04-25T08:59:33.529 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:33.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-04-25T08:59:33.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.685+0000 7f6fd8e5d640 1 Processor -- start 2024-04-25T08:59:33.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.685+0000 7f6fd8e5d640 1 -- start start 2024-04-25T08:59:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd8e5d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fd415df10 0x7f6fd41618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd8e5d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6fd40cefe0 0x7f6fd40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd8e5d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd4162150 con 0x7f6fd40b6250 2024-04-25T08:59:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd8e5d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd40d20d0 con 0x7f6fd415df10 2024-04-25T08:59:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd8e5d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd4162430 con 0x7f6fd40cefe0 2024-04-25T08:59:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fd415df10 0x7f6fd41618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fd415df10 0x7f6fd41618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44034/0 (socket says 172.21.15.5:44034) 2024-04-25T08:59:33.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.686+0000 7f6fd259c640 1 -- 172.21.15.5:0/3584617658 learned_addr learned my addr 172.21.15.5:0/3584617658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.687+0000 7f6fd259c640 1 -- 172.21.15.5:0/3584617658 >> v2:172.21.15.80:3300/0 conn(0x7f6fd40cefe0 msgr2=0x7f6fd40d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.687+0000 7f6fd259c640 1 --2- 172.21.15.5:0/3584617658 >> v2:172.21.15.80:3300/0 conn(0x7f6fd40cefe0 0x7f6fd40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.687+0000 7f6fd259c640 1 -- 172.21.15.5:0/3584617658 >> v1:172.21.15.80:6789/0 conn(0x7f6fd40b6250 legacy=0x7f6fd40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.687+0000 7f6fd259c640 1 -- 172.21.15.5:0/3584617658 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4162710 con 0x7f6fd415df10 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.687+0000 7f6fd259c640 1 --2- 172.21.15.5:0/3584617658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd415df10 0x7f6fd41618d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40b3610 tx=0x7f6fcc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ac7613b246c0f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.687+0000 7f6fd159a640 1 -- 172.21.15.5:0/3584617658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc037070 con 0x7f6fd415df10 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.687+0000 7f6fd159a640 1 -- 172.21.15.5:0/3584617658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc032440 con 0x7f6fd415df10 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd159a640 1 -- 172.21.15.5:0/3584617658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc032810 con 0x7f6fd415df10 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/3584617658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd415df10 msgr2=0x7f6fd41618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/3584617658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd415df10 0x7f6fd41618d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40b3610 tx=0x7f6fcc02a230 comp rx=0 tx=0).stop 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/3584617658 shutdown_connections 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/3584617658 >> v2:172.21.15.80:3300/0 conn(0x7f6fd40cefe0 0x7f6fd40d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/3584617658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd415df10 0x7f6fd41618d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/3584617658 >> 172.21.15.5:0/3584617658 conn(0x7f6fd40668f0 msgr2=0x7f6fd4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/3584617658 shutdown_connections 2024-04-25T08:59:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.688+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/3584617658 wait complete. 2024-04-25T08:59:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.689+0000 7f6fd8e5d640 1 Processor -- start 2024-04-25T08:59:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.689+0000 7f6fd8e5d640 1 -- start start 2024-04-25T08:59:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd8e5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6fd40b6250 0x7f6fd41f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd8e5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd40cefe0 0x7f6fd415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd8e5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fd415df10 0x7f6fd41e7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd8e5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40d2aa0 con 0x7f6fd40cefe0 2024-04-25T08:59:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd8e5d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4161e10 con 0x7f6fd415df10 2024-04-25T08:59:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd8e5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40d2c20 con 0x7f6fd40b6250 2024-04-25T08:59:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd40cefe0 0x7f6fd415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd40cefe0 0x7f6fd415c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44040/0 (socket says 172.21.15.5:44040) 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd1d9b640 1 -- 172.21.15.5:0/182569610 learned_addr learned my addr 172.21.15.5:0/182569610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.690+0000 7f6fd259c640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6fd40b6250 0x7f6fd41f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fd415df10 0x7f6fd41e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd1d9b640 1 -- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6fd40b6250 msgr2=0x7f6fd41f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6fd40b6250 0x7f6fd41f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd1d9b640 1 -- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fd415df10 msgr2=0x7f6fd41e7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fd415df10 0x7f6fd41e7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd1d9b640 1 -- 172.21.15.5:0/182569610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40c8a50 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd259c640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6fd40b6250 0x7f6fd41f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd40cefe0 0x7f6fd415c920 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c410 tx=0x7f6fc800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fc2ffd640 1 -- 172.21.15.5:0/182569610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8017070 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fc2ffd640 1 -- 172.21.15.5:0/182569610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc80035f0 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fc2ffd640 1 -- 172.21.15.5:0/182569610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8003a20 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd40c8d30 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.691+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd415ce60 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.692+0000 7f6fc2ffd640 1 -- 172.21.15.5:0/182569610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fc801a070 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.693+0000 7f6fc2ffd640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6fb406b4d0 0x7f6fb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.693+0000 7f6fc2ffd640 1 -- 172.21.15.5:0/182569610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6fc80897d0 con 0x7f6fd40cefe0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.693+0000 7f6fd259c640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6fb406b4d0 0x7f6fb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.694+0000 7f6fd259c640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6fb406b4d0 0x7f6fb406d990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc034000 tx=0x7f6fcc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.694+0000 7f6fdbc38740 1 Processor -- start 2024-04-25T08:59:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.694+0000 7f6fdbc38740 1 -- start start 2024-04-25T08:59:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862aa27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a61360 0x55e862a89c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8629c2ee0 con 0x55e862a8a140 2024-04-25T08:59:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e86296bc50 con 0x55e862a82360 2024-04-25T08:59:33.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8629bef80 con 0x55e862a61360 2024-04-25T08:59:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862aa27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44052/0 (socket says 172.21.15.5:44052) 2024-04-25T08:59:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2055572194 learned_addr learned my addr 172.21.15.5:0/2055572194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a61360 0x55e862a89c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2055572194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a61360 msgr2=0x55e862a89c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a61360 0x55e862a89c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2055572194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 msgr2=0x55e862aa27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862aa27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2055572194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8627a3c00 con 0x55e862a8a140 2024-04-25T08:59:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f7c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009ef0 tx=0x7f6fc400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50e131889d9d57d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fb3fff640 1 -- 172.21.15.5:0/2055572194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc401a070 con 0x55e862a8a140 2024-04-25T08:59:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fb3fff640 1 -- 172.21.15.5:0/2055572194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc4015410 con 0x55e862a8a140 2024-04-25T08:59:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.695+0000 7f6fb3fff640 1 -- 172.21.15.5:0/2055572194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40157c0 con 0x55e862a8a140 2024-04-25T08:59:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2055572194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 msgr2=0x55e862a5f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f7c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009ef0 tx=0x7f6fc400c7f0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2055572194 shutdown_connections 2024-04-25T08:59:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f7c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a61360 0x55e862a89c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2055572194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862aa27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2055572194 >> 172.21.15.5:0/2055572194 conn(0x55e862a26810 msgr2=0x55e862aa4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2055572194 shutdown_connections 2024-04-25T08:59:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.696+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2055572194 wait complete. 2024-04-25T08:59:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.697+0000 7f6fdbc38740 1 -- start start 2024-04-25T08:59:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.697+0000 7f6fdbc38740 1 Processor -- start 2024-04-25T08:59:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862a811d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a8a140 0x55e862a8d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e862a5f330 con 0x55e862a61360 2024-04-25T08:59:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e862961340 con 0x55e862a82360 2024-04-25T08:59:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e862a5a1a0 con 0x55e862a8a140 2024-04-25T08:59:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fdbc38740 10 client.0 _ll_register_callbacks cb 0x55e8626d6fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:33.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a9d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44066/0 (socket says 172.21.15.5:44066) 2024-04-25T08:59:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 -- 172.21.15.5:0/3502251202 learned_addr learned my addr 172.21.15.5:0/3502251202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a8a140 0x55e862a8d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862a811d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 -- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a8a140 msgr2=0x55e862a8d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a8a140 0x55e862a8d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 -- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 msgr2=0x55e862a811d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862a811d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 -- 172.21.15.5:0/3502251202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8626974f0 con 0x55e862a61360 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fd259c640 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a9d490 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0090b0 tx=0x7f6fcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4d11f47479047c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.698+0000 7f6fb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fb17fa640 1 -- 172.21.15.5:0/3502251202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc037040 con 0x55e862a61360 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fb17fa640 1 -- 172.21.15.5:0/3502251202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6fcc03ca50 con 0x55e862a61360 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fc4015410 con 0x55e862a61360 2024-04-25T08:59:33.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fb17fa640 1 -- 172.21.15.5:0/3502251202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fcc057050 con 0x55e862a61360 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 10 client.5943 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55e862804390 con 0x55e862a61360 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fb17fa640 1 -- 172.21.15.5:0/3502251202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc4015410 con 0x55e862a61360 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fb17fa640 1 -- 172.21.15.5:0/3502251202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6fcc05a020 con 0x55e862a61360 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 10 client.5943 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 20 client.5943 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862a9bc90 0x55e862a9c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 4 client.5943 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8629d0420 con 0x55e862a9bc90 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.699+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862a9bc90 0x55e862a9c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fb17fa640 10 client.5943 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862a9bc90 0x55e862a9c0b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0adbedb5aec993 server_cookie=f8b072ed2dd49262 in_seq=0 out_seq=0 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fb17fa640 1 -- 172.21.15.5:0/3502251202 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e8629d0420 con 0x55e862a9bc90 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fb17fa640 10 client.5943 handle_command_reply: tid=0 2024-04-25T08:59:33.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 client.5943 shutdown 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 msgr2=0x55e862a9d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a9d490 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0090b0 tx=0x7f6fcc004730 comp rx=0 tx=0).stop 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 shutdown_connections 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862a9bc90 0x55e862a9c0b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a8a140 0x55e862a8d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a82360 0x55e862a811d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fb17fa640 0 client.5943 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/3502251202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a9d490 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 >> 172.21.15.5:0/3502251202 conn(0x55e862a26810 msgr2=0x55e862a59560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 shutdown_connections 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.700+0000 7f6fdbc38740 1 -- 172.21.15.5:0/3502251202 wait complete. 2024-04-25T08:59:33.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.701+0000 7f6fdbc38740 20 client.5943 trim_cache size 0 max 16384 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.716+0000 7f6fdbc38740 1 Processor -- start 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.716+0000 7f6fdbc38740 1 -- start start 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.716+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a61360 0x55e862a5ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.716+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a5f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e862a82ab0 con 0x55e862a8a140 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd41fffa0 con 0x55e862a61360 2024-04-25T08:59:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd415f160 con 0x55e862a82360 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44068/0 (socket says 172.21.15.5:44068) 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2179024420 learned_addr learned my addr 172.21.15.5:0/2179024420 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd259c640 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a61360 0x55e862a5ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a5f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 msgr2=0x55e862a5f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a5f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a61360 msgr2=0x55e862a5ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a61360 0x55e862a5ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 -- 172.21.15.5:0/2179024420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e862670670 con 0x55e862a8a140 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd259c640 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a61360 0x55e862a5ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f850 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009e90 tx=0x7f6fc4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890ae4eb304cc50b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fb37fe640 1 -- 172.21.15.5:0/2179024420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4026070 con 0x55e862a8a140 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fb37fe640 1 -- 172.21.15.5:0/2179024420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc4020670 con 0x55e862a8a140 2024-04-25T08:59:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.717+0000 7f6fb37fe640 1 -- 172.21.15.5:0/2179024420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc401a040 con 0x55e862a8a140 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2179024420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 msgr2=0x55e862a5f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f850 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009e90 tx=0x7f6fc4011000 comp rx=0 tx=0).stop 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2179024420 shutdown_connections 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a8a140 0x55e862a5f850 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a5f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/2179024420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a61360 0x55e862a5ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2179024420 >> 172.21.15.5:0/2179024420 conn(0x55e862a26810 msgr2=0x55e862a80fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2179024420 shutdown_connections 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 -- 172.21.15.5:0/2179024420 wait complete. 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 -- start start 2024-04-25T08:59:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.718+0000 7f6fdbc38740 1 Processor -- start 2024-04-25T08:59:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a88d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a8b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fdbc38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a8a140 0x55e862a5f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd415eb60 con 0x55e862a61360 2024-04-25T08:59:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd415e560 con 0x55e862a8a140 2024-04-25T08:59:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fdbc38740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e862a89c30 con 0x55e862a82360 2024-04-25T08:59:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fdbc38740 10 client.0 _ll_register_callbacks cb 0x7f6fc40096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fd259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a88d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fd259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a88d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44086/0 (socket says 172.21.15.5:44086) 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.719+0000 7f6fd259c640 1 -- 172.21.15.5:0/4054699022 learned_addr learned my addr 172.21.15.5:0/4054699022 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a8b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd2d9d640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a8a140 0x55e862a5f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd259c640 1 -- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 msgr2=0x55e862a8b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd259c640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a8b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd259c640 1 -- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a8a140 msgr2=0x55e862a5f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd259c640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a8a140 0x55e862a5f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd259c640 1 -- 172.21.15.5:0/4054699022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e862a5fc50 con 0x55e862a61360 2024-04-25T08:59:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a8b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fd259c640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a88d10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc004770 tx=0x7f6fcc009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e44a60941037be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fb17fa640 1 -- 172.21.15.5:0/4054699022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc05f030 con 0x55e862a61360 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fb17fa640 1 -- 172.21.15.5:0/4054699022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6fcc052640 con 0x55e862a61360 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fc4020670 con 0x55e862a61360 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fb17fa640 1 -- 172.21.15.5:0/4054699022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fcc06b050 con 0x55e862a61360 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fdbc38740 10 client.5949 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55e862aa7ef0 con 0x55e862a61360 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fb17fa640 1 -- 172.21.15.5:0/4054699022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc4020670 con 0x55e862a61360 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fb17fa640 1 -- 172.21.15.5:0/4054699022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6fcc06e020 con 0x55e862a61360 2024-04-25T08:59:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fdbc38740 10 client.5949 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fdbc38740 10 client.5949 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.720+0000 7f6fdbc38740 20 client.5949 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862aa8410 0x55e862aa8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fdbc38740 4 client.5949 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) v1 -- 0x55e8629ca770 con 0x55e862aa8410 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862aa8410 0x55e862aa8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fd1d9b640 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862aa8410 0x55e862aa8820 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=763aa4662f15baa6 server_cookie=7cc769891ca7a67c in_seq=0 out_seq=0 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fb17fa640 10 client.5949 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fb17fa640 1 -- 172.21.15.5:0/4054699022 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e8629ca770 con 0x55e862aa8410 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fb17fa640 10 client.5949 handle_command_reply: tid=0 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fdbc38740 1 client.5949 shutdown 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 msgr2=0x55e862a88d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a88d10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc004770 tx=0x7f6fcc009240 comp rx=0 tx=0).stop 2024-04-25T08:59:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.721+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 shutdown_connections 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55e862aa8410 0x55e862aa8820 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e862a8a140 0x55e862a5f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e862a82360 0x55e862a8b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fb17fa640 0 client.5949 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 1 --2- 172.21.15.5:0/4054699022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e862a61360 0x55e862a88d10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 >> 172.21.15.5:0/4054699022 conn(0x55e862a26810 msgr2=0x55e862a9c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 shutdown_connections 2024-04-25T08:59:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 1 -- 172.21.15.5:0/4054699022 wait complete. 2024-04-25T08:59:33.720 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6f4a360640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096a [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v448 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5123=0-4194304@1} caps={5123=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5123 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55f7be8c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1000000096a:[<0x10000000001/new_file_0 v448>,<0x10000000000/ceph-qa-suite v40>,<0x1/scrub_test_path v8>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-04-25T08:59:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fdbc38740 20 client.5949 trim_cache size 0 max 16384 2024-04-25T08:59:33.721 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:33.721 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:33.721 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "80592cbd-d867-4ce9-af8b-61ef21762213", 2024-04-25T08:59:33.721 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:33.721 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6fb406b4d0 msgr2=0x7f6fb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6fb406b4d0 0x7f6fb406d990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc034000 tx=0x7f6fcc02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd40cefe0 msgr2=0x7f6fd415c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd40cefe0 0x7f6fd415c920 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c410 tx=0x7f6fc800c8d0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 shutdown_connections 2024-04-25T08:59:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6fb406b4d0 0x7f6fb406d990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fd415df10 0x7f6fd41e7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fd40cefe0 0x7f6fd415c920 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 --2- 172.21.15.5:0/182569610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6fd40b6250 0x7f6fd41f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 >> 172.21.15.5:0/182569610 conn(0x7f6fd40668f0 msgr2=0x7f6fd40b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 shutdown_connections 2024-04-25T08:59:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.722+0000 7f6fd8e5d640 1 -- 172.21.15.5:0/182569610 wait complete. 2024-04-25T08:59:33.724 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '80592cbd-d867-4ce9-af8b-61ef21762213', 'mode': 'asynchronous'}' 2024-04-25T08:59:33.724 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:59:33.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:59:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.839+0000 7fce33ff5640 1 Processor -- start 2024-04-25T08:59:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.839+0000 7fce33ff5640 1 -- start start 2024-04-25T08:59:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce33ff5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce2c0d2f70 0x7fce2c0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce33ff5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce2c0ced50 0x7fce2c0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce33ff5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2c0d1ed0 con 0x7fce2c15df70 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce33ff5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2c0d1c80 con 0x7fce2c0d2f70 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce33ff5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2c0d2ae0 con 0x7fce2c0ced50 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31590640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce2c0d2f70 0x7fce2c0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31d91640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fce2c15df70 0x7fce2c0b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60448/0 (socket says 172.21.15.5:60448) 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31590640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce2c0d2f70 0x7fce2c0ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44100/0 (socket says 172.21.15.5:44100) 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31d91640 1 -- 172.21.15.5:0/952076599 learned_addr learned my addr 172.21.15.5:0/952076599 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce32592640 1 --2- 172.21.15.5:0/952076599 >> v2:172.21.15.80:3300/0 conn(0x7fce2c0ced50 0x7fce2c0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31590640 1 -- 172.21.15.5:0/952076599 >> v2:172.21.15.80:3300/0 conn(0x7fce2c0ced50 msgr2=0x7fce2c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31590640 1 --2- 172.21.15.5:0/952076599 >> v2:172.21.15.80:3300/0 conn(0x7fce2c0ced50 0x7fce2c0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31590640 1 -- 172.21.15.5:0/952076599 >> v1:172.21.15.5:6789/0 conn(0x7fce2c15df70 legacy=0x7fce2c0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce31590640 1 -- 172.21.15.5:0/952076599 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0d21b0 con 0x7fce2c0d2f70 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.840+0000 7fce32592640 1 --2- 172.21.15.5:0/952076599 >> v2:172.21.15.80:3300/0 conn(0x7fce2c0ced50 0x7fce2c0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce31590640 1 --2- 172.21.15.5:0/952076599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c0ce810 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fce2c08c740 tx=0x7fce2002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7f99f7c6afcf05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce30d8f640 1 -- 172.21.15.5:0/952076599 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20037070 con 0x7fce2c0d2f70 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce30d8f640 1 -- 172.21.15.5:0/952076599 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20032440 con 0x7fce2c0d2f70 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce30d8f640 1 -- 172.21.15.5:0/952076599 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20032810 con 0x7fce2c0d2f70 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce33ff5640 1 -- 172.21.15.5:0/952076599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 msgr2=0x7fce2c0ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce33ff5640 1 --2- 172.21.15.5:0/952076599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c0ce810 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fce2c08c740 tx=0x7fce2002a230 comp rx=0 tx=0).stop 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce33ff5640 1 -- 172.21.15.5:0/952076599 shutdown_connections 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce33ff5640 1 --2- 172.21.15.5:0/952076599 >> v2:172.21.15.80:3300/0 conn(0x7fce2c0ced50 0x7fce2c0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.841+0000 7fce33ff5640 1 --2- 172.21.15.5:0/952076599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c0ce810 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.842+0000 7fce33ff5640 1 -- 172.21.15.5:0/952076599 >> 172.21.15.5:0/952076599 conn(0x7fce2c06b000 msgr2=0x7fce2c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.842+0000 7fce33ff5640 1 -- 172.21.15.5:0/952076599 shutdown_connections 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.842+0000 7fce33ff5640 1 -- 172.21.15.5:0/952076599 wait complete. 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.843+0000 7fce33ff5640 1 Processor -- start 2024-04-25T08:59:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.843+0000 7fce33ff5640 1 -- start start 2024-04-25T08:59:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.843+0000 7fce33ff5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0ced50 0x7fce2c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.843+0000 7fce33ff5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce33ff5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce2c150600 0x7fce2c0b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce33ff5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0d3720 con 0x7fce2c0d2f70 2024-04-25T08:59:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce33ff5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0d2770 con 0x7fce2c0ced50 2024-04-25T08:59:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce33ff5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0d38a0 con 0x7fce2c150600 2024-04-25T08:59:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c14ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44102/0 (socket says 172.21.15.5:44102) 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 -- 172.21.15.5:0/1162429795 learned_addr learned my addr 172.21.15.5:0/1162429795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31d91640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0ced50 0x7fce2c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce32592640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce2c150600 0x7fce2c0b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 -- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce2c150600 msgr2=0x7fce2c0b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce2c150600 0x7fce2c0b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 -- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0ced50 msgr2=0x7fce2c0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0ced50 0x7fce2c0c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 -- 172.21.15.5:0/1162429795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0c7950 con 0x7fce2c0d2f70 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce31590640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c14ce60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fce20009890 tx=0x7fce200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce2a7fc640 1 -- 172.21.15.5:0/1162429795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20037040 con 0x7fce2c0d2f70 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce2a7fc640 1 -- 172.21.15.5:0/1162429795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20042070 con 0x7fce2c0d2f70 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce2a7fc640 1 -- 172.21.15.5:0/1162429795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20030bd0 con 0x7fce2c0d2f70 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c0c7c30 con 0x7fce2c0d2f70 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.844+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c0c8730 con 0x7fce2c0d2f70 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.846+0000 7fce2a7fc640 1 -- 172.21.15.5:0/1162429795 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce20047460 con 0x7fce2c0d2f70 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.846+0000 7fce2a7fc640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce1806b4d0 0x7fce1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.846+0000 7fce2a7fc640 1 -- 172.21.15.5:0/1162429795 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fce200aadb0 con 0x7fce2c0d2f70 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.847+0000 7fce31d91640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce1806b4d0 0x7fce1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.847+0000 7fce31d91640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce1806b4d0 0x7fce1806d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce24000f60 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.847+0000 7fce36dd2740 1 Processor -- start 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce36dd2740 1 -- start start 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddb10 0x564d467e0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddef0 0x564d467e0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467b0770 0x564d467b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce36dd2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d46719da0 con 0x564d467b0770 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d466c2b80 con 0x564d467ddef0 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d46715e40 con 0x564d467ddb10 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce32592640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467b0770 0x564d467b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce32592640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467b0770 0x564d467b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44120/0 (socket says 172.21.15.5:44120) 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce32592640 1 -- 172.21.15.5:0/281324714 learned_addr learned my addr 172.21.15.5:0/281324714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce31590640 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddef0 0x564d467e0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.848+0000 7fce31d91640 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddb10 0x564d467e0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce32592640 1 -- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddb10 msgr2=0x564d467e0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce32592640 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddb10 0x564d467e0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce32592640 1 -- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddef0 msgr2=0x564d467e0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce32592640 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddef0 0x564d467e0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce32592640 1 -- 172.21.15.5:0/281324714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d466ccf10 con 0x564d467b0770 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce32592640 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467b0770 0x564d467b3f80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fce1c007360 tx=0x7fce1c007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7bb3b452b7af92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce137fe640 1 -- 172.21.15.5:0/281324714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c013890 con 0x564d467b0770 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce137fe640 1 -- 172.21.15.5:0/281324714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c019070 con 0x564d467b0770 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.849+0000 7fce137fe640 1 -- 172.21.15.5:0/281324714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c013c30 con 0x564d467b0770 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 -- 172.21.15.5:0/281324714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467b0770 msgr2=0x564d467b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467b0770 0x564d467b3f80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fce1c007360 tx=0x7fce1c007820 comp rx=0 tx=0).stop 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 -- 172.21.15.5:0/281324714 shutdown_connections 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467b0770 0x564d467b3f80 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddef0 0x564d467e0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 --2- 172.21.15.5:0/281324714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddb10 0x564d467e0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 -- 172.21.15.5:0/281324714 >> 172.21.15.5:0/281324714 conn(0x564d467b29e0 msgr2=0x564d467fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 -- 172.21.15.5:0/281324714 shutdown_connections 2024-04-25T08:59:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 -- 172.21.15.5:0/281324714 wait complete. 2024-04-25T08:59:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 -- start start 2024-04-25T08:59:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.850+0000 7fce36dd2740 1 Processor -- start 2024-04-25T08:59:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddb10 0x564d467d8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467e1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467fe420 0x564d467e4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce36dd2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d467b5b90 con 0x564d467fe420 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d466b84b0 con 0x564d467ddb10 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d467b5e70 con 0x564d467ddef0 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce36dd2740 10 client.0 _ll_register_callbacks cb 0x564d466f8180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce32592640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467fe420 0x564d467e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce32592640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467fe420 0x564d467e4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44134/0 (socket says 172.21.15.5:44134) 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce32592640 1 -- 172.21.15.5:0/3451741434 learned_addr learned my addr 172.21.15.5:0/3451741434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce31590640 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467e1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.851+0000 7fce31d91640 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddb10 0x564d467d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce32592640 1 -- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 msgr2=0x564d467e1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce32592640 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467e1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce32592640 1 -- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddb10 msgr2=0x564d467d8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce32592640 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddb10 0x564d467d8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce32592640 1 -- 172.21.15.5:0/3451741434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d464f87d0 con 0x564d467fe420 2024-04-25T08:59:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce32592640 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467fe420 0x564d467e4320 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fce1c007860 tx=0x7fce1c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85f2ae1de778a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce10ff9640 1 -- 172.21.15.5:0/3451741434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c029680 con 0x564d467fe420 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce10ff9640 1 -- 172.21.15.5:0/3451741434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fce1c029820 con 0x564d467fe420 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce1c019070 con 0x564d467fe420 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce10ff9640 1 -- 172.21.15.5:0/3451741434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce1c031050 con 0x564d467fe420 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce36dd2740 10 client.5964 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x564d4642e3f0 con 0x564d467fe420 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.852+0000 7fce10ff9640 1 -- 172.21.15.5:0/3451741434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c019070 con 0x564d467fe420 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce10ff9640 1 -- 172.21.15.5:0/3451741434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce1c034020 con 0x564d467fe420 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce36dd2740 10 client.5964 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce36dd2740 10 client.5964 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce36dd2740 20 client.5964 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce36dd2740 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467d96a0 0x564d467fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce36dd2740 4 client.5964 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d467272e0 con 0x564d467d96a0 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce31d91640 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467d96a0 0x564d467fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce10ff9640 10 client.5964 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.853+0000 7fce31d91640 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467d96a0 0x564d467fc450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d2a62669e9b8658 server_cookie=d14f24678084e39b in_seq=0 out_seq=0 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce10ff9640 1 -- 172.21.15.5:0/3451741434 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564d467272e0 con 0x564d467d96a0 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce10ff9640 10 client.5964 handle_command_reply: tid=0 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 client.5964 shutdown 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467fe420 msgr2=0x564d467e4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467fe420 0x564d467e4320 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fce1c007860 tx=0x7fce1c004ab0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 shutdown_connections 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467d96a0 0x564d467fc450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467fe420 0x564d467e4320 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467e1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce10ff9640 0 client.5964 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 --2- 172.21.15.5:0/3451741434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467ddb10 0x564d467d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 >> 172.21.15.5:0/3451741434 conn(0x564d467b0770 msgr2=0x564d467dcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 shutdown_connections 2024-04-25T08:59:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 1 -- 172.21.15.5:0/3451741434 wait complete. 2024-04-25T08:59:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.854+0000 7fce36dd2740 20 client.5964 trim_cache size 0 max 16384 2024-04-25T08:59:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.869+0000 7fce36dd2740 1 Processor -- start 2024-04-25T08:59:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.869+0000 7fce36dd2740 1 -- start start 2024-04-25T08:59:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d467fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467d6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce36dd2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c200100 con 0x564d467ddb10 2024-04-25T08:59:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1ff300 con 0x564d467fe420 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1fe730 con 0x564d467ddef0 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d467fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d467fabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44140/0 (socket says 172.21.15.5:44140) 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 -- 172.21.15.5:0/605227186 learned_addr learned my addr 172.21.15.5:0/605227186 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31590640 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 -- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 msgr2=0x564d467f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce32592640 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467f0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 -- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 msgr2=0x564d467d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467d6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 -- 172.21.15.5:0/605227186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d463ee0f0 con 0x564d467ddb10 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce32592640 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467d6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.870+0000 7fce31d91640 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d467fabc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fce24005db0 tx=0x7fce24011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f159fddf50f08acf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce12ffd640 1 -- 172.21.15.5:0/605227186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2402c070 con 0x564d467ddb10 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce12ffd640 1 -- 172.21.15.5:0/605227186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce240070d0 con 0x564d467ddb10 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce12ffd640 1 -- 172.21.15.5:0/605227186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24027e60 con 0x564d467ddb10 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 -- 172.21.15.5:0/605227186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 msgr2=0x564d467fabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d467fabc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fce24005db0 tx=0x7fce24011000 comp rx=0 tx=0).stop 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 -- 172.21.15.5:0/605227186 shutdown_connections 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467d6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 --2- 172.21.15.5:0/605227186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d467fabc0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 -- 172.21.15.5:0/605227186 >> 172.21.15.5:0/605227186 conn(0x564d467b0770 msgr2=0x564d467e4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 -- 172.21.15.5:0/605227186 shutdown_connections 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.871+0000 7fce36dd2740 1 -- 172.21.15.5:0/605227186 wait complete. 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.872+0000 7fce36dd2740 1 -- start start 2024-04-25T08:59:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.872+0000 7fce36dd2740 1 Processor -- start 2024-04-25T08:59:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d46809c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467abc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467da130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d467e19a0 con 0x564d467ddb10 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1fed30 con 0x564d467fe420 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d467dbbc0 con 0x564d467ddef0 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 10 client.0 _ll_register_callbacks cb 0x7fce1c0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d46809c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d46809c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44156/0 (socket says 172.21.15.5:44156) 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 -- 172.21.15.5:0/2792263035 learned_addr learned my addr 172.21.15.5:0/2792263035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce32592640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467da130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31590640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 -- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 msgr2=0x564d467abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 -- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 msgr2=0x564d467da130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467da130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 -- 172.21.15.5:0/2792263035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d467fb6e0 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31590640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce31d91640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d46809c70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x564d467d8ce0 tx=0x7fce24000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b9f92dc845ff37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce10ff9640 1 -- 172.21.15.5:0/2792263035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2402c070 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce10ff9640 1 -- 172.21.15.5:0/2792263035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fce24027350 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce240070d0 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.873+0000 7fce10ff9640 1 -- 172.21.15.5:0/2792263035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce24027e60 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 10 client.5970 fetch_fsmap learned FSMap version 21 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x564d467fbfe0 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce10ff9640 1 -- 172.21.15.5:0/2792263035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce240070d0 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce10ff9640 1 -- 172.21.15.5:0/2792263035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce24027570 con 0x564d467ddb10 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 10 client.5970 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 10 client.5970 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 20 client.5970 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467ac1a0 0x564d467da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 4 client.5970 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564d46721630 con 0x564d467ac1a0 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce31590640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467ac1a0 0x564d467da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce10ff9640 10 client.5970 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce31590640 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467ac1a0 0x564d467da670 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c89dcc7cc0a215 server_cookie=7045fb12c3b707e7 in_seq=0 out_seq=0 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce10ff9640 1 -- 172.21.15.5:0/2792263035 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+696 (crc 0 0 0) 0x564d46721630 con 0x564d467ac1a0 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce10ff9640 10 client.5970 handle_command_reply: tid=0 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 1 client.5970 shutdown 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 msgr2=0x564d46809c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.874+0000 7fce36dd2740 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d46809c70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x564d467d8ce0 tx=0x7fce24000bc0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 shutdown_connections 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x564d467ac1a0 0x564d467da670 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d467fe420 0x564d467da130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce10ff9640 0 client.5970 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564d467ddef0 0x564d467abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 --2- 172.21.15.5:0/2792263035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d467ddb10 0x564d46809c70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 >> 172.21.15.5:0/2792263035 conn(0x564d467b0770 msgr2=0x564d467d7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 shutdown_connections 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 1 -- 172.21.15.5:0/2792263035 wait complete. 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce36dd2740 20 client.5970 trim_cache size 0 max 16384 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stdout: "577ff95f-768b-4445-9578-349e458d1bee": { 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "577ff95f-768b-4445-9578-349e458d1bee", 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "5ef9fabf-3036-4582-9f7c-60b5ecbfcae7": { 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "5ef9fabf-3036-4582-9f7c-60b5ecbfcae7", 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "80592cbd-d867-4ce9-af8b-61ef21762213": { 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "80592cbd-d867-4ce9-af8b-61ef21762213", 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce1806b4d0 msgr2=0x7fce1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce1806b4d0 0x7fce1806d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce24000f60 tx=0x7fce24009040 comp rx=0 tx=0).stop 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 msgr2=0x7fce2c14ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c14ce60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fce20009890 tx=0x7fce200046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 shutdown_connections 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce1806b4d0 0x7fce1806d990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce2c150600 0x7fce2c0b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c0d2f70 0x7fce2c14ce60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 --2- 172.21.15.5:0/1162429795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0ced50 0x7fce2c0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 >> 172.21.15.5:0/1162429795 conn(0x7fce2c06b000 msgr2=0x7fce2c0b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 shutdown_connections 2024-04-25T08:59:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:33.875+0000 7fce33ff5640 1 -- 172.21.15.5:0/1162429795 wait complete. 2024-04-25T08:59:36.635 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T08:59:36.646+0000 7f7b6dbf5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T08:59:38.875 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:59:38.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:59:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.002+0000 7f13066e1640 1 Processor -- start 2024-04-25T08:59:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.002+0000 7f13066e1640 1 -- start start 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f13066e1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f130015e0b0 0x7f130006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f13066e1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13000cc780 0x7f13000ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f13066e1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000d27f0 con 0x7f13000d0c80 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f13066e1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000cfee0 con 0x7f130015e0b0 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f13066e1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000d01c0 con 0x7f13000cc780 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f12fffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f130015e0b0 0x7f130006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f12fffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f130015e0b0 0x7f130006adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44172/0 (socket says 172.21.15.5:44172) 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.003+0000 7f12fffff640 1 -- 172.21.15.5:0/2659059060 learned_addr learned my addr 172.21.15.5:0/2659059060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.004+0000 7f1304c7e640 1 --2- 172.21.15.5:0/2659059060 >> v2:172.21.15.80:3300/0 conn(0x7f13000cc780 0x7f13000ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.004+0000 7f12fffff640 1 -- 172.21.15.5:0/2659059060 >> v2:172.21.15.80:3300/0 conn(0x7f13000cc780 msgr2=0x7f13000ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.004+0000 7f12fffff640 1 --2- 172.21.15.5:0/2659059060 >> v2:172.21.15.80:3300/0 conn(0x7f13000cc780 0x7f13000ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.004+0000 7f12fffff640 1 -- 172.21.15.5:0/2659059060 >> v1:172.21.15.5:6789/0 conn(0x7f13000d0c80 legacy=0x7f13000cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:38.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.004+0000 7f12fffff640 1 -- 172.21.15.5:0/2659059060 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000d04a0 con 0x7f130015e0b0 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.004+0000 7f12fffff640 1 --2- 172.21.15.5:0/2659059060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f130006adf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009870 tx=0x7f12f002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b573ea36c7585 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f12feffd640 1 -- 172.21.15.5:0/2659059060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0037070 con 0x7f130015e0b0 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f12feffd640 1 -- 172.21.15.5:0/2659059060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0032440 con 0x7f130015e0b0 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f12feffd640 1 -- 172.21.15.5:0/2659059060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0032810 con 0x7f130015e0b0 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 -- 172.21.15.5:0/2659059060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 msgr2=0x7f130006adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 --2- 172.21.15.5:0/2659059060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f130006adf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009870 tx=0x7f12f002a2a0 comp rx=0 tx=0).stop 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 -- 172.21.15.5:0/2659059060 shutdown_connections 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 --2- 172.21.15.5:0/2659059060 >> v2:172.21.15.80:3300/0 conn(0x7f13000cc780 0x7f13000ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 --2- 172.21.15.5:0/2659059060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f130006adf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 -- 172.21.15.5:0/2659059060 >> 172.21.15.5:0/2659059060 conn(0x7f13000d1a20 msgr2=0x7f13000d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 -- 172.21.15.5:0/2659059060 shutdown_connections 2024-04-25T08:59:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.005+0000 7f13066e1640 1 -- 172.21.15.5:0/2659059060 wait complete. 2024-04-25T08:59:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.006+0000 7f13066e1640 1 Processor -- start 2024-04-25T08:59:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.007+0000 7f13066e1640 1 -- start start 2024-04-25T08:59:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.007+0000 7f13066e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000cc780 0x7f130015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.007+0000 7f13066e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13000d0c80 0x7f13000ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.007+0000 7f13066e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f1300159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.007+0000 7f13066e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000cfb90 con 0x7f130015e0b0 2024-04-25T08:59:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.007+0000 7f13066e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130015e490 con 0x7f13000cc780 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.007+0000 7f13066e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000ccc30 con 0x7f13000d0c80 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f1300159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f1300159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44174/0 (socket says 172.21.15.5:44174) 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 -- 172.21.15.5:0/3173304235 learned_addr learned my addr 172.21.15.5:0/3173304235 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f12fffff640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000cc780 0x7f130015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13000d0c80 0x7f13000ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 -- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13000d0c80 msgr2=0x7f13000ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13000d0c80 0x7f13000ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 -- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000cc780 msgr2=0x7f130015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000cc780 0x7f130015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 -- 172.21.15.5:0/3173304235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130015f870 con 0x7f130015e0b0 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f1304c7e640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f1300159aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f12f8007e40 tx=0x7f12f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f12fcff9640 1 -- 172.21.15.5:0/3173304235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8014620 con 0x7f130015e0b0 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f12fcff9640 1 -- 172.21.15.5:0/3173304235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8019070 con 0x7f130015e0b0 2024-04-25T08:59:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130015fb50 con 0x7f130015e0b0 2024-04-25T08:59:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f12fcff9640 1 -- 172.21.15.5:0/3173304235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8014a20 con 0x7f130015e0b0 2024-04-25T08:59:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.008+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300160110 con 0x7f130015e0b0 2024-04-25T08:59:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.010+0000 7f12fcff9640 1 -- 172.21.15.5:0/3173304235 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f12f8014bc0 con 0x7f130015e0b0 2024-04-25T08:59:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.010+0000 7f12fcff9640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e006b4d0 0x7f12e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.010+0000 7f12fcff9640 1 -- 172.21.15.5:0/3173304235 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f12f808aaa0 con 0x7f130015e0b0 2024-04-25T08:59:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.011+0000 7f12fffff640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e006b4d0 0x7f12e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.011+0000 7f12fffff640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e006b4d0 0x7f12e006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f12f0034000 tx=0x7f12f002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.011+0000 7f13093e3740 1 Processor -- start 2024-04-25T08:59:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.011+0000 7f13093e3740 1 -- start start 2024-04-25T08:59:39.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d21c9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f13093e3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d2199770 0x55b1d219cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f13093e3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d2102da0 con 0x55b1d21c6ef0 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d20abb80 con 0x55b1d21c6b10 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1d20fee40 con 0x55b1d2199770 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44184/0 (socket says 172.21.15.5:44184) 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 -- 172.21.15.5:0/255339544 learned_addr learned my addr 172.21.15.5:0/255339544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12fffff640 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d21c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f1304c7e640 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d2199770 0x55b1d219cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 -- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d2199770 msgr2=0x55b1d219cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d2199770 0x55b1d219cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 -- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 msgr2=0x55b1d21c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d21c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.012+0000 7f12ff7fe640 1 -- 172.21.15.5:0/255339544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1d20b5f10 con 0x55b1d21c6ef0 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.013+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c9860 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f12e8001540 tx=0x7f12e8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a285a434ddab0892 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.013+0000 7f12f5ffb640 1 -- 172.21.15.5:0/255339544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8019070 con 0x55b1d21c6ef0 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.013+0000 7f12f5ffb640 1 -- 172.21.15.5:0/255339544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e80050d0 con 0x55b1d21c6ef0 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.013+0000 7f12f5ffb640 1 -- 172.21.15.5:0/255339544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80054a0 con 0x55b1d21c6ef0 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.013+0000 7f13093e3740 1 -- 172.21.15.5:0/255339544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 msgr2=0x55b1d21c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.013+0000 7f13093e3740 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c9860 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f12e8001540 tx=0x7f12e8001a00 comp rx=0 tx=0).stop 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 -- 172.21.15.5:0/255339544 shutdown_connections 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d2199770 0x55b1d219cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c9860 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 --2- 172.21.15.5:0/255339544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d21c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 -- 172.21.15.5:0/255339544 >> 172.21.15.5:0/255339544 conn(0x55b1d219b9e0 msgr2=0x55b1d21e4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 -- 172.21.15.5:0/255339544 shutdown_connections 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 -- 172.21.15.5:0/255339544 wait complete. 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 -- start start 2024-04-25T08:59:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.014+0000 7f13093e3740 1 Processor -- start 2024-04-25T08:59:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d21be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f13093e3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21e7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f13093e3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d219eb90 con 0x55b1d21de950 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d20a14b0 con 0x55b1d21c6ef0 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1d219ee70 con 0x55b1d21c6b10 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f13093e3740 10 client.0 _ll_register_callbacks cb 0x55b1d20e1180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f1304c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f1304c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44186/0 (socket says 172.21.15.5:44186) 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f1304c7e640 1 -- 172.21.15.5:0/1937120928 learned_addr learned my addr 172.21.15.5:0/1937120928 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.015+0000 7f12fffff640 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d21be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f1304c7e640 1 -- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 msgr2=0x55b1d21be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f1304c7e640 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d21be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f1304c7e640 1 -- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6ef0 msgr2=0x55b1d21c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f1304c7e640 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f1304c7e640 1 -- 172.21.15.5:0/1937120928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1d1ee17d0 con 0x55b1d21de950 2024-04-25T08:59:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f1304c7e640 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21e7890 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f12f8058f70 tx=0x7f12f805d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff097cb893949038 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f12deffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f12deffd640 1 -- 172.21.15.5:0/1937120928 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f805d170 con 0x55b1d21de950 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f12deffd640 1 -- 172.21.15.5:0/1937120928 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f12f80614f0 con 0x55b1d21de950 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12e80050d0 con 0x55b1d21de950 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f12deffd640 1 -- 172.21.15.5:0/1937120928 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12f80616f0 con 0x55b1d21de950 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f13093e3740 10 client.5985 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55b1d1e173f0 con 0x55b1d21de950 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f12deffd640 1 -- 172.21.15.5:0/1937120928 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e80050d0 con 0x55b1d21de950 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f12deffd640 1 -- 172.21.15.5:0/1937120928 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12f80586c0 con 0x55b1d21de950 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f13093e3740 10 client.5985 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f13093e3740 10 client.5985 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.016+0000 7f13093e3740 20 client.5985 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f13093e3740 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e66e0 0x55b1d21e6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f13093e3740 4 client.5985 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1d21102e0 con 0x55b1d21e66e0 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f12fffff640 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e66e0 0x55b1d21e6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f12fffff640 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e66e0 0x55b1d21e6af0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f3ea3eb15fe4cdf server_cookie=51385f30d302f113 in_seq=0 out_seq=0 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f12deffd640 10 client.5985 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f12deffd640 1 -- 172.21.15.5:0/1937120928 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b1d21102e0 con 0x55b1d21e66e0 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.017+0000 7f12deffd640 10 client.5985 handle_command_reply: tid=0 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 client.5985 shutdown 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 msgr2=0x55b1d21e7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21e7890 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f12f8058f70 tx=0x7f12f805d480 comp rx=0 tx=0).stop 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 shutdown_connections 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e66e0 0x55b1d21e6af0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21e7890 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f12deffd640 0 client.5985 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 --2- 172.21.15.5:0/1937120928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d21be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 >> 172.21.15.5:0/1937120928 conn(0x55b1d2199770 msgr2=0x55b1d21c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 shutdown_connections 2024-04-25T08:59:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 1 -- 172.21.15.5:0/1937120928 wait complete. 2024-04-25T08:59:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.018+0000 7f13093e3740 20 client.5985 trim_cache size 0 max 16384 2024-04-25T08:59:39.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.033+0000 7f13093e3740 1 Processor -- start 2024-04-25T08:59:39.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.033+0000 7f13093e3740 1 -- start start 2024-04-25T08:59:39.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d219a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f13093e3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21de950 0x55b1d21bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f13093e3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d21de560 con 0x55b1d21c6ef0 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300200080 con 0x55b1d21de950 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13001ff2b0 con 0x55b1d21c6b10 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44194/0 (socket says 172.21.15.5:44194) 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 -- 172.21.15.5:0/4048256295 learned_addr learned my addr 172.21.15.5:0/4048256295 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f1304c7e640 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21de950 0x55b1d21bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12fffff640 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d219a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 -- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 msgr2=0x55b1d219a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d219a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 -- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21de950 msgr2=0x55b1d21bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21de950 0x55b1d21bde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12ff7fe640 1 -- 172.21.15.5:0/4048256295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1d1dd70f0 con 0x55b1d21c6ef0 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f12fffff640 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d219a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.034+0000 7f1304c7e640 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21de950 0x55b1d21bde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0fd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f12e8007000 tx=0x7f12e8005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d286a571c19e35b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f12f57fa640 1 -- 172.21.15.5:0/4048256295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8025070 con 0x55b1d21c6ef0 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f12f57fa640 1 -- 172.21.15.5:0/4048256295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e801a040 con 0x55b1d21c6ef0 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f12f57fa640 1 -- 172.21.15.5:0/4048256295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8019070 con 0x55b1d21c6ef0 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 -- 172.21.15.5:0/4048256295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 msgr2=0x55b1d21c0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0fd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f12e8007000 tx=0x7f12e8005000 comp rx=0 tx=0).stop 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 -- 172.21.15.5:0/4048256295 shutdown_connections 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21de950 0x55b1d21bde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21c6ef0 0x55b1d21c0fd0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 --2- 172.21.15.5:0/4048256295 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6b10 0x55b1d219a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 -- 172.21.15.5:0/4048256295 >> 172.21.15.5:0/4048256295 conn(0x55b1d2199770 msgr2=0x55b1d21c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 -- 172.21.15.5:0/4048256295 shutdown_connections 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.035+0000 7f13093e3740 1 -- 172.21.15.5:0/4048256295 wait complete. 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.036+0000 7f13093e3740 1 -- start start 2024-04-25T08:59:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.036+0000 7f13093e3740 1 Processor -- start 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d224ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f13093e3740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6ef0 0x55b1d21f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f13093e3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f13093e3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001f4f00 con 0x55b1d21de950 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001f4900 con 0x55b1d21c6b10 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f13093e3740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1d21bf160 con 0x55b1d21c6ef0 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f13093e3740 10 client.0 _ll_register_callbacks cb 0x7f12e8007e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44200/0 (socket says 172.21.15.5:44200) 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 -- 172.21.15.5:0/1765895615 learned_addr learned my addr 172.21.15.5:0/1765895615 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f12ff7fe640 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6ef0 0x55b1d21f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f12fffff640 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d224ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 -- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6ef0 msgr2=0x55b1d21f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6ef0 0x55b1d21f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 -- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 msgr2=0x55b1d224ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d224ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.037+0000 7f1304c7e640 1 -- 172.21.15.5:0/1765895615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1d21f6370 con 0x55b1d21de950 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f1304c7e640 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21ccc30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f12f8058f20 tx=0x7f12f800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df26978140c3b3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f12deffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f12deffd640 1 -- 172.21.15.5:0/1765895615 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f805d170 con 0x55b1d21de950 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f12deffd640 1 -- 172.21.15.5:0/1765895615 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f12f80614f0 con 0x55b1d21de950 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12e801a040 con 0x55b1d21de950 2024-04-25T08:59:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f12deffd640 1 -- 172.21.15.5:0/1765895615 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12f8069050 con 0x55b1d21de950 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 10 client.5991 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55b1d21f6370 con 0x55b1d21de950 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f12deffd640 1 -- 172.21.15.5:0/1765895615 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e801a040 con 0x55b1d21de950 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f12deffd640 1 -- 172.21.15.5:0/1765895615 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12f806c020 con 0x55b1d21de950 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 10 client.5991 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 10 client.5991 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 20 client.5991 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e5450 0x55b1d21cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 4 client.5991 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b1d210a630 con 0x55b1d21e5450 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.038+0000 7f12fffff640 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e5450 0x55b1d21cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f12deffd640 10 client.5991 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f12fffff640 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e5450 0x55b1d21cd170 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66f41e202dfcc719 server_cookie=2392c9e665bfb645 in_seq=0 out_seq=0 2024-04-25T08:59:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f12deffd640 1 -- 172.21.15.5:0/1765895615 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b1d210a630 con 0x55b1d21e5450 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f12deffd640 10 client.5991 handle_command_reply: tid=0 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 client.5991 shutdown 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 msgr2=0x55b1d21ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21ccc30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f12f8058f20 tx=0x7f12f800ef90 comp rx=0 tx=0).stop 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 shutdown_connections 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b1d21e5450 0x55b1d21cd170 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1d21de950 0x55b1d21ccc30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b1d21c6ef0 0x55b1d21f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f12deffd640 0 client.5991 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 --2- 172.21.15.5:0/1765895615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1d21c6b10 0x55b1d224ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 >> 172.21.15.5:0/1765895615 conn(0x55b1d2199770 msgr2=0x55b1d21c0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 shutdown_connections 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 1 -- 172.21.15.5:0/1765895615 wait complete. 2024-04-25T08:59:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.039+0000 7f13093e3740 20 client.5991 trim_cache size 0 max 16384 2024-04-25T08:59:39.034 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-04-25T08:59:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T08:59:39.034 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e006b4d0 msgr2=0x7f12e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e006b4d0 0x7f12e006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f12f0034000 tx=0x7f12f002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 msgr2=0x7f1300159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f1300159aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f12f8007e40 tx=0x7f12f800e4b0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 shutdown_connections 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e006b4d0 0x7f12e006d990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130015e0b0 0x7f1300159aa0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13000d0c80 0x7f13000ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 --2- 172.21.15.5:0/3173304235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000cc780 0x7f130015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 >> 172.21.15.5:0/3173304235 conn(0x7f13000d1a20 msgr2=0x7f13000b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 shutdown_connections 2024-04-25T08:59:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.040+0000 7f13066e1640 1 -- 172.21.15.5:0/3173304235 wait complete. 2024-04-25T08:59:39.039 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:59:39.039 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:39.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:59:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.154+0000 7fbd210cb640 1 Processor -- start 2024-04-25T08:59:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.154+0000 7fbd210cb640 1 -- start start 2024-04-25T08:59:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.155+0000 7fbd210cb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd1c0b6250 0x7fbd1c0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.155+0000 7fbd210cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c162150 con 0x7fbd1c0cee10 2024-04-25T08:59:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.155+0000 7fbd210cb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c162430 con 0x7fbd1c15df10 2024-04-25T08:59:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.155+0000 7fbd210cb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0cf260 con 0x7fbd1c0b6250 2024-04-25T08:59:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.155+0000 7fbd1b59e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbd1c0cee10 0x7fbd1c0d2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60472/0 (socket says 172.21.15.5:60472) 2024-04-25T08:59:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.155+0000 7fbd1b59e640 1 -- 172.21.15.5:0/2679251348 learned_addr learned my addr 172.21.15.5:0/2679251348 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.155+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/2679251348 >> v2:172.21.15.80:3300/0 conn(0x7fbd1c0b6250 0x7fbd1c0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.156+0000 7fbd19d9b640 1 -- 172.21.15.5:0/2679251348 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702680979 0 0) 0x7fbd1c162150 con 0x7fbd1c0cee10 2024-04-25T08:59:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.156+0000 7fbd19d9b640 1 -- 172.21.15.5:0/2679251348 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd08003520 con 0x7fbd1c0cee10 2024-04-25T08:59:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.156+0000 7fbd1a59c640 1 -- 172.21.15.5:0/2679251348 >> v1:172.21.15.80:6789/0 conn(0x7fbd1c15df10 legacy=0x7fbd1c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.156+0000 7fbd1a59c640 1 -- 172.21.15.5:0/2679251348 >> v1:172.21.15.5:6789/0 conn(0x7fbd1c0cee10 legacy=0x7fbd1c0d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.156+0000 7fbd1a59c640 1 -- 172.21.15.5:0/2679251348 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c162710 con 0x7fbd1c0b6250 2024-04-25T08:59:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/2679251348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c0b6250 0x7fbd1c0ce8d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097a0 tx=0x7fbd0402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1a07eeef995f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd19d9b640 1 -- 172.21.15.5:0/2679251348 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04037070 con 0x7fbd1c0b6250 2024-04-25T08:59:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd19d9b640 1 -- 172.21.15.5:0/2679251348 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04032440 con 0x7fbd1c0b6250 2024-04-25T08:59:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd19d9b640 1 -- 172.21.15.5:0/2679251348 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040327f0 con 0x7fbd1c0b6250 2024-04-25T08:59:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd210cb640 1 -- 172.21.15.5:0/2679251348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c0b6250 msgr2=0x7fbd1c0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd210cb640 1 --2- 172.21.15.5:0/2679251348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c0b6250 0x7fbd1c0ce8d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097a0 tx=0x7fbd0402a230 comp rx=0 tx=0).stop 2024-04-25T08:59:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd210cb640 1 -- 172.21.15.5:0/2679251348 shutdown_connections 2024-04-25T08:59:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd210cb640 1 --2- 172.21.15.5:0/2679251348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c0b6250 0x7fbd1c0ce8d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd210cb640 1 -- 172.21.15.5:0/2679251348 >> 172.21.15.5:0/2679251348 conn(0x7fbd1c0668f0 msgr2=0x7fbd1c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd210cb640 1 -- 172.21.15.5:0/2679251348 shutdown_connections 2024-04-25T08:59:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.157+0000 7fbd210cb640 1 -- 172.21.15.5:0/2679251348 wait complete. 2024-04-25T08:59:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.159+0000 7fbd210cb640 1 Processor -- start 2024-04-25T08:59:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.159+0000 7fbd210cb640 1 -- start start 2024-04-25T08:59:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbd1c0b6250 0x7fbd1c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd1c0cee10 0x7fbd1c160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c15df10 0x7fbd1c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0d2c70 con 0x7fbd1c0cee10 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0d20d0 con 0x7fbd1c15df10 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0d2df0 con 0x7fbd1c0b6250 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd1c0cee10 0x7fbd1c160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd1c0cee10 0x7fbd1c160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44202/0 (socket says 172.21.15.5:44202) 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1531021121 learned_addr learned my addr 172.21.15.5:0/1531021121 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c15df10 0x7fbd1c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbd1c0b6250 msgr2=0x7fbd1c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbd1c0b6250 0x7fbd1c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbd1c0b6250 0x7fbd1c15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c15df10 msgr2=0x7fbd1c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c15df10 0x7fbd1c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1531021121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c15e830 con 0x7fbd1c0cee10 2024-04-25T08:59:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c15df10 0x7fbd1c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbd1c0b6250 0x7fbd1c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd1c0cee10 0x7fbd1c160960 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097a0 tx=0x7fbd040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd137fe640 1 -- 172.21.15.5:0/1531021121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04037050 con 0x7fbd1c0cee10 2024-04-25T08:59:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd137fe640 1 -- 172.21.15.5:0/1531021121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04038040 con 0x7fbd1c0cee10 2024-04-25T08:59:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd137fe640 1 -- 172.21.15.5:0/1531021121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04004470 con 0x7fbd1c0cee10 2024-04-25T08:59:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c0cb7d0 con 0x7fbd1c0cee10 2024-04-25T08:59:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.160+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c15ed90 con 0x7fbd1c0cee10 2024-04-25T08:59:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.162+0000 7fbd137fe640 1 -- 172.21.15.5:0/1531021121 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd0403c6d0 con 0x7fbd1c0cee10 2024-04-25T08:59:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.162+0000 7fbd137fe640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbcfc06b4d0 0x7fbcfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.162+0000 7fbd137fe640 1 -- 172.21.15.5:0/1531021121 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbd040aacc0 con 0x7fbd1c0cee10 2024-04-25T08:59:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.162+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbcfc06b4d0 0x7fbcfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.163+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbcfc06b4d0 0x7fbcfc06d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd140015e0 tx=0x7fbd14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.163+0000 7fbd23dce740 1 Processor -- start 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd23dce740 1 -- start start 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2a1700 0x5604ca2a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd23dce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ca20ae00 con 0x5604ca2cee80 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ca1b3d20 con 0x5604ca2a1700 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604ca206ea0 con 0x5604ca2ceaa0 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44216/0 (socket says 172.21.15.5:44216) 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1987760827 learned_addr learned my addr 172.21.15.5:0/1987760827 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2a1700 0x5604ca2a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.164+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 msgr2=0x5604ca2d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2a1700 msgr2=0x5604ca2a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2a1700 0x5604ca2a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd1a59c640 1 -- 172.21.15.5:0/1987760827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604ca1d5df0 con 0x5604ca2cee80 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2d17f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbd040815e0 tx=0x7fbd04009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36311b62cb69984 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd10ff9640 1 -- 172.21.15.5:0/1987760827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0407d4c0 con 0x5604ca2cee80 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd10ff9640 1 -- 172.21.15.5:0/1987760827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04081b10 con 0x5604ca2cee80 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.165+0000 7fbd10ff9640 1 -- 172.21.15.5:0/1987760827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0407d160 con 0x5604ca2cee80 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 -- 172.21.15.5:0/1987760827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 msgr2=0x5604ca2d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2d17f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbd040815e0 tx=0x7fbd04009190 comp rx=0 tx=0).stop 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 -- 172.21.15.5:0/1987760827 shutdown_connections 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2a1700 0x5604ca2a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2d17f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 --2- 172.21.15.5:0/1987760827 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 -- 172.21.15.5:0/1987760827 >> 172.21.15.5:0/1987760827 conn(0x5604ca2a3970 msgr2=0x5604ca2ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 -- 172.21.15.5:0/1987760827 shutdown_connections 2024-04-25T08:59:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 -- 172.21.15.5:0/1987760827 wait complete. 2024-04-25T08:59:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 -- start start 2024-04-25T08:59:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.166+0000 7fbd23dce740 1 Processor -- start 2024-04-25T08:59:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2cee80 0x5604ca2d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca2eea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd23dce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ca2a6b20 con 0x5604ca2ee5e0 2024-04-25T08:59:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ca1a9590 con 0x5604ca2ceaa0 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604ca2a6e00 con 0x5604ca2cee80 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd23dce740 10 client.0 _ll_register_callbacks cb 0x5604ca1b5e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd1b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca2eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd1b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca2eea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44228/0 (socket says 172.21.15.5:44228) 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd1b59e640 1 -- 172.21.15.5:0/956511279 learned_addr learned my addr 172.21.15.5:0/956511279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.167+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2cee80 0x5604ca2d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1b59e640 1 -- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2cee80 msgr2=0x5604ca2d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2cee80 0x5604ca2d2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1b59e640 1 -- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 msgr2=0x5604ca2f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1b59e640 1 -- 172.21.15.5:0/956511279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604c9f1f3f0 con 0x5604ca2ee5e0 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2cee80 0x5604ca2d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca2eea60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c007610 tx=0x7fbd0c007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f233ea7093fd2098 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbcf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/956511279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0107c0 con 0x5604ca2ee5e0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/956511279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbd0c010960 con 0x5604ca2ee5e0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd04081b10 con 0x5604ca2ee5e0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/956511279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd0c021050 con 0x5604ca2ee5e0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 10 client.6003 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5604c9fe97d0 con 0x5604ca2ee5e0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/956511279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04081b10 con 0x5604ca2ee5e0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/956511279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbd0c024020 con 0x5604ca2ee5e0 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 10 client.6003 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 10 client.6003 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 20 client.6003 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca307a50 0x5604ca309e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 4 client.6003 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.168+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604ca218340 con 0x5604ca307a50 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca307a50 0x5604ca309e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca307a50 0x5604ca309e40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bee50085dd7989bc server_cookie=930974bd577b19a5 in_seq=0 out_seq=0 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbcf9ffb640 10 client.6003 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/956511279 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5604ca218340 con 0x5604ca307a50 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbcf9ffb640 10 client.6003 handle_command_reply: tid=0 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbd23dce740 1 client.6003 shutdown 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 msgr2=0x5604ca2eea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.169+0000 7fbd23dce740 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca2eea60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c007610 tx=0x7fbd0c007ad0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 shutdown_connections 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca307a50 0x5604ca309e40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca2eea60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2cee80 0x5604ca2d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 --2- 172.21.15.5:0/956511279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbcf9ffb640 0 client.6003 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 >> 172.21.15.5:0/956511279 conn(0x5604ca2a1700 msgr2=0x5604ca2e9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 shutdown_connections 2024-04-25T08:59:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 1 -- 172.21.15.5:0/956511279 wait complete. 2024-04-25T08:59:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.170+0000 7fbd23dce740 20 client.6003 trim_cache size 0 max 16384 2024-04-25T08:59:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 Processor -- start 2024-04-25T08:59:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 -- start start 2024-04-25T08:59:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2cee80 0x5604ca30de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca30e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c200040 con 0x5604ca2ee5e0 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1ff200 con 0x5604ca2cee80 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1f8400 con 0x5604ca2ceaa0 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd1b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca30e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd1b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca30e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44242/0 (socket says 172.21.15.5:44242) 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.182+0000 7fbd1b59e640 1 -- 172.21.15.5:0/3952056627 learned_addr learned my addr 172.21.15.5:0/3952056627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2cee80 0x5604ca30de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1b59e640 1 -- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 msgr2=0x5604ca2a24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2a24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1b59e640 1 -- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2cee80 msgr2=0x5604ca30de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2cee80 0x5604ca30de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1b59e640 1 -- 172.21.15.5:0/3952056627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604ca2f0980 con 0x5604ca2ee5e0 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca30e3a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c011010 tx=0x7fbd0c007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a03fbe16f0c8634 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbcfbfff640 1 -- 172.21.15.5:0/3952056627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0108d0 con 0x5604ca2ee5e0 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbcfbfff640 1 -- 172.21.15.5:0/3952056627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c019070 con 0x5604ca2ee5e0 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbcfbfff640 1 -- 172.21.15.5:0/3952056627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c004d60 con 0x5604ca2ee5e0 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd23dce740 1 -- 172.21.15.5:0/3952056627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 msgr2=0x5604ca30e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.183+0000 7fbd23dce740 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca30e3a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c011010 tx=0x7fbd0c007c00 comp rx=0 tx=0).stop 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 -- 172.21.15.5:0/3952056627 shutdown_connections 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2ee5e0 0x5604ca30e3a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2cee80 0x5604ca30de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 --2- 172.21.15.5:0/3952056627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ceaa0 0x5604ca2a24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 -- 172.21.15.5:0/3952056627 >> 172.21.15.5:0/3952056627 conn(0x5604ca2a1700 msgr2=0x5604ca2f0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 -- 172.21.15.5:0/3952056627 shutdown_connections 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 -- 172.21.15.5:0/3952056627 wait complete. 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 -- start start 2024-04-25T08:59:39.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.184+0000 7fbd23dce740 1 Processor -- start 2024-04-25T08:59:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2ede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd23dce740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ee5e0 0x5604ca2f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd23dce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1fec90 con 0x5604ca2cee80 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ca210080 con 0x5604ca2ceaa0 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd23dce740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604ca2ed3e0 con 0x5604ca2ee5e0 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd23dce740 10 client.0 _ll_register_callbacks cb 0x7fbd04075690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2ede30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44244/0 (socket says 172.21.15.5:44244) 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 -- 172.21.15.5:0/283847417 learned_addr learned my addr 172.21.15.5:0/283847417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1b59e640 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ee5e0 0x5604ca2f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 -- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ee5e0 msgr2=0x5604ca2f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ee5e0 0x5604ca2f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 -- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 msgr2=0x5604ca2cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 -- 172.21.15.5:0/283847417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604ca2cba90 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.185+0000 7fbd1a59c640 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2ede30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009560 tx=0x7fbd04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1d7046fcfa2955 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbcf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/283847417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040a6040 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/283847417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbd0407d160 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd0c019070 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/283847417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd04079140 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 10 client.6009 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5604ca351660 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/283847417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c019070 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/283847417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbd04081680 con 0x5604ca2cee80 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 10 client.6009 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 10 client.6009 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 20 client.6009 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca351c80 0x5604ca2e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 4 client.6009 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5604ca212690 con 0x5604ca351c80 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca351c80 0x5604ca2e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbcf9ffb640 10 client.6009 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.186+0000 7fbd1ad9d640 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca351c80 0x5604ca2e1c40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a6640f194cb0919 server_cookie=4286b93b2bbc06e4 in_seq=0 out_seq=0 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbcf9ffb640 1 -- 172.21.15.5:0/283847417 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x5604ca212690 con 0x5604ca351c80 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbcf9ffb640 10 client.6009 handle_command_reply: tid=0 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 client.6009 shutdown 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 msgr2=0x5604ca2ede30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2ede30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009560 tx=0x7fbd04000bc0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 shutdown_connections 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5604ca351c80 0x5604ca2e1c40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604ca2ee5e0 0x5604ca2f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5604ca2cee80 0x5604ca2ede30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbcf9ffb640 0 client.6009 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 --2- 172.21.15.5:0/283847417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604ca2ceaa0 0x5604ca2cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 >> 172.21.15.5:0/283847417 conn(0x5604ca2a1700 msgr2=0x5604ca29cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 shutdown_connections 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 1 -- 172.21.15.5:0/283847417 wait complete. 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd23dce740 20 client.6009 trim_cache size 0 max 16384 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2024-04-25T08:59:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 2970589833, 2024-04-25T08:59:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511630186, 2024-04-25T08:59:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-04-25T08:59:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:39.183 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T08:59:39.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbcfc06b4d0 msgr2=0x7fbcfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbcfc06b4d0 0x7fbcfc06d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd140015e0 tx=0x7fbd14009040 comp rx=0 tx=0).stop 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd1c0cee10 msgr2=0x7fbd1c160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd1c0cee10 0x7fbd1c160960 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097a0 tx=0x7fbd040046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 shutdown_connections 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbcfc06b4d0 0x7fbcfc06d990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1c15df10 0x7fbd1c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd1c0cee10 0x7fbd1c160960 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 --2- 172.21.15.5:0/1531021121 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbd1c0b6250 0x7fbd1c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.187+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 >> 172.21.15.5:0/1531021121 conn(0x7fbd1c0668f0 msgr2=0x7fbd1c161830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.188+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 shutdown_connections 2024-04-25T08:59:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.188+0000 7fbd210cb640 1 -- 172.21.15.5:0/1531021121 wait complete. 2024-04-25T08:59:39.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:39.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.299+0000 7f96acbc4640 1 Processor -- start 2024-04-25T08:59:39.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.299+0000 7f96acbc4640 1 -- start start 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96acbc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f96a80b2cc0 0x7f96a80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96acbc4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a80d20e0 con 0x7f96a815de70 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96acbc4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a80d23c0 con 0x7f96a80b7130 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96acbc4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a80d2a10 con 0x7f96a80b2cc0 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96a659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f96a815de70 0x7f96a80b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60488/0 (socket says 172.21.15.5:60488) 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96a659c640 1 -- 172.21.15.5:0/1143609778 learned_addr learned my addr 172.21.15.5:0/1143609778 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f969ffff640 1 --2- 172.21.15.5:0/1143609778 >> v2:172.21.15.80:3300/0 conn(0x7f96a80b2cc0 0x7f96a80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96a5d9b640 1 -- 172.21.15.5:0/1143609778 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717122483 0 0) 0x7f96a80d20e0 con 0x7f96a815de70 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96a5d9b640 1 -- 172.21.15.5:0/1143609778 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9694003520 con 0x7f96a815de70 2024-04-25T08:59:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f969ffff640 1 -- 172.21.15.5:0/1143609778 >> v1:172.21.15.80:6789/0 conn(0x7f96a80b7130 legacy=0x7f96a80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f96a5d9b640 1 -- 172.21.15.5:0/1143609778 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3606038100 0 0) 0x7f9694003520 con 0x7f96a815de70 2024-04-25T08:59:39.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f969ffff640 1 -- 172.21.15.5:0/1143609778 >> v1:172.21.15.5:6789/0 conn(0x7f96a815de70 legacy=0x7f96a80b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.300+0000 7f969ffff640 1 -- 172.21.15.5:0/1143609778 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a80d26a0 con 0x7f96a80b2cc0 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.301+0000 7f969ffff640 1 --2- 172.21.15.5:0/1143609778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a80b2cc0 0x7f96a80b6bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96900097d0 tx=0x7f969002a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25bd31d1392f036c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.301+0000 7f96a5d9b640 1 -- 172.21.15.5:0/1143609778 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690037070 con 0x7f96a80b2cc0 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.301+0000 7f96a5d9b640 1 -- 172.21.15.5:0/1143609778 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969002ac90 con 0x7f96a80b2cc0 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.301+0000 7f96a5d9b640 1 -- 172.21.15.5:0/1143609778 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698001670 con 0x7f96a80b2cc0 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.302+0000 7f96acbc4640 1 -- 172.21.15.5:0/1143609778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a80b2cc0 msgr2=0x7f96a80b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.302+0000 7f96acbc4640 1 --2- 172.21.15.5:0/1143609778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a80b2cc0 0x7f96a80b6bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96900097d0 tx=0x7f969002a200 comp rx=0 tx=0).stop 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.302+0000 7f96acbc4640 1 -- 172.21.15.5:0/1143609778 shutdown_connections 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.302+0000 7f96acbc4640 1 --2- 172.21.15.5:0/1143609778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a80b2cc0 0x7f96a80b6bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.302+0000 7f96acbc4640 1 -- 172.21.15.5:0/1143609778 >> 172.21.15.5:0/1143609778 conn(0x7f96a806b000 msgr2=0x7f96a806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.302+0000 7f96acbc4640 1 -- 172.21.15.5:0/1143609778 shutdown_connections 2024-04-25T08:59:39.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.302+0000 7f96acbc4640 1 -- 172.21.15.5:0/1143609778 wait complete. 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.303+0000 7f96acbc4640 1 Processor -- start 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.303+0000 7f96acbc4640 1 -- start start 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96acbc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96a80b2cc0 0x7f96a80c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96acbc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a80b7130 0x7f96a81f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96acbc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a815de70 0x7f96a814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96acbc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80d2ea0 con 0x7f96a80b7130 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96acbc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80cf110 con 0x7f96a815de70 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96acbc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80d3020 con 0x7f96a80b2cc0 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f969ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a80b7130 0x7f96a81f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f969ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a80b7130 0x7f96a81f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44258/0 (socket says 172.21.15.5:44258) 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f969ffff640 1 -- 172.21.15.5:0/461767405 learned_addr learned my addr 172.21.15.5:0/461767405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96a659c640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96a80b2cc0 0x7f96a80c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.304+0000 7f96a6d9d640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a815de70 0x7f96a814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969ffff640 1 -- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96a80b2cc0 msgr2=0x7f96a80c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969ffff640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96a80b2cc0 0x7f96a80c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969ffff640 1 -- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a815de70 msgr2=0x7f96a814cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969ffff640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a815de70 0x7f96a814cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969ffff640 1 -- 172.21.15.5:0/461767405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a81e65f0 con 0x7f96a80b7130 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969ffff640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a80b7130 0x7f96a81f7570 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9690000c00 tx=0x7f96900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969effd640 1 -- 172.21.15.5:0/461767405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690037040 con 0x7f96a80b7130 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969effd640 1 -- 172.21.15.5:0/461767405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690004230 con 0x7f96a80b7130 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a80c77e0 con 0x7f96a80b7130 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f969effd640 1 -- 172.21.15.5:0/461767405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690006e10 con 0x7f96a80b7130 2024-04-25T08:59:39.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.305+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a80c7da0 con 0x7f96a80b7130 2024-04-25T08:59:39.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.306+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a804ef20 con 0x7f96a80b7130 2024-04-25T08:59:39.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.307+0000 7f969effd640 1 -- 172.21.15.5:0/461767405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f969003a070 con 0x7f96a80b7130 2024-04-25T08:59:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.307+0000 7f969effd640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f968806b4d0 0x7f968806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.307+0000 7f969effd640 1 -- 172.21.15.5:0/461767405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f96900aa750 con 0x7f96a80b7130 2024-04-25T08:59:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.307+0000 7f96a659c640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f968806b4d0 0x7f968806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.308+0000 7f96a659c640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f968806b4d0 0x7f968806d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9698005880 tx=0x7f9698000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.311+0000 7f969effd640 1 -- 172.21.15.5:0/461767405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9690041020 con 0x7f96a80b7130 2024-04-25T08:59:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.534+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96a806b6c0 con 0x7f96a80b7130 2024-04-25T08:59:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.534+0000 7f969effd640 1 -- 172.21.15.5:0/461767405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f9690078fd0 con 0x7f96a80b7130 2024-04-25T08:59:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:39.523 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:36.481771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-25T08:59:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f968806b4d0 msgr2=0x7f968806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f968806b4d0 0x7f968806d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9698005880 tx=0x7f9698000bc0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a80b7130 msgr2=0x7f96a81f7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a80b7130 0x7f96a81f7570 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9690000c00 tx=0x7f96900046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 shutdown_connections 2024-04-25T08:59:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f968806b4d0 0x7f968806d990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a815de70 0x7f96a814cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a80b7130 0x7f96a81f7570 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 --2- 172.21.15.5:0/461767405 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96a80b2cc0 0x7f96a80c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 >> 172.21.15.5:0/461767405 conn(0x7f96a806b000 msgr2=0x7f96a80b9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 shutdown_connections 2024-04-25T08:59:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.537+0000 7f96acbc4640 1 -- 172.21.15.5:0/461767405 wait complete. 2024-04-25T08:59:39.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 2970589833 2024-04-25T08:59:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.651+0000 7f6aba9d5640 1 Processor -- start 2024-04-25T08:59:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.651+0000 7f6aba9d5640 1 -- start start 2024-04-25T08:59:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.652+0000 7f6aba9d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ab406bfb0 0x7f6ab40b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.652+0000 7f6aba9d5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab406ae90 con 0x7f6ab40b2c60 2024-04-25T08:59:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.652+0000 7f6aba9d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40cfdb0 con 0x7f6ab40b2340 2024-04-25T08:59:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.652+0000 7f6aba9d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab40d03c0 con 0x7f6ab406bfb0 2024-04-25T08:59:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.652+0000 7f6ab8f72640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ab40b2c60 0x7f6ab40d0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60490/0 (socket says 172.21.15.5:60490) 2024-04-25T08:59:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.652+0000 7f6ab8f72640 1 -- 172.21.15.5:0/1072922087 learned_addr learned my addr 172.21.15.5:0/1072922087 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.652+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/1072922087 >> v2:172.21.15.80:3300/0 conn(0x7f6ab406bfb0 0x7f6ab40b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.653+0000 7f6ab2ffd640 1 -- 172.21.15.5:0/1072922087 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591081863 0 0) 0x7f6ab406ae90 con 0x7f6ab40b2c60 2024-04-25T08:59:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.653+0000 7f6ab2ffd640 1 -- 172.21.15.5:0/1072922087 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa0003520 con 0x7f6ab40b2c60 2024-04-25T08:59:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.653+0000 7f6ab37fe640 1 -- 172.21.15.5:0/1072922087 >> v1:172.21.15.80:6789/0 conn(0x7f6ab40b2340 legacy=0x7f6ab40b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.653+0000 7f6ab37fe640 1 -- 172.21.15.5:0/1072922087 >> v1:172.21.15.5:6789/0 conn(0x7f6ab40b2c60 legacy=0x7f6ab40d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.653+0000 7f6ab37fe640 1 -- 172.21.15.5:0/1072922087 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab406b130 con 0x7f6ab406bfb0 2024-04-25T08:59:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/1072922087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab406bfb0 0x7f6ab40b2720 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40cff80 tx=0x7f6aa402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d71f07d71017549 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6ab2ffd640 1 -- 172.21.15.5:0/1072922087 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4037070 con 0x7f6ab406bfb0 2024-04-25T08:59:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6ab2ffd640 1 -- 172.21.15.5:0/1072922087 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4032440 con 0x7f6ab406bfb0 2024-04-25T08:59:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6ab2ffd640 1 -- 172.21.15.5:0/1072922087 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4032810 con 0x7f6ab406bfb0 2024-04-25T08:59:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1072922087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab406bfb0 msgr2=0x7f6ab40b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1072922087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab406bfb0 0x7f6ab40b2720 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40cff80 tx=0x7f6aa402a210 comp rx=0 tx=0).stop 2024-04-25T08:59:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1072922087 shutdown_connections 2024-04-25T08:59:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1072922087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab406bfb0 0x7f6ab40b2720 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1072922087 >> 172.21.15.5:0/1072922087 conn(0x7f6ab40d1a40 msgr2=0x7f6ab40d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1072922087 shutdown_connections 2024-04-25T08:59:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.654+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1072922087 wait complete. 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.655+0000 7f6aba9d5640 1 Processor -- start 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6aba9d5640 1 -- start start 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6aba9d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ab406bfb0 0x7f6ab4153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6aba9d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab40b2340 0x7f6ab40c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6aba9d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab40b2c60 0x7f6ab40c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6aba9d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40d16b0 con 0x7f6ab40b2340 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6aba9d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40b1a90 con 0x7f6ab40b2c60 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6aba9d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40d1830 con 0x7f6ab406bfb0 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6ab37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab40b2340 0x7f6ab40c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6ab37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab40b2340 0x7f6ab40c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44274/0 (socket says 172.21.15.5:44274) 2024-04-25T08:59:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.656+0000 7f6ab37fe640 1 -- 172.21.15.5:0/1940729602 learned_addr learned my addr 172.21.15.5:0/1940729602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab40b2c60 0x7f6ab40c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ab406bfb0 0x7f6ab4153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab37fe640 1 -- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ab406bfb0 msgr2=0x7f6ab4153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ab406bfb0 0x7f6ab4153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab37fe640 1 -- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab40b2c60 msgr2=0x7f6ab40c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab40b2c60 0x7f6ab40c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab37fe640 1 -- 172.21.15.5:0/1940729602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40c9b30 con 0x7f6ab40b2340 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab40b2340 0x7f6ab40c7d40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4000c00 tx=0x7f6aa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab0ff9640 1 -- 172.21.15.5:0/1940729602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4037040 con 0x7f6ab40b2340 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab0ff9640 1 -- 172.21.15.5:0/1940729602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4042070 con 0x7f6ab40b2340 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab41536c0 con 0x7f6ab40b2340 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6ab0ff9640 1 -- 172.21.15.5:0/1940729602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4030960 con 0x7f6ab40b2340 2024-04-25T08:59:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.657+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab40ca080 con 0x7f6ab40b2340 2024-04-25T08:59:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.659+0000 7f6ab0ff9640 1 -- 172.21.15.5:0/1940729602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6aa4030b00 con 0x7f6ab40b2340 2024-04-25T08:59:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.659+0000 7f6ab0ff9640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a9406b4d0 0x7f6a9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.659+0000 7f6ab0ff9640 1 -- 172.21.15.5:0/1940729602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6aa40aaa00 con 0x7f6ab40b2340 2024-04-25T08:59:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.659+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a9406b4d0 0x7f6a9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.660+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a9406b4d0 0x7f6a9406d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c001780 tx=0x7f6a9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.660+0000 7f6abd7b4740 1 Processor -- start 2024-04-25T08:59:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.660+0000 7f6abd7b4740 1 -- start start 2024-04-25T08:59:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f18790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f18cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0ee8be0 0x55acd0eec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd0e51ac0 con 0x55acd0ee8be0 2024-04-25T08:59:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd0dfadb0 con 0x55acd0f16360 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acd0e4db60 con 0x55acd0f15f80 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0ee8be0 0x55acd0eec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0ee8be0 0x55acd0eec3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44290/0 (socket says 172.21.15.5:44290) 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 -- 172.21.15.5:0/775588816 learned_addr learned my addr 172.21.15.5:0/775588816 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f18cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f18790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 -- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 msgr2=0x55acd0f18790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f18790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 -- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 msgr2=0x55acd0f18cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f18cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 -- 172.21.15.5:0/775588816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acd0c32710 con 0x55acd0ee8be0 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0ee8be0 0x55acd0eec3f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6aac001f90 tx=0x7f6aac007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac248d4476dda111 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6aa9ffb640 1 -- 172.21.15.5:0/775588816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac002080 con 0x55acd0ee8be0 2024-04-25T08:59:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6aa9ffb640 1 -- 172.21.15.5:0/775588816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac018070 con 0x55acd0ee8be0 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.661+0000 7f6aa9ffb640 1 -- 172.21.15.5:0/775588816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac012760 con 0x55acd0ee8be0 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 -- 172.21.15.5:0/775588816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0ee8be0 msgr2=0x55acd0eec3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0ee8be0 0x55acd0eec3f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6aac001f90 tx=0x7f6aac007410 comp rx=0 tx=0).stop 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 -- 172.21.15.5:0/775588816 shutdown_connections 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0ee8be0 0x55acd0eec3f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f18cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/775588816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f18790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 -- 172.21.15.5:0/775588816 >> 172.21.15.5:0/775588816 conn(0x55acd0eeae50 msgr2=0x55acd0f33790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 -- 172.21.15.5:0/775588816 shutdown_connections 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.662+0000 7f6abd7b4740 1 -- 172.21.15.5:0/775588816 wait complete. 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.663+0000 7f6abd7b4740 1 -- start start 2024-04-25T08:59:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.663+0000 7f6abd7b4740 1 Processor -- start 2024-04-25T08:59:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.663+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f15f80 0x55acd0f104c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f16360 0x55acd0f12b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd0eee000 con 0x55acd0f46c40 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd0df04e0 con 0x55acd0f15f80 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acd0eee2e0 con 0x55acd0f16360 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6abd7b4740 10 client.0 _ll_register_callbacks cb 0x55acd0b65af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44292/0 (socket says 172.21.15.5:44292) 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 -- 172.21.15.5:0/4161240013 learned_addr learned my addr 172.21.15.5:0/4161240013 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f15f80 0x55acd0f104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f16360 0x55acd0f12b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 -- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f16360 msgr2=0x55acd0f12b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f16360 0x55acd0f12b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 -- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f15f80 msgr2=0x55acd0f104c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f15f80 0x55acd0f104c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 -- 172.21.15.5:0/4161240013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acd0c92ea0 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f470c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6aac015040 tx=0x7f6aac001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2d03142b989f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6a92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6a92ffd640 1 -- 172.21.15.5:0/4161240013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac012d20 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6aac018070 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.664+0000 7f6a92ffd640 1 -- 172.21.15.5:0/4161240013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6aac027420 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6a92ffd640 1 -- 172.21.15.5:0/4161240013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aac02e050 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 10 client.6027 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55acd0b26000 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6a92ffd640 1 -- 172.21.15.5:0/4161240013 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac018070 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6a92ffd640 1 -- 172.21.15.5:0/4161240013 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6aac031020 con 0x55acd0f46c40 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 10 client.6027 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 10 client.6027 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:59:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 20 client.6027 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f0e740 0x55acd0f0eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 4 client.6027 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55acd0e5f000 con 0x55acd0f0e740 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f0e740 0x55acd0f0eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f0e740 0x55acd0f0eb20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37fd1777b22bed6b server_cookie=65878212b0bcc13c in_seq=0 out_seq=0 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.665+0000 7f6a92ffd640 10 client.6027 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6a92ffd640 1 -- 172.21.15.5:0/4161240013 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55acd0e5f000 con 0x55acd0f0e740 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6a92ffd640 10 client.6027 handle_command_reply: tid=0 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 client.6027 shutdown 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 msgr2=0x55acd0f470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f470c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6aac015040 tx=0x7f6aac001250 comp rx=0 tx=0).stop 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 shutdown_connections 2024-04-25T08:59:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f0e740 0x55acd0f0eb20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f470c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6a92ffd640 0 client.6027 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f16360 0x55acd0f12b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/4161240013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f15f80 0x55acd0f104c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 >> 172.21.15.5:0/4161240013 conn(0x55acd0ee8be0 msgr2=0x55acd0f15370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 shutdown_connections 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 1 -- 172.21.15.5:0/4161240013 wait complete. 2024-04-25T08:59:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.666+0000 7f6abd7b4740 20 client.6027 trim_cache size 0 max 16384 2024-04-25T08:59:39.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.678+0000 7f6abd7b4740 1 Processor -- start 2024-04-25T08:59:39.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.678+0000 7f6abd7b4740 1 -- start start 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f1c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f4e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40b67b0 con 0x55acd0f46c40 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40cb750 con 0x55acd0f16360 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40b61b0 con 0x55acd0f15f80 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f124c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44298/0 (socket says 172.21.15.5:44298) 2024-04-25T08:59:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 -- 172.21.15.5:0/3048673928 learned_addr learned my addr 172.21.15.5:0/3048673928 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f1c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f4e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 -- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 msgr2=0x55acd0f1c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f1c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 -- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 msgr2=0x55acd0f4e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f4e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.679+0000 7f6ab8f72640 1 -- 172.21.15.5:0/3048673928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acd0f37120 con 0x55acd0f46c40 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f124c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007450 tx=0x7f6aac020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfab4a730e9f71af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6aa97fa640 1 -- 172.21.15.5:0/3048673928 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac012770 con 0x55acd0f46c40 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6aa97fa640 1 -- 172.21.15.5:0/3048673928 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac018070 con 0x55acd0f46c40 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6aa97fa640 1 -- 172.21.15.5:0/3048673928 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac012d20 con 0x55acd0f46c40 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 -- 172.21.15.5:0/3048673928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 msgr2=0x55acd0f124c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f124c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007450 tx=0x7f6aac020070 comp rx=0 tx=0).stop 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 -- 172.21.15.5:0/3048673928 shutdown_connections 2024-04-25T08:59:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f124c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f4e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/3048673928 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f1c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 -- 172.21.15.5:0/3048673928 >> 172.21.15.5:0/3048673928 conn(0x55acd0ee8be0 msgr2=0x55acd0f365c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 -- 172.21.15.5:0/3048673928 shutdown_connections 2024-04-25T08:59:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.680+0000 7f6abd7b4740 1 -- 172.21.15.5:0/3048673928 wait complete. 2024-04-25T08:59:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.681+0000 7f6abd7b4740 1 -- start start 2024-04-25T08:59:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.681+0000 7f6abd7b4740 1 Processor -- start 2024-04-25T08:59:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f29ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6abd7b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f12a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd0f13d90 con 0x55acd0f46c40 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd0f0fa40 con 0x55acd0f16360 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6abd7b4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acd0f13040 con 0x55acd0f15f80 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6abd7b4740 10 client.0 _ll_register_callbacks cb 0x7f6aac006cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f12a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f12a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44312/0 (socket says 172.21.15.5:44312) 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 -- 172.21.15.5:0/167470034 learned_addr learned my addr 172.21.15.5:0/167470034 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f29ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab37fe640 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 -- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 msgr2=0x55acd0f29ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f29ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 -- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 msgr2=0x55acd0f124c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f124c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 -- 172.21.15.5:0/167470034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acd0f33a40 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6ab8f72640 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f12a00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6aac001ee0 tx=0x7f6aac00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d600ac42345b3eba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.682+0000 7f6a92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6a92ffd640 1 -- 172.21.15.5:0/167470034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac040070 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6a92ffd640 1 -- 172.21.15.5:0/167470034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6aac012d20 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6aac018070 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6a92ffd640 1 -- 172.21.15.5:0/167470034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aac04b050 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 10 client.6033 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55acd0f2a0e0 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6a92ffd640 1 -- 172.21.15.5:0/167470034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac018070 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6a92ffd640 1 -- 172.21.15.5:0/167470034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6aac04e020 con 0x55acd0f46c40 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 10 client.6033 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 10 client.6033 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:59:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 20 client.6033 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f14950 0x55acd0f14d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 4 client.6033 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 2970589833}] 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2970589833}) v1 -- 0x55acd0e59350 con 0x55acd0f14950 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f14950 0x55acd0f14d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6ab3fff640 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f14950 0x55acd0f14d30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98cfbd3579e17a41 server_cookie=84fdb22f4385e28b in_seq=0 out_seq=0 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.683+0000 7f6a92ffd640 10 client.6033 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6a92ffd640 1 -- 172.21.15.5:0/167470034 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x55acd0e59350 con 0x55acd0f14950 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6a92ffd640 10 client.6033 handle_command_reply: tid=0 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 client.6033 shutdown 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 msgr2=0x55acd0f12a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f12a00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6aac001ee0 tx=0x7f6aac00a000 comp rx=0 tx=0).stop 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 shutdown_connections 2024-04-25T08:59:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55acd0f14950 0x55acd0f14d30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd0f46c40 0x55acd0f12a00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acd0f16360 0x55acd0f124c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6a92ffd640 0 client.6033 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 --2- 172.21.15.5:0/167470034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55acd0f15f80 0x55acd0f29ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 >> 172.21.15.5:0/167470034 conn(0x55acd0ee8be0 msgr2=0x55acd0ee7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 shutdown_connections 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 1 -- 172.21.15.5:0/167470034 wait complete. 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6abd7b4740 20 client.6033 trim_cache size 0 max 16384 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a9406b4d0 msgr2=0x7f6a9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a9406b4d0 0x7f6a9406d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c001780 tx=0x7f6a9c009040 comp rx=0 tx=0).stop 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab40b2340 msgr2=0x7f6ab40c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.684+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab40b2340 0x7f6ab40c7d40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4000c00 tx=0x7f6aa40046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 shutdown_connections 2024-04-25T08:59:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a9406b4d0 0x7f6a9406d990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ab40b2c60 0x7f6ab40c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ab40b2340 0x7f6ab40c7d40 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 --2- 172.21.15.5:0/1940729602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6ab406bfb0 0x7f6ab4153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 >> 172.21.15.5:0/1940729602 conn(0x7f6ab40d1a40 msgr2=0x7f6ab40aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 shutdown_connections 2024-04-25T08:59:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.685+0000 7f6aba9d5640 1 -- 172.21.15.5:0/1940729602 wait complete. 2024-04-25T08:59:39.683 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T08:59:39.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:39.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.796+0000 7f7ddcbc1640 1 Processor -- start 2024-04-25T08:59:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.796+0000 7f7ddcbc1640 1 -- start start 2024-04-25T08:59:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7ddcbc1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd815de70 0x7f7dd80b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7ddcbc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80ce7f0 0x7f7dd80cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7ddcbc1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd80cf1c0 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7ddcbc1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80d2a10 con 0x7f7dd815de70 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7ddcbc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80d20e0 con 0x7f7dd80ce7f0 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd815de70 0x7f7dd80b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd5d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7dd80b2cc0 0x7f7dd80b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60496/0 (socket says 172.21.15.5:60496) 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd5d9b640 1 -- 172.21.15.5:0/592247040 learned_addr learned my addr 172.21.15.5:0/592247040 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd6d9d640 1 --2- 172.21.15.5:0/592247040 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80ce7f0 0x7f7dd80cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd559a640 1 -- 172.21.15.5:0/592247040 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802320382 0 0) 0x7f7dd80cf1c0 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd559a640 1 -- 172.21.15.5:0/592247040 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc4003520 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd659c640 1 -- 172.21.15.5:0/592247040 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80ce7f0 msgr2=0x7f7dd80cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd659c640 1 --2- 172.21.15.5:0/592247040 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80ce7f0 0x7f7dd80cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd659c640 1 -- 172.21.15.5:0/592247040 >> v1:172.21.15.5:6789/0 conn(0x7f7dd80b2cc0 legacy=0x7f7dd80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.797+0000 7f7dd659c640 1 -- 172.21.15.5:0/592247040 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80d23c0 con 0x7f7dd815de70 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.798+0000 7f7dd659c640 1 --2- 172.21.15.5:0/592247040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd815de70 0x7f7dd80b93e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00097a0 tx=0x7f7dd002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0db14bcbaf33696 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.798+0000 7f7dd559a640 1 -- 172.21.15.5:0/592247040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0037070 con 0x7f7dd815de70 2024-04-25T08:59:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.798+0000 7f7dd559a640 1 -- 172.21.15.5:0/592247040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0032440 con 0x7f7dd815de70 2024-04-25T08:59:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.798+0000 7f7dd559a640 1 -- 172.21.15.5:0/592247040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0032810 con 0x7f7dd815de70 2024-04-25T08:59:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/592247040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd815de70 msgr2=0x7f7dd80b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/592247040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd815de70 0x7f7dd80b93e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00097a0 tx=0x7f7dd002a180 comp rx=0 tx=0).stop 2024-04-25T08:59:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/592247040 shutdown_connections 2024-04-25T08:59:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/592247040 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80ce7f0 0x7f7dd80cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/592247040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd815de70 0x7f7dd80b93e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/592247040 >> 172.21.15.5:0/592247040 conn(0x7f7dd806b000 msgr2=0x7f7dd806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/592247040 shutdown_connections 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.799+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/592247040 wait complete. 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.800+0000 7f7ddcbc1640 1 Processor -- start 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.800+0000 7f7ddcbc1640 1 -- start start 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7ddcbc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7ddcbc1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd80ce7f0 0x7f7dd81605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7ddcbc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd815de70 0x7f7dd8160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7ddcbc1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80b7300 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7ddcbc1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80b9920 con 0x7f7dd80ce7f0 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7ddcbc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80d2ea0 con 0x7f7dd815de70 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44340/0 (socket says 172.21.15.5:44340) 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 -- 172.21.15.5:0/405911945 learned_addr learned my addr 172.21.15.5:0/405911945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 -- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd815de70 msgr2=0x7f7dd8160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd815de70 0x7f7dd8160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 -- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd80ce7f0 msgr2=0x7f7dd81605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd5d9b640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd80ce7f0 0x7f7dd81605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd80ce7f0 0x7f7dd81605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd659c640 1 -- 172.21.15.5:0/405911945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80c8320 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.801+0000 7f7dd5d9b640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd80ce7f0 0x7f7dd81605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.802+0000 7f7dd659c640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd815a9c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0035040 tx=0x7f7dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.802+0000 7f7dceffd640 1 -- 172.21.15.5:0/405911945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0041030 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.802+0000 7f7dceffd640 1 -- 172.21.15.5:0/405911945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd003d4e0 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.802+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd80c8600 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.802+0000 7f7dceffd640 1 -- 172.21.15.5:0/405911945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0037040 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.802+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80c8bc0 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.803+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd80685b0 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.803+0000 7f7dceffd640 1 -- 172.21.15.5:0/405911945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7dd0044070 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.804+0000 7f7dceffd640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7db806b500 0x7f7db806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.804+0000 7f7dceffd640 1 -- 172.21.15.5:0/405911945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7dd00aa8b0 con 0x7f7dd80b2cc0 2024-04-25T08:59:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.804+0000 7f7dd5d9b640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7db806b500 0x7f7db806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.805+0000 7f7dd5d9b640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7db806b500 0x7f7db806d9c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80b8d00 tx=0x7f7dc0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:39.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:39.808+0000 7f7dceffd640 1 -- 172.21.15.5:0/405911945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7dd80685b0 con 0x7f7dd80b2cc0 2024-04-25T08:59:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.024+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dd804ef20 con 0x7f7dd80b2cc0 2024-04-25T08:59:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.024+0000 7f7dceffd640 1 -- 172.21.15.5:0/405911945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f7dd0079820 con 0x7f7dd80b2cc0 2024-04-25T08:59:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:40.013 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:36.481771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-25T08:59:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7db806b500 msgr2=0x7f7db806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7db806b500 0x7f7db806d9c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80b8d00 tx=0x7f7dc0009040 comp rx=0 tx=0).stop 2024-04-25T08:59:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 msgr2=0x7f7dd815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd815a9c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0035040 tx=0x7f7dd00046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 shutdown_connections 2024-04-25T08:59:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7db806b500 0x7f7db806d9c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd815de70 0x7f7dd8160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd80ce7f0 0x7f7dd81605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 --2- 172.21.15.5:0/405911945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd815a9c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 >> 172.21.15.5:0/405911945 conn(0x7f7dd806b000 msgr2=0x7f7dd80b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 shutdown_connections 2024-04-25T08:59:40.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.027+0000 7f7ddcbc1640 1 -- 172.21.15.5:0/405911945 wait complete. 2024-04-25T08:59:40.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path / 2024-04-25T08:59:40.135 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:40.135 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:40.144 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:40.144 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:40.144 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-04-25T08:59:40.144 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-04-25T08:59:40.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:40.144 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-04-25T08:59:40.160 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-04-25T08:59:40.160 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> import json 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> import sys 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> except OSError as e: 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> sys.exit(e.errno) 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> print(json.dumps( 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> indent=2)) 2024-04-25T08:59:40.161 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-25T08:59:40.268 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mode": 16877, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ino": 1099511627777, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_dev": 43, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_nlink": 16, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_uid": 1000, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_gid": 1316, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_size": 18, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_atime": 1714035566.8093245, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mtime": 1714035572.7052052, 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ctime": 1714035572.7052052 2024-04-25T08:59:40.269 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:40.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:59:40.278 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-04-25T08:59:40.278 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-04-25T08:59:40.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.431+0000 7f0444f9e640 1 Processor -- start 2024-04-25T08:59:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.431+0000 7f0444f9e640 1 -- start start 2024-04-25T08:59:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f0444f9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04400b2cc0 0x7f04400b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f0444f9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04400b7130 0x7f04400ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f0444f9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04400d20e0 con 0x7f044015de70 2024-04-25T08:59:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f0444f9e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04400d2a10 con 0x7f04400b2cc0 2024-04-25T08:59:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f0444f9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04400d23c0 con 0x7f04400b7130 2024-04-25T08:59:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f043dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04400b2cc0 0x7f04400b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f043e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f044015de70 0x7f04400b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60498/0 (socket says 172.21.15.5:60498) 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f043e59c640 1 -- 172.21.15.5:0/909661659 learned_addr learned my addr 172.21.15.5:0/909661659 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f043ed9d640 1 --2- 172.21.15.5:0/909661659 >> v2:172.21.15.80:3300/0 conn(0x7f04400b7130 0x7f04400ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.432+0000 7f043dd9b640 1 -- 172.21.15.5:0/909661659 >> v2:172.21.15.80:3300/0 conn(0x7f04400b7130 msgr2=0x7f04400ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043dd9b640 1 --2- 172.21.15.5:0/909661659 >> v2:172.21.15.80:3300/0 conn(0x7f04400b7130 0x7f04400ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043dd9b640 1 -- 172.21.15.5:0/909661659 >> v1:172.21.15.5:6789/0 conn(0x7f044015de70 legacy=0x7f04400b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043d59a640 1 -- 172.21.15.5:0/909661659 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003379103 0 0) 0x7f04400d20e0 con 0x7f044015de70 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043dd9b640 1 -- 172.21.15.5:0/909661659 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400d26a0 con 0x7f04400b2cc0 2024-04-25T08:59:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043ed9d640 1 --2- 172.21.15.5:0/909661659 >> v2:172.21.15.80:3300/0 conn(0x7f04400b7130 0x7f04400ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043dd9b640 1 --2- 172.21.15.5:0/909661659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04400b2cc0 0x7f04400b6bf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f04280097a0 tx=0x7f042802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5b243875e212a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043d59a640 1 -- 172.21.15.5:0/909661659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428037070 con 0x7f04400b2cc0 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043d59a640 1 -- 172.21.15.5:0/909661659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0428032440 con 0x7f04400b2cc0 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.433+0000 7f043d59a640 1 -- 172.21.15.5:0/909661659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428032810 con 0x7f04400b2cc0 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 -- 172.21.15.5:0/909661659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04400b2cc0 msgr2=0x7f04400b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 --2- 172.21.15.5:0/909661659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04400b2cc0 0x7f04400b6bf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f04280097a0 tx=0x7f042802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 -- 172.21.15.5:0/909661659 shutdown_connections 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 --2- 172.21.15.5:0/909661659 >> v2:172.21.15.80:3300/0 conn(0x7f04400b7130 0x7f04400ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 --2- 172.21.15.5:0/909661659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04400b2cc0 0x7f04400b6bf0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 -- 172.21.15.5:0/909661659 >> 172.21.15.5:0/909661659 conn(0x7f044006b000 msgr2=0x7f044006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 -- 172.21.15.5:0/909661659 shutdown_connections 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.434+0000 7f0444f9e640 1 -- 172.21.15.5:0/909661659 wait complete. 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.435+0000 7f0444f9e640 1 Processor -- start 2024-04-25T08:59:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.435+0000 7f0444f9e640 1 -- start start 2024-04-25T08:59:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f0444f9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04400b2cc0 0x7f04400c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f0444f9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04400b7130 0x7f04400b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f0444f9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f044015de70 0x7f04400c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f0444f9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04400cf0c0 con 0x7f044015de70 2024-04-25T08:59:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f0444f9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04400cef40 con 0x7f04400b7130 2024-04-25T08:59:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f0444f9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04400b5630 con 0x7f04400b2cc0 2024-04-25T08:59:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f043ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f044015de70 0x7f04400c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f043ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f044015de70 0x7f04400c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44364/0 (socket says 172.21.15.5:44364) 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.436+0000 7f043ed9d640 1 -- 172.21.15.5:0/1391410914 learned_addr learned my addr 172.21.15.5:0/1391410914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043e59c640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04400b2cc0 0x7f04400c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043dd9b640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04400b7130 0x7f04400b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043ed9d640 1 -- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04400b2cc0 msgr2=0x7f04400c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043ed9d640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04400b2cc0 0x7f04400c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043ed9d640 1 -- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04400b7130 msgr2=0x7f04400b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043ed9d640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04400b7130 0x7f04400b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043ed9d640 1 -- 172.21.15.5:0/1391410914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400b5e20 con 0x7f044015de70 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043e59c640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04400b2cc0 0x7f04400c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043dd9b640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04400b7130 0x7f04400b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f043ed9d640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f044015de70 0x7f04400c7480 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f043000ce80 tx=0x7f043000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f0436ffd640 1 -- 172.21.15.5:0/1391410914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043001a070 con 0x7f044015de70 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f0436ffd640 1 -- 172.21.15.5:0/1391410914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043000d880 con 0x7f044015de70 2024-04-25T08:59:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f0436ffd640 1 -- 172.21.15.5:0/1391410914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000dc70 con 0x7f044015de70 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04400b5860 con 0x7f044015de70 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.437+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04400cc230 con 0x7f044015de70 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.438+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044004ef20 con 0x7f044015de70 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.438+0000 7f0436ffd640 1 -- 172.21.15.5:0/1391410914 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f043001d070 con 0x7f044015de70 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.439+0000 7f0436ffd640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f042006b4d0 0x7f042006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.439+0000 7f0436ffd640 1 -- 172.21.15.5:0/1391410914 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f043008a980 con 0x7f044015de70 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.439+0000 7f043e59c640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f042006b4d0 0x7f042006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.440+0000 7f043e59c640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f042006b4d0 0x7f042006d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f60 tx=0x7f0438009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.443+0000 7f0436ffd640 1 -- 172.21.15.5:0/1391410914 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04400b5e20 con 0x7f044015de70 2024-04-25T08:59:40.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.662+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04400d0f90 con 0x7f044015de70 2024-04-25T08:59:40.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.662+0000 7f0436ffd640 1 -- 172.21.15.5:0/1391410914 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f0430059180 con 0x7f044015de70 2024-04-25T08:59:40.651 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:40.651 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:36.481771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:40.651 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f042006b4d0 msgr2=0x7f042006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f042006b4d0 0x7f042006d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f60 tx=0x7f0438009040 comp rx=0 tx=0).stop 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f044015de70 msgr2=0x7f04400c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f044015de70 0x7f04400c7480 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f043000ce80 tx=0x7f043000a710 comp rx=0 tx=0).stop 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 shutdown_connections 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f042006b4d0 0x7f042006d990 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f044015de70 0x7f04400c7480 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04400b7130 0x7f04400b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 --2- 172.21.15.5:0/1391410914 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04400b2cc0 0x7f04400c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 >> 172.21.15.5:0/1391410914 conn(0x7f044006b000 msgr2=0x7f044015e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 shutdown_connections 2024-04-25T08:59:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.664+0000 7f0444f9e640 1 -- 172.21.15.5:0/1391410914 wait complete. 2024-04-25T08:59:40.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/i/dont/exist 2024-04-25T08:59:40.770 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:40.770 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-04-25T08:59:40.770 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:40.779 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-04-25T08:59:40.779 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-04-25T08:59:40.779 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:40.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-04-25T08:59:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.894+0000 7f94c2038640 1 Processor -- start 2024-04-25T08:59:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.895+0000 7f94c2038640 1 -- start start 2024-04-25T08:59:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.895+0000 7f94c2038640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94bc15df10 0x7f94bc1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.895+0000 7f94c2038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0b6250 0x7f94bc0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.895+0000 7f94c2038640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc162150 con 0x7f94bc0cee10 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.895+0000 7f94c2038640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94bc0d20d0 con 0x7f94bc15df10 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.895+0000 7f94c2038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc162430 con 0x7f94bc0b6250 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94baffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0b6250 0x7f94bc0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94bb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94bc15df10 0x7f94bc1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94baffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0b6250 0x7f94bc0ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:44680/0 (socket says 172.21.15.5:44680) 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94baffd640 1 -- 172.21.15.5:0/3452520710 learned_addr learned my addr 172.21.15.5:0/3452520710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94bbfff640 1 --1- 172.21.15.5:0/3452520710 >> v1:172.21.15.80:6789/0 conn(0x7f94bc0cee10 0x7f94bc0d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41438/0 (socket says 172.21.15.5:41438) 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94baffd640 1 -- 172.21.15.5:0/3452520710 >> v2:172.21.15.80:3300/0 conn(0x7f94bc15df10 msgr2=0x7f94bc1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94baffd640 1 --2- 172.21.15.5:0/3452520710 >> v2:172.21.15.80:3300/0 conn(0x7f94bc15df10 0x7f94bc1618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94baffd640 1 -- 172.21.15.5:0/3452520710 >> v1:172.21.15.80:6789/0 conn(0x7f94bc0cee10 legacy=0x7f94bc0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94baffd640 1 -- 172.21.15.5:0/3452520710 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc162710 con 0x7f94bc0b6250 2024-04-25T08:59:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.896+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/3452520710 >> v2:172.21.15.80:3300/0 conn(0x7f94bc15df10 0x7f94bc1618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.897+0000 7f94baffd640 1 --2- 172.21.15.5:0/3452520710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0b6250 0x7f94bc0ce8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009870 tx=0x7f94b002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecccf46fd457bd69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.897+0000 7f94ba7fc640 1 -- 172.21.15.5:0/3452520710 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0037070 con 0x7f94bc0b6250 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.897+0000 7f94ba7fc640 1 -- 172.21.15.5:0/3452520710 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0032440 con 0x7f94bc0b6250 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.897+0000 7f94ba7fc640 1 -- 172.21.15.5:0/3452520710 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0032810 con 0x7f94bc0b6250 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.897+0000 7f94c2038640 1 -- 172.21.15.5:0/3452520710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0b6250 msgr2=0x7f94bc0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.897+0000 7f94c2038640 1 --2- 172.21.15.5:0/3452520710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0b6250 0x7f94bc0ce8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009870 tx=0x7f94b002a270 comp rx=0 tx=0).stop 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.898+0000 7f94c2038640 1 -- 172.21.15.5:0/3452520710 shutdown_connections 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.898+0000 7f94c2038640 1 --2- 172.21.15.5:0/3452520710 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0b6250 0x7f94bc0ce8d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.898+0000 7f94c2038640 1 --2- 172.21.15.5:0/3452520710 >> v2:172.21.15.80:3300/0 conn(0x7f94bc15df10 0x7f94bc1618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.898+0000 7f94c2038640 1 -- 172.21.15.5:0/3452520710 >> 172.21.15.5:0/3452520710 conn(0x7f94bc0668f0 msgr2=0x7f94bc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.898+0000 7f94c2038640 1 -- 172.21.15.5:0/3452520710 shutdown_connections 2024-04-25T08:59:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.898+0000 7f94c2038640 1 -- 172.21.15.5:0/3452520710 wait complete. 2024-04-25T08:59:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.899+0000 7f94c2038640 1 Processor -- start 2024-04-25T08:59:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.899+0000 7f94c2038640 1 -- start start 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94c2038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc0b6250 0x7f94bc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94c2038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0cee10 0x7f94bc0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94c2038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc15df10 0x7f94bc15f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94c2038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0d3570 con 0x7f94bc0b6250 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94c2038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc161e10 con 0x7f94bc15df10 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94c2038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0d36f0 con 0x7f94bc0cee10 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc0b6250 0x7f94bc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc0b6250 0x7f94bc0cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42926/0 (socket says 172.21.15.5:42926) 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 -- 172.21.15.5:0/450928100 learned_addr learned my addr 172.21.15.5:0/450928100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bbfff640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc15df10 0x7f94bc15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94baffd640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0cee10 0x7f94bc0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 -- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0cee10 msgr2=0x7f94bc0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0cee10 0x7f94bc0c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 -- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc15df10 msgr2=0x7f94bc15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc15df10 0x7f94bc15f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 -- 172.21.15.5:0/450928100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc0c6cf0 con 0x7f94bc0b6250 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc0b6250 0x7f94bc0cae90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00e960 tx=0x7f94ac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94a3fff640 1 -- 172.21.15.5:0/450928100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac017070 con 0x7f94bc0b6250 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94a3fff640 1 -- 172.21.15.5:0/450928100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac00ca00 con 0x7f94bc0b6250 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.900+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc0cbb90 con 0x7f94bc0b6250 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.901+0000 7f94a3fff640 1 -- 172.21.15.5:0/450928100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00cdd0 con 0x7f94bc0b6250 2024-04-25T08:59:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.901+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc15fb80 con 0x7f94bc0b6250 2024-04-25T08:59:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.902+0000 7f94a3fff640 1 -- 172.21.15.5:0/450928100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f94ac01a070 con 0x7f94bc0b6250 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.902+0000 7f94a3fff640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94a806b4d0 0x7f94a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.903+0000 7f94a3fff640 1 -- 172.21.15.5:0/450928100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f94ac08a090 con 0x7f94bc0b6250 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.903+0000 7f94baffd640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94a806b4d0 0x7f94a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.903+0000 7f94baffd640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94a806b4d0 0x7f94a806d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f94b0034000 tx=0x7f94b002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.903+0000 7f94c4e15740 1 Processor -- start 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.903+0000 7f94c4e15740 1 -- start start 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02caa6b0 0x555c02caaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02c80390 0x555c02cc6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94c4e15740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c02be2c60 con 0x555c02c80390 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c02b8bee0 con 0x555c02caa6b0 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c02bded00 con 0x555c02cc7f50 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02c80390 0x555c02cc6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02c80390 0x555c02cc6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42940/0 (socket says 172.21.15.5:42940) 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94bbfff640 1 -- 172.21.15.5:0/4013478032 learned_addr learned my addr 172.21.15.5:0/4013478032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94baffd640 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.904+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02caa6b0 0x555c02caaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94bbfff640 1 -- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 msgr2=0x555c02cc84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94bbfff640 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94bbfff640 1 -- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02caa6b0 msgr2=0x555c02caaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94bbfff640 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02caa6b0 0x555c02caaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94bbfff640 1 -- 172.21.15.5:0/4013478032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c029c39f0 con 0x555c02c80390 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94bbfff640 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02c80390 0x555c02cc6610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f94b4007410 tx=0x7f94b40078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2a72415ac052e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94a17fa640 1 -- 172.21.15.5:0/4013478032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4019070 con 0x555c02c80390 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94a17fa640 1 -- 172.21.15.5:0/4013478032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4001d00 con 0x555c02c80390 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.905+0000 7f94a17fa640 1 -- 172.21.15.5:0/4013478032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4014480 con 0x555c02c80390 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 -- 172.21.15.5:0/4013478032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02c80390 msgr2=0x555c02cc6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02c80390 0x555c02cc6610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f94b4007410 tx=0x7f94b40078d0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 -- 172.21.15.5:0/4013478032 shutdown_connections 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02c80390 0x555c02cc6610 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 --2- 172.21.15.5:0/4013478032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02caa6b0 0x555c02caaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 -- 172.21.15.5:0/4013478032 >> 172.21.15.5:0/4013478032 conn(0x555c02c7ccc0 msgr2=0x555c02cc54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 -- 172.21.15.5:0/4013478032 shutdown_connections 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 -- 172.21.15.5:0/4013478032 wait complete. 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 -- start start 2024-04-25T08:59:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.906+0000 7f94c4e15740 1 Processor -- start 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02ccba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cab840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02c79920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94c4e15740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c02c81130 con 0x555c02caa6b0 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c02b9f470 con 0x555c02cd58c0 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c02c7abf0 con 0x555c02cc7f50 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94c4e15740 10 client.0 _ll_register_callbacks cb 0x555c02b6b7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02ccba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02ccba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42946/0 (socket says 172.21.15.5:42946) 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94bb7fe640 1 -- 172.21.15.5:0/864067379 learned_addr learned my addr 172.21.15.5:0/864067379 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94baffd640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.907+0000 7f94bbfff640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02c79920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94bb7fe640 1 -- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 msgr2=0x555c02cab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94bb7fe640 1 -- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 msgr2=0x555c02c79920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02c79920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94bb7fe640 1 -- 172.21.15.5:0/864067379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c028b72e0 con 0x555c02caa6b0 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94bbfff640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02c79920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02ccba70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0587f0 tx=0x7f94ac0588e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26720c65f9507238 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f949a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f949a7fc640 1 -- 172.21.15.5:0/864067379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac070070 con 0x555c02caa6b0 2024-04-25T08:59:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f949a7fc640 1 -- 172.21.15.5:0/864067379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f94ac070210 con 0x555c02caa6b0 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94b4001d00 con 0x555c02caa6b0 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f949a7fc640 1 -- 172.21.15.5:0/864067379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94ac021040 con 0x555c02caa6b0 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 10 client.6060 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x555c02a24180 con 0x555c02caa6b0 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f949a7fc640 1 -- 172.21.15.5:0/864067379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4001d00 con 0x555c02caa6b0 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f949a7fc640 1 -- 172.21.15.5:0/864067379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f94ac024060 con 0x555c02caa6b0 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 10 client.6060 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 10 client.6060 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 20 client.6060 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02c79e60 0x555c02cd8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 4 client.6060 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c02bf01a0 con 0x555c02c79e60 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.908+0000 7f94baffd640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02c79e60 0x555c02cd8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f949a7fc640 10 client.6060 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94baffd640 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02c79e60 0x555c02cd8eb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10e58e9fda576d3c server_cookie=a55c96bb2de7f9dd in_seq=0 out_seq=0 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f949a7fc640 1 -- 172.21.15.5:0/864067379 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c02bf01a0 con 0x555c02c79e60 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f949a7fc640 10 client.6060 handle_command_reply: tid=0 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 client.6060 shutdown 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 msgr2=0x555c02ccba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02ccba70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0587f0 tx=0x7f94ac0588e0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 shutdown_connections 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02c79e60 0x555c02cd8eb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02c79920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f949a7fc640 0 client.6060 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 --2- 172.21.15.5:0/864067379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02ccba70 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 >> 172.21.15.5:0/864067379 conn(0x555c02c80390 msgr2=0x555c02cc8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.909+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 shutdown_connections 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.910+0000 7f94c4e15740 1 -- 172.21.15.5:0/864067379 wait complete. 2024-04-25T08:59:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.910+0000 7f94c4e15740 20 client.6060 trim_cache size 0 max 16384 2024-04-25T08:59:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.925+0000 7f94c4e15740 1 Processor -- start 2024-04-25T08:59:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.925+0000 7f94c4e15740 1 -- start start 2024-04-25T08:59:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02caa6b0 0x555c02c7f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cc7f50 0x555c02ca63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02cd58c0 0x555c02ca68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94c4e15740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc2042f0 con 0x555c02cd58c0 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc1f9190 con 0x555c02cc7f50 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc1e8230 con 0x555c02caa6b0 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02cd58c0 0x555c02ca68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02cd58c0 0x555c02ca68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42960/0 (socket says 172.21.15.5:42960) 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 -- 172.21.15.5:0/3713081649 learned_addr learned my addr 172.21.15.5:0/3713081649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 -- 172.21.15.5:0/3713081649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02caa6b0 msgr2=0x555c02c7f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02caa6b0 0x555c02c7f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94baffd640 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cc7f50 0x555c02ca63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 -- 172.21.15.5:0/3713081649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cc7f50 msgr2=0x555c02ca63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cc7f50 0x555c02ca63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 -- 172.21.15.5:0/3713081649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c02c79c90 con 0x555c02cd58c0 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.926+0000 7f94bbfff640 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02cd58c0 0x555c02ca68f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f94b4017040 tx=0x7f94b4009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2481d53dfda706ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94a0ff9640 1 -- 172.21.15.5:0/3713081649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4023070 con 0x555c02cd58c0 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94a0ff9640 1 -- 172.21.15.5:0/3713081649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4002010 con 0x555c02cd58c0 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94a0ff9640 1 -- 172.21.15.5:0/3713081649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4019040 con 0x555c02cd58c0 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 -- 172.21.15.5:0/3713081649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02cd58c0 msgr2=0x555c02ca68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02cd58c0 0x555c02ca68f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f94b4017040 tx=0x7f94b4009030 comp rx=0 tx=0).stop 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 -- 172.21.15.5:0/3713081649 shutdown_connections 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02cd58c0 0x555c02ca68f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cc7f50 0x555c02ca63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 --2- 172.21.15.5:0/3713081649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02caa6b0 0x555c02c7f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 -- 172.21.15.5:0/3713081649 >> 172.21.15.5:0/3713081649 conn(0x555c02c80390 msgr2=0x555c02cad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 -- 172.21.15.5:0/3713081649 shutdown_connections 2024-04-25T08:59:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.927+0000 7f94c4e15740 1 -- 172.21.15.5:0/3713081649 wait complete. 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.928+0000 7f94c4e15740 1 -- start start 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.928+0000 7f94c4e15740 1 Processor -- start 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02d154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02cadef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc1f8b90 con 0x555c02caa6b0 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c02caae20 con 0x555c02cd58c0 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c02cdf070 con 0x555c02cc7f50 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 10 client.0 _ll_register_callbacks cb 0x555c02c7b0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02d154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02d154a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42962/0 (socket says 172.21.15.5:42962) 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 -- 172.21.15.5:0/2353383124 learned_addr learned my addr 172.21.15.5:0/2353383124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bbfff640 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02cadef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94baffd640 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 -- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 msgr2=0x555c02cc3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 -- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 msgr2=0x555c02cadef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02cadef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 -- 172.21.15.5:0/2353383124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c028903a0 con 0x555c02caa6b0 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94bb7fe640 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02d154a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f94ac060a40 tx=0x7f94ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7e6837bfe198c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f949a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f949a7fc640 1 -- 172.21.15.5:0/2353383124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac070040 con 0x555c02caa6b0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f949a7fc640 1 -- 172.21.15.5:0/2353383124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f94ac059b90 con 0x555c02caa6b0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94b4002010 con 0x555c02caa6b0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.929+0000 7f949a7fc640 1 -- 172.21.15.5:0/2353383124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94ac058630 con 0x555c02caa6b0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 10 client.6066 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x555c02cc5050 con 0x555c02caa6b0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f949a7fc640 1 -- 172.21.15.5:0/2353383124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4002010 con 0x555c02caa6b0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f949a7fc640 1 -- 172.21.15.5:0/2353383124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f94ac057cb0 con 0x555c02caa6b0 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 10 client.6066 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 10 client.6066 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 20 client.6066 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02cc42f0 0x555c02cae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 4 client.6066 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-04-25T08:59:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x555c02bea4f0 con 0x555c02cc42f0 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94baffd640 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02cc42f0 0x555c02cae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f949a7fc640 10 client.6066 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94baffd640 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02cc42f0 0x555c02cae430 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98423936666dd4fa server_cookie=c03fd69d3d49b612 in_seq=0 out_seq=0 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f949a7fc640 1 -- 172.21.15.5:0/2353383124 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x555c02bea4f0 con 0x555c02cc42f0 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f949a7fc640 10 client.6066 handle_command_reply: tid=0 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 1 client.6066 shutdown 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.930+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 msgr2=0x555c02d154a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02d154a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f94ac060a40 tx=0x7f94ac000bc0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 shutdown_connections 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x555c02cc42f0 0x555c02cae430 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c02cd58c0 0x555c02cadef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c02cc7f50 0x555c02cc3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f949a7fc640 0 client.6066 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 --2- 172.21.15.5:0/2353383124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c02caa6b0 0x555c02d154a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 >> 172.21.15.5:0/2353383124 conn(0x555c02c80390 msgr2=0x555c02c7f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 shutdown_connections 2024-04-25T08:59:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 1 -- 172.21.15.5:0/2353383124 wait complete. 2024-04-25T08:59:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c4e15740 20 client.6066 trim_cache size 0 max 16384 2024-04-25T08:59:40.925 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:40.925 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-04-25T08:59:40.925 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94a806b4d0 msgr2=0x7f94a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94a806b4d0 0x7f94a806d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f94b0034000 tx=0x7f94b002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc0b6250 msgr2=0x7f94bc0cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc0b6250 0x7f94bc0cae90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00e960 tx=0x7f94ac00ee20 comp rx=0 tx=0).stop 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 shutdown_connections 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94a806b4d0 0x7f94a806d990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc15df10 0x7f94bc15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94bc0cee10 0x7f94bc0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 --2- 172.21.15.5:0/450928100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc0b6250 0x7f94bc0cae90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 >> 172.21.15.5:0/450928100 conn(0x7f94bc0668f0 msgr2=0x7f94bc0b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 shutdown_connections 2024-04-25T08:59:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:40.931+0000 7f94c2038640 1 -- 172.21.15.5:0/450928100 wait complete. 2024-04-25T08:59:40.930 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-04-25T08:59:40.930 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T08:59:40.930 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:40.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.045+0000 7fd9d45a5640 1 Processor -- start 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.045+0000 7fd9d45a5640 1 -- start start 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.046+0000 7fd9d45a5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9cc15df10 0x7fd9cc1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.046+0000 7fd9d45a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9cc0cefe0 0x7fd9cc0d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.046+0000 7fd9d45a5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9cc162150 con 0x7fd9cc0b6250 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.046+0000 7fd9d45a5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc0d20d0 con 0x7fd9cc15df10 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.046+0000 7fd9d45a5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc162430 con 0x7fd9cc0cefe0 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.046+0000 7fd9d2341640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9cc15df10 0x7fd9cc1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.046+0000 7fd9d1b40640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9cc0b6250 0x7fd9cc0ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42798/0 (socket says 172.21.15.5:42798) 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.047+0000 7fd9d1b40640 1 -- 172.21.15.5:0/2768736672 learned_addr learned my addr 172.21.15.5:0/2768736672 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.047+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/2768736672 >> v2:172.21.15.80:3300/0 conn(0x7fd9cc0cefe0 0x7fd9cc0d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.047+0000 7fd9d2341640 1 -- 172.21.15.5:0/2768736672 >> v2:172.21.15.80:3300/0 conn(0x7fd9cc0cefe0 msgr2=0x7fd9cc0d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.047+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2768736672 >> v2:172.21.15.80:3300/0 conn(0x7fd9cc0cefe0 0x7fd9cc0d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.047+0000 7fd9d2341640 1 -- 172.21.15.5:0/2768736672 >> v1:172.21.15.5:6789/0 conn(0x7fd9cc0b6250 legacy=0x7fd9cc0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.047+0000 7fd9d2341640 1 -- 172.21.15.5:0/2768736672 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc162710 con 0x7fd9cc15df10 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.047+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2768736672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc15df10 0x7fd9cc1618d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0b3610 tx=0x7fd9c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0888dbd883855f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d133f640 1 -- 172.21.15.5:0/2768736672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4037070 con 0x7fd9cc15df10 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d133f640 1 -- 172.21.15.5:0/2768736672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c4032440 con 0x7fd9cc15df10 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d133f640 1 -- 172.21.15.5:0/2768736672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4032810 con 0x7fd9cc15df10 2024-04-25T08:59:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 -- 172.21.15.5:0/2768736672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc15df10 msgr2=0x7fd9cc1618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/2768736672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc15df10 0x7fd9cc1618d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0b3610 tx=0x7fd9c402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 -- 172.21.15.5:0/2768736672 shutdown_connections 2024-04-25T08:59:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/2768736672 >> v2:172.21.15.80:3300/0 conn(0x7fd9cc0cefe0 0x7fd9cc0d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/2768736672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc15df10 0x7fd9cc1618d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 -- 172.21.15.5:0/2768736672 >> 172.21.15.5:0/2768736672 conn(0x7fd9cc0668f0 msgr2=0x7fd9cc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 -- 172.21.15.5:0/2768736672 shutdown_connections 2024-04-25T08:59:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.048+0000 7fd9d45a5640 1 -- 172.21.15.5:0/2768736672 wait complete. 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.049+0000 7fd9d45a5640 1 Processor -- start 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.049+0000 7fd9d45a5640 1 -- start start 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d45a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0b6250 0x7fd9cc154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d45a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9cc0cefe0 0x7fd9cc160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d45a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9cc15df10 0x7fd9cc15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d45a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0d2aa0 con 0x7fd9cc0b6250 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d45a5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc161e10 con 0x7fd9cc15df10 2024-04-25T08:59:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d45a5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0d2c20 con 0x7fd9cc0cefe0 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d2341640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0b6250 0x7fd9cc154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d2341640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0b6250 0x7fd9cc154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42974/0 (socket says 172.21.15.5:42974) 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d2341640 1 -- 172.21.15.5:0/1712980769 learned_addr learned my addr 172.21.15.5:0/1712980769 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9cc15df10 0x7fd9cc15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.050+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9cc0cefe0 0x7fd9cc160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d2341640 1 -- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9cc0cefe0 msgr2=0x7fd9cc160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d2341640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9cc0cefe0 0x7fd9cc160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d2341640 1 -- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9cc15df10 msgr2=0x7fd9cc15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d2341640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9cc15df10 0x7fd9cc15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d2341640 1 -- 172.21.15.5:0/1712980769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc1612e0 con 0x7fd9cc0b6250 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9cc15df10 0x7fd9cc15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9cc0cefe0 0x7fd9cc160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d2341640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0b6250 0x7fd9cc154130 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4000c00 tx=0x7fd9c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9caffd640 1 -- 172.21.15.5:0/1712980769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4037040 con 0x7fd9cc0b6250 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9caffd640 1 -- 172.21.15.5:0/1712980769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c4042070 con 0x7fd9cc0b6250 2024-04-25T08:59:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc161000 con 0x7fd9cc0b6250 2024-04-25T08:59:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9caffd640 1 -- 172.21.15.5:0/1712980769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4030bd0 con 0x7fd9cc0b6250 2024-04-25T08:59:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.051+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc0c87d0 con 0x7fd9cc0b6250 2024-04-25T08:59:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.053+0000 7fd9caffd640 1 -- 172.21.15.5:0/1712980769 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9c4047460 con 0x7fd9cc0b6250 2024-04-25T08:59:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.053+0000 7fd9caffd640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b806b500 0x7fd9b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.053+0000 7fd9caffd640 1 -- 172.21.15.5:0/1712980769 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd9c40aae40 con 0x7fd9cc0b6250 2024-04-25T08:59:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.053+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b806b500 0x7fd9b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.054+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b806b500 0x7fd9b806d9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0b7c70 tx=0x7fd9c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.054+0000 7fd9d7384740 1 Processor -- start 2024-04-25T08:59:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.054+0000 7fd9d7384740 1 -- start start 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e8a3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 0x56332e8a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8cb9d0 0x56332e8cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d7384740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332e7d2fe0 con 0x56332e8cb9d0 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332e804d20 con 0x56332e8dd5e0 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332e7adfa0 con 0x56332e8a0f10 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d2b42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8cb9d0 0x56332e8cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d2b42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8cb9d0 0x56332e8cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42978/0 (socket says 172.21.15.5:42978) 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d2b42640 1 -- 172.21.15.5:0/4085851417 learned_addr learned my addr 172.21.15.5:0/4085851417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 0x56332e8a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.055+0000 7fd9d2341640 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e8a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9d2b42640 1 -- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 msgr2=0x56332e8a3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e8a3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9d2b42640 1 -- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 msgr2=0x56332e8a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 0x56332e8a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9d2b42640 1 -- 172.21.15.5:0/4085851417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332e5e5b00 con 0x56332e8cb9d0 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8cb9d0 0x56332e8cbe50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007510 tx=0x7fd9bc0079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc34f2b5ff9f05f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9b3fff640 1 -- 172.21.15.5:0/4085851417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0147e0 con 0x56332e8cb9d0 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9b3fff640 1 -- 172.21.15.5:0/4085851417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc01b070 con 0x56332e8cb9d0 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.056+0000 7fd9b3fff640 1 -- 172.21.15.5:0/4085851417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc014bc0 con 0x56332e8cb9d0 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 -- 172.21.15.5:0/4085851417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8cb9d0 msgr2=0x56332e8cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8cb9d0 0x56332e8cbe50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007510 tx=0x7fd9bc0079d0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 -- 172.21.15.5:0/4085851417 shutdown_connections 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8cb9d0 0x56332e8cbe50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 0x56332e8a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 --2- 172.21.15.5:0/4085851417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e8a3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 -- 172.21.15.5:0/4085851417 >> 172.21.15.5:0/4085851417 conn(0x56332e869100 msgr2=0x56332e8e69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 -- 172.21.15.5:0/4085851417 shutdown_connections 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 -- 172.21.15.5:0/4085851417 wait complete. 2024-04-25T08:59:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 -- start start 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.057+0000 7fd9d7384740 1 Processor -- start 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.058+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8a0f10 0x56332e8b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.058+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 0x56332e8df0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.058+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e8e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.058+0000 7fd9d7384740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332e7a3750 con 0x56332e8dd5e0 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.058+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332e800dc0 con 0x56332e8a0f10 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.058+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332e8b8990 con 0x56332e8cb9d0 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.058+0000 7fd9d7384740 10 client.0 _ll_register_callbacks cb 0x56332e7bbee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e8e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e8e0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42990/0 (socket says 172.21.15.5:42990) 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 -- 172.21.15.5:0/2349520643 learned_addr learned my addr 172.21.15.5:0/2349520643 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 0x56332e8df0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8a0f10 0x56332e8b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 -- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 msgr2=0x56332e8df0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 0x56332e8df0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 -- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8a0f10 msgr2=0x56332e8b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8a0f10 0x56332e8b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 -- 172.21.15.5:0/2349520643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56332e4d93f0 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e8e0ee0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007a10 tx=0x7fd9bc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11098c50cfbaa59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9b17fa640 1 -- 172.21.15.5:0/2349520643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc014a70 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9b17fa640 1 -- 172.21.15.5:0/2349520643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd9bc014c10 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9bc01b070 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9b17fa640 1 -- 172.21.15.5:0/2349520643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9bc032050 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d7384740 10 client.6081 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.059+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56332e646290 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9b17fa640 1 -- 172.21.15.5:0/2349520643 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc01b070 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9b17fa640 1 -- 172.21.15.5:0/2349520643 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd9bc035020 con 0x56332e8dd5e0 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d7384740 10 client.6081 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d7384740 10 client.6081 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d7384740 20 client.6081 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e8f9c90 0x56332e8fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d7384740 4 client.6081 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56332e812260 con 0x56332e8f9c90 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e8f9c90 0x56332e8fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9b17fa640 10 client.6081 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.060+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e8f9c90 0x56332e8fa0a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77e09db697a3bd76 server_cookie=5963872a44f13413 in_seq=0 out_seq=0 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9b17fa640 1 -- 172.21.15.5:0/2349520643 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56332e812260 con 0x56332e8f9c90 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9b17fa640 10 client.6081 handle_command_reply: tid=0 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 client.6081 shutdown 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 msgr2=0x56332e8e0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e8e0ee0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007a10 tx=0x7fd9bc004ab0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 shutdown_connections 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e8f9c90 0x56332e8fa0a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e8e0ee0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 0x56332e8df0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2349520643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8a0f10 0x56332e8b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9b17fa640 0 client.6081 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 >> 172.21.15.5:0/2349520643 conn(0x56332e869100 msgr2=0x56332e8e7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 shutdown_connections 2024-04-25T08:59:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 1 -- 172.21.15.5:0/2349520643 wait complete. 2024-04-25T08:59:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.061+0000 7fd9d7384740 20 client.6081 trim_cache size 0 max 16384 2024-04-25T08:59:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.076+0000 7fd9d7384740 1 Processor -- start 2024-04-25T08:59:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.076+0000 7fd9d7384740 1 -- start start 2024-04-25T08:59:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8a0f10 0x56332e8e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 0x56332e8e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 0x56332e8cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d7384740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc200120 con 0x56332e8a0f10 2024-04-25T08:59:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc1f8050 con 0x56332e8dd5e0 2024-04-25T08:59:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc1f7450 con 0x56332e8cb9d0 2024-04-25T08:59:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8a0f10 0x56332e8e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8a0f10 0x56332e8e6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43002/0 (socket says 172.21.15.5:43002) 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 -- 172.21.15.5:0/2557826279 learned_addr learned my addr 172.21.15.5:0/2557826279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 -- 172.21.15.5:0/2557826279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 msgr2=0x56332e8e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2557826279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 0x56332e8e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 -- 172.21.15.5:0/2557826279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 msgr2=0x56332e8cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2557826279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 0x56332e8cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.077+0000 7fd9d2341640 1 -- 172.21.15.5:0/2557826279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332e8df460 con 0x56332e8a0f10 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d2341640 1 --2- 172.21.15.5:0/2557826279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8a0f10 0x56332e8e6f70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4075990 tx=0x7fd9c4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44669b584762b41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9b37fe640 1 -- 172.21.15.5:0/2557826279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40a90b0 con 0x56332e8a0f10 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9b37fe640 1 -- 172.21.15.5:0/2557826279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c40a6070 con 0x56332e8a0f10 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9b37fe640 1 -- 172.21.15.5:0/2557826279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4079580 con 0x56332e8a0f10 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 -- 172.21.15.5:0/2557826279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8a0f10 msgr2=0x56332e8e6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2557826279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8a0f10 0x56332e8e6f70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4075990 tx=0x7fd9c4009190 comp rx=0 tx=0).stop 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 -- 172.21.15.5:0/2557826279 shutdown_connections 2024-04-25T08:59:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2557826279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8dd5e0 0x56332e8cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2557826279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8cb9d0 0x56332e8e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 --2- 172.21.15.5:0/2557826279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8a0f10 0x56332e8e6f70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 -- 172.21.15.5:0/2557826279 >> 172.21.15.5:0/2557826279 conn(0x56332e869100 msgr2=0x56332e8a2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 -- 172.21.15.5:0/2557826279 shutdown_connections 2024-04-25T08:59:41.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.078+0000 7fd9d7384740 1 -- 172.21.15.5:0/2557826279 wait complete. 2024-04-25T08:59:41.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.079+0000 7fd9d7384740 1 -- start start 2024-04-25T08:59:41.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.079+0000 7fd9d7384740 1 Processor -- start 2024-04-25T08:59:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e900820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8cb9d0 0x56332e9546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d7384740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e94e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d7384740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc1f7a50 con 0x56332e8dd5e0 2024-04-25T08:59:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332e8eae20 con 0x56332e8cb9d0 2024-04-25T08:59:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d7384740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332e954f60 con 0x56332e8a0f10 2024-04-25T08:59:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d7384740 10 client.0 _ll_register_callbacks cb 0x7fd9bc0099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e94e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e94e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43014/0 (socket says 172.21.15.5:43014) 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 -- 172.21.15.5:0/107098317 learned_addr learned my addr 172.21.15.5:0/107098317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8cb9d0 0x56332e9546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2341640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e900820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 -- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 msgr2=0x56332e900820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e900820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 -- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8cb9d0 msgr2=0x56332e9546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8cb9d0 0x56332e9546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d2b42640 1 -- 172.21.15.5:0/107098317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56332e4b24b0 con 0x56332e8dd5e0 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.080+0000 7fd9d1b40640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8cb9d0 0x56332e9546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d2b42640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e94e580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00b010 tx=0x7fd9bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0cc881fc4f3839 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9b17fa640 1 -- 172.21.15.5:0/107098317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc02ab80 con 0x56332e8dd5e0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9b17fa640 1 -- 172.21.15.5:0/107098317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd9bc02ad20 con 0x56332e8dd5e0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9c40a6070 con 0x56332e8dd5e0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9b17fa640 1 -- 172.21.15.5:0/107098317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9bc02a4d0 con 0x56332e8dd5e0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 10 client.6087 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56332e8c7620 con 0x56332e8dd5e0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9b17fa640 1 -- 172.21.15.5:0/107098317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c40a6070 con 0x56332e8dd5e0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9b17fa640 1 -- 172.21.15.5:0/107098317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd9bc035070 con 0x56332e8dd5e0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 10 client.6087 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 20 client.6087 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e951710 0x56332e951b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 4 client.6087 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x56332e8e27f0 con 0x56332e951710 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.081+0000 7fd9d2341640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e951710 0x56332e951b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9b17fa640 10 client.6087 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d2341640 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e951710 0x56332e951b20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe2a3bbd14d3cc3 server_cookie=3889e5196819032a in_seq=0 out_seq=0 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9b17fa640 1 -- 172.21.15.5:0/107098317 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56332e8e27f0 con 0x56332e951710 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9b17fa640 10 client.6087 handle_command_reply: tid=0 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 client.6087 shutdown 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 msgr2=0x56332e94e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e94e580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00b010 tx=0x7fd9bc004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 shutdown_connections 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x56332e951710 0x56332e951b20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56332e8dd5e0 0x56332e94e580 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56332e8cb9d0 0x56332e9546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9b17fa640 0 client.6087 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 --2- 172.21.15.5:0/107098317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56332e8a0f10 0x56332e900820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 >> 172.21.15.5:0/107098317 conn(0x56332e869100 msgr2=0x56332e8ea120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.082+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 shutdown_connections 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d7384740 1 -- 172.21.15.5:0/107098317 wait complete. 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d7384740 20 client.6087 trim_cache size 0 max 16384 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "dd91885e-7f35-42a7-a337-4a7fe0b5573a", 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:41.077 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:41.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b806b500 msgr2=0x7fd9b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b806b500 0x7fd9b806d9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0b7c70 tx=0x7fd9c0009040 comp rx=0 tx=0).stop 2024-04-25T08:59:41.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0b6250 msgr2=0x7fd9cc154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0b6250 0x7fd9cc154130 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4000c00 tx=0x7fd9c40046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 shutdown_connections 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b806b500 0x7fd9b806d9c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9cc15df10 0x7fd9cc15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9cc0cefe0 0x7fd9cc160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 --2- 172.21.15.5:0/1712980769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0b6250 0x7fd9cc154130 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 >> 172.21.15.5:0/1712980769 conn(0x7fd9cc0668f0 msgr2=0x7fd9cc0b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 shutdown_connections 2024-04-25T08:59:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.083+0000 7fd9d45a5640 1 -- 172.21.15.5:0/1712980769 wait complete. 2024-04-25T08:59:41.082 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'dd91885e-7f35-42a7-a337-4a7fe0b5573a', 'mode': 'asynchronous'}' 2024-04-25T08:59:41.082 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T08:59:41.082 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:41.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:59:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.197+0000 7fc38086b640 1 Processor -- start 2024-04-25T08:59:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.197+0000 7fc38086b640 1 -- start start 2024-04-25T08:59:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc38086b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc37c15df70 0x7fc37c0b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc38086b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc37c0cef20 0x7fc37c0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc38086b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0d1ed0 con 0x7fc37c0d2f70 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc38086b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0d1c80 con 0x7fc37c0cef20 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc38086b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0d2ae0 con 0x7fc37c15df70 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc37c0cef20 0x7fc37c0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc37c0cef20 0x7fc37c0b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43022/0 (socket says 172.21.15.5:43022) 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37ad9d640 1 -- 172.21.15.5:0/1423401965 learned_addr learned my addr 172.21.15.5:0/1423401965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37a59c640 1 --2- 172.21.15.5:0/1423401965 >> v2:172.21.15.80:3300/0 conn(0x7fc37c15df70 0x7fc37c0b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37ad9d640 1 -- 172.21.15.5:0/1423401965 >> v2:172.21.15.80:3300/0 conn(0x7fc37c15df70 msgr2=0x7fc37c0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/1423401965 >> v2:172.21.15.80:3300/0 conn(0x7fc37c15df70 0x7fc37c0b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37ad9d640 1 -- 172.21.15.5:0/1423401965 >> v1:172.21.15.80:6789/0 conn(0x7fc37c0d2f70 legacy=0x7fc37c0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.198+0000 7fc37ad9d640 1 -- 172.21.15.5:0/1423401965 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0d21b0 con 0x7fc37c0cef20 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.199+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/1423401965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c0cef20 0x7fc37c0b6c50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0d1220 tx=0x7fc37402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c6ea089343b3ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.199+0000 7fc37959a640 1 -- 172.21.15.5:0/1423401965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374036070 con 0x7fc37c0cef20 2024-04-25T08:59:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.199+0000 7fc37959a640 1 -- 172.21.15.5:0/1423401965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374031600 con 0x7fc37c0cef20 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.199+0000 7fc37959a640 1 -- 172.21.15.5:0/1423401965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740319d0 con 0x7fc37c0cef20 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 -- 172.21.15.5:0/1423401965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c0cef20 msgr2=0x7fc37c0b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 --2- 172.21.15.5:0/1423401965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c0cef20 0x7fc37c0b6c50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0d1220 tx=0x7fc37402a780 comp rx=0 tx=0).stop 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 -- 172.21.15.5:0/1423401965 shutdown_connections 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 --2- 172.21.15.5:0/1423401965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c0cef20 0x7fc37c0b6c50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 --2- 172.21.15.5:0/1423401965 >> v2:172.21.15.80:3300/0 conn(0x7fc37c15df70 0x7fc37c0b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 -- 172.21.15.5:0/1423401965 >> 172.21.15.5:0/1423401965 conn(0x7fc37c06b000 msgr2=0x7fc37c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 -- 172.21.15.5:0/1423401965 shutdown_connections 2024-04-25T08:59:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.200+0000 7fc38086b640 1 -- 172.21.15.5:0/1423401965 wait complete. 2024-04-25T08:59:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.201+0000 7fc38086b640 1 Processor -- start 2024-04-25T08:59:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.201+0000 7fc38086b640 1 -- start start 2024-04-25T08:59:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc38086b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc37c0cef20 0x7fc37c0b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc38086b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc37c0d2f70 0x7fc37c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc38086b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c14d110 0x7fc37c0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc38086b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0b9a10 con 0x7fc37c14d110 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc38086b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0d2770 con 0x7fc37c0d2f70 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc38086b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0d3720 con 0x7fc37c0cef20 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc37ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c14d110 0x7fc37c0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc37ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c14d110 0x7fc37c0c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43030/0 (socket says 172.21.15.5:43030) 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc37ad9d640 1 -- 172.21.15.5:0/3910170853 learned_addr learned my addr 172.21.15.5:0/3910170853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc37a59c640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc37c0cef20 0x7fc37c0b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.202+0000 7fc379d9b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc37c0d2f70 0x7fc37c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc37ad9d640 1 -- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc37c0cef20 msgr2=0x7fc37c0b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc37c0cef20 0x7fc37c0b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc37ad9d640 1 -- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc37c0d2f70 msgr2=0x7fc37c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc37c0d2f70 0x7fc37c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc37ad9d640 1 -- 172.21.15.5:0/3910170853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0c71f0 con 0x7fc37c14d110 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc379d9b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc37c0d2f70 0x7fc37c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c14d110 0x7fc37c0c7fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc37402ad70 tx=0x7fc374004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc36affd640 1 -- 172.21.15.5:0/3910170853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374036050 con 0x7fc37c14d110 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc36affd640 1 -- 172.21.15.5:0/3910170853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374042070 con 0x7fc37c14d110 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c0c74d0 con 0x7fc37c14d110 2024-04-25T08:59:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc36affd640 1 -- 172.21.15.5:0/3910170853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374009510 con 0x7fc37c14d110 2024-04-25T08:59:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.203+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c0b83e0 con 0x7fc37c14d110 2024-04-25T08:59:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.205+0000 7fc36affd640 1 -- 172.21.15.5:0/3910170853 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc374007bd0 con 0x7fc37c14d110 2024-04-25T08:59:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.205+0000 7fc36affd640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc35c06b500 0x7fc35c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.205+0000 7fc36affd640 1 -- 172.21.15.5:0/3910170853 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc3740ab000 con 0x7fc37c14d110 2024-04-25T08:59:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.205+0000 7fc37a59c640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc35c06b500 0x7fc35c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.206+0000 7fc37a59c640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc35c06b500 0x7fc35c06d9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0079a0 tx=0x7fc36c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.206+0000 7fc38356b740 1 Processor -- start 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.206+0000 7fc38356b740 1 -- start start 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc38356b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734ebe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734ebb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc38356b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561734ddae60 con 0x561734e78130 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561734d84120 con 0x561734e9eaf0 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561734dd6f00 con 0x561734ebdf60 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734ebe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734ebe340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43034/0 (socket says 172.21.15.5:43034) 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 -- 172.21.15.5:0/1512597079 learned_addr learned my addr 172.21.15.5:0/1512597079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734ebb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc37a59c640 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 -- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 msgr2=0x561734ebc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 -- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 msgr2=0x561734ebb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734ebb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 -- 172.21.15.5:0/1512597079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561734bbbf00 con 0x561734e78130 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.207+0000 7fc379d9b640 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734ebe340 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc370003d90 tx=0x7fc370004190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f9b26e387cd601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc35bfff640 1 -- 172.21.15.5:0/1512597079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370018020 con 0x561734e78130 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc35bfff640 1 -- 172.21.15.5:0/1512597079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370005030 con 0x561734e78130 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc35bfff640 1 -- 172.21.15.5:0/1512597079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370005420 con 0x561734e78130 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 -- 172.21.15.5:0/1512597079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 msgr2=0x561734ebe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734ebe340 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc370003d90 tx=0x7fc370004190 comp rx=0 tx=0).stop 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 -- 172.21.15.5:0/1512597079 shutdown_connections 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734ebb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734ebe340 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 --2- 172.21.15.5:0/1512597079 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 -- 172.21.15.5:0/1512597079 >> 172.21.15.5:0/1512597079 conn(0x561734e3ef70 msgr2=0x561734e75150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 -- 172.21.15.5:0/1512597079 shutdown_connections 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.208+0000 7fc38356b740 1 -- 172.21.15.5:0/1512597079 wait complete. 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.209+0000 7fc38356b740 1 -- start start 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.209+0000 7fc38356b740 1 Processor -- start 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734ea1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc38356b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734ea1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734e9fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc38356b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561734ebd760 con 0x561734e9eaf0 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561734d79cd0 con 0x561734e78130 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561734ebd480 con 0x561734ebdf60 2024-04-25T08:59:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc38356b740 10 client.0 _ll_register_callbacks cb 0x561734aef2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734ea1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734ea1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43038/0 (socket says 172.21.15.5:43038) 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 -- 172.21.15.5:0/507036074 learned_addr learned my addr 172.21.15.5:0/507036074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734e9fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc37a59c640 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734ea1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 -- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 msgr2=0x561734e9fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734e9fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 -- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 msgr2=0x561734ea1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734ea1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 -- 172.21.15.5:0/507036074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561734aaf7f0 con 0x561734e9eaf0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc379d9b640 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734ea1ff0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc37000e530 tx=0x7fc3700036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11afa6a37f0c298e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.210+0000 7fc3597fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc3597fa640 1 -- 172.21.15.5:0/507036074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370022060 con 0x561734e9eaf0 2024-04-25T08:59:41.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc3597fa640 1 -- 172.21.15.5:0/507036074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc3700074d0 con 0x561734e9eaf0 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc370005030 con 0x561734e9eaf0 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc3597fa640 1 -- 172.21.15.5:0/507036074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc370028050 con 0x561734e9eaf0 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 10 client.6099 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561734c1c690 con 0x561734e9eaf0 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc3597fa640 1 -- 172.21.15.5:0/507036074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370005030 con 0x561734e9eaf0 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc3597fa640 1 -- 172.21.15.5:0/507036074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc37002b020 con 0x561734e9eaf0 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 10 client.6099 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 10 client.6099 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 20 client.6099 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734ea1620 0x561734ea4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 4 client.6099 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561734de83a0 con 0x561734ea1620 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.211+0000 7fc37a59c640 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734ea1620 0x561734ea4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc3597fa640 10 client.6099 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc37a59c640 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734ea1620 0x561734ea4f30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9443deed96b45cc7 server_cookie=f37b0ec1da2355f7 in_seq=0 out_seq=0 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc3597fa640 1 -- 172.21.15.5:0/507036074 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561734de83a0 con 0x561734ea1620 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc3597fa640 10 client.6099 handle_command_reply: tid=0 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 client.6099 shutdown 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 msgr2=0x561734ea1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734ea1ff0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc37000e530 tx=0x7fc3700036f0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 shutdown_connections 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734ea1620 0x561734ea4f30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734e9fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734ea1ff0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc3597fa640 0 client.6099 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 --2- 172.21.15.5:0/507036074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734ea1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 >> 172.21.15.5:0/507036074 conn(0x561734e3ef70 msgr2=0x561734ebfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 shutdown_connections 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 1 -- 172.21.15.5:0/507036074 wait complete. 2024-04-25T08:59:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.212+0000 7fc38356b740 20 client.6099 trim_cache size 0 max 16384 2024-04-25T08:59:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 Processor -- start 2024-04-25T08:59:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 -- start start 2024-04-25T08:59:41.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734e73010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734e73550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c200040 con 0x561734e9eaf0 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0cb480 con 0x561734e78130 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.228+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c149340 con 0x561734ebdf60 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734e73550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734e73550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43048/0 (socket says 172.21.15.5:43048) 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 -- 172.21.15.5:0/4038396610 learned_addr learned my addr 172.21.15.5:0/4038396610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc37a59c640 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734e73010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 -- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 msgr2=0x561734ebfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 -- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 msgr2=0x561734e73010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734e73010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 -- 172.21.15.5:0/4038396610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561734e76a30 con 0x561734e9eaf0 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc379d9b640 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734e73550 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc370003730 tx=0x7fc37001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9370a65f44969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc35b7fe640 1 -- 172.21.15.5:0/4038396610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370018070 con 0x561734e9eaf0 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc35b7fe640 1 -- 172.21.15.5:0/4038396610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3700072d0 con 0x561734e9eaf0 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.229+0000 7fc35b7fe640 1 -- 172.21.15.5:0/4038396610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370006bc0 con 0x561734e9eaf0 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 -- 172.21.15.5:0/4038396610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 msgr2=0x561734e73550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734e73550 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc370003730 tx=0x7fc37001c000 comp rx=0 tx=0).stop 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 -- 172.21.15.5:0/4038396610 shutdown_connections 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ebfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e9eaf0 0x561734e73550 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 --2- 172.21.15.5:0/4038396610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e78130 0x561734e73010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 -- 172.21.15.5:0/4038396610 >> 172.21.15.5:0/4038396610 conn(0x561734e3ef70 msgr2=0x561734e9e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 -- 172.21.15.5:0/4038396610 shutdown_connections 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 -- 172.21.15.5:0/4038396610 wait complete. 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 -- start start 2024-04-25T08:59:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.230+0000 7fc38356b740 1 Processor -- start 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc38356b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734f263a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734e95bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc38356b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ec0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc38356b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0cae80 con 0x561734e78130 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561734ebe620 con 0x561734e9eaf0 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc38356b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561734eb5a10 con 0x561734ebdf60 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc38356b740 10 client.0 _ll_register_callbacks cb 0x7fc370007f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc37a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734f263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc37a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734f263a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43050/0 (socket says 172.21.15.5:43050) 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc37a59c640 1 -- 172.21.15.5:0/2446347457 learned_addr learned my addr 172.21.15.5:0/2446347457 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc379d9b640 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734e95bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.231+0000 7fc37ad9d640 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ec0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc37a59c640 1 -- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 msgr2=0x561734ec0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc37a59c640 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ec0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc37a59c640 1 -- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 msgr2=0x561734e95bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc37a59c640 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734e95bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc37a59c640 1 -- 172.21.15.5:0/2446347457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561734a888b0 con 0x561734e78130 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc37a59c640 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734f263a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x561734ea0ab0 tx=0x7fc36c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68a5560edb1930 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc3597fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc3597fa640 1 -- 172.21.15.5:0/2446347457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c01c040 con 0x561734e78130 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc3597fa640 1 -- 172.21.15.5:0/2446347457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc36c018a30 con 0x561734e78130 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3700072d0 con 0x561734e78130 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc3597fa640 1 -- 172.21.15.5:0/2446347457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc36c03a050 con 0x561734e78130 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 10 client.6105 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561734eb5750 con 0x561734e78130 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc3597fa640 1 -- 172.21.15.5:0/2446347457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3700072d0 con 0x561734e78130 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc3597fa640 1 -- 172.21.15.5:0/2446347457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc36c018c70 con 0x561734e78130 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 10 client.6105 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 10 client.6105 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 20 client.6105 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734e9d5b0 0x561734e73010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 4 client.6105 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x561734de26f0 con 0x561734e9d5b0 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.232+0000 7fc379d9b640 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734e9d5b0 0x561734e73010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.233+0000 7fc3597fa640 10 client.6105 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.233+0000 7fc379d9b640 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734e9d5b0 0x561734e73010 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=130080df4017f440 server_cookie=29d3beea71e7dd7d in_seq=0 out_seq=0 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.233+0000 7fc3597fa640 1 -- 172.21.15.5:0/2446347457 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561734de26f0 con 0x561734e9d5b0 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.233+0000 7fc3597fa640 10 client.6105 handle_command_reply: tid=0 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.233+0000 7fc38356b740 1 client.6105 shutdown 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.233+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 msgr2=0x561734f263a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.233+0000 7fc38356b740 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734f263a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x561734ea0ab0 tx=0x7fc36c013000 comp rx=0 tx=0).stop 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 shutdown_connections 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561734e9d5b0 0x561734e73010 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561734ebdf60 0x561734ec0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561734e9eaf0 0x561734e95bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc3597fa640 0 client.6105 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 --2- 172.21.15.5:0/2446347457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561734e78130 0x561734f263a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 >> 172.21.15.5:0/2446347457 conn(0x561734e3ef70 msgr2=0x561734e75040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 shutdown_connections 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 1 -- 172.21.15.5:0/2446347457 wait complete. 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38356b740 20 client.6105 trim_cache size 0 max 16384 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "345a4c35-527f-48ce-bc7c-2a1371f3ec17", 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc35c06b500 msgr2=0x7fc35c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc35c06b500 0x7fc35c06d9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0079a0 tx=0x7fc36c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c14d110 msgr2=0x7fc37c0c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c14d110 0x7fc37c0c7fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc37402ad70 tx=0x7fc374004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 shutdown_connections 2024-04-25T08:59:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc35c06b500 0x7fc35c06d9c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc37c14d110 0x7fc37c0c7fb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc37c0d2f70 0x7fc37c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 --2- 172.21.15.5:0/3910170853 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc37c0cef20 0x7fc37c0b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 >> 172.21.15.5:0/3910170853 conn(0x7fc37c06b000 msgr2=0x7fc37c0b9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 shutdown_connections 2024-04-25T08:59:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.234+0000 7fc38086b640 1 -- 172.21.15.5:0/3910170853 wait complete. 2024-04-25T08:59:41.233 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '345a4c35-527f-48ce-bc7c-2a1371f3ec17', 'mode': 'asynchronous'}' 2024-04-25T08:59:41.233 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-04-25T08:59:41.233 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:41.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-04-25T08:59:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.349+0000 7fcb2f6ac640 1 Processor -- start 2024-04-25T08:59:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.349+0000 7fcb2f6ac640 1 -- start start 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.349+0000 7fcb2f6ac640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb281614b0 0x7fcb280b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.349+0000 7fcb2f6ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d1f60 0x7fcb280d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2f6ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb280d4060 0x7fcb280b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2f6ac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280d2740 con 0x7fcb280d4060 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2f6ac640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280d2a20 con 0x7fcb281614b0 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2f6ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280d2d00 con 0x7fcb280d1f60 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb280d4060 0x7fcb280b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb280d4060 0x7fcb280b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43054/0 (socket says 172.21.15.5:43054) 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 -- 172.21.15.5:0/1598079362 learned_addr learned my addr 172.21.15.5:0/1598079362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1598079362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d1f60 0x7fcb280d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1598079362 >> v2:172.21.15.80:3300/0 conn(0x7fcb281614b0 0x7fcb280b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 -- 172.21.15.5:0/1598079362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d1f60 msgr2=0x7fcb280d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1598079362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d1f60 0x7fcb280d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 -- 172.21.15.5:0/1598079362 >> v2:172.21.15.80:3300/0 conn(0x7fcb281614b0 msgr2=0x7fcb280b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1598079362 >> v2:172.21.15.80:3300/0 conn(0x7fcb281614b0 0x7fcb280b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2dc49640 1 -- 172.21.15.5:0/1598079362 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280d2fe0 con 0x7fcb280d4060 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.350+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1598079362 >> v2:172.21.15.80:3300/0 conn(0x7fcb281614b0 0x7fcb280b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1598079362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb280d4060 0x7fcb280b5610 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcb2808ca90 tx=0x7fcb1802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64415affec76bb6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb27fff640 1 -- 172.21.15.5:0/1598079362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18036070 con 0x7fcb280d4060 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb27fff640 1 -- 172.21.15.5:0/1598079362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb18031600 con 0x7fcb280d4060 2024-04-25T08:59:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb27fff640 1 -- 172.21.15.5:0/1598079362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180319d0 con 0x7fcb280d4060 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/1598079362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb280d4060 msgr2=0x7fcb280b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/1598079362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb280d4060 0x7fcb280b5610 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcb2808ca90 tx=0x7fcb1802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/1598079362 shutdown_connections 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/1598079362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb280d4060 0x7fcb280b5610 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/1598079362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d1f60 0x7fcb280d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/1598079362 >> v2:172.21.15.80:3300/0 conn(0x7fcb281614b0 0x7fcb280b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.351+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/1598079362 >> 172.21.15.5:0/1598079362 conn(0x7fcb2806b000 msgr2=0x7fcb2806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.352+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/1598079362 shutdown_connections 2024-04-25T08:59:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.352+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/1598079362 wait complete. 2024-04-25T08:59:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 Processor -- start 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 -- start start 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb280d1f60 0x7fcb280b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d4060 0x7fcb281522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb281614b0 0x7fcb2815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280d23a0 con 0x7fcb281614b0 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280d37e0 con 0x7fcb280d1f60 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.353+0000 7fcb2f6ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280d2520 con 0x7fcb280d4060 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb281614b0 0x7fcb2815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb281614b0 0x7fcb2815b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43056/0 (socket says 172.21.15.5:43056) 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 -- 172.21.15.5:0/2041026818 learned_addr learned my addr 172.21.15.5:0/2041026818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2d448640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb280d1f60 0x7fcb280b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d4060 0x7fcb281522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 -- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d4060 msgr2=0x7fcb281522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d4060 0x7fcb281522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 -- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb280d1f60 msgr2=0x7fcb280b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb280d1f60 0x7fcb280b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 -- 172.21.15.5:0/2041026818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2815c350 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2d448640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb280d1f60 0x7fcb280b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb281614b0 0x7fcb2815b9e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcb18034040 tx=0x7fcb18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb25ffb640 1 -- 172.21.15.5:0/2041026818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18036050 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb25ffb640 1 -- 172.21.15.5:0/2041026818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb18042070 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb25ffb640 1 -- 172.21.15.5:0/2041026818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18009510 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2815c630 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.354+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2815ced0 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.356+0000 7fcb25ffb640 1 -- 172.21.15.5:0/2041026818 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb18007bf0 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.356+0000 7fcb25ffb640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb1406b4d0 0x7fcb1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.356+0000 7fcb25ffb640 1 -- 172.21.15.5:0/2041026818 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcb180ab080 con 0x7fcb281614b0 2024-04-25T08:59:41.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.357+0000 7fcb2d448640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb1406b4d0 0x7fcb1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.357+0000 7fcb2d448640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb1406b4d0 0x7fcb1406d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcb280c8270 tx=0x7fcb20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.357+0000 7fcb323ab740 1 Processor -- start 2024-04-25T08:59:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.357+0000 7fcb323ab740 1 -- start start 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e06a3c0 0x55974e06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e03cc40 0x55974e040450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb323ab740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974dfa5a50 con 0x55974e06a3c0 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974df4ed40 con 0x55974e03cc40 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974dfa1af0 con 0x55974e069fe0 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e06a3c0 0x55974e06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e06a3c0 0x55974e06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43064/0 (socket says 172.21.15.5:43064) 2024-04-25T08:59:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2d448640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 -- 172.21.15.5:0/1494712844 learned_addr learned my addr 172.21.15.5:0/1494712844 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e03cc40 0x55974e040450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 -- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 msgr2=0x55974e06c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e06c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 -- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e03cc40 msgr2=0x55974e040450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e03cc40 0x55974e040450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2cc47640 1 -- 172.21.15.5:0/1494712844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974dd86690 con 0x55974e06a3c0 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.358+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e03cc40 0x55974e040450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e06a3c0 0x55974e06cd30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009ae0 tx=0x7fcb1c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ecf3e6bf4e1205 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb0effd640 1 -- 172.21.15.5:0/1494712844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c019070 con 0x55974e06a3c0 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb0effd640 1 -- 172.21.15.5:0/1494712844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c011b60 con 0x55974e06a3c0 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb0effd640 1 -- 172.21.15.5:0/1494712844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c015460 con 0x55974e06a3c0 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 -- 172.21.15.5:0/1494712844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e06a3c0 msgr2=0x55974e06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e06a3c0 0x55974e06cd30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009ae0 tx=0x7fcb1c009190 comp rx=0 tx=0).stop 2024-04-25T08:59:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 -- 172.21.15.5:0/1494712844 shutdown_connections 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e03cc40 0x55974e040450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e06a3c0 0x55974e06cd30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1494712844 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e06c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 -- 172.21.15.5:0/1494712844 >> 172.21.15.5:0/1494712844 conn(0x55974e03eeb0 msgr2=0x55974e0877f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.359+0000 7fcb323ab740 1 -- 172.21.15.5:0/1494712844 shutdown_connections 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.360+0000 7fcb323ab740 1 -- 172.21.15.5:0/1494712844 wait complete. 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.360+0000 7fcb323ab740 1 -- start start 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.360+0000 7fcb323ab740 1 Processor -- start 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e09b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e098420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb323ab740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974e042060 con 0x55974e069fe0 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974df44340 con 0x55974e065e00 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974e042340 con 0x55974e06a3c0 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb323ab740 10 client.0 _ll_register_callbacks cb 0x55974df61cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43068/0 (socket says 172.21.15.5:43068) 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 -- 172.21.15.5:0/1124468004 learned_addr learned my addr 172.21.15.5:0/1124468004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e09b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e098420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 -- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 msgr2=0x55974e09b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e09b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 -- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 msgr2=0x55974e098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e098420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2d448640 1 -- 172.21.15.5:0/1124468004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55974dde6e20 con 0x55974e069fe0 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.361+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e098420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06ed50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcb20014740 tx=0x7fcb200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da858229fc368ec7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb03fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb03fff640 1 -- 172.21.15.5:0/1124468004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20025070 con 0x55974e069fe0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb03fff640 1 -- 172.21.15.5:0/1124468004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcb200158e0 con 0x55974e069fe0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb1c011b60 con 0x55974e069fe0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb03fff640 1 -- 172.21.15.5:0/1124468004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb2001b040 con 0x55974e069fe0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 10 client.6117 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55974dc79f80 con 0x55974e069fe0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb03fff640 1 -- 172.21.15.5:0/1124468004 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c011b60 con 0x55974e069fe0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb03fff640 1 -- 172.21.15.5:0/1124468004 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcb20033080 con 0x55974e069fe0 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 10 client.6117 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 10 client.6117 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 20 client.6117 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e066960 0x55974e06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 4 client.6117 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55974dfb2f90 con 0x55974e066960 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.362+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e066960 0x55974e06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e066960 0x55974e06f2f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=125c3b0280dbaab5 server_cookie=e2b663ffdde8610a in_seq=0 out_seq=0 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb03fff640 10 client.6117 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb03fff640 1 -- 172.21.15.5:0/1124468004 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55974dfb2f90 con 0x55974e066960 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb03fff640 10 client.6117 handle_command_reply: tid=0 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 client.6117 shutdown 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 msgr2=0x55974e06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06ed50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcb20014740 tx=0x7fcb200046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 shutdown_connections 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e066960 0x55974e06f2f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e098420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e09b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb03fff640 0 client.6117 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.363+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1124468004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06ed50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.364+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 >> 172.21.15.5:0/1124468004 conn(0x55974e03cc40 msgr2=0x55974e03d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.364+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 shutdown_connections 2024-04-25T08:59:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.364+0000 7fcb323ab740 1 -- 172.21.15.5:0/1124468004 wait complete. 2024-04-25T08:59:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.364+0000 7fcb323ab740 20 client.6117 trim_cache size 0 max 16384 2024-04-25T08:59:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.379+0000 7fcb323ab740 1 Processor -- start 2024-04-25T08:59:41.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.379+0000 7fcb323ab740 1 -- start start 2024-04-25T08:59:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e065e00 0x55974e041130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e041670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e06a3c0 0x55974e03d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb323ab740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28200040 con 0x55974e065e00 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281ff1a0 con 0x55974e06a3c0 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281fe5d0 con 0x55974e069fe0 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e065e00 0x55974e041130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e065e00 0x55974e041130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43084/0 (socket says 172.21.15.5:43084) 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 -- 172.21.15.5:0/1990274920 learned_addr learned my addr 172.21.15.5:0/1990274920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e041670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e06a3c0 0x55974e03d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 -- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 msgr2=0x55974e041670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e041670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 -- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e06a3c0 msgr2=0x55974e03d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e06a3c0 0x55974e03d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 -- 172.21.15.5:0/1990274920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974e068760 con 0x55974e065e00 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e041670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e06a3c0 0x55974e03d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb2d448640 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e065e00 0x55974e041130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb20022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ca2f513aac5d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb0e7fc640 1 -- 172.21.15.5:0/1990274920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20025030 con 0x55974e065e00 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb0e7fc640 1 -- 172.21.15.5:0/1990274920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2001c040 con 0x55974e065e00 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.380+0000 7fcb0e7fc640 1 -- 172.21.15.5:0/1990274920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200158e0 con 0x55974e065e00 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 -- 172.21.15.5:0/1990274920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e065e00 msgr2=0x55974e041130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e065e00 0x55974e041130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb20022000 comp rx=0 tx=0).stop 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 -- 172.21.15.5:0/1990274920 shutdown_connections 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e06a3c0 0x55974e03d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e069fe0 0x55974e041670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 --2- 172.21.15.5:0/1990274920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e065e00 0x55974e041130 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 -- 172.21.15.5:0/1990274920 >> 172.21.15.5:0/1990274920 conn(0x55974e03cc40 msgr2=0x55974e06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 -- 172.21.15.5:0/1990274920 shutdown_connections 2024-04-25T08:59:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 -- 172.21.15.5:0/1990274920 wait complete. 2024-04-25T08:59:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 -- start start 2024-04-25T08:59:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.381+0000 7fcb323ab740 1 Processor -- start 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e0f3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb323ab740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e07d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb323ab740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974e0407d0 con 0x55974e069fe0 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281febd0 con 0x55974e065e00 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb323ab740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974e041cd0 con 0x55974e06a3c0 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb323ab740 10 client.0 _ll_register_callbacks cb 0x7fcb20004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb2cc47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb2cc47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43094/0 (socket says 172.21.15.5:43094) 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.382+0000 7fcb2cc47640 1 -- 172.21.15.5:0/4067455847 learned_addr learned my addr 172.21.15.5:0/4067455847 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2d448640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e0f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e07d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2cc47640 1 -- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 msgr2=0x55974e07d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e07d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2cc47640 1 -- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 msgr2=0x55974e0f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e0f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2cc47640 1 -- 172.21.15.5:0/4067455847 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55974e0388d0 con 0x55974e069fe0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2d448640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e0f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2dc49640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e07d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb2cc47640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06d300 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c018000 tx=0x7fcb1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbb7a0be7a7c865 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb03fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb03fff640 1 -- 172.21.15.5:0/4067455847 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c02d070 con 0x55974e069fe0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb03fff640 1 -- 172.21.15.5:0/4067455847 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcb1c005990 con 0x55974e069fe0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb2001c040 con 0x55974e069fe0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb03fff640 1 -- 172.21.15.5:0/4067455847 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb1c038050 con 0x55974e069fe0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb323ab740 10 client.6123 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55974e0f3450 con 0x55974e069fe0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb03fff640 1 -- 172.21.15.5:0/4067455847 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2001c040 con 0x55974e069fe0 2024-04-25T08:59:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.383+0000 7fcb03fff640 1 -- 172.21.15.5:0/4067455847 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcb1c03b020 con 0x55974e069fe0 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb323ab740 10 client.6123 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb323ab740 10 client.6123 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb323ab740 20 client.6123 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb323ab740 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e0ed020 0x55974e07d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb323ab740 4 client.6123 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x55974dfad2e0 con 0x55974e0ed020 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb2d448640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e0ed020 0x55974e07d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb2d448640 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e0ed020 0x55974e07d6c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64e590e72383c783 server_cookie=2af4229f584e28c in_seq=0 out_seq=0 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb03fff640 10 client.6123 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb03fff640 1 -- 172.21.15.5:0/4067455847 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55974dfad2e0 con 0x55974e0ed020 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb03fff640 10 client.6123 handle_command_reply: tid=0 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.384+0000 7fcb323ab740 1 client.6123 shutdown 2024-04-25T08:59:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 msgr2=0x55974e06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06d300 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c018000 tx=0x7fcb1c004730 comp rx=0 tx=0).stop 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 shutdown_connections 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55974e0ed020 0x55974e07d6c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55974e06a3c0 0x55974e07d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55974e069fe0 0x55974e06d300 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 --2- 172.21.15.5:0/4067455847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55974e065e00 0x55974e0f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 >> 172.21.15.5:0/4067455847 conn(0x55974e03cc40 msgr2=0x55974e06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb03fff640 0 client.6123 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 shutdown_connections 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 1 -- 172.21.15.5:0/4067455847 wait complete. 2024-04-25T08:59:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb323ab740 20 client.6123 trim_cache size 0 max 16384 2024-04-25T08:59:41.380 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "a95fee54-6588-40ef-8572-fe767758887a", 2024-04-25T08:59:41.380 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:41.380 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb1406b4d0 msgr2=0x7fcb1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb1406b4d0 0x7fcb1406d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcb280c8270 tx=0x7fcb20008040 comp rx=0 tx=0).stop 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb281614b0 msgr2=0x7fcb2815b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.385+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb281614b0 0x7fcb2815b9e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcb18034040 tx=0x7fcb18004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 shutdown_connections 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb1406b4d0 0x7fcb1406d990 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb281614b0 0x7fcb2815b9e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb280d4060 0x7fcb281522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 --2- 172.21.15.5:0/2041026818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb280d1f60 0x7fcb280b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 >> 172.21.15.5:0/2041026818 conn(0x7fcb2806b000 msgr2=0x7fcb280b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 shutdown_connections 2024-04-25T08:59:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.386+0000 7fcb2f6ac640 1 -- 172.21.15.5:0/2041026818 wait complete. 2024-04-25T08:59:41.385 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'a95fee54-6588-40ef-8572-fe767758887a', 'mode': 'asynchronous'}' 2024-04-25T08:59:41.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:41.385 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-04-25T08:59:41.401 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-04-25T08:59:41.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.554+0000 7fceb3c93640 1 Processor -- start 2024-04-25T08:59:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.554+0000 7fceb3c93640 1 -- start start 2024-04-25T08:59:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb3c93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 0x7fceac0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb3c93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac0cf1c0 con 0x7fceac0b2cc0 2024-04-25T08:59:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb3c93640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac0d20e0 con 0x7fceac15de70 2024-04-25T08:59:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb3c93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0d2a10 con 0x7fceac0ce7f0 2024-04-25T08:59:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb122e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fceac0b2cc0 0x7fceac0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42806/0 (socket says 172.21.15.5:42806) 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb122e640 1 -- 172.21.15.5:0/2685991231 learned_addr learned my addr 172.21.15.5:0/2685991231 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb2230640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 0x7fceac0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902036302 0 0) 0x7fceac0cf1c0 con 0x7fceac0b2cc0 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce98003520 con 0x7fceac0b2cc0 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 715290867 0 0) 0x7fce98003520 con 0x7fceac0b2cc0 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 msgr2=0x7fceac0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 0x7fceac0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 >> v1:172.21.15.80:6789/0 conn(0x7fceac15de70 legacy=0x7fceac0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0d23c0 con 0x7fceac0b2cc0 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fce9c001670 con 0x7fceac0b2cc0 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 >> v1:172.21.15.5:6789/0 conn(0x7fceac0b2cc0 legacy=0x7fceac0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.555+0000 7fceb0a2d640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce980039e0 0x7fce98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb0a2d640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 0x7fce98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb0a2d640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce98004d40 0x7fce980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0d2a10 con 0x7fce980039e0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9800b9f0 con 0x7fce98004d40 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9800bbf0 con 0x7fceac0ce7f0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb1a2f640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce980039e0 0x7fce98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb2230640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce98004d40 0x7fce980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb122e640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 0x7fce98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb1a2f640 1 -- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 msgr2=0x7fce98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb1a2f640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac0ce7f0 0x7fce98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb1a2f640 1 -- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce98004d40 msgr2=0x7fce980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb1a2f640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce98004d40 0x7fce980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.556+0000 7fceb1a2f640 1 -- 172.21.15.5:0/2685991231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98003520 con 0x7fce980039e0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb1a2f640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce980039e0 0x7fce98003dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001910 tx=0x7fce98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1f0d85dae83774 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8037070 con 0x7fce980039e0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea802aba0 con 0x7fce980039e0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb0a2d640 1 -- 172.21.15.5:0/2685991231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80014e0 con 0x7fce980039e0 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb3c93640 1 -- 172.21.15.5:0/2685991231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce980039e0 msgr2=0x7fce98003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb3c93640 1 --2- 172.21.15.5:0/2685991231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce980039e0 0x7fce98003dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001910 tx=0x7fce98005830 comp rx=0 tx=0).stop 2024-04-25T08:59:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb2230640 1 -- 172.21.15.5:0/2685991231 reap_dead start 2024-04-25T08:59:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb3c93640 1 -- 172.21.15.5:0/2685991231 shutdown_connections 2024-04-25T08:59:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb3c93640 1 -- 172.21.15.5:0/2685991231 >> 172.21.15.5:0/2685991231 conn(0x7fceac06b000 msgr2=0x7fceac06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb3c93640 1 -- 172.21.15.5:0/2685991231 shutdown_connections 2024-04-25T08:59:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.557+0000 7fceb3c93640 1 -- 172.21.15.5:0/2685991231 wait complete. 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 Processor -- start 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 -- start start 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce980039e0 0x7fceac0c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac1535d0 0x7fceac1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceac154af0 0x7fceac1f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0cec80 con 0x7fceac154af0 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b7300 con 0x7fce980039e0 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb3c93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0cee00 con 0x7fceac1535d0 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.559+0000 7fceb2230640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceac154af0 0x7fceac1f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceac154af0 0x7fceac1f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43120/0 (socket says 172.21.15.5:43120) 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 -- 172.21.15.5:0/3135272033 learned_addr learned my addr 172.21.15.5:0/3135272033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb1a2f640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce980039e0 0x7fceac0c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb122e640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac1535d0 0x7fceac1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 -- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac1535d0 msgr2=0x7fceac1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac1535d0 0x7fceac1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 -- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce980039e0 msgr2=0x7fceac0c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce980039e0 0x7fceac0c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 -- 172.21.15.5:0/3135272033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac1f4360 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb2230640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceac154af0 0x7fceac1f3590 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b3590 tx=0x7fcea400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fcea27fc640 1 -- 172.21.15.5:0/3135272033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400fd10 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fcea27fc640 1 -- 172.21.15.5:0/3135272033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea401d070 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0b4bf0 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fcea27fc640 1 -- 172.21.15.5:0/3135272033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4015670 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.560+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac1f3ad0 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.561+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac04ef20 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.562+0000 7fcea27fc640 1 -- 172.21.15.5:0/3135272033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcea4015810 con 0x7fceac154af0 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.562+0000 7fcea27fc640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce9006b4d0 0x7fce9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.562+0000 7fcea27fc640 1 -- 172.21.15.5:0/3135272033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcea408a980 con 0x7fceac154af0 2024-04-25T08:59:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.562+0000 7fceb1a2f640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce9006b4d0 0x7fce9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.563+0000 7fceb1a2f640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce9006b4d0 0x7fce9006d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcea8034000 tx=0x7fcea802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.566+0000 7fcea27fc640 1 -- 172.21.15.5:0/3135272033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcea4010040 con 0x7fceac154af0 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.784+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fceac0ce4e0 con 0x7fceac154af0 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.785+0000 7fcea27fc640 1 -- 172.21.15.5:0/3135272033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fcea40597c0 con 0x7fceac154af0 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:36.481771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-25T08:59:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.786+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce9006b4d0 msgr2=0x7fce9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.786+0000 7fceb3c93640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce9006b4d0 0x7fce9006d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcea8034000 tx=0x7fcea802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.786+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceac154af0 msgr2=0x7fceac1f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.786+0000 7fceb3c93640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceac154af0 0x7fceac1f3590 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b3590 tx=0x7fcea400f1b0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 shutdown_connections 2024-04-25T08:59:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce9006b4d0 0x7fce9006d990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceac154af0 0x7fceac1f3590 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fceac1535d0 0x7fceac1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 --2- 172.21.15.5:0/3135272033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce980039e0 0x7fceac0c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 >> 172.21.15.5:0/3135272033 conn(0x7fceac06b000 msgr2=0x7fceac15e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 shutdown_connections 2024-04-25T08:59:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:41.787+0000 7fceb3c93640 1 -- 172.21.15.5:0/3135272033 wait complete. 2024-04-25T08:59:41.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-04-25T08:59:41.893 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:41.894 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:41.894 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:41.902 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:41.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:41.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:41.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:41.919 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-04-25T08:59:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T08:59:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T08:59:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812538 s, 129 MB/s 2024-04-25T08:59:41.984 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-04-25T08:59:41.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:42.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.135+0000 7f773b5c1640 1 Processor -- start 2024-04-25T08:59:42.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.135+0000 7f773b5c1640 1 -- start start 2024-04-25T08:59:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773b5c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7734156250 0x7f77340b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773b5c1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77340aeda0 0x7f773415d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773b5c1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77340b2aa0 con 0x7f773406dd20 2024-04-25T08:59:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773b5c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77340b2850 con 0x7f7734156250 2024-04-25T08:59:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773b5c1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77340b2d80 con 0x7f77340aeda0 2024-04-25T08:59:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773935d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7734156250 0x7f77340b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773935d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7734156250 0x7f77340b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43126/0 (socket says 172.21.15.5:43126) 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773935d640 1 -- 172.21.15.5:0/926137779 learned_addr learned my addr 172.21.15.5:0/926137779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f7739b5e640 1 --2- 172.21.15.5:0/926137779 >> v2:172.21.15.80:3300/0 conn(0x7f77340aeda0 0x7f773415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773935d640 1 -- 172.21.15.5:0/926137779 >> v2:172.21.15.80:3300/0 conn(0x7f77340aeda0 msgr2=0x7f773415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773935d640 1 --2- 172.21.15.5:0/926137779 >> v2:172.21.15.80:3300/0 conn(0x7f77340aeda0 0x7f773415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773935d640 1 -- 172.21.15.5:0/926137779 >> v1:172.21.15.80:6789/0 conn(0x7f773406dd20 legacy=0x7f77340ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.136+0000 7f773935d640 1 -- 172.21.15.5:0/926137779 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77340b3060 con 0x7f7734156250 2024-04-25T08:59:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.137+0000 7f773935d640 1 --2- 172.21.15.5:0/926137779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7734156250 0x7f77340b44c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f773406d750 tx=0x7f773002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d7350dbe5d3c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.137+0000 7f772bfff640 1 -- 172.21.15.5:0/926137779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730037070 con 0x7f7734156250 2024-04-25T08:59:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.137+0000 7f772bfff640 1 -- 172.21.15.5:0/926137779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730032440 con 0x7f7734156250 2024-04-25T08:59:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.137+0000 7f772bfff640 1 -- 172.21.15.5:0/926137779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730032810 con 0x7f7734156250 2024-04-25T08:59:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 -- 172.21.15.5:0/926137779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7734156250 msgr2=0x7f77340b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 --2- 172.21.15.5:0/926137779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7734156250 0x7f77340b44c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f773406d750 tx=0x7f773002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 -- 172.21.15.5:0/926137779 shutdown_connections 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 --2- 172.21.15.5:0/926137779 >> v2:172.21.15.80:3300/0 conn(0x7f77340aeda0 0x7f773415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 --2- 172.21.15.5:0/926137779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7734156250 0x7f77340b44c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 -- 172.21.15.5:0/926137779 >> 172.21.15.5:0/926137779 conn(0x7f77340668f0 msgr2=0x7f7734066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 -- 172.21.15.5:0/926137779 shutdown_connections 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.138+0000 7f773b5c1640 1 -- 172.21.15.5:0/926137779 wait complete. 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.139+0000 7f773b5c1640 1 Processor -- start 2024-04-25T08:59:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.139+0000 7f773b5c1640 1 -- start start 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773b5c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77340aeda0 0x7f7734156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773b5c1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7734156250 0x7f77340b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773b5c1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7734157040 0x7f773414a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773b5c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340b4b80 con 0x7f77340aeda0 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773b5c1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340b4a00 con 0x7f7734157040 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773b5c1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77340b3860 con 0x7f7734156250 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77340aeda0 0x7f7734156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77340aeda0 0x7f7734156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43134/0 (socket says 172.21.15.5:43134) 2024-04-25T08:59:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 -- 172.21.15.5:0/2882426126 learned_addr learned my addr 172.21.15.5:0/2882426126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f7739b5e640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7734157040 0x7f773414a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 -- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7734156250 msgr2=0x7f77340b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7734156250 0x7f77340b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 -- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7734157040 msgr2=0x7f773414a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7734157040 0x7f773414a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 -- 172.21.15.5:0/2882426126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734156d60 con 0x7f77340aeda0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.140+0000 7f773935d640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77340aeda0 0x7f7734156630 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f773002a220 tx=0x7f77300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.141+0000 7f7729ffb640 1 -- 172.21.15.5:0/2882426126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730041020 con 0x7f77340aeda0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.141+0000 7f7729ffb640 1 -- 172.21.15.5:0/2882426126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300306c0 con 0x7f77340aeda0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.141+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77341f5b40 con 0x7f77340aeda0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.141+0000 7f7729ffb640 1 -- 172.21.15.5:0/2882426126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730037040 con 0x7f77340aeda0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.141+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77341f5060 con 0x7f77340aeda0 2024-04-25T08:59:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.142+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773404ef20 con 0x7f77340aeda0 2024-04-25T08:59:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.142+0000 7f7729ffb640 1 -- 172.21.15.5:0/2882426126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7730044020 con 0x7f77340aeda0 2024-04-25T08:59:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.143+0000 7f7729ffb640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f771806b500 0x7f771806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.143+0000 7f7729ffb640 1 -- 172.21.15.5:0/2882426126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f77300aa9f0 con 0x7f77340aeda0 2024-04-25T08:59:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.143+0000 7f7738b5c640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f771806b500 0x7f771806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.144+0000 7f7738b5c640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f771806b500 0x7f771806d9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7724000f60 tx=0x7f77240079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.147+0000 7f7729ffb640 1 -- 172.21.15.5:0/2882426126 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f773004b030 con 0x7f77340aeda0 2024-04-25T08:59:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.363+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7734067050 con 0x7f77340aeda0 2024-04-25T08:59:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.364+0000 7f7729ffb640 1 -- 172.21.15.5:0/2882426126 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f7730079830 con 0x7f77340aeda0 2024-04-25T08:59:42.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:42.352 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:36.481771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-25T08:59:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f771806b500 msgr2=0x7f771806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f771806b500 0x7f771806d9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7724000f60 tx=0x7f77240079d0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77340aeda0 msgr2=0x7f7734156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77340aeda0 0x7f7734156630 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f773002a220 tx=0x7f77300046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 shutdown_connections 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f771806b500 0x7f771806d9c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7734157040 0x7f773414a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7734156250 0x7f77340b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 --2- 172.21.15.5:0/2882426126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77340aeda0 0x7f7734156630 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 >> 172.21.15.5:0/2882426126 conn(0x7f77340668f0 msgr2=0x7f773415aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 shutdown_connections 2024-04-25T08:59:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.366+0000 7f773b5c1640 1 -- 172.21.15.5:0/2882426126 wait complete. 2024-04-25T08:59:42.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-04-25T08:59:42.476 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:42.476 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:42.476 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:42.485 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:42.485 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-04-25T08:59:42.485 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-25T08:59:42.485 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-04-25T08:59:42.485 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T08:59:42.485 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-04-25T08:59:42.485 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-25T08:59:42.552 INFO:teuthology.orchestra.run.smithi005.stdout:1099511630188 2024-04-25T08:59:42.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:42.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:59:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.717+0000 7f4300334640 1 Processor -- start 2024-04-25T08:59:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.717+0000 7f4300334640 1 -- start start 2024-04-25T08:59:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f4300334640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80cf790 0x7f42f80cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f4300334640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b3480 0x7f42f80b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f4300334640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f815c0c0 con 0x7f42f815bce0 2024-04-25T08:59:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f4300334640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f806cb10 con 0x7f42f80cf790 2024-04-25T08:59:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f4300334640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8070e90 con 0x7f42f80b3480 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fd8cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80cf790 0x7f42f80cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fe0d0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42f815bce0 0x7f42f806c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42816/0 (socket says 172.21.15.5:42816) 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fe0d0640 1 -- 172.21.15.5:0/2730632840 learned_addr learned my addr 172.21.15.5:0/2730632840 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fe8d1640 1 --2- 172.21.15.5:0/2730632840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b3480 0x7f42f80b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fd8cf640 1 -- 172.21.15.5:0/2730632840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b3480 msgr2=0x7f42f80b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/2730632840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b3480 0x7f42f80b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fd8cf640 1 -- 172.21.15.5:0/2730632840 >> v1:172.21.15.5:6789/0 conn(0x7f42f815bce0 legacy=0x7f42f806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fd8cf640 1 -- 172.21.15.5:0/2730632840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8071170 con 0x7f42f80cf790 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.718+0000 7f42fd0ce640 1 -- 172.21.15.5:0/2730632840 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612417675 0 0) 0x7f42f815c0c0 con 0x7f42f815bce0 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.719+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/2730632840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cf790 0x7f42f80cfc20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4a53536a22909b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.719+0000 7f42fd0ce640 1 -- 172.21.15.5:0/2730632840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8037070 con 0x7f42f80cf790 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.719+0000 7f42fd0ce640 1 -- 172.21.15.5:0/2730632840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8032440 con 0x7f42f80cf790 2024-04-25T08:59:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.719+0000 7f42fd0ce640 1 -- 172.21.15.5:0/2730632840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8032810 con 0x7f42f80cf790 2024-04-25T08:59:42.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.719+0000 7f4300334640 1 -- 172.21.15.5:0/2730632840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cf790 msgr2=0x7f42f80cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.719+0000 7f4300334640 1 --2- 172.21.15.5:0/2730632840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cf790 0x7f42f80cfc20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a180 comp rx=0 tx=0).stop 2024-04-25T08:59:42.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.720+0000 7f4300334640 1 -- 172.21.15.5:0/2730632840 shutdown_connections 2024-04-25T08:59:42.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.720+0000 7f4300334640 1 --2- 172.21.15.5:0/2730632840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b3480 0x7f42f80b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.720+0000 7f4300334640 1 --2- 172.21.15.5:0/2730632840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cf790 0x7f42f80cfc20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.720+0000 7f4300334640 1 -- 172.21.15.5:0/2730632840 >> 172.21.15.5:0/2730632840 conn(0x7f42f80b1550 msgr2=0x7f42f80b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.720+0000 7f4300334640 1 -- 172.21.15.5:0/2730632840 shutdown_connections 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.720+0000 7f4300334640 1 -- 172.21.15.5:0/2730632840 wait complete. 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 Processor -- start 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 -- start start 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f80b3480 0x7f42f8155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cf790 0x7f42f815c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f815bce0 0x7f42f814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80b4140 con 0x7f42f815bce0 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8071730 con 0x7f42f80b3480 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.721+0000 7f4300334640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80b3dd0 con 0x7f42f80cf790 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f815bce0 0x7f42f814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f815bce0 0x7f42f814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43156/0 (socket says 172.21.15.5:43156) 2024-04-25T08:59:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 -- 172.21.15.5:0/3195909679 learned_addr learned my addr 172.21.15.5:0/3195909679 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cf790 0x7f42f815c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f80b3480 0x7f42f8155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 -- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cf790 msgr2=0x7f42f815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cf790 0x7f42f815c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 -- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f80b3480 msgr2=0x7f42f8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f80b3480 0x7f42f8155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 -- 172.21.15.5:0/3195909679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8152370 con 0x7f42f815bce0 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cf790 0x7f42f815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42fe8d1640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f815bce0 0x7f42f814f3b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f42f0007e70 tx=0x7f42f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42eeffd640 1 -- 172.21.15.5:0/3195909679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0014620 con 0x7f42f815bce0 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42eeffd640 1 -- 172.21.15.5:0/3195909679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0019070 con 0x7f42f815bce0 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f42eeffd640 1 -- 172.21.15.5:0/3195909679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0014a20 con 0x7f42f815bce0 2024-04-25T08:59:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f815c600 con 0x7f42f815bce0 2024-04-25T08:59:42.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.722+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f8153540 con 0x7f42f815bce0 2024-04-25T08:59:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.724+0000 7f42eeffd640 1 -- 172.21.15.5:0/3195909679 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42f0014bc0 con 0x7f42f815bce0 2024-04-25T08:59:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.724+0000 7f42eeffd640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42dc06b4d0 0x7f42dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.725+0000 7f42eeffd640 1 -- 172.21.15.5:0/3195909679 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f42f008ab40 con 0x7f42f815bce0 2024-04-25T08:59:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.725+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42dc06b4d0 0x7f42dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.725+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42dc06b4d0 0x7f42dc06d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42f4000f60 tx=0x7f42f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.726+0000 7f4303037740 1 Processor -- start 2024-04-25T08:59:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.726+0000 7f4303037740 1 -- start start 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.726+0000 7f4303037740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20eaa0 0x55f5df2112b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20ee80 0x55f5df2117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df1e1700 0x55f5df1e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f4303037740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5df14ae00 con 0x55f5df20eaa0 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5df0f3d20 con 0x55f5df1e1700 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5df146ea0 con 0x55f5df20ee80 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20eaa0 0x55f5df2112b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20eaa0 0x55f5df2112b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43166/0 (socket says 172.21.15.5:43166) 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 -- 172.21.15.5:0/2064034900 learned_addr learned my addr 172.21.15.5:0/2064034900 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20ee80 0x55f5df2117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe8d1640 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df1e1700 0x55f5df1e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 -- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20ee80 msgr2=0x55f5df2117f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20ee80 0x55f5df2117f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 -- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df1e1700 msgr2=0x55f5df1e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df1e1700 0x55f5df1e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 -- 172.21.15.5:0/2064034900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5df115df0 con 0x55f5df20eaa0 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20eaa0 0x55f5df2112b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f42f4007490 tx=0x7f42f4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6947885409af628 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42dbfff640 1 -- 172.21.15.5:0/2064034900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f400da70 con 0x55f5df20eaa0 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42dbfff640 1 -- 172.21.15.5:0/2064034900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f400dc10 con 0x55f5df20eaa0 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.727+0000 7f42dbfff640 1 -- 172.21.15.5:0/2064034900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4020450 con 0x55f5df20eaa0 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 -- 172.21.15.5:0/2064034900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20eaa0 msgr2=0x55f5df2112b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20eaa0 0x55f5df2112b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f42f4007490 tx=0x7f42f4010000 comp rx=0 tx=0).stop 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 -- 172.21.15.5:0/2064034900 shutdown_connections 2024-04-25T08:59:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df1e1700 0x55f5df1e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20ee80 0x55f5df2117f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 --2- 172.21.15.5:0/2064034900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20eaa0 0x55f5df2112b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 -- 172.21.15.5:0/2064034900 >> 172.21.15.5:0/2064034900 conn(0x55f5df1e3970 msgr2=0x55f5df22c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 -- 172.21.15.5:0/2064034900 shutdown_connections 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.728+0000 7f4303037740 1 -- 172.21.15.5:0/2064034900 wait complete. 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.729+0000 7f4303037740 1 -- start start 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.729+0000 7f4303037740 1 Processor -- start 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df20eaa0 0x55f5df1e6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df212cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df231360 0x55f5df213200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5df1e6b20 con 0x55f5df20ee80 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5df0e9590 con 0x55f5df20eaa0 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5df1e6e00 con 0x55f5df231360 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 10 client.0 _ll_register_callbacks cb 0x55f5df0f5e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df212cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df212cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43170/0 (socket says 172.21.15.5:43170) 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 -- 172.21.15.5:0/268612717 learned_addr learned my addr 172.21.15.5:0/268612717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 -- 172.21.15.5:0/268612717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df231360 msgr2=0x55f5df213200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df231360 0x55f5df213200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 -- 172.21.15.5:0/268612717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df20eaa0 msgr2=0x55f5df1e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df20eaa0 0x55f5df1e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 -- 172.21.15.5:0/268612717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5dee5f3f0 con 0x55f5df20ee80 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df212cc0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979a868fe58b4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42d97fa640 1 -- 172.21.15.5:0/268612717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8037040 con 0x55f5df20ee80 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f42d97fa640 1 -- 172.21.15.5:0/268612717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f42e8046630 con 0x55f5df20ee80 2024-04-25T08:59:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.730+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42f400dc10 con 0x55f5df20ee80 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f42d97fa640 1 -- 172.21.15.5:0/268612717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42e804d050 con 0x55f5df20ee80 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 10 client.6150 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55f5def297d0 con 0x55f5df20ee80 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f42d97fa640 1 -- 172.21.15.5:0/268612717 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f400dc10 con 0x55f5df20ee80 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f42d97fa640 1 -- 172.21.15.5:0/268612717 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f42e8050020 con 0x55f5df20ee80 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 10 client.6150 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 10 client.6150 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 20 client.6150 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df204d80 0x55f5df22d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 4 client.6150 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5df158340 con 0x55f5df204d80 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df204d80 0x55f5df22d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df204d80 0x55f5df22d3e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a85c175fcaba7be server_cookie=5adca1292a40364c in_seq=0 out_seq=0 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.731+0000 7f42d97fa640 10 client.6150 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f42d97fa640 1 -- 172.21.15.5:0/268612717 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f5df158340 con 0x55f5df204d80 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f42d97fa640 10 client.6150 handle_command_reply: tid=0 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 client.6150 shutdown 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 msgr2=0x55f5df212cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df212cc0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e8004730 comp rx=0 tx=0).stop 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 shutdown_connections 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df204d80 0x55f5df22d3e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df231360 0x55f5df213200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df212cc0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f42d97fa640 0 client.6150 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 --2- 172.21.15.5:0/268612717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df20eaa0 0x55f5df1e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 >> 172.21.15.5:0/268612717 conn(0x55f5df1e1700 msgr2=0x55f5df20d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 shutdown_connections 2024-04-25T08:59:42.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 1 -- 172.21.15.5:0/268612717 wait complete. 2024-04-25T08:59:42.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.732+0000 7f4303037740 20 client.6150 trim_cache size 0 max 16384 2024-04-25T08:59:42.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.744+0000 7f4303037740 1 Processor -- start 2024-04-25T08:59:42.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.744+0000 7f4303037740 1 -- start start 2024-04-25T08:59:42.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df20e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f4303037740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df2341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f4303037740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81fdd30 con 0x55f5df20ee80 2024-04-25T08:59:42.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81fd000 con 0x55f5df231360 2024-04-25T08:59:42.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8151760 con 0x55f5df20eaa0 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43182/0 (socket says 172.21.15.5:43182) 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 -- 172.21.15.5:0/1758494824 learned_addr learned my addr 172.21.15.5:0/1758494824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 -- 172.21.15.5:0/1758494824 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 msgr2=0x55f5df20e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/1758494824 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df20e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 -- 172.21.15.5:0/1758494824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 msgr2=0x55f5df2341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/1758494824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df2341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 -- 172.21.15.5:0/1758494824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5df1dd690 con 0x55f5df20ee80 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.745+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/1758494824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233c90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f42e802a6f0 tx=0x7f42e803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0188257f1e55dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f42db7fe640 1 -- 172.21.15.5:0/1758494824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8037070 con 0x55f5df20ee80 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f42db7fe640 1 -- 172.21.15.5:0/1758494824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8046430 con 0x55f5df20ee80 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f42db7fe640 1 -- 172.21.15.5:0/1758494824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8046ac0 con 0x55f5df20ee80 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 -- 172.21.15.5:0/1758494824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 msgr2=0x55f5df233c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 --2- 172.21.15.5:0/1758494824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233c90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f42e802a6f0 tx=0x7f42e803d000 comp rx=0 tx=0).stop 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 -- 172.21.15.5:0/1758494824 shutdown_connections 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 --2- 172.21.15.5:0/1758494824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df2341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 --2- 172.21.15.5:0/1758494824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233c90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 --2- 172.21.15.5:0/1758494824 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df20e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 -- 172.21.15.5:0/1758494824 >> 172.21.15.5:0/1758494824 conn(0x55f5df1e1700 msgr2=0x55f5df1dcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 -- 172.21.15.5:0/1758494824 shutdown_connections 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.746+0000 7f4303037740 1 -- 172.21.15.5:0/1758494824 wait complete. 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.747+0000 7f4303037740 1 -- start start 2024-04-25T08:59:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.747+0000 7f4303037740 1 Processor -- start 2024-04-25T08:59:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df225e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f4303037740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f4303037740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df22db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f4303037740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5df1e7900 con 0x55f5df20ee80 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8151d60 con 0x55f5df231360 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f4303037740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5df0d0d70 con 0x55f5df20eaa0 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f4303037740 10 client.0 _ll_register_callbacks cb 0x7f42f40012f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43196/0 (socket says 172.21.15.5:43196) 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 -- 172.21.15.5:0/3721027416 learned_addr learned my addr 172.21.15.5:0/3721027416 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df225e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fe8d1640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df22db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 -- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 msgr2=0x55f5df225e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df225e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 -- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 msgr2=0x55f5df22db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df22db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 -- 172.21.15.5:0/3721027416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5df297890 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fe8d1640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df22db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df225e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42fd8cf640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233e80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009160 tx=0x7f42e8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e3922ef397071c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.748+0000 7f42d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f42d97fa640 1 -- 172.21.15.5:0/3721027416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8037040 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f42d97fa640 1 -- 172.21.15.5:0/3721027416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f42e8004030 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42e8046430 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f42d97fa640 1 -- 172.21.15.5:0/3721027416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42e8004230 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 10 client.6156 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55f5df2134c0 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f42d97fa640 1 -- 172.21.15.5:0/3721027416 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8046430 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f42d97fa640 1 -- 172.21.15.5:0/3721027416 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f42e8050040 con 0x55f5df20ee80 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 10 client.6156 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 10 client.6156 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 20 client.6156 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df2343c0 0x55f5df22e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 4 client.6156 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f5df152690 con 0x55f5df2343c0 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df2343c0 0x55f5df22e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.749+0000 7f42d97fa640 10 client.6156 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f42fe0d0640 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df2343c0 0x55f5df22e090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fe4395de1560e50 server_cookie=c0e32e14024260e in_seq=0 out_seq=0 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f42d97fa640 1 -- 172.21.15.5:0/3721027416 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f5df152690 con 0x55f5df2343c0 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f42d97fa640 10 client.6156 handle_command_reply: tid=0 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 client.6156 shutdown 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 msgr2=0x55f5df233e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233e80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009160 tx=0x7f42e8009190 comp rx=0 tx=0).stop 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 shutdown_connections 2024-04-25T08:59:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55f5df2343c0 0x55f5df22e090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f5df231360 0x55f5df22db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5df20ee80 0x55f5df233e80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f42d97fa640 0 client.6156 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 --2- 172.21.15.5:0/3721027416 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55f5df20eaa0 0x55f5df225e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 >> 172.21.15.5:0/3721027416 conn(0x55f5df1e1700 msgr2=0x55f5df2304e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 shutdown_connections 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 1 -- 172.21.15.5:0/3721027416 wait complete. 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.750+0000 7f4303037740 20 client.6156 trim_cache size 0 max 16384 2024-04-25T08:59:42.745 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-04-25T08:59:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42dc06b4d0 msgr2=0x7f42dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42dc06b4d0 0x7f42dc06d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42f4000f60 tx=0x7f42f4009040 comp rx=0 tx=0).stop 2024-04-25T08:59:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f815bce0 msgr2=0x7f42f814f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f815bce0 0x7f42f814f3b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f42f0007e70 tx=0x7f42f000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 shutdown_connections 2024-04-25T08:59:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42dc06b4d0 0x7f42dc06d990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f815bce0 0x7f42f814f3b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cf790 0x7f42f815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 --2- 172.21.15.5:0/3195909679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f80b3480 0x7f42f8155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 >> 172.21.15.5:0/3195909679 conn(0x7f42f80b1550 msgr2=0x7f42f80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 shutdown_connections 2024-04-25T08:59:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.751+0000 7f4300334640 1 -- 172.21.15.5:0/3195909679 wait complete. 2024-04-25T08:59:42.749 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096c.00000000 parent 2024-04-25T08:59:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.804+0000 7f74c71b7f40 1 Processor -- start 2024-04-25T08:59:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.804+0000 7f74c71b7f40 1 -- start start 2024-04-25T08:59:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.804+0000 7f74c71b7f40 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048e930 0x55e630490060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.804+0000 7f74c71b7f40 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048ed10 0x55e6305b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c71b7f40 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 0x55e6305b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c71b7f40 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6304785f0 con 0x55e63048ed10 2024-04-25T08:59:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c71b7f40 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e63048f9c0 con 0x55e63048e930 2024-04-25T08:59:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c71b7f40 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e63048df50 con 0x55e6305200c0 2024-04-25T08:59:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048ed10 0x55e6305b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048ed10 0x55e6305b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43206/0 (socket says 172.21.15.5:43206) 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 -- 172.21.15.5:0/1072061721 learned_addr learned my addr 172.21.15.5:0/1072061721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c4cba640 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048e930 0x55e630490060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c54bb640 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 0x55e6305b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 -- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 msgr2=0x55e6305b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 0x55e6305b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 -- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048e930 msgr2=0x55e630490060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048e930 0x55e630490060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 -- 172.21.15.5:0/1072061721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e630389de0 con 0x55e63048ed10 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c44b9640 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048ed10 0x55e6305b2a10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f74ac025ca0 tx=0x7f74ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c5d7a09e8ad039 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c34b7640 1 -- 172.21.15.5:0/1072061721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac062070 con 0x55e63048ed10 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c34b7640 1 -- 172.21.15.5:0/1072061721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac054970 con 0x55e63048ed10 2024-04-25T08:59:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.805+0000 7f74c34b7640 1 -- 172.21.15.5:0/1072061721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac054d20 con 0x55e63048ed10 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 -- 172.21.15.5:0/1072061721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048ed10 msgr2=0x55e6305b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048ed10 0x55e6305b2a10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f74ac025ca0 tx=0x7f74ac051000 comp rx=0 tx=0).stop 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 -- 172.21.15.5:0/1072061721 shutdown_connections 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 0x55e6305b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048ed10 0x55e6305b2a10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/1072061721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048e930 0x55e630490060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 -- 172.21.15.5:0/1072061721 >> 172.21.15.5:0/1072061721 conn(0x55e63044a9d0 msgr2=0x55e630473d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 -- 172.21.15.5:0/1072061721 shutdown_connections 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 -- 172.21.15.5:0/1072061721 wait complete. 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 Processor -- start 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.806+0000 7f74c71b7f40 1 -- start start 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c71b7f40 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048e930 0x55e63051c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c71b7f40 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048ed10 0x55e630473d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c71b7f40 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 0x55e6304742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c71b7f40 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e630491a70 con 0x55e63048e930 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c71b7f40 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6304917d0 con 0x55e63048ed10 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c71b7f40 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e630518140 con 0x55e6305200c0 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048e930 0x55e63051c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048e930 0x55e63051c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43222/0 (socket says 172.21.15.5:43222) 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 -- 172.21.15.5:0/711118183 learned_addr learned my addr 172.21.15.5:0/711118183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 -- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 msgr2=0x55e6304742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c54bb640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 0x55e6304742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c44b9640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048ed10 0x55e630473d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e6305200c0 0x55e6304742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 -- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048ed10 msgr2=0x55e630473d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e63048ed10 0x55e630473d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.807+0000 7f74c4cba640 1 -- 172.21.15.5:0/711118183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e630375c50 con 0x55e63048e930 2024-04-25T08:59:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.808+0000 7f74c4cba640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048e930 0x55e63051c490 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f74b400f5f0 tx=0x7f74b400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.808+0000 7f74c24b5640 1 -- 172.21.15.5:0/711118183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4017070 con 0x55e63048e930 2024-04-25T08:59:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.808+0000 7f74c24b5640 1 -- 172.21.15.5:0/711118183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4013700 con 0x55e63048e930 2024-04-25T08:59:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.808+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e63051cf50 con 0x55e63048e930 2024-04-25T08:59:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.808+0000 7f74c24b5640 1 -- 172.21.15.5:0/711118183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4013ad0 con 0x55e63048e930 2024-04-25T08:59:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.808+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e63051e940 con 0x55e63048e930 2024-04-25T08:59:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.809+0000 7f74c24b5640 1 -- 172.21.15.5:0/711118183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74b401a070 con 0x55e63048e930 2024-04-25T08:59:42.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.809+0000 7f74c24b5640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74a4069ee0 0x7f74a406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.810+0000 7f74c24b5640 1 -- 172.21.15.5:0/711118183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f74b40892d0 con 0x55e63048e930 2024-04-25T08:59:42.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.810+0000 7f74c44b9640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74a4069ee0 0x7f74a406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.810+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x55e6305b7630 0x55e6305c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.810+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 --> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] -- osd_op(unknown.0.0:1 7.2b 7:d716f75e:::1000000096c.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v9 -- 0x55e6305c25b0 con 0x55e6305b7630 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.810+0000 7f74c54bb640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x55e6305b7630 0x55e6305c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.810+0000 7f74c44b9640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74a4069ee0 0x7f74a406c3a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f74ac066000 tx=0x7f74ac053000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.810+0000 7f74c54bb640 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x55e6305b7630 0x55e6305c2070 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.811+0000 7f74c54bb640 1 -- 172.21.15.5:0/711118183 <== osd.3 v2:172.21.15.5:6808/2008289449 1 ==== osd_op_reply(1 1000000096c.00000000 [rmxattr] v46'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f74bc009740 con 0x55e6305b7630 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x55e6305b7630 msgr2=0x55e6305c2070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x55e6305b7630 0x55e6305c2070 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74a4069ee0 msgr2=0x7f74a406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74a4069ee0 0x7f74a406c3a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f74ac066000 tx=0x7f74ac053000 comp rx=0 tx=0).stop 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048e930 msgr2=0x55e63051c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 --2- 172.21.15.5:0/711118183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e63048e930 0x55e63051c490 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f74b400f5f0 tx=0x7f74b400fab0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c54bb640 1 -- 172.21.15.5:0/711118183 reap_dead start 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 shutdown_connections 2024-04-25T08:59:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 >> 172.21.15.5:0/711118183 conn(0x55e63044a9d0 msgr2=0x55e6304468c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 shutdown_connections 2024-04-25T08:59:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.812+0000 7f74c71b7f40 1 -- 172.21.15.5:0/711118183 wait complete. 2024-04-25T08:59:42.805 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-04-25T08:59:42.805 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:42.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-04-25T08:59:42.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.958+0000 7fcfebbc8640 1 Processor -- start 2024-04-25T08:59:42.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.958+0000 7fcfebbc8640 1 -- start start 2024-04-25T08:59:42.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfebbc8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40b72b0 0x7fcfe40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfebbc8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcfe40d0d20 0x7fcfe40ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfebbc8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfe40ce6e0 0x7fcfe406b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfebbc8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40cc010 con 0x7fcfe40ce6e0 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfebbc8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40cc2f0 con 0x7fcfe40d0d20 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfebbc8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40cc5d0 con 0x7fcfe40b72b0 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfea165640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfe40ce6e0 0x7fcfe406b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfea165640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfe40ce6e0 0x7fcfe406b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43236/0 (socket says 172.21.15.5:43236) 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.959+0000 7fcfea165640 1 -- 172.21.15.5:0/3936858126 learned_addr learned my addr 172.21.15.5:0/3936858126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfe9964640 1 --2- 172.21.15.5:0/3936858126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40b72b0 0x7fcfe40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfe9163640 1 --2- 172.21.15.5:0/3936858126 >> v2:172.21.15.80:3300/0 conn(0x7fcfe40d0d20 0x7fcfe40ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfea165640 1 -- 172.21.15.5:0/3936858126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40b72b0 msgr2=0x7fcfe40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfea165640 1 --2- 172.21.15.5:0/3936858126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40b72b0 0x7fcfe40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfea165640 1 -- 172.21.15.5:0/3936858126 >> v2:172.21.15.80:3300/0 conn(0x7fcfe40d0d20 msgr2=0x7fcfe40ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfea165640 1 --2- 172.21.15.5:0/3936858126 >> v2:172.21.15.80:3300/0 conn(0x7fcfe40d0d20 0x7fcfe40ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfea165640 1 -- 172.21.15.5:0/3936858126 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40cc8b0 con 0x7fcfe40ce6e0 2024-04-25T08:59:42.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfe9163640 1 --2- 172.21.15.5:0/3936858126 >> v2:172.21.15.80:3300/0 conn(0x7fcfe40d0d20 0x7fcfe40ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.960+0000 7fcfea165640 1 --2- 172.21.15.5:0/3936858126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40ce6e0 0x7fcfe406b3b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fcfe406d0a0 tx=0x7fcfe002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04377d0f9d45e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfe8962640 1 -- 172.21.15.5:0/3936858126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0036070 con 0x7fcfe40ce6e0 2024-04-25T08:59:42.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfe8962640 1 -- 172.21.15.5:0/3936858126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0031600 con 0x7fcfe40ce6e0 2024-04-25T08:59:42.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfe8962640 1 -- 172.21.15.5:0/3936858126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00319d0 con 0x7fcfe40ce6e0 2024-04-25T08:59:42.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3936858126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40ce6e0 msgr2=0x7fcfe406b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3936858126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40ce6e0 0x7fcfe406b3b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fcfe406d0a0 tx=0x7fcfe002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3936858126 shutdown_connections 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3936858126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40ce6e0 0x7fcfe406b3b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3936858126 >> v2:172.21.15.80:3300/0 conn(0x7fcfe40d0d20 0x7fcfe40ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3936858126 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40b72b0 0x7fcfe40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3936858126 >> 172.21.15.5:0/3936858126 conn(0x7fcfe40d1920 msgr2=0x7fcfe40d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3936858126 shutdown_connections 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.961+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3936858126 wait complete. 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.962+0000 7fcfebbc8640 1 Processor -- start 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.962+0000 7fcfebbc8640 1 -- start start 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfebbc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe40b72b0 0x7fcfe41f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfebbc8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40ce6e0 0x7fcfe409ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfebbc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40d0d20 0x7fcfe41f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfebbc8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40d1180 con 0x7fcfe40d0d20 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfebbc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40d1550 con 0x7fcfe40b72b0 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfebbc8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40d1300 con 0x7fcfe40ce6e0 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfea165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40d0d20 0x7fcfe41f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfea165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40d0d20 0x7fcfe41f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43244/0 (socket says 172.21.15.5:43244) 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.963+0000 7fcfea165640 1 -- 172.21.15.5:0/3099092640 learned_addr learned my addr 172.21.15.5:0/3099092640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfe9163640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40ce6e0 0x7fcfe409ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfe9964640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe40b72b0 0x7fcfe41f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfea165640 1 -- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40ce6e0 msgr2=0x7fcfe409ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfea165640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40ce6e0 0x7fcfe409ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfea165640 1 -- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe40b72b0 msgr2=0x7fcfe41f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfea165640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe40b72b0 0x7fcfe41f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfea165640 1 -- 172.21.15.5:0/3099092640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40c7100 con 0x7fcfe40d0d20 2024-04-25T08:59:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfe9964640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe40b72b0 0x7fcfe41f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:42.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfea165640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40d0d20 0x7fcfe41f30d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009f40 tx=0x7fcfe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3099092640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0041020 con 0x7fcfe40d0d20 2024-04-25T08:59:42.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3099092640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe00077a0 con 0x7fcfe40d0d20 2024-04-25T08:59:42.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe40c73e0 con 0x7fcfe40d0d20 2024-04-25T08:59:42.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3099092640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0036040 con 0x7fcfe40d0d20 2024-04-25T08:59:42.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.964+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe409f1b0 con 0x7fcfe40d0d20 2024-04-25T08:59:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.966+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3099092640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfe0044020 con 0x7fcfe40d0d20 2024-04-25T08:59:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.966+0000 7fcfda7fc640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc806b4d0 0x7fcfc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.966+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3099092640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcfe00aaec0 con 0x7fcfe40d0d20 2024-04-25T08:59:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.967+0000 7fcfe9964640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc806b4d0 0x7fcfc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.967+0000 7fcfe9964640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc806b4d0 0x7fcfc806d990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0099a0 tx=0x7fcfdc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.967+0000 7fcfee9a5740 1 Processor -- start 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.967+0000 7fcfee9a5740 1 -- start start 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfb5360 0x561bddfd57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfbcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddf927c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bddef5ee0 con 0x561bddfbd140 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdde9ec50 con 0x561bddf94360 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bddef1f80 con 0x561bddfb5360 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddf927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddf927c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43256/0 (socket says 172.21.15.5:43256) 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 -- 172.21.15.5:0/145590591 learned_addr learned my addr 172.21.15.5:0/145590591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfe9964640 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfb5360 0x561bddfd57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfe9163640 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfbcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 -- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfb5360 msgr2=0x561bddfd57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfb5360 0x561bddfd57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 -- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 msgr2=0x561bddfbcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfbcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfea165640 1 -- 172.21.15.5:0/145590591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bddcd6c00 con 0x561bddfbd140 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.968+0000 7fcfe9163640 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfbcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfea165640 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddf927c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034040 tx=0x7fcfe0079010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a0bed7d65cb23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfc77fe640 1 -- 172.21.15.5:0/145590591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00a7070 con 0x561bddfbd140 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfc77fe640 1 -- 172.21.15.5:0/145590591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0079db0 con 0x561bddfbd140 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfc77fe640 1 -- 172.21.15.5:0/145590591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00796b0 con 0x561bddfbd140 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 -- 172.21.15.5:0/145590591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 msgr2=0x561bddf927c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddf927c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034040 tx=0x7fcfe0079010 comp rx=0 tx=0).stop 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 -- 172.21.15.5:0/145590591 shutdown_connections 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddf927c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfbcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/145590591 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfb5360 0x561bddfd57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 -- 172.21.15.5:0/145590591 >> 172.21.15.5:0/145590591 conn(0x561bddf59810 msgr2=0x561bddfd7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.969+0000 7fcfee9a5740 1 -- 172.21.15.5:0/145590591 shutdown_connections 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.970+0000 7fcfee9a5740 1 -- 172.21.15.5:0/145590591 wait complete. 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.970+0000 7fcfee9a5740 1 -- start start 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.970+0000 7fcfee9a5740 1 Processor -- start 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfcff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddfbfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddfc0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdde9ec50 con 0x561bddfb5360 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bdde94340 con 0x561bddf94360 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bddef5ee0 con 0x561bddfbd140 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfee9a5740 10 client.0 _ll_register_callbacks cb 0x561bddc09fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddfbfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddfbfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43272/0 (socket says 172.21.15.5:43272) 2024-04-25T08:59:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 -- 172.21.15.5:0/1905866776 learned_addr learned my addr 172.21.15.5:0/1905866776 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9964640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfcff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfea165640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddfc0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 -- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 msgr2=0x561bddfc0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddfc0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 -- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 msgr2=0x561bddfcff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfcff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9163640 1 -- 172.21.15.5:0/1905866776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bddbca4f0 con 0x561bddfb5360 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfe9964640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfcff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.971+0000 7fcfea165640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddfc0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfe9163640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddfbfff0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b6760 tx=0x7fcfd40109e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ea65a2bbc4d8d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1905866776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4004020 con 0x561bddfb5360 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1905866776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcfd40041c0 con 0x561bddfb5360 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfe0079db0 con 0x561bddfb5360 2024-04-25T08:59:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1905866776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfd4023050 con 0x561bddfb5360 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 10 client.6177 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561bddd37390 con 0x561bddfb5360 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1905866776 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0079db0 con 0x561bddfb5360 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1905866776 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcfd4026020 con 0x561bddfb5360 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 10 client.6177 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 10 client.6177 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 20 client.6177 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfcf160 0x561bddfcf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 4 client.6177 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bddf03420 con 0x561bddfcf160 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.972+0000 7fcfe9964640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfcf160 0x561bddfcf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfc4ff9640 10 client.6177 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfe9964640 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfcf160 0x561bddfcf540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=194bb94a0fb4c8fd server_cookie=fa8715db8b3f7710 in_seq=0 out_seq=0 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1905866776 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561bddf03420 con 0x561bddfcf160 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfc4ff9640 10 client.6177 handle_command_reply: tid=0 2024-04-25T08:59:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 client.6177 shutdown 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 msgr2=0x561bddfbfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddfbfff0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b6760 tx=0x7fcfd40109e0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 shutdown_connections 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfcf160 0x561bddfcf540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddfc0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddfbfff0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfc4ff9640 0 client.6177 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1905866776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddfcff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.973+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 >> 172.21.15.5:0/1905866776 conn(0x561bddf59810 msgr2=0x561bddf91b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.974+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 shutdown_connections 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.974+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1905866776 wait complete. 2024-04-25T08:59:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.974+0000 7fcfee9a5740 20 client.6177 trim_cache size 0 max 16384 2024-04-25T08:59:42.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 Processor -- start 2024-04-25T08:59:42.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 -- start start 2024-04-25T08:59:42.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddf90770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddf90cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddf92310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4200100 con 0x561bddfb5360 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe41ff310 con 0x561bddf94360 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.989+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40c6000 con 0x561bddfbd140 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddf90cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddf90cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43288/0 (socket says 172.21.15.5:43288) 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 -- 172.21.15.5:0/61483918 learned_addr learned my addr 172.21.15.5:0/61483918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfea165640 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddf92310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9964640 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddf90770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 -- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 msgr2=0x561bddf92310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddf92310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 -- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 msgr2=0x561bddf90770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddf90770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 -- 172.21.15.5:0/61483918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bddba3670 con 0x561bddfb5360 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfe9163640 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddf90cb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4001eb0 tx=0x7fcfd4010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9479da2b460c55c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfc6ffd640 1 -- 172.21.15.5:0/61483918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4014ac0 con 0x561bddfb5360 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfc6ffd640 1 -- 172.21.15.5:0/61483918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd402c070 con 0x561bddfb5360 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.990+0000 7fcfc6ffd640 1 -- 172.21.15.5:0/61483918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd401c400 con 0x561bddfb5360 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 -- 172.21.15.5:0/61483918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 msgr2=0x561bddf90cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddf90cb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4001eb0 tx=0x7fcfd4010f90 comp rx=0 tx=0).stop 2024-04-25T08:59:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 -- 172.21.15.5:0/61483918 shutdown_connections 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddfbd140 0x561bddf92310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfb5360 0x561bddf90cb0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/61483918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddf94360 0x561bddf90770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 -- 172.21.15.5:0/61483918 >> 172.21.15.5:0/61483918 conn(0x561bddf59810 msgr2=0x561bddfe8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 -- 172.21.15.5:0/61483918 shutdown_connections 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 -- 172.21.15.5:0/61483918 wait complete. 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 -- start start 2024-04-25T08:59:42.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.991+0000 7fcfee9a5740 1 Processor -- start 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.992+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddf94360 0x561bddfbab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.992+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddfb5360 0x561bddfbb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.992+0000 7fcfee9a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddfbe3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.992+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe409c220 con 0x561bddfbd140 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.992+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bddf03420 con 0x561bddfb5360 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.992+0000 7fcfee9a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bde042a50 con 0x561bddf94360 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.992+0000 7fcfee9a5740 10 client.0 _ll_register_callbacks cb 0x7fcfe00092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddfbe3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddfbe3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43300/0 (socket says 172.21.15.5:43300) 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 -- 172.21.15.5:0/1836585525 learned_addr learned my addr 172.21.15.5:0/1836585525 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfe9964640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddf94360 0x561bddfbab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfe9163640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddfb5360 0x561bddfbb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 -- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddf94360 msgr2=0x561bddfbab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddf94360 0x561bddfbab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 -- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddfb5360 msgr2=0x561bddfbb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddfb5360 0x561bddfbb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 -- 172.21.15.5:0/1836585525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bddfcd8d0 con 0x561bddfbd140 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfe9163640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddfb5360 0x561bddfbb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfea165640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddfbe3d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009c90 tx=0x7fcfe0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1768372c185bd061 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1836585525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe009d060 con 0x561bddfbd140 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1836585525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcfe0007b90 con 0x561bddfbd140 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfd402c070 con 0x561bddfbd140 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1836585525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfe00a7040 con 0x561bddfbd140 2024-04-25T08:59:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfee9a5740 10 client.6183 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561bddffa480 con 0x561bddfbd140 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.993+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1836585525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd402c070 con 0x561bddfbd140 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1836585525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcfe0078b00 con 0x561bddfbd140 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfee9a5740 10 client.6183 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfee9a5740 10 client.6183 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfee9a5740 20 client.6183 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfb95a0 0x561bddfbe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfee9a5740 4 client.6183 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) v1 -- 0x561bddfba280 con 0x561bddfb95a0 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfe9964640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfb95a0 0x561bddfbe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfc4ff9640 10 client.6183 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfe9964640 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfb95a0 0x561bddfbe910 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90cb5899e92212e server_cookie=e058878ba6f74915 in_seq=0 out_seq=0 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfc4ff9640 1 -- 172.21.15.5:0/1836585525 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561bddfba280 con 0x561bddfb95a0 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfc4ff9640 10 client.6183 handle_command_reply: tid=0 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.994+0000 7fcfee9a5740 1 client.6183 shutdown 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 msgr2=0x561bddfbe3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddfbe3d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009c90 tx=0x7fcfe0009810 comp rx=0 tx=0).stop 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 shutdown_connections 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x561bddfb95a0 0x561bddfbe910 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bddfbd140 0x561bddfbe3d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561bddfb5360 0x561bddfbb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 --2- 172.21.15.5:0/1836585525 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561bddf94360 0x561bddfbab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 >> 172.21.15.5:0/1836585525 conn(0x561bddf59810 msgr2=0x561bddf90700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfc4ff9640 0 client.6183 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:42.990 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-04-25T08:59:42.995+0000 7f6f4a360640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096c [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v471 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5123=0-4194304@1} caps={5123=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5123 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55f7be8c3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1000000096c:[<0x10000000001/new_file_1 v471>,<0x10000000000/ceph-qa-suite v55>,<0x1/scrub_test_path v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-04-25T08:59:42.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 shutdown_connections 2024-04-25T08:59:42.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 1 -- 172.21.15.5:0/1836585525 wait complete. 2024-04-25T08:59:42.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfee9a5740 20 client.6183 trim_cache size 0 max 16384 2024-04-25T08:59:42.991 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:42.992 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T08:59:42.992 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "9d630bf5-b545-4e41-bc93-0f9506775db3", 2024-04-25T08:59:42.992 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T08:59:42.992 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc806b4d0 msgr2=0x7fcfc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc806b4d0 0x7fcfc806d990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0099a0 tx=0x7fcfdc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40d0d20 msgr2=0x7fcfe41f30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40d0d20 0x7fcfe41f30d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009f40 tx=0x7fcfe0004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 shutdown_connections 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc806b4d0 0x7fcfc806d990 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe40d0d20 0x7fcfe41f30d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfe40ce6e0 0x7fcfe409ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 --2- 172.21.15.5:0/3099092640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe40b72b0 0x7fcfe41f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.995+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 >> 172.21.15.5:0/3099092640 conn(0x7fcfe40d1920 msgr2=0x7fcfe40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.996+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 shutdown_connections 2024-04-25T08:59:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:42.996+0000 7fcfebbc8640 1 -- 172.21.15.5:0/3099092640 wait complete. 2024-04-25T08:59:42.995 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '9d630bf5-b545-4e41-bc93-0f9506775db3', 'mode': 'asynchronous'}' 2024-04-25T08:59:42.995 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:59:42.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:59:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.108+0000 7fcac4a9e640 1 Processor -- start 2024-04-25T08:59:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcac4a9e640 1 -- start start 2024-04-25T08:59:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcac4a9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcac015df10 0x7fcac01618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcac4a9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcac00b6250 0x7fcac00ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcac4a9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac0162150 con 0x7fcac00cee10 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcac4a9e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac00cf260 con 0x7fcac015df10 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcac4a9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac00d20d0 con 0x7fcac00b6250 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcabe59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcac015df10 0x7fcac01618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcabe59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcac015df10 0x7fcac01618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43314/0 (socket says 172.21.15.5:43314) 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.109+0000 7fcabe59c640 1 -- 172.21.15.5:0/617519642 learned_addr learned my addr 172.21.15.5:0/617519642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.110+0000 7fcab7fff640 1 --2- 172.21.15.5:0/617519642 >> v2:172.21.15.80:3300/0 conn(0x7fcac00b6250 0x7fcac00ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.110+0000 7fcabe59c640 1 -- 172.21.15.5:0/617519642 >> v2:172.21.15.80:3300/0 conn(0x7fcac00b6250 msgr2=0x7fcac00ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.110+0000 7fcabe59c640 1 --2- 172.21.15.5:0/617519642 >> v2:172.21.15.80:3300/0 conn(0x7fcac00b6250 0x7fcac00ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.110+0000 7fcabe59c640 1 -- 172.21.15.5:0/617519642 >> v1:172.21.15.80:6789/0 conn(0x7fcac00cee10 legacy=0x7fcac00d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.110+0000 7fcabe59c640 1 -- 172.21.15.5:0/617519642 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0162430 con 0x7fcac015df10 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.110+0000 7fcab7fff640 1 --2- 172.21.15.5:0/617519642 >> v2:172.21.15.80:3300/0 conn(0x7fcac00b6250 0x7fcac00ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.110+0000 7fcabe59c640 1 --2- 172.21.15.5:0/617519642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac015df10 0x7fcac01618d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcac00b9d70 tx=0x7fcab002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8db0f3628585ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcabdd9b640 1 -- 172.21.15.5:0/617519642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0037070 con 0x7fcac015df10 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcabdd9b640 1 -- 172.21.15.5:0/617519642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab0032440 con 0x7fcac015df10 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcabdd9b640 1 -- 172.21.15.5:0/617519642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0032810 con 0x7fcac015df10 2024-04-25T08:59:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 -- 172.21.15.5:0/617519642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac015df10 msgr2=0x7fcac01618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/617519642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac015df10 0x7fcac01618d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcac00b9d70 tx=0x7fcab002a230 comp rx=0 tx=0).stop 2024-04-25T08:59:43.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 -- 172.21.15.5:0/617519642 shutdown_connections 2024-04-25T08:59:43.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/617519642 >> v2:172.21.15.80:3300/0 conn(0x7fcac00b6250 0x7fcac00ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/617519642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac015df10 0x7fcac01618d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 -- 172.21.15.5:0/617519642 >> 172.21.15.5:0/617519642 conn(0x7fcac00668f0 msgr2=0x7fcac0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:43.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 -- 172.21.15.5:0/617519642 shutdown_connections 2024-04-25T08:59:43.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.111+0000 7fcac4a9e640 1 -- 172.21.15.5:0/617519642 wait complete. 2024-04-25T08:59:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 Processor -- start 2024-04-25T08:59:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 -- start start 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00b6250 0x7fcac01e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac00cee10 0x7fcac0151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcac015df10 0x7fcac0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0161e10 con 0x7fcac00cee10 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00d1d60 con 0x7fcac00b6250 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcac4a9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00d3570 con 0x7fcac015df10 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.113+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac00cee10 0x7fcac0151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac00cee10 0x7fcac0151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43320/0 (socket says 172.21.15.5:43320) 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 -- 172.21.15.5:0/3544544751 learned_addr learned my addr 172.21.15.5:0/3544544751 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00b6250 0x7fcac01e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcabed9d640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcac015df10 0x7fcac0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 -- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcac015df10 msgr2=0x7fcac0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcac015df10 0x7fcac0151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 -- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00b6250 msgr2=0x7fcac01e7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00b6250 0x7fcac01e7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 -- 172.21.15.5:0/3544544751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00cdd70 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab7fff640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac00cee10 0x7fcac0151790 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800c7f0 tx=0x7fcaa800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab6ffd640 1 -- 172.21.15.5:0/3544544751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8015070 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab6ffd640 1 -- 172.21.15.5:0/3544544751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80079d0 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcab6ffd640 1 -- 172.21.15.5:0/3544544751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8007da0 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac01603f0 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.114+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac01609b0 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.116+0000 7fcab6ffd640 1 -- 172.21.15.5:0/3544544751 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcaa8018070 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.116+0000 7fcab6ffd640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaa006b4d0 0x7fcaa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.116+0000 7fcab6ffd640 1 -- 172.21.15.5:0/3544544751 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcaa808a040 con 0x7fcac00cee10 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.116+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaa006b4d0 0x7fcaa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.117+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaa006b4d0 0x7fcaa006d990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcab0034000 tx=0x7fcab002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.117+0000 7fcac77a5740 1 Processor -- start 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.117+0000 7fcac77a5740 1 -- start start 2024-04-25T08:59:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c2e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c2e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1bfe770 0x55c0d1c01f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcac77a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1b67da0 con 0x55c0d1c2bef0 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1b10b80 con 0x55c0d1bfe770 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1b63e40 con 0x55c0d1c2bb10 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c2e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcabe59c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c2e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c2e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43336/0 (socket says 172.21.15.5:43336) 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcab7fff640 1 -- 172.21.15.5:0/1836773301 learned_addr learned my addr 172.21.15.5:0/1836773301 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.118+0000 7fcabed9d640 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1bfe770 0x55c0d1c01f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcab7fff640 1 -- 172.21.15.5:0/1836773301 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 msgr2=0x55c0d1c2e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcab7fff640 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c2e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcab7fff640 1 -- 172.21.15.5:0/1836773301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1bfe770 msgr2=0x55c0d1c01f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcab7fff640 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1bfe770 0x55c0d1c01f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcab7fff640 1 -- 172.21.15.5:0/1836773301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0d1b1af10 con 0x55c0d1c2bef0 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcab7fff640 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c2e860 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80609f0 tx=0x7fcaa8058980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86885b062a00b746 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fca9ffff640 1 -- 172.21.15.5:0/1836773301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa801f040 con 0x55c0d1c2bef0 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fca9ffff640 1 -- 172.21.15.5:0/1836773301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa8056bc0 con 0x55c0d1c2bef0 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fca9ffff640 1 -- 172.21.15.5:0/1836773301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80701c0 con 0x55c0d1c2bef0 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcac77a5740 1 -- 172.21.15.5:0/1836773301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 msgr2=0x55c0d1c2e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c2e860 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80609f0 tx=0x7fcaa8058980 comp rx=0 tx=0).stop 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcac77a5740 1 -- 172.21.15.5:0/1836773301 shutdown_connections 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1bfe770 0x55c0d1c01f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c2e860 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.119+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1836773301 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c2e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.120+0000 7fcac77a5740 1 -- 172.21.15.5:0/1836773301 >> 172.21.15.5:0/1836773301 conn(0x55c0d1c009e0 msgr2=0x55c0d1c49320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:43.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.120+0000 7fcac77a5740 1 -- 172.21.15.5:0/1836773301 shutdown_connections 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.120+0000 7fcac77a5740 1 -- 172.21.15.5:0/1836773301 wait complete. 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.120+0000 7fcac77a5740 1 -- start start 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.120+0000 7fcac77a5740 1 Processor -- start 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bb10 0x55c0d1c4d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bef0 0x55c0d1c22400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1c28340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcac77a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1c03b90 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1b064b0 con 0x55c0d1c2bb10 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1c03e70 con 0x55c0d1c2bef0 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcac77a5740 10 client.0 _ll_register_callbacks cb 0x55c0d1b46180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcabed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1c28340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcabed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1c28340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43344/0 (socket says 172.21.15.5:43344) 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcabed9d640 1 -- 172.21.15.5:0/3324548736 learned_addr learned my addr 172.21.15.5:0/3324548736 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bb10 0x55c0d1c4d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.121+0000 7fcab7fff640 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bef0 0x55c0d1c22400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcabed9d640 1 -- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bef0 msgr2=0x55c0d1c22400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcabed9d640 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bef0 0x55c0d1c22400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcabed9d640 1 -- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bb10 msgr2=0x55c0d1c4d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcabed9d640 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bb10 0x55c0d1c4d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcabed9d640 1 -- 172.21.15.5:0/3324548736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0d19467d0 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcabed9d640 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1c28340 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcab8012910 tx=0x7fcab8012d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19075b17ffbdf843 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fca9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3324548736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8019020 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3324548736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcab8003b80 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaa8056bc0 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3324548736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab8023050 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 10 client.6195 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55c0d187c3f0 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3324548736 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa8056bc0 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3324548736 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcab8026020 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 10 client.6195 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 10 client.6195 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 20 client.6195 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c2ec30 0x55c0d1bff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 4 client.6195 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.122+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0d1b752e0 con 0x55c0d1c2ec30 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.123+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c2ec30 0x55c0d1bff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.123+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c2ec30 0x55c0d1bff8d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6600c6ae61e6292b server_cookie=184ba91b3d684f06 in_seq=0 out_seq=0 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.123+0000 7fca9d7fa640 10 client.6195 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.123+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3324548736 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c0d1b752e0 con 0x55c0d1c2ec30 2024-04-25T08:59:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.123+0000 7fca9d7fa640 10 client.6195 handle_command_reply: tid=0 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.123+0000 7fcac77a5740 1 client.6195 shutdown 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 msgr2=0x55c0d1c28340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1c28340 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcab8012910 tx=0x7fcab8012d10 comp rx=0 tx=0).stop 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 shutdown_connections 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c2ec30 0x55c0d1bff8d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1c28340 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bef0 0x55c0d1c22400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3324548736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bb10 0x55c0d1c4d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fca9d7fa640 0 client.6195 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 >> 172.21.15.5:0/3324548736 conn(0x55c0d1bfe770 msgr2=0x55c0d1c2adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 shutdown_connections 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 1 -- 172.21.15.5:0/3324548736 wait complete. 2024-04-25T08:59:43.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.124+0000 7fcac77a5740 20 client.6195 trim_cache size 0 max 16384 2024-04-25T08:59:43.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 Processor -- start 2024-04-25T08:59:43.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 -- start start 2024-04-25T08:59:43.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c49740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1bfd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1bfdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac01ffeb0 con 0x55c0d1c2bef0 2024-04-25T08:59:43.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cd970 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.139+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac015fc80 con 0x55c0d1c2bb10 2024-04-25T08:59:43.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1bfd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1bfd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43346/0 (socket says 172.21.15.5:43346) 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 -- 172.21.15.5:0/1184454263 learned_addr learned my addr 172.21.15.5:0/1184454263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcabe59c640 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c49740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcabed9d640 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1bfdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 -- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 msgr2=0x55c0d1c49740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c49740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 -- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2e7b0 msgr2=0x55c0d1bfdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1bfdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 -- 172.21.15.5:0/1184454263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0d183c0f0 con 0x55c0d1c2bef0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fcab7fff640 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1bfd600 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80609f0 tx=0x7fcaa801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ce47af525040b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fca9f7fe640 1 -- 172.21.15.5:0/1184454263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa801f040 con 0x55c0d1c2bef0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fca9f7fe640 1 -- 172.21.15.5:0/1184454263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80881e0 con 0x55c0d1c2bef0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.140+0000 7fca9f7fe640 1 -- 172.21.15.5:0/1184454263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80701c0 con 0x55c0d1c2bef0 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 -- 172.21.15.5:0/1184454263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 msgr2=0x55c0d1bfd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1bfd600 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80609f0 tx=0x7fcaa801c000 comp rx=0 tx=0).stop 2024-04-25T08:59:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 -- 172.21.15.5:0/1184454263 shutdown_connections 2024-04-25T08:59:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1bfdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2bef0 0x55c0d1bfd600 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 --2- 172.21.15.5:0/1184454263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c49740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 -- 172.21.15.5:0/1184454263 >> 172.21.15.5:0/1184454263 conn(0x55c0d1bfe770 msgr2=0x55c0d1c2ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 -- 172.21.15.5:0/1184454263 shutdown_connections 2024-04-25T08:59:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 -- 172.21.15.5:0/1184454263 wait complete. 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 -- start start 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.141+0000 7fcac77a5740 1 Processor -- start 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c20870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c22210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcac77a5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1cb6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcac77a5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cd370 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1c21100 con 0x55c0d1c2bef0 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcac77a5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0d1c26030 con 0x55c0d1c2bb10 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcac77a5740 10 client.0 _ll_register_callbacks cb 0x7fcab80014a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcabed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1cb6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcabed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1cb6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43352/0 (socket says 172.21.15.5:43352) 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.142+0000 7fcabed9d640 1 -- 172.21.15.5:0/3190653243 learned_addr learned my addr 172.21.15.5:0/3190653243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c20870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcab7fff640 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c22210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcabed9d640 1 -- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 msgr2=0x55c0d1c20870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcabed9d640 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c20870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcabed9d640 1 -- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bef0 msgr2=0x55c0d1c22210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcabed9d640 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c22210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcabed9d640 1 -- 172.21.15.5:0/3190653243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0d1c26280 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcabed9d640 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1cb6660 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcab8012910 tx=0x7fcab80013a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62054ced0be7720 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fca9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3190653243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8010610 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3190653243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcab8010a30 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaa80881e0 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3190653243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab8036050 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 10 client.6201 fetch_fsmap learned FSMap version 22 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55c0d1c20e40 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3190653243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80881e0 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3190653243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcab8039020 con 0x55c0d1c2e7b0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 10 client.6201 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 10 client.6201 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 20 client.6201 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c025f0 0x55c0d1c02a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 4 client.6201 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.143+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c0d1b6f630 con 0x55c0d1c025f0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c025f0 0x55c0d1c02a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcabe59c640 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c025f0 0x55c0d1c02a00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2e2776178e6c9 server_cookie=a320c486ec0c56e5 in_seq=0 out_seq=0 2024-04-25T08:59:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fca9d7fa640 10 client.6201 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fca9d7fa640 1 -- 172.21.15.5:0/3190653243 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x55c0d1b6f630 con 0x55c0d1c025f0 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fca9d7fa640 10 client.6201 handle_command_reply: tid=0 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 client.6201 shutdown 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 msgr2=0x55c0d1cb6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1cb6660 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcab8012910 tx=0x7fcab80013a0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 shutdown_connections 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55c0d1c025f0 0x55c0d1c02a00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c0d1c2e7b0 0x55c0d1cb6660 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0d1c2bef0 0x55c0d1c22210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 --2- 172.21.15.5:0/3190653243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55c0d1c2bb10 0x55c0d1c20870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fca9d7fa640 0 client.6201 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 >> 172.21.15.5:0/3190653243 conn(0x55c0d1bfe770 msgr2=0x55c0d1bfd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 shutdown_connections 2024-04-25T08:59:43.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 1 -- 172.21.15.5:0/3190653243 wait complete. 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.144+0000 7fcac77a5740 20 client.6201 trim_cache size 0 max 16384 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: "9d630bf5-b545-4e41-bc93-0f9506775db3": { 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "9d630bf5-b545-4e41-bc93-0f9506775db3", 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:43.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:43.142 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:43.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaa006b4d0 msgr2=0x7fcaa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaa006b4d0 0x7fcaa006d990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcab0034000 tx=0x7fcab002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac00cee10 msgr2=0x7fcac0151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac00cee10 0x7fcac0151790 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800c7f0 tx=0x7fcaa800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 shutdown_connections 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaa006b4d0 0x7fcaa006d990 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcac015df10 0x7fcac0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcac00cee10 0x7fcac0151790 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 --2- 172.21.15.5:0/3544544751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcac00b6250 0x7fcac01e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 >> 172.21.15.5:0/3544544751 conn(0x7fcac00668f0 msgr2=0x7fcac00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 shutdown_connections 2024-04-25T08:59:43.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:43.145+0000 7fcac4a9e640 1 -- 172.21.15.5:0/3544544751 wait complete. 2024-04-25T08:59:46.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:46.703 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:48.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:59:48.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:59:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.272+0000 7f88f16d2640 1 Processor -- start 2024-04-25T08:59:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.272+0000 7f88f16d2640 1 -- start start 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88f16d2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88f16d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88ec15e880 0x7f88ec0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88f16d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec15a720 con 0x7f88ec15a340 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88f16d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0aeef0 con 0x7f88ec15e880 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88f16d2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0af1d0 con 0x7f88ec0b43d0 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88ec15e880 0x7f88ec0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88ec15a340 0x7f88ec0b3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42818/0 (socket says 172.21.15.5:42818) 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88ec15e880 0x7f88ec0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43360/0 (socket says 172.21.15.5:43360) 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eaffd640 1 -- 172.21.15.5:0/2151510255 learned_addr learned my addr 172.21.15.5:0/2151510255 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2151510255 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eb7fe640 1 -- 172.21.15.5:0/2151510255 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 msgr2=0x7f88ec0ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/2151510255 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec0ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eb7fe640 1 -- 172.21.15.5:0/2151510255 >> v1:172.21.15.5:6789/0 conn(0x7f88ec15a340 legacy=0x7f88ec0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88ea7fc640 1 -- 172.21.15.5:0/2151510255 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532957363 0 0) 0x7f88ec15a720 con 0x7f88ec15a340 2024-04-25T08:59:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88eb7fe640 1 -- 172.21.15.5:0/2151510255 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0d0370 con 0x7f88ec15e880 2024-04-25T08:59:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.273+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2151510255 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec0ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.274+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/2151510255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0ceb30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009d90 tx=0x7f88e402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c65b292dfc78855 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.274+0000 7f88ea7fc640 1 -- 172.21.15.5:0/2151510255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4031600 con 0x7f88ec15e880 2024-04-25T08:59:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.274+0000 7f88ea7fc640 1 -- 172.21.15.5:0/2151510255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e40317a0 con 0x7f88ec15e880 2024-04-25T08:59:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.274+0000 7f88ea7fc640 1 -- 172.21.15.5:0/2151510255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4031b70 con 0x7f88ec15e880 2024-04-25T08:59:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 -- 172.21.15.5:0/2151510255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 msgr2=0x7f88ec0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 --2- 172.21.15.5:0/2151510255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0ceb30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009d90 tx=0x7f88e402a5d0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 -- 172.21.15.5:0/2151510255 shutdown_connections 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 --2- 172.21.15.5:0/2151510255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0ceb30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 --2- 172.21.15.5:0/2151510255 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec0ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 -- 172.21.15.5:0/2151510255 >> 172.21.15.5:0/2151510255 conn(0x7f88ec0b1550 msgr2=0x7f88ec0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 -- 172.21.15.5:0/2151510255 shutdown_connections 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.275+0000 7f88f16d2640 1 -- 172.21.15.5:0/2151510255 wait complete. 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.276+0000 7f88f16d2640 1 Processor -- start 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.276+0000 7f88f16d2640 1 -- start start 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88f16d2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88f16d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ec15a340 0x7f88ec0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88f16d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88f16d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec071ed0 con 0x7f88ec15e880 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88f16d2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0703a0 con 0x7f88ec15a340 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88f16d2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec072050 con 0x7f88ec0b43d0 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43368/0 (socket says 172.21.15.5:43368) 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88eb7fe640 1 -- 172.21.15.5:0/265288440 learned_addr learned my addr 172.21.15.5:0/265288440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88e3fff640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ec15a340 0x7f88ec0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88eaffd640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88eb7fe640 1 -- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 msgr2=0x7f88ec14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.277+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec14dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88eb7fe640 1 -- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ec15a340 msgr2=0x7f88ec0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ec15a340 0x7f88ec0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88eb7fe640 1 -- 172.21.15.5:0/265288440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec1500f0 con 0x7f88ec15e880 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0add80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009eb0 tx=0x7f88e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88e37fe640 1 -- 172.21.15.5:0/265288440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e403f070 con 0x7f88ec15e880 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88e37fe640 1 -- 172.21.15.5:0/265288440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4030b60 con 0x7f88ec15e880 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88e37fe640 1 -- 172.21.15.5:0/265288440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4044460 con 0x7f88ec15e880 2024-04-25T08:59:48.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec150390 con 0x7f88ec15e880 2024-04-25T08:59:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.278+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec150950 con 0x7f88ec15e880 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.279+0000 7f88e37fe640 1 -- 172.21.15.5:0/265288440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f88e403b410 con 0x7f88ec15e880 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.280+0000 7f88e37fe640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88cc06b500 0x7f88cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.280+0000 7f88e37fe640 1 -- 172.21.15.5:0/265288440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f88e40ab920 con 0x7f88ec15e880 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.280+0000 7f88eaffd640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88cc06b500 0x7f88cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.281+0000 7f88eaffd640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88cc06b500 0x7f88cc06d9c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88dc000f60 tx=0x7f88dc007b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.281+0000 7f88f43d8740 1 Processor -- start 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.281+0000 7f88f43d8740 1 -- start start 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f24320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f24860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30ef4770 0x560b30ef7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88f43d8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b30e5dda0 con 0x560b30f21b10 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b30e06b80 con 0x560b30f21ef0 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b30e59e40 con 0x560b30ef4770 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f24320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f24320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43380/0 (socket says 172.21.15.5:43380) 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 -- 172.21.15.5:0/4057832599 learned_addr learned my addr 172.21.15.5:0/4057832599 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30ef4770 0x560b30ef7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88e3fff640 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f24860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 -- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30ef4770 msgr2=0x560b30ef7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30ef4770 0x560b30ef7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 -- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 msgr2=0x560b30f24860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f24860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 -- 172.21.15.5:0/4057832599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b30e10f10 con 0x560b30f21b10 2024-04-25T08:59:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.282+0000 7f88eaffd640 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f24320 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f88dc005d80 tx=0x7f88dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e20dcb8269711f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88e0ff9640 1 -- 172.21.15.5:0/4057832599 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc015110 con 0x560b30f21b10 2024-04-25T08:59:48.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88e0ff9640 1 -- 172.21.15.5:0/4057832599 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0159c0 con 0x560b30f21b10 2024-04-25T08:59:48.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88e0ff9640 1 -- 172.21.15.5:0/4057832599 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc015d70 con 0x560b30f21b10 2024-04-25T08:59:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 -- 172.21.15.5:0/4057832599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 msgr2=0x560b30f24320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f24320 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f88dc005d80 tx=0x7f88dc012000 comp rx=0 tx=0).stop 2024-04-25T08:59:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 -- 172.21.15.5:0/4057832599 shutdown_connections 2024-04-25T08:59:48.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30ef4770 0x560b30ef7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f24860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 --2- 172.21.15.5:0/4057832599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f24320 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 -- 172.21.15.5:0/4057832599 >> 172.21.15.5:0/4057832599 conn(0x560b30ef69e0 msgr2=0x560b30f3f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 -- 172.21.15.5:0/4057832599 shutdown_connections 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.283+0000 7f88f43d8740 1 -- 172.21.15.5:0/4057832599 wait complete. 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.284+0000 7f88f43d8740 1 -- start start 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.284+0000 7f88f43d8740 1 Processor -- start 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f40450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f40990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88f43d8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b30ef9b90 con 0x560b30f21b10 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b30dfc4b0 con 0x560b30f21ef0 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b30ef9e70 con 0x560b30f40ed0 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88f43d8740 10 client.0 _ll_register_callbacks cb 0x560b30e3c180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:48.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f40450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f40450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43384/0 (socket says 172.21.15.5:43384) 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 -- 172.21.15.5:0/2344336624 learned_addr learned my addr 172.21.15.5:0/2344336624 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f40990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 -- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 msgr2=0x560b30f525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 -- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 msgr2=0x560b30f40990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f40990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 -- 172.21.15.5:0/2344336624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b30c3c7d0 con 0x560b30f21b10 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f40990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88eaffd640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f40450 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f88dc015810 tx=0x7f88dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32274220963075a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.285+0000 7f88c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2344336624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc015d80 con 0x560b30f21b10 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2344336624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f88dc021450 con 0x560b30f21b10 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88dc0159c0 con 0x560b30f21b10 2024-04-25T08:59:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2344336624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88dc021650 con 0x560b30f21b10 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 10 client.6216 fetch_fsmap learned FSMap version 23 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x560b30b723f0 con 0x560b30f21b10 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2344336624 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0159c0 con 0x560b30f21b10 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2344336624 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f88dc036080 con 0x560b30f21b10 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 10 client.6216 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 10 client.6216 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 20 client.6216 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f52fb0 0x560b30f1e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 4 client.6216 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b30e6b2e0 con 0x560b30f52fb0 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.286+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f52fb0 0x560b30f1e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88c9ffb640 10 client.6216 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f52fb0 0x560b30f1e960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74a929864927944a server_cookie=3517cfef884a637d in_seq=0 out_seq=0 2024-04-25T08:59:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2344336624 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560b30e6b2e0 con 0x560b30f52fb0 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88c9ffb640 10 client.6216 handle_command_reply: tid=0 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 client.6216 shutdown 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 msgr2=0x560b30f40450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f40450 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f88dc015810 tx=0x7f88dc000ed0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 shutdown_connections 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f52fb0 0x560b30f1e960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21ef0 0x560b30f40990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88c9ffb640 0 client.6216 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2344336624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f40450 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 >> 172.21.15.5:0/2344336624 conn(0x560b30ef4770 msgr2=0x560b30ef3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 shutdown_connections 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.287+0000 7f88f43d8740 1 -- 172.21.15.5:0/2344336624 wait complete. 2024-04-25T08:59:48.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.288+0000 7f88f43d8740 20 client.6216 trim_cache size 0 max 16384 2024-04-25T08:59:48.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.303+0000 7f88f43d8740 1 Processor -- start 2024-04-25T08:59:48.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.303+0000 7f88f43d8740 1 -- start start 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.303+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f394c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.303+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f21ef0 0x560b30f40450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.303+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f40ed0 0x560b30efb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.303+0000 7f88f43d8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec1ffe40 con 0x560b30f21b10 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec1ff030 con 0x560b30f40ed0 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec15bc60 con 0x560b30f21ef0 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f394c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43388/0 (socket says 172.21.15.5:43388) 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 -- 172.21.15.5:0/3580106099 learned_addr learned my addr 172.21.15.5:0/3580106099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88e3fff640 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f21ef0 0x560b30f40450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f40ed0 0x560b30efb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 -- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f21ef0 msgr2=0x560b30f40450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f21ef0 0x560b30f40450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 -- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f40ed0 msgr2=0x560b30efb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f40ed0 0x560b30efb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 -- 172.21.15.5:0/3580106099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b30b320f0 con 0x560b30f21b10 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f40ed0 0x560b30efb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88eaffd640 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f394c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f88dc005d60 tx=0x7f88dc028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec0772ce0a1eefc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88cbfff640 1 -- 172.21.15.5:0/3580106099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc015250 con 0x560b30f21b10 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88cbfff640 1 -- 172.21.15.5:0/3580106099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc021a30 con 0x560b30f21b10 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.304+0000 7f88cbfff640 1 -- 172.21.15.5:0/3580106099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc02d460 con 0x560b30f21b10 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 -- 172.21.15.5:0/3580106099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 msgr2=0x560b30f394c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f394c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f88dc005d60 tx=0x7f88dc028000 comp rx=0 tx=0).stop 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 -- 172.21.15.5:0/3580106099 shutdown_connections 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f40ed0 0x560b30efb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f21ef0 0x560b30f40450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 --2- 172.21.15.5:0/3580106099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21b10 0x560b30f394c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 -- 172.21.15.5:0/3580106099 >> 172.21.15.5:0/3580106099 conn(0x560b30ef4770 msgr2=0x560b30f3be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 -- 172.21.15.5:0/3580106099 shutdown_connections 2024-04-25T08:59:48.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 -- 172.21.15.5:0/3580106099 wait complete. 2024-04-25T08:59:48.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 -- start start 2024-04-25T08:59:48.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.305+0000 7f88f43d8740 1 Processor -- start 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21b10 0x560b30f51ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21ef0 0x560b30f3f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88f43d8740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f25420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88f43d8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec1fea30 con 0x560b30f21ef0 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b30e14d90 con 0x560b30f21b10 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88f43d8740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b30fa9bd0 con 0x560b30f40ed0 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88f43d8740 10 client.0 _ll_register_callbacks cb 0x7f88dc0071f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21ef0 0x560b30f3f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21ef0 0x560b30f3f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43402/0 (socket says 172.21.15.5:43402) 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88e3fff640 1 -- 172.21.15.5:0/2443967978 learned_addr learned my addr 172.21.15.5:0/2443967978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f25420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.306+0000 7f88eaffd640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21b10 0x560b30f51ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88e3fff640 1 -- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 msgr2=0x560b30f25420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f25420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88e3fff640 1 -- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21b10 msgr2=0x560b30f51ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21b10 0x560b30f51ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88e3fff640 1 -- 172.21.15.5:0/2443967978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b30f39860 con 0x560b30f21ef0 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88eb7fe640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f25420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88eaffd640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21b10 0x560b30f51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88e3fff640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21ef0 0x560b30f3f9e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ae400 tx=0x7f88d401ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0c6e92f62ee9a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2443967978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d401f4e0 con 0x560b30f21ef0 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2443967978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f88d401f680 con 0x560b30f21ef0 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88dc021a30 con 0x560b30f21ef0 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2443967978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88d401f880 con 0x560b30f21ef0 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 10 client.6222 fetch_fsmap learned FSMap version 23 2024-04-25T08:59:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x560b30fa9910 con 0x560b30f21ef0 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2443967978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc021a30 con 0x560b30f21ef0 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2443967978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f88d4030080 con 0x560b30f21ef0 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 10 client.6222 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 10 client.6222 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 20 client.6222 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f3ff20 0x560b30f25960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 4 client.6222 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560b30e65630 con 0x560b30f3ff20 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.307+0000 7f88eaffd640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f3ff20 0x560b30f25960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88c9ffb640 10 client.6222 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88eaffd640 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f3ff20 0x560b30f25960 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe489eb7aa39e028 server_cookie=3dee648ce45dfa95 in_seq=0 out_seq=0 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88c9ffb640 1 -- 172.21.15.5:0/2443967978 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560b30e65630 con 0x560b30f3ff20 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88c9ffb640 10 client.6222 handle_command_reply: tid=0 2024-04-25T08:59:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 client.6222 shutdown 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21ef0 msgr2=0x560b30f3f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21ef0 0x560b30f3f9e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ae400 tx=0x7f88d401ff50 comp rx=0 tx=0).stop 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 shutdown_connections 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x560b30f3ff20 0x560b30f25960 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560b30f40ed0 0x560b30f25420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b30f21ef0 0x560b30f3f9e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88c9ffb640 0 client.6222 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 --2- 172.21.15.5:0/2443967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b30f21b10 0x560b30f51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 >> 172.21.15.5:0/2443967978 conn(0x560b30ef4770 msgr2=0x560b30f26cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 shutdown_connections 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 1 -- 172.21.15.5:0/2443967978 wait complete. 2024-04-25T08:59:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.308+0000 7f88f43d8740 20 client.6222 trim_cache size 0 max 16384 2024-04-25T08:59:48.305 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:48.305 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-04-25T08:59:48.305 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T08:59:48.305 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88cc06b500 msgr2=0x7f88cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88cc06b500 0x7f88cc06d9c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88dc000f60 tx=0x7f88dc007b70 comp rx=0 tx=0).stop 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 msgr2=0x7f88ec0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0add80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009eb0 tx=0x7f88e4004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 shutdown_connections 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88cc06b500 0x7f88cc06d9c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88ec15e880 0x7f88ec0add80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ec15a340 0x7f88ec0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 --2- 172.21.15.5:0/265288440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88ec0b43d0 0x7f88ec14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 >> 172.21.15.5:0/265288440 conn(0x7f88ec0b1550 msgr2=0x7f88ec0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 shutdown_connections 2024-04-25T08:59:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.309+0000 7f88f16d2640 1 -- 172.21.15.5:0/265288440 wait complete. 2024-04-25T08:59:48.309 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:59:48.309 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:59:48.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:59:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.422+0000 7f18bd615640 1 Processor -- start 2024-04-25T08:59:48.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.422+0000 7f18bd615640 1 -- start start 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18bd615640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18b80b6250 0x7f18b80ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18bd615640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b8162150 con 0x7f18b815df10 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18bd615640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b8162430 con 0x7f18b80cee10 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18bd615640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b80cf260 con 0x7f18b80b6250 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18b6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18b815df10 0x7f18b81618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42820/0 (socket says 172.21.15.5:42820) 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18b6ffd640 1 -- 172.21.15.5:0/2325254805 learned_addr learned my addr 172.21.15.5:0/2325254805 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18b67fc640 1 --2- 172.21.15.5:0/2325254805 >> v2:172.21.15.5:3300/0 conn(0x7f18b80b6250 0x7f18b80ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18b67fc640 1 -- 172.21.15.5:0/2325254805 >> v1:172.21.15.80:6789/0 conn(0x7f18b80cee10 legacy=0x7f18b80d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18b67fc640 1 -- 172.21.15.5:0/2325254805 >> v1:172.21.15.5:6789/0 conn(0x7f18b815df10 legacy=0x7f18b81618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18b5ffb640 1 -- 172.21.15.5:0/2325254805 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674093880 0 0) 0x7f18b8162150 con 0x7f18b815df10 2024-04-25T08:59:48.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.423+0000 7f18b67fc640 1 -- 172.21.15.5:0/2325254805 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8162710 con 0x7f18b80b6250 2024-04-25T08:59:48.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.424+0000 7f18b67fc640 1 --2- 172.21.15.5:0/2325254805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80ce8d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0097a0 tx=0x7f18ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea8979b62522f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.424+0000 7f18b5ffb640 1 -- 172.21.15.5:0/2325254805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac037070 con 0x7f18b80b6250 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.424+0000 7f18b5ffb640 1 -- 172.21.15.5:0/2325254805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac032440 con 0x7f18b80b6250 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.424+0000 7f18b5ffb640 1 -- 172.21.15.5:0/2325254805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac032810 con 0x7f18b80b6250 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.425+0000 7f18bd615640 1 -- 172.21.15.5:0/2325254805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 msgr2=0x7f18b80ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.425+0000 7f18bd615640 1 --2- 172.21.15.5:0/2325254805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80ce8d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0097a0 tx=0x7f18ac02a230 comp rx=0 tx=0).stop 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.425+0000 7f18bd615640 1 -- 172.21.15.5:0/2325254805 shutdown_connections 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.425+0000 7f18bd615640 1 --2- 172.21.15.5:0/2325254805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80ce8d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.425+0000 7f18bd615640 1 -- 172.21.15.5:0/2325254805 >> 172.21.15.5:0/2325254805 conn(0x7f18b80668f0 msgr2=0x7f18b8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.425+0000 7f18bd615640 1 -- 172.21.15.5:0/2325254805 shutdown_connections 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.425+0000 7f18bd615640 1 -- 172.21.15.5:0/2325254805 wait complete. 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.426+0000 7f18bd615640 1 Processor -- start 2024-04-25T08:59:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.426+0000 7f18bd615640 1 -- start start 2024-04-25T08:59:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18bd615640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18bd615640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18b80cee10 0x7f18b8148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18bd615640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18b815df10 0x7f18b80c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18bd615640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80d2c70 con 0x7f18b80b6250 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18bd615640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80d20d0 con 0x7f18b80cee10 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18bd615640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80d2df0 con 0x7f18b815df10 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43416/0 (socket says 172.21.15.5:43416) 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3353340692 learned_addr learned my addr 172.21.15.5:0/3353340692 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b67fc640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18b80cee10 0x7f18b8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b77fe640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18b815df10 0x7f18b80c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18b815df10 msgr2=0x7f18b80c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18b815df10 0x7f18b80c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18b80cee10 msgr2=0x7f18b8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18b80cee10 0x7f18b8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3353340692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80c6250 con 0x7f18b80b6250 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b67fc640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18b80cee10 0x7f18b8148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.427+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80c5d10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c3f0 tx=0x7f18b000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.428+0000 7f189f7fe640 1 -- 172.21.15.5:0/3353340692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00074e0 con 0x7f18b80b6250 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.428+0000 7f189f7fe640 1 -- 172.21.15.5:0/3353340692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b00047e0 con 0x7f18b80b6250 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.428+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b80ca560 con 0x7f18b80b6250 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.428+0000 7f189f7fe640 1 -- 172.21.15.5:0/3353340692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0004bd0 con 0x7f18b80b6250 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.428+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b815f9a0 con 0x7f18b80b6250 2024-04-25T08:59:48.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.429+0000 7f189f7fe640 1 -- 172.21.15.5:0/3353340692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f18b0011070 con 0x7f18b80b6250 2024-04-25T08:59:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.430+0000 7f189f7fe640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18a406b4d0 0x7f18a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.430+0000 7f189f7fe640 1 -- 172.21.15.5:0/3353340692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f18b0089e70 con 0x7f18b80b6250 2024-04-25T08:59:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.430+0000 7f18b67fc640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18a406b4d0 0x7f18a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.430+0000 7f18b67fc640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18a406b4d0 0x7f18a406d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f18ac034000 tx=0x7f18ac02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.431+0000 7f18c03f9740 1 Processor -- start 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.431+0000 7f18c03f9740 1 -- start start 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995e22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995b2700 0x5565995b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18c03f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55659951be00 con 0x5565995b2700 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565994c4d20 con 0x5565995dfe80 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x556599517ea0 con 0x5565995dfaa0 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995b2700 0x5565995b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995e22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995b2700 0x5565995b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43428/0 (socket says 172.21.15.5:43428) 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 -- 172.21.15.5:0/1209492394 learned_addr learned my addr 172.21.15.5:0/1209492394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 -- 172.21.15.5:0/1209492394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 msgr2=0x5565995e22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 --2- 172.21.15.5:0/1209492394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995e22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 -- 172.21.15.5:0/1209492394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 msgr2=0x5565995e27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 --2- 172.21.15.5:0/1209492394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995e27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 -- 172.21.15.5:0/1209492394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565994e6df0 con 0x5565995b2700 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.432+0000 7f18b77fe640 1 --2- 172.21.15.5:0/1209492394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995b2700 0x5565995b5f10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f18a8001c70 tx=0x7f18a8002130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c22a1b2dad4f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f189cff9640 1 -- 172.21.15.5:0/1209492394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8019070 con 0x5565995b2700 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f189cff9640 1 -- 172.21.15.5:0/1209492394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8003b80 con 0x5565995b2700 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f189cff9640 1 -- 172.21.15.5:0/1209492394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800e800 con 0x5565995b2700 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 -- 172.21.15.5:0/1209492394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995b2700 msgr2=0x5565995b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 --2- 172.21.15.5:0/1209492394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995b2700 0x5565995b5f10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f18a8001c70 tx=0x7f18a8002130 comp rx=0 tx=0).stop 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 -- 172.21.15.5:0/1209492394 shutdown_connections 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 --2- 172.21.15.5:0/1209492394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995b2700 0x5565995b5f10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 --2- 172.21.15.5:0/1209492394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995e27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 --2- 172.21.15.5:0/1209492394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995e22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 -- 172.21.15.5:0/1209492394 >> 172.21.15.5:0/1209492394 conn(0x5565995b4970 msgr2=0x5565995fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 -- 172.21.15.5:0/1209492394 shutdown_connections 2024-04-25T08:59:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.433+0000 7f18c03f9740 1 -- 172.21.15.5:0/1209492394 wait complete. 2024-04-25T08:59:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.434+0000 7f18c03f9740 1 -- start start 2024-04-25T08:59:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.434+0000 7f18c03f9740 1 Processor -- start 2024-04-25T08:59:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995fe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995fec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x556599600ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565995b7b20 con 0x5565995da700 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565994ba590 con 0x5565995dfe80 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565995b7e00 con 0x5565995dfaa0 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 10 client.0 _ll_register_callbacks cb 0x5565994c6e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x556599600ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x556599600ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43444/0 (socket says 172.21.15.5:43444) 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 -- 172.21.15.5:0/2492708254 learned_addr learned my addr 172.21.15.5:0/2492708254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b67fc640 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 -- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 msgr2=0x5565995fe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995fe730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 -- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 msgr2=0x5565995fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 -- 172.21.15.5:0/2492708254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565992303f0 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18b77fe640 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x556599600ac0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007ed0 tx=0x7f18a8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b294251b6dd290d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f1895ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f1895ffb640 1 -- 172.21.15.5:0/2492708254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8019040 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f1895ffb640 1 -- 172.21.15.5:0/2492708254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f18a800e800 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.435+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18a8003b80 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f1895ffb640 1 -- 172.21.15.5:0/2492708254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18a802a050 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 10 client.6237 fetch_fsmap learned FSMap version 23 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5565992fa7d0 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f1895ffb640 1 -- 172.21.15.5:0/2492708254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8003b80 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f1895ffb640 1 -- 172.21.15.5:0/2492708254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f18a802d020 con 0x5565995da700 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 10 client.6237 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 10 client.6237 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 20 client.6237 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:48.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995e4850 0x5565995e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 4 client.6237 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556599529340 con 0x5565995e4850 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995e4850 0x5565995e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f1895ffb640 10 client.6237 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.436+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995e4850 0x5565995e4c60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8af3513cace9cb0f server_cookie=3af04e3c818052be in_seq=0 out_seq=0 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f1895ffb640 1 -- 172.21.15.5:0/2492708254 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556599529340 con 0x5565995e4850 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f1895ffb640 10 client.6237 handle_command_reply: tid=0 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 client.6237 shutdown 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 msgr2=0x556599600ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x556599600ac0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007ed0 tx=0x7f18a8001250 comp rx=0 tx=0).stop 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 shutdown_connections 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995e4850 0x5565995e4c60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x556599600ac0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f1895ffb640 0 client.6237 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 --2- 172.21.15.5:0/2492708254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfaa0 0x5565995fe730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 >> 172.21.15.5:0/2492708254 conn(0x5565995b2700 msgr2=0x5565995b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 shutdown_connections 2024-04-25T08:59:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 1 -- 172.21.15.5:0/2492708254 wait complete. 2024-04-25T08:59:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.437+0000 7f18c03f9740 20 client.6237 trim_cache size 0 max 16384 2024-04-25T08:59:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.449+0000 7f18c03f9740 1 Processor -- start 2024-04-25T08:59:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.449+0000 7f18c03f9740 1 -- start start 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfaa0 0x5565995de190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfe80 0x5565995db090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18c03f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81ffef0 con 0x5565995da700 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b814af20 con 0x5565995dfaa0 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80c9e10 con 0x5565995dfe80 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43460/0 (socket says 172.21.15.5:43460) 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3649327396 learned_addr learned my addr 172.21.15.5:0/3649327396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3649327396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfe80 msgr2=0x5565995db090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3649327396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfe80 0x5565995db090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3649327396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfaa0 msgr2=0x5565995de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3649327396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfaa0 0x5565995de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 -- 172.21.15.5:0/3649327396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565995fe3e0 con 0x5565995da700 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3649327396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x5565995b76d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f18b0054a10 tx=0x7f18b0054850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4734a4ab057c6a11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f1897fff640 1 -- 172.21.15.5:0/3649327396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0086070 con 0x5565995da700 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f1897fff640 1 -- 172.21.15.5:0/3649327396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b00880c0 con 0x5565995da700 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.450+0000 7f1897fff640 1 -- 172.21.15.5:0/3649327396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00585b0 con 0x5565995da700 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 -- 172.21.15.5:0/3649327396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 msgr2=0x5565995b76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3649327396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x5565995b76d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f18b0054a10 tx=0x7f18b0054850 comp rx=0 tx=0).stop 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 -- 172.21.15.5:0/3649327396 shutdown_connections 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3649327396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995dfe80 0x5565995db090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3649327396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfaa0 0x5565995de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3649327396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 -- 172.21.15.5:0/3649327396 >> 172.21.15.5:0/3649327396 conn(0x5565995b2700 msgr2=0x5565996005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 -- 172.21.15.5:0/3649327396 shutdown_connections 2024-04-25T08:59:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 -- 172.21.15.5:0/3649327396 wait complete. 2024-04-25T08:59:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.451+0000 7f18c03f9740 1 -- start start 2024-04-25T08:59:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 1 Processor -- start 2024-04-25T08:59:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995dfaa0 0x556599668f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565995fa5b0 con 0x5565995dfaa0 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b814a920 con 0x5565995dfe80 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565994a1d70 con 0x5565995da700 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18c03f9740 10 client.0 _ll_register_callbacks cb 0x7f18a80016e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18b67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995dfaa0 0x556599668f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18b67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995dfaa0 0x556599668f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43468/0 (socket says 172.21.15.5:43468) 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.452+0000 7f18b67fc640 1 -- 172.21.15.5:0/3399306950 learned_addr learned my addr 172.21.15.5:0/3399306950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b77fe640 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b67fc640 1 -- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995da700 msgr2=0x5565995b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b67fc640 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b67fc640 1 -- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 msgr2=0x5565995b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b67fc640 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b67fc640 1 -- 172.21.15.5:0/3399306950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565995f9960 con 0x5565995dfaa0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18b67fc640 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995dfaa0 0x556599668f90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f18ac000c00 tx=0x7f18ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef999074d77d357 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f1895ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f1895ffb640 1 -- 172.21.15.5:0/3399306950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac04e020 con 0x5565995dfaa0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f1895ffb640 1 -- 172.21.15.5:0/3399306950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f18ac03ee00 con 0x5565995dfaa0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18b00880c0 con 0x5565995dfaa0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f1895ffb640 1 -- 172.21.15.5:0/3399306950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18ac058050 con 0x5565995dfaa0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18c03f9740 10 client.6243 fetch_fsmap learned FSMap version 23 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5565996684e0 con 0x5565995dfaa0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f1895ffb640 1 -- 172.21.15.5:0/3399306950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b00880c0 con 0x5565995dfaa0 2024-04-25T08:59:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.453+0000 7f1895ffb640 1 -- 172.21.15.5:0/3399306950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f18ac05b020 con 0x5565995dfaa0 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 10 client.6243 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 10 client.6243 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 20 client.6243 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995b1c10 0x5565996167d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 4 client.6243 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556599523690 con 0x5565995b1c10 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995b1c10 0x5565996167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f1895ffb640 10 client.6243 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18b6ffd640 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995b1c10 0x5565996167d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d1d410562bc0233 server_cookie=2521bfc800e57133 in_seq=0 out_seq=0 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f1895ffb640 1 -- 172.21.15.5:0/3399306950 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x556599523690 con 0x5565995b1c10 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f1895ffb640 10 client.6243 handle_command_reply: tid=0 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 client.6243 shutdown 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995dfaa0 msgr2=0x556599668f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995dfaa0 0x556599668f90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f18ac000c00 tx=0x7f18ac004730 comp rx=0 tx=0).stop 2024-04-25T08:59:48.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 shutdown_connections 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x5565995b1c10 0x5565996167d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565995dfe80 0x5565995b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5565995dfaa0 0x556599668f90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f1895ffb640 0 client.6243 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 --2- 172.21.15.5:0/3399306950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5565995da700 0x5565995b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 >> 172.21.15.5:0/3399306950 conn(0x5565995b2700 msgr2=0x5565995db090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 shutdown_connections 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.454+0000 7f18c03f9740 1 -- 172.21.15.5:0/3399306950 wait complete. 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18c03f9740 20 client.6243 trim_cache size 0 max 16384 2024-04-25T08:59:48.450 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T08:59:48.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T08:59:48.451 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2024-04-25T08:59:48.451 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 3679084982, 2024-04-25T08:59:48.451 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511630188, 2024-04-25T08:59:48.451 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-04-25T08:59:48.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T08:59:48.451 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18a406b4d0 msgr2=0x7f18a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18a406b4d0 0x7f18a406d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f18ac034000 tx=0x7f18ac02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 msgr2=0x7f18b80c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80c5d10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c3f0 tx=0x7f18b000c8b0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 shutdown_connections 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f18a406b4d0 0x7f18a406d990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18b815df10 0x7f18b80c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18b80cee10 0x7f18b8148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 --2- 172.21.15.5:0/3353340692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80b6250 0x7f18b80c5d10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 >> 172.21.15.5:0/3353340692 conn(0x7f18b80668f0 msgr2=0x7f18b8161830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 shutdown_connections 2024-04-25T08:59:48.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.455+0000 7f18bd615640 1 -- 172.21.15.5:0/3353340692 wait complete. 2024-04-25T08:59:48.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:48.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.567+0000 7f419f7d5640 1 Processor -- start 2024-04-25T08:59:48.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419f7d5640 1 -- start start 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419f7d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41980b0a50 0x7f41980ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419f7d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41980cbf40 0x7f41980ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419f7d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419806ba50 con 0x7f41980b0e30 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419f7d5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419806b800 con 0x7f41980cbf40 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419f7d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419806bd30 con 0x7f41980b0a50 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419dd72640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41980cbf40 0x7f41980ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419dd72640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41980cbf40 0x7f41980ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43474/0 (socket says 172.21.15.5:43474) 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.568+0000 7f419dd72640 1 -- 172.21.15.5:0/1476792774 learned_addr learned my addr 172.21.15.5:0/1476792774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.569+0000 7f419d571640 1 --2- 172.21.15.5:0/1476792774 >> v2:172.21.15.80:3300/0 conn(0x7f41980b0a50 0x7f41980ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.569+0000 7f419dd72640 1 -- 172.21.15.5:0/1476792774 >> v2:172.21.15.80:3300/0 conn(0x7f41980b0a50 msgr2=0x7f41980ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.569+0000 7f419dd72640 1 --2- 172.21.15.5:0/1476792774 >> v2:172.21.15.80:3300/0 conn(0x7f41980b0a50 0x7f41980ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.569+0000 7f419dd72640 1 -- 172.21.15.5:0/1476792774 >> v1:172.21.15.80:6789/0 conn(0x7f41980b0e30 legacy=0x7f41980d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.569+0000 7f419dd72640 1 -- 172.21.15.5:0/1476792774 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419806c010 con 0x7f41980cbf40 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.569+0000 7f419d571640 1 --2- 172.21.15.5:0/1476792774 >> v2:172.21.15.80:3300/0 conn(0x7f41980b0a50 0x7f41980ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.569+0000 7f419dd72640 1 --2- 172.21.15.5:0/1476792774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41980ce740 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4198071950 tx=0x7f419002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d71db38c63d9bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f418ffff640 1 -- 172.21.15.5:0/1476792774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190036070 con 0x7f41980cbf40 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f418ffff640 1 -- 172.21.15.5:0/1476792774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190031600 con 0x7f41980cbf40 2024-04-25T08:59:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f418ffff640 1 -- 172.21.15.5:0/1476792774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900319d0 con 0x7f41980cbf40 2024-04-25T08:59:48.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 -- 172.21.15.5:0/1476792774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 msgr2=0x7f41980ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1476792774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41980ce740 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4198071950 tx=0x7f419002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 -- 172.21.15.5:0/1476792774 shutdown_connections 2024-04-25T08:59:48.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1476792774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41980ce740 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1476792774 >> v2:172.21.15.80:3300/0 conn(0x7f41980b0a50 0x7f41980ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 -- 172.21.15.5:0/1476792774 >> 172.21.15.5:0/1476792774 conn(0x7f41980d18f0 msgr2=0x7f41980d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 -- 172.21.15.5:0/1476792774 shutdown_connections 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.570+0000 7f419f7d5640 1 -- 172.21.15.5:0/1476792774 wait complete. 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.571+0000 7f419f7d5640 1 Processor -- start 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.571+0000 7f419f7d5640 1 -- start start 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419f7d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41980b0a50 0x7f41980c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419f7d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41980b0e30 0x7f41980c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419f7d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41981f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419f7d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980b2bf0 con 0x7f41980cbf40 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419f7d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980cfd60 con 0x7f41980b0a50 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419f7d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980c6bb0 con 0x7f41980b0e30 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419dd72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41981f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419dd72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41981f3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43482/0 (socket says 172.21.15.5:43482) 2024-04-25T08:59:48.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419dd72640 1 -- 172.21.15.5:0/1077839967 learned_addr learned my addr 172.21.15.5:0/1077839967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419d571640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41980b0a50 0x7f41980c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.572+0000 7f419cd70640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41980b0e30 0x7f41980c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419dd72640 1 -- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41980b0e30 msgr2=0x7f41980c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419dd72640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41980b0e30 0x7f41980c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419dd72640 1 -- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41980b0a50 msgr2=0x7f41980c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419dd72640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41980b0a50 0x7f41980c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419dd72640 1 -- 172.21.15.5:0/1077839967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980c6e90 con 0x7f41980cbf40 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419d571640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41980b0a50 0x7f41980c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419dd72640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41981f3560 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4190009f40 tx=0x7f4190004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f418dffb640 1 -- 172.21.15.5:0/1077839967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190036050 con 0x7f41980cbf40 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f418dffb640 1 -- 172.21.15.5:0/1077839967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190042070 con 0x7f41980cbf40 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f418dffb640 1 -- 172.21.15.5:0/1077839967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190009510 con 0x7f41980cbf40 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41980c8a60 con 0x7f41980cbf40 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.573+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41980c68a0 con 0x7f41980cbf40 2024-04-25T08:59:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.574+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419806cd70 con 0x7f41980cbf40 2024-04-25T08:59:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.574+0000 7f418dffb640 1 -- 172.21.15.5:0/1077839967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4190007bd0 con 0x7f41980cbf40 2024-04-25T08:59:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.575+0000 7f418dffb640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.575+0000 7f418dffb640 1 -- 172.21.15.5:0/1077839967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f41900ab200 con 0x7f41980cbf40 2024-04-25T08:59:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.575+0000 7f419d571640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.576+0000 7f419d571640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f417c06b4d0 0x7f417c06d990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f41980cd600 tx=0x7f4194008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.579+0000 7f418dffb640 1 -- 172.21.15.5:0/1077839967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4190045360 con 0x7f41980cbf40 2024-04-25T08:59:48.710 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T08:59:48.721+0000 7f7b6dbf5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T08:59:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.796+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f419804ef20 con 0x7f41980cbf40 2024-04-25T08:59:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.797+0000 7f418dffb640 1 -- 172.21.15.5:0/1077839967 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f419007a040 con 0x7f41980cbf40 2024-04-25T08:59:48.786 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:48.787 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:48.481928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f417c06b4d0 msgr2=0x7f417c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f417c06b4d0 0x7f417c06d990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f41980cd600 tx=0x7f4194008040 comp rx=0 tx=0).stop 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 msgr2=0x7f41981f3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41981f3560 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4190009f40 tx=0x7f4190004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 shutdown_connections 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41980cbf40 0x7f41981f3560 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41980b0e30 0x7f41980c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 --2- 172.21.15.5:0/1077839967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41980b0a50 0x7f41980c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 >> 172.21.15.5:0/1077839967 conn(0x7f41980d18f0 msgr2=0x7f41980cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 shutdown_connections 2024-04-25T08:59:48.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.799+0000 7f419f7d5640 1 -- 172.21.15.5:0/1077839967 wait complete. 2024-04-25T08:59:48.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 3679084982 2024-04-25T08:59:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.913+0000 7fe25c2e1640 1 Processor -- start 2024-04-25T08:59:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.913+0000 7fe25c2e1640 1 -- start start 2024-04-25T08:59:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25c2e1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe25415df70 0x7fe2540b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25c2e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe2540ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25c2e1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540d1ed0 con 0x7fe2540ced50 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25c2e1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2540d1c80 con 0x7fe25415df70 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25c2e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540d2ae0 con 0x7fe2540d2f70 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25a87e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe2540ced50 0x7fe2540b55e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42826/0 (socket says 172.21.15.5:42826) 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25a87e640 1 -- 172.21.15.5:0/435651575 learned_addr learned my addr 172.21.15.5:0/435651575 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25a07d640 1 --2- 172.21.15.5:0/435651575 >> v2:172.21.15.80:3300/0 conn(0x7fe25415df70 0x7fe2540b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.914+0000 7fe25987c640 1 --2- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe2540ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.915+0000 7fe25907b640 1 -- 172.21.15.5:0/435651575 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471715705 0 0) 0x7fe2540d1ed0 con 0x7fe2540ced50 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.915+0000 7fe25907b640 1 -- 172.21.15.5:0/435651575 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe23c003520 con 0x7fe2540ced50 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.915+0000 7fe25a07d640 1 -- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 msgr2=0x7fe2540ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.915+0000 7fe25a07d640 1 --2- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe2540ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.915+0000 7fe25a07d640 1 -- 172.21.15.5:0/435651575 >> v1:172.21.15.5:6789/0 conn(0x7fe2540ced50 legacy=0x7fe2540b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.915+0000 7fe25a07d640 1 -- 172.21.15.5:0/435651575 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540d21b0 con 0x7fe25415df70 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.915+0000 7fe25a07d640 1 --2- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe25415df70 0x7fe2540b94d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097a0 tx=0x7fe24c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4bc634b85481316 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25907b640 1 -- 172.21.15.5:0/435651575 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c037070 con 0x7fe25415df70 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25907b640 1 -- 172.21.15.5:0/435651575 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c032440 con 0x7fe25415df70 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25907b640 1 -- 172.21.15.5:0/435651575 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0327f0 con 0x7fe25415df70 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 -- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe25415df70 msgr2=0x7fe2540b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe25415df70 0x7fe2540b94d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097a0 tx=0x7fe24c02a210 comp rx=0 tx=0).stop 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 -- 172.21.15.5:0/435651575 shutdown_connections 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe2540ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/435651575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe25415df70 0x7fe2540b94d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 -- 172.21.15.5:0/435651575 >> 172.21.15.5:0/435651575 conn(0x7fe25406b000 msgr2=0x7fe25406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 -- 172.21.15.5:0/435651575 shutdown_connections 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.916+0000 7fe25c2e1640 1 -- 172.21.15.5:0/435651575 wait complete. 2024-04-25T08:59:48.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 Processor -- start 2024-04-25T08:59:48.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 -- start start 2024-04-25T08:59:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2540ced50 0x7fe2540b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe254152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe254156610 0x7fe254145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540b9a10 con 0x7fe254156610 2024-04-25T08:59:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540d2770 con 0x7fe2540ced50 2024-04-25T08:59:48.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25c2e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540d3720 con 0x7fe2540d2f70 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.918+0000 7fe25a87e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe254156610 0x7fe254145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe254156610 0x7fe254145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43496/0 (socket says 172.21.15.5:43496) 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 -- 172.21.15.5:0/3061952456 learned_addr learned my addr 172.21.15.5:0/3061952456 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25987c640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe254152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a07d640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2540ced50 0x7fe2540b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 -- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 msgr2=0x7fe254152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe254152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 -- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2540ced50 msgr2=0x7fe2540b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2540ced50 0x7fe2540b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 -- 172.21.15.5:0/3061952456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540b39a0 con 0x7fe254156610 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25a87e640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe254156610 0x7fe254145e10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe24400caa0 tx=0x7fe24400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe252ffd640 1 -- 172.21.15.5:0/3061952456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244017070 con 0x7fe254156610 2024-04-25T08:59:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe252ffd640 1 -- 172.21.15.5:0/3061952456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24400ac00 con 0x7fe254156610 2024-04-25T08:59:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2540b62c0 con 0x7fe254156610 2024-04-25T08:59:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe252ffd640 1 -- 172.21.15.5:0/3061952456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244012400 con 0x7fe254156610 2024-04-25T08:59:48.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.919+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe254155e10 con 0x7fe254156610 2024-04-25T08:59:48.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.921+0000 7fe252ffd640 1 -- 172.21.15.5:0/3061952456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe24401a070 con 0x7fe254156610 2024-04-25T08:59:48.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.921+0000 7fe252ffd640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24006b4d0 0x7fe24006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.921+0000 7fe252ffd640 1 -- 172.21.15.5:0/3061952456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe244089ec0 con 0x7fe254156610 2024-04-25T08:59:48.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.921+0000 7fe25a07d640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24006b4d0 0x7fe24006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.922+0000 7fe25a07d640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24006b4d0 0x7fe24006d990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe24c034000 tx=0x7fe24c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.922+0000 7fe25efe4740 1 Processor -- start 2024-04-25T08:59:48.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.922+0000 7fe25efe4740 1 -- start start 2024-04-25T08:59:48.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bef80 0x55b9203c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b920391be0 0x55b9203953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25efe4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9202faac0 con 0x55b920391be0 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9202a3db0 con 0x55b9203bef80 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9202f6b60 con 0x55b9203bf360 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25a87e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b920391be0 0x55b9203953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25a87e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b920391be0 0x55b9203953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43504/0 (socket says 172.21.15.5:43504) 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25a87e640 1 -- 172.21.15.5:0/2857193551 learned_addr learned my addr 172.21.15.5:0/2857193551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25987c640 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.923+0000 7fe25a07d640 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bef80 0x55b9203c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe25a87e640 1 -- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 msgr2=0x55b9203c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe25a87e640 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe25a87e640 1 -- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bef80 msgr2=0x55b9203c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe25a87e640 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bef80 0x55b9203c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe25a87e640 1 -- 172.21.15.5:0/2857193551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9200db710 con 0x55b920391be0 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe25a87e640 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b920391be0 0x55b9203953f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe2440586d0 tx=0x7fe2440588c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d87ee7bf855b9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe23bfff640 1 -- 172.21.15.5:0/2857193551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244056a40 con 0x55b920391be0 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe23bfff640 1 -- 172.21.15.5:0/2857193551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244054db0 con 0x55b920391be0 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.924+0000 7fe23bfff640 1 -- 172.21.15.5:0/2857193551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244060b10 con 0x55b920391be0 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 -- 172.21.15.5:0/2857193551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b920391be0 msgr2=0x55b9203953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b920391be0 0x55b9203953f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe2440586d0 tx=0x7fe2440588c0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 -- 172.21.15.5:0/2857193551 shutdown_connections 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b920391be0 0x55b9203953f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2857193551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bef80 0x55b9203c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 -- 172.21.15.5:0/2857193551 >> 172.21.15.5:0/2857193551 conn(0x55b920393e50 msgr2=0x55b9203dc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 -- 172.21.15.5:0/2857193551 shutdown_connections 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 -- 172.21.15.5:0/2857193551 wait complete. 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 -- start start 2024-04-25T08:59:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.925+0000 7fe25efe4740 1 Processor -- start 2024-04-25T08:59:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203e0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203ec5e0 0x55b9203b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25efe4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b920397000 con 0x55b9203bef80 2024-04-25T08:59:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9202994e0 con 0x55b9203ec5e0 2024-04-25T08:59:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9203972e0 con 0x55b9203bf360 2024-04-25T08:59:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25efe4740 10 client.0 _ll_register_callbacks cb 0x55b92000eaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25a07d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25a07d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203b90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43508/0 (socket says 172.21.15.5:43508) 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25a07d640 1 -- 172.21.15.5:0/2407056194 learned_addr learned my addr 172.21.15.5:0/2407056194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25a87e640 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203ec5e0 0x55b9203b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.926+0000 7fe25987c640 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25a07d640 1 -- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 msgr2=0x55b9203e0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25a07d640 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203e0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25a07d640 1 -- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203ec5e0 msgr2=0x55b9203b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25a07d640 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203ec5e0 0x55b9203b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25a07d640 1 -- 172.21.15.5:0/2407056194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b92013bea0 con 0x55b9203bef80 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25a07d640 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203b90b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0098c0 tx=0x7fe24c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95a6377f50a87b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe2397fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe2397fa640 1 -- 172.21.15.5:0/2407056194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c037040 con 0x55b9203bef80 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe2397fa640 1 -- 172.21.15.5:0/2407056194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe24c049680 con 0x55b9203bef80 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe244054db0 con 0x55b9203bef80 2024-04-25T08:59:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe2397fa640 1 -- 172.21.15.5:0/2407056194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe24c0498c0 con 0x55b9203bef80 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25efe4740 10 client.6261 fetch_fsmap learned FSMap version 24 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55b91ffcf000 con 0x55b9203bef80 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe2397fa640 1 -- 172.21.15.5:0/2407056194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244054db0 con 0x55b9203bef80 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.927+0000 7fe2397fa640 1 -- 172.21.15.5:0/2407056194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe24c049a60 con 0x55b9203bef80 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25efe4740 10 client.6261 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25efe4740 10 client.6261 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25efe4740 20 client.6261 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203efc00 0x55b9203effe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25efe4740 4 client.6261 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b920308000 con 0x55b9203efc00 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25987c640 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203efc00 0x55b9203effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe25987c640 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203efc00 0x55b9203effe0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45af6ce0696da879 server_cookie=3b34359ad4868fd5 in_seq=0 out_seq=0 2024-04-25T08:59:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe2397fa640 10 client.6261 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe2397fa640 1 -- 172.21.15.5:0/2407056194 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b920308000 con 0x55b9203efc00 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.928+0000 7fe2397fa640 10 client.6261 handle_command_reply: tid=0 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 client.6261 shutdown 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 msgr2=0x55b9203b90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203b90b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0098c0 tx=0x7fe24c004730 comp rx=0 tx=0).stop 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 shutdown_connections 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203efc00 0x55b9203effe0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203ec5e0 0x55b9203b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bf360 0x55b9203e0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 --2- 172.21.15.5:0/2407056194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203b90b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe2397fa640 0 client.6261 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 >> 172.21.15.5:0/2407056194 conn(0x55b920391be0 msgr2=0x55b9203be230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 shutdown_connections 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 1 -- 172.21.15.5:0/2407056194 wait complete. 2024-04-25T08:59:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.929+0000 7fe25efe4740 20 client.6261 trim_cache size 0 max 16384 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.941+0000 7fe25efe4740 1 Processor -- start 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.941+0000 7fe25efe4740 1 -- start start 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203df450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203df990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203d9690 0x55b9203b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25efe4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541ff120 con 0x55b9203bef80 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541fe550 con 0x55b9203bf360 2024-04-25T08:59:48.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541feb50 con 0x55b9203d9690 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203df450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43520/0 (socket says 172.21.15.5:43520) 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 -- 172.21.15.5:0/4121526331 learned_addr learned my addr 172.21.15.5:0/4121526331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 -- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203d9690 msgr2=0x55b9203b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203d9690 0x55b9203b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25987c640 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 -- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 msgr2=0x55b9203df990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203df990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 -- 172.21.15.5:0/4121526331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9203e0790 con 0x55b9203bef80 2024-04-25T08:59:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25987c640 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe25a07d640 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203df450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097a0 tx=0x7fe24c044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345ab9cf8f4f9d7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe23b7fe640 1 -- 172.21.15.5:0/4121526331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c05f070 con 0x55b9203bef80 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe23b7fe640 1 -- 172.21.15.5:0/4121526331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c04e070 con 0x55b9203bef80 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.942+0000 7fe23b7fe640 1 -- 172.21.15.5:0/4121526331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c049680 con 0x55b9203bef80 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 -- 172.21.15.5:0/4121526331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 msgr2=0x55b9203df450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203df450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097a0 tx=0x7fe24c044000 comp rx=0 tx=0).stop 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 -- 172.21.15.5:0/4121526331 shutdown_connections 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203d9690 0x55b9203b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 --2- 172.21.15.5:0/4121526331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203bef80 0x55b9203df450 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 -- 172.21.15.5:0/4121526331 >> 172.21.15.5:0/4121526331 conn(0x55b920391be0 msgr2=0x55b9203c1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 -- 172.21.15.5:0/4121526331 shutdown_connections 2024-04-25T08:59:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 -- 172.21.15.5:0/4121526331 wait complete. 2024-04-25T08:59:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.943+0000 7fe25efe4740 1 -- start start 2024-04-25T08:59:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 1 Processor -- start 2024-04-25T08:59:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bef80 0x55b9203b9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203d9690 0x55b920447500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9203dda40 con 0x55b9203d9690 2024-04-25T08:59:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9203ed260 con 0x55b9203bf360 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9203b73e0 con 0x55b9203bef80 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.944+0000 7fe25efe4740 10 client.0 _ll_register_callbacks cb 0x7fe248009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203d9690 0x55b920447500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203d9690 0x55b920447500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43524/0 (socket says 172.21.15.5:43524) 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 -- 172.21.15.5:0/1640909316 learned_addr learned my addr 172.21.15.5:0/1640909316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a07d640 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bef80 0x55b9203b9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25987c640 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 -- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bef80 msgr2=0x55b9203b9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bef80 0x55b9203b9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 -- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 msgr2=0x55b9203eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 -- 172.21.15.5:0/1640909316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9203c59e0 con 0x55b9203d9690 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25a87e640 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203d9690 0x55b920447500 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe24400cfd0 tx=0x7fe244001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a12de303142136 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe2397fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T08:59:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe2397fa640 1 -- 172.21.15.5:0/1640909316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244004b60 con 0x55b9203d9690 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe2397fa640 1 -- 172.21.15.5:0/1640909316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe244004d00 con 0x55b9203d9690 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe24c04e070 con 0x55b9203d9690 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe2397fa640 1 -- 172.21.15.5:0/1640909316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe244057b90 con 0x55b9203d9690 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25efe4740 10 client.6267 fetch_fsmap learned FSMap version 24 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55b9203eb680 con 0x55b9203d9690 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.945+0000 7fe2397fa640 1 -- 172.21.15.5:0/1640909316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c04e070 con 0x55b9203d9690 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe2397fa640 1 -- 172.21.15.5:0/1640909316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe244057d30 con 0x55b9203d9690 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 10 client.6267 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 10 client.6267 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 20 client.6267 populate_metadata read hostname 'smithi005' 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203b8f30 0x55b9203b9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 4 client.6267 mds_command: new command op to 5616 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3679084982}] 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 --> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3679084982}) v1 -- 0x55b920302350 con 0x55b9203b8f30 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25a07d640 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203b8f30 0x55b9203b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe2397fa640 10 client.6267 ms_handle_connect on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25a07d640 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203b8f30 0x55b9203b9310 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=899d49db4445880 server_cookie=c2865e01fcf58a9a in_seq=0 out_seq=0 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe2397fa640 1 -- 172.21.15.5:0/1640909316 <== mds.0 v2:172.21.15.5:6833/2992823124 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x55b920302350 con 0x55b9203b8f30 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe2397fa640 10 client.6267 handle_command_reply: tid=0 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 client.6267 shutdown 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203d9690 msgr2=0x55b920447500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203d9690 0x55b920447500 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe24400cfd0 tx=0x7fe244001250 comp rx=0 tx=0).stop 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 shutdown_connections 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:6833/2992823124,v1:172.21.15.5:6835/2992823124] conn(0x55b9203b8f30 0x55b9203b9310 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b9203d9690 0x55b920447500 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.946+0000 7fe25efe4740 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b9203bf360 0x55b9203eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25efe4740 1 --2- 172.21.15.5:0/1640909316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55b9203bef80 0x55b9203b9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe2397fa640 0 client.6267 ms_handle_reset on v2:172.21.15.5:6833/2992823124 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 >> 172.21.15.5:0/1640909316 conn(0x55b920391be0 msgr2=0x55b9203df3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 shutdown_connections 2024-04-25T08:59:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25efe4740 1 -- 172.21.15.5:0/1640909316 wait complete. 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25efe4740 20 client.6267 trim_cache size 0 max 16384 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24006b4d0 msgr2=0x7fe24006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24006b4d0 0x7fe24006d990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe24c034000 tx=0x7fe24c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe254156610 msgr2=0x7fe254145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe254156610 0x7fe254145e10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe24400caa0 tx=0x7fe24400cf60 comp rx=0 tx=0).stop 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 shutdown_connections 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24006b4d0 0x7fe24006d990 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe254156610 0x7fe254145e10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe2540d2f70 0x7fe254152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 --2- 172.21.15.5:0/3061952456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2540ced50 0x7fe2540b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 >> 172.21.15.5:0/3061952456 conn(0x7fe25406b000 msgr2=0x7fe25415f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 shutdown_connections 2024-04-25T08:59:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:48.947+0000 7fe25c2e1640 1 -- 172.21.15.5:0/3061952456 wait complete. 2024-04-25T08:59:48.947 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T08:59:48.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.058+0000 7fcaf35fe640 1 Processor -- start 2024-04-25T08:59:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.059+0000 7fcaf35fe640 1 -- start start 2024-04-25T08:59:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.059+0000 7fcaf35fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaec15e0a0 0x7fcaec0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.059+0000 7fcaf35fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3df0 0x7fcaec0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.059+0000 7fcaf35fe640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec0b7f60 con 0x7fcaec0d3990 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.059+0000 7fcaf35fe640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec0b29c0 con 0x7fcaec15e0a0 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.059+0000 7fcaf35fe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0d2080 con 0x7fcaec0d3df0 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf139a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaec15e0a0 0x7fcaec0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf1b9b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3df0 0x7fcaec0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf139a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaec15e0a0 0x7fcaec0d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:40562/0 (socket says 172.21.15.5:40562) 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf1b9b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3df0 0x7fcaec0cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:45322/0 (socket says 172.21.15.5:45322) 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf139a640 1 -- 172.21.15.5:0/2716359842 learned_addr learned my addr 172.21.15.5:0/2716359842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf0b99640 1 --1- 172.21.15.5:0/2716359842 >> v1:172.21.15.80:6789/0 conn(0x7fcaec0d3990 0x7fcaec0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41492/0 (socket says 172.21.15.5:41492) 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf139a640 1 -- 172.21.15.5:0/2716359842 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3df0 msgr2=0x7fcaec0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:49.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf139a640 1 --2- 172.21.15.5:0/2716359842 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3df0 0x7fcaec0cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf139a640 1 -- 172.21.15.5:0/2716359842 >> v1:172.21.15.80:6789/0 conn(0x7fcaec0d3990 legacy=0x7fcaec0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.060+0000 7fcaf139a640 1 -- 172.21.15.5:0/2716359842 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0d2360 con 0x7fcaec15e0a0 2024-04-25T08:59:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.061+0000 7fcaf139a640 1 --2- 172.21.15.5:0/2716359842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec15e0a0 0x7fcaec0d0d50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009870 tx=0x7fcae802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c470275aac9209a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.061+0000 7fcae3fff640 1 -- 172.21.15.5:0/2716359842 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8037070 con 0x7fcaec15e0a0 2024-04-25T08:59:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.061+0000 7fcae3fff640 1 -- 172.21.15.5:0/2716359842 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8032440 con 0x7fcaec15e0a0 2024-04-25T08:59:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.061+0000 7fcae3fff640 1 -- 172.21.15.5:0/2716359842 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8032810 con 0x7fcaec15e0a0 2024-04-25T08:59:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.061+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2716359842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec15e0a0 msgr2=0x7fcaec0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.061+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2716359842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec15e0a0 0x7fcaec0d0d50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009870 tx=0x7fcae802a270 comp rx=0 tx=0).stop 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.062+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2716359842 shutdown_connections 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.062+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2716359842 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3df0 0x7fcaec0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.062+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2716359842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec15e0a0 0x7fcaec0d0d50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.062+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2716359842 >> 172.21.15.5:0/2716359842 conn(0x7fcaec0668f0 msgr2=0x7fcaec066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.062+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2716359842 shutdown_connections 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.062+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2716359842 wait complete. 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 Processor -- start 2024-04-25T08:59:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 -- start start 2024-04-25T08:59:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3990 0x7fcaec1f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec0d3df0 0x7fcaec0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15e0a0 0x7fcaec15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0d2c00 con 0x7fcaec15e0a0 2024-04-25T08:59:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0d2920 con 0x7fcaec0d3df0 2024-04-25T08:59:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.063+0000 7fcaf35fe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0d4280 con 0x7fcaec0d3990 2024-04-25T08:59:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15e0a0 0x7fcaec15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15e0a0 0x7fcaec15c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43540/0 (socket says 172.21.15.5:43540) 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 -- 172.21.15.5:0/2888888612 learned_addr learned my addr 172.21.15.5:0/2888888612 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf0b99640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec0d3df0 0x7fcaec0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf139a640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3990 0x7fcaec1f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 -- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3990 msgr2=0x7fcaec1f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3990 0x7fcaec1f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 -- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec0d3df0 msgr2=0x7fcaec0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec0d3df0 0x7fcaec0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 -- 172.21.15.5:0/2888888612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0ccf90 con 0x7fcaec15e0a0 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf1b9b640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15e0a0 0x7fcaec15c710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcae400efc0 tx=0x7fcae400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcae1ffb640 1 -- 172.21.15.5:0/2888888612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4018020 con 0x7fcaec15e0a0 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcae1ffb640 1 -- 172.21.15.5:0/2888888612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4014480 con 0x7fcaec15e0a0 2024-04-25T08:59:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec0cbc90 con 0x7fcaec15e0a0 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.064+0000 7fcae1ffb640 1 -- 172.21.15.5:0/2888888612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4014870 con 0x7fcaec15e0a0 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.065+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec0cc250 con 0x7fcaec15e0a0 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.066+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec04ef20 con 0x7fcaec15e0a0 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.066+0000 7fcae1ffb640 1 -- 172.21.15.5:0/2888888612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcae4005d10 con 0x7fcaec15e0a0 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.066+0000 7fcae1ffb640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.067+0000 7fcae1ffb640 1 -- 172.21.15.5:0/2888888612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcae408b080 con 0x7fcaec15e0a0 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.067+0000 7fcaf139a640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.067+0000 7fcaf139a640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcad006b4d0 0x7fcad006d990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcae8034000 tx=0x7fcae802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.071+0000 7fcae1ffb640 1 -- 172.21.15.5:0/2888888612 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcae4022030 con 0x7fcaec15e0a0 2024-04-25T08:59:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.287+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcaec0b4df0 con 0x7fcaec15e0a0 2024-04-25T08:59:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.288+0000 7fcae1ffb640 1 -- 172.21.15.5:0/2888888612 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fcae4010040 con 0x7fcaec15e0a0 2024-04-25T08:59:49.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:49.278 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:48.481928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcad006b4d0 msgr2=0x7fcad006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcad006b4d0 0x7fcad006d990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcae8034000 tx=0x7fcae802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15e0a0 msgr2=0x7fcaec15c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15e0a0 0x7fcaec15c710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcae400efc0 tx=0x7fcae400c490 comp rx=0 tx=0).stop 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 shutdown_connections 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15e0a0 0x7fcaec15c710 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaec0d3df0 0x7fcaec0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 --2- 172.21.15.5:0/2888888612 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaec0d3990 0x7fcaec1f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 >> 172.21.15.5:0/2888888612 conn(0x7fcaec0668f0 msgr2=0x7fcaec0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 shutdown_connections 2024-04-25T08:59:49.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.290+0000 7fcaf35fe640 1 -- 172.21.15.5:0/2888888612 wait complete. 2024-04-25T08:59:49.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path / 2024-04-25T08:59:49.399 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T08:59:49.399 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T08:59:49.399 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T08:59:49.408 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:59:49.408 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:59:49.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:49.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:49.504 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:59:49.504 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:49.504 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:49.520 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:49.520 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:49.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.727+0000 7f0516709640 1 Processor -- start 2024-04-25T08:59:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.727+0000 7f0516709640 1 -- start start 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f0516709640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f051015de70 0x7f05100b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f0516709640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 0x7f05100b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f0516709640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05100d20e0 con 0x7f05100b7130 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f0516709640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100d2a10 con 0x7f051015de70 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f0516709640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05100d23c0 con 0x7f05100b2cc0 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f051015de70 0x7f05100b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f051015de70 0x7f05100b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43552/0 (socket says 172.21.15.5:43552) 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f0514ca6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f05100b7130 0x7f05100ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42842/0 (socket says 172.21.15.5:42842) 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050ffff640 1 -- 172.21.15.5:0/2289993024 learned_addr learned my addr 172.21.15.5:0/2289993024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050f7fe640 1 --2- 172.21.15.5:0/2289993024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 0x7f05100b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050ffff640 1 -- 172.21.15.5:0/2289993024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 msgr2=0x7f05100b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050ffff640 1 --2- 172.21.15.5:0/2289993024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 0x7f05100b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050ffff640 1 -- 172.21.15.5:0/2289993024 >> v1:172.21.15.5:6789/0 conn(0x7f05100b7130 legacy=0x7f05100ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050ffff640 1 -- 172.21.15.5:0/2289993024 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100d26a0 con 0x7f051015de70 2024-04-25T08:59:49.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.728+0000 7f050effd640 1 -- 172.21.15.5:0/2289993024 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631900639 0 0) 0x7f05100d20e0 con 0x7f05100b7130 2024-04-25T08:59:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.729+0000 7f050ffff640 1 --2- 172.21.15.5:0/2289993024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051015de70 0x7f05100b93e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009870 tx=0x7f04f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23953ef8a85e0521 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.729+0000 7f050effd640 1 -- 172.21.15.5:0/2289993024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8037070 con 0x7f051015de70 2024-04-25T08:59:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.729+0000 7f050effd640 1 -- 172.21.15.5:0/2289993024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8032440 con 0x7f051015de70 2024-04-25T08:59:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.729+0000 7f050effd640 1 -- 172.21.15.5:0/2289993024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8032810 con 0x7f051015de70 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 -- 172.21.15.5:0/2289993024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051015de70 msgr2=0x7f05100b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 --2- 172.21.15.5:0/2289993024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051015de70 0x7f05100b93e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009870 tx=0x7f04f802a270 comp rx=0 tx=0).stop 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 -- 172.21.15.5:0/2289993024 shutdown_connections 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 --2- 172.21.15.5:0/2289993024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 0x7f05100b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 --2- 172.21.15.5:0/2289993024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051015de70 0x7f05100b93e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 -- 172.21.15.5:0/2289993024 >> 172.21.15.5:0/2289993024 conn(0x7f051006b000 msgr2=0x7f051006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 -- 172.21.15.5:0/2289993024 shutdown_connections 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.730+0000 7f0516709640 1 -- 172.21.15.5:0/2289993024 wait complete. 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.731+0000 7f0516709640 1 Processor -- start 2024-04-25T08:59:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.731+0000 7f0516709640 1 -- start start 2024-04-25T08:59:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f0516709640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 0x7f05100c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f0516709640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05100b7130 0x7f05101f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f0516709640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051015de70 0x7f05101f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f0516709640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05100cf080 con 0x7f05100b7130 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f0516709640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05100cef00 con 0x7f051015de70 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f0516709640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05100cf200 con 0x7f05100b2cc0 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05100b7130 0x7f05101f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05100b7130 0x7f05101f7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43554/0 (socket says 172.21.15.5:43554) 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 -- 172.21.15.5:0/3172873499 learned_addr learned my addr 172.21.15.5:0/3172873499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 -- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 msgr2=0x7f05100c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 0x7f05100c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 -- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051015de70 msgr2=0x7f05101f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051015de70 0x7f05101f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.732+0000 7f050f7fe640 1 -- 172.21.15.5:0/3172873499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100cc1f0 con 0x7f05100b7130 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.733+0000 7f050f7fe640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05100b7130 0x7f05101f7380 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f050000d800 tx=0x7f050000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.733+0000 7f050cff9640 1 -- 172.21.15.5:0/3172873499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000b6c0 con 0x7f05100b7130 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.733+0000 7f050cff9640 1 -- 172.21.15.5:0/3172873499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500019070 con 0x7f05100b7130 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.733+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05100c86a0 con 0x7f05100b7130 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.733+0000 7f050cff9640 1 -- 172.21.15.5:0/3172873499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000ba80 con 0x7f05100b7130 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.733+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05100b3630 con 0x7f05100b7130 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.734+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051004ef20 con 0x7f05100b7130 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.734+0000 7f050cff9640 1 -- 172.21.15.5:0/3172873499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f050000bc20 con 0x7f05100b7130 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.735+0000 7f050cff9640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04f006b4d0 0x7f04f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.735+0000 7f050cff9640 1 -- 172.21.15.5:0/3172873499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f050008a690 con 0x7f05100b7130 2024-04-25T08:59:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.735+0000 7f050ffff640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04f006b4d0 0x7f04f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.736+0000 7f050ffff640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04f006b4d0 0x7f04f006d990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f04f8034000 tx=0x7f04f802c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.739+0000 7f050cff9640 1 -- 172.21.15.5:0/3172873499 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05100cc1f0 con 0x7f05100b7130 2024-04-25T08:59:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.921+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05100d05a0 con 0x7f05100b7130 2024-04-25T08:59:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.922+0000 7f050cff9640 1 -- 172.21.15.5:0/3172873499 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16621 (secure 0 0 0) 0x7f050001c360 con 0x7f05100b7130 2024-04-25T08:59:49.912 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:49.912 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:26.620146+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:14.076773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:14.788001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04f006b4d0 msgr2=0x7f04f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04f006b4d0 0x7f04f006d990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f04f8034000 tx=0x7f04f802c000 comp rx=0 tx=0).stop 2024-04-25T08:59:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05100b7130 msgr2=0x7f05101f7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05100b7130 0x7f05101f7380 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f050000d800 tx=0x7f050000dcc0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 shutdown_connections 2024-04-25T08:59:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04f006b4d0 0x7f04f006d990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051015de70 0x7f05101f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05100b7130 0x7f05101f7380 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 --2- 172.21.15.5:0/3172873499 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05100b2cc0 0x7f05100c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.924+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 >> 172.21.15.5:0/3172873499 conn(0x7f051006b000 msgr2=0x7f05100d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.925+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 shutdown_connections 2024-04-25T08:59:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:49.925+0000 7f0516709640 1 -- 172.21.15.5:0/3172873499 wait complete. 2024-04-25T08:59:49.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:59:14.076773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:59:14.788001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:49.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:50.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.039+0000 7efe40a1f640 1 Processor -- start 2024-04-25T08:59:50.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.039+0000 7efe40a1f640 1 -- start start 2024-04-25T08:59:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.040+0000 7efe40a1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe3c15c0f0 0x7efe3c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.040+0000 7efe40a1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0cf7a0 con 0x7efe3c0b24b0 2024-04-25T08:59:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.040+0000 7efe40a1f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0d24e0 con 0x7efe3c0d0610 2024-04-25T08:59:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.040+0000 7efe40a1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0cd350 con 0x7efe3c15c0f0 2024-04-25T08:59:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.040+0000 7efe3a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe3c15c0f0 0x7efe3c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.040+0000 7efe39d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efe3c0b24b0 0x7efe3c0cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42844/0 (socket says 172.21.15.5:42844) 2024-04-25T08:59:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.040+0000 7efe39d9b640 1 -- 172.21.15.5:0/1358120031 learned_addr learned my addr 172.21.15.5:0/1358120031 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.041+0000 7efe3a59c640 1 -- 172.21.15.5:0/1358120031 >> v1:172.21.15.80:6789/0 conn(0x7efe3c0d0610 legacy=0x7efe3c0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.041+0000 7efe3a59c640 1 -- 172.21.15.5:0/1358120031 >> v1:172.21.15.5:6789/0 conn(0x7efe3c0b24b0 legacy=0x7efe3c0cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.041+0000 7efe3a59c640 1 -- 172.21.15.5:0/1358120031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c0d27c0 con 0x7efe3c15c0f0 2024-04-25T08:59:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.041+0000 7efe3959a640 1 -- 172.21.15.5:0/1358120031 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642499420 0 0) 0x7efe3c0cf7a0 con 0x7efe3c0b24b0 2024-04-25T08:59:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.041+0000 7efe3a59c640 1 --2- 172.21.15.5:0/1358120031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c0cd7e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efe340097a0 tx=0x7efe3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dd3f2311458213 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe3959a640 1 -- 172.21.15.5:0/1358120031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34037070 con 0x7efe3c15c0f0 2024-04-25T08:59:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe3959a640 1 -- 172.21.15.5:0/1358120031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34032440 con 0x7efe3c15c0f0 2024-04-25T08:59:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe3959a640 1 -- 172.21.15.5:0/1358120031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34032810 con 0x7efe3c15c0f0 2024-04-25T08:59:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe40a1f640 1 -- 172.21.15.5:0/1358120031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 msgr2=0x7efe3c0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe40a1f640 1 --2- 172.21.15.5:0/1358120031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c0cd7e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efe340097a0 tx=0x7efe3402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe40a1f640 1 -- 172.21.15.5:0/1358120031 shutdown_connections 2024-04-25T08:59:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe40a1f640 1 --2- 172.21.15.5:0/1358120031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c0cd7e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe40a1f640 1 -- 172.21.15.5:0/1358120031 >> 172.21.15.5:0/1358120031 conn(0x7efe3c0d1920 msgr2=0x7efe3c0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe40a1f640 1 -- 172.21.15.5:0/1358120031 shutdown_connections 2024-04-25T08:59:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.042+0000 7efe40a1f640 1 -- 172.21.15.5:0/1358120031 wait complete. 2024-04-25T08:59:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 Processor -- start 2024-04-25T08:59:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 -- start start 2024-04-25T08:59:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe3c0b24b0 0x7efe3c1eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c0d0610 0x7efe3c0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0cdd20 con 0x7efe3c15c0f0 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0cfa40 con 0x7efe3c0d0610 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.044+0000 7efe40a1f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0cdea0 con 0x7efe3c0b24b0 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c1f4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43582/0 (socket says 172.21.15.5:43582) 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 -- 172.21.15.5:0/2870042215 learned_addr learned my addr 172.21.15.5:0/2870042215 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3a59c640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe3c0b24b0 0x7efe3c1eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe39d9b640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c0d0610 0x7efe3c0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 -- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe3c0b24b0 msgr2=0x7efe3c1eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe3c0b24b0 0x7efe3c1eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 -- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c0d0610 msgr2=0x7efe3c0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c0d0610 0x7efe3c0c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 -- 172.21.15.5:0/2870042215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c0ca9e0 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe3ad9d640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c1f4e80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c700 tx=0x7efe2c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe32ffd640 1 -- 172.21.15.5:0/2870042215 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c016020 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe32ffd640 1 -- 172.21.15.5:0/2870042215 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00aa50 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c0cacc0 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe32ffd640 1 -- 172.21.15.5:0/2870042215 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00ce10 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.045+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c0cb280 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.046+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c04ef20 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.047+0000 7efe32ffd640 1 -- 172.21.15.5:0/2870042215 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe2c019020 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.047+0000 7efe32ffd640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe1c06b4d0 0x7efe1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.047+0000 7efe32ffd640 1 -- 172.21.15.5:0/2870042215 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efe2c08a370 con 0x7efe3c15c0f0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.048+0000 7efe3a59c640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe1c06b4d0 0x7efe1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.048+0000 7efe3a59c640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe1c06b4d0 0x7efe1c06d990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efe34034000 tx=0x7efe3402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.051+0000 7efe32ffd640 1 -- 172.21.15.5:0/2870042215 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe2c020020 con 0x7efe3c15c0f0 2024-04-25T08:59:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.230+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe3c0b7530 con 0x7efe3c15c0f0 2024-04-25T08:59:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.230+0000 7efe32ffd640 1 -- 172.21.15.5:0/2870042215 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe2c058b60 con 0x7efe3c15c0f0 2024-04-25T08:59:50.220 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe1c06b4d0 msgr2=0x7efe1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe1c06b4d0 0x7efe1c06d990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efe34034000 tx=0x7efe3402e000 comp rx=0 tx=0).stop 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 msgr2=0x7efe3c1f4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c1f4e80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c700 tx=0x7efe2c00cbc0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 shutdown_connections 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe1c06b4d0 0x7efe1c06d990 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe3c15c0f0 0x7efe3c1f4e80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe3c0d0610 0x7efe3c0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 --2- 172.21.15.5:0/2870042215 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe3c0b24b0 0x7efe3c1eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 >> 172.21.15.5:0/2870042215 conn(0x7efe3c0d1920 msgr2=0x7efe3c0c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 shutdown_connections 2024-04-25T08:59:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.232+0000 7efe40a1f640 1 -- 172.21.15.5:0/2870042215 wait complete. 2024-04-25T08:59:50.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:59:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.346+0000 7f440d122640 1 Processor -- start 2024-04-25T08:59:50.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.346+0000 7f440d122640 1 -- start start 2024-04-25T08:59:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f440d122640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44080b2850 0x7f44080cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f440d122640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4408072690 con 0x7f44080b4550 2024-04-25T08:59:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f440d122640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44080b2ca0 con 0x7f44080ae690 2024-04-25T08:59:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f440d122640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4408071ff0 con 0x7f44080b2850 2024-04-25T08:59:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f440659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f44080b4550 0x7f44080ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42846/0 (socket says 172.21.15.5:42846) 2024-04-25T08:59:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f440659c640 1 -- 172.21.15.5:0/2712474496 learned_addr learned my addr 172.21.15.5:0/2712474496 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f440759e640 1 --2- 172.21.15.5:0/2712474496 >> v2:172.21.15.80:3300/0 conn(0x7f44080b2850 0x7f44080cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152726945 0 0) 0x7f4408072690 con 0x7f44080b4550 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.347+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f0005730 con 0x7f44080b4550 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1451311129 0 0) 0x7f43f0005730 con 0x7f44080b4550 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 >> v2:172.21.15.80:3300/0 conn(0x7f44080b2850 msgr2=0x7f44080cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 --2- 172.21.15.5:0/2712474496 >> v2:172.21.15.80:3300/0 conn(0x7f44080b2850 0x7f44080cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 >> v1:172.21.15.80:6789/0 conn(0x7f44080ae690 legacy=0x7f44080aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080b2f50 con 0x7f44080b4550 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f43fc001670 con 0x7f44080b4550 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 >> v1:172.21.15.5:6789/0 conn(0x7f44080b4550 legacy=0x7f44080ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43f0005bc0 0x7f43f0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f43f0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43f00073d0 0x7f43f000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f000e340 con 0x7f43f0006a10 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f000e4f0 con 0x7f43f0005bc0 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f000e6f0 con 0x7f43f00073d0 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440659c640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f43f0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f4406d9d640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43f0005bc0 0x7f43f0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440759e640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43f00073d0 0x7f43f000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440659c640 1 -- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43f00073d0 msgr2=0x7f43f000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440659c640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43f00073d0 0x7f43f000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440659c640 1 -- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43f0005bc0 msgr2=0x7f43f0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440659c640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43f0005bc0 0x7f43f0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440659c640 1 -- 172.21.15.5:0/2712474496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0005730 con 0x7f43f0006a10 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.348+0000 7f440759e640 1 -- 172.21.15.5:0/2712474496 reap_dead start 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.349+0000 7f440659c640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f43f0006e90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00c210 tx=0x7f43f0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a465fe8dbc0d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.349+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc007d30 con 0x7f43f0006a10 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.349+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc005af0 con 0x7f43f0006a10 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.349+0000 7f4405d9b640 1 -- 172.21.15.5:0/2712474496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc007070 con 0x7f43f0006a10 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.350+0000 7f440d122640 1 -- 172.21.15.5:0/2712474496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 msgr2=0x7f43f0006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.350+0000 7f440d122640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f43f0006e90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00c210 tx=0x7f43f0007a40 comp rx=0 tx=0).stop 2024-04-25T08:59:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.350+0000 7f440d122640 1 -- 172.21.15.5:0/2712474496 shutdown_connections 2024-04-25T08:59:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.350+0000 7f440d122640 1 --2- 172.21.15.5:0/2712474496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f43f0006e90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.350+0000 7f440d122640 1 -- 172.21.15.5:0/2712474496 >> 172.21.15.5:0/2712474496 conn(0x7f44080b1550 msgr2=0x7f44080b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.350+0000 7f440d122640 1 -- 172.21.15.5:0/2712474496 shutdown_connections 2024-04-25T08:59:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.350+0000 7f440d122640 1 -- 172.21.15.5:0/2712474496 wait complete. 2024-04-25T08:59:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.351+0000 7f440d122640 1 Processor -- start 2024-04-25T08:59:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.351+0000 7f440d122640 1 -- start start 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440d122640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f4408154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440d122640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44081ef9f0 0x7f440815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440d122640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4408151d70 0x7f44080ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440d122640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080cd990 con 0x7f43f0006a10 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440d122640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080cd6b0 con 0x7f44081ef9f0 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440d122640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080cdc70 con 0x7f4408151d70 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f4408154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f4408154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43594/0 (socket says 172.21.15.5:43594) 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 -- 172.21.15.5:0/2543118483 learned_addr learned my addr 172.21.15.5:0/2543118483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 -- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4408151d70 msgr2=0x7f44080ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440759e640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4408151d70 0x7f44080ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f440659c640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44081ef9f0 0x7f440815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4408151d70 0x7f44080ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 -- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44081ef9f0 msgr2=0x7f440815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44081ef9f0 0x7f440815d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 -- 172.21.15.5:0/2543118483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408152220 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.352+0000 7f4406d9d640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f4408154f60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f440000f620 tx=0x7f440000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.353+0000 7f43ef7fe640 1 -- 172.21.15.5:0/2543118483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44000052e0 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.353+0000 7f43ef7fe640 1 -- 172.21.15.5:0/2543118483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400018070 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.353+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4408155660 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.353+0000 7f43ef7fe640 1 -- 172.21.15.5:0/2543118483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400003810 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.353+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440815ad60 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.354+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440804ef20 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.354+0000 7f43ef7fe640 1 -- 172.21.15.5:0/2543118483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44000039b0 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.355+0000 7f43ef7fe640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43f406b500 0x7f43f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.355+0000 7f43ef7fe640 1 -- 172.21.15.5:0/2543118483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4400089f70 con 0x7f43f0006a10 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.355+0000 7f440659c640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43f406b500 0x7f43f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.355+0000 7f440659c640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43f406b500 0x7f43f406d9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43fc032000 tx=0x7f43fc02d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.359+0000 7f43ef7fe640 1 -- 172.21.15.5:0/2543118483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4400058db0 con 0x7f43f0006a10 2024-04-25T08:59:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.537+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f440806e640 con 0x7f43f0006a10 2024-04-25T08:59:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.537+0000 7f43ef7fe640 1 -- 172.21.15.5:0/2543118483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44000586b0 con 0x7f43f0006a10 2024-04-25T08:59:50.527 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:59:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43f406b500 msgr2=0x7f43f406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43f406b500 0x7f43f406d9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43fc032000 tx=0x7f43fc02d000 comp rx=0 tx=0).stop 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 msgr2=0x7f4408154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f4408154f60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f440000f620 tx=0x7f440000fae0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 shutdown_connections 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43f406b500 0x7f43f406d9c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4408151d70 0x7f44080ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44081ef9f0 0x7f440815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 --2- 172.21.15.5:0/2543118483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43f0006a10 0x7f4408154f60 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 >> 172.21.15.5:0/2543118483 conn(0x7f44080b1550 msgr2=0x7f44080b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 shutdown_connections 2024-04-25T08:59:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.539+0000 7f440d122640 1 -- 172.21.15.5:0/2543118483 wait complete. 2024-04-25T08:59:50.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:59:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.654+0000 7f0b56038640 1 Processor -- start 2024-04-25T08:59:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.654+0000 7f0b56038640 1 -- start start 2024-04-25T08:59:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.654+0000 7f0b56038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b500b24b0 0x7f0b500b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.654+0000 7f0b56038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b500d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.654+0000 7f0b56038640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b500cdef0 con 0x7f0b5015c0f0 2024-04-25T08:59:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.654+0000 7f0b56038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500d08b0 con 0x7f0b500b24b0 2024-04-25T08:59:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.654+0000 7f0b56038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500cd350 con 0x7f0b500cff00 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b500b24b0 0x7f0b500b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0b5015c0f0 0x7f0b500cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42852/0 (socket says 172.21.15.5:42852) 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4f7fe640 1 -- 172.21.15.5:0/884944101 learned_addr learned my addr 172.21.15.5:0/884944101 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4ffff640 1 --2- 172.21.15.5:0/884944101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b500d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4effd640 1 -- 172.21.15.5:0/884944101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 msgr2=0x7f0b500d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4effd640 1 --2- 172.21.15.5:0/884944101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b500d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4effd640 1 -- 172.21.15.5:0/884944101 >> v1:172.21.15.5:6789/0 conn(0x7f0b5015c0f0 legacy=0x7f0b500cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4effd640 1 -- 172.21.15.5:0/884944101 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500cf7a0 con 0x7f0b500b24b0 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4e7fc640 1 -- 172.21.15.5:0/884944101 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475793224 0 0) 0x7f0b500cdef0 con 0x7f0b5015c0f0 2024-04-25T08:59:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.655+0000 7f0b4ffff640 1 --2- 172.21.15.5:0/884944101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b500d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b4effd640 1 --2- 172.21.15.5:0/884944101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b500b2960 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0b440097a0 tx=0x7f0b4402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5928d5312ae756dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b4e7fc640 1 -- 172.21.15.5:0/884944101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44037070 con 0x7f0b500b24b0 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b4e7fc640 1 -- 172.21.15.5:0/884944101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44032440 con 0x7f0b500b24b0 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b4e7fc640 1 -- 172.21.15.5:0/884944101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44032810 con 0x7f0b500b24b0 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 -- 172.21.15.5:0/884944101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 msgr2=0x7f0b500b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 --2- 172.21.15.5:0/884944101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b500b2960 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0b440097a0 tx=0x7f0b4402a180 comp rx=0 tx=0).stop 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 -- 172.21.15.5:0/884944101 shutdown_connections 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 --2- 172.21.15.5:0/884944101 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b500d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 --2- 172.21.15.5:0/884944101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b500b2960 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 -- 172.21.15.5:0/884944101 >> 172.21.15.5:0/884944101 conn(0x7f0b500d1920 msgr2=0x7f0b500d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 -- 172.21.15.5:0/884944101 shutdown_connections 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.656+0000 7f0b56038640 1 -- 172.21.15.5:0/884944101 wait complete. 2024-04-25T08:59:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.657+0000 7f0b56038640 1 Processor -- start 2024-04-25T08:59:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b56038640 1 -- start start 2024-04-25T08:59:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b56038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b5006f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b56038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b5006c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b56038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015c0f0 0x7f0b5006c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b56038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500b3170 con 0x7f0b500b24b0 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b56038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500d27c0 con 0x7f0b5015c0f0 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b56038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500cfa40 con 0x7f0b500cff00 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b5006f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b5006f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43604/0 (socket says 172.21.15.5:43604) 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.658+0000 7f0b4f7fe640 1 -- 172.21.15.5:0/2253759152 learned_addr learned my addr 172.21.15.5:0/2253759152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4ffff640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015c0f0 0x7f0b5006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4effd640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b5006c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4f7fe640 1 -- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 msgr2=0x7f0b5006c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4f7fe640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b5006c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4f7fe640 1 -- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015c0f0 msgr2=0x7f0b5006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4f7fe640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015c0f0 0x7f0b5006c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4f7fe640 1 -- 172.21.15.5:0/2253759152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b501f74d0 con 0x7f0b500b24b0 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b4f7fe640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b5006f880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c430 tx=0x7f0b4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b37fff640 1 -- 172.21.15.5:0/2253759152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400074e0 con 0x7f0b500b24b0 2024-04-25T08:59:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b37fff640 1 -- 172.21.15.5:0/2253759152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b400047e0 con 0x7f0b500b24b0 2024-04-25T08:59:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b37fff640 1 -- 172.21.15.5:0/2253759152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40004bd0 con 0x7f0b500b24b0 2024-04-25T08:59:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b501f77b0 con 0x7f0b500b24b0 2024-04-25T08:59:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.659+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b501f7d70 con 0x7f0b500b24b0 2024-04-25T08:59:50.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.660+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5004ef20 con 0x7f0b500b24b0 2024-04-25T08:59:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.661+0000 7f0b37fff640 1 -- 172.21.15.5:0/2253759152 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b40011070 con 0x7f0b500b24b0 2024-04-25T08:59:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.661+0000 7f0b37fff640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.661+0000 7f0b37fff640 1 -- 172.21.15.5:0/2253759152 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0b40089df0 con 0x7f0b500b24b0 2024-04-25T08:59:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.661+0000 7f0b4effd640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.662+0000 7f0b4effd640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0b44034000 tx=0x7f0b4402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.665+0000 7f0b37fff640 1 -- 172.21.15.5:0/2253759152 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b40058ca0 con 0x7f0b500b24b0 2024-04-25T08:59:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.846+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b500cfce0 con 0x7f0b500b24b0 2024-04-25T08:59:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.846+0000 7f0b37fff640 1 -- 172.21.15.5:0/2253759152 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b400585a0 con 0x7f0b500b24b0 2024-04-25T08:59:50.836 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:59:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3c06b500 msgr2=0x7f0b3c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0b44034000 tx=0x7f0b4402e000 comp rx=0 tx=0).stop 2024-04-25T08:59:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 msgr2=0x7f0b5006f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b5006f880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c430 tx=0x7f0b4000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 shutdown_connections 2024-04-25T08:59:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015c0f0 0x7f0b5006c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500cff00 0x7f0b5006c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 --2- 172.21.15.5:0/2253759152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500b24b0 0x7f0b5006f880 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.848+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 >> 172.21.15.5:0/2253759152 conn(0x7f0b500d1920 msgr2=0x7f0b50159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.849+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 shutdown_connections 2024-04-25T08:59:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.849+0000 7f0b56038640 1 -- 172.21.15.5:0/2253759152 wait complete. 2024-04-25T08:59:50.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:59:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.960+0000 7ff528bb7640 1 Processor -- start 2024-04-25T08:59:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.960+0000 7ff528bb7640 1 -- start start 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.961+0000 7ff528bb7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0e30 0x7ff5240b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.961+0000 7ff528bb7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52406ba50 con 0x7ff5240ce910 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.961+0000 7ff528bb7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52406bd30 con 0x7ff5240b0a50 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.961+0000 7ff528bb7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52406b800 con 0x7ff5240b0e30 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff522d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5240ce910 0x7ff5240b1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53744/0 (socket says 172.21.15.5:53744) 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff522d9d640 1 -- 172.21.15.5:0/164369947 learned_addr learned my addr 172.21.15.5:0/164369947 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff521d9b640 1 --2- 172.21.15.5:0/164369947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0e30 0x7ff5240b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85832477 0 0) 0x7ff52406ba50 con 0x7ff5240ce910 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff510003520 con 0x7ff5240ce910 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041807476 0 0) 0x7ff52406bd30 con 0x7ff5240b0a50 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff52406ba50 con 0x7ff5240b0a50 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023039261 0 0) 0x7ff510003520 con 0x7ff5240ce910 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff521d9b640 1 -- 172.21.15.5:0/164369947 >> v1:172.21.15.80:6789/0 conn(0x7ff5240b0a50 legacy=0x7ff5240ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff521d9b640 1 -- 172.21.15.5:0/164369947 >> v1:172.21.15.5:6789/0 conn(0x7ff5240ce910 legacy=0x7ff5240b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.962+0000 7ff521d9b640 1 -- 172.21.15.5:0/164369947 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52406c010 con 0x7ff5240b0e30 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.963+0000 7ff521d9b640 1 --2- 172.21.15.5:0/164369947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0e30 0x7ff5240b1230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0097d0 tx=0x7ff50c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd4581a747adb9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.963+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c037070 con 0x7ff5240b0e30 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.963+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c02ab90 con 0x7ff5240b0e30 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.963+0000 7ff52159a640 1 -- 172.21.15.5:0/164369947 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140019f0 con 0x7ff5240b0e30 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.964+0000 7ff528bb7640 1 -- 172.21.15.5:0/164369947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0e30 msgr2=0x7ff5240b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.964+0000 7ff528bb7640 1 --2- 172.21.15.5:0/164369947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0e30 0x7ff5240b1230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0097d0 tx=0x7ff50c02a100 comp rx=0 tx=0).stop 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.964+0000 7ff528bb7640 1 -- 172.21.15.5:0/164369947 shutdown_connections 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.964+0000 7ff528bb7640 1 --2- 172.21.15.5:0/164369947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0e30 0x7ff5240b1230 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.964+0000 7ff528bb7640 1 -- 172.21.15.5:0/164369947 >> 172.21.15.5:0/164369947 conn(0x7ff5240d18f0 msgr2=0x7ff5240d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.964+0000 7ff528bb7640 1 -- 172.21.15.5:0/164369947 shutdown_connections 2024-04-25T08:59:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.964+0000 7ff528bb7640 1 -- 172.21.15.5:0/164369947 wait complete. 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.965+0000 7ff528bb7640 1 Processor -- start 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.965+0000 7ff528bb7640 1 -- start start 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff528bb7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0a50 0x7ff5241f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff528bb7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5240b0e30 0x7ff5240b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff528bb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5240ce910 0x7ff5240b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff528bb7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240b2bf0 con 0x7ff5240b0e30 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff528bb7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240cfd60 con 0x7ff5240ce910 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff528bb7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5241f7230 con 0x7ff5240b0a50 2024-04-25T08:59:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5240b0e30 0x7ff5240b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5240b0e30 0x7ff5240b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44230/0 (socket says 172.21.15.5:44230) 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 -- 172.21.15.5:0/394366099 learned_addr learned my addr 172.21.15.5:0/394366099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff522d9d640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5240ce910 0x7ff5240b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff52259c640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0a50 0x7ff5241f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 -- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0a50 msgr2=0x7ff5241f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0a50 0x7ff5241f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 -- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5240ce910 msgr2=0x7ff5240b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5240ce910 0x7ff5240b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 -- 172.21.15.5:0/394366099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5241f7510 con 0x7ff5240b0e30 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff52259c640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0a50 0x7ff5241f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.966+0000 7ff521d9b640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5240b0e30 0x7ff5240b54f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff50c035040 tx=0x7ff50c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.967+0000 7ff51affd640 1 -- 172.21.15.5:0/394366099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c037050 con 0x7ff5240b0e30 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.967+0000 7ff51affd640 1 -- 172.21.15.5:0/394366099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c043070 con 0x7ff5240b0e30 2024-04-25T08:59:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.967+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5241f77f0 con 0x7ff5240b0e30 2024-04-25T08:59:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.967+0000 7ff51affd640 1 -- 172.21.15.5:0/394366099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c003da0 con 0x7ff5240b0e30 2024-04-25T08:59:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.967+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5241f6cc0 con 0x7ff5240b0e30 2024-04-25T08:59:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.968+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5240cbd20 con 0x7ff5240b0e30 2024-04-25T08:59:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.968+0000 7ff51affd640 1 -- 172.21.15.5:0/394366099 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff50c048460 con 0x7ff5240b0e30 2024-04-25T08:59:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.968+0000 7ff51affd640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff50406b4d0 0x7ff50406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.968+0000 7ff51affd640 1 -- 172.21.15.5:0/394366099 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff50c0aaa70 con 0x7ff5240b0e30 2024-04-25T08:59:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.969+0000 7ff52259c640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff50406b4d0 0x7ff50406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.969+0000 7ff52259c640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff50406b4d0 0x7ff50406d990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0011e0 tx=0x7ff51c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:50.973+0000 7ff51affd640 1 -- 172.21.15.5:0/394366099 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff50c0799d0 con 0x7ff5240b0e30 2024-04-25T08:59:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.163+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff5241f6f80 con 0x7ff5240b0e30 2024-04-25T08:59:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.163+0000 7ff51affd640 1 -- 172.21.15.5:0/394366099 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff50c0792d0 con 0x7ff5240b0e30 2024-04-25T08:59:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff50406b4d0 msgr2=0x7ff50406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff50406b4d0 0x7ff50406d990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0011e0 tx=0x7ff51c009040 comp rx=0 tx=0).stop 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5240b0e30 msgr2=0x7ff5240b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5240b0e30 0x7ff5240b54f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff50c035040 tx=0x7ff50c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 shutdown_connections 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff50406b4d0 0x7ff50406d990 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5240ce910 0x7ff5240b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5240b0e30 0x7ff5240b54f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 --2- 172.21.15.5:0/394366099 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5240b0a50 0x7ff5241f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 >> 172.21.15.5:0/394366099 conn(0x7ff5240d18f0 msgr2=0x7ff5240ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 shutdown_connections 2024-04-25T08:59:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:51.165+0000 7ff528bb7640 1 -- 172.21.15.5:0/394366099 wait complete. 2024-04-25T08:59:51.165 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:59:51.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:51.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:52.454 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T08:59:52.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.454 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:59:52.469 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:59:52.469 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:52.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:52.486 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T08:59:52.487 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:52.525 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:59:52.526 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T08:59:52.526 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:52.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:52.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.677+0000 7f1ba8353640 1 Processor -- start 2024-04-25T08:59:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.677+0000 7f1ba8353640 1 -- start start 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba8353640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 0x7f1ba00cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba8353640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ba00cfec0 0x7f1ba00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba8353640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba00cfc00 con 0x7f1ba00cc460 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba8353640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00d0840 con 0x7f1ba00cfec0 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba8353640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00cf250 con 0x7f1ba015f100 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba68f0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ba00cc460 0x7f1ba00cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53756/0 (socket says 172.21.15.5:53756) 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba68f0640 1 -- 172.21.15.5:0/1388389593 learned_addr learned my addr 172.21.15.5:0/1388389593 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba58ee640 1 --2- 172.21.15.5:0/1388389593 >> v2:172.21.15.80:3300/0 conn(0x7f1ba00cfec0 0x7f1ba00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba60ef640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 0x7f1ba00cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060140745 0 0) 0x7f1ba00cfc00 con 0x7f1ba00cc460 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b8c003520 con 0x7f1ba00cc460 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981404725 0 0) 0x7f1b8c003520 con 0x7f1ba00cc460 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 msgr2=0x7f1ba00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 0x7f1ba00cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 >> v2:172.21.15.80:3300/0 conn(0x7f1ba00cfec0 msgr2=0x7f1ba00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 --2- 172.21.15.5:0/1388389593 >> v2:172.21.15.80:3300/0 conn(0x7f1ba00cfec0 0x7f1ba00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba00cec90 con 0x7f1ba00cc460 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1b980019f0 con 0x7f1ba00cc460 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 >> v1:172.21.15.5:6789/0 conn(0x7f1ba00cc460 legacy=0x7f1ba00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c0039b0 0x7f1b8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c004800 0x7f1b8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 0x7f1b8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00d0840 con 0x7f1b8c004800 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00cf250 con 0x7f1b8c0039b0 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.678+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c00b9c0 con 0x7f1ba015f100 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba58ee640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c004800 0x7f1b8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba60ef640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c0039b0 0x7f1b8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba68f0640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 0x7f1b8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba58ee640 1 -- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 msgr2=0x7f1b8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba58ee640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ba015f100 0x7f1b8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba58ee640 1 -- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c0039b0 msgr2=0x7f1b8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba58ee640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c0039b0 0x7f1b8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.679+0000 7f1ba58ee640 1 -- 172.21.15.5:0/1388389593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c003520 con 0x7f1b8c004800 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba58ee640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c004800 0x7f1b8c004c80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009ac0 tx=0x7f1b8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aaed3c5cceddca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c036070 con 0x7f1b8c004800 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c031400 con 0x7f1b8c004800 2024-04-25T08:59:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba50ed640 1 -- 172.21.15.5:0/1388389593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c009690 con 0x7f1b8c004800 2024-04-25T08:59:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba8353640 1 -- 172.21.15.5:0/1388389593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c004800 msgr2=0x7f1b8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba8353640 1 --2- 172.21.15.5:0/1388389593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c004800 0x7f1b8c004c80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009ac0 tx=0x7f1b8c005830 comp rx=0 tx=0).stop 2024-04-25T08:59:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba68f0640 1 -- 172.21.15.5:0/1388389593 reap_dead start 2024-04-25T08:59:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba8353640 1 -- 172.21.15.5:0/1388389593 shutdown_connections 2024-04-25T08:59:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba8353640 1 -- 172.21.15.5:0/1388389593 >> 172.21.15.5:0/1388389593 conn(0x7f1ba00d18e0 msgr2=0x7f1ba00d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba8353640 1 -- 172.21.15.5:0/1388389593 shutdown_connections 2024-04-25T08:59:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.680+0000 7f1ba8353640 1 -- 172.21.15.5:0/1388389593 wait complete. 2024-04-25T08:59:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.681+0000 7f1ba8353640 1 Processor -- start 2024-04-25T08:59:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba8353640 1 -- start start 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba8353640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1b8c004800 0x7f1ba009e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba8353640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ba00b5ce0 0x7f1ba015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba8353640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba00ca000 0x7f1ba00b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba8353640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00d2600 con 0x7f1ba00ca000 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba8353640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00c5560 con 0x7f1ba00b5ce0 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba8353640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00ce920 con 0x7f1b8c004800 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba68f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba00ca000 0x7f1ba00b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba68f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba00ca000 0x7f1ba00b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44248/0 (socket says 172.21.15.5:44248) 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.682+0000 7f1ba68f0640 1 -- 172.21.15.5:0/943470122 learned_addr learned my addr 172.21.15.5:0/943470122 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba60ef640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1b8c004800 0x7f1ba009e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba58ee640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ba00b5ce0 0x7f1ba015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba68f0640 1 -- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1b8c004800 msgr2=0x7f1ba009e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba68f0640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1b8c004800 0x7f1ba009e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba68f0640 1 -- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ba00b5ce0 msgr2=0x7f1ba015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba68f0640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ba00b5ce0 0x7f1ba015ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba68f0640 1 -- 172.21.15.5:0/943470122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba015b3a0 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba68f0640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba00ca000 0x7f1ba00b27e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ba006e1a0 tx=0x7f1b98007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1b96ffd640 1 -- 172.21.15.5:0/943470122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800ac40 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1b96ffd640 1 -- 172.21.15.5:0/943470122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b98019070 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba00b5a20 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1b96ffd640 1 -- 172.21.15.5:0/943470122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980133f0 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.683+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba009eff0 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.684+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba004ef20 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.684+0000 7f1b96ffd640 1 -- 172.21.15.5:0/943470122 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1b980135b0 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.685+0000 7f1b96ffd640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b8406b500 0x7f1b8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.685+0000 7f1b96ffd640 1 -- 172.21.15.5:0/943470122 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1b9808a810 con 0x7f1ba00ca000 2024-04-25T08:59:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.685+0000 7f1ba60ef640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b8406b500 0x7f1b8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.685+0000 7f1ba60ef640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b8406b500 0x7f1b8406d9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b900098a0 tx=0x7f1b90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.689+0000 7f1b96ffd640 1 -- 172.21.15.5:0/943470122 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b98059650 con 0x7f1ba00ca000 2024-04-25T08:59:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.910+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ba00c4d80 con 0x7f1ba00ca000 2024-04-25T08:59:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.911+0000 7f1b96ffd640 1 -- 172.21.15.5:0/943470122 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f1b98058f50 con 0x7f1ba00ca000 2024-04-25T08:59:52.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:52.901 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:52.482011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:52.901 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-04-25T08:59:52.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b8406b500 msgr2=0x7f1b8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b8406b500 0x7f1b8406d9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b900098a0 tx=0x7f1b90008040 comp rx=0 tx=0).stop 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba00ca000 msgr2=0x7f1ba00b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba00ca000 0x7f1ba00b27e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ba006e1a0 tx=0x7f1b98007bd0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 shutdown_connections 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1b8406b500 0x7f1b8406d9c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba00ca000 0x7f1ba00b27e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ba00b5ce0 0x7f1ba015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 --2- 172.21.15.5:0/943470122 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1b8c004800 0x7f1ba009e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 >> 172.21.15.5:0/943470122 conn(0x7f1ba00d18e0 msgr2=0x7f1ba00c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 shutdown_connections 2024-04-25T08:59:52.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:52.913+0000 7f1ba8353640 1 -- 172.21.15.5:0/943470122 wait complete. 2024-04-25T08:59:52.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:53.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.025+0000 7f557a542640 1 Processor -- start 2024-04-25T08:59:53.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.025+0000 7f557a542640 1 -- start start 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f557a542640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55740d3990 0x7f55740d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f557a542640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740b29c0 con 0x7f557415e0a0 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f557a542640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740d2080 con 0x7f55740b6f50 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f557a542640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740d4330 con 0x7f55740d3990 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f55737fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55740d3990 0x7f55740d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f5573fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f557415e0a0 0x7f55740d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53758/0 (socket says 172.21.15.5:53758) 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f5573fff640 1 -- 172.21.15.5:0/398564026 learned_addr learned my addr 172.21.15.5:0/398564026 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f5572ffd640 1 -- 172.21.15.5:0/398564026 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504054025 0 0) 0x7f55740b29c0 con 0x7f557415e0a0 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f5572ffd640 1 -- 172.21.15.5:0/398564026 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f555c003520 con 0x7f557415e0a0 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f55737fe640 1 -- 172.21.15.5:0/398564026 >> v1:172.21.15.80:6789/0 conn(0x7f55740b6f50 legacy=0x7f55740b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f55737fe640 1 -- 172.21.15.5:0/398564026 >> v1:172.21.15.5:6789/0 conn(0x7f557415e0a0 legacy=0x7f55740d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.026+0000 7f55737fe640 1 -- 172.21.15.5:0/398564026 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740d2360 con 0x7f55740d3990 2024-04-25T08:59:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.027+0000 7f55737fe640 1 --2- 172.21.15.5:0/398564026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740d3990 0x7f55740d3df0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f55680097a0 tx=0x7f556802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88455bf6e25887f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.027+0000 7f5572ffd640 1 -- 172.21.15.5:0/398564026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568037070 con 0x7f55740d3990 2024-04-25T08:59:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.027+0000 7f5572ffd640 1 -- 172.21.15.5:0/398564026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568032440 con 0x7f55740d3990 2024-04-25T08:59:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.027+0000 7f5572ffd640 1 -- 172.21.15.5:0/398564026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568032810 con 0x7f55740d3990 2024-04-25T08:59:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.028+0000 7f557a542640 1 -- 172.21.15.5:0/398564026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740d3990 msgr2=0x7f55740d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.028+0000 7f557a542640 1 --2- 172.21.15.5:0/398564026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740d3990 0x7f55740d3df0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f55680097a0 tx=0x7f556802a230 comp rx=0 tx=0).stop 2024-04-25T08:59:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.028+0000 7f557a542640 1 -- 172.21.15.5:0/398564026 shutdown_connections 2024-04-25T08:59:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.028+0000 7f557a542640 1 --2- 172.21.15.5:0/398564026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740d3990 0x7f55740d3df0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.028+0000 7f557a542640 1 -- 172.21.15.5:0/398564026 >> 172.21.15.5:0/398564026 conn(0x7f55740668f0 msgr2=0x7f5574066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.028+0000 7f557a542640 1 -- 172.21.15.5:0/398564026 shutdown_connections 2024-04-25T08:59:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.028+0000 7f557a542640 1 -- 172.21.15.5:0/398564026 wait complete. 2024-04-25T08:59:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.029+0000 7f557a542640 1 Processor -- start 2024-04-25T08:59:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.029+0000 7f557a542640 1 -- start start 2024-04-25T08:59:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f557a542640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740b6f50 0x7f55740cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f557a542640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55740d3990 0x7f55740cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f557a542640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557415e0a0 0x7f557414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f557a542640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740d2920 con 0x7f55740b6f50 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f557a542640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740d1460 con 0x7f557415e0a0 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f557a542640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740d2c00 con 0x7f55740d3990 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740b6f50 0x7f55740cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740b6f50 0x7f55740cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44254/0 (socket says 172.21.15.5:44254) 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 -- 172.21.15.5:0/1128447433 learned_addr learned my addr 172.21.15.5:0/1128447433 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5578adf640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557415e0a0 0x7f557414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f55737fe640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55740d3990 0x7f55740cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 -- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55740d3990 msgr2=0x7f55740cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55740d3990 0x7f55740cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 -- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557415e0a0 msgr2=0x7f557414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557415e0a0 0x7f557414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 -- 172.21.15.5:0/1128447433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557414f4d0 con 0x7f55740b6f50 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.030+0000 7f5573fff640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740b6f50 0x7f55740cb5b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f556400c500 tx=0x7f556400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.031+0000 7f5570ff9640 1 -- 172.21.15.5:0/1128447433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564017070 con 0x7f55740b6f50 2024-04-25T08:59:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.031+0000 7f5570ff9640 1 -- 172.21.15.5:0/1128447433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5564005ce0 con 0x7f55740b6f50 2024-04-25T08:59:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.031+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740cbcb0 con 0x7f55740b6f50 2024-04-25T08:59:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.031+0000 7f5570ff9640 1 -- 172.21.15.5:0/1128447433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564007330 con 0x7f55740b6f50 2024-04-25T08:59:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.031+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55740cc270 con 0x7f55740b6f50 2024-04-25T08:59:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.032+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5574068550 con 0x7f55740b6f50 2024-04-25T08:59:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.032+0000 7f5570ff9640 1 -- 172.21.15.5:0/1128447433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f556401a070 con 0x7f55740b6f50 2024-04-25T08:59:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.032+0000 7f5570ff9640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f556006b4d0 0x7f556006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.033+0000 7f5570ff9640 1 -- 172.21.15.5:0/1128447433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5564089620 con 0x7f55740b6f50 2024-04-25T08:59:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.033+0000 7f55737fe640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f556006b4d0 0x7f556006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.033+0000 7f55737fe640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f556006b4d0 0x7f556006d990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5568034000 tx=0x7f556802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.037+0000 7f5570ff9640 1 -- 172.21.15.5:0/1128447433 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5574068550 con 0x7f55740b6f50 2024-04-25T08:59:53.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.216+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f557404ef20 con 0x7f55740b6f50 2024-04-25T08:59:53.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.217+0000 7f5570ff9640 1 -- 172.21.15.5:0/1128447433 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16621 (secure 0 0 0) 0x7f55640585b0 con 0x7f55740b6f50 2024-04-25T08:59:53.207 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:53.207 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:26.620146+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:14.076773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:14.788001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f556006b4d0 msgr2=0x7f556006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f556006b4d0 0x7f556006d990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5568034000 tx=0x7f556802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740b6f50 msgr2=0x7f55740cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740b6f50 0x7f55740cb5b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f556400c500 tx=0x7f556400c9c0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 shutdown_connections 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f556006b4d0 0x7f556006d990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557415e0a0 0x7f557414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f55740d3990 0x7f55740cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.219+0000 7f557a542640 1 --2- 172.21.15.5:0/1128447433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55740b6f50 0x7f55740cb5b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.220+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 >> 172.21.15.5:0/1128447433 conn(0x7f55740668f0 msgr2=0x7f5574066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.220+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 shutdown_connections 2024-04-25T08:59:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.220+0000 7f557a542640 1 -- 172.21.15.5:0/1128447433 wait complete. 2024-04-25T08:59:53.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:59:14.076773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:59:14.788001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:53.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.334+0000 7fcc63790640 1 Processor -- start 2024-04-25T08:59:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.334+0000 7fcc63790640 1 -- start start 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc63790640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc5c0b3b90 0x7fcc5c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc63790640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c15c0c0 con 0x7fcc5c15bce0 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc63790640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c06cb10 con 0x7fcc5c0cf790 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc63790640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c070e90 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc6152c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc5c15bce0 0x7fcc5c06c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53774/0 (socket says 172.21.15.5:53774) 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc6152c640 1 -- 172.21.15.5:0/1495740974 learned_addr learned my addr 172.21.15.5:0/1495740974 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc61d2d640 1 --2- 172.21.15.5:0/1495740974 >> v2:172.21.15.80:3300/0 conn(0x7fcc5c0b3b90 0x7fcc5c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662500567 0 0) 0x7fcc5c15c0c0 con 0x7fcc5c15bce0 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc48003520 con 0x7fcc5c15bce0 2024-04-25T08:59:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000025144 0 0) 0x7fcc5c06cb10 con 0x7fcc5c0cf790 2024-04-25T08:59:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc5c15c0c0 con 0x7fcc5c0cf790 2024-04-25T08:59:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc61d2d640 1 -- 172.21.15.5:0/1495740974 >> v1:172.21.15.80:6789/0 conn(0x7fcc5c0cf790 legacy=0x7fcc5c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc61d2d640 1 -- 172.21.15.5:0/1495740974 >> v1:172.21.15.5:6789/0 conn(0x7fcc5c15bce0 legacy=0x7fcc5c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.335+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366576753 0 0) 0x7fcc48003520 con 0x7fcc5c15bce0 2024-04-25T08:59:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.336+0000 7fcc61d2d640 1 -- 172.21.15.5:0/1495740974 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c071170 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.336+0000 7fcc61d2d640 1 --2- 172.21.15.5:0/1495740974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c0cfc20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009d90 tx=0x7fcc5402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d79b4392c7b51f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.336+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58001670 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc54007540 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc53fff640 1 -- 172.21.15.5:0/1495740974 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54007910 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc63790640 1 -- 172.21.15.5:0/1495740974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0b3b90 msgr2=0x7fcc5c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc63790640 1 --2- 172.21.15.5:0/1495740974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c0cfc20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009d90 tx=0x7fcc5402a680 comp rx=0 tx=0).stop 2024-04-25T08:59:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc63790640 1 -- 172.21.15.5:0/1495740974 shutdown_connections 2024-04-25T08:59:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc63790640 1 --2- 172.21.15.5:0/1495740974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c0cfc20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc63790640 1 -- 172.21.15.5:0/1495740974 >> 172.21.15.5:0/1495740974 conn(0x7fcc5c0b1550 msgr2=0x7fcc5c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc63790640 1 -- 172.21.15.5:0/1495740974 shutdown_connections 2024-04-25T08:59:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.337+0000 7fcc63790640 1 -- 172.21.15.5:0/1495740974 wait complete. 2024-04-25T08:59:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.338+0000 7fcc63790640 1 Processor -- start 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.338+0000 7fcc63790640 1 -- start start 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc63790640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c14bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc63790640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0cf790 0x7fcc5c15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc63790640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc5c15bce0 0x7fcc5c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc63790640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0b4140 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc63790640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c071730 con 0x7fcc5c0cf790 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc63790640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c071c50 con 0x7fcc5c15bce0 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc6152c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c14bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc6152c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c14bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44260/0 (socket says 172.21.15.5:44260) 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc6152c640 1 -- 172.21.15.5:0/575363009 learned_addr learned my addr 172.21.15.5:0/575363009 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.339+0000 7fcc60d2b640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0cf790 0x7fcc5c15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc61d2d640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc5c15bce0 0x7fcc5c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc6152c640 1 -- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc5c15bce0 msgr2=0x7fcc5c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc6152c640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc5c15bce0 0x7fcc5c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc6152c640 1 -- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0cf790 msgr2=0x7fcc5c15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc6152c640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0cf790 0x7fcc5c15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc6152c640 1 -- 172.21.15.5:0/575363009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0ce350 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc6152c640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c14bc30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c520 tx=0x7fcc5800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc51ffb640 1 -- 172.21.15.5:0/575363009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58017070 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc51ffb640 1 -- 172.21.15.5:0/575363009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc58005ce0 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c0ce630 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc51ffb640 1 -- 172.21.15.5:0/575363009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc580072b0 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.340+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c0cebf0 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.341+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c04ef20 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.342+0000 7fcc51ffb640 1 -- 172.21.15.5:0/575363009 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc5801a070 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.342+0000 7fcc51ffb640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc4006b4d0 0x7fcc4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.342+0000 7fcc51ffb640 1 -- 172.21.15.5:0/575363009 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcc580896e0 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.342+0000 7fcc60d2b640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc4006b4d0 0x7fcc4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.343+0000 7fcc60d2b640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc4006b4d0 0x7fcc4006d990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c1590d0 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.346+0000 7fcc51ffb640 1 -- 172.21.15.5:0/575363009 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc58058530 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.525+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc5c068e10 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.526+0000 7fcc51ffb640 1 -- 172.21.15.5:0/575363009 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc58057e30 con 0x7fcc5c0b3b90 2024-04-25T08:59:53.515 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T08:59:53.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc4006b4d0 msgr2=0x7fcc4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc4006b4d0 0x7fcc4006d990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c1590d0 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc5c0b3b90 msgr2=0x7fcc5c14bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c14bc30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c520 tx=0x7fcc5800c9e0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 shutdown_connections 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc4006b4d0 0x7fcc4006d990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc5c15bce0 0x7fcc5c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc5c0cf790 0x7fcc5c15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 --2- 172.21.15.5:0/575363009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc5c0b3b90 0x7fcc5c14bc30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 >> 172.21.15.5:0/575363009 conn(0x7fcc5c0b1550 msgr2=0x7fcc5c0b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 shutdown_connections 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.528+0000 7fcc63790640 1 -- 172.21.15.5:0/575363009 wait complete. 2024-04-25T08:59:53.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:59:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.641+0000 7f38430f5640 1 Processor -- start 2024-04-25T08:59:53.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f38430f5640 1 -- start start 2024-04-25T08:59:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f38430f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f383c0d0c80 0x7f383c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f38430f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c0d27f0 con 0x7f383c0cc780 2024-04-25T08:59:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f38430f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c0cfee0 con 0x7f383c15e0b0 2024-04-25T08:59:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f38430f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383c0d01c0 con 0x7f383c0d0c80 2024-04-25T08:59:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f383bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f383c0d0c80 0x7f383c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f3841692640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f383c0cc780 0x7f383c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53778/0 (socket says 172.21.15.5:53778) 2024-04-25T08:59:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.642+0000 7f3841692640 1 -- 172.21.15.5:0/3955345109 learned_addr learned my addr 172.21.15.5:0/3955345109 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.643+0000 7f383bfff640 1 -- 172.21.15.5:0/3955345109 >> v1:172.21.15.80:6789/0 conn(0x7f383c15e0b0 legacy=0x7f383c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.643+0000 7f383bfff640 1 -- 172.21.15.5:0/3955345109 >> v1:172.21.15.5:6789/0 conn(0x7f383c0cc780 legacy=0x7f383c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.643+0000 7f383bfff640 1 -- 172.21.15.5:0/3955345109 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0d04a0 con 0x7f383c0d0c80 2024-04-25T08:59:53.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.643+0000 7f383b7fe640 1 -- 172.21.15.5:0/3955345109 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098325998 0 0) 0x7f383c0d27f0 con 0x7f383c0cc780 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.643+0000 7f383bfff640 1 --2- 172.21.15.5:0/3955345109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c06adf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f38280097d0 tx=0x7f382802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426f7a19bfb5a29d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f383b7fe640 1 -- 172.21.15.5:0/3955345109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828037070 con 0x7f383c0d0c80 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f383b7fe640 1 -- 172.21.15.5:0/3955345109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3828032440 con 0x7f383c0d0c80 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f383b7fe640 1 -- 172.21.15.5:0/3955345109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828032810 con 0x7f383c0d0c80 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f38430f5640 1 -- 172.21.15.5:0/3955345109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 msgr2=0x7f383c06adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f38430f5640 1 --2- 172.21.15.5:0/3955345109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c06adf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f38280097d0 tx=0x7f382802a270 comp rx=0 tx=0).stop 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f38430f5640 1 -- 172.21.15.5:0/3955345109 shutdown_connections 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f38430f5640 1 --2- 172.21.15.5:0/3955345109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c06adf0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f38430f5640 1 -- 172.21.15.5:0/3955345109 >> 172.21.15.5:0/3955345109 conn(0x7f383c0d1a20 msgr2=0x7f383c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f38430f5640 1 -- 172.21.15.5:0/3955345109 shutdown_connections 2024-04-25T08:59:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.644+0000 7f38430f5640 1 -- 172.21.15.5:0/3955345109 wait complete. 2024-04-25T08:59:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.645+0000 7f38430f5640 1 Processor -- start 2024-04-25T08:59:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.645+0000 7f38430f5640 1 -- start start 2024-04-25T08:59:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f38430f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f383c0cc780 0x7f383c0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f38430f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f38430f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f383c15e0b0 0x7f383c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f38430f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0cfb90 con 0x7f383c0d0c80 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f38430f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c15e490 con 0x7f383c15e0b0 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f38430f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0ccc30 con 0x7f383c0cc780 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f383bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f383bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c0b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44276/0 (socket says 172.21.15.5:44276) 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.646+0000 7f383bfff640 1 -- 172.21.15.5:0/3126891964 learned_addr learned my addr 172.21.15.5:0/3126891964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f3841692640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f383c15e0b0 0x7f383c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f3840e91640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f383c0cc780 0x7f383c0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f383bfff640 1 -- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f383c0cc780 msgr2=0x7f383c0c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f383bfff640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f383c0cc780 0x7f383c0c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f383bfff640 1 -- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f383c15e0b0 msgr2=0x7f383c157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f383bfff640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f383c15e0b0 0x7f383c157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f383bfff640 1 -- 172.21.15.5:0/3126891964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0c5b30 con 0x7f383c0d0c80 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f3841692640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f383c15e0b0 0x7f383c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f3840e91640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f383c0cc780 0x7f383c0c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f383bfff640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c0b6780 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3828035040 tx=0x7f38280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f38397fa640 1 -- 172.21.15.5:0/3126891964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828037040 con 0x7f383c0d0c80 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f38397fa640 1 -- 172.21.15.5:0/3126891964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3828030770 con 0x7f383c0d0c80 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c0c5e10 con 0x7f383c0d0c80 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f38397fa640 1 -- 172.21.15.5:0/3126891964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828030b60 con 0x7f383c0d0c80 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.647+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c0c63d0 con 0x7f383c0d0c80 2024-04-25T08:59:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.648+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c04ef20 con 0x7f383c0d0c80 2024-04-25T08:59:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.649+0000 7f38397fa640 1 -- 172.21.15.5:0/3126891964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3828044020 con 0x7f383c0d0c80 2024-04-25T08:59:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.649+0000 7f38397fa640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f382006b4d0 0x7f382006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.649+0000 7f38397fa640 1 -- 172.21.15.5:0/3126891964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f38280aa770 con 0x7f383c0d0c80 2024-04-25T08:59:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.649+0000 7f3840e91640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f382006b4d0 0x7f382006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.650+0000 7f3840e91640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f382006b4d0 0x7f382006d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3830000f60 tx=0x7f3830009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.653+0000 7f38397fa640 1 -- 172.21.15.5:0/3126891964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3828032e20 con 0x7f383c0d0c80 2024-04-25T08:59:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.834+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f383c0b79a0 con 0x7f383c0d0c80 2024-04-25T08:59:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.835+0000 7f38397fa640 1 -- 172.21.15.5:0/3126891964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3828079640 con 0x7f383c0d0c80 2024-04-25T08:59:53.824 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T08:59:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.836+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f382006b4d0 msgr2=0x7f382006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.836+0000 7f38430f5640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f382006b4d0 0x7f382006d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3830000f60 tx=0x7f3830009040 comp rx=0 tx=0).stop 2024-04-25T08:59:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 msgr2=0x7f383c0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c0b6780 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3828035040 tx=0x7f38280046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 shutdown_connections 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f382006b4d0 0x7f382006d990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f383c15e0b0 0x7f383c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c0d0c80 0x7f383c0b6780 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 --2- 172.21.15.5:0/3126891964 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f383c0cc780 0x7f383c0c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 >> 172.21.15.5:0/3126891964 conn(0x7f383c0d1a20 msgr2=0x7f383c0ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 shutdown_connections 2024-04-25T08:59:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.837+0000 7f38430f5640 1 -- 172.21.15.5:0/3126891964 wait complete. 2024-04-25T08:59:53.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f109111d640 1 Processor -- start 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f109111d640 1 -- start start 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f109111d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f108c1614b0 0x7f108c0b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f109111d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f108c0d4230 0x7f108c0b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f109111d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c0d2740 con 0x7f108c0d1f60 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f109111d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c0d2a20 con 0x7f108c1614b0 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f109111d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c0d2d00 con 0x7f108c0d4230 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.951+0000 7f108ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f108c1614b0 0x7f108c0b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f108c1614b0 0x7f108c0b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44284/0 (socket says 172.21.15.5:44284) 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108ad9d640 1 -- 172.21.15.5:0/3201400035 learned_addr learned my addr 172.21.15.5:0/3201400035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108b59e640 1 --2- 172.21.15.5:0/3201400035 >> v2:172.21.15.80:3300/0 conn(0x7f108c0d4230 0x7f108c0b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108ad9d640 1 -- 172.21.15.5:0/3201400035 >> v2:172.21.15.80:3300/0 conn(0x7f108c0d4230 msgr2=0x7f108c0b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108ad9d640 1 --2- 172.21.15.5:0/3201400035 >> v2:172.21.15.80:3300/0 conn(0x7f108c0d4230 0x7f108c0b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108ad9d640 1 -- 172.21.15.5:0/3201400035 >> v1:172.21.15.80:6789/0 conn(0x7f108c0d1f60 legacy=0x7f108c0d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108ad9d640 1 -- 172.21.15.5:0/3201400035 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c0d2fe0 con 0x7f108c1614b0 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.952+0000 7f108b59e640 1 --2- 172.21.15.5:0/3201400035 >> v2:172.21.15.80:3300/0 conn(0x7f108c0d4230 0x7f108c0b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f108ad9d640 1 --2- 172.21.15.5:0/3201400035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c1614b0 0x7f108c0b96e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f108c0cabf0 tx=0x7f107c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb33733970d9d0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f1089d9b640 1 -- 172.21.15.5:0/3201400035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c037070 con 0x7f108c1614b0 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f1089d9b640 1 -- 172.21.15.5:0/3201400035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c032440 con 0x7f108c1614b0 2024-04-25T08:59:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f1089d9b640 1 -- 172.21.15.5:0/3201400035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c032810 con 0x7f108c1614b0 2024-04-25T08:59:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 -- 172.21.15.5:0/3201400035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c1614b0 msgr2=0x7f108c0b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 --2- 172.21.15.5:0/3201400035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c1614b0 0x7f108c0b96e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f108c0cabf0 tx=0x7f107c02a270 comp rx=0 tx=0).stop 2024-04-25T08:59:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 -- 172.21.15.5:0/3201400035 shutdown_connections 2024-04-25T08:59:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 --2- 172.21.15.5:0/3201400035 >> v2:172.21.15.80:3300/0 conn(0x7f108c0d4230 0x7f108c0b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 --2- 172.21.15.5:0/3201400035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c1614b0 0x7f108c0b96e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 -- 172.21.15.5:0/3201400035 >> 172.21.15.5:0/3201400035 conn(0x7f108c06b000 msgr2=0x7f108c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 -- 172.21.15.5:0/3201400035 shutdown_connections 2024-04-25T08:59:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.953+0000 7f109111d640 1 -- 172.21.15.5:0/3201400035 wait complete. 2024-04-25T08:59:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.955+0000 7f109111d640 1 Processor -- start 2024-04-25T08:59:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.955+0000 7f109111d640 1 -- start start 2024-04-25T08:59:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f109111d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c0d1f60 0x7f108c0b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f109111d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f108c0d4230 0x7f108c1f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f109111d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f108c1614b0 0x7f108c149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f109111d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0d23a0 con 0x7f108c0d1f60 2024-04-25T08:59:53.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f109111d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0d37e0 con 0x7f108c1614b0 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f109111d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0d2520 con 0x7f108c0d4230 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c0d1f60 0x7f108c0b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c0d1f60 0x7f108c0b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44288/0 (socket says 172.21.15.5:44288) 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 -- 172.21.15.5:0/1882318968 learned_addr learned my addr 172.21.15.5:0/1882318968 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108b59e640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f108c1614b0 0x7f108c149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 -- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f108c0d4230 msgr2=0x7f108c1f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108a59c640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f108c0d4230 0x7f108c1f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f108c0d4230 0x7f108c1f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 -- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f108c1614b0 msgr2=0x7f108c149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f108c1614b0 0x7f108c149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 -- 172.21.15.5:0/1882318968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c1f4b50 con 0x7f108c0d1f60 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108b59e640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f108c1614b0 0x7f108c149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f108ad9d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c0d1f60 0x7f108c0b2e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f107c02a2b0 tx=0x7f107c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f10737fe640 1 -- 172.21.15.5:0/1882318968 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c041020 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f10737fe640 1 -- 172.21.15.5:0/1882318968 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c0306c0 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.956+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c0b33e0 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.957+0000 7f10737fe640 1 -- 172.21.15.5:0/1882318968 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c037040 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.957+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c0b39a0 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.958+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c04ef20 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.958+0000 7f10737fe640 1 -- 172.21.15.5:0/1882318968 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f107c044020 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.958+0000 7f10737fe640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f107806b500 0x7f107806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.959+0000 7f10737fe640 1 -- 172.21.15.5:0/1882318968 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f107c0aa940 con 0x7f108c0d1f60 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.959+0000 7f108a59c640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f107806b500 0x7f107806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.959+0000 7f108a59c640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f107806b500 0x7f107806d9c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f108c15b7d0 tx=0x7f1080009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:53.963+0000 7f10737fe640 1 -- 172.21.15.5:0/1882318968 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f107c04b030 con 0x7f108c0d1f60 2024-04-25T08:59:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.140+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f108c0718e0 con 0x7f108c0d1f60 2024-04-25T08:59:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.141+0000 7f10737fe640 1 -- 172.21.15.5:0/1882318968 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f107c079810 con 0x7f108c0d1f60 2024-04-25T08:59:54.130 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T08:59:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f107806b500 msgr2=0x7f107806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f107806b500 0x7f107806d9c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f108c15b7d0 tx=0x7f1080009040 comp rx=0 tx=0).stop 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c0d1f60 msgr2=0x7f108c0b2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c0d1f60 0x7f108c0b2e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f107c02a2b0 tx=0x7f107c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 shutdown_connections 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f107806b500 0x7f107806d9c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f108c1614b0 0x7f108c149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f108c0d4230 0x7f108c1f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 --2- 172.21.15.5:0/1882318968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108c0d1f60 0x7f108c0b2e00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 >> 172.21.15.5:0/1882318968 conn(0x7f108c06b000 msgr2=0x7f108c0b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 shutdown_connections 2024-04-25T08:59:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.143+0000 7f109111d640 1 -- 172.21.15.5:0/1882318968 wait complete. 2024-04-25T08:59:54.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:54.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.254+0000 7fd1779bd640 1 Processor -- start 2024-04-25T08:59:54.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.255+0000 7fd1779bd640 1 -- start start 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.255+0000 7fd1779bd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd17015de70 0x7fd1700b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.255+0000 7fd1779bd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1700b2cc0 0x7fd1700b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.255+0000 7fd1779bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700d20e0 con 0x7fd1700b7130 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.255+0000 7fd1779bd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700d2a10 con 0x7fd17015de70 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd1779bd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700d23c0 con 0x7fd1700b2cc0 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175759640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd17015de70 0x7fd1700b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175f5a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1700b7130 0x7fd1700ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53780/0 (socket says 172.21.15.5:53780) 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175759640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd17015de70 0x7fd1700b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44294/0 (socket says 172.21.15.5:44294) 2024-04-25T08:59:54.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175f5a640 1 -- 172.21.15.5:0/1084156183 learned_addr learned my addr 172.21.15.5:0/1084156183 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd174f58640 1 --2- 172.21.15.5:0/1084156183 >> v2:172.21.15.80:3300/0 conn(0x7fd1700b2cc0 0x7fd1700b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175759640 1 -- 172.21.15.5:0/1084156183 >> v2:172.21.15.80:3300/0 conn(0x7fd1700b2cc0 msgr2=0x7fd1700b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175759640 1 --2- 172.21.15.5:0/1084156183 >> v2:172.21.15.80:3300/0 conn(0x7fd1700b2cc0 0x7fd1700b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175759640 1 -- 172.21.15.5:0/1084156183 >> v1:172.21.15.5:6789/0 conn(0x7fd1700b7130 legacy=0x7fd1700ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd16ffff640 1 -- 172.21.15.5:0/1084156183 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077634049 0 0) 0x7fd1700d20e0 con 0x7fd1700b7130 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd175759640 1 -- 172.21.15.5:0/1084156183 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700d26a0 con 0x7fd17015de70 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.256+0000 7fd174f58640 1 --2- 172.21.15.5:0/1084156183 >> v2:172.21.15.80:3300/0 conn(0x7fd1700b2cc0 0x7fd1700b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd175759640 1 --2- 172.21.15.5:0/1084156183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17015de70 0x7fd1700b93e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097a0 tx=0x7fd16802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975ee3a14febd7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd16ffff640 1 -- 172.21.15.5:0/1084156183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168037070 con 0x7fd17015de70 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd16ffff640 1 -- 172.21.15.5:0/1084156183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd168032440 con 0x7fd17015de70 2024-04-25T08:59:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd16ffff640 1 -- 172.21.15.5:0/1084156183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168032810 con 0x7fd17015de70 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd1779bd640 1 -- 172.21.15.5:0/1084156183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17015de70 msgr2=0x7fd1700b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd1779bd640 1 --2- 172.21.15.5:0/1084156183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17015de70 0x7fd1700b93e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097a0 tx=0x7fd16802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd1779bd640 1 -- 172.21.15.5:0/1084156183 shutdown_connections 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd1779bd640 1 --2- 172.21.15.5:0/1084156183 >> v2:172.21.15.80:3300/0 conn(0x7fd1700b2cc0 0x7fd1700b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd1779bd640 1 --2- 172.21.15.5:0/1084156183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17015de70 0x7fd1700b93e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.257+0000 7fd1779bd640 1 -- 172.21.15.5:0/1084156183 >> 172.21.15.5:0/1084156183 conn(0x7fd17006b000 msgr2=0x7fd17006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.258+0000 7fd1779bd640 1 -- 172.21.15.5:0/1084156183 shutdown_connections 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.258+0000 7fd1779bd640 1 -- 172.21.15.5:0/1084156183 wait complete. 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 Processor -- start 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 -- start start 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1700b2cc0 0x7fd17014aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1700b7130 0x7fd1700b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd17015de70 0x7fd1700b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700cf080 con 0x7fd1700b7130 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700cef00 con 0x7fd1700b2cc0 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.259+0000 7fd1779bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700cf200 con 0x7fd17015de70 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1700b7130 0x7fd1700b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1700b7130 0x7fd1700b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44304/0 (socket says 172.21.15.5:44304) 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 -- 172.21.15.5:0/3599644629 learned_addr learned my addr 172.21.15.5:0/3599644629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd175759640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1700b2cc0 0x7fd17014aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd175f5a640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd17015de70 0x7fd1700b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 -- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd17015de70 msgr2=0x7fd1700b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd17015de70 0x7fd1700b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 -- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1700b2cc0 msgr2=0x7fd17014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1700b2cc0 0x7fd17014aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 -- 172.21.15.5:0/3599644629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700b4cd0 con 0x7fd1700b7130 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd175759640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1700b2cc0 0x7fd17014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd174f58640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1700b7130 0x7fd1700b5d70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd16400e7e0 tx=0x7fd16400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd16dffb640 1 -- 172.21.15.5:0/3599644629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400f040 con 0x7fd1700b7130 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd16dffb640 1 -- 172.21.15.5:0/3599644629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164004030 con 0x7fd1700b7130 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1700b4fb0 con 0x7fd1700b7130 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd16dffb640 1 -- 172.21.15.5:0/3599644629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164004400 con 0x7fd1700b7130 2024-04-25T08:59:54.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.260+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1700b5570 con 0x7fd1700b7130 2024-04-25T08:59:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.261+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17004ef20 con 0x7fd1700b7130 2024-04-25T08:59:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.262+0000 7fd16dffb640 1 -- 172.21.15.5:0/3599644629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd16400c6d0 con 0x7fd1700b7130 2024-04-25T08:59:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.262+0000 7fd16dffb640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.262+0000 7fd16dffb640 1 -- 172.21.15.5:0/3599644629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd16408a140 con 0x7fd1700b7130 2024-04-25T08:59:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.263+0000 7fd175759640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.263+0000 7fd175759640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd168034000 tx=0x7fd16802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.266+0000 7fd16dffb640 1 -- 172.21.15.5:0/3599644629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd164017020 con 0x7fd1700b7130 2024-04-25T08:59:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.486+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1700b27f0 con 0x7fd1700b7130 2024-04-25T08:59:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.487+0000 7fd16dffb640 1 -- 172.21.15.5:0/3599644629 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fd164058ee0 con 0x7fd1700b7130 2024-04-25T08:59:54.476 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:54.476 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:52.482011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:54.477 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-04-25T08:59:54.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 msgr2=0x7fd15c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd168034000 tx=0x7fd16802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1700b7130 msgr2=0x7fd1700b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1700b7130 0x7fd1700b5d70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd16400e7e0 tx=0x7fd16400eca0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 shutdown_connections 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd17015de70 0x7fd1700b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1700b7130 0x7fd1700b5d70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 --2- 172.21.15.5:0/3599644629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1700b2cc0 0x7fd17014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 >> 172.21.15.5:0/3599644629 conn(0x7fd17006b000 msgr2=0x7fd1700ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 shutdown_connections 2024-04-25T08:59:54.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.489+0000 7fd1779bd640 1 -- 172.21.15.5:0/3599644629 wait complete. 2024-04-25T08:59:54.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:54.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.600+0000 7fefcf3f4640 1 Processor -- start 2024-04-25T08:59:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.600+0000 7fefcf3f4640 1 -- start start 2024-04-25T08:59:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefcf3f4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fefc80cea80 0x7fefc815f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefcf3f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc815ef10 con 0x7fefc806bd00 2024-04-25T08:59:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefcf3f4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc815f1a0 con 0x7fefc815fd80 2024-04-25T08:59:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefcf3f4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80cfd60 con 0x7fefc80cea80 2024-04-25T08:59:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefcd991640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fefc806bd00 0x7fefc80d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53794/0 (socket says 172.21.15.5:53794) 2024-04-25T08:59:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefcd991640 1 -- 172.21.15.5:0/193776816 learned_addr learned my addr 172.21.15.5:0/193776816 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefcd190640 1 --2- 172.21.15.5:0/193776816 >> v2:172.21.15.80:3300/0 conn(0x7fefc80cea80 0x7fefc815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683222990 0 0) 0x7fefc815ef10 con 0x7fefc806bd00 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.601+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb4003520 con 0x7fefc806bd00 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651934120 0 0) 0x7fefb4003520 con 0x7fefc806bd00 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 >> v2:172.21.15.80:3300/0 conn(0x7fefc80cea80 msgr2=0x7fefc815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 --2- 172.21.15.5:0/193776816 >> v2:172.21.15.80:3300/0 conn(0x7fefc80cea80 0x7fefc815f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 >> v1:172.21.15.80:6789/0 conn(0x7fefc815fd80 legacy=0x7fefc806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80cff90 con 0x7fefc806bd00 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fefc00019f0 con 0x7fefc806bd00 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 >> v1:172.21.15.5:6789/0 conn(0x7fefc806bd00 legacy=0x7fefc80d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefb40039b0 0x7fefb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb40043b0 0x7fefb4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb4005080 0x7fefb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb400bfb0 con 0x7fefb4005080 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb400c160 con 0x7fefb40043b0 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb400c360 con 0x7fefb40039b0 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcd991640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb4005080 0x7fefb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcd190640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefb40039b0 0x7fefb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcc98f640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb40043b0 0x7fefb4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcd991640 1 -- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefb40039b0 msgr2=0x7fefb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcd991640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefb40039b0 0x7fefb4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcd991640 1 -- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb40043b0 msgr2=0x7fefb4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcd991640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb40043b0 0x7fefb4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.602+0000 7fefcd991640 1 -- 172.21.15.5:0/193776816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb4003520 con 0x7fefb4005080 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefcd991640 1 -- 172.21.15.5:0/193776816 reap_dead start 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefcd991640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb4005080 0x7fefb400b9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fefc000a880 tx=0x7fefb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a903680d9aefde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000a4a0 con 0x7fefb4005080 2024-04-25T08:59:54.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc002f070 con 0x7fefb4005080 2024-04-25T08:59:54.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefbffff640 1 -- 172.21.15.5:0/193776816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc002bce0 con 0x7fefb4005080 2024-04-25T08:59:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefcf3f4640 1 -- 172.21.15.5:0/193776816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb4005080 msgr2=0x7fefb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb4005080 0x7fefb400b9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fefc000a880 tx=0x7fefb4005830 comp rx=0 tx=0).stop 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.603+0000 7fefcf3f4640 1 -- 172.21.15.5:0/193776816 shutdown_connections 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.604+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/193776816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb4005080 0x7fefb400b9c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.604+0000 7fefcf3f4640 1 -- 172.21.15.5:0/193776816 >> 172.21.15.5:0/193776816 conn(0x7fefc80d19f0 msgr2=0x7fefc80d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.604+0000 7fefcf3f4640 1 -- 172.21.15.5:0/193776816 shutdown_connections 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.604+0000 7fefcf3f4640 1 -- 172.21.15.5:0/193776816 wait complete. 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 Processor -- start 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 -- start start 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb4005080 0x7fefc815c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc80af4c0 0x7fefc80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefc80b0ec0 0x7fefc80b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80d1660 con 0x7fefc80af4c0 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc815f480 con 0x7fefb4005080 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.605+0000 7fefcf3f4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80d17e0 con 0x7fefc80b0ec0 2024-04-25T08:59:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc80af4c0 0x7fefc80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc80af4c0 0x7fefc80af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44330/0 (socket says 172.21.15.5:44330) 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 -- 172.21.15.5:0/863458070 learned_addr learned my addr 172.21.15.5:0/863458070 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcd190640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb4005080 0x7fefc815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcd991640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefc80b0ec0 0x7fefc80b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 -- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefc80b0ec0 msgr2=0x7fefc80b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefc80b0ec0 0x7fefc80b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 -- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb4005080 msgr2=0x7fefc815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb4005080 0x7fefc815c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 -- 172.21.15.5:0/863458070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80b2590 con 0x7fefc80af4c0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcd190640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb4005080 0x7fefc815c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcd991640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefc80b0ec0 0x7fefc80b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcc98f640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc80af4c0 0x7fefc80af940 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fefb800f7f0 tx=0x7fefb800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefbdffb640 1 -- 172.21.15.5:0/863458070 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb801a070 con 0x7fefc80af4c0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefbdffb640 1 -- 172.21.15.5:0/863458070 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb8005110 con 0x7fefc80af4c0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc80b2060 con 0x7fefc80af4c0 2024-04-25T08:59:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefbdffb640 1 -- 172.21.15.5:0/863458070 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8007050 con 0x7fefc80af4c0 2024-04-25T08:59:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.606+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc80b1d80 con 0x7fefc80af4c0 2024-04-25T08:59:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.607+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc804ef20 con 0x7fefc80af4c0 2024-04-25T08:59:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.608+0000 7fefbdffb640 1 -- 172.21.15.5:0/863458070 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefb801d070 con 0x7fefc80af4c0 2024-04-25T08:59:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.608+0000 7fefbdffb640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fefac06b4d0 0x7fefac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.608+0000 7fefbdffb640 1 -- 172.21.15.5:0/863458070 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fefb8089a80 con 0x7fefc80af4c0 2024-04-25T08:59:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.608+0000 7fefcd190640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fefac06b4d0 0x7fefac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.609+0000 7fefcd190640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fefac06b4d0 0x7fefac06d990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fefc8161ae0 tx=0x7fefc4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.613+0000 7fefbdffb640 1 -- 172.21.15.5:0/863458070 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fefb8058930 con 0x7fefc80af4c0 2024-04-25T08:59:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.798+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefc80cefa0 con 0x7fefc80af4c0 2024-04-25T08:59:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.799+0000 7fefbdffb640 1 -- 172.21.15.5:0/863458070 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16621 (secure 0 0 0) 0x7fefb8058230 con 0x7fefc80af4c0 2024-04-25T08:59:54.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:54.789 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:26.620146+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:14.076773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:14.788001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fefac06b4d0 msgr2=0x7fefac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fefac06b4d0 0x7fefac06d990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fefc8161ae0 tx=0x7fefc4008040 comp rx=0 tx=0).stop 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc80af4c0 msgr2=0x7fefc80af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc80af4c0 0x7fefc80af940 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fefb800f7f0 tx=0x7fefb800fcb0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 shutdown_connections 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fefac06b4d0 0x7fefac06d990 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fefc80b0ec0 0x7fefc80b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefc80af4c0 0x7fefc80af940 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 --2- 172.21.15.5:0/863458070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefb4005080 0x7fefc815c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 >> 172.21.15.5:0/863458070 conn(0x7fefc80d19f0 msgr2=0x7fefc8160170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 shutdown_connections 2024-04-25T08:59:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.801+0000 7fefcf3f4640 1 -- 172.21.15.5:0/863458070 wait complete. 2024-04-25T08:59:54.801 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:59:54.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:54.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.913+0000 7f214f95c640 1 Processor -- start 2024-04-25T08:59:54.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.913+0000 7f214f95c640 1 -- start start 2024-04-25T08:59:54.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f214f95c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 0x7f21480cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f214f95c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21480cf1c0 con 0x7f214815de70 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f214f95c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21480d20e0 con 0x7f21480b2cc0 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f214f95c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480d2a10 con 0x7f21480ce7f0 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f214d6f8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f214815de70 0x7f21480b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53800/0 (socket says 172.21.15.5:53800) 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f214d6f8640 1 -- 172.21.15.5:0/1618156034 learned_addr learned my addr 172.21.15.5:0/1618156034 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423043120 0 0) 0x7f21480cf1c0 con 0x7f214815de70 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2134003520 con 0x7f214815de70 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.914+0000 7f214def9640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 0x7f21480cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2057086845 0 0) 0x7f2134003520 con 0x7f214815de70 2024-04-25T08:59:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 msgr2=0x7f21480cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:54.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 0x7f21480cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 >> v1:172.21.15.80:6789/0 conn(0x7f21480b2cc0 legacy=0x7f21480b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480d23c0 con 0x7f214815de70 2024-04-25T08:59:54.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2144001670 con 0x7f214815de70 2024-04-25T08:59:54.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 >> v1:172.21.15.5:6789/0 conn(0x7f214815de70 legacy=0x7f21480b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21340039e0 0x7f2134003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 0x7f2134004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2134004d40 0x7f21340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480d2a10 con 0x7f21340039e0 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213400b9f0 con 0x7f2134004d40 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213400bbf0 con 0x7f21480ce7f0 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214d6f8640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21340039e0 0x7f2134003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214def9640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2134004d40 0x7f21340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214cef7640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 0x7f2134004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214d6f8640 1 -- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 msgr2=0x7f2134004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214d6f8640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21480ce7f0 0x7f2134004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214d6f8640 1 -- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2134004d40 msgr2=0x7f21340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214d6f8640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2134004d40 0x7f21340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.915+0000 7f214d6f8640 1 -- 172.21.15.5:0/1618156034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134003520 con 0x7f21340039e0 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.916+0000 7f214d6f8640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21340039e0 0x7f2134003dc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f214400c240 tx=0x7f2134005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c93b7daf9f230c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.916+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144007d30 con 0x7f21340039e0 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.916+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144005af0 con 0x7f21340039e0 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.916+0000 7f213ffff640 1 -- 172.21.15.5:0/1618156034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144007070 con 0x7f21340039e0 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.916+0000 7f214f95c640 1 -- 172.21.15.5:0/1618156034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21340039e0 msgr2=0x7f2134003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.916+0000 7f214f95c640 1 --2- 172.21.15.5:0/1618156034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21340039e0 0x7f2134003dc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f214400c240 tx=0x7f2134005830 comp rx=0 tx=0).stop 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.916+0000 7f214def9640 1 -- 172.21.15.5:0/1618156034 reap_dead start 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.917+0000 7f214f95c640 1 -- 172.21.15.5:0/1618156034 shutdown_connections 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.917+0000 7f214f95c640 1 -- 172.21.15.5:0/1618156034 >> 172.21.15.5:0/1618156034 conn(0x7f214806b000 msgr2=0x7f214806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.917+0000 7f214f95c640 1 -- 172.21.15.5:0/1618156034 shutdown_connections 2024-04-25T08:59:54.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.917+0000 7f214f95c640 1 -- 172.21.15.5:0/1618156034 wait complete. 2024-04-25T08:59:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.918+0000 7f214f95c640 1 Processor -- start 2024-04-25T08:59:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.918+0000 7f214f95c640 1 -- start start 2024-04-25T08:59:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.918+0000 7f214f95c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21340039e0 0x7f21480c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.918+0000 7f214f95c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f214814ae40 0x7f21480cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.918+0000 7f214f95c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21480cc2a0 0x7f214815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.918+0000 7f214f95c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480cec80 con 0x7f21480cc2a0 2024-04-25T08:59:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.918+0000 7f214f95c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480b7300 con 0x7f21340039e0 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214f95c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480cee00 con 0x7f214814ae40 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21480cc2a0 0x7f214815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21480cc2a0 0x7f214815fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44336/0 (socket says 172.21.15.5:44336) 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 -- 172.21.15.5:0/355604342 learned_addr learned my addr 172.21.15.5:0/355604342 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214d6f8640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21340039e0 0x7f21480c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214cef7640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f214814ae40 0x7f21480cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 -- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f214814ae40 msgr2=0x7f21480cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f214814ae40 0x7f21480cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 -- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21340039e0 msgr2=0x7f21480c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21340039e0 0x7f21480c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 -- 172.21.15.5:0/355604342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480c8ba0 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214def9640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21480cc2a0 0x7f214815fbc0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f21480b66f0 tx=0x7f214000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f213dffb640 1 -- 172.21.15.5:0/355604342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000fde0 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f213dffb640 1 -- 172.21.15.5:0/355604342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140015430 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21480ca420 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.919+0000 7f213dffb640 1 -- 172.21.15.5:0/355604342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140015820 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.920+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21480c9120 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.920+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214804ef20 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.921+0000 7f213dffb640 1 -- 172.21.15.5:0/355604342 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21400159c0 con 0x7f21480cc2a0 2024-04-25T08:59:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.921+0000 7f213dffb640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f212c06b4d0 0x7f212c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.921+0000 7f213dffb640 1 -- 172.21.15.5:0/355604342 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f214008ae50 con 0x7f21480cc2a0 2024-04-25T08:59:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.922+0000 7f214d6f8640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f212c06b4d0 0x7f212c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.922+0000 7f214d6f8640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f212c06b4d0 0x7f212c06d990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2144032000 tx=0x7f2144034040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:54.926+0000 7f213dffb640 1 -- 172.21.15.5:0/355604342 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2140019030 con 0x7f21480cc2a0 2024-04-25T08:59:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.146+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21480b6e00 con 0x7f21480cc2a0 2024-04-25T08:59:55.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.147+0000 7f213dffb640 1 -- 172.21.15.5:0/355604342 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f2140010040 con 0x7f21480cc2a0 2024-04-25T08:59:55.136 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:55.136 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:52.482011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:55.136 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f212c06b4d0 msgr2=0x7f212c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f212c06b4d0 0x7f212c06d990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2144032000 tx=0x7f2144034040 comp rx=0 tx=0).stop 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21480cc2a0 msgr2=0x7f214815fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21480cc2a0 0x7f214815fbc0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f21480b66f0 tx=0x7f214000f580 comp rx=0 tx=0).stop 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 shutdown_connections 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f212c06b4d0 0x7f212c06d990 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21480cc2a0 0x7f214815fbc0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f214814ae40 0x7f21480cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 --2- 172.21.15.5:0/355604342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21340039e0 0x7f21480c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.148+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 >> 172.21.15.5:0/355604342 conn(0x7f214806b000 msgr2=0x7f214815f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:55.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.149+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 shutdown_connections 2024-04-25T08:59:55.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.149+0000 7f214f95c640 1 -- 172.21.15.5:0/355604342 wait complete. 2024-04-25T08:59:55.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.260+0000 7fb97317e640 1 Processor -- start 2024-04-25T08:59:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.260+0000 7fb97317e640 1 -- start start 2024-04-25T08:59:55.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97317e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb96c0cc120 0x7fb96c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97317e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb96c15c7f0 0x7fb96c0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97317e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c15cbd0 con 0x7fb96c0cfbb0 2024-04-25T08:59:55.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97317e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c06d280 con 0x7fb96c15c7f0 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97317e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c06c4c0 con 0x7fb96c0cc120 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97171b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb96c15c7f0 0x7fb96c0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97171b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb96c15c7f0 0x7fb96c0b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44352/0 (socket says 172.21.15.5:44352) 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97171b640 1 -- 172.21.15.5:0/1824229982 learned_addr learned my addr 172.21.15.5:0/1824229982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb970f1a640 1 --2- 172.21.15.5:0/1824229982 >> v2:172.21.15.80:3300/0 conn(0x7fb96c0cc120 0x7fb96c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97171b640 1 -- 172.21.15.5:0/1824229982 >> v2:172.21.15.80:3300/0 conn(0x7fb96c0cc120 msgr2=0x7fb96c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97171b640 1 --2- 172.21.15.5:0/1824229982 >> v2:172.21.15.80:3300/0 conn(0x7fb96c0cc120 0x7fb96c0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97171b640 1 -- 172.21.15.5:0/1824229982 >> v1:172.21.15.80:6789/0 conn(0x7fb96c0cfbb0 legacy=0x7fb96c15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.261+0000 7fb97171b640 1 -- 172.21.15.5:0/1824229982 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c06c7a0 con 0x7fb96c15c7f0 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.262+0000 7fb97171b640 1 --2- 172.21.15.5:0/1824229982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c15c7f0 0x7fb96c0b2850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0d0420 tx=0x7fb96402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0816efe6139655f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.262+0000 7fb96b7fe640 1 -- 172.21.15.5:0/1824229982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964036070 con 0x7fb96c15c7f0 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.262+0000 7fb96b7fe640 1 -- 172.21.15.5:0/1824229982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964031600 con 0x7fb96c15c7f0 2024-04-25T08:59:55.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.262+0000 7fb96b7fe640 1 -- 172.21.15.5:0/1824229982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640319d0 con 0x7fb96c15c7f0 2024-04-25T08:59:55.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 -- 172.21.15.5:0/1824229982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c15c7f0 msgr2=0x7fb96c0b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 --2- 172.21.15.5:0/1824229982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c15c7f0 0x7fb96c0b2850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0d0420 tx=0x7fb96402a730 comp rx=0 tx=0).stop 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 -- 172.21.15.5:0/1824229982 shutdown_connections 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 --2- 172.21.15.5:0/1824229982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c15c7f0 0x7fb96c0b2850 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 --2- 172.21.15.5:0/1824229982 >> v2:172.21.15.80:3300/0 conn(0x7fb96c0cc120 0x7fb96c0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 -- 172.21.15.5:0/1824229982 >> 172.21.15.5:0/1824229982 conn(0x7fb96c0668f0 msgr2=0x7fb96c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 -- 172.21.15.5:0/1824229982 shutdown_connections 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.263+0000 7fb97317e640 1 -- 172.21.15.5:0/1824229982 wait complete. 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.264+0000 7fb97317e640 1 Processor -- start 2024-04-25T08:59:55.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.264+0000 7fb97317e640 1 -- start start 2024-04-25T08:59:55.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97317e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c0cc120 0x7fb96c14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97317e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb96c0cfbb0 0x7fb96c1f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97317e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c15c7f0 0x7fb96c155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97317e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c15ce50 con 0x7fb96c0cc120 2024-04-25T08:59:55.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97317e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c06cd60 con 0x7fb96c15c7f0 2024-04-25T08:59:55.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97317e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0cc500 con 0x7fb96c0cfbb0 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c0cc120 0x7fb96c14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c0cc120 0x7fb96c14a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44360/0 (socket says 172.21.15.5:44360) 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 -- 172.21.15.5:0/3856320184 learned_addr learned my addr 172.21.15.5:0/3856320184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97171b640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c15c7f0 0x7fb96c155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb96bfff640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb96c0cfbb0 0x7fb96c1f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 -- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb96c0cfbb0 msgr2=0x7fb96c1f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb96c0cfbb0 0x7fb96c1f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 -- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c15c7f0 msgr2=0x7fb96c155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c15c7f0 0x7fb96c155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 -- 172.21.15.5:0/3856320184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c15aa40 con 0x7fb96c0cc120 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb97171b640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c15c7f0 0x7fb96c155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.265+0000 7fb970f1a640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c0cc120 0x7fb96c14a440 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb96000d5f0 tx=0x7fb96000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.266+0000 7fb9697fa640 1 -- 172.21.15.5:0/3856320184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600125f0 con 0x7fb96c0cc120 2024-04-25T08:59:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.266+0000 7fb9697fa640 1 -- 172.21.15.5:0/3856320184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb960019070 con 0x7fb96c0cc120 2024-04-25T08:59:55.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.266+0000 7fb9697fa640 1 -- 172.21.15.5:0/3856320184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600129d0 con 0x7fb96c0cc120 2024-04-25T08:59:55.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.266+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c15ad20 con 0x7fb96c0cc120 2024-04-25T08:59:55.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.266+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c15b5c0 con 0x7fb96c0cc120 2024-04-25T08:59:55.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.267+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c04ef20 con 0x7fb96c0cc120 2024-04-25T08:59:55.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.267+0000 7fb9697fa640 1 -- 172.21.15.5:0/3856320184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb960012b70 con 0x7fb96c0cc120 2024-04-25T08:59:55.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.267+0000 7fb9697fa640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb95006b500 0x7fb95006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.268+0000 7fb9697fa640 1 -- 172.21.15.5:0/3856320184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb96008a530 con 0x7fb96c0cc120 2024-04-25T08:59:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.268+0000 7fb96bfff640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb95006b500 0x7fb95006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.268+0000 7fb96bfff640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb95006b500 0x7fb95006d9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb96c150670 tx=0x7fb958009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.272+0000 7fb9697fa640 1 -- 172.21.15.5:0/3856320184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb960059400 con 0x7fb96c0cc120 2024-04-25T08:59:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.490+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb96c1527c0 con 0x7fb96c0cc120 2024-04-25T08:59:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.490+0000 7fb9697fa640 1 -- 172.21.15.5:0/3856320184 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fb960058d00 con 0x7fb96c0cc120 2024-04-25T08:59:55.480 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:55.480 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:15.812891+0000","modified":"2024-04-25T08:59:52.482011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5616":{"gid":5616,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.5:6835/2992823124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2992823124},{"type":"v1","addr":"172.21.15.5:6835","nonce":2992823124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:59:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.492+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb95006b500 msgr2=0x7fb95006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.492+0000 7fb97317e640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb95006b500 0x7fb95006d9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb96c150670 tx=0x7fb958009040 comp rx=0 tx=0).stop 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.492+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c0cc120 msgr2=0x7fb96c14a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.492+0000 7fb97317e640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c0cc120 0x7fb96c14a440 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb96000d5f0 tx=0x7fb96000dab0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.492+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 shutdown_connections 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.493+0000 7fb97317e640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb95006b500 0x7fb95006d9c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.493+0000 7fb97317e640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c15c7f0 0x7fb96c155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.493+0000 7fb97317e640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb96c0cfbb0 0x7fb96c1f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.493+0000 7fb97317e640 1 --2- 172.21.15.5:0/3856320184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96c0cc120 0x7fb96c14a440 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.493+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 >> 172.21.15.5:0/3856320184 conn(0x7fb96c0668f0 msgr2=0x7fb96c150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.493+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 shutdown_connections 2024-04-25T08:59:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.493+0000 7fb97317e640 1 -- 172.21.15.5:0/3856320184 wait complete. 2024-04-25T08:59:55.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.604+0000 7f079af90640 1 Processor -- start 2024-04-25T08:59:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.604+0000 7f079af90640 1 -- start start 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.604+0000 7f079af90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b2cc0 0x7f07940b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.604+0000 7f079af90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07940b7130 0x7f07940ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.604+0000 7f079af90640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07940d20e0 con 0x7f079415de70 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.604+0000 7f079af90640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07940d2a10 con 0x7f07940b7130 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.604+0000 7f079af90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07940d23c0 con 0x7f07940b2cc0 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f079952d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07940b7130 0x7f07940ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f079952d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07940b7130 0x7f07940ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44368/0 (socket says 172.21.15.5:44368) 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f0798d2c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f079415de70 0x7f07940b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53816/0 (socket says 172.21.15.5:53816) 2024-04-25T08:59:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f079952d640 1 -- 172.21.15.5:0/4120220360 learned_addr learned my addr 172.21.15.5:0/4120220360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f0793fff640 1 --2- 172.21.15.5:0/4120220360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b2cc0 0x7f07940b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f079952d640 1 -- 172.21.15.5:0/4120220360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b2cc0 msgr2=0x7f07940b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f079952d640 1 --2- 172.21.15.5:0/4120220360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b2cc0 0x7f07940b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f079952d640 1 -- 172.21.15.5:0/4120220360 >> v1:172.21.15.5:6789/0 conn(0x7f079415de70 legacy=0x7f07940b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f07937fe640 1 -- 172.21.15.5:0/4120220360 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886228921 0 0) 0x7f07940d20e0 con 0x7f079415de70 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f079952d640 1 -- 172.21.15.5:0/4120220360 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940d26a0 con 0x7f07940b7130 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.605+0000 7f0793fff640 1 --2- 172.21.15.5:0/4120220360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b2cc0 0x7f07940b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079952d640 1 --2- 172.21.15.5:0/4120220360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07940b7130 0x7f07940ce7f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f078c009e50 tx=0x7f078c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cb3517e71ef8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f07937fe640 1 -- 172.21.15.5:0/4120220360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c036070 con 0x7f07940b7130 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f07937fe640 1 -- 172.21.15.5:0/4120220360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c031600 con 0x7f07940b7130 2024-04-25T08:59:55.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f07937fe640 1 -- 172.21.15.5:0/4120220360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0319d0 con 0x7f07940b7130 2024-04-25T08:59:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 -- 172.21.15.5:0/4120220360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07940b7130 msgr2=0x7f07940ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 --2- 172.21.15.5:0/4120220360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07940b7130 0x7f07940ce7f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f078c009e50 tx=0x7f078c02a710 comp rx=0 tx=0).stop 2024-04-25T08:59:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 -- 172.21.15.5:0/4120220360 shutdown_connections 2024-04-25T08:59:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 --2- 172.21.15.5:0/4120220360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07940b7130 0x7f07940ce7f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 --2- 172.21.15.5:0/4120220360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b2cc0 0x7f07940b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 -- 172.21.15.5:0/4120220360 >> 172.21.15.5:0/4120220360 conn(0x7f079406b000 msgr2=0x7f079406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 -- 172.21.15.5:0/4120220360 shutdown_connections 2024-04-25T08:59:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.606+0000 7f079af90640 1 -- 172.21.15.5:0/4120220360 wait complete. 2024-04-25T08:59:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 Processor -- start 2024-04-25T08:59:55.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 -- start start 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07940b2cc0 0x7f07940c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b7130 0x7f07940b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f079415de70 0x7f0794153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940cf0c0 con 0x7f079415de70 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940cef40 con 0x7f07940b2cc0 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.608+0000 7f079af90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07940ca3d0 con 0x7f07940b7130 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f079415de70 0x7f0794153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f079415de70 0x7f0794153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44370/0 (socket says 172.21.15.5:44370) 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 -- 172.21.15.5:0/4288960083 learned_addr learned my addr 172.21.15.5:0/4288960083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f0793fff640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b7130 0x7f07940b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f0798d2c640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07940b2cc0 0x7f07940c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 -- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b7130 msgr2=0x7f07940b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b7130 0x7f07940b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 -- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07940b2cc0 msgr2=0x7f07940c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07940b2cc0 0x7f07940c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 -- 172.21.15.5:0/4288960083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940c9b70 con 0x7f079415de70 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f0793fff640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b7130 0x7f07940b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079952d640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f079415de70 0x7f0794153ad0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f078c034040 tx=0x7f078c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f07917fa640 1 -- 172.21.15.5:0/4288960083 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c041020 con 0x7f079415de70 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f07917fa640 1 -- 172.21.15.5:0/4288960083 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c037040 con 0x7f079415de70 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07940c9e10 con 0x7f079415de70 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f07917fa640 1 -- 172.21.15.5:0/4288960083 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c036050 con 0x7f079415de70 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.609+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0794151d90 con 0x7f079415de70 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.610+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079404ef20 con 0x7f079415de70 2024-04-25T08:59:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.611+0000 7f07917fa640 1 -- 172.21.15.5:0/4288960083 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f078c007c30 con 0x7f079415de70 2024-04-25T08:59:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.611+0000 7f07917fa640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f077806b4d0 0x7f077806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.611+0000 7f07917fa640 1 -- 172.21.15.5:0/4288960083 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f078c0aab00 con 0x7f079415de70 2024-04-25T08:59:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.611+0000 7f0798d2c640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f077806b4d0 0x7f077806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.612+0000 7f0798d2c640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f077806b4d0 0x7f077806d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0788000f60 tx=0x7f0788007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.615+0000 7f07917fa640 1 -- 172.21.15.5:0/4288960083 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f078c04b060 con 0x7f079415de70 2024-04-25T08:59:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.800+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07940b8f80 con 0x7f079415de70 2024-04-25T08:59:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.801+0000 7f07917fa640 1 -- 172.21.15.5:0/4288960083 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16621 (secure 0 0 0) 0x7f078c0799d0 con 0x7f079415de70 2024-04-25T08:59:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T08:59:55.791 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:26.620146+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:14.076773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:14.788001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f077806b4d0 msgr2=0x7f077806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f077806b4d0 0x7f077806d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0788000f60 tx=0x7f0788007c00 comp rx=0 tx=0).stop 2024-04-25T08:59:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f079415de70 msgr2=0x7f0794153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f079415de70 0x7f0794153ad0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f078c034040 tx=0x7f078c004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 shutdown_connections 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f077806b4d0 0x7f077806d990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f079415de70 0x7f0794153ad0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f07940b7130 0x7f07940b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 --2- 172.21.15.5:0/4288960083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07940b2cc0 0x7f07940c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 >> 172.21.15.5:0/4288960083 conn(0x7f079406b000 msgr2=0x7f07940b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 shutdown_connections 2024-04-25T08:59:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.803+0000 7f079af90640 1 -- 172.21.15.5:0/4288960083 wait complete. 2024-04-25T08:59:55.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:59:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.915+0000 7f63e0942640 1 Processor -- start 2024-04-25T08:59:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.915+0000 7f63e0942640 1 -- start start 2024-04-25T08:59:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63e0942640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63dc0cea80 0x7f63dc15f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63e0942640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc06bd00 0x7f63dc0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63e0942640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc15ef10 con 0x7f63dc15fd80 2024-04-25T08:59:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63e0942640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc0cfd60 con 0x7f63dc0cea80 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63e0942640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc15f480 con 0x7f63dc06bd00 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63da59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63dc0cea80 0x7f63dc15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63d3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f63dc15fd80 0x7f63dc06b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53822/0 (socket says 172.21.15.5:53822) 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63d3fff640 1 -- 172.21.15.5:0/306393118 learned_addr learned my addr 172.21.15.5:0/306393118 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63dad9d640 1 --2- 172.21.15.5:0/306393118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc06bd00 0x7f63dc0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63da59c640 1 -- 172.21.15.5:0/306393118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc06bd00 msgr2=0x7f63dc0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63da59c640 1 --2- 172.21.15.5:0/306393118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc06bd00 0x7f63dc0d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63da59c640 1 -- 172.21.15.5:0/306393118 >> v1:172.21.15.5:6789/0 conn(0x7f63dc15fd80 legacy=0x7f63dc06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63da59c640 1 -- 172.21.15.5:0/306393118 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc15f1a0 con 0x7f63dc0cea80 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.916+0000 7f63d9d9b640 1 -- 172.21.15.5:0/306393118 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140280134 0 0) 0x7f63dc15ef10 con 0x7f63dc15fd80 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.917+0000 7f63da59c640 1 --2- 172.21.15.5:0/306393118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cea80 0x7f63dc15f840 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0097a0 tx=0x7f63cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0b965393493f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.917+0000 7f63d9d9b640 1 -- 172.21.15.5:0/306393118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc037070 con 0x7f63dc0cea80 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.917+0000 7f63d9d9b640 1 -- 172.21.15.5:0/306393118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc032440 con 0x7f63dc0cea80 2024-04-25T08:59:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.917+0000 7f63d9d9b640 1 -- 172.21.15.5:0/306393118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc032810 con 0x7f63dc0cea80 2024-04-25T08:59:55.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 -- 172.21.15.5:0/306393118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cea80 msgr2=0x7f63dc15f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 --2- 172.21.15.5:0/306393118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cea80 0x7f63dc15f840 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0097a0 tx=0x7f63cc02a180 comp rx=0 tx=0).stop 2024-04-25T08:59:55.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 -- 172.21.15.5:0/306393118 shutdown_connections 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 --2- 172.21.15.5:0/306393118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc06bd00 0x7f63dc0d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 --2- 172.21.15.5:0/306393118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc0cea80 0x7f63dc15f840 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 -- 172.21.15.5:0/306393118 >> 172.21.15.5:0/306393118 conn(0x7f63dc0d19f0 msgr2=0x7f63dc0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 -- 172.21.15.5:0/306393118 shutdown_connections 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.918+0000 7f63e0942640 1 -- 172.21.15.5:0/306393118 wait complete. 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.919+0000 7f63e0942640 1 Processor -- start 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.919+0000 7f63e0942640 1 -- start start 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63e0942640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc06bd00 0x7f63dc156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63e0942640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63dc0cea80 0x7f63dc0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63e0942640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc0b0ed0 0x7f63dc0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63e0942640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0d1660 con 0x7f63dc06bd00 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63e0942640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0d0270 con 0x7f63dc0cea80 2024-04-25T08:59:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63e0942640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0d17e0 con 0x7f63dc0b0ed0 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc06bd00 0x7f63dc156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc06bd00 0x7f63dc156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44384/0 (socket says 172.21.15.5:44384) 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 -- 172.21.15.5:0/1764934460 learned_addr learned my addr 172.21.15.5:0/1764934460 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 -- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc0b0ed0 msgr2=0x7f63dc0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63dad9d640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc0b0ed0 0x7f63dc0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63d3fff640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63dc0cea80 0x7f63dc0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc0b0ed0 0x7f63dc0b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 -- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63dc0cea80 msgr2=0x7f63dc0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63dc0cea80 0x7f63dc0b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 -- 172.21.15.5:0/1764934460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0b5880 con 0x7f63dc06bd00 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63da59c640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc06bd00 0x7f63dc156ee0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f63cc000c00 tx=0x7f63cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.920+0000 7f63d2ffd640 1 -- 172.21.15.5:0/1764934460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc037040 con 0x7f63dc06bd00 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.921+0000 7f63d2ffd640 1 -- 172.21.15.5:0/1764934460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc042070 con 0x7f63dc06bd00 2024-04-25T08:59:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.921+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc0b5b60 con 0x7f63dc06bd00 2024-04-25T08:59:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.921+0000 7f63d2ffd640 1 -- 172.21.15.5:0/1764934460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc030bb0 con 0x7f63dc06bd00 2024-04-25T08:59:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.921+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc159110 con 0x7f63dc06bd00 2024-04-25T08:59:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.922+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc04ef20 con 0x7f63dc06bd00 2024-04-25T08:59:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.922+0000 7f63d2ffd640 1 -- 172.21.15.5:0/1764934460 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f63cc047460 con 0x7f63dc06bd00 2024-04-25T08:59:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.922+0000 7f63d2ffd640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63bc06b500 0x7f63bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.923+0000 7f63d2ffd640 1 -- 172.21.15.5:0/1764934460 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f63cc0aad40 con 0x7f63dc06bd00 2024-04-25T08:59:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.923+0000 7f63d3fff640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63bc06b500 0x7f63bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.923+0000 7f63d3fff640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63bc06b500 0x7f63bc06d9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0d2360 tx=0x7f63c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:55.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:55.927+0000 7f63d2ffd640 1 -- 172.21.15.5:0/1764934460 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63cc032e20 con 0x7f63dc06bd00 2024-04-25T08:59:56.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.144+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f63dc0cefa0 con 0x7f63dc06bd00 2024-04-25T08:59:56.134 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T08:59:56.145+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:59:56.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.146+0000 7f63d2ffd640 1 -- 172.21.15.5:0/1764934460 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f63cc079c10 con 0x7f63dc06bd00 2024-04-25T08:59:56.135 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:59:56.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63bc06b500 msgr2=0x7f63bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:56.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63bc06b500 0x7f63bc06d9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0d2360 tx=0x7f63c4009040 comp rx=0 tx=0).stop 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc06bd00 msgr2=0x7f63dc156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc06bd00 0x7f63dc156ee0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f63cc000c00 tx=0x7f63cc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 shutdown_connections 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f63bc06b500 0x7f63bc06d9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f63dc0b0ed0 0x7f63dc0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63dc0cea80 0x7f63dc0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 --2- 172.21.15.5:0/1764934460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63dc06bd00 0x7f63dc156ee0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 >> 172.21.15.5:0/1764934460 conn(0x7f63dc0d19f0 msgr2=0x7f63dc0afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 shutdown_connections 2024-04-25T08:59:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.149+0000 7f63e0942640 1 -- 172.21.15.5:0/1764934460 wait complete. 2024-04-25T08:59:56.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:59:56.180 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T08:59:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.268+0000 7fb98ce88640 1 Processor -- start 2024-04-25T08:59:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.268+0000 7fb98ce88640 1 -- start start 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.269+0000 7fb98ce88640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9880d2dc0 0x7fb9880d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.269+0000 7fb98ce88640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9880d3720 con 0x7fb9880ce1c0 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.269+0000 7fb98ce88640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98815e260 con 0x7fb98815de80 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.269+0000 7fb98ce88640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9880d1ef0 con 0x7fb9880d2dc0 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.269+0000 7fb986d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9880d2dc0 0x7fb9880d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.269+0000 7fb985d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb9880ce1c0 0x7fb9880d2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53840/0 (socket says 172.21.15.5:53840) 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.269+0000 7fb985d9b640 1 -- 172.21.15.5:0/2019351973 learned_addr learned my addr 172.21.15.5:0/2019351973 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.270+0000 7fb986d9d640 1 -- 172.21.15.5:0/2019351973 >> v1:172.21.15.80:6789/0 conn(0x7fb98815de80 legacy=0x7fb9880ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.270+0000 7fb986d9d640 1 -- 172.21.15.5:0/2019351973 >> v1:172.21.15.5:6789/0 conn(0x7fb9880ce1c0 legacy=0x7fb9880d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.270+0000 7fb986d9d640 1 -- 172.21.15.5:0/2019351973 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880d18c0 con 0x7fb9880d2dc0 2024-04-25T08:59:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.270+0000 7fb98559a640 1 -- 172.21.15.5:0/2019351973 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358413918 0 0) 0x7fb9880d3720 con 0x7fb9880ce1c0 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.270+0000 7fb986d9d640 1 --2- 172.21.15.5:0/2019351973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880d2dc0 0x7fb9880d31e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb9800097a0 tx=0x7fb98002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee75050f4f6e2bb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.270+0000 7fb98559a640 1 -- 172.21.15.5:0/2019351973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980037070 con 0x7fb9880d2dc0 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98559a640 1 -- 172.21.15.5:0/2019351973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980032440 con 0x7fb9880d2dc0 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98559a640 1 -- 172.21.15.5:0/2019351973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980032810 con 0x7fb9880d2dc0 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98ce88640 1 -- 172.21.15.5:0/2019351973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880d2dc0 msgr2=0x7fb9880d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98ce88640 1 --2- 172.21.15.5:0/2019351973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880d2dc0 0x7fb9880d31e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb9800097a0 tx=0x7fb98002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98ce88640 1 -- 172.21.15.5:0/2019351973 shutdown_connections 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98ce88640 1 --2- 172.21.15.5:0/2019351973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880d2dc0 0x7fb9880d31e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98ce88640 1 -- 172.21.15.5:0/2019351973 >> 172.21.15.5:0/2019351973 conn(0x7fb98806b000 msgr2=0x7fb98806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98ce88640 1 -- 172.21.15.5:0/2019351973 shutdown_connections 2024-04-25T08:59:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.271+0000 7fb98ce88640 1 -- 172.21.15.5:0/2019351973 wait complete. 2024-04-25T08:59:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.272+0000 7fb98ce88640 1 Processor -- start 2024-04-25T08:59:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98ce88640 1 -- start start 2024-04-25T08:59:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98ce88640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9880ce1c0 0x7fb988160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98ce88640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9880d2dc0 0x7fb9880cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98ce88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb98815de80 0x7fb9880b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98ce88640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880b6cf0 con 0x7fb98815de80 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98ce88640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880d1b80 con 0x7fb9880ce1c0 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98ce88640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880b6e70 con 0x7fb9880d2dc0 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb986d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb98815de80 0x7fb9880b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb986d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb98815de80 0x7fb9880b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44412/0 (socket says 172.21.15.5:44412) 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb986d9d640 1 -- 172.21.15.5:0/1921147004 learned_addr learned my addr 172.21.15.5:0/1921147004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb98659c640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9880ce1c0 0x7fb988160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.273+0000 7fb985d9b640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9880d2dc0 0x7fb9880cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb986d9d640 1 -- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9880d2dc0 msgr2=0x7fb9880cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb986d9d640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9880d2dc0 0x7fb9880cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb986d9d640 1 -- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9880ce1c0 msgr2=0x7fb988160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb986d9d640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9880ce1c0 0x7fb988160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb986d9d640 1 -- 172.21.15.5:0/1921147004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98815ff70 con 0x7fb98815de80 2024-04-25T08:59:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb98659c640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9880ce1c0 0x7fb988160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb986d9d640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb98815de80 0x7fb9880b46c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb9800097a0 tx=0x7fb9800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb97effd640 1 -- 172.21.15.5:0/1921147004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980037040 con 0x7fb98815de80 2024-04-25T08:59:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb97effd640 1 -- 172.21.15.5:0/1921147004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980042070 con 0x7fb98815de80 2024-04-25T08:59:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb988160250 con 0x7fb98815de80 2024-04-25T08:59:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb97effd640 1 -- 172.21.15.5:0/1921147004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980030b30 con 0x7fb98815de80 2024-04-25T08:59:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.274+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98815f2b0 con 0x7fb98815de80 2024-04-25T08:59:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.275+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9880d2be0 con 0x7fb98815de80 2024-04-25T08:59:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.276+0000 7fb97effd640 1 -- 172.21.15.5:0/1921147004 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb980030cd0 con 0x7fb98815de80 2024-04-25T08:59:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.276+0000 7fb97effd640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb96806b4d0 0x7fb96806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.276+0000 7fb97effd640 1 -- 172.21.15.5:0/1921147004 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb9800aad60 con 0x7fb98815de80 2024-04-25T08:59:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.276+0000 7fb98659c640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb96806b4d0 0x7fb96806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.277+0000 7fb98659c640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb96806b4d0 0x7fb96806d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9780012e0 tx=0x7fb978009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.280+0000 7fb97effd640 1 -- 172.21.15.5:0/1921147004 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9880d2be0 con 0x7fb98815de80 2024-04-25T08:59:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:56.503+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb98804ef20 con 0x7fb98815de80 2024-04-25T08:59:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.151+0000 7fb97effd640 1 -- 172.21.15.5:0/1921147004 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb980079be0 con 0x7fb98815de80 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb96806b4d0 msgr2=0x7fb96806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb96806b4d0 0x7fb96806d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9780012e0 tx=0x7fb978009040 comp rx=0 tx=0).stop 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb98815de80 msgr2=0x7fb9880b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb98815de80 0x7fb9880b46c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb9800097a0 tx=0x7fb9800046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 shutdown_connections 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb96806b4d0 0x7fb96806d990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb98815de80 0x7fb9880b46c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9880d2dc0 0x7fb9880cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 --2- 172.21.15.5:0/1921147004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9880ce1c0 0x7fb988160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 >> 172.21.15.5:0/1921147004 conn(0x7fb98806b000 msgr2=0x7fb98815d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 shutdown_connections 2024-04-25T08:59:57.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.154+0000 7fb98ce88640 1 -- 172.21.15.5:0/1921147004 wait complete. 2024-04-25T08:59:57.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:59:57.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.323+0000 7fb9c61d5640 1 Processor -- start 2024-04-25T08:59:57.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.323+0000 7fb9c61d5640 1 -- start start 2024-04-25T08:59:57.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9c61d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb9c0074210 0x7fb9c00729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9c61d5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c0161a40 con 0x7fb9c006d1e0 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9c61d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c0161d20 con 0x7fb9c0071060 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9c61d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c0074610 con 0x7fb9c0074210 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9beffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb9c006d1e0 0x7fb9c00ad9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53854/0 (socket says 172.21.15.5:53854) 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9beffd640 1 -- 172.21.15.5:0/539983180 learned_addr learned my addr 172.21.15.5:0/539983180 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9bffff640 1 --2- 172.21.15.5:0/539983180 >> v2:172.21.15.80:3300/0 conn(0x7fb9c0074210 0x7fb9c00729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.324+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161330455 0 0) 0x7fb9c0161a40 con 0x7fb9c006d1e0 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a8003520 con 0x7fb9c006d1e0 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4213776792 0 0) 0x7fb9a8003520 con 0x7fb9c006d1e0 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 >> v2:172.21.15.80:3300/0 conn(0x7fb9c0074210 msgr2=0x7fb9c00729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 --2- 172.21.15.5:0/539983180 >> v2:172.21.15.80:3300/0 conn(0x7fb9c0074210 0x7fb9c00729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 >> v1:172.21.15.80:6789/0 conn(0x7fb9c0071060 legacy=0x7fb9c006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0162000 con 0x7fb9c006d1e0 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb9b4001670 con 0x7fb9c006d1e0 2024-04-25T08:59:57.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 >> v1:172.21.15.5:6789/0 conn(0x7fb9c006d1e0 legacy=0x7fb9c00ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9a80039b0 0x7fb9a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a8004800 0x7fb9a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a80051c0 0x7fb9a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a800c030 con 0x7fb9a8004800 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a800c1e0 con 0x7fb9a80039b0 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a800c3e0 con 0x7fb9a80051c0 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9bffff640 1 --2- 172.21.15.5:0/539983180 >> v2:172.21.15.80:3300/0 conn(0x7fb9c0074210 0x7fb9c00729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9beffd640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a8004800 0x7fb9a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9bf7fe640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9a80039b0 0x7fb9a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9bffff640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a80051c0 0x7fb9a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9beffd640 1 -- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a80051c0 msgr2=0x7fb9a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9beffd640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a80051c0 0x7fb9a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9beffd640 1 -- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9a80039b0 msgr2=0x7fb9a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9beffd640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9a80039b0 0x7fb9a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9beffd640 1 -- 172.21.15.5:0/539983180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8003520 con 0x7fb9a8004800 2024-04-25T08:59:57.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.325+0000 7fb9bffff640 1 -- 172.21.15.5:0/539983180 reap_dead start 2024-04-25T08:59:57.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.326+0000 7fb9beffd640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a8004800 0x7fb9a8004c80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c240 tx=0x7fb9a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465f5974a257c7f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:57.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.326+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4007cf0 con 0x7fb9a8004800 2024-04-25T08:59:57.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.326+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4005af0 con 0x7fb9a8004800 2024-04-25T08:59:57.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.326+0000 7fb9be7fc640 1 -- 172.21.15.5:0/539983180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4007070 con 0x7fb9a8004800 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.327+0000 7fb9c61d5640 1 -- 172.21.15.5:0/539983180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a8004800 msgr2=0x7fb9a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.327+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a8004800 0x7fb9a8004c80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c240 tx=0x7fb9a8005830 comp rx=0 tx=0).stop 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.327+0000 7fb9c61d5640 1 -- 172.21.15.5:0/539983180 shutdown_connections 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.327+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/539983180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a8004800 0x7fb9a8004c80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.327+0000 7fb9c61d5640 1 -- 172.21.15.5:0/539983180 >> 172.21.15.5:0/539983180 conn(0x7fb9c00b1d30 msgr2=0x7fb9c00b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.327+0000 7fb9c61d5640 1 -- 172.21.15.5:0/539983180 shutdown_connections 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.327+0000 7fb9c61d5640 1 -- 172.21.15.5:0/539983180 wait complete. 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.328+0000 7fb9c61d5640 1 Processor -- start 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.328+0000 7fb9c61d5640 1 -- start start 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9c61d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a8004800 0x7fb9c015f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9c61d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c0142730 0x7fb9c013dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9c61d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c013f350 0x7fb9c013f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9c61d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0071440 con 0x7fb9c0142730 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9c61d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01617f0 con 0x7fb9c013f350 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9c61d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00715c0 con 0x7fb9a8004800 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c0142730 0x7fb9c013dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c0142730 0x7fb9c013dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44442/0 (socket says 172.21.15.5:44442) 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 -- 172.21.15.5:0/1988080258 learned_addr learned my addr 172.21.15.5:0/1988080258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9bffff640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c013f350 0x7fb9c013f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9bf7fe640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a8004800 0x7fb9c015f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 -- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a8004800 msgr2=0x7fb9c015f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a8004800 0x7fb9c015f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 -- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c013f350 msgr2=0x7fb9c013f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c013f350 0x7fb9c013f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:57.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.329+0000 7fb9beffd640 1 -- 172.21.15.5:0/1988080258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0143160 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.330+0000 7fb9beffd640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c0142730 0x7fb9c013dae0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c360 tx=0x7fb9c01621d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.330+0000 7fb9a7fff640 1 -- 172.21.15.5:0/1988080258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4041020 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.330+0000 7fb9a7fff640 1 -- 172.21.15.5:0/1988080258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4038040 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.330+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c0143400 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.330+0000 7fb9a7fff640 1 -- 172.21.15.5:0/1988080258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4001670 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.330+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c01439c0 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.331+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c004ef20 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.331+0000 7fb9a7fff640 1 -- 172.21.15.5:0/1988080258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9b4044020 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.332+0000 7fb9a7fff640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9ac06b500 0x7fb9ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.332+0000 7fb9a7fff640 1 -- 172.21.15.5:0/1988080258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb9b40aa5f0 con 0x7fb9c0142730 2024-04-25T08:59:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.332+0000 7fb9bf7fe640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9ac06b500 0x7fb9ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:57.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.332+0000 7fb9bf7fe640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9ac06b500 0x7fb9ac06d9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0000c00 tx=0x7fb9b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:57.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.336+0000 7fb9a7fff640 1 -- 172.21.15.5:0/1988080258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9b4079500 con 0x7fb9c0142730 2024-04-25T08:59:57.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:57.517+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9c00af980 con 0x7fb9c0142730 2024-04-25T08:59:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.153+0000 7fb9a7fff640 1 -- 172.21.15.5:0/1988080258 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb9b4078e00 con 0x7fb9c0142730 2024-04-25T08:59:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:59:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9ac06b500 msgr2=0x7fb9ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:58.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9ac06b500 0x7fb9ac06d9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0000c00 tx=0x7fb9b0009040 comp rx=0 tx=0).stop 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c0142730 msgr2=0x7fb9c013dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c0142730 0x7fb9c013dae0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c360 tx=0x7fb9c01621d0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 shutdown_connections 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9ac06b500 0x7fb9ac06d9c0 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0000c00 tx=0x7fb9b0009040 comp rx=0 tx=0).stop 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9c013f350 0x7fb9c013f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c0142730 0x7fb9c013dae0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 --2- 172.21.15.5:0/1988080258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9a8004800 0x7fb9c015f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 >> 172.21.15.5:0/1988080258 conn(0x7fb9c00b1d30 msgr2=0x7fb9c00ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.157+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 shutdown_connections 2024-04-25T08:59:58.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.158+0000 7fb9c61d5640 1 -- 172.21.15.5:0/1988080258 wait complete. 2024-04-25T08:59:58.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:59:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.284+0000 7f9087730640 1 Processor -- start 2024-04-25T08:59:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.284+0000 7f9087730640 1 -- start start 2024-04-25T08:59:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9087730640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 0x7f90801617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9087730640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9080162070 con 0x7f90800b9470 2024-04-25T08:59:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9087730640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9080162350 con 0x7f90800ceec0 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9087730640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90800d1c50 con 0x7f908015dbd0 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9084ccb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90800b9470 0x7f90800ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53868/0 (socket says 172.21.15.5:53868) 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9084ccb640 1 -- 172.21.15.5:0/2706409800 learned_addr learned my addr 172.21.15.5:0/2706409800 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f90854cc640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 0x7f90801617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868976419 0 0) 0x7f9080162070 con 0x7f90800b9470 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.285+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c003520 con 0x7f90800b9470 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065823775 0 0) 0x7f9080162350 con 0x7f90800ceec0 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9080162070 con 0x7f90800ceec0 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509213701 0 0) 0x7f906c003520 con 0x7f90800b9470 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 msgr2=0x7f90801617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 0x7f90801617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 >> v1:172.21.15.80:6789/0 conn(0x7f90800ceec0 legacy=0x7f90800d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800d1f30 con 0x7f90800b9470 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f9070001670 con 0x7f90800b9470 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 >> v1:172.21.15.5:6789/0 conn(0x7f90800b9470 legacy=0x7f90800ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c003b70 0x7f906c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906c004800 0x7f906c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 0x7f906c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800d1c50 con 0x7f906c004800 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c00ba70 con 0x7f906c003b70 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c00bc40 con 0x7f908015dbd0 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9084ccb640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906c004800 0x7f906c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f90854cc640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c003b70 0x7f906c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9085ccd640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 0x7f906c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9084ccb640 1 -- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 msgr2=0x7f906c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9084ccb640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f908015dbd0 0x7f906c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9084ccb640 1 -- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c003b70 msgr2=0x7f906c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9084ccb640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c003b70 0x7f906c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.286+0000 7f9084ccb640 1 -- 172.21.15.5:0/2706409800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c003520 con 0x7f906c004800 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.287+0000 7f9084ccb640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906c004800 0x7f906c004c80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f90800b98b0 tx=0x7f906c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b2462e4d75ddf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.287+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070007ca0 con 0x7f906c004800 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.287+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070005af0 con 0x7f906c004800 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.287+0000 7f9077fff640 1 -- 172.21.15.5:0/2706409800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070007070 con 0x7f906c004800 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.287+0000 7f9087730640 1 -- 172.21.15.5:0/2706409800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906c004800 msgr2=0x7f906c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.287+0000 7f9087730640 1 --2- 172.21.15.5:0/2706409800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906c004800 0x7f906c004c80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f90800b98b0 tx=0x7f906c005830 comp rx=0 tx=0).stop 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.287+0000 7f9085ccd640 1 -- 172.21.15.5:0/2706409800 reap_dead start 2024-04-25T08:59:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.288+0000 7f9087730640 1 -- 172.21.15.5:0/2706409800 shutdown_connections 2024-04-25T08:59:58.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.288+0000 7f9087730640 1 -- 172.21.15.5:0/2706409800 >> 172.21.15.5:0/2706409800 conn(0x7f9080066ad0 msgr2=0x7f9080066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:58.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.288+0000 7f9087730640 1 -- 172.21.15.5:0/2706409800 shutdown_connections 2024-04-25T08:59:58.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.288+0000 7f9087730640 1 -- 172.21.15.5:0/2706409800 wait complete. 2024-04-25T08:59:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.289+0000 7f9087730640 1 Processor -- start 2024-04-25T08:59:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.289+0000 7f9087730640 1 -- start start 2024-04-25T08:59:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9087730640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c004800 0x7f90801e9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9087730640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9080158e10 0x7f90800b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9087730640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90801e9eb0 0x7f90800b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9087730640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015e130 con 0x7f9080158e10 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9087730640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015dfb0 con 0x7f906c004800 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9087730640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90801617b0 con 0x7f90801e9eb0 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9080158e10 0x7f90800b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9080158e10 0x7f90800b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44452/0 (socket says 172.21.15.5:44452) 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 -- 172.21.15.5:0/3455595175 learned_addr learned my addr 172.21.15.5:0/3455595175 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9085ccd640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90801e9eb0 0x7f90800b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f90854cc640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c004800 0x7f90801e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 -- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90801e9eb0 msgr2=0x7f90800b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90801e9eb0 0x7f90800b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 -- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c004800 msgr2=0x7f90801e9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c004800 0x7f90801e9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:58.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 -- 172.21.15.5:0/3455595175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90801f8580 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f90854cc640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c004800 0x7f90801e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9085ccd640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90801e9eb0 0x7f90800b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9084ccb640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9080158e10 0x7f90800b50b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f907000c220 tx=0x7f9080162520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9075ffb640 1 -- 172.21.15.5:0/3455595175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070041030 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9075ffb640 1 -- 172.21.15.5:0/3455595175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070038040 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90801f77c0 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.290+0000 7f9075ffb640 1 -- 172.21.15.5:0/3455595175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070007070 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.291+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90801f7d80 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.292+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908004ef20 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.292+0000 7f9075ffb640 1 -- 172.21.15.5:0/3455595175 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9070044070 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.293+0000 7f9075ffb640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f906406b4d0 0x7f906406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.293+0000 7f9075ffb640 1 -- 172.21.15.5:0/3455595175 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f90700a9b60 con 0x7f9080158e10 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.293+0000 7f90854cc640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f906406b4d0 0x7f906406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:58.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.294+0000 7f90854cc640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f906406b4d0 0x7f906406d990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f907c006d40 tx=0x7f907c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:58.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.297+0000 7f9075ffb640 1 -- 172.21.15.5:0/3455595175 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f907004b020 con 0x7f9080158e10 2024-04-25T08:59:58.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:58.478+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90800cf750 con 0x7f9080158e10 2024-04-25T08:59:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.158+0000 7f9075ffb640 1 -- 172.21.15.5:0/3455595175 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9070078af0 con 0x7f9080158e10 2024-04-25T08:59:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T08:59:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f906406b4d0 msgr2=0x7f906406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f906406b4d0 0x7f906406d990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f907c006d40 tx=0x7f907c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9080158e10 msgr2=0x7f90800b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9080158e10 0x7f90800b50b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f907000c220 tx=0x7f9080162520 comp rx=0 tx=0).stop 2024-04-25T08:59:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 shutdown_connections 2024-04-25T08:59:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f906406b4d0 0x7f906406d990 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90801e9eb0 0x7f90800b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9080158e10 0x7f90800b50b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 --2- 172.21.15.5:0/3455595175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906c004800 0x7f90801e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.164+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 >> 172.21.15.5:0/3455595175 conn(0x7f9080066ad0 msgr2=0x7f90800b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:59.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.166+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 shutdown_connections 2024-04-25T08:59:59.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.168+0000 7f9087730640 1 -- 172.21.15.5:0/3455595175 wait complete. 2024-04-25T08:59:59.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:59:59.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.300+0000 7f62bb038640 1 Processor -- start 2024-04-25T08:59:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.300+0000 7f62bb038640 1 -- start start 2024-04-25T08:59:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62bb038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b415df10 0x7f62b41618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62bb038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62b40b6250 0x7f62b40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62bb038640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b4162150 con 0x7f62b40cee10 2024-04-25T08:59:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62bb038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40d20d0 con 0x7f62b40b6250 2024-04-25T08:59:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62bb038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4162430 con 0x7f62b415df10 2024-04-25T08:59:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62b3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62b40b6250 0x7f62b40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62b95d5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62b40cee10 0x7f62b40d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53880/0 (socket says 172.21.15.5:53880) 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.301+0000 7f62b95d5640 1 -- 172.21.15.5:0/2745315459 learned_addr learned my addr 172.21.15.5:0/2745315459 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.302+0000 7f62b3fff640 1 -- 172.21.15.5:0/2745315459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b415df10 msgr2=0x7f62b41618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.302+0000 7f62b3fff640 1 --2- 172.21.15.5:0/2745315459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b415df10 0x7f62b41618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.302+0000 7f62b3fff640 1 -- 172.21.15.5:0/2745315459 >> v1:172.21.15.5:6789/0 conn(0x7f62b40cee10 legacy=0x7f62b40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.302+0000 7f62b37fe640 1 -- 172.21.15.5:0/2745315459 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583684698 0 0) 0x7f62b4162150 con 0x7f62b40cee10 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.302+0000 7f62b3fff640 1 -- 172.21.15.5:0/2745315459 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4162710 con 0x7f62b40b6250 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.302+0000 7f62b3fff640 1 --2- 172.21.15.5:0/2745315459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40b6250 0x7f62b40ce8d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f62a80097a0 tx=0x7f62a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7b2456f53163fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62b37fe640 1 -- 172.21.15.5:0/2745315459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8037070 con 0x7f62b40b6250 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62b37fe640 1 -- 172.21.15.5:0/2745315459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a8032440 con 0x7f62b40b6250 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62b37fe640 1 -- 172.21.15.5:0/2745315459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8032810 con 0x7f62b40b6250 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 -- 172.21.15.5:0/2745315459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40b6250 msgr2=0x7f62b40ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 --2- 172.21.15.5:0/2745315459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40b6250 0x7f62b40ce8d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f62a80097a0 tx=0x7f62a802a180 comp rx=0 tx=0).stop 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 -- 172.21.15.5:0/2745315459 shutdown_connections 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 --2- 172.21.15.5:0/2745315459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40b6250 0x7f62b40ce8d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 --2- 172.21.15.5:0/2745315459 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b415df10 0x7f62b41618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 -- 172.21.15.5:0/2745315459 >> 172.21.15.5:0/2745315459 conn(0x7f62b40668f0 msgr2=0x7f62b4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 -- 172.21.15.5:0/2745315459 shutdown_connections 2024-04-25T08:59:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.303+0000 7f62bb038640 1 -- 172.21.15.5:0/2745315459 wait complete. 2024-04-25T08:59:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.304+0000 7f62bb038640 1 Processor -- start 2024-04-25T08:59:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.304+0000 7f62bb038640 1 -- start start 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62bb038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b40b6250 0x7f62b40cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62bb038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62b40cee10 0x7f62b40aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62bb038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415df10 0x7f62b415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62bb038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40d3570 con 0x7f62b415df10 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62bb038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4161e10 con 0x7f62b40cee10 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62bb038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40d36f0 con 0x7f62b40b6250 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62b95d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415df10 0x7f62b415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62b95d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415df10 0x7f62b415d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44470/0 (socket says 172.21.15.5:44470) 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.305+0000 7f62b95d5640 1 -- 172.21.15.5:0/1316497649 learned_addr learned my addr 172.21.15.5:0/1316497649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b8dd4640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b40b6250 0x7f62b40cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b3fff640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62b40cee10 0x7f62b40aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b95d5640 1 -- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b40b6250 msgr2=0x7f62b40cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b95d5640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b40b6250 0x7f62b40cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b95d5640 1 -- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62b40cee10 msgr2=0x7f62b40aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b95d5640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62b40cee10 0x7f62b40aa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b95d5640 1 -- 172.21.15.5:0/1316497649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40cb390 con 0x7f62b415df10 2024-04-25T08:59:59.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b3fff640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62b40cee10 0x7f62b40aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b8dd4640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b40b6250 0x7f62b40cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b95d5640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415df10 0x7f62b415d000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f62a400c450 tx=0x7f62a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b17fa640 1 -- 172.21.15.5:0/1316497649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4018070 con 0x7f62b415df10 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b17fa640 1 -- 172.21.15.5:0/1316497649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4007500 con 0x7f62b415df10 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b40ce3b0 con 0x7f62b415df10 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62b17fa640 1 -- 172.21.15.5:0/1316497649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4004a20 con 0x7f62b415df10 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.306+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b40cddf0 con 0x7f62b415df10 2024-04-25T08:59:59.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.307+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b404ef20 con 0x7f62b415df10 2024-04-25T08:59:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.307+0000 7f62b17fa640 1 -- 172.21.15.5:0/1316497649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f62a401b070 con 0x7f62b415df10 2024-04-25T08:59:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.308+0000 7f62b17fa640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f62a006b4d0 0x7f62a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.308+0000 7f62b17fa640 1 -- 172.21.15.5:0/1316497649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f62a4089080 con 0x7f62b415df10 2024-04-25T08:59:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.308+0000 7f62b8dd4640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f62a006b4d0 0x7f62a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.309+0000 7f62b8dd4640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f62a006b4d0 0x7f62a006d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b1a20 tx=0x7f62ac0073e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.312+0000 7f62b17fa640 1 -- 172.21.15.5:0/1316497649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f62a4058290 con 0x7f62b415df10 2024-04-25T08:59:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.499+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f62b40b3340 con 0x7f62b415df10 2024-04-25T08:59:59.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.501+0000 7f62b17fa640 1 -- 172.21.15.5:0/1316497649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62a4057b90 con 0x7f62b415df10 2024-04-25T08:59:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f62a006b4d0 msgr2=0x7f62a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f62a006b4d0 0x7f62a006d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b1a20 tx=0x7f62ac0073e0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415df10 msgr2=0x7f62b415d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415df10 0x7f62b415d000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f62a400c450 tx=0x7f62a400c910 comp rx=0 tx=0).stop 2024-04-25T08:59:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 shutdown_connections 2024-04-25T08:59:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f62a006b4d0 0x7f62a006d990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415df10 0x7f62b415d000 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62b40cee10 0x7f62b40aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 --2- 172.21.15.5:0/1316497649 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62b40b6250 0x7f62b40cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.503+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 >> 172.21.15.5:0/1316497649 conn(0x7f62b40668f0 msgr2=0x7f62b40b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.504+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 shutdown_connections 2024-04-25T08:59:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.504+0000 7f62bb038640 1 -- 172.21.15.5:0/1316497649 wait complete. 2024-04-25T08:59:59.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-04-25T08:59:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.615+0000 7f288c5ce640 1 Processor -- start 2024-04-25T08:59:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.615+0000 7f288c5ce640 1 -- start start 2024-04-25T08:59:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288c5ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28840b2cc0 0x7f28840b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288c5ce640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 0x7f28840ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288c5ce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840d20e0 con 0x7f288415de70 2024-04-25T08:59:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288c5ce640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840d2a10 con 0x7f28840b2cc0 2024-04-25T08:59:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288c5ce640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840d23c0 con 0x7f28840b7130 2024-04-25T08:59:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288a36a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f288415de70 0x7f28840b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53888/0 (socket says 172.21.15.5:53888) 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288a36a640 1 -- 172.21.15.5:0/2798336801 learned_addr learned my addr 172.21.15.5:0/2798336801 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789472431 0 0) 0x7f28840d20e0 con 0x7f288415de70 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f2889b69640 1 --2- 172.21.15.5:0/2798336801 >> v2:172.21.15.80:3300/0 conn(0x7f28840b2cc0 0x7f28840b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286c003520 con 0x7f288415de70 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.616+0000 7f288ab6b640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 0x7f28840ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2438658277 0 0) 0x7f286c003520 con 0x7f288415de70 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 msgr2=0x7f28840ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 0x7f28840ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 >> v2:172.21.15.80:3300/0 conn(0x7f28840b2cc0 msgr2=0x7f28840b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 --2- 172.21.15.5:0/2798336801 >> v2:172.21.15.80:3300/0 conn(0x7f28840b2cc0 0x7f28840b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840d26a0 con 0x7f288415de70 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f287c001670 con 0x7f288415de70 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 >> v1:172.21.15.5:6789/0 conn(0x7f288415de70 legacy=0x7f28840b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c0039b0 0x7f286c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 0x7f286c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840d2a10 con 0x7f286c004d40 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840d23c0 con 0x7f286c0039b0 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c00b9c0 con 0x7f28840b7130 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f288ab6b640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f288a36a640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c0039b0 0x7f286c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f2889b69640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 0x7f286c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f288ab6b640 1 -- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 msgr2=0x7f286c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f288ab6b640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b7130 0x7f286c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f288ab6b640 1 -- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c0039b0 msgr2=0x7f286c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f288ab6b640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286c0039b0 0x7f286c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.617+0000 7f288ab6b640 1 -- 172.21.15.5:0/2798336801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c003520 con 0x7f286c004d40 2024-04-25T08:59:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.618+0000 7f288ab6b640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2874009fc0 tx=0x7f286c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faedbe403139ad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.618+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874009c10 con 0x7f286c004d40 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.618+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874036070 con 0x7f286c004d40 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.618+0000 7f2889368640 1 -- 172.21.15.5:0/2798336801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874031880 con 0x7f286c004d40 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.619+0000 7f288c5ce640 1 -- 172.21.15.5:0/2798336801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 msgr2=0x7f286c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.619+0000 7f288c5ce640 1 --2- 172.21.15.5:0/2798336801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2874009fc0 tx=0x7f286c005830 comp rx=0 tx=0).stop 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.619+0000 7f288ab6b640 1 -- 172.21.15.5:0/2798336801 reap_dead start 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.619+0000 7f288c5ce640 1 -- 172.21.15.5:0/2798336801 shutdown_connections 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.619+0000 7f288c5ce640 1 -- 172.21.15.5:0/2798336801 >> 172.21.15.5:0/2798336801 conn(0x7f288406b000 msgr2=0x7f288406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.619+0000 7f288c5ce640 1 -- 172.21.15.5:0/2798336801 shutdown_connections 2024-04-25T08:59:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.619+0000 7f288c5ce640 1 -- 172.21.15.5:0/2798336801 wait complete. 2024-04-25T08:59:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.620+0000 7f288c5ce640 1 Processor -- start 2024-04-25T08:59:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.620+0000 7f288c5ce640 1 -- start start 2024-04-25T08:59:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288c5ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f28840cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288c5ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28840b3ea0 0x7f288415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288c5ce640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b5ce0 0x7f28840b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288c5ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840cebc0 con 0x7f286c004d40 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288c5ce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840cea40 con 0x7f28840b3ea0 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288c5ce640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840ced40 con 0x7f28840b5ce0 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f28840cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f28840cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44482/0 (socket says 172.21.15.5:44482) 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 -- 172.21.15.5:0/3856330335 learned_addr learned my addr 172.21.15.5:0/3856330335 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288ab6b640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b5ce0 0x7f28840b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f2889b69640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28840b3ea0 0x7f288415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 -- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b5ce0 msgr2=0x7f28840b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b5ce0 0x7f28840b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 -- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28840b3ea0 msgr2=0x7f288415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28840b3ea0 0x7f288415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 -- 172.21.15.5:0/3856330335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28841f3cd0 con 0x7f286c004d40 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288a36a640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f28840cc740 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f287c007290 tx=0x7f287c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f2882ffd640 1 -- 172.21.15.5:0/3856330335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00f9c0 con 0x7f286c004d40 2024-04-25T08:59:59.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f2882ffd640 1 -- 172.21.15.5:0/3856330335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c018070 con 0x7f286c004d40 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f2882ffd640 1 -- 172.21.15.5:0/3856330335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00fda0 con 0x7f286c004d40 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.621+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840b4700 con 0x7f286c004d40 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.622+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28840b4cc0 con 0x7f286c004d40 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.622+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288404ef20 con 0x7f286c004d40 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.623+0000 7f2882ffd640 1 -- 172.21.15.5:0/3856330335 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f287c01d460 con 0x7f286c004d40 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.623+0000 7f2882ffd640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f287006b4d0 0x7f287006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.623+0000 7f2882ffd640 1 -- 172.21.15.5:0/3856330335 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f287c08a080 con 0x7f286c004d40 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.624+0000 7f2889b69640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f287006b4d0 0x7f287006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.624+0000 7f2889b69640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f287006b4d0 0x7f287006d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2878009b80 tx=0x7f2878008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.628+0000 7f2882ffd640 1 -- 172.21.15.5:0/3856330335 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f287c059200 con 0x7f286c004d40 2024-04-25T08:59:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T08:59:59.879+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7f28841f3ea0 con 0x7f286c004d40 2024-04-25T09:00:00.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.159+0000 7f2882ffd640 1 -- 172.21.15.5:0/3856330335 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v176) v1 ==== 143+0+0 (secure 0 0 0) 0x7f287c058b00 con 0x7f286c004d40 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f287006b4d0 msgr2=0x7f287006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f287006b4d0 0x7f287006d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2878009b80 tx=0x7f2878008040 comp rx=0 tx=0).stop 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 msgr2=0x7f28840cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f28840cc740 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f287c007290 tx=0x7f287c007750 comp rx=0 tx=0).stop 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 shutdown_connections 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f287006b4d0 0x7f287006d990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28840b5ce0 0x7f28840b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28840b3ea0 0x7f288415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 --2- 172.21.15.5:0/3856330335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c004d40 0x7f28840cc740 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.161+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 >> 172.21.15.5:0/3856330335 conn(0x7f288406b000 msgr2=0x7f28840b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.162+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 shutdown_connections 2024-04-25T09:00:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.162+0000 7f288c5ce640 1 -- 172.21.15.5:0/3856330335 wait complete. 2024-04-25T09:00:00.163 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-04-25T09:00:00.164 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T09:00:00.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:00.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.280+0000 7fe604038640 1 Processor -- start 2024-04-25T09:00:00.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.280+0000 7fe604038640 1 -- start start 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe604038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe604038640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe5fc0b2cc0 0x7fe5fc0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe604038640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0d20e0 con 0x7fe5fc0b7130 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe604038640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0d2a10 con 0x7fe5fc0b2cc0 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe604038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0d23c0 con 0x7fe5fc15de70 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe6025d5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5fc0b7130 0x7fe5fc0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53892/0 (socket says 172.21.15.5:53892) 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe6025d5640 1 -- 172.21.15.5:0/1660048406 learned_addr learned my addr 172.21.15.5:0/1660048406 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe6015d3640 1 --2- 172.21.15.5:0/1660048406 >> v2:172.21.15.80:3300/0 conn(0x7fe5fc0b2cc0 0x7fe5fc0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.281+0000 7fe601dd4640 1 --2- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.282+0000 7fe600dd2640 1 -- 172.21.15.5:0/1660048406 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462680891 0 0) 0x7fe5fc0d20e0 con 0x7fe5fc0b7130 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.282+0000 7fe600dd2640 1 -- 172.21.15.5:0/1660048406 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e4003520 con 0x7fe5fc0b7130 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.282+0000 7fe6015d3640 1 -- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 msgr2=0x7fe5fc0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.282+0000 7fe6015d3640 1 --2- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.282+0000 7fe6015d3640 1 -- 172.21.15.5:0/1660048406 >> v1:172.21.15.5:6789/0 conn(0x7fe5fc0b7130 legacy=0x7fe5fc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.282+0000 7fe6015d3640 1 -- 172.21.15.5:0/1660048406 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0d26a0 con 0x7fe5fc0b2cc0 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.282+0000 7fe6015d3640 1 --2- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b6bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00097a0 tx=0x7fe5f002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba65f22f0c68daf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe600dd2640 1 -- 172.21.15.5:0/1660048406 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0037070 con 0x7fe5fc0b2cc0 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe600dd2640 1 -- 172.21.15.5:0/1660048406 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0032440 con 0x7fe5fc0b2cc0 2024-04-25T09:00:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe600dd2640 1 -- 172.21.15.5:0/1660048406 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0032810 con 0x7fe5fc0b2cc0 2024-04-25T09:00:00.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 -- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 msgr2=0x7fe5fc0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 --2- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b6bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00097a0 tx=0x7fe5f002a180 comp rx=0 tx=0).stop 2024-04-25T09:00:00.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 -- 172.21.15.5:0/1660048406 shutdown_connections 2024-04-25T09:00:00.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 --2- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b6bf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 --2- 172.21.15.5:0/1660048406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 -- 172.21.15.5:0/1660048406 >> 172.21.15.5:0/1660048406 conn(0x7fe5fc06b000 msgr2=0x7fe5fc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:00.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 -- 172.21.15.5:0/1660048406 shutdown_connections 2024-04-25T09:00:00.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.283+0000 7fe604038640 1 -- 172.21.15.5:0/1660048406 wait complete. 2024-04-25T09:00:00.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 Processor -- start 2024-04-25T09:00:00.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 -- start start 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5fc0b7130 0x7fe5fc152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cf080 con 0x7fe5fc0b7130 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cef00 con 0x7fe5fc0b2cc0 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.285+0000 7fe604038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cf200 con 0x7fe5fc15de70 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5fc0b7130 0x7fe5fc152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5fc0b7130 0x7fe5fc152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44492/0 (socket says 172.21.15.5:44492) 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 -- 172.21.15.5:0/255396176 learned_addr learned my addr 172.21.15.5:0/255396176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe601dd4640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6025d5640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 -- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 msgr2=0x7fe5fc0c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 -- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 msgr2=0x7fe5fc0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 -- 172.21.15.5:0/255396176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0b4690 con 0x7fe5fc0b7130 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe601dd4640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe6015d3640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5fc0b7130 0x7fe5fc152db0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00098c0 tx=0x7fe5f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe5fa7fc640 1 -- 172.21.15.5:0/255396176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0041030 con 0x7fe5fc0b7130 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe5fa7fc640 1 -- 172.21.15.5:0/255396176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f003d4e0 con 0x7fe5fc0b7130 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc0b4970 con 0x7fe5fc0b7130 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe5fa7fc640 1 -- 172.21.15.5:0/255396176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0037040 con 0x7fe5fc0b7130 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.286+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc0b4f30 con 0x7fe5fc0b7130 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.287+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc04ef20 con 0x7fe5fc0b7130 2024-04-25T09:00:00.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.288+0000 7fe5fa7fc640 1 -- 172.21.15.5:0/255396176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5f0044070 con 0x7fe5fc0b7130 2024-04-25T09:00:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.288+0000 7fe5fa7fc640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5e806b4d0 0x7fe5e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.288+0000 7fe5fa7fc640 1 -- 172.21.15.5:0/255396176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5f00aa4d0 con 0x7fe5fc0b7130 2024-04-25T09:00:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.288+0000 7fe601dd4640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5e806b4d0 0x7fe5e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.289+0000 7fe601dd4640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5e806b4d0 0x7fe5e806d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009af0 tx=0x7fe5f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.293+0000 7fe5fa7fc640 1 -- 172.21.15.5:0/255396176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5f0079660 con 0x7fe5fc0b7130 2024-04-25T09:00:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.474+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5fc0d2180 con 0x7fe5fc0b7130 2024-04-25T09:00:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.475+0000 7fe5fa7fc640 1 -- 172.21.15.5:0/255396176 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+12934 (secure 0 0 0) 0x7fe5f0078f60 con 0x7fe5fc0b7130 2024-04-25T09:00:00.465 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:00.465 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T08:59:59.154843+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/2992823124":"2024-04-26T08:59:56.146247+0000","172.21.15.5:6833/2992823124":"2024-04-26T08:59:56.146247+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5e806b4d0 msgr2=0x7fe5e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5e806b4d0 0x7fe5e806d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009af0 tx=0x7fe5f4008040 comp rx=0 tx=0).stop 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5fc0b7130 msgr2=0x7fe5fc152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5fc0b7130 0x7fe5fc152db0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00098c0 tx=0x7fe5f00046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 shutdown_connections 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe5e806b4d0 0x7fe5e806d990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe5fc15de70 0x7fe5fc0c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5fc0b7130 0x7fe5fc152db0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 --2- 172.21.15.5:0/255396176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5fc0b2cc0 0x7fe5fc0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 >> 172.21.15.5:0/255396176 conn(0x7fe5fc06b000 msgr2=0x7fe5fc0ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 shutdown_connections 2024-04-25T09:00:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.477+0000 7fe604038640 1 -- 172.21.15.5:0/255396176 wait complete. 2024-04-25T09:00:00.478 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:00.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:00.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.593+0000 7f42ffabd640 1 Processor -- start 2024-04-25T09:00:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.593+0000 7f42ffabd640 1 -- start start 2024-04-25T09:00:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42ffabd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80b24b0 0x7f42f80b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42ffabd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cff00 0x7f42f80d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42ffabd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f80cdef0 con 0x7f42f815c0f0 2024-04-25T09:00:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42ffabd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f80d08b0 con 0x7f42f80b24b0 2024-04-25T09:00:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42ffabd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80cd350 con 0x7f42f80cff00 2024-04-25T09:00:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42fd058640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80b24b0 0x7f42f80b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42fd859640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42f815c0f0 0x7f42f80cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53908/0 (socket says 172.21.15.5:53908) 2024-04-25T09:00:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42fd058640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80b24b0 0x7f42f80b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44506/0 (socket says 172.21.15.5:44506) 2024-04-25T09:00:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.594+0000 7f42fd859640 1 -- 172.21.15.5:0/60174967 learned_addr learned my addr 172.21.15.5:0/60174967 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.595+0000 7f42fe05a640 1 --2- 172.21.15.5:0/60174967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cff00 0x7f42f80d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.595+0000 7f42fd058640 1 -- 172.21.15.5:0/60174967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cff00 msgr2=0x7f42f80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.595+0000 7f42fd058640 1 --2- 172.21.15.5:0/60174967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cff00 0x7f42f80d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.595+0000 7f42fd058640 1 -- 172.21.15.5:0/60174967 >> v1:172.21.15.5:6789/0 conn(0x7f42f815c0f0 legacy=0x7f42f80cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.595+0000 7f42fd058640 1 -- 172.21.15.5:0/60174967 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f80cf7a0 con 0x7f42f80b24b0 2024-04-25T09:00:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.595+0000 7f42fd058640 1 --2- 172.21.15.5:0/60174967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80b24b0 0x7f42f80b2960 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0097a0 tx=0x7f42ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c090567585fa747a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42fc857640 1 -- 172.21.15.5:0/60174967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec037070 con 0x7f42f80b24b0 2024-04-25T09:00:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42fc857640 1 -- 172.21.15.5:0/60174967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec032440 con 0x7f42f80b24b0 2024-04-25T09:00:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42fc857640 1 -- 172.21.15.5:0/60174967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec032810 con 0x7f42f80b24b0 2024-04-25T09:00:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 -- 172.21.15.5:0/60174967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80b24b0 msgr2=0x7f42f80b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 --2- 172.21.15.5:0/60174967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80b24b0 0x7f42f80b2960 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0097a0 tx=0x7f42ec02a180 comp rx=0 tx=0).stop 2024-04-25T09:00:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 -- 172.21.15.5:0/60174967 shutdown_connections 2024-04-25T09:00:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 --2- 172.21.15.5:0/60174967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80cff00 0x7f42f80d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 --2- 172.21.15.5:0/60174967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80b24b0 0x7f42f80b2960 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 -- 172.21.15.5:0/60174967 >> 172.21.15.5:0/60174967 conn(0x7f42f80d1920 msgr2=0x7f42f80d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 -- 172.21.15.5:0/60174967 shutdown_connections 2024-04-25T09:00:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.596+0000 7f42ffabd640 1 -- 172.21.15.5:0/60174967 wait complete. 2024-04-25T09:00:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.597+0000 7f42ffabd640 1 Processor -- start 2024-04-25T09:00:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42ffabd640 1 -- start start 2024-04-25T09:00:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42ffabd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b24b0 0x7f42f81f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42ffabd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cff00 0x7f42f80b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42ffabd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815c0f0 0x7f42f80c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42ffabd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80b3170 con 0x7f42f80cff00 2024-04-25T09:00:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42ffabd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80d27c0 con 0x7f42f815c0f0 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42ffabd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80cfa40 con 0x7f42f80b24b0 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42fd058640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cff00 0x7f42f80b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42fd058640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cff00 0x7f42f80b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44520/0 (socket says 172.21.15.5:44520) 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.598+0000 7f42fd058640 1 -- 172.21.15.5:0/1657980365 learned_addr learned my addr 172.21.15.5:0/1657980365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fe05a640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815c0f0 0x7f42f80c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fd859640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b24b0 0x7f42f81f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fd058640 1 -- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b24b0 msgr2=0x7f42f81f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fd058640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b24b0 0x7f42f81f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fd058640 1 -- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815c0f0 msgr2=0x7f42f80c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fd058640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815c0f0 0x7f42f80c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fd058640 1 -- 172.21.15.5:0/1657980365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f80b13c0 con 0x7f42f80cff00 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fe05a640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815c0f0 0x7f42f80c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42fd058640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cff00 0x7f42f80b0970 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f42ec035040 tx=0x7f42ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42f67fc640 1 -- 172.21.15.5:0/1657980365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec037040 con 0x7f42f80cff00 2024-04-25T09:00:00.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42f67fc640 1 -- 172.21.15.5:0/1657980365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec030770 con 0x7f42f80cff00 2024-04-25T09:00:00.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f815c720 con 0x7f42f80cff00 2024-04-25T09:00:00.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42f67fc640 1 -- 172.21.15.5:0/1657980365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec030b80 con 0x7f42f80cff00 2024-04-25T09:00:00.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.599+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f815cce0 con 0x7f42f80cff00 2024-04-25T09:00:00.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.600+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f815c510 con 0x7f42f80cff00 2024-04-25T09:00:00.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.600+0000 7f42f67fc640 1 -- 172.21.15.5:0/1657980365 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42ec044020 con 0x7f42f80cff00 2024-04-25T09:00:00.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.601+0000 7f42f67fc640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42e406b500 0x7f42e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.601+0000 7f42f67fc640 1 -- 172.21.15.5:0/1657980365 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f42ec0aa390 con 0x7f42f80cff00 2024-04-25T09:00:00.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.601+0000 7f42fd859640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42e406b500 0x7f42e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.602+0000 7f42fd859640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42e406b500 0x7f42e406d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000f60 tx=0x7f42f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.606+0000 7f42f67fc640 1 -- 172.21.15.5:0/1657980365 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42ec032e20 con 0x7f42f80cff00 2024-04-25T09:00:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.784+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42f804ef20 con 0x7f42f80cff00 2024-04-25T09:00:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.784+0000 7f42f67fc640 1 -- 172.21.15.5:0/1657980365 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42ec0795a0 con 0x7f42f80cff00 2024-04-25T09:00:00.774 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:00:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42e406b500 msgr2=0x7f42e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42e406b500 0x7f42e406d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000f60 tx=0x7f42f0009040 comp rx=0 tx=0).stop 2024-04-25T09:00:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cff00 msgr2=0x7f42f80b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cff00 0x7f42f80b0970 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f42ec035040 tx=0x7f42ec0046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 shutdown_connections 2024-04-25T09:00:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42e406b500 0x7f42e406d9c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815c0f0 0x7f42f80c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80cff00 0x7f42f80b0970 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 --2- 172.21.15.5:0/1657980365 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42f80b24b0 0x7f42f81f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 >> 172.21.15.5:0/1657980365 conn(0x7f42f80d1920 msgr2=0x7f42f80d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:00.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 shutdown_connections 2024-04-25T09:00:00.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.786+0000 7f42ffabd640 1 -- 172.21.15.5:0/1657980365 wait complete. 2024-04-25T09:00:00.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-04-25T09:00:00.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.898+0000 7fdd7a542640 1 Processor -- start 2024-04-25T09:00:00.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.898+0000 7fdd7a542640 1 -- start start 2024-04-25T09:00:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd7a542640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd740d05f0 0x7fdd740d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd7a542640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd740d0f10 con 0x7fdd740b9990 2024-04-25T09:00:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd7a542640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd740d23c0 con 0x7fdd740d3710 2024-04-25T09:00:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd7a542640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd740d2670 con 0x7fdd740d05f0 2024-04-25T09:00:00.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd73fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd740d05f0 0x7fdd740d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd737fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdd740b9990 0x7fdd740d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53882/0 (socket says 172.21.15.5:53882) 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd737fe640 1 -- 172.21.15.5:0/3885105073 learned_addr learned my addr 172.21.15.5:0/3885105073 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd73fff640 1 -- 172.21.15.5:0/3885105073 >> v1:172.21.15.80:6789/0 conn(0x7fdd740d3710 legacy=0x7fdd740b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd73fff640 1 -- 172.21.15.5:0/3885105073 >> v1:172.21.15.5:6789/0 conn(0x7fdd740b9990 legacy=0x7fdd740d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd73fff640 1 -- 172.21.15.5:0/3885105073 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740d2950 con 0x7fdd740d05f0 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.899+0000 7fdd72ffd640 1 -- 172.21.15.5:0/3885105073 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963663805 0 0) 0x7fdd740d0f10 con 0x7fdd740b9990 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.900+0000 7fdd73fff640 1 --2- 172.21.15.5:0/3885105073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd740d09d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097a0 tx=0x7fdd6802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d3f625d43aebe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.900+0000 7fdd72ffd640 1 -- 172.21.15.5:0/3885105073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68037070 con 0x7fdd740d05f0 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.900+0000 7fdd72ffd640 1 -- 172.21.15.5:0/3885105073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68032640 con 0x7fdd740d05f0 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.900+0000 7fdd72ffd640 1 -- 172.21.15.5:0/3885105073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68032a10 con 0x7fdd740d05f0 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.901+0000 7fdd7a542640 1 -- 172.21.15.5:0/3885105073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 msgr2=0x7fdd740d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.901+0000 7fdd7a542640 1 --2- 172.21.15.5:0/3885105073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd740d09d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097a0 tx=0x7fdd6802a2c0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.901+0000 7fdd7a542640 1 -- 172.21.15.5:0/3885105073 shutdown_connections 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.901+0000 7fdd7a542640 1 --2- 172.21.15.5:0/3885105073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd740d09d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.901+0000 7fdd7a542640 1 -- 172.21.15.5:0/3885105073 >> 172.21.15.5:0/3885105073 conn(0x7fdd7406b000 msgr2=0x7fdd7406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.901+0000 7fdd7a542640 1 -- 172.21.15.5:0/3885105073 shutdown_connections 2024-04-25T09:00:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.901+0000 7fdd7a542640 1 -- 172.21.15.5:0/3885105073 wait complete. 2024-04-25T09:00:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.902+0000 7fdd7a542640 1 Processor -- start 2024-04-25T09:00:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.902+0000 7fdd7a542640 1 -- start start 2024-04-25T09:00:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd7a542640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd741f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd7a542640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd740d3710 0x7fdd7415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd7a542640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd74160030 0x7fdd740b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd7a542640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7415e090 con 0x7fdd740d05f0 2024-04-25T09:00:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd7a542640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740d2f10 con 0x7fdd740d3710 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd7a542640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7415e210 con 0x7fdd74160030 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd741f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd741f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60988/0 (socket says 172.21.15.5:60988) 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 -- 172.21.15.5:0/239752071 learned_addr learned my addr 172.21.15.5:0/239752071 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 -- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd74160030 msgr2=0x7fdd740b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd74160030 0x7fdd740b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 -- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd740d3710 msgr2=0x7fdd7415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd740d3710 0x7fdd7415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.903+0000 7fdd73fff640 1 -- 172.21.15.5:0/239752071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740cd6e0 con 0x7fdd740d05f0 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.904+0000 7fdd73fff640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd741f7b30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097a0 tx=0x7fdd680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.904+0000 7fdd70ff9640 1 -- 172.21.15.5:0/239752071 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68037050 con 0x7fdd740d05f0 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.904+0000 7fdd70ff9640 1 -- 172.21.15.5:0/239752071 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68038040 con 0x7fdd740d05f0 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.904+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd740cd9c0 con 0x7fdd740d05f0 2024-04-25T09:00:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.904+0000 7fdd70ff9640 1 -- 172.21.15.5:0/239752071 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68004490 con 0x7fdd740d05f0 2024-04-25T09:00:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.904+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7415f850 con 0x7fdd740d05f0 2024-04-25T09:00:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.905+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7404ef20 con 0x7fdd740d05f0 2024-04-25T09:00:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.905+0000 7fdd70ff9640 1 -- 172.21.15.5:0/239752071 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd68030900 con 0x7fdd740d05f0 2024-04-25T09:00:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.906+0000 7fdd70ff9640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd6006b4d0 0x7fdd6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.906+0000 7fdd70ff9640 1 -- 172.21.15.5:0/239752071 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdd680aaa90 con 0x7fdd740d05f0 2024-04-25T09:00:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.906+0000 7fdd737fe640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd6006b4d0 0x7fdd6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.907+0000 7fdd737fe640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd6006b4d0 0x7fdd6006d990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdd64007fd0 tx=0x7fdd64007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:00.910+0000 7fdd70ff9640 1 -- 172.21.15.5:0/239752071 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd68079dc0 con 0x7fdd740d05f0 2024-04-25T09:00:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.158+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7fdd740b3320 con 0x7fdd740d05f0 2024-04-25T09:00:01.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.163+0000 7fdd70ff9640 1 -- 172.21.15.5:0/239752071 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v177) v1 ==== 146+0+0 (secure 0 0 0) 0x7fdd680796c0 con 0x7fdd740d05f0 2024-04-25T09:00:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd6006b4d0 msgr2=0x7fdd6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd6006b4d0 0x7fdd6006d990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdd64007fd0 tx=0x7fdd64007900 comp rx=0 tx=0).stop 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 msgr2=0x7fdd741f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd741f7b30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097a0 tx=0x7fdd680046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 shutdown_connections 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd6006b4d0 0x7fdd6006d990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd74160030 0x7fdd740b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd740d3710 0x7fdd7415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 --2- 172.21.15.5:0/239752071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd740d05f0 0x7fdd741f7b30 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 >> 172.21.15.5:0/239752071 conn(0x7fdd7406b000 msgr2=0x7fdd740c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 shutdown_connections 2024-04-25T09:00:01.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.166+0000 7fdd7a542640 1 -- 172.21.15.5:0/239752071 wait complete. 2024-04-25T09:00:01.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:00:01.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.281+0000 7fc03106b640 1 Processor -- start 2024-04-25T09:00:01.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.281+0000 7fc03106b640 1 -- start start 2024-04-25T09:00:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc03106b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c0b6250 0x7fc02c0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc03106b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c162150 con 0x7fc02c0cee10 2024-04-25T09:00:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc03106b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c162430 con 0x7fc02c15df10 2024-04-25T09:00:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc03106b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0d20d0 con 0x7fc02c0b6250 2024-04-25T09:00:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc02b59e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc02c0cee10 0x7fc02c0d2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53894/0 (socket says 172.21.15.5:53894) 2024-04-25T09:00:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc02b59e640 1 -- 172.21.15.5:0/129109687 learned_addr learned my addr 172.21.15.5:0/129109687 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc02a59c640 1 --2- 172.21.15.5:0/129109687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c0b6250 0x7fc02c0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869559400 0 0) 0x7fc02c162150 con 0x7fc02c0cee10 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc014003520 con 0x7fc02c0cee10 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757083638 0 0) 0x7fc02c162430 con 0x7fc02c15df10 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c162150 con 0x7fc02c15df10 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc02a59c640 1 -- 172.21.15.5:0/129109687 >> v1:172.21.15.80:6789/0 conn(0x7fc02c15df10 legacy=0x7fc02c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc02a59c640 1 -- 172.21.15.5:0/129109687 >> v1:172.21.15.5:6789/0 conn(0x7fc02c0cee10 legacy=0x7fc02c0d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.282+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672682304 0 0) 0x7fc014003520 con 0x7fc02c0cee10 2024-04-25T09:00:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.283+0000 7fc02a59c640 1 -- 172.21.15.5:0/129109687 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c162710 con 0x7fc02c0b6250 2024-04-25T09:00:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.283+0000 7fc02a59c640 1 --2- 172.21.15.5:0/129109687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c0b6250 0x7fc02c0ce8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc0200097d0 tx=0x7fc02002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1970db9c1b00ec7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020037070 con 0x7fc02c0b6250 2024-04-25T09:00:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02002ac30 con 0x7fc02c0b6250 2024-04-25T09:00:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc029d9b640 1 -- 172.21.15.5:0/129109687 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0019f0 con 0x7fc02c0b6250 2024-04-25T09:00:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc03106b640 1 -- 172.21.15.5:0/129109687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c0b6250 msgr2=0x7fc02c0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc03106b640 1 --2- 172.21.15.5:0/129109687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c0b6250 0x7fc02c0ce8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc0200097d0 tx=0x7fc02002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc03106b640 1 -- 172.21.15.5:0/129109687 shutdown_connections 2024-04-25T09:00:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc03106b640 1 --2- 172.21.15.5:0/129109687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c0b6250 0x7fc02c0ce8d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc03106b640 1 -- 172.21.15.5:0/129109687 >> 172.21.15.5:0/129109687 conn(0x7fc02c0668f0 msgr2=0x7fc02c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc03106b640 1 -- 172.21.15.5:0/129109687 shutdown_connections 2024-04-25T09:00:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.284+0000 7fc03106b640 1 -- 172.21.15.5:0/129109687 wait complete. 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 Processor -- start 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 -- start start 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c0b6250 0x7fc02c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c0cee10 0x7fc02c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c15df10 0x7fc02c1f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0d2df0 con 0x7fc02c0cee10 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0d2c70 con 0x7fc02c0b6250 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc03106b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0d2f70 con 0x7fc02c15df10 2024-04-25T09:00:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc02a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c0cee10 0x7fc02c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc02a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c0cee10 0x7fc02c0caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60990/0 (socket says 172.21.15.5:60990) 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.286+0000 7fc02a59c640 1 -- 172.21.15.5:0/189153953 learned_addr learned my addr 172.21.15.5:0/189153953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02b59e640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c15df10 0x7fc02c1f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02ad9d640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c0b6250 0x7fc02c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02a59c640 1 -- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c15df10 msgr2=0x7fc02c1f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02a59c640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c15df10 0x7fc02c1f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02a59c640 1 -- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c0b6250 msgr2=0x7fc02c0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02a59c640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c0b6250 0x7fc02c0c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02a59c640 1 -- 172.21.15.5:0/189153953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c0c9a50 con 0x7fc02c0cee10 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02ad9d640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c0b6250 0x7fc02c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc02a59c640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c0cee10 0x7fc02c0caf40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc020035040 tx=0x7fc0200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc0137fe640 1 -- 172.21.15.5:0/189153953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020041020 con 0x7fc02c0cee10 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc0137fe640 1 -- 172.21.15.5:0/189153953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02003d640 con 0x7fc02c0cee10 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c0c9d30 con 0x7fc02c0cee10 2024-04-25T09:00:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc0137fe640 1 -- 172.21.15.5:0/189153953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020037040 con 0x7fc02c0cee10 2024-04-25T09:00:01.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.287+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c15d5b0 con 0x7fc02c0cee10 2024-04-25T09:00:01.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.288+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c04ef20 con 0x7fc02c0cee10 2024-04-25T09:00:01.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.289+0000 7fc0137fe640 1 -- 172.21.15.5:0/189153953 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc020044020 con 0x7fc02c0cee10 2024-04-25T09:00:01.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.289+0000 7fc0137fe640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc01806b4d0 0x7fc01806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.289+0000 7fc0137fe640 1 -- 172.21.15.5:0/189153953 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc0200aa4e0 con 0x7fc02c0cee10 2024-04-25T09:00:01.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.289+0000 7fc02ad9d640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc01806b4d0 0x7fc01806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.290+0000 7fc02ad9d640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc01806b4d0 0x7fc01806d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc0240011e0 tx=0x7fc024009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.293+0000 7fc0137fe640 1 -- 172.21.15.5:0/189153953 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc02004b030 con 0x7fc02c0cee10 2024-04-25T09:00:01.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.475+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc02c161f10 con 0x7fc02c0cee10 2024-04-25T09:00:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.478+0000 7fc0137fe640 1 -- 172.21.15.5:0/189153953 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0200795e0 con 0x7fc02c0cee10 2024-04-25T09:00:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc01806b4d0 msgr2=0x7fc01806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc01806b4d0 0x7fc01806d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc0240011e0 tx=0x7fc024009040 comp rx=0 tx=0).stop 2024-04-25T09:00:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c0cee10 msgr2=0x7fc02c0caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c0cee10 0x7fc02c0caf40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc020035040 tx=0x7fc0200046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 shutdown_connections 2024-04-25T09:00:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc01806b4d0 0x7fc01806d990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc02c15df10 0x7fc02c1f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c0cee10 0x7fc02c0caf40 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 --2- 172.21.15.5:0/189153953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c0b6250 0x7fc02c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 >> 172.21.15.5:0/189153953 conn(0x7fc02c0668f0 msgr2=0x7fc02c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 shutdown_connections 2024-04-25T09:00:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.481+0000 7fc03106b640 1 -- 172.21.15.5:0/189153953 wait complete. 2024-04-25T09:00:01.482 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:00:01.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:00:01.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:00:01.600 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:00:01.600 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:01.600 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:01.615 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:00:01.616 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:00:01.616 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:01.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:00:01.634 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:01.634 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:01.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:00:01.672 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:00:01.672 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:01.694 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:00:01.694 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:00:01.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.823+0000 7ff0a399b640 1 Processor -- start 2024-04-25T09:00:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.823+0000 7ff0a399b640 1 -- start start 2024-04-25T09:00:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a399b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a399b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff09c15e120 0x7ff09c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a399b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c0b4730 con 0x7ff09c06bbb0 2024-04-25T09:00:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a399b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0d0b70 con 0x7ff09c15e120 2024-04-25T09:00:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a399b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0cbf30 con 0x7ff09c06b7d0 2024-04-25T09:00:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1f38640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff09c15e120 0x7ff09c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1f38640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff09c15e120 0x7ff09c0d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32774/0 (socket says 172.21.15.5:32774) 2024-04-25T09:00:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1f38640 1 -- 172.21.15.5:0/1119366600 learned_addr learned my addr 172.21.15.5:0/1119366600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1737640 1 --2- 172.21.15.5:0/1119366600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1f38640 1 -- 172.21.15.5:0/1119366600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 msgr2=0x7ff09c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1f38640 1 --2- 172.21.15.5:0/1119366600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1f38640 1 -- 172.21.15.5:0/1119366600 >> v1:172.21.15.80:6789/0 conn(0x7ff09c06bbb0 legacy=0x7ff09c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1f38640 1 -- 172.21.15.5:0/1119366600 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0d0da0 con 0x7ff09c15e120 2024-04-25T09:00:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.824+0000 7ff0a1737640 1 --2- 172.21.15.5:0/1119366600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.825+0000 7ff0a1f38640 1 --2- 172.21.15.5:0/1119366600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c0d0630 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e50 tx=0x7ff08c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d10407517d60c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.825+0000 7ff09bfff640 1 -- 172.21.15.5:0/1119366600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c036070 con 0x7ff09c15e120 2024-04-25T09:00:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.825+0000 7ff09bfff640 1 -- 172.21.15.5:0/1119366600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c031600 con 0x7ff09c15e120 2024-04-25T09:00:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.825+0000 7ff09bfff640 1 -- 172.21.15.5:0/1119366600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0319d0 con 0x7ff09c15e120 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 -- 172.21.15.5:0/1119366600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 msgr2=0x7ff09c0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 --2- 172.21.15.5:0/1119366600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c0d0630 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e50 tx=0x7ff08c02a7a0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 -- 172.21.15.5:0/1119366600 shutdown_connections 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 --2- 172.21.15.5:0/1119366600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c0d0630 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 --2- 172.21.15.5:0/1119366600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 -- 172.21.15.5:0/1119366600 >> 172.21.15.5:0/1119366600 conn(0x7ff09c0d18e0 msgr2=0x7ff09c0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 -- 172.21.15.5:0/1119366600 shutdown_connections 2024-04-25T09:00:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.826+0000 7ff0a399b640 1 -- 172.21.15.5:0/1119366600 wait complete. 2024-04-25T09:00:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.827+0000 7ff0a399b640 1 Processor -- start 2024-04-25T09:00:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.827+0000 7ff0a399b640 1 -- start start 2024-04-25T09:00:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a399b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c15f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a399b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff09c06bbb0 0x7ff09c160ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a399b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a399b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0cc460 con 0x7ff09c15e120 2024-04-25T09:00:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a399b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0cc7d0 con 0x7ff09c06bbb0 2024-04-25T09:00:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a399b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0ccc60 con 0x7ff09c06b7d0 2024-04-25T09:00:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c15b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32790/0 (socket says 172.21.15.5:32790) 2024-04-25T09:00:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 -- 172.21.15.5:0/291414259 learned_addr learned my addr 172.21.15.5:0/291414259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a0f36640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff09c06bbb0 0x7ff09c160ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1737640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c15f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 -- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 msgr2=0x7ff09c15f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c15f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 -- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff09c06bbb0 msgr2=0x7ff09c160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff09c06bbb0 0x7ff09c160ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 -- 172.21.15.5:0/291414259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c15fb60 con 0x7ff09c15e120 2024-04-25T09:00:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1737640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c15f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.828+0000 7ff0a1f38640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c15b920 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009f70 tx=0x7ff08c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.829+0000 7ff099ffb640 1 -- 172.21.15.5:0/291414259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c036050 con 0x7ff09c15e120 2024-04-25T09:00:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.829+0000 7ff099ffb640 1 -- 172.21.15.5:0/291414259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c042070 con 0x7ff09c15e120 2024-04-25T09:00:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.829+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c15fe00 con 0x7ff09c15e120 2024-04-25T09:00:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.829+0000 7ff099ffb640 1 -- 172.21.15.5:0/291414259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c009510 con 0x7ff09c15e120 2024-04-25T09:00:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.829+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c1603c0 con 0x7ff09c15e120 2024-04-25T09:00:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.830+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c04ef20 con 0x7ff09c15e120 2024-04-25T09:00:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.830+0000 7ff099ffb640 1 -- 172.21.15.5:0/291414259 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff08c007bb0 con 0x7ff09c15e120 2024-04-25T09:00:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.831+0000 7ff099ffb640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff08806b4d0 0x7ff08806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.831+0000 7ff099ffb640 1 -- 172.21.15.5:0/291414259 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff08c0aad40 con 0x7ff09c15e120 2024-04-25T09:00:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.831+0000 7ff0a1737640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff08806b4d0 0x7ff08806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.831+0000 7ff0a1737640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff08806b4d0 0x7ff08806d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff09c153770 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:01.835+0000 7ff099ffb640 1 -- 172.21.15.5:0/291414259 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff08c079eb0 con 0x7ff09c15e120 2024-04-25T09:00:02.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.050+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff09c1613e0 con 0x7ff09c15e120 2024-04-25T09:00:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.051+0000 7ff099ffb640 1 -- 172.21.15.5:0/291414259 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3693 (secure 0 0 0) 0x7ff08c0797b0 con 0x7ff09c15e120 2024-04-25T09:00:02.040 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:02.040 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1927383651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1927383651},{"type":"v1","addr":"172.21.15.80:6836","nonce":1927383651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3615625073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3615625073},{"type":"v1","addr":"172.21.15.80:6837","nonce":3615625073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2280337640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2280337640},{"type":"v1","addr":"172.21.15.5:6834","nonce":2280337640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2752261166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2752261166},{"type":"v1","addr":"172.21.15.5:6835","nonce":2752261166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[]} 2024-04-25T09:00:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2024-04-25T09:00:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff08806b4d0 msgr2=0x7ff08806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff08806b4d0 0x7ff08806d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff09c153770 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-04-25T09:00:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 msgr2=0x7ff09c15b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c15b920 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009f70 tx=0x7ff08c004a40 comp rx=0 tx=0).stop 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 shutdown_connections 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff08806b4d0 0x7ff08806d990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff09c15e120 0x7ff09c15b920 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff09c06bbb0 0x7ff09c160ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 --2- 172.21.15.5:0/291414259 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff09c06b7d0 0x7ff09c15f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 >> 172.21.15.5:0/291414259 conn(0x7ff09c0d18e0 msgr2=0x7ff09c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 shutdown_connections 2024-04-25T09:00:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.053+0000 7ff0a399b640 1 -- 172.21.15.5:0/291414259 wait complete. 2024-04-25T09:00:02.053 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:00:02.053 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:00:02.054 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:00:02.054 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:02.054 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:00:02.054 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:00:02.054 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:00:02.055 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:02.055 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:00:02.055 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:00:02.055 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:00:02.055 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:02.055 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:00:02.055 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:00:02.056 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:00:02.056 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:02.064 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:00:02.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:00:02.065 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:00:02.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:00:02.067 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:00:02.067 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:00:02.068 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:00:02.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:00:02.107 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:00:02.108 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:00:02.108 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:02.108 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:02.109 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:00:02.110 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:02.111 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:00:02.111 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:02.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:00:02.183 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:00:02.183 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:00:02.192 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:00:02.192 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:00:02.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.229+0000 7fc598058640 1 Processor -- start 2024-04-25T09:00:02.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.229+0000 7fc598058640 1 -- start start 2024-04-25T09:00:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc598058640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59015e0a0 0x7fc5900d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc598058640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5900d3df0 0x7fc5900cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc598058640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5900b7f60 con 0x7fc5900d3990 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc598058640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5900b29c0 con 0x7fc59015e0a0 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc598058640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5900d2080 con 0x7fc5900d3df0 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc595df4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59015e0a0 0x7fc5900d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc595df4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59015e0a0 0x7fc5900d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32854/0 (socket says 172.21.15.5:32854) 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc595df4640 1 -- 172.21.15.5:0/1461924619 learned_addr learned my addr 172.21.15.5:0/1461924619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc5965f5640 1 --2- 172.21.15.5:0/1461924619 >> v2:172.21.15.80:3300/0 conn(0x7fc5900d3df0 0x7fc5900cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc595df4640 1 -- 172.21.15.5:0/1461924619 >> v2:172.21.15.80:3300/0 conn(0x7fc5900d3df0 msgr2=0x7fc5900cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc595df4640 1 --2- 172.21.15.5:0/1461924619 >> v2:172.21.15.80:3300/0 conn(0x7fc5900d3df0 0x7fc5900cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc595df4640 1 -- 172.21.15.5:0/1461924619 >> v1:172.21.15.80:6789/0 conn(0x7fc5900d3990 legacy=0x7fc5900ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.230+0000 7fc595df4640 1 -- 172.21.15.5:0/1461924619 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900d2360 con 0x7fc59015e0a0 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.231+0000 7fc595df4640 1 --2- 172.21.15.5:0/1461924619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59015e0a0 0x7fc5900d0d50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc5900b34f0 tx=0x7fc58c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de852493743781e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.231+0000 7fc594df2640 1 -- 172.21.15.5:0/1461924619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c037070 con 0x7fc59015e0a0 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.231+0000 7fc594df2640 1 -- 172.21.15.5:0/1461924619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c032440 con 0x7fc59015e0a0 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.231+0000 7fc594df2640 1 -- 172.21.15.5:0/1461924619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c032810 con 0x7fc59015e0a0 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.231+0000 7fc598058640 1 -- 172.21.15.5:0/1461924619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59015e0a0 msgr2=0x7fc5900d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.231+0000 7fc598058640 1 --2- 172.21.15.5:0/1461924619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59015e0a0 0x7fc5900d0d50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc5900b34f0 tx=0x7fc58c02a230 comp rx=0 tx=0).stop 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.232+0000 7fc598058640 1 -- 172.21.15.5:0/1461924619 shutdown_connections 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.232+0000 7fc598058640 1 --2- 172.21.15.5:0/1461924619 >> v2:172.21.15.80:3300/0 conn(0x7fc5900d3df0 0x7fc5900cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.232+0000 7fc598058640 1 --2- 172.21.15.5:0/1461924619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59015e0a0 0x7fc5900d0d50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.232+0000 7fc598058640 1 -- 172.21.15.5:0/1461924619 >> 172.21.15.5:0/1461924619 conn(0x7fc5900668f0 msgr2=0x7fc590066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.232+0000 7fc598058640 1 -- 172.21.15.5:0/1461924619 shutdown_connections 2024-04-25T09:00:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.232+0000 7fc598058640 1 -- 172.21.15.5:0/1461924619 wait complete. 2024-04-25T09:00:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.233+0000 7fc598058640 1 Processor -- start 2024-04-25T09:00:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.233+0000 7fc598058640 1 -- start start 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc598058640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5900d3990 0x7fc590151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc598058640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5900d3df0 0x7fc5900c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5900d3990 0x7fc590151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc598058640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc59015e0a0 0x7fc5901f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc598058640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900d2c00 con 0x7fc5900d3990 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc598058640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900d2920 con 0x7fc59015e0a0 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5900d3990 0x7fc590151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32860/0 (socket says 172.21.15.5:32860) 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 -- 172.21.15.5:0/399156411 learned_addr learned my addr 172.21.15.5:0/399156411 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900d4280 con 0x7fc5900d3df0 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc5955f3640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5900d3df0 0x7fc5900c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc5965f5640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc59015e0a0 0x7fc5901f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 -- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5900d3df0 msgr2=0x7fc5900c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5900d3df0 0x7fc5900c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 -- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc59015e0a0 msgr2=0x7fc5901f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc59015e0a0 0x7fc5901f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 -- 172.21.15.5:0/399156411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900caba0 con 0x7fc5900d3990 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc5965f5640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc59015e0a0 0x7fc5901f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc595df4640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5900d3990 0x7fc590151fe0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc58c000c00 tx=0x7fc58c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc5867fc640 1 -- 172.21.15.5:0/399156411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c041070 con 0x7fc5900d3990 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc5867fc640 1 -- 172.21.15.5:0/399156411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c03c870 con 0x7fc5900d3990 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.234+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5900cae80 con 0x7fc5900d3990 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.235+0000 7fc5867fc640 1 -- 172.21.15.5:0/399156411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c037040 con 0x7fc5900d3990 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.235+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5900cb440 con 0x7fc5900d3990 2024-04-25T09:00:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.235+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59004ef20 con 0x7fc5900d3990 2024-04-25T09:00:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.236+0000 7fc5867fc640 1 -- 172.21.15.5:0/399156411 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc58c044070 con 0x7fc5900d3990 2024-04-25T09:00:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.236+0000 7fc5867fc640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc57406b4d0 0x7fc57406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.236+0000 7fc5867fc640 1 -- 172.21.15.5:0/399156411 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc58c0aae00 con 0x7fc5900d3990 2024-04-25T09:00:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.237+0000 7fc5955f3640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc57406b4d0 0x7fc57406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.237+0000 7fc5955f3640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc57406b4d0 0x7fc57406d990 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc580006fd0 tx=0x7fc580008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:02.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.241+0000 7fc5867fc640 1 -- 172.21.15.5:0/399156411 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc58c07a090 con 0x7fc5900d3990 2024-04-25T09:00:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:02.432+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc5900ceb90 con 0x7fc5900d3990 2024-04-25T09:00:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.176+0000 7fc5867fc640 1 -- 172.21.15.5:0/399156411 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc58c079990 con 0x7fc5900d3990 2024-04-25T09:00:03.166 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T09:00:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.179+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc57406b4d0 msgr2=0x7fc57406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.179+0000 7fc598058640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc57406b4d0 0x7fc57406d990 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc580006fd0 tx=0x7fc580008040 comp rx=0 tx=0).stop 2024-04-25T09:00:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5900d3990 msgr2=0x7fc590151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5900d3990 0x7fc590151fe0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc58c000c00 tx=0x7fc58c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 shutdown_connections 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc57406b4d0 0x7fc57406d990 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc59015e0a0 0x7fc5901f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5900d3df0 0x7fc5900c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 --2- 172.21.15.5:0/399156411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5900d3990 0x7fc590151fe0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 >> 172.21.15.5:0/399156411 conn(0x7fc5900668f0 msgr2=0x7fc5900b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 shutdown_connections 2024-04-25T09:00:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.180+0000 7fc598058640 1 -- 172.21.15.5:0/399156411 wait complete. 2024-04-25T09:00:03.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:00:03.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.303+0000 7f9a0aaac640 1 Processor -- start 2024-04-25T09:00:03.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.303+0000 7f9a0aaac640 1 -- start start 2024-04-25T09:00:03.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a0aaac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a04154f10 0x7f9a040b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a0aaac640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a0415bbd0 0x7f9a040cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a0aaac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a040b3f30 con 0x7f9a040b39b0 2024-04-25T09:00:03.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a0aaac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0415b0f0 con 0x7f9a04154f10 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a0aaac640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0415b3d0 con 0x7f9a0415bbd0 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a08848640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a04154f10 0x7f9a040b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a08848640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a04154f10 0x7f9a040b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32870/0 (socket says 172.21.15.5:32870) 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a08848640 1 -- 172.21.15.5:0/511955456 learned_addr learned my addr 172.21.15.5:0/511955456 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a03fff640 1 --2- 172.21.15.5:0/511955456 >> v2:172.21.15.80:3300/0 conn(0x7f9a0415bbd0 0x7f9a040cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a08848640 1 -- 172.21.15.5:0/511955456 >> v2:172.21.15.80:3300/0 conn(0x7f9a0415bbd0 msgr2=0x7f9a040cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a08848640 1 --2- 172.21.15.5:0/511955456 >> v2:172.21.15.80:3300/0 conn(0x7f9a0415bbd0 0x7f9a040cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a08848640 1 -- 172.21.15.5:0/511955456 >> v1:172.21.15.80:6789/0 conn(0x7f9a040b39b0 legacy=0x7f9a0406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.304+0000 7f9a08848640 1 -- 172.21.15.5:0/511955456 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a041552f0 con 0x7f9a04154f10 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.305+0000 7f9a08848640 1 --2- 172.21.15.5:0/511955456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a040b3470 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009870 tx=0x7f99f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103287eb8a291ed7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.305+0000 7f9a037fe640 1 -- 172.21.15.5:0/511955456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8037070 con 0x7f9a04154f10 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.305+0000 7f9a037fe640 1 -- 172.21.15.5:0/511955456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8032440 con 0x7f9a04154f10 2024-04-25T09:00:03.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.305+0000 7f9a037fe640 1 -- 172.21.15.5:0/511955456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8032810 con 0x7f9a04154f10 2024-04-25T09:00:03.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 -- 172.21.15.5:0/511955456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 msgr2=0x7f9a040b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/511955456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a040b3470 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009870 tx=0x7f99f802a210 comp rx=0 tx=0).stop 2024-04-25T09:00:03.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 -- 172.21.15.5:0/511955456 shutdown_connections 2024-04-25T09:00:03.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/511955456 >> v2:172.21.15.80:3300/0 conn(0x7f9a0415bbd0 0x7f9a040cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/511955456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a040b3470 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 -- 172.21.15.5:0/511955456 >> 172.21.15.5:0/511955456 conn(0x7f9a040668f0 msgr2=0x7f9a04066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:03.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 -- 172.21.15.5:0/511955456 shutdown_connections 2024-04-25T09:00:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.306+0000 7f9a0aaac640 1 -- 172.21.15.5:0/511955456 wait complete. 2024-04-25T09:00:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.307+0000 7f9a0aaac640 1 Processor -- start 2024-04-25T09:00:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.307+0000 7f9a0aaac640 1 -- start start 2024-04-25T09:00:03.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a0aaac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a040b39b0 0x7f9a041422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a0aaac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a04156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a0aaac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a0415bbd0 0x7f9a041569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a0aaac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040cfc40 con 0x7f9a04154f10 2024-04-25T09:00:03.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a0aaac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040cfac0 con 0x7f9a040b39b0 2024-04-25T09:00:03.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a0aaac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040cfdc0 con 0x7f9a0415bbd0 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a04156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a04156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32872/0 (socket says 172.21.15.5:32872) 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 -- 172.21.15.5:0/2128473925 learned_addr learned my addr 172.21.15.5:0/2128473925 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a08848640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a040b39b0 0x7f9a041422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a09049640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a0415bbd0 0x7f9a041569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 -- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a0415bbd0 msgr2=0x7f9a041569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a0415bbd0 0x7f9a041569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 -- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a040b39b0 msgr2=0x7f9a041422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a040b39b0 0x7f9a041422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 -- 172.21.15.5:0/2128473925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a041e50e0 con 0x7f9a04154f10 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a09049640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a0415bbd0 0x7f9a041569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.308+0000 7f9a03fff640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a04156480 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f99f000d590 tx=0x7f99f000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.309+0000 7f9a017fa640 1 -- 172.21.15.5:0/2128473925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00125f0 con 0x7f9a04154f10 2024-04-25T09:00:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.309+0000 7f9a017fa640 1 -- 172.21.15.5:0/2128473925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0019070 con 0x7f9a04154f10 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.309+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a041e53c0 con 0x7f9a04154f10 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.309+0000 7f9a017fa640 1 -- 172.21.15.5:0/2128473925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00129f0 con 0x7f9a04154f10 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.309+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a041e5980 con 0x7f9a04154f10 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.310+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0404ef20 con 0x7f9a04154f10 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.310+0000 7f9a017fa640 1 -- 172.21.15.5:0/2128473925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99f0012b90 con 0x7f9a04154f10 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.311+0000 7f9a017fa640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f99e806b4d0 0x7f99e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.311+0000 7f9a017fa640 1 -- 172.21.15.5:0/2128473925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f99f008a200 con 0x7f9a04154f10 2024-04-25T09:00:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.311+0000 7f9a08848640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f99e806b4d0 0x7f99e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.312+0000 7f9a08848640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f99e806b4d0 0x7f99e806d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99f8034000 tx=0x7f99f802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.315+0000 7f9a017fa640 1 -- 172.21.15.5:0/2128473925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99f00593b0 con 0x7f9a04154f10 2024-04-25T09:00:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.561+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9a04070d30 con 0x7f9a04154f10 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.561+0000 7f9a017fa640 1 -- 172.21.15.5:0/2128473925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f99f0058cb0 con 0x7f9a04154f10 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:00:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:00:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T09:00:03.565 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:00:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f99e806b4d0 msgr2=0x7f99e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f99e806b4d0 0x7f99e806d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99f8034000 tx=0x7f99f802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 msgr2=0x7f9a04156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a04156480 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f99f000d590 tx=0x7f99f000da50 comp rx=0 tx=0).stop 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 shutdown_connections 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f99e806b4d0 0x7f99e806d990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9a0415bbd0 0x7f9a041569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a04154f10 0x7f9a04156480 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 --2- 172.21.15.5:0/2128473925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a040b39b0 0x7f9a041422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 >> 172.21.15.5:0/2128473925 conn(0x7f9a040668f0 msgr2=0x7f9a0415c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 shutdown_connections 2024-04-25T09:00:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.563+0000 7f9a0aaac640 1 -- 172.21.15.5:0/2128473925 wait complete. 2024-04-25T09:00:03.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:03.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.680+0000 7f1df4377640 1 Processor -- start 2024-04-25T09:00:03.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.680+0000 7f1df4377640 1 -- start start 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.681+0000 7f1df4377640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1dec0ce290 0x7f1dec0ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.681+0000 7f1df4377640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec0cdcb0 con 0x7f1dec15bdc0 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.681+0000 7f1df4377640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec0cdf90 con 0x7f1dec0b52c0 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.681+0000 7f1df4377640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dec0b47e0 con 0x7f1dec0ce290 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.681+0000 7f1df2113640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1dec15bdc0 0x7f1dec0cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53904/0 (socket says 172.21.15.5:53904) 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.681+0000 7f1df2113640 1 -- 172.21.15.5:0/2270215641 learned_addr learned my addr 172.21.15.5:0/2270215641 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1912640 1 --2- 172.21.15.5:0/2270215641 >> v2:172.21.15.80:3300/0 conn(0x7f1dec0ce290 0x7f1dec0ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434501803 0 0) 0x7f1dec0cdcb0 con 0x7f1dec15bdc0 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd4003520 con 0x7f1dec15bdc0 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2872820403 0 0) 0x7f1dd4003520 con 0x7f1dec15bdc0 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 >> v2:172.21.15.80:3300/0 conn(0x7f1dec0ce290 msgr2=0x7f1dec0ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 --2- 172.21.15.5:0/2270215641 >> v2:172.21.15.80:3300/0 conn(0x7f1dec0ce290 0x7f1dec0ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 >> v1:172.21.15.80:6789/0 conn(0x7f1dec0b52c0 legacy=0x7f1dec0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec0b4ac0 con 0x7f1dec15bdc0 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1de4001670 con 0x7f1dec15bdc0 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 >> v1:172.21.15.5:6789/0 conn(0x7f1dec15bdc0 legacy=0x7f1dec0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dd4003a00 0x7f1dd4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd4004800 0x7f1dd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0b47e0 con 0x7f1dd40051c0 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd400c0c0 con 0x7f1dd4004800 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd400c2c0 con 0x7f1dd4003a00 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df2914640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df1912640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd4004800 0x7f1dd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df2113640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dd4003a00 0x7f1dd4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df2914640 1 -- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dd4003a00 msgr2=0x7f1dd4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df2914640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dd4003a00 0x7f1dd4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df2914640 1 -- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd4004800 msgr2=0x7f1dd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df2914640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd4004800 0x7f1dd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.682+0000 7f1df2914640 1 -- 172.21.15.5:0/2270215641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd4003520 con 0x7f1dd40051c0 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.683+0000 7f1df2914640 1 -- 172.21.15.5:0/2270215641 reap_dead start 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.683+0000 7f1df2914640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dd400b9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc001e50 tx=0x7f1dd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fc02e32856667f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.683+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc001a70 con 0x7f1dd40051c0 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.683+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc003970 con 0x7f1dd40051c0 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.683+0000 7f1df1111640 1 -- 172.21.15.5:0/2270215641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc003d60 con 0x7f1dd40051c0 2024-04-25T09:00:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.684+0000 7f1df4377640 1 -- 172.21.15.5:0/2270215641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 msgr2=0x7f1dd400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.684+0000 7f1df4377640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dd400b9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc001e50 tx=0x7f1dd4005830 comp rx=0 tx=0).stop 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.684+0000 7f1df4377640 1 -- 172.21.15.5:0/2270215641 shutdown_connections 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.684+0000 7f1df4377640 1 --2- 172.21.15.5:0/2270215641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dd400b9c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.684+0000 7f1df4377640 1 -- 172.21.15.5:0/2270215641 >> 172.21.15.5:0/2270215641 conn(0x7f1dec0d18f0 msgr2=0x7f1dec0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.684+0000 7f1df4377640 1 -- 172.21.15.5:0/2270215641 shutdown_connections 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.684+0000 7f1df4377640 1 -- 172.21.15.5:0/2270215641 wait complete. 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.685+0000 7f1df4377640 1 Processor -- start 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.685+0000 7f1df4377640 1 -- start start 2024-04-25T09:00:03.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df4377640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dec06e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df4377640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dec15da20 0x7f1dec06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df4377640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dec15f030 0x7f1dec1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df4377640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec15c1a0 con 0x7f1dd40051c0 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df4377640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0d09a0 con 0x7f1dec15f030 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df4377640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec15c320 con 0x7f1dec15da20 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dec06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dec06e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32882/0 (socket says 172.21.15.5:32882) 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 -- 172.21.15.5:0/626065315 learned_addr learned my addr 172.21.15.5:0/626065315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df1912640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dec15da20 0x7f1dec06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2914640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dec15f030 0x7f1dec1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 -- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dec15da20 msgr2=0x7f1dec06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dec15da20 0x7f1dec06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 -- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dec15f030 msgr2=0x7f1dec1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dec15f030 0x7f1dec1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 -- 172.21.15.5:0/626065315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec1580e0 con 0x7f1dd40051c0 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df1912640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dec15da20 0x7f1dec06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2914640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dec15f030 0x7f1dec1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1df2113640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dec06e490 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1de40072c0 tx=0x7f1de40076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.686+0000 7f1deaffd640 1 -- 172.21.15.5:0/626065315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4001610 con 0x7f1dd40051c0 2024-04-25T09:00:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.687+0000 7f1deaffd640 1 -- 172.21.15.5:0/626065315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de4018070 con 0x7f1dd40051c0 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.687+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec15deb0 con 0x7f1dd40051c0 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.687+0000 7f1deaffd640 1 -- 172.21.15.5:0/626065315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400fbe0 con 0x7f1dd40051c0 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.687+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec15e830 con 0x7f1dd40051c0 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.688+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec04ef20 con 0x7f1dd40051c0 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.688+0000 7f1deaffd640 1 -- 172.21.15.5:0/626065315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1de401d460 con 0x7f1dd40051c0 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.688+0000 7f1deaffd640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dd806b4d0 0x7f1dd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.689+0000 7f1deaffd640 1 -- 172.21.15.5:0/626065315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1de4089e30 con 0x7f1dd40051c0 2024-04-25T09:00:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.689+0000 7f1df1912640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dd806b4d0 0x7f1dd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.689+0000 7f1df1912640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dd806b4d0 0x7f1dd806d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0d2680 tx=0x7f1de0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.693+0000 7f1deaffd640 1 -- 172.21.15.5:0/626065315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1de4059150 con 0x7f1dd40051c0 2024-04-25T09:00:03.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.877+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dec0b6c40 con 0x7f1dd40051c0 2024-04-25T09:00:03.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.877+0000 7f1deaffd640 1 -- 172.21.15.5:0/626065315 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+12807 (secure 0 0 0) 0x7f1de4058a50 con 0x7f1dd40051c0 2024-04-25T09:00:03.867 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:03.867 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":53,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:03.185728+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:03.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dd806b4d0 msgr2=0x7f1dd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dd806b4d0 0x7f1dd806d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0d2680 tx=0x7f1de0008040 comp rx=0 tx=0).stop 2024-04-25T09:00:03.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 msgr2=0x7f1dec06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dec06e490 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1de40072c0 tx=0x7f1de40076c0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 shutdown_connections 2024-04-25T09:00:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dd806b4d0 0x7f1dd806d990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dec15f030 0x7f1dec1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1dec15da20 0x7f1dec06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 --2- 172.21.15.5:0/626065315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dd40051c0 0x7f1dec06e490 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.879+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 >> 172.21.15.5:0/626065315 conn(0x7f1dec0d18f0 msgr2=0x7f1dec0b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:03.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.880+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 shutdown_connections 2024-04-25T09:00:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.880+0000 7f1df4377640 1 -- 172.21.15.5:0/626065315 wait complete. 2024-04-25T09:00:03.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:03.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:03.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.995+0000 7f859e7b7640 1 Processor -- start 2024-04-25T09:00:03.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.995+0000 7f859e7b7640 1 -- start start 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f859e7b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f85980d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f859e7b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85980d4060 0x7f85980b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f859e7b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85980b9b20 con 0x7f85981614b0 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f859e7b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85980d2740 con 0x7f85980d4060 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f859e7b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85980d2a20 con 0x7f85980b96e0 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f8597fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85981614b0 0x7f85980d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53914/0 (socket says 172.21.15.5:53914) 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f8597fff640 1 -- 172.21.15.5:0/2394802516 learned_addr learned my addr 172.21.15.5:0/2394802516 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f85977fe640 1 --2- 172.21.15.5:0/2394802516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f85980d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f859cd54640 1 --2- 172.21.15.5:0/2394802516 >> v2:172.21.15.80:3300/0 conn(0x7f85980d4060 0x7f85980b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f8596ffd640 1 -- 172.21.15.5:0/2394802516 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248794849 0 0) 0x7f85980b9b20 con 0x7f85981614b0 2024-04-25T09:00:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f8596ffd640 1 -- 172.21.15.5:0/2394802516 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8580003520 con 0x7f85981614b0 2024-04-25T09:00:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f85977fe640 1 -- 172.21.15.5:0/2394802516 >> v2:172.21.15.80:3300/0 conn(0x7f85980d4060 msgr2=0x7f85980b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f85977fe640 1 --2- 172.21.15.5:0/2394802516 >> v2:172.21.15.80:3300/0 conn(0x7f85980d4060 0x7f85980b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f85977fe640 1 -- 172.21.15.5:0/2394802516 >> v1:172.21.15.5:6789/0 conn(0x7f85981614b0 legacy=0x7f85980d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.996+0000 7f85977fe640 1 -- 172.21.15.5:0/2394802516 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85980d2d00 con 0x7f85980b96e0 2024-04-25T09:00:03.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.997+0000 7f85977fe640 1 --2- 172.21.15.5:0/2394802516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f85980d3b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f85880097a0 tx=0x7f858802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41fd7a4a48da81ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.997+0000 7f8596ffd640 1 -- 172.21.15.5:0/2394802516 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588037070 con 0x7f85980b96e0 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.997+0000 7f8596ffd640 1 -- 172.21.15.5:0/2394802516 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588032440 con 0x7f85980b96e0 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.997+0000 7f8596ffd640 1 -- 172.21.15.5:0/2394802516 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85880327f0 con 0x7f85980b96e0 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 -- 172.21.15.5:0/2394802516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 msgr2=0x7f85980d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2394802516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f85980d3b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f85880097a0 tx=0x7f858802a180 comp rx=0 tx=0).stop 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 -- 172.21.15.5:0/2394802516 shutdown_connections 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2394802516 >> v2:172.21.15.80:3300/0 conn(0x7f85980d4060 0x7f85980b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2394802516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f85980d3b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 -- 172.21.15.5:0/2394802516 >> 172.21.15.5:0/2394802516 conn(0x7f859806b000 msgr2=0x7f859806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 -- 172.21.15.5:0/2394802516 shutdown_connections 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.998+0000 7f859e7b7640 1 -- 172.21.15.5:0/2394802516 wait complete. 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.999+0000 7f859e7b7640 1 Processor -- start 2024-04-25T09:00:03.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:03.999+0000 7f859e7b7640 1 -- start start 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f859e7b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f859814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f859e7b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85980d4060 0x7f85980c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f859e7b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85981614b0 0x7f85981e65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f859e7b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85980d37e0 con 0x7f85980d4060 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f859e7b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85980d32c0 con 0x7f85981614b0 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f859e7b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85980b7200 con 0x7f85980b96e0 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85980d4060 0x7f85980c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85980d4060 0x7f85980c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32892/0 (socket says 172.21.15.5:32892) 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 -- 172.21.15.5:0/2495428150 learned_addr learned my addr 172.21.15.5:0/2495428150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f8597fff640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f859814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 -- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 msgr2=0x7f859814cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f859cd54640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85981614b0 0x7f85981e65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f859814cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 -- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85981614b0 msgr2=0x7f85981e65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85981614b0 0x7f85981e65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 -- 172.21.15.5:0/2495428150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85980c9e60 con 0x7f85980d4060 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f8597fff640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f859814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.000+0000 7f85977fe640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85980d4060 0x7f85980c9410 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8588035040 tx=0x7f85880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.001+0000 7f8594ff9640 1 -- 172.21.15.5:0/2495428150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588037040 con 0x7f85980d4060 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.001+0000 7f8594ff9640 1 -- 172.21.15.5:0/2495428150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588042070 con 0x7f85980d4060 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.001+0000 7f8594ff9640 1 -- 172.21.15.5:0/2495428150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858803b930 con 0x7f85980d4060 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.001+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85980ca140 con 0x7f85980d4060 2024-04-25T09:00:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.001+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85980b48d0 con 0x7f85980d4060 2024-04-25T09:00:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.002+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859804ef20 con 0x7f85980d4060 2024-04-25T09:00:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.002+0000 7f8594ff9640 1 -- 172.21.15.5:0/2495428150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f858803bad0 con 0x7f85980d4060 2024-04-25T09:00:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.003+0000 7f8594ff9640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f858406b4d0 0x7f858406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.003+0000 7f8594ff9640 1 -- 172.21.15.5:0/2495428150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85880aa690 con 0x7f85980d4060 2024-04-25T09:00:03.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.003+0000 7f8597fff640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f858406b4d0 0x7f858406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:03.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.004+0000 7f8597fff640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f858406b4d0 0x7f858406d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f858c005880 tx=0x7f858c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:03.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.007+0000 7f8594ff9640 1 -- 172.21.15.5:0/2495428150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8588079a10 con 0x7f85980d4060 2024-04-25T09:00:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.189+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85980d22a0 con 0x7f85980d4060 2024-04-25T09:00:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.189+0000 7f8594ff9640 1 -- 172.21.15.5:0/2495428150 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8588079310 con 0x7f85980d4060 2024-04-25T09:00:04.179 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:00:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f858406b4d0 msgr2=0x7f858406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f858406b4d0 0x7f858406d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f858c005880 tx=0x7f858c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85980d4060 msgr2=0x7f85980c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85980d4060 0x7f85980c9410 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8588035040 tx=0x7f85880046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 shutdown_connections 2024-04-25T09:00:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f858406b4d0 0x7f858406d990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85981614b0 0x7f85981e65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85980d4060 0x7f85980c9410 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 --2- 172.21.15.5:0/2495428150 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85980b96e0 0x7f859814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 >> 172.21.15.5:0/2495428150 conn(0x7f859806b000 msgr2=0x7f85980ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 shutdown_connections 2024-04-25T09:00:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.192+0000 7f859e7b7640 1 -- 172.21.15.5:0/2495428150 wait complete. 2024-04-25T09:00:04.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:00:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.304+0000 7f986a0f5640 1 Processor -- start 2024-04-25T09:00:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.304+0000 7f986a0f5640 1 -- start start 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f986a0f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98640ce290 0x7f98640ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f986a0f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640b52c0 0x7f98640b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f986a0f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98640cdcb0 con 0x7f986415bdc0 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f986a0f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640cdf90 con 0x7f98640ce290 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f986a0f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640b47e0 con 0x7f98640b52c0 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f9862ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98640ce290 0x7f98640ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f98637fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f986415bdc0 0x7f98640cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53918/0 (socket says 172.21.15.5:53918) 2024-04-25T09:00:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f98637fe640 1 -- 172.21.15.5:0/919385756 learned_addr learned my addr 172.21.15.5:0/919385756 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f9863fff640 1 --2- 172.21.15.5:0/919385756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640b52c0 0x7f98640b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f9862ffd640 1 -- 172.21.15.5:0/919385756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640b52c0 msgr2=0x7f98640b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f9862ffd640 1 --2- 172.21.15.5:0/919385756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640b52c0 0x7f98640b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f9862ffd640 1 -- 172.21.15.5:0/919385756 >> v1:172.21.15.5:6789/0 conn(0x7f986415bdc0 legacy=0x7f98640cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.305+0000 7f9862ffd640 1 -- 172.21.15.5:0/919385756 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640b4ac0 con 0x7f98640ce290 2024-04-25T09:00:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.306+0000 7f9862ffd640 1 --2- 172.21.15.5:0/919385756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98640ce290 0x7f98640ce720 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f98580097a0 tx=0x7f985802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde75db769d9613d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.306+0000 7f98627fc640 1 -- 172.21.15.5:0/919385756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858037070 con 0x7f98640ce290 2024-04-25T09:00:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.306+0000 7f98627fc640 1 -- 172.21.15.5:0/919385756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9858032440 con 0x7f98640ce290 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.306+0000 7f98627fc640 1 -- 172.21.15.5:0/919385756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858032810 con 0x7f98640ce290 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 -- 172.21.15.5:0/919385756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98640ce290 msgr2=0x7f98640ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 --2- 172.21.15.5:0/919385756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98640ce290 0x7f98640ce720 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f98580097a0 tx=0x7f985802a180 comp rx=0 tx=0).stop 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 -- 172.21.15.5:0/919385756 shutdown_connections 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 --2- 172.21.15.5:0/919385756 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640b52c0 0x7f98640b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 --2- 172.21.15.5:0/919385756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98640ce290 0x7f98640ce720 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 -- 172.21.15.5:0/919385756 >> 172.21.15.5:0/919385756 conn(0x7f98640d18f0 msgr2=0x7f98640d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 -- 172.21.15.5:0/919385756 shutdown_connections 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.307+0000 7f986a0f5640 1 -- 172.21.15.5:0/919385756 wait complete. 2024-04-25T09:00:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.308+0000 7f986a0f5640 1 Processor -- start 2024-04-25T09:00:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.308+0000 7f986a0f5640 1 -- start start 2024-04-25T09:00:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f986a0f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98640b52c0 0x7f986406b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f986a0f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640ce290 0x7f986406bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f986a0f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415bdc0 0x7f9864159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f986a0f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640cd8b0 con 0x7f986415bdc0 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f986a0f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640d09a0 con 0x7f98640b52c0 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f986a0f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640cda30 con 0x7f98640ce290 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415bdc0 0x7f9864159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415bdc0 0x7f9864159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32898/0 (socket says 172.21.15.5:32898) 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 -- 172.21.15.5:0/1252962885 learned_addr learned my addr 172.21.15.5:0/1252962885 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9862ffd640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640ce290 0x7f986406bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f98637fe640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98640b52c0 0x7f986406b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 -- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640ce290 msgr2=0x7f986406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640ce290 0x7f986406bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 -- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98640b52c0 msgr2=0x7f986406b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98640b52c0 0x7f986406b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9863fff640 1 -- 172.21.15.5:0/1252962885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98641584d0 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.309+0000 7f9862ffd640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640ce290 0x7f986406bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.310+0000 7f9863fff640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415bdc0 0x7f9864159350 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f985c00cda0 tx=0x7f985c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.310+0000 7f984bfff640 1 -- 172.21.15.5:0/1252962885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c003b90 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.310+0000 7f984bfff640 1 -- 172.21.15.5:0/1252962885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c003d30 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.310+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986406c390 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.310+0000 7f984bfff640 1 -- 172.21.15.5:0/1252962885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c004240 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.310+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98640c5910 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.311+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98640c5420 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.311+0000 7f984bfff640 1 -- 172.21.15.5:0/1252962885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f985c0043e0 con 0x7f986415bdc0 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.312+0000 7f984bfff640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b500 0x7f985006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.312+0000 7f984bfff640 1 -- 172.21.15.5:0/1252962885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f985c08a9b0 con 0x7f986415bdc0 2024-04-25T09:00:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.312+0000 7f98637fe640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b500 0x7f985006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.312+0000 7f98637fe640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b500 0x7f985006d9c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9854000f60 tx=0x7f9854009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.316+0000 7f984bfff640 1 -- 172.21.15.5:0/1252962885 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f985c059b80 con 0x7f986415bdc0 2024-04-25T09:00:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.500+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f986406c090 con 0x7f986415bdc0 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.500+0000 7f984bfff640 1 -- 172.21.15.5:0/1252962885 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+65 (secure 0 0 0) 0x7f985c059480 con 0x7f986415bdc0 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:04.490 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T09:00:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b500 msgr2=0x7f985006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b500 0x7f985006d9c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9854000f60 tx=0x7f9854009040 comp rx=0 tx=0).stop 2024-04-25T09:00:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415bdc0 msgr2=0x7f9864159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415bdc0 0x7f9864159350 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f985c00cda0 tx=0x7f985c00a660 comp rx=0 tx=0).stop 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 shutdown_connections 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b500 0x7f985006d9c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415bdc0 0x7f9864159350 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640ce290 0x7f986406bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 --2- 172.21.15.5:0/1252962885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98640b52c0 0x7f986406b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 >> 172.21.15.5:0/1252962885 conn(0x7f98640d18f0 msgr2=0x7f986415e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 shutdown_connections 2024-04-25T09:00:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.503+0000 7f986a0f5640 1 -- 172.21.15.5:0/1252962885 wait complete. 2024-04-25T09:00:04.503 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:00:04.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:00:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.618+0000 7f70426f5640 1 Processor -- start 2024-04-25T09:00:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.618+0000 7f70426f5640 1 -- start start 2024-04-25T09:00:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.619+0000 7f70426f5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f703c0cefd0 0x7f703c168c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.619+0000 7f70426f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c162820 con 0x7f703c0b97f0 2024-04-25T09:00:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.619+0000 7f70426f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c162260 con 0x7f703c15dde0 2024-04-25T09:00:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.619+0000 7f70426f5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c162540 con 0x7f703c0cefd0 2024-04-25T09:00:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.619+0000 7f703b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f703c0b97f0 0x7f703c0ce8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53930/0 (socket says 172.21.15.5:53930) 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.619+0000 7f703b7fe640 1 -- 172.21.15.5:0/3011389247 learned_addr learned my addr 172.21.15.5:0/3011389247 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.619+0000 7f7040c92640 1 --2- 172.21.15.5:0/3011389247 >> v2:172.21.15.80:3300/0 conn(0x7f703c0cefd0 0x7f703c168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5913188 0 0) 0x7f703c162820 con 0x7f703c0b97f0 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7028003520 con 0x7f703c0b97f0 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171570611 0 0) 0x7f7028003520 con 0x7f703c0b97f0 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 >> v2:172.21.15.80:3300/0 conn(0x7f703c0cefd0 msgr2=0x7f703c168c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 --2- 172.21.15.5:0/3011389247 >> v2:172.21.15.80:3300/0 conn(0x7f703c0cefd0 0x7f703c168c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 >> v1:172.21.15.80:6789/0 conn(0x7f703c15dde0 legacy=0x7f703c161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0d1f90 con 0x7f703c0b97f0 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f702c001690 con 0x7f703c0b97f0 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 >> v1:172.21.15.5:6789/0 conn(0x7f703c0b97f0 legacy=0x7f703c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70280039b0 0x7f7028003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70280043b0 0x7f7028004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7028005080 0x7f702800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c162540 con 0x7f7028005080 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702800bf30 con 0x7f70280039b0 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702800c130 con 0x7f70280043b0 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f7040c92640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7028005080 0x7f702800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703bfff640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70280039b0 0x7f7028003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f703b7fe640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70280043b0 0x7f7028004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f7040c92640 1 -- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70280043b0 msgr2=0x7f7028004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f7040c92640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70280043b0 0x7f7028004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f7040c92640 1 -- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70280039b0 msgr2=0x7f7028003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f7040c92640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70280039b0 0x7f7028003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.620+0000 7f7040c92640 1 -- 172.21.15.5:0/3011389247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7028003520 con 0x7f7028005080 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.621+0000 7f7040c92640 1 -- 172.21.15.5:0/3011389247 reap_dead start 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.621+0000 7f7040c92640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7028005080 0x7f702800b9c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f703c08cfb0 tx=0x7f7028005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcafe18b0b4b0e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.621+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034035020 con 0x7f7028005080 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.621+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034003b90 con 0x7f7028005080 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.621+0000 7f703affd640 1 -- 172.21.15.5:0/3011389247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034009c10 con 0x7f7028005080 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.622+0000 7f70426f5640 1 -- 172.21.15.5:0/3011389247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7028005080 msgr2=0x7f702800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.622+0000 7f70426f5640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7028005080 0x7f702800b9c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f703c08cfb0 tx=0x7f7028005830 comp rx=0 tx=0).stop 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.622+0000 7f70426f5640 1 -- 172.21.15.5:0/3011389247 shutdown_connections 2024-04-25T09:00:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.622+0000 7f70426f5640 1 --2- 172.21.15.5:0/3011389247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7028005080 0x7f702800b9c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.622+0000 7f70426f5640 1 -- 172.21.15.5:0/3011389247 >> 172.21.15.5:0/3011389247 conn(0x7f703c0668f0 msgr2=0x7f703c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:04.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.622+0000 7f70426f5640 1 -- 172.21.15.5:0/3011389247 shutdown_connections 2024-04-25T09:00:04.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.622+0000 7f70426f5640 1 -- 172.21.15.5:0/3011389247 wait complete. 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.623+0000 7f70426f5640 1 Processor -- start 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.623+0000 7f70426f5640 1 -- start start 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f70426f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7028005080 0x7f703c14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f70426f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703c1514a0 0x7f703c1f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f70426f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f703c15e340 0x7f703c1f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f70426f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c15e1c0 con 0x7f703c1514a0 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f70426f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0b6c90 con 0x7f7028005080 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f70426f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0ce8c0 con 0x7f703c15e340 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703c1514a0 0x7f703c1f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703c1514a0 0x7f703c1f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32916/0 (socket says 172.21.15.5:32916) 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 -- 172.21.15.5:0/2457598203 learned_addr learned my addr 172.21.15.5:0/2457598203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703bfff640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7028005080 0x7f703c14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f7040c92640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f703c15e340 0x7f703c1f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 -- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f703c15e340 msgr2=0x7f703c1f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f703c15e340 0x7f703c1f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 -- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7028005080 msgr2=0x7f703c14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7028005080 0x7f703c14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.624+0000 7f703b7fe640 1 -- 172.21.15.5:0/2457598203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c14f0f0 con 0x7f703c1514a0 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.625+0000 7f703b7fe640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703c1514a0 0x7f703c1f2f20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f702c00e700 tx=0x7f702c00eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.625+0000 7f7038ff9640 1 -- 172.21.15.5:0/2457598203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00c620 con 0x7f703c1514a0 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.625+0000 7f7038ff9640 1 -- 172.21.15.5:0/2457598203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c018070 con 0x7f703c1514a0 2024-04-25T09:00:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.625+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c14f3d0 con 0x7f703c1514a0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.625+0000 7f7038ff9640 1 -- 172.21.15.5:0/2457598203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00ca00 con 0x7f703c1514a0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.625+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c14f990 con 0x7f703c1514a0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.626+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c04ef20 con 0x7f703c1514a0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.626+0000 7f7038ff9640 1 -- 172.21.15.5:0/2457598203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f702c00cba0 con 0x7f703c1514a0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.627+0000 7f7038ff9640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f701c06b4d0 0x7f701c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.627+0000 7f7038ff9640 1 -- 172.21.15.5:0/2457598203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f702c089bb0 con 0x7f703c1514a0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.627+0000 7f703bfff640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f701c06b4d0 0x7f701c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.628+0000 7f703bfff640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f701c06b4d0 0x7f701c06d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7024003640 tx=0x7f7024009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.631+0000 7f7038ff9640 1 -- 172.21.15.5:0/2457598203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f702c058e10 con 0x7f703c1514a0 2024-04-25T09:00:04.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:04.812+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f703c0d17c0 con 0x7f703c1514a0 2024-04-25T09:00:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.178+0000 7f7038ff9640 1 -- 172.21.15.5:0/2457598203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) v1 ==== 138+0+0 (secure 0 0 0) 0x7f702c058710 con 0x7f703c1514a0 2024-04-25T09:00:05.168 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f701c06b4d0 msgr2=0x7f701c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f701c06b4d0 0x7f701c06d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7024003640 tx=0x7f7024009040 comp rx=0 tx=0).stop 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703c1514a0 msgr2=0x7f703c1f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703c1514a0 0x7f703c1f2f20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f702c00e700 tx=0x7f702c00eb00 comp rx=0 tx=0).stop 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 shutdown_connections 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f701c06b4d0 0x7f701c06d990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f703c15e340 0x7f703c1f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703c1514a0 0x7f703c1f2f20 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 --2- 172.21.15.5:0/2457598203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7028005080 0x7f703c14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 >> 172.21.15.5:0/2457598203 conn(0x7f703c0668f0 msgr2=0x7f703c0c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.182+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 shutdown_connections 2024-04-25T09:00:05.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.183+0000 7f70426f5640 1 -- 172.21.15.5:0/2457598203 wait complete. 2024-04-25T09:00:05.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:00:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.309+0000 7effd02b3640 1 Processor -- start 2024-04-25T09:00:05.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.309+0000 7effd02b3640 1 -- start start 2024-04-25T09:00:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effd02b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 0x7effc8168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effd02b3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc8162150 con 0x7effc80b6250 2024-04-25T09:00:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effd02b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc8162430 con 0x7effc815df10 2024-04-25T09:00:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effd02b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80d20d0 con 0x7effc80cefe0 2024-04-25T09:00:05.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effcd84e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7effc80b6250 0x7effc80ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53942/0 (socket says 172.21.15.5:53942) 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effcd84e640 1 -- 172.21.15.5:0/285782348 learned_addr learned my addr 172.21.15.5:0/285782348 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effce850640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 0x7effc8168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994799843 0 0) 0x7effc8162150 con 0x7effc80b6250 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.310+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb0003520 con 0x7effc80b6250 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144196378 0 0) 0x7effc8162430 con 0x7effc815df10 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc8162150 con 0x7effc815df10 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3504142127 0 0) 0x7effb0003520 con 0x7effc80b6250 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 msgr2=0x7effc8168c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 0x7effc8168c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 >> v1:172.21.15.80:6789/0 conn(0x7effc815df10 legacy=0x7effc81618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8162710 con 0x7effc80b6250 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7effbc001670 con 0x7effc80b6250 2024-04-25T09:00:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 >> v1:172.21.15.5:6789/0 conn(0x7effc80b6250 legacy=0x7effc80ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effb0003b70 0x7effb0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 0x7effb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80d20d0 con 0x7effb0004800 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb000ba70 con 0x7effb0003b70 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb000bc70 con 0x7effc80cefe0 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd84e640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effce04f640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effb0003b70 0x7effb0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effce850640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 0x7effb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd84e640 1 -- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 msgr2=0x7effb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd84e640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80cefe0 0x7effb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd84e640 1 -- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effb0003b70 msgr2=0x7effb0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd84e640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effb0003b70 0x7effb0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.311+0000 7effcd84e640 1 -- 172.21.15.5:0/285782348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0003520 con 0x7effb0004800 2024-04-25T09:00:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.312+0000 7effcd84e640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effb0004c80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7effbc007fd0 tx=0x7effb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d27def1549d6c76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:05.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.312+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc007ca0 con 0x7effb0004800 2024-04-25T09:00:05.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.312+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc005ad0 con 0x7effb0004800 2024-04-25T09:00:05.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.312+0000 7effcd04d640 1 -- 172.21.15.5:0/285782348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc007070 con 0x7effb0004800 2024-04-25T09:00:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.313+0000 7effd02b3640 1 -- 172.21.15.5:0/285782348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 msgr2=0x7effb0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.313+0000 7effd02b3640 1 --2- 172.21.15.5:0/285782348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effb0004c80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7effbc007fd0 tx=0x7effb0005830 comp rx=0 tx=0).stop 2024-04-25T09:00:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.313+0000 7effce850640 1 -- 172.21.15.5:0/285782348 reap_dead start 2024-04-25T09:00:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.313+0000 7effd02b3640 1 -- 172.21.15.5:0/285782348 shutdown_connections 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.313+0000 7effd02b3640 1 -- 172.21.15.5:0/285782348 >> 172.21.15.5:0/285782348 conn(0x7effc80668f0 msgr2=0x7effc8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.313+0000 7effd02b3640 1 -- 172.21.15.5:0/285782348 shutdown_connections 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.313+0000 7effd02b3640 1 -- 172.21.15.5:0/285782348 wait complete. 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.314+0000 7effd02b3640 1 Processor -- start 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.314+0000 7effd02b3640 1 -- start start 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effc8160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effc815f3d0 0x7effc80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80c7340 0x7effc80c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80d36f0 con 0x7effb0004800 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80d3570 con 0x7effc815f3d0 2024-04-25T09:00:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80d3870 con 0x7effc80c7340 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effc8160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effc8160950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32934/0 (socket says 172.21.15.5:32934) 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 -- 172.21.15.5:0/3349470193 learned_addr learned my addr 172.21.15.5:0/3349470193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce850640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80c7340 0x7effc80c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effcd84e640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effc815f3d0 0x7effc80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 -- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80c7340 msgr2=0x7effc80c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80c7340 0x7effc80c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 -- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effc815f3d0 msgr2=0x7effc80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effc815f3d0 0x7effc80cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 -- 172.21.15.5:0/3349470193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80ce140 con 0x7effb0004800 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effce04f640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effc8160950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7effc000fb40 tx=0x7effc00021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effc6ffd640 1 -- 172.21.15.5:0/3349470193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0003b80 con 0x7effb0004800 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effc6ffd640 1 -- 172.21.15.5:0/3349470193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0018070 con 0x7effb0004800 2024-04-25T09:00:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc815f8b0 con 0x7effb0004800 2024-04-25T09:00:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effc6ffd640 1 -- 172.21.15.5:0/3349470193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000d910 con 0x7effb0004800 2024-04-25T09:00:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.315+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc815fe70 con 0x7effb0004800 2024-04-25T09:00:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.316+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc804ef20 con 0x7effb0004800 2024-04-25T09:00:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.317+0000 7effc6ffd640 1 -- 172.21.15.5:0/3349470193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effc000dab0 con 0x7effb0004800 2024-04-25T09:00:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.318+0000 7effc6ffd640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effb406b500 0x7effb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:05.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.318+0000 7effc6ffd640 1 -- 172.21.15.5:0/3349470193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5227+0+0 (secure 0 0 0) 0x7effc008a150 con 0x7effb0004800 2024-04-25T09:00:05.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.318+0000 7effcd84e640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effb406b500 0x7effb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:05.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.318+0000 7effcd84e640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effb406b500 0x7effb406d9c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7effbc007fd0 tx=0x7effbc034040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:05.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.322+0000 7effc6ffd640 1 -- 172.21.15.5:0/3349470193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effc80ce140 con 0x7effb0004800 2024-04-25T09:00:05.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:05.503+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7effc80d1910 con 0x7effb0004800 2024-04-25T09:00:06.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.181+0000 7effc6ffd640 1 -- 172.21.15.5:0/3349470193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) v1 ==== 170+0+0 (secure 0 0 0) 0x7effc0058b60 con 0x7effb0004800 2024-04-25T09:00:06.170 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T09:00:06.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.186+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effb406b500 msgr2=0x7effb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:06.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.186+0000 7effd02b3640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effb406b500 0x7effb406d9c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7effbc007fd0 tx=0x7effbc034040 comp rx=0 tx=0).stop 2024-04-25T09:00:06.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.186+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 msgr2=0x7effc8160950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:06.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.186+0000 7effd02b3640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effc8160950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7effc000fb40 tx=0x7effc00021e0 comp rx=0 tx=0).stop 2024-04-25T09:00:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.188+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 shutdown_connections 2024-04-25T09:00:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.188+0000 7effd02b3640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effb406b500 0x7effb406d9c0 secure :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7effbc007fd0 tx=0x7effbc034040 comp rx=0 tx=0).stop 2024-04-25T09:00:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.188+0000 7effd02b3640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effc80c7340 0x7effc80c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.188+0000 7effd02b3640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effc815f3d0 0x7effc80cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.188+0000 7effd02b3640 1 --2- 172.21.15.5:0/3349470193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb0004800 0x7effc8160950 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:06.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.188+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 >> 172.21.15.5:0/3349470193 conn(0x7effc80668f0 msgr2=0x7effc80b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:06.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.193+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 shutdown_connections 2024-04-25T09:00:06.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.193+0000 7effd02b3640 1 -- 172.21.15.5:0/3349470193 wait complete. 2024-04-25T09:00:06.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:00:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.323+0000 7f5326563640 1 Processor -- start 2024-04-25T09:00:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.323+0000 7f5326563640 1 -- start start 2024-04-25T09:00:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f5326563640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f532015df30 0x7f53200b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f5326563640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200b4d80 con 0x7f53201624e0 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f5326563640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200b5060 con 0x7f5320161970 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f5326563640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200b5340 con 0x7f532015df30 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f5324b00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f53201624e0 0x7f53200cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53952/0 (socket says 172.21.15.5:53952) 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f5324b00640 1 -- 172.21.15.5:0/3594094743 learned_addr learned my addr 172.21.15.5:0/3594094743 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531ffff640 1 --2- 172.21.15.5:0/3594094743 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f532015df30 0x7f53200b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531effd640 1 -- 172.21.15.5:0/3594094743 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796466628 0 0) 0x7f53200b4d80 con 0x7f53201624e0 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531effd640 1 -- 172.21.15.5:0/3594094743 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c003520 con 0x7f53201624e0 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531effd640 1 -- 172.21.15.5:0/3594094743 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001445398 0 0) 0x7f53200b5060 con 0x7f5320161970 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531effd640 1 -- 172.21.15.5:0/3594094743 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53200b4d80 con 0x7f5320161970 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531ffff640 1 -- 172.21.15.5:0/3594094743 >> v1:172.21.15.80:6789/0 conn(0x7f5320161970 legacy=0x7f5320161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531ffff640 1 -- 172.21.15.5:0/3594094743 >> v1:172.21.15.5:6789/0 conn(0x7f53201624e0 legacy=0x7f53200cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.324+0000 7f531ffff640 1 -- 172.21.15.5:0/3594094743 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200b4a70 con 0x7f532015df30 2024-04-25T09:00:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.325+0000 7f531ffff640 1 --2- 172.21.15.5:0/3594094743 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f532015df30 0x7f53200b2fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53100097d0 tx=0x7f531002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7be3c7b4df0b20a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.325+0000 7f531effd640 1 -- 172.21.15.5:0/3594094743 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310037070 con 0x7f532015df30 2024-04-25T09:00:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.325+0000 7f531effd640 1 -- 172.21.15.5:0/3594094743 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310032440 con 0x7f532015df30 2024-04-25T09:00:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.325+0000 7f531effd640 1 -- 172.21.15.5:0/3594094743 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310032810 con 0x7f532015df30 2024-04-25T09:00:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.326+0000 7f5326563640 1 -- 172.21.15.5:0/3594094743 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f532015df30 msgr2=0x7f53200b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.326+0000 7f5326563640 1 --2- 172.21.15.5:0/3594094743 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f532015df30 0x7f53200b2fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53100097d0 tx=0x7f531002a210 comp rx=0 tx=0).stop 2024-04-25T09:00:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.326+0000 7f5326563640 1 -- 172.21.15.5:0/3594094743 shutdown_connections 2024-04-25T09:00:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.326+0000 7f5326563640 1 --2- 172.21.15.5:0/3594094743 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f532015df30 0x7f53200b2fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.326+0000 7f5326563640 1 -- 172.21.15.5:0/3594094743 >> 172.21.15.5:0/3594094743 conn(0x7f5320072070 msgr2=0x7f5320072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.326+0000 7f5326563640 1 -- 172.21.15.5:0/3594094743 shutdown_connections 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.326+0000 7f5326563640 1 -- 172.21.15.5:0/3594094743 wait complete. 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.327+0000 7f5326563640 1 Processor -- start 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.327+0000 7f5326563640 1 -- start start 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f5326563640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f532015df30 0x7f532009afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f5326563640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5320161970 0x7f53200cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f5326563640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53201624e0 0x7f53200cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f5326563640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320072f00 con 0x7f532015df30 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f5326563640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532015e520 con 0x7f53201624e0 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f5326563640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200cafb0 con 0x7f5320161970 2024-04-25T09:00:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f531ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f532015df30 0x7f532009afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f531ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f532015df30 0x7f532009afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32944/0 (socket says 172.21.15.5:32944) 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f531ffff640 1 -- 172.21.15.5:0/3494833383 learned_addr learned my addr 172.21.15.5:0/3494833383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f531f7fe640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5320161970 0x7f53200cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.328+0000 7f5324b00640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53201624e0 0x7f53200cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531ffff640 1 -- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5320161970 msgr2=0x7f53200cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531ffff640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5320161970 0x7f53200cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531ffff640 1 -- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53201624e0 msgr2=0x7f53200cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531ffff640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53201624e0 0x7f53200cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531ffff640 1 -- 172.21.15.5:0/3494833383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532015b000 con 0x7f532015df30 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f5324b00640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53201624e0 0x7f53200cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531ffff640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f532015df30 0x7f532009afe0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f53100097d0 tx=0x7f53100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531cff9640 1 -- 172.21.15.5:0/3494833383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310041070 con 0x7f532015df30 2024-04-25T09:00:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531cff9640 1 -- 172.21.15.5:0/3494833383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531003c870 con 0x7f532015df30 2024-04-25T09:00:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f531cff9640 1 -- 172.21.15.5:0/3494833383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310037040 con 0x7f532015df30 2024-04-25T09:00:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53200d0230 con 0x7f532015df30 2024-04-25T09:00:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.329+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532015b580 con 0x7f532015df30 2024-04-25T09:00:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.330+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532004ef20 con 0x7f532015df30 2024-04-25T09:00:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.331+0000 7f531cff9640 1 -- 172.21.15.5:0/3494833383 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5310044070 con 0x7f532015df30 2024-04-25T09:00:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.331+0000 7f531cff9640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f530006b4d0 0x7f530006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.331+0000 7f531cff9640 1 -- 172.21.15.5:0/3494833383 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f53100aaca0 con 0x7f532015df30 2024-04-25T09:00:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.331+0000 7f531f7fe640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f530006b4d0 0x7f530006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.332+0000 7f531f7fe640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f530006b4d0 0x7f530006d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f532015ce30 tx=0x7f5308009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:06.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.336+0000 7f531cff9640 1 -- 172.21.15.5:0/3494833383 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5310079d30 con 0x7f532015df30 2024-04-25T09:00:06.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:06.552+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f532009e120 con 0x7f532015df30 2024-04-25T09:00:07.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.198+0000 7f531cff9640 1 -- 172.21.15.5:0/3494833383 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5310079630 con 0x7f532015df30 2024-04-25T09:00:07.188 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 8 and data pool 9 2024-04-25T09:00:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.210+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f530006b4d0 msgr2=0x7f530006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.210+0000 7f5326563640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f530006b4d0 0x7f530006d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f532015ce30 tx=0x7f5308009040 comp rx=0 tx=0).stop 2024-04-25T09:00:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.210+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f532015df30 msgr2=0x7f532009afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.210+0000 7f5326563640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f532015df30 0x7f532009afe0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f53100097d0 tx=0x7f53100046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.214+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 shutdown_connections 2024-04-25T09:00:07.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.214+0000 7f5326563640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f530006b4d0 0x7f530006d990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.214+0000 7f5326563640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53201624e0 0x7f53200cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.214+0000 7f5326563640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5320161970 0x7f53200cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.214+0000 7f5326563640 1 --2- 172.21.15.5:0/3494833383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f532015df30 0x7f532009afe0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.214+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 >> 172.21.15.5:0/3494833383 conn(0x7f5320072070 msgr2=0x7f532006e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.216+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 shutdown_connections 2024-04-25T09:00:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.217+0000 7f5326563640 1 -- 172.21.15.5:0/3494833383 wait complete. 2024-04-25T09:00:07.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.337+0000 7f855e7ce640 1 Processor -- start 2024-04-25T09:00:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.337+0000 7f855e7ce640 1 -- start start 2024-04-25T09:00:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.338+0000 7f855e7ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85580cea80 0x7f855815f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.338+0000 7f855e7ce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855815ef10 con 0x7f855815fd80 2024-04-25T09:00:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.338+0000 7f855e7ce640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855815f1a0 con 0x7f855806bd00 2024-04-25T09:00:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.338+0000 7f855e7ce640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580cfd60 con 0x7f85580cea80 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.338+0000 7f85577fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f855815fd80 0x7f855806b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53964/0 (socket says 172.21.15.5:53964) 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.338+0000 7f85577fe640 1 -- 172.21.15.5:0/674295421 learned_addr learned my addr 172.21.15.5:0/674295421 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.339+0000 7f8557fff640 1 --2- 172.21.15.5:0/674295421 >> v2:172.21.15.80:3300/0 conn(0x7f85580cea80 0x7f855815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.339+0000 7f8556ffd640 1 -- 172.21.15.5:0/674295421 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165422982 0 0) 0x7f855815ef10 con 0x7f855815fd80 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.339+0000 7f8556ffd640 1 -- 172.21.15.5:0/674295421 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8544003520 con 0x7f855815fd80 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.339+0000 7f8556ffd640 1 -- 172.21.15.5:0/674295421 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1800934211 0 0) 0x7f8544003520 con 0x7f855815fd80 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.339+0000 7f8557fff640 1 -- 172.21.15.5:0/674295421 >> v1:172.21.15.80:6789/0 conn(0x7f855806bd00 legacy=0x7f85580d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.339+0000 7f8557fff640 1 -- 172.21.15.5:0/674295421 >> v1:172.21.15.5:6789/0 conn(0x7f855815fd80 legacy=0x7f855806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.339+0000 7f8557fff640 1 -- 172.21.15.5:0/674295421 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580cff90 con 0x7f85580cea80 2024-04-25T09:00:07.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.340+0000 7f8557fff640 1 --2- 172.21.15.5:0/674295421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85580cea80 0x7f855815f840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85480097a0 tx=0x7f854802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff9c1630c2b477f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.340+0000 7f8556ffd640 1 -- 172.21.15.5:0/674295421 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548037070 con 0x7f85580cea80 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.340+0000 7f8556ffd640 1 -- 172.21.15.5:0/674295421 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854802ac50 con 0x7f85580cea80 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.340+0000 7f8556ffd640 1 -- 172.21.15.5:0/674295421 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540001670 con 0x7f85580cea80 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.340+0000 7f855e7ce640 1 -- 172.21.15.5:0/674295421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85580cea80 msgr2=0x7f855815f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.340+0000 7f855e7ce640 1 --2- 172.21.15.5:0/674295421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85580cea80 0x7f855815f840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85480097a0 tx=0x7f854802a1c0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.341+0000 7f855e7ce640 1 -- 172.21.15.5:0/674295421 shutdown_connections 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.341+0000 7f855e7ce640 1 --2- 172.21.15.5:0/674295421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85580cea80 0x7f855815f840 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.341+0000 7f855e7ce640 1 -- 172.21.15.5:0/674295421 >> 172.21.15.5:0/674295421 conn(0x7f85580d19f0 msgr2=0x7f85580d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.341+0000 7f855e7ce640 1 -- 172.21.15.5:0/674295421 shutdown_connections 2024-04-25T09:00:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.341+0000 7f855e7ce640 1 -- 172.21.15.5:0/674295421 wait complete. 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.342+0000 7f855e7ce640 1 Processor -- start 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.342+0000 7f855e7ce640 1 -- start start 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f855e7ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f855806bd00 0x7f85580c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f855e7ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85580cea80 0x7f85580b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f855e7ce640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85580c7e80 0x7f8558156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f855e7ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580d1660 con 0x7f85580cea80 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f855e7ce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855815f480 con 0x7f855806bd00 2024-04-25T09:00:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f855e7ce640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580d17e0 con 0x7f85580c7e80 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85580cea80 0x7f85580b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85580cea80 0x7f85580b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32948/0 (socket says 172.21.15.5:32948) 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 -- 172.21.15.5:0/656504316 learned_addr learned my addr 172.21.15.5:0/656504316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f855cd6b640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85580c7e80 0x7f8558156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f8557fff640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f855806bd00 0x7f85580c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 -- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85580c7e80 msgr2=0x7f8558156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85580c7e80 0x7f8558156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 -- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f855806bd00 msgr2=0x7f85580c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f855806bd00 0x7f85580c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 -- 172.21.15.5:0/656504316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580c7560 con 0x7f85580cea80 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.343+0000 7f85577fe640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85580cea80 0x7f85580b6780 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f854000c780 tx=0x7f854000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.344+0000 7f8554ff9640 1 -- 172.21.15.5:0/656504316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540005ad0 con 0x7f85580cea80 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.344+0000 7f8554ff9640 1 -- 172.21.15.5:0/656504316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8540005c70 con 0x7f85580cea80 2024-04-25T09:00:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.344+0000 7f8554ff9640 1 -- 172.21.15.5:0/656504316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540007290 con 0x7f85580cea80 2024-04-25T09:00:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.344+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85580b59c0 con 0x7f85580cea80 2024-04-25T09:00:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.344+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85580b5f80 con 0x7f85580cea80 2024-04-25T09:00:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.345+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8558073f60 con 0x7f85580cea80 2024-04-25T09:00:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.345+0000 7f8554ff9640 1 -- 172.21.15.5:0/656504316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8540007430 con 0x7f85580cea80 2024-04-25T09:00:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.345+0000 7f8554ff9640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f853806b500 0x7f853806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.346+0000 7f8554ff9640 1 -- 172.21.15.5:0/656504316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8540089f40 con 0x7f85580cea80 2024-04-25T09:00:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.346+0000 7f8557fff640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f853806b500 0x7f853806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.346+0000 7f8557fff640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f853806b500 0x7f853806d9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8548034000 tx=0x7f854802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.350+0000 7f8554ff9640 1 -- 172.21.15.5:0/656504316 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8558073f60 con 0x7f85580cea80 2024-04-25T09:00:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.531+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f855804ef20 con 0x7f85580cea80 2024-04-25T09:00:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.532+0000 7f8554ff9640 1 -- 172.21.15.5:0/656504316 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f8540010300 con 0x7f85580cea80 2024-04-25T09:00:07.523 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:07.523 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:06.554083+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f853806b500 msgr2=0x7f853806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f853806b500 0x7f853806d9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8548034000 tx=0x7f854802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85580cea80 msgr2=0x7f85580b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85580cea80 0x7f85580b6780 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f854000c780 tx=0x7f854000cc40 comp rx=0 tx=0).stop 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 shutdown_connections 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f853806b500 0x7f853806d9c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85580c7e80 0x7f8558156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85580cea80 0x7f85580b6780 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 --2- 172.21.15.5:0/656504316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f855806bd00 0x7f85580c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 >> 172.21.15.5:0/656504316 conn(0x7f85580d19f0 msgr2=0x7f855815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 shutdown_connections 2024-04-25T09:00:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.534+0000 7f855e7ce640 1 -- 172.21.15.5:0/656504316 wait complete. 2024-04-25T09:00:07.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.647+0000 7f2541390640 1 Processor -- start 2024-04-25T09:00:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.647+0000 7f2541390640 1 -- start start 2024-04-25T09:00:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f2541390640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f253c0ce7f0 0x7f253c0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f2541390640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0cf1c0 con 0x7f253c0b2cc0 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f2541390640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0d20e0 con 0x7f253c15de70 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f2541390640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c0d2a10 con 0x7f253c0ce7f0 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f253b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f253c0ce7f0 0x7f253c0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f2533fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f253c0b2cc0 0x7f253c0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53966/0 (socket says 172.21.15.5:53966) 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f2533fff640 1 -- 172.21.15.5:0/186747440 learned_addr learned my addr 172.21.15.5:0/186747440 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f253b7fe640 1 -- 172.21.15.5:0/186747440 >> v1:172.21.15.80:6789/0 conn(0x7f253c15de70 legacy=0x7f253c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f253b7fe640 1 -- 172.21.15.5:0/186747440 >> v1:172.21.15.5:6789/0 conn(0x7f253c0b2cc0 legacy=0x7f253c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f253b7fe640 1 -- 172.21.15.5:0/186747440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0d23c0 con 0x7f253c0ce7f0 2024-04-25T09:00:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.648+0000 7f253a7fc640 1 -- 172.21.15.5:0/186747440 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648679952 0 0) 0x7f253c0cf1c0 con 0x7f253c0b2cc0 2024-04-25T09:00:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.649+0000 7f253b7fe640 1 --2- 172.21.15.5:0/186747440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cec80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2534009d90 tx=0x7f253402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab678e5909c96dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.649+0000 7f253a7fc640 1 -- 172.21.15.5:0/186747440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534007740 con 0x7f253c0ce7f0 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.649+0000 7f253a7fc640 1 -- 172.21.15.5:0/186747440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340078e0 con 0x7f253c0ce7f0 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.649+0000 7f253a7fc640 1 -- 172.21.15.5:0/186747440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534007cb0 con 0x7f253c0ce7f0 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.650+0000 7f2541390640 1 -- 172.21.15.5:0/186747440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 msgr2=0x7f253c0cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.650+0000 7f2541390640 1 --2- 172.21.15.5:0/186747440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cec80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2534009d90 tx=0x7f253402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.650+0000 7f2541390640 1 -- 172.21.15.5:0/186747440 shutdown_connections 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.650+0000 7f2541390640 1 --2- 172.21.15.5:0/186747440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cec80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.650+0000 7f2541390640 1 -- 172.21.15.5:0/186747440 >> 172.21.15.5:0/186747440 conn(0x7f253c06b000 msgr2=0x7f253c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.650+0000 7f2541390640 1 -- 172.21.15.5:0/186747440 shutdown_connections 2024-04-25T09:00:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.650+0000 7f2541390640 1 -- 172.21.15.5:0/186747440 wait complete. 2024-04-25T09:00:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.651+0000 7f2541390640 1 Processor -- start 2024-04-25T09:00:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.651+0000 7f2541390640 1 -- start start 2024-04-25T09:00:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2541390640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c0b2cc0 0x7f253c1f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2541390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2541390640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f253c15de70 0x7f253c0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2541390640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0d2ea0 con 0x7f253c0ce7f0 2024-04-25T09:00:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2541390640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0b7300 con 0x7f253c0b2cc0 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2541390640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0d3020 con 0x7f253c15de70 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32980/0 (socket says 172.21.15.5:32980) 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 -- 172.21.15.5:0/2129923945 learned_addr learned my addr 172.21.15.5:0/2129923945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f253b7fe640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f253c15de70 0x7f253c0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f253affd640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c0b2cc0 0x7f253c1f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 -- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f253c15de70 msgr2=0x7f253c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f253c15de70 0x7f253c0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 -- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c0b2cc0 msgr2=0x7f253c1f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c0b2cc0 0x7f253c1f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 -- 172.21.15.5:0/2129923945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0ca160 con 0x7f253c0ce7f0 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f253affd640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c0b2cc0 0x7f253c1f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2533fff640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cc9a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f252400c4d0 tx=0x7f252400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f25337fe640 1 -- 172.21.15.5:0/2129923945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524018070 con 0x7f253c0ce7f0 2024-04-25T09:00:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f25337fe640 1 -- 172.21.15.5:0/2129923945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524007500 con 0x7f253c0ce7f0 2024-04-25T09:00:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f25337fe640 1 -- 172.21.15.5:0/2129923945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524004a20 con 0x7f253c0ce7f0 2024-04-25T09:00:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.652+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c1542e0 con 0x7f253c0ce7f0 2024-04-25T09:00:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.653+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c1548a0 con 0x7f253c0ce7f0 2024-04-25T09:00:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.653+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c04ef20 con 0x7f253c0ce7f0 2024-04-25T09:00:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.654+0000 7f25337fe640 1 -- 172.21.15.5:0/2129923945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f252401b070 con 0x7f253c0ce7f0 2024-04-25T09:00:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.654+0000 7f25337fe640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f251c06b4d0 0x7f251c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.654+0000 7f25337fe640 1 -- 172.21.15.5:0/2129923945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2524089510 con 0x7f253c0ce7f0 2024-04-25T09:00:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.655+0000 7f253affd640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f251c06b4d0 0x7f251c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.655+0000 7f253affd640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f251c06b4d0 0x7f251c06d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f252c006fd0 tx=0x7f252c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.658+0000 7f25337fe640 1 -- 172.21.15.5:0/2129923945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2524058390 con 0x7f253c0ce7f0 2024-04-25T09:00:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.842+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f253c0b98d0 con 0x7f253c0ce7f0 2024-04-25T09:00:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.843+0000 7f25337fe640 1 -- 172.21.15.5:0/2129923945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f2524057c90 con 0x7f253c0ce7f0 2024-04-25T09:00:07.833 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:07.833 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:06.554083+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.845+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f251c06b4d0 msgr2=0x7f251c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f251c06b4d0 0x7f251c06d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f252c006fd0 tx=0x7f252c008040 comp rx=0 tx=0).stop 2024-04-25T09:00:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 msgr2=0x7f253c0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cc9a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f252400c4d0 tx=0x7f252400c990 comp rx=0 tx=0).stop 2024-04-25T09:00:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 shutdown_connections 2024-04-25T09:00:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f251c06b4d0 0x7f251c06d990 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f253c15de70 0x7f253c0ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253c0ce7f0 0x7f253c0cc9a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 --2- 172.21.15.5:0/2129923945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c0b2cc0 0x7f253c1f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 >> 172.21.15.5:0/2129923945 conn(0x7f253c06b000 msgr2=0x7f253c0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 shutdown_connections 2024-04-25T09:00:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.846+0000 7f2541390640 1 -- 172.21.15.5:0/2129923945 wait complete. 2024-04-25T09:00:07.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:00:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.961+0000 7f520ef09640 1 Processor -- start 2024-04-25T09:00:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.961+0000 7f520ef09640 1 -- start start 2024-04-25T09:00:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.962+0000 7f520ef09640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52080b72b0 0x7f52080cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.962+0000 7f520ef09640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080cc010 con 0x7f52080d0d20 2024-04-25T09:00:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.962+0000 7f520ef09640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080cc2f0 con 0x7f52080ce8b0 2024-04-25T09:00:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.962+0000 7f520ef09640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52080cc5d0 con 0x7f52080b72b0 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.962+0000 7f5207fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f52080d0d20 0x7f52080ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53974/0 (socket says 172.21.15.5:53974) 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.962+0000 7f5207fff640 1 -- 172.21.15.5:0/2467748398 learned_addr learned my addr 172.21.15.5:0/2467748398 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.963+0000 7f520cca5640 1 --2- 172.21.15.5:0/2467748398 >> v2:172.21.15.80:3300/0 conn(0x7f52080b72b0 0x7f52080cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.963+0000 7f52077fe640 1 -- 172.21.15.5:0/2467748398 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548326415 0 0) 0x7f52080cc010 con 0x7f52080d0d20 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.963+0000 7f52077fe640 1 -- 172.21.15.5:0/2467748398 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f0003520 con 0x7f52080d0d20 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.963+0000 7f520cca5640 1 -- 172.21.15.5:0/2467748398 >> v1:172.21.15.80:6789/0 conn(0x7f52080ce8b0 legacy=0x7f52080ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.963+0000 7f520cca5640 1 -- 172.21.15.5:0/2467748398 >> v1:172.21.15.5:6789/0 conn(0x7f52080d0d20 legacy=0x7f52080ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.963+0000 7f52077fe640 1 -- 172.21.15.5:0/2467748398 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3695480628 0 0) 0x7f51f0003520 con 0x7f52080d0d20 2024-04-25T09:00:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.963+0000 7f520cca5640 1 -- 172.21.15.5:0/2467748398 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080cc8b0 con 0x7f52080b72b0 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.964+0000 7f520cca5640 1 --2- 172.21.15.5:0/2467748398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f52080cfd70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5200009d90 tx=0x7f520002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32747e2132380f97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.964+0000 7f52077fe640 1 -- 172.21.15.5:0/2467748398 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc001670 con 0x7f52080b72b0 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.964+0000 7f52077fe640 1 -- 172.21.15.5:0/2467748398 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200007540 con 0x7f52080b72b0 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.964+0000 7f52077fe640 1 -- 172.21.15.5:0/2467748398 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200007910 con 0x7f52080b72b0 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.965+0000 7f520ef09640 1 -- 172.21.15.5:0/2467748398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 msgr2=0x7f52080cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.965+0000 7f520ef09640 1 --2- 172.21.15.5:0/2467748398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f52080cfd70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5200009d90 tx=0x7f520002a680 comp rx=0 tx=0).stop 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.965+0000 7f520ef09640 1 -- 172.21.15.5:0/2467748398 shutdown_connections 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.965+0000 7f520ef09640 1 --2- 172.21.15.5:0/2467748398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f52080cfd70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.965+0000 7f520ef09640 1 -- 172.21.15.5:0/2467748398 >> 172.21.15.5:0/2467748398 conn(0x7f52080d1920 msgr2=0x7f52080d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.965+0000 7f520ef09640 1 -- 172.21.15.5:0/2467748398 shutdown_connections 2024-04-25T09:00:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.965+0000 7f520ef09640 1 -- 172.21.15.5:0/2467748398 wait complete. 2024-04-25T09:00:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.966+0000 7f520ef09640 1 Processor -- start 2024-04-25T09:00:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.966+0000 7f520ef09640 1 -- start start 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f5208155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52080ce8b0 0x7f52080cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52080d0d20 0x7f52080cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52080d11b0 con 0x7f52080d0d20 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52080d1550 con 0x7f52080b72b0 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52080d1330 con 0x7f52080ce8b0 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52080d0d20 0x7f52080cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52080d0d20 0x7f52080cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32992/0 (socket says 172.21.15.5:32992) 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 -- 172.21.15.5:0/167138310 learned_addr learned my addr 172.21.15.5:0/167138310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f5207fff640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52080ce8b0 0x7f52080cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520cca5640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f5208155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 -- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52080ce8b0 msgr2=0x7f52080cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52080ce8b0 0x7f52080cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 -- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 msgr2=0x7f5208155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f5208155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 -- 172.21.15.5:0/167138310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520809f350 con 0x7f52080d0d20 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f5207fff640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52080ce8b0 0x7f52080cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520cca5640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f5208155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520d4a6640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52080d0d20 0x7f52080cb100 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c3a0 tx=0x7f51f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f52057fa640 1 -- 172.21.15.5:0/167138310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8017070 con 0x7f52080d0d20 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f52057fa640 1 -- 172.21.15.5:0/167138310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80052d0 con 0x7f52080d0d20 2024-04-25T09:00:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520809f630 con 0x7f52080d0d20 2024-04-25T09:00:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f52057fa640 1 -- 172.21.15.5:0/167138310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8003830 con 0x7f52080d0d20 2024-04-25T09:00:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.967+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52080c6db0 con 0x7f52080d0d20 2024-04-25T09:00:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.969+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520804ef20 con 0x7f52080d0d20 2024-04-25T09:00:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.969+0000 7f52057fa640 1 -- 172.21.15.5:0/167138310 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51f801a070 con 0x7f52080d0d20 2024-04-25T09:00:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.969+0000 7f52057fa640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51f406b4d0 0x7f51f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.969+0000 7f52057fa640 1 -- 172.21.15.5:0/167138310 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51f8089580 con 0x7f52080d0d20 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.970+0000 7f520cca5640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51f406b4d0 0x7f51f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.970+0000 7f520cca5640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51f406b4d0 0x7f51f406d990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5200034000 tx=0x7f520002f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:07.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:07.974+0000 7f52057fa640 1 -- 172.21.15.5:0/167138310 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51f80584d0 con 0x7f52080d0d20 2024-04-25T09:00:08.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.191+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5208070180 con 0x7f52080d0d20 2024-04-25T09:00:08.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.198+0000 7f52057fa640 1 -- 172.21.15.5:0/167138310 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f51f8057dd0 con 0x7f52080d0d20 2024-04-25T09:00:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.200+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51f406b4d0 msgr2=0x7f51f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.200+0000 7f520ef09640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51f406b4d0 0x7f51f406d990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5200034000 tx=0x7f520002f000 comp rx=0 tx=0).stop 2024-04-25T09:00:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.200+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52080d0d20 msgr2=0x7f52080cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.200+0000 7f520ef09640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52080d0d20 0x7f52080cb100 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c3a0 tx=0x7f51f800c860 comp rx=0 tx=0).stop 2024-04-25T09:00:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 shutdown_connections 2024-04-25T09:00:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51f406b4d0 0x7f51f406d990 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52080d0d20 0x7f52080cb100 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52080ce8b0 0x7f52080cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 --2- 172.21.15.5:0/167138310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52080b72b0 0x7f5208155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 >> 172.21.15.5:0/167138310 conn(0x7f52080d1920 msgr2=0x7f52080d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 shutdown_connections 2024-04-25T09:00:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.201+0000 7f520ef09640 1 -- 172.21.15.5:0/167138310 wait complete. 2024-04-25T09:00:08.202 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:00:08.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:00:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.317+0000 7feee24f5640 1 Processor -- start 2024-04-25T09:00:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.317+0000 7feee24f5640 1 -- start start 2024-04-25T09:00:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.317+0000 7feee24f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc15de80 0x7feedc0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.317+0000 7feee24f5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feedc0d2dc0 0x7feedc0d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.317+0000 7feee24f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc15e260 con 0x7feedc0ce1c0 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.317+0000 7feee24f5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feedc0d3770 con 0x7feedc0d2dc0 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.317+0000 7feee24f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0d1ef0 con 0x7feedc15de80 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feedb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feedc0ce1c0 0x7feedc0d2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53978/0 (socket says 172.21.15.5:53978) 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feedb7fe640 1 -- 172.21.15.5:0/3725363256 learned_addr learned my addr 172.21.15.5:0/3725363256 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feee0a92640 1 --2- 172.21.15.5:0/3725363256 >> v2:172.21.15.80:3300/0 conn(0x7feedc0d2dc0 0x7feedc0d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feedbfff640 1 --2- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc15de80 0x7feedc0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feedaffd640 1 -- 172.21.15.5:0/3725363256 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541418522 0 0) 0x7feedc15e260 con 0x7feedc0ce1c0 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feedaffd640 1 -- 172.21.15.5:0/3725363256 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec4003520 con 0x7feedc0ce1c0 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feee0a92640 1 -- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc15de80 msgr2=0x7feedc0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feee0a92640 1 --2- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc15de80 0x7feedc0ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feee0a92640 1 -- 172.21.15.5:0/3725363256 >> v1:172.21.15.5:6789/0 conn(0x7feedc0ce1c0 legacy=0x7feedc0d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feee0a92640 1 -- 172.21.15.5:0/3725363256 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0cf2e0 con 0x7feedc0d2dc0 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.318+0000 7feedbfff640 1 --2- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc15de80 0x7feedc0ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feee0a92640 1 --2- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc0d2dc0 0x7feedc0d3230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feed4009d90 tx=0x7feed402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=295342480cfcae80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feedaffd640 1 -- 172.21.15.5:0/3725363256 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4007740 con 0x7feedc0d2dc0 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feedaffd640 1 -- 172.21.15.5:0/3725363256 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed40078e0 con 0x7feedc0d2dc0 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feedaffd640 1 -- 172.21.15.5:0/3725363256 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4007c90 con 0x7feedc0d2dc0 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feee24f5640 1 -- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc0d2dc0 msgr2=0x7feedc0d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feee24f5640 1 --2- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc0d2dc0 0x7feedc0d3230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feed4009d90 tx=0x7feed402a660 comp rx=0 tx=0).stop 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feee24f5640 1 -- 172.21.15.5:0/3725363256 shutdown_connections 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feee24f5640 1 --2- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc0d2dc0 0x7feedc0d3230 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feee24f5640 1 --2- 172.21.15.5:0/3725363256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc15de80 0x7feedc0ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.319+0000 7feee24f5640 1 -- 172.21.15.5:0/3725363256 >> 172.21.15.5:0/3725363256 conn(0x7feedc06b000 msgr2=0x7feedc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.320+0000 7feee24f5640 1 -- 172.21.15.5:0/3725363256 shutdown_connections 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.320+0000 7feee24f5640 1 -- 172.21.15.5:0/3725363256 wait complete. 2024-04-25T09:00:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.321+0000 7feee24f5640 1 Processor -- start 2024-04-25T09:00:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.321+0000 7feee24f5640 1 -- start start 2024-04-25T09:00:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee24f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc0ce1c0 0x7feedc160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee24f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feedc0d2dc0 0x7feedc14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee24f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc15de80 0x7feedc0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee24f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0d1b80 con 0x7feedc0d2dc0 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee24f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0ce780 con 0x7feedc15de80 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee24f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0b6cf0 con 0x7feedc0ce1c0 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feedc0d2dc0 0x7feedc14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feedc0d2dc0 0x7feedc14ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33000/0 (socket says 172.21.15.5:33000) 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 -- 172.21.15.5:0/2415607285 learned_addr learned my addr 172.21.15.5:0/2415607285 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee0a92640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc15de80 0x7feedc0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedbfff640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc0ce1c0 0x7feedc160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 -- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc0ce1c0 msgr2=0x7feedc160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc0ce1c0 0x7feedc160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 -- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc15de80 msgr2=0x7feedc0cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc15de80 0x7feedc0cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 -- 172.21.15.5:0/2415607285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc15fa70 con 0x7feedc0d2dc0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee0a92640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc15de80 0x7feedc0cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedbfff640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc0ce1c0 0x7feedc160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feedb7fe640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feedc0d2dc0 0x7feedc14ef20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feed00010e0 tx=0x7feed000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feed8ff9640 1 -- 172.21.15.5:0/2415607285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0017070 con 0x7feedc0d2dc0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feed8ff9640 1 -- 172.21.15.5:0/2415607285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0005d00 con 0x7feedc0d2dc0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feed8ff9640 1 -- 172.21.15.5:0/2415607285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00072b0 con 0x7feedc0d2dc0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.322+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc15fd50 con 0x7feedc0d2dc0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.323+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feedc160310 con 0x7feedc0d2dc0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.324+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc04ef20 con 0x7feedc0d2dc0 2024-04-25T09:00:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.324+0000 7feed8ff9640 1 -- 172.21.15.5:0/2415607285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feed001a070 con 0x7feedc0d2dc0 2024-04-25T09:00:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.324+0000 7feed8ff9640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feec806b500 0x7feec806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.324+0000 7feed8ff9640 1 -- 172.21.15.5:0/2415607285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feed00896b0 con 0x7feedc0d2dc0 2024-04-25T09:00:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.325+0000 7feedbfff640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feec806b500 0x7feec806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.325+0000 7feedbfff640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feec806b500 0x7feec806d9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feecc009a20 tx=0x7feecc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.328+0000 7feed8ff9640 1 -- 172.21.15.5:0/2415607285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feed0058490 con 0x7feedc0d2dc0 2024-04-25T09:00:08.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:08.547+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feedc0b3000 con 0x7feedc0d2dc0 2024-04-25T09:00:09.168 INFO:tasks.ceph.mds.d.smithi080.stderr:2024-04-25T09:00:09.180+0000 7ffb32d33640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:00:09.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.206+0000 7feed8ff9640 1 -- 172.21.15.5:0/2415607285 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7feed0057d90 con 0x7feedc0d2dc0 2024-04-25T09:00:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feec806b500 msgr2=0x7feec806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feec806b500 0x7feec806d9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feecc009a20 tx=0x7feecc008040 comp rx=0 tx=0).stop 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feedc0d2dc0 msgr2=0x7feedc14ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feedc0d2dc0 0x7feedc14ef20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feed00010e0 tx=0x7feed000c960 comp rx=0 tx=0).stop 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 shutdown_connections 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feec806b500 0x7feec806d9c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feedc15de80 0x7feedc0cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feedc0d2dc0 0x7feedc14ef20 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 --2- 172.21.15.5:0/2415607285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feedc0ce1c0 0x7feedc160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 >> 172.21.15.5:0/2415607285 conn(0x7feedc06b000 msgr2=0x7feedc0b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 shutdown_connections 2024-04-25T09:00:09.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.209+0000 7feee24f5640 1 -- 172.21.15.5:0/2415607285 wait complete. 2024-04-25T09:00:09.212 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:00:09.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.330+0000 7f8594a6f640 1 Processor -- start 2024-04-25T09:00:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.330+0000 7f8594a6f640 1 -- start start 2024-04-25T09:00:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f8594a6f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f859006adf0 0x7f859006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f8594a6f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859015ef10 con 0x7f859006bb30 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f8594a6f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859006bf10 con 0x7f85900cea80 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f8594a6f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85900cfd60 con 0x7f859006adf0 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f859006bb30 0x7f85900d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53986/0 (socket says 172.21.15.5:53986) 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858ed9d640 1 -- 172.21.15.5:0/1751918797 learned_addr learned my addr 172.21.15.5:0/1751918797 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f8585d9b640 1 --2- 172.21.15.5:0/1751918797 >> v2:172.21.15.80:3300/0 conn(0x7f859006adf0 0x7f859006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040522696 0 0) 0x7f859015ef10 con 0x7f859006bb30 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f857c003520 con 0x7f859006bb30 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888278554 0 0) 0x7f859006bf10 con 0x7f85900cea80 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f859015ef10 con 0x7f85900cea80 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2539193538 0 0) 0x7f857c003520 con 0x7f859006bb30 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 >> v2:172.21.15.80:3300/0 conn(0x7f859006adf0 msgr2=0x7f859006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 --2- 172.21.15.5:0/1751918797 >> v2:172.21.15.80:3300/0 conn(0x7f859006adf0 0x7f859006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 >> v1:172.21.15.80:6789/0 conn(0x7f85900cea80 legacy=0x7f859015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859015ff50 con 0x7f859006bb30 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f85880019f0 con 0x7f859006bb30 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.331+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 >> v1:172.21.15.5:6789/0 conn(0x7f859006bb30 legacy=0x7f85900d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858dd9b640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c003b90 0x7f857c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858dd9b640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c004800 0x7f857c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858dd9b640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c0051c0 0x7f857c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c00c090 con 0x7f857c003b90 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c00c210 con 0x7f857c004800 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c00c410 con 0x7f857c0051c0 2024-04-25T09:00:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858e59c640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c003b90 0x7f857c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f8585d9b640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c004800 0x7f857c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858ed9d640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c0051c0 0x7f857c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858e59c640 1 -- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c0051c0 msgr2=0x7f857c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858e59c640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c0051c0 0x7f857c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858e59c640 1 -- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c004800 msgr2=0x7f857c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858e59c640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c004800 0x7f857c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858e59c640 1 -- 172.21.15.5:0/1751918797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c003520 con 0x7f857c003b90 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.332+0000 7f858ed9d640 1 -- 172.21.15.5:0/1751918797 reap_dead start 2024-04-25T09:00:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f858e59c640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c003b90 0x7f857c003f90 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f85800018d0 tx=0x7f857c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b77c98b7ccb584 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800014f0 con 0x7f857c003b90 2024-04-25T09:00:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800052d0 con 0x7f857c003b90 2024-04-25T09:00:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f858dd9b640 1 -- 172.21.15.5:0/1751918797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858002ac70 con 0x7f857c003b90 2024-04-25T09:00:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f8594a6f640 1 -- 172.21.15.5:0/1751918797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c003b90 msgr2=0x7f857c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c003b90 0x7f857c003f90 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f85800018d0 tx=0x7f857c005830 comp rx=0 tx=0).stop 2024-04-25T09:00:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f8594a6f640 1 -- 172.21.15.5:0/1751918797 shutdown_connections 2024-04-25T09:00:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1751918797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c003b90 0x7f857c003f90 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f8594a6f640 1 -- 172.21.15.5:0/1751918797 >> 172.21.15.5:0/1751918797 conn(0x7f85900d19f0 msgr2=0x7f85900d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f8594a6f640 1 -- 172.21.15.5:0/1751918797 shutdown_connections 2024-04-25T09:00:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.333+0000 7f8594a6f640 1 -- 172.21.15.5:0/1751918797 wait complete. 2024-04-25T09:00:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.335+0000 7f8594a6f640 1 Processor -- start 2024-04-25T09:00:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.335+0000 7f8594a6f640 1 -- start start 2024-04-25T09:00:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8594a6f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c003b90 0x7f8590153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8594a6f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85900b4fb0 0x7f85900b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8594a6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85901585a0 0x7f8590158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8594a6f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85900cff90 con 0x7f85901585a0 2024-04-25T09:00:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8594a6f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859015f480 con 0x7f85900b4fb0 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8594a6f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85900d0270 con 0x7f857c003b90 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85901585a0 0x7f8590158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85901585a0 0x7f8590158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33014/0 (socket says 172.21.15.5:33014) 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 -- 172.21.15.5:0/1691575638 learned_addr learned my addr 172.21.15.5:0/1691575638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858e59c640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c003b90 0x7f8590153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8585d9b640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85900b4fb0 0x7f85900b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 -- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c003b90 msgr2=0x7f8590153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c003b90 0x7f8590153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 -- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85900b4fb0 msgr2=0x7f85900b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85900b4fb0 0x7f85900b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 -- 172.21.15.5:0/1691575638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900b1080 con 0x7f85901585a0 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8585d9b640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85900b4fb0 0x7f85900b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f858ed9d640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85901585a0 0x7f8590158a20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f85900724a0 tx=0x7f8588007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f85877fe640 1 -- 172.21.15.5:0/1691575638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800e9c0 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f85877fe640 1 -- 172.21.15.5:0/1691575638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858800eb60 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f85877fe640 1 -- 172.21.15.5:0/1691575638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800ed50 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.336+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85900b1360 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.337+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85900b1920 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.337+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859004ef20 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.338+0000 7f85877fe640 1 -- 172.21.15.5:0/1691575638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f858801a020 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.338+0000 7f85877fe640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f857006b500 0x7f857006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.339+0000 7f85877fe640 1 -- 172.21.15.5:0/1691575638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8588089bb0 con 0x7f85901585a0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.339+0000 7f858e59c640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f857006b500 0x7f857006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.339+0000 7f858e59c640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f857006b500 0x7f857006d9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8580032000 tx=0x7f8580009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.343+0000 7f85877fe640 1 -- 172.21.15.5:0/1691575638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8588021020 con 0x7f85901585a0 2024-04-25T09:00:09.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.558+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85900cefa0 con 0x7f85901585a0 2024-04-25T09:00:09.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.559+0000 7f85877fe640 1 -- 172.21.15.5:0/1691575638 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f858808d090 con 0x7f85901585a0 2024-04-25T09:00:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:09.549 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/313563585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":313563585},{"type":"v1","addr":"172.21.15.80:6837","nonce":313563585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/109709411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":109709411},{"type":"v1","addr":"172.21.15.5:6834","nonce":109709411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2543846434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543846434},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543846434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:08.548961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6495":{"gid":6495,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6836/3464170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3464170028},{"type":"v1","addr":"172.21.15.80:6836","nonce":3464170028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:09.549 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-04-25T09:00:09.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f857006b500 msgr2=0x7f857006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f857006b500 0x7f857006d9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8580032000 tx=0x7f8580009030 comp rx=0 tx=0).stop 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85901585a0 msgr2=0x7f8590158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85901585a0 0x7f8590158a20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f85900724a0 tx=0x7f8588007af0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 shutdown_connections 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f857006b500 0x7f857006d9c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85901585a0 0x7f8590158a20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85900b4fb0 0x7f85900b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 --2- 172.21.15.5:0/1691575638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f857c003b90 0x7f8590153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 >> 172.21.15.5:0/1691575638 conn(0x7f85900d19f0 msgr2=0x7f8590160560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 shutdown_connections 2024-04-25T09:00:09.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.561+0000 7f8594a6f640 1 -- 172.21.15.5:0/1691575638 wait complete. 2024-04-25T09:00:09.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.673+0000 7fcad2963640 1 Processor -- start 2024-04-25T09:00:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.673+0000 7fcad2963640 1 -- start start 2024-04-25T09:00:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcad2963640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc0668f0 0x7fcacc066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcad2963640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcacc161fe0 0x7fcacc0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcad2963640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc067210 con 0x7fcacc0b3e10 2024-04-25T09:00:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcad2963640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc0b5740 con 0x7fcacc161fe0 2024-04-25T09:00:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcad2963640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0b5a20 con 0x7fcacc0668f0 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcacb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcacc161fe0 0x7fcacc0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcad0f00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcacc0b3e10 0x7fcacc06d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53988/0 (socket says 172.21.15.5:53988) 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcad0f00640 1 -- 172.21.15.5:0/3941009677 learned_addr learned my addr 172.21.15.5:0/3941009677 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcacbfff640 1 --2- 172.21.15.5:0/3941009677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc0668f0 0x7fcacc066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcacb7fe640 1 -- 172.21.15.5:0/3941009677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc0668f0 msgr2=0x7fcacc066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcacb7fe640 1 --2- 172.21.15.5:0/3941009677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc0668f0 0x7fcacc066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcacb7fe640 1 -- 172.21.15.5:0/3941009677 >> v1:172.21.15.5:6789/0 conn(0x7fcacc0b3e10 legacy=0x7fcacc06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcacaffd640 1 -- 172.21.15.5:0/3941009677 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028884760 0 0) 0x7fcacc067210 con 0x7fcacc0b3e10 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.674+0000 7fcacb7fe640 1 -- 172.21.15.5:0/3941009677 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0b5d00 con 0x7fcacc161fe0 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.675+0000 7fcacb7fe640 1 --2- 172.21.15.5:0/3941009677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc161fe0 0x7fcacc0b38d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcac00097d0 tx=0x7fcac002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cef4d39d1e0d11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.675+0000 7fcacaffd640 1 -- 172.21.15.5:0/3941009677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0037070 con 0x7fcacc161fe0 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.675+0000 7fcacaffd640 1 -- 172.21.15.5:0/3941009677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0032440 con 0x7fcacc161fe0 2024-04-25T09:00:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.675+0000 7fcacaffd640 1 -- 172.21.15.5:0/3941009677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0032810 con 0x7fcacc161fe0 2024-04-25T09:00:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 -- 172.21.15.5:0/3941009677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc161fe0 msgr2=0x7fcacc0b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 --2- 172.21.15.5:0/3941009677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc161fe0 0x7fcacc0b38d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcac00097d0 tx=0x7fcac002a1c0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 -- 172.21.15.5:0/3941009677 shutdown_connections 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 --2- 172.21.15.5:0/3941009677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc161fe0 0x7fcacc0b38d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 --2- 172.21.15.5:0/3941009677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc0668f0 0x7fcacc066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 -- 172.21.15.5:0/3941009677 >> 172.21.15.5:0/3941009677 conn(0x7fcacc0b25d0 msgr2=0x7fcacc0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 -- 172.21.15.5:0/3941009677 shutdown_connections 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.676+0000 7fcad2963640 1 -- 172.21.15.5:0/3941009677 wait complete. 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.677+0000 7fcad2963640 1 Processor -- start 2024-04-25T09:00:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.677+0000 7fcad2963640 1 -- start start 2024-04-25T09:00:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcad2963640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcacc0668f0 0x7fcacc1f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcad2963640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc0b3e10 0x7fcacc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcad2963640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc161fe0 0x7fcacc0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcad2963640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc06f030 con 0x7fcacc0b3e10 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcad2963640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc161ac0 con 0x7fcacc0668f0 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcad2963640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc06f1b0 con 0x7fcacc161fe0 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc0b3e10 0x7fcacc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc0b3e10 0x7fcacc0b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33024/0 (socket says 172.21.15.5:33024) 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 -- 172.21.15.5:0/3594122432 learned_addr learned my addr 172.21.15.5:0/3594122432 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacbfff640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcacc0668f0 0x7fcacc1f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcad0f00640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc161fe0 0x7fcacc0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 -- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc161fe0 msgr2=0x7fcacc0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc161fe0 0x7fcacc0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 -- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcacc0668f0 msgr2=0x7fcacc1f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcacc0668f0 0x7fcacc1f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 -- 172.21.15.5:0/3594122432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0b2060 con 0x7fcacc0b3e10 2024-04-25T09:00:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.678+0000 7fcacb7fe640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc0b3e10 0x7fcacc0b0b40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcac0000c00 tx=0x7fcac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.679+0000 7fcac8ff9640 1 -- 172.21.15.5:0/3594122432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0037040 con 0x7fcacc0b3e10 2024-04-25T09:00:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.679+0000 7fcac8ff9640 1 -- 172.21.15.5:0/3594122432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0042070 con 0x7fcacc0b3e10 2024-04-25T09:00:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.679+0000 7fcac8ff9640 1 -- 172.21.15.5:0/3594122432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0030bb0 con 0x7fcacc0b3e10 2024-04-25T09:00:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.679+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc15a900 con 0x7fcacc0b3e10 2024-04-25T09:00:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.679+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc15aec0 con 0x7fcacc0b3e10 2024-04-25T09:00:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.680+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc13d220 con 0x7fcacc0b3e10 2024-04-25T09:00:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.680+0000 7fcac8ff9640 1 -- 172.21.15.5:0/3594122432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcac0047460 con 0x7fcacc0b3e10 2024-04-25T09:00:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.681+0000 7fcac8ff9640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcab806b4d0 0x7fcab806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.681+0000 7fcac8ff9640 1 -- 172.21.15.5:0/3594122432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcac00aad90 con 0x7fcacc0b3e10 2024-04-25T09:00:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.681+0000 7fcacbfff640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcab806b4d0 0x7fcab806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.681+0000 7fcacbfff640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcab806b4d0 0x7fcab806d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.685+0000 7fcac8ff9640 1 -- 172.21.15.5:0/3594122432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcac0032e20 con 0x7fcacc0b3e10 2024-04-25T09:00:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.865+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcacc04ef20 con 0x7fcacc0b3e10 2024-04-25T09:00:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.866+0000 7fcac8ff9640 1 -- 172.21.15.5:0/3594122432 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16581 (secure 0 0 0) 0x7fcac0079c10 con 0x7fcacc0b3e10 2024-04-25T09:00:09.855 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:09.855 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:08.199215+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcab806b4d0 msgr2=0x7fcab806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcab806b4d0 0x7fcab806d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc008040 comp rx=0 tx=0).stop 2024-04-25T09:00:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc0b3e10 msgr2=0x7fcacc0b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc0b3e10 0x7fcacc0b0b40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcac0000c00 tx=0x7fcac00046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 shutdown_connections 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcab806b4d0 0x7fcab806d990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcacc161fe0 0x7fcacc0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcacc0b3e10 0x7fcacc0b0b40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 --2- 172.21.15.5:0/3594122432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcacc0668f0 0x7fcacc1f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 >> 172.21.15.5:0/3594122432 conn(0x7fcacc0b25d0 msgr2=0x7fcacc06d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 shutdown_connections 2024-04-25T09:00:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.868+0000 7fcad2963640 1 -- 172.21.15.5:0/3594122432 wait complete. 2024-04-25T09:00:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:00:09.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:00:09.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.980+0000 7ff5b46b3640 1 Processor -- start 2024-04-25T09:00:09.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.980+0000 7ff5b46b3640 1 -- start start 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b46b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0ce7f0 0x7ff5ac0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b46b3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0cf1c0 con 0x7ff5ac0b2cc0 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b46b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0d20e0 con 0x7ff5ac15de70 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b46b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0d2a10 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b1c4e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5ac0b2cc0 0x7ff5ac0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53990/0 (socket says 172.21.15.5:53990) 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b1c4e640 1 -- 172.21.15.5:0/43385166 learned_addr learned my addr 172.21.15.5:0/43385166 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b2c50640 1 --2- 172.21.15.5:0/43385166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0ce7f0 0x7ff5ac0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437257191 0 0) 0x7ff5ac0cf1c0 con 0x7ff5ac0b2cc0 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff598003520 con 0x7ff5ac0b2cc0 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821160711 0 0) 0x7ff5ac0d20e0 con 0x7ff5ac15de70 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5ac0cf1c0 con 0x7ff5ac15de70 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3691729917 0 0) 0x7ff598003520 con 0x7ff5ac0b2cc0 2024-04-25T09:00:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b2c50640 1 -- 172.21.15.5:0/43385166 >> v1:172.21.15.80:6789/0 conn(0x7ff5ac15de70 legacy=0x7ff5ac0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b2c50640 1 -- 172.21.15.5:0/43385166 >> v1:172.21.15.5:6789/0 conn(0x7ff5ac0b2cc0 legacy=0x7ff5ac0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.981+0000 7ff5b2c50640 1 -- 172.21.15.5:0/43385166 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0d23c0 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.982+0000 7ff5b2c50640 1 --2- 172.21.15.5:0/43385166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0ce7f0 0x7ff5ac0cec80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009dc0 tx=0x7ff5a402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb4044af23bcc88f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.982+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c001670 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.982+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4007540 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.982+0000 7ff5b144d640 1 -- 172.21.15.5:0/43385166 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40078f0 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.983+0000 7ff5b46b3640 1 -- 172.21.15.5:0/43385166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0ce7f0 msgr2=0x7ff5ac0cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.983+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/43385166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0ce7f0 0x7ff5ac0cec80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009dc0 tx=0x7ff5a402a660 comp rx=0 tx=0).stop 2024-04-25T09:00:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.983+0000 7ff5b46b3640 1 -- 172.21.15.5:0/43385166 shutdown_connections 2024-04-25T09:00:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.983+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/43385166 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0ce7f0 0x7ff5ac0cec80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.983+0000 7ff5b46b3640 1 -- 172.21.15.5:0/43385166 >> 172.21.15.5:0/43385166 conn(0x7ff5ac06b000 msgr2=0x7ff5ac06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.983+0000 7ff5b46b3640 1 -- 172.21.15.5:0/43385166 shutdown_connections 2024-04-25T09:00:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.983+0000 7ff5b46b3640 1 -- 172.21.15.5:0/43385166 wait complete. 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.984+0000 7ff5b46b3640 1 Processor -- start 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.984+0000 7ff5b46b3640 1 -- start start 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b46b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0b2cc0 0x7ff5ac147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b46b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5ac0ce7f0 0x7ff5ac1f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b46b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5ac15de70 0x7ff5ac0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b46b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0d2ea0 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b46b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0b7300 con 0x7ff5ac15de70 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b46b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0d3020 con 0x7ff5ac0b2cc0 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5ac0ce7f0 0x7ff5ac1f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5ac0ce7f0 0x7ff5ac1f3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33030/0 (socket says 172.21.15.5:33030) 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 -- 172.21.15.5:0/3341244881 learned_addr learned my addr 172.21.15.5:0/3341244881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b244f640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0b2cc0 0x7ff5ac147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b2c50640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5ac15de70 0x7ff5ac0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 -- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0b2cc0 msgr2=0x7ff5ac147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0b2cc0 0x7ff5ac147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 -- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5ac15de70 msgr2=0x7ff5ac0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5ac15de70 0x7ff5ac0b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.985+0000 7ff5b1c4e640 1 -- 172.21.15.5:0/3341244881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac1480b0 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.986+0000 7ff5b1c4e640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5ac0ce7f0 0x7ff5ac1f3510 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c5a0 tx=0x7ff59c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.986+0000 7ff5a2ffd640 1 -- 172.21.15.5:0/3341244881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c017070 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.986+0000 7ff5a2ffd640 1 -- 172.21.15.5:0/3341244881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c005ce0 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.986+0000 7ff5a2ffd640 1 -- 172.21.15.5:0/3341244881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0072b0 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.986+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac148390 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.986+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac148950 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.987+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac04ef20 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.987+0000 7ff5a2ffd640 1 -- 172.21.15.5:0/3341244881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff59c01a070 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.988+0000 7ff5a2ffd640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59006b500 0x7ff59006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:09.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.988+0000 7ff5a2ffd640 1 -- 172.21.15.5:0/3341244881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff59c0896e0 con 0x7ff5ac0ce7f0 2024-04-25T09:00:09.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.988+0000 7ff5b244f640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59006b500 0x7ff59006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:09.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.989+0000 7ff5b244f640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59006b500 0x7ff59006d9c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80011e0 tx=0x7ff5a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:09.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:09.992+0000 7ff5a2ffd640 1 -- 172.21.15.5:0/3341244881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff59c057e70 con 0x7ff5ac0ce7f0 2024-04-25T09:00:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.167+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5ac147da0 con 0x7ff59006b500 2024-04-25T09:00:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.174+0000 7ff5a2ffd640 1 -- 172.21.15.5:0/3341244881 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246637 (secure 0 0 0) 0x7ff5ac147da0 con 0x7ff59006b500 2024-04-25T09:00:10.165 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:10.167 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:00:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59006b500 msgr2=0x7ff59006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59006b500 0x7ff59006d9c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80011e0 tx=0x7ff5a8009040 comp rx=0 tx=0).stop 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5ac0ce7f0 msgr2=0x7ff5ac1f3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5ac0ce7f0 0x7ff5ac1f3510 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c5a0 tx=0x7ff59c00ca60 comp rx=0 tx=0).stop 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 shutdown_connections 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff59006b500 0x7ff59006d9c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5ac15de70 0x7ff5ac0b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5ac0ce7f0 0x7ff5ac1f3510 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 --2- 172.21.15.5:0/3341244881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff5ac0b2cc0 0x7ff5ac147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 >> 172.21.15.5:0/3341244881 conn(0x7ff5ac06b000 msgr2=0x7ff5ac15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.176+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 shutdown_connections 2024-04-25T09:00:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.177+0000 7ff5b46b3640 1 -- 172.21.15.5:0/3341244881 wait complete. 2024-04-25T09:00:10.177 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-04-25T09:00:08.433030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":305624,"kb_used_data":6252,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669096,"statfs":{"total":773094113280,"available":772781154304,"internally_reserved":0,"allocated":6402048,"data_stored":3327529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001008"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190978+0000","last_change":"2024-04-25T09:00:06.190978+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190978+0000","last_undegraded":"2024-04-25T09:00:06.190978+0000","last_fullsized":"2024-04-25T09:00:06.190978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192596+0000","last_change":"2024-04-25T09:00:06.192596+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192596+0000","last_undegraded":"2024-04-25T09:00:06.192596+0000","last_fullsized":"2024-04-25T09:00:06.192596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187020+0000","last_change":"2024-04-25T09:00:06.187020+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187020+0000","last_undegraded":"2024-04-25T09:00:06.187020+0000","last_fullsized":"2024-04-25T09:00:06.187020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192288+0000","last_change":"2024-04-25T09:00:06.192288+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192288+0000","last_undegraded":"2024-04-25T09:00:06.192288+0000","last_fullsized":"2024-04-25T09:00:06.192288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191450+0000","last_change":"2024-04-25T09:00:06.191450+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191450+0000","last_undegraded":"2024-04-25T09:00:06.191450+0000","last_fullsized":"2024-04-25T09:00:06.191450+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187431+0000","last_change":"2024-04-25T09:00:06.187431+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187431+0000","last_undegraded":"2024-04-25T09:00:06.187431+0000","last_fullsized":"2024-04-25T09:00:06.187431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191331+0000","last_change":"2024-04-25T09:00:06.191331+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191331+0000","last_undegraded":"2024-04-25T09:00:06.191331+0000","last_fullsized":"2024-04-25T09:00:06.191331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192108+0000","last_change":"2024-04-25T09:00:06.192108+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192108+0000","last_undegraded":"2024-04-25T09:00:06.192108+0000","last_fullsized":"2024-04-25T09:00:06.192108+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191505+0000","last_change":"2024-04-25T09:00:06.191505+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191505+0000","last_undegraded":"2024-04-25T09:00:06.191505+0000","last_fullsized":"2024-04-25T09:00:06.191505+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192468+0000","last_change":"2024-04-25T09:00:06.192468+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192468+0000","last_undegraded":"2024-04-25T09:00:06.192468+0000","last_fullsized":"2024-04-25T09:00:06.192468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193470+0000","last_change":"2024-04-25T09:00:06.193470+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193470+0000","last_undegraded":"2024-04-25T09:00:06.193470+0000","last_fullsized":"2024-04-25T09:00:06.193470+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191829+0000","last_change":"2024-04-25T09:00:06.191829+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191829+0000","last_undegraded":"2024-04-25T09:00:06.191829+0000","last_fullsized":"2024-04-25T09:00:06.191829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188629+0000","last_change":"2024-04-25T09:00:06.188629+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188629+0000","last_undegraded":"2024-04-25T09:00:06.188629+0000","last_fullsized":"2024-04-25T09:00:06.188629+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191981+0000","last_change":"2024-04-25T09:00:06.191981+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191981+0000","last_undegraded":"2024-04-25T09:00:06.191981+0000","last_fullsized":"2024-04-25T09:00:06.191981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190813+0000","last_change":"2024-04-25T09:00:06.190813+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190813+0000","last_undegraded":"2024-04-25T09:00:06.190813+0000","last_fullsized":"2024-04-25T09:00:06.190813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188689+0000","last_change":"2024-04-25T09:00:06.188689+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188689+0000","last_undegraded":"2024-04-25T09:00:06.188689+0000","last_fullsized":"2024-04-25T09:00:06.188689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191416+0000","last_change":"2024-04-25T09:00:06.191416+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191416+0000","last_undegraded":"2024-04-25T09:00:06.191416+0000","last_fullsized":"2024-04-25T09:00:06.191416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186660+0000","last_change":"2024-04-25T09:00:06.186660+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186660+0000","last_undegraded":"2024-04-25T09:00:06.186660+0000","last_fullsized":"2024-04-25T09:00:06.186660+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192156+0000","last_change":"2024-04-25T09:00:06.192156+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192156+0000","last_undegraded":"2024-04-25T09:00:06.192156+0000","last_fullsized":"2024-04-25T09:00:06.192156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190935+0000","last_change":"2024-04-25T09:00:06.190935+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190935+0000","last_undegraded":"2024-04-25T09:00:06.190935+0000","last_fullsized":"2024-04-25T09:00:06.190935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187635+0000","last_change":"2024-04-25T09:00:06.187635+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187635+0000","last_undegraded":"2024-04-25T09:00:06.187635+0000","last_fullsized":"2024-04-25T09:00:06.187635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190893+0000","last_change":"2024-04-25T09:00:06.190893+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190893+0000","last_undegraded":"2024-04-25T09:00:06.190893+0000","last_fullsized":"2024-04-25T09:00:06.190893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186918+0000","last_change":"2024-04-25T09:00:06.186918+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186918+0000","last_undegraded":"2024-04-25T09:00:06.186918+0000","last_fullsized":"2024-04-25T09:00:06.186918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189560+0000","last_change":"2024-04-25T09:00:06.189560+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189560+0000","last_undegraded":"2024-04-25T09:00:06.189560+0000","last_fullsized":"2024-04-25T09:00:06.189560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190520+0000","last_change":"2024-04-25T09:00:06.190520+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190520+0000","last_undegraded":"2024-04-25T09:00:06.190520+0000","last_fullsized":"2024-04-25T09:00:06.190520+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191585+0000","last_change":"2024-04-25T09:00:06.191585+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191585+0000","last_undegraded":"2024-04-25T09:00:06.191585+0000","last_fullsized":"2024-04-25T09:00:06.191585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188965+0000","last_change":"2024-04-25T09:00:06.188965+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188965+0000","last_undegraded":"2024-04-25T09:00:06.188965+0000","last_fullsized":"2024-04-25T09:00:06.188965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191888+0000","last_change":"2024-04-25T09:00:06.191888+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191888+0000","last_undegraded":"2024-04-25T09:00:06.191888+0000","last_fullsized":"2024-04-25T09:00:06.191888+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193591+0000","last_change":"2024-04-25T09:00:06.193591+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193591+0000","last_undegraded":"2024-04-25T09:00:06.193591+0000","last_fullsized":"2024-04-25T09:00:06.193591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185906+0000","last_change":"2024-04-25T09:00:06.185906+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185906+0000","last_undegraded":"2024-04-25T09:00:06.185906+0000","last_fullsized":"2024-04-25T09:00:06.185906+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191330+0000","last_change":"2024-04-25T09:00:06.191330+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191330+0000","last_undegraded":"2024-04-25T09:00:06.191330+0000","last_fullsized":"2024-04-25T09:00:06.191330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185852+0000","last_change":"2024-04-25T09:00:06.185852+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185852+0000","last_undegraded":"2024-04-25T09:00:06.185852+0000","last_fullsized":"2024-04-25T09:00:06.185852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188286+0000","last_change":"2024-04-25T09:00:06.188286+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188286+0000","last_undegraded":"2024-04-25T09:00:06.188286+0000","last_fullsized":"2024-04-25T09:00:06.188286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200278+0000","last_change":"2024-04-25T09:00:06.199616+0000","last_active":"2024-04-25T09:00:06.200278+0000","last_peered":"2024-04-25T09:00:06.200278+0000","last_clean":"2024-04-25T09:00:06.200278+0000","last_became_active":"2024-04-25T09:00:06.199305+0000","last_became_peered":"2024-04-25T09:00:06.199305+0000","last_unstale":"2024-04-25T09:00:06.200278+0000","last_undegraded":"2024-04-25T09:00:06.200278+0000","last_fullsized":"2024-04-25T09:00:06.200278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:57.120298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191823+0000","last_change":"2024-04-25T09:00:06.191823+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191823+0000","last_undegraded":"2024-04-25T09:00:06.191823+0000","last_fullsized":"2024-04-25T09:00:06.191823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205473+0000","last_change":"2024-04-25T09:00:06.202408+0000","last_active":"2024-04-25T09:00:06.205473+0000","last_peered":"2024-04-25T09:00:06.205473+0000","last_clean":"2024-04-25T09:00:06.205473+0000","last_became_active":"2024-04-25T09:00:06.200858+0000","last_became_peered":"2024-04-25T09:00:06.200858+0000","last_unstale":"2024-04-25T09:00:06.205473+0000","last_undegraded":"2024-04-25T09:00:06.205473+0000","last_fullsized":"2024-04-25T09:00:06.205473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.891482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186977+0000","last_change":"2024-04-25T09:00:06.186977+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186977+0000","last_undegraded":"2024-04-25T09:00:06.186977+0000","last_fullsized":"2024-04-25T09:00:06.186977+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205129+0000","last_change":"2024-04-25T09:00:06.203421+0000","last_active":"2024-04-25T09:00:06.205129+0000","last_peered":"2024-04-25T09:00:06.205129+0000","last_clean":"2024-04-25T09:00:06.205129+0000","last_became_active":"2024-04-25T09:00:06.203097+0000","last_became_peered":"2024-04-25T09:00:06.203097+0000","last_unstale":"2024-04-25T09:00:06.205129+0000","last_undegraded":"2024-04-25T09:00:06.205129+0000","last_fullsized":"2024-04-25T09:00:06.205129+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:42.364834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187459+0000","last_change":"2024-04-25T09:00:06.187459+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187459+0000","last_undegraded":"2024-04-25T09:00:06.187459+0000","last_fullsized":"2024-04-25T09:00:06.187459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202834+0000","last_change":"2024-04-25T09:00:06.201046+0000","last_active":"2024-04-25T09:00:06.202834+0000","last_peered":"2024-04-25T09:00:06.202834+0000","last_clean":"2024-04-25T09:00:06.202834+0000","last_became_active":"2024-04-25T09:00:06.200765+0000","last_became_peered":"2024-04-25T09:00:06.200765+0000","last_unstale":"2024-04-25T09:00:06.202834+0000","last_undegraded":"2024-04-25T09:00:06.202834+0000","last_fullsized":"2024-04-25T09:00:06.202834+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:43.278902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190415+0000","last_change":"2024-04-25T09:00:06.190415+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190415+0000","last_undegraded":"2024-04-25T09:00:06.190415+0000","last_fullsized":"2024-04-25T09:00:06.190415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199790+0000","last_change":"2024-04-25T09:00:06.198409+0000","last_active":"2024-04-25T09:00:06.199790+0000","last_peered":"2024-04-25T09:00:06.199790+0000","last_clean":"2024-04-25T09:00:06.199790+0000","last_became_active":"2024-04-25T09:00:06.198093+0000","last_became_peered":"2024-04-25T09:00:06.198093+0000","last_unstale":"2024-04-25T09:00:06.199790+0000","last_undegraded":"2024-04-25T09:00:06.199790+0000","last_fullsized":"2024-04-25T09:00:06.199790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193147+0000","last_change":"2024-04-25T09:00:06.193147+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193147+0000","last_undegraded":"2024-04-25T09:00:06.193147+0000","last_fullsized":"2024-04-25T09:00:06.193147+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198833+0000","last_change":"2024-04-25T09:00:06.197490+0000","last_active":"2024-04-25T09:00:06.198833+0000","last_peered":"2024-04-25T09:00:06.198833+0000","last_clean":"2024-04-25T09:00:06.198833+0000","last_became_active":"2024-04-25T09:00:06.196586+0000","last_became_peered":"2024-04-25T09:00:06.196586+0000","last_unstale":"2024-04-25T09:00:06.198833+0000","last_undegraded":"2024-04-25T09:00:06.198833+0000","last_fullsized":"2024-04-25T09:00:06.198833+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188988+0000","last_change":"2024-04-25T09:00:06.188988+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188988+0000","last_undegraded":"2024-04-25T09:00:06.188988+0000","last_fullsized":"2024-04-25T09:00:06.188988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202655+0000","last_change":"2024-04-25T09:00:06.200363+0000","last_active":"2024-04-25T09:00:06.202655+0000","last_peered":"2024-04-25T09:00:06.202655+0000","last_clean":"2024-04-25T09:00:06.202655+0000","last_became_active":"2024-04-25T09:00:06.200060+0000","last_became_peered":"2024-04-25T09:00:06.200060+0000","last_unstale":"2024-04-25T09:00:06.202655+0000","last_undegraded":"2024-04-25T09:00:06.202655+0000","last_fullsized":"2024-04-25T09:00:06.202655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189042+0000","last_change":"2024-04-25T09:00:06.189042+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189042+0000","last_undegraded":"2024-04-25T09:00:06.189042+0000","last_fullsized":"2024-04-25T09:00:06.189042+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205468+0000","last_change":"2024-04-25T09:00:06.203119+0000","last_active":"2024-04-25T09:00:06.205468+0000","last_peered":"2024-04-25T09:00:06.205468+0000","last_clean":"2024-04-25T09:00:06.205468+0000","last_became_active":"2024-04-25T09:00:06.202821+0000","last_became_peered":"2024-04-25T09:00:06.202821+0000","last_unstale":"2024-04-25T09:00:06.205468+0000","last_undegraded":"2024-04-25T09:00:06.205468+0000","last_fullsized":"2024-04-25T09:00:06.205468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191565+0000","last_change":"2024-04-25T09:00:06.191565+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191565+0000","last_undegraded":"2024-04-25T09:00:06.191565+0000","last_fullsized":"2024-04-25T09:00:06.191565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199354+0000","last_change":"2024-04-25T09:00:06.196201+0000","last_active":"2024-04-25T09:00:06.199354+0000","last_peered":"2024-04-25T09:00:06.199354+0000","last_clean":"2024-04-25T09:00:06.199354+0000","last_became_active":"2024-04-25T09:00:06.195618+0000","last_became_peered":"2024-04-25T09:00:06.195618+0000","last_unstale":"2024-04-25T09:00:06.199354+0000","last_undegraded":"2024-04-25T09:00:06.199354+0000","last_fullsized":"2024-04-25T09:00:06.199354+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185892+0000","last_change":"2024-04-25T09:00:06.185892+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185892+0000","last_undegraded":"2024-04-25T09:00:06.185892+0000","last_fullsized":"2024-04-25T09:00:06.185892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205491+0000","last_change":"2024-04-25T09:00:06.203661+0000","last_active":"2024-04-25T09:00:06.205491+0000","last_peered":"2024-04-25T09:00:06.205491+0000","last_clean":"2024-04-25T09:00:06.205491+0000","last_became_active":"2024-04-25T09:00:06.201182+0000","last_became_peered":"2024-04-25T09:00:06.201182+0000","last_unstale":"2024-04-25T09:00:06.205491+0000","last_undegraded":"2024-04-25T09:00:06.205491+0000","last_fullsized":"2024-04-25T09:00:06.205491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:31.994350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190313+0000","last_change":"2024-04-25T09:00:06.190313+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190313+0000","last_undegraded":"2024-04-25T09:00:06.190313+0000","last_fullsized":"2024-04-25T09:00:06.190313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199920+0000","last_change":"2024-04-25T09:00:06.198508+0000","last_active":"2024-04-25T09:00:06.199920+0000","last_peered":"2024-04-25T09:00:06.199920+0000","last_clean":"2024-04-25T09:00:06.199920+0000","last_became_active":"2024-04-25T09:00:06.198162+0000","last_became_peered":"2024-04-25T09:00:06.198162+0000","last_unstale":"2024-04-25T09:00:06.199920+0000","last_undegraded":"2024-04-25T09:00:06.199920+0000","last_fullsized":"2024-04-25T09:00:06.199920+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186579+0000","last_change":"2024-04-25T09:00:06.186579+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186579+0000","last_undegraded":"2024-04-25T09:00:06.186579+0000","last_fullsized":"2024-04-25T09:00:06.186579+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200547+0000","last_change":"2024-04-25T09:00:06.199821+0000","last_active":"2024-04-25T09:00:06.200547+0000","last_peered":"2024-04-25T09:00:06.200547+0000","last_clean":"2024-04-25T09:00:06.200547+0000","last_became_active":"2024-04-25T09:00:06.199310+0000","last_became_peered":"2024-04-25T09:00:06.199310+0000","last_unstale":"2024-04-25T09:00:06.200547+0000","last_undegraded":"2024-04-25T09:00:06.200547+0000","last_fullsized":"2024-04-25T09:00:06.200547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:47.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193479+0000","last_change":"2024-04-25T09:00:06.193479+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193479+0000","last_undegraded":"2024-04-25T09:00:06.193479+0000","last_fullsized":"2024-04-25T09:00:06.193479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205531+0000","last_change":"2024-04-25T09:00:06.202728+0000","last_active":"2024-04-25T09:00:06.205531+0000","last_peered":"2024-04-25T09:00:06.205531+0000","last_clean":"2024-04-25T09:00:06.205531+0000","last_became_active":"2024-04-25T09:00:06.201927+0000","last_became_peered":"2024-04-25T09:00:06.201927+0000","last_unstale":"2024-04-25T09:00:06.205531+0000","last_undegraded":"2024-04-25T09:00:06.205531+0000","last_fullsized":"2024-04-25T09:00:06.205531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:34.685720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186754+0000","last_change":"2024-04-25T09:00:06.186754+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186754+0000","last_undegraded":"2024-04-25T09:00:06.186754+0000","last_fullsized":"2024-04-25T09:00:06.186754+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.195562+0000","last_change":"2024-04-25T09:00:06.193400+0000","last_active":"2024-04-25T09:00:06.195562+0000","last_peered":"2024-04-25T09:00:06.195562+0000","last_clean":"2024-04-25T09:00:06.195562+0000","last_became_active":"2024-04-25T09:00:06.193121+0000","last_became_peered":"2024-04-25T09:00:06.193121+0000","last_unstale":"2024-04-25T09:00:06.195562+0000","last_undegraded":"2024-04-25T09:00:06.195562+0000","last_fullsized":"2024-04-25T09:00:06.195562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:57.093035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.194668+0000","last_change":"2024-04-25T09:00:06.194668+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.194668+0000","last_undegraded":"2024-04-25T09:00:06.194668+0000","last_fullsized":"2024-04-25T09:00:06.194668+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201702+0000","last_change":"2024-04-25T09:00:06.198624+0000","last_active":"2024-04-25T09:00:06.201702+0000","last_peered":"2024-04-25T09:00:06.201702+0000","last_clean":"2024-04-25T09:00:06.201702+0000","last_became_active":"2024-04-25T09:00:06.198238+0000","last_became_peered":"2024-04-25T09:00:06.198238+0000","last_unstale":"2024-04-25T09:00:06.201702+0000","last_undegraded":"2024-04-25T09:00:06.201702+0000","last_fullsized":"2024-04-25T09:00:06.201702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185884+0000","last_change":"2024-04-25T09:00:06.185884+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185884+0000","last_undegraded":"2024-04-25T09:00:06.185884+0000","last_fullsized":"2024-04-25T09:00:06.185884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202443+0000","last_change":"2024-04-25T09:00:06.201475+0000","last_active":"2024-04-25T09:00:06.202443+0000","last_peered":"2024-04-25T09:00:06.202443+0000","last_clean":"2024-04-25T09:00:06.202443+0000","last_became_active":"2024-04-25T09:00:06.201166+0000","last_became_peered":"2024-04-25T09:00:06.201166+0000","last_unstale":"2024-04-25T09:00:06.202443+0000","last_undegraded":"2024-04-25T09:00:06.202443+0000","last_fullsized":"2024-04-25T09:00:06.202443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186231+0000","last_change":"2024-04-25T09:00:06.186231+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186231+0000","last_undegraded":"2024-04-25T09:00:06.186231+0000","last_fullsized":"2024-04-25T09:00:06.186231+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205304+0000","last_change":"2024-04-25T09:00:06.200834+0000","last_active":"2024-04-25T09:00:06.205304+0000","last_peered":"2024-04-25T09:00:06.205304+0000","last_clean":"2024-04-25T09:00:06.205304+0000","last_became_active":"2024-04-25T09:00:06.200467+0000","last_became_peered":"2024-04-25T09:00:06.200467+0000","last_unstale":"2024-04-25T09:00:06.205304+0000","last_undegraded":"2024-04-25T09:00:06.205304+0000","last_fullsized":"2024-04-25T09:00:06.205304+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:28.284535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192889+0000","last_change":"2024-04-25T09:00:06.192889+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192889+0000","last_undegraded":"2024-04-25T09:00:06.192889+0000","last_fullsized":"2024-04-25T09:00:06.192889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199291+0000","last_change":"2024-04-25T09:00:06.197838+0000","last_active":"2024-04-25T09:00:06.199291+0000","last_peered":"2024-04-25T09:00:06.199291+0000","last_clean":"2024-04-25T09:00:06.199291+0000","last_became_active":"2024-04-25T09:00:06.197304+0000","last_became_peered":"2024-04-25T09:00:06.197304+0000","last_unstale":"2024-04-25T09:00:06.199291+0000","last_undegraded":"2024-04-25T09:00:06.199291+0000","last_fullsized":"2024-04-25T09:00:06.199291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189244+0000","last_change":"2024-04-25T09:00:06.189244+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189244+0000","last_undegraded":"2024-04-25T09:00:06.189244+0000","last_fullsized":"2024-04-25T09:00:06.189244+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202574+0000","last_change":"2024-04-25T09:00:06.200257+0000","last_active":"2024-04-25T09:00:06.202574+0000","last_peered":"2024-04-25T09:00:06.202574+0000","last_clean":"2024-04-25T09:00:06.202574+0000","last_became_active":"2024-04-25T09:00:06.199977+0000","last_became_peered":"2024-04-25T09:00:06.199977+0000","last_unstale":"2024-04-25T09:00:06.202574+0000","last_undegraded":"2024-04-25T09:00:06.202574+0000","last_fullsized":"2024-04-25T09:00:06.202574+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186033+0000","last_change":"2024-04-25T09:00:06.186033+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186033+0000","last_undegraded":"2024-04-25T09:00:06.186033+0000","last_fullsized":"2024-04-25T09:00:06.186033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.204537+0000","last_change":"2024-04-25T09:00:06.201254+0000","last_active":"2024-04-25T09:00:06.204537+0000","last_peered":"2024-04-25T09:00:06.204537+0000","last_clean":"2024-04-25T09:00:06.204537+0000","last_became_active":"2024-04-25T09:00:06.200978+0000","last_became_peered":"2024-04-25T09:00:06.200978+0000","last_unstale":"2024-04-25T09:00:06.204537+0000","last_undegraded":"2024-04-25T09:00:06.204537+0000","last_fullsized":"2024-04-25T09:00:06.204537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:23.480824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190853+0000","last_change":"2024-04-25T09:00:06.190853+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190853+0000","last_undegraded":"2024-04-25T09:00:06.190853+0000","last_fullsized":"2024-04-25T09:00:06.190853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205510+0000","last_change":"2024-04-25T09:00:06.202223+0000","last_active":"2024-04-25T09:00:06.205510+0000","last_peered":"2024-04-25T09:00:06.205510+0000","last_clean":"2024-04-25T09:00:06.205510+0000","last_became_active":"2024-04-25T09:00:06.200842+0000","last_became_peered":"2024-04-25T09:00:06.200842+0000","last_unstale":"2024-04-25T09:00:06.205510+0000","last_undegraded":"2024-04-25T09:00:06.205510+0000","last_fullsized":"2024-04-25T09:00:06.205510+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:58.308566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186255+0000","last_change":"2024-04-25T09:00:06.186255+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186255+0000","last_undegraded":"2024-04-25T09:00:06.186255+0000","last_fullsized":"2024-04-25T09:00:06.186255+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202466+0000","last_change":"2024-04-25T09:00:06.196060+0000","last_active":"2024-04-25T09:00:06.202466+0000","last_peered":"2024-04-25T09:00:06.202466+0000","last_clean":"2024-04-25T09:00:06.202466+0000","last_became_active":"2024-04-25T09:00:06.195716+0000","last_became_peered":"2024-04-25T09:00:06.195716+0000","last_unstale":"2024-04-25T09:00:06.202466+0000","last_undegraded":"2024-04-25T09:00:06.202466+0000","last_fullsized":"2024-04-25T09:00:06.202466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:23.177590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185862+0000","last_change":"2024-04-25T09:00:06.185862+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185862+0000","last_undegraded":"2024-04-25T09:00:06.185862+0000","last_fullsized":"2024-04-25T09:00:06.185862+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205803+0000","last_change":"2024-04-25T09:00:06.204013+0000","last_active":"2024-04-25T09:00:06.205803+0000","last_peered":"2024-04-25T09:00:06.205803+0000","last_clean":"2024-04-25T09:00:06.205803+0000","last_became_active":"2024-04-25T09:00:06.203786+0000","last_became_peered":"2024-04-25T09:00:06.203786+0000","last_unstale":"2024-04-25T09:00:06.205803+0000","last_undegraded":"2024-04-25T09:00:06.205803+0000","last_fullsized":"2024-04-25T09:00:06.205803+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:57.421924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191168+0000","last_change":"2024-04-25T09:00:06.191168+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191168+0000","last_undegraded":"2024-04-25T09:00:06.191168+0000","last_fullsized":"2024-04-25T09:00:06.191168+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203908+0000","last_change":"2024-04-25T09:00:06.203068+0000","last_active":"2024-04-25T09:00:06.203908+0000","last_peered":"2024-04-25T09:00:06.203908+0000","last_clean":"2024-04-25T09:00:06.203908+0000","last_became_active":"2024-04-25T09:00:06.202810+0000","last_became_peered":"2024-04-25T09:00:06.202810+0000","last_unstale":"2024-04-25T09:00:06.203908+0000","last_undegraded":"2024-04-25T09:00:06.203908+0000","last_fullsized":"2024-04-25T09:00:06.203908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:21.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192530+0000","last_change":"2024-04-25T09:00:06.192530+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192530+0000","last_undegraded":"2024-04-25T09:00:06.192530+0000","last_fullsized":"2024-04-25T09:00:06.192530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199313+0000","last_change":"2024-04-25T09:00:06.198465+0000","last_active":"2024-04-25T09:00:06.199313+0000","last_peered":"2024-04-25T09:00:06.199313+0000","last_clean":"2024-04-25T09:00:06.199313+0000","last_became_active":"2024-04-25T09:00:06.198180+0000","last_became_peered":"2024-04-25T09:00:06.198180+0000","last_unstale":"2024-04-25T09:00:06.199313+0000","last_undegraded":"2024-04-25T09:00:06.199313+0000","last_fullsized":"2024-04-25T09:00:06.199313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:48.720837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189845+0000","last_change":"2024-04-25T09:00:06.189845+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189845+0000","last_undegraded":"2024-04-25T09:00:06.189845+0000","last_fullsized":"2024-04-25T09:00:06.189845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198645+0000","last_change":"2024-04-25T09:00:06.196940+0000","last_active":"2024-04-25T09:00:06.198645+0000","last_peered":"2024-04-25T09:00:06.198645+0000","last_clean":"2024-04-25T09:00:06.198645+0000","last_became_active":"2024-04-25T09:00:06.196651+0000","last_became_peered":"2024-04-25T09:00:06.196651+0000","last_unstale":"2024-04-25T09:00:06.198645+0000","last_undegraded":"2024-04-25T09:00:06.198645+0000","last_fullsized":"2024-04-25T09:00:06.198645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:25.280084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187024+0000","last_change":"2024-04-25T09:00:06.187024+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187024+0000","last_undegraded":"2024-04-25T09:00:06.187024+0000","last_fullsized":"2024-04-25T09:00:06.187024+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202853+0000","last_change":"2024-04-25T09:00:06.201200+0000","last_active":"2024-04-25T09:00:06.202853+0000","last_peered":"2024-04-25T09:00:06.202853+0000","last_clean":"2024-04-25T09:00:06.202853+0000","last_became_active":"2024-04-25T09:00:06.200924+0000","last_became_peered":"2024-04-25T09:00:06.200924+0000","last_unstale":"2024-04-25T09:00:06.202853+0000","last_undegraded":"2024-04-25T09:00:06.202853+0000","last_fullsized":"2024-04-25T09:00:06.202853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.391108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189728+0000","last_change":"2024-04-25T09:00:06.189728+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189728+0000","last_undegraded":"2024-04-25T09:00:06.189728+0000","last_fullsized":"2024-04-25T09:00:06.189728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203581+0000","last_change":"2024-04-25T09:00:06.199594+0000","last_active":"2024-04-25T09:00:06.203581+0000","last_peered":"2024-04-25T09:00:06.203581+0000","last_clean":"2024-04-25T09:00:06.203581+0000","last_became_active":"2024-04-25T09:00:06.199318+0000","last_became_peered":"2024-04-25T09:00:06.199318+0000","last_unstale":"2024-04-25T09:00:06.203581+0000","last_undegraded":"2024-04-25T09:00:06.203581+0000","last_fullsized":"2024-04-25T09:00:06.203581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:01.451638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186083+0000","last_change":"2024-04-25T09:00:06.186083+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186083+0000","last_undegraded":"2024-04-25T09:00:06.186083+0000","last_fullsized":"2024-04-25T09:00:06.186083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201694+0000","last_change":"2024-04-25T09:00:06.199988+0000","last_active":"2024-04-25T09:00:06.201694+0000","last_peered":"2024-04-25T09:00:06.201694+0000","last_clean":"2024-04-25T09:00:06.201694+0000","last_became_active":"2024-04-25T09:00:06.199325+0000","last_became_peered":"2024-04-25T09:00:06.199325+0000","last_unstale":"2024-04-25T09:00:06.201694+0000","last_undegraded":"2024-04-25T09:00:06.201694+0000","last_fullsized":"2024-04-25T09:00:06.201694+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188555+0000","last_change":"2024-04-25T09:00:06.188555+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188555+0000","last_undegraded":"2024-04-25T09:00:06.188555+0000","last_fullsized":"2024-04-25T09:00:06.188555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202384+0000","last_change":"2024-04-25T09:00:06.195158+0000","last_active":"2024-04-25T09:00:06.202384+0000","last_peered":"2024-04-25T09:00:06.202384+0000","last_clean":"2024-04-25T09:00:06.202384+0000","last_became_active":"2024-04-25T09:00:06.194854+0000","last_became_peered":"2024-04-25T09:00:06.194854+0000","last_unstale":"2024-04-25T09:00:06.202384+0000","last_undegraded":"2024-04-25T09:00:06.202384+0000","last_fullsized":"2024-04-25T09:00:06.202384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:34.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188439+0000","last_change":"2024-04-25T09:00:06.188439+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188439+0000","last_undegraded":"2024-04-25T09:00:06.188439+0000","last_fullsized":"2024-04-25T09:00:06.188439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205335+0000","last_change":"2024-04-25T09:00:06.202020+0000","last_active":"2024-04-25T09:00:06.205335+0000","last_peered":"2024-04-25T09:00:06.205335+0000","last_clean":"2024-04-25T09:00:06.205335+0000","last_became_active":"2024-04-25T09:00:06.201586+0000","last_became_peered":"2024-04-25T09:00:06.201586+0000","last_unstale":"2024-04-25T09:00:06.205335+0000","last_undegraded":"2024-04-25T09:00:06.205335+0000","last_fullsized":"2024-04-25T09:00:06.205335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:07.176226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188477+0000","last_change":"2024-04-25T09:00:06.188477+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188477+0000","last_undegraded":"2024-04-25T09:00:06.188477+0000","last_fullsized":"2024-04-25T09:00:06.188477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201954+0000","last_change":"2024-04-25T09:00:06.200265+0000","last_active":"2024-04-25T09:00:06.201954+0000","last_peered":"2024-04-25T09:00:06.201954+0000","last_clean":"2024-04-25T09:00:06.201954+0000","last_became_active":"2024-04-25T09:00:06.199932+0000","last_became_peered":"2024-04-25T09:00:06.199932+0000","last_unstale":"2024-04-25T09:00:06.201954+0000","last_undegraded":"2024-04-25T09:00:06.201954+0000","last_fullsized":"2024-04-25T09:00:06.201954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:36.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.188288+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:00:06.188288+0000","last_peered":"2024-04-25T09:00:06.188288+0000","last_clean":"2024-04-25T09:00:06.188288+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:00:06.188288+0000","last_undegraded":"2024-04-25T09:00:06.188288+0000","last_fullsized":"2024-04-25T09:00:06.188288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1253376,"data_stored":862634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44292,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327548,"statfs":{"total":96636764160,"available":96591409152,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1241088,"data_stored":856367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:00:10.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:00:10.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.328+0000 7f30e0d70640 1 Processor -- start 2024-04-25T09:00:10.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.328+0000 7f30e0d70640 1 -- start start 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30e0d70640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30dc15e0a0 0x7f30dc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30e0d70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30e0d70640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30dc0b7f60 con 0x7f30dc0d3990 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30e0d70640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30dc0b29c0 con 0x7f30dc15e0a0 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30e0d70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0d2080 con 0x7f30dc0d3df0 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30da59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30dc15e0a0 0x7f30dc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30d9d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f30dc0d3990 0x7f30dc0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54002/0 (socket says 172.21.15.5:54002) 2024-04-25T09:00:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.329+0000 7f30d9d9b640 1 -- 172.21.15.5:0/3699332152 learned_addr learned my addr 172.21.15.5:0/3699332152 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.330+0000 7f30da59c640 1 -- 172.21.15.5:0/3699332152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 msgr2=0x7f30dc0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.330+0000 7f30da59c640 1 --2- 172.21.15.5:0/3699332152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.330+0000 7f30da59c640 1 -- 172.21.15.5:0/3699332152 >> v1:172.21.15.5:6789/0 conn(0x7f30dc0d3990 legacy=0x7f30dc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.330+0000 7f30da59c640 1 -- 172.21.15.5:0/3699332152 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0d2360 con 0x7f30dc15e0a0 2024-04-25T09:00:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.330+0000 7f30da59c640 1 --2- 172.21.15.5:0/3699332152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc15e0a0 0x7f30dc0d0d50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0097a0 tx=0x7f30cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a534783f9be2c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.330+0000 7f30d959a640 1 -- 172.21.15.5:0/3699332152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc037070 con 0x7f30dc15e0a0 2024-04-25T09:00:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30d959a640 1 -- 172.21.15.5:0/3699332152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc032440 con 0x7f30dc15e0a0 2024-04-25T09:00:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30d959a640 1 -- 172.21.15.5:0/3699332152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc032810 con 0x7f30dc15e0a0 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 -- 172.21.15.5:0/3699332152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc15e0a0 msgr2=0x7f30dc0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 --2- 172.21.15.5:0/3699332152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc15e0a0 0x7f30dc0d0d50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0097a0 tx=0x7f30cc02a180 comp rx=0 tx=0).stop 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 -- 172.21.15.5:0/3699332152 shutdown_connections 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 --2- 172.21.15.5:0/3699332152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 --2- 172.21.15.5:0/3699332152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc15e0a0 0x7f30dc0d0d50 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 -- 172.21.15.5:0/3699332152 >> 172.21.15.5:0/3699332152 conn(0x7f30dc0668f0 msgr2=0x7f30dc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 -- 172.21.15.5:0/3699332152 shutdown_connections 2024-04-25T09:00:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.331+0000 7f30e0d70640 1 -- 172.21.15.5:0/3699332152 wait complete. 2024-04-25T09:00:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.332+0000 7f30e0d70640 1 Processor -- start 2024-04-25T09:00:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30e0d70640 1 -- start start 2024-04-25T09:00:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30e0d70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc0d3990 0x7f30dc15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30e0d70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc1f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30e0d70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30dc15e0a0 0x7f30dc1f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30e0d70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0d2c00 con 0x7f30dc0d3990 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30e0d70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0d2920 con 0x7f30dc15e0a0 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30e0d70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0d4280 con 0x7f30dc0d3df0 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30da59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc0d3990 0x7f30dc15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30da59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc0d3990 0x7f30dc15cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33044/0 (socket says 172.21.15.5:33044) 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.333+0000 7f30da59c640 1 -- 172.21.15.5:0/2902516720 learned_addr learned my addr 172.21.15.5:0/2902516720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30d9d9b640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc1f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30dad9d640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30dc15e0a0 0x7f30dc1f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30da59c640 1 -- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 msgr2=0x7f30dc1f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30da59c640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc1f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30da59c640 1 -- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30dc15e0a0 msgr2=0x7f30dc1f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30da59c640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30dc15e0a0 0x7f30dc1f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30da59c640 1 -- 172.21.15.5:0/2902516720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc1e7ee0 con 0x7f30dc0d3990 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30dad9d640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30dc15e0a0 0x7f30dc1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30d9d9b640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc1f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30da59c640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc0d3990 0x7f30dc15cd40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f30cc000c00 tx=0x7f30cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30caffd640 1 -- 172.21.15.5:0/2902516720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc037040 con 0x7f30dc0d3990 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30caffd640 1 -- 172.21.15.5:0/2902516720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc042070 con 0x7f30dc0d3990 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc0c8ca0 con 0x7f30dc0d3990 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30caffd640 1 -- 172.21.15.5:0/2902516720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc030a70 con 0x7f30dc0d3990 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.334+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc0c9260 con 0x7f30dc0d3990 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.335+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc04ef20 con 0x7f30dc0d3990 2024-04-25T09:00:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.335+0000 7f30caffd640 1 -- 172.21.15.5:0/2902516720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30cc030c10 con 0x7f30dc0d3990 2024-04-25T09:00:10.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.336+0000 7f30caffd640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30bc06b4d0 0x7f30bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.336+0000 7f30caffd640 1 -- 172.21.15.5:0/2902516720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30cc0aac10 con 0x7f30dc0d3990 2024-04-25T09:00:10.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.336+0000 7f30d9d9b640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30bc06b4d0 0x7f30bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.337+0000 7f30d9d9b640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30bc06b4d0 0x7f30bc06d990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f30dc1f7290 tx=0x7f30d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.340+0000 7f30caffd640 1 -- 172.21.15.5:0/2902516720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30cc045360 con 0x7f30dc0d3990 2024-04-25T09:00:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.520+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30dc0d0830 con 0x7f30bc06b4d0 2024-04-25T09:00:10.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.526+0000 7f30caffd640 1 -- 172.21.15.5:0/2902516720 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246637 (secure 0 0 0) 0x7f30dc0d0830 con 0x7f30bc06b4d0 2024-04-25T09:00:10.518 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:00:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30bc06b4d0 msgr2=0x7f30bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30bc06b4d0 0x7f30bc06d990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f30dc1f7290 tx=0x7f30d0009040 comp rx=0 tx=0).stop 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc0d3990 msgr2=0x7f30dc15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc0d3990 0x7f30dc15cd40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f30cc000c00 tx=0x7f30cc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 shutdown_connections 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30bc06b4d0 0x7f30bc06d990 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30dc15e0a0 0x7f30dc1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30dc0d3df0 0x7f30dc1f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 --2- 172.21.15.5:0/2902516720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30dc0d3990 0x7f30dc15cd40 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 >> 172.21.15.5:0/2902516720 conn(0x7f30dc0668f0 msgr2=0x7f30dc0ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 shutdown_connections 2024-04-25T09:00:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.529+0000 7f30e0d70640 1 -- 172.21.15.5:0/2902516720 wait complete. 2024-04-25T09:00:10.529 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-25T09:00:10.433603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":305624,"kb_used_data":6252,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669096,"statfs":{"total":773094113280,"available":772781154304,"internally_reserved":0,"allocated":6402048,"data_stored":3327529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.252819"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190978+0000","last_change":"2024-04-25T09:00:06.190978+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190978+0000","last_undegraded":"2024-04-25T09:00:06.190978+0000","last_fullsized":"2024-04-25T09:00:06.190978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192596+0000","last_change":"2024-04-25T09:00:06.192596+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192596+0000","last_undegraded":"2024-04-25T09:00:06.192596+0000","last_fullsized":"2024-04-25T09:00:06.192596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187020+0000","last_change":"2024-04-25T09:00:06.187020+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187020+0000","last_undegraded":"2024-04-25T09:00:06.187020+0000","last_fullsized":"2024-04-25T09:00:06.187020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192288+0000","last_change":"2024-04-25T09:00:06.192288+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192288+0000","last_undegraded":"2024-04-25T09:00:06.192288+0000","last_fullsized":"2024-04-25T09:00:06.192288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191450+0000","last_change":"2024-04-25T09:00:06.191450+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191450+0000","last_undegraded":"2024-04-25T09:00:06.191450+0000","last_fullsized":"2024-04-25T09:00:06.191450+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187431+0000","last_change":"2024-04-25T09:00:06.187431+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187431+0000","last_undegraded":"2024-04-25T09:00:06.187431+0000","last_fullsized":"2024-04-25T09:00:06.187431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191331+0000","last_change":"2024-04-25T09:00:06.191331+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191331+0000","last_undegraded":"2024-04-25T09:00:06.191331+0000","last_fullsized":"2024-04-25T09:00:06.191331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192108+0000","last_change":"2024-04-25T09:00:06.192108+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192108+0000","last_undegraded":"2024-04-25T09:00:06.192108+0000","last_fullsized":"2024-04-25T09:00:06.192108+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191505+0000","last_change":"2024-04-25T09:00:06.191505+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191505+0000","last_undegraded":"2024-04-25T09:00:06.191505+0000","last_fullsized":"2024-04-25T09:00:06.191505+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192468+0000","last_change":"2024-04-25T09:00:06.192468+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192468+0000","last_undegraded":"2024-04-25T09:00:06.192468+0000","last_fullsized":"2024-04-25T09:00:06.192468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193470+0000","last_change":"2024-04-25T09:00:06.193470+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193470+0000","last_undegraded":"2024-04-25T09:00:06.193470+0000","last_fullsized":"2024-04-25T09:00:06.193470+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191829+0000","last_change":"2024-04-25T09:00:06.191829+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191829+0000","last_undegraded":"2024-04-25T09:00:06.191829+0000","last_fullsized":"2024-04-25T09:00:06.191829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188629+0000","last_change":"2024-04-25T09:00:06.188629+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188629+0000","last_undegraded":"2024-04-25T09:00:06.188629+0000","last_fullsized":"2024-04-25T09:00:06.188629+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191981+0000","last_change":"2024-04-25T09:00:06.191981+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191981+0000","last_undegraded":"2024-04-25T09:00:06.191981+0000","last_fullsized":"2024-04-25T09:00:06.191981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190813+0000","last_change":"2024-04-25T09:00:06.190813+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190813+0000","last_undegraded":"2024-04-25T09:00:06.190813+0000","last_fullsized":"2024-04-25T09:00:06.190813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188689+0000","last_change":"2024-04-25T09:00:06.188689+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188689+0000","last_undegraded":"2024-04-25T09:00:06.188689+0000","last_fullsized":"2024-04-25T09:00:06.188689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191416+0000","last_change":"2024-04-25T09:00:06.191416+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191416+0000","last_undegraded":"2024-04-25T09:00:06.191416+0000","last_fullsized":"2024-04-25T09:00:06.191416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186660+0000","last_change":"2024-04-25T09:00:06.186660+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186660+0000","last_undegraded":"2024-04-25T09:00:06.186660+0000","last_fullsized":"2024-04-25T09:00:06.186660+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192156+0000","last_change":"2024-04-25T09:00:06.192156+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192156+0000","last_undegraded":"2024-04-25T09:00:06.192156+0000","last_fullsized":"2024-04-25T09:00:06.192156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190935+0000","last_change":"2024-04-25T09:00:06.190935+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190935+0000","last_undegraded":"2024-04-25T09:00:06.190935+0000","last_fullsized":"2024-04-25T09:00:06.190935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187635+0000","last_change":"2024-04-25T09:00:06.187635+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187635+0000","last_undegraded":"2024-04-25T09:00:06.187635+0000","last_fullsized":"2024-04-25T09:00:06.187635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190893+0000","last_change":"2024-04-25T09:00:06.190893+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190893+0000","last_undegraded":"2024-04-25T09:00:06.190893+0000","last_fullsized":"2024-04-25T09:00:06.190893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186918+0000","last_change":"2024-04-25T09:00:06.186918+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186918+0000","last_undegraded":"2024-04-25T09:00:06.186918+0000","last_fullsized":"2024-04-25T09:00:06.186918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189560+0000","last_change":"2024-04-25T09:00:06.189560+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189560+0000","last_undegraded":"2024-04-25T09:00:06.189560+0000","last_fullsized":"2024-04-25T09:00:06.189560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190520+0000","last_change":"2024-04-25T09:00:06.190520+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190520+0000","last_undegraded":"2024-04-25T09:00:06.190520+0000","last_fullsized":"2024-04-25T09:00:06.190520+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191585+0000","last_change":"2024-04-25T09:00:06.191585+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191585+0000","last_undegraded":"2024-04-25T09:00:06.191585+0000","last_fullsized":"2024-04-25T09:00:06.191585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188965+0000","last_change":"2024-04-25T09:00:06.188965+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188965+0000","last_undegraded":"2024-04-25T09:00:06.188965+0000","last_fullsized":"2024-04-25T09:00:06.188965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191888+0000","last_change":"2024-04-25T09:00:06.191888+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191888+0000","last_undegraded":"2024-04-25T09:00:06.191888+0000","last_fullsized":"2024-04-25T09:00:06.191888+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193591+0000","last_change":"2024-04-25T09:00:06.193591+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193591+0000","last_undegraded":"2024-04-25T09:00:06.193591+0000","last_fullsized":"2024-04-25T09:00:06.193591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185906+0000","last_change":"2024-04-25T09:00:06.185906+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185906+0000","last_undegraded":"2024-04-25T09:00:06.185906+0000","last_fullsized":"2024-04-25T09:00:06.185906+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191330+0000","last_change":"2024-04-25T09:00:06.191330+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191330+0000","last_undegraded":"2024-04-25T09:00:06.191330+0000","last_fullsized":"2024-04-25T09:00:06.191330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185852+0000","last_change":"2024-04-25T09:00:06.185852+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185852+0000","last_undegraded":"2024-04-25T09:00:06.185852+0000","last_fullsized":"2024-04-25T09:00:06.185852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188286+0000","last_change":"2024-04-25T09:00:06.188286+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188286+0000","last_undegraded":"2024-04-25T09:00:06.188286+0000","last_fullsized":"2024-04-25T09:00:06.188286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200278+0000","last_change":"2024-04-25T09:00:06.199616+0000","last_active":"2024-04-25T09:00:06.200278+0000","last_peered":"2024-04-25T09:00:06.200278+0000","last_clean":"2024-04-25T09:00:06.200278+0000","last_became_active":"2024-04-25T09:00:06.199305+0000","last_became_peered":"2024-04-25T09:00:06.199305+0000","last_unstale":"2024-04-25T09:00:06.200278+0000","last_undegraded":"2024-04-25T09:00:06.200278+0000","last_fullsized":"2024-04-25T09:00:06.200278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:57.120298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191823+0000","last_change":"2024-04-25T09:00:06.191823+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191823+0000","last_undegraded":"2024-04-25T09:00:06.191823+0000","last_fullsized":"2024-04-25T09:00:06.191823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205473+0000","last_change":"2024-04-25T09:00:06.202408+0000","last_active":"2024-04-25T09:00:06.205473+0000","last_peered":"2024-04-25T09:00:06.205473+0000","last_clean":"2024-04-25T09:00:06.205473+0000","last_became_active":"2024-04-25T09:00:06.200858+0000","last_became_peered":"2024-04-25T09:00:06.200858+0000","last_unstale":"2024-04-25T09:00:06.205473+0000","last_undegraded":"2024-04-25T09:00:06.205473+0000","last_fullsized":"2024-04-25T09:00:06.205473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.891482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186977+0000","last_change":"2024-04-25T09:00:06.186977+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186977+0000","last_undegraded":"2024-04-25T09:00:06.186977+0000","last_fullsized":"2024-04-25T09:00:06.186977+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205129+0000","last_change":"2024-04-25T09:00:06.203421+0000","last_active":"2024-04-25T09:00:06.205129+0000","last_peered":"2024-04-25T09:00:06.205129+0000","last_clean":"2024-04-25T09:00:06.205129+0000","last_became_active":"2024-04-25T09:00:06.203097+0000","last_became_peered":"2024-04-25T09:00:06.203097+0000","last_unstale":"2024-04-25T09:00:06.205129+0000","last_undegraded":"2024-04-25T09:00:06.205129+0000","last_fullsized":"2024-04-25T09:00:06.205129+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:42.364834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187459+0000","last_change":"2024-04-25T09:00:06.187459+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187459+0000","last_undegraded":"2024-04-25T09:00:06.187459+0000","last_fullsized":"2024-04-25T09:00:06.187459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202834+0000","last_change":"2024-04-25T09:00:06.201046+0000","last_active":"2024-04-25T09:00:06.202834+0000","last_peered":"2024-04-25T09:00:06.202834+0000","last_clean":"2024-04-25T09:00:06.202834+0000","last_became_active":"2024-04-25T09:00:06.200765+0000","last_became_peered":"2024-04-25T09:00:06.200765+0000","last_unstale":"2024-04-25T09:00:06.202834+0000","last_undegraded":"2024-04-25T09:00:06.202834+0000","last_fullsized":"2024-04-25T09:00:06.202834+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:43.278902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190415+0000","last_change":"2024-04-25T09:00:06.190415+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190415+0000","last_undegraded":"2024-04-25T09:00:06.190415+0000","last_fullsized":"2024-04-25T09:00:06.190415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199790+0000","last_change":"2024-04-25T09:00:06.198409+0000","last_active":"2024-04-25T09:00:06.199790+0000","last_peered":"2024-04-25T09:00:06.199790+0000","last_clean":"2024-04-25T09:00:06.199790+0000","last_became_active":"2024-04-25T09:00:06.198093+0000","last_became_peered":"2024-04-25T09:00:06.198093+0000","last_unstale":"2024-04-25T09:00:06.199790+0000","last_undegraded":"2024-04-25T09:00:06.199790+0000","last_fullsized":"2024-04-25T09:00:06.199790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193147+0000","last_change":"2024-04-25T09:00:06.193147+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193147+0000","last_undegraded":"2024-04-25T09:00:06.193147+0000","last_fullsized":"2024-04-25T09:00:06.193147+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198833+0000","last_change":"2024-04-25T09:00:06.197490+0000","last_active":"2024-04-25T09:00:06.198833+0000","last_peered":"2024-04-25T09:00:06.198833+0000","last_clean":"2024-04-25T09:00:06.198833+0000","last_became_active":"2024-04-25T09:00:06.196586+0000","last_became_peered":"2024-04-25T09:00:06.196586+0000","last_unstale":"2024-04-25T09:00:06.198833+0000","last_undegraded":"2024-04-25T09:00:06.198833+0000","last_fullsized":"2024-04-25T09:00:06.198833+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188988+0000","last_change":"2024-04-25T09:00:06.188988+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188988+0000","last_undegraded":"2024-04-25T09:00:06.188988+0000","last_fullsized":"2024-04-25T09:00:06.188988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202655+0000","last_change":"2024-04-25T09:00:06.200363+0000","last_active":"2024-04-25T09:00:06.202655+0000","last_peered":"2024-04-25T09:00:06.202655+0000","last_clean":"2024-04-25T09:00:06.202655+0000","last_became_active":"2024-04-25T09:00:06.200060+0000","last_became_peered":"2024-04-25T09:00:06.200060+0000","last_unstale":"2024-04-25T09:00:06.202655+0000","last_undegraded":"2024-04-25T09:00:06.202655+0000","last_fullsized":"2024-04-25T09:00:06.202655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189042+0000","last_change":"2024-04-25T09:00:06.189042+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189042+0000","last_undegraded":"2024-04-25T09:00:06.189042+0000","last_fullsized":"2024-04-25T09:00:06.189042+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205468+0000","last_change":"2024-04-25T09:00:06.203119+0000","last_active":"2024-04-25T09:00:06.205468+0000","last_peered":"2024-04-25T09:00:06.205468+0000","last_clean":"2024-04-25T09:00:06.205468+0000","last_became_active":"2024-04-25T09:00:06.202821+0000","last_became_peered":"2024-04-25T09:00:06.202821+0000","last_unstale":"2024-04-25T09:00:06.205468+0000","last_undegraded":"2024-04-25T09:00:06.205468+0000","last_fullsized":"2024-04-25T09:00:06.205468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191565+0000","last_change":"2024-04-25T09:00:06.191565+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191565+0000","last_undegraded":"2024-04-25T09:00:06.191565+0000","last_fullsized":"2024-04-25T09:00:06.191565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199354+0000","last_change":"2024-04-25T09:00:06.196201+0000","last_active":"2024-04-25T09:00:06.199354+0000","last_peered":"2024-04-25T09:00:06.199354+0000","last_clean":"2024-04-25T09:00:06.199354+0000","last_became_active":"2024-04-25T09:00:06.195618+0000","last_became_peered":"2024-04-25T09:00:06.195618+0000","last_unstale":"2024-04-25T09:00:06.199354+0000","last_undegraded":"2024-04-25T09:00:06.199354+0000","last_fullsized":"2024-04-25T09:00:06.199354+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185892+0000","last_change":"2024-04-25T09:00:06.185892+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185892+0000","last_undegraded":"2024-04-25T09:00:06.185892+0000","last_fullsized":"2024-04-25T09:00:06.185892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205491+0000","last_change":"2024-04-25T09:00:06.203661+0000","last_active":"2024-04-25T09:00:06.205491+0000","last_peered":"2024-04-25T09:00:06.205491+0000","last_clean":"2024-04-25T09:00:06.205491+0000","last_became_active":"2024-04-25T09:00:06.201182+0000","last_became_peered":"2024-04-25T09:00:06.201182+0000","last_unstale":"2024-04-25T09:00:06.205491+0000","last_undegraded":"2024-04-25T09:00:06.205491+0000","last_fullsized":"2024-04-25T09:00:06.205491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:31.994350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190313+0000","last_change":"2024-04-25T09:00:06.190313+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190313+0000","last_undegraded":"2024-04-25T09:00:06.190313+0000","last_fullsized":"2024-04-25T09:00:06.190313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199920+0000","last_change":"2024-04-25T09:00:06.198508+0000","last_active":"2024-04-25T09:00:06.199920+0000","last_peered":"2024-04-25T09:00:06.199920+0000","last_clean":"2024-04-25T09:00:06.199920+0000","last_became_active":"2024-04-25T09:00:06.198162+0000","last_became_peered":"2024-04-25T09:00:06.198162+0000","last_unstale":"2024-04-25T09:00:06.199920+0000","last_undegraded":"2024-04-25T09:00:06.199920+0000","last_fullsized":"2024-04-25T09:00:06.199920+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186579+0000","last_change":"2024-04-25T09:00:06.186579+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186579+0000","last_undegraded":"2024-04-25T09:00:06.186579+0000","last_fullsized":"2024-04-25T09:00:06.186579+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200547+0000","last_change":"2024-04-25T09:00:06.199821+0000","last_active":"2024-04-25T09:00:06.200547+0000","last_peered":"2024-04-25T09:00:06.200547+0000","last_clean":"2024-04-25T09:00:06.200547+0000","last_became_active":"2024-04-25T09:00:06.199310+0000","last_became_peered":"2024-04-25T09:00:06.199310+0000","last_unstale":"2024-04-25T09:00:06.200547+0000","last_undegraded":"2024-04-25T09:00:06.200547+0000","last_fullsized":"2024-04-25T09:00:06.200547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:47.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193479+0000","last_change":"2024-04-25T09:00:06.193479+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193479+0000","last_undegraded":"2024-04-25T09:00:06.193479+0000","last_fullsized":"2024-04-25T09:00:06.193479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205531+0000","last_change":"2024-04-25T09:00:06.202728+0000","last_active":"2024-04-25T09:00:06.205531+0000","last_peered":"2024-04-25T09:00:06.205531+0000","last_clean":"2024-04-25T09:00:06.205531+0000","last_became_active":"2024-04-25T09:00:06.201927+0000","last_became_peered":"2024-04-25T09:00:06.201927+0000","last_unstale":"2024-04-25T09:00:06.205531+0000","last_undegraded":"2024-04-25T09:00:06.205531+0000","last_fullsized":"2024-04-25T09:00:06.205531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:34.685720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186754+0000","last_change":"2024-04-25T09:00:06.186754+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186754+0000","last_undegraded":"2024-04-25T09:00:06.186754+0000","last_fullsized":"2024-04-25T09:00:06.186754+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.195562+0000","last_change":"2024-04-25T09:00:06.193400+0000","last_active":"2024-04-25T09:00:06.195562+0000","last_peered":"2024-04-25T09:00:06.195562+0000","last_clean":"2024-04-25T09:00:06.195562+0000","last_became_active":"2024-04-25T09:00:06.193121+0000","last_became_peered":"2024-04-25T09:00:06.193121+0000","last_unstale":"2024-04-25T09:00:06.195562+0000","last_undegraded":"2024-04-25T09:00:06.195562+0000","last_fullsized":"2024-04-25T09:00:06.195562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:57.093035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.194668+0000","last_change":"2024-04-25T09:00:06.194668+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.194668+0000","last_undegraded":"2024-04-25T09:00:06.194668+0000","last_fullsized":"2024-04-25T09:00:06.194668+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201702+0000","last_change":"2024-04-25T09:00:06.198624+0000","last_active":"2024-04-25T09:00:06.201702+0000","last_peered":"2024-04-25T09:00:06.201702+0000","last_clean":"2024-04-25T09:00:06.201702+0000","last_became_active":"2024-04-25T09:00:06.198238+0000","last_became_peered":"2024-04-25T09:00:06.198238+0000","last_unstale":"2024-04-25T09:00:06.201702+0000","last_undegraded":"2024-04-25T09:00:06.201702+0000","last_fullsized":"2024-04-25T09:00:06.201702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185884+0000","last_change":"2024-04-25T09:00:06.185884+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185884+0000","last_undegraded":"2024-04-25T09:00:06.185884+0000","last_fullsized":"2024-04-25T09:00:06.185884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202443+0000","last_change":"2024-04-25T09:00:06.201475+0000","last_active":"2024-04-25T09:00:06.202443+0000","last_peered":"2024-04-25T09:00:06.202443+0000","last_clean":"2024-04-25T09:00:06.202443+0000","last_became_active":"2024-04-25T09:00:06.201166+0000","last_became_peered":"2024-04-25T09:00:06.201166+0000","last_unstale":"2024-04-25T09:00:06.202443+0000","last_undegraded":"2024-04-25T09:00:06.202443+0000","last_fullsized":"2024-04-25T09:00:06.202443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186231+0000","last_change":"2024-04-25T09:00:06.186231+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186231+0000","last_undegraded":"2024-04-25T09:00:06.186231+0000","last_fullsized":"2024-04-25T09:00:06.186231+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205304+0000","last_change":"2024-04-25T09:00:06.200834+0000","last_active":"2024-04-25T09:00:06.205304+0000","last_peered":"2024-04-25T09:00:06.205304+0000","last_clean":"2024-04-25T09:00:06.205304+0000","last_became_active":"2024-04-25T09:00:06.200467+0000","last_became_peered":"2024-04-25T09:00:06.200467+0000","last_unstale":"2024-04-25T09:00:06.205304+0000","last_undegraded":"2024-04-25T09:00:06.205304+0000","last_fullsized":"2024-04-25T09:00:06.205304+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:28.284535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192889+0000","last_change":"2024-04-25T09:00:06.192889+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192889+0000","last_undegraded":"2024-04-25T09:00:06.192889+0000","last_fullsized":"2024-04-25T09:00:06.192889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199291+0000","last_change":"2024-04-25T09:00:06.197838+0000","last_active":"2024-04-25T09:00:06.199291+0000","last_peered":"2024-04-25T09:00:06.199291+0000","last_clean":"2024-04-25T09:00:06.199291+0000","last_became_active":"2024-04-25T09:00:06.197304+0000","last_became_peered":"2024-04-25T09:00:06.197304+0000","last_unstale":"2024-04-25T09:00:06.199291+0000","last_undegraded":"2024-04-25T09:00:06.199291+0000","last_fullsized":"2024-04-25T09:00:06.199291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189244+0000","last_change":"2024-04-25T09:00:06.189244+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189244+0000","last_undegraded":"2024-04-25T09:00:06.189244+0000","last_fullsized":"2024-04-25T09:00:06.189244+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202574+0000","last_change":"2024-04-25T09:00:06.200257+0000","last_active":"2024-04-25T09:00:06.202574+0000","last_peered":"2024-04-25T09:00:06.202574+0000","last_clean":"2024-04-25T09:00:06.202574+0000","last_became_active":"2024-04-25T09:00:06.199977+0000","last_became_peered":"2024-04-25T09:00:06.199977+0000","last_unstale":"2024-04-25T09:00:06.202574+0000","last_undegraded":"2024-04-25T09:00:06.202574+0000","last_fullsized":"2024-04-25T09:00:06.202574+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186033+0000","last_change":"2024-04-25T09:00:06.186033+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186033+0000","last_undegraded":"2024-04-25T09:00:06.186033+0000","last_fullsized":"2024-04-25T09:00:06.186033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.204537+0000","last_change":"2024-04-25T09:00:06.201254+0000","last_active":"2024-04-25T09:00:06.204537+0000","last_peered":"2024-04-25T09:00:06.204537+0000","last_clean":"2024-04-25T09:00:06.204537+0000","last_became_active":"2024-04-25T09:00:06.200978+0000","last_became_peered":"2024-04-25T09:00:06.200978+0000","last_unstale":"2024-04-25T09:00:06.204537+0000","last_undegraded":"2024-04-25T09:00:06.204537+0000","last_fullsized":"2024-04-25T09:00:06.204537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:23.480824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190853+0000","last_change":"2024-04-25T09:00:06.190853+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190853+0000","last_undegraded":"2024-04-25T09:00:06.190853+0000","last_fullsized":"2024-04-25T09:00:06.190853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205510+0000","last_change":"2024-04-25T09:00:06.202223+0000","last_active":"2024-04-25T09:00:06.205510+0000","last_peered":"2024-04-25T09:00:06.205510+0000","last_clean":"2024-04-25T09:00:06.205510+0000","last_became_active":"2024-04-25T09:00:06.200842+0000","last_became_peered":"2024-04-25T09:00:06.200842+0000","last_unstale":"2024-04-25T09:00:06.205510+0000","last_undegraded":"2024-04-25T09:00:06.205510+0000","last_fullsized":"2024-04-25T09:00:06.205510+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:58.308566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186255+0000","last_change":"2024-04-25T09:00:06.186255+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186255+0000","last_undegraded":"2024-04-25T09:00:06.186255+0000","last_fullsized":"2024-04-25T09:00:06.186255+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202466+0000","last_change":"2024-04-25T09:00:06.196060+0000","last_active":"2024-04-25T09:00:06.202466+0000","last_peered":"2024-04-25T09:00:06.202466+0000","last_clean":"2024-04-25T09:00:06.202466+0000","last_became_active":"2024-04-25T09:00:06.195716+0000","last_became_peered":"2024-04-25T09:00:06.195716+0000","last_unstale":"2024-04-25T09:00:06.202466+0000","last_undegraded":"2024-04-25T09:00:06.202466+0000","last_fullsized":"2024-04-25T09:00:06.202466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:23.177590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185862+0000","last_change":"2024-04-25T09:00:06.185862+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185862+0000","last_undegraded":"2024-04-25T09:00:06.185862+0000","last_fullsized":"2024-04-25T09:00:06.185862+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205803+0000","last_change":"2024-04-25T09:00:06.204013+0000","last_active":"2024-04-25T09:00:06.205803+0000","last_peered":"2024-04-25T09:00:06.205803+0000","last_clean":"2024-04-25T09:00:06.205803+0000","last_became_active":"2024-04-25T09:00:06.203786+0000","last_became_peered":"2024-04-25T09:00:06.203786+0000","last_unstale":"2024-04-25T09:00:06.205803+0000","last_undegraded":"2024-04-25T09:00:06.205803+0000","last_fullsized":"2024-04-25T09:00:06.205803+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:57.421924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191168+0000","last_change":"2024-04-25T09:00:06.191168+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191168+0000","last_undegraded":"2024-04-25T09:00:06.191168+0000","last_fullsized":"2024-04-25T09:00:06.191168+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203908+0000","last_change":"2024-04-25T09:00:06.203068+0000","last_active":"2024-04-25T09:00:06.203908+0000","last_peered":"2024-04-25T09:00:06.203908+0000","last_clean":"2024-04-25T09:00:06.203908+0000","last_became_active":"2024-04-25T09:00:06.202810+0000","last_became_peered":"2024-04-25T09:00:06.202810+0000","last_unstale":"2024-04-25T09:00:06.203908+0000","last_undegraded":"2024-04-25T09:00:06.203908+0000","last_fullsized":"2024-04-25T09:00:06.203908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:21.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192530+0000","last_change":"2024-04-25T09:00:06.192530+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192530+0000","last_undegraded":"2024-04-25T09:00:06.192530+0000","last_fullsized":"2024-04-25T09:00:06.192530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199313+0000","last_change":"2024-04-25T09:00:06.198465+0000","last_active":"2024-04-25T09:00:06.199313+0000","last_peered":"2024-04-25T09:00:06.199313+0000","last_clean":"2024-04-25T09:00:06.199313+0000","last_became_active":"2024-04-25T09:00:06.198180+0000","last_became_peered":"2024-04-25T09:00:06.198180+0000","last_unstale":"2024-04-25T09:00:06.199313+0000","last_undegraded":"2024-04-25T09:00:06.199313+0000","last_fullsized":"2024-04-25T09:00:06.199313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:48.720837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189845+0000","last_change":"2024-04-25T09:00:06.189845+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189845+0000","last_undegraded":"2024-04-25T09:00:06.189845+0000","last_fullsized":"2024-04-25T09:00:06.189845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198645+0000","last_change":"2024-04-25T09:00:06.196940+0000","last_active":"2024-04-25T09:00:06.198645+0000","last_peered":"2024-04-25T09:00:06.198645+0000","last_clean":"2024-04-25T09:00:06.198645+0000","last_became_active":"2024-04-25T09:00:06.196651+0000","last_became_peered":"2024-04-25T09:00:06.196651+0000","last_unstale":"2024-04-25T09:00:06.198645+0000","last_undegraded":"2024-04-25T09:00:06.198645+0000","last_fullsized":"2024-04-25T09:00:06.198645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:25.280084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187024+0000","last_change":"2024-04-25T09:00:06.187024+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187024+0000","last_undegraded":"2024-04-25T09:00:06.187024+0000","last_fullsized":"2024-04-25T09:00:06.187024+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202853+0000","last_change":"2024-04-25T09:00:06.201200+0000","last_active":"2024-04-25T09:00:06.202853+0000","last_peered":"2024-04-25T09:00:06.202853+0000","last_clean":"2024-04-25T09:00:06.202853+0000","last_became_active":"2024-04-25T09:00:06.200924+0000","last_became_peered":"2024-04-25T09:00:06.200924+0000","last_unstale":"2024-04-25T09:00:06.202853+0000","last_undegraded":"2024-04-25T09:00:06.202853+0000","last_fullsized":"2024-04-25T09:00:06.202853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.391108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189728+0000","last_change":"2024-04-25T09:00:06.189728+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189728+0000","last_undegraded":"2024-04-25T09:00:06.189728+0000","last_fullsized":"2024-04-25T09:00:06.189728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203581+0000","last_change":"2024-04-25T09:00:06.199594+0000","last_active":"2024-04-25T09:00:06.203581+0000","last_peered":"2024-04-25T09:00:06.203581+0000","last_clean":"2024-04-25T09:00:06.203581+0000","last_became_active":"2024-04-25T09:00:06.199318+0000","last_became_peered":"2024-04-25T09:00:06.199318+0000","last_unstale":"2024-04-25T09:00:06.203581+0000","last_undegraded":"2024-04-25T09:00:06.203581+0000","last_fullsized":"2024-04-25T09:00:06.203581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:01.451638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186083+0000","last_change":"2024-04-25T09:00:06.186083+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186083+0000","last_undegraded":"2024-04-25T09:00:06.186083+0000","last_fullsized":"2024-04-25T09:00:06.186083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201694+0000","last_change":"2024-04-25T09:00:06.199988+0000","last_active":"2024-04-25T09:00:06.201694+0000","last_peered":"2024-04-25T09:00:06.201694+0000","last_clean":"2024-04-25T09:00:06.201694+0000","last_became_active":"2024-04-25T09:00:06.199325+0000","last_became_peered":"2024-04-25T09:00:06.199325+0000","last_unstale":"2024-04-25T09:00:06.201694+0000","last_undegraded":"2024-04-25T09:00:06.201694+0000","last_fullsized":"2024-04-25T09:00:06.201694+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188555+0000","last_change":"2024-04-25T09:00:06.188555+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188555+0000","last_undegraded":"2024-04-25T09:00:06.188555+0000","last_fullsized":"2024-04-25T09:00:06.188555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202384+0000","last_change":"2024-04-25T09:00:06.195158+0000","last_active":"2024-04-25T09:00:06.202384+0000","last_peered":"2024-04-25T09:00:06.202384+0000","last_clean":"2024-04-25T09:00:06.202384+0000","last_became_active":"2024-04-25T09:00:06.194854+0000","last_became_peered":"2024-04-25T09:00:06.194854+0000","last_unstale":"2024-04-25T09:00:06.202384+0000","last_undegraded":"2024-04-25T09:00:06.202384+0000","last_fullsized":"2024-04-25T09:00:06.202384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:34.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188439+0000","last_change":"2024-04-25T09:00:06.188439+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188439+0000","last_undegraded":"2024-04-25T09:00:06.188439+0000","last_fullsized":"2024-04-25T09:00:06.188439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205335+0000","last_change":"2024-04-25T09:00:06.202020+0000","last_active":"2024-04-25T09:00:06.205335+0000","last_peered":"2024-04-25T09:00:06.205335+0000","last_clean":"2024-04-25T09:00:06.205335+0000","last_became_active":"2024-04-25T09:00:06.201586+0000","last_became_peered":"2024-04-25T09:00:06.201586+0000","last_unstale":"2024-04-25T09:00:06.205335+0000","last_undegraded":"2024-04-25T09:00:06.205335+0000","last_fullsized":"2024-04-25T09:00:06.205335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:07.176226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188477+0000","last_change":"2024-04-25T09:00:06.188477+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188477+0000","last_undegraded":"2024-04-25T09:00:06.188477+0000","last_fullsized":"2024-04-25T09:00:06.188477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201954+0000","last_change":"2024-04-25T09:00:06.200265+0000","last_active":"2024-04-25T09:00:06.201954+0000","last_peered":"2024-04-25T09:00:06.201954+0000","last_clean":"2024-04-25T09:00:06.201954+0000","last_became_active":"2024-04-25T09:00:06.199932+0000","last_became_peered":"2024-04-25T09:00:06.199932+0000","last_unstale":"2024-04-25T09:00:06.201954+0000","last_undegraded":"2024-04-25T09:00:06.201954+0000","last_fullsized":"2024-04-25T09:00:06.201954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:36.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.188288+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:00:06.188288+0000","last_peered":"2024-04-25T09:00:06.188288+0000","last_clean":"2024-04-25T09:00:06.188288+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:00:06.188288+0000","last_undegraded":"2024-04-25T09:00:06.188288+0000","last_fullsized":"2024-04-25T09:00:06.188288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1253376,"data_stored":862634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44292,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327548,"statfs":{"total":96636764160,"available":96591409152,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1241088,"data_stored":856367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:00:10.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:00:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.682+0000 7fdc28b9e640 1 Processor -- start 2024-04-25T09:00:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.682+0000 7fdc28b9e640 1 -- start start 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc28b9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc2415de70 0x7fdc240b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc28b9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc240ce7f0 0x7fdc240cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc28b9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240cf1c0 con 0x7fdc240b2cc0 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc28b9e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240d2a10 con 0x7fdc240ce7f0 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc28b9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240d20e0 con 0x7fdc2415de70 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc22d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc240ce7f0 0x7fdc240cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc21d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdc240b2cc0 0x7fdc240b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54016/0 (socket says 172.21.15.5:54016) 2024-04-25T09:00:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc21d9b640 1 -- 172.21.15.5:0/3618017519 learned_addr learned my addr 172.21.15.5:0/3618017519 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc2259c640 1 --2- 172.21.15.5:0/3618017519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc2415de70 0x7fdc240b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc22d9d640 1 -- 172.21.15.5:0/3618017519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc2415de70 msgr2=0x7fdc240b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc22d9d640 1 --2- 172.21.15.5:0/3618017519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc2415de70 0x7fdc240b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc22d9d640 1 -- 172.21.15.5:0/3618017519 >> v1:172.21.15.5:6789/0 conn(0x7fdc240b2cc0 legacy=0x7fdc240b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc22d9d640 1 -- 172.21.15.5:0/3618017519 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240d23c0 con 0x7fdc240ce7f0 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.683+0000 7fdc2159a640 1 -- 172.21.15.5:0/3618017519 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961192412 0 0) 0x7fdc240cf1c0 con 0x7fdc240b2cc0 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.684+0000 7fdc22d9d640 1 --2- 172.21.15.5:0/3618017519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240ce7f0 0x7fdc240cec80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009d90 tx=0x7fdc1402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e52a21fecda9430 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.684+0000 7fdc2159a640 1 -- 172.21.15.5:0/3618017519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14007740 con 0x7fdc240ce7f0 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.684+0000 7fdc2159a640 1 -- 172.21.15.5:0/3618017519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc140078e0 con 0x7fdc240ce7f0 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.684+0000 7fdc2159a640 1 -- 172.21.15.5:0/3618017519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14007cb0 con 0x7fdc240ce7f0 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.684+0000 7fdc28b9e640 1 -- 172.21.15.5:0/3618017519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240ce7f0 msgr2=0x7fdc240cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.684+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/3618017519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240ce7f0 0x7fdc240cec80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009d90 tx=0x7fdc1402a660 comp rx=0 tx=0).stop 2024-04-25T09:00:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.685+0000 7fdc28b9e640 1 -- 172.21.15.5:0/3618017519 shutdown_connections 2024-04-25T09:00:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.685+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/3618017519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240ce7f0 0x7fdc240cec80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.685+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/3618017519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc2415de70 0x7fdc240b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.685+0000 7fdc28b9e640 1 -- 172.21.15.5:0/3618017519 >> 172.21.15.5:0/3618017519 conn(0x7fdc2406b000 msgr2=0x7fdc2406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.685+0000 7fdc28b9e640 1 -- 172.21.15.5:0/3618017519 shutdown_connections 2024-04-25T09:00:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.685+0000 7fdc28b9e640 1 -- 172.21.15.5:0/3618017519 wait complete. 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.686+0000 7fdc28b9e640 1 Processor -- start 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.686+0000 7fdc28b9e640 1 -- start start 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc28b9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240b2cc0 0x7fdc240b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc28b9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc240ce7f0 0x7fdc240cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc28b9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc2415de70 0x7fdc24152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc28b9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b7300 con 0x7fdc240b2cc0 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc28b9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b9920 con 0x7fdc2415de70 2024-04-25T09:00:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc28b9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240d2ea0 con 0x7fdc240ce7f0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240b2cc0 0x7fdc240b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240b2cc0 0x7fdc240b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33062/0 (socket says 172.21.15.5:33062) 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 -- 172.21.15.5:0/1899350048 learned_addr learned my addr 172.21.15.5:0/1899350048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc22d9d640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc2415de70 0x7fdc24152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc21d9b640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc240ce7f0 0x7fdc240cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 -- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc240ce7f0 msgr2=0x7fdc240cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc240ce7f0 0x7fdc240cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 -- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc2415de70 msgr2=0x7fdc24152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc2415de70 0x7fdc24152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 -- 172.21.15.5:0/1899350048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240b49a0 con 0x7fdc240b2cc0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc2259c640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240b2cc0 0x7fdc240b5a40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00e870 tx=0x7fdc1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc1affd640 1 -- 172.21.15.5:0/1899350048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c017070 con 0x7fdc240b2cc0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.687+0000 7fdc1affd640 1 -- 172.21.15.5:0/1899350048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c00c940 con 0x7fdc240b2cc0 2024-04-25T09:00:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.688+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240b4c80 con 0x7fdc240b2cc0 2024-04-25T09:00:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.688+0000 7fdc1affd640 1 -- 172.21.15.5:0/1899350048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00cd30 con 0x7fdc240b2cc0 2024-04-25T09:00:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.688+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc240b5240 con 0x7fdc240b2cc0 2024-04-25T09:00:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.689+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2404ef20 con 0x7fdc240b2cc0 2024-04-25T09:00:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.689+0000 7fdc1affd640 1 -- 172.21.15.5:0/1899350048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc1c01a070 con 0x7fdc240b2cc0 2024-04-25T09:00:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.689+0000 7fdc1affd640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdc0406b4d0 0x7fdc0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.690+0000 7fdc1affd640 1 -- 172.21.15.5:0/1899350048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc1c08a3f0 con 0x7fdc240b2cc0 2024-04-25T09:00:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.690+0000 7fdc21d9b640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdc0406b4d0 0x7fdc0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.690+0000 7fdc21d9b640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdc0406b4d0 0x7fdc0406d990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007fd0 tx=0x7fdc0c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.694+0000 7fdc1affd640 1 -- 172.21.15.5:0/1899350048 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc1c059300 con 0x7fdc240b2cc0 2024-04-25T09:00:10.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.870+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc24156fa0 con 0x7fdc0406b4d0 2024-04-25T09:00:10.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.876+0000 7fdc1affd640 1 -- 172.21.15.5:0/1899350048 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246637 (secure 0 0 0) 0x7fdc24156fa0 con 0x7fdc0406b4d0 2024-04-25T09:00:10.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdc0406b4d0 msgr2=0x7fdc0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdc0406b4d0 0x7fdc0406d990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007fd0 tx=0x7fdc0c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240b2cc0 msgr2=0x7fdc240b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240b2cc0 0x7fdc240b5a40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00e870 tx=0x7fdc1c00ed30 comp rx=0 tx=0).stop 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 shutdown_connections 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdc0406b4d0 0x7fdc0406d990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc2415de70 0x7fdc24152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdc240ce7f0 0x7fdc240cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 --2- 172.21.15.5:0/1899350048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc240b2cc0 0x7fdc240b5a40 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 >> 172.21.15.5:0/1899350048 conn(0x7fdc2406b000 msgr2=0x7fdc240b8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:10.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 shutdown_connections 2024-04-25T09:00:10.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:10.879+0000 7fdc28b9e640 1 -- 172.21.15.5:0/1899350048 wait complete. 2024-04-25T09:00:10.879 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-25T09:00:10.433603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":305624,"kb_used_data":6252,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669096,"statfs":{"total":773094113280,"available":772781154304,"internally_reserved":0,"allocated":6402048,"data_stored":3327529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.252819"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190978+0000","last_change":"2024-04-25T09:00:06.190978+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190978+0000","last_undegraded":"2024-04-25T09:00:06.190978+0000","last_fullsized":"2024-04-25T09:00:06.190978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192596+0000","last_change":"2024-04-25T09:00:06.192596+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192596+0000","last_undegraded":"2024-04-25T09:00:06.192596+0000","last_fullsized":"2024-04-25T09:00:06.192596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187020+0000","last_change":"2024-04-25T09:00:06.187020+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187020+0000","last_undegraded":"2024-04-25T09:00:06.187020+0000","last_fullsized":"2024-04-25T09:00:06.187020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192288+0000","last_change":"2024-04-25T09:00:06.192288+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192288+0000","last_undegraded":"2024-04-25T09:00:06.192288+0000","last_fullsized":"2024-04-25T09:00:06.192288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191450+0000","last_change":"2024-04-25T09:00:06.191450+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191450+0000","last_undegraded":"2024-04-25T09:00:06.191450+0000","last_fullsized":"2024-04-25T09:00:06.191450+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187431+0000","last_change":"2024-04-25T09:00:06.187431+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187431+0000","last_undegraded":"2024-04-25T09:00:06.187431+0000","last_fullsized":"2024-04-25T09:00:06.187431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191331+0000","last_change":"2024-04-25T09:00:06.191331+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191331+0000","last_undegraded":"2024-04-25T09:00:06.191331+0000","last_fullsized":"2024-04-25T09:00:06.191331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192108+0000","last_change":"2024-04-25T09:00:06.192108+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192108+0000","last_undegraded":"2024-04-25T09:00:06.192108+0000","last_fullsized":"2024-04-25T09:00:06.192108+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191505+0000","last_change":"2024-04-25T09:00:06.191505+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191505+0000","last_undegraded":"2024-04-25T09:00:06.191505+0000","last_fullsized":"2024-04-25T09:00:06.191505+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192468+0000","last_change":"2024-04-25T09:00:06.192468+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192468+0000","last_undegraded":"2024-04-25T09:00:06.192468+0000","last_fullsized":"2024-04-25T09:00:06.192468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193470+0000","last_change":"2024-04-25T09:00:06.193470+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193470+0000","last_undegraded":"2024-04-25T09:00:06.193470+0000","last_fullsized":"2024-04-25T09:00:06.193470+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191829+0000","last_change":"2024-04-25T09:00:06.191829+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191829+0000","last_undegraded":"2024-04-25T09:00:06.191829+0000","last_fullsized":"2024-04-25T09:00:06.191829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188629+0000","last_change":"2024-04-25T09:00:06.188629+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188629+0000","last_undegraded":"2024-04-25T09:00:06.188629+0000","last_fullsized":"2024-04-25T09:00:06.188629+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191981+0000","last_change":"2024-04-25T09:00:06.191981+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191981+0000","last_undegraded":"2024-04-25T09:00:06.191981+0000","last_fullsized":"2024-04-25T09:00:06.191981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190813+0000","last_change":"2024-04-25T09:00:06.190813+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190813+0000","last_undegraded":"2024-04-25T09:00:06.190813+0000","last_fullsized":"2024-04-25T09:00:06.190813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188689+0000","last_change":"2024-04-25T09:00:06.188689+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188689+0000","last_undegraded":"2024-04-25T09:00:06.188689+0000","last_fullsized":"2024-04-25T09:00:06.188689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191416+0000","last_change":"2024-04-25T09:00:06.191416+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191416+0000","last_undegraded":"2024-04-25T09:00:06.191416+0000","last_fullsized":"2024-04-25T09:00:06.191416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186660+0000","last_change":"2024-04-25T09:00:06.186660+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186660+0000","last_undegraded":"2024-04-25T09:00:06.186660+0000","last_fullsized":"2024-04-25T09:00:06.186660+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192156+0000","last_change":"2024-04-25T09:00:06.192156+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192156+0000","last_undegraded":"2024-04-25T09:00:06.192156+0000","last_fullsized":"2024-04-25T09:00:06.192156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190935+0000","last_change":"2024-04-25T09:00:06.190935+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190935+0000","last_undegraded":"2024-04-25T09:00:06.190935+0000","last_fullsized":"2024-04-25T09:00:06.190935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187635+0000","last_change":"2024-04-25T09:00:06.187635+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187635+0000","last_undegraded":"2024-04-25T09:00:06.187635+0000","last_fullsized":"2024-04-25T09:00:06.187635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190893+0000","last_change":"2024-04-25T09:00:06.190893+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190893+0000","last_undegraded":"2024-04-25T09:00:06.190893+0000","last_fullsized":"2024-04-25T09:00:06.190893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186918+0000","last_change":"2024-04-25T09:00:06.186918+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186918+0000","last_undegraded":"2024-04-25T09:00:06.186918+0000","last_fullsized":"2024-04-25T09:00:06.186918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189560+0000","last_change":"2024-04-25T09:00:06.189560+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189560+0000","last_undegraded":"2024-04-25T09:00:06.189560+0000","last_fullsized":"2024-04-25T09:00:06.189560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190520+0000","last_change":"2024-04-25T09:00:06.190520+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190520+0000","last_undegraded":"2024-04-25T09:00:06.190520+0000","last_fullsized":"2024-04-25T09:00:06.190520+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191585+0000","last_change":"2024-04-25T09:00:06.191585+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191585+0000","last_undegraded":"2024-04-25T09:00:06.191585+0000","last_fullsized":"2024-04-25T09:00:06.191585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188965+0000","last_change":"2024-04-25T09:00:06.188965+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188965+0000","last_undegraded":"2024-04-25T09:00:06.188965+0000","last_fullsized":"2024-04-25T09:00:06.188965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191888+0000","last_change":"2024-04-25T09:00:06.191888+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191888+0000","last_undegraded":"2024-04-25T09:00:06.191888+0000","last_fullsized":"2024-04-25T09:00:06.191888+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193591+0000","last_change":"2024-04-25T09:00:06.193591+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193591+0000","last_undegraded":"2024-04-25T09:00:06.193591+0000","last_fullsized":"2024-04-25T09:00:06.193591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185906+0000","last_change":"2024-04-25T09:00:06.185906+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185906+0000","last_undegraded":"2024-04-25T09:00:06.185906+0000","last_fullsized":"2024-04-25T09:00:06.185906+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191330+0000","last_change":"2024-04-25T09:00:06.191330+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191330+0000","last_undegraded":"2024-04-25T09:00:06.191330+0000","last_fullsized":"2024-04-25T09:00:06.191330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185852+0000","last_change":"2024-04-25T09:00:06.185852+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185852+0000","last_undegraded":"2024-04-25T09:00:06.185852+0000","last_fullsized":"2024-04-25T09:00:06.185852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188286+0000","last_change":"2024-04-25T09:00:06.188286+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188286+0000","last_undegraded":"2024-04-25T09:00:06.188286+0000","last_fullsized":"2024-04-25T09:00:06.188286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200278+0000","last_change":"2024-04-25T09:00:06.199616+0000","last_active":"2024-04-25T09:00:06.200278+0000","last_peered":"2024-04-25T09:00:06.200278+0000","last_clean":"2024-04-25T09:00:06.200278+0000","last_became_active":"2024-04-25T09:00:06.199305+0000","last_became_peered":"2024-04-25T09:00:06.199305+0000","last_unstale":"2024-04-25T09:00:06.200278+0000","last_undegraded":"2024-04-25T09:00:06.200278+0000","last_fullsized":"2024-04-25T09:00:06.200278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:57.120298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191823+0000","last_change":"2024-04-25T09:00:06.191823+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191823+0000","last_undegraded":"2024-04-25T09:00:06.191823+0000","last_fullsized":"2024-04-25T09:00:06.191823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205473+0000","last_change":"2024-04-25T09:00:06.202408+0000","last_active":"2024-04-25T09:00:06.205473+0000","last_peered":"2024-04-25T09:00:06.205473+0000","last_clean":"2024-04-25T09:00:06.205473+0000","last_became_active":"2024-04-25T09:00:06.200858+0000","last_became_peered":"2024-04-25T09:00:06.200858+0000","last_unstale":"2024-04-25T09:00:06.205473+0000","last_undegraded":"2024-04-25T09:00:06.205473+0000","last_fullsized":"2024-04-25T09:00:06.205473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.891482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186977+0000","last_change":"2024-04-25T09:00:06.186977+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186977+0000","last_undegraded":"2024-04-25T09:00:06.186977+0000","last_fullsized":"2024-04-25T09:00:06.186977+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205129+0000","last_change":"2024-04-25T09:00:06.203421+0000","last_active":"2024-04-25T09:00:06.205129+0000","last_peered":"2024-04-25T09:00:06.205129+0000","last_clean":"2024-04-25T09:00:06.205129+0000","last_became_active":"2024-04-25T09:00:06.203097+0000","last_became_peered":"2024-04-25T09:00:06.203097+0000","last_unstale":"2024-04-25T09:00:06.205129+0000","last_undegraded":"2024-04-25T09:00:06.205129+0000","last_fullsized":"2024-04-25T09:00:06.205129+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:42.364834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187459+0000","last_change":"2024-04-25T09:00:06.187459+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187459+0000","last_undegraded":"2024-04-25T09:00:06.187459+0000","last_fullsized":"2024-04-25T09:00:06.187459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202834+0000","last_change":"2024-04-25T09:00:06.201046+0000","last_active":"2024-04-25T09:00:06.202834+0000","last_peered":"2024-04-25T09:00:06.202834+0000","last_clean":"2024-04-25T09:00:06.202834+0000","last_became_active":"2024-04-25T09:00:06.200765+0000","last_became_peered":"2024-04-25T09:00:06.200765+0000","last_unstale":"2024-04-25T09:00:06.202834+0000","last_undegraded":"2024-04-25T09:00:06.202834+0000","last_fullsized":"2024-04-25T09:00:06.202834+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:43.278902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190415+0000","last_change":"2024-04-25T09:00:06.190415+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190415+0000","last_undegraded":"2024-04-25T09:00:06.190415+0000","last_fullsized":"2024-04-25T09:00:06.190415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199790+0000","last_change":"2024-04-25T09:00:06.198409+0000","last_active":"2024-04-25T09:00:06.199790+0000","last_peered":"2024-04-25T09:00:06.199790+0000","last_clean":"2024-04-25T09:00:06.199790+0000","last_became_active":"2024-04-25T09:00:06.198093+0000","last_became_peered":"2024-04-25T09:00:06.198093+0000","last_unstale":"2024-04-25T09:00:06.199790+0000","last_undegraded":"2024-04-25T09:00:06.199790+0000","last_fullsized":"2024-04-25T09:00:06.199790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193147+0000","last_change":"2024-04-25T09:00:06.193147+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193147+0000","last_undegraded":"2024-04-25T09:00:06.193147+0000","last_fullsized":"2024-04-25T09:00:06.193147+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198833+0000","last_change":"2024-04-25T09:00:06.197490+0000","last_active":"2024-04-25T09:00:06.198833+0000","last_peered":"2024-04-25T09:00:06.198833+0000","last_clean":"2024-04-25T09:00:06.198833+0000","last_became_active":"2024-04-25T09:00:06.196586+0000","last_became_peered":"2024-04-25T09:00:06.196586+0000","last_unstale":"2024-04-25T09:00:06.198833+0000","last_undegraded":"2024-04-25T09:00:06.198833+0000","last_fullsized":"2024-04-25T09:00:06.198833+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188988+0000","last_change":"2024-04-25T09:00:06.188988+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188988+0000","last_undegraded":"2024-04-25T09:00:06.188988+0000","last_fullsized":"2024-04-25T09:00:06.188988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202655+0000","last_change":"2024-04-25T09:00:06.200363+0000","last_active":"2024-04-25T09:00:06.202655+0000","last_peered":"2024-04-25T09:00:06.202655+0000","last_clean":"2024-04-25T09:00:06.202655+0000","last_became_active":"2024-04-25T09:00:06.200060+0000","last_became_peered":"2024-04-25T09:00:06.200060+0000","last_unstale":"2024-04-25T09:00:06.202655+0000","last_undegraded":"2024-04-25T09:00:06.202655+0000","last_fullsized":"2024-04-25T09:00:06.202655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189042+0000","last_change":"2024-04-25T09:00:06.189042+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189042+0000","last_undegraded":"2024-04-25T09:00:06.189042+0000","last_fullsized":"2024-04-25T09:00:06.189042+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205468+0000","last_change":"2024-04-25T09:00:06.203119+0000","last_active":"2024-04-25T09:00:06.205468+0000","last_peered":"2024-04-25T09:00:06.205468+0000","last_clean":"2024-04-25T09:00:06.205468+0000","last_became_active":"2024-04-25T09:00:06.202821+0000","last_became_peered":"2024-04-25T09:00:06.202821+0000","last_unstale":"2024-04-25T09:00:06.205468+0000","last_undegraded":"2024-04-25T09:00:06.205468+0000","last_fullsized":"2024-04-25T09:00:06.205468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191565+0000","last_change":"2024-04-25T09:00:06.191565+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191565+0000","last_undegraded":"2024-04-25T09:00:06.191565+0000","last_fullsized":"2024-04-25T09:00:06.191565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199354+0000","last_change":"2024-04-25T09:00:06.196201+0000","last_active":"2024-04-25T09:00:06.199354+0000","last_peered":"2024-04-25T09:00:06.199354+0000","last_clean":"2024-04-25T09:00:06.199354+0000","last_became_active":"2024-04-25T09:00:06.195618+0000","last_became_peered":"2024-04-25T09:00:06.195618+0000","last_unstale":"2024-04-25T09:00:06.199354+0000","last_undegraded":"2024-04-25T09:00:06.199354+0000","last_fullsized":"2024-04-25T09:00:06.199354+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185892+0000","last_change":"2024-04-25T09:00:06.185892+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185892+0000","last_undegraded":"2024-04-25T09:00:06.185892+0000","last_fullsized":"2024-04-25T09:00:06.185892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205491+0000","last_change":"2024-04-25T09:00:06.203661+0000","last_active":"2024-04-25T09:00:06.205491+0000","last_peered":"2024-04-25T09:00:06.205491+0000","last_clean":"2024-04-25T09:00:06.205491+0000","last_became_active":"2024-04-25T09:00:06.201182+0000","last_became_peered":"2024-04-25T09:00:06.201182+0000","last_unstale":"2024-04-25T09:00:06.205491+0000","last_undegraded":"2024-04-25T09:00:06.205491+0000","last_fullsized":"2024-04-25T09:00:06.205491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:31.994350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190313+0000","last_change":"2024-04-25T09:00:06.190313+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190313+0000","last_undegraded":"2024-04-25T09:00:06.190313+0000","last_fullsized":"2024-04-25T09:00:06.190313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199920+0000","last_change":"2024-04-25T09:00:06.198508+0000","last_active":"2024-04-25T09:00:06.199920+0000","last_peered":"2024-04-25T09:00:06.199920+0000","last_clean":"2024-04-25T09:00:06.199920+0000","last_became_active":"2024-04-25T09:00:06.198162+0000","last_became_peered":"2024-04-25T09:00:06.198162+0000","last_unstale":"2024-04-25T09:00:06.199920+0000","last_undegraded":"2024-04-25T09:00:06.199920+0000","last_fullsized":"2024-04-25T09:00:06.199920+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186579+0000","last_change":"2024-04-25T09:00:06.186579+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186579+0000","last_undegraded":"2024-04-25T09:00:06.186579+0000","last_fullsized":"2024-04-25T09:00:06.186579+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200547+0000","last_change":"2024-04-25T09:00:06.199821+0000","last_active":"2024-04-25T09:00:06.200547+0000","last_peered":"2024-04-25T09:00:06.200547+0000","last_clean":"2024-04-25T09:00:06.200547+0000","last_became_active":"2024-04-25T09:00:06.199310+0000","last_became_peered":"2024-04-25T09:00:06.199310+0000","last_unstale":"2024-04-25T09:00:06.200547+0000","last_undegraded":"2024-04-25T09:00:06.200547+0000","last_fullsized":"2024-04-25T09:00:06.200547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:47.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193479+0000","last_change":"2024-04-25T09:00:06.193479+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193479+0000","last_undegraded":"2024-04-25T09:00:06.193479+0000","last_fullsized":"2024-04-25T09:00:06.193479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205531+0000","last_change":"2024-04-25T09:00:06.202728+0000","last_active":"2024-04-25T09:00:06.205531+0000","last_peered":"2024-04-25T09:00:06.205531+0000","last_clean":"2024-04-25T09:00:06.205531+0000","last_became_active":"2024-04-25T09:00:06.201927+0000","last_became_peered":"2024-04-25T09:00:06.201927+0000","last_unstale":"2024-04-25T09:00:06.205531+0000","last_undegraded":"2024-04-25T09:00:06.205531+0000","last_fullsized":"2024-04-25T09:00:06.205531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:34.685720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186754+0000","last_change":"2024-04-25T09:00:06.186754+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186754+0000","last_undegraded":"2024-04-25T09:00:06.186754+0000","last_fullsized":"2024-04-25T09:00:06.186754+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.195562+0000","last_change":"2024-04-25T09:00:06.193400+0000","last_active":"2024-04-25T09:00:06.195562+0000","last_peered":"2024-04-25T09:00:06.195562+0000","last_clean":"2024-04-25T09:00:06.195562+0000","last_became_active":"2024-04-25T09:00:06.193121+0000","last_became_peered":"2024-04-25T09:00:06.193121+0000","last_unstale":"2024-04-25T09:00:06.195562+0000","last_undegraded":"2024-04-25T09:00:06.195562+0000","last_fullsized":"2024-04-25T09:00:06.195562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:57.093035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.194668+0000","last_change":"2024-04-25T09:00:06.194668+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.194668+0000","last_undegraded":"2024-04-25T09:00:06.194668+0000","last_fullsized":"2024-04-25T09:00:06.194668+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201702+0000","last_change":"2024-04-25T09:00:06.198624+0000","last_active":"2024-04-25T09:00:06.201702+0000","last_peered":"2024-04-25T09:00:06.201702+0000","last_clean":"2024-04-25T09:00:06.201702+0000","last_became_active":"2024-04-25T09:00:06.198238+0000","last_became_peered":"2024-04-25T09:00:06.198238+0000","last_unstale":"2024-04-25T09:00:06.201702+0000","last_undegraded":"2024-04-25T09:00:06.201702+0000","last_fullsized":"2024-04-25T09:00:06.201702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185884+0000","last_change":"2024-04-25T09:00:06.185884+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185884+0000","last_undegraded":"2024-04-25T09:00:06.185884+0000","last_fullsized":"2024-04-25T09:00:06.185884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202443+0000","last_change":"2024-04-25T09:00:06.201475+0000","last_active":"2024-04-25T09:00:06.202443+0000","last_peered":"2024-04-25T09:00:06.202443+0000","last_clean":"2024-04-25T09:00:06.202443+0000","last_became_active":"2024-04-25T09:00:06.201166+0000","last_became_peered":"2024-04-25T09:00:06.201166+0000","last_unstale":"2024-04-25T09:00:06.202443+0000","last_undegraded":"2024-04-25T09:00:06.202443+0000","last_fullsized":"2024-04-25T09:00:06.202443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186231+0000","last_change":"2024-04-25T09:00:06.186231+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186231+0000","last_undegraded":"2024-04-25T09:00:06.186231+0000","last_fullsized":"2024-04-25T09:00:06.186231+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205304+0000","last_change":"2024-04-25T09:00:06.200834+0000","last_active":"2024-04-25T09:00:06.205304+0000","last_peered":"2024-04-25T09:00:06.205304+0000","last_clean":"2024-04-25T09:00:06.205304+0000","last_became_active":"2024-04-25T09:00:06.200467+0000","last_became_peered":"2024-04-25T09:00:06.200467+0000","last_unstale":"2024-04-25T09:00:06.205304+0000","last_undegraded":"2024-04-25T09:00:06.205304+0000","last_fullsized":"2024-04-25T09:00:06.205304+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:28.284535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192889+0000","last_change":"2024-04-25T09:00:06.192889+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192889+0000","last_undegraded":"2024-04-25T09:00:06.192889+0000","last_fullsized":"2024-04-25T09:00:06.192889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199291+0000","last_change":"2024-04-25T09:00:06.197838+0000","last_active":"2024-04-25T09:00:06.199291+0000","last_peered":"2024-04-25T09:00:06.199291+0000","last_clean":"2024-04-25T09:00:06.199291+0000","last_became_active":"2024-04-25T09:00:06.197304+0000","last_became_peered":"2024-04-25T09:00:06.197304+0000","last_unstale":"2024-04-25T09:00:06.199291+0000","last_undegraded":"2024-04-25T09:00:06.199291+0000","last_fullsized":"2024-04-25T09:00:06.199291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189244+0000","last_change":"2024-04-25T09:00:06.189244+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189244+0000","last_undegraded":"2024-04-25T09:00:06.189244+0000","last_fullsized":"2024-04-25T09:00:06.189244+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202574+0000","last_change":"2024-04-25T09:00:06.200257+0000","last_active":"2024-04-25T09:00:06.202574+0000","last_peered":"2024-04-25T09:00:06.202574+0000","last_clean":"2024-04-25T09:00:06.202574+0000","last_became_active":"2024-04-25T09:00:06.199977+0000","last_became_peered":"2024-04-25T09:00:06.199977+0000","last_unstale":"2024-04-25T09:00:06.202574+0000","last_undegraded":"2024-04-25T09:00:06.202574+0000","last_fullsized":"2024-04-25T09:00:06.202574+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186033+0000","last_change":"2024-04-25T09:00:06.186033+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186033+0000","last_undegraded":"2024-04-25T09:00:06.186033+0000","last_fullsized":"2024-04-25T09:00:06.186033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.204537+0000","last_change":"2024-04-25T09:00:06.201254+0000","last_active":"2024-04-25T09:00:06.204537+0000","last_peered":"2024-04-25T09:00:06.204537+0000","last_clean":"2024-04-25T09:00:06.204537+0000","last_became_active":"2024-04-25T09:00:06.200978+0000","last_became_peered":"2024-04-25T09:00:06.200978+0000","last_unstale":"2024-04-25T09:00:06.204537+0000","last_undegraded":"2024-04-25T09:00:06.204537+0000","last_fullsized":"2024-04-25T09:00:06.204537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:23.480824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190853+0000","last_change":"2024-04-25T09:00:06.190853+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190853+0000","last_undegraded":"2024-04-25T09:00:06.190853+0000","last_fullsized":"2024-04-25T09:00:06.190853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205510+0000","last_change":"2024-04-25T09:00:06.202223+0000","last_active":"2024-04-25T09:00:06.205510+0000","last_peered":"2024-04-25T09:00:06.205510+0000","last_clean":"2024-04-25T09:00:06.205510+0000","last_became_active":"2024-04-25T09:00:06.200842+0000","last_became_peered":"2024-04-25T09:00:06.200842+0000","last_unstale":"2024-04-25T09:00:06.205510+0000","last_undegraded":"2024-04-25T09:00:06.205510+0000","last_fullsized":"2024-04-25T09:00:06.205510+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:58.308566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186255+0000","last_change":"2024-04-25T09:00:06.186255+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186255+0000","last_undegraded":"2024-04-25T09:00:06.186255+0000","last_fullsized":"2024-04-25T09:00:06.186255+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202466+0000","last_change":"2024-04-25T09:00:06.196060+0000","last_active":"2024-04-25T09:00:06.202466+0000","last_peered":"2024-04-25T09:00:06.202466+0000","last_clean":"2024-04-25T09:00:06.202466+0000","last_became_active":"2024-04-25T09:00:06.195716+0000","last_became_peered":"2024-04-25T09:00:06.195716+0000","last_unstale":"2024-04-25T09:00:06.202466+0000","last_undegraded":"2024-04-25T09:00:06.202466+0000","last_fullsized":"2024-04-25T09:00:06.202466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:23.177590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185862+0000","last_change":"2024-04-25T09:00:06.185862+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185862+0000","last_undegraded":"2024-04-25T09:00:06.185862+0000","last_fullsized":"2024-04-25T09:00:06.185862+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205803+0000","last_change":"2024-04-25T09:00:06.204013+0000","last_active":"2024-04-25T09:00:06.205803+0000","last_peered":"2024-04-25T09:00:06.205803+0000","last_clean":"2024-04-25T09:00:06.205803+0000","last_became_active":"2024-04-25T09:00:06.203786+0000","last_became_peered":"2024-04-25T09:00:06.203786+0000","last_unstale":"2024-04-25T09:00:06.205803+0000","last_undegraded":"2024-04-25T09:00:06.205803+0000","last_fullsized":"2024-04-25T09:00:06.205803+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:57.421924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191168+0000","last_change":"2024-04-25T09:00:06.191168+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191168+0000","last_undegraded":"2024-04-25T09:00:06.191168+0000","last_fullsized":"2024-04-25T09:00:06.191168+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203908+0000","last_change":"2024-04-25T09:00:06.203068+0000","last_active":"2024-04-25T09:00:06.203908+0000","last_peered":"2024-04-25T09:00:06.203908+0000","last_clean":"2024-04-25T09:00:06.203908+0000","last_became_active":"2024-04-25T09:00:06.202810+0000","last_became_peered":"2024-04-25T09:00:06.202810+0000","last_unstale":"2024-04-25T09:00:06.203908+0000","last_undegraded":"2024-04-25T09:00:06.203908+0000","last_fullsized":"2024-04-25T09:00:06.203908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:21.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192530+0000","last_change":"2024-04-25T09:00:06.192530+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192530+0000","last_undegraded":"2024-04-25T09:00:06.192530+0000","last_fullsized":"2024-04-25T09:00:06.192530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199313+0000","last_change":"2024-04-25T09:00:06.198465+0000","last_active":"2024-04-25T09:00:06.199313+0000","last_peered":"2024-04-25T09:00:06.199313+0000","last_clean":"2024-04-25T09:00:06.199313+0000","last_became_active":"2024-04-25T09:00:06.198180+0000","last_became_peered":"2024-04-25T09:00:06.198180+0000","last_unstale":"2024-04-25T09:00:06.199313+0000","last_undegraded":"2024-04-25T09:00:06.199313+0000","last_fullsized":"2024-04-25T09:00:06.199313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:48.720837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189845+0000","last_change":"2024-04-25T09:00:06.189845+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189845+0000","last_undegraded":"2024-04-25T09:00:06.189845+0000","last_fullsized":"2024-04-25T09:00:06.189845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198645+0000","last_change":"2024-04-25T09:00:06.196940+0000","last_active":"2024-04-25T09:00:06.198645+0000","last_peered":"2024-04-25T09:00:06.198645+0000","last_clean":"2024-04-25T09:00:06.198645+0000","last_became_active":"2024-04-25T09:00:06.196651+0000","last_became_peered":"2024-04-25T09:00:06.196651+0000","last_unstale":"2024-04-25T09:00:06.198645+0000","last_undegraded":"2024-04-25T09:00:06.198645+0000","last_fullsized":"2024-04-25T09:00:06.198645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:25.280084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187024+0000","last_change":"2024-04-25T09:00:06.187024+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187024+0000","last_undegraded":"2024-04-25T09:00:06.187024+0000","last_fullsized":"2024-04-25T09:00:06.187024+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202853+0000","last_change":"2024-04-25T09:00:06.201200+0000","last_active":"2024-04-25T09:00:06.202853+0000","last_peered":"2024-04-25T09:00:06.202853+0000","last_clean":"2024-04-25T09:00:06.202853+0000","last_became_active":"2024-04-25T09:00:06.200924+0000","last_became_peered":"2024-04-25T09:00:06.200924+0000","last_unstale":"2024-04-25T09:00:06.202853+0000","last_undegraded":"2024-04-25T09:00:06.202853+0000","last_fullsized":"2024-04-25T09:00:06.202853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.391108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189728+0000","last_change":"2024-04-25T09:00:06.189728+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189728+0000","last_undegraded":"2024-04-25T09:00:06.189728+0000","last_fullsized":"2024-04-25T09:00:06.189728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203581+0000","last_change":"2024-04-25T09:00:06.199594+0000","last_active":"2024-04-25T09:00:06.203581+0000","last_peered":"2024-04-25T09:00:06.203581+0000","last_clean":"2024-04-25T09:00:06.203581+0000","last_became_active":"2024-04-25T09:00:06.199318+0000","last_became_peered":"2024-04-25T09:00:06.199318+0000","last_unstale":"2024-04-25T09:00:06.203581+0000","last_undegraded":"2024-04-25T09:00:06.203581+0000","last_fullsized":"2024-04-25T09:00:06.203581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:01.451638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186083+0000","last_change":"2024-04-25T09:00:06.186083+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186083+0000","last_undegraded":"2024-04-25T09:00:06.186083+0000","last_fullsized":"2024-04-25T09:00:06.186083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201694+0000","last_change":"2024-04-25T09:00:06.199988+0000","last_active":"2024-04-25T09:00:06.201694+0000","last_peered":"2024-04-25T09:00:06.201694+0000","last_clean":"2024-04-25T09:00:06.201694+0000","last_became_active":"2024-04-25T09:00:06.199325+0000","last_became_peered":"2024-04-25T09:00:06.199325+0000","last_unstale":"2024-04-25T09:00:06.201694+0000","last_undegraded":"2024-04-25T09:00:06.201694+0000","last_fullsized":"2024-04-25T09:00:06.201694+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188555+0000","last_change":"2024-04-25T09:00:06.188555+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188555+0000","last_undegraded":"2024-04-25T09:00:06.188555+0000","last_fullsized":"2024-04-25T09:00:06.188555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202384+0000","last_change":"2024-04-25T09:00:06.195158+0000","last_active":"2024-04-25T09:00:06.202384+0000","last_peered":"2024-04-25T09:00:06.202384+0000","last_clean":"2024-04-25T09:00:06.202384+0000","last_became_active":"2024-04-25T09:00:06.194854+0000","last_became_peered":"2024-04-25T09:00:06.194854+0000","last_unstale":"2024-04-25T09:00:06.202384+0000","last_undegraded":"2024-04-25T09:00:06.202384+0000","last_fullsized":"2024-04-25T09:00:06.202384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:34.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188439+0000","last_change":"2024-04-25T09:00:06.188439+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188439+0000","last_undegraded":"2024-04-25T09:00:06.188439+0000","last_fullsized":"2024-04-25T09:00:06.188439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205335+0000","last_change":"2024-04-25T09:00:06.202020+0000","last_active":"2024-04-25T09:00:06.205335+0000","last_peered":"2024-04-25T09:00:06.205335+0000","last_clean":"2024-04-25T09:00:06.205335+0000","last_became_active":"2024-04-25T09:00:06.201586+0000","last_became_peered":"2024-04-25T09:00:06.201586+0000","last_unstale":"2024-04-25T09:00:06.205335+0000","last_undegraded":"2024-04-25T09:00:06.205335+0000","last_fullsized":"2024-04-25T09:00:06.205335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:07.176226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188477+0000","last_change":"2024-04-25T09:00:06.188477+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188477+0000","last_undegraded":"2024-04-25T09:00:06.188477+0000","last_fullsized":"2024-04-25T09:00:06.188477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201954+0000","last_change":"2024-04-25T09:00:06.200265+0000","last_active":"2024-04-25T09:00:06.201954+0000","last_peered":"2024-04-25T09:00:06.201954+0000","last_clean":"2024-04-25T09:00:06.201954+0000","last_became_active":"2024-04-25T09:00:06.199932+0000","last_became_peered":"2024-04-25T09:00:06.199932+0000","last_unstale":"2024-04-25T09:00:06.201954+0000","last_undegraded":"2024-04-25T09:00:06.201954+0000","last_fullsized":"2024-04-25T09:00:06.201954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:36.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.188288+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:00:06.188288+0000","last_peered":"2024-04-25T09:00:06.188288+0000","last_clean":"2024-04-25T09:00:06.188288+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:00:06.188288+0000","last_undegraded":"2024-04-25T09:00:06.188288+0000","last_fullsized":"2024-04-25T09:00:06.188288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1253376,"data_stored":862634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44292,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327548,"statfs":{"total":96636764160,"available":96591409152,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1241088,"data_stored":856367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:00:10.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-04-25T09:00:10.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190978+0000', 'last_change': '2024-04-25T09:00:06.190978+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190978+0000', 'last_undegraded': '2024-04-25T09:00:06.190978+0000', 'last_fullsized': '2024-04-25T09:00:06.190978+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.192596+0000', 'last_change': '2024-04-25T09:00:06.192596+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.192596+0000', 'last_undegraded': '2024-04-25T09:00:06.192596+0000', 'last_fullsized': '2024-04-25T09:00:06.192596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.187020+0000', 'last_change': '2024-04-25T09:00:06.187020+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.187020+0000', 'last_undegraded': '2024-04-25T09:00:06.187020+0000', 'last_fullsized': '2024-04-25T09:00:06.187020+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.192288+0000', 'last_change': '2024-04-25T09:00:06.192288+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.192288+0000', 'last_undegraded': '2024-04-25T09:00:06.192288+0000', 'last_fullsized': '2024-04-25T09:00:06.192288+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191450+0000', 'last_change': '2024-04-25T09:00:06.191450+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191450+0000', 'last_undegraded': '2024-04-25T09:00:06.191450+0000', 'last_fullsized': '2024-04-25T09:00:06.191450+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-04-25T09:00:10.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.187431+0000', 'last_change': '2024-04-25T09:00:06.187431+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.187431+0000', 'last_undegraded': '2024-04-25T09:00:06.187431+0000', 'last_fullsized': '2024-04-25T09:00:06.187431+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191331+0000', 'last_change': '2024-04-25T09:00:06.191331+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191331+0000', 'last_undegraded': '2024-04-25T09:00:06.191331+0000', 'last_fullsized': '2024-04-25T09:00:06.191331+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.192108+0000', 'last_change': '2024-04-25T09:00:06.192108+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.192108+0000', 'last_undegraded': '2024-04-25T09:00:06.192108+0000', 'last_fullsized': '2024-04-25T09:00:06.192108+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191505+0000', 'last_change': '2024-04-25T09:00:06.191505+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191505+0000', 'last_undegraded': '2024-04-25T09:00:06.191505+0000', 'last_fullsized': '2024-04-25T09:00:06.191505+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.192468+0000', 'last_change': '2024-04-25T09:00:06.192468+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.192468+0000', 'last_undegraded': '2024-04-25T09:00:06.192468+0000', 'last_fullsized': '2024-04-25T09:00:06.192468+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-04-25T09:00:10.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.193470+0000', 'last_change': '2024-04-25T09:00:06.193470+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.193470+0000', 'last_undegraded': '2024-04-25T09:00:06.193470+0000', 'last_fullsized': '2024-04-25T09:00:06.193470+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191829+0000', 'last_change': '2024-04-25T09:00:06.191829+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191829+0000', 'last_undegraded': '2024-04-25T09:00:06.191829+0000', 'last_fullsized': '2024-04-25T09:00:06.191829+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188629+0000', 'last_change': '2024-04-25T09:00:06.188629+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188629+0000', 'last_undegraded': '2024-04-25T09:00:06.188629+0000', 'last_fullsized': '2024-04-25T09:00:06.188629+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191981+0000', 'last_change': '2024-04-25T09:00:06.191981+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191981+0000', 'last_undegraded': '2024-04-25T09:00:06.191981+0000', 'last_fullsized': '2024-04-25T09:00:06.191981+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190813+0000', 'last_change': '2024-04-25T09:00:06.190813+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190813+0000', 'last_undegraded': '2024-04-25T09:00:06.190813+0000', 'last_fullsized': '2024-04-25T09:00:06.190813+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-04-25T09:00:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188689+0000', 'last_change': '2024-04-25T09:00:06.188689+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188689+0000', 'last_undegraded': '2024-04-25T09:00:06.188689+0000', 'last_fullsized': '2024-04-25T09:00:06.188689+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191416+0000', 'last_change': '2024-04-25T09:00:06.191416+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191416+0000', 'last_undegraded': '2024-04-25T09:00:06.191416+0000', 'last_fullsized': '2024-04-25T09:00:06.191416+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186660+0000', 'last_change': '2024-04-25T09:00:06.186660+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186660+0000', 'last_undegraded': '2024-04-25T09:00:06.186660+0000', 'last_fullsized': '2024-04-25T09:00:06.186660+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.192156+0000', 'last_change': '2024-04-25T09:00:06.192156+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.192156+0000', 'last_undegraded': '2024-04-25T09:00:06.192156+0000', 'last_fullsized': '2024-04-25T09:00:06.192156+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190935+0000', 'last_change': '2024-04-25T09:00:06.190935+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190935+0000', 'last_undegraded': '2024-04-25T09:00:06.190935+0000', 'last_fullsized': '2024-04-25T09:00:06.190935+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.187635+0000', 'last_change': '2024-04-25T09:00:06.187635+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.187635+0000', 'last_undegraded': '2024-04-25T09:00:06.187635+0000', 'last_fullsized': '2024-04-25T09:00:06.187635+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-04-25T09:00:10.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190893+0000', 'last_change': '2024-04-25T09:00:06.190893+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190893+0000', 'last_undegraded': '2024-04-25T09:00:06.190893+0000', 'last_fullsized': '2024-04-25T09:00:06.190893+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-04-25T09:00:10.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186918+0000', 'last_change': '2024-04-25T09:00:06.186918+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186918+0000', 'last_undegraded': '2024-04-25T09:00:06.186918+0000', 'last_fullsized': '2024-04-25T09:00:06.186918+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-04-25T09:00:10.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.189560+0000', 'last_change': '2024-04-25T09:00:06.189560+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.189560+0000', 'last_undegraded': '2024-04-25T09:00:06.189560+0000', 'last_fullsized': '2024-04-25T09:00:06.189560+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:00:10.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-04-25T09:00:10.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190520+0000', 'last_change': '2024-04-25T09:00:06.190520+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190520+0000', 'last_undegraded': '2024-04-25T09:00:06.190520+0000', 'last_fullsized': '2024-04-25T09:00:06.190520+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191585+0000', 'last_change': '2024-04-25T09:00:06.191585+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191585+0000', 'last_undegraded': '2024-04-25T09:00:06.191585+0000', 'last_fullsized': '2024-04-25T09:00:06.191585+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188965+0000', 'last_change': '2024-04-25T09:00:06.188965+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188965+0000', 'last_undegraded': '2024-04-25T09:00:06.188965+0000', 'last_fullsized': '2024-04-25T09:00:06.188965+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191888+0000', 'last_change': '2024-04-25T09:00:06.191888+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191888+0000', 'last_undegraded': '2024-04-25T09:00:06.191888+0000', 'last_fullsized': '2024-04-25T09:00:06.191888+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.193591+0000', 'last_change': '2024-04-25T09:00:06.193591+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.193591+0000', 'last_undegraded': '2024-04-25T09:00:06.193591+0000', 'last_fullsized': '2024-04-25T09:00:06.193591+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-04-25T09:00:10.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.185906+0000', 'last_change': '2024-04-25T09:00:06.185906+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.185906+0000', 'last_undegraded': '2024-04-25T09:00:06.185906+0000', 'last_fullsized': '2024-04-25T09:00:06.185906+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191330+0000', 'last_change': '2024-04-25T09:00:06.191330+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191330+0000', 'last_undegraded': '2024-04-25T09:00:06.191330+0000', 'last_fullsized': '2024-04-25T09:00:06.191330+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.185852+0000', 'last_change': '2024-04-25T09:00:06.185852+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.185852+0000', 'last_undegraded': '2024-04-25T09:00:06.185852+0000', 'last_fullsized': '2024-04-25T09:00:06.185852+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188286+0000', 'last_change': '2024-04-25T09:00:06.188286+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188286+0000', 'last_undegraded': '2024-04-25T09:00:06.188286+0000', 'last_fullsized': '2024-04-25T09:00:06.188286+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191823+0000', 'last_change': '2024-04-25T09:00:06.191823+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191823+0000', 'last_undegraded': '2024-04-25T09:00:06.191823+0000', 'last_fullsized': '2024-04-25T09:00:06.191823+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:00:10.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186977+0000', 'last_change': '2024-04-25T09:00:06.186977+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186977+0000', 'last_undegraded': '2024-04-25T09:00:06.186977+0000', 'last_fullsized': '2024-04-25T09:00:06.186977+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.187459+0000', 'last_change': '2024-04-25T09:00:06.187459+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.187459+0000', 'last_undegraded': '2024-04-25T09:00:06.187459+0000', 'last_fullsized': '2024-04-25T09:00:06.187459+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190415+0000', 'last_change': '2024-04-25T09:00:06.190415+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190415+0000', 'last_undegraded': '2024-04-25T09:00:06.190415+0000', 'last_fullsized': '2024-04-25T09:00:06.190415+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.193147+0000', 'last_change': '2024-04-25T09:00:06.193147+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.193147+0000', 'last_undegraded': '2024-04-25T09:00:06.193147+0000', 'last_fullsized': '2024-04-25T09:00:06.193147+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188988+0000', 'last_change': '2024-04-25T09:00:06.188988+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188988+0000', 'last_undegraded': '2024-04-25T09:00:06.188988+0000', 'last_fullsized': '2024-04-25T09:00:06.188988+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:00:10.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.189042+0000', 'last_change': '2024-04-25T09:00:06.189042+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.189042+0000', 'last_undegraded': '2024-04-25T09:00:06.189042+0000', 'last_fullsized': '2024-04-25T09:00:06.189042+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191565+0000', 'last_change': '2024-04-25T09:00:06.191565+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191565+0000', 'last_undegraded': '2024-04-25T09:00:06.191565+0000', 'last_fullsized': '2024-04-25T09:00:06.191565+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.185892+0000', 'last_change': '2024-04-25T09:00:06.185892+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.185892+0000', 'last_undegraded': '2024-04-25T09:00:06.185892+0000', 'last_fullsized': '2024-04-25T09:00:06.185892+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190313+0000', 'last_change': '2024-04-25T09:00:06.190313+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190313+0000', 'last_undegraded': '2024-04-25T09:00:06.190313+0000', 'last_fullsized': '2024-04-25T09:00:06.190313+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186579+0000', 'last_change': '2024-04-25T09:00:06.186579+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186579+0000', 'last_undegraded': '2024-04-25T09:00:06.186579+0000', 'last_fullsized': '2024-04-25T09:00:06.186579+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-04-25T09:00:10.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.193479+0000', 'last_change': '2024-04-25T09:00:06.193479+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.193479+0000', 'last_undegraded': '2024-04-25T09:00:06.193479+0000', 'last_fullsized': '2024-04-25T09:00:06.193479+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186754+0000', 'last_change': '2024-04-25T09:00:06.186754+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186754+0000', 'last_undegraded': '2024-04-25T09:00:06.186754+0000', 'last_fullsized': '2024-04-25T09:00:06.186754+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.194668+0000', 'last_change': '2024-04-25T09:00:06.194668+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.194668+0000', 'last_undegraded': '2024-04-25T09:00:06.194668+0000', 'last_fullsized': '2024-04-25T09:00:06.194668+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.185884+0000', 'last_change': '2024-04-25T09:00:06.185884+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.185884+0000', 'last_undegraded': '2024-04-25T09:00:06.185884+0000', 'last_fullsized': '2024-04-25T09:00:06.185884+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186231+0000', 'last_change': '2024-04-25T09:00:06.186231+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186231+0000', 'last_undegraded': '2024-04-25T09:00:06.186231+0000', 'last_fullsized': '2024-04-25T09:00:06.186231+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.192889+0000', 'last_change': '2024-04-25T09:00:06.192889+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.192889+0000', 'last_undegraded': '2024-04-25T09:00:06.192889+0000', 'last_fullsized': '2024-04-25T09:00:06.192889+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.189244+0000', 'last_change': '2024-04-25T09:00:06.189244+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.189244+0000', 'last_undegraded': '2024-04-25T09:00:06.189244+0000', 'last_fullsized': '2024-04-25T09:00:06.189244+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186033+0000', 'last_change': '2024-04-25T09:00:06.186033+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186033+0000', 'last_undegraded': '2024-04-25T09:00:06.186033+0000', 'last_fullsized': '2024-04-25T09:00:06.186033+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.190853+0000', 'last_change': '2024-04-25T09:00:06.190853+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.190853+0000', 'last_undegraded': '2024-04-25T09:00:06.190853+0000', 'last_fullsized': '2024-04-25T09:00:06.190853+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186255+0000', 'last_change': '2024-04-25T09:00:06.186255+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186255+0000', 'last_undegraded': '2024-04-25T09:00:06.186255+0000', 'last_fullsized': '2024-04-25T09:00:06.186255+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.185862+0000', 'last_change': '2024-04-25T09:00:06.185862+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.185862+0000', 'last_undegraded': '2024-04-25T09:00:06.185862+0000', 'last_fullsized': '2024-04-25T09:00:06.185862+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.191168+0000', 'last_change': '2024-04-25T09:00:06.191168+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.191168+0000', 'last_undegraded': '2024-04-25T09:00:06.191168+0000', 'last_fullsized': '2024-04-25T09:00:06.191168+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.192530+0000', 'last_change': '2024-04-25T09:00:06.192530+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.192530+0000', 'last_undegraded': '2024-04-25T09:00:06.192530+0000', 'last_fullsized': '2024-04-25T09:00:06.192530+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.189845+0000', 'last_change': '2024-04-25T09:00:06.189845+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.189845+0000', 'last_undegraded': '2024-04-25T09:00:06.189845+0000', 'last_fullsized': '2024-04-25T09:00:06.189845+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.187024+0000', 'last_change': '2024-04-25T09:00:06.187024+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.187024+0000', 'last_undegraded': '2024-04-25T09:00:06.187024+0000', 'last_fullsized': '2024-04-25T09:00:06.187024+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:00:10.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.189728+0000', 'last_change': '2024-04-25T09:00:06.189728+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.189728+0000', 'last_undegraded': '2024-04-25T09:00:06.189728+0000', 'last_fullsized': '2024-04-25T09:00:06.189728+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.186083+0000', 'last_change': '2024-04-25T09:00:06.186083+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.186083+0000', 'last_undegraded': '2024-04-25T09:00:06.186083+0000', 'last_fullsized': '2024-04-25T09:00:06.186083+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188555+0000', 'last_change': '2024-04-25T09:00:06.188555+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188555+0000', 'last_undegraded': '2024-04-25T09:00:06.188555+0000', 'last_fullsized': '2024-04-25T09:00:06.188555+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188439+0000', 'last_change': '2024-04-25T09:00:06.188439+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188439+0000', 'last_undegraded': '2024-04-25T09:00:06.188439+0000', 'last_fullsized': '2024-04-25T09:00:06.188439+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-04-25T09:00:10.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:00:06.188477+0000', 'last_change': '2024-04-25T09:00:06.188477+0000', 'last_active': '2024-04-25T09:00:06.180030+0000', 'last_peered': '2024-04-25T09:00:06.180030+0000', 'last_clean': '2024-04-25T09:00:06.180030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:00:06.188477+0000', 'last_undegraded': '2024-04-25T09:00:06.188477+0000', 'last_fullsized': '2024-04-25T09:00:06.188477+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'last_clean_scrub_stamp': '2024-04-25T09:00:06.180030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:00:10.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:00:11.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.030+0000 7fe15e15c640 1 Processor -- start 2024-04-25T09:00:11.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.030+0000 7fe15e15c640 1 -- start start 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe15e15c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe158154f10 0x7fe1580b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe15e15c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe1580cfc90 0x7fe158070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe15e15c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1580b3f30 con 0x7fe15815bbd0 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe15e15c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15815b0f0 con 0x7fe1580cfc90 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe15e15c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15815b3d0 con 0x7fe158154f10 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe156ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe15815bbd0 0x7fe1580cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49902/0 (socket says 172.21.15.5:49902) 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe156ffd640 1 -- 172.21.15.5:0/254056422 learned_addr learned my addr 172.21.15.5:0/254056422 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe1577fe640 1 --2- 172.21.15.5:0/254056422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe158154f10 0x7fe1580b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe157fff640 1 --2- 172.21.15.5:0/254056422 >> v2:172.21.15.80:3300/0 conn(0x7fe1580cfc90 0x7fe158070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.031+0000 7fe1567fc640 1 -- 172.21.15.5:0/254056422 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290517832 0 0) 0x7fe1580b3f30 con 0x7fe15815bbd0 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.032+0000 7fe1567fc640 1 -- 172.21.15.5:0/254056422 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe140003520 con 0x7fe15815bbd0 2024-04-25T09:00:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.032+0000 7fe1577fe640 1 -- 172.21.15.5:0/254056422 >> v2:172.21.15.80:3300/0 conn(0x7fe1580cfc90 msgr2=0x7fe158070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.032+0000 7fe1577fe640 1 --2- 172.21.15.5:0/254056422 >> v2:172.21.15.80:3300/0 conn(0x7fe1580cfc90 0x7fe158070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.032+0000 7fe1577fe640 1 -- 172.21.15.5:0/254056422 >> v1:172.21.15.5:6789/0 conn(0x7fe15815bbd0 legacy=0x7fe1580cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.032+0000 7fe1577fe640 1 -- 172.21.15.5:0/254056422 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1581552f0 con 0x7fe158154f10 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.032+0000 7fe157fff640 1 --2- 172.21.15.5:0/254056422 >> v2:172.21.15.80:3300/0 conn(0x7fe1580cfc90 0x7fe158070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.032+0000 7fe1577fe640 1 --2- 172.21.15.5:0/254056422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe158154f10 0x7fe1580b3470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1480097a0 tx=0x7fe14802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fb93da11616ee62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe1567fc640 1 -- 172.21.15.5:0/254056422 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148037070 con 0x7fe158154f10 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe1567fc640 1 -- 172.21.15.5:0/254056422 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14802ae50 con 0x7fe158154f10 2024-04-25T09:00:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe1567fc640 1 -- 172.21.15.5:0/254056422 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148032640 con 0x7fe158154f10 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 -- 172.21.15.5:0/254056422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe158154f10 msgr2=0x7fe1580b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 --2- 172.21.15.5:0/254056422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe158154f10 0x7fe1580b3470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1480097a0 tx=0x7fe14802a100 comp rx=0 tx=0).stop 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 -- 172.21.15.5:0/254056422 shutdown_connections 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 --2- 172.21.15.5:0/254056422 >> v2:172.21.15.80:3300/0 conn(0x7fe1580cfc90 0x7fe158070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 --2- 172.21.15.5:0/254056422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe158154f10 0x7fe1580b3470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 -- 172.21.15.5:0/254056422 >> 172.21.15.5:0/254056422 conn(0x7fe1580668f0 msgr2=0x7fe158066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 -- 172.21.15.5:0/254056422 shutdown_connections 2024-04-25T09:00:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.033+0000 7fe15e15c640 1 -- 172.21.15.5:0/254056422 wait complete. 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.034+0000 7fe15e15c640 1 Processor -- start 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe15e15c640 1 -- start start 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe15e15c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1580cfc90 0x7fe158144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe15e15c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe158154f10 0x7fe15815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe15e15c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15815bbd0 0x7fe15815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe15e15c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b3b30 con 0x7fe15815bbd0 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe15e15c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b39b0 con 0x7fe158154f10 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe15e15c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b3cb0 con 0x7fe1580cfc90 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe157fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15815bbd0 0x7fe15815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe157fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15815bbd0 0x7fe15815a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38650/0 (socket says 172.21.15.5:38650) 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.035+0000 7fe157fff640 1 -- 172.21.15.5:0/573265391 learned_addr learned my addr 172.21.15.5:0/573265391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe156ffd640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe158154f10 0x7fe15815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe1577fe640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1580cfc90 0x7fe158144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe157fff640 1 -- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1580cfc90 msgr2=0x7fe158144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe157fff640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1580cfc90 0x7fe158144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe157fff640 1 -- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe158154f10 msgr2=0x7fe15815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe157fff640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe158154f10 0x7fe15815a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe157fff640 1 -- 172.21.15.5:0/573265391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580c47c0 con 0x7fe15815bbd0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe157fff640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15815bbd0 0x7fe15815a8d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe15000ef90 tx=0x7fe150009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe13ffff640 1 -- 172.21.15.5:0/573265391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150018020 con 0x7fe15815bbd0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe13ffff640 1 -- 172.21.15.5:0/573265391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150014480 con 0x7fe15815bbd0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1580c4aa0 con 0x7fe15815bbd0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe13ffff640 1 -- 172.21.15.5:0/573265391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150014870 con 0x7fe15815bbd0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.036+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1580c5060 con 0x7fe15815bbd0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.037+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe158067200 con 0x7fe15815bbd0 2024-04-25T09:00:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.038+0000 7fe13ffff640 1 -- 172.21.15.5:0/573265391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe150005d10 con 0x7fe15815bbd0 2024-04-25T09:00:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.038+0000 7fe13ffff640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe14406b4d0 0x7fe14406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.038+0000 7fe13ffff640 1 -- 172.21.15.5:0/573265391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe15008aeb0 con 0x7fe15815bbd0 2024-04-25T09:00:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.038+0000 7fe1577fe640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe14406b4d0 0x7fe14406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.039+0000 7fe1577fe640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe14406b4d0 0x7fe14406d990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe148034000 tx=0x7fe14802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.042+0000 7fe13ffff640 1 -- 172.21.15.5:0/573265391 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe158067200 con 0x7fe15815bbd0 2024-04-25T09:00:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.293+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe1580b4990 con 0x7fe15815bbd0 2024-04-25T09:00:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.294+0000 7fe13ffff640 1 -- 172.21.15.5:0/573265391 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1454 (secure 0 0 0) 0x7fe150022030 con 0x7fe15815bbd0 2024-04-25T09:00:11.283 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:11.283 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":231,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":312958976,"bytes_avail":772781154304,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6495}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-04-25T08:59:56.430483+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe14406b4d0 msgr2=0x7fe14406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe14406b4d0 0x7fe14406d990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe148034000 tx=0x7fe14802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15815bbd0 msgr2=0x7fe15815a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15815bbd0 0x7fe15815a8d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe15000ef90 tx=0x7fe150009f90 comp rx=0 tx=0).stop 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 shutdown_connections 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe14406b4d0 0x7fe14406d990 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15815bbd0 0x7fe15815a8d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe158154f10 0x7fe15815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.295+0000 7fe15e15c640 1 --2- 172.21.15.5:0/573265391 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1580cfc90 0x7fe158144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.296+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 >> 172.21.15.5:0/573265391 conn(0x7fe1580668f0 msgr2=0x7fe158072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.296+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 shutdown_connections 2024-04-25T09:00:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.296+0000 7fe15e15c640 1 -- 172.21.15.5:0/573265391 wait complete. 2024-04-25T09:00:11.296 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:00:11.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:00:11.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.408+0000 7f00f8a9c640 1 Processor -- start 2024-04-25T09:00:11.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.408+0000 7f00f8a9c640 1 -- start start 2024-04-25T09:00:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f8a9c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f415de70 0x7f00f40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f8a9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00f40ce7f0 0x7f00f40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f8a9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40cf1c0 con 0x7f00f40b2cc0 2024-04-25T09:00:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f8a9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40d2a10 con 0x7f00f40ce7f0 2024-04-25T09:00:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f8a9c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40d20e0 con 0x7f00f415de70 2024-04-25T09:00:11.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00f40ce7f0 0x7f00f40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00ebfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f00f40b2cc0 0x7f00f40b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49912/0 (socket says 172.21.15.5:49912) 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00ebfff640 1 -- 172.21.15.5:0/990041034 learned_addr learned my addr 172.21.15.5:0/990041034 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f259c640 1 --2- 172.21.15.5:0/990041034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f415de70 0x7f00f40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f2d9d640 1 -- 172.21.15.5:0/990041034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f415de70 msgr2=0x7f00f40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f2d9d640 1 --2- 172.21.15.5:0/990041034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f415de70 0x7f00f40b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f2d9d640 1 -- 172.21.15.5:0/990041034 >> v1:172.21.15.5:6789/0 conn(0x7f00f40b2cc0 legacy=0x7f00f40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f1d9b640 1 -- 172.21.15.5:0/990041034 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193660406 0 0) 0x7f00f40cf1c0 con 0x7f00f40b2cc0 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f2d9d640 1 -- 172.21.15.5:0/990041034 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40d23c0 con 0x7f00f40ce7f0 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.409+0000 7f00f259c640 1 --2- 172.21.15.5:0/990041034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f415de70 0x7f00f40b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f2d9d640 1 --2- 172.21.15.5:0/990041034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f40cec80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd12bcad5dfab57f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f1d9b640 1 -- 172.21.15.5:0/990041034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec007740 con 0x7f00f40ce7f0 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f1d9b640 1 -- 172.21.15.5:0/990041034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0078e0 con 0x7f00f40ce7f0 2024-04-25T09:00:11.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f1d9b640 1 -- 172.21.15.5:0/990041034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec007cb0 con 0x7f00f40ce7f0 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f8a9c640 1 -- 172.21.15.5:0/990041034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 msgr2=0x7f00f40cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/990041034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f40cec80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec02a660 comp rx=0 tx=0).stop 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f8a9c640 1 -- 172.21.15.5:0/990041034 shutdown_connections 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/990041034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f40cec80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.410+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/990041034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f415de70 0x7f00f40b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.411+0000 7f00f8a9c640 1 -- 172.21.15.5:0/990041034 >> 172.21.15.5:0/990041034 conn(0x7f00f406b000 msgr2=0x7f00f406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.411+0000 7f00f8a9c640 1 -- 172.21.15.5:0/990041034 shutdown_connections 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.411+0000 7f00f8a9c640 1 -- 172.21.15.5:0/990041034 wait complete. 2024-04-25T09:00:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.412+0000 7f00f8a9c640 1 Processor -- start 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.412+0000 7f00f8a9c640 1 -- start start 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f40b2cc0 0x7f00f40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f4149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f415de70 0x7f00f40cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40b7300 con 0x7f00f40ce7f0 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40b9920 con 0x7f00f415de70 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40d2ea0 con 0x7f00f40b2cc0 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f4149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f4149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38672/0 (socket says 172.21.15.5:38672) 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 -- 172.21.15.5:0/4231967011 learned_addr learned my addr 172.21.15.5:0/4231967011 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f2d9d640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f415de70 0x7f00f40cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f259c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f40b2cc0 0x7f00f40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 -- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f40b2cc0 msgr2=0x7f00f40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f40b2cc0 0x7f00f40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 -- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f415de70 msgr2=0x7f00f40cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f415de70 0x7f00f40cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 -- 172.21.15.5:0/4231967011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40cb960 con 0x7f00f40ce7f0 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f2d9d640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f415de70 0x7f00f40cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00ebfff640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f4149fd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c4d0 tx=0x7f00dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00eaffd640 1 -- 172.21.15.5:0/4231967011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc018070 con 0x7f00f40ce7f0 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00eaffd640 1 -- 172.21.15.5:0/4231967011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc007500 con 0x7f00f40ce7f0 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00eaffd640 1 -- 172.21.15.5:0/4231967011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc004a20 con 0x7f00f40ce7f0 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40b5e30 con 0x7f00f40ce7f0 2024-04-25T09:00:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.413+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f40b5870 con 0x7f00f40ce7f0 2024-04-25T09:00:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.414+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f404ef20 con 0x7f00f40ce7f0 2024-04-25T09:00:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.415+0000 7f00eaffd640 1 -- 172.21.15.5:0/4231967011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00dc01b070 con 0x7f00f40ce7f0 2024-04-25T09:00:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.415+0000 7f00eaffd640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00d406b4d0 0x7f00d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.415+0000 7f00eaffd640 1 -- 172.21.15.5:0/4231967011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00dc089550 con 0x7f00f40ce7f0 2024-04-25T09:00:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.415+0000 7f00f259c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00d406b4d0 0x7f00d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.416+0000 7f00f259c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00d406b4d0 0x7f00d406d990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f00e400a950 tx=0x7f00e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.419+0000 7f00eaffd640 1 -- 172.21.15.5:0/4231967011 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00dc0583d0 con 0x7f00f40ce7f0 2024-04-25T09:00:11.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.594+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00f40b6c90 con 0x7f00d406b4d0 2024-04-25T09:00:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.601+0000 7f00eaffd640 1 -- 172.21.15.5:0/4231967011 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246637 (secure 0 0 0) 0x7f00f40b6c90 con 0x7f00d406b4d0 2024-04-25T09:00:11.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:00:11.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00d406b4d0 msgr2=0x7f00d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00d406b4d0 0x7f00d406d990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f00e400a950 tx=0x7f00e4008040 comp rx=0 tx=0).stop 2024-04-25T09:00:11.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 msgr2=0x7f00f4149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:11.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f4149fd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c4d0 tx=0x7f00dc00c990 comp rx=0 tx=0).stop 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 shutdown_connections 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00d406b4d0 0x7f00d406d990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f415de70 0x7f00f40cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f40ce7f0 0x7f00f4149fd0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 --2- 172.21.15.5:0/4231967011 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f00f40b2cc0 0x7f00f40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 >> 172.21.15.5:0/4231967011 conn(0x7f00f406b000 msgr2=0x7f00f40b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 shutdown_connections 2024-04-25T09:00:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:11.603+0000 7f00f8a9c640 1 -- 172.21.15.5:0/4231967011 wait complete. 2024-04-25T09:00:11.604 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-25T09:00:10.433603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":305624,"kb_used_data":6252,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669096,"statfs":{"total":773094113280,"available":772781154304,"internally_reserved":0,"allocated":6402048,"data_stored":3327529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.252819"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190978+0000","last_change":"2024-04-25T09:00:06.190978+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190978+0000","last_undegraded":"2024-04-25T09:00:06.190978+0000","last_fullsized":"2024-04-25T09:00:06.190978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192596+0000","last_change":"2024-04-25T09:00:06.192596+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192596+0000","last_undegraded":"2024-04-25T09:00:06.192596+0000","last_fullsized":"2024-04-25T09:00:06.192596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187020+0000","last_change":"2024-04-25T09:00:06.187020+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187020+0000","last_undegraded":"2024-04-25T09:00:06.187020+0000","last_fullsized":"2024-04-25T09:00:06.187020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192288+0000","last_change":"2024-04-25T09:00:06.192288+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192288+0000","last_undegraded":"2024-04-25T09:00:06.192288+0000","last_fullsized":"2024-04-25T09:00:06.192288+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191450+0000","last_change":"2024-04-25T09:00:06.191450+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191450+0000","last_undegraded":"2024-04-25T09:00:06.191450+0000","last_fullsized":"2024-04-25T09:00:06.191450+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187431+0000","last_change":"2024-04-25T09:00:06.187431+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187431+0000","last_undegraded":"2024-04-25T09:00:06.187431+0000","last_fullsized":"2024-04-25T09:00:06.187431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191331+0000","last_change":"2024-04-25T09:00:06.191331+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191331+0000","last_undegraded":"2024-04-25T09:00:06.191331+0000","last_fullsized":"2024-04-25T09:00:06.191331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192108+0000","last_change":"2024-04-25T09:00:06.192108+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192108+0000","last_undegraded":"2024-04-25T09:00:06.192108+0000","last_fullsized":"2024-04-25T09:00:06.192108+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191505+0000","last_change":"2024-04-25T09:00:06.191505+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191505+0000","last_undegraded":"2024-04-25T09:00:06.191505+0000","last_fullsized":"2024-04-25T09:00:06.191505+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192468+0000","last_change":"2024-04-25T09:00:06.192468+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192468+0000","last_undegraded":"2024-04-25T09:00:06.192468+0000","last_fullsized":"2024-04-25T09:00:06.192468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193470+0000","last_change":"2024-04-25T09:00:06.193470+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193470+0000","last_undegraded":"2024-04-25T09:00:06.193470+0000","last_fullsized":"2024-04-25T09:00:06.193470+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191829+0000","last_change":"2024-04-25T09:00:06.191829+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191829+0000","last_undegraded":"2024-04-25T09:00:06.191829+0000","last_fullsized":"2024-04-25T09:00:06.191829+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188629+0000","last_change":"2024-04-25T09:00:06.188629+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188629+0000","last_undegraded":"2024-04-25T09:00:06.188629+0000","last_fullsized":"2024-04-25T09:00:06.188629+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191981+0000","last_change":"2024-04-25T09:00:06.191981+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191981+0000","last_undegraded":"2024-04-25T09:00:06.191981+0000","last_fullsized":"2024-04-25T09:00:06.191981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190813+0000","last_change":"2024-04-25T09:00:06.190813+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190813+0000","last_undegraded":"2024-04-25T09:00:06.190813+0000","last_fullsized":"2024-04-25T09:00:06.190813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188689+0000","last_change":"2024-04-25T09:00:06.188689+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188689+0000","last_undegraded":"2024-04-25T09:00:06.188689+0000","last_fullsized":"2024-04-25T09:00:06.188689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191416+0000","last_change":"2024-04-25T09:00:06.191416+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191416+0000","last_undegraded":"2024-04-25T09:00:06.191416+0000","last_fullsized":"2024-04-25T09:00:06.191416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186660+0000","last_change":"2024-04-25T09:00:06.186660+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186660+0000","last_undegraded":"2024-04-25T09:00:06.186660+0000","last_fullsized":"2024-04-25T09:00:06.186660+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192156+0000","last_change":"2024-04-25T09:00:06.192156+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192156+0000","last_undegraded":"2024-04-25T09:00:06.192156+0000","last_fullsized":"2024-04-25T09:00:06.192156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190935+0000","last_change":"2024-04-25T09:00:06.190935+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190935+0000","last_undegraded":"2024-04-25T09:00:06.190935+0000","last_fullsized":"2024-04-25T09:00:06.190935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187635+0000","last_change":"2024-04-25T09:00:06.187635+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187635+0000","last_undegraded":"2024-04-25T09:00:06.187635+0000","last_fullsized":"2024-04-25T09:00:06.187635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190893+0000","last_change":"2024-04-25T09:00:06.190893+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190893+0000","last_undegraded":"2024-04-25T09:00:06.190893+0000","last_fullsized":"2024-04-25T09:00:06.190893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186918+0000","last_change":"2024-04-25T09:00:06.186918+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186918+0000","last_undegraded":"2024-04-25T09:00:06.186918+0000","last_fullsized":"2024-04-25T09:00:06.186918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189560+0000","last_change":"2024-04-25T09:00:06.189560+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189560+0000","last_undegraded":"2024-04-25T09:00:06.189560+0000","last_fullsized":"2024-04-25T09:00:06.189560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190520+0000","last_change":"2024-04-25T09:00:06.190520+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190520+0000","last_undegraded":"2024-04-25T09:00:06.190520+0000","last_fullsized":"2024-04-25T09:00:06.190520+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191585+0000","last_change":"2024-04-25T09:00:06.191585+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191585+0000","last_undegraded":"2024-04-25T09:00:06.191585+0000","last_fullsized":"2024-04-25T09:00:06.191585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188965+0000","last_change":"2024-04-25T09:00:06.188965+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188965+0000","last_undegraded":"2024-04-25T09:00:06.188965+0000","last_fullsized":"2024-04-25T09:00:06.188965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191888+0000","last_change":"2024-04-25T09:00:06.191888+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191888+0000","last_undegraded":"2024-04-25T09:00:06.191888+0000","last_fullsized":"2024-04-25T09:00:06.191888+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193591+0000","last_change":"2024-04-25T09:00:06.193591+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193591+0000","last_undegraded":"2024-04-25T09:00:06.193591+0000","last_fullsized":"2024-04-25T09:00:06.193591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185906+0000","last_change":"2024-04-25T09:00:06.185906+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185906+0000","last_undegraded":"2024-04-25T09:00:06.185906+0000","last_fullsized":"2024-04-25T09:00:06.185906+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191330+0000","last_change":"2024-04-25T09:00:06.191330+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191330+0000","last_undegraded":"2024-04-25T09:00:06.191330+0000","last_fullsized":"2024-04-25T09:00:06.191330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185852+0000","last_change":"2024-04-25T09:00:06.185852+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185852+0000","last_undegraded":"2024-04-25T09:00:06.185852+0000","last_fullsized":"2024-04-25T09:00:06.185852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188286+0000","last_change":"2024-04-25T09:00:06.188286+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188286+0000","last_undegraded":"2024-04-25T09:00:06.188286+0000","last_fullsized":"2024-04-25T09:00:06.188286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200278+0000","last_change":"2024-04-25T09:00:06.199616+0000","last_active":"2024-04-25T09:00:06.200278+0000","last_peered":"2024-04-25T09:00:06.200278+0000","last_clean":"2024-04-25T09:00:06.200278+0000","last_became_active":"2024-04-25T09:00:06.199305+0000","last_became_peered":"2024-04-25T09:00:06.199305+0000","last_unstale":"2024-04-25T09:00:06.200278+0000","last_undegraded":"2024-04-25T09:00:06.200278+0000","last_fullsized":"2024-04-25T09:00:06.200278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:57.120298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191823+0000","last_change":"2024-04-25T09:00:06.191823+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191823+0000","last_undegraded":"2024-04-25T09:00:06.191823+0000","last_fullsized":"2024-04-25T09:00:06.191823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205473+0000","last_change":"2024-04-25T09:00:06.202408+0000","last_active":"2024-04-25T09:00:06.205473+0000","last_peered":"2024-04-25T09:00:06.205473+0000","last_clean":"2024-04-25T09:00:06.205473+0000","last_became_active":"2024-04-25T09:00:06.200858+0000","last_became_peered":"2024-04-25T09:00:06.200858+0000","last_unstale":"2024-04-25T09:00:06.205473+0000","last_undegraded":"2024-04-25T09:00:06.205473+0000","last_fullsized":"2024-04-25T09:00:06.205473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.891482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186977+0000","last_change":"2024-04-25T09:00:06.186977+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186977+0000","last_undegraded":"2024-04-25T09:00:06.186977+0000","last_fullsized":"2024-04-25T09:00:06.186977+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205129+0000","last_change":"2024-04-25T09:00:06.203421+0000","last_active":"2024-04-25T09:00:06.205129+0000","last_peered":"2024-04-25T09:00:06.205129+0000","last_clean":"2024-04-25T09:00:06.205129+0000","last_became_active":"2024-04-25T09:00:06.203097+0000","last_became_peered":"2024-04-25T09:00:06.203097+0000","last_unstale":"2024-04-25T09:00:06.205129+0000","last_undegraded":"2024-04-25T09:00:06.205129+0000","last_fullsized":"2024-04-25T09:00:06.205129+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:42.364834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187459+0000","last_change":"2024-04-25T09:00:06.187459+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187459+0000","last_undegraded":"2024-04-25T09:00:06.187459+0000","last_fullsized":"2024-04-25T09:00:06.187459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202834+0000","last_change":"2024-04-25T09:00:06.201046+0000","last_active":"2024-04-25T09:00:06.202834+0000","last_peered":"2024-04-25T09:00:06.202834+0000","last_clean":"2024-04-25T09:00:06.202834+0000","last_became_active":"2024-04-25T09:00:06.200765+0000","last_became_peered":"2024-04-25T09:00:06.200765+0000","last_unstale":"2024-04-25T09:00:06.202834+0000","last_undegraded":"2024-04-25T09:00:06.202834+0000","last_fullsized":"2024-04-25T09:00:06.202834+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:43.278902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190415+0000","last_change":"2024-04-25T09:00:06.190415+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190415+0000","last_undegraded":"2024-04-25T09:00:06.190415+0000","last_fullsized":"2024-04-25T09:00:06.190415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199790+0000","last_change":"2024-04-25T09:00:06.198409+0000","last_active":"2024-04-25T09:00:06.199790+0000","last_peered":"2024-04-25T09:00:06.199790+0000","last_clean":"2024-04-25T09:00:06.199790+0000","last_became_active":"2024-04-25T09:00:06.198093+0000","last_became_peered":"2024-04-25T09:00:06.198093+0000","last_unstale":"2024-04-25T09:00:06.199790+0000","last_undegraded":"2024-04-25T09:00:06.199790+0000","last_fullsized":"2024-04-25T09:00:06.199790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193147+0000","last_change":"2024-04-25T09:00:06.193147+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193147+0000","last_undegraded":"2024-04-25T09:00:06.193147+0000","last_fullsized":"2024-04-25T09:00:06.193147+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198833+0000","last_change":"2024-04-25T09:00:06.197490+0000","last_active":"2024-04-25T09:00:06.198833+0000","last_peered":"2024-04-25T09:00:06.198833+0000","last_clean":"2024-04-25T09:00:06.198833+0000","last_became_active":"2024-04-25T09:00:06.196586+0000","last_became_peered":"2024-04-25T09:00:06.196586+0000","last_unstale":"2024-04-25T09:00:06.198833+0000","last_undegraded":"2024-04-25T09:00:06.198833+0000","last_fullsized":"2024-04-25T09:00:06.198833+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188988+0000","last_change":"2024-04-25T09:00:06.188988+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188988+0000","last_undegraded":"2024-04-25T09:00:06.188988+0000","last_fullsized":"2024-04-25T09:00:06.188988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202655+0000","last_change":"2024-04-25T09:00:06.200363+0000","last_active":"2024-04-25T09:00:06.202655+0000","last_peered":"2024-04-25T09:00:06.202655+0000","last_clean":"2024-04-25T09:00:06.202655+0000","last_became_active":"2024-04-25T09:00:06.200060+0000","last_became_peered":"2024-04-25T09:00:06.200060+0000","last_unstale":"2024-04-25T09:00:06.202655+0000","last_undegraded":"2024-04-25T09:00:06.202655+0000","last_fullsized":"2024-04-25T09:00:06.202655+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189042+0000","last_change":"2024-04-25T09:00:06.189042+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189042+0000","last_undegraded":"2024-04-25T09:00:06.189042+0000","last_fullsized":"2024-04-25T09:00:06.189042+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205468+0000","last_change":"2024-04-25T09:00:06.203119+0000","last_active":"2024-04-25T09:00:06.205468+0000","last_peered":"2024-04-25T09:00:06.205468+0000","last_clean":"2024-04-25T09:00:06.205468+0000","last_became_active":"2024-04-25T09:00:06.202821+0000","last_became_peered":"2024-04-25T09:00:06.202821+0000","last_unstale":"2024-04-25T09:00:06.205468+0000","last_undegraded":"2024-04-25T09:00:06.205468+0000","last_fullsized":"2024-04-25T09:00:06.205468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191565+0000","last_change":"2024-04-25T09:00:06.191565+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191565+0000","last_undegraded":"2024-04-25T09:00:06.191565+0000","last_fullsized":"2024-04-25T09:00:06.191565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199354+0000","last_change":"2024-04-25T09:00:06.196201+0000","last_active":"2024-04-25T09:00:06.199354+0000","last_peered":"2024-04-25T09:00:06.199354+0000","last_clean":"2024-04-25T09:00:06.199354+0000","last_became_active":"2024-04-25T09:00:06.195618+0000","last_became_peered":"2024-04-25T09:00:06.195618+0000","last_unstale":"2024-04-25T09:00:06.199354+0000","last_undegraded":"2024-04-25T09:00:06.199354+0000","last_fullsized":"2024-04-25T09:00:06.199354+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185892+0000","last_change":"2024-04-25T09:00:06.185892+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185892+0000","last_undegraded":"2024-04-25T09:00:06.185892+0000","last_fullsized":"2024-04-25T09:00:06.185892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205491+0000","last_change":"2024-04-25T09:00:06.203661+0000","last_active":"2024-04-25T09:00:06.205491+0000","last_peered":"2024-04-25T09:00:06.205491+0000","last_clean":"2024-04-25T09:00:06.205491+0000","last_became_active":"2024-04-25T09:00:06.201182+0000","last_became_peered":"2024-04-25T09:00:06.201182+0000","last_unstale":"2024-04-25T09:00:06.205491+0000","last_undegraded":"2024-04-25T09:00:06.205491+0000","last_fullsized":"2024-04-25T09:00:06.205491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:31.994350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190313+0000","last_change":"2024-04-25T09:00:06.190313+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190313+0000","last_undegraded":"2024-04-25T09:00:06.190313+0000","last_fullsized":"2024-04-25T09:00:06.190313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199920+0000","last_change":"2024-04-25T09:00:06.198508+0000","last_active":"2024-04-25T09:00:06.199920+0000","last_peered":"2024-04-25T09:00:06.199920+0000","last_clean":"2024-04-25T09:00:06.199920+0000","last_became_active":"2024-04-25T09:00:06.198162+0000","last_became_peered":"2024-04-25T09:00:06.198162+0000","last_unstale":"2024-04-25T09:00:06.199920+0000","last_undegraded":"2024-04-25T09:00:06.199920+0000","last_fullsized":"2024-04-25T09:00:06.199920+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186579+0000","last_change":"2024-04-25T09:00:06.186579+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186579+0000","last_undegraded":"2024-04-25T09:00:06.186579+0000","last_fullsized":"2024-04-25T09:00:06.186579+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.200547+0000","last_change":"2024-04-25T09:00:06.199821+0000","last_active":"2024-04-25T09:00:06.200547+0000","last_peered":"2024-04-25T09:00:06.200547+0000","last_clean":"2024-04-25T09:00:06.200547+0000","last_became_active":"2024-04-25T09:00:06.199310+0000","last_became_peered":"2024-04-25T09:00:06.199310+0000","last_unstale":"2024-04-25T09:00:06.200547+0000","last_undegraded":"2024-04-25T09:00:06.200547+0000","last_fullsized":"2024-04-25T09:00:06.200547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:47.909493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.193479+0000","last_change":"2024-04-25T09:00:06.193479+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.193479+0000","last_undegraded":"2024-04-25T09:00:06.193479+0000","last_fullsized":"2024-04-25T09:00:06.193479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205531+0000","last_change":"2024-04-25T09:00:06.202728+0000","last_active":"2024-04-25T09:00:06.205531+0000","last_peered":"2024-04-25T09:00:06.205531+0000","last_clean":"2024-04-25T09:00:06.205531+0000","last_became_active":"2024-04-25T09:00:06.201927+0000","last_became_peered":"2024-04-25T09:00:06.201927+0000","last_unstale":"2024-04-25T09:00:06.205531+0000","last_undegraded":"2024-04-25T09:00:06.205531+0000","last_fullsized":"2024-04-25T09:00:06.205531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:34.685720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186754+0000","last_change":"2024-04-25T09:00:06.186754+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186754+0000","last_undegraded":"2024-04-25T09:00:06.186754+0000","last_fullsized":"2024-04-25T09:00:06.186754+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.195562+0000","last_change":"2024-04-25T09:00:06.193400+0000","last_active":"2024-04-25T09:00:06.195562+0000","last_peered":"2024-04-25T09:00:06.195562+0000","last_clean":"2024-04-25T09:00:06.195562+0000","last_became_active":"2024-04-25T09:00:06.193121+0000","last_became_peered":"2024-04-25T09:00:06.193121+0000","last_unstale":"2024-04-25T09:00:06.195562+0000","last_undegraded":"2024-04-25T09:00:06.195562+0000","last_fullsized":"2024-04-25T09:00:06.195562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:57.093035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.194668+0000","last_change":"2024-04-25T09:00:06.194668+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.194668+0000","last_undegraded":"2024-04-25T09:00:06.194668+0000","last_fullsized":"2024-04-25T09:00:06.194668+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201702+0000","last_change":"2024-04-25T09:00:06.198624+0000","last_active":"2024-04-25T09:00:06.201702+0000","last_peered":"2024-04-25T09:00:06.201702+0000","last_clean":"2024-04-25T09:00:06.201702+0000","last_became_active":"2024-04-25T09:00:06.198238+0000","last_became_peered":"2024-04-25T09:00:06.198238+0000","last_unstale":"2024-04-25T09:00:06.201702+0000","last_undegraded":"2024-04-25T09:00:06.201702+0000","last_fullsized":"2024-04-25T09:00:06.201702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:23.562706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185884+0000","last_change":"2024-04-25T09:00:06.185884+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185884+0000","last_undegraded":"2024-04-25T09:00:06.185884+0000","last_fullsized":"2024-04-25T09:00:06.185884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202443+0000","last_change":"2024-04-25T09:00:06.201475+0000","last_active":"2024-04-25T09:00:06.202443+0000","last_peered":"2024-04-25T09:00:06.202443+0000","last_clean":"2024-04-25T09:00:06.202443+0000","last_became_active":"2024-04-25T09:00:06.201166+0000","last_became_peered":"2024-04-25T09:00:06.201166+0000","last_unstale":"2024-04-25T09:00:06.202443+0000","last_undegraded":"2024-04-25T09:00:06.202443+0000","last_fullsized":"2024-04-25T09:00:06.202443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:46.945836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186231+0000","last_change":"2024-04-25T09:00:06.186231+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186231+0000","last_undegraded":"2024-04-25T09:00:06.186231+0000","last_fullsized":"2024-04-25T09:00:06.186231+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205304+0000","last_change":"2024-04-25T09:00:06.200834+0000","last_active":"2024-04-25T09:00:06.205304+0000","last_peered":"2024-04-25T09:00:06.205304+0000","last_clean":"2024-04-25T09:00:06.205304+0000","last_became_active":"2024-04-25T09:00:06.200467+0000","last_became_peered":"2024-04-25T09:00:06.200467+0000","last_unstale":"2024-04-25T09:00:06.205304+0000","last_undegraded":"2024-04-25T09:00:06.205304+0000","last_fullsized":"2024-04-25T09:00:06.205304+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:28.284535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192889+0000","last_change":"2024-04-25T09:00:06.192889+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192889+0000","last_undegraded":"2024-04-25T09:00:06.192889+0000","last_fullsized":"2024-04-25T09:00:06.192889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199291+0000","last_change":"2024-04-25T09:00:06.197838+0000","last_active":"2024-04-25T09:00:06.199291+0000","last_peered":"2024-04-25T09:00:06.199291+0000","last_clean":"2024-04-25T09:00:06.199291+0000","last_became_active":"2024-04-25T09:00:06.197304+0000","last_became_peered":"2024-04-25T09:00:06.197304+0000","last_unstale":"2024-04-25T09:00:06.199291+0000","last_undegraded":"2024-04-25T09:00:06.199291+0000","last_fullsized":"2024-04-25T09:00:06.199291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:15.742912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189244+0000","last_change":"2024-04-25T09:00:06.189244+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189244+0000","last_undegraded":"2024-04-25T09:00:06.189244+0000","last_fullsized":"2024-04-25T09:00:06.189244+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202574+0000","last_change":"2024-04-25T09:00:06.200257+0000","last_active":"2024-04-25T09:00:06.202574+0000","last_peered":"2024-04-25T09:00:06.202574+0000","last_clean":"2024-04-25T09:00:06.202574+0000","last_became_active":"2024-04-25T09:00:06.199977+0000","last_became_peered":"2024-04-25T09:00:06.199977+0000","last_unstale":"2024-04-25T09:00:06.202574+0000","last_undegraded":"2024-04-25T09:00:06.202574+0000","last_fullsized":"2024-04-25T09:00:06.202574+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:38.820204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186033+0000","last_change":"2024-04-25T09:00:06.186033+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186033+0000","last_undegraded":"2024-04-25T09:00:06.186033+0000","last_fullsized":"2024-04-25T09:00:06.186033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.204537+0000","last_change":"2024-04-25T09:00:06.201254+0000","last_active":"2024-04-25T09:00:06.204537+0000","last_peered":"2024-04-25T09:00:06.204537+0000","last_clean":"2024-04-25T09:00:06.204537+0000","last_became_active":"2024-04-25T09:00:06.200978+0000","last_became_peered":"2024-04-25T09:00:06.200978+0000","last_unstale":"2024-04-25T09:00:06.204537+0000","last_undegraded":"2024-04-25T09:00:06.204537+0000","last_fullsized":"2024-04-25T09:00:06.204537+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:23.480824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.190853+0000","last_change":"2024-04-25T09:00:06.190853+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.190853+0000","last_undegraded":"2024-04-25T09:00:06.190853+0000","last_fullsized":"2024-04-25T09:00:06.190853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205510+0000","last_change":"2024-04-25T09:00:06.202223+0000","last_active":"2024-04-25T09:00:06.205510+0000","last_peered":"2024-04-25T09:00:06.205510+0000","last_clean":"2024-04-25T09:00:06.205510+0000","last_became_active":"2024-04-25T09:00:06.200842+0000","last_became_peered":"2024-04-25T09:00:06.200842+0000","last_unstale":"2024-04-25T09:00:06.205510+0000","last_undegraded":"2024-04-25T09:00:06.205510+0000","last_fullsized":"2024-04-25T09:00:06.205510+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:58.308566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186255+0000","last_change":"2024-04-25T09:00:06.186255+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186255+0000","last_undegraded":"2024-04-25T09:00:06.186255+0000","last_fullsized":"2024-04-25T09:00:06.186255+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202466+0000","last_change":"2024-04-25T09:00:06.196060+0000","last_active":"2024-04-25T09:00:06.202466+0000","last_peered":"2024-04-25T09:00:06.202466+0000","last_clean":"2024-04-25T09:00:06.202466+0000","last_became_active":"2024-04-25T09:00:06.195716+0000","last_became_peered":"2024-04-25T09:00:06.195716+0000","last_unstale":"2024-04-25T09:00:06.202466+0000","last_undegraded":"2024-04-25T09:00:06.202466+0000","last_fullsized":"2024-04-25T09:00:06.202466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:23.177590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.185862+0000","last_change":"2024-04-25T09:00:06.185862+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.185862+0000","last_undegraded":"2024-04-25T09:00:06.185862+0000","last_fullsized":"2024-04-25T09:00:06.185862+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205803+0000","last_change":"2024-04-25T09:00:06.204013+0000","last_active":"2024-04-25T09:00:06.205803+0000","last_peered":"2024-04-25T09:00:06.205803+0000","last_clean":"2024-04-25T09:00:06.205803+0000","last_became_active":"2024-04-25T09:00:06.203786+0000","last_became_peered":"2024-04-25T09:00:06.203786+0000","last_unstale":"2024-04-25T09:00:06.205803+0000","last_undegraded":"2024-04-25T09:00:06.205803+0000","last_fullsized":"2024-04-25T09:00:06.205803+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:57.421924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.191168+0000","last_change":"2024-04-25T09:00:06.191168+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.191168+0000","last_undegraded":"2024-04-25T09:00:06.191168+0000","last_fullsized":"2024-04-25T09:00:06.191168+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203908+0000","last_change":"2024-04-25T09:00:06.203068+0000","last_active":"2024-04-25T09:00:06.203908+0000","last_peered":"2024-04-25T09:00:06.203908+0000","last_clean":"2024-04-25T09:00:06.203908+0000","last_became_active":"2024-04-25T09:00:06.202810+0000","last_became_peered":"2024-04-25T09:00:06.202810+0000","last_unstale":"2024-04-25T09:00:06.203908+0000","last_undegraded":"2024-04-25T09:00:06.203908+0000","last_fullsized":"2024-04-25T09:00:06.203908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:21.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.192530+0000","last_change":"2024-04-25T09:00:06.192530+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.192530+0000","last_undegraded":"2024-04-25T09:00:06.192530+0000","last_fullsized":"2024-04-25T09:00:06.192530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.199313+0000","last_change":"2024-04-25T09:00:06.198465+0000","last_active":"2024-04-25T09:00:06.199313+0000","last_peered":"2024-04-25T09:00:06.199313+0000","last_clean":"2024-04-25T09:00:06.199313+0000","last_became_active":"2024-04-25T09:00:06.198180+0000","last_became_peered":"2024-04-25T09:00:06.198180+0000","last_unstale":"2024-04-25T09:00:06.199313+0000","last_undegraded":"2024-04-25T09:00:06.199313+0000","last_fullsized":"2024-04-25T09:00:06.199313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:48.720837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189845+0000","last_change":"2024-04-25T09:00:06.189845+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189845+0000","last_undegraded":"2024-04-25T09:00:06.189845+0000","last_fullsized":"2024-04-25T09:00:06.189845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.198645+0000","last_change":"2024-04-25T09:00:06.196940+0000","last_active":"2024-04-25T09:00:06.198645+0000","last_peered":"2024-04-25T09:00:06.198645+0000","last_clean":"2024-04-25T09:00:06.198645+0000","last_became_active":"2024-04-25T09:00:06.196651+0000","last_became_peered":"2024-04-25T09:00:06.196651+0000","last_unstale":"2024-04-25T09:00:06.198645+0000","last_undegraded":"2024-04-25T09:00:06.198645+0000","last_fullsized":"2024-04-25T09:00:06.198645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:25.280084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.187024+0000","last_change":"2024-04-25T09:00:06.187024+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.187024+0000","last_undegraded":"2024-04-25T09:00:06.187024+0000","last_fullsized":"2024-04-25T09:00:06.187024+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202853+0000","last_change":"2024-04-25T09:00:06.201200+0000","last_active":"2024-04-25T09:00:06.202853+0000","last_peered":"2024-04-25T09:00:06.202853+0000","last_clean":"2024-04-25T09:00:06.202853+0000","last_became_active":"2024-04-25T09:00:06.200924+0000","last_became_peered":"2024-04-25T09:00:06.200924+0000","last_unstale":"2024-04-25T09:00:06.202853+0000","last_undegraded":"2024-04-25T09:00:06.202853+0000","last_fullsized":"2024-04-25T09:00:06.202853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.391108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.189728+0000","last_change":"2024-04-25T09:00:06.189728+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.189728+0000","last_undegraded":"2024-04-25T09:00:06.189728+0000","last_fullsized":"2024-04-25T09:00:06.189728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.203581+0000","last_change":"2024-04-25T09:00:06.199594+0000","last_active":"2024-04-25T09:00:06.203581+0000","last_peered":"2024-04-25T09:00:06.203581+0000","last_clean":"2024-04-25T09:00:06.203581+0000","last_became_active":"2024-04-25T09:00:06.199318+0000","last_became_peered":"2024-04-25T09:00:06.199318+0000","last_unstale":"2024-04-25T09:00:06.203581+0000","last_undegraded":"2024-04-25T09:00:06.203581+0000","last_fullsized":"2024-04-25T09:00:06.203581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:01.451638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.186083+0000","last_change":"2024-04-25T09:00:06.186083+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.186083+0000","last_undegraded":"2024-04-25T09:00:06.186083+0000","last_fullsized":"2024-04-25T09:00:06.186083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201694+0000","last_change":"2024-04-25T09:00:06.199988+0000","last_active":"2024-04-25T09:00:06.201694+0000","last_peered":"2024-04-25T09:00:06.201694+0000","last_clean":"2024-04-25T09:00:06.201694+0000","last_became_active":"2024-04-25T09:00:06.199325+0000","last_became_peered":"2024-04-25T09:00:06.199325+0000","last_unstale":"2024-04-25T09:00:06.201694+0000","last_undegraded":"2024-04-25T09:00:06.201694+0000","last_fullsized":"2024-04-25T09:00:06.201694+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:09.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188555+0000","last_change":"2024-04-25T09:00:06.188555+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188555+0000","last_undegraded":"2024-04-25T09:00:06.188555+0000","last_fullsized":"2024-04-25T09:00:06.188555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.202384+0000","last_change":"2024-04-25T09:00:06.195158+0000","last_active":"2024-04-25T09:00:06.202384+0000","last_peered":"2024-04-25T09:00:06.202384+0000","last_clean":"2024-04-25T09:00:06.202384+0000","last_became_active":"2024-04-25T09:00:06.194854+0000","last_became_peered":"2024-04-25T09:00:06.194854+0000","last_unstale":"2024-04-25T09:00:06.202384+0000","last_undegraded":"2024-04-25T09:00:06.202384+0000","last_fullsized":"2024-04-25T09:00:06.202384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:34.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188439+0000","last_change":"2024-04-25T09:00:06.188439+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188439+0000","last_undegraded":"2024-04-25T09:00:06.188439+0000","last_fullsized":"2024-04-25T09:00:06.188439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.205335+0000","last_change":"2024-04-25T09:00:06.202020+0000","last_active":"2024-04-25T09:00:06.205335+0000","last_peered":"2024-04-25T09:00:06.205335+0000","last_clean":"2024-04-25T09:00:06.205335+0000","last_became_active":"2024-04-25T09:00:06.201586+0000","last_became_peered":"2024-04-25T09:00:06.201586+0000","last_unstale":"2024-04-25T09:00:06.205335+0000","last_undegraded":"2024-04-25T09:00:06.205335+0000","last_fullsized":"2024-04-25T09:00:06.205335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:07.176226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:00:06.188477+0000","last_change":"2024-04-25T09:00:06.188477+0000","last_active":"2024-04-25T09:00:06.180030+0000","last_peered":"2024-04-25T09:00:06.180030+0000","last_clean":"2024-04-25T09:00:06.180030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:00:06.188477+0000","last_undegraded":"2024-04-25T09:00:06.188477+0000","last_fullsized":"2024-04-25T09:00:06.188477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.201954+0000","last_change":"2024-04-25T09:00:06.200265+0000","last_active":"2024-04-25T09:00:06.201954+0000","last_peered":"2024-04-25T09:00:06.201954+0000","last_clean":"2024-04-25T09:00:06.201954+0000","last_became_active":"2024-04-25T09:00:06.199932+0000","last_became_peered":"2024-04-25T09:00:06.199932+0000","last_unstale":"2024-04-25T09:00:06.201954+0000","last_undegraded":"2024-04-25T09:00:06.201954+0000","last_fullsized":"2024-04-25T09:00:06.201954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:36.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:00:06.188288+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:00:06.188288+0000","last_peered":"2024-04-25T09:00:06.188288+0000","last_clean":"2024-04-25T09:00:06.188288+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:00:06.188288+0000","last_undegraded":"2024-04-25T09:00:06.188288+0000","last_fullsized":"2024-04-25T09:00:06.188288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1253376,"data_stored":862634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":659456,"data_stored":272266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40132,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331708,"statfs":{"total":96636764160,"available":96595668992,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44292,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327548,"statfs":{"total":96636764160,"available":96591409152,"internally_reserved":0,"allocated":647168,"data_stored":265999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1241088,"data_stored":856367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:00:14.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:00:14.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.733+0000 7fdfb9237640 1 Processor -- start 2024-04-25T09:00:14.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.733+0000 7fdfb9237640 1 -- start start 2024-04-25T09:00:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb9237640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfb40b2cc0 0x7fdfb40b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb9237640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb40b7130 0x7fdfb40ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb9237640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40d20e0 con 0x7fdfb415de70 2024-04-25T09:00:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb9237640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40d2a10 con 0x7fdfb40b2cc0 2024-04-25T09:00:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb9237640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40d23c0 con 0x7fdfb40b7130 2024-04-25T09:00:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb359e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb40b7130 0x7fdfb40ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfabfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfb40b2cc0 0x7fdfb40b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb2d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdfb415de70 0x7fdfb40b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:53956/0 (socket says 172.21.15.5:53956) 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb359e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb40b7130 0x7fdfb40ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:50528/0 (socket says 172.21.15.5:50528) 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.734+0000 7fdfb2d9d640 1 -- 172.21.15.5:0/1766756105 learned_addr learned my addr 172.21.15.5:0/1766756105 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.735+0000 7fdfb259c640 1 -- 172.21.15.5:0/1766756105 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898724804 0 0) 0x7fdfb40d20e0 con 0x7fdfb415de70 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.735+0000 7fdfb359e640 1 -- 172.21.15.5:0/1766756105 >> v2:172.21.15.80:3300/0 conn(0x7fdfb40b2cc0 msgr2=0x7fdfb40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.735+0000 7fdfb359e640 1 --2- 172.21.15.5:0/1766756105 >> v2:172.21.15.80:3300/0 conn(0x7fdfb40b2cc0 0x7fdfb40b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.735+0000 7fdfb359e640 1 -- 172.21.15.5:0/1766756105 >> v1:172.21.15.80:6789/0 conn(0x7fdfb415de70 legacy=0x7fdfb40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.735+0000 7fdfb359e640 1 -- 172.21.15.5:0/1766756105 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40d26a0 con 0x7fdfb40b7130 2024-04-25T09:00:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb359e640 1 --2- 172.21.15.5:0/1766756105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb40b7130 0x7fdfb40ce7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009d90 tx=0x7fdfac02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a41b39735e6da11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb259c640 1 -- 172.21.15.5:0/1766756105 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac007740 con 0x7fdfb40b7130 2024-04-25T09:00:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb259c640 1 -- 172.21.15.5:0/1766756105 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac0078e0 con 0x7fdfb40b7130 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb259c640 1 -- 172.21.15.5:0/1766756105 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac007cb0 con 0x7fdfb40b7130 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 -- 172.21.15.5:0/1766756105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb40b7130 msgr2=0x7fdfb40ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 --2- 172.21.15.5:0/1766756105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb40b7130 0x7fdfb40ce7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009d90 tx=0x7fdfac02a660 comp rx=0 tx=0).stop 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 -- 172.21.15.5:0/1766756105 shutdown_connections 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 --2- 172.21.15.5:0/1766756105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb40b7130 0x7fdfb40ce7f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 --2- 172.21.15.5:0/1766756105 >> v2:172.21.15.80:3300/0 conn(0x7fdfb40b2cc0 0x7fdfb40b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 -- 172.21.15.5:0/1766756105 >> 172.21.15.5:0/1766756105 conn(0x7fdfb406b000 msgr2=0x7fdfb406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 -- 172.21.15.5:0/1766756105 shutdown_connections 2024-04-25T09:00:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.736+0000 7fdfb9237640 1 -- 172.21.15.5:0/1766756105 wait complete. 2024-04-25T09:00:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.738+0000 7fdfb9237640 1 Processor -- start 2024-04-25T09:00:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.738+0000 7fdfb9237640 1 -- start start 2024-04-25T09:00:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb9237640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb40b2cc0 0x7fdfb4159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb9237640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb40b7130 0x7fdfb41f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb9237640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb415de70 0x7fdfb41f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb9237640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40cf100 con 0x7fdfb40b7130 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb9237640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40cef80 con 0x7fdfb40b2cc0 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb9237640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40d2ea0 con 0x7fdfb415de70 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb40b7130 0x7fdfb41f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb40b7130 0x7fdfb41f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38674/0 (socket says 172.21.15.5:38674) 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 -- 172.21.15.5:0/3060024671 learned_addr learned my addr 172.21.15.5:0/3060024671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb2d9d640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb40b2cc0 0x7fdfb4159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb359e640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb415de70 0x7fdfb41f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 -- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb415de70 msgr2=0x7fdfb41f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb415de70 0x7fdfb41f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 -- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb40b2cc0 msgr2=0x7fdfb4159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb40b2cc0 0x7fdfb4159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 -- 172.21.15.5:0/3060024671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40cd570 con 0x7fdfb40b7130 2024-04-25T09:00:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfb2d9d640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb40b2cc0 0x7fdfb4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfabfff640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb40b7130 0x7fdfb41f37a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00e9b0 tx=0x7fdf9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.739+0000 7fdfab7fe640 1 -- 172.21.15.5:0/3060024671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c017070 con 0x7fdfb40b7130 2024-04-25T09:00:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.740+0000 7fdfab7fe640 1 -- 172.21.15.5:0/3060024671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c00c9a0 con 0x7fdfb40b7130 2024-04-25T09:00:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.740+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40cd850 con 0x7fdfb40b7130 2024-04-25T09:00:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.740+0000 7fdfab7fe640 1 -- 172.21.15.5:0/3060024671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00cd90 con 0x7fdfb40b7130 2024-04-25T09:00:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.740+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb4151cd0 con 0x7fdfb40b7130 2024-04-25T09:00:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.741+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb404ef20 con 0x7fdfb40b7130 2024-04-25T09:00:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.741+0000 7fdfab7fe640 1 -- 172.21.15.5:0/3060024671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf9c01a070 con 0x7fdfb40b7130 2024-04-25T09:00:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.742+0000 7fdfab7fe640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf9406b4d0 0x7fdf9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.742+0000 7fdfab7fe640 1 -- 172.21.15.5:0/3060024671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf9c08a260 con 0x7fdfb40b7130 2024-04-25T09:00:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.742+0000 7fdfb2d9d640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf9406b4d0 0x7fdf9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.742+0000 7fdfb2d9d640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf9406b4d0 0x7fdf9406d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000f60 tx=0x7fdfa4007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.746+0000 7fdfab7fe640 1 -- 172.21.15.5:0/3060024671 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf9c0590f0 con 0x7fdfb40b7130 2024-04-25T09:00:14.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.921+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfb40d3630 con 0x7fdf9406b4d0 2024-04-25T09:00:14.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.928+0000 7fdfab7fe640 1 -- 172.21.15.5:0/3060024671 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251955 (secure 0 0 0) 0x7fdfb40d3630 con 0x7fdf9406b4d0 2024-04-25T09:00:14.920 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf9406b4d0 msgr2=0x7fdf9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf9406b4d0 0x7fdf9406d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000f60 tx=0x7fdfa4007ca0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb40b7130 msgr2=0x7fdfb41f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb40b7130 0x7fdfb41f37a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00e9b0 tx=0x7fdf9c00ee70 comp rx=0 tx=0).stop 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 shutdown_connections 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf9406b4d0 0x7fdf9406d990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdfb415de70 0x7fdfb41f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb40b7130 0x7fdfb41f37a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 --2- 172.21.15.5:0/3060024671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb40b2cc0 0x7fdfb4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 >> 172.21.15.5:0/3060024671 conn(0x7fdfb406b000 msgr2=0x7fdfb40ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 shutdown_connections 2024-04-25T09:00:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:14.930+0000 7fdfb9237640 1 -- 172.21.15.5:0/3060024671 wait complete. 2024-04-25T09:00:14.930 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-04-25T09:00:14.434621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":305964,"kb_used_data":6568,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754668756,"statfs":{"total":773094113280,"available":772780806144,"internally_reserved":0,"allocated":6725632,"data_stored":3468284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002106"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.204849+0000","last_change":"2024-04-25T09:00:07.209051+0000","last_active":"2024-04-25T09:00:08.204849+0000","last_peered":"2024-04-25T09:00:08.204849+0000","last_clean":"2024-04-25T09:00:08.204849+0000","last_became_active":"2024-04-25T09:00:07.208527+0000","last_became_peered":"2024-04-25T09:00:07.208527+0000","last_unstale":"2024-04-25T09:00:08.204849+0000","last_undegraded":"2024-04-25T09:00:08.204849+0000","last_fullsized":"2024-04-25T09:00:08.204849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:25.896247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009104+0000","last_change":"2024-04-25T09:00:07.214440+0000","last_active":"2024-04-25T09:00:09.009104+0000","last_peered":"2024-04-25T09:00:09.009104+0000","last_clean":"2024-04-25T09:00:09.009104+0000","last_became_active":"2024-04-25T09:00:07.214113+0000","last_became_peered":"2024-04-25T09:00:07.214113+0000","last_unstale":"2024-04-25T09:00:09.009104+0000","last_undegraded":"2024-04-25T09:00:09.009104+0000","last_fullsized":"2024-04-25T09:00:09.009104+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:50.336819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009132+0000","last_change":"2024-04-25T09:00:07.218293+0000","last_active":"2024-04-25T09:00:09.009132+0000","last_peered":"2024-04-25T09:00:09.009132+0000","last_clean":"2024-04-25T09:00:09.009132+0000","last_became_active":"2024-04-25T09:00:07.217945+0000","last_became_peered":"2024-04-25T09:00:07.217945+0000","last_unstale":"2024-04-25T09:00:09.009132+0000","last_undegraded":"2024-04-25T09:00:09.009132+0000","last_fullsized":"2024-04-25T09:00:09.009132+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:21.513562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208837+0000","last_change":"2024-04-25T09:00:07.218449+0000","last_active":"2024-04-25T09:00:08.208837+0000","last_peered":"2024-04-25T09:00:08.208837+0000","last_clean":"2024-04-25T09:00:08.208837+0000","last_became_active":"2024-04-25T09:00:07.218152+0000","last_became_peered":"2024-04-25T09:00:07.218152+0000","last_unstale":"2024-04-25T09:00:08.208837+0000","last_undegraded":"2024-04-25T09:00:08.208837+0000","last_fullsized":"2024-04-25T09:00:08.208837+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:49.049536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.204652+0000","last_change":"2024-04-25T09:00:07.209715+0000","last_active":"2024-04-25T09:00:08.204652+0000","last_peered":"2024-04-25T09:00:08.204652+0000","last_clean":"2024-04-25T09:00:08.204652+0000","last_became_active":"2024-04-25T09:00:07.208402+0000","last_became_peered":"2024-04-25T09:00:07.208402+0000","last_unstale":"2024-04-25T09:00:08.204652+0000","last_undegraded":"2024-04-25T09:00:08.204652+0000","last_fullsized":"2024-04-25T09:00:08.204652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:02.455652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211009+0000","last_change":"2024-04-25T09:00:07.207175+0000","last_active":"2024-04-25T09:00:08.211009+0000","last_peered":"2024-04-25T09:00:08.211009+0000","last_clean":"2024-04-25T09:00:08.211009+0000","last_became_active":"2024-04-25T09:00:07.206876+0000","last_became_peered":"2024-04-25T09:00:07.206876+0000","last_unstale":"2024-04-25T09:00:08.211009+0000","last_undegraded":"2024-04-25T09:00:08.211009+0000","last_fullsized":"2024-04-25T09:00:08.211009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:01.895496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208103+0000","last_change":"2024-04-25T09:00:07.206358+0000","last_active":"2024-04-25T09:00:08.208103+0000","last_peered":"2024-04-25T09:00:08.208103+0000","last_clean":"2024-04-25T09:00:08.208103+0000","last_became_active":"2024-04-25T09:00:07.206034+0000","last_became_peered":"2024-04-25T09:00:07.206034+0000","last_unstale":"2024-04-25T09:00:08.208103+0000","last_undegraded":"2024-04-25T09:00:08.208103+0000","last_fullsized":"2024-04-25T09:00:08.208103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:39.824217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008655+0000","last_change":"2024-04-25T09:00:07.203659+0000","last_active":"2024-04-25T09:00:09.008655+0000","last_peered":"2024-04-25T09:00:09.008655+0000","last_clean":"2024-04-25T09:00:09.008655+0000","last_became_active":"2024-04-25T09:00:07.203241+0000","last_became_peered":"2024-04-25T09:00:07.203241+0000","last_unstale":"2024-04-25T09:00:09.008655+0000","last_undegraded":"2024-04-25T09:00:09.008655+0000","last_fullsized":"2024-04-25T09:00:09.008655+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:45.924186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.209295+0000","last_change":"2024-04-25T09:00:07.207873+0000","last_active":"2024-04-25T09:00:08.209295+0000","last_peered":"2024-04-25T09:00:08.209295+0000","last_clean":"2024-04-25T09:00:08.209295+0000","last_became_active":"2024-04-25T09:00:07.207589+0000","last_became_peered":"2024-04-25T09:00:07.207589+0000","last_unstale":"2024-04-25T09:00:08.209295+0000","last_undegraded":"2024-04-25T09:00:08.209295+0000","last_fullsized":"2024-04-25T09:00:08.209295+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:44.282916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009521+0000","last_change":"2024-04-25T09:00:07.210407+0000","last_active":"2024-04-25T09:00:09.009521+0000","last_peered":"2024-04-25T09:00:09.009521+0000","last_clean":"2024-04-25T09:00:09.009521+0000","last_became_active":"2024-04-25T09:00:07.210008+0000","last_became_peered":"2024-04-25T09:00:07.210008+0000","last_unstale":"2024-04-25T09:00:09.009521+0000","last_undegraded":"2024-04-25T09:00:09.009521+0000","last_fullsized":"2024-04-25T09:00:09.009521+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:16.746926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009395+0000","last_change":"2024-04-25T09:00:07.221292+0000","last_active":"2024-04-25T09:00:09.009395+0000","last_peered":"2024-04-25T09:00:09.009395+0000","last_clean":"2024-04-25T09:00:09.009395+0000","last_became_active":"2024-04-25T09:00:07.220544+0000","last_became_peered":"2024-04-25T09:00:07.220544+0000","last_unstale":"2024-04-25T09:00:09.009395+0000","last_undegraded":"2024-04-25T09:00:09.009395+0000","last_fullsized":"2024-04-25T09:00:09.009395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:10.379930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208842+0000","last_change":"2024-04-25T09:00:07.209214+0000","last_active":"2024-04-25T09:00:08.208842+0000","last_peered":"2024-04-25T09:00:08.208842+0000","last_clean":"2024-04-25T09:00:08.208842+0000","last_became_active":"2024-04-25T09:00:07.208941+0000","last_became_peered":"2024-04-25T09:00:07.208941+0000","last_unstale":"2024-04-25T09:00:08.208842+0000","last_undegraded":"2024-04-25T09:00:08.208842+0000","last_fullsized":"2024-04-25T09:00:08.208842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:14.595816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.213500+0000","last_change":"2024-04-25T09:00:07.207971+0000","last_active":"2024-04-25T09:00:08.213500+0000","last_peered":"2024-04-25T09:00:08.213500+0000","last_clean":"2024-04-25T09:00:08.213500+0000","last_became_active":"2024-04-25T09:00:07.207719+0000","last_became_peered":"2024-04-25T09:00:07.207719+0000","last_unstale":"2024-04-25T09:00:08.213500+0000","last_undegraded":"2024-04-25T09:00:08.213500+0000","last_fullsized":"2024-04-25T09:00:08.213500+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:48.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208330+0000","last_change":"2024-04-25T09:00:07.202467+0000","last_active":"2024-04-25T09:00:08.208330+0000","last_peered":"2024-04-25T09:00:08.208330+0000","last_clean":"2024-04-25T09:00:08.208330+0000","last_became_active":"2024-04-25T09:00:07.202132+0000","last_became_peered":"2024-04-25T09:00:07.202132+0000","last_unstale":"2024-04-25T09:00:08.208330+0000","last_undegraded":"2024-04-25T09:00:08.208330+0000","last_fullsized":"2024-04-25T09:00:08.208330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:47.949850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.207960+0000","last_change":"2024-04-25T09:00:07.212524+0000","last_active":"2024-04-25T09:00:08.207960+0000","last_peered":"2024-04-25T09:00:08.207960+0000","last_clean":"2024-04-25T09:00:08.207960+0000","last_became_active":"2024-04-25T09:00:07.212183+0000","last_became_peered":"2024-04-25T09:00:07.212183+0000","last_unstale":"2024-04-25T09:00:08.207960+0000","last_undegraded":"2024-04-25T09:00:08.207960+0000","last_fullsized":"2024-04-25T09:00:08.207960+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:24.566719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211035+0000","last_change":"2024-04-25T09:00:07.213714+0000","last_active":"2024-04-25T09:00:08.211035+0000","last_peered":"2024-04-25T09:00:08.211035+0000","last_clean":"2024-04-25T09:00:08.211035+0000","last_became_active":"2024-04-25T09:00:07.213392+0000","last_became_peered":"2024-04-25T09:00:07.213392+0000","last_unstale":"2024-04-25T09:00:08.211035+0000","last_undegraded":"2024-04-25T09:00:08.211035+0000","last_fullsized":"2024-04-25T09:00:08.211035+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:38.974851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009184+0000","last_change":"2024-04-25T09:00:07.205218+0000","last_active":"2024-04-25T09:00:09.009184+0000","last_peered":"2024-04-25T09:00:09.009184+0000","last_clean":"2024-04-25T09:00:09.009184+0000","last_became_active":"2024-04-25T09:00:07.204930+0000","last_became_peered":"2024-04-25T09:00:07.204930+0000","last_unstale":"2024-04-25T09:00:09.009184+0000","last_undegraded":"2024-04-25T09:00:09.009184+0000","last_fullsized":"2024-04-25T09:00:09.009184+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:29.980863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009222+0000","last_change":"2024-04-25T09:00:07.212712+0000","last_active":"2024-04-25T09:00:09.009222+0000","last_peered":"2024-04-25T09:00:09.009222+0000","last_clean":"2024-04-25T09:00:09.009222+0000","last_became_active":"2024-04-25T09:00:07.212426+0000","last_became_peered":"2024-04-25T09:00:07.212426+0000","last_unstale":"2024-04-25T09:00:09.009222+0000","last_undegraded":"2024-04-25T09:00:09.009222+0000","last_fullsized":"2024-04-25T09:00:09.009222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:14.595816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.204708+0000","last_change":"2024-04-25T09:00:07.209587+0000","last_active":"2024-04-25T09:00:08.204708+0000","last_peered":"2024-04-25T09:00:08.204708+0000","last_clean":"2024-04-25T09:00:08.204708+0000","last_became_active":"2024-04-25T09:00:07.208007+0000","last_became_peered":"2024-04-25T09:00:07.208007+0000","last_unstale":"2024-04-25T09:00:08.204708+0000","last_undegraded":"2024-04-25T09:00:08.204708+0000","last_fullsized":"2024-04-25T09:00:08.204708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:22.037660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009475+0000","last_change":"2024-04-25T09:00:07.215118+0000","last_active":"2024-04-25T09:00:09.009475+0000","last_peered":"2024-04-25T09:00:09.009475+0000","last_clean":"2024-04-25T09:00:09.009475+0000","last_became_active":"2024-04-25T09:00:07.214868+0000","last_became_peered":"2024-04-25T09:00:07.214868+0000","last_unstale":"2024-04-25T09:00:09.009475+0000","last_undegraded":"2024-04-25T09:00:09.009475+0000","last_fullsized":"2024-04-25T09:00:09.009475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:17.155153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009057+0000","last_change":"2024-04-25T09:00:07.221048+0000","last_active":"2024-04-25T09:00:09.009057+0000","last_peered":"2024-04-25T09:00:09.009057+0000","last_clean":"2024-04-25T09:00:09.009057+0000","last_became_active":"2024-04-25T09:00:07.219526+0000","last_became_peered":"2024-04-25T09:00:07.219526+0000","last_unstale":"2024-04-25T09:00:09.009057+0000","last_undegraded":"2024-04-25T09:00:09.009057+0000","last_fullsized":"2024-04-25T09:00:09.009057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:34.415974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008767+0000","last_change":"2024-04-25T09:00:07.208548+0000","last_active":"2024-04-25T09:00:09.008767+0000","last_peered":"2024-04-25T09:00:09.008767+0000","last_clean":"2024-04-25T09:00:09.008767+0000","last_became_active":"2024-04-25T09:00:07.208244+0000","last_became_peered":"2024-04-25T09:00:07.208244+0000","last_unstale":"2024-04-25T09:00:09.008767+0000","last_undegraded":"2024-04-25T09:00:09.008767+0000","last_fullsized":"2024-04-25T09:00:09.008767+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:30.885172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009135+0000","last_change":"2024-04-25T09:00:07.219912+0000","last_active":"2024-04-25T09:00:09.009135+0000","last_peered":"2024-04-25T09:00:09.009135+0000","last_clean":"2024-04-25T09:00:09.009135+0000","last_became_active":"2024-04-25T09:00:07.219469+0000","last_became_peered":"2024-04-25T09:00:07.219469+0000","last_unstale":"2024-04-25T09:00:09.009135+0000","last_undegraded":"2024-04-25T09:00:09.009135+0000","last_fullsized":"2024-04-25T09:00:09.009135+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:52.720801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.213385+0000","last_change":"2024-04-25T09:00:07.208861+0000","last_active":"2024-04-25T09:00:08.213385+0000","last_peered":"2024-04-25T09:00:08.213385+0000","last_clean":"2024-04-25T09:00:08.213385+0000","last_became_active":"2024-04-25T09:00:07.208510+0000","last_became_peered":"2024-04-25T09:00:07.208510+0000","last_unstale":"2024-04-25T09:00:08.213385+0000","last_undegraded":"2024-04-25T09:00:08.213385+0000","last_fullsized":"2024-04-25T09:00:08.213385+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:55.859698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.204849+0000","last_change":"2024-04-25T09:00:07.212288+0000","last_active":"2024-04-25T09:00:08.204849+0000","last_peered":"2024-04-25T09:00:08.204849+0000","last_clean":"2024-04-25T09:00:08.204849+0000","last_became_active":"2024-04-25T09:00:07.211629+0000","last_became_peered":"2024-04-25T09:00:07.211629+0000","last_unstale":"2024-04-25T09:00:08.204849+0000","last_undegraded":"2024-04-25T09:00:08.204849+0000","last_fullsized":"2024-04-25T09:00:08.204849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:38.750935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208553+0000","last_change":"2024-04-25T09:00:07.211058+0000","last_active":"2024-04-25T09:00:08.208553+0000","last_peered":"2024-04-25T09:00:08.208553+0000","last_clean":"2024-04-25T09:00:08.208553+0000","last_became_active":"2024-04-25T09:00:07.210348+0000","last_became_peered":"2024-04-25T09:00:07.210348+0000","last_unstale":"2024-04-25T09:00:08.208553+0000","last_undegraded":"2024-04-25T09:00:08.208553+0000","last_fullsized":"2024-04-25T09:00:08.208553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:21.513562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211171+0000","last_change":"2024-04-25T09:00:07.206826+0000","last_active":"2024-04-25T09:00:08.211171+0000","last_peered":"2024-04-25T09:00:08.211171+0000","last_clean":"2024-04-25T09:00:08.211171+0000","last_became_active":"2024-04-25T09:00:07.206492+0000","last_became_peered":"2024-04-25T09:00:07.206492+0000","last_unstale":"2024-04-25T09:00:08.211171+0000","last_undegraded":"2024-04-25T09:00:08.211171+0000","last_fullsized":"2024-04-25T09:00:08.211171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:35.689734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.204893+0000","last_change":"2024-04-25T09:00:07.213849+0000","last_active":"2024-04-25T09:00:08.204893+0000","last_peered":"2024-04-25T09:00:08.204893+0000","last_clean":"2024-04-25T09:00:08.204893+0000","last_became_active":"2024-04-25T09:00:07.213589+0000","last_became_peered":"2024-04-25T09:00:07.213589+0000","last_unstale":"2024-04-25T09:00:08.204893+0000","last_undegraded":"2024-04-25T09:00:08.204893+0000","last_fullsized":"2024-04-25T09:00:08.204893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:16.656139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009560+0000","last_change":"2024-04-25T09:00:07.217117+0000","last_active":"2024-04-25T09:00:09.009560+0000","last_peered":"2024-04-25T09:00:09.009560+0000","last_clean":"2024-04-25T09:00:09.009560+0000","last_became_active":"2024-04-25T09:00:07.216450+0000","last_became_peered":"2024-04-25T09:00:07.216450+0000","last_unstale":"2024-04-25T09:00:09.009560+0000","last_undegraded":"2024-04-25T09:00:09.009560+0000","last_fullsized":"2024-04-25T09:00:09.009560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:20.042208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008860+0000","last_change":"2024-04-25T09:00:07.221465+0000","last_active":"2024-04-25T09:00:09.008860+0000","last_peered":"2024-04-25T09:00:09.008860+0000","last_clean":"2024-04-25T09:00:09.008860+0000","last_became_active":"2024-04-25T09:00:07.221195+0000","last_became_peered":"2024-04-25T09:00:07.221195+0000","last_unstale":"2024-04-25T09:00:09.008860+0000","last_undegraded":"2024-04-25T09:00:09.008860+0000","last_fullsized":"2024-04-25T09:00:09.008860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.569301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.204537+0000","last_change":"2024-04-25T09:00:07.210426+0000","last_active":"2024-04-25T09:00:08.204537+0000","last_peered":"2024-04-25T09:00:08.204537+0000","last_clean":"2024-04-25T09:00:08.204537+0000","last_became_active":"2024-04-25T09:00:07.210152+0000","last_became_peered":"2024-04-25T09:00:07.210152+0000","last_unstale":"2024-04-25T09:00:08.204537+0000","last_undegraded":"2024-04-25T09:00:08.204537+0000","last_fullsized":"2024-04-25T09:00:08.204537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:24.181604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.210931+0000","last_change":"2024-04-25T09:00:07.224003+0000","last_active":"2024-04-25T09:00:08.210931+0000","last_peered":"2024-04-25T09:00:08.210931+0000","last_clean":"2024-04-25T09:00:08.210931+0000","last_became_active":"2024-04-25T09:00:07.222875+0000","last_became_peered":"2024-04-25T09:00:07.222875+0000","last_unstale":"2024-04-25T09:00:08.210931+0000","last_undegraded":"2024-04-25T09:00:08.210931+0000","last_fullsized":"2024-04-25T09:00:08.210931+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:59.312579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211973+0000","last_change":"2024-04-25T09:00:07.220511+0000","last_active":"2024-04-25T09:00:08.211973+0000","last_peered":"2024-04-25T09:00:08.211973+0000","last_clean":"2024-04-25T09:00:08.211973+0000","last_became_active":"2024-04-25T09:00:07.220238+0000","last_became_peered":"2024-04-25T09:00:07.220238+0000","last_unstale":"2024-04-25T09:00:08.211973+0000","last_undegraded":"2024-04-25T09:00:08.211973+0000","last_fullsized":"2024-04-25T09:00:08.211973+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.569301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211132+0000","last_change":"2024-04-25T09:00:06.199616+0000","last_active":"2024-04-25T09:00:08.211132+0000","last_peered":"2024-04-25T09:00:08.211132+0000","last_clean":"2024-04-25T09:00:08.211132+0000","last_became_active":"2024-04-25T09:00:06.199305+0000","last_became_peered":"2024-04-25T09:00:06.199305+0000","last_unstale":"2024-04-25T09:00:08.211132+0000","last_undegraded":"2024-04-25T09:00:08.211132+0000","last_fullsized":"2024-04-25T09:00:08.211132+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:01.809204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009028+0000","last_change":"2024-04-25T09:00:07.221234+0000","last_active":"2024-04-25T09:00:09.009028+0000","last_peered":"2024-04-25T09:00:09.009028+0000","last_clean":"2024-04-25T09:00:09.009028+0000","last_became_active":"2024-04-25T09:00:07.220952+0000","last_became_peered":"2024-04-25T09:00:07.220952+0000","last_unstale":"2024-04-25T09:00:09.009028+0000","last_undegraded":"2024-04-25T09:00:09.009028+0000","last_fullsized":"2024-04-25T09:00:09.009028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:57.030765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009161+0000","last_change":"2024-04-25T09:00:06.202408+0000","last_active":"2024-04-25T09:00:09.009161+0000","last_peered":"2024-04-25T09:00:09.009161+0000","last_clean":"2024-04-25T09:00:09.009161+0000","last_became_active":"2024-04-25T09:00:06.200858+0000","last_became_peered":"2024-04-25T09:00:06.200858+0000","last_unstale":"2024-04-25T09:00:09.009161+0000","last_undegraded":"2024-04-25T09:00:09.009161+0000","last_fullsized":"2024-04-25T09:00:09.009161+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:37.970837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211189+0000","last_change":"2024-04-25T09:00:07.211749+0000","last_active":"2024-04-25T09:00:08.211189+0000","last_peered":"2024-04-25T09:00:08.211189+0000","last_clean":"2024-04-25T09:00:08.211189+0000","last_became_active":"2024-04-25T09:00:07.211426+0000","last_became_peered":"2024-04-25T09:00:07.211426+0000","last_unstale":"2024-04-25T09:00:08.211189+0000","last_undegraded":"2024-04-25T09:00:08.211189+0000","last_fullsized":"2024-04-25T09:00:08.211189+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:32.998364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211385+0000","last_change":"2024-04-25T09:00:06.203421+0000","last_active":"2024-04-25T09:00:08.211385+0000","last_peered":"2024-04-25T09:00:08.211385+0000","last_clean":"2024-04-25T09:00:08.211385+0000","last_became_active":"2024-04-25T09:00:06.203097+0000","last_became_peered":"2024-04-25T09:00:06.203097+0000","last_unstale":"2024-04-25T09:00:08.211385+0000","last_undegraded":"2024-04-25T09:00:08.211385+0000","last_fullsized":"2024-04-25T09:00:08.211385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.504752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211258+0000","last_change":"2024-04-25T09:00:07.215669+0000","last_active":"2024-04-25T09:00:08.211258+0000","last_peered":"2024-04-25T09:00:08.211258+0000","last_clean":"2024-04-25T09:00:08.211258+0000","last_became_active":"2024-04-25T09:00:07.215382+0000","last_became_peered":"2024-04-25T09:00:07.215382+0000","last_unstale":"2024-04-25T09:00:08.211258+0000","last_undegraded":"2024-04-25T09:00:08.211258+0000","last_fullsized":"2024-04-25T09:00:08.211258+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:56.241375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208963+0000","last_change":"2024-04-25T09:00:06.201046+0000","last_active":"2024-04-25T09:00:08.208963+0000","last_peered":"2024-04-25T09:00:08.208963+0000","last_clean":"2024-04-25T09:00:08.208963+0000","last_became_active":"2024-04-25T09:00:06.200765+0000","last_became_peered":"2024-04-25T09:00:06.200765+0000","last_unstale":"2024-04-25T09:00:08.208963+0000","last_undegraded":"2024-04-25T09:00:08.208963+0000","last_fullsized":"2024-04-25T09:00:08.208963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:58.308566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008941+0000","last_change":"2024-04-25T09:00:07.203623+0000","last_active":"2024-04-25T09:00:09.008941+0000","last_peered":"2024-04-25T09:00:09.008941+0000","last_clean":"2024-04-25T09:00:09.008941+0000","last_became_active":"2024-04-25T09:00:07.203335+0000","last_became_peered":"2024-04-25T09:00:07.203335+0000","last_unstale":"2024-04-25T09:00:09.008941+0000","last_undegraded":"2024-04-25T09:00:09.008941+0000","last_fullsized":"2024-04-25T09:00:09.008941+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:57.204291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208156+0000","last_change":"2024-04-25T09:00:06.198409+0000","last_active":"2024-04-25T09:00:08.208156+0000","last_peered":"2024-04-25T09:00:08.208156+0000","last_clean":"2024-04-25T09:00:08.208156+0000","last_became_active":"2024-04-25T09:00:06.198093+0000","last_became_peered":"2024-04-25T09:00:06.198093+0000","last_unstale":"2024-04-25T09:00:08.208156+0000","last_undegraded":"2024-04-25T09:00:08.208156+0000","last_fullsized":"2024-04-25T09:00:08.208156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:48.720837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009283+0000","last_change":"2024-04-25T09:00:07.218133+0000","last_active":"2024-04-25T09:00:09.009283+0000","last_peered":"2024-04-25T09:00:09.009283+0000","last_clean":"2024-04-25T09:00:09.009283+0000","last_became_active":"2024-04-25T09:00:07.212420+0000","last_became_peered":"2024-04-25T09:00:07.212420+0000","last_unstale":"2024-04-25T09:00:09.009283+0000","last_undegraded":"2024-04-25T09:00:09.009283+0000","last_fullsized":"2024-04-25T09:00:09.009283+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:47.453984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211045+0000","last_change":"2024-04-25T09:00:06.197490+0000","last_active":"2024-04-25T09:00:08.211045+0000","last_peered":"2024-04-25T09:00:08.211045+0000","last_clean":"2024-04-25T09:00:08.211045+0000","last_became_active":"2024-04-25T09:00:06.196586+0000","last_became_peered":"2024-04-25T09:00:06.196586+0000","last_unstale":"2024-04-25T09:00:08.211045+0000","last_undegraded":"2024-04-25T09:00:08.211045+0000","last_fullsized":"2024-04-25T09:00:08.211045+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:58.258250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.213452+0000","last_change":"2024-04-25T09:00:07.206618+0000","last_active":"2024-04-25T09:00:08.213452+0000","last_peered":"2024-04-25T09:00:08.213452+0000","last_clean":"2024-04-25T09:00:08.213452+0000","last_became_active":"2024-04-25T09:00:07.206317+0000","last_became_peered":"2024-04-25T09:00:07.206317+0000","last_unstale":"2024-04-25T09:00:08.213452+0000","last_undegraded":"2024-04-25T09:00:08.213452+0000","last_fullsized":"2024-04-25T09:00:08.213452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:57.030765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208301+0000","last_change":"2024-04-25T09:00:06.200363+0000","last_active":"2024-04-25T09:00:08.208301+0000","last_peered":"2024-04-25T09:00:08.208301+0000","last_clean":"2024-04-25T09:00:08.208301+0000","last_became_active":"2024-04-25T09:00:06.200060+0000","last_became_peered":"2024-04-25T09:00:06.200060+0000","last_unstale":"2024-04-25T09:00:08.208301+0000","last_undegraded":"2024-04-25T09:00:08.208301+0000","last_fullsized":"2024-04-25T09:00:08.208301+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:31.495156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008789+0000","last_change":"2024-04-25T09:00:07.205827+0000","last_active":"2024-04-25T09:00:09.008789+0000","last_peered":"2024-04-25T09:00:09.008789+0000","last_clean":"2024-04-25T09:00:09.008789+0000","last_became_active":"2024-04-25T09:00:07.205443+0000","last_became_peered":"2024-04-25T09:00:07.205443+0000","last_unstale":"2024-04-25T09:00:09.008789+0000","last_undegraded":"2024-04-25T09:00:09.008789+0000","last_fullsized":"2024-04-25T09:00:09.008789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.207915+0000","last_change":"2024-04-25T09:00:06.203119+0000","last_active":"2024-04-25T09:00:08.207915+0000","last_peered":"2024-04-25T09:00:08.207915+0000","last_clean":"2024-04-25T09:00:08.207915+0000","last_became_active":"2024-04-25T09:00:06.202821+0000","last_became_peered":"2024-04-25T09:00:06.202821+0000","last_unstale":"2024-04-25T09:00:08.207915+0000","last_undegraded":"2024-04-25T09:00:08.207915+0000","last_fullsized":"2024-04-25T09:00:08.207915+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:23.480824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.209431+0000","last_change":"2024-04-25T09:00:07.214656+0000","last_active":"2024-04-25T09:00:08.209431+0000","last_peered":"2024-04-25T09:00:08.209431+0000","last_clean":"2024-04-25T09:00:08.209431+0000","last_became_active":"2024-04-25T09:00:07.213911+0000","last_became_peered":"2024-04-25T09:00:07.213911+0000","last_unstale":"2024-04-25T09:00:08.209431+0000","last_undegraded":"2024-04-25T09:00:08.209431+0000","last_fullsized":"2024-04-25T09:00:08.209431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009351+0000","last_change":"2024-04-25T09:00:06.196201+0000","last_active":"2024-04-25T09:00:09.009351+0000","last_peered":"2024-04-25T09:00:09.009351+0000","last_clean":"2024-04-25T09:00:09.009351+0000","last_became_active":"2024-04-25T09:00:06.195618+0000","last_became_peered":"2024-04-25T09:00:06.195618+0000","last_unstale":"2024-04-25T09:00:09.009351+0000","last_undegraded":"2024-04-25T09:00:09.009351+0000","last_fullsized":"2024-04-25T09:00:09.009351+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.391108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009405+0000","last_change":"2024-04-25T09:00:07.218328+0000","last_active":"2024-04-25T09:00:09.009405+0000","last_peered":"2024-04-25T09:00:09.009405+0000","last_clean":"2024-04-25T09:00:09.009405+0000","last_became_active":"2024-04-25T09:00:07.218045+0000","last_became_peered":"2024-04-25T09:00:07.218045+0000","last_unstale":"2024-04-25T09:00:09.009405+0000","last_undegraded":"2024-04-25T09:00:09.009405+0000","last_fullsized":"2024-04-25T09:00:09.009405+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:01:11.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009223+0000","last_change":"2024-04-25T09:00:06.203661+0000","last_active":"2024-04-25T09:00:09.009223+0000","last_peered":"2024-04-25T09:00:09.009223+0000","last_clean":"2024-04-25T09:00:09.009223+0000","last_became_active":"2024-04-25T09:00:06.201182+0000","last_became_peered":"2024-04-25T09:00:06.201182+0000","last_unstale":"2024-04-25T09:00:09.009223+0000","last_undegraded":"2024-04-25T09:00:09.009223+0000","last_fullsized":"2024-04-25T09:00:09.009223+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:28.565287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008874+0000","last_change":"2024-04-25T09:00:07.221850+0000","last_active":"2024-04-25T09:00:09.008874+0000","last_peered":"2024-04-25T09:00:09.008874+0000","last_clean":"2024-04-25T09:00:09.008874+0000","last_became_active":"2024-04-25T09:00:07.220247+0000","last_became_peered":"2024-04-25T09:00:07.220247+0000","last_unstale":"2024-04-25T09:00:09.008874+0000","last_undegraded":"2024-04-25T09:00:09.008874+0000","last_fullsized":"2024-04-25T09:00:09.008874+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:55.859698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009491+0000","last_change":"2024-04-25T09:00:06.198508+0000","last_active":"2024-04-25T09:00:09.009491+0000","last_peered":"2024-04-25T09:00:09.009491+0000","last_clean":"2024-04-25T09:00:09.009491+0000","last_became_active":"2024-04-25T09:00:06.198162+0000","last_became_peered":"2024-04-25T09:00:06.198162+0000","last_unstale":"2024-04-25T09:00:09.009491+0000","last_undegraded":"2024-04-25T09:00:09.009491+0000","last_fullsized":"2024-04-25T09:00:09.009491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:57.421924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009418+0000","last_change":"2024-04-25T09:00:07.218393+0000","last_active":"2024-04-25T09:00:09.009418+0000","last_peered":"2024-04-25T09:00:09.009418+0000","last_clean":"2024-04-25T09:00:09.009418+0000","last_became_active":"2024-04-25T09:00:07.217976+0000","last_became_peered":"2024-04-25T09:00:07.217976+0000","last_unstale":"2024-04-25T09:00:09.009418+0000","last_undegraded":"2024-04-25T09:00:09.009418+0000","last_fullsized":"2024-04-25T09:00:09.009418+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:49.434612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208306+0000","last_change":"2024-04-25T09:00:06.199821+0000","last_active":"2024-04-25T09:00:08.208306+0000","last_peered":"2024-04-25T09:00:08.208306+0000","last_clean":"2024-04-25T09:00:08.208306+0000","last_became_active":"2024-04-25T09:00:06.199310+0000","last_became_peered":"2024-04-25T09:00:06.199310+0000","last_unstale":"2024-04-25T09:00:08.208306+0000","last_undegraded":"2024-04-25T09:00:08.208306+0000","last_fullsized":"2024-04-25T09:00:08.208306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:57.120298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208465+0000","last_change":"2024-04-25T09:00:07.212928+0000","last_active":"2024-04-25T09:00:08.208465+0000","last_peered":"2024-04-25T09:00:08.208465+0000","last_clean":"2024-04-25T09:00:08.208465+0000","last_became_active":"2024-04-25T09:00:07.212679+0000","last_became_peered":"2024-04-25T09:00:07.212679+0000","last_unstale":"2024-04-25T09:00:08.208465+0000","last_undegraded":"2024-04-25T09:00:08.208465+0000","last_fullsized":"2024-04-25T09:00:08.208465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:22.519672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009381+0000","last_change":"2024-04-25T09:00:06.202728+0000","last_active":"2024-04-25T09:00:09.009381+0000","last_peered":"2024-04-25T09:00:09.009381+0000","last_clean":"2024-04-25T09:00:09.009381+0000","last_became_active":"2024-04-25T09:00:06.201927+0000","last_became_peered":"2024-04-25T09:00:06.201927+0000","last_unstale":"2024-04-25T09:00:09.009381+0000","last_undegraded":"2024-04-25T09:00:09.009381+0000","last_fullsized":"2024-04-25T09:00:09.009381+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:22.845085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008880+0000","last_change":"2024-04-25T09:00:07.220393+0000","last_active":"2024-04-25T09:00:09.008880+0000","last_peered":"2024-04-25T09:00:09.008880+0000","last_clean":"2024-04-25T09:00:09.008880+0000","last_became_active":"2024-04-25T09:00:07.220120+0000","last_became_peered":"2024-04-25T09:00:07.220120+0000","last_unstale":"2024-04-25T09:00:09.008880+0000","last_undegraded":"2024-04-25T09:00:09.008880+0000","last_fullsized":"2024-04-25T09:00:09.008880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:22.519672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.213522+0000","last_change":"2024-04-25T09:00:06.193400+0000","last_active":"2024-04-25T09:00:08.213522+0000","last_peered":"2024-04-25T09:00:08.213522+0000","last_clean":"2024-04-25T09:00:08.213522+0000","last_became_active":"2024-04-25T09:00:06.193121+0000","last_became_peered":"2024-04-25T09:00:06.193121+0000","last_unstale":"2024-04-25T09:00:08.213522+0000","last_undegraded":"2024-04-25T09:00:08.213522+0000","last_fullsized":"2024-04-25T09:00:08.213522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:37.156322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.207860+0000","last_change":"2024-04-25T09:00:07.215022+0000","last_active":"2024-04-25T09:00:08.207860+0000","last_peered":"2024-04-25T09:00:08.207860+0000","last_clean":"2024-04-25T09:00:08.207860+0000","last_became_active":"2024-04-25T09:00:07.214506+0000","last_became_peered":"2024-04-25T09:00:07.214506+0000","last_unstale":"2024-04-25T09:00:08.207860+0000","last_undegraded":"2024-04-25T09:00:08.207860+0000","last_fullsized":"2024-04-25T09:00:08.207860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:32.092240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208396+0000","last_change":"2024-04-25T09:00:06.198624+0000","last_active":"2024-04-25T09:00:08.208396+0000","last_peered":"2024-04-25T09:00:08.208396+0000","last_clean":"2024-04-25T09:00:08.208396+0000","last_became_active":"2024-04-25T09:00:06.198238+0000","last_became_peered":"2024-04-25T09:00:06.198238+0000","last_unstale":"2024-04-25T09:00:08.208396+0000","last_undegraded":"2024-04-25T09:00:08.208396+0000","last_fullsized":"2024-04-25T09:00:08.208396+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:28.284535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009186+0000","last_change":"2024-04-25T09:00:07.221613+0000","last_active":"2024-04-25T09:00:09.009186+0000","last_peered":"2024-04-25T09:00:09.009186+0000","last_clean":"2024-04-25T09:00:09.009186+0000","last_became_active":"2024-04-25T09:00:07.221228+0000","last_became_peered":"2024-04-25T09:00:07.221228+0000","last_unstale":"2024-04-25T09:00:09.009186+0000","last_undegraded":"2024-04-25T09:00:09.009186+0000","last_fullsized":"2024-04-25T09:00:09.009186+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:59.708469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008703+0000","last_change":"2024-04-25T09:00:06.201475+0000","last_active":"2024-04-25T09:00:09.008703+0000","last_peered":"2024-04-25T09:00:09.008703+0000","last_clean":"2024-04-25T09:00:09.008703+0000","last_became_active":"2024-04-25T09:00:06.201166+0000","last_became_peered":"2024-04-25T09:00:06.201166+0000","last_unstale":"2024-04-25T09:00:09.008703+0000","last_undegraded":"2024-04-25T09:00:09.008703+0000","last_fullsized":"2024-04-25T09:00:09.008703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:43.278902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009281+0000","last_change":"2024-04-25T09:00:07.221568+0000","last_active":"2024-04-25T09:00:09.009281+0000","last_peered":"2024-04-25T09:00:09.009281+0000","last_clean":"2024-04-25T09:00:09.009281+0000","last_became_active":"2024-04-25T09:00:07.221277+0000","last_became_peered":"2024-04-25T09:00:07.221277+0000","last_unstale":"2024-04-25T09:00:09.009281+0000","last_undegraded":"2024-04-25T09:00:09.009281+0000","last_fullsized":"2024-04-25T09:00:09.009281+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:49.049536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009295+0000","last_change":"2024-04-25T09:00:06.200834+0000","last_active":"2024-04-25T09:00:09.009295+0000","last_peered":"2024-04-25T09:00:09.009295+0000","last_clean":"2024-04-25T09:00:09.009295+0000","last_became_active":"2024-04-25T09:00:06.200467+0000","last_became_peered":"2024-04-25T09:00:06.200467+0000","last_unstale":"2024-04-25T09:00:09.009295+0000","last_undegraded":"2024-04-25T09:00:09.009295+0000","last_fullsized":"2024-04-25T09:00:09.009295+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:24.365388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208905+0000","last_change":"2024-04-25T09:00:07.218475+0000","last_active":"2024-04-25T09:00:08.208905+0000","last_peered":"2024-04-25T09:00:08.208905+0000","last_clean":"2024-04-25T09:00:08.208905+0000","last_became_active":"2024-04-25T09:00:07.218166+0000","last_became_peered":"2024-04-25T09:00:07.218166+0000","last_unstale":"2024-04-25T09:00:08.208905+0000","last_undegraded":"2024-04-25T09:00:08.208905+0000","last_fullsized":"2024-04-25T09:00:08.208905+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:13.657307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211316+0000","last_change":"2024-04-25T09:00:06.197838+0000","last_active":"2024-04-25T09:00:08.211316+0000","last_peered":"2024-04-25T09:00:08.211316+0000","last_clean":"2024-04-25T09:00:08.211316+0000","last_became_active":"2024-04-25T09:00:06.197304+0000","last_became_peered":"2024-04-25T09:00:06.197304+0000","last_unstale":"2024-04-25T09:00:08.211316+0000","last_undegraded":"2024-04-25T09:00:08.211316+0000","last_fullsized":"2024-04-25T09:00:08.211316+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.544582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009637+0000","last_change":"2024-04-25T09:00:07.200351+0000","last_active":"2024-04-25T09:00:09.009637+0000","last_peered":"2024-04-25T09:00:09.009637+0000","last_clean":"2024-04-25T09:00:09.009637+0000","last_became_active":"2024-04-25T09:00:07.199944+0000","last_became_peered":"2024-04-25T09:00:07.199944+0000","last_unstale":"2024-04-25T09:00:09.009637+0000","last_undegraded":"2024-04-25T09:00:09.009637+0000","last_fullsized":"2024-04-25T09:00:09.009637+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:06.643335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.209214+0000","last_change":"2024-04-25T09:00:06.200257+0000","last_active":"2024-04-25T09:00:08.209214+0000","last_peered":"2024-04-25T09:00:08.209214+0000","last_clean":"2024-04-25T09:00:08.209214+0000","last_became_active":"2024-04-25T09:00:06.199977+0000","last_became_peered":"2024-04-25T09:00:06.199977+0000","last_unstale":"2024-04-25T09:00:08.209214+0000","last_undegraded":"2024-04-25T09:00:08.209214+0000","last_fullsized":"2024-04-25T09:00:08.209214+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:07.176226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009461+0000","last_change":"2024-04-25T09:00:07.221078+0000","last_active":"2024-04-25T09:00:09.009461+0000","last_peered":"2024-04-25T09:00:09.009461+0000","last_clean":"2024-04-25T09:00:09.009461+0000","last_became_active":"2024-04-25T09:00:07.220776+0000","last_became_peered":"2024-04-25T09:00:07.220776+0000","last_unstale":"2024-04-25T09:00:09.009461+0000","last_undegraded":"2024-04-25T09:00:09.009461+0000","last_fullsized":"2024-04-25T09:00:09.009461+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:51.025893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211308+0000","last_change":"2024-04-25T09:00:06.201254+0000","last_active":"2024-04-25T09:00:08.211308+0000","last_peered":"2024-04-25T09:00:08.211308+0000","last_clean":"2024-04-25T09:00:08.211308+0000","last_became_active":"2024-04-25T09:00:06.200978+0000","last_became_peered":"2024-04-25T09:00:06.200978+0000","last_unstale":"2024-04-25T09:00:08.211308+0000","last_undegraded":"2024-04-25T09:00:08.211308+0000","last_fullsized":"2024-04-25T09:00:08.211308+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:19.124855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208632+0000","last_change":"2024-04-25T09:00:07.212289+0000","last_active":"2024-04-25T09:00:08.208632+0000","last_peered":"2024-04-25T09:00:08.208632+0000","last_clean":"2024-04-25T09:00:08.208632+0000","last_became_active":"2024-04-25T09:00:07.211971+0000","last_became_peered":"2024-04-25T09:00:07.211971+0000","last_unstale":"2024-04-25T09:00:08.208632+0000","last_undegraded":"2024-04-25T09:00:08.208632+0000","last_fullsized":"2024-04-25T09:00:08.208632+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:52.720801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009572+0000","last_change":"2024-04-25T09:00:06.202223+0000","last_active":"2024-04-25T09:00:09.009572+0000","last_peered":"2024-04-25T09:00:09.009572+0000","last_clean":"2024-04-25T09:00:09.009572+0000","last_became_active":"2024-04-25T09:00:06.200842+0000","last_became_peered":"2024-04-25T09:00:06.200842+0000","last_unstale":"2024-04-25T09:00:09.009572+0000","last_undegraded":"2024-04-25T09:00:09.009572+0000","last_fullsized":"2024-04-25T09:00:09.009572+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:33.411960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211432+0000","last_change":"2024-04-25T09:00:07.212614+0000","last_active":"2024-04-25T09:00:08.211432+0000","last_peered":"2024-04-25T09:00:08.211432+0000","last_clean":"2024-04-25T09:00:08.211432+0000","last_became_active":"2024-04-25T09:00:07.212299+0000","last_became_peered":"2024-04-25T09:00:07.212299+0000","last_unstale":"2024-04-25T09:00:08.211432+0000","last_undegraded":"2024-04-25T09:00:08.211432+0000","last_fullsized":"2024-04-25T09:00:08.211432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:23.849098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008751+0000","last_change":"2024-04-25T09:00:06.196060+0000","last_active":"2024-04-25T09:00:09.008751+0000","last_peered":"2024-04-25T09:00:09.008751+0000","last_clean":"2024-04-25T09:00:09.008751+0000","last_became_active":"2024-04-25T09:00:06.195716+0000","last_became_peered":"2024-04-25T09:00:06.195716+0000","last_unstale":"2024-04-25T09:00:09.008751+0000","last_undegraded":"2024-04-25T09:00:09.008751+0000","last_fullsized":"2024-04-25T09:00:09.008751+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:37.746921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.210956+0000","last_change":"2024-04-25T09:00:07.224456+0000","last_active":"2024-04-25T09:00:08.210956+0000","last_peered":"2024-04-25T09:00:08.210956+0000","last_clean":"2024-04-25T09:00:08.210956+0000","last_became_active":"2024-04-25T09:00:07.223113+0000","last_became_peered":"2024-04-25T09:00:07.223113+0000","last_unstale":"2024-04-25T09:00:08.210956+0000","last_undegraded":"2024-04-25T09:00:08.210956+0000","last_fullsized":"2024-04-25T09:00:08.210956+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:08.180240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208147+0000","last_change":"2024-04-25T09:00:06.204013+0000","last_active":"2024-04-25T09:00:08.208147+0000","last_peered":"2024-04-25T09:00:08.208147+0000","last_clean":"2024-04-25T09:00:08.208147+0000","last_became_active":"2024-04-25T09:00:06.203786+0000","last_became_peered":"2024-04-25T09:00:06.203786+0000","last_unstale":"2024-04-25T09:00:08.208147+0000","last_undegraded":"2024-04-25T09:00:08.208147+0000","last_fullsized":"2024-04-25T09:00:08.208147+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:35.195921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208719+0000","last_change":"2024-04-25T09:00:07.217399+0000","last_active":"2024-04-25T09:00:08.208719+0000","last_peered":"2024-04-25T09:00:08.208719+0000","last_clean":"2024-04-25T09:00:08.208719+0000","last_became_active":"2024-04-25T09:00:07.217083+0000","last_became_peered":"2024-04-25T09:00:07.217083+0000","last_unstale":"2024-04-25T09:00:08.208719+0000","last_undegraded":"2024-04-25T09:00:08.208719+0000","last_fullsized":"2024-04-25T09:00:08.208719+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:59.708469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009129+0000","last_change":"2024-04-25T09:00:06.203068+0000","last_active":"2024-04-25T09:00:09.009129+0000","last_peered":"2024-04-25T09:00:09.009129+0000","last_clean":"2024-04-25T09:00:09.009129+0000","last_became_active":"2024-04-25T09:00:06.202810+0000","last_became_peered":"2024-04-25T09:00:06.202810+0000","last_unstale":"2024-04-25T09:00:09.009129+0000","last_undegraded":"2024-04-25T09:00:09.009129+0000","last_fullsized":"2024-04-25T09:00:09.009129+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:36.038648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208998+0000","last_change":"2024-04-25T09:00:07.211188+0000","last_active":"2024-04-25T09:00:08.208998+0000","last_peered":"2024-04-25T09:00:08.208998+0000","last_clean":"2024-04-25T09:00:08.208998+0000","last_became_active":"2024-04-25T09:00:07.210903+0000","last_became_peered":"2024-04-25T09:00:07.210903+0000","last_unstale":"2024-04-25T09:00:08.208998+0000","last_undegraded":"2024-04-25T09:00:08.208998+0000","last_fullsized":"2024-04-25T09:00:08.208998+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:01:11.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211467+0000","last_change":"2024-04-25T09:00:06.198465+0000","last_active":"2024-04-25T09:00:08.211467+0000","last_peered":"2024-04-25T09:00:08.211467+0000","last_clean":"2024-04-25T09:00:08.211467+0000","last_became_active":"2024-04-25T09:00:06.198180+0000","last_became_peered":"2024-04-25T09:00:06.198180+0000","last_unstale":"2024-04-25T09:00:08.211467+0000","last_undegraded":"2024-04-25T09:00:08.211467+0000","last_fullsized":"2024-04-25T09:00:08.211467+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:05.561112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009033+0000","last_change":"2024-04-25T09:00:07.213967+0000","last_active":"2024-04-25T09:00:09.009033+0000","last_peered":"2024-04-25T09:00:09.009033+0000","last_clean":"2024-04-25T09:00:09.009033+0000","last_became_active":"2024-04-25T09:00:07.213398+0000","last_became_peered":"2024-04-25T09:00:07.213398+0000","last_unstale":"2024-04-25T09:00:09.009033+0000","last_undegraded":"2024-04-25T09:00:09.009033+0000","last_fullsized":"2024-04-25T09:00:09.009033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:48.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.213500+0000","last_change":"2024-04-25T09:00:06.196940+0000","last_active":"2024-04-25T09:00:08.213500+0000","last_peered":"2024-04-25T09:00:08.213500+0000","last_clean":"2024-04-25T09:00:08.213500+0000","last_became_active":"2024-04-25T09:00:06.196651+0000","last_became_peered":"2024-04-25T09:00:06.196651+0000","last_unstale":"2024-04-25T09:00:08.213500+0000","last_undegraded":"2024-04-25T09:00:08.213500+0000","last_fullsized":"2024-04-25T09:00:08.213500+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:31.989406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.211325+0000","last_change":"2024-04-25T09:00:07.207661+0000","last_active":"2024-04-25T09:00:08.211325+0000","last_peered":"2024-04-25T09:00:08.211325+0000","last_clean":"2024-04-25T09:00:08.211325+0000","last_became_active":"2024-04-25T09:00:07.207201+0000","last_became_peered":"2024-04-25T09:00:07.207201+0000","last_unstale":"2024-04-25T09:00:08.211325+0000","last_undegraded":"2024-04-25T09:00:08.211325+0000","last_fullsized":"2024-04-25T09:00:08.211325+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:25.369401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.209081+0000","last_change":"2024-04-25T09:00:06.201200+0000","last_active":"2024-04-25T09:00:08.209081+0000","last_peered":"2024-04-25T09:00:08.209081+0000","last_clean":"2024-04-25T09:00:08.209081+0000","last_became_active":"2024-04-25T09:00:06.200924+0000","last_became_peered":"2024-04-25T09:00:06.200924+0000","last_unstale":"2024-04-25T09:00:08.209081+0000","last_undegraded":"2024-04-25T09:00:08.209081+0000","last_fullsized":"2024-04-25T09:00:08.209081+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.891482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009003+0000","last_change":"2024-04-25T09:00:07.214399+0000","last_active":"2024-04-25T09:00:09.009003+0000","last_peered":"2024-04-25T09:00:09.009003+0000","last_clean":"2024-04-25T09:00:09.009003+0000","last_became_active":"2024-04-25T09:00:07.214033+0000","last_became_peered":"2024-04-25T09:00:07.214033+0000","last_unstale":"2024-04-25T09:00:09.009003+0000","last_undegraded":"2024-04-25T09:00:09.009003+0000","last_fullsized":"2024-04-25T09:00:09.009003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:17.944280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009155+0000","last_change":"2024-04-25T09:00:06.199594+0000","last_active":"2024-04-25T09:00:09.009155+0000","last_peered":"2024-04-25T09:00:09.009155+0000","last_clean":"2024-04-25T09:00:09.009155+0000","last_became_active":"2024-04-25T09:00:06.199318+0000","last_became_peered":"2024-04-25T09:00:06.199318+0000","last_unstale":"2024-04-25T09:00:09.009155+0000","last_undegraded":"2024-04-25T09:00:09.009155+0000","last_fullsized":"2024-04-25T09:00:09.009155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:24.892233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.009338+0000","last_change":"2024-04-25T09:00:07.223259+0000","last_active":"2024-04-25T09:00:09.009338+0000","last_peered":"2024-04-25T09:00:09.009338+0000","last_clean":"2024-04-25T09:00:09.009338+0000","last_became_active":"2024-04-25T09:00:07.223011+0000","last_became_peered":"2024-04-25T09:00:07.223011+0000","last_unstale":"2024-04-25T09:00:09.009338+0000","last_undegraded":"2024-04-25T09:00:09.009338+0000","last_fullsized":"2024-04-25T09:00:09.009338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:13.657307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.208423+0000","last_change":"2024-04-25T09:00:06.199988+0000","last_active":"2024-04-25T09:00:08.208423+0000","last_peered":"2024-04-25T09:00:08.208423+0000","last_clean":"2024-04-25T09:00:08.208423+0000","last_became_active":"2024-04-25T09:00:06.199325+0000","last_became_peered":"2024-04-25T09:00:06.199325+0000","last_unstale":"2024-04-25T09:00:08.208423+0000","last_undegraded":"2024-04-25T09:00:08.208423+0000","last_fullsized":"2024-04-25T09:00:08.208423+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:42.364834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008559+0000","last_change":"2024-04-25T09:00:07.209582+0000","last_active":"2024-04-25T09:00:09.008559+0000","last_peered":"2024-04-25T09:00:09.008559+0000","last_clean":"2024-04-25T09:00:09.008559+0000","last_became_active":"2024-04-25T09:00:07.209281+0000","last_became_peered":"2024-04-25T09:00:07.209281+0000","last_unstale":"2024-04-25T09:00:09.008559+0000","last_undegraded":"2024-04-25T09:00:09.008559+0000","last_fullsized":"2024-04-25T09:00:09.008559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:00.525930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008603+0000","last_change":"2024-04-25T09:00:06.195158+0000","last_active":"2024-04-25T09:00:09.008603+0000","last_peered":"2024-04-25T09:00:09.008603+0000","last_clean":"2024-04-25T09:00:09.008603+0000","last_became_active":"2024-04-25T09:00:06.194854+0000","last_became_peered":"2024-04-25T09:00:06.194854+0000","last_unstale":"2024-04-25T09:00:09.008603+0000","last_undegraded":"2024-04-25T09:00:09.008603+0000","last_fullsized":"2024-04-25T09:00:09.008603+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:15.652125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008965+0000","last_change":"2024-04-25T09:00:07.205463+0000","last_active":"2024-04-25T09:00:09.008965+0000","last_peered":"2024-04-25T09:00:09.008965+0000","last_clean":"2024-04-25T09:00:09.008965+0000","last_became_active":"2024-04-25T09:00:07.205082+0000","last_became_peered":"2024-04-25T09:00:07.205082+0000","last_unstale":"2024-04-25T09:00:09.008965+0000","last_undegraded":"2024-04-25T09:00:09.008965+0000","last_fullsized":"2024-04-25T09:00:09.008965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:34.265418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008958+0000","last_change":"2024-04-25T09:00:06.202020+0000","last_active":"2024-04-25T09:00:09.008958+0000","last_peered":"2024-04-25T09:00:09.008958+0000","last_clean":"2024-04-25T09:00:09.008958+0000","last_became_active":"2024-04-25T09:00:06.201586+0000","last_became_peered":"2024-04-25T09:00:06.201586+0000","last_unstale":"2024-04-25T09:00:09.008958+0000","last_undegraded":"2024-04-25T09:00:09.008958+0000","last_fullsized":"2024-04-25T09:00:09.008958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:55.237361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008855+0000","last_change":"2024-04-25T09:00:07.215483+0000","last_active":"2024-04-25T09:00:09.008855+0000","last_peered":"2024-04-25T09:00:09.008855+0000","last_clean":"2024-04-25T09:00:09.008855+0000","last_became_active":"2024-04-25T09:00:07.215190+0000","last_became_peered":"2024-04-25T09:00:07.215190+0000","last_unstale":"2024-04-25T09:00:09.008855+0000","last_undegraded":"2024-04-25T09:00:09.008855+0000","last_fullsized":"2024-04-25T09:00:09.008855+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:06.180030+0000","last_clean_scrub_stamp":"2024-04-25T09:00:06.180030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:15.944090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:08.213410+0000","last_change":"2024-04-25T09:00:06.200265+0000","last_active":"2024-04-25T09:00:08.213410+0000","last_peered":"2024-04-25T09:00:08.213410+0000","last_clean":"2024-04-25T09:00:08.213410+0000","last_became_active":"2024-04-25T09:00:06.199932+0000","last_became_peered":"2024-04-25T09:00:06.199932+0000","last_unstale":"2024-04-25T09:00:08.213410+0000","last_undegraded":"2024-04-25T09:00:08.213410+0000","last_fullsized":"2024-04-25T09:00:08.213410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:00:05.176017+0000","last_clean_scrub_stamp":"2024-04-25T09:00:05.176017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:37.782944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":239,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:00:09.008784+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:00:09.008784+0000","last_peered":"2024-04-25T09:00:09.008784+0000","last_clean":"2024-04-25T09:00:09.008784+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:00:09.008784+0000","last_undegraded":"2024-04-25T09:00:09.008784+0000","last_fullsized":"2024-04-25T09:00:09.008784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36600,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335240,"statfs":{"total":96636764160,"available":96599285760,"internally_reserved":0,"allocated":1286144,"data_stored":875869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":684032,"data_stored":285341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36020,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":692224,"data_stored":285993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36024,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":696320,"data_stored":286953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":692224,"data_stored":285397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":692224,"data_stored":285397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44332,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327508,"statfs":{"total":96636764160,"available":96591368192,"internally_reserved":0,"allocated":688128,"data_stored":285431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1294336,"data_stored":877903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:00:14.934 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:00:14.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:00:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.090+0000 7f691896a640 1 Processor -- start 2024-04-25T09:00:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.090+0000 7f691896a640 1 -- start start 2024-04-25T09:00:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.090+0000 7f691896a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f691415df90 0x7f69140b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.090+0000 7f691896a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69140cef40 0x7f69140b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.090+0000 7f691896a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69140d1ef0 con 0x7f69140d2f90 2024-04-25T09:00:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.090+0000 7f691896a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69140d1ca0 con 0x7f69140cef40 2024-04-25T09:00:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.090+0000 7f691896a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69140d2b00 con 0x7f691415df90 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f6912d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69140cef40 0x7f69140b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f690bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f69140d2f90 0x7f69140ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49926/0 (socket says 172.21.15.5:49926) 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f690bfff640 1 -- 172.21.15.5:0/4213418234 learned_addr learned my addr 172.21.15.5:0/4213418234 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f691259c640 1 --2- 172.21.15.5:0/4213418234 >> v2:172.21.15.80:3300/0 conn(0x7f691415df90 0x7f69140b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f6912d9d640 1 -- 172.21.15.5:0/4213418234 >> v2:172.21.15.80:3300/0 conn(0x7f691415df90 msgr2=0x7f69140b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f6912d9d640 1 --2- 172.21.15.5:0/4213418234 >> v2:172.21.15.80:3300/0 conn(0x7f691415df90 0x7f69140b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f6912d9d640 1 -- 172.21.15.5:0/4213418234 >> v1:172.21.15.5:6789/0 conn(0x7f69140d2f90 legacy=0x7f69140ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f6912d9d640 1 -- 172.21.15.5:0/4213418234 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140d21d0 con 0x7f69140cef40 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.091+0000 7f691259c640 1 --2- 172.21.15.5:0/4213418234 >> v2:172.21.15.80:3300/0 conn(0x7f691415df90 0x7f69140b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f6912d9d640 1 --2- 172.21.15.5:0/4213418234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f69140b6c70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f69140d1240 tx=0x7f690c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfb32a3f58858e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f6911d9b640 1 -- 172.21.15.5:0/4213418234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c007740 con 0x7f69140cef40 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f6911d9b640 1 -- 172.21.15.5:0/4213418234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c0078e0 con 0x7f69140cef40 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f6911d9b640 1 -- 172.21.15.5:0/4213418234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c007cb0 con 0x7f69140cef40 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 -- 172.21.15.5:0/4213418234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 msgr2=0x7f69140b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 --2- 172.21.15.5:0/4213418234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f69140b6c70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f69140d1240 tx=0x7f690c02a710 comp rx=0 tx=0).stop 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 -- 172.21.15.5:0/4213418234 shutdown_connections 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 --2- 172.21.15.5:0/4213418234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f69140b6c70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 --2- 172.21.15.5:0/4213418234 >> v2:172.21.15.80:3300/0 conn(0x7f691415df90 0x7f69140b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 -- 172.21.15.5:0/4213418234 >> 172.21.15.5:0/4213418234 conn(0x7f691406b000 msgr2=0x7f691406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 -- 172.21.15.5:0/4213418234 shutdown_connections 2024-04-25T09:00:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.092+0000 7f691896a640 1 -- 172.21.15.5:0/4213418234 wait complete. 2024-04-25T09:00:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 Processor -- start 2024-04-25T09:00:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 -- start start 2024-04-25T09:00:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f6914150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69140d2f90 0x7f69140c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69140c9ff0 0x7f69140d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140b9a30 con 0x7f69140cef40 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140d2790 con 0x7f69140c9ff0 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.094+0000 7f691896a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69140d3740 con 0x7f69140d2f90 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f6914150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f6914150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38698/0 (socket says 172.21.15.5:38698) 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 -- 172.21.15.5:0/2623315815 learned_addr learned my addr 172.21.15.5:0/2623315815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f6912d9d640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69140c9ff0 0x7f69140d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f690bfff640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69140d2f90 0x7f69140c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 -- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69140d2f90 msgr2=0x7f69140c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69140d2f90 0x7f69140c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 -- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69140c9ff0 msgr2=0x7f69140d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69140c9ff0 0x7f69140d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 -- 172.21.15.5:0/2623315815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140c8f50 con 0x7f69140cef40 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f690bfff640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69140d2f90 0x7f69140c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691259c640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f6914150f80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f690400c7f0 tx=0x7f690400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f690affd640 1 -- 172.21.15.5:0/2623315815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904015070 con 0x7f69140cef40 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f690affd640 1 -- 172.21.15.5:0/2623315815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904007820 con 0x7f69140cef40 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69140c9230 con 0x7f69140cef40 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f690affd640 1 -- 172.21.15.5:0/2623315815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904007bd0 con 0x7f69140cef40 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.095+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69140c97f0 con 0x7f69140cef40 2024-04-25T09:00:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.096+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691404ef20 con 0x7f69140cef40 2024-04-25T09:00:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.097+0000 7f690affd640 1 -- 172.21.15.5:0/2623315815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6904018070 con 0x7f69140cef40 2024-04-25T09:00:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.097+0000 7f690affd640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f68f406b4d0 0x7f68f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.097+0000 7f690affd640 1 -- 172.21.15.5:0/2623315815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f690408a2c0 con 0x7f69140cef40 2024-04-25T09:00:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.097+0000 7f690bfff640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f68f406b4d0 0x7f68f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.098+0000 7f690bfff640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f68f406b4d0 0x7f68f406d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68fc000f60 tx=0x7f68fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.101+0000 7f690affd640 1 -- 172.21.15.5:0/2623315815 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6904058af0 con 0x7f69140cef40 2024-04-25T09:00:15.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.353+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f69140ca880 con 0x7f69140cef40 2024-04-25T09:00:15.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.355+0000 7f690affd640 1 -- 172.21.15.5:0/2623315815 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f690405cb90 con 0x7f69140cef40 2024-04-25T09:00:15.345 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T09:00:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T09:00:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T09:00:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T09:00:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:00:15.345 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T09:00:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f68f406b4d0 msgr2=0x7f68f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f68f406b4d0 0x7f68f406d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68fc000f60 tx=0x7f68fc009040 comp rx=0 tx=0).stop 2024-04-25T09:00:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 msgr2=0x7f6914150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f6914150f80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f690400c7f0 tx=0x7f690400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 shutdown_connections 2024-04-25T09:00:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f68f406b4d0 0x7f68f406d990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69140c9ff0 0x7f69140d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69140d2f90 0x7f69140c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 --2- 172.21.15.5:0/2623315815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69140cef40 0x7f6914150f80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 >> 172.21.15.5:0/2623315815 conn(0x7f691406b000 msgr2=0x7f6914160c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 shutdown_connections 2024-04-25T09:00:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.357+0000 7f691896a640 1 -- 172.21.15.5:0/2623315815 wait complete. 2024-04-25T09:00:15.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.470+0000 7f15f362a640 1 Processor -- start 2024-04-25T09:00:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.470+0000 7f15f362a640 1 -- start start 2024-04-25T09:00:15.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f362a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15ec15de70 0x7f15ec0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f362a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15ec0b2cc0 0x7f15ec0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f362a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f362a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ec0d2a10 con 0x7f15ec15de70 2024-04-25T09:00:15.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f362a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ec0d20e0 con 0x7f15ec0b2cc0 2024-04-25T09:00:15.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f362a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0d23c0 con 0x7f15ec0b7130 2024-04-25T09:00:15.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15ec15de70 0x7f15ec0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15ec15de70 0x7f15ec0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38708/0 (socket says 172.21.15.5:38708) 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 -- 172.21.15.5:0/2212481528 learned_addr learned my addr 172.21.15.5:0/2212481528 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f1bc7640 1 --2- 172.21.15.5:0/2212481528 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f0bc5640 1 --2- 172.21.15.5:0/2212481528 >> v2:172.21.15.80:3300/0 conn(0x7f15ec0b2cc0 0x7f15ec0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 -- 172.21.15.5:0/2212481528 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 msgr2=0x7f15ec0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 --2- 172.21.15.5:0/2212481528 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 -- 172.21.15.5:0/2212481528 >> v2:172.21.15.80:3300/0 conn(0x7f15ec0b2cc0 msgr2=0x7f15ec0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 --2- 172.21.15.5:0/2212481528 >> v2:172.21.15.80:3300/0 conn(0x7f15ec0b2cc0 0x7f15ec0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f13c6640 1 -- 172.21.15.5:0/2212481528 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0d26a0 con 0x7f15ec15de70 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.471+0000 7f15f0bc5640 1 --2- 172.21.15.5:0/2212481528 >> v2:172.21.15.80:3300/0 conn(0x7f15ec0b2cc0 0x7f15ec0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.472+0000 7f15f13c6640 1 --2- 172.21.15.5:0/2212481528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec0b93e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f15ec161740 tx=0x7f15e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66f0a096e3e7b28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.472+0000 7f15e3fff640 1 -- 172.21.15.5:0/2212481528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8037070 con 0x7f15ec15de70 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.472+0000 7f15e3fff640 1 -- 172.21.15.5:0/2212481528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8032440 con 0x7f15ec15de70 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.472+0000 7f15e3fff640 1 -- 172.21.15.5:0/2212481528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8032810 con 0x7f15ec15de70 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 -- 172.21.15.5:0/2212481528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 msgr2=0x7f15ec0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 --2- 172.21.15.5:0/2212481528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec0b93e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f15ec161740 tx=0x7f15e802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 -- 172.21.15.5:0/2212481528 shutdown_connections 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 --2- 172.21.15.5:0/2212481528 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 --2- 172.21.15.5:0/2212481528 >> v2:172.21.15.80:3300/0 conn(0x7f15ec0b2cc0 0x7f15ec0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 --2- 172.21.15.5:0/2212481528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec0b93e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 -- 172.21.15.5:0/2212481528 >> 172.21.15.5:0/2212481528 conn(0x7f15ec06b000 msgr2=0x7f15ec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:15.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 -- 172.21.15.5:0/2212481528 shutdown_connections 2024-04-25T09:00:15.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.473+0000 7f15f362a640 1 -- 172.21.15.5:0/2212481528 wait complete. 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.474+0000 7f15f362a640 1 Processor -- start 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.474+0000 7f15f362a640 1 -- start start 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f362a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ec0b2cc0 0x7f15ec0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f362a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f362a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f362a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0ceeb0 con 0x7f15ec15de70 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f362a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0ced30 con 0x7f15ec0b2cc0 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f362a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0cf030 con 0x7f15ec0b7130 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec15f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38714/0 (socket says 172.21.15.5:38714) 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 -- 172.21.15.5:0/3849532256 learned_addr learned my addr 172.21.15.5:0/3849532256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f0bc5640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f13c6640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ec0b2cc0 0x7f15ec0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 -- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 msgr2=0x7f15ec0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 -- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ec0b2cc0 msgr2=0x7f15ec0b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ec0b2cc0 0x7f15ec0b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 -- 172.21.15.5:0/3849532256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0b4a70 con 0x7f15ec15de70 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f13c6640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ec0b2cc0 0x7f15ec0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f0bc5640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f1bc7640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec15f770 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009dd0 tx=0x7f15e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15e1ffb640 1 -- 172.21.15.5:0/3849532256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4018020 con 0x7f15ec15de70 2024-04-25T09:00:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15e1ffb640 1 -- 172.21.15.5:0/3849532256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e4014480 con 0x7f15ec15de70 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0b4d50 con 0x7f15ec15de70 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.475+0000 7f15e1ffb640 1 -- 172.21.15.5:0/3849532256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4014870 con 0x7f15ec15de70 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.476+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec0b5310 con 0x7f15ec15de70 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.477+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec04ef20 con 0x7f15ec15de70 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.477+0000 7f15e1ffb640 1 -- 172.21.15.5:0/3849532256 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f15e4005d10 con 0x7f15ec15de70 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.477+0000 7f15e1ffb640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f15d006b4d0 0x7f15d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.478+0000 7f15e1ffb640 1 -- 172.21.15.5:0/3849532256 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15e408b0a0 con 0x7f15ec15de70 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.478+0000 7f15f13c6640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f15d006b4d0 0x7f15d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.478+0000 7f15f13c6640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f15d006b4d0 0x7f15d006d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f15e8034000 tx=0x7f15e802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.482+0000 7f15e1ffb640 1 -- 172.21.15.5:0/3849532256 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f15e4022030 con 0x7f15ec15de70 2024-04-25T09:00:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.703+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15ec0b2760 con 0x7f15ec15de70 2024-04-25T09:00:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.704+0000 7f15e1ffb640 1 -- 172.21.15.5:0/3849532256 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f15e4010040 con 0x7f15ec15de70 2024-04-25T09:00:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:15.694 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/313563585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":313563585},{"type":"v1","addr":"172.21.15.80:6837","nonce":313563585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/109709411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":109709411},{"type":"v1","addr":"172.21.15.5:6834","nonce":109709411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2543846434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543846434},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543846434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:08.548961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6495":{"gid":6495,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6836/3464170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3464170028},{"type":"v1","addr":"172.21.15.80:6836","nonce":3464170028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-04-25T09:00:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f15d006b4d0 msgr2=0x7f15d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f15d006b4d0 0x7f15d006d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f15e8034000 tx=0x7f15e802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 msgr2=0x7f15ec15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec15f770 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009dd0 tx=0x7f15e400c490 comp rx=0 tx=0).stop 2024-04-25T09:00:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 shutdown_connections 2024-04-25T09:00:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f15d006b4d0 0x7f15d006d990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ec15de70 0x7f15ec15f770 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15ec0b7130 0x7f15ec0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 --2- 172.21.15.5:0/3849532256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ec0b2cc0 0x7f15ec0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 >> 172.21.15.5:0/3849532256 conn(0x7f15ec06b000 msgr2=0x7f15ec15e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 shutdown_connections 2024-04-25T09:00:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:15.706+0000 7f15f362a640 1 -- 172.21.15.5:0/3849532256 wait complete. 2024-04-25T09:00:16.109 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:00:06.554390+0000', 'modified': '2024-04-25T09:00:08.548961+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6495}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6495': {'gid': 6495, 'name': 'd', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6836/3464170028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 3464170028}, {'type': 'v1', 'addr': '172.21.15.80:6836', 'nonce': 3464170028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:00:16.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:00:16.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:00:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.236+0000 7fa746ce4640 1 Processor -- start 2024-04-25T09:00:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.236+0000 7fa746ce4640 1 -- start start 2024-04-25T09:00:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa746ce4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7400d3990 0x7fa7400d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa746ce4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400b29c0 con 0x7fa7400b6f50 2024-04-25T09:00:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa746ce4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400d2080 con 0x7fa74015e0a0 2024-04-25T09:00:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa746ce4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400d4330 con 0x7fa7400d3990 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa73ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7400d3990 0x7fa7400d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa745281640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7400b6f50 0x7fa7400b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49938/0 (socket says 172.21.15.5:49938) 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa745281640 1 -- 172.21.15.5:0/368334533 learned_addr learned my addr 172.21.15.5:0/368334533 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa73f7fe640 1 -- 172.21.15.5:0/368334533 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621338247 0 0) 0x7fa7400b29c0 con 0x7fa7400b6f50 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa73f7fe640 1 -- 172.21.15.5:0/368334533 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72c003520 con 0x7fa7400b6f50 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa73ffff640 1 -- 172.21.15.5:0/368334533 >> v1:172.21.15.80:6789/0 conn(0x7fa74015e0a0 legacy=0x7fa7400d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa73ffff640 1 -- 172.21.15.5:0/368334533 >> v1:172.21.15.5:6789/0 conn(0x7fa7400b6f50 legacy=0x7fa7400b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.237+0000 7fa73ffff640 1 -- 172.21.15.5:0/368334533 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400d2360 con 0x7fa7400d3990 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.238+0000 7fa73ffff640 1 --2- 172.21.15.5:0/368334533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7400d3990 0x7fa7400d3df0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097a0 tx=0x7fa72802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c14f4d6175a5107 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.238+0000 7fa73f7fe640 1 -- 172.21.15.5:0/368334533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728037070 con 0x7fa7400d3990 2024-04-25T09:00:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.238+0000 7fa73f7fe640 1 -- 172.21.15.5:0/368334533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728032440 con 0x7fa7400d3990 2024-04-25T09:00:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.238+0000 7fa73f7fe640 1 -- 172.21.15.5:0/368334533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728032810 con 0x7fa7400d3990 2024-04-25T09:00:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.239+0000 7fa746ce4640 1 -- 172.21.15.5:0/368334533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7400d3990 msgr2=0x7fa7400d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.239+0000 7fa746ce4640 1 --2- 172.21.15.5:0/368334533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7400d3990 0x7fa7400d3df0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097a0 tx=0x7fa72802a230 comp rx=0 tx=0).stop 2024-04-25T09:00:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.239+0000 7fa746ce4640 1 -- 172.21.15.5:0/368334533 shutdown_connections 2024-04-25T09:00:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.239+0000 7fa746ce4640 1 --2- 172.21.15.5:0/368334533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7400d3990 0x7fa7400d3df0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.239+0000 7fa746ce4640 1 -- 172.21.15.5:0/368334533 >> 172.21.15.5:0/368334533 conn(0x7fa7400668f0 msgr2=0x7fa740066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.239+0000 7fa746ce4640 1 -- 172.21.15.5:0/368334533 shutdown_connections 2024-04-25T09:00:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.239+0000 7fa746ce4640 1 -- 172.21.15.5:0/368334533 wait complete. 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.240+0000 7fa746ce4640 1 Processor -- start 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.240+0000 7fa746ce4640 1 -- start start 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa746ce4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7400b6f50 0x7fa7401590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa746ce4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7400d3990 0x7fa74015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa746ce4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa74015e0a0 0x7fa7400ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa746ce4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400d2920 con 0x7fa74015e0a0 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa746ce4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400d1460 con 0x7fa7400b6f50 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa746ce4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400d2c00 con 0x7fa7400d3990 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa74015e0a0 0x7fa7400ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa74015e0a0 0x7fa7400ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38730/0 (socket says 172.21.15.5:38730) 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 -- 172.21.15.5:0/3565151228 learned_addr learned my addr 172.21.15.5:0/3565151228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa744a80640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7400b6f50 0x7fa7401590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa73ffff640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7400d3990 0x7fa74015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 -- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7400d3990 msgr2=0x7fa74015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7400d3990 0x7fa74015ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 -- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7400b6f50 msgr2=0x7fa7401590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7400b6f50 0x7fa7401590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.241+0000 7fa745281640 1 -- 172.21.15.5:0/3565151228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400abb90 con 0x7fa74015e0a0 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.242+0000 7fa745281640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa74015e0a0 0x7fa7400ab140 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c390 tx=0x7fa73000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.242+0000 7fa73d7fa640 1 -- 172.21.15.5:0/3565151228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730017070 con 0x7fa74015e0a0 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.242+0000 7fa73d7fa640 1 -- 172.21.15.5:0/3565151228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730005ce0 con 0x7fa74015e0a0 2024-04-25T09:00:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.242+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7400cc660 con 0x7fa74015e0a0 2024-04-25T09:00:16.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.242+0000 7fa73d7fa640 1 -- 172.21.15.5:0/3565151228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730007310 con 0x7fa74015e0a0 2024-04-25T09:00:16.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.242+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7400ccc20 con 0x7fa74015e0a0 2024-04-25T09:00:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.244+0000 7fa73d7fa640 1 -- 172.21.15.5:0/3565151228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa73001a070 con 0x7fa74015e0a0 2024-04-25T09:00:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.244+0000 7fa73d7fa640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa72006b4d0 0x7fa72006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.244+0000 7fa73d7fa640 1 -- 172.21.15.5:0/3565151228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7300894e0 con 0x7fa74015e0a0 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.244+0000 7fa744a80640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa72006b4d0 0x7fa72006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.245+0000 7fa744a80640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa72006b4d0 0x7fa72006d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa738001f10 tx=0x7fa738009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.245+0000 7fa7499df740 1 Processor -- start 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.245+0000 7fa7499df740 1 -- start start 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd18610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd36020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa7499df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bcedf10 0x555c0bd34190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa7499df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0bc50a10 con 0x555c0bcedf10 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0bbf9b30 con 0x555c0bd35ad0 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c0bc4cc50 con 0x555c0bd18230 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bcedf10 0x555c0bd34190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bcedf10 0x555c0bd34190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38736/0 (socket says 172.21.15.5:38736) 2024-04-25T09:00:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 -- 172.21.15.5:0/1532279892 learned_addr learned my addr 172.21.15.5:0/1532279892 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa744a80640 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd18610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa73ffff640 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd36020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 -- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 msgr2=0x555c0bd18610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd18610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 -- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 msgr2=0x555c0bd36020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd36020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa745281640 1 -- 172.21.15.5:0/1532279892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c0bc0ee10 con 0x555c0bcedf10 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.246+0000 7fa744a80640 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd18610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa745281640 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bcedf10 0x555c0bd34190 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa7300070a0 tx=0x7fa730057e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c750e1b180e26ebf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7367fc640 1 -- 172.21.15.5:0/1532279892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730055e40 con 0x555c0bcedf10 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7367fc640 1 -- 172.21.15.5:0/1532279892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300560a0 con 0x555c0bcedf10 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7367fc640 1 -- 172.21.15.5:0/1532279892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300890c0 con 0x555c0bcedf10 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 -- 172.21.15.5:0/1532279892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bcedf10 msgr2=0x555c0bd34190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bcedf10 0x555c0bd34190 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa7300070a0 tx=0x7fa730057e60 comp rx=0 tx=0).stop 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 -- 172.21.15.5:0/1532279892 shutdown_connections 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bcedf10 0x555c0bd34190 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd36020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 --2- 172.21.15.5:0/1532279892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd18610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 -- 172.21.15.5:0/1532279892 >> 172.21.15.5:0/1532279892 conn(0x555c0bcea840 msgr2=0x555c0bd33040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 -- 172.21.15.5:0/1532279892 shutdown_connections 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.247+0000 7fa7499df740 1 -- 172.21.15.5:0/1532279892 wait complete. 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.248+0000 7fa7499df740 1 -- start start 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.248+0000 7fa7499df740 1 Processor -- start 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd01d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd16570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa7499df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd03860 0x555c0bd16ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa7499df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0bceecb0 con 0x555c0bd03860 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0bc0d0c0 con 0x555c0bd35ad0 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c0bce8770 con 0x555c0bd18230 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa7499df740 10 client.0 _ll_register_callbacks cb 0x555c0bc00ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd03860 0x555c0bd16ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd03860 0x555c0bd16ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38738/0 (socket says 172.21.15.5:38738) 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 -- 172.21.15.5:0/4196180440 learned_addr learned my addr 172.21.15.5:0/4196180440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa744a80640 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd01d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa73ffff640 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd16570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 -- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 msgr2=0x555c0bd01d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd01d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 -- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 msgr2=0x555c0bd16570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd16570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.249+0000 7fa745281640 1 -- 172.21.15.5:0/4196180440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c0b9652d0 con 0x555c0bd03860 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa745281640 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd03860 0x555c0bd16ab0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa73000cd50 tx=0x7fa730001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83511d677780c8a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa71f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa71f7fe640 1 -- 172.21.15.5:0/4196180440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300892d0 con 0x555c0bd03860 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa71f7fe640 1 -- 172.21.15.5:0/4196180440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7300074b0 con 0x555c0bd03860 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7300560a0 con 0x555c0bd03860 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa71f7fe640 1 -- 172.21.15.5:0/4196180440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7300076b0 con 0x555c0bd03860 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 10 client.6663 fetch_fsmap learned FSMap version 32 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555c0ba2f6b0 con 0x555c0bd03860 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa71f7fe640 1 -- 172.21.15.5:0/4196180440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300560a0 con 0x555c0bd03860 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa71f7fe640 1 -- 172.21.15.5:0/4196180440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa7300571f0 con 0x555c0bd03860 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 10 client.6663 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 10 client.6663 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 20 client.6663 populate_metadata read hostname 'smithi005' 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd2a0f0 0x555c0bd2a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 4 client.6663 mds_command: new command op to 6495 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.250+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 --> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c0bcaf920 con 0x555c0bd2a0f0 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.251+0000 7fa744a80640 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd2a0f0 0x555c0bd2a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.251+0000 7fa744a80640 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd2a0f0 0x555c0bd2a4d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e2865b923f795a server_cookie=791e06265fd53f1c in_seq=0 out_seq=0 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.251+0000 7fa71f7fe640 10 client.6663 ms_handle_connect on v2:172.21.15.80:6834/3464170028 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa71f7fe640 1 -- 172.21.15.5:0/4196180440 <== mds.0 v2:172.21.15.80:6834/3464170028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c0bcaf920 con 0x555c0bd2a0f0 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa71f7fe640 10 client.6663 handle_command_reply: tid=0 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 client.6663 shutdown 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd03860 msgr2=0x555c0bd16ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd03860 0x555c0bd16ab0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa73000cd50 tx=0x7fa730001150 comp rx=0 tx=0).stop 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 shutdown_connections 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd2a0f0 0x555c0bd2a4d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd03860 0x555c0bd16ab0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa71f7fe640 0 client.6663 ms_handle_reset on v2:172.21.15.80:6834/3464170028 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd16570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 --2- 172.21.15.5:0/4196180440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd18230 0x555c0bd01d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 >> 172.21.15.5:0/4196180440 conn(0x555c0bcedf10 msgr2=0x555c0bd365c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 shutdown_connections 2024-04-25T09:00:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 1 -- 172.21.15.5:0/4196180440 wait complete. 2024-04-25T09:00:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.252+0000 7fa7499df740 20 client.6663 trim_cache size 0 max 16384 2024-04-25T09:00:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.268+0000 7fa7499df740 1 Processor -- start 2024-04-25T09:00:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.268+0000 7fa7499df740 1 -- start start 2024-04-25T09:00:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd04200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa7499df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd41980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd41ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa7499df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7401ff130 con 0x555c0bd18230 2024-04-25T09:00:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400caf60 con 0x555c0bd35ad0 2024-04-25T09:00:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400cb560 con 0x555c0bd03860 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd41980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd41980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38740/0 (socket says 172.21.15.5:38740) 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 -- 172.21.15.5:0/140572223 learned_addr learned my addr 172.21.15.5:0/140572223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa744a80640 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd04200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa745281640 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd41ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 -- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 msgr2=0x555c0bd04200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd04200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 -- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 msgr2=0x555c0bd41ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd41ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 -- 172.21.15.5:0/140572223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c0bd2c0b0 con 0x555c0bd18230 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.269+0000 7fa73ffff640 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd41980 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097a0 tx=0x7fa72802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e76511719de4fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa735ffb640 1 -- 172.21.15.5:0/140572223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728037040 con 0x555c0bd18230 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa735ffb640 1 -- 172.21.15.5:0/140572223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280326c0 con 0x555c0bd18230 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa735ffb640 1 -- 172.21.15.5:0/140572223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728032ab0 con 0x555c0bd18230 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 -- 172.21.15.5:0/140572223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 msgr2=0x555c0bd41980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd41980 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097a0 tx=0x7fa72802c000 comp rx=0 tx=0).stop 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 -- 172.21.15.5:0/140572223 shutdown_connections 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd41ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd41980 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 --2- 172.21.15.5:0/140572223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd04200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 -- 172.21.15.5:0/140572223 >> 172.21.15.5:0/140572223 conn(0x555c0bcedf10 msgr2=0x555c0bd353a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 -- 172.21.15.5:0/140572223 shutdown_connections 2024-04-25T09:00:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.270+0000 7fa7499df740 1 -- 172.21.15.5:0/140572223 wait complete. 2024-04-25T09:00:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.271+0000 7fa7499df740 1 -- start start 2024-04-25T09:00:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.271+0000 7fa7499df740 1 Processor -- start 2024-04-25T09:00:16.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd9e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd33e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd34370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0bceecb0 con 0x555c0bd18230 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c0bce8770 con 0x555c0bd35ad0 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c0bc0d0c0 con 0x555c0bd03860 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 10 client.0 _ll_register_callbacks cb 0x555c0bce8c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd33e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd33e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38748/0 (socket says 172.21.15.5:38748) 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 -- 172.21.15.5:0/2782137739 learned_addr learned my addr 172.21.15.5:0/2782137739 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa744a80640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd9e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa745281640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd34370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 -- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 msgr2=0x555c0bd9e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd9e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 -- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 msgr2=0x555c0bd34370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd34370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 -- 172.21.15.5:0/2782137739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c0bcffe90 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa745281640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd34370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa73ffff640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd33e30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098c0 tx=0x7fa728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561fe3bb36c225a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa71f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa71f7fe640 1 -- 172.21.15.5:0/2782137739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728037040 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa71f7fe640 1 -- 172.21.15.5:0/2782137739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa728032a80 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.272+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7280326c0 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa71f7fe640 1 -- 172.21.15.5:0/2782137739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa72805a050 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 10 client.6669 fetch_fsmap learned FSMap version 32 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555c0bd9dc00 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa71f7fe640 1 -- 172.21.15.5:0/2782137739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280326c0 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa71f7fe640 1 -- 172.21.15.5:0/2782137739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa72805d020 con 0x555c0bd18230 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 10 client.6669 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 10 client.6669 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:00:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 20 client.6669 populate_metadata read hostname 'smithi005' 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd36560 0x555c0bd4c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 4 client.6669 mds_command: new command op to 6495 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 --> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555c0bc5df50 con 0x555c0bd36560 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.273+0000 7fa744a80640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd36560 0x555c0bd4c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa71f7fe640 10 client.6669 ms_handle_connect on v2:172.21.15.80:6834/3464170028 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa744a80640 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd36560 0x555c0bd4c870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9963e28273caaa1b server_cookie=796a15d761d95b94 in_seq=0 out_seq=0 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa71f7fe640 1 -- 172.21.15.5:0/2782137739 <== mds.0 v2:172.21.15.80:6834/3464170028 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555c0bc5df50 con 0x555c0bd36560 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa71f7fe640 10 client.6669 handle_command_reply: tid=0 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 client.6669 shutdown 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 msgr2=0x555c0bd33e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd33e30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098c0 tx=0x7fa728004730 comp rx=0 tx=0).stop 2024-04-25T09:00:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 shutdown_connections 2024-04-25T09:00:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:6834/3464170028,v1:172.21.15.80:6836/3464170028] conn(0x555c0bd36560 0x555c0bd4c870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c0bd35ad0 0x555c0bd34370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa71f7fe640 0 client.6669 ms_handle_reset on v2:172.21.15.80:6834/3464170028 2024-04-25T09:00:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555c0bd18230 0x555c0bd33e30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 --2- 172.21.15.5:0/2782137739 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555c0bd03860 0x555c0bd9e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 >> 172.21.15.5:0/2782137739 conn(0x555c0bcedf10 msgr2=0x555c0bd55e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 shutdown_connections 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 1 -- 172.21.15.5:0/2782137739 wait complete. 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.274+0000 7fa7499df740 20 client.6669 trim_cache size 0 max 16384 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6495, 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:00:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:00:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 9.0751208240000008, 2024-04-25T09:00:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 32, 2024-04-25T09:00:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 57, 2024-04-25T09:00:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 57, 2024-04-25T09:00:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 14.069850008 2024-04-25T09:00:16.273 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa72006b4d0 msgr2=0x7fa72006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa72006b4d0 0x7fa72006d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa738001f10 tx=0x7fa738009040 comp rx=0 tx=0).stop 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa74015e0a0 msgr2=0x7fa7400ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa74015e0a0 0x7fa7400ab140 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c390 tx=0x7fa73000c850 comp rx=0 tx=0).stop 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 shutdown_connections 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa72006b4d0 0x7fa72006d990 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa74015e0a0 0x7fa7400ab140 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7400d3990 0x7fa74015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 --2- 172.21.15.5:0/3565151228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7400b6f50 0x7fa7401590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 >> 172.21.15.5:0/3565151228 conn(0x7fa7400668f0 msgr2=0x7fa7400d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 shutdown_connections 2024-04-25T09:00:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.275+0000 7fa746ce4640 1 -- 172.21.15.5:0/3565151228 wait complete. 2024-04-25T09:00:16.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:00:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.387+0000 7f1d90f5c640 1 Processor -- start 2024-04-25T09:00:16.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.387+0000 7f1d90f5c640 1 -- start start 2024-04-25T09:00:16.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d90f5c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d8c0b9990 0x7f1d8c0d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d90f5c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c0d2670 con 0x7f1d8c0d21f0 2024-04-25T09:00:16.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d90f5c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c0d2950 con 0x7f1d8c0d05f0 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d90f5c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0d2c30 con 0x7f1d8c0b9990 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d8ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1d8c0d21f0 0x7f1d8c0b6c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49950/0 (socket says 172.21.15.5:49950) 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d8ad9d640 1 -- 172.21.15.5:0/265932485 learned_addr learned my addr 172.21.15.5:0/265932485 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/265932485 >> v2:172.21.15.80:3300/0 conn(0x7f1d8c0b9990 0x7f1d8c0d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.388+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053475079 0 0) 0x7f1d8c0d2670 con 0x7f1d8c0d21f0 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d74003520 con 0x7f1d8c0d21f0 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469302015 0 0) 0x7f1d74003520 con 0x7f1d8c0d21f0 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 >> v2:172.21.15.80:3300/0 conn(0x7f1d8c0b9990 msgr2=0x7f1d8c0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 --2- 172.21.15.5:0/265932485 >> v2:172.21.15.80:3300/0 conn(0x7f1d8c0b9990 0x7f1d8c0d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 >> v1:172.21.15.80:6789/0 conn(0x7f1d8c0d05f0 legacy=0x7f1d8c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0d2f10 con 0x7f1d8c0d21f0 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1d84001a10 con 0x7f1d8c0d21f0 2024-04-25T09:00:16.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 >> v1:172.21.15.5:6789/0 conn(0x7f1d8c0d21f0 legacy=0x7f1d8c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d740039b0 0x7f1d74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d740051c0 0x7f1d7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0d2c30 con 0x7f1d74004800 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7400c070 con 0x7f1d740039b0 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7400c270 con 0x7f1d740051c0 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8a59c640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d740039b0 0x7f1d74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.389+0000 7f1d8ad9d640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d740051c0 0x7f1d7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d89d9b640 1 -- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d740051c0 msgr2=0x7f1d7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d740051c0 0x7f1d7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d89d9b640 1 -- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d740039b0 msgr2=0x7f1d74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d740039b0 0x7f1d74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d89d9b640 1 -- 172.21.15.5:0/265932485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74003520 con 0x7f1d74004800 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d8ad9d640 1 -- 172.21.15.5:0/265932485 reap_dead start 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d8a59c640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d740039b0 0x7f1d74003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d74004c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009ac0 tx=0x7f1d74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d44291f76ebcee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80036070 con 0x7f1d74004800 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80031400 con 0x7f1d74004800 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.390+0000 7f1d8959a640 1 -- 172.21.15.5:0/265932485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80009690 con 0x7f1d74004800 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.391+0000 7f1d90f5c640 1 -- 172.21.15.5:0/265932485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 msgr2=0x7f1d74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.391+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d74004c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009ac0 tx=0x7f1d74005830 comp rx=0 tx=0).stop 2024-04-25T09:00:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.391+0000 7f1d90f5c640 1 -- 172.21.15.5:0/265932485 shutdown_connections 2024-04-25T09:00:16.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.391+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/265932485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d74004c80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.391+0000 7f1d90f5c640 1 -- 172.21.15.5:0/265932485 >> 172.21.15.5:0/265932485 conn(0x7f1d8c06b000 msgr2=0x7f1d8c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.391+0000 7f1d90f5c640 1 -- 172.21.15.5:0/265932485 shutdown_connections 2024-04-25T09:00:16.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.391+0000 7f1d90f5c640 1 -- 172.21.15.5:0/265932485 wait complete. 2024-04-25T09:00:16.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.392+0000 7f1d90f5c640 1 Processor -- start 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.392+0000 7f1d90f5c640 1 -- start start 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d90f5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d8c14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d90f5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8c15e330 0x7f1d8c160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d90f5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d8c15e7b0 0x7f1d8c160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d90f5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0d3890 con 0x7f1d74004800 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d90f5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0d3710 con 0x7f1d8c15e7b0 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d90f5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0d3a10 con 0x7f1d8c15e330 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d8a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d8c14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d8a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d8c14c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38770/0 (socket says 172.21.15.5:38770) 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d8a59c640 1 -- 172.21.15.5:0/451192633 learned_addr learned my addr 172.21.15.5:0/451192633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8c15e330 0x7f1d8c160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.393+0000 7f1d8ad9d640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d8c15e7b0 0x7f1d8c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d8a59c640 1 -- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8c15e330 msgr2=0x7f1d8c160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d8a59c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8c15e330 0x7f1d8c160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d8a59c640 1 -- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d8c15e7b0 msgr2=0x7f1d8c160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d8a59c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d8c15e7b0 0x7f1d8c160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d8a59c640 1 -- 172.21.15.5:0/451192633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c15eca0 con 0x7f1d74004800 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d8a59c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d8c14c070 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00f810 tx=0x7f1d7c00fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d7affd640 1 -- 172.21.15.5:0/451192633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c01a070 con 0x7f1d74004800 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d7affd640 1 -- 172.21.15.5:0/451192633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c005320 con 0x7f1d74004800 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c15ef80 con 0x7f1d74004800 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d7affd640 1 -- 172.21.15.5:0/451192633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c001370 con 0x7f1d74004800 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.394+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c15f540 con 0x7f1d74004800 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.395+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c04ef20 con 0x7f1d74004800 2024-04-25T09:00:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.395+0000 7f1d7affd640 1 -- 172.21.15.5:0/451192633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d7c01d070 con 0x7f1d74004800 2024-04-25T09:00:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.396+0000 7f1d7affd640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d6c06b4d0 0x7f1d6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.396+0000 7f1d7affd640 1 -- 172.21.15.5:0/451192633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d7c0899f0 con 0x7f1d74004800 2024-04-25T09:00:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.396+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d6c06b4d0 0x7f1d6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.397+0000 7f1d89d9b640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d6c06b4d0 0x7f1d6c06d990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1d80033000 tx=0x7f1d80008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.400+0000 7f1d7affd640 1 -- 172.21.15.5:0/451192633 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d7c058870 con 0x7f1d74004800 2024-04-25T09:00:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.625+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d8c0b3320 con 0x7f1d74004800 2024-04-25T09:00:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.625+0000 7f1d7affd640 1 -- 172.21.15.5:0/451192633 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1d7c058170 con 0x7f1d74004800 2024-04-25T09:00:16.616 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:00:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d6c06b4d0 msgr2=0x7f1d6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d6c06b4d0 0x7f1d6c06d990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1d80033000 tx=0x7f1d80008030 comp rx=0 tx=0).stop 2024-04-25T09:00:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 msgr2=0x7f1d8c14c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d8c14c070 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00f810 tx=0x7f1d7c00fcd0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 shutdown_connections 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d6c06b4d0 0x7f1d6c06d990 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d8c15e7b0 0x7f1d8c160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8c15e330 0x7f1d8c160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 --2- 172.21.15.5:0/451192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d74004800 0x7f1d8c14c070 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 >> 172.21.15.5:0/451192633 conn(0x7f1d8c06b000 msgr2=0x7f1d8c066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.627+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 shutdown_connections 2024-04-25T09:00:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:16.628+0000 7f1d90f5c640 1 -- 172.21.15.5:0/451192633 wait complete. 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:00:16.628 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:00:16.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:16.629 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:00:16.644 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:00:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:00:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:00:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42543sec preferred_lft 42543sec 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:16.645 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:00:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:00:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:16.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:16.647 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:00:16.707 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:00:16.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:16.708 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:00:16.765 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:00:16.765 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:00:16.765 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:00:16.765 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:00:16.765 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:00:16.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:16.766 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:00:16.766 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:00:16.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:00:16.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:00:16.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:00:16.766 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:00:16.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:16.808 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:16.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:16.852 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:00:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:00:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:00:16.934 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:00:16.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:16.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:00:16.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:00:16.999 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:00:17.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:00:17.055 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:17.110 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:00:17.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:17.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:00:17.192 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:00:17.193 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:00:17.200 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:00:17.200 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:00:17.200 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:00:17.200 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:00:17.200 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:00:17.201 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:00:17.201 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:00:17.201 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:00:17.201 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:00:17.201 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:00:17.202 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:00:17.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:17.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:17.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:17.269 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:00:17.333 INFO:teuthology.orchestra.run.smithi005.stdout:client6079 2024-04-25T09:00:17.333 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:17.333 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:17.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:17.388 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-04-25T09:00:17.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:17.449 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-04-25T09:00:17.506 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-04-25T09:00:17.506 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-25T09:00:17.507 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-04-25T09:00:17.507 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T09:00:17.507 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-04-25T09:00:17.507 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-25T09:00:17.614 INFO:teuthology.orchestra.run.smithi005.stdout:1099511627776 2024-04-25T09:00:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:00:17.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:17.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:17.679 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:17.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:17.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:17.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.886+0000 7f5e474ee640 1 Processor -- start 2024-04-25T09:00:17.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.886+0000 7f5e474ee640 1 -- start start 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e474ee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e4006b7d0 0x7f5e4006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e474ee640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4006bbb0 0x7f5e400d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e474ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e4015da10 0x7f5e4015de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e474ee640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400d0b70 con 0x7f5e4006b7d0 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e474ee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400cbf30 con 0x7f5e4015da10 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e474ee640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400cc7d0 con 0x7f5e4006bbb0 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e4006b7d0 0x7f5e4006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e4006b7d0 0x7f5e4006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38780/0 (socket says 172.21.15.5:38780) 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 -- 172.21.15.5:0/1576743706 learned_addr learned my addr 172.21.15.5:0/1576743706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e44a89640 1 --2- 172.21.15.5:0/1576743706 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4006bbb0 0x7f5e400d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e45a8b640 1 --2- 172.21.15.5:0/1576743706 >> v2:172.21.15.80:3300/0 conn(0x7f5e4015da10 0x7f5e4015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 -- 172.21.15.5:0/1576743706 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4006bbb0 msgr2=0x7f5e400d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 --2- 172.21.15.5:0/1576743706 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4006bbb0 0x7f5e400d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 -- 172.21.15.5:0/1576743706 >> v2:172.21.15.80:3300/0 conn(0x7f5e4015da10 msgr2=0x7f5e4015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 --2- 172.21.15.5:0/1576743706 >> v2:172.21.15.80:3300/0 conn(0x7f5e4015da10 0x7f5e4015de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e4528a640 1 -- 172.21.15.5:0/1576743706 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400b4730 con 0x7f5e4006b7d0 2024-04-25T09:00:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e44a89640 1 --2- 172.21.15.5:0/1576743706 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4006bbb0 0x7f5e400d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.887+0000 7f5e45a8b640 1 --2- 172.21.15.5:0/1576743706 >> v2:172.21.15.80:3300/0 conn(0x7f5e4015da10 0x7f5e4015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.888+0000 7f5e4528a640 1 --2- 172.21.15.5:0/1576743706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e4006aef0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5e400732a0 tx=0x7f5e3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f56e61ae712b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.888+0000 7f5e37fff640 1 -- 172.21.15.5:0/1576743706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037070 con 0x7f5e4006b7d0 2024-04-25T09:00:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.888+0000 7f5e37fff640 1 -- 172.21.15.5:0/1576743706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c032440 con 0x7f5e4006b7d0 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.888+0000 7f5e37fff640 1 -- 172.21.15.5:0/1576743706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c032810 con 0x7f5e4006b7d0 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 -- 172.21.15.5:0/1576743706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 msgr2=0x7f5e4006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 --2- 172.21.15.5:0/1576743706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e4006aef0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5e400732a0 tx=0x7f5e3c02a270 comp rx=0 tx=0).stop 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 -- 172.21.15.5:0/1576743706 shutdown_connections 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 --2- 172.21.15.5:0/1576743706 >> v2:172.21.15.80:3300/0 conn(0x7f5e4015da10 0x7f5e4015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 --2- 172.21.15.5:0/1576743706 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4006bbb0 0x7f5e400d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 --2- 172.21.15.5:0/1576743706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e4006aef0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 -- 172.21.15.5:0/1576743706 >> 172.21.15.5:0/1576743706 conn(0x7f5e400d18e0 msgr2=0x7f5e400d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 -- 172.21.15.5:0/1576743706 shutdown_connections 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.889+0000 7f5e474ee640 1 -- 172.21.15.5:0/1576743706 wait complete. 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.890+0000 7f5e474ee640 1 Processor -- start 2024-04-25T09:00:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.890+0000 7f5e474ee640 1 -- start start 2024-04-25T09:00:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e474ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e400c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e474ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e4006bbb0 0x7f5e401f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e474ee640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4015da10 0x7f5e400ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e474ee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400cc180 con 0x7f5e4006b7d0 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e474ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400d0da0 con 0x7f5e4006bbb0 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e474ee640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400cc460 con 0x7f5e4015da10 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e400c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e400c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38788/0 (socket says 172.21.15.5:38788) 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 -- 172.21.15.5:0/4067128358 learned_addr learned my addr 172.21.15.5:0/4067128358 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e45a8b640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4015da10 0x7f5e400ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e44a89640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e4006bbb0 0x7f5e401f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 -- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4015da10 msgr2=0x7f5e400ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4015da10 0x7f5e400ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 -- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e4006bbb0 msgr2=0x7f5e401f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e4006bbb0 0x7f5e401f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 -- 172.21.15.5:0/4067128358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400c9090 con 0x7f5e4006b7d0 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e44a89640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e4006bbb0 0x7f5e401f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.891+0000 7f5e4528a640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e400c89b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c02a2b0 tx=0x7f5e3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.892+0000 7f5e35ffb640 1 -- 172.21.15.5:0/4067128358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037040 con 0x7f5e4006b7d0 2024-04-25T09:00:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.892+0000 7f5e35ffb640 1 -- 172.21.15.5:0/4067128358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c042070 con 0x7f5e4006b7d0 2024-04-25T09:00:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.892+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e400c9370 con 0x7f5e4006b7d0 2024-04-25T09:00:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.892+0000 7f5e35ffb640 1 -- 172.21.15.5:0/4067128358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c030bb0 con 0x7f5e4006b7d0 2024-04-25T09:00:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.892+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e400c9930 con 0x7f5e4006b7d0 2024-04-25T09:00:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.893+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4004ef20 con 0x7f5e4006b7d0 2024-04-25T09:00:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.893+0000 7f5e35ffb640 1 -- 172.21.15.5:0/4067128358 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e3c047460 con 0x7f5e4006b7d0 2024-04-25T09:00:17.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.894+0000 7f5e35ffb640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e2406b4d0 0x7f5e2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.894+0000 7f5e35ffb640 1 -- 172.21.15.5:0/4067128358 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e3c0aadc0 con 0x7f5e4006b7d0 2024-04-25T09:00:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.894+0000 7f5e44a89640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e2406b4d0 0x7f5e2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.895+0000 7f5e44a89640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e2406b4d0 0x7f5e2406d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5e400b66d0 tx=0x7f5e30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:17.898+0000 7f5e35ffb640 1 -- 172.21.15.5:0/4067128358 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e400b4730 con 0x7f5e4006b7d0 2024-04-25T09:00:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.079+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e4006d460 con 0x7f5e4006b7d0 2024-04-25T09:00:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.080+0000 7f5e35ffb640 1 -- 172.21.15.5:0/4067128358 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f5e3c045360 con 0x7f5e4006b7d0 2024-04-25T09:00:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:18.069 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:08.199215+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e2406b4d0 msgr2=0x7f5e2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e2406b4d0 0x7f5e2406d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5e400b66d0 tx=0x7f5e30008040 comp rx=0 tx=0).stop 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 msgr2=0x7f5e400c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e400c89b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c02a2b0 tx=0x7f5e3c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 shutdown_connections 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e2406b4d0 0x7f5e2406d990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e4015da10 0x7f5e400ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e4006bbb0 0x7f5e401f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 --2- 172.21.15.5:0/4067128358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e4006b7d0 0x7f5e400c89b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 >> 172.21.15.5:0/4067128358 conn(0x7f5e400d18e0 msgr2=0x7f5e400cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 shutdown_connections 2024-04-25T09:00:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.082+0000 7f5e474ee640 1 -- 172.21.15.5:0/4067128358 wait complete. 2024-04-25T09:00:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:00:04.844156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:00:05.534669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:18.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:18.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.196+0000 7fc1e8c88640 1 Processor -- start 2024-04-25T09:00:18.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.196+0000 7fc1e8c88640 1 -- start start 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e8c88640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e41618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e8c88640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1e40cefe0 0x7fc1e40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e8c88640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e4162150 con 0x7fc1e40b6250 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e8c88640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40d20d0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e8c88640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4162430 con 0x7fc1e415df10 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1e40cefe0 0x7fc1e40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1e40cefe0 0x7fc1e40d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38790/0 (socket says 172.21.15.5:38790) 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.197+0000 7fc1e2d9d640 1 -- 172.21.15.5:0/2217629517 learned_addr learned my addr 172.21.15.5:0/2217629517 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:18.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.198+0000 7fc1e259c640 1 --2- 172.21.15.5:0/2217629517 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e41618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.198+0000 7fc1e2d9d640 1 -- 172.21.15.5:0/2217629517 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 msgr2=0x7fc1e41618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:18.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.198+0000 7fc1e2d9d640 1 --2- 172.21.15.5:0/2217629517 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e41618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.198+0000 7fc1e2d9d640 1 -- 172.21.15.5:0/2217629517 >> v1:172.21.15.80:6789/0 conn(0x7fc1e40b6250 legacy=0x7fc1e40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.198+0000 7fc1e2d9d640 1 -- 172.21.15.5:0/2217629517 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4162710 con 0x7fc1e40cefe0 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.198+0000 7fc1e2d9d640 1 --2- 172.21.15.5:0/2217629517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e40d2560 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e80 tx=0x7fc1dc02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bb165f7a880f7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e159a640 1 -- 172.21.15.5:0/2217629517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc036070 con 0x7fc1e40cefe0 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e159a640 1 -- 172.21.15.5:0/2217629517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc031600 con 0x7fc1e40cefe0 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e159a640 1 -- 172.21.15.5:0/2217629517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0319d0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 -- 172.21.15.5:0/2217629517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 msgr2=0x7fc1e40d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/2217629517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e40d2560 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e80 tx=0x7fc1dc02a750 comp rx=0 tx=0).stop 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 -- 172.21.15.5:0/2217629517 shutdown_connections 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/2217629517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e40d2560 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/2217629517 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e41618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 -- 172.21.15.5:0/2217629517 >> 172.21.15.5:0/2217629517 conn(0x7fc1e40668f0 msgr2=0x7fc1e4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:18.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 -- 172.21.15.5:0/2217629517 shutdown_connections 2024-04-25T09:00:18.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.199+0000 7fc1e8c88640 1 -- 172.21.15.5:0/2217629517 wait complete. 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 Processor -- start 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 -- start start 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e40b6250 0x7fc1e41f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e4157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40d2aa0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4161e10 con 0x7fc1e40b6250 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.201+0000 7fc1e8c88640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40d2c20 con 0x7fc1e415df10 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e4157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e40b6250 0x7fc1e41f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e40b6250 0x7fc1e41f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:38034/0 (socket says 172.21.15.5:38034) 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e2d9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e259c640 1 -- 172.21.15.5:0/361569646 learned_addr learned my addr 172.21.15.5:0/361569646 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e4157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38792/0 (socket says 172.21.15.5:38792) 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 -- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 msgr2=0x7fc1e40c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e40c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 -- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e40b6250 msgr2=0x7fc1e41f82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e40b6250 0x7fc1e41f82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 -- 172.21.15.5:0/361569646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4157ea0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e1d9b640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e4157960 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c340 tx=0x7fc1d800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1d2ffd640 1 -- 172.21.15.5:0/361569646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80052d0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1d2ffd640 1 -- 172.21.15.5:0/361569646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d8005490 con 0x7fc1e40cefe0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e4159770 con 0x7fc1e40cefe0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1d2ffd640 1 -- 172.21.15.5:0/361569646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8007260 con 0x7fc1e40cefe0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.202+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e41f7aa0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.203+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e404ef20 con 0x7fc1e40cefe0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.204+0000 7fc1d2ffd640 1 -- 172.21.15.5:0/361569646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc1d8007400 con 0x7fc1e40cefe0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.204+0000 7fc1d2ffd640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc1c406b4d0 0x7fc1c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.204+0000 7fc1d2ffd640 1 -- 172.21.15.5:0/361569646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d80895b0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.205+0000 7fc1e259c640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc1c406b4d0 0x7fc1c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.205+0000 7fc1e259c640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc1c406b4d0 0x7fc1c406d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40c7020 tx=0x7fc1d4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.209+0000 7fc1d2ffd640 1 -- 172.21.15.5:0/361569646 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1d8057dd0 con 0x7fc1e40cefe0 2024-04-25T09:00:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.388+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1e4155640 con 0x7fc1e40cefe0 2024-04-25T09:00:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.389+0000 7fc1d2ffd640 1 -- 172.21.15.5:0/361569646 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1d805be70 con 0x7fc1e40cefe0 2024-04-25T09:00:18.378 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:00:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.390+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc1c406b4d0 msgr2=0x7fc1c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc1c406b4d0 0x7fc1c406d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40c7020 tx=0x7fc1d4009190 comp rx=0 tx=0).stop 2024-04-25T09:00:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 msgr2=0x7fc1e4157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e4157960 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c340 tx=0x7fc1d800c800 comp rx=0 tx=0).stop 2024-04-25T09:00:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 shutdown_connections 2024-04-25T09:00:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc1c406b4d0 0x7fc1c406d990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc1e415df10 0x7fc1e40c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cefe0 0x7fc1e4157960 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 --2- 172.21.15.5:0/361569646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1e40b6250 0x7fc1e41f82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 >> 172.21.15.5:0/361569646 conn(0x7fc1e40668f0 msgr2=0x7fc1e40b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 shutdown_connections 2024-04-25T09:00:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.391+0000 7fc1e8c88640 1 -- 172.21.15.5:0/361569646 wait complete. 2024-04-25T09:00:18.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:00:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.505+0000 7f5897e07640 1 Processor -- start 2024-04-25T09:00:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.505+0000 7f5897e07640 1 -- start start 2024-04-25T09:00:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.506+0000 7f5897e07640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58900cfd70 0x7f58900ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.506+0000 7f5897e07640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900ce6e0 0x7f58900ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.506+0000 7f5897e07640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900cc010 con 0x7f58900b72b0 2024-04-25T09:00:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.506+0000 7f5897e07640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58900ceb50 con 0x7f58900cfd70 2024-04-25T09:00:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.506+0000 7f5897e07640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900cc2f0 con 0x7f58900ce6e0 2024-04-25T09:00:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58953a2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58900cfd70 0x7f58900ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58963a4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900ce6e0 0x7f58900ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58963a4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900ce6e0 0x7f58900ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:50674/0 (socket says 172.21.15.5:50674) 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58953a2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58900cfd70 0x7f58900ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:38046/0 (socket says 172.21.15.5:38046) 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f5895ba3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f58900b72b0 0x7f58900d0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:54008/0 (socket says 172.21.15.5:54008) 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58963a4640 1 -- 172.21.15.5:0/4232234229 learned_addr learned my addr 172.21.15.5:0/4232234229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58953a2640 1 -- 172.21.15.5:0/4232234229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900ce6e0 msgr2=0x7f58900ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58953a2640 1 --2- 172.21.15.5:0/4232234229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900ce6e0 0x7f58900ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58953a2640 1 -- 172.21.15.5:0/4232234229 >> v1:172.21.15.80:6789/0 conn(0x7f58900b72b0 legacy=0x7f58900d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.507+0000 7f58953a2640 1 -- 172.21.15.5:0/4232234229 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58900cc5d0 con 0x7f58900cfd70 2024-04-25T09:00:18.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f58953a2640 1 --2- 172.21.15.5:0/4232234229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 0x7f58900ce1a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f0e9b58d3ec55d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5894ba1640 1 -- 172.21.15.5:0/4232234229 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884037070 con 0x7f58900cfd70 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5894ba1640 1 -- 172.21.15.5:0/4232234229 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884032440 con 0x7f58900cfd70 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5894ba1640 1 -- 172.21.15.5:0/4232234229 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884032810 con 0x7f58900cfd70 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5897e07640 1 -- 172.21.15.5:0/4232234229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 msgr2=0x7f58900ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5897e07640 1 --2- 172.21.15.5:0/4232234229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 0x7f58900ce1a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402a180 comp rx=0 tx=0).stop 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5897e07640 1 -- 172.21.15.5:0/4232234229 shutdown_connections 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5897e07640 1 --2- 172.21.15.5:0/4232234229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900ce6e0 0x7f58900ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5897e07640 1 --2- 172.21.15.5:0/4232234229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 0x7f58900ce1a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.508+0000 7f5897e07640 1 -- 172.21.15.5:0/4232234229 >> 172.21.15.5:0/4232234229 conn(0x7f58900d1920 msgr2=0x7f58900d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.509+0000 7f5897e07640 1 -- 172.21.15.5:0/4232234229 shutdown_connections 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.509+0000 7f5897e07640 1 -- 172.21.15.5:0/4232234229 wait complete. 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 Processor -- start 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 -- start start 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900b72b0 0x7f58900c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58900ce6e0 0x7f589006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 0x7f589006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900d1550 con 0x7f58900ce6e0 2024-04-25T09:00:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900b4770 con 0x7f58900cfd70 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.510+0000 7f5897e07640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900b7690 con 0x7f58900b72b0 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58900ce6e0 0x7f589006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58900ce6e0 0x7f589006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38802/0 (socket says 172.21.15.5:38802) 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 -- 172.21.15.5:0/4169505017 learned_addr learned my addr 172.21.15.5:0/4169505017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f5895ba3640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900b72b0 0x7f58900c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58963a4640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 0x7f589006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 -- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900b72b0 msgr2=0x7f58900c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900b72b0 0x7f58900c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 -- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 msgr2=0x7f589006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 0x7f589006e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 -- 172.21.15.5:0/4169505017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58900c8b20 con 0x7f58900ce6e0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f58953a2640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58900ce6e0 0x7f589006e490 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f58840098c0 tx=0x7f58840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f588e7fc640 1 -- 172.21.15.5:0/4169505017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884037040 con 0x7f58900ce6e0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f588e7fc640 1 -- 172.21.15.5:0/4169505017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884042070 con 0x7f58900ce6e0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58900c8dc0 con 0x7f58900ce6e0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f588e7fc640 1 -- 172.21.15.5:0/4169505017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884030920 con 0x7f58900ce6e0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.511+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58900c9380 con 0x7f58900ce6e0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.512+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589004ef20 con 0x7f58900ce6e0 2024-04-25T09:00:18.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.513+0000 7f588e7fc640 1 -- 172.21.15.5:0/4169505017 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5884030ac0 con 0x7f58900ce6e0 2024-04-25T09:00:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.513+0000 7f588e7fc640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587c06b500 0x7f587c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.513+0000 7f588e7fc640 1 -- 172.21.15.5:0/4169505017 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58840aaa40 con 0x7f58900ce6e0 2024-04-25T09:00:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.514+0000 7f5895ba3640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587c06b500 0x7f587c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.514+0000 7f5895ba3640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587c06b500 0x7f587c06d9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5888000f60 tx=0x7f5888007ce0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.517+0000 7f588e7fc640 1 -- 172.21.15.5:0/4169505017 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5884079300 con 0x7f58900ce6e0 2024-04-25T09:00:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.696+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58900d0b60 con 0x7f58900ce6e0 2024-04-25T09:00:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.696+0000 7f588e7fc640 1 -- 172.21.15.5:0/4169505017 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58840aae20 con 0x7f58900ce6e0 2024-04-25T09:00:18.686 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:00:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587c06b500 msgr2=0x7f587c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587c06b500 0x7f587c06d9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5888000f60 tx=0x7f5888007ce0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58900ce6e0 msgr2=0x7f589006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58900ce6e0 0x7f589006e490 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f58840098c0 tx=0x7f58840046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 shutdown_connections 2024-04-25T09:00:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587c06b500 0x7f587c06d9c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58900cfd70 0x7f589006e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58900ce6e0 0x7f589006e490 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 --2- 172.21.15.5:0/4169505017 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58900b72b0 0x7f58900c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 >> 172.21.15.5:0/4169505017 conn(0x7f58900d1920 msgr2=0x7f589006f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 shutdown_connections 2024-04-25T09:00:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.698+0000 7f5897e07640 1 -- 172.21.15.5:0/4169505017 wait complete. 2024-04-25T09:00:18.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:00:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.813+0000 7f010b238640 1 Processor -- start 2024-04-25T09:00:18.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f010b238640 1 -- start start 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f010b238640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f010415c0f0 0x7f01040cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f010b238640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 0x7f01040b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f010b238640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040cf7a0 con 0x7f01040b24b0 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f010b238640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01040cd350 con 0x7f010415c0f0 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f010b238640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040d24e0 con 0x7f01040d0610 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f0103fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01040b24b0 0x7f01040cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49958/0 (socket says 172.21.15.5:49958) 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.814+0000 7f0103fff640 1 -- 172.21.15.5:0/2698795340 learned_addr learned my addr 172.21.15.5:0/2698795340 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01097d5640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 0x7f01040b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2698795340 >> v2:172.21.15.80:3300/0 conn(0x7f010415c0f0 0x7f01040cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410529018 0 0) 0x7f01040cf7a0 con 0x7f01040b24b0 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f0003520 con 0x7f01040b24b0 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2378916908 0 0) 0x7f00f0003520 con 0x7f01040b24b0 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 msgr2=0x7f01040b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 0x7f01040b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 >> v2:172.21.15.80:3300/0 conn(0x7f010415c0f0 msgr2=0x7f01040cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 --2- 172.21.15.5:0/2698795340 >> v2:172.21.15.80:3300/0 conn(0x7f010415c0f0 0x7f01040cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040d27c0 con 0x7f01040b24b0 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f00f4001670 con 0x7f01040b24b0 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 >> v1:172.21.15.5:6789/0 conn(0x7f01040b24b0 legacy=0x7f01040cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f00039b0 0x7f00f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 0x7f00f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f0004d40 0x7f00f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040cd350 con 0x7f00f0004d40 2024-04-25T09:00:18.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040d24e0 con 0x7f00f00039b0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000b9c0 con 0x7f01040d0610 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f01097d5640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f0004d40 0x7f00f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f00039b0 0x7f00f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.815+0000 7f0103fff640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 0x7f00f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.816+0000 7f0108fd4640 1 -- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 msgr2=0x7f00f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.816+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040d0610 0x7f00f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.816+0000 7f0108fd4640 1 -- 172.21.15.5:0/2698795340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f0004d40 msgr2=0x7f00f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.816+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f0004d40 0x7f00f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.816+0000 7f0108fd4640 1 -- 172.21.15.5:0/2698795340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0003520 con 0x7f00f00039b0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.816+0000 7f01097d5640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f0004d40 0x7f00f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.816+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f00039b0 0x7f00f0003dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00d230 tx=0x7f00f0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f96c26a67126cfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc036070 con 0x7f00f00039b0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc031600 con 0x7f00f00039b0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f01037fe640 1 -- 172.21.15.5:0/2698795340 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc009d00 con 0x7f00f00039b0 2024-04-25T09:00:18.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f010b238640 1 -- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f00039b0 msgr2=0x7f00f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f010b238640 1 --2- 172.21.15.5:0/2698795340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00f00039b0 0x7f00f0003dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00d230 tx=0x7f00f0005830 comp rx=0 tx=0).stop 2024-04-25T09:00:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f01097d5640 1 -- 172.21.15.5:0/2698795340 reap_dead start 2024-04-25T09:00:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f010b238640 1 -- 172.21.15.5:0/2698795340 shutdown_connections 2024-04-25T09:00:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f010b238640 1 -- 172.21.15.5:0/2698795340 >> 172.21.15.5:0/2698795340 conn(0x7f01040d1920 msgr2=0x7f01040d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f010b238640 1 -- 172.21.15.5:0/2698795340 shutdown_connections 2024-04-25T09:00:18.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.817+0000 7f010b238640 1 -- 172.21.15.5:0/2698795340 wait complete. 2024-04-25T09:00:18.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.818+0000 7f010b238640 1 Processor -- start 2024-04-25T09:00:18.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.818+0000 7f010b238640 1 -- start start 2024-04-25T09:00:18.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f010b238640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f00039b0 0x7f0104154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f010b238640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040ae570 0x7f01040c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f010b238640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01040cadd0 0x7f01040cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f010b238640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040cdd20 con 0x7f00f00039b0 2024-04-25T09:00:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f010b238640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040cfa40 con 0x7f01040cadd0 2024-04-25T09:00:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f010b238640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040cdea0 con 0x7f01040ae570 2024-04-25T09:00:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f0108fd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f00039b0 0x7f0104154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f0108fd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f00039b0 0x7f0104154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38816/0 (socket says 172.21.15.5:38816) 2024-04-25T09:00:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f0108fd4640 1 -- 172.21.15.5:0/2378328909 learned_addr learned my addr 172.21.15.5:0/2378328909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f0103fff640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040ae570 0x7f01040c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.819+0000 7f01097d5640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01040cadd0 0x7f01040cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f0108fd4640 1 -- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040ae570 msgr2=0x7f01040c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040ae570 0x7f01040c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f0108fd4640 1 -- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01040cadd0 msgr2=0x7f01040cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01040cadd0 0x7f01040cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f0108fd4640 1 -- 172.21.15.5:0/2378328909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040c9960 con 0x7f00f00039b0 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f0108fd4640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f00039b0 0x7f0104154170 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f00fc034040 tx=0x7f00fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f01017fa640 1 -- 172.21.15.5:0/2378328909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc041030 con 0x7f00f00039b0 2024-04-25T09:00:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f01017fa640 1 -- 172.21.15.5:0/2378328909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc031400 con 0x7f00f00039b0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01040c9c40 con 0x7f00f00039b0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f01017fa640 1 -- 172.21.15.5:0/2378328909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc036040 con 0x7f00f00039b0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.820+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01040ca200 con 0x7f00f00039b0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.821+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010404ef20 con 0x7f00f00039b0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.821+0000 7f01017fa640 1 -- 172.21.15.5:0/2378328909 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00fc044070 con 0x7f00f00039b0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.822+0000 7f01017fa640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00e406b500 0x7f00e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.822+0000 7f01017fa640 1 -- 172.21.15.5:0/2378328909 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00fc0aac70 con 0x7f00f00039b0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.822+0000 7f0103fff640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00e406b500 0x7f00e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.823+0000 7f0103fff640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00e406b500 0x7f00e406d9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f00f4001d30 tx=0x7f00f4007970 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:18.827+0000 7f01017fa640 1 -- 172.21.15.5:0/2378328909 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00fc079400 con 0x7f00f00039b0 2024-04-25T09:00:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.003+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01040c9040 con 0x7f00f00039b0 2024-04-25T09:00:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.004+0000 7f01017fa640 1 -- 172.21.15.5:0/2378328909 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00fc07d4a0 con 0x7f00f00039b0 2024-04-25T09:00:18.993 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:00:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00e406b500 msgr2=0x7f00e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00e406b500 0x7f00e406d9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f00f4001d30 tx=0x7f00f4007970 comp rx=0 tx=0).stop 2024-04-25T09:00:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f00039b0 msgr2=0x7f0104154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f00039b0 0x7f0104154170 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f00fc034040 tx=0x7f00fc009750 comp rx=0 tx=0).stop 2024-04-25T09:00:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 shutdown_connections 2024-04-25T09:00:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f00e406b500 0x7f00e406d9c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01040cadd0 0x7f01040cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01040ae570 0x7f01040c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 --2- 172.21.15.5:0/2378328909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00f00039b0 0x7f0104154170 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 >> 172.21.15.5:0/2378328909 conn(0x7f01040d1920 msgr2=0x7f010406c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 shutdown_connections 2024-04-25T09:00:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.006+0000 7f010b238640 1 -- 172.21.15.5:0/2378328909 wait complete. 2024-04-25T09:00:19.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:00:19.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbf789640 1 Processor -- start 2024-04-25T09:00:19.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbf789640 1 -- start start 2024-04-25T09:00:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbf789640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cb815e0a0 0x7f7cb80d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbf789640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80b7f60 con 0x7f7cb80d3df0 2024-04-25T09:00:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbf789640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80cf400 con 0x7f7cb80d3990 2024-04-25T09:00:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbf789640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80b29c0 con 0x7f7cb815e0a0 2024-04-25T09:00:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbd525640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cb815e0a0 0x7f7cb80d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbdd26640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7cb80d3df0 0x7f7cb80cecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49974/0 (socket says 172.21.15.5:49974) 2024-04-25T09:00:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbdd26640 1 -- 172.21.15.5:0/255765069 learned_addr learned my addr 172.21.15.5:0/255765069 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbd525640 1 -- 172.21.15.5:0/255765069 >> v1:172.21.15.80:6789/0 conn(0x7f7cb80d3990 legacy=0x7f7cb80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbd525640 1 -- 172.21.15.5:0/255765069 >> v1:172.21.15.5:6789/0 conn(0x7f7cb80d3df0 legacy=0x7f7cb80cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7cbd525640 1 -- 172.21.15.5:0/255765069 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80d2080 con 0x7f7cb815e0a0 2024-04-25T09:00:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.121+0000 7f7caffff640 1 -- 172.21.15.5:0/255765069 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197793790 0 0) 0x7f7cb80b7f60 con 0x7f7cb80d3df0 2024-04-25T09:00:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.122+0000 7f7cbd525640 1 --2- 172.21.15.5:0/255765069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb815e0a0 0x7f7cb80d0d50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40097a0 tx=0x7f7cb402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194dd864a63c97ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.122+0000 7f7caffff640 1 -- 172.21.15.5:0/255765069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4037070 con 0x7f7cb815e0a0 2024-04-25T09:00:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.122+0000 7f7caffff640 1 -- 172.21.15.5:0/255765069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb4032440 con 0x7f7cb815e0a0 2024-04-25T09:00:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.122+0000 7f7caffff640 1 -- 172.21.15.5:0/255765069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4032810 con 0x7f7cb815e0a0 2024-04-25T09:00:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.122+0000 7f7cbf789640 1 -- 172.21.15.5:0/255765069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb815e0a0 msgr2=0x7f7cb80d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.122+0000 7f7cbf789640 1 --2- 172.21.15.5:0/255765069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb815e0a0 0x7f7cb80d0d50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40097a0 tx=0x7f7cb402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.122+0000 7f7cbf789640 1 -- 172.21.15.5:0/255765069 shutdown_connections 2024-04-25T09:00:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.123+0000 7f7cbf789640 1 --2- 172.21.15.5:0/255765069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb815e0a0 0x7f7cb80d0d50 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.123+0000 7f7cbf789640 1 -- 172.21.15.5:0/255765069 >> 172.21.15.5:0/255765069 conn(0x7f7cb80668f0 msgr2=0x7f7cb8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.123+0000 7f7cbf789640 1 -- 172.21.15.5:0/255765069 shutdown_connections 2024-04-25T09:00:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.123+0000 7f7cbf789640 1 -- 172.21.15.5:0/255765069 wait complete. 2024-04-25T09:00:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 Processor -- start 2024-04-25T09:00:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 -- start start 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb80d3990 0x7f7cb815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7cb80d3df0 0x7f7cb80ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cb815e0a0 0x7f7cb80b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80d2920 con 0x7f7cb80d3990 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80d2640 con 0x7f7cb815e0a0 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.124+0000 7f7cbf789640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80d2c00 con 0x7f7cb80d3df0 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb80d3990 0x7f7cb815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb80d3990 0x7f7cb815a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38834/0 (socket says 172.21.15.5:38834) 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 -- 172.21.15.5:0/1266915052 learned_addr learned my addr 172.21.15.5:0/1266915052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbdd26640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cb815e0a0 0x7f7cb80b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbcd24640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7cb80d3df0 0x7f7cb80ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 -- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7cb80d3df0 msgr2=0x7f7cb80ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7cb80d3df0 0x7f7cb80ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 -- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cb815e0a0 msgr2=0x7f7cb80b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cb815e0a0 0x7f7cb80b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 -- 172.21.15.5:0/1266915052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80cd400 con 0x7f7cb80d3990 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbcd24640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7cb80d3df0 0x7f7cb80ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbd525640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb80d3990 0x7f7cb815a140 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4000c00 tx=0x7f7cb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cadffb640 1 -- 172.21.15.5:0/1266915052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4037040 con 0x7f7cb80d3990 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cadffb640 1 -- 172.21.15.5:0/1266915052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb4042070 con 0x7f7cb80d3990 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb80cd6e0 con 0x7f7cb80d3990 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cadffb640 1 -- 172.21.15.5:0/1266915052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4030a70 con 0x7f7cb80d3990 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.125+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb815fb20 con 0x7f7cb80d3990 2024-04-25T09:00:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.126+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb804ef20 con 0x7f7cb80d3990 2024-04-25T09:00:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.127+0000 7f7cadffb640 1 -- 172.21.15.5:0/1266915052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7cb4030c10 con 0x7f7cb80d3990 2024-04-25T09:00:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.127+0000 7f7cadffb640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c9c06b4d0 0x7f7c9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.128+0000 7f7cadffb640 1 -- 172.21.15.5:0/1266915052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cb40aace0 con 0x7f7cb80d3990 2024-04-25T09:00:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.128+0000 7f7cbcd24640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c9c06b4d0 0x7f7c9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.128+0000 7f7cbcd24640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c9c06b4d0 0x7f7c9c06d990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7cb815ed50 tx=0x7f7ca8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.133+0000 7f7cadffb640 1 -- 172.21.15.5:0/1266915052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7cb4045360 con 0x7f7cb80d3990 2024-04-25T09:00:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.327+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7cb815d5e0 con 0x7f7cb80d3990 2024-04-25T09:00:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.327+0000 7f7cadffb640 1 -- 172.21.15.5:0/1266915052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7cb4079b60 con 0x7f7cb80d3990 2024-04-25T09:00:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T09:00:19.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c9c06b4d0 msgr2=0x7f7c9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c9c06b4d0 0x7f7c9c06d990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7cb815ed50 tx=0x7f7ca8009040 comp rx=0 tx=0).stop 2024-04-25T09:00:19.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb80d3990 msgr2=0x7f7cb815a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb80d3990 0x7f7cb815a140 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4000c00 tx=0x7f7cb40046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 shutdown_connections 2024-04-25T09:00:19.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7c9c06b4d0 0x7f7c9c06d990 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cb815e0a0 0x7f7cb80b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7cb80d3df0 0x7f7cb80ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.329+0000 7f7cbf789640 1 --2- 172.21.15.5:0/1266915052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb80d3990 0x7f7cb815a140 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.330+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 >> 172.21.15.5:0/1266915052 conn(0x7f7cb80668f0 msgr2=0x7f7cb80d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.330+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 shutdown_connections 2024-04-25T09:00:19.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.330+0000 7f7cbf789640 1 -- 172.21.15.5:0/1266915052 wait complete. 2024-04-25T09:00:19.330 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:00:19.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:19.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:19.380 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:00:19.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:19.381 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:00:19.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:19.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.559+0000 7fdec484d640 1 Processor -- start 2024-04-25T09:00:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.559+0000 7fdec484d640 1 -- start start 2024-04-25T09:00:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdec484d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec015de70 0x7fdec00b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdec484d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdec00ce7f0 0x7fdec00cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdec484d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00cf1c0 con 0x7fdec00b2cc0 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdec484d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec00d2a10 con 0x7fdec00ce7f0 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdec484d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00d20e0 con 0x7fdec015de70 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdeb5d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdec00b2cc0 0x7fdec00b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49978/0 (socket says 172.21.15.5:49978) 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdeb5d9b640 1 -- 172.21.15.5:0/1641331611 learned_addr learned my addr 172.21.15.5:0/1641331611 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdebe59c640 1 --2- 172.21.15.5:0/1641331611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec015de70 0x7fdec00b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdebed9d640 1 --2- 172.21.15.5:0/1641331611 >> v2:172.21.15.80:3300/0 conn(0x7fdec00ce7f0 0x7fdec00cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdebdd9b640 1 -- 172.21.15.5:0/1641331611 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019059485 0 0) 0x7fdec00cf1c0 con 0x7fdec00b2cc0 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdebdd9b640 1 -- 172.21.15.5:0/1641331611 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeac003520 con 0x7fdec00b2cc0 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdebe59c640 1 -- 172.21.15.5:0/1641331611 >> v2:172.21.15.80:3300/0 conn(0x7fdec00ce7f0 msgr2=0x7fdec00cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdebe59c640 1 --2- 172.21.15.5:0/1641331611 >> v2:172.21.15.80:3300/0 conn(0x7fdec00ce7f0 0x7fdec00cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.560+0000 7fdebe59c640 1 -- 172.21.15.5:0/1641331611 >> v1:172.21.15.5:6789/0 conn(0x7fdec00b2cc0 legacy=0x7fdec00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.561+0000 7fdebdd9b640 1 -- 172.21.15.5:0/1641331611 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3724547848 0 0) 0x7fdeac003520 con 0x7fdec00b2cc0 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.561+0000 7fdebe59c640 1 -- 172.21.15.5:0/1641331611 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00d23c0 con 0x7fdec015de70 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.561+0000 7fdebe59c640 1 --2- 172.21.15.5:0/1641331611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec015de70 0x7fdec00b93e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00097a0 tx=0x7fdeb002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeab74503a174f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.561+0000 7fdebdd9b640 1 -- 172.21.15.5:0/1641331611 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0037070 con 0x7fdec015de70 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.561+0000 7fdebdd9b640 1 -- 172.21.15.5:0/1641331611 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb002aba0 con 0x7fdec015de70 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.561+0000 7fdebdd9b640 1 -- 172.21.15.5:0/1641331611 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8001670 con 0x7fdec015de70 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 -- 172.21.15.5:0/1641331611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec015de70 msgr2=0x7fdec00b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 --2- 172.21.15.5:0/1641331611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec015de70 0x7fdec00b93e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00097a0 tx=0x7fdeb002a110 comp rx=0 tx=0).stop 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 -- 172.21.15.5:0/1641331611 shutdown_connections 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 --2- 172.21.15.5:0/1641331611 >> v2:172.21.15.80:3300/0 conn(0x7fdec00ce7f0 0x7fdec00cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 --2- 172.21.15.5:0/1641331611 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec015de70 0x7fdec00b93e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 -- 172.21.15.5:0/1641331611 >> 172.21.15.5:0/1641331611 conn(0x7fdec006b000 msgr2=0x7fdec006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 -- 172.21.15.5:0/1641331611 shutdown_connections 2024-04-25T09:00:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.562+0000 7fdec484d640 1 -- 172.21.15.5:0/1641331611 wait complete. 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.563+0000 7fdec484d640 1 Processor -- start 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdec484d640 1 -- start start 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdec484d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec00b2cc0 0x7fdec00c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdec484d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec00ce7f0 0x7fdec00ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdec484d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec015de70 0x7fdec0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdec484d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00b7300 con 0x7fdec015de70 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdec484d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00b9920 con 0x7fdec00b2cc0 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdec484d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00d2ea0 con 0x7fdec00ce7f0 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdebed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec015de70 0x7fdec0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdebed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec015de70 0x7fdec0159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38842/0 (socket says 172.21.15.5:38842) 2024-04-25T09:00:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdebed9d640 1 -- 172.21.15.5:0/3155320678 learned_addr learned my addr 172.21.15.5:0/3155320678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdebe59c640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec00b2cc0 0x7fdec00c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.564+0000 7fdeb5d9b640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec00ce7f0 0x7fdec00ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdebed9d640 1 -- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec00ce7f0 msgr2=0x7fdec00ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdebed9d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec00ce7f0 0x7fdec00ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdebed9d640 1 -- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec00b2cc0 msgr2=0x7fdec00c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdebed9d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec00b2cc0 0x7fdec00c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdebed9d640 1 -- 172.21.15.5:0/3155320678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00c7620 con 0x7fdec015de70 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdeb5d9b640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec00ce7f0 0x7fdec00ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdebed9d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec015de70 0x7fdec0159fe0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800efc0 tx=0x7fdeb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdeb77fe640 1 -- 172.21.15.5:0/3155320678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8018020 con 0x7fdec015de70 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdeb77fe640 1 -- 172.21.15.5:0/3155320678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8014480 con 0x7fdec015de70 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec00c7900 con 0x7fdec015de70 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdeb77fe640 1 -- 172.21.15.5:0/3155320678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8014870 con 0x7fdec015de70 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.565+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec00c7ec0 con 0x7fdec015de70 2024-04-25T09:00:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.566+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec004ef20 con 0x7fdec015de70 2024-04-25T09:00:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.566+0000 7fdeb77fe640 1 -- 172.21.15.5:0/3155320678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdeb8005d10 con 0x7fdec015de70 2024-04-25T09:00:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.567+0000 7fdeb77fe640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdea006b4d0 0x7fdea006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.567+0000 7fdeb77fe640 1 -- 172.21.15.5:0/3155320678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdeb808b040 con 0x7fdec015de70 2024-04-25T09:00:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.567+0000 7fdebe59c640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdea006b4d0 0x7fdea006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.568+0000 7fdebe59c640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdea006b4d0 0x7fdea006d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0034000 tx=0x7fdeb002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.571+0000 7fdeb77fe640 1 -- 172.21.15.5:0/3155320678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdeb8022030 con 0x7fdec015de70 2024-04-25T09:00:19.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.792+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdec00b9290 con 0x7fdec015de70 2024-04-25T09:00:19.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.792+0000 7fdeb77fe640 1 -- 172.21.15.5:0/3155320678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fdeb8010040 con 0x7fdec015de70 2024-04-25T09:00:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:19.781 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/313563585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":313563585},{"type":"v1","addr":"172.21.15.80:6837","nonce":313563585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/109709411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":109709411},{"type":"v1","addr":"172.21.15.5:6834","nonce":109709411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6483,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2543846434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2543846434},{"type":"v1","addr":"172.21.15.5:6835","nonce":2543846434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:08.548961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6495":{"gid":6495,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6836/3464170028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3464170028},{"type":"v1","addr":"172.21.15.80:6836","nonce":3464170028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:19.781 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdea006b4d0 msgr2=0x7fdea006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdea006b4d0 0x7fdea006d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0034000 tx=0x7fdeb002e000 comp rx=0 tx=0).stop 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec015de70 msgr2=0x7fdec0159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec015de70 0x7fdec0159fe0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800efc0 tx=0x7fdeb800c490 comp rx=0 tx=0).stop 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 shutdown_connections 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdea006b4d0 0x7fdea006d990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec015de70 0x7fdec0159fe0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdec00ce7f0 0x7fdec00ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 --2- 172.21.15.5:0/3155320678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec00b2cc0 0x7fdec00c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 >> 172.21.15.5:0/3155320678 conn(0x7fdec006b000 msgr2=0x7fdec015e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:19.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 shutdown_connections 2024-04-25T09:00:19.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:19.794+0000 7fdec484d640 1 -- 172.21.15.5:0/3155320678 wait complete. 2024-04-25T09:00:19.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-25T09:00:19.924 INFO:teuthology.orchestra.run.smithi080.stdout:{"message":"","return_code":0} 2024-04-25T09:00:19.924 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:00:19.925 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:00:19.925 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:19.925 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:00:19.925 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:19.926 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:00:19.926 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:19.926 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:00:19.926 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:19.935 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:00:19.936 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:19.938 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:00:19.938 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:00:19.938 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:19.938 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:24.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T09:00:25.938 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:00:25.938 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:25.938 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-04-25T09:00:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.000+0000 7fe95bc67f40 1 Processor -- start 2024-04-25T09:00:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.000+0000 7fe95bc67f40 1 -- start start 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe95bc67f40 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e23ac70 0x55694e305200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe95bc67f40 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23d0d0 0x55694e30e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe95bc67f40 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e30fd40 0x55694e30eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe95bc67f40 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694e23b590 con 0x55694e23ac70 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe95bc67f40 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694e1e2df0 con 0x55694e30fd40 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe95bc67f40 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55694e26b490 con 0x55694e23d0d0 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e23ac70 0x55694e305200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e23ac70 0x55694e305200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39780/0 (socket says 172.21.15.5:39780) 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 -- 172.21.15.5:0/1742903798 learned_addr learned my addr 172.21.15.5:0/1742903798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959f69640 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e30fd40 0x55694e30eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe958f67640 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23d0d0 0x55694e30e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 -- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23d0d0 msgr2=0x55694e30e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23d0d0 0x55694e30e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 -- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e30fd40 msgr2=0x55694e30eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e30fd40 0x55694e30eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 -- 172.21.15.5:0/1742903798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55694e168c50 con 0x55694e23ac70 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959f69640 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e30fd40 0x55694e30eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe958f67640 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23d0d0 0x55694e30e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.001+0000 7fe959768640 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e23ac70 0x55694e305200 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001d90 tx=0x7fe94c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4602f65dc36dac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe94b7fe640 1 -- 172.21.15.5:0/1742903798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c012020 con 0x55694e23ac70 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe94b7fe640 1 -- 172.21.15.5:0/1742903798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c00e670 con 0x55694e23ac70 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe94b7fe640 1 -- 172.21.15.5:0/1742903798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00eac0 con 0x55694e23ac70 2024-04-25T09:00:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 -- 172.21.15.5:0/1742903798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e23ac70 msgr2=0x55694e305200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e23ac70 0x55694e305200 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001d90 tx=0x7fe94c00b6c0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 -- 172.21.15.5:0/1742903798 shutdown_connections 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e30fd40 0x55694e30eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23d0d0 0x55694e30e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/1742903798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e23ac70 0x55694e305200 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 -- 172.21.15.5:0/1742903798 >> 172.21.15.5:0/1742903798 conn(0x55694e23d9d0 msgr2=0x55694e282bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 -- 172.21.15.5:0/1742903798 shutdown_connections 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.002+0000 7fe95bc67f40 1 -- 172.21.15.5:0/1742903798 wait complete. 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.003+0000 7fe95bc67f40 1 Processor -- start 2024-04-25T09:00:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.003+0000 7fe95bc67f40 1 -- start start 2024-04-25T09:00:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe95bc67f40 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23ac70 0x55694e30ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe95bc67f40 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e23d0d0 0x55694e308fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe95bc67f40 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e30fd40 0x55694e3066b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe95bc67f40 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694e3062c0 con 0x55694e30fd40 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe95bc67f40 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694e305fe0 con 0x55694e23d0d0 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe95bc67f40 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55694e26a820 con 0x55694e23ac70 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e30fd40 0x55694e3066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e30fd40 0x55694e3066b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39786/0 (socket says 172.21.15.5:39786) 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 -- 172.21.15.5:0/615648959 learned_addr learned my addr 172.21.15.5:0/615648959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959768640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23ac70 0x55694e30ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe958f67640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e23d0d0 0x55694e308fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 -- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23ac70 msgr2=0x55694e30ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55694e23ac70 0x55694e30ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 -- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e23d0d0 msgr2=0x55694e308fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55694e23d0d0 0x55694e308fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 -- 172.21.15.5:0/615648959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55694e281a60 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe959f69640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e30fd40 0x55694e3066b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe954008240 tx=0x7fe954008700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.004+0000 7fe94a7fc640 1 -- 172.21.15.5:0/615648959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954016030 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.005+0000 7fe94a7fc640 1 -- 172.21.15.5:0/615648959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954012410 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.005+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55694e281d40 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.005+0000 7fe94a7fc640 1 -- 172.21.15.5:0/615648959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400e040 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.005+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55694e3087e0 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.006+0000 7fe94a7fc640 1 -- 172.21.15.5:0/615648959 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe954019070 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.007+0000 7fe94a7fc640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe93c069eb0 0x7fe93c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.007+0000 7fe94a7fc640 1 -- 172.21.15.5:0/615648959 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe954088980 con 0x55694e30fd40 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.007+0000 7fe959768640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe93c069eb0 0x7fe93c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.007+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x55694e306bf0 0x55694e303d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.007+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 --> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] -- osd_op(unknown.0.0:1 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) v9 -- 0x55694e304240 con 0x55694e306bf0 2024-04-25T09:00:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.007+0000 7fe958f67640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x55694e306bf0 0x55694e303d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.007+0000 7fe959768640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe93c069eb0 0x7fe93c06c370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001d90 tx=0x7fe94c009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.008+0000 7fe958f67640 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x55694e306bf0 0x55694e303d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe958f67640 1 -- 172.21.15.5:0/615648959 <== osd.7 v2:172.21.15.80:6800/4179945280 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v57'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe950054970 con 0x55694e306bf0 2024-04-25T09:00:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x55694e306bf0 msgr2=0x55694e303d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x55694e306bf0 0x55694e303d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe93c069eb0 msgr2=0x7fe93c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe93c069eb0 0x7fe93c06c370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001d90 tx=0x7fe94c009000 comp rx=0 tx=0).stop 2024-04-25T09:00:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e30fd40 msgr2=0x55694e3066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 --2- 172.21.15.5:0/615648959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55694e30fd40 0x55694e3066b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe954008240 tx=0x7fe954008700 comp rx=0 tx=0).stop 2024-04-25T09:00:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe959f69640 1 -- 172.21.15.5:0/615648959 reap_dead start 2024-04-25T09:00:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 shutdown_connections 2024-04-25T09:00:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 >> 172.21.15.5:0/615648959 conn(0x55694e23d9d0 msgr2=0x55694e3057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 shutdown_connections 2024-04-25T09:00:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.009+0000 7fe95bc67f40 1 -- 172.21.15.5:0/615648959 wait complete. 2024-04-25T09:00:26.001 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-04-25T09:00:26.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-04-25T09:00:26.001 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-04-25T09:00:26.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-04-25T09:00:26.002 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-04-25T09:00:26.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-04-25T09:00:26.002 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-04-25T09:00:26.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-04-25T09:00:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.127+0000 7f91319f9640 1 Processor -- start 2024-04-25T09:00:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.127+0000 7f51db36a640 1 Processor -- start 2024-04-25T09:00:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.127+0000 7f91319f9640 1 -- start start 2024-04-25T09:00:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.127+0000 7f51db36a640 1 -- start start 2024-04-25T09:00:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.128+0000 7f91319f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f912c15ef00 0x7f912c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.128+0000 7f91319f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c067240 con 0x7f912c066e30 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.128+0000 7f91319f9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c0ae5e0 con 0x7f912c1581e0 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.128+0000 7f91319f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c0ae300 con 0x7f912c15ef00 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.128+0000 7f9123fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f912c15ef00 0x7f912c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.128+0000 7f912b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f912c066e30 0x7f912c161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60162/0 (socket says 172.21.15.5:60162) 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.128+0000 7f912b7fe640 1 -- 172.21.15.5:0/1202218309 learned_addr learned my addr 172.21.15.5:0/1202218309 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f912a7fc640 1 -- 172.21.15.5:0/1202218309 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318290361 0 0) 0x7f9124001490 con 0x7f912c066e30 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f912a7fc640 1 -- 172.21.15.5:0/1202218309 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9118003520 con 0x7f912c066e30 2024-04-25T09:00:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51db36a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51d40714d0 0x7f51d415e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f9123fff640 1 -- 172.21.15.5:0/1202218309 >> v1:172.21.15.80:6789/0 conn(0x7f912c1581e0 legacy=0x7f912c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f9123fff640 1 -- 172.21.15.5:0/1202218309 >> v1:172.21.15.5:6789/0 conn(0x7f912c066e30 legacy=0x7f912c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f9123fff640 1 -- 172.21.15.5:0/1202218309 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c15e420 con 0x7f912c15ef00 2024-04-25T09:00:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51d9106640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f51d40710f0 0x7f51d40ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60170/0 (socket says 172.21.15.5:60170) 2024-04-25T09:00:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51d8905640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51d40714d0 0x7f51d415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51d9106640 1 -- 172.21.15.5:0/380580406 learned_addr learned my addr 172.21.15.5:0/380580406 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d415edc0 con 0x7f51d40710f0 2024-04-25T09:00:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d415f0a0 con 0x7f51d40cd1d0 2024-04-25T09:00:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d415eb90 con 0x7f51d40714d0 2024-04-25T09:00:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406157525 0 0) 0x7f51d415edc0 con 0x7f51d40710f0 2024-04-25T09:00:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.129+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c0003520 con 0x7f51d40710f0 2024-04-25T09:00:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926514739 0 0) 0x7f51d415f0a0 con 0x7f51d40cd1d0 2024-04-25T09:00:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d415edc0 con 0x7f51d40cd1d0 2024-04-25T09:00:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509586015 0 0) 0x7f51c0003520 con 0x7f51d40710f0 2024-04-25T09:00:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f9123fff640 1 --2- 172.21.15.5:0/1202218309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c15ef00 0x7f912c0668f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f91140097a0 tx=0x7f911402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c8e6709200e129 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 >> v2:172.21.15.80:3300/0 conn(0x7f51d40714d0 msgr2=0x7f51d415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 --2- 172.21.15.5:0/380580406 >> v2:172.21.15.80:3300/0 conn(0x7f51d40714d0 0x7f51d415e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 >> v1:172.21.15.80:6789/0 conn(0x7f51d40cd1d0 legacy=0x7f51d40ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d415f380 con 0x7f51d40710f0 2024-04-25T09:00:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f912a7fc640 1 -- 172.21.15.5:0/1202218309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114037070 con 0x7f912c15ef00 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f51d0001670 con 0x7f51d40710f0 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 >> v1:172.21.15.5:6789/0 conn(0x7f51d40710f0 legacy=0x7f51d40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51c0003b40 0x7f51c0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c0004800 0x7f51c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51c00051c0 0x7f51c000ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0010510 con 0x7f51c00051c0 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0010690 con 0x7f51c0004800 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0010810 con 0x7f51c0003b40 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d9907640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51c00051c0 0x7f51c000ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d9106640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51c0003b40 0x7f51c0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d8905640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c0004800 0x7f51c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f912a7fc640 1 -- 172.21.15.5:0/1202218309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114032440 con 0x7f912c15ef00 2024-04-25T09:00:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f912a7fc640 1 -- 172.21.15.5:0/1202218309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114032810 con 0x7f912c15ef00 2024-04-25T09:00:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d9907640 1 -- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51c0003b40 msgr2=0x7f51c0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d9907640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51c0003b40 0x7f51c0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d9907640 1 -- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c0004800 msgr2=0x7f51c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d9907640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c0004800 0x7f51c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d9907640 1 -- 172.21.15.5:0/380580406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0003520 con 0x7f51c00051c0 2024-04-25T09:00:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.130+0000 7f51d8905640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c0004800 0x7f51c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f91319f9640 1 -- 172.21.15.5:0/1202218309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c15ef00 msgr2=0x7f912c0668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f91319f9640 1 --2- 172.21.15.5:0/1202218309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c15ef00 0x7f912c0668f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f91140097a0 tx=0x7f911402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f91319f9640 1 -- 172.21.15.5:0/1202218309 shutdown_connections 2024-04-25T09:00:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f91319f9640 1 --2- 172.21.15.5:0/1202218309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c15ef00 0x7f912c0668f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f91319f9640 1 -- 172.21.15.5:0/1202218309 >> 172.21.15.5:0/1202218309 conn(0x7f912c0d0870 msgr2=0x7f912c0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f51d9907640 1 -- 172.21.15.5:0/380580406 reap_dead start 2024-04-25T09:00:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f51d9907640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51c00051c0 0x7f51c000ffd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51cc001fd0 tx=0x7f51c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2e13706d47f678 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f91319f9640 1 -- 172.21.15.5:0/1202218309 shutdown_connections 2024-04-25T09:00:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f91319f9640 1 -- 172.21.15.5:0/1202218309 wait complete. 2024-04-25T09:00:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc001bf0 con 0x7f51c00051c0 2024-04-25T09:00:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc003b70 con 0x7f51c00051c0 2024-04-25T09:00:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.131+0000 7f51cbfff640 1 -- 172.21.15.5:0/380580406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc0050d0 con 0x7f51c00051c0 2024-04-25T09:00:26.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.132+0000 7efef0a8f640 1 Processor -- start 2024-04-25T09:00:26.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.132+0000 7efef0a8f640 1 -- start start 2024-04-25T09:00:26.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.132+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51c00051c0 msgr2=0x7f51c000ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.132+0000 7f51db36a640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51c00051c0 0x7f51c000ffd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51cc001fd0 tx=0x7f51c0005830 comp rx=0 tx=0).stop 2024-04-25T09:00:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.132+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 shutdown_connections 2024-04-25T09:00:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.132+0000 7f51db36a640 1 --2- 172.21.15.5:0/380580406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51c00051c0 0x7f51c000ffd0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.132+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 >> 172.21.15.5:0/380580406 conn(0x7f51d40b1da0 msgr2=0x7f51d40b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7f91319f9640 1 Processor -- start 2024-04-25T09:00:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 shutdown_connections 2024-04-25T09:00:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7f51db36a640 1 -- 172.21.15.5:0/380580406 wait complete. 2024-04-25T09:00:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7f91319f9640 1 -- start start 2024-04-25T09:00:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7efef0a8f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec0d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7efef0a8f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0d2550 con 0x7efeec0d0400 2024-04-25T09:00:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7efef0a8f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0d2830 con 0x7efeec15def0 2024-04-25T09:00:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7efef0a8f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec15e2d0 con 0x7efeec0b94c0 2024-04-25T09:00:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7efeead9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efeec0d0400 0x7efeec0b6c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60178/0 (socket says 172.21.15.5:60178) 2024-04-25T09:00:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7efeead9d640 1 -- 172.21.15.5:0/2440371555 learned_addr learned my addr 172.21.15.5:0/2440371555 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.133+0000 7facf1bb0640 1 Processor -- start 2024-04-25T09:00:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee3fff640 1 --2- 172.21.15.5:0/2440371555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec0d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f91319f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c066e30 0x7f912c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f91319f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c1581e0 0x7f912c161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f91319f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912c15ef00 0x7f912c1f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f91319f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c1585c0 con 0x7f912c1581e0 2024-04-25T09:00:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f91319f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c15e9e0 con 0x7f912c066e30 2024-04-25T09:00:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f91319f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0afd50 con 0x7f912c15ef00 2024-04-25T09:00:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7facf1bb0640 1 -- start start 2024-04-25T09:00:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c1581e0 0x7f912c161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216498189 0 0) 0x7efeec0d2550 con 0x7efeec0d0400 2024-04-25T09:00:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed8003520 con 0x7efeec0d0400 2024-04-25T09:00:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644939361 0 0) 0x7efeec0d2830 con 0x7efeec15def0 2024-04-25T09:00:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeec0d2550 con 0x7efeec15def0 2024-04-25T09:00:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c1581e0 0x7f912c161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39818/0 (socket says 172.21.15.5:39818) 2024-04-25T09:00:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 -- 172.21.15.5:0/119520776 learned_addr learned my addr 172.21.15.5:0/119520776 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f912affd640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c066e30 0x7f912c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f51db36a640 1 Processor -- start 2024-04-25T09:00:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f51db36a640 1 -- start start 2024-04-25T09:00:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee3fff640 1 -- 172.21.15.5:0/2440371555 >> v1:172.21.15.80:6789/0 conn(0x7efeec15def0 legacy=0x7efeec0d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f912b7fe640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912c15ef00 0x7f912c1f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 -- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912c15ef00 msgr2=0x7f912c1f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912c15ef00 0x7f912c1f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 -- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c066e30 msgr2=0x7f912c0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c066e30 0x7f912c0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7f9123fff640 1 -- 172.21.15.5:0/119520776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0cd720 con 0x7f912c1581e0 2024-04-25T09:00:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee3fff640 1 -- 172.21.15.5:0/2440371555 >> v1:172.21.15.5:6789/0 conn(0x7efeec0d0400 legacy=0x7efeec0b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee3fff640 1 -- 172.21.15.5:0/2440371555 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0d2b10 con 0x7efeec0b94c0 2024-04-25T09:00:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f9123fff640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c1581e0 0x7f912c161a50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f911402a790 tx=0x7f91140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.134+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 <== mon.1 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2675675622 0 0) 0x7efeec0d2550 con 0x7efeec15def0 2024-04-25T09:00:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f9128ff9640 1 -- 172.21.15.5:0/119520776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114037050 con 0x7f912c1581e0 2024-04-25T09:00:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f9128ff9640 1 -- 172.21.15.5:0/119520776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114043070 con 0x7f912c1581e0 2024-04-25T09:00:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f9128ff9640 1 -- 172.21.15.5:0/119520776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911403cb30 con 0x7f912c1581e0 2024-04-25T09:00:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912c0cda00 con 0x7f912c1581e0 2024-04-25T09:00:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c0cdfc0 con 0x7f912c1581e0 2024-04-25T09:00:26.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7facf1bb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec067000 0x7facec168b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51db36a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c00051c0 0x7f51d40ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51db36a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51d415ca50 0x7f51d415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51db36a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51d41f2c80 0x7f51d41f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7faceaffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7facec15ef00 0x7facec0668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:60766/0 (socket says 172.21.15.5:60766) 2024-04-25T09:00:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51db36a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d4143e20 con 0x7f51d415ca50 2024-04-25T09:00:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51db36a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d4143ca0 con 0x7f51c00051c0 2024-04-25T09:00:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51db36a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d4143fa0 con 0x7f51d41f2c80 2024-04-25T09:00:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51d9106640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c00051c0 0x7f51d40ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51d8905640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51d415ca50 0x7f51d415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51d9907640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51d41f2c80 0x7f51d41f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7faceaffd640 1 -- 172.21.15.5:0/779037616 learned_addr learned my addr 172.21.15.5:0/779037616 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51d8905640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51d415ca50 0x7f51d415ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39826/0 (socket says 172.21.15.5:39826) 2024-04-25T09:00:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7f51d8905640 1 -- 172.21.15.5:0/3689961123 learned_addr learned my addr 172.21.15.5:0/3689961123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facebfff640 1 --2- 172.21.15.5:0/779037616 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec067000 0x7facec168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.135+0000 7f51d9106640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c00051c0 0x7f51d40ac540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:49632/0 (socket says 172.21.15.5:49632) 2024-04-25T09:00:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec0ae5e0 con 0x7facec1581e0 2024-04-25T09:00:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7efee3fff640 1 --2- 172.21.15.5:0/2440371555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec0d35f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efed40097d0 tx=0x7efed402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffff3a611aaa9d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec0ae300 con 0x7facec15ef00 2024-04-25T09:00:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec15e420 con 0x7facec067000 2024-04-25T09:00:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4037070 con 0x7efeec0b94c0 2024-04-25T09:00:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed402abd0 con 0x7efeec0b94c0 2024-04-25T09:00:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7efee9d9b640 1 -- 172.21.15.5:0/2440371555 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4001970 con 0x7efeec0b94c0 2024-04-25T09:00:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facea7fc640 1 -- 172.21.15.5:0/779037616 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001018535 0 0) 0x7facec0ae5e0 con 0x7facec1581e0 2024-04-25T09:00:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facea7fc640 1 -- 172.21.15.5:0/779037616 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd4003520 con 0x7facec1581e0 2024-04-25T09:00:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7f51d8905640 1 -- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51d41f2c80 msgr2=0x7f51d41f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7f51d8905640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51d41f2c80 0x7f51d41f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7f51d8905640 1 -- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c00051c0 msgr2=0x7f51d40ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7f51d8905640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c00051c0 0x7f51d40ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7f51d8905640 1 -- 172.21.15.5:0/3689961123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40a9c10 con 0x7f51d415ca50 2024-04-25T09:00:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7f51d9907640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51d41f2c80 0x7f51d41f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facebfff640 1 -- 172.21.15.5:0/779037616 >> v1:172.21.15.80:6789/0 conn(0x7facec15ef00 legacy=0x7facec0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facebfff640 1 -- 172.21.15.5:0/779037616 >> v1:172.21.15.5:6789/0 conn(0x7facec1581e0 legacy=0x7facec0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.136+0000 7facebfff640 1 -- 172.21.15.5:0/779037616 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec15e700 con 0x7facec067000 2024-04-25T09:00:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f51d8905640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51d415ca50 0x7f51d415ced0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f51c40108e0 tx=0x7f51c4010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f51c9ffb640 1 -- 172.21.15.5:0/3689961123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c400f040 con 0x7f51d415ca50 2024-04-25T09:00:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7efef0a8f640 1 -- 172.21.15.5:0/2440371555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 msgr2=0x7efeec0d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7efef0a8f640 1 --2- 172.21.15.5:0/2440371555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec0d35f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efed40097d0 tx=0x7efed402a140 comp rx=0 tx=0).stop 2024-04-25T09:00:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f51c9ffb640 1 -- 172.21.15.5:0/3689961123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c400ec20 con 0x7f51d415ca50 2024-04-25T09:00:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d40a9ef0 con 0x7f51d415ca50 2024-04-25T09:00:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f51c9ffb640 1 -- 172.21.15.5:0/3689961123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c401c400 con 0x7f51d415ca50 2024-04-25T09:00:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c0ae7d0 con 0x7f912c1581e0 2024-04-25T09:00:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7facebfff640 1 --2- 172.21.15.5:0/779037616 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec067000 0x7facec168b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7face4009dc0 tx=0x7face402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12cf60d58e8099d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7efef0a8f640 1 -- 172.21.15.5:0/2440371555 shutdown_connections 2024-04-25T09:00:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7efef0a8f640 1 --2- 172.21.15.5:0/2440371555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec0d35f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7efef0a8f640 1 -- 172.21.15.5:0/2440371555 >> 172.21.15.5:0/2440371555 conn(0x7efeec06b000 msgr2=0x7efeec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7efef0a8f640 1 -- 172.21.15.5:0/2440371555 shutdown_connections 2024-04-25T09:00:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7efef0a8f640 1 -- 172.21.15.5:0/2440371555 wait complete. 2024-04-25T09:00:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d415d410 con 0x7f51d415ca50 2024-04-25T09:00:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.137+0000 7f9128ff9640 1 -- 172.21.15.5:0/119520776 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f911403ccd0 con 0x7f912c1581e0 2024-04-25T09:00:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.138+0000 7facea7fc640 1 -- 172.21.15.5:0/779037616 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face402ae60 con 0x7facec067000 2024-04-25T09:00:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.138+0000 7facea7fc640 1 -- 172.21.15.5:0/779037616 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4007740 con 0x7facec067000 2024-04-25T09:00:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.138+0000 7facea7fc640 1 -- 172.21.15.5:0/779037616 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4007af0 con 0x7facec067000 2024-04-25T09:00:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.138+0000 7f9128ff9640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910c06b520 0x7f910c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.138+0000 7f9128ff9640 1 -- 172.21.15.5:0/119520776 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9114075d70 con 0x7f912c1581e0 2024-04-25T09:00:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.138+0000 7f912affd640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910c06b520 0x7f910c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.138+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d40aa500 con 0x7f51d415ca50 2024-04-25T09:00:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec067000 msgr2=0x7facec168b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7facf1bb0640 1 --2- 172.21.15.5:0/779037616 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec067000 0x7facec168b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7face4009dc0 tx=0x7face402a640 comp rx=0 tx=0).stop 2024-04-25T09:00:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 shutdown_connections 2024-04-25T09:00:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7facf1bb0640 1 --2- 172.21.15.5:0/779037616 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec067000 0x7facec168b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 >> 172.21.15.5:0/779037616 conn(0x7facec0d0870 msgr2=0x7facec0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 shutdown_connections 2024-04-25T09:00:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7f912affd640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910c06b520 0x7f910c06d9e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f911c000f60 tx=0x7f911c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7f51c9ffb640 1 -- 172.21.15.5:0/3689961123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51c401c5a0 con 0x7f51d415ca50 2024-04-25T09:00:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7facf1bb0640 1 -- 172.21.15.5:0/779037616 wait complete. 2024-04-25T09:00:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7efef0a8f640 1 Processor -- start 2024-04-25T09:00:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7f51c9ffb640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51b806b4d0 0x7f51b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.139+0000 7efef0a8f640 1 -- start start 2024-04-25T09:00:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7f51c9ffb640 1 -- 172.21.15.5:0/3689961123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51c408a8c0 con 0x7f51d415ca50 2024-04-25T09:00:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7f51d9106640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51b806b4d0 0x7f51b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efef0a8f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efef0a8f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0d0400 0x7efeec160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efef0a8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec15def0 0x7efeec0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efef0a8f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0d0870 con 0x7efeec0d0400 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efef0a8f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0d30d0 con 0x7efeec15def0 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efef0a8f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0d09f0 con 0x7efeec0b94c0 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efeea59c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efeea59c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:47564/0 (socket says 172.21.15.5:47564) 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efeea59c640 1 -- 172.21.15.5:0/1101433075 learned_addr learned my addr 172.21.15.5:0/1101433075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0d0400 0x7efeec160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7efeead9d640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec15def0 0x7efeec0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.140+0000 7facf1bb0640 1 Processor -- start 2024-04-25T09:00:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7facf1bb0640 1 -- start start 2024-04-25T09:00:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7f51d9106640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51b806b4d0 0x7f51b806d990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f51d00011e0 tx=0x7f51d0001e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7efeea59c640 1 -- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec15def0 msgr2=0x7efeec0cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7efeea59c640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec15def0 0x7efeec0cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7efeea59c640 1 -- 172.21.15.5:0/1101433075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0d0400 msgr2=0x7efeec160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7efeea59c640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0d0400 0x7efeec160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7efeea59c640 1 -- 172.21.15.5:0/1101433075 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec151570 con 0x7efeec0b94c0 2024-04-25T09:00:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7efee3fff640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0d0400 0x7efeec160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.141+0000 7efeea59c640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec151030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c700 tx=0x7efedc00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facf1bb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facec067000 0x7facec145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facf1bb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facec1581e0 0x7facec1f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facf1bb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec15ef00 0x7facec06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7efee2ffd640 1 -- 172.21.15.5:0/1101433075 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc016020 con 0x7efeec0b94c0 2024-04-25T09:00:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7efee2ffd640 1 -- 172.21.15.5:0/1101433075 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc00a880 con 0x7efeec0b94c0 2024-04-25T09:00:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7efee2ffd640 1 -- 172.21.15.5:0/1101433075 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00ac70 con 0x7efeec0b94c0 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facf1bb0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0afd50 con 0x7facec1581e0 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facf1bb0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec1585c0 con 0x7facec067000 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facec1581e0 0x7facec1f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facf1bb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0adf50 con 0x7facec15ef00 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facec1581e0 0x7facec1f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39844/0 (socket says 172.21.15.5:39844) 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceaffd640 1 -- 172.21.15.5:0/2708526777 learned_addr learned my addr 172.21.15.5:0/2708526777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceb7fe640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facec067000 0x7facec145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facebfff640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec15ef00 0x7facec06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec1f6550 con 0x7efeec0b94c0 2024-04-25T09:00:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec1f6b10 con 0x7efeec0b94c0 2024-04-25T09:00:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceb7fe640 1 -- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec15ef00 msgr2=0x7facec06e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceb7fe640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec15ef00 0x7facec06e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceb7fe640 1 -- 172.21.15.5:0/2708526777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facec1581e0 msgr2=0x7facec1f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceb7fe640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facec1581e0 0x7facec1f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceb7fe640 1 -- 172.21.15.5:0/2708526777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec1f4650 con 0x7facec067000 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7facebfff640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec15ef00 0x7facec06e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceaffd640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facec1581e0 0x7facec1f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.142+0000 7faceb7fe640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facec067000 0x7facec145600 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c3c0 tx=0x7facdc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.143+0000 7facd3fff640 1 -- 172.21.15.5:0/2708526777 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc017070 con 0x7facec067000 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.143+0000 7facd3fff640 1 -- 172.21.15.5:0/2708526777 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc0052f0 con 0x7facec067000 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.143+0000 7facd3fff640 1 -- 172.21.15.5:0/2708526777 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc003830 con 0x7facec067000 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.143+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec1f4930 con 0x7facec067000 2024-04-25T09:00:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.143+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec1f4190 con 0x7facec067000 2024-04-25T09:00:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.144+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec04ef20 con 0x7efeec0b94c0 2024-04-25T09:00:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.144+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec04ef20 con 0x7facec067000 2024-04-25T09:00:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.144+0000 7efee2ffd640 1 -- 172.21.15.5:0/1101433075 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efedc019020 con 0x7efeec0b94c0 2024-04-25T09:00:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.144+0000 7efee2ffd640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efecc06b4d0 0x7efecc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.144+0000 7efee2ffd640 1 -- 172.21.15.5:0/1101433075 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efedc089ec0 con 0x7efeec0b94c0 2024-04-25T09:00:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.144+0000 7efee3fff640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efecc06b4d0 0x7efecc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.145+0000 7efee3fff640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efecc06b4d0 0x7efecc06d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efed4034000 tx=0x7efed402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.145+0000 7facd3fff640 1 -- 172.21.15.5:0/2708526777 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7facdc01a070 con 0x7facec067000 2024-04-25T09:00:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.145+0000 7facd3fff640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7facd806b500 0x7facd806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.145+0000 7facd3fff640 1 -- 172.21.15.5:0/2708526777 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facdc0894c0 con 0x7facec067000 2024-04-25T09:00:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.146+0000 7faceaffd640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7facd806b500 0x7facd806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.146+0000 7faceaffd640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7facd806b500 0x7facd806d9c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7facec160ce0 tx=0x7face0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.146+0000 7f9128ff9640 1 -- 172.21.15.5:0/119520776 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f912c0ae7d0 con 0x7f912c1581e0 2024-04-25T09:00:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.149+0000 7efee2ffd640 1 -- 172.21.15.5:0/1101433075 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efedc020030 con 0x7efeec0b94c0 2024-04-25T09:00:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.151+0000 7facd3fff640 1 -- 172.21.15.5:0/2708526777 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7facdc057cf0 con 0x7facec067000 2024-04-25T09:00:26.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.151+0000 7f51c9ffb640 1 -- 172.21.15.5:0/3689961123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51c4018030 con 0x7f51d415ca50 2024-04-25T09:00:26.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.405+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7efeec0ce660 con 0x7efeec0b94c0 2024-04-25T09:00:26.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.407+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7facec066de0 con 0x7facec067000 2024-04-25T09:00:26.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.420+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f912c0d16a0 con 0x7f912c1581e0 2024-04-25T09:00:26.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:26.430+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7f51d404ef20 con 0x7f51d415ca50 2024-04-25T09:00:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.251+0000 7efee2ffd640 1 -- 172.21.15.5:0/1101433075 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6483 v33) v1 ==== 95+0+0 (secure 0 0 0) 0x7efedc058760 con 0x7efeec0b94c0 2024-04-25T09:00:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6483 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efecc06b4d0 msgr2=0x7efecc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efecc06b4d0 0x7efecc06d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efed4034000 tx=0x7efed402e000 comp rx=0 tx=0).stop 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 msgr2=0x7efeec151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec151030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c700 tx=0x7efedc00cbc0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 shutdown_connections 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efecc06b4d0 0x7efecc06d990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec15def0 0x7efeec0cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0d0400 0x7efeec160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 --2- 172.21.15.5:0/1101433075 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efeec0b94c0 0x7efeec151030 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 >> 172.21.15.5:0/1101433075 conn(0x7efeec06b000 msgr2=0x7efeec0b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 shutdown_connections 2024-04-25T09:00:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.255+0000 7efef0a8f640 1 -- 172.21.15.5:0/1101433075 wait complete. 2024-04-25T09:00:27.247 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:00:27.259+0000 7f7b68beb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:00:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.261+0000 7f9128ff9640 1 -- 172.21.15.5:0/119520776 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6480 v34) v1 ==== 95+0+0 (secure 0 0 0) 0x7f9114079e00 con 0x7f912c1581e0 2024-04-25T09:00:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.261+0000 7f51c9ffb640 1 -- 172.21.15.5:0/3689961123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6495 v34) v1 ==== 95+0+0 (secure 0 0 0) 0x7f51c40590f0 con 0x7f51d415ca50 2024-04-25T09:00:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6480 2024-04-25T09:00:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6495 2024-04-25T09:00:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.264+0000 7facd3fff640 1 -- 172.21.15.5:0/2708526777 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5944 v34) v1 ==== 95+0+0 (secure 0 0 0) 0x7facdc05bd90 con 0x7facec067000 2024-04-25T09:00:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 5944 2024-04-25T09:00:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51b806b4d0 msgr2=0x7f51b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51b806b4d0 0x7f51b806d990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f51d00011e0 tx=0x7f51d0001e30 comp rx=0 tx=0).stop 2024-04-25T09:00:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51d415ca50 msgr2=0x7f51d415ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51d415ca50 0x7f51d415ced0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f51c40108e0 tx=0x7f51c4010da0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910c06b520 msgr2=0x7f910c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f91319f9640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910c06b520 0x7f910c06d9e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f911c000f60 tx=0x7f911c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c1581e0 msgr2=0x7f912c161a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f91319f9640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c1581e0 0x7f912c161a50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f911402a790 tx=0x7f91140046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 shutdown_connections 2024-04-25T09:00:27.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f51b806b4d0 0x7f51b806d990 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f51d00011e0 tx=0x7f51d0001e30 comp rx=0 tx=0).stop 2024-04-25T09:00:27.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51d41f2c80 0x7f51d41f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51d415ca50 0x7f51d415ced0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 --2- 172.21.15.5:0/3689961123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51c00051c0 0x7f51d40ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.265+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 >> 172.21.15.5:0/3689961123 conn(0x7f51d40b1da0 msgr2=0x7f51d40ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.266+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 shutdown_connections 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.266+0000 7f91319f9640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f910c06b520 0x7f910c06d9e0 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f911c000f60 tx=0x7f911c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.266+0000 7f91319f9640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f912c15ef00 0x7f912c1f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.266+0000 7f91319f9640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f912c1581e0 0x7f912c161a50 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.266+0000 7f91319f9640 1 --2- 172.21.15.5:0/119520776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c066e30 0x7f912c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.266+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 >> 172.21.15.5:0/119520776 conn(0x7f912c0d0870 msgr2=0x7f912c155970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.266+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 shutdown_connections 2024-04-25T09:00:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.268+0000 7f51db36a640 1 -- 172.21.15.5:0/3689961123 wait complete. 2024-04-25T09:00:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.268+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 shutdown_connections 2024-04-25T09:00:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7f91319f9640 1 -- 172.21.15.5:0/119520776 wait complete. 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7facd806b500 msgr2=0x7facd806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7facd806b500 0x7facd806d9c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7facec160ce0 tx=0x7face0009040 comp rx=0 tx=0).stop 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facec067000 msgr2=0x7facec145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facec067000 0x7facec145600 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c3c0 tx=0x7facdc00c880 comp rx=0 tx=0).stop 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 shutdown_connections 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7facd806b500 0x7facd806d9c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7facec15ef00 0x7facec06e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facec1581e0 0x7facec1f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 --2- 172.21.15.5:0/2708526777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facec067000 0x7facec145600 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 >> 172.21.15.5:0/2708526777 conn(0x7facec0d0870 msgr2=0x7facec0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 shutdown_connections 2024-04-25T09:00:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.269+0000 7facf1bb0640 1 -- 172.21.15.5:0/2708526777 wait complete. 2024-04-25T09:00:27.261 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:00:27.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:00:27.264 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:00:27.264 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:27.273 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:00:27.273 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:00:27.274 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:00:27.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:00:27.275 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:00:27.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:00:27.277 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:00:27.277 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:27.277 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:00:27.278 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:27.315 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:00:27.315 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:27.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:27.342 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:00:27.356 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:00:27.356 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:00:27.394 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:00:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.431+0000 7ff543590640 1 Processor -- start 2024-04-25T09:00:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.432+0000 7ff543590640 1 -- start start 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.432+0000 7ff543590640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.432+0000 7ff543590640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff53c0ce9a0 0x7ff53c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.432+0000 7ff543590640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0cdcb0 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.432+0000 7ff543590640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0cdf90 con 0x7ff53c0ce9a0 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.432+0000 7ff543590640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b47e0 con 0x7ff53c15bdc0 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff541b2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff53c0ce9a0 0x7ff53c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff540b2b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff53c0cd6e0 0x7ff53c0ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60210/0 (socket says 172.21.15.5:60210) 2024-04-25T09:00:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff540b2b640 1 -- 172.21.15.5:0/6515374 learned_addr learned my addr 172.21.15.5:0/6515374 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff54132c640 1 --2- 172.21.15.5:0/6515374 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff541b2d640 1 -- 172.21.15.5:0/6515374 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 msgr2=0x7ff53c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff541b2d640 1 --2- 172.21.15.5:0/6515374 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff541b2d640 1 -- 172.21.15.5:0/6515374 >> v1:172.21.15.5:6789/0 conn(0x7ff53c0cd6e0 legacy=0x7ff53c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff533fff640 1 -- 172.21.15.5:0/6515374 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699469943 0 0) 0x7ff53c0cdcb0 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.433+0000 7ff541b2d640 1 -- 172.21.15.5:0/6515374 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0b4ac0 con 0x7ff53c0ce9a0 2024-04-25T09:00:27.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff541b2d640 1 --2- 172.21.15.5:0/6515374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0ce9a0 0x7ff53c0b52c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff534009d90 tx=0x7ff53402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a316e08ed988892b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff533fff640 1 -- 172.21.15.5:0/6515374 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534007740 con 0x7ff53c0ce9a0 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff533fff640 1 -- 172.21.15.5:0/6515374 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5340078e0 con 0x7ff53c0ce9a0 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff533fff640 1 -- 172.21.15.5:0/6515374 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534007cb0 con 0x7ff53c0ce9a0 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 -- 172.21.15.5:0/6515374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0ce9a0 msgr2=0x7ff53c0b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 --2- 172.21.15.5:0/6515374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0ce9a0 0x7ff53c0b52c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff534009d90 tx=0x7ff53402a660 comp rx=0 tx=0).stop 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 -- 172.21.15.5:0/6515374 shutdown_connections 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 --2- 172.21.15.5:0/6515374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0ce9a0 0x7ff53c0b52c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 --2- 172.21.15.5:0/6515374 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 -- 172.21.15.5:0/6515374 >> 172.21.15.5:0/6515374 conn(0x7ff53c0d18f0 msgr2=0x7ff53c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 -- 172.21.15.5:0/6515374 shutdown_connections 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.434+0000 7ff543590640 1 -- 172.21.15.5:0/6515374 wait complete. 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.435+0000 7ff543590640 1 Processor -- start 2024-04-25T09:00:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff543590640 1 -- start start 2024-04-25T09:00:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff543590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0cd6e0 0x7ff53c06abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff543590640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53c0ce9a0 0x7ff53c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff543590640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff543590640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c15c1a0 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff543590640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0d09a0 con 0x7ff53c0ce9a0 2024-04-25T09:00:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff543590640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c15c320 con 0x7ff53c15bdc0 2024-04-25T09:00:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff54132c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0cd6e0 0x7ff53c06abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff54132c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0cd6e0 0x7ff53c06abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39888/0 (socket says 172.21.15.5:39888) 2024-04-25T09:00:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.436+0000 7ff54132c640 1 -- 172.21.15.5:0/1057559543 learned_addr learned my addr 172.21.15.5:0/1057559543 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff541b2d640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff54132c640 1 -- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 msgr2=0x7ff53c14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff54132c640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff54132c640 1 -- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53c0ce9a0 msgr2=0x7ff53c15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff54132c640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53c0ce9a0 0x7ff53c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff54132c640 1 -- 172.21.15.5:0/1057559543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c06b120 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff54132c640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0cd6e0 0x7ff53c06abe0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d5d0 tx=0x7ff52c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff531ffb640 1 -- 172.21.15.5:0/1057559543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0125f0 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff531ffb640 1 -- 172.21.15.5:0/1057559543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c019070 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff531ffb640 1 -- 172.21.15.5:0/1057559543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0129f0 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c06b3c0 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.437+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c06b980 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.438+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c04ef20 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.438+0000 7ff531ffb640 1 -- 172.21.15.5:0/1057559543 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff52c012b90 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.439+0000 7ff531ffb640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52006b4d0 0x7ff52006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.439+0000 7ff531ffb640 1 -- 172.21.15.5:0/1057559543 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff52c08a670 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.439+0000 7ff540b2b640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52006b4d0 0x7ff52006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.440+0000 7ff540b2b640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52006b4d0 0x7ff52006d990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff538007fd0 tx=0x7ff538007920 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:27.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.443+0000 7ff531ffb640 1 -- 172.21.15.5:0/1057559543 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff52c059490 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.666+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff53c0b7210 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.667+0000 7ff531ffb640 1 -- 172.21.15.5:0/1057559543 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1767 (secure 0 0 0) 0x7ff52c058d90 con 0x7ff53c0cd6e0 2024-04-25T09:00:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:27.655 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:27.259317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-04-25T09:00:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.668+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52006b4d0 msgr2=0x7ff52006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.668+0000 7ff543590640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52006b4d0 0x7ff52006d990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff538007fd0 tx=0x7ff538007920 comp rx=0 tx=0).stop 2024-04-25T09:00:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.668+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0cd6e0 msgr2=0x7ff53c06abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.668+0000 7ff543590640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0cd6e0 0x7ff53c06abe0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d5d0 tx=0x7ff52c00da90 comp rx=0 tx=0).stop 2024-04-25T09:00:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 shutdown_connections 2024-04-25T09:00:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52006b4d0 0x7ff52006d990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff53c15bdc0 0x7ff53c14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53c0ce9a0 0x7ff53c15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 --2- 172.21.15.5:0/1057559543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff53c0cd6e0 0x7ff53c06abe0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 >> 172.21.15.5:0/1057559543 conn(0x7ff53c0d18f0 msgr2=0x7ff53c06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 shutdown_connections 2024-04-25T09:00:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:27.669+0000 7ff543590640 1 -- 172.21.15.5:0/1057559543 wait complete. 2024-04-25T09:00:28.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:00:06.554390+0000', 'modified': '2024-04-25T09:00:27.259317+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:00:28.073 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-04-25T09:00:29.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.199+0000 7f10eecc4640 1 Processor -- start 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.199+0000 7f10eecc4640 1 -- start start 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eecc4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10e80668f0 0x7f10e8066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eecc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10e8161fe0 0x7f10e80b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eecc4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e8067210 con 0x7f10e80b3e10 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eecc4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80b5740 con 0x7f10e80668f0 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eecc4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80b5a20 con 0x7f10e8161fe0 2024-04-25T09:00:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eca60640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10e80668f0 0x7f10e8066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10ed261640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10e80b3e10 0x7f10e806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60218/0 (socket says 172.21.15.5:60218) 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eca60640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10e80668f0 0x7f10e8066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39898/0 (socket says 172.21.15.5:39898) 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10ed261640 1 -- 172.21.15.5:0/2026672493 learned_addr learned my addr 172.21.15.5:0/2026672493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10dffff640 1 --2- 172.21.15.5:0/2026672493 >> v2:172.21.15.80:3300/0 conn(0x7f10e8161fe0 0x7f10e80b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eca60640 1 -- 172.21.15.5:0/2026672493 >> v2:172.21.15.80:3300/0 conn(0x7f10e8161fe0 msgr2=0x7f10e80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eca60640 1 --2- 172.21.15.5:0/2026672493 >> v2:172.21.15.80:3300/0 conn(0x7f10e8161fe0 0x7f10e80b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eca60640 1 -- 172.21.15.5:0/2026672493 >> v1:172.21.15.5:6789/0 conn(0x7f10e80b3e10 legacy=0x7f10e806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10eca60640 1 -- 172.21.15.5:0/2026672493 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80b5d00 con 0x7f10e80668f0 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.200+0000 7f10df7fe640 1 -- 172.21.15.5:0/2026672493 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793837845 0 0) 0x7f10e8067210 con 0x7f10e80b3e10 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.201+0000 7f10eca60640 1 --2- 172.21.15.5:0/2026672493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e8066cd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f10e806d3a0 tx=0x7f10e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18a227081914fea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.201+0000 7f10df7fe640 1 -- 172.21.15.5:0/2026672493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4037070 con 0x7f10e80668f0 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.201+0000 7f10df7fe640 1 -- 172.21.15.5:0/2026672493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4032440 con 0x7f10e80668f0 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.201+0000 7f10df7fe640 1 -- 172.21.15.5:0/2026672493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4032810 con 0x7f10e80668f0 2024-04-25T09:00:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 -- 172.21.15.5:0/2026672493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 msgr2=0x7f10e8066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 --2- 172.21.15.5:0/2026672493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e8066cd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f10e806d3a0 tx=0x7f10e402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 -- 172.21.15.5:0/2026672493 shutdown_connections 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 --2- 172.21.15.5:0/2026672493 >> v2:172.21.15.80:3300/0 conn(0x7f10e8161fe0 0x7f10e80b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 --2- 172.21.15.5:0/2026672493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e8066cd0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 -- 172.21.15.5:0/2026672493 >> 172.21.15.5:0/2026672493 conn(0x7f10e80b25d0 msgr2=0x7f10e80b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 -- 172.21.15.5:0/2026672493 shutdown_connections 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.202+0000 7f10eecc4640 1 -- 172.21.15.5:0/2026672493 wait complete. 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.203+0000 7f10eecc4640 1 Processor -- start 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.203+0000 7f10eecc4640 1 -- start start 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eecc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e81f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eecc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e80b3e10 0x7f10e80cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eecc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10e8161fe0 0x7f10e81fbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eecc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e806f030 con 0x7f10e80668f0 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eecc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8161ac0 con 0x7f10e80b3e10 2024-04-25T09:00:29.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eecc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e806f1b0 con 0x7f10e8161fe0 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e81f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e81f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39914/0 (socket says 172.21.15.5:39914) 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 -- 172.21.15.5:0/1600772285 learned_addr learned my addr 172.21.15.5:0/1600772285 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10ed261640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10e8161fe0 0x7f10e81fbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10dffff640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e80b3e10 0x7f10e80cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 -- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10e8161fe0 msgr2=0x7f10e81fbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10e8161fe0 0x7f10e81fbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 -- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e80b3e10 msgr2=0x7f10e80cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e80b3e10 0x7f10e80cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10eca60640 1 -- 172.21.15.5:0/1600772285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8160f50 con 0x7f10e80668f0 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10ed261640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10e8161fe0 0x7f10e81fbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.204+0000 7f10dffff640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e80b3e10 0x7f10e80cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.205+0000 7f10eca60640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e81f5a90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f10e4035040 tx=0x7f10e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.205+0000 7f10dd7fa640 1 -- 172.21.15.5:0/1600772285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4037040 con 0x7f10e80668f0 2024-04-25T09:00:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.205+0000 7f10dd7fa640 1 -- 172.21.15.5:0/1600772285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4004230 con 0x7f10e80668f0 2024-04-25T09:00:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.205+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e815f5b0 con 0x7f10e80668f0 2024-04-25T09:00:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.205+0000 7f10dd7fa640 1 -- 172.21.15.5:0/1600772285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4006e10 con 0x7f10e80668f0 2024-04-25T09:00:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.205+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e815fb70 con 0x7f10e80668f0 2024-04-25T09:00:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.206+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e804ef20 con 0x7f10e80668f0 2024-04-25T09:00:29.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.206+0000 7f10dd7fa640 1 -- 172.21.15.5:0/1600772285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10e4030770 con 0x7f10e80668f0 2024-04-25T09:00:29.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.207+0000 7f10dd7fa640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10d406b4d0 0x7f10d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:29.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.207+0000 7f10dd7fa640 1 -- 172.21.15.5:0/1600772285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f10e40ab3e0 con 0x7f10e80668f0 2024-04-25T09:00:29.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.207+0000 7f10dffff640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10d406b4d0 0x7f10d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:29.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.207+0000 7f10dffff640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10d406b4d0 0x7f10d406d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006fd0 tx=0x7f10d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:29.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.211+0000 7f10dd7fa640 1 -- 172.21.15.5:0/1600772285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10e4032e20 con 0x7f10e80668f0 2024-04-25T09:00:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.432+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10e80b4b70 con 0x7f10e80668f0 2024-04-25T09:00:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.433+0000 7f10dd7fa640 1 -- 172.21.15.5:0/1600772285 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f10e407a3b0 con 0x7f10e80668f0 2024-04-25T09:00:29.421 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:29.421 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:28.276391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":36,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.5:6835/1111822668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1111822668},{"type":"v1","addr":"172.21.15.5:6835","nonce":1111822668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 37 2024-04-25T09:00:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10d406b4d0 msgr2=0x7f10d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10d406b4d0 0x7f10d406d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006fd0 tx=0x7f10d8008040 comp rx=0 tx=0).stop 2024-04-25T09:00:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 msgr2=0x7f10e81f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e81f5a90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f10e4035040 tx=0x7f10e40046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 shutdown_connections 2024-04-25T09:00:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10d406b4d0 0x7f10d406d990 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10e8161fe0 0x7f10e81fbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10e80b3e10 0x7f10e80cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 --2- 172.21.15.5:0/1600772285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e80668f0 0x7f10e81f5a90 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 >> 172.21.15.5:0/1600772285 conn(0x7f10e80b25d0 msgr2=0x7f10e80d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 shutdown_connections 2024-04-25T09:00:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:29.435+0000 7f10eecc4640 1 -- 172.21.15.5:0/1600772285 wait complete. 2024-04-25T09:00:29.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:00:06.554390+0000', 'modified': '2024-04-25T09:00:28.276391+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6780}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6780': {'gid': 6780, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.5:6835/1111822668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1111822668}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1111822668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:00:29.837 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6780:up:reconnect 2024-04-25T09:00:30.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.964+0000 7f9f2005a640 1 Processor -- start 2024-04-25T09:00:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.965+0000 7f9f2005a640 1 -- start start 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.965+0000 7f9f2005a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f180b94c0 0x7f9f180d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.965+0000 7f9f2005a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 0x7f9f180d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.965+0000 7f9f2005a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f180d0d40 con 0x7f9f1815def0 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f2005a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1815e2d0 con 0x7f9f180b94c0 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f2005a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180d2550 con 0x7f9f180d0400 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1ddf6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f1815def0 0x7f9f180d1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60016/0 (socket says 172.21.15.5:60016) 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1ddf6640 1 -- 172.21.15.5:0/3882956973 learned_addr learned my addr 172.21.15.5:0/3882956973 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1d5f5640 1 --2- 172.21.15.5:0/3882956973 >> v2:172.21.15.80:3300/0 conn(0x7f9f180b94c0 0x7f9f180d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1e5f7640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 0x7f9f180d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540216586 0 0) 0x7f9f180d0d40 con 0x7f9f1815def0 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f04003520 con 0x7f9f1815def0 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976224619 0 0) 0x7f9f04003520 con 0x7f9f1815def0 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 msgr2=0x7f9f180d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 0x7f9f180d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 >> v2:172.21.15.80:3300/0 conn(0x7f9f180b94c0 msgr2=0x7f9f180d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 --2- 172.21.15.5:0/3882956973 >> v2:172.21.15.80:3300/0 conn(0x7f9f180b94c0 0x7f9f180d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180d2830 con 0x7f9f1815def0 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f9f14001670 con 0x7f9f1815def0 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 >> v1:172.21.15.5:6789/0 conn(0x7f9f1815def0 legacy=0x7f9f180d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040039b0 0x7f9f04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 0x7f9f04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f04004d40 0x7f9f040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1815e2d0 con 0x7f9f040039b0 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.966+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180d2550 con 0x7f9f04004d40 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0400b9c0 con 0x7f9f180d0400 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040039b0 0x7f9f04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1d5f5640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 0x7f9f04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1e5f7640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f04004d40 0x7f9f040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1ddf6640 1 -- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 msgr2=0x7f9f04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f180d0400 0x7f9f04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1ddf6640 1 -- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f04004d40 msgr2=0x7f9f040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f04004d40 0x7f9f040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1ddf6640 1 -- 172.21.15.5:0/3882956973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04003520 con 0x7f9f040039b0 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.967+0000 7f9f1e5f7640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f04004d40 0x7f9f040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040039b0 0x7f9f04003dd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400c210 tx=0x7f9f04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f7387d45620a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14007d50 con 0x7f9f040039b0 2024-04-25T09:00:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14005ad0 con 0x7f9f040039b0 2024-04-25T09:00:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f1cdf4640 1 -- 172.21.15.5:0/3882956973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14007070 con 0x7f9f040039b0 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f2005a640 1 -- 172.21.15.5:0/3882956973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040039b0 msgr2=0x7f9f04003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f2005a640 1 --2- 172.21.15.5:0/3882956973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f040039b0 0x7f9f04003dd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400c210 tx=0x7f9f04005830 comp rx=0 tx=0).stop 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f1e5f7640 1 -- 172.21.15.5:0/3882956973 reap_dead start 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f2005a640 1 -- 172.21.15.5:0/3882956973 shutdown_connections 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.968+0000 7f9f2005a640 1 -- 172.21.15.5:0/3882956973 >> 172.21.15.5:0/3882956973 conn(0x7f9f1806b000 msgr2=0x7f9f1806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.969+0000 7f9f2005a640 1 -- 172.21.15.5:0/3882956973 shutdown_connections 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.969+0000 7f9f2005a640 1 -- 172.21.15.5:0/3882956973 wait complete. 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.970+0000 7f9f2005a640 1 Processor -- start 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.970+0000 7f9f2005a640 1 -- start start 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.970+0000 7f9f2005a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040039b0 0x7f9f180cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f2005a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f180ccc50 0x7f9f1814f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f2005a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f1814fdb0 0x7f9f18150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f2005a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180d30d0 con 0x7f9f180ccc50 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f2005a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180d2df0 con 0x7f9f1814fdb0 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f2005a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180d0800 con 0x7f9f040039b0 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f180ccc50 0x7f9f1814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f180ccc50 0x7f9f1814f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35760/0 (socket says 172.21.15.5:35760) 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 -- 172.21.15.5:0/2977056523 learned_addr learned my addr 172.21.15.5:0/2977056523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1e5f7640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f1814fdb0 0x7f9f18150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040039b0 0x7f9f180cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 -- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040039b0 msgr2=0x7f9f180cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040039b0 0x7f9f180cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 -- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f1814fdb0 msgr2=0x7f9f18150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f1814fdb0 0x7f9f18150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 -- 172.21.15.5:0/2977056523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180cd470 con 0x7f9f180ccc50 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1e5f7640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f1814fdb0 0x7f9f18150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040039b0 0x7f9f180cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f1d5f5640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f180ccc50 0x7f9f1814f870 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011a70 tx=0x7f9f08011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f0e7fc640 1 -- 172.21.15.5:0/2977056523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800fb50 con 0x7f9f180ccc50 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f0e7fc640 1 -- 172.21.15.5:0/2977056523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0800fcf0 con 0x7f9f180ccc50 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1814d830 con 0x7f9f180ccc50 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f0e7fc640 1 -- 172.21.15.5:0/2977056523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800fea0 con 0x7f9f180ccc50 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.971+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1814ddf0 con 0x7f9f180ccc50 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.973+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1804ef20 con 0x7f9f180ccc50 2024-04-25T09:00:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.973+0000 7f9f0e7fc640 1 -- 172.21.15.5:0/2977056523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f08012040 con 0x7f9f180ccc50 2024-04-25T09:00:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.973+0000 7f9f0e7fc640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9efc06b4d0 0x7f9efc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.973+0000 7f9f0e7fc640 1 -- 172.21.15.5:0/2977056523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9f0808a850 con 0x7f9f180ccc50 2024-04-25T09:00:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.974+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9efc06b4d0 0x7f9efc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.974+0000 7f9f1ddf6640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9efc06b4d0 0x7f9efc06d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9f14033000 tx=0x7f9f14007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:30.978+0000 7f9f0e7fc640 1 -- 172.21.15.5:0/2977056523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f08019030 con 0x7f9f180ccc50 2024-04-25T09:00:31.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.193+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f180717c0 con 0x7f9f180ccc50 2024-04-25T09:00:31.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.194+0000 7f9f0e7fc640 1 -- 172.21.15.5:0/2977056523 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f9f080590b0 con 0x7f9f180ccc50 2024-04-25T09:00:31.182 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:31.182 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:29.272799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.5:6835/1111822668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1111822668},{"type":"v1","addr":"172.21.15.5:6835","nonce":1111822668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:31.182 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 38 2024-04-25T09:00:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9efc06b4d0 msgr2=0x7f9efc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9efc06b4d0 0x7f9efc06d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9f14033000 tx=0x7f9f14007000 comp rx=0 tx=0).stop 2024-04-25T09:00:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f180ccc50 msgr2=0x7f9f1814f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f180ccc50 0x7f9f1814f870 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011a70 tx=0x7f9f08011f30 comp rx=0 tx=0).stop 2024-04-25T09:00:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 shutdown_connections 2024-04-25T09:00:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9efc06b4d0 0x7f9efc06d990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f1814fdb0 0x7f9f18150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f180ccc50 0x7f9f1814f870 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 --2- 172.21.15.5:0/2977056523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f040039b0 0x7f9f180cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 >> 172.21.15.5:0/2977056523 conn(0x7f9f1806b000 msgr2=0x7f9f180cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 shutdown_connections 2024-04-25T09:00:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:31.196+0000 7f9f2005a640 1 -- 172.21.15.5:0/2977056523 wait complete. 2024-04-25T09:00:31.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T09:00:31.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:00:06.554390+0000', 'modified': '2024-04-25T09:00:29.272799+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6780}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6780': {'gid': 6780, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.5:6835/1111822668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1111822668}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1111822668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:00:31.600 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6780:up:rejoin 2024-04-25T09:00:32.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.726+0000 7f2d9dc12640 1 Processor -- start 2024-04-25T09:00:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.726+0000 7f2d9dc12640 1 -- start start 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d9dc12640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d9815de70 0x7f2d980b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d9dc12640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b2cc0 0x7f2d980b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d9dc12640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980d20e0 con 0x7f2d980b7130 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d9dc12640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980d2a10 con 0x7f2d9815de70 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d9dc12640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980d23c0 con 0x7f2d980b2cc0 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d977fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d9815de70 0x7f2d980b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d97fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d980b7130 0x7f2d980ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60028/0 (socket says 172.21.15.5:60028) 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d97fff640 1 -- 172.21.15.5:0/3244311377 learned_addr learned my addr 172.21.15.5:0/3244311377 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d977fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d9815de70 0x7f2d980b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35766/0 (socket says 172.21.15.5:35766) 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d96ffd640 1 --2- 172.21.15.5:0/3244311377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b2cc0 0x7f2d980b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d977fe640 1 -- 172.21.15.5:0/3244311377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b2cc0 msgr2=0x7f2d980b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d977fe640 1 --2- 172.21.15.5:0/3244311377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b2cc0 0x7f2d980b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d977fe640 1 -- 172.21.15.5:0/3244311377 >> v1:172.21.15.5:6789/0 conn(0x7f2d980b7130 legacy=0x7f2d980ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d977fe640 1 -- 172.21.15.5:0/3244311377 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980d26a0 con 0x7f2d9815de70 2024-04-25T09:00:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.727+0000 7f2d967fc640 1 -- 172.21.15.5:0/3244311377 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680709408 0 0) 0x7f2d980d20e0 con 0x7f2d980b7130 2024-04-25T09:00:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.728+0000 7f2d977fe640 1 --2- 172.21.15.5:0/3244311377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980b93e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2d880097a0 tx=0x7f2d8802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d0ea364a41051e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:32.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.728+0000 7f2d967fc640 1 -- 172.21.15.5:0/3244311377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88037070 con 0x7f2d9815de70 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.728+0000 7f2d967fc640 1 -- 172.21.15.5:0/3244311377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d88032440 con 0x7f2d9815de70 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.728+0000 7f2d967fc640 1 -- 172.21.15.5:0/3244311377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88032810 con 0x7f2d9815de70 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 -- 172.21.15.5:0/3244311377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 msgr2=0x7f2d980b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/3244311377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980b93e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2d880097a0 tx=0x7f2d8802a180 comp rx=0 tx=0).stop 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 -- 172.21.15.5:0/3244311377 shutdown_connections 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/3244311377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b2cc0 0x7f2d980b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/3244311377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980b93e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 -- 172.21.15.5:0/3244311377 >> 172.21.15.5:0/3244311377 conn(0x7f2d9806b000 msgr2=0x7f2d9806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 -- 172.21.15.5:0/3244311377 shutdown_connections 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.729+0000 7f2d9dc12640 1 -- 172.21.15.5:0/3244311377 wait complete. 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.730+0000 7f2d9dc12640 1 Processor -- start 2024-04-25T09:00:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.730+0000 7f2d9dc12640 1 -- start start 2024-04-25T09:00:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d9dc12640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d980b2cc0 0x7f2d980caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d9dc12640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b7130 0x7f2d9814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d9dc12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d9dc12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980cf080 con 0x7f2d9815de70 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d9dc12640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980cef00 con 0x7f2d980b2cc0 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d9dc12640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980cf200 con 0x7f2d980b7130 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35780/0 (socket says 172.21.15.5:35780) 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d97fff640 1 -- 172.21.15.5:0/2935658985 learned_addr learned my addr 172.21.15.5:0/2935658985 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d96ffd640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b7130 0x7f2d9814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d97fff640 1 -- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b7130 msgr2=0x7f2d9814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d97fff640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b7130 0x7f2d9814afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d97fff640 1 -- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d980b2cc0 msgr2=0x7f2d980caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.731+0000 7f2d977fe640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d980b2cc0 0x7f2d980caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d97fff640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d980b2cc0 0x7f2d980caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d97fff640 1 -- 172.21.15.5:0/2935658985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980cb180 con 0x7f2d9815de70 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d97fff640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980c7eb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c7d0 tx=0x7f2d9000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d7ffff640 1 -- 172.21.15.5:0/2935658985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90018070 con 0x7f2d9815de70 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d7ffff640 1 -- 172.21.15.5:0/2935658985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000a640 con 0x7f2d9815de70 2024-04-25T09:00:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d980cb460 con 0x7f2d9815de70 2024-04-25T09:00:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d7ffff640 1 -- 172.21.15.5:0/2935658985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000aa30 con 0x7f2d9815de70 2024-04-25T09:00:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.732+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d980cba20 con 0x7f2d9815de70 2024-04-25T09:00:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.733+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9804ef20 con 0x7f2d9815de70 2024-04-25T09:00:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.733+0000 7f2d7ffff640 1 -- 172.21.15.5:0/2935658985 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2d9000abd0 con 0x7f2d9815de70 2024-04-25T09:00:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.734+0000 7f2d7ffff640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2d8406b4d0 0x7f2d8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.734+0000 7f2d7ffff640 1 -- 172.21.15.5:0/2935658985 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2d900899d0 con 0x7f2d9815de70 2024-04-25T09:00:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.734+0000 7f2d977fe640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2d8406b4d0 0x7f2d8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.735+0000 7f2d977fe640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2d8406b4d0 0x7f2d8406d990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2d88034000 tx=0x7f2d8802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.738+0000 7f2d7ffff640 1 -- 172.21.15.5:0/2935658985 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d900586d0 con 0x7f2d9815de70 2024-04-25T09:00:32.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.955+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d9815f0d0 con 0x7f2d9815de70 2024-04-25T09:00:32.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.956+0000 7f2d7ffff640 1 -- 172.21.15.5:0/2935658985 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f2d90057fd0 con 0x7f2d9815de70 2024-04-25T09:00:32.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:32.946 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:30.278033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/1111822668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1111822668},{"type":"v1","addr":"172.21.15.5:6835","nonce":1111822668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:32.946 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 39 2024-04-25T09:00:32.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2d8406b4d0 msgr2=0x7f2d8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2d8406b4d0 0x7f2d8406d990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2d88034000 tx=0x7f2d8802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 msgr2=0x7f2d980c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980c7eb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c7d0 tx=0x7f2d9000cc90 comp rx=0 tx=0).stop 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 shutdown_connections 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2d8406b4d0 0x7f2d8406d990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d9815de70 0x7f2d980c7eb0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2d980b7130 0x7f2d9814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 --2- 172.21.15.5:0/2935658985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d980b2cc0 0x7f2d980caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 >> 172.21.15.5:0/2935658985 conn(0x7f2d9806b000 msgr2=0x7f2d9815e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 shutdown_connections 2024-04-25T09:00:32.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:32.958+0000 7f2d9dc12640 1 -- 172.21.15.5:0/2935658985 wait complete. 2024-04-25T09:00:33.361 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:00:06.554390+0000', 'modified': '2024-04-25T09:00:30.278033+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6780}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6780': {'gid': 6780, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6835/1111822668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1111822668}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1111822668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:00:33.361 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:00:33.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:00:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.481+0000 7fc3e8342640 1 Processor -- start 2024-04-25T09:00:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.481+0000 7fc3e8342640 1 -- start start 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e8342640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3e015de70 0x7fc3e00b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e8342640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e00ce7f0 0x7fc3e00cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e8342640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e00cf1c0 con 0x7fc3e00b2cc0 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e8342640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e00d2a10 con 0x7fc3e015de70 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e8342640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e00d20e0 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e60de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3e015de70 0x7fc3e00b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e58dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3e00b2cc0 0x7fc3e00b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60032/0 (socket says 172.21.15.5:60032) 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e58dd640 1 -- 172.21.15.5:0/2442594246 learned_addr learned my addr 172.21.15.5:0/2442594246 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e68df640 1 --2- 172.21.15.5:0/2442594246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e00ce7f0 0x7fc3e00cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e60de640 1 -- 172.21.15.5:0/2442594246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e00ce7f0 msgr2=0x7fc3e00cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e60de640 1 --2- 172.21.15.5:0/2442594246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e00ce7f0 0x7fc3e00cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e60de640 1 -- 172.21.15.5:0/2442594246 >> v1:172.21.15.5:6789/0 conn(0x7fc3e00b2cc0 legacy=0x7fc3e00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.482+0000 7fc3e60de640 1 -- 172.21.15.5:0/2442594246 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e00d23c0 con 0x7fc3e015de70 2024-04-25T09:00:33.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.483+0000 7fc3e60de640 1 --2- 172.21.15.5:0/2442594246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e015de70 0x7fc3e00b93e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0097a0 tx=0x7fc3dc02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c6f5b65942870b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.483+0000 7fc3e50dc640 1 -- 172.21.15.5:0/2442594246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc037070 con 0x7fc3e015de70 2024-04-25T09:00:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.483+0000 7fc3e50dc640 1 -- 172.21.15.5:0/2442594246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc02ad10 con 0x7fc3e015de70 2024-04-25T09:00:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.483+0000 7fc3e50dc640 1 -- 172.21.15.5:0/2442594246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc032660 con 0x7fc3e015de70 2024-04-25T09:00:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 -- 172.21.15.5:0/2442594246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e015de70 msgr2=0x7fc3e00b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 --2- 172.21.15.5:0/2442594246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e015de70 0x7fc3e00b93e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0097a0 tx=0x7fc3dc02a080 comp rx=0 tx=0).stop 2024-04-25T09:00:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 -- 172.21.15.5:0/2442594246 shutdown_connections 2024-04-25T09:00:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 --2- 172.21.15.5:0/2442594246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e00ce7f0 0x7fc3e00cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 --2- 172.21.15.5:0/2442594246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e015de70 0x7fc3e00b93e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 -- 172.21.15.5:0/2442594246 >> 172.21.15.5:0/2442594246 conn(0x7fc3e006b000 msgr2=0x7fc3e006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 -- 172.21.15.5:0/2442594246 shutdown_connections 2024-04-25T09:00:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.484+0000 7fc3e8342640 1 -- 172.21.15.5:0/2442594246 wait complete. 2024-04-25T09:00:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.485+0000 7fc3e8342640 1 Processor -- start 2024-04-25T09:00:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.485+0000 7fc3e8342640 1 -- start start 2024-04-25T09:00:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e8342640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e00b2cc0 0x7fc3e00c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e8342640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e00ce7f0 0x7fc3e00b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e8342640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e015de70 0x7fc3e0154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e8342640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e00b7300 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e8342640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e00b9920 con 0x7fc3e00b2cc0 2024-04-25T09:00:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e8342640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e00d2ea0 con 0x7fc3e015de70 2024-04-25T09:00:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e00ce7f0 0x7fc3e00b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e00ce7f0 0x7fc3e00b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35808/0 (socket says 172.21.15.5:35808) 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 -- 172.21.15.5:0/1994809816 learned_addr learned my addr 172.21.15.5:0/1994809816 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e68df640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e015de70 0x7fc3e0154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e60de640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e00b2cc0 0x7fc3e00c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 -- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e015de70 msgr2=0x7fc3e0154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e015de70 0x7fc3e0154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 -- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e00b2cc0 msgr2=0x7fc3e00c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e00b2cc0 0x7fc3e00c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.486+0000 7fc3e58dd640 1 -- 172.21.15.5:0/1994809816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e00c9650 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.487+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e00ce7f0 0x7fc3e00b60c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c7b0 tx=0x7fc3d000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.487+0000 7fc3d6ffd640 1 -- 172.21.15.5:0/1994809816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0018070 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.487+0000 7fc3d6ffd640 1 -- 172.21.15.5:0/1994809816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00072f0 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.487+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e00b4070 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.487+0000 7fc3d6ffd640 1 -- 172.21.15.5:0/1994809816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00047e0 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.487+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e00b4630 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.488+0000 7fc3d6ffd640 1 -- 172.21.15.5:0/1994809816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3d001b070 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.489+0000 7fc3d6ffd640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3c406b4d0 0x7fc3c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.489+0000 7fc3d6ffd640 1 -- 172.21.15.5:0/1994809816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc3d0089650 con 0x7fc3e00ce7f0 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.489+0000 7fc3e60de640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3c406b4d0 0x7fc3c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.490+0000 7fc3eb046740 1 Processor -- start 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.490+0000 7fc3e60de640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3c406b4d0 0x7fc3c406d990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc034000 tx=0x7fc3dc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.490+0000 7fc3eb046740 1 -- start start 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270ceb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d08ad0 0x561270d09020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270cc0f10 0x561270d07190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3eb046740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561270c23a10 con 0x561270cc0f10 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561270bccb30 con 0x561270ceb230 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561270c1fc50 con 0x561270d08ad0 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270cc0f10 0x561270d07190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270cc0f10 0x561270d07190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35822/0 (socket says 172.21.15.5:35822) 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 -- 172.21.15.5:0/4142919761 learned_addr learned my addr 172.21.15.5:0/4142919761 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e60de640 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270ceb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d08ad0 0x561270d09020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 -- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d08ad0 msgr2=0x561270d09020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d08ad0 0x561270d09020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 -- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 msgr2=0x561270ceb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270ceb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 -- 172.21.15.5:0/4142919761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561270be1e10 con 0x561270cc0f10 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.491+0000 7fc3e68df640 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270cc0f10 0x561270d07190 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80039e0 tx=0x7fc3d8003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647ecc45ef308d90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3c3fff640 1 -- 172.21.15.5:0/4142919761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8015420 con 0x561270cc0f10 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3c3fff640 1 -- 172.21.15.5:0/4142919761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d801a070 con 0x561270cc0f10 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3c3fff640 1 -- 172.21.15.5:0/4142919761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d80157c0 con 0x561270cc0f10 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 -- 172.21.15.5:0/4142919761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270cc0f10 msgr2=0x561270d07190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270cc0f10 0x561270d07190 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80039e0 tx=0x7fc3d8003ea0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 -- 172.21.15.5:0/4142919761 shutdown_connections 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270cc0f10 0x561270d07190 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d08ad0 0x561270d09020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 --2- 172.21.15.5:0/4142919761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270ceb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 -- 172.21.15.5:0/4142919761 >> 172.21.15.5:0/4142919761 conn(0x561270cbd840 msgr2=0x561270d06040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 -- 172.21.15.5:0/4142919761 shutdown_connections 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.492+0000 7fc3eb046740 1 -- 172.21.15.5:0/4142919761 wait complete. 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.493+0000 7fc3eb046740 1 -- start start 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.493+0000 7fc3eb046740 1 Processor -- start 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270cd3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d08ad0 0x561270d0bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3eb046740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561270cc1cb0 con 0x561270d08ad0 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561270be00c0 con 0x561270ceb230 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561270cbb770 con 0x561270d0c0e0 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3eb046740 10 client.0 _ll_register_callbacks cb 0x561270bd3ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:33.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d08ad0 0x561270d0bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d08ad0 0x561270d0bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35828/0 (socket says 172.21.15.5:35828) 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 -- 172.21.15.5:0/3230878897 learned_addr learned my addr 172.21.15.5:0/3230878897 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e60de640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270cd3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e68df640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 -- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 msgr2=0x561270cba4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cba4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 -- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 msgr2=0x561270cd3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270cd3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 -- 172.21.15.5:0/3230878897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612709382d0 con 0x561270d08ad0 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e68df640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cba4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d08ad0 0x561270d0bba0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c780 tx=0x7fc3d0057850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd8a37e8849ae57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.494+0000 7fc3c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:00:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3c17fa640 1 -- 172.21.15.5:0/3230878897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0057270 con 0x561270d08ad0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3c17fa640 1 -- 172.21.15.5:0/3230878897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc3d0057410 con 0x561270d08ad0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3d801a070 con 0x561270d08ad0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3c17fa640 1 -- 172.21.15.5:0/3230878897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3d006fb00 con 0x561270d08ad0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 10 client.6828 fetch_fsmap learned FSMap version 39 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x561270a026b0 con 0x561270d08ad0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3c17fa640 1 -- 172.21.15.5:0/3230878897 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d801a070 con 0x561270d08ad0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3c17fa640 1 -- 172.21.15.5:0/3230878897 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3d006fca0 con 0x561270d08ad0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 10 client.6828 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 10 client.6828 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 20 client.6828 populate_metadata read hostname 'smithi005' 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d1a0a0 0x561270cd5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 4 client.6828 mds_command: new command op to 6780 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 --> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561270c82920 con 0x561270d1a0a0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.495+0000 7fc3e60de640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d1a0a0 0x561270cd5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3e60de640 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d1a0a0 0x561270cd5280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7084e12985a30e28 server_cookie=891827abfd4ad3e3 in_seq=0 out_seq=0 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3c17fa640 10 client.6828 ms_handle_connect on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3c17fa640 1 -- 172.21.15.5:0/3230878897 <== mds.0 v2:172.21.15.5:6834/1111822668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561270c82920 con 0x561270d1a0a0 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3c17fa640 10 client.6828 handle_command_reply: tid=0 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 client.6828 shutdown 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d08ad0 msgr2=0x561270d0bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d08ad0 0x561270d0bba0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c780 tx=0x7fc3d0057850 comp rx=0 tx=0).stop 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 shutdown_connections 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cba4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d08ad0 0x561270d0bba0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d1a0a0 0x561270cd5280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 --2- 172.21.15.5:0/3230878897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270ceb230 0x561270cd3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 >> 172.21.15.5:0/3230878897 conn(0x561270cc0f10 msgr2=0x561270d095c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3c17fa640 0 client.6828 ms_handle_reset on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:33.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.496+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 shutdown_connections 2024-04-25T09:00:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.497+0000 7fc3eb046740 1 -- 172.21.15.5:0/3230878897 wait complete. 2024-04-25T09:00:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.497+0000 7fc3eb046740 20 client.6828 trim_cache size 0 max 16384 2024-04-25T09:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.512+0000 7fc3eb046740 1 Processor -- start 2024-04-25T09:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.512+0000 7fc3eb046740 1 -- start start 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270ceb230 0x561270cee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 0x561270cc0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cc0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3eb046740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e01ff1d0 con 0x561270ceb230 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e01fe5d0 con 0x561270d08ad0 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e01febd0 con 0x561270d0c0e0 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3e60de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270ceb230 0x561270cee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3e60de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270ceb230 0x561270cee0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35842/0 (socket says 172.21.15.5:35842) 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3e60de640 1 -- 172.21.15.5:0/1302961526 learned_addr learned my addr 172.21.15.5:0/1302961526 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3e60de640 1 -- 172.21.15.5:0/1302961526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 msgr2=0x561270cc0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3e60de640 1 --2- 172.21.15.5:0/1302961526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cc0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3e60de640 1 -- 172.21.15.5:0/1302961526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 msgr2=0x561270cc0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.513+0000 7fc3e60de640 1 --2- 172.21.15.5:0/1302961526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 0x561270cc0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3e60de640 1 -- 172.21.15.5:0/1302961526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561270cba810 con 0x561270ceb230 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3e60de640 1 --2- 172.21.15.5:0/1302961526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270ceb230 0x561270cee0f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0098c0 tx=0x7fc3dc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3a7a28b36d1c32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3c37fe640 1 -- 172.21.15.5:0/1302961526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc054070 con 0x561270ceb230 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3c37fe640 1 -- 172.21.15.5:0/1302961526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc04ee50 con 0x561270ceb230 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3c37fe640 1 -- 172.21.15.5:0/1302961526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc037040 con 0x561270ceb230 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 -- 172.21.15.5:0/1302961526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270ceb230 msgr2=0x561270cee0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 --2- 172.21.15.5:0/1302961526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270ceb230 0x561270cee0f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0098c0 tx=0x7fc3dc02c000 comp rx=0 tx=0).stop 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 -- 172.21.15.5:0/1302961526 shutdown_connections 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 --2- 172.21.15.5:0/1302961526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270d0c0e0 0x561270cc0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 --2- 172.21.15.5:0/1302961526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 0x561270cc0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 --2- 172.21.15.5:0/1302961526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270ceb230 0x561270cee0f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 -- 172.21.15.5:0/1302961526 >> 172.21.15.5:0/1302961526 conn(0x561270cc0f10 msgr2=0x561270ce7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 -- 172.21.15.5:0/1302961526 shutdown_connections 2024-04-25T09:00:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.514+0000 7fc3eb046740 1 -- 172.21.15.5:0/1302961526 wait complete. 2024-04-25T09:00:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.515+0000 7fc3eb046740 1 -- start start 2024-04-25T09:00:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.515+0000 7fc3eb046740 1 Processor -- start 2024-04-25T09:00:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270ceb230 0x561270cc04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 0x561270cea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3eb046740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d0c0e0 0x561270cbef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3eb046740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561270d19f20 con 0x561270d0c0e0 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561270cd47b0 con 0x561270d08ad0 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3eb046740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561270d1a520 con 0x561270ceb230 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3eb046740 10 client.0 _ll_register_callbacks cb 0x561270cbbc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d0c0e0 0x561270cbef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d0c0e0 0x561270cbef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35852/0 (socket says 172.21.15.5:35852) 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 -- 172.21.15.5:0/998066388 learned_addr learned my addr 172.21.15.5:0/998066388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e60de640 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270ceb230 0x561270cc04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e58dd640 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 0x561270cea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 -- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270ceb230 msgr2=0x561270cc04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270ceb230 0x561270cc04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 -- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 msgr2=0x561270cea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 0x561270cea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 -- 172.21.15.5:0/998066388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561270cc2770 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3e68df640 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d0c0e0 0x561270cbef90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80039b0 tx=0x7fc3d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4710c05f9d49c999 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.516+0000 7fc3c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3c17fa640 1 -- 172.21.15.5:0/998066388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8023070 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3c17fa640 1 -- 172.21.15.5:0/998066388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc3d80158e0 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3dc04ee50 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3c17fa640 1 -- 172.21.15.5:0/998066388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3d802e050 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 10 client.6834 fetch_fsmap learned FSMap version 39 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x561270d188d0 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3c17fa640 1 -- 172.21.15.5:0/998066388 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc04ee50 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3c17fa640 1 -- 172.21.15.5:0/998066388 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3d8031020 con 0x561270d0c0e0 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 10 client.6834 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:00:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 10 client.6834 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 20 client.6834 populate_metadata read hostname 'smithi005' 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d71280 0x561270d03f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 4 client.6834 mds_command: new command op to 6780 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 --> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561270c30f50 con 0x561270d71280 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.517+0000 7fc3e60de640 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d71280 0x561270d03f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3c17fa640 10 client.6834 ms_handle_connect on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3e60de640 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d71280 0x561270d03f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a6cd74f35cf8e7 server_cookie=e2443078cc87668f in_seq=0 out_seq=0 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3c17fa640 1 -- 172.21.15.5:0/998066388 <== mds.0 v2:172.21.15.5:6834/1111822668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561270c30f50 con 0x561270d71280 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3c17fa640 10 client.6834 handle_command_reply: tid=0 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 client.6834 shutdown 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d0c0e0 msgr2=0x561270cbef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d0c0e0 0x561270cbef90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80039b0 tx=0x7fc3d8004a40 comp rx=0 tx=0).stop 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 shutdown_connections 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561270d0c0e0 0x561270cbef90 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561270d71280 0x561270d03f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561270d08ad0 0x561270cea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 --2- 172.21.15.5:0/998066388 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561270ceb230 0x561270cc04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3c17fa640 0 client.6834 ms_handle_reset on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 >> 172.21.15.5:0/998066388 conn(0x561270cc0f10 msgr2=0x561270ce7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 shutdown_connections 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 1 -- 172.21.15.5:0/998066388 wait complete. 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.518+0000 7fc3eb046740 20 client.6834 trim_cache size 0 max 16384 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:00:33.513 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6780, 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.250336227, 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 39, 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 61, 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 61, 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 6.1112445099999997 2024-04-25T09:00:33.514 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:00:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3c406b4d0 msgr2=0x7fc3c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3c406b4d0 0x7fc3c406d990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc034000 tx=0x7fc3dc02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e00ce7f0 msgr2=0x7fc3e00b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e00ce7f0 0x7fc3e00b60c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c7b0 tx=0x7fc3d000cc70 comp rx=0 tx=0).stop 2024-04-25T09:00:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 shutdown_connections 2024-04-25T09:00:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc3c406b4d0 0x7fc3c406d990 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc3e015de70 0x7fc3e0154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3e00ce7f0 0x7fc3e00b60c0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 --2- 172.21.15.5:0/1994809816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e00b2cc0 0x7fc3e00c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 >> 172.21.15.5:0/1994809816 conn(0x7fc3e006b000 msgr2=0x7fc3e00b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 shutdown_connections 2024-04-25T09:00:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.519+0000 7fc3e8342640 1 -- 172.21.15.5:0/1994809816 wait complete. 2024-04-25T09:00:33.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:00:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.630+0000 7fb202bb7640 1 Processor -- start 2024-04-25T09:00:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.630+0000 7fb202bb7640 1 -- start start 2024-04-25T09:00:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb202bb7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc156250 0x7fb1fc0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb202bb7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1fc0aeda0 0x7fb1fc15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb202bb7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0b2aa0 con 0x7fb1fc06dd20 2024-04-25T09:00:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb202bb7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b2850 con 0x7fb1fc0aeda0 2024-04-25T09:00:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb202bb7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b2d80 con 0x7fb1fc156250 2024-04-25T09:00:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb200953640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc156250 0x7fb1fc0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb201154640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1fc0aeda0 0x7fb1fc15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb200953640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc156250 0x7fb1fc0b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:50798/0 (socket says 172.21.15.5:50798) 2024-04-25T09:00:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb201154640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1fc0aeda0 0x7fb1fc15d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:35500/0 (socket says 172.21.15.5:35500) 2024-04-25T09:00:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb200953640 1 -- 172.21.15.5:0/1628597632 learned_addr learned my addr 172.21.15.5:0/1628597632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.631+0000 7fb1fbfff640 1 --1- 172.21.15.5:0/1628597632 >> v1:172.21.15.80:6789/0 conn(0x7fb1fc06dd20 0x7fb1fc0ae690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:58440/0 (socket says 172.21.15.5:58440) 2024-04-25T09:00:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.632+0000 7fb200953640 1 -- 172.21.15.5:0/1628597632 >> v2:172.21.15.80:3300/0 conn(0x7fb1fc0aeda0 msgr2=0x7fb1fc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.632+0000 7fb200953640 1 --2- 172.21.15.5:0/1628597632 >> v2:172.21.15.80:3300/0 conn(0x7fb1fc0aeda0 0x7fb1fc15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.632+0000 7fb200953640 1 -- 172.21.15.5:0/1628597632 >> v1:172.21.15.80:6789/0 conn(0x7fb1fc06dd20 legacy=0x7fb1fc0ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.632+0000 7fb200953640 1 -- 172.21.15.5:0/1628597632 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0b3060 con 0x7fb1fc156250 2024-04-25T09:00:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.632+0000 7fb200953640 1 --2- 172.21.15.5:0/1628597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc156250 0x7fb1fc0b44c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009870 tx=0x7fb1ec02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8001a451d7ba076 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.632+0000 7fb1fb7fe640 1 -- 172.21.15.5:0/1628597632 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec037070 con 0x7fb1fc156250 2024-04-25T09:00:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb1fb7fe640 1 -- 172.21.15.5:0/1628597632 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec032440 con 0x7fb1fc156250 2024-04-25T09:00:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb1fb7fe640 1 -- 172.21.15.5:0/1628597632 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec032810 con 0x7fb1fc156250 2024-04-25T09:00:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 -- 172.21.15.5:0/1628597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc156250 msgr2=0x7fb1fc0b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 --2- 172.21.15.5:0/1628597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc156250 0x7fb1fc0b44c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009870 tx=0x7fb1ec02a1c0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 -- 172.21.15.5:0/1628597632 shutdown_connections 2024-04-25T09:00:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 --2- 172.21.15.5:0/1628597632 >> v2:172.21.15.80:3300/0 conn(0x7fb1fc0aeda0 0x7fb1fc15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 --2- 172.21.15.5:0/1628597632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc156250 0x7fb1fc0b44c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 -- 172.21.15.5:0/1628597632 >> 172.21.15.5:0/1628597632 conn(0x7fb1fc0668f0 msgr2=0x7fb1fc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 -- 172.21.15.5:0/1628597632 shutdown_connections 2024-04-25T09:00:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.633+0000 7fb202bb7640 1 -- 172.21.15.5:0/1628597632 wait complete. 2024-04-25T09:00:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.634+0000 7fb202bb7640 1 Processor -- start 2024-04-25T09:00:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.634+0000 7fb202bb7640 1 -- start start 2024-04-25T09:00:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb202bb7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc0aeda0 0x7fb1fc1f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb202bb7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1fc156250 0x7fb1fc0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb202bb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1fc0cf4b0 0x7fb1fc156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb202bb7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b4b80 con 0x7fb1fc156250 2024-04-25T09:00:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb202bb7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b4a00 con 0x7fb1fc0cf4b0 2024-04-25T09:00:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb202bb7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b3860 con 0x7fb1fc0aeda0 2024-04-25T09:00:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb1fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1fc156250 0x7fb1fc0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb200953640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc0aeda0 0x7fb1fc1f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb1fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1fc156250 0x7fb1fc0cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35864/0 (socket says 172.21.15.5:35864) 2024-04-25T09:00:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb201154640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1fc0cf4b0 0x7fb1fc156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.635+0000 7fb1fbfff640 1 -- 172.21.15.5:0/2403782226 learned_addr learned my addr 172.21.15.5:0/2403782226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1fbfff640 1 -- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc0aeda0 msgr2=0x7fb1fc1f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1fbfff640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc0aeda0 0x7fb1fc1f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1fbfff640 1 -- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1fc0cf4b0 msgr2=0x7fb1fc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1fbfff640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1fc0cf4b0 0x7fb1fc156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1fbfff640 1 -- 172.21.15.5:0/2403782226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc1f5730 con 0x7fb1fc156250 2024-04-25T09:00:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb201154640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1fc0cf4b0 0x7fb1fc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1fbfff640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1fc156250 0x7fb1fc0cef70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c430 tx=0x7fb1f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1f97fa640 1 -- 172.21.15.5:0/2403782226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00074e0 con 0x7fb1fc156250 2024-04-25T09:00:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1f97fa640 1 -- 172.21.15.5:0/2403782226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0007680 con 0x7fb1fc156250 2024-04-25T09:00:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb1f97fa640 1 -- 172.21.15.5:0/2403782226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0004a00 con 0x7fb1fc156250 2024-04-25T09:00:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc1f11d0 con 0x7fb1fc156250 2024-04-25T09:00:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.636+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc13d080 con 0x7fb1fc156250 2024-04-25T09:00:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.637+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc04ef20 con 0x7fb1fc156250 2024-04-25T09:00:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.638+0000 7fb1f97fa640 1 -- 172.21.15.5:0/2403782226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1f001a020 con 0x7fb1fc156250 2024-04-25T09:00:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.638+0000 7fb1f97fa640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb1e806b4d0 0x7fb1e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.638+0000 7fb1f97fa640 1 -- 172.21.15.5:0/2403782226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb1f0089910 con 0x7fb1fc156250 2024-04-25T09:00:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.638+0000 7fb200953640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb1e806b4d0 0x7fb1e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.639+0000 7fb200953640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb1e806b4d0 0x7fb1e806d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec034000 tx=0x7fb1ec02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.642+0000 7fb1f97fa640 1 -- 172.21.15.5:0/2403782226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb1f00580e0 con 0x7fb1fc156250 2024-04-25T09:00:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.860+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1fc06b3a0 con 0x7fb1fc156250 2024-04-25T09:00:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.860+0000 7fb1f97fa640 1 -- 172.21.15.5:0/2403782226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb1f005c180 con 0x7fb1fc156250 2024-04-25T09:00:33.849 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:00:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb1e806b4d0 msgr2=0x7fb1e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb1e806b4d0 0x7fb1e806d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec034000 tx=0x7fb1ec02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1fc156250 msgr2=0x7fb1fc0cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1fc156250 0x7fb1fc0cef70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c430 tx=0x7fb1f000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 shutdown_connections 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb1e806b4d0 0x7fb1e806d990 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1fc0cf4b0 0x7fb1fc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1fc156250 0x7fb1fc0cef70 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 --2- 172.21.15.5:0/2403782226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1fc0aeda0 0x7fb1fc1f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 >> 172.21.15.5:0/2403782226 conn(0x7fb1fc0668f0 msgr2=0x7fb1fc15c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 shutdown_connections 2024-04-25T09:00:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:33.862+0000 7fb202bb7640 1 -- 172.21.15.5:0/2403782226 wait complete. 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:00:33.862 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:00:33.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:33.863 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:00:33.880 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:00:33.880 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:00:33.880 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:00:33.880 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:33.881 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:00:33.881 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:33.881 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:00:33.881 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:33.881 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:00:33.881 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:00:33.882 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:33.882 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:00:33.882 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:00:33.882 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:33.882 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:00:33.882 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:00:33.883 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42526sec preferred_lft 42526sec 2024-04-25T09:00:33.883 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:00:33.883 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:33.883 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:00:33.883 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:33.883 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:00:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:00:33.884 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:00:33.884 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:00:33.884 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:33.884 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:00:33.884 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:00:33.885 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:00:33.885 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:00:33.885 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:00:33.885 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:00:33.886 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:00:33.886 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:00:33.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:33.886 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:00:33.942 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:00:33.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:33.944 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:00:34.000 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:00:34.000 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:00:34.000 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:00:34.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:00:34.001 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:00:34.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:34.001 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:00:34.001 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:00:34.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:00:34.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:00:34.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:00:34.002 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:00:34.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:34.085 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:00:34.102 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:00:34.102 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:00:34.102 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:00:34.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:34.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:00:34.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:00:34.167 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:34.222 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:00:34.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:00:34.223 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:34.257 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-04-25T09:00:34.268+0000 7f8896873640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:00:34.271 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:00:34.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:34.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:00:34.355 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:00:34.355 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:00:34.362 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:00:34.362 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:00:34.362 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:00:34.362 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:00:34.362 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:00:34.363 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:00:34.363 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:00:34.363 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:00:34.363 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:00:34.363 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:00:34.365 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:00:34.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:34.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:34.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:34.431 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:00:34.490 INFO:teuthology.orchestra.run.smithi005.stdout:client6196 2024-04-25T09:00:34.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:34.976 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:34.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:34.994 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-04-25T09:00:35.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:35.052 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-04-25T09:00:35.053 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-04-25T09:00:35.053 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:00:35.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /scrub_repair_path repair 2024-04-25T09:00:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.214+0000 7f06bf476640 1 Processor -- start 2024-04-25T09:00:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.214+0000 7f06bf476640 1 -- start start 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bf476640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f06b8161610 0x7f06b80d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bf476640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06b80d0920 0x7f06b80d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bf476640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b80d2500 0x7f06b80b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bf476640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b81619f0 con 0x7f06b80d0920 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bf476640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b80b74c0 con 0x7f06b8161610 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bf476640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80d0db0 con 0x7f06b80d2500 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bca11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06b80d0920 0x7f06b80d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bca11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06b80d0920 0x7f06b80d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35880/0 (socket says 172.21.15.5:35880) 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.215+0000 7f06bca11640 1 -- 172.21.15.5:0/3321721789 learned_addr learned my addr 172.21.15.5:0/3321721789 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.216+0000 7f06bda13640 1 --2- 172.21.15.5:0/3321721789 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b80d2500 0x7f06b80b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.216+0000 7f06bd212640 1 --2- 172.21.15.5:0/3321721789 >> v2:172.21.15.80:3300/0 conn(0x7f06b8161610 0x7f06b80d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.216+0000 7f06bca11640 1 -- 172.21.15.5:0/3321721789 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b80d2500 msgr2=0x7f06b80b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.216+0000 7f06bca11640 1 --2- 172.21.15.5:0/3321721789 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b80d2500 0x7f06b80b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.216+0000 7f06bca11640 1 -- 172.21.15.5:0/3321721789 >> v2:172.21.15.80:3300/0 conn(0x7f06b8161610 msgr2=0x7f06b80d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.216+0000 7f06bca11640 1 --2- 172.21.15.5:0/3321721789 >> v2:172.21.15.80:3300/0 conn(0x7f06b8161610 0x7f06b80d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.216+0000 7f06bca11640 1 -- 172.21.15.5:0/3321721789 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80b6ed0 con 0x7f06b80d0920 2024-04-25T09:00:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bca11640 1 --2- 172.21.15.5:0/3321721789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d0920 0x7f06b80d1fc0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f06b808c730 tx=0x7f06ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceb8c4d84e5fc0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06b7fff640 1 -- 172.21.15.5:0/3321721789 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac037070 con 0x7f06b80d0920 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06b7fff640 1 -- 172.21.15.5:0/3321721789 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac032440 con 0x7f06b80d0920 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06b7fff640 1 -- 172.21.15.5:0/3321721789 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac032810 con 0x7f06b80d0920 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 -- 172.21.15.5:0/3321721789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d0920 msgr2=0x7f06b80d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 --2- 172.21.15.5:0/3321721789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d0920 0x7f06b80d1fc0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f06b808c730 tx=0x7f06ac02a180 comp rx=0 tx=0).stop 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 -- 172.21.15.5:0/3321721789 shutdown_connections 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 --2- 172.21.15.5:0/3321721789 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b80d2500 0x7f06b80b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 --2- 172.21.15.5:0/3321721789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d0920 0x7f06b80d1fc0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 --2- 172.21.15.5:0/3321721789 >> v2:172.21.15.80:3300/0 conn(0x7f06b8161610 0x7f06b80d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 -- 172.21.15.5:0/3321721789 >> 172.21.15.5:0/3321721789 conn(0x7f06b80668f0 msgr2=0x7f06b8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 -- 172.21.15.5:0/3321721789 shutdown_connections 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.217+0000 7f06bf476640 1 -- 172.21.15.5:0/3321721789 wait complete. 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 Processor -- start 2024-04-25T09:00:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 -- start start 2024-04-25T09:00:35.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06b80d0920 0x7f06b8151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d2500 0x7f06b80c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b8161610 0x7f06b80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80b7150 con 0x7f06b80d2500 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80d3070 con 0x7f06b80d0920 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bf476640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80d2970 con 0x7f06b8161610 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.219+0000 7f06bca11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d2500 0x7f06b80c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d2500 0x7f06b80c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35894/0 (socket says 172.21.15.5:35894) 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 -- 172.21.15.5:0/2283964740 learned_addr learned my addr 172.21.15.5:0/2283964740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bda13640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b8161610 0x7f06b80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bd212640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06b80d0920 0x7f06b8151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 -- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b8161610 msgr2=0x7f06b80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b8161610 0x7f06b80b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 -- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06b80d0920 msgr2=0x7f06b8151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06b80d0920 0x7f06b8151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 -- 172.21.15.5:0/2283964740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b815d730 con 0x7f06b80d2500 2024-04-25T09:00:35.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bca11640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d2500 0x7f06b80c99f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f06ac000c00 tx=0x7f06ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:35.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06b5ffb640 1 -- 172.21.15.5:0/2283964740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac041020 con 0x7f06b80d2500 2024-04-25T09:00:35.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06b5ffb640 1 -- 172.21.15.5:0/2283964740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac0306c0 con 0x7f06b80d2500 2024-04-25T09:00:35.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b815da10 con 0x7f06b80d2500 2024-04-25T09:00:35.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.220+0000 7f06b5ffb640 1 -- 172.21.15.5:0/2283964740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac037040 con 0x7f06b80d2500 2024-04-25T09:00:35.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.221+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b80c94d0 con 0x7f06b80d2500 2024-04-25T09:00:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.222+0000 7f06b5ffb640 1 -- 172.21.15.5:0/2283964740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f06ac044020 con 0x7f06b80d2500 2024-04-25T09:00:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.222+0000 7f06b5ffb640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f06a406b4d0 0x7f06a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.223+0000 7f06b5ffb640 1 -- 172.21.15.5:0/2283964740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f06ac0aa980 con 0x7f06b80d2500 2024-04-25T09:00:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.223+0000 7f06bd212640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f06a406b4d0 0x7f06a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.223+0000 7f06c2180740 1 Processor -- start 2024-04-25T09:00:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.223+0000 7f06bd212640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f06a406b4d0 0x7f06a406d990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f06b0006fd0 tx=0x7f06b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.223+0000 7f06c2180740 1 -- start start 2024-04-25T09:00:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 0x5615618ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618dc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06c2180740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dc700 0x5615618b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06c2180740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561561814f40 con 0x5615618dc700 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615617b40d0 con 0x5615618dce40 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561561810fe0 con 0x5615618f9d20 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06bda13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dc700 0x5615618b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06bda13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dc700 0x5615618b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35910/0 (socket says 172.21.15.5:35910) 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06bda13640 1 -- 172.21.15.5:0/1068731464 learned_addr learned my addr 172.21.15.5:0/1068731464 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06bca11640 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618dc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.224+0000 7f06bd212640 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 0x5615618ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f06bda13640 1 -- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 msgr2=0x5615618ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f06bda13640 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 0x5615618ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f06bda13640 1 -- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 msgr2=0x5615618dc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f06bda13640 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618dc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f06bda13640 1 -- 172.21.15.5:0/1068731464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615615f5af0 con 0x5615618dc700 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f06bda13640 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dc700 0x5615618b1510 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f06a8003a40 tx=0x7f06a8003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1664465fc8ffd05f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f069effd640 1 -- 172.21.15.5:0/1068731464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8015420 con 0x5615618dc700 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f069effd640 1 -- 172.21.15.5:0/1068731464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a801a070 con 0x5615618dc700 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.225+0000 7f069effd640 1 -- 172.21.15.5:0/1068731464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a80157c0 con 0x5615618dc700 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 -- 172.21.15.5:0/1068731464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dc700 msgr2=0x5615618b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dc700 0x5615618b1510 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f06a8003a40 tx=0x7f06a8003f00 comp rx=0 tx=0).stop 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 -- 172.21.15.5:0/1068731464 shutdown_connections 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dc700 0x5615618b1510 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618dc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 --2- 172.21.15.5:0/1068731464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 0x5615618ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 -- 172.21.15.5:0/1068731464 >> 172.21.15.5:0/1068731464 conn(0x5615618ae920 msgr2=0x5615618f71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 -- 172.21.15.5:0/1068731464 shutdown_connections 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 -- 172.21.15.5:0/1068731464 wait complete. 2024-04-25T09:00:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 -- start start 2024-04-25T09:00:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.226+0000 7f06c2180740 1 Processor -- start 2024-04-25T09:00:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618ee840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06c2180740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06c2180740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615618b0ad0 con 0x5615618f9d20 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615617b1ba0 con 0x5615618dce40 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615618afec0 con 0x5615618df880 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06c2180740 10 client.0 _ll_register_callbacks cb 0x5615617b1570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06bca11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06bca11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35922/0 (socket says 172.21.15.5:35922) 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06bca11640 1 -- 172.21.15.5:0/1946591496 learned_addr learned my addr 172.21.15.5:0/1946591496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06bd212640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.227+0000 7f06bda13640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bca11640 1 -- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 msgr2=0x5615618b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bca11640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bca11640 1 -- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 msgr2=0x5615618ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bca11640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bca11640 1 -- 172.21.15.5:0/1946591496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615614e93e0 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bd212640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bda13640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bca11640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618ccd30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f06ac075510 tx=0x7f06ac079170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62257a338c8c7c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f0697fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f0697fff640 1 -- 172.21.15.5:0/1946591496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac081710 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f0697fff640 1 -- 172.21.15.5:0/1946591496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f06ac0a3e20 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06a801a070 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f0697fff640 1 -- 172.21.15.5:0/1946591496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06ac081280 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 10 client.6849 fetch_fsmap learned FSMap version 39 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x561561656280 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f0697fff640 1 -- 172.21.15.5:0/1946591496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a801a070 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f0697fff640 1 -- 172.21.15.5:0/1946591496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f06ac03a030 con 0x5615618f9d20 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 10 client.6849 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 10 client.6849 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 20 client.6849 populate_metadata read hostname 'smithi005' 2024-04-25T09:00:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x5615618ca6c0 0x5615618caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 4 client.6849 mds_command: new command op to 6780 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 --> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561561822480 con 0x5615618ca6c0 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.228+0000 7f06bd212640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x5615618ca6c0 0x5615618caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.229+0000 7f0697fff640 10 client.6849 ms_handle_connect on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.229+0000 7f06bd212640 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x5615618ca6c0 0x5615618caae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181816274a4cf849 server_cookie=ad072cf2301592a0 in_seq=0 out_seq=0 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.229+0000 7f0697fff640 1 -- 172.21.15.5:0/1946591496 <== mds.0 v2:172.21.15.5:6834/1111822668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561561822480 con 0x5615618ca6c0 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.229+0000 7f0697fff640 10 client.6849 handle_command_reply: tid=0 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.229+0000 7f06c2180740 1 client.6849 shutdown 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.229+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 msgr2=0x5615618ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.229+0000 7f06c2180740 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618ccd30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f06ac075510 tx=0x7f06ac079170 comp rx=0 tx=0).stop 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 shutdown_connections 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618ccd30 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x5615618ca6c0 0x5615618caae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 --2- 172.21.15.5:0/1946591496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 >> 172.21.15.5:0/1946591496 conn(0x5615618dc700 msgr2=0x5615618ad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f0697fff640 0 client.6849 ms_handle_reset on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 shutdown_connections 2024-04-25T09:00:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 1 -- 172.21.15.5:0/1946591496 wait complete. 2024-04-25T09:00:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.230+0000 7f06c2180740 20 client.6849 trim_cache size 0 max 16384 2024-04-25T09:00:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.245+0000 7f06c2180740 1 Processor -- start 2024-04-25T09:00:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.245+0000 7f06c2180740 1 -- start start 2024-04-25T09:00:35.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06c2180740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dce40 0x5615618d8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618df880 0x5615618d96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 0x5615618dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06c2180740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8200060 con 0x5615618dce40 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80b41c0 con 0x5615618df880 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b81f4aa0 con 0x5615618f9d20 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dce40 0x5615618d8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dce40 0x5615618d8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35936/0 (socket says 172.21.15.5:35936) 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 -- 172.21.15.5:0/489528524 learned_addr learned my addr 172.21.15.5:0/489528524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 -- 172.21.15.5:0/489528524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 msgr2=0x5615618dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 --2- 172.21.15.5:0/489528524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 0x5615618dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 -- 172.21.15.5:0/489528524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618df880 msgr2=0x5615618d96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 --2- 172.21.15.5:0/489528524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618df880 0x5615618d96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 -- 172.21.15.5:0/489528524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615614c2560 con 0x5615618dce40 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f06bd212640 1 --2- 172.21.15.5:0/489528524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dce40 0x5615618d8fe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f06b0010620 tx=0x7f06b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe5ee62a17663a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f069e7fc640 1 -- 172.21.15.5:0/489528524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b002f070 con 0x5615618dce40 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f069e7fc640 1 -- 172.21.15.5:0/489528524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b001d040 con 0x5615618dce40 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.246+0000 7f069e7fc640 1 -- 172.21.15.5:0/489528524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b001c040 con 0x5615618dce40 2024-04-25T09:00:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 -- 172.21.15.5:0/489528524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dce40 msgr2=0x5615618d8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 --2- 172.21.15.5:0/489528524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dce40 0x5615618d8fe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f06b0010620 tx=0x7f06b0016000 comp rx=0 tx=0).stop 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 -- 172.21.15.5:0/489528524 shutdown_connections 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 --2- 172.21.15.5:0/489528524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618f9d20 0x5615618dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 --2- 172.21.15.5:0/489528524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618df880 0x5615618d96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 --2- 172.21.15.5:0/489528524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618dce40 0x5615618d8fe0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 -- 172.21.15.5:0/489528524 >> 172.21.15.5:0/489528524 conn(0x5615618dc700 msgr2=0x5615618cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 -- 172.21.15.5:0/489528524 shutdown_connections 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 -- 172.21.15.5:0/489528524 wait complete. 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 -- start start 2024-04-25T09:00:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.247+0000 7f06c2180740 1 Processor -- start 2024-04-25T09:00:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618d6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06c2180740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06c2180740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06c2180740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156191a410 con 0x5615618f9d20 2024-04-25T09:00:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80b3bc0 con 0x5615618dce40 2024-04-25T09:00:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06c2180740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561561948620 con 0x5615618df880 2024-04-25T09:00:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06c2180740 10 client.0 _ll_register_callbacks cb 0x7f06ac0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06bda13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06bda13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35950/0 (socket says 172.21.15.5:35950) 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.248+0000 7f06bda13640 1 -- 172.21.15.5:0/3317058734 learned_addr learned my addr 172.21.15.5:0/3317058734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bca11640 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bd212640 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618d6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bda13640 1 -- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 msgr2=0x5615618dfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bda13640 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618dfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bda13640 1 -- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 msgr2=0x5615618d6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bda13640 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618d6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bda13640 1 -- 172.21.15.5:0/3317058734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615618d8360 con 0x5615618f9d20 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06bda13640 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618e01f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f06a8003a10 tx=0x7f06a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7d28a5e7fe76b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f0697fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f0697fff640 1 -- 172.21.15.5:0/3317058734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a80159b0 con 0x5615618f9d20 2024-04-25T09:00:35.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f0697fff640 1 -- 172.21.15.5:0/3317058734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f06a8015b50 con 0x5615618f9d20 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06b001d040 con 0x5615618f9d20 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f0697fff640 1 -- 172.21.15.5:0/3317058734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06a802f050 con 0x5615618f9d20 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06c2180740 10 client.6855 fetch_fsmap learned FSMap version 39 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5615618edac0 con 0x5615618f9d20 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f0697fff640 1 -- 172.21.15.5:0/3317058734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b001d040 con 0x5615618f9d20 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f0697fff640 1 -- 172.21.15.5:0/3317058734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f06a8032020 con 0x5615618f9d20 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06c2180740 10 client.6855 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06c2180740 10 client.6855 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06c2180740 20 client.6855 populate_metadata read hostname 'smithi005' 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.249+0000 7f06c2180740 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561561947e60 0x5615618ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f06c2180740 4 client.6855 mds_command: new command op to 6780 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 --> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) v1 -- 0x56156181c7d0 con 0x561561947e60 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f06bd212640 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561561947e60 0x5615618ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f06bd212640 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561561947e60 0x5615618ecb50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b519f874a4b4b5 server_cookie=63e210258d9d8a0a in_seq=0 out_seq=0 2024-04-25T09:00:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f0697fff640 10 client.6855 ms_handle_connect on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f0697fff640 1 -- 172.21.15.5:0/3317058734 <== mds.0 v2:172.21.15.5:6834/1111822668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56156181c7d0 con 0x561561947e60 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f0697fff640 10 client.6855 handle_command_reply: tid=0 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f06c2180740 1 client.6855 shutdown 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 msgr2=0x5615618e01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.250+0000 7f06c2180740 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618e01f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f06a8003a10 tx=0x7f06a8004a40 comp rx=0 tx=0).stop 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 shutdown_connections 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615618f9d20 0x5615618e01f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5615618df880 0x5615618dfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.5:6834/1111822668,v1:172.21.15.5:6835/1111822668] conn(0x561561947e60 0x5615618ecb50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 --2- 172.21.15.5:0/3317058734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5615618dce40 0x5615618d6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f0697fff640 0 client.6855 ms_handle_reset on v2:172.21.15.5:6834/1111822668 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 >> 172.21.15.5:0/3317058734 conn(0x5615618dc700 msgr2=0x5615618b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 shutdown_connections 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 1 -- 172.21.15.5:0/3317058734 wait complete. 2024-04-25T09:00:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06c2180740 20 client.6855 trim_cache size 0 max 16384 2024-04-25T09:00:35.246 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:00:35.246 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T09:00:35.246 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "072f0f42-e5dc-45ca-a675-dc612a7cf8ab", 2024-04-25T09:00:35.246 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T09:00:35.246 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:00:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f06a406b4d0 msgr2=0x7f06a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f06a406b4d0 0x7f06a406d990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f06b0006fd0 tx=0x7f06b0008040 comp rx=0 tx=0).stop 2024-04-25T09:00:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d2500 msgr2=0x7f06b80c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d2500 0x7f06b80c99f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f06ac000c00 tx=0x7f06ac0046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 shutdown_connections 2024-04-25T09:00:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f06a406b4d0 0x7f06a406d990 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06b8161610 0x7f06b80b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06b80d2500 0x7f06b80c99f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 --2- 172.21.15.5:0/2283964740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06b80d0920 0x7f06b8151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 >> 172.21.15.5:0/2283964740 conn(0x7f06b80668f0 msgr2=0x7f06b815bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.251+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 shutdown_connections 2024-04-25T09:00:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:35.252+0000 7f06bf476640 1 -- 172.21.15.5:0/2283964740 wait complete. 2024-04-25T09:00:35.251 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '072f0f42-e5dc-45ca-a675-dc612a7cf8ab', 'mode': 'asynchronous'}' 2024-04-25T09:00:45.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:45.253 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-04-25T09:00:45.275 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:00:45.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:00:45.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:00:45.404 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:00:45.404 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:45.404 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:45.422 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:45.423 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:45.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.641+0000 7f900ee58640 1 Processor -- start 2024-04-25T09:00:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.641+0000 7f900ee58640 1 -- start start 2024-04-25T09:00:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.642+0000 7f900ee58640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 0x7f9008066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.642+0000 7f900ee58640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9008161fe0 0x7f90080b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.642+0000 7f900ee58640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9008067210 con 0x7f90080b3e10 2024-04-25T09:00:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.642+0000 7f900ee58640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90080b5740 con 0x7f9008161fe0 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.642+0000 7f900ee58640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90080b5a20 con 0x7f90080668f0 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.642+0000 7f900d3f5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90080b3e10 0x7f900806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43388/0 (socket says 172.21.15.5:43388) 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.642+0000 7f900d3f5640 1 -- 172.21.15.5:0/2881679136 learned_addr learned my addr 172.21.15.5:0/2881679136 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f900cbf4640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 0x7f9008066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f9007fff640 1 --2- 172.21.15.5:0/2881679136 >> v2:172.21.15.80:3300/0 conn(0x7f9008161fe0 0x7f90080b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107074092 0 0) 0x7f9008067210 con 0x7f90080b3e10 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff0003520 con 0x7f90080b3e10 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907880681 0 0) 0x7f8ff0003520 con 0x7f90080b3e10 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 msgr2=0x7f9008066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 0x7f9008066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 >> v2:172.21.15.80:3300/0 conn(0x7f9008161fe0 msgr2=0x7f90080b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 --2- 172.21.15.5:0/2881679136 >> v2:172.21.15.80:3300/0 conn(0x7f9008161fe0 0x7f90080b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080b5d00 con 0x7f90080b3e10 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f8ff8001670 con 0x7f90080b3e10 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 >> v1:172.21.15.5:6789/0 conn(0x7f90080b3e10 legacy=0x7f900806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 0x7f8ff00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f8ff0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff0004d40 0x7f8ff00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90080b5740 con 0x7f8ff0003f30 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90080b5a20 con 0x7f8ff0004d40 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff000b9c0 con 0x7f90080668f0 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f9007fff640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f8ff0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f900cbf4640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 0x7f8ff00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f900d3f5640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff0004d40 0x7f8ff00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f9007fff640 1 -- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 msgr2=0x7f8ff00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f9007fff640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f90080668f0 0x7f8ff00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f9007fff640 1 -- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff0004d40 msgr2=0x7f8ff00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f9007fff640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff0004d40 0x7f8ff00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.643+0000 7f9007fff640 1 -- 172.21.15.5:0/2881679136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0003520 con 0x7f8ff0003f30 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.644+0000 7f9007fff640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f8ff0004800 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009ac0 tx=0x7f8ff0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17053f85d7064800 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.644+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc036070 con 0x7f8ff0003f30 2024-04-25T09:00:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.644+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc031400 con 0x7f8ff0003f30 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.644+0000 7f90077fe640 1 -- 172.21.15.5:0/2881679136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc009690 con 0x7f8ff0003f30 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.645+0000 7f900ee58640 1 -- 172.21.15.5:0/2881679136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 msgr2=0x7f8ff0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.645+0000 7f900ee58640 1 --2- 172.21.15.5:0/2881679136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f8ff0004800 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009ac0 tx=0x7f8ff0005830 comp rx=0 tx=0).stop 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.645+0000 7f900d3f5640 1 -- 172.21.15.5:0/2881679136 reap_dead start 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.645+0000 7f900ee58640 1 -- 172.21.15.5:0/2881679136 shutdown_connections 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.645+0000 7f900ee58640 1 -- 172.21.15.5:0/2881679136 >> 172.21.15.5:0/2881679136 conn(0x7f90080b25d0 msgr2=0x7f90080b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.645+0000 7f900ee58640 1 -- 172.21.15.5:0/2881679136 shutdown_connections 2024-04-25T09:00:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.645+0000 7f900ee58640 1 -- 172.21.15.5:0/2881679136 wait complete. 2024-04-25T09:00:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.646+0000 7f900ee58640 1 Processor -- start 2024-04-25T09:00:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.646+0000 7f900ee58640 1 -- start start 2024-04-25T09:00:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900ee58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f9008142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900ee58640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f900815e230 0x7f900815e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900ee58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9008160990 0x7f9008160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900ee58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900806f030 con 0x7f8ff0003f30 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900ee58640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9008161ac0 con 0x7f9008160990 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900ee58640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900806f1b0 con 0x7f900815e230 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900cbf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f9008142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900cbf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f9008142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52754/0 (socket says 172.21.15.5:52754) 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900cbf4640 1 -- 172.21.15.5:0/2094102360 learned_addr learned my addr 172.21.15.5:0/2094102360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f900d3f5640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9008160990 0x7f9008160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.647+0000 7f9007fff640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f900815e230 0x7f900815e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900cbf4640 1 -- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f900815e230 msgr2=0x7f900815e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900cbf4640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f900815e230 0x7f900815e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900cbf4640 1 -- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9008160990 msgr2=0x7f9008160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900cbf4640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9008160990 0x7f9008160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900cbf4640 1 -- 172.21.15.5:0/2094102360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900815ecb0 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900d3f5640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9008160990 0x7f9008160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f9007fff640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f900815e230 0x7f900815e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900cbf4640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f9008142d50 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9000009fc0 tx=0x7f900000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f90057fa640 1 -- 172.21.15.5:0/2094102360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000fea0 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f90057fa640 1 -- 172.21.15.5:0/2094102360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9000015630 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f90057fa640 1 -- 172.21.15.5:0/2094102360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000015a20 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900815ef90 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.648+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900815f550 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.649+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900804ef20 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.649+0000 7f90057fa640 1 -- 172.21.15.5:0/2094102360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9000015bc0 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.650+0000 7f90057fa640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ff406b4d0 0x7f8ff406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.650+0000 7f90057fa640 1 -- 172.21.15.5:0/2094102360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f900008b3b0 con 0x7f8ff0003f30 2024-04-25T09:00:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.650+0000 7f9007fff640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ff406b4d0 0x7f8ff406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.651+0000 7f9007fff640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ff406b4d0 0x7f8ff406d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc033000 tx=0x7f8ffc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.654+0000 7f90057fa640 1 -- 172.21.15.5:0/2094102360 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9000019030 con 0x7f8ff0003f30 2024-04-25T09:00:45.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.835+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9008072140 con 0x7f8ff0003f30 2024-04-25T09:00:45.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.836+0000 7f90057fa640 1 -- 172.21.15.5:0/2094102360 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16710 (secure 0 0 0) 0x7f9000010040 con 0x7f8ff0003f30 2024-04-25T09:00:45.826 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:45.827 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:27.259335+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6836/3464170028":"2024-04-26T09:00:27.259301+0000","172.21.15.80:6834/3464170028":"2024-04-26T09:00:27.259301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ff406b4d0 msgr2=0x7f8ff406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ff406b4d0 0x7f8ff406d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc033000 tx=0x7f8ffc008030 comp rx=0 tx=0).stop 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 msgr2=0x7f9008142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f9008142d50 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9000009fc0 tx=0x7f900000f580 comp rx=0 tx=0).stop 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 shutdown_connections 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ff406b4d0 0x7f8ff406d990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9008160990 0x7f9008160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f900815e230 0x7f900815e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 --2- 172.21.15.5:0/2094102360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ff0003f30 0x7f9008142d50 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 >> 172.21.15.5:0/2094102360 conn(0x7f90080b25d0 msgr2=0x7f90081588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 shutdown_connections 2024-04-25T09:00:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.838+0000 7f900ee58640 1 -- 172.21.15.5:0/2094102360 wait complete. 2024-04-25T09:00:45.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:00:04.844156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:00:05.534669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:45.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.952+0000 7f020dd3b640 1 Processor -- start 2024-04-25T09:00:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.952+0000 7f020dd3b640 1 -- start start 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.953+0000 7f020dd3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020815dc00 0x7f02080b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.953+0000 7f020dd3b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02080668f0 0x7f0208066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.953+0000 7f020dd3b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02080b3a00 con 0x7f020806abe0 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.953+0000 7f020dd3b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0208067290 con 0x7f02080668f0 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.953+0000 7f020dd3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208072410 con 0x7f020815dc00 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f0206ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02080668f0 0x7f0208066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f02077fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020815dc00 0x7f02080b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f0207fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f020806abe0 0x7f020806b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:49098/0 (socket says 172.21.15.5:49098) 2024-04-25T09:00:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f0207fff640 1 -- 172.21.15.5:0/2542770089 learned_addr learned my addr 172.21.15.5:0/2542770089 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f0206ffd640 1 -- 172.21.15.5:0/2542770089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020815dc00 msgr2=0x7f02080b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f0206ffd640 1 --2- 172.21.15.5:0/2542770089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020815dc00 0x7f02080b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f0206ffd640 1 -- 172.21.15.5:0/2542770089 >> v1:172.21.15.80:6789/0 conn(0x7f020806abe0 legacy=0x7f020806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.954+0000 7f0206ffd640 1 -- 172.21.15.5:0/2542770089 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080b3ce0 con 0x7f02080668f0 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f0206ffd640 1 --2- 172.21.15.5:0/2542770089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f0208066d50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0097a0 tx=0x7f01fc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439ff059643a50b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f02067fc640 1 -- 172.21.15.5:0/2542770089 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc037070 con 0x7f02080668f0 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f02067fc640 1 -- 172.21.15.5:0/2542770089 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc032440 con 0x7f02080668f0 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f02067fc640 1 -- 172.21.15.5:0/2542770089 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc032810 con 0x7f02080668f0 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 -- 172.21.15.5:0/2542770089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 msgr2=0x7f0208066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 --2- 172.21.15.5:0/2542770089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f0208066d50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0097a0 tx=0x7f01fc02a180 comp rx=0 tx=0).stop 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 -- 172.21.15.5:0/2542770089 shutdown_connections 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 --2- 172.21.15.5:0/2542770089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f0208066d50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 --2- 172.21.15.5:0/2542770089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020815dc00 0x7f02080b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 -- 172.21.15.5:0/2542770089 >> 172.21.15.5:0/2542770089 conn(0x7f02080b2560 msgr2=0x7f02080b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 -- 172.21.15.5:0/2542770089 shutdown_connections 2024-04-25T09:00:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.955+0000 7f020dd3b640 1 -- 172.21.15.5:0/2542770089 wait complete. 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.956+0000 7f020dd3b640 1 Processor -- start 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.957+0000 7f020dd3b640 1 -- start start 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.957+0000 7f020dd3b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f02080cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.957+0000 7f020dd3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020806abe0 0x7f020813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.957+0000 7f020dd3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815dc00 0x7f020815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.957+0000 7f020dd3b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020806d450 con 0x7f020815dc00 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.957+0000 7f020dd3b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080af260 con 0x7f02080668f0 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.957+0000 7f020dd3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020815dfe0 con 0x7f020806abe0 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815dc00 0x7f020815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f02077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f02080cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f02077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f02080cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:33284/0 (socket says 172.21.15.5:33284) 2024-04-25T09:00:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0206ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020806abe0 0x7f020813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f02077fe640 1 -- 172.21.15.5:0/214581610 learned_addr learned my addr 172.21.15.5:0/214581610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815dc00 0x7f020815b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52758/0 (socket says 172.21.15.5:52758) 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 -- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020806abe0 msgr2=0x7f020813fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020806abe0 0x7f020813fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 -- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 msgr2=0x7f02080cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f02080cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 -- 172.21.15.5:0/214581610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020815f370 con 0x7f020815dc00 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f02077fe640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f02080cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f0207fff640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815dc00 0x7f020815b6d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f020000caa0 tx=0x7f020000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f01effff640 1 -- 172.21.15.5:0/214581610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200017070 con 0x7f020815dc00 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f01effff640 1 -- 172.21.15.5:0/214581610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000ac00 con 0x7f020815dc00 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020815f650 con 0x7f020815dc00 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f01effff640 1 -- 172.21.15.5:0/214581610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200012400 con 0x7f020815dc00 2024-04-25T09:00:45.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.958+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020815fc10 con 0x7f020815dc00 2024-04-25T09:00:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.959+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02080b6b30 con 0x7f020815dc00 2024-04-25T09:00:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.960+0000 7f01effff640 1 -- 172.21.15.5:0/214581610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f020001a070 con 0x7f020815dc00 2024-04-25T09:00:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.960+0000 7f01effff640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f01f406b4d0 0x7f01f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.960+0000 7f01effff640 1 -- 172.21.15.5:0/214581610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0200089d90 con 0x7f020815dc00 2024-04-25T09:00:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.961+0000 7f02077fe640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f01f406b4d0 0x7f01f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.961+0000 7f02077fe640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f01f406b4d0 0x7f01f406d990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f02081f7d80 tx=0x7f01f8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:45.964+0000 7f01effff640 1 -- 172.21.15.5:0/214581610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02080b6b30 con 0x7f020815dc00 2024-04-25T09:00:46.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.145+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f020804ef20 con 0x7f020815dc00 2024-04-25T09:00:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.146+0000 7f01effff640 1 -- 172.21.15.5:0/214581610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02000585f0 con 0x7f020815dc00 2024-04-25T09:00:46.135 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f01f406b4d0 msgr2=0x7f01f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f01f406b4d0 0x7f01f406d990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f02081f7d80 tx=0x7f01f8009190 comp rx=0 tx=0).stop 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815dc00 msgr2=0x7f020815b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815dc00 0x7f020815b6d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f020000caa0 tx=0x7f020000cf60 comp rx=0 tx=0).stop 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 shutdown_connections 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f01f406b4d0 0x7f01f406d990 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815dc00 0x7f020815b6d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f020806abe0 0x7f020813fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 --2- 172.21.15.5:0/214581610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02080668f0 0x7f02080cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.147+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 >> 172.21.15.5:0/214581610 conn(0x7f02080b2560 msgr2=0x7f02080b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.148+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 shutdown_connections 2024-04-25T09:00:46.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.148+0000 7f020dd3b640 1 -- 172.21.15.5:0/214581610 wait complete. 2024-04-25T09:00:46.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:00:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.265+0000 7f2740b7e640 1 Processor -- start 2024-04-25T09:00:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.265+0000 7f2740b7e640 1 -- start start 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.266+0000 7f2740b7e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f273c0b4550 0x7f273c0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.266+0000 7f2740b7e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c072690 con 0x7f273c0ce190 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.266+0000 7f2740b7e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0b2f50 con 0x7f273c0ae690 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.266+0000 7f2740b7e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c071ff0 con 0x7f273c0b4550 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.266+0000 7f273ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f273c0ce190 0x7f273c0cefd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43396/0 (socket says 172.21.15.5:43396) 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.266+0000 7f273ad9d640 1 -- 172.21.15.5:0/4137114500 learned_addr learned my addr 172.21.15.5:0/4137114500 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.266+0000 7f2739d9b640 1 --2- 172.21.15.5:0/4137114500 >> v2:172.21.15.80:3300/0 conn(0x7f273c0b4550 0x7f273c0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.267+0000 7f273959a640 1 -- 172.21.15.5:0/4137114500 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964160545 0 0) 0x7f273c072690 con 0x7f273c0ce190 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.267+0000 7f273959a640 1 -- 172.21.15.5:0/4137114500 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2728003520 con 0x7f273c0ce190 2024-04-25T09:00:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.267+0000 7f273959a640 1 -- 172.21.15.5:0/4137114500 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357055043 0 0) 0x7f273c0b2f50 con 0x7f273c0ae690 2024-04-25T09:00:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.267+0000 7f273959a640 1 -- 172.21.15.5:0/4137114500 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c072690 con 0x7f273c0ae690 2024-04-25T09:00:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.267+0000 7f2739d9b640 1 -- 172.21.15.5:0/4137114500 >> v1:172.21.15.80:6789/0 conn(0x7f273c0ae690 legacy=0x7f273c0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.267+0000 7f2739d9b640 1 -- 172.21.15.5:0/4137114500 >> v1:172.21.15.5:6789/0 conn(0x7f273c0ce190 legacy=0x7f273c0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.267+0000 7f2739d9b640 1 -- 172.21.15.5:0/4137114500 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0cd3d0 con 0x7f273c0b4550 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f2739d9b640 1 --2- 172.21.15.5:0/4137114500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0b4550 0x7f273c0b2850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27240097a0 tx=0x7f272402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c0799bbde0c1b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f273959a640 1 -- 172.21.15.5:0/4137114500 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724037070 con 0x7f273c0b4550 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f273959a640 1 -- 172.21.15.5:0/4137114500 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724032440 con 0x7f273c0b4550 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f273959a640 1 -- 172.21.15.5:0/4137114500 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724032810 con 0x7f273c0b4550 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f2740b7e640 1 -- 172.21.15.5:0/4137114500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0b4550 msgr2=0x7f273c0b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f2740b7e640 1 --2- 172.21.15.5:0/4137114500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0b4550 0x7f273c0b2850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27240097a0 tx=0x7f272402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f2740b7e640 1 -- 172.21.15.5:0/4137114500 shutdown_connections 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f2740b7e640 1 --2- 172.21.15.5:0/4137114500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0b4550 0x7f273c0b2850 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.268+0000 7f2740b7e640 1 -- 172.21.15.5:0/4137114500 >> 172.21.15.5:0/4137114500 conn(0x7f273c0b1550 msgr2=0x7f273c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.269+0000 7f2740b7e640 1 -- 172.21.15.5:0/4137114500 shutdown_connections 2024-04-25T09:00:46.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.269+0000 7f2740b7e640 1 -- 172.21.15.5:0/4137114500 wait complete. 2024-04-25T09:00:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.270+0000 7f2740b7e640 1 Processor -- start 2024-04-25T09:00:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.270+0000 7f2740b7e640 1 -- start start 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2740b7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0ae690 0x7f273c146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2740b7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f273c0b4550 0x7f273c0cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2740b7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f273c0ce190 0x7f273c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2740b7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0cdc70 con 0x7f273c0b4550 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2740b7e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0cd990 con 0x7f273c0ae690 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2740b7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c15ad60 con 0x7f273c0ce190 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f273c0b4550 0x7f273c0cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f273c0b4550 0x7f273c0cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52768/0 (socket says 172.21.15.5:52768) 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 -- 172.21.15.5:0/1471887906 learned_addr learned my addr 172.21.15.5:0/1471887906 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f273a59c640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0ae690 0x7f273c146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f273ad9d640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f273c0ce190 0x7f273c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 -- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f273c0ce190 msgr2=0x7f273c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f273c0ce190 0x7f273c0d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 -- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0ae690 msgr2=0x7f273c146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0ae690 0x7f273c146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 -- 172.21.15.5:0/1471887906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c156c10 con 0x7f273c0b4550 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.271+0000 7f2739d9b640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f273c0b4550 0x7f273c0cfb50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2724035040 tx=0x7f27240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.272+0000 7f2732ffd640 1 -- 172.21.15.5:0/1471887906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724041030 con 0x7f273c0b4550 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.272+0000 7f2732ffd640 1 -- 172.21.15.5:0/1471887906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272403d4e0 con 0x7f273c0b4550 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.272+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c15d730 con 0x7f273c0b4550 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.272+0000 7f2732ffd640 1 -- 172.21.15.5:0/1471887906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724037040 con 0x7f273c0b4550 2024-04-25T09:00:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.272+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c1e3630 con 0x7f273c0b4550 2024-04-25T09:00:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.273+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c04ef20 con 0x7f273c0b4550 2024-04-25T09:00:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.273+0000 7f2732ffd640 1 -- 172.21.15.5:0/1471887906 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2724044070 con 0x7f273c0b4550 2024-04-25T09:00:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.274+0000 7f2732ffd640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f271c06b4d0 0x7f271c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.274+0000 7f2732ffd640 1 -- 172.21.15.5:0/1471887906 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f27240aa780 con 0x7f273c0b4550 2024-04-25T09:00:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.274+0000 7f273a59c640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f271c06b4d0 0x7f271c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.274+0000 7f273a59c640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f271c06b4d0 0x7f271c06d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f272c007fd0 tx=0x7f272c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.278+0000 7f2732ffd640 1 -- 172.21.15.5:0/1471887906 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2724079080 con 0x7f273c0b4550 2024-04-25T09:00:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.461+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f273c0b1330 con 0x7f273c0b4550 2024-04-25T09:00:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.461+0000 7f2732ffd640 1 -- 172.21.15.5:0/1471887906 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f272407d120 con 0x7f273c0b4550 2024-04-25T09:00:46.451 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:00:46.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f271c06b4d0 msgr2=0x7f271c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f271c06b4d0 0x7f271c06d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f272c007fd0 tx=0x7f272c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:46.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f273c0b4550 msgr2=0x7f273c0cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f273c0b4550 0x7f273c0cfb50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2724035040 tx=0x7f27240046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 shutdown_connections 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f271c06b4d0 0x7f271c06d990 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f273c0ce190 0x7f273c0d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f273c0b4550 0x7f273c0cfb50 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 --2- 172.21.15.5:0/1471887906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273c0ae690 0x7f273c146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 >> 172.21.15.5:0/1471887906 conn(0x7f273c0b1550 msgr2=0x7f273c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 shutdown_connections 2024-04-25T09:00:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.463+0000 7f2740b7e640 1 -- 172.21.15.5:0/1471887906 wait complete. 2024-04-25T09:00:46.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:00:46.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.580+0000 7f50681d5640 1 Processor -- start 2024-04-25T09:00:46.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.580+0000 7f50681d5640 1 -- start start 2024-04-25T09:00:46.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.581+0000 7f50681d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f506015a9d0 0x7f5060071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.581+0000 7f50681d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.581+0000 7f50681d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506006e070 con 0x7f506006dbe0 2024-04-25T09:00:46.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.581+0000 7f50681d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506006e350 con 0x7f506015a9d0 2024-04-25T09:00:46.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.581+0000 7f50681d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506006e630 con 0x7f506006b2f0 2024-04-25T09:00:46.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5065f71640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f506015a9d0 0x7f5060071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5066772640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5065770640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f506006dbe0 0x7f506006abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:49106/0 (socket says 172.21.15.5:49106) 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5065770640 1 -- 172.21.15.5:0/602033547 learned_addr learned my addr 172.21.15.5:0/602033547 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5065f71640 1 -- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 msgr2=0x7f50600b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5065f71640 1 --2- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5065f71640 1 -- 172.21.15.5:0/602033547 >> v1:172.21.15.80:6789/0 conn(0x7f506006dbe0 legacy=0x7f506006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5065f71640 1 -- 172.21.15.5:0/602033547 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506006e910 con 0x7f506015a9d0 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5066772640 1 --2- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:46.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.582+0000 7f5064f6f640 1 -- 172.21.15.5:0/602033547 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808749361 0 0) 0x7f506006e070 con 0x7f506006dbe0 2024-04-25T09:00:46.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.583+0000 7f5065f71640 1 --2- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f506015a9d0 0x7f5060071e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50500097a0 tx=0x7f505002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2dc65c5fbcd887c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.583+0000 7f5064f6f640 1 -- 172.21.15.5:0/602033547 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050037070 con 0x7f506015a9d0 2024-04-25T09:00:46.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.583+0000 7f5064f6f640 1 -- 172.21.15.5:0/602033547 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5050032440 con 0x7f506015a9d0 2024-04-25T09:00:46.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.583+0000 7f5064f6f640 1 -- 172.21.15.5:0/602033547 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050032810 con 0x7f506015a9d0 2024-04-25T09:00:46.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 -- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f506015a9d0 msgr2=0x7f5060071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 --2- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f506015a9d0 0x7f5060071e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50500097a0 tx=0x7f505002a180 comp rx=0 tx=0).stop 2024-04-25T09:00:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 -- 172.21.15.5:0/602033547 shutdown_connections 2024-04-25T09:00:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 --2- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 --2- 172.21.15.5:0/602033547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f506015a9d0 0x7f5060071e00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 -- 172.21.15.5:0/602033547 >> 172.21.15.5:0/602033547 conn(0x7f50600b2560 msgr2=0x7f50600b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 -- 172.21.15.5:0/602033547 shutdown_connections 2024-04-25T09:00:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.584+0000 7f50681d5640 1 -- 172.21.15.5:0/602033547 wait complete. 2024-04-25T09:00:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.585+0000 7f50681d5640 1 Processor -- start 2024-04-25T09:00:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.585+0000 7f50681d5640 1 -- start start 2024-04-25T09:00:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f50681d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f50681d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506015a9d0 0x7f5060154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f50681d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601597f0 0x7f5060159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f50681d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060072340 con 0x7f506015a9d0 2024-04-25T09:00:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f50681d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506015adb0 con 0x7f50601597f0 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f50681d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600b3fa0 con 0x7f506006b2f0 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506015a9d0 0x7f5060154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506015a9d0 0x7f5060154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52784/0 (socket says 172.21.15.5:52784) 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 -- 172.21.15.5:0/1545161198 learned_addr learned my addr 172.21.15.5:0/1545161198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5066772640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601597f0 0x7f5060159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065f71640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 -- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 msgr2=0x7f50600ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 -- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601597f0 msgr2=0x7f5060159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601597f0 0x7f5060159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 -- 172.21.15.5:0/1545161198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060156ea0 con 0x7f506015a9d0 2024-04-25T09:00:46.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.586+0000 7f5065770640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506015a9d0 0x7f5060154770 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c470 tx=0x7f505c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.587+0000 7f50567fc640 1 -- 172.21.15.5:0/1545161198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0074e0 con 0x7f506015a9d0 2024-04-25T09:00:46.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.587+0000 7f50567fc640 1 -- 172.21.15.5:0/1545161198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c0047e0 con 0x7f506015a9d0 2024-04-25T09:00:46.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.587+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5060154cb0 con 0x7f506015a9d0 2024-04-25T09:00:46.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.587+0000 7f50567fc640 1 -- 172.21.15.5:0/1545161198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c004bd0 con 0x7f506015a9d0 2024-04-25T09:00:46.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.587+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5060157110 con 0x7f506015a9d0 2024-04-25T09:00:46.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.588+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506004ef20 con 0x7f506015a9d0 2024-04-25T09:00:46.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.589+0000 7f50567fc640 1 -- 172.21.15.5:0/1545161198 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f505c011070 con 0x7f506015a9d0 2024-04-25T09:00:46.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.589+0000 7f50567fc640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f504406b4d0 0x7f504406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.589+0000 7f50567fc640 1 -- 172.21.15.5:0/1545161198 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f505c089e00 con 0x7f506015a9d0 2024-04-25T09:00:46.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.589+0000 7f5065f71640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f504406b4d0 0x7f504406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.590+0000 7f5065f71640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f504406b4d0 0x7f504406d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5050034000 tx=0x7f505002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.593+0000 7f50567fc640 1 -- 172.21.15.5:0/1545161198 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f505c058c10 con 0x7f506015a9d0 2024-04-25T09:00:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.773+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f506015cf40 con 0x7f506015a9d0 2024-04-25T09:00:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.774+0000 7f50567fc640 1 -- 172.21.15.5:0/1545161198 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f505c058510 con 0x7f506015a9d0 2024-04-25T09:00:46.763 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.775+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f504406b4d0 msgr2=0x7f504406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.775+0000 7f50681d5640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f504406b4d0 0x7f504406d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5050034000 tx=0x7f505002e000 comp rx=0 tx=0).stop 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506015a9d0 msgr2=0x7f5060154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506015a9d0 0x7f5060154770 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c470 tx=0x7f505c00c870 comp rx=0 tx=0).stop 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 shutdown_connections 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f504406b4d0 0x7f504406d990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50601597f0 0x7f5060159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f506015a9d0 0x7f5060154770 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 --2- 172.21.15.5:0/1545161198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f506006b2f0 0x7f50600ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 >> 172.21.15.5:0/1545161198 conn(0x7f50600b2560 msgr2=0x7f50600b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 shutdown_connections 2024-04-25T09:00:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.776+0000 7f50681d5640 1 -- 172.21.15.5:0/1545161198 wait complete. 2024-04-25T09:00:46.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:00:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.889+0000 7fa124ebd640 1 Processor -- start 2024-04-25T09:00:46.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.889+0000 7fa124ebd640 1 -- start start 2024-04-25T09:00:46.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa124ebd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa12015e0a0 0x7fa1200d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa124ebd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa1200d3df0 0x7fa1200cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa124ebd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200b7f60 con 0x7fa1200d3990 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa124ebd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200b29c0 con 0x7fa12015e0a0 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa124ebd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200d2080 con 0x7fa1200d3df0 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa117fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa1200d3990 0x7fa1200ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43400/0 (socket says 172.21.15.5:43400) 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa11e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa12015e0a0 0x7fa1200d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.890+0000 7fa117fff640 1 -- 172.21.15.5:0/2605441845 learned_addr learned my addr 172.21.15.5:0/2605441845 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.891+0000 7fa11ed9d640 1 --2- 172.21.15.5:0/2605441845 >> v2:172.21.15.80:3300/0 conn(0x7fa1200d3df0 0x7fa1200cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.891+0000 7fa11e59c640 1 -- 172.21.15.5:0/2605441845 >> v2:172.21.15.80:3300/0 conn(0x7fa1200d3df0 msgr2=0x7fa1200cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.891+0000 7fa11e59c640 1 --2- 172.21.15.5:0/2605441845 >> v2:172.21.15.80:3300/0 conn(0x7fa1200d3df0 0x7fa1200cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.891+0000 7fa11e59c640 1 -- 172.21.15.5:0/2605441845 >> v1:172.21.15.5:6789/0 conn(0x7fa1200d3990 legacy=0x7fa1200ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.891+0000 7fa11dd9b640 1 -- 172.21.15.5:0/2605441845 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030699967 0 0) 0x7fa1200b7f60 con 0x7fa1200d3990 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.891+0000 7fa11e59c640 1 -- 172.21.15.5:0/2605441845 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200d2360 con 0x7fa12015e0a0 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa11e59c640 1 --2- 172.21.15.5:0/2605441845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa12015e0a0 0x7fa1200d0d50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fa1200b34f0 tx=0x7fa11002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583e879b81792690 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa11dd9b640 1 -- 172.21.15.5:0/2605441845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110037070 con 0x7fa12015e0a0 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa11dd9b640 1 -- 172.21.15.5:0/2605441845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa110032440 con 0x7fa12015e0a0 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa11dd9b640 1 -- 172.21.15.5:0/2605441845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110032810 con 0x7fa12015e0a0 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa124ebd640 1 -- 172.21.15.5:0/2605441845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa12015e0a0 msgr2=0x7fa1200d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa124ebd640 1 --2- 172.21.15.5:0/2605441845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa12015e0a0 0x7fa1200d0d50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fa1200b34f0 tx=0x7fa11002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa124ebd640 1 -- 172.21.15.5:0/2605441845 shutdown_connections 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa124ebd640 1 --2- 172.21.15.5:0/2605441845 >> v2:172.21.15.80:3300/0 conn(0x7fa1200d3df0 0x7fa1200cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa124ebd640 1 --2- 172.21.15.5:0/2605441845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa12015e0a0 0x7fa1200d0d50 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa124ebd640 1 -- 172.21.15.5:0/2605441845 >> 172.21.15.5:0/2605441845 conn(0x7fa1200668f0 msgr2=0x7fa120066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:46.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.892+0000 7fa124ebd640 1 -- 172.21.15.5:0/2605441845 shutdown_connections 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.893+0000 7fa124ebd640 1 -- 172.21.15.5:0/2605441845 wait complete. 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.894+0000 7fa124ebd640 1 Processor -- start 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.894+0000 7fa124ebd640 1 -- start start 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa124ebd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1200d3990 0x7fa12015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa124ebd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1200d3df0 0x7fa1200cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa124ebd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa12015e0a0 0x7fa1200aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa124ebd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200d2c00 con 0x7fa1200d3990 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa124ebd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200d2920 con 0x7fa12015e0a0 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa124ebd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200d4280 con 0x7fa1200d3df0 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1200d3990 0x7fa12015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1200d3990 0x7fa12015a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52810/0 (socket says 172.21.15.5:52810) 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 -- 172.21.15.5:0/3092351279 learned_addr learned my addr 172.21.15.5:0/3092351279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11ed9d640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa12015e0a0 0x7fa1200aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa117fff640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1200d3df0 0x7fa1200cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 -- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1200d3df0 msgr2=0x7fa1200cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1200d3df0 0x7fa1200cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 -- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa12015e0a0 msgr2=0x7fa1200aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa12015e0a0 0x7fa1200aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 -- 172.21.15.5:0/3092351279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200cbd90 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11ed9d640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa12015e0a0 0x7fa1200aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.895+0000 7fa11e59c640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1200d3990 0x7fa12015a250 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa110009890 tx=0x7fa1100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.896+0000 7fa116ffd640 1 -- 172.21.15.5:0/3092351279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110041070 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.896+0000 7fa116ffd640 1 -- 172.21.15.5:0/3092351279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11003c950 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.896+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1200cc070 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.896+0000 7fa116ffd640 1 -- 172.21.15.5:0/3092351279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110037040 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.896+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1200cc630 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.897+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12004ef20 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.898+0000 7fa116ffd640 1 -- 172.21.15.5:0/3092351279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa110044070 con 0x7fa1200d3990 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.899+0000 7fa116ffd640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa10006b4d0 0x7fa10006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.899+0000 7fa116ffd640 1 -- 172.21.15.5:0/3092351279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa1100ab040 con 0x7fa1200d3990 2024-04-25T09:00:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.899+0000 7fa117fff640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa10006b4d0 0x7fa10006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.899+0000 7fa117fff640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa10006b4d0 0x7fa10006d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa12015d890 tx=0x7fa108007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:46.902+0000 7fa116ffd640 1 -- 172.21.15.5:0/3092351279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa110079f40 con 0x7fa1200d3990 2024-04-25T09:00:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.097+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa12015d500 con 0x7fa1200d3990 2024-04-25T09:00:47.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.098+0000 7fa116ffd640 1 -- 172.21.15.5:0/3092351279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v61) v1 ==== 80+0+122 (secure 0 0 0) 0x7fa110079840 con 0x7fa1200d3990 2024-04-25T09:00:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.80:6836/3464170028 2024-04-26T09:00:27.259301+0000 2024-04-25T09:00:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.80:6834/3464170028 2024-04-26T09:00:27.259301+0000 2024-04-25T09:00:47.088 INFO:teuthology.orchestra.run.smithi005.stderr:listed 2 entries 2024-04-25T09:00:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa10006b4d0 msgr2=0x7fa10006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa10006b4d0 0x7fa10006d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa12015d890 tx=0x7fa108007c00 comp rx=0 tx=0).stop 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1200d3990 msgr2=0x7fa12015a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1200d3990 0x7fa12015a250 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa110009890 tx=0x7fa1100046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 shutdown_connections 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa10006b4d0 0x7fa10006d990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa12015e0a0 0x7fa1200aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1200d3df0 0x7fa1200cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 --2- 172.21.15.5:0/3092351279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1200d3990 0x7fa12015a250 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 >> 172.21.15.5:0/3092351279 conn(0x7fa1200668f0 msgr2=0x7fa1200d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 shutdown_connections 2024-04-25T09:00:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.100+0000 7fa124ebd640 1 -- 172.21.15.5:0/3092351279 wait complete. 2024-04-25T09:00:47.100 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:00:47.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:47.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:47.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:00:47.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:47.132 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:00:47.188 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:00:47.188 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:47.208 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:00:47.208 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:47.208 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:47.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:00:47.246 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:00:47.246 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:47.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:00:47.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.400+0000 7ff1e5f5c640 1 Processor -- start 2024-04-25T09:00:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.400+0000 7ff1e5f5c640 1 -- start start 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1e5f5c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1e006b7d0 0x7ff1e006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1e5f5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e015e120 0x7ff1e00d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1e5f5c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e00b4730 con 0x7ff1e006bbb0 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1e5f5c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e00d0b70 con 0x7ff1e006b7d0 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1e5f5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00cbf30 con 0x7ff1e015e120 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e015e120 0x7ff1e00d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1df7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1e006b7d0 0x7ff1e006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1df7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1e006b7d0 0x7ff1e006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:33356/0 (socket says 172.21.15.5:33356) 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1df7fe640 1 -- 172.21.15.5:0/233198783 learned_addr learned my addr 172.21.15.5:0/233198783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.401+0000 7ff1dffff640 1 --2- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e015e120 0x7ff1e00d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:56786/0 (socket says 172.21.15.5:56786) 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.402+0000 7ff1df7fe640 1 -- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e015e120 msgr2=0x7ff1e00d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.402+0000 7ff1df7fe640 1 --2- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e015e120 0x7ff1e00d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.402+0000 7ff1df7fe640 1 -- 172.21.15.5:0/233198783 >> v1:172.21.15.80:6789/0 conn(0x7ff1e006bbb0 legacy=0x7ff1e015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.402+0000 7ff1df7fe640 1 -- 172.21.15.5:0/233198783 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00d0da0 con 0x7ff1e006b7d0 2024-04-25T09:00:47.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.402+0000 7ff1de7fc640 1 -- 172.21.15.5:0/233198783 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96336706 0 0) 0x7ff1d0001110 con 0x7ff1e006bbb0 2024-04-25T09:00:47.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.402+0000 7ff1dffff640 1 --2- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e015e120 0x7ff1e00d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.402+0000 7ff1df7fe640 1 --2- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006b7d0 0x7ff1e006aef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009870 tx=0x7ff1c802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17695ee83006c260 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1de7fc640 1 -- 172.21.15.5:0/233198783 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8037070 con 0x7ff1e006b7d0 2024-04-25T09:00:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1de7fc640 1 -- 172.21.15.5:0/233198783 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c802ae50 con 0x7ff1e006b7d0 2024-04-25T09:00:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1de7fc640 1 -- 172.21.15.5:0/233198783 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8032860 con 0x7ff1e006b7d0 2024-04-25T09:00:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006b7d0 msgr2=0x7ff1e006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006b7d0 0x7ff1e006aef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009870 tx=0x7ff1c802a300 comp rx=0 tx=0).stop 2024-04-25T09:00:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/233198783 shutdown_connections 2024-04-25T09:00:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e015e120 0x7ff1e00d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/233198783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006b7d0 0x7ff1e006aef0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/233198783 >> 172.21.15.5:0/233198783 conn(0x7ff1e00d18e0 msgr2=0x7ff1e00d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/233198783 shutdown_connections 2024-04-25T09:00:47.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.403+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/233198783 wait complete. 2024-04-25T09:00:47.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.404+0000 7ff1e5f5c640 1 Processor -- start 2024-04-25T09:00:47.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1e5f5c640 1 -- start start 2024-04-25T09:00:47.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1e5f5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e006b7d0 0x7ff1e00b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1e5f5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006bbb0 0x7ff1e01f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1e5f5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e015e120 0x7ff1e015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1e5f5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00cc460 con 0x7ff1e015e120 2024-04-25T09:00:47.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1e5f5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00cc7d0 con 0x7ff1e006bbb0 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1e5f5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00ccc60 con 0x7ff1e006b7d0 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e006b7d0 0x7ff1e00b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e015e120 0x7ff1e015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e006b7d0 0x7ff1e00b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:56788/0 (socket says 172.21.15.5:56788) 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.405+0000 7ff1df7fe640 1 -- 172.21.15.5:0/1688304465 learned_addr learned my addr 172.21.15.5:0/1688304465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1deffd640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006bbb0 0x7ff1e01f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1dffff640 1 -- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e006b7d0 msgr2=0x7ff1e00b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1dffff640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e006b7d0 0x7ff1e00b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1dffff640 1 -- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006bbb0 msgr2=0x7ff1e01f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1dffff640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006bbb0 0x7ff1e01f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1dffff640 1 -- 172.21.15.5:0/1688304465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0160b40 con 0x7ff1e015e120 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1df7fe640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e006b7d0 0x7ff1e00b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1dffff640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e015e120 0x7ff1e015fde0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800efc0 tx=0x7ff1d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1d7fff640 1 -- 172.21.15.5:0/1688304465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8018030 con 0x7ff1e015e120 2024-04-25T09:00:47.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1d7fff640 1 -- 172.21.15.5:0/1688304465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d800cd30 con 0x7ff1e015e120 2024-04-25T09:00:47.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e0160e20 con 0x7ff1e015e120 2024-04-25T09:00:47.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1d7fff640 1 -- 172.21.15.5:0/1688304465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8003bb0 con 0x7ff1e015e120 2024-04-25T09:00:47.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.406+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e01613e0 con 0x7ff1e015e120 2024-04-25T09:00:47.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.407+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e004ef20 con 0x7ff1e015e120 2024-04-25T09:00:47.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.408+0000 7ff1d7fff640 1 -- 172.21.15.5:0/1688304465 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1d801b070 con 0x7ff1e015e120 2024-04-25T09:00:47.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.408+0000 7ff1d7fff640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c006b4d0 0x7ff1c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.408+0000 7ff1d7fff640 1 -- 172.21.15.5:0/1688304465 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff1d808a9d0 con 0x7ff1e015e120 2024-04-25T09:00:47.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.408+0000 7ff1df7fe640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c006b4d0 0x7ff1c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.409+0000 7ff1df7fe640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c006b4d0 0x7ff1c006d990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80090b0 tx=0x7ff1c802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.416+0000 7ff1d7fff640 1 -- 172.21.15.5:0/1688304465 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff1d8010040 con 0x7ff1e015e120 2024-04-25T09:00:47.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.630+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1e00cbd10 con 0x7ff1e015e120 2024-04-25T09:00:47.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.631+0000 7ff1d7fff640 1 -- 172.21.15.5:0/1688304465 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4933 (secure 0 0 0) 0x7ff1d8059230 con 0x7ff1e015e120 2024-04-25T09:00:47.621 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:47.621 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:30.278033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/1111822668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1111822668},{"type":"v1","addr":"172.21.15.5:6835","nonce":1111822668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:47.621 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 39 2024-04-25T09:00:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c006b4d0 msgr2=0x7ff1c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c006b4d0 0x7ff1c006d990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80090b0 tx=0x7ff1c802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e015e120 msgr2=0x7ff1e015fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e015e120 0x7ff1e015fde0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800efc0 tx=0x7ff1d800c490 comp rx=0 tx=0).stop 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 shutdown_connections 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c006b4d0 0x7ff1c006d990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e015e120 0x7ff1e015fde0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e006bbb0 0x7ff1e01f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 --2- 172.21.15.5:0/1688304465 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e006b7d0 0x7ff1e00b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 >> 172.21.15.5:0/1688304465 conn(0x7ff1e00d18e0 msgr2=0x7ff1e006e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 shutdown_connections 2024-04-25T09:00:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.633+0000 7ff1e5f5c640 1 -- 172.21.15.5:0/1688304465 wait complete. 2024-04-25T09:00:47.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.744+0000 7f74fcecb640 1 Processor -- start 2024-04-25T09:00:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.744+0000 7f74fcecb640 1 -- start start 2024-04-25T09:00:47.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.745+0000 7f74fcecb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74f80b94c0 0x7f74f80d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.745+0000 7f74fcecb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74f80d0400 0x7f74f80d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.745+0000 7f74fcecb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f80d0d40 con 0x7f74f815def0 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.745+0000 7f74fcecb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f815e2d0 con 0x7f74f80d0400 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.745+0000 7f74fcecb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f80d2550 con 0x7f74f80b94c0 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74f80d0400 0x7f74f80d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f5d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74f80b94c0 0x7f74f80d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74f80d0400 0x7f74f80d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52828/0 (socket says 172.21.15.5:52828) 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f6d9d640 1 -- 172.21.15.5:0/2924347757 learned_addr learned my addr 172.21.15.5:0/2924347757 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f6d9d640 1 -- 172.21.15.5:0/2924347757 >> v2:172.21.15.80:3300/0 conn(0x7f74f80b94c0 msgr2=0x7f74f80d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f6d9d640 1 --2- 172.21.15.5:0/2924347757 >> v2:172.21.15.80:3300/0 conn(0x7f74f80b94c0 0x7f74f80d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f6d9d640 1 -- 172.21.15.5:0/2924347757 >> v1:172.21.15.80:6789/0 conn(0x7f74f815def0 legacy=0x7f74f80d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f559a640 1 -- 172.21.15.5:0/2924347757 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968294461 0 0) 0x7f74f80d0d40 con 0x7f74f815def0 2024-04-25T09:00:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.746+0000 7f74f6d9d640 1 -- 172.21.15.5:0/2924347757 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80d2830 con 0x7f74f80d0400 2024-04-25T09:00:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74f6d9d640 1 --2- 172.21.15.5:0/2924347757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80d0800 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f74f80b9950 tx=0x7f74e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8555aad2612f2b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74f559a640 1 -- 172.21.15.5:0/2924347757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8036070 con 0x7f74f80d0400 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74f559a640 1 -- 172.21.15.5:0/2924347757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8031600 con 0x7f74f80d0400 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74f559a640 1 -- 172.21.15.5:0/2924347757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e80319d0 con 0x7f74f80d0400 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74fcecb640 1 -- 172.21.15.5:0/2924347757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 msgr2=0x7f74f80d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2924347757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80d0800 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f74f80b9950 tx=0x7f74e802a730 comp rx=0 tx=0).stop 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74fcecb640 1 -- 172.21.15.5:0/2924347757 shutdown_connections 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2924347757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80d0800 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2924347757 >> v2:172.21.15.80:3300/0 conn(0x7f74f80b94c0 0x7f74f80d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.747+0000 7f74fcecb640 1 -- 172.21.15.5:0/2924347757 >> 172.21.15.5:0/2924347757 conn(0x7f74f806b000 msgr2=0x7f74f806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.748+0000 7f74fcecb640 1 -- 172.21.15.5:0/2924347757 shutdown_connections 2024-04-25T09:00:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.748+0000 7f74fcecb640 1 -- 172.21.15.5:0/2924347757 wait complete. 2024-04-25T09:00:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.749+0000 7f74fcecb640 1 Processor -- start 2024-04-25T09:00:47.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.749+0000 7f74fcecb640 1 -- start start 2024-04-25T09:00:47.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.749+0000 7f74fcecb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74f80b94c0 0x7f74f815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74fcecb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74fcecb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74f815def0 0x7f74f80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74fcecb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80d30d0 con 0x7f74f80d0400 2024-04-25T09:00:47.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74fcecb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80d2df0 con 0x7f74f815def0 2024-04-25T09:00:47.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74fcecb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80b6c60 con 0x7f74f80b94c0 2024-04-25T09:00:47.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52842/0 (socket says 172.21.15.5:52842) 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 -- 172.21.15.5:0/2300049202 learned_addr learned my addr 172.21.15.5:0/2300049202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f659c640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74f80b94c0 0x7f74f815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 -- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74f80b94c0 msgr2=0x7f74f815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74f80b94c0 0x7f74f815c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 -- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74f815def0 msgr2=0x7f74f80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f6d9d640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74f815def0 0x7f74f80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74f815def0 0x7f74f80ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 -- 172.21.15.5:0/2300049202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80cc960 con 0x7f74f80d0400 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f659c640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74f80b94c0 0x7f74f815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74f5d9b640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80aac40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00e9b0 tx=0x7f74ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74e6ffd640 1 -- 172.21.15.5:0/2300049202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec017070 con 0x7f74f80d0400 2024-04-25T09:00:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74e6ffd640 1 -- 172.21.15.5:0/2300049202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00c9a0 con 0x7f74f80d0400 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f80ccc40 con 0x7f74f80d0400 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74e6ffd640 1 -- 172.21.15.5:0/2300049202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00cd90 con 0x7f74f80d0400 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.750+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f80cd200 con 0x7f74f80d0400 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.751+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f80cd540 con 0x7f74f80d0400 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.752+0000 7f74e6ffd640 1 -- 172.21.15.5:0/2300049202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74ec01a070 con 0x7f74f80d0400 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.752+0000 7f74e6ffd640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74d806b4d0 0x7f74d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.753+0000 7f74e6ffd640 1 -- 172.21.15.5:0/2300049202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f74ec08a640 con 0x7f74f80d0400 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.753+0000 7f74f659c640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74d806b4d0 0x7f74d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.753+0000 7f74f659c640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74d806b4d0 0x7f74d806d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000f60 tx=0x7f74f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.757+0000 7f74e6ffd640 1 -- 172.21.15.5:0/2300049202 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74f80cd540 con 0x7f74f80d0400 2024-04-25T09:00:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.936+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74f80af1c0 con 0x7f74f80d0400 2024-04-25T09:00:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.937+0000 7f74e6ffd640 1 -- 172.21.15.5:0/2300049202 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16710 (secure 0 0 0) 0x7f74f80af1c0 con 0x7f74f80d0400 2024-04-25T09:00:47.926 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:47.927 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:27.259335+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6836/3464170028":"2024-04-26T09:00:27.259301+0000","172.21.15.80:6834/3464170028":"2024-04-26T09:00:27.259301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74d806b4d0 msgr2=0x7f74d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74d806b4d0 0x7f74d806d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000f60 tx=0x7f74f0009040 comp rx=0 tx=0).stop 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 msgr2=0x7f74f80aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80aac40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00e9b0 tx=0x7f74ec00ee70 comp rx=0 tx=0).stop 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 shutdown_connections 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f74d806b4d0 0x7f74d806d990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74f815def0 0x7f74f80ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f80d0400 0x7f74f80aac40 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 --2- 172.21.15.5:0/2300049202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74f80b94c0 0x7f74f815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 >> 172.21.15.5:0/2300049202 conn(0x7f74f806b000 msgr2=0x7f74f815e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 shutdown_connections 2024-04-25T09:00:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:47.939+0000 7f74fcecb640 1 -- 172.21.15.5:0/2300049202 wait complete. 2024-04-25T09:00:47.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:00:04.844156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:00:05.534669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:47.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.054+0000 7f612fb7e640 1 Processor -- start 2024-04-25T09:00:48.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.054+0000 7f612fb7e640 1 -- start start 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612fb7e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f612815c0f0 0x7f61280cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612fb7e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61280d0610 0x7f61280b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612fb7e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61280cf7a0 con 0x7f61280b24b0 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612fb7e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280cd350 con 0x7f612815c0f0 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612fb7e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280d24e0 con 0x7f61280d0610 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612d91a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f612815c0f0 0x7f61280cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612d91a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f612815c0f0 0x7f61280cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52848/0 (socket says 172.21.15.5:52848) 2024-04-25T09:00:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.055+0000 7f612d91a640 1 -- 172.21.15.5:0/1917617684 learned_addr learned my addr 172.21.15.5:0/1917617684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:48.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612e11b640 1 --2- 172.21.15.5:0/1917617684 >> v2:172.21.15.80:3300/0 conn(0x7f61280d0610 0x7f61280b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612d91a640 1 -- 172.21.15.5:0/1917617684 >> v2:172.21.15.80:3300/0 conn(0x7f61280d0610 msgr2=0x7f61280b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612d91a640 1 --2- 172.21.15.5:0/1917617684 >> v2:172.21.15.80:3300/0 conn(0x7f61280d0610 0x7f61280b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612d91a640 1 -- 172.21.15.5:0/1917617684 >> v1:172.21.15.80:6789/0 conn(0x7f61280b24b0 legacy=0x7f61280cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612d91a640 1 -- 172.21.15.5:0/1917617684 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280d27c0 con 0x7f612815c0f0 2024-04-25T09:00:48.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612e11b640 1 --2- 172.21.15.5:0/1917617684 >> v2:172.21.15.80:3300/0 conn(0x7f61280d0610 0x7f61280b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612d91a640 1 --2- 172.21.15.5:0/1917617684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f61280cd7e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f61280cd4d0 tx=0x7f612002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a520365d372ec9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.056+0000 7f612c918640 1 -- 172.21.15.5:0/1917617684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120037070 con 0x7f612815c0f0 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612c918640 1 -- 172.21.15.5:0/1917617684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120032440 con 0x7f612815c0f0 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612c918640 1 -- 172.21.15.5:0/1917617684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120032810 con 0x7f612815c0f0 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 -- 172.21.15.5:0/1917617684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 msgr2=0x7f61280cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 --2- 172.21.15.5:0/1917617684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f61280cd7e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f61280cd4d0 tx=0x7f612002a270 comp rx=0 tx=0).stop 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 -- 172.21.15.5:0/1917617684 shutdown_connections 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 --2- 172.21.15.5:0/1917617684 >> v2:172.21.15.80:3300/0 conn(0x7f61280d0610 0x7f61280b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 --2- 172.21.15.5:0/1917617684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f61280cd7e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 -- 172.21.15.5:0/1917617684 >> 172.21.15.5:0/1917617684 conn(0x7f61280d1920 msgr2=0x7f61280d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 -- 172.21.15.5:0/1917617684 shutdown_connections 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.057+0000 7f612fb7e640 1 -- 172.21.15.5:0/1917617684 wait complete. 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.058+0000 7f612fb7e640 1 Processor -- start 2024-04-25T09:00:48.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.058+0000 7f612fb7e640 1 -- start start 2024-04-25T09:00:48.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612fb7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61280b24b0 0x7f612815c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612fb7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f61280d0610 0x7f612815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612fb7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f612815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612fb7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61280cdd20 con 0x7f612815c0f0 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612fb7e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61280cfa40 con 0x7f61280b24b0 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612fb7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280cdea0 con 0x7f61280d0610 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612e11b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f612815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612e11b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f612815ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52852/0 (socket says 172.21.15.5:52852) 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.059+0000 7f612e11b640 1 -- 172.21.15.5:0/831589212 learned_addr learned my addr 172.21.15.5:0/831589212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612d91a640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61280b24b0 0x7f612815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612d119640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f61280d0610 0x7f612815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612e11b640 1 -- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f61280d0610 msgr2=0x7f612815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612e11b640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f61280d0610 0x7f612815e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612e11b640 1 -- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61280b24b0 msgr2=0x7f612815c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612e11b640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61280b24b0 0x7f612815c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612e11b640 1 -- 172.21.15.5:0/831589212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280c43b0 con 0x7f612815c0f0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612e11b640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f612815ee10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6118007e70 tx=0x7f611800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f61267fc640 1 -- 172.21.15.5:0/831589212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611801a070 con 0x7f612815c0f0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f61267fc640 1 -- 172.21.15.5:0/831589212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118015600 con 0x7f612815c0f0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61280c4650 con 0x7f612815c0f0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f61267fc640 1 -- 172.21.15.5:0/831589212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61180159f0 con 0x7f612815c0f0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.060+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61280d2020 con 0x7f612815c0f0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.061+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612804ef20 con 0x7f612815c0f0 2024-04-25T09:00:48.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.062+0000 7f61267fc640 1 -- 172.21.15.5:0/831589212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f611801d070 con 0x7f612815c0f0 2024-04-25T09:00:48.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.062+0000 7f61267fc640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f611406b4d0 0x7f611406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.062+0000 7f61267fc640 1 -- 172.21.15.5:0/831589212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f611808a550 con 0x7f612815c0f0 2024-04-25T09:00:48.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.062+0000 7f612d91a640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f611406b4d0 0x7f611406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.063+0000 7f612d91a640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f611406b4d0 0x7f611406d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6120034000 tx=0x7f612002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.066+0000 7f61267fc640 1 -- 172.21.15.5:0/831589212 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6118010070 con 0x7f612815c0f0 2024-04-25T09:00:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.247+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61280702c0 con 0x7f612815c0f0 2024-04-25T09:00:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.247+0000 7f61267fc640 1 -- 172.21.15.5:0/831589212 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6118059370 con 0x7f612815c0f0 2024-04-25T09:00:48.236 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:00:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f611406b4d0 msgr2=0x7f611406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f611406b4d0 0x7f611406d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6120034000 tx=0x7f612002e000 comp rx=0 tx=0).stop 2024-04-25T09:00:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 msgr2=0x7f612815ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f612815ee10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6118007e70 tx=0x7f611800d4a0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 shutdown_connections 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f611406b4d0 0x7f611406d990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f612815c0f0 0x7f612815ee10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f61280d0610 0x7f612815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 --2- 172.21.15.5:0/831589212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61280b24b0 0x7f612815c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 >> 172.21.15.5:0/831589212 conn(0x7f61280d1920 msgr2=0x7f61280ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 shutdown_connections 2024-04-25T09:00:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.249+0000 7f612fb7e640 1 -- 172.21.15.5:0/831589212 wait complete. 2024-04-25T09:00:48.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:00:48.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.364+0000 7f8908b63640 1 Processor -- start 2024-04-25T09:00:48.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.364+0000 7f8908b63640 1 -- start start 2024-04-25T09:00:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8908b63640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f890415df70 0x7f89040b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8908b63640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 0x7f89040ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8908b63640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89040d1ed0 con 0x7f89040ced50 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8908b63640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89040d1c80 con 0x7f890415df70 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8908b63640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89040d2ae0 con 0x7f89040d2f70 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8902d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89040ced50 0x7f89040b55e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43416/0 (socket says 172.21.15.5:43416) 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8902d9d640 1 -- 172.21.15.5:0/1607598926 learned_addr learned my addr 172.21.15.5:0/1607598926 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f8901d9b640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 0x7f89040ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289863237 0 0) 0x7f89040d1ed0 con 0x7f89040ced50 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.365+0000 7f890259c640 1 --2- 172.21.15.5:0/1607598926 >> v2:172.21.15.80:3300/0 conn(0x7f890415df70 0x7f89040b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f0003520 con 0x7f89040ced50 2024-04-25T09:00:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 552264102 0 0) 0x7f88f0003520 con 0x7f89040ced50 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 msgr2=0x7f89040ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 0x7f89040ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 >> v2:172.21.15.80:3300/0 conn(0x7f890415df70 msgr2=0x7f89040b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 --2- 172.21.15.5:0/1607598926 >> v2:172.21.15.80:3300/0 conn(0x7f890415df70 0x7f89040b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040d21b0 con 0x7f89040ced50 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f88f40019f0 con 0x7f89040ced50 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 >> v1:172.21.15.5:6789/0 conn(0x7f89040ced50 legacy=0x7f89040b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f0004800 0x7f88f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 0x7f88f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040d1c80 con 0x7f88f00039b0 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040d2ae0 con 0x7f88f0004800 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f000b9c0 con 0x7f89040d2f70 2024-04-25T09:00:48.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890259c640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f8901d9b640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f0004800 0x7f88f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f8902d9d640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 0x7f88f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890259c640 1 -- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 msgr2=0x7f88f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890259c640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 0x7f88f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890259c640 1 -- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f0004800 msgr2=0x7f88f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890259c640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f0004800 0x7f88f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f890259c640 1 -- 172.21.15.5:0/1607598926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0003520 con 0x7f88f00039b0 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.366+0000 7f8902d9d640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89040d2f70 0x7f88f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.367+0000 7f890259c640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009ac0 tx=0x7f88f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900f378fedd71ef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.367+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc036070 con 0x7f88f00039b0 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.367+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc031400 con 0x7f88f00039b0 2024-04-25T09:00:48.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.367+0000 7f890159a640 1 -- 172.21.15.5:0/1607598926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc009690 con 0x7f88f00039b0 2024-04-25T09:00:48.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.368+0000 7f8908b63640 1 -- 172.21.15.5:0/1607598926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00039b0 msgr2=0x7f88f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.368+0000 7f8908b63640 1 --2- 172.21.15.5:0/1607598926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00039b0 0x7f88f0003dd0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009ac0 tx=0x7f88f0005830 comp rx=0 tx=0).stop 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.368+0000 7f8902d9d640 1 -- 172.21.15.5:0/1607598926 reap_dead start 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.368+0000 7f8908b63640 1 -- 172.21.15.5:0/1607598926 shutdown_connections 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.368+0000 7f8908b63640 1 -- 172.21.15.5:0/1607598926 >> 172.21.15.5:0/1607598926 conn(0x7f890406b000 msgr2=0x7f890406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.368+0000 7f8908b63640 1 -- 172.21.15.5:0/1607598926 shutdown_connections 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.368+0000 7f8908b63640 1 -- 172.21.15.5:0/1607598926 wait complete. 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.369+0000 7f8908b63640 1 Processor -- start 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.369+0000 7f8908b63640 1 -- start start 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8908b63640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88f00039b0 0x7f8904156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8908b63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89041f7ee0 0x7f89040b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8908b63640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89040cc410 0x7f89040cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8908b63640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040b9a10 con 0x7f89041f7ee0 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8908b63640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040d2770 con 0x7f89040cc410 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8908b63640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89040d3720 con 0x7f88f00039b0 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89041f7ee0 0x7f89040b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89041f7ee0 0x7f89040b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52868/0 (socket says 172.21.15.5:52868) 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 -- 172.21.15.5:0/3998925668 learned_addr learned my addr 172.21.15.5:0/3998925668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f890259c640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88f00039b0 0x7f8904156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8902d9d640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89040cc410 0x7f89040cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 -- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88f00039b0 msgr2=0x7f8904156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88f00039b0 0x7f8904156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 -- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89040cc410 msgr2=0x7f89040cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89040cc410 0x7f89040cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 -- 172.21.15.5:0/3998925668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8904157130 con 0x7f89041f7ee0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f890259c640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88f00039b0 0x7f8904156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.370+0000 7f8901d9b640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89041f7ee0 0x7f89040b5ec0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0119a0 tx=0x7f88ec011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.371+0000 7f88faffd640 1 -- 172.21.15.5:0/3998925668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00faf0 con 0x7f89041f7ee0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.371+0000 7f88faffd640 1 -- 172.21.15.5:0/3998925668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec00fc90 con 0x7f89041f7ee0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.371+0000 7f88faffd640 1 -- 172.21.15.5:0/3998925668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec014440 con 0x7f89041f7ee0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.371+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89041f3ff0 con 0x7f89041f7ee0 2024-04-25T09:00:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.371+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89041f45b0 con 0x7f89041f7ee0 2024-04-25T09:00:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.372+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890404ef20 con 0x7f89041f7ee0 2024-04-25T09:00:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.372+0000 7f88faffd640 1 -- 172.21.15.5:0/3998925668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f88ec012040 con 0x7f89041f7ee0 2024-04-25T09:00:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.372+0000 7f88faffd640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88e406b500 0x7f88e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.373+0000 7f88faffd640 1 -- 172.21.15.5:0/3998925668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f88ec08a930 con 0x7f89041f7ee0 2024-04-25T09:00:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.373+0000 7f890259c640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88e406b500 0x7f88e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.373+0000 7f890259c640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88e406b500 0x7f88e406d9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f88fc033000 tx=0x7f88fc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.377+0000 7f88faffd640 1 -- 172.21.15.5:0/3998925668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f88ec019030 con 0x7f89041f7ee0 2024-04-25T09:00:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.555+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89040d1880 con 0x7f89041f7ee0 2024-04-25T09:00:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.555+0000 7f88faffd640 1 -- 172.21.15.5:0/3998925668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88ec059100 con 0x7f89041f7ee0 2024-04-25T09:00:48.544 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:00:48.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88e406b500 msgr2=0x7f88e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88e406b500 0x7f88e406d9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f88fc033000 tx=0x7f88fc008030 comp rx=0 tx=0).stop 2024-04-25T09:00:48.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89041f7ee0 msgr2=0x7f89040b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89041f7ee0 0x7f89040b5ec0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0119a0 tx=0x7f88ec011e60 comp rx=0 tx=0).stop 2024-04-25T09:00:48.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 shutdown_connections 2024-04-25T09:00:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f88e406b500 0x7f88e406d9c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89040cc410 0x7f89040cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89041f7ee0 0x7f89040b5ec0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 --2- 172.21.15.5:0/3998925668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f88f00039b0 0x7f8904156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 >> 172.21.15.5:0/3998925668 conn(0x7f890406b000 msgr2=0x7f89040b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 shutdown_connections 2024-04-25T09:00:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.557+0000 7f8908b63640 1 -- 172.21.15.5:0/3998925668 wait complete. 2024-04-25T09:00:48.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:00:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.671+0000 7fd64704d640 1 Processor -- start 2024-04-25T09:00:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.671+0000 7fd64704d640 1 -- start start 2024-04-25T09:00:48.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd64704d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400b96e0 0x7fd6400d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd64704d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6400d4060 0x7fd6400b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd64704d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6400b9b20 con 0x7fd6401614b0 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd64704d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400d2740 con 0x7fd6400d4060 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd64704d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400d2a20 con 0x7fd6400b96e0 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd6455ea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6400d4060 0x7fd6400b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd644de9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd6401614b0 0x7fd6400d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43430/0 (socket says 172.21.15.5:43430) 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd644de9640 1 -- 172.21.15.5:0/2346893897 learned_addr learned my addr 172.21.15.5:0/2346893897 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.672+0000 7fd63ffff640 1 --2- 172.21.15.5:0/2346893897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400b96e0 0x7fd6400d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd6455ea640 1 -- 172.21.15.5:0/2346893897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400b96e0 msgr2=0x7fd6400d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd6455ea640 1 --2- 172.21.15.5:0/2346893897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400b96e0 0x7fd6400d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd6455ea640 1 -- 172.21.15.5:0/2346893897 >> v1:172.21.15.5:6789/0 conn(0x7fd6401614b0 legacy=0x7fd6400d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd6455ea640 1 -- 172.21.15.5:0/2346893897 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400d2d00 con 0x7fd6400d4060 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd63f7fe640 1 -- 172.21.15.5:0/2346893897 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598234082 0 0) 0x7fd6400b9b20 con 0x7fd6401614b0 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd63ffff640 1 --2- 172.21.15.5:0/2346893897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400b96e0 0x7fd6400d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd6455ea640 1 --2- 172.21.15.5:0/2346893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400d4060 0x7fd6400b6cc0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd6300097a0 tx=0x7fd63002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365975ea7d33d055 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd63f7fe640 1 -- 172.21.15.5:0/2346893897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630037070 con 0x7fd6400d4060 2024-04-25T09:00:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd63f7fe640 1 -- 172.21.15.5:0/2346893897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630032440 con 0x7fd6400d4060 2024-04-25T09:00:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.673+0000 7fd63f7fe640 1 -- 172.21.15.5:0/2346893897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630032810 con 0x7fd6400d4060 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 -- 172.21.15.5:0/2346893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400d4060 msgr2=0x7fd6400b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 --2- 172.21.15.5:0/2346893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400d4060 0x7fd6400b6cc0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd6300097a0 tx=0x7fd63002a180 comp rx=0 tx=0).stop 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 -- 172.21.15.5:0/2346893897 shutdown_connections 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 --2- 172.21.15.5:0/2346893897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400d4060 0x7fd6400b6cc0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 --2- 172.21.15.5:0/2346893897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400b96e0 0x7fd6400d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 -- 172.21.15.5:0/2346893897 >> 172.21.15.5:0/2346893897 conn(0x7fd64006b000 msgr2=0x7fd64006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 -- 172.21.15.5:0/2346893897 shutdown_connections 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.674+0000 7fd64704d640 1 -- 172.21.15.5:0/2346893897 wait complete. 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.675+0000 7fd64704d640 1 Processor -- start 2024-04-25T09:00:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.675+0000 7fd64704d640 1 -- start start 2024-04-25T09:00:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd64704d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400b96e0 0x7fd6401f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd64704d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400d4060 0x7fd6400b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd64704d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6401614b0 0x7fd6400b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd64704d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400d37e0 con 0x7fd6400b96e0 2024-04-25T09:00:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd64704d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400d32c0 con 0x7fd6401614b0 2024-04-25T09:00:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd64704d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400b7200 con 0x7fd6400d4060 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400b96e0 0x7fd6401f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400b96e0 0x7fd6401f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52886/0 (socket says 172.21.15.5:52886) 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 -- 172.21.15.5:0/847815106 learned_addr learned my addr 172.21.15.5:0/847815106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd6455ea640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6401614b0 0x7fd6400b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd63ffff640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400d4060 0x7fd6400b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 -- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400d4060 msgr2=0x7fd6400b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400d4060 0x7fd6400b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 -- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6401614b0 msgr2=0x7fd6400b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6401614b0 0x7fd6400b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.676+0000 7fd644de9640 1 -- 172.21.15.5:0/847815106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6401f4910 con 0x7fd6400b96e0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.677+0000 7fd644de9640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400b96e0 0x7fd6401f43d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c7c0 tx=0x7fd63800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.677+0000 7fd63d7fa640 1 -- 172.21.15.5:0/847815106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638018070 con 0x7fd6400b96e0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.677+0000 7fd63d7fa640 1 -- 172.21.15.5:0/847815106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800a640 con 0x7fd6400b96e0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.677+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6400b5960 con 0x7fd6400b96e0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.677+0000 7fd63d7fa640 1 -- 172.21.15.5:0/847815106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800aa30 con 0x7fd6400b96e0 2024-04-25T09:00:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.677+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6400b5f20 con 0x7fd6400b96e0 2024-04-25T09:00:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.678+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64004ef20 con 0x7fd6400b96e0 2024-04-25T09:00:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.678+0000 7fd63d7fa640 1 -- 172.21.15.5:0/847815106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd63801b070 con 0x7fd6400b96e0 2024-04-25T09:00:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.679+0000 7fd63d7fa640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd62c06b4d0 0x7fd62c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.679+0000 7fd63d7fa640 1 -- 172.21.15.5:0/847815106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd638089870 con 0x7fd6400b96e0 2024-04-25T09:00:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.679+0000 7fd63ffff640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd62c06b4d0 0x7fd62c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.679+0000 7fd63ffff640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd62c06b4d0 0x7fd62c06d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd640155cb0 tx=0x7fd634008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.683+0000 7fd63d7fa640 1 -- 172.21.15.5:0/847815106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6401f4910 con 0x7fd6400b96e0 2024-04-25T09:00:48.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.862+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6400b6120 con 0x7fd6400b96e0 2024-04-25T09:00:48.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.862+0000 7fd63d7fa640 1 -- 172.21.15.5:0/847815106 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd638058690 con 0x7fd6400b96e0 2024-04-25T09:00:48.851 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:00:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd62c06b4d0 msgr2=0x7fd62c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd62c06b4d0 0x7fd62c06d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd640155cb0 tx=0x7fd634008040 comp rx=0 tx=0).stop 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400b96e0 msgr2=0x7fd6401f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400b96e0 0x7fd6401f43d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c7c0 tx=0x7fd63800cc80 comp rx=0 tx=0).stop 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 shutdown_connections 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd62c06b4d0 0x7fd62c06d990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6401614b0 0x7fd6400b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd6400d4060 0x7fd6400b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 --2- 172.21.15.5:0/847815106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6400b96e0 0x7fd6401f43d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 >> 172.21.15.5:0/847815106 conn(0x7fd64006b000 msgr2=0x7fd6400b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 shutdown_connections 2024-04-25T09:00:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.864+0000 7fd64704d640 1 -- 172.21.15.5:0/847815106 wait complete. 2024-04-25T09:00:48.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.975+0000 7f9b4381f640 1 Processor -- start 2024-04-25T09:00:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.976+0000 7f9b4381f640 1 -- start start 2024-04-25T09:00:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.976+0000 7f9b4381f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.976+0000 7f9b4381f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b3c0ce7f0 0x7f9b3c0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.976+0000 7f9b4381f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c0cf1c0 con 0x7f9b3c0b2cc0 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.976+0000 7f9b4381f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c0d2a10 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.976+0000 7f9b4381f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0d20e0 con 0x7f9b3c15de70 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b415bb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b41dbc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b3c0ce7f0 0x7f9b3c0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b415bb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:56852/0 (socket says 172.21.15.5:56852) 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b41dbc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b3c0ce7f0 0x7f9b3c0cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:33430/0 (socket says 172.21.15.5:33430) 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b415bb640 1 -- 172.21.15.5:0/987738310 learned_addr learned my addr 172.21.15.5:0/987738310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b40dba640 1 --1- 172.21.15.5:0/987738310 >> v1:172.21.15.80:6789/0 conn(0x7f9b3c0b2cc0 0x7f9b3c0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:49140/0 (socket says 172.21.15.5:49140) 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b415bb640 1 -- 172.21.15.5:0/987738310 >> v2:172.21.15.80:3300/0 conn(0x7f9b3c0ce7f0 msgr2=0x7f9b3c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b415bb640 1 --2- 172.21.15.5:0/987738310 >> v2:172.21.15.80:3300/0 conn(0x7f9b3c0ce7f0 0x7f9b3c0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b415bb640 1 -- 172.21.15.5:0/987738310 >> v1:172.21.15.80:6789/0 conn(0x7f9b3c0b2cc0 legacy=0x7f9b3c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b415bb640 1 -- 172.21.15.5:0/987738310 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0d23c0 con 0x7f9b3c15de70 2024-04-25T09:00:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.977+0000 7f9b41dbc640 1 --2- 172.21.15.5:0/987738310 >> v2:172.21.15.80:3300/0 conn(0x7f9b3c0ce7f0 0x7f9b3c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.978+0000 7f9b415bb640 1 --2- 172.21.15.5:0/987738310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0b93e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009870 tx=0x7f9b3802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e063232197a6047c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.978+0000 7f9b33fff640 1 -- 172.21.15.5:0/987738310 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38037070 con 0x7f9b3c15de70 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.978+0000 7f9b33fff640 1 -- 172.21.15.5:0/987738310 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38032440 con 0x7f9b3c15de70 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.978+0000 7f9b33fff640 1 -- 172.21.15.5:0/987738310 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38032810 con 0x7f9b3c15de70 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 -- 172.21.15.5:0/987738310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 msgr2=0x7f9b3c0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 --2- 172.21.15.5:0/987738310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0b93e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009870 tx=0x7f9b3802a270 comp rx=0 tx=0).stop 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 -- 172.21.15.5:0/987738310 shutdown_connections 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 --2- 172.21.15.5:0/987738310 >> v2:172.21.15.80:3300/0 conn(0x7f9b3c0ce7f0 0x7f9b3c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 --2- 172.21.15.5:0/987738310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0b93e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 -- 172.21.15.5:0/987738310 >> 172.21.15.5:0/987738310 conn(0x7f9b3c06b000 msgr2=0x7f9b3c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 -- 172.21.15.5:0/987738310 shutdown_connections 2024-04-25T09:00:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.979+0000 7f9b4381f640 1 -- 172.21.15.5:0/987738310 wait complete. 2024-04-25T09:00:48.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.980+0000 7f9b4381f640 1 Processor -- start 2024-04-25T09:00:48.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.980+0000 7f9b4381f640 1 -- start start 2024-04-25T09:00:48.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b4381f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b3c0b2cc0 0x7f9b3c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b4381f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b3c0ce7f0 0x7f9b3c0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b4381f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b4381f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0b7300 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b4381f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0b9920 con 0x7f9b3c0b2cc0 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b4381f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0d2ea0 con 0x7f9b3c15de70 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b3c0ce7f0 0x7f9b3c0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b3c0ce7f0 0x7f9b3c0caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52902/0 (socket says 172.21.15.5:52902) 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 -- 172.21.15.5:0/2992417755 learned_addr learned my addr 172.21.15.5:0/2992417755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b415bb640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b3c0b2cc0 0x7f9b3c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b41dbc640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 -- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 msgr2=0x7f9b3c0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 -- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b3c0b2cc0 msgr2=0x7f9b3c1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b3c0b2cc0 0x7f9b3c1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.981+0000 7f9b40dba640 1 -- 172.21.15.5:0/2992417755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0cb5f0 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.982+0000 7f9b40dba640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b3c0ce7f0 0x7f9b3c0caba0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c400 tx=0x7f9b2c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.982+0000 7f9b31ffb640 1 -- 172.21.15.5:0/2992417755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0074e0 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.982+0000 7f9b31ffb640 1 -- 172.21.15.5:0/2992417755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c007680 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.982+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c0cb8d0 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.982+0000 7f9b31ffb640 1 -- 172.21.15.5:0/2992417755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c004a00 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.982+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c0b39f0 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.983+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c04ef20 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.983+0000 7f9b31ffb640 1 -- 172.21.15.5:0/2992417755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b2c01a020 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.984+0000 7f9b31ffb640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b2006b4d0 0x7f9b2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.984+0000 7f9b31ffb640 1 -- 172.21.15.5:0/2992417755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9b2c089860 con 0x7f9b3c0ce7f0 2024-04-25T09:00:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.984+0000 7f9b415bb640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b2006b4d0 0x7f9b2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.984+0000 7f9b415bb640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b2006b4d0 0x7f9b2006d990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9b38034000 tx=0x7f9b3802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:48.988+0000 7f9b31ffb640 1 -- 172.21.15.5:0/2992417755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b2c058710 con 0x7f9b3c0ce7f0 2024-04-25T09:00:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.204+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b3c06b3e0 con 0x7f9b3c0ce7f0 2024-04-25T09:00:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.204+0000 7f9b31ffb640 1 -- 172.21.15.5:0/2992417755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f9b2c058010 con 0x7f9b3c0ce7f0 2024-04-25T09:00:49.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:49.194 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:30.278033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/1111822668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1111822668},{"type":"v1","addr":"172.21.15.5:6835","nonce":1111822668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 39 2024-04-25T09:00:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b2006b4d0 msgr2=0x7f9b2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b2006b4d0 0x7f9b2006d990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9b38034000 tx=0x7f9b3802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b3c0ce7f0 msgr2=0x7f9b3c0caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b3c0ce7f0 0x7f9b3c0caba0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c400 tx=0x7f9b2c00c800 comp rx=0 tx=0).stop 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 shutdown_connections 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b2006b4d0 0x7f9b2006d990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b3c15de70 0x7f9b3c0cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b3c0ce7f0 0x7f9b3c0caba0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 --2- 172.21.15.5:0/2992417755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b3c0b2cc0 0x7f9b3c1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 >> 172.21.15.5:0/2992417755 conn(0x7f9b3c06b000 msgr2=0x7f9b3c15ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 shutdown_connections 2024-04-25T09:00:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.206+0000 7f9b4381f640 1 -- 172.21.15.5:0/2992417755 wait complete. 2024-04-25T09:00:49.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:49.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.318+0000 7f5e2d36a640 1 Processor -- start 2024-04-25T09:00:49.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.318+0000 7f5e2d36a640 1 -- start start 2024-04-25T09:00:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e2d36a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280b0a50 0x7f5e280ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e2d36a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e280b0e30 0x7f5e280ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e2d36a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2806ba50 con 0x7f5e280cbf40 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e2d36a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2806b800 con 0x7f5e280b0e30 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e2d36a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2806bd30 con 0x7f5e280b0a50 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e277fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e280cbf40 0x7f5e280d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43444/0 (socket says 172.21.15.5:43444) 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e277fe640 1 -- 172.21.15.5:0/3798392938 learned_addr learned my addr 172.21.15.5:0/3798392938 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e26ffd640 1 --2- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280b0a50 0x7f5e280ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e267fc640 1 --2- 172.21.15.5:0/3798392938 >> v2:172.21.15.80:3300/0 conn(0x7f5e280b0e30 0x7f5e280ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e25ffb640 1 -- 172.21.15.5:0/3798392938 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653436297 0 0) 0x7f5e2806ba50 con 0x7f5e280cbf40 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e25ffb640 1 -- 172.21.15.5:0/3798392938 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e10003520 con 0x7f5e280cbf40 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e267fc640 1 -- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280b0a50 msgr2=0x7f5e280ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e25ffb640 1 -- 172.21.15.5:0/3798392938 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1763199615 0 0) 0x7f5e10003520 con 0x7f5e280cbf40 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e267fc640 1 --2- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280b0a50 0x7f5e280ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e267fc640 1 -- 172.21.15.5:0/3798392938 >> v1:172.21.15.5:6789/0 conn(0x7f5e280cbf40 legacy=0x7f5e280d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e267fc640 1 -- 172.21.15.5:0/3798392938 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2806c010 con 0x7f5e280b0e30 2024-04-25T09:00:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.319+0000 7f5e26ffd640 1 --2- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280b0a50 0x7f5e280ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.320+0000 7f5e267fc640 1 --2- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 0x7f5e280ce740 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097a0 tx=0x7f5e1c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a808ba1309cc07e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.320+0000 7f5e25ffb640 1 -- 172.21.15.5:0/3798392938 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c037070 con 0x7f5e280b0e30 2024-04-25T09:00:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.320+0000 7f5e25ffb640 1 -- 172.21.15.5:0/3798392938 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c02ab10 con 0x7f5e280b0e30 2024-04-25T09:00:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.320+0000 7f5e25ffb640 1 -- 172.21.15.5:0/3798392938 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e200019f0 con 0x7f5e280b0e30 2024-04-25T09:00:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 msgr2=0x7f5e280ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 0x7f5e280ce740 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097a0 tx=0x7f5e1c02a080 comp rx=0 tx=0).stop 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3798392938 shutdown_connections 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 0x7f5e280ce740 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3798392938 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280b0a50 0x7f5e280ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3798392938 >> 172.21.15.5:0/3798392938 conn(0x7f5e280d18f0 msgr2=0x7f5e280d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3798392938 shutdown_connections 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.321+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3798392938 wait complete. 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.322+0000 7f5e2d36a640 1 Processor -- start 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.322+0000 7f5e2d36a640 1 -- start start 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e2d36a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e280b0a50 0x7f5e2815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e2d36a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 0x7f5e2814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e2d36a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280cbf40 0x7f5e2814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e2d36a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280b2bf0 con 0x7f5e280b0a50 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e2d36a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280cfd60 con 0x7f5e280b0e30 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e2d36a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280c63e0 con 0x7f5e280cbf40 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e26ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e280b0a50 0x7f5e2815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e26ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e280b0a50 0x7f5e2815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52904/0 (socket says 172.21.15.5:52904) 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e26ffd640 1 -- 172.21.15.5:0/3593953487 learned_addr learned my addr 172.21.15.5:0/3593953487 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e277fe640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280cbf40 0x7f5e2814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.323+0000 7f5e267fc640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 0x7f5e2814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e26ffd640 1 -- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280cbf40 msgr2=0x7f5e2814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e26ffd640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280cbf40 0x7f5e2814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e26ffd640 1 -- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 msgr2=0x7f5e2814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e26ffd640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 0x7f5e2814c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e26ffd640 1 -- 172.21.15.5:0/3593953487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e280c6680 con 0x7f5e280b0a50 2024-04-25T09:00:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e26ffd640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e280b0a50 0x7f5e2815e610 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800ebe0 tx=0x7f5e1800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/3593953487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18017070 con 0x7f5e280b0a50 2024-04-25T09:00:49.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/3593953487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1800cc30 con 0x7f5e280b0a50 2024-04-25T09:00:49.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/3593953487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18013470 con 0x7f5e280b0a50 2024-04-25T09:00:49.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e280c6960 con 0x7f5e280b0a50 2024-04-25T09:00:49.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.324+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e280c6f20 con 0x7f5e280b0a50 2024-04-25T09:00:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.325+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2806cd70 con 0x7f5e280b0a50 2024-04-25T09:00:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.325+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/3593953487 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e1801a070 con 0x7f5e280b0a50 2024-04-25T09:00:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.326+0000 7f5e0f7fe640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e1406b4d0 0x7f5e1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.326+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/3593953487 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5e1808a580 con 0x7f5e280b0a50 2024-04-25T09:00:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.326+0000 7f5e267fc640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e1406b4d0 0x7f5e1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.327+0000 7f5e267fc640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e1406b4d0 0x7f5e1406d990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c034000 tx=0x7f5e1c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.330+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/3593953487 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e180593b0 con 0x7f5e280b0a50 2024-04-25T09:00:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.511+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e2804ef20 con 0x7f5e280b0a50 2024-04-25T09:00:49.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.512+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/3593953487 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16710 (secure 0 0 0) 0x7f5e18058cb0 con 0x7f5e280b0a50 2024-04-25T09:00:49.501 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:49.501 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:27.259335+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6836/3464170028":"2024-04-26T09:00:27.259301+0000","172.21.15.80:6834/3464170028":"2024-04-26T09:00:27.259301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e1406b4d0 msgr2=0x7f5e1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e1406b4d0 0x7f5e1406d990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c034000 tx=0x7f5e1c02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e280b0a50 msgr2=0x7f5e2815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e280b0a50 0x7f5e2815e610 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800ebe0 tx=0x7f5e1800c520 comp rx=0 tx=0).stop 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 shutdown_connections 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5e1406b4d0 0x7f5e1406d990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e280cbf40 0x7f5e2814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e280b0e30 0x7f5e2814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 --2- 172.21.15.5:0/3593953487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e280b0a50 0x7f5e2815e610 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 >> 172.21.15.5:0/3593953487 conn(0x7f5e280d18f0 msgr2=0x7f5e280ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:49.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 shutdown_connections 2024-04-25T09:00:49.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.514+0000 7f5e2d36a640 1 -- 172.21.15.5:0/3593953487 wait complete. 2024-04-25T09:00:49.514 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:00:49.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.626+0000 7fd91b1b7640 1 Processor -- start 2024-04-25T09:00:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.626+0000 7fd91b1b7640 1 -- start start 2024-04-25T09:00:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd91b1b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd91415de70 0x7fd9140b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd91b1b7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9140b2cc0 0x7fd9140b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd91b1b7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9140d20e0 con 0x7fd9140b7130 2024-04-25T09:00:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd91b1b7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9140d2a10 con 0x7fd9140b2cc0 2024-04-25T09:00:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd91b1b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140d23c0 con 0x7fd91415de70 2024-04-25T09:00:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd913fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9140b2cc0 0x7fd9140b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd913fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9140b2cc0 0x7fd9140b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52910/0 (socket says 172.21.15.5:52910) 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd913fff640 1 -- 172.21.15.5:0/3700834745 learned_addr learned my addr 172.21.15.5:0/3700834745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd918f53640 1 --2- 172.21.15.5:0/3700834745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd91415de70 0x7fd9140b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd913fff640 1 -- 172.21.15.5:0/3700834745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd91415de70 msgr2=0x7fd9140b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd913fff640 1 --2- 172.21.15.5:0/3700834745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd91415de70 0x7fd9140b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd913fff640 1 -- 172.21.15.5:0/3700834745 >> v1:172.21.15.80:6789/0 conn(0x7fd9140b7130 legacy=0x7fd9140ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd913fff640 1 -- 172.21.15.5:0/3700834745 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140d26a0 con 0x7fd9140b2cc0 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.627+0000 7fd918f53640 1 --2- 172.21.15.5:0/3700834745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd91415de70 0x7fd9140b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.628+0000 7fd913fff640 1 --2- 172.21.15.5:0/3700834745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9140b2cc0 0x7fd9140b6bf0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd904009870 tx=0x7fd90402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992eab2ea918f142 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.628+0000 7fd9137fe640 1 -- 172.21.15.5:0/3700834745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904037070 con 0x7fd9140b2cc0 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.628+0000 7fd9137fe640 1 -- 172.21.15.5:0/3700834745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd904032440 con 0x7fd9140b2cc0 2024-04-25T09:00:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.628+0000 7fd9137fe640 1 -- 172.21.15.5:0/3700834745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904032810 con 0x7fd9140b2cc0 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 -- 172.21.15.5:0/3700834745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9140b2cc0 msgr2=0x7fd9140b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/3700834745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9140b2cc0 0x7fd9140b6bf0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd904009870 tx=0x7fd90402a210 comp rx=0 tx=0).stop 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 -- 172.21.15.5:0/3700834745 shutdown_connections 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/3700834745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9140b2cc0 0x7fd9140b6bf0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/3700834745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd91415de70 0x7fd9140b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 -- 172.21.15.5:0/3700834745 >> 172.21.15.5:0/3700834745 conn(0x7fd91406b000 msgr2=0x7fd91406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 -- 172.21.15.5:0/3700834745 shutdown_connections 2024-04-25T09:00:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.629+0000 7fd91b1b7640 1 -- 172.21.15.5:0/3700834745 wait complete. 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.630+0000 7fd91b1b7640 1 Processor -- start 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.630+0000 7fd91b1b7640 1 -- start start 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd91b1b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9140b2cc0 0x7fd9140c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd91b1b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9140b7130 0x7fd9140cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd91b1b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91415de70 0x7fd9140cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd91b1b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140cf080 con 0x7fd91415de70 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd91b1b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140cef00 con 0x7fd9140b7130 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd91b1b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140cf200 con 0x7fd9140b2cc0 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91415de70 0x7fd9140cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91415de70 0x7fd9140cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52916/0 (socket says 172.21.15.5:52916) 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 -- 172.21.15.5:0/2904829623 learned_addr learned my addr 172.21.15.5:0/2904829623 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd918f53640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9140b2cc0 0x7fd9140c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd913fff640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9140b7130 0x7fd9140cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 -- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9140b2cc0 msgr2=0x7fd9140c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9140b2cc0 0x7fd9140c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 -- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9140b7130 msgr2=0x7fd9140cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9140b7130 0x7fd9140cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 -- 172.21.15.5:0/2904829623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140c8c30 con 0x7fd91415de70 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd918f53640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9140b2cc0 0x7fd9140c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd913fff640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9140b7130 0x7fd9140cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.631+0000 7fd919754640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91415de70 0x7fd9140cae10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00c410 tx=0x7fd8fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.632+0000 7fd9117fa640 1 -- 172.21.15.5:0/2904829623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc011790 con 0x7fd91415de70 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.632+0000 7fd9117fa640 1 -- 172.21.15.5:0/2904829623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc017070 con 0x7fd91415de70 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.632+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9140c8f10 con 0x7fd91415de70 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.632+0000 7fd9117fa640 1 -- 172.21.15.5:0/2904829623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc011bb0 con 0x7fd91415de70 2024-04-25T09:00:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.632+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9140c94d0 con 0x7fd91415de70 2024-04-25T09:00:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.633+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91404ef20 con 0x7fd91415de70 2024-04-25T09:00:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.633+0000 7fd9117fa640 1 -- 172.21.15.5:0/2904829623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8fc01c460 con 0x7fd91415de70 2024-04-25T09:00:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.634+0000 7fd9117fa640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f406b4d0 0x7fd8f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.634+0000 7fd9117fa640 1 -- 172.21.15.5:0/2904829623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd8fc089eb0 con 0x7fd91415de70 2024-04-25T09:00:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.634+0000 7fd918f53640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f406b4d0 0x7fd8f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.634+0000 7fd918f53640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f406b4d0 0x7fd8f406d990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd9140ca620 tx=0x7fd90c0074b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.638+0000 7fd9117fa640 1 -- 172.21.15.5:0/2904829623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8fc021020 con 0x7fd91415de70 2024-04-25T09:00:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.855+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9140cf840 con 0x7fd91415de70 2024-04-25T09:00:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.855+0000 7fd9117fa640 1 -- 172.21.15.5:0/2904829623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fd8fc058c50 con 0x7fd91415de70 2024-04-25T09:00:49.844 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:49.845 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:30.278033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/1111822668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1111822668},{"type":"v1","addr":"172.21.15.5:6835","nonce":1111822668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 39 2024-04-25T09:00:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f406b4d0 msgr2=0x7fd8f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f406b4d0 0x7fd8f406d990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd9140ca620 tx=0x7fd90c0074b0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91415de70 msgr2=0x7fd9140cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91415de70 0x7fd9140cae10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00c410 tx=0x7fd8fc00c8d0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 shutdown_connections 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f406b4d0 0x7fd8f406d990 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91415de70 0x7fd9140cae10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9140b7130 0x7fd9140cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 --2- 172.21.15.5:0/2904829623 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9140b2cc0 0x7fd9140c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 >> 172.21.15.5:0/2904829623 conn(0x7fd91406b000 msgr2=0x7fd91415e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 shutdown_connections 2024-04-25T09:00:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.857+0000 7fd91b1b7640 1 -- 172.21.15.5:0/2904829623 wait complete. 2024-04-25T09:00:49.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.973+0000 7f26394bd640 1 Processor -- start 2024-04-25T09:00:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.973+0000 7f26394bd640 1 -- start start 2024-04-25T09:00:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26394bd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26340ce7f0 0x7f26340cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26394bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26340cf1c0 con 0x7f263415de70 2024-04-25T09:00:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26394bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26340d20e0 con 0x7f26340b2cc0 2024-04-25T09:00:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26394bd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26340d2a10 con 0x7f26340ce7f0 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f2632ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f263415de70 0x7f26340b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43446/0 (socket says 172.21.15.5:43446) 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f2632ffd640 1 -- 172.21.15.5:0/1857534070 learned_addr learned my addr 172.21.15.5:0/1857534070 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26337fe640 1 --2- 172.21.15.5:0/1857534070 >> v2:172.21.15.5:3300/0 conn(0x7f26340ce7f0 0x7f26340cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26337fe640 1 -- 172.21.15.5:0/1857534070 >> v1:172.21.15.80:6789/0 conn(0x7f26340b2cc0 legacy=0x7f26340b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26337fe640 1 -- 172.21.15.5:0/1857534070 >> v1:172.21.15.5:6789/0 conn(0x7f263415de70 legacy=0x7f26340b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f2631ffb640 1 -- 172.21.15.5:0/1857534070 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820732832 0 0) 0x7f26340cf1c0 con 0x7f263415de70 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.974+0000 7f26337fe640 1 -- 172.21.15.5:0/1857534070 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340d23c0 con 0x7f26340ce7f0 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.975+0000 7f26337fe640 1 --2- 172.21.15.5:0/1857534070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26340ce7f0 0x7f26340cec80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2624009d90 tx=0x7f262402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bd7b1180c23bae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.975+0000 7f2631ffb640 1 -- 172.21.15.5:0/1857534070 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624007740 con 0x7f26340ce7f0 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.975+0000 7f2631ffb640 1 -- 172.21.15.5:0/1857534070 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26240078e0 con 0x7f26340ce7f0 2024-04-25T09:00:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.975+0000 7f2631ffb640 1 -- 172.21.15.5:0/1857534070 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624007cb0 con 0x7f26340ce7f0 2024-04-25T09:00:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.976+0000 7f26394bd640 1 -- 172.21.15.5:0/1857534070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26340ce7f0 msgr2=0x7f26340cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.976+0000 7f26394bd640 1 --2- 172.21.15.5:0/1857534070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26340ce7f0 0x7f26340cec80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2624009d90 tx=0x7f262402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.976+0000 7f26394bd640 1 -- 172.21.15.5:0/1857534070 shutdown_connections 2024-04-25T09:00:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.976+0000 7f26394bd640 1 --2- 172.21.15.5:0/1857534070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26340ce7f0 0x7f26340cec80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.976+0000 7f26394bd640 1 -- 172.21.15.5:0/1857534070 >> 172.21.15.5:0/1857534070 conn(0x7f263406b000 msgr2=0x7f263406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.976+0000 7f26394bd640 1 -- 172.21.15.5:0/1857534070 shutdown_connections 2024-04-25T09:00:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.976+0000 7f26394bd640 1 -- 172.21.15.5:0/1857534070 wait complete. 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.977+0000 7f26394bd640 1 Processor -- start 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.977+0000 7f26394bd640 1 -- start start 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26394bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26340b2cc0 0x7f2634156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26394bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26340ce7f0 0x7f26340c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26394bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f263415de70 0x7f26340b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26394bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340d2ea0 con 0x7f263415de70 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26394bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340b7300 con 0x7f26340ce7f0 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26394bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26340d3020 con 0x7f26340b2cc0 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f263415de70 0x7f26340b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f263415de70 0x7f26340b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52934/0 (socket says 172.21.15.5:52934) 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 -- 172.21.15.5:0/1444343380 learned_addr learned my addr 172.21.15.5:0/1444343380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f2632ffd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26340b2cc0 0x7f2634156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26327fc640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26340ce7f0 0x7f26340c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 -- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26340b2cc0 msgr2=0x7f2634156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26340b2cc0 0x7f2634156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 -- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26340ce7f0 msgr2=0x7f26340c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26340ce7f0 0x7f26340c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 -- 172.21.15.5:0/1444343380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340b4860 con 0x7f263415de70 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f2632ffd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26340b2cc0 0x7f2634156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f26337fe640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f263415de70 0x7f26340b5900 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2624009eb0 tx=0x7f2624004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.978+0000 7f262b7fe640 1 -- 172.21.15.5:0/1444343380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624040070 con 0x7f263415de70 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.979+0000 7f262b7fe640 1 -- 172.21.15.5:0/1444343380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2624031c90 con 0x7f263415de70 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.979+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26340b4b40 con 0x7f263415de70 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.979+0000 7f262b7fe640 1 -- 172.21.15.5:0/1444343380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262403c640 con 0x7f263415de70 2024-04-25T09:00:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.979+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26340b5100 con 0x7f263415de70 2024-04-25T09:00:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.980+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263404ef20 con 0x7f263415de70 2024-04-25T09:00:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.980+0000 7f262b7fe640 1 -- 172.21.15.5:0/1444343380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2624039040 con 0x7f263415de70 2024-04-25T09:00:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.980+0000 7f262b7fe640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f261406b4d0 0x7f261406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.981+0000 7f262b7fe640 1 -- 172.21.15.5:0/1444343380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f26240ab7d0 con 0x7f263415de70 2024-04-25T09:00:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.981+0000 7f2632ffd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f261406b4d0 0x7f261406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.981+0000 7f2632ffd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f261406b4d0 0x7f261406d990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f262c000f60 tx=0x7f262c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:49.985+0000 7f262b7fe640 1 -- 172.21.15.5:0/1444343380 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f262407a740 con 0x7f263415de70 2024-04-25T09:00:50.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.205+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26340ce440 con 0x7f263415de70 2024-04-25T09:00:50.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.205+0000 7f262b7fe640 1 -- 172.21.15.5:0/1444343380 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f262407a040 con 0x7f263415de70 2024-04-25T09:00:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:50.195 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:00:06.554390+0000","modified":"2024-04-25T09:00:30.278033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/1111822668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1111822668},{"type":"v1","addr":"172.21.15.5:6835","nonce":1111822668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:00:50.195 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 39 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f261406b4d0 msgr2=0x7f261406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f261406b4d0 0x7f261406d990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f262c000f60 tx=0x7f262c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f263415de70 msgr2=0x7f26340b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f263415de70 0x7f26340b5900 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2624009eb0 tx=0x7f2624004a40 comp rx=0 tx=0).stop 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 shutdown_connections 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f261406b4d0 0x7f261406d990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f263415de70 0x7f26340b5900 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26340ce7f0 0x7f26340c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 --2- 172.21.15.5:0/1444343380 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26340b2cc0 0x7f2634156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.207+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 >> 172.21.15.5:0/1444343380 conn(0x7f263406b000 msgr2=0x7f263415e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.208+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 shutdown_connections 2024-04-25T09:00:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.208+0000 7f26394bd640 1 -- 172.21.15.5:0/1444343380 wait complete. 2024-04-25T09:00:50.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.322+0000 7fcabbc2a640 1 Processor -- start 2024-04-25T09:00:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcabbc2a640 1 -- start start 2024-04-25T09:00:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcabbc2a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcabbc2a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcab40b0e30 0x7fcab40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcabbc2a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcab40cbf40 0x7fcab40d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcabbc2a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab406b800 con 0x7fcab40b0e30 2024-04-25T09:00:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcabbc2a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab406ba50 con 0x7fcab40cbf40 2024-04-25T09:00:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcabbc2a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab406bd30 con 0x7fcab40b0a50 2024-04-25T09:00:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.323+0000 7fcab91c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcab40b0e30 0x7fcab40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab91c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcab40b0e30 0x7fcab40ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52940/0 (socket says 172.21.15.5:52940) 2024-04-25T09:00:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab91c5640 1 -- 172.21.15.5:0/266299115 learned_addr learned my addr 172.21.15.5:0/266299115 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:50.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcaba1c7640 1 --2- 172.21.15.5:0/266299115 >> v2:172.21.15.80:3300/0 conn(0x7fcab40cbf40 0x7fcab40d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab99c6640 1 --2- 172.21.15.5:0/266299115 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab91c5640 1 -- 172.21.15.5:0/266299115 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 msgr2=0x7fcab40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab91c5640 1 --2- 172.21.15.5:0/266299115 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab91c5640 1 -- 172.21.15.5:0/266299115 >> v2:172.21.15.80:3300/0 conn(0x7fcab40cbf40 msgr2=0x7fcab40d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab91c5640 1 --2- 172.21.15.5:0/266299115 >> v2:172.21.15.80:3300/0 conn(0x7fcab40cbf40 0x7fcab40d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.324+0000 7fcab91c5640 1 -- 172.21.15.5:0/266299115 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab406c010 con 0x7fcab40b0e30 2024-04-25T09:00:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcab91c5640 1 --2- 172.21.15.5:0/266299115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab40ce740 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcab4067890 tx=0x7fcaa402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8e5be11a2c5939 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcab89c4640 1 -- 172.21.15.5:0/266299115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4037070 con 0x7fcab40b0e30 2024-04-25T09:00:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcab89c4640 1 -- 172.21.15.5:0/266299115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4032440 con 0x7fcab40b0e30 2024-04-25T09:00:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcab89c4640 1 -- 172.21.15.5:0/266299115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4032810 con 0x7fcab40b0e30 2024-04-25T09:00:50.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 -- 172.21.15.5:0/266299115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 msgr2=0x7fcab40ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/266299115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab40ce740 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcab4067890 tx=0x7fcaa402a140 comp rx=0 tx=0).stop 2024-04-25T09:00:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 -- 172.21.15.5:0/266299115 shutdown_connections 2024-04-25T09:00:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/266299115 >> v2:172.21.15.80:3300/0 conn(0x7fcab40cbf40 0x7fcab40d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/266299115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab40ce740 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/266299115 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 -- 172.21.15.5:0/266299115 >> 172.21.15.5:0/266299115 conn(0x7fcab40d18f0 msgr2=0x7fcab40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:50.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 -- 172.21.15.5:0/266299115 shutdown_connections 2024-04-25T09:00:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.325+0000 7fcabbc2a640 1 -- 172.21.15.5:0/266299115 wait complete. 2024-04-25T09:00:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.326+0000 7fcabbc2a640 1 Processor -- start 2024-04-25T09:00:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcabbc2a640 1 -- start start 2024-04-25T09:00:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcabbc2a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcabbc2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab41606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcabbc2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcab40cbf40 0x7fcab4160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcabbc2a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab40b2bf0 con 0x7fcab40b0e30 2024-04-25T09:00:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcabbc2a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab40cfd60 con 0x7fcab40cbf40 2024-04-25T09:00:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcabbc2a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab415f360 con 0x7fcab40b0a50 2024-04-25T09:00:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcab91c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab41606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcab91c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab41606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52950/0 (socket says 172.21.15.5:52950) 2024-04-25T09:00:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcab91c5640 1 -- 172.21.15.5:0/4075669423 learned_addr learned my addr 172.21.15.5:0/4075669423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcab99c6640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.327+0000 7fcaba1c7640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcab40cbf40 0x7fcab4160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcab91c5640 1 -- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 msgr2=0x7fcab414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcab91c5640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab414ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcab91c5640 1 -- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcab40cbf40 msgr2=0x7fcab4160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcab91c5640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcab40cbf40 0x7fcab4160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcab91c5640 1 -- 172.21.15.5:0/4075669423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab415f640 con 0x7fcab40b0e30 2024-04-25T09:00:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcab91c5640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab41606d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fcaa402a180 tx=0x7fcaa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcaaa7fc640 1 -- 172.21.15.5:0/4075669423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4041020 con 0x7fcab40b0e30 2024-04-25T09:00:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcaaa7fc640 1 -- 172.21.15.5:0/4075669423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa403d620 con 0x7fcab40b0e30 2024-04-25T09:00:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab415f920 con 0x7fcab40b0e30 2024-04-25T09:00:50.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcaaa7fc640 1 -- 172.21.15.5:0/4075669423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4037040 con 0x7fcab40b0e30 2024-04-25T09:00:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.328+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab414f230 con 0x7fcab40b0e30 2024-04-25T09:00:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.329+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab406cd70 con 0x7fcab40b0e30 2024-04-25T09:00:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.329+0000 7fcaaa7fc640 1 -- 172.21.15.5:0/4075669423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcaa4044020 con 0x7fcab40b0e30 2024-04-25T09:00:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.330+0000 7fcaaa7fc640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9806b4d0 0x7fca9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.330+0000 7fcaaa7fc640 1 -- 172.21.15.5:0/4075669423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcaa40aa7d0 con 0x7fcab40b0e30 2024-04-25T09:00:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.330+0000 7fcab99c6640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9806b4d0 0x7fca9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.331+0000 7fcab99c6640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9806b4d0 0x7fca9806d990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009b40 tx=0x7fcab0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.334+0000 7fcaaa7fc640 1 -- 172.21.15.5:0/4075669423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcaa404b030 con 0x7fcab40b0e30 2024-04-25T09:00:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.515+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcab404ef20 con 0x7fcab40b0e30 2024-04-25T09:00:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.516+0000 7fcaaa7fc640 1 -- 172.21.15.5:0/4075669423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16710 (secure 0 0 0) 0x7fcaa40790c0 con 0x7fcab40b0e30 2024-04-25T09:00:50.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:50.505 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:27.259335+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:04.844156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:00:05.534669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6836/3464170028":"2024-04-26T09:00:27.259301+0000","172.21.15.80:6834/3464170028":"2024-04-26T09:00:27.259301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9806b4d0 msgr2=0x7fca9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9806b4d0 0x7fca9806d990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009b40 tx=0x7fcab0009190 comp rx=0 tx=0).stop 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 msgr2=0x7fcab41606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab41606d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fcaa402a180 tx=0x7fcaa40046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 shutdown_connections 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9806b4d0 0x7fca9806d990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcab40cbf40 0x7fcab4160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab40b0e30 0x7fcab41606d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 --2- 172.21.15.5:0/4075669423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcab40b0a50 0x7fcab414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 >> 172.21.15.5:0/4075669423 conn(0x7fcab40d18f0 msgr2=0x7fcab4068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 shutdown_connections 2024-04-25T09:00:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.518+0000 7fcabbc2a640 1 -- 172.21.15.5:0/4075669423 wait complete. 2024-04-25T09:00:50.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:00:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.632+0000 7fa261df5640 1 Processor -- start 2024-04-25T09:00:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.632+0000 7fa261df5640 1 -- start start 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa261df5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa25c0ce910 0x7fa25c168b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa261df5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c06ba50 con 0x7fa25c0b0a50 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa261df5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c06bd30 con 0x7fa25c0b0e30 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa261df5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c06b800 con 0x7fa25c0ce910 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa25c0b0a50 0x7fa25c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43462/0 (socket says 172.21.15.5:43462) 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25b7fe640 1 -- 172.21.15.5:0/2365991627 learned_addr learned my addr 172.21.15.5:0/2365991627 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369242897 0 0) 0x7fa25c06ba50 con 0x7fa25c0b0a50 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25bfff640 1 --2- 172.21.15.5:0/2365991627 >> v2:172.21.15.80:3300/0 conn(0x7fa25c0ce910 0x7fa25c168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa244003520 con 0x7fa25c0b0a50 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375918463 0 0) 0x7fa244003520 con 0x7fa25c0b0a50 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 >> v2:172.21.15.80:3300/0 conn(0x7fa25c0ce910 msgr2=0x7fa25c168b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 --2- 172.21.15.5:0/2365991627 >> v2:172.21.15.80:3300/0 conn(0x7fa25c0ce910 0x7fa25c168b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 >> v1:172.21.15.80:6789/0 conn(0x7fa25c0b0e30 legacy=0x7fa25c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c06c010 con 0x7fa25c0b0a50 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fa24c001670 con 0x7fa25c0b0a50 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 >> v1:172.21.15.5:6789/0 conn(0x7fa25c0b0a50 legacy=0x7fa25c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2440039b0 0x7fa244003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa244004800 0x7fa244004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2440051c0 0x7fa24400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c06b800 con 0x7fa244004800 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400c160 con 0x7fa2440039b0 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400c360 con 0x7fa2440051c0 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.633+0000 7fa25affd640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa244004800 0x7fa244004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25b7fe640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2440039b0 0x7fa244003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25bfff640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2440051c0 0x7fa24400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25affd640 1 -- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2440051c0 msgr2=0x7fa24400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25affd640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa2440051c0 0x7fa24400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25affd640 1 -- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2440039b0 msgr2=0x7fa244003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25affd640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2440039b0 0x7fa244003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25affd640 1 -- 172.21.15.5:0/2365991627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244003520 con 0x7fa244004800 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25bfff640 1 -- 172.21.15.5:0/2365991627 reap_dead start 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.634+0000 7fa25affd640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa244004800 0x7fa244004c80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa25c161ab0 tx=0x7fa244005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb7a4c6fa6a36ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250001370 con 0x7fa244004800 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2500052d0 con 0x7fa244004800 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa25a7fc640 1 -- 172.21.15.5:0/2365991627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25002ab70 con 0x7fa244004800 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa261df5640 1 -- 172.21.15.5:0/2365991627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa244004800 msgr2=0x7fa244004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa261df5640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa244004800 0x7fa244004c80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa25c161ab0 tx=0x7fa244005830 comp rx=0 tx=0).stop 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa261df5640 1 -- 172.21.15.5:0/2365991627 shutdown_connections 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa261df5640 1 --2- 172.21.15.5:0/2365991627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa244004800 0x7fa244004c80 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa261df5640 1 -- 172.21.15.5:0/2365991627 >> 172.21.15.5:0/2365991627 conn(0x7fa25c0d18f0 msgr2=0x7fa25c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:50.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa261df5640 1 -- 172.21.15.5:0/2365991627 shutdown_connections 2024-04-25T09:00:50.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.635+0000 7fa261df5640 1 -- 172.21.15.5:0/2365991627 wait complete. 2024-04-25T09:00:50.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.636+0000 7fa261df5640 1 Processor -- start 2024-04-25T09:00:50.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa261df5640 1 -- start start 2024-04-25T09:00:50.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa261df5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa244004800 0x7fa25c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa261df5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25c0c63a0 0x7fa25c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa261df5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa25c0c8c30 0x7fa25c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa261df5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0b2bf0 con 0x7fa25c0c63a0 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa261df5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0cfd60 con 0x7fa25c0c8c30 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa261df5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0c74b0 con 0x7fa244004800 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa25affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25c0c63a0 0x7fa25c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa25affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25c0c63a0 0x7fa25c0cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52964/0 (socket says 172.21.15.5:52964) 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.637+0000 7fa25affd640 1 -- 172.21.15.5:0/635668152 learned_addr learned my addr 172.21.15.5:0/635668152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25b7fe640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa244004800 0x7fa25c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25bfff640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa25c0c8c30 0x7fa25c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25affd640 1 -- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa244004800 msgr2=0x7fa25c0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25affd640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa244004800 0x7fa25c0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25affd640 1 -- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa25c0c8c30 msgr2=0x7fa25c14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25affd640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa25c0c8c30 0x7fa25c14fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25affd640 1 -- 172.21.15.5:0/635668152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c0c68a0 con 0x7fa25c0c63a0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa25affd640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25c0c63a0 0x7fa25c0cb4a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa250001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa243fff640 1 -- 172.21.15.5:0/635668152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25003f030 con 0x7fa25c0c63a0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa243fff640 1 -- 172.21.15.5:0/635668152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250005480 con 0x7fa25c0c63a0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c0c6b80 con 0x7fa25c0c63a0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa243fff640 1 -- 172.21.15.5:0/635668152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250037040 con 0x7fa25c0c63a0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.638+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c0c7140 con 0x7fa25c0c63a0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.639+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c0cf900 con 0x7fa25c0c63a0 2024-04-25T09:00:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.640+0000 7fa243fff640 1 -- 172.21.15.5:0/635668152 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa250042070 con 0x7fa25c0c63a0 2024-04-25T09:00:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.640+0000 7fa243fff640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa24806b4d0 0x7fa24806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.640+0000 7fa243fff640 1 -- 172.21.15.5:0/635668152 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa2500a9810 con 0x7fa25c0c63a0 2024-04-25T09:00:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.640+0000 7fa25b7fe640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa24806b4d0 0x7fa24806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.641+0000 7fa25b7fe640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa24806b4d0 0x7fa24806d990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0011e0 tx=0x7fa24c000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.644+0000 7fa243fff640 1 -- 172.21.15.5:0/635668152 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa25c0cf900 con 0x7fa25c0c63a0 2024-04-25T09:00:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.868+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa25c04ef20 con 0x7fa25c0c63a0 2024-04-25T09:00:50.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:00:50.868+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:00:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.870+0000 7fa243fff640 1 -- 172.21.15.5:0/635668152 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa250049070 con 0x7fa25c0c63a0 2024-04-25T09:00:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa24806b4d0 msgr2=0x7fa24806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa24806b4d0 0x7fa24806d990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0011e0 tx=0x7fa24c000ed0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25c0c63a0 msgr2=0x7fa25c0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25c0c63a0 0x7fa25c0cb4a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa250001120 comp rx=0 tx=0).stop 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 shutdown_connections 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa24806b4d0 0x7fa24806d990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa25c0c8c30 0x7fa25c14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25c0c63a0 0x7fa25c0cb4a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 --2- 172.21.15.5:0/635668152 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa244004800 0x7fa25c0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 >> 172.21.15.5:0/635668152 conn(0x7fa25c0d18f0 msgr2=0x7fa25c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:50.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 shutdown_connections 2024-04-25T09:00:50.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.872+0000 7fa261df5640 1 -- 172.21.15.5:0/635668152 wait complete. 2024-04-25T09:00:50.863 INFO:tasks.ceph.mds.a.smithi005.stderr: -2349> 2024-04-25T09:00:34.268+0000 7f8896873640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:00:50.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:00:50.891 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:00:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.988+0000 7f4efe7cf640 1 Processor -- start 2024-04-25T09:00:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.989+0000 7f4efe7cf640 1 -- start start 2024-04-25T09:00:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.989+0000 7f4efe7cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ef80cd6e0 0x7f4ef80d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.989+0000 7f4efe7cf640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80cc530 con 0x7f4ef8160540 2024-04-25T09:00:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.989+0000 7f4efe7cf640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80d0930 con 0x7f4ef815f1b0 2024-04-25T09:00:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.989+0000 7f4efe7cf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80d0370 con 0x7f4ef80cd6e0 2024-04-25T09:00:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.990+0000 7f4efcd6c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ef80cd6e0 0x7f4ef80d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.990+0000 7f4ef77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ef8160540 0x7f4ef80ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52088/0 (socket says 172.21.15.5:52088) 2024-04-25T09:00:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.990+0000 7f4ef77fe640 1 -- 172.21.15.5:0/3206195295 learned_addr learned my addr 172.21.15.5:0/3206195295 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.990+0000 7f4efcd6c640 1 -- 172.21.15.5:0/3206195295 >> v1:172.21.15.80:6789/0 conn(0x7f4ef815f1b0 legacy=0x7f4ef80b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.990+0000 7f4efcd6c640 1 -- 172.21.15.5:0/3206195295 >> v1:172.21.15.5:6789/0 conn(0x7f4ef8160540 legacy=0x7f4ef80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.990+0000 7f4efcd6c640 1 -- 172.21.15.5:0/3206195295 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80d0650 con 0x7f4ef80cd6e0 2024-04-25T09:00:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.990+0000 7f4ef6ffd640 1 -- 172.21.15.5:0/3206195295 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650643733 0 0) 0x7f4ef80cc530 con 0x7f4ef8160540 2024-04-25T09:00:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efcd6c640 1 --2- 172.21.15.5:0/3206195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef80d2540 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009d90 tx=0x7f4ef002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb102fb6bb1bf181 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4ef6ffd640 1 -- 172.21.15.5:0/3206195295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0007740 con 0x7f4ef80cd6e0 2024-04-25T09:00:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4ef6ffd640 1 -- 172.21.15.5:0/3206195295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef00078e0 con 0x7f4ef80cd6e0 2024-04-25T09:00:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4ef6ffd640 1 -- 172.21.15.5:0/3206195295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0007cb0 con 0x7f4ef80cd6e0 2024-04-25T09:00:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3206195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef80cd6e0 msgr2=0x7f4ef80d2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3206195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef80d2540 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009d90 tx=0x7f4ef002a730 comp rx=0 tx=0).stop 2024-04-25T09:00:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3206195295 shutdown_connections 2024-04-25T09:00:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3206195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef80d2540 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3206195295 >> 172.21.15.5:0/3206195295 conn(0x7f4ef80d1a20 msgr2=0x7f4ef80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3206195295 shutdown_connections 2024-04-25T09:00:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.991+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3206195295 wait complete. 2024-04-25T09:00:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 Processor -- start 2024-04-25T09:00:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 -- start start 2024-04-25T09:00:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef8156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef815f1b0 0x7f4ef80c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ef8160540 0x7f4ef81f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b4f80 con 0x7f4ef815f1b0 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80ccab0 con 0x7f4ef80cd6e0 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.993+0000 7f4efe7cf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80d0000 con 0x7f4ef8160540 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef815f1b0 0x7f4ef80c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef815f1b0 0x7f4ef80c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55270/0 (socket says 172.21.15.5:55270) 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 -- 172.21.15.5:0/3408091054 learned_addr learned my addr 172.21.15.5:0/3408091054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4efcd6c640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ef8160540 0x7f4ef81f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef7fff640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef8156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 -- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ef8160540 msgr2=0x7f4ef81f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ef8160540 0x7f4ef81f14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 -- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef80cd6e0 msgr2=0x7f4ef8156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef8156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 -- 172.21.15.5:0/3408091054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef81f1f00 con 0x7f4ef815f1b0 2024-04-25T09:00:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef7fff640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef8156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef77fe640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef815f1b0 0x7f4ef80c5e80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c3f0 tx=0x7f4ee800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef4ff9640 1 -- 172.21.15.5:0/3408091054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80074e0 con 0x7f4ef815f1b0 2024-04-25T09:00:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef4ff9640 1 -- 172.21.15.5:0/3408091054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee80047e0 con 0x7f4ef815f1b0 2024-04-25T09:00:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef81f21e0 con 0x7f4ef815f1b0 2024-04-25T09:00:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4ef4ff9640 1 -- 172.21.15.5:0/3408091054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8004bd0 con 0x7f4ef815f1b0 2024-04-25T09:00:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.994+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80c5960 con 0x7f4ef815f1b0 2024-04-25T09:00:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.995+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef804ef20 con 0x7f4ef815f1b0 2024-04-25T09:00:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.996+0000 7f4ef4ff9640 1 -- 172.21.15.5:0/3408091054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ee8011070 con 0x7f4ef815f1b0 2024-04-25T09:00:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.996+0000 7f4ef4ff9640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4ed806b4d0 0x7f4ed806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.996+0000 7f4ef4ff9640 1 -- 172.21.15.5:0/3408091054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f4ee8089e50 con 0x7f4ef815f1b0 2024-04-25T09:00:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.996+0000 7f4ef7fff640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4ed806b4d0 0x7f4ed806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:50.997+0000 7f4ef7fff640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4ed806b4d0 0x7f4ed806d990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80c8550 tx=0x7f4ee0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.000+0000 7f4ef4ff9640 1 -- 172.21.15.5:0/3408091054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ee8058c10 con 0x7f4ef815f1b0 2024-04-25T09:00:51.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.220+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4ef80b79a0 con 0x7f4ef815f1b0 2024-04-25T09:00:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.871+0000 7f4ef4ff9640 1 -- 172.21.15.5:0/3408091054 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ee8058510 con 0x7f4ef815f1b0 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4ed806b4d0 msgr2=0x7f4ed806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4ed806b4d0 0x7f4ed806d990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80c8550 tx=0x7f4ee0009040 comp rx=0 tx=0).stop 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef815f1b0 msgr2=0x7f4ef80c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef815f1b0 0x7f4ef80c5e80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c3f0 tx=0x7f4ee800c8b0 comp rx=0 tx=0).stop 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 shutdown_connections 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4ed806b4d0 0x7f4ed806d990 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ef8160540 0x7f4ef81f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef815f1b0 0x7f4ef80c5e80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 --2- 172.21.15.5:0/3408091054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef80cd6e0 0x7f4ef8156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.874+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 >> 172.21.15.5:0/3408091054 conn(0x7f4ef80d1a20 msgr2=0x7f4ef80ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.875+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 shutdown_connections 2024-04-25T09:00:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:51.875+0000 7f4efe7cf640 1 -- 172.21.15.5:0/3408091054 wait complete. 2024-04-25T09:00:51.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:00:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.042+0000 7ff7085f4640 1 Processor -- start 2024-04-25T09:00:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.042+0000 7ff7085f4640 1 -- start start 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff7085f4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 0x7ff700161970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff7085f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000b0e80 con 0x7ff70015dc50 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff7085f4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70006be20 con 0x7ff700162530 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff7085f4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000b1120 con 0x7ff70015e030 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff706390640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff70015dc50 0x7ff70006b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52094/0 (socket says 172.21.15.5:52094) 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff706390640 1 -- 172.21.15.5:0/4046104856 learned_addr learned my addr 172.21.15.5:0/4046104856 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff705b8f640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 0x7ff700161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952766047 0 0) 0x7ff7000b0e80 con 0x7ff70015dc50 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ec003520 con 0x7ff70015dc50 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245876871 0 0) 0x7ff6ec003520 con 0x7ff70015dc50 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 msgr2=0x7ff700161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 0x7ff700161970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 >> v1:172.21.15.80:6789/0 conn(0x7ff700162530 legacy=0x7ff7000b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000b1400 con 0x7ff70015dc50 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.043+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7ff6fc001670 con 0x7ff70015dc50 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 >> v1:172.21.15.5:6789/0 conn(0x7ff70015dc50 legacy=0x7ff70006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff70538e640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 0x7ff6ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff70538e640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff6ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff70538e640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec004d40 0x7ff6ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000b1120 con 0x7ff6ec003f60 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00baa0 con 0x7ff6ec004d40 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00bca0 con 0x7ff70015e030 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff705b8f640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff6ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff706390640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 0x7ff6ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff706b91640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec004d40 0x7ff6ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff705b8f640 1 -- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 msgr2=0x7ff6ec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff705b8f640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70015e030 0x7ff6ec0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff705b8f640 1 -- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec004d40 msgr2=0x7ff6ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff705b8f640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec004d40 0x7ff6ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.044+0000 7ff705b8f640 1 -- 172.21.15.5:0/4046104856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec003520 con 0x7ff6ec003f60 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.045+0000 7ff705b8f640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff6ec004800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009ac0 tx=0x7ff6ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32c7f1a4feab643 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.045+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0036070 con 0x7ff6ec003f60 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.045+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0031400 con 0x7ff6ec003f60 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.045+0000 7ff70538e640 1 -- 172.21.15.5:0/4046104856 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0009690 con 0x7ff6ec003f60 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.045+0000 7ff7085f4640 1 -- 172.21.15.5:0/4046104856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 msgr2=0x7ff6ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.045+0000 7ff7085f4640 1 --2- 172.21.15.5:0/4046104856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff6ec004800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009ac0 tx=0x7ff6ec005830 comp rx=0 tx=0).stop 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.045+0000 7ff706b91640 1 -- 172.21.15.5:0/4046104856 reap_dead start 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.046+0000 7ff7085f4640 1 -- 172.21.15.5:0/4046104856 shutdown_connections 2024-04-25T09:00:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.046+0000 7ff7085f4640 1 -- 172.21.15.5:0/4046104856 >> 172.21.15.5:0/4046104856 conn(0x7ff7000b34a0 msgr2=0x7ff7000b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:52.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.046+0000 7ff7085f4640 1 -- 172.21.15.5:0/4046104856 shutdown_connections 2024-04-25T09:00:52.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.046+0000 7ff7085f4640 1 -- 172.21.15.5:0/4046104856 wait complete. 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.047+0000 7ff7085f4640 1 Processor -- start 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.047+0000 7ff7085f4640 1 -- start start 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff7001f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7001f3bb0 0x7ff7000c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b45b0 0x7ff7001f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff700161af0 con 0x7ff6ec003f60 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff700161970 con 0x7ff7001f3bb0 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff700161c70 con 0x7ff7000b45b0 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff7001f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff7001f8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55282/0 (socket says 172.21.15.5:55282) 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 -- 172.21.15.5:0/613116587 learned_addr learned my addr 172.21.15.5:0/613116587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:52.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff705b8f640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7001f3bb0 0x7ff7000c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706b91640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b45b0 0x7ff7001f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 -- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b45b0 msgr2=0x7ff7001f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b45b0 0x7ff7001f7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 -- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7001f3bb0 msgr2=0x7ff7000c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7001f3bb0 0x7ff7000c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 -- 172.21.15.5:0/613116587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000c7fd0 con 0x7ff6ec003f60 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff705b8f640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7001f3bb0 0x7ff7000c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706b91640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b45b0 0x7ff7001f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff706390640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff7001f8100 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0072f0 tx=0x7ff6fc0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/613116587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00f8e0 con 0x7ff6ec003f60 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/613116587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc018070 con 0x7ff6ec003f60 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7000c82b0 con 0x7ff6ec003f60 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/613116587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00fcc0 con 0x7ff6ec003f60 2024-04-25T09:00:52.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.048+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7000b73a0 con 0x7ff6ec003f60 2024-04-25T09:00:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.050+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70015d490 con 0x7ff6ec003f60 2024-04-25T09:00:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.050+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/613116587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff6fc01c410 con 0x7ff6ec003f60 2024-04-25T09:00:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.050+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b500 0x7ff6e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.050+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/613116587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff6fc089f10 con 0x7ff6ec003f60 2024-04-25T09:00:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.051+0000 7ff705b8f640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b500 0x7ff6e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.051+0000 7ff705b8f640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b500 0x7ff6e406d9c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0033000 tx=0x7ff6f0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:52.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.055+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/613116587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff70015d490 con 0x7ff6ec003f60 2024-04-25T09:00:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.233+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff70004ef20 con 0x7ff6ec003f60 2024-04-25T09:00:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.873+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/613116587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff6fc00fe60 con 0x7ff6ec003f60 2024-04-25T09:00:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:00:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.876+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b500 msgr2=0x7ff6e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.876+0000 7ff7085f4640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b500 0x7ff6e406d9c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0033000 tx=0x7ff6f0008030 comp rx=0 tx=0).stop 2024-04-25T09:00:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.876+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 msgr2=0x7ff7001f8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.876+0000 7ff7085f4640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff7001f8100 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0072f0 tx=0x7ff6fc0077b0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 shutdown_connections 2024-04-25T09:00:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e406b500 0x7ff6e406d9c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7000b45b0 0x7ff7001f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7001f3bb0 0x7ff7000c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 --2- 172.21.15.5:0/613116587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003f60 0x7ff7001f8100 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 >> 172.21.15.5:0/613116587 conn(0x7ff7000b34a0 msgr2=0x7ff70015bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:52.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 shutdown_connections 2024-04-25T09:00:52.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:52.877+0000 7ff7085f4640 1 -- 172.21.15.5:0/613116587 wait complete. 2024-04-25T09:00:52.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:00:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.001+0000 7fc791eac640 1 Processor -- start 2024-04-25T09:00:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.001+0000 7fc791eac640 1 -- start start 2024-04-25T09:00:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc791eac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c15dbd0 0x7fc78c1617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc791eac640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc78c0b9470 0x7fc78c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc791eac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c162070 con 0x7fc78c0cecf0 2024-04-25T09:00:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc791eac640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c0cf160 con 0x7fc78c0b9470 2024-04-25T09:00:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc791eac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c162350 con 0x7fc78c15dbd0 2024-04-25T09:00:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc78b7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c15dbd0 0x7fc78c1617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc78affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc78c0b9470 0x7fc78c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc78affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc78c0b9470 0x7fc78c0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:57236/0 (socket says 172.21.15.5:57236) 2024-04-25T09:00:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc78affd640 1 -- 172.21.15.5:0/2787067589 learned_addr learned my addr 172.21.15.5:0/2787067589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.002+0000 7fc78bfff640 1 --1- 172.21.15.5:0/2787067589 >> v1:172.21.15.80:6789/0 conn(0x7fc78c0cecf0 0x7fc78c0b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:52612/0 (socket says 172.21.15.5:52612) 2024-04-25T09:00:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78a7fc640 1 -- 172.21.15.5:0/2787067589 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240433526 0 0) 0x7fc78c162070 con 0x7fc78c0cecf0 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78a7fc640 1 -- 172.21.15.5:0/2787067589 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc774003520 con 0x7fc78c0cecf0 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78b7fe640 1 -- 172.21.15.5:0/2787067589 >> v2:172.21.15.80:3300/0 conn(0x7fc78c0b9470 msgr2=0x7fc78c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78b7fe640 1 --2- 172.21.15.5:0/2787067589 >> v2:172.21.15.80:3300/0 conn(0x7fc78c0b9470 0x7fc78c0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78b7fe640 1 -- 172.21.15.5:0/2787067589 >> v1:172.21.15.80:6789/0 conn(0x7fc78c0cecf0 legacy=0x7fc78c0b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78b7fe640 1 -- 172.21.15.5:0/2787067589 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0d1c50 con 0x7fc78c15dbd0 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78affd640 1 --2- 172.21.15.5:0/2787067589 >> v2:172.21.15.80:3300/0 conn(0x7fc78c0b9470 0x7fc78c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.003+0000 7fc78b7fe640 1 --2- 172.21.15.5:0/2787067589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c15dbd0 0x7fc78c1617b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0097a0 tx=0x7fc77c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b454957b68f4701 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc78a7fc640 1 -- 172.21.15.5:0/2787067589 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c037070 con 0x7fc78c15dbd0 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc78a7fc640 1 -- 172.21.15.5:0/2787067589 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c032440 con 0x7fc78c15dbd0 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc78a7fc640 1 -- 172.21.15.5:0/2787067589 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0327f0 con 0x7fc78c15dbd0 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 -- 172.21.15.5:0/2787067589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c15dbd0 msgr2=0x7fc78c1617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 --2- 172.21.15.5:0/2787067589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c15dbd0 0x7fc78c1617b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0097a0 tx=0x7fc77c02a180 comp rx=0 tx=0).stop 2024-04-25T09:00:52.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 -- 172.21.15.5:0/2787067589 shutdown_connections 2024-04-25T09:00:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 --2- 172.21.15.5:0/2787067589 >> v2:172.21.15.80:3300/0 conn(0x7fc78c0b9470 0x7fc78c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 --2- 172.21.15.5:0/2787067589 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c15dbd0 0x7fc78c1617b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 -- 172.21.15.5:0/2787067589 >> 172.21.15.5:0/2787067589 conn(0x7fc78c066ad0 msgr2=0x7fc78c066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 -- 172.21.15.5:0/2787067589 shutdown_connections 2024-04-25T09:00:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.004+0000 7fc791eac640 1 -- 172.21.15.5:0/2787067589 wait complete. 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.005+0000 7fc791eac640 1 Processor -- start 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.006+0000 7fc791eac640 1 -- start start 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.006+0000 7fc791eac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c0b9470 0x7fc78c15e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.006+0000 7fc791eac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc78c0cecf0 0x7fc78c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.006+0000 7fc791eac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c15dbd0 0x7fc78c15ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.006+0000 7fc791eac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c161cf0 con 0x7fc78c15dbd0 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.006+0000 7fc791eac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c162630 con 0x7fc78c0cecf0 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.006+0000 7fc791eac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c15dfb0 con 0x7fc78c0b9470 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c15dbd0 0x7fc78c15ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c15dbd0 0x7fc78c15ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55288/0 (socket says 172.21.15.5:55288) 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 -- 172.21.15.5:0/545505734 learned_addr learned my addr 172.21.15.5:0/545505734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78b7fe640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c0b9470 0x7fc78c15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78affd640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc78c0cecf0 0x7fc78c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 -- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c0b9470 msgr2=0x7fc78c15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c0b9470 0x7fc78c15e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 -- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc78c0cecf0 msgr2=0x7fc78c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc78c0cecf0 0x7fc78c0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 -- 172.21.15.5:0/545505734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0cdb00 con 0x7fc78c15dbd0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78affd640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc78c0cecf0 0x7fc78c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78b7fe640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c0b9470 0x7fc78c15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc78bfff640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c15dbd0 0x7fc78c15ff40 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc78400c7f0 tx=0x7fc78400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc773fff640 1 -- 172.21.15.5:0/545505734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784017070 con 0x7fc78c15dbd0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc773fff640 1 -- 172.21.15.5:0/545505734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400a640 con 0x7fc78c15dbd0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc773fff640 1 -- 172.21.15.5:0/545505734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400aa10 con 0x7fc78c15dbd0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c0b6180 con 0x7fc78c15dbd0 2024-04-25T09:00:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.007+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c0b58e0 con 0x7fc78c15dbd0 2024-04-25T09:00:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.008+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c04ef20 con 0x7fc78c15dbd0 2024-04-25T09:00:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.009+0000 7fc773fff640 1 -- 172.21.15.5:0/545505734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc78401a070 con 0x7fc78c15dbd0 2024-04-25T09:00:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.009+0000 7fc773fff640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc77806b4d0 0x7fc77806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.009+0000 7fc773fff640 1 -- 172.21.15.5:0/545505734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5443+0+0 (secure 0 0 0) 0x7fc784089710 con 0x7fc78c15dbd0 2024-04-25T09:00:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.009+0000 7fc78b7fe640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc77806b4d0 0x7fc77806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.010+0000 7fc78b7fe640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc77806b4d0 0x7fc77806d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc77c034000 tx=0x7fc77c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.013+0000 7fc773fff640 1 -- 172.21.15.5:0/545505734 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc78c0cdb00 con 0x7fc78c15dbd0 2024-04-25T09:00:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.198+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc78c0d1760 con 0x7fc78c15dbd0 2024-04-25T09:00:53.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.874+0000 7fc773fff640 1 -- 172.21.15.5:0/545505734 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc784058720 con 0x7fc78c15dbd0 2024-04-25T09:00:53.864 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T09:00:53.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.880+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc77806b4d0 msgr2=0x7fc77806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:53.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.880+0000 7fc791eac640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc77806b4d0 0x7fc77806d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc77c034000 tx=0x7fc77c02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:53.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.880+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c15dbd0 msgr2=0x7fc78c15ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:53.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.880+0000 7fc791eac640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c15dbd0 0x7fc78c15ff40 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc78400c7f0 tx=0x7fc78400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.881+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 shutdown_connections 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.881+0000 7fc791eac640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc77806b4d0 0x7fc77806d990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.881+0000 7fc791eac640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc78c15dbd0 0x7fc78c15ff40 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.881+0000 7fc791eac640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc78c0cecf0 0x7fc78c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.881+0000 7fc791eac640 1 --2- 172.21.15.5:0/545505734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc78c0b9470 0x7fc78c15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.881+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 >> 172.21.15.5:0/545505734 conn(0x7fc78c066ad0 msgr2=0x7fc78c0b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.881+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 shutdown_connections 2024-04-25T09:00:53.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:53.882+0000 7fc791eac640 1 -- 172.21.15.5:0/545505734 wait complete. 2024-04-25T09:00:53.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:00:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.007+0000 7f763c30a640 1 Processor -- start 2024-04-25T09:00:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.007+0000 7f763c30a640 1 -- start start 2024-04-25T09:00:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.008+0000 7f763c30a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f763415de80 0x7f76340ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.008+0000 7f763c30a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76340d2dc0 0x7f76340d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.008+0000 7f763c30a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763415e260 con 0x7f76340ce1c0 2024-04-25T09:00:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.008+0000 7f763c30a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76340d3770 con 0x7f76340d2dc0 2024-04-25T09:00:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.008+0000 7f763c30a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76340d1ef0 con 0x7f763415de80 2024-04-25T09:00:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a8a7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76340d2dc0 0x7f76340d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a8a7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76340d2dc0 0x7f76340d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55300/0 (socket says 172.21.15.5:55300) 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a8a7640 1 -- 172.21.15.5:0/1292410446 learned_addr learned my addr 172.21.15.5:0/1292410446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a0a6640 1 --2- 172.21.15.5:0/1292410446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f763415de80 0x7f76340ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a8a7640 1 -- 172.21.15.5:0/1292410446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f763415de80 msgr2=0x7f76340ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a8a7640 1 --2- 172.21.15.5:0/1292410446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f763415de80 0x7f76340ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a8a7640 1 -- 172.21.15.5:0/1292410446 >> v1:172.21.15.80:6789/0 conn(0x7f76340ce1c0 legacy=0x7f76340d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a8a7640 1 -- 172.21.15.5:0/1292410446 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340cf2e0 con 0x7f76340d2dc0 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.009+0000 7f763a0a6640 1 --2- 172.21.15.5:0/1292410446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f763415de80 0x7f76340ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.010+0000 7f763a8a7640 1 --2- 172.21.15.5:0/1292410446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f76340d3230 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f76340b3610 tx=0x7f762c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b9616b8670e2e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.010+0000 7f76390a4640 1 -- 172.21.15.5:0/1292410446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c036070 con 0x7f76340d2dc0 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.010+0000 7f76390a4640 1 -- 172.21.15.5:0/1292410446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c031600 con 0x7f76340d2dc0 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.010+0000 7f76390a4640 1 -- 172.21.15.5:0/1292410446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0319d0 con 0x7f76340d2dc0 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.010+0000 7f763c30a640 1 -- 172.21.15.5:0/1292410446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 msgr2=0x7f76340d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.010+0000 7f763c30a640 1 --2- 172.21.15.5:0/1292410446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f76340d3230 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f76340b3610 tx=0x7f762c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.011+0000 7f763c30a640 1 -- 172.21.15.5:0/1292410446 shutdown_connections 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.011+0000 7f763c30a640 1 --2- 172.21.15.5:0/1292410446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f76340d3230 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.011+0000 7f763c30a640 1 --2- 172.21.15.5:0/1292410446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f763415de80 0x7f76340ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.011+0000 7f763c30a640 1 -- 172.21.15.5:0/1292410446 >> 172.21.15.5:0/1292410446 conn(0x7f763406b000 msgr2=0x7f763406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.011+0000 7f763c30a640 1 -- 172.21.15.5:0/1292410446 shutdown_connections 2024-04-25T09:00:54.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.011+0000 7f763c30a640 1 -- 172.21.15.5:0/1292410446 wait complete. 2024-04-25T09:00:54.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.012+0000 7f763c30a640 1 Processor -- start 2024-04-25T09:00:54.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.012+0000 7f763c30a640 1 -- start start 2024-04-25T09:00:54.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.012+0000 7f763c30a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76340ce1c0 0x7f76341601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.012+0000 7f763c30a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f7634158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763c30a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f763415de80 0x7f76340b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763c30a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76340d1b80 con 0x7f76340d2dc0 2024-04-25T09:00:54.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763c30a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76340ce780 con 0x7f763415de80 2024-04-25T09:00:54.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763c30a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76340b6cf0 con 0x7f76340ce1c0 2024-04-25T09:00:54.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f7634158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f7634158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55304/0 (socket says 172.21.15.5:55304) 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 -- 172.21.15.5:0/1460353274 learned_addr learned my addr 172.21.15.5:0/1460353274 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763a0a6640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76340ce1c0 0x7f76341601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763a8a7640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f763415de80 0x7f76340b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 -- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76340ce1c0 msgr2=0x7f76341601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76340ce1c0 0x7f76341601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 -- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f763415de80 msgr2=0x7f76340b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f763415de80 0x7f76340b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 -- 172.21.15.5:0/1460353274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763415f110 con 0x7f76340d2dc0 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f76398a5640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f7634158250 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f762400c430 tx=0x7f762400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f762affd640 1 -- 172.21.15.5:0/1460353274 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624011790 con 0x7f76340d2dc0 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f762affd640 1 -- 172.21.15.5:0/1460353274 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7624017070 con 0x7f76340d2dc0 2024-04-25T09:00:54.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763415f3f0 con 0x7f76340d2dc0 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f762affd640 1 -- 172.21.15.5:0/1460353274 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624011bb0 con 0x7f76340d2dc0 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.013+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763415f9b0 con 0x7f76340d2dc0 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.014+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763404ef20 con 0x7f76340d2dc0 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.015+0000 7f762affd640 1 -- 172.21.15.5:0/1460353274 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f762401c460 con 0x7f76340d2dc0 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.015+0000 7f762affd640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f761806b4d0 0x7f761806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.015+0000 7f762affd640 1 -- 172.21.15.5:0/1460353274 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7624089d80 con 0x7f76340d2dc0 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.015+0000 7f763a0a6640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f761806b4d0 0x7f761806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.016+0000 7f763a0a6640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f761806b4d0 0x7f761806d990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f763000aac0 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.019+0000 7f762affd640 1 -- 172.21.15.5:0/1460353274 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76240587b0 con 0x7f76340d2dc0 2024-04-25T09:00:54.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.200+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7634158790 con 0x7f76340d2dc0 2024-04-25T09:00:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.203+0000 7f762affd640 1 -- 172.21.15.5:0/1460353274 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f762405c850 con 0x7f76340d2dc0 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f761806b4d0 msgr2=0x7f761806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f761806b4d0 0x7f761806d990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f763000aac0 tx=0x7f7630008040 comp rx=0 tx=0).stop 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 msgr2=0x7f7634158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f7634158250 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f762400c430 tx=0x7f762400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 shutdown_connections 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f761806b4d0 0x7f761806d990 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f763415de80 0x7f76340b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76340d2dc0 0x7f7634158250 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 --2- 172.21.15.5:0/1460353274 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76340ce1c0 0x7f76341601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 >> 172.21.15.5:0/1460353274 conn(0x7f763406b000 msgr2=0x7f76340b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 shutdown_connections 2024-04-25T09:00:54.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.205+0000 7f763c30a640 1 -- 172.21.15.5:0/1460353274 wait complete. 2024-04-25T09:00:54.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-04-25T09:00:54.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.320+0000 7ff53e009640 1 Processor -- start 2024-04-25T09:00:54.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.320+0000 7ff53e009640 1 -- start start 2024-04-25T09:00:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.321+0000 7ff53e009640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5380668f0 0x7ff538066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.321+0000 7ff53e009640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 0x7ff5380b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.321+0000 7ff53e009640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff538067210 con 0x7ff5380b3e10 2024-04-25T09:00:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.321+0000 7ff53e009640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5380b5740 con 0x7ff5380668f0 2024-04-25T09:00:54.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.321+0000 7ff53e009640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380b5a20 con 0x7ff538161fe0 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.321+0000 7ff537fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5380b3e10 0x7ff53806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52108/0 (socket says 172.21.15.5:52108) 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.321+0000 7ff537fff640 1 -- 172.21.15.5:0/3121702358 learned_addr learned my addr 172.21.15.5:0/3121702358 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3121702358 >> v2:172.21.15.80:3300/0 conn(0x7ff5380668f0 0x7ff538066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff536ffd640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 0x7ff5380b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993020418 0 0) 0x7ff538067210 con 0x7ff5380b3e10 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff520003520 con 0x7ff5380b3e10 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 72408227 0 0) 0x7ff520003520 con 0x7ff5380b3e10 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 msgr2=0x7ff5380b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 0x7ff5380b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 >> v2:172.21.15.80:3300/0 conn(0x7ff5380668f0 msgr2=0x7ff538066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 --2- 172.21.15.5:0/3121702358 >> v2:172.21.15.80:3300/0 conn(0x7ff5380668f0 0x7ff538066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380b5d00 con 0x7ff5380b3e10 2024-04-25T09:00:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7ff5300019f0 con 0x7ff5380b3e10 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 >> v1:172.21.15.5:6789/0 conn(0x7ff5380b3e10 legacy=0x7ff53806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff520003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 0x7ff520004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff520004d40 0x7ff5200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380b5740 con 0x7ff5200039b0 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380b5a20 con 0x7ff520004d40 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52000b9c0 con 0x7ff538161fe0 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff520003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff536ffd640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 0x7ff520004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff537fff640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff520004d40 0x7ff5200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5377fe640 1 -- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 msgr2=0x7ff520004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538161fe0 0x7ff520004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5377fe640 1 -- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff520004d40 msgr2=0x7ff5200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff520004d40 0x7ff5200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff5377fe640 1 -- 172.21.15.5:0/3121702358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520003520 con 0x7ff5200039b0 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.322+0000 7ff537fff640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff520004d40 0x7ff5200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.323+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff520003dd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff528009ac0 tx=0x7ff520005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94da7416d08fb7e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.323+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528036070 con 0x7ff5200039b0 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.323+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528031400 con 0x7ff5200039b0 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.323+0000 7ff5367fc640 1 -- 172.21.15.5:0/3121702358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528009690 con 0x7ff5200039b0 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.324+0000 7ff53e009640 1 -- 172.21.15.5:0/3121702358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 msgr2=0x7ff520003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.324+0000 7ff53e009640 1 --2- 172.21.15.5:0/3121702358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff520003dd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff528009ac0 tx=0x7ff520005830 comp rx=0 tx=0).stop 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.324+0000 7ff537fff640 1 -- 172.21.15.5:0/3121702358 reap_dead start 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.324+0000 7ff53e009640 1 -- 172.21.15.5:0/3121702358 shutdown_connections 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.324+0000 7ff53e009640 1 -- 172.21.15.5:0/3121702358 >> 172.21.15.5:0/3121702358 conn(0x7ff5380b25d0 msgr2=0x7ff5380b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.324+0000 7ff53e009640 1 -- 172.21.15.5:0/3121702358 shutdown_connections 2024-04-25T09:00:54.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.324+0000 7ff53e009640 1 -- 172.21.15.5:0/3121702358 wait complete. 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.325+0000 7ff53e009640 1 Processor -- start 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.325+0000 7ff53e009640 1 -- start start 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff53e009640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff5381592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff53e009640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538142900 0x7ff538143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff53e009640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538144400 0x7ff538144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff53e009640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53806f030 con 0x7ff5200039b0 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff53e009640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff538161ac0 con 0x7ff538144400 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff53e009640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53806f1b0 con 0x7ff538142900 2024-04-25T09:00:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff5381592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff5381592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55316/0 (socket says 172.21.15.5:55316) 2024-04-25T09:00:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 -- 172.21.15.5:0/3130025587 learned_addr learned my addr 172.21.15.5:0/3130025587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff536ffd640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538142900 0x7ff538143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff537fff640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538144400 0x7ff538144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 -- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538142900 msgr2=0x7ff538143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538142900 0x7ff538143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 -- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538144400 msgr2=0x7ff538144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538144400 0x7ff538144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 -- 172.21.15.5:0/3130025587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380cdeb0 con 0x7ff5200039b0 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.326+0000 7ff5377fe640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff5381592c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff528034040 tx=0x7ff528004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.327+0000 7ff51ffff640 1 -- 172.21.15.5:0/3130025587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528040020 con 0x7ff5200039b0 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.327+0000 7ff51ffff640 1 -- 172.21.15.5:0/3130025587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528003950 con 0x7ff5200039b0 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.327+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff538142d80 con 0x7ff5200039b0 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.327+0000 7ff51ffff640 1 -- 172.21.15.5:0/3130025587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528036040 con 0x7ff5200039b0 2024-04-25T09:00:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.327+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff538159ca0 con 0x7ff5200039b0 2024-04-25T09:00:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.328+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53804ef20 con 0x7ff5200039b0 2024-04-25T09:00:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.328+0000 7ff51ffff640 1 -- 172.21.15.5:0/3130025587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff528043020 con 0x7ff5200039b0 2024-04-25T09:00:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.329+0000 7ff51ffff640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52406b4d0 0x7ff52406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.329+0000 7ff51ffff640 1 -- 172.21.15.5:0/3130025587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff5280aa370 con 0x7ff5200039b0 2024-04-25T09:00:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.329+0000 7ff536ffd640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52406b4d0 0x7ff52406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.329+0000 7ff536ffd640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52406b4d0 0x7ff52406d990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0099e0 tx=0x7ff52c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.333+0000 7ff51ffff640 1 -- 172.21.15.5:0/3130025587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff52804a030 con 0x7ff5200039b0 2024-04-25T09:00:54.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.587+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7ff538072140 con 0x7ff5200039b0 2024-04-25T09:00:54.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.882+0000 7ff51ffff640 1 -- 172.21.15.5:0/3130025587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v220) v1 ==== 143+0+0 (secure 0 0 0) 0x7ff528079490 con 0x7ff5200039b0 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52406b4d0 msgr2=0x7ff52406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52406b4d0 0x7ff52406d990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0099e0 tx=0x7ff52c008040 comp rx=0 tx=0).stop 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 msgr2=0x7ff5381592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff5381592c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff528034040 tx=0x7ff528004730 comp rx=0 tx=0).stop 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 shutdown_connections 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff52406b4d0 0x7ff52406d990 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538144400 0x7ff538144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff538142900 0x7ff538143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 --2- 172.21.15.5:0/3130025587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5200039b0 0x7ff5381592c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 >> 172.21.15.5:0/3130025587 conn(0x7ff5380b25d0 msgr2=0x7ff538143620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 shutdown_connections 2024-04-25T09:00:54.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.884+0000 7ff53e009640 1 -- 172.21.15.5:0/3130025587 wait complete. 2024-04-25T09:00:54.885 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-04-25T09:00:54.886 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-04-25T09:00:54.886 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T09:00:54.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.999+0000 7f08d4569640 1 Processor -- start 2024-04-25T09:00:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:54.999+0000 7f08d4569640 1 -- start start 2024-04-25T09:00:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.000+0000 7f08d4569640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08cc06b7d0 0x7f08cc06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.000+0000 7f08d4569640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08cc06bbb0 0x7f08cc0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.000+0000 7f08d4569640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.000+0000 7f08d4569640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0d0b70 con 0x7f08cc06b7d0 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.000+0000 7f08d4569640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0cbf30 con 0x7f08cc06bbb0 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.000+0000 7f08d4569640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0cc7d0 con 0x7f08cc15da10 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.000+0000 7f08d2305640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08cc06b7d0 0x7f08cc06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2305640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08cc06b7d0 0x7f08cc06aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55332/0 (socket says 172.21.15.5:55332) 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2305640 1 -- 172.21.15.5:0/1026605382 learned_addr learned my addr 172.21.15.5:0/1026605382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2b06640 1 --2- 172.21.15.5:0/1026605382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d1b04640 1 --2- 172.21.15.5:0/1026605382 >> v2:172.21.15.80:3300/0 conn(0x7f08cc06bbb0 0x7f08cc0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2305640 1 -- 172.21.15.5:0/1026605382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 msgr2=0x7f08cc15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2305640 1 --2- 172.21.15.5:0/1026605382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2305640 1 -- 172.21.15.5:0/1026605382 >> v2:172.21.15.80:3300/0 conn(0x7f08cc06bbb0 msgr2=0x7f08cc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2305640 1 --2- 172.21.15.5:0/1026605382 >> v2:172.21.15.80:3300/0 conn(0x7f08cc06bbb0 0x7f08cc0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.001+0000 7f08d2305640 1 -- 172.21.15.5:0/1026605382 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0b4730 con 0x7f08cc06b7d0 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d2305640 1 --2- 172.21.15.5:0/1026605382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06b7d0 0x7f08cc06aef0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f08cc072970 tx=0x7f08c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17addb52cfa788f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d1303640 1 -- 172.21.15.5:0/1026605382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8037070 con 0x7f08cc06b7d0 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d1303640 1 -- 172.21.15.5:0/1026605382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c8032440 con 0x7f08cc06b7d0 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d1303640 1 -- 172.21.15.5:0/1026605382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8032810 con 0x7f08cc06b7d0 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 -- 172.21.15.5:0/1026605382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06b7d0 msgr2=0x7f08cc06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 --2- 172.21.15.5:0/1026605382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06b7d0 0x7f08cc06aef0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f08cc072970 tx=0x7f08c802a270 comp rx=0 tx=0).stop 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 -- 172.21.15.5:0/1026605382 shutdown_connections 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 --2- 172.21.15.5:0/1026605382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 --2- 172.21.15.5:0/1026605382 >> v2:172.21.15.80:3300/0 conn(0x7f08cc06bbb0 0x7f08cc0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 --2- 172.21.15.5:0/1026605382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06b7d0 0x7f08cc06aef0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 -- 172.21.15.5:0/1026605382 >> 172.21.15.5:0/1026605382 conn(0x7f08cc0d18e0 msgr2=0x7f08cc0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 -- 172.21.15.5:0/1026605382 shutdown_connections 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.002+0000 7f08d4569640 1 -- 172.21.15.5:0/1026605382 wait complete. 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 Processor -- start 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 -- start start 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc06b7d0 0x7f08cc0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06bbb0 0x7f08cc1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc1f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0cc180 con 0x7f08cc06bbb0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15e3e0 con 0x7f08cc06b7d0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.004+0000 7f08d4569640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0cc460 con 0x7f08cc15da10 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06bbb0 0x7f08cc1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06bbb0 0x7f08cc1f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55338/0 (socket says 172.21.15.5:55338) 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 -- 172.21.15.5:0/1883798308 learned_addr learned my addr 172.21.15.5:0/1883798308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d2305640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc06b7d0 0x7f08cc0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d2b06640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc1f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 -- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 msgr2=0x7f08cc1f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc1f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 -- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc06b7d0 msgr2=0x7f08cc0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc06b7d0 0x7f08cc0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 -- 172.21.15.5:0/1883798308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0b5f80 con 0x7f08cc06bbb0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d1b04640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06bbb0 0x7f08cc1f3f60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00e9e0 tx=0x7f08bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08c2ffd640 1 -- 172.21.15.5:0/1883798308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc017070 con 0x7f08cc06bbb0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08c2ffd640 1 -- 172.21.15.5:0/1883798308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc00c9d0 con 0x7f08cc06bbb0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08c2ffd640 1 -- 172.21.15.5:0/1883798308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00cdc0 con 0x7f08cc06bbb0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc0b6260 con 0x7f08cc06bbb0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.005+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc0b6820 con 0x7f08cc06bbb0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.006+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc04ef20 con 0x7f08cc06bbb0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.007+0000 7f08c2ffd640 1 -- 172.21.15.5:0/1883798308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08bc01a070 con 0x7f08cc06bbb0 2024-04-25T09:00:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.007+0000 7f08c2ffd640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b006b4d0 0x7f08b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.007+0000 7f08c2ffd640 1 -- 172.21.15.5:0/1883798308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f08bc08a260 con 0x7f08cc06bbb0 2024-04-25T09:00:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.008+0000 7f08d2305640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b006b4d0 0x7f08b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.008+0000 7f08d2305640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b006b4d0 0x7f08b006d990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f08c8034000 tx=0x7f08c802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.012+0000 7f08c2ffd640 1 -- 172.21.15.5:0/1883798308 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08bc058dc0 con 0x7f08cc06bbb0 2024-04-25T09:00:55.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.192+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08cc15d320 con 0x7f08cc06bbb0 2024-04-25T09:00:55.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.193+0000 7f08c2ffd640 1 -- 172.21.15.5:0/1883798308 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13064 (secure 0 0 0) 0x7f08bc05ce60 con 0x7f08cc06bbb0 2024-04-25T09:00:55.182 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:55.182 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:53.874495+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1111822668":"2024-04-26T09:00:50.869647+0000","172.21.15.5:6834/1111822668":"2024-04-26T09:00:50.869647+0000","172.21.15.80:6836/3464170028":"2024-04-26T09:00:27.259301+0000","172.21.15.80:6834/3464170028":"2024-04-26T09:00:27.259301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:55.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b006b4d0 msgr2=0x7f08b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b006b4d0 0x7f08b006d990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f08c8034000 tx=0x7f08c802e000 comp rx=0 tx=0).stop 2024-04-25T09:00:55.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06bbb0 msgr2=0x7f08cc1f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06bbb0 0x7f08cc1f3f60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00e9e0 tx=0x7f08bc00eea0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 shutdown_connections 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08b006b4d0 0x7f08b006d990 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08cc15da10 0x7f08cc1f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08cc06bbb0 0x7f08cc1f3f60 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 --2- 172.21.15.5:0/1883798308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc06b7d0 0x7f08cc0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 >> 172.21.15.5:0/1883798308 conn(0x7f08cc0d18e0 msgr2=0x7f08cc0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 shutdown_connections 2024-04-25T09:00:55.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.195+0000 7f08d4569640 1 -- 172.21.15.5:0/1883798308 wait complete. 2024-04-25T09:00:55.195 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:55.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:55.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.309+0000 7f86778e1640 1 Processor -- start 2024-04-25T09:00:55.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.310+0000 7f86778e1640 1 -- start start 2024-04-25T09:00:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.310+0000 7f86778e1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86700cefe0 0x7f8670168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.310+0000 7f86778e1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8670162150 con 0x7f867015df10 2024-04-25T09:00:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.310+0000 7f86778e1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8670162430 con 0x7f86700b6250 2024-04-25T09:00:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.310+0000 7f86778e1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86700d20d0 con 0x7f86700cefe0 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f867567d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f867015df10 0x7f86701618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52124/0 (socket says 172.21.15.5:52124) 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f867567d640 1 -- 172.21.15.5:0/708966298 learned_addr learned my addr 172.21.15.5:0/708966298 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f8675e7e640 1 --2- 172.21.15.5:0/708966298 >> v2:172.21.15.80:3300/0 conn(0x7f86700cefe0 0x7f8670168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f866ffff640 1 -- 172.21.15.5:0/708966298 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458786649 0 0) 0x7f8670162150 con 0x7f867015df10 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f866ffff640 1 -- 172.21.15.5:0/708966298 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8658003520 con 0x7f867015df10 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f866ffff640 1 -- 172.21.15.5:0/708966298 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61856070 0 0) 0x7f8670162430 con 0x7f86700b6250 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f866ffff640 1 -- 172.21.15.5:0/708966298 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8670162150 con 0x7f86700b6250 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f8675e7e640 1 -- 172.21.15.5:0/708966298 >> v1:172.21.15.80:6789/0 conn(0x7f86700b6250 legacy=0x7f86700ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f8675e7e640 1 -- 172.21.15.5:0/708966298 >> v1:172.21.15.5:6789/0 conn(0x7f867015df10 legacy=0x7f86701618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.311+0000 7f8675e7e640 1 -- 172.21.15.5:0/708966298 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670162710 con 0x7f86700cefe0 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.312+0000 7f8675e7e640 1 --2- 172.21.15.5:0/708966298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86700cefe0 0x7f8670168c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8660009d90 tx=0x7f866002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a739f3eafe947ba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.312+0000 7f866ffff640 1 -- 172.21.15.5:0/708966298 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660007740 con 0x7f86700cefe0 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.312+0000 7f866ffff640 1 -- 172.21.15.5:0/708966298 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600078e0 con 0x7f86700cefe0 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.312+0000 7f866ffff640 1 -- 172.21.15.5:0/708966298 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660007cb0 con 0x7f86700cefe0 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.313+0000 7f86778e1640 1 -- 172.21.15.5:0/708966298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86700cefe0 msgr2=0x7f8670168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.313+0000 7f86778e1640 1 --2- 172.21.15.5:0/708966298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86700cefe0 0x7f8670168c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8660009d90 tx=0x7f866002a6f0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.313+0000 7f86778e1640 1 -- 172.21.15.5:0/708966298 shutdown_connections 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.313+0000 7f86778e1640 1 --2- 172.21.15.5:0/708966298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86700cefe0 0x7f8670168c40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.313+0000 7f86778e1640 1 -- 172.21.15.5:0/708966298 >> 172.21.15.5:0/708966298 conn(0x7f86700668f0 msgr2=0x7f8670066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.313+0000 7f86778e1640 1 -- 172.21.15.5:0/708966298 shutdown_connections 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.313+0000 7f86778e1640 1 -- 172.21.15.5:0/708966298 wait complete. 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.314+0000 7f86778e1640 1 Processor -- start 2024-04-25T09:00:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.314+0000 7f86778e1640 1 -- start start 2024-04-25T09:00:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.314+0000 7f86778e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86700b6250 0x7f86700c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.314+0000 7f86778e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86700cefe0 0x7f8670152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.314+0000 7f86778e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f867015df10 0x7f867015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f86778e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700d36f0 con 0x7f86700b6250 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f86778e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700d3570 con 0x7f867015df10 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f86778e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700d3870 con 0x7f86700cefe0 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86700b6250 0x7f86700c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86700b6250 0x7f86700c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55344/0 (socket says 172.21.15.5:55344) 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 -- 172.21.15.5:0/2014894229 learned_addr learned my addr 172.21.15.5:0/2014894229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f8675e7e640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f867015df10 0x7f867015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 -- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86700cefe0 msgr2=0x7f8670152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f8674e7c640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86700cefe0 0x7f8670152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86700cefe0 0x7f8670152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 -- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f867015df10 msgr2=0x7f867015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f867015df10 0x7f867015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 -- 172.21.15.5:0/2014894229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670156b10 con 0x7f86700b6250 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f8675e7e640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f867015df10 0x7f867015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f8674e7c640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86700cefe0 0x7f8670152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f867567d640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86700b6250 0x7f86700c7470 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f866800c430 tx=0x7f866800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f866dffb640 1 -- 172.21.15.5:0/2014894229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668017070 con 0x7f86700b6250 2024-04-25T09:00:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f866dffb640 1 -- 172.21.15.5:0/2014894229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668005ce0 con 0x7f86700b6250 2024-04-25T09:00:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8670156df0 con 0x7f86700b6250 2024-04-25T09:00:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.315+0000 7f866dffb640 1 -- 172.21.15.5:0/2014894229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680072f0 con 0x7f86700b6250 2024-04-25T09:00:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.316+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86701573b0 con 0x7f86700b6250 2024-04-25T09:00:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.316+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867004ef20 con 0x7f86700b6250 2024-04-25T09:00:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.317+0000 7f866dffb640 1 -- 172.21.15.5:0/2014894229 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f866801a070 con 0x7f86700b6250 2024-04-25T09:00:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.317+0000 7f866dffb640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865c06b4d0 0x7f865c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.317+0000 7f866dffb640 1 -- 172.21.15.5:0/2014894229 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8668089480 con 0x7f86700b6250 2024-04-25T09:00:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.318+0000 7f8674e7c640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865c06b4d0 0x7f865c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.318+0000 7f8674e7c640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865c06b4d0 0x7f865c06d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f867015db50 tx=0x7f8664009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.322+0000 7f866dffb640 1 -- 172.21.15.5:0/2014894229 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8668058520 con 0x7f86700b6250 2024-04-25T09:00:55.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.502+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86700d1910 con 0x7f86700b6250 2024-04-25T09:00:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.502+0000 7f866dffb640 1 -- 172.21.15.5:0/2014894229 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8668057e20 con 0x7f86700b6250 2024-04-25T09:00:55.492 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865c06b4d0 msgr2=0x7f865c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865c06b4d0 0x7f865c06d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f867015db50 tx=0x7f8664009040 comp rx=0 tx=0).stop 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86700b6250 msgr2=0x7f86700c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86700b6250 0x7f86700c7470 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f866800c430 tx=0x7f866800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 shutdown_connections 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865c06b4d0 0x7f865c06d990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f867015df10 0x7f867015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86700cefe0 0x7f8670152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 --2- 172.21.15.5:0/2014894229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86700b6250 0x7f86700c7470 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 >> 172.21.15.5:0/2014894229 conn(0x7f86700668f0 msgr2=0x7f867015d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 shutdown_connections 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.504+0000 7f86778e1640 1 -- 172.21.15.5:0/2014894229 wait complete. 2024-04-25T09:00:55.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-04-25T09:00:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.615+0000 7f326beb3640 1 Processor -- start 2024-04-25T09:00:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.615+0000 7f326beb3640 1 -- start start 2024-04-25T09:00:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326beb3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f326406cbf0 0x7f32640cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326beb3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32640ce190 0x7f32640ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326beb3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3264072150 con 0x7f326415df80 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326beb3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640cbd50 con 0x7f32640ce190 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326beb3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640cc030 con 0x7f326406cbf0 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326944e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32640ce190 0x7f32640ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326944e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32640ce190 0x7f32640ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55360/0 (socket says 172.21.15.5:55360) 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f326944e640 1 -- 172.21.15.5:0/4061769105 learned_addr learned my addr 172.21.15.5:0/4061769105 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.616+0000 7f3269c4f640 1 --2- 172.21.15.5:0/4061769105 >> v2:172.21.15.80:3300/0 conn(0x7f326406cbf0 0x7f32640cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f326944e640 1 -- 172.21.15.5:0/4061769105 >> v2:172.21.15.80:3300/0 conn(0x7f326406cbf0 msgr2=0x7f32640cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f326944e640 1 --2- 172.21.15.5:0/4061769105 >> v2:172.21.15.80:3300/0 conn(0x7f326406cbf0 0x7f32640cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f326944e640 1 -- 172.21.15.5:0/4061769105 >> v1:172.21.15.80:6789/0 conn(0x7f326415df80 legacy=0x7f326406cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f326944e640 1 -- 172.21.15.5:0/4061769105 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640cc310 con 0x7f32640ce190 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f3269c4f640 1 --2- 172.21.15.5:0/4061769105 >> v2:172.21.15.80:3300/0 conn(0x7f326406cbf0 0x7f32640cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f326944e640 1 --2- 172.21.15.5:0/4061769105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32640ce190 0x7f32640ccb10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f326406c890 tx=0x7f325802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59511fb3d4ada83f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f3268c4d640 1 -- 172.21.15.5:0/4061769105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258037070 con 0x7f32640ce190 2024-04-25T09:00:55.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f3268c4d640 1 -- 172.21.15.5:0/4061769105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258032440 con 0x7f32640ce190 2024-04-25T09:00:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.617+0000 7f3268c4d640 1 -- 172.21.15.5:0/4061769105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258032810 con 0x7f32640ce190 2024-04-25T09:00:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 -- 172.21.15.5:0/4061769105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32640ce190 msgr2=0x7f32640ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 --2- 172.21.15.5:0/4061769105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32640ce190 0x7f32640ccb10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f326406c890 tx=0x7f325802a2c0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 -- 172.21.15.5:0/4061769105 shutdown_connections 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 --2- 172.21.15.5:0/4061769105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32640ce190 0x7f32640ccb10 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 --2- 172.21.15.5:0/4061769105 >> v2:172.21.15.80:3300/0 conn(0x7f326406cbf0 0x7f32640cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 -- 172.21.15.5:0/4061769105 >> 172.21.15.5:0/4061769105 conn(0x7f32640b1c50 msgr2=0x7f32640b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 -- 172.21.15.5:0/4061769105 shutdown_connections 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.618+0000 7f326beb3640 1 -- 172.21.15.5:0/4061769105 wait complete. 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.619+0000 7f326beb3640 1 Processor -- start 2024-04-25T09:00:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.619+0000 7f326beb3640 1 -- start start 2024-04-25T09:00:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326beb3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f326406cbf0 0x7f326415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326beb3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32640ce190 0x7f32640b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326beb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f326415df80 0x7f32640ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326beb3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264071d50 con 0x7f326415df80 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326beb3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264071bd0 con 0x7f32640ce190 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326beb3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264071ed0 con 0x7f326406cbf0 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f326415df80 0x7f32640ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f326415df80 0x7f32640ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55370/0 (socket says 172.21.15.5:55370) 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 -- 172.21.15.5:0/2096200655 learned_addr learned my addr 172.21.15.5:0/2096200655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326944e640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32640ce190 0x7f32640b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f3269c4f640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f326406cbf0 0x7f326415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 -- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f326406cbf0 msgr2=0x7f326415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f326406cbf0 0x7f326415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 -- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32640ce190 msgr2=0x7f32640b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32640ce190 0x7f32640b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.620+0000 7f326a450640 1 -- 172.21.15.5:0/2096200655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640b4760 con 0x7f326415df80 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.621+0000 7f326944e640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32640ce190 0x7f32640b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.621+0000 7f326a450640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f326415df80 0x7f32640ced50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f325400be60 tx=0x7f325400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.621+0000 7f32627fc640 1 -- 172.21.15.5:0/2096200655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254019070 con 0x7f326415df80 2024-04-25T09:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.621+0000 7f32627fc640 1 -- 172.21.15.5:0/2096200655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254014440 con 0x7f326415df80 2024-04-25T09:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.621+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32640b4a40 con 0x7f326415df80 2024-04-25T09:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.621+0000 7f32627fc640 1 -- 172.21.15.5:0/2096200655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254014870 con 0x7f326415df80 2024-04-25T09:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.621+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640b5000 con 0x7f326415df80 2024-04-25T09:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.622+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326404ef20 con 0x7f326415df80 2024-04-25T09:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.622+0000 7f32627fc640 1 -- 172.21.15.5:0/2096200655 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f325401c070 con 0x7f326415df80 2024-04-25T09:00:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.623+0000 7f32627fc640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f325006b4d0 0x7f325006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.623+0000 7f32627fc640 1 -- 172.21.15.5:0/2096200655 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3254089e60 con 0x7f326415df80 2024-04-25T09:00:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.623+0000 7f3269c4f640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f325006b4d0 0x7f325006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.623+0000 7f3269c4f640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f325006b4d0 0x7f325006d990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f325c00a990 tx=0x7f325c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.627+0000 7f32627fc640 1 -- 172.21.15.5:0/2096200655 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3254059010 con 0x7f326415df80 2024-04-25T09:00:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.874+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f32640b5cf0 con 0x7f326415df80 2024-04-25T09:00:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.883+0000 7f32627fc640 1 -- 172.21.15.5:0/2096200655 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v221) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3254058910 con 0x7f326415df80 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f325006b4d0 msgr2=0x7f325006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f325006b4d0 0x7f325006d990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f325c00a990 tx=0x7f325c008040 comp rx=0 tx=0).stop 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f326415df80 msgr2=0x7f32640ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f326415df80 0x7f32640ced50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f325400be60 tx=0x7f325400bf50 comp rx=0 tx=0).stop 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 shutdown_connections 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f325006b4d0 0x7f325006d990 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f326415df80 0x7f32640ced50 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32640ce190 0x7f32640b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 --2- 172.21.15.5:0/2096200655 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f326406cbf0 0x7f326415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.885+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 >> 172.21.15.5:0/2096200655 conn(0x7f32640b1c50 msgr2=0x7f32640ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.886+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 shutdown_connections 2024-04-25T09:00:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:55.886+0000 7f326beb3640 1 -- 172.21.15.5:0/2096200655 wait complete. 2024-04-25T09:00:55.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:00:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.000+0000 7fd2d3d22640 1 Processor -- start 2024-04-25T09:00:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.000+0000 7fd2d3d22640 1 -- start start 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d3d22640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2cc15df70 0x7fd2cc0b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d3d22640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc0d1ed0 con 0x7fd2cc0cef20 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d3d22640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc0d21b0 con 0x7fd2cc0d2f70 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d3d22640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0d1c80 con 0x7fd2cc15df70 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d22bf640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd2cc0cef20 0x7fd2cc0b6c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52134/0 (socket says 172.21.15.5:52134) 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d22bf640 1 -- 172.21.15.5:0/1365450898 learned_addr learned my addr 172.21.15.5:0/1365450898 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d1abe640 1 --2- 172.21.15.5:0/1365450898 >> v2:172.21.15.80:3300/0 conn(0x7fd2cc15df70 0x7fd2cc0b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870877291 0 0) 0x7fd2cc0d1ed0 con 0x7fd2cc0cef20 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b8003520 con 0x7fd2cc0cef20 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682122543 0 0) 0x7fd2b8003520 con 0x7fd2cc0cef20 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 >> v2:172.21.15.80:3300/0 conn(0x7fd2cc15df70 msgr2=0x7fd2cc0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d0abc640 1 --2- 172.21.15.5:0/1365450898 >> v2:172.21.15.80:3300/0 conn(0x7fd2cc15df70 0x7fd2cc0b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 >> v1:172.21.15.80:6789/0 conn(0x7fd2cc0d2f70 legacy=0x7fd2cc0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.001+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc0d2490 con 0x7fd2cc0cef20 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fd2c40019f0 con 0x7fd2cc0cef20 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 >> v1:172.21.15.5:6789/0 conn(0x7fd2cc0cef20 legacy=0x7fd2cc0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80039b0 0x7fd2b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b8004800 0x7fd2b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2b80051c0 0x7fd2b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0d1c80 con 0x7fd2b8004800 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b800c070 con 0x7fd2b80039b0 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b800c270 con 0x7fd2b80051c0 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d12bd640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b8004800 0x7fd2b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d1abe640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80039b0 0x7fd2b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d22bf640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2b80051c0 0x7fd2b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d12bd640 1 -- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2b80051c0 msgr2=0x7fd2b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d12bd640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2b80051c0 0x7fd2b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d12bd640 1 -- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80039b0 msgr2=0x7fd2b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d12bd640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80039b0 0x7fd2b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d12bd640 1 -- 172.21.15.5:0/1365450898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8003520 con 0x7fd2b8004800 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.002+0000 7fd2d22bf640 1 -- 172.21.15.5:0/1365450898 reap_dead start 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d12bd640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b8004800 0x7fd2b8004c80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc001750 tx=0x7fd2b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f874f213acfe7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc001370 con 0x7fd2b8004800 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc0052d0 con 0x7fd2b8004800 2024-04-25T09:00:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d0abc640 1 -- 172.21.15.5:0/1365450898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc02abc0 con 0x7fd2b8004800 2024-04-25T09:00:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d3d22640 1 -- 172.21.15.5:0/1365450898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b8004800 msgr2=0x7fd2b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b8004800 0x7fd2b8004c80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc001750 tx=0x7fd2b8005830 comp rx=0 tx=0).stop 2024-04-25T09:00:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d3d22640 1 -- 172.21.15.5:0/1365450898 shutdown_connections 2024-04-25T09:00:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/1365450898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b8004800 0x7fd2b8004c80 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.003+0000 7fd2d3d22640 1 -- 172.21.15.5:0/1365450898 >> 172.21.15.5:0/1365450898 conn(0x7fd2cc06b000 msgr2=0x7fd2cc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.004+0000 7fd2d3d22640 1 -- 172.21.15.5:0/1365450898 shutdown_connections 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.004+0000 7fd2d3d22640 1 -- 172.21.15.5:0/1365450898 wait complete. 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 Processor -- start 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 -- start start 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b8004800 0x7fd2cc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2cc157470 0x7fd2cc152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2cc153ef0 0x7fd2cc0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0d3720 con 0x7fd2cc153ef0 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0d2ae0 con 0x7fd2b8004800 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.005+0000 7fd2d3d22640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0d38a0 con 0x7fd2cc157470 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2cc153ef0 0x7fd2cc0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2cc153ef0 0x7fd2cc0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55378/0 (socket says 172.21.15.5:55378) 2024-04-25T09:00:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 -- 172.21.15.5:0/935336937 learned_addr learned my addr 172.21.15.5:0/935336937 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d12bd640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2cc157470 0x7fd2cc152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d1abe640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b8004800 0x7fd2cc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 -- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2cc157470 msgr2=0x7fd2cc152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2cc157470 0x7fd2cc152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 -- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b8004800 msgr2=0x7fd2cc154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b8004800 0x7fd2cc154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 -- 172.21.15.5:0/935336937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc0cbb30 con 0x7fd2cc153ef0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d12bd640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2cc157470 0x7fd2cc152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d22bf640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2cc153ef0 0x7fd2cc0cc8b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0ce0d0 tx=0x7fd2c4007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2c27fc640 1 -- 172.21.15.5:0/935336937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400ea80 con 0x7fd2cc153ef0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2c27fc640 1 -- 172.21.15.5:0/935336937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4018070 con 0x7fd2cc153ef0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc1550d0 con 0x7fd2cc153ef0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2c27fc640 1 -- 172.21.15.5:0/935336937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400eea0 con 0x7fd2cc153ef0 2024-04-25T09:00:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.006+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc0cc0b0 con 0x7fd2cc153ef0 2024-04-25T09:00:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.007+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc0d1ed0 con 0x7fd2cc153ef0 2024-04-25T09:00:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.008+0000 7fd2c27fc640 1 -- 172.21.15.5:0/935336937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2c401d460 con 0x7fd2cc153ef0 2024-04-25T09:00:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.008+0000 7fd2c27fc640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2b006b500 0x7fd2b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.008+0000 7fd2c27fc640 1 -- 172.21.15.5:0/935336937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd2c408a1e0 con 0x7fd2cc153ef0 2024-04-25T09:00:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.008+0000 7fd2d1abe640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2b006b500 0x7fd2b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.009+0000 7fd2d1abe640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2b006b500 0x7fd2b006d9c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc15cd80 tx=0x7fd2c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.012+0000 7fd2c27fc640 1 -- 172.21.15.5:0/935336937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2cc0d1ed0 con 0x7fd2cc153ef0 2024-04-25T09:00:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.192+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd2cc04ef20 con 0x7fd2cc153ef0 2024-04-25T09:00:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.195+0000 7fd2c27fc640 1 -- 172.21.15.5:0/935336937 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd2c4059390 con 0x7fd2cc153ef0 2024-04-25T09:00:56.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2b006b500 msgr2=0x7fd2b006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2b006b500 0x7fd2b006d9c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc15cd80 tx=0x7fd2c8008040 comp rx=0 tx=0).stop 2024-04-25T09:00:56.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2cc153ef0 msgr2=0x7fd2cc0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2cc153ef0 0x7fd2cc0cc8b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0ce0d0 tx=0x7fd2c4007bc0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 shutdown_connections 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd2b006b500 0x7fd2b006d9c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2cc153ef0 0x7fd2cc0cc8b0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2cc157470 0x7fd2cc152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 --2- 172.21.15.5:0/935336937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b8004800 0x7fd2cc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 >> 172.21.15.5:0/935336937 conn(0x7fd2cc06b000 msgr2=0x7fd2cc0c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 shutdown_connections 2024-04-25T09:00:56.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.197+0000 7fd2d3d22640 1 -- 172.21.15.5:0/935336937 wait complete. 2024-04-25T09:00:56.197 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:00:56.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:00:56.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:00:56.283 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:00:56.284 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:56.284 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:56.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:00:56.299 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:00:56.299 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:56.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:00:56.342 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:00:56.342 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:56.358 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:00:56.358 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:00:56.358 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:56.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:00:56.401 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:00:56.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.512+0000 7f108c1b0640 1 Processor -- start 2024-04-25T09:00:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.512+0000 7f108c1b0640 1 -- start start 2024-04-25T09:00:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f108c1b0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f108415e0a0 0x7f10840d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f108c1b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840d3990 0x7f10840d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f108c1b0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10840b7f60 con 0x7f10840ce5e0 2024-04-25T09:00:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f108c1b0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10840d4330 con 0x7f108415e0a0 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f108c1b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10840b29c0 con 0x7f10840d3990 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f1089f4c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f108415e0a0 0x7f10840d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f1089f4c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f108415e0a0 0x7f10840d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55382/0 (socket says 172.21.15.5:55382) 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f108a74d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10840ce5e0 0x7f10840cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52138/0 (socket says 172.21.15.5:52138) 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f1089f4c640 1 -- 172.21.15.5:0/1924024005 learned_addr learned my addr 172.21.15.5:0/1924024005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.513+0000 7f108974b640 1 --2- 172.21.15.5:0/1924024005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840d3990 0x7f10840d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.514+0000 7f1089f4c640 1 -- 172.21.15.5:0/1924024005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840d3990 msgr2=0x7f10840d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.514+0000 7f1089f4c640 1 --2- 172.21.15.5:0/1924024005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840d3990 0x7f10840d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.514+0000 7f1089f4c640 1 -- 172.21.15.5:0/1924024005 >> v1:172.21.15.5:6789/0 conn(0x7f10840ce5e0 legacy=0x7f10840cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.514+0000 7f1089f4c640 1 -- 172.21.15.5:0/1924024005 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840d2080 con 0x7f108415e0a0 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.514+0000 7f108974b640 1 --2- 172.21.15.5:0/1924024005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840d3990 0x7f10840d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.514+0000 7f1089f4c640 1 --2- 172.21.15.5:0/1924024005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840d0d50 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f1080009870 tx=0x7f108002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7772126de6696090 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.514+0000 7f1088f4a640 1 -- 172.21.15.5:0/1924024005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080037070 con 0x7f108415e0a0 2024-04-25T09:00:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f1088f4a640 1 -- 172.21.15.5:0/1924024005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108002adf0 con 0x7f108415e0a0 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f1088f4a640 1 -- 172.21.15.5:0/1924024005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080032660 con 0x7f108415e0a0 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 -- 172.21.15.5:0/1924024005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 msgr2=0x7f10840d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 --2- 172.21.15.5:0/1924024005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840d0d50 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f1080009870 tx=0x7f108002a160 comp rx=0 tx=0).stop 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 -- 172.21.15.5:0/1924024005 shutdown_connections 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 --2- 172.21.15.5:0/1924024005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840d3990 0x7f10840d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 --2- 172.21.15.5:0/1924024005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840d0d50 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 -- 172.21.15.5:0/1924024005 >> 172.21.15.5:0/1924024005 conn(0x7f10840668f0 msgr2=0x7f1084066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 -- 172.21.15.5:0/1924024005 shutdown_connections 2024-04-25T09:00:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.515+0000 7f108c1b0640 1 -- 172.21.15.5:0/1924024005 wait complete. 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.516+0000 7f108c1b0640 1 Processor -- start 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.516+0000 7f108c1b0640 1 -- start start 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108c1b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840ce5e0 0x7f108415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108c1b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10840d3990 0x7f10840aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108c1b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108c1b0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10840d2920 con 0x7f108415e0a0 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108c1b0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10840d2640 con 0x7f10840d3990 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108c1b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10840d2c00 con 0x7f10840ce5e0 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840aaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55388/0 (socket says 172.21.15.5:55388) 2024-04-25T09:00:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 -- 172.21.15.5:0/2424889145 learned_addr learned my addr 172.21.15.5:0/2424889145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f1089f4c640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840ce5e0 0x7f108415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108974b640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10840d3990 0x7f10840aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 -- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840ce5e0 msgr2=0x7f108415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840ce5e0 0x7f108415a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 -- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10840d3990 msgr2=0x7f10840aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10840d3990 0x7f10840aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.517+0000 7f108a74d640 1 -- 172.21.15.5:0/2424889145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840cad40 con 0x7f108415e0a0 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.518+0000 7f108974b640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10840d3990 0x7f10840aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.518+0000 7f108a74d640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840aaa60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f107c00c8d0 tx=0x7f107c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.518+0000 7f107a7fc640 1 -- 172.21.15.5:0/2424889145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c018070 con 0x7f108415e0a0 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.518+0000 7f107a7fc640 1 -- 172.21.15.5:0/2424889145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00a640 con 0x7f108415e0a0 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.518+0000 7f107a7fc640 1 -- 172.21.15.5:0/2424889145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00aa70 con 0x7f108415e0a0 2024-04-25T09:00:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.518+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10840cb020 con 0x7f108415e0a0 2024-04-25T09:00:56.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.518+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10840cb5e0 con 0x7f108415e0a0 2024-04-25T09:00:56.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.519+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108404ef20 con 0x7f108415e0a0 2024-04-25T09:00:56.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.519+0000 7f107a7fc640 1 -- 172.21.15.5:0/2424889145 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f107c01b070 con 0x7f108415e0a0 2024-04-25T09:00:56.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.520+0000 7f107a7fc640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f106806b4d0 0x7f106806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.520+0000 7f107a7fc640 1 -- 172.21.15.5:0/2424889145 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f107c089680 con 0x7f108415e0a0 2024-04-25T09:00:56.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.520+0000 7f1089f4c640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f106806b4d0 0x7f106806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.520+0000 7f1089f4c640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f106806b4d0 0x7f106806d990 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1080034000 tx=0x7f108002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.524+0000 7f107a7fc640 1 -- 172.21.15.5:0/2424889145 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f107c0587a0 con 0x7f108415e0a0 2024-04-25T09:00:56.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.739+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10840ca690 con 0x7f108415e0a0 2024-04-25T09:00:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.739+0000 7f107a7fc640 1 -- 172.21.15.5:0/2424889145 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f107c0580a0 con 0x7f108415e0a0 2024-04-25T09:00:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:56.729 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1697189438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1697189438},{"type":"v1","addr":"172.21.15.80:6837","nonce":1697189438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6160,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3922084939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3922084939},{"type":"v1","addr":"172.21.15.80:6836","nonce":3922084939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2055386574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2055386574},{"type":"v1","addr":"172.21.15.5:6833","nonce":2055386574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4095826421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4095826421},{"type":"v1","addr":"172.21.15.5:6835","nonce":4095826421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[]} 2024-04-25T09:00:56.729 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2024-04-25T09:00:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f106806b4d0 msgr2=0x7f106806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f106806b4d0 0x7f106806d990 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1080034000 tx=0x7f108002e000 comp rx=0 tx=0).stop 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 msgr2=0x7f10840aaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840aaa60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f107c00c8d0 tx=0x7f107c00cd90 comp rx=0 tx=0).stop 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 shutdown_connections 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f106806b4d0 0x7f106806d990 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f108415e0a0 0x7f10840aaa60 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10840d3990 0x7f10840aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 --2- 172.21.15.5:0/2424889145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10840ce5e0 0x7f108415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 >> 172.21.15.5:0/2424889145 conn(0x7f10840668f0 msgr2=0x7f10840b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 shutdown_connections 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.741+0000 7f108c1b0640 1 -- 172.21.15.5:0/2424889145 wait complete. 2024-04-25T09:00:56.741 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:00:56.741 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:00:56.742 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:00:56.742 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:56.742 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:00:56.742 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:00:56.742 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:00:56.743 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:56.743 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:00:56.743 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:00:56.743 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:00:56.743 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:56.743 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:00:56.743 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:00:56.744 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:00:56.744 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:00:56.751 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:00:56.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:00:56.753 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:00:56.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:00:56.756 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:00:56.756 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:00:56.757 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:00:56.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:00:56.795 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:00:56.796 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:56.796 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:00:56.796 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:56.799 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:00:56.799 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:56.799 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:00:56.800 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:56.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:00:56.872 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:00:56.872 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:00:56.881 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:00:56.882 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:00:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.920+0000 7f1420a9e640 1 Processor -- start 2024-04-25T09:00:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.920+0000 7f1420a9e640 1 -- start start 2024-04-25T09:00:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f1420a9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f141c15de70 0x7f141c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f1420a9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f141c0ce7f0 0x7f141c0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f1420a9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c0cf1c0 con 0x7f141c0b2cc0 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f1420a9e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0d2a10 con 0x7f141c15de70 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f1420a9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0d20e0 con 0x7f141c0ce7f0 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f141c15de70 0x7f141c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f141c15de70 0x7f141c0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55434/0 (socket says 172.21.15.5:55434) 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141a59c640 1 -- 172.21.15.5:0/4088175994 learned_addr learned my addr 172.21.15.5:0/4088175994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141ad9d640 1 --2- 172.21.15.5:0/4088175994 >> v2:172.21.15.80:3300/0 conn(0x7f141c0ce7f0 0x7f141c0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141a59c640 1 -- 172.21.15.5:0/4088175994 >> v2:172.21.15.80:3300/0 conn(0x7f141c0ce7f0 msgr2=0x7f141c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141a59c640 1 --2- 172.21.15.5:0/4088175994 >> v2:172.21.15.80:3300/0 conn(0x7f141c0ce7f0 0x7f141c0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141a59c640 1 -- 172.21.15.5:0/4088175994 >> v1:172.21.15.80:6789/0 conn(0x7f141c0b2cc0 legacy=0x7f141c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.921+0000 7f141a59c640 1 -- 172.21.15.5:0/4088175994 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0d23c0 con 0x7f141c15de70 2024-04-25T09:00:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.922+0000 7f141a59c640 1 --2- 172.21.15.5:0/4088175994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b93e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f141c0d1970 tx=0x7f140c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31f2c523ab4d2de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.922+0000 7f1419d9b640 1 -- 172.21.15.5:0/4088175994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c037070 con 0x7f141c15de70 2024-04-25T09:00:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.922+0000 7f1419d9b640 1 -- 172.21.15.5:0/4088175994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c032440 con 0x7f141c15de70 2024-04-25T09:00:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.922+0000 7f1419d9b640 1 -- 172.21.15.5:0/4088175994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c032810 con 0x7f141c15de70 2024-04-25T09:00:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.922+0000 7f1420a9e640 1 -- 172.21.15.5:0/4088175994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 msgr2=0x7f141c0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.922+0000 7f1420a9e640 1 --2- 172.21.15.5:0/4088175994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b93e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f141c0d1970 tx=0x7f140c02a270 comp rx=0 tx=0).stop 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.923+0000 7f1420a9e640 1 -- 172.21.15.5:0/4088175994 shutdown_connections 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.923+0000 7f1420a9e640 1 --2- 172.21.15.5:0/4088175994 >> v2:172.21.15.80:3300/0 conn(0x7f141c0ce7f0 0x7f141c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.923+0000 7f1420a9e640 1 --2- 172.21.15.5:0/4088175994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b93e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.923+0000 7f1420a9e640 1 -- 172.21.15.5:0/4088175994 >> 172.21.15.5:0/4088175994 conn(0x7f141c06b000 msgr2=0x7f141c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.923+0000 7f1420a9e640 1 -- 172.21.15.5:0/4088175994 shutdown_connections 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.923+0000 7f1420a9e640 1 -- 172.21.15.5:0/4088175994 wait complete. 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.924+0000 7f1420a9e640 1 Processor -- start 2024-04-25T09:00:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.924+0000 7f1420a9e640 1 -- start start 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f1420a9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f141c0b2cc0 0x7f141c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f1420a9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f141c0ce7f0 0x7f141c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f1420a9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f1420a9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0b7300 con 0x7f141c15de70 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f1420a9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0b9920 con 0x7f141c0ce7f0 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f1420a9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0d2ea0 con 0x7f141c0b2cc0 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f141ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f141ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55450/0 (socket says 172.21.15.5:55450) 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f141ad9d640 1 -- 172.21.15.5:0/1771054859 learned_addr learned my addr 172.21.15.5:0/1771054859 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f141a59c640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f141c0b2cc0 0x7f141c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.925+0000 7f1411d9b640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f141c0ce7f0 0x7f141c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f141ad9d640 1 -- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f141c0b2cc0 msgr2=0x7f141c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f141ad9d640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f141c0b2cc0 0x7f141c157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f141ad9d640 1 -- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f141c0ce7f0 msgr2=0x7f141c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f141ad9d640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f141c0ce7f0 0x7f141c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f141ad9d640 1 -- 172.21.15.5:0/1771054859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0cde00 con 0x7f141c15de70 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f1411d9b640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f141c0ce7f0 0x7f141c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f141ad9d640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b4a20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f141400efc0 tx=0x7f141400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f14137fe640 1 -- 172.21.15.5:0/1771054859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414018020 con 0x7f141c15de70 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f14137fe640 1 -- 172.21.15.5:0/1771054859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414014480 con 0x7f141c15de70 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f14137fe640 1 -- 172.21.15.5:0/1771054859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414014870 con 0x7f141c15de70 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c0b5d20 con 0x7f141c15de70 2024-04-25T09:00:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.926+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c0b62e0 con 0x7f141c15de70 2024-04-25T09:00:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.927+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c04ef20 con 0x7f141c15de70 2024-04-25T09:00:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.928+0000 7f14137fe640 1 -- 172.21.15.5:0/1771054859 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1414005d10 con 0x7f141c15de70 2024-04-25T09:00:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.928+0000 7f14137fe640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f13fc06b4d0 0x7f13fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.928+0000 7f14137fe640 1 -- 172.21.15.5:0/1771054859 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f141408abd0 con 0x7f141c15de70 2024-04-25T09:00:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.929+0000 7f141a59c640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f13fc06b4d0 0x7f13fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.929+0000 7f141a59c640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f13fc06b4d0 0x7f13fc06d990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f140c034000 tx=0x7f140c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:56.932+0000 7f14137fe640 1 -- 172.21.15.5:0/1771054859 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1414022070 con 0x7f141c15de70 2024-04-25T09:00:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:57.124+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f141c067f80 con 0x7f141c15de70 2024-04-25T09:00:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.207+0000 7f14137fe640 1 -- 172.21.15.5:0/1771054859 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1414010040 con 0x7f141c15de70 2024-04-25T09:00:58.196 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f13fc06b4d0 msgr2=0x7f13fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f13fc06b4d0 0x7f13fc06d990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f140c034000 tx=0x7f140c02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 msgr2=0x7f141c0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b4a20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f141400efc0 tx=0x7f141400c490 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 shutdown_connections 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f13fc06b4d0 0x7f13fc06d990 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c15de70 0x7f141c0b4a20 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f141c0ce7f0 0x7f141c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 --2- 172.21.15.5:0/1771054859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f141c0b2cc0 0x7f141c157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 >> 172.21.15.5:0/1771054859 conn(0x7f141c06b000 msgr2=0x7f141c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 shutdown_connections 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.210+0000 7f1420a9e640 1 -- 172.21.15.5:0/1771054859 wait complete. 2024-04-25T09:00:58.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:00:58.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.326+0000 7f5f9d093640 1 Processor -- start 2024-04-25T09:00:58.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.326+0000 7f5f9d093640 1 -- start start 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9d093640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 0x7f5f980d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9d093640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9815ef10 con 0x7f5f980cea80 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9d093640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9815ff50 con 0x7f5f9806adf0 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9d093640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980cfd60 con 0x7f5f9806bd00 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f96d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f980cea80 0x7f5f9815f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52158/0 (socket says 172.21.15.5:52158) 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f96d9d640 1 -- 172.21.15.5:0/2189249931 learned_addr learned my addr 172.21.15.5:0/2189249931 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9759e640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 0x7f5f980d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291887143 0 0) 0x7f5f9815ef10 con 0x7f5f980cea80 2024-04-25T09:00:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f84003520 con 0x7f5f980cea80 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1230238090 0 0) 0x7f5f84003520 con 0x7f5f980cea80 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 msgr2=0x7f5f980d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 0x7f5f980d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 >> v1:172.21.15.80:6789/0 conn(0x7f5f9806adf0 legacy=0x7f5f9806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9815f1a0 con 0x7f5f980cea80 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f5f88001670 con 0x7f5f980cea80 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.327+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 >> v1:172.21.15.5:6789/0 conn(0x7f5f980cea80 legacy=0x7f5f9815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f9659c640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f840039e0 0x7f5f84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f9659c640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f84004390 0x7f5f84004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f9659c640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 0x7f5f840050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8400b9c0 con 0x7f5f84004390 2024-04-25T09:00:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8400bb70 con 0x7f5f840039e0 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8400bd70 con 0x7f5f9806bd00 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f84004390 0x7f5f84004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f96d9d640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f840039e0 0x7f5f84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f9759e640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 0x7f5f840050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f8ffff640 1 -- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 msgr2=0x7f5f840050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f9806bd00 0x7f5f840050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f8ffff640 1 -- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f840039e0 msgr2=0x7f5f84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f840039e0 0x7f5f84003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.328+0000 7f5f8ffff640 1 -- 172.21.15.5:0/2189249931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84003520 con 0x7f5f84004390 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f84004390 0x7f5f84004860 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5f80001860 tx=0x7f5f84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee846358b15c538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80037070 con 0x7f5f84004390 2024-04-25T09:00:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8002abf0 con 0x7f5f84004390 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9659c640 1 -- 172.21.15.5:0/2189249931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80001430 con 0x7f5f84004390 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9d093640 1 -- 172.21.15.5:0/2189249931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f84004390 msgr2=0x7f5f84004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9d093640 1 --2- 172.21.15.5:0/2189249931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f84004390 0x7f5f84004860 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5f80001860 tx=0x7f5f84005830 comp rx=0 tx=0).stop 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9759e640 1 -- 172.21.15.5:0/2189249931 reap_dead start 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9d093640 1 -- 172.21.15.5:0/2189249931 shutdown_connections 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9d093640 1 -- 172.21.15.5:0/2189249931 >> 172.21.15.5:0/2189249931 conn(0x7f5f980d19f0 msgr2=0x7f5f980d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9d093640 1 -- 172.21.15.5:0/2189249931 shutdown_connections 2024-04-25T09:00:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.329+0000 7f5f9d093640 1 -- 172.21.15.5:0/2189249931 wait complete. 2024-04-25T09:00:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 Processor -- start 2024-04-25T09:00:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 -- start start 2024-04-25T09:00:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f84004390 0x7f5f9814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f981f39c0 0x7f5f9815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f9815bd20 0x7f5f981e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980d0270 con 0x7f5f981f39c0 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9815f480 con 0x7f5f9815bd20 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.331+0000 7f5f9d093640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980d1660 con 0x7f5f84004390 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f981f39c0 0x7f5f9815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f981f39c0 0x7f5f9815b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55470/0 (socket says 172.21.15.5:55470) 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 -- 172.21.15.5:0/4044168001 learned_addr learned my addr 172.21.15.5:0/4044168001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f9759e640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f9815bd20 0x7f5f981e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f96d9d640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f84004390 0x7f5f9814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 -- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f84004390 msgr2=0x7f5f9814d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f84004390 0x7f5f9814d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 -- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f9815bd20 msgr2=0x7f5f981e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f9815bd20 0x7f5f981e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 -- 172.21.15.5:0/4044168001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9815c1c0 con 0x7f5f981f39c0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f96d9d640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f84004390 0x7f5f9814d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f9759e640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f9815bd20 0x7f5f981e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f981f39c0 0x7f5f9815b7e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f5f80001980 tx=0x7f5f80001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/4044168001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8003f020 con 0x7f5f981f39c0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/4044168001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80005270 con 0x7f5f981f39c0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/4044168001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80037040 con 0x7f5f981f39c0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9815c4a0 con 0x7f5f981f39c0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.332+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f980b4640 con 0x7f5f981f39c0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.333+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9804ef20 con 0x7f5f981f39c0 2024-04-25T09:00:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.334+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/4044168001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f80042020 con 0x7f5f981f39c0 2024-04-25T09:00:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.334+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5f7806b500 0x7f5f7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.334+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/4044168001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f800a9e00 con 0x7f5f981f39c0 2024-04-25T09:00:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.334+0000 7f5f96d9d640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5f7806b500 0x7f5f7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.335+0000 7f5f96d9d640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5f7806b500 0x7f5f7806d9c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5f981e7020 tx=0x7f5f88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.338+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/4044168001 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f80049030 con 0x7f5f981f39c0 2024-04-25T09:00:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.586+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5f980cefa0 con 0x7f5f981f39c0 2024-04-25T09:00:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.587+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/4044168001 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5f80078fd0 con 0x7f5f981f39c0 2024-04-25T09:00:58.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:58.576 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:00:58.576 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T09:00:58.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.580 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.582 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T09:00:58.583 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:00:58.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.586 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T09:00:58.586 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T09:00:58.586 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.586 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T09:00:58.588 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T09:00:58.590 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5f7806b500 msgr2=0x7f5f7806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5f7806b500 0x7f5f7806d9c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5f981e7020 tx=0x7f5f88009040 comp rx=0 tx=0).stop 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f981f39c0 msgr2=0x7f5f9815b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f981f39c0 0x7f5f9815b7e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f5f80001980 tx=0x7f5f80001230 comp rx=0 tx=0).stop 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 shutdown_connections 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5f7806b500 0x7f5f7806d9c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f9815bd20 0x7f5f981e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f981f39c0 0x7f5f9815b7e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 --2- 172.21.15.5:0/4044168001 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5f84004390 0x7f5f9814d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 >> 172.21.15.5:0/4044168001 conn(0x7f5f980d19f0 msgr2=0x7f5f980b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 shutdown_connections 2024-04-25T09:00:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.589+0000 7f5f9d093640 1 -- 172.21.15.5:0/4044168001 wait complete. 2024-04-25T09:00:58.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:58.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.704+0000 7f2b4feee640 1 Processor -- start 2024-04-25T09:00:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.704+0000 7f2b4feee640 1 -- start start 2024-04-25T09:00:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.705+0000 7f2b4feee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b480cea80 0x7f2b4815f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.705+0000 7f2b4feee640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4815ef10 con 0x7f2b4806bd00 2024-04-25T09:00:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.705+0000 7f2b4feee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4815f1a0 con 0x7f2b4815fd80 2024-04-25T09:00:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.705+0000 7f2b4feee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480cfd60 con 0x7f2b480cea80 2024-04-25T09:00:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.705+0000 7f2b4e48b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b4806bd00 0x7f2b480d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52162/0 (socket says 172.21.15.5:52162) 2024-04-25T09:00:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.705+0000 7f2b4e48b640 1 -- 172.21.15.5:0/2110881918 learned_addr learned my addr 172.21.15.5:0/2110881918 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/2110881918 >> v2:172.21.15.80:3300/0 conn(0x7f2b480cea80 0x7f2b4815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928715763 0 0) 0x7f2b4815ef10 con 0x7f2b4806bd00 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b30003520 con 0x7f2b4806bd00 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1349474208 0 0) 0x7f2b30003520 con 0x7f2b4806bd00 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 >> v2:172.21.15.80:3300/0 conn(0x7f2b480cea80 msgr2=0x7f2b4815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 --2- 172.21.15.5:0/2110881918 >> v2:172.21.15.80:3300/0 conn(0x7f2b480cea80 0x7f2b4815f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 >> v1:172.21.15.80:6789/0 conn(0x7f2b4815fd80 legacy=0x7f2b4806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480cff90 con 0x7f2b4806bd00 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2b38001670 con 0x7f2b4806bd00 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 >> v1:172.21.15.5:6789/0 conn(0x7f2b4806bd00 legacy=0x7f2b480d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b30004800 0x7f2b30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b300051c0 0x7f2b3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3000c030 con 0x7f2b300039b0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3000c1e0 con 0x7f2b300051c0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3000c3e0 con 0x7f2b30004800 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4e48b640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b300051c0 0x7f2b3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4d489640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b30004800 0x7f2b30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4dc8a640 1 -- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b30004800 msgr2=0x7f2b30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b30004800 0x7f2b30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4dc8a640 1 -- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b300051c0 msgr2=0x7f2b3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b300051c0 0x7f2b3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4e48b640 1 -- 172.21.15.5:0/2110881918 reap_dead start 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.706+0000 7f2b4dc8a640 1 -- 172.21.15.5:0/2110881918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b30003520 con 0x7f2b300039b0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.707+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b30003dd0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009fc0 tx=0x7f2b30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f11b65f6b82d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.707+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40009c10 con 0x7f2b300039b0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.707+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40036070 con 0x7f2b300039b0 2024-04-25T09:00:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.707+0000 7f2b4cc88640 1 -- 172.21.15.5:0/2110881918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40031880 con 0x7f2b300039b0 2024-04-25T09:00:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.708+0000 7f2b4feee640 1 -- 172.21.15.5:0/2110881918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 msgr2=0x7f2b30003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.708+0000 7f2b4feee640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b30003dd0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009fc0 tx=0x7f2b30005830 comp rx=0 tx=0).stop 2024-04-25T09:00:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.708+0000 7f2b4feee640 1 -- 172.21.15.5:0/2110881918 shutdown_connections 2024-04-25T09:00:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.708+0000 7f2b4feee640 1 --2- 172.21.15.5:0/2110881918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b30003dd0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.708+0000 7f2b4feee640 1 -- 172.21.15.5:0/2110881918 >> 172.21.15.5:0/2110881918 conn(0x7f2b480d19f0 msgr2=0x7f2b480d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.708+0000 7f2b4feee640 1 -- 172.21.15.5:0/2110881918 shutdown_connections 2024-04-25T09:00:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.708+0000 7f2b4feee640 1 -- 172.21.15.5:0/2110881918 wait complete. 2024-04-25T09:00:58.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.709+0000 7f2b4feee640 1 Processor -- start 2024-04-25T09:00:58.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.709+0000 7f2b4feee640 1 -- start start 2024-04-25T09:00:58.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4feee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b48157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4feee640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b481f6f90 0x7f2b481f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4feee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b480b5830 0x7f2b480b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4feee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480d1660 con 0x7f2b300039b0 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4feee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4815f480 con 0x7f2b480b5830 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4feee640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480d17e0 con 0x7f2b481f6f90 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b48157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b48157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55486/0 (socket says 172.21.15.5:55486) 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 -- 172.21.15.5:0/3123302732 learned_addr learned my addr 172.21.15.5:0/3123302732 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4d489640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b481f6f90 0x7f2b481f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4e48b640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b480b5830 0x7f2b480b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 -- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b481f6f90 msgr2=0x7f2b481f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b481f6f90 0x7f2b481f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 -- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b480b5830 msgr2=0x7f2b480b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b480b5830 0x7f2b480b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4dc8a640 1 -- 172.21.15.5:0/3123302732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480b65a0 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.710+0000 7f2b4e48b640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b480b5830 0x7f2b480b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.711+0000 7f2b4dc8a640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b48157190 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2b4002aee0 tx=0x7f2b40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.711+0000 7f2b467fc640 1 -- 172.21.15.5:0/3123302732 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40009c10 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.711+0000 7f2b467fc640 1 -- 172.21.15.5:0/3123302732 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40003990 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.711+0000 7f2b467fc640 1 -- 172.21.15.5:0/3123302732 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40003d80 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.711+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b480b6880 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.711+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b480b61f0 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.712+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4804ef20 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.712+0000 7f2b467fc640 1 -- 172.21.15.5:0/3123302732 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b40005d10 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.713+0000 7f2b467fc640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b3406b4d0 0x7f2b3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.713+0000 7f2b467fc640 1 -- 172.21.15.5:0/3123302732 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b400ab1f0 con 0x7f2b300039b0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.713+0000 7f2b4d489640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b3406b4d0 0x7f2b3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.713+0000 7f2b4d489640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b3406b4d0 0x7f2b3406d990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c000c00 tx=0x7f2b3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.717+0000 7f2b467fc640 1 -- 172.21.15.5:0/3123302732 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2b4007a450 con 0x7f2b300039b0 2024-04-25T09:00:58.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.901+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b480b6a50 con 0x7f2b300039b0 2024-04-25T09:00:58.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.902+0000 7f2b467fc640 1 -- 172.21.15.5:0/3123302732 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+12807 (secure 0 0 0) 0x7f2b40079d50 con 0x7f2b300039b0 2024-04-25T09:00:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:58.891 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:00:58.206761+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:58.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b3406b4d0 msgr2=0x7f2b3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b3406b4d0 0x7f2b3406d990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c000c00 tx=0x7f2b3c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:58.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 msgr2=0x7f2b48157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b48157190 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2b4002aee0 tx=0x7f2b40009750 comp rx=0 tx=0).stop 2024-04-25T09:00:58.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 shutdown_connections 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b3406b4d0 0x7f2b3406d990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b480b5830 0x7f2b480b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b481f6f90 0x7f2b481f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 --2- 172.21.15.5:0/3123302732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b300039b0 0x7f2b48157190 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 >> 172.21.15.5:0/3123302732 conn(0x7f2b480d19f0 msgr2=0x7f2b480afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 shutdown_connections 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:58.904+0000 7f2b4feee640 1 -- 172.21.15.5:0/3123302732 wait complete. 2024-04-25T09:00:58.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:58.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.019+0000 7f082e007640 1 Processor -- start 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.019+0000 7f082e007640 1 -- start start 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f082e007640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f082815e0b0 0x7f082806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f082e007640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08280cc780 0x7f08280ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f082e007640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08280d27f0 con 0x7f08280d0c80 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f082e007640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280cfee0 con 0x7f08280cc780 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f082e007640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280d01c0 con 0x7f082815e0b0 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f0827fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08280cc780 0x7f08280ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f0827fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08280cc780 0x7f08280ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55490/0 (socket says 172.21.15.5:55490) 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.020+0000 7f0827fff640 1 -- 172.21.15.5:0/4130701307 learned_addr learned my addr 172.21.15.5:0/4130701307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f08277fe640 1 --2- 172.21.15.5:0/4130701307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f082815e0b0 0x7f082806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f0827fff640 1 -- 172.21.15.5:0/4130701307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f082815e0b0 msgr2=0x7f082806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f0827fff640 1 --2- 172.21.15.5:0/4130701307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f082815e0b0 0x7f082806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f0827fff640 1 -- 172.21.15.5:0/4130701307 >> v1:172.21.15.80:6789/0 conn(0x7f08280d0c80 legacy=0x7f08280cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f0827fff640 1 -- 172.21.15.5:0/4130701307 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280d04a0 con 0x7f08280cc780 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f08277fe640 1 --2- 172.21.15.5:0/4130701307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f082815e0b0 0x7f082806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f0827fff640 1 --2- 172.21.15.5:0/4130701307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280cc780 0x7f08280ce3b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0820009e50 tx=0x7f082002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f6c9d96aa153b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.021+0000 7f08267fc640 1 -- 172.21.15.5:0/4130701307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820036070 con 0x7f08280cc780 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f08267fc640 1 -- 172.21.15.5:0/4130701307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0820031600 con 0x7f08280cc780 2024-04-25T09:00:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f08267fc640 1 -- 172.21.15.5:0/4130701307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200319d0 con 0x7f08280cc780 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 -- 172.21.15.5:0/4130701307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280cc780 msgr2=0x7f08280ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 --2- 172.21.15.5:0/4130701307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280cc780 0x7f08280ce3b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0820009e50 tx=0x7f082002a6c0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 -- 172.21.15.5:0/4130701307 shutdown_connections 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 --2- 172.21.15.5:0/4130701307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280cc780 0x7f08280ce3b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 --2- 172.21.15.5:0/4130701307 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f082815e0b0 0x7f082806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 -- 172.21.15.5:0/4130701307 >> 172.21.15.5:0/4130701307 conn(0x7f08280d1a20 msgr2=0x7f08280d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 -- 172.21.15.5:0/4130701307 shutdown_connections 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.022+0000 7f082e007640 1 -- 172.21.15.5:0/4130701307 wait complete. 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.023+0000 7f082e007640 1 Processor -- start 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.023+0000 7f082e007640 1 -- start start 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f082e007640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08280cc780 0x7f082815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f082e007640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280d0c80 0x7f08280c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f082e007640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f082815e0b0 0x7f08280c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f082e007640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280cfb90 con 0x7f08280d0c80 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f082e007640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082815e490 con 0x7f082815e0b0 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f082e007640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280ccc10 con 0x7f08280cc780 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f0826ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280d0c80 0x7f08280c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f0826ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280d0c80 0x7f08280c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55504/0 (socket says 172.21.15.5:55504) 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f0826ffd640 1 -- 172.21.15.5:0/3603354319 learned_addr learned my addr 172.21.15.5:0/3603354319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f0827fff640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f082815e0b0 0x7f08280c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.024+0000 7f08277fe640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08280cc780 0x7f082815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f0826ffd640 1 -- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08280cc780 msgr2=0x7f082815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f0826ffd640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08280cc780 0x7f082815a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f0826ffd640 1 -- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f082815e0b0 msgr2=0x7f08280c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f0826ffd640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f082815e0b0 0x7f08280c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f0826ffd640 1 -- 172.21.15.5:0/3603354319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082815a710 con 0x7f08280d0c80 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f08277fe640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08280cc780 0x7f082815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f0827fff640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f082815e0b0 0x7f08280c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f0826ffd640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280d0c80 0x7f08280c8af0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c430 tx=0x7f081c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f080ffff640 1 -- 172.21.15.5:0/3603354319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c011790 con 0x7f08280d0c80 2024-04-25T09:00:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f080ffff640 1 -- 172.21.15.5:0/3603354319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c017070 con 0x7f08280d0c80 2024-04-25T09:00:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08280c94d0 con 0x7f08280d0c80 2024-04-25T09:00:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f080ffff640 1 -- 172.21.15.5:0/3603354319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c011bb0 con 0x7f08280d0c80 2024-04-25T09:00:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.025+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08280c9e00 con 0x7f08280d0c80 2024-04-25T09:00:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.026+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082804ef20 con 0x7f08280d0c80 2024-04-25T09:00:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.027+0000 7f080ffff640 1 -- 172.21.15.5:0/3603354319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f081c01c460 con 0x7f08280d0c80 2024-04-25T09:00:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.027+0000 7f080ffff640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f081406b4d0 0x7f081406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.027+0000 7f080ffff640 1 -- 172.21.15.5:0/3603354319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f081c089d10 con 0x7f08280d0c80 2024-04-25T09:00:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.027+0000 7f08277fe640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f081406b4d0 0x7f081406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.028+0000 7f08277fe640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f081406b4d0 0x7f081406d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f081800a990 tx=0x7f0818008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.031+0000 7f080ffff640 1 -- 172.21.15.5:0/3603354319 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f082815a710 con 0x7f08280d0c80 2024-04-25T09:00:59.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.214+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08280cc380 con 0x7f08280d0c80 2024-04-25T09:00:59.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.215+0000 7f080ffff640 1 -- 172.21.15.5:0/3603354319 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f081c058ee0 con 0x7f08280d0c80 2024-04-25T09:00:59.204 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:00:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f081406b4d0 msgr2=0x7f081406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f081406b4d0 0x7f081406d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f081800a990 tx=0x7f0818008040 comp rx=0 tx=0).stop 2024-04-25T09:00:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280d0c80 msgr2=0x7f08280c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280d0c80 0x7f08280c8af0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c430 tx=0x7f081c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 shutdown_connections 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f081406b4d0 0x7f081406d990 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f082815e0b0 0x7f08280c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08280d0c80 0x7f08280c8af0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 --2- 172.21.15.5:0/3603354319 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08280cc780 0x7f082815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 >> 172.21.15.5:0/3603354319 conn(0x7f08280d1a20 msgr2=0x7f082806ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 shutdown_connections 2024-04-25T09:00:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.217+0000 7f082e007640 1 -- 172.21.15.5:0/3603354319 wait complete. 2024-04-25T09:00:59.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:00:59.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.329+0000 7fc436e1b640 1 Processor -- start 2024-04-25T09:00:59.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.329+0000 7fc436e1b640 1 -- start start 2024-04-25T09:00:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.329+0000 7fc436e1b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc43006adf0 0x7fc43006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.329+0000 7fc436e1b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43015ef10 con 0x7fc4300cea80 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.329+0000 7fc436e1b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43006bf10 con 0x7fc43006bb30 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.329+0000 7fc436e1b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4300cfd60 con 0x7fc43006adf0 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc434bb7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc4300cea80 0x7fc43015f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52166/0 (socket says 172.21.15.5:52166) 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc434bb7640 1 -- 172.21.15.5:0/3186902024 learned_addr learned my addr 172.21.15.5:0/3186902024 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42ffff640 1 --2- 172.21.15.5:0/3186902024 >> v2:172.21.15.80:3300/0 conn(0x7fc43006adf0 0x7fc43006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633064041 0 0) 0x7fc43015ef10 con 0x7fc4300cea80 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc41c003520 con 0x7fc4300cea80 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652528632 0 0) 0x7fc43006bf10 con 0x7fc43006bb30 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc43015ef10 con 0x7fc43006bb30 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42ffff640 1 -- 172.21.15.5:0/3186902024 >> v1:172.21.15.80:6789/0 conn(0x7fc43006bb30 legacy=0x7fc4300d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3590773148 0 0) 0x7fc41c003520 con 0x7fc4300cea80 2024-04-25T09:00:59.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42ffff640 1 -- 172.21.15.5:0/3186902024 >> v1:172.21.15.5:6789/0 conn(0x7fc4300cea80 legacy=0x7fc43015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.330+0000 7fc42ffff640 1 -- 172.21.15.5:0/3186902024 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43015ff50 con 0x7fc43006adf0 2024-04-25T09:00:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.331+0000 7fc42ffff640 1 --2- 172.21.15.5:0/3186902024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc43006adf0 0x7fc43006b5f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc4200097a0 tx=0x7fc42002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e11c31fe7fc79ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.331+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420037070 con 0x7fc43006adf0 2024-04-25T09:00:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.331+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42002ac50 con 0x7fc43006adf0 2024-04-25T09:00:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.331+0000 7fc42f7fe640 1 -- 172.21.15.5:0/3186902024 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280019f0 con 0x7fc43006adf0 2024-04-25T09:00:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.332+0000 7fc436e1b640 1 -- 172.21.15.5:0/3186902024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc43006adf0 msgr2=0x7fc43006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.332+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3186902024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc43006adf0 0x7fc43006b5f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc4200097a0 tx=0x7fc42002a1c0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.332+0000 7fc436e1b640 1 -- 172.21.15.5:0/3186902024 shutdown_connections 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.332+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3186902024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc43006adf0 0x7fc43006b5f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.332+0000 7fc436e1b640 1 -- 172.21.15.5:0/3186902024 >> 172.21.15.5:0/3186902024 conn(0x7fc4300d19f0 msgr2=0x7fc4300d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.332+0000 7fc436e1b640 1 -- 172.21.15.5:0/3186902024 shutdown_connections 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.332+0000 7fc436e1b640 1 -- 172.21.15.5:0/3186902024 wait complete. 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.333+0000 7fc436e1b640 1 Processor -- start 2024-04-25T09:00:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.333+0000 7fc436e1b640 1 -- start start 2024-04-25T09:00:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc436e1b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc43006adf0 0x7fc4300b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc436e1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc43006bb30 0x7fc4300b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc436e1b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4300cea80 0x7fc430157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc436e1b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300cff90 con 0x7fc43006bb30 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc436e1b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015f480 con 0x7fc4300cea80 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc436e1b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300d0270 con 0x7fc43006adf0 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc43006bb30 0x7fc4300b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc43006bb30 0x7fc4300b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55514/0 (socket says 172.21.15.5:55514) 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 -- 172.21.15.5:0/3221998470 learned_addr learned my addr 172.21.15.5:0/3221998470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc4353b8640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4300cea80 0x7fc430157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc434bb7640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc43006adf0 0x7fc4300b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 -- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc43006adf0 msgr2=0x7fc4300b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc43006adf0 0x7fc4300b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 -- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4300cea80 msgr2=0x7fc430157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4300cea80 0x7fc430157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 -- 172.21.15.5:0/3221998470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430158170 con 0x7fc43006bb30 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.334+0000 7fc42ffff640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc43006bb30 0x7fc4300b5a70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc420035040 tx=0x7fc4200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.335+0000 7fc42d7fa640 1 -- 172.21.15.5:0/3221998470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420037050 con 0x7fc43006bb30 2024-04-25T09:00:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.335+0000 7fc42d7fa640 1 -- 172.21.15.5:0/3221998470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420043070 con 0x7fc43006bb30 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.335+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4300b49d0 con 0x7fc43006bb30 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.335+0000 7fc42d7fa640 1 -- 172.21.15.5:0/3221998470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420006e10 con 0x7fc43006bb30 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.335+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4300b4f90 con 0x7fc43006bb30 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.336+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43004ef20 con 0x7fc43006bb30 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.336+0000 7fc42d7fa640 1 -- 172.21.15.5:0/3221998470 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc42003c850 con 0x7fc43006bb30 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.337+0000 7fc42d7fa640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc41006b500 0x7fc41006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.337+0000 7fc42d7fa640 1 -- 172.21.15.5:0/3221998470 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc4200aa6b0 con 0x7fc43006bb30 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.337+0000 7fc434bb7640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc41006b500 0x7fc41006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.337+0000 7fc434bb7640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc41006b500 0x7fc41006d9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc428001560 tx=0x7fc428009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.341+0000 7fc42d7fa640 1 -- 172.21.15.5:0/3221998470 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc420030e20 con 0x7fc43006bb30 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.525+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4300cefa0 con 0x7fc43006bb30 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.526+0000 7fc42d7fa640 1 -- 172.21.15.5:0/3221998470 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc420079910 con 0x7fc43006bb30 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T09:00:59.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:00:59.516 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T09:00:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc41006b500 msgr2=0x7fc41006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc41006b500 0x7fc41006d9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc428001560 tx=0x7fc428009040 comp rx=0 tx=0).stop 2024-04-25T09:00:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc43006bb30 msgr2=0x7fc4300b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc43006bb30 0x7fc4300b5a70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc420035040 tx=0x7fc4200046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 shutdown_connections 2024-04-25T09:00:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc41006b500 0x7fc41006d9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4300cea80 0x7fc430157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc43006bb30 0x7fc4300b5a70 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 --2- 172.21.15.5:0/3221998470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc43006adf0 0x7fc4300b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 >> 172.21.15.5:0/3221998470 conn(0x7fc4300d19f0 msgr2=0x7fc4300ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 shutdown_connections 2024-04-25T09:00:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.528+0000 7fc436e1b640 1 -- 172.21.15.5:0/3221998470 wait complete. 2024-04-25T09:00:59.530 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:00:59.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:00:59.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.646+0000 7f9df0d63640 1 Processor -- start 2024-04-25T09:00:59.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.646+0000 7f9df0d63640 1 -- start start 2024-04-25T09:00:59.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9df0d63640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dec15dbd0 0x7f9dec1617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9df0d63640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec162070 con 0x7f9dec0b9470 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9df0d63640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec162350 con 0x7f9dec0ceec0 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9df0d63640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec0d1c50 con 0x7f9dec15dbd0 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9dea59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dec15dbd0 0x7f9dec1617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9de9d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9dec0b9470 0x7f9dec0ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52172/0 (socket says 172.21.15.5:52172) 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9de9d9b640 1 -- 172.21.15.5:0/721304343 learned_addr learned my addr 172.21.15.5:0/721304343 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9dea59c640 1 -- 172.21.15.5:0/721304343 >> v1:172.21.15.80:6789/0 conn(0x7f9dec0ceec0 legacy=0x7f9dec0d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.647+0000 7f9dea59c640 1 -- 172.21.15.5:0/721304343 >> v1:172.21.15.5:6789/0 conn(0x7f9dec0b9470 legacy=0x7f9dec0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.648+0000 7f9dea59c640 1 -- 172.21.15.5:0/721304343 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec0d1f30 con 0x7f9dec15dbd0 2024-04-25T09:00:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.648+0000 7f9de959a640 1 -- 172.21.15.5:0/721304343 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939736822 0 0) 0x7f9dec162070 con 0x7f9dec0b9470 2024-04-25T09:00:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.648+0000 7f9dea59c640 1 --2- 172.21.15.5:0/721304343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec15dbd0 0x7f9dec1617b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0097a0 tx=0x7f9ddc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490bdbab2ed751f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.648+0000 7f9de959a640 1 -- 172.21.15.5:0/721304343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc037070 con 0x7f9dec15dbd0 2024-04-25T09:00:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.648+0000 7f9de959a640 1 -- 172.21.15.5:0/721304343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc032440 con 0x7f9dec15dbd0 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.648+0000 7f9de959a640 1 -- 172.21.15.5:0/721304343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc032810 con 0x7f9dec15dbd0 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.649+0000 7f9df0d63640 1 -- 172.21.15.5:0/721304343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec15dbd0 msgr2=0x7f9dec1617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.649+0000 7f9df0d63640 1 --2- 172.21.15.5:0/721304343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec15dbd0 0x7f9dec1617b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0097a0 tx=0x7f9ddc02a230 comp rx=0 tx=0).stop 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.649+0000 7f9df0d63640 1 -- 172.21.15.5:0/721304343 shutdown_connections 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.649+0000 7f9df0d63640 1 --2- 172.21.15.5:0/721304343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec15dbd0 0x7f9dec1617b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.649+0000 7f9df0d63640 1 -- 172.21.15.5:0/721304343 >> 172.21.15.5:0/721304343 conn(0x7f9dec066ad0 msgr2=0x7f9dec066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.649+0000 7f9df0d63640 1 -- 172.21.15.5:0/721304343 shutdown_connections 2024-04-25T09:00:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.649+0000 7f9df0d63640 1 -- 172.21.15.5:0/721304343 wait complete. 2024-04-25T09:00:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.650+0000 7f9df0d63640 1 Processor -- start 2024-04-25T09:00:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.650+0000 7f9df0d63640 1 -- start start 2024-04-25T09:00:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9df0d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec0b9470 0x7f9dec145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9df0d63640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dec0ceec0 0x7f9dec0c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9df0d63640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dec15dbd0 0x7f9dec0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9df0d63640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec15dfb0 con 0x7f9dec0b9470 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9df0d63640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec161cf0 con 0x7f9dec0ceec0 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9df0d63640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec15e130 con 0x7f9dec15dbd0 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec0b9470 0x7f9dec145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec0b9470 0x7f9dec145c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55534/0 (socket says 172.21.15.5:55534) 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 -- 172.21.15.5:0/1439506762 learned_addr learned my addr 172.21.15.5:0/1439506762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 -- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dec15dbd0 msgr2=0x7f9dec0c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dec15dbd0 0x7f9dec0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 -- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dec0ceec0 msgr2=0x7f9dec0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9de9d9b640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dec0ceec0 0x7f9dec0c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dec0ceec0 0x7f9dec0c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.651+0000 7f9dea59c640 1 -- 172.21.15.5:0/1439506762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec15e450 con 0x7f9dec0b9470 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.652+0000 7f9dea59c640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec0b9470 0x7f9dec145c80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc000c00 tx=0x7f9ddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.652+0000 7f9ddaffd640 1 -- 172.21.15.5:0/1439506762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc037040 con 0x7f9dec0b9470 2024-04-25T09:00:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.652+0000 7f9ddaffd640 1 -- 172.21.15.5:0/1439506762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc042070 con 0x7f9dec0b9470 2024-04-25T09:00:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.652+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec15e730 con 0x7f9dec0b9470 2024-04-25T09:00:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.652+0000 7f9ddaffd640 1 -- 172.21.15.5:0/1439506762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc030a70 con 0x7f9dec0b9470 2024-04-25T09:00:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.652+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec15ecf0 con 0x7f9dec0b9470 2024-04-25T09:00:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.653+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec04ef20 con 0x7f9dec0b9470 2024-04-25T09:00:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.653+0000 7f9ddaffd640 1 -- 172.21.15.5:0/1439506762 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ddc030c10 con 0x7f9dec0b9470 2024-04-25T09:00:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.654+0000 7f9ddaffd640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9dcc06b500 0x7f9dcc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.654+0000 7f9ddaffd640 1 -- 172.21.15.5:0/1439506762 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9ddc0aa970 con 0x7f9dec0b9470 2024-04-25T09:00:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.654+0000 7f9de9d9b640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9dcc06b500 0x7f9dcc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.654+0000 7f9de9d9b640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9dcc06b500 0x7f9dcc06d9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9de0007fd0 tx=0x7f9de0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.658+0000 7f9ddaffd640 1 -- 172.21.15.5:0/1439506762 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ddc079b40 con 0x7f9dec0b9470 2024-04-25T09:00:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:00:59.838+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9dec0b8b40 con 0x7f9dec0b9470 2024-04-25T09:01:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.209+0000 7f9ddaffd640 1 -- 172.21.15.5:0/1439506762 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9ddc079440 con 0x7f9dec0b9470 2024-04-25T09:01:00.199 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T09:01:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9dcc06b500 msgr2=0x7f9dcc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9dcc06b500 0x7f9dcc06d9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9de0007fd0 tx=0x7f9de0009040 comp rx=0 tx=0).stop 2024-04-25T09:01:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec0b9470 msgr2=0x7f9dec145c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec0b9470 0x7f9dec145c80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc000c00 tx=0x7f9ddc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 shutdown_connections 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9dcc06b500 0x7f9dcc06d9c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dec15dbd0 0x7f9dec0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dec0ceec0 0x7f9dec0c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 --2- 172.21.15.5:0/1439506762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dec0b9470 0x7f9dec145c80 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 >> 172.21.15.5:0/1439506762 conn(0x7f9dec066ad0 msgr2=0x7f9dec0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 shutdown_connections 2024-04-25T09:01:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.212+0000 7f9df0d63640 1 -- 172.21.15.5:0/1439506762 wait complete. 2024-04-25T09:01:00.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:01:00.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.335+0000 7f1828541640 1 Processor -- start 2024-04-25T09:01:00.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.335+0000 7f1828541640 1 -- start start 2024-04-25T09:01:00.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1828541640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 0x7f18200b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1828541640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f18200d1f60 0x7f18200d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1828541640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200d2740 con 0x7f18200d4060 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1828541640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200d2a20 con 0x7f18200d1f60 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1828541640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200d2d00 con 0x7f18201614b0 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1826ade640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18200d4060 0x7f18200b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52182/0 (socket says 172.21.15.5:52182) 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1826ade640 1 -- 172.21.15.5:0/1186679640 learned_addr learned my addr 172.21.15.5:0/1186679640 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039527464 0 0) 0x7f18200d2740 con 0x7f18200d4060 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1808003520 con 0x7f18200d4060 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f1825adc640 1 --2- 172.21.15.5:0/1186679640 >> v2:172.21.15.80:3300/0 conn(0x7f18200d1f60 0x7f18200d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.336+0000 7f18262dd640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 0x7f18200b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1933417985 0 0) 0x7f1808003520 con 0x7f18200d4060 2024-04-25T09:01:00.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 msgr2=0x7f18200b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 0x7f18200b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 >> v2:172.21.15.80:3300/0 conn(0x7f18200d1f60 msgr2=0x7f18200d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 --2- 172.21.15.5:0/1186679640 >> v2:172.21.15.80:3300/0 conn(0x7f18200d1f60 0x7f18200d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200d2fe0 con 0x7f18200d4060 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f18100019f0 con 0x7f18200d4060 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 >> v1:172.21.15.5:6789/0 conn(0x7f18200d4060 legacy=0x7f18200b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 0x7f18080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808003f30 0x7f1808004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1808004d40 0x7f18080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200d2a20 con 0x7f1808004d40 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200d2d00 con 0x7f1808003f30 2024-04-25T09:01:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180800b9c0 con 0x7f18201614b0 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1826ade640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1808004d40 0x7f18080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f18262dd640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 0x7f18080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1825adc640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808003f30 0x7f1808004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1826ade640 1 -- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 msgr2=0x7f18080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1826ade640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18201614b0 0x7f18080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1826ade640 1 -- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808003f30 msgr2=0x7f1808004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1826ade640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808003f30 0x7f1808004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1826ade640 1 -- 172.21.15.5:0/1186679640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808003520 con 0x7f1808004d40 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.337+0000 7f1825adc640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808003f30 0x7f1808004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.338+0000 7f1826ade640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1808004d40 0x7f18080051c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f18100013d0 tx=0x7f1808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2762c58deda570bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.338+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000a4e0 con 0x7f1808004d40 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.338+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181002f070 con 0x7f1808004d40 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.338+0000 7f18252db640 1 -- 172.21.15.5:0/1186679640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181002bcd0 con 0x7f1808004d40 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.339+0000 7f1828541640 1 -- 172.21.15.5:0/1186679640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1808004d40 msgr2=0x7f18080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.339+0000 7f1828541640 1 --2- 172.21.15.5:0/1186679640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1808004d40 0x7f18080051c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f18100013d0 tx=0x7f1808005830 comp rx=0 tx=0).stop 2024-04-25T09:01:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.339+0000 7f1826ade640 1 -- 172.21.15.5:0/1186679640 reap_dead start 2024-04-25T09:01:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.339+0000 7f1828541640 1 -- 172.21.15.5:0/1186679640 shutdown_connections 2024-04-25T09:01:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.339+0000 7f1828541640 1 -- 172.21.15.5:0/1186679640 >> 172.21.15.5:0/1186679640 conn(0x7f182006b000 msgr2=0x7f182006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.339+0000 7f1828541640 1 -- 172.21.15.5:0/1186679640 shutdown_connections 2024-04-25T09:01:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.339+0000 7f1828541640 1 -- 172.21.15.5:0/1186679640 wait complete. 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.340+0000 7f1828541640 1 Processor -- start 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.340+0000 7f1828541640 1 -- start start 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1828541640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808004d40 0x7f1820153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1828541640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1820158cc0 0x7f1820159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1828541640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182015c880 0x7f182015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1828541640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200d23a0 con 0x7f182015c880 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1828541640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200d37e0 con 0x7f1808004d40 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1828541640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200d2520 con 0x7f1820158cc0 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182015c880 0x7f182015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182015c880 0x7f182015cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55548/0 (socket says 172.21.15.5:55548) 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 -- 172.21.15.5:0/313557385 learned_addr learned my addr 172.21.15.5:0/313557385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f18262dd640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808004d40 0x7f1820153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1825adc640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1820158cc0 0x7f1820159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 -- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1820158cc0 msgr2=0x7f1820159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1820158cc0 0x7f1820159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 -- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808004d40 msgr2=0x7f1820153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808004d40 0x7f1820153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 -- 172.21.15.5:0/313557385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820159830 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f1826ade640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182015c880 0x7f182015cd00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f181000a980 tx=0x7f1810001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.341+0000 7f181effd640 1 -- 172.21.15.5:0/313557385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814009690 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.342+0000 7f181effd640 1 -- 172.21.15.5:0/313557385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000a4c0 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.342+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1820159b10 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.342+0000 7f181effd640 1 -- 172.21.15.5:0/313557385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810002040 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.342+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182015a0d0 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.343+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182015d240 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.343+0000 7f181effd640 1 -- 172.21.15.5:0/313557385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1810034670 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.344+0000 7f181effd640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f180c06b500 0x7f180c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.344+0000 7f181effd640 1 -- 172.21.15.5:0/313557385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f18100aa030 con 0x7f182015c880 2024-04-25T09:01:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.344+0000 7f18262dd640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f180c06b500 0x7f180c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.345+0000 7f18262dd640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f180c06b500 0x7f180c06d9c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1820154bc0 tx=0x7f1818009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.349+0000 7f181effd640 1 -- 172.21.15.5:0/313557385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1810046060 con 0x7f182015c880 2024-04-25T09:01:00.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:00.534+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f182004ef20 con 0x7f182015c880 2024-04-25T09:01:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.214+0000 7f181effd640 1 -- 172.21.15.5:0/313557385 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1810079090 con 0x7f182015c880 2024-04-25T09:01:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T09:01:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f180c06b500 msgr2=0x7f180c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f180c06b500 0x7f180c06d9c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1820154bc0 tx=0x7f1818009190 comp rx=0 tx=0).stop 2024-04-25T09:01:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182015c880 msgr2=0x7f182015cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182015c880 0x7f182015cd00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f181000a980 tx=0x7f1810001dc0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 shutdown_connections 2024-04-25T09:01:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f180c06b500 0x7f180c06d9c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182015c880 0x7f182015cd00 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1820158cc0 0x7f1820159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 --2- 172.21.15.5:0/313557385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1808004d40 0x7f1820153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 >> 172.21.15.5:0/313557385 conn(0x7f182006b000 msgr2=0x7f182015fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 shutdown_connections 2024-04-25T09:01:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.218+0000 7f1828541640 1 -- 172.21.15.5:0/313557385 wait complete. 2024-04-25T09:01:01.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:01:01.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.351+0000 7f6069076640 1 Processor -- start 2024-04-25T09:01:01.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.351+0000 7f6069076640 1 -- start start 2024-04-25T09:01:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6069076640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f606415df70 0x7f60640b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6069076640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60640d2f70 0x7f60640ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6069076640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60640d1ed0 con 0x7f60640ced50 2024-04-25T09:01:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6069076640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60640d1c80 con 0x7f606415df70 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6069076640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60640d2ae0 con 0x7f60640d2f70 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6062d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f606415df70 0x7f60640b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f606359e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f60640ced50 0x7f60640b55e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37848/0 (socket says 172.21.15.5:37848) 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f606359e640 1 -- 172.21.15.5:0/2605229439 learned_addr learned my addr 172.21.15.5:0/2605229439 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f605bfff640 1 --2- 172.21.15.5:0/2605229439 >> v2:172.21.15.80:3300/0 conn(0x7f60640d2f70 0x7f60640ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6062d9d640 1 -- 172.21.15.5:0/2605229439 >> v2:172.21.15.80:3300/0 conn(0x7f60640d2f70 msgr2=0x7f60640ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6062d9d640 1 --2- 172.21.15.5:0/2605229439 >> v2:172.21.15.80:3300/0 conn(0x7f60640d2f70 0x7f60640ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6062d9d640 1 -- 172.21.15.5:0/2605229439 >> v1:172.21.15.5:6789/0 conn(0x7f60640ced50 legacy=0x7f60640b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f6062d9d640 1 -- 172.21.15.5:0/2605229439 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640d21b0 con 0x7f606415df70 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.352+0000 7f606259c640 1 -- 172.21.15.5:0/2605229439 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874670446 0 0) 0x7f60640d1ed0 con 0x7f60640ced50 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.353+0000 7f6062d9d640 1 --2- 172.21.15.5:0/2605229439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f606415df70 0x7f60640b94d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f60640ce2f0 tx=0x7f605402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91cf8cc75b3ef65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.353+0000 7f606259c640 1 -- 172.21.15.5:0/2605229439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054037070 con 0x7f606415df70 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.353+0000 7f606259c640 1 -- 172.21.15.5:0/2605229439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054032440 con 0x7f606415df70 2024-04-25T09:01:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.353+0000 7f606259c640 1 -- 172.21.15.5:0/2605229439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054032810 con 0x7f606415df70 2024-04-25T09:01:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 -- 172.21.15.5:0/2605229439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f606415df70 msgr2=0x7f60640b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 --2- 172.21.15.5:0/2605229439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f606415df70 0x7f60640b94d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f60640ce2f0 tx=0x7f605402a230 comp rx=0 tx=0).stop 2024-04-25T09:01:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 -- 172.21.15.5:0/2605229439 shutdown_connections 2024-04-25T09:01:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 --2- 172.21.15.5:0/2605229439 >> v2:172.21.15.80:3300/0 conn(0x7f60640d2f70 0x7f60640ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 --2- 172.21.15.5:0/2605229439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f606415df70 0x7f60640b94d0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 -- 172.21.15.5:0/2605229439 >> 172.21.15.5:0/2605229439 conn(0x7f606406b000 msgr2=0x7f606406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 -- 172.21.15.5:0/2605229439 shutdown_connections 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.354+0000 7f6069076640 1 -- 172.21.15.5:0/2605229439 wait complete. 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.355+0000 7f6069076640 1 Processor -- start 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.355+0000 7f6069076640 1 -- start start 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f6069076640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60640ced50 0x7f6064143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f6069076640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60640d2f70 0x7f60641594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f6069076640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6064144fc0 0x7f6064154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f6069076640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640b9a10 con 0x7f60640d2f70 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f6069076640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640d2770 con 0x7f60640ced50 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f6069076640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60640d3720 con 0x7f6064144fc0 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f605bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60640d2f70 0x7f60641594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f605bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60640d2f70 0x7f60641594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55222/0 (socket says 172.21.15.5:55222) 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f605bfff640 1 -- 172.21.15.5:0/196553686 learned_addr learned my addr 172.21.15.5:0/196553686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f6062d9d640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60640ced50 0x7f6064143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f606359e640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6064144fc0 0x7f6064154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f605bfff640 1 -- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6064144fc0 msgr2=0x7f6064154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f605bfff640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6064144fc0 0x7f6064154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f605bfff640 1 -- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60640ced50 msgr2=0x7f6064143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.356+0000 7f605bfff640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60640ced50 0x7f6064143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.357+0000 7f605bfff640 1 -- 172.21.15.5:0/196553686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6064143f20 con 0x7f60640d2f70 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.357+0000 7f605bfff640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60640d2f70 0x7f60641594f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f604c00e8a0 tx=0x7f604c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.357+0000 7f605b7fe640 1 -- 172.21.15.5:0/196553686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c017070 con 0x7f60640d2f70 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.357+0000 7f605b7fe640 1 -- 172.21.15.5:0/196553686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c00c940 con 0x7f60640d2f70 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.357+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6064144200 con 0x7f60640d2f70 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.357+0000 7f605b7fe640 1 -- 172.21.15.5:0/196553686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c00cd30 con 0x7f60640d2f70 2024-04-25T09:01:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.357+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60641447c0 con 0x7f60640d2f70 2024-04-25T09:01:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.358+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606404ef20 con 0x7f60640d2f70 2024-04-25T09:01:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.359+0000 7f605b7fe640 1 -- 172.21.15.5:0/196553686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f604c01a070 con 0x7f60640d2f70 2024-04-25T09:01:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.359+0000 7f605b7fe640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f604406b500 0x7f604406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.359+0000 7f605b7fe640 1 -- 172.21.15.5:0/196553686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f604c08a390 con 0x7f60640d2f70 2024-04-25T09:01:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.359+0000 7f6062d9d640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f604406b500 0x7f604406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.360+0000 7f6062d9d640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f604406b500 0x7f604406d9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f605402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:01.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.364+0000 7f605b7fe640 1 -- 172.21.15.5:0/196553686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f604c058b90 con 0x7f60640d2f70 2024-04-25T09:01:01.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:01.583+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6064159a30 con 0x7f60640d2f70 2024-04-25T09:01:02.217 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 10 and data pool 11 2024-04-25T09:01:02.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.224+0000 7f605b7fe640 1 -- 172.21.15.5:0/196553686 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f604c05cc30 con 0x7f60640d2f70 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f604406b500 msgr2=0x7f604406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f604406b500 0x7f604406d9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f605402e000 comp rx=0 tx=0).stop 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60640d2f70 msgr2=0x7f60641594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60640d2f70 0x7f60641594f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f604c00e8a0 tx=0x7f604c00ed60 comp rx=0 tx=0).stop 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 shutdown_connections 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f604406b500 0x7f604406d9c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6064144fc0 0x7f6064154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60640d2f70 0x7f60641594f0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 --2- 172.21.15.5:0/196553686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60640ced50 0x7f6064143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.228+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 >> 172.21.15.5:0/196553686 conn(0x7f606406b000 msgr2=0x7f606415ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.230+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 shutdown_connections 2024-04-25T09:01:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.230+0000 7f6069076640 1 -- 172.21.15.5:0/196553686 wait complete. 2024-04-25T09:01:02.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:02.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.359+0000 7f77dacf5640 1 Processor -- start 2024-04-25T09:01:02.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.359+0000 7f77dacf5640 1 -- start start 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77dacf5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d40cef60 0x7f77d4161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77dacf5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77d40b94a0 0x7f77d40d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77dacf5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d4161fc0 con 0x7f77d415dc70 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77dacf5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40d2180 con 0x7f77d40cef60 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77dacf5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d4161d90 con 0x7f77d40b94a0 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d40cef60 0x7f77d4161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d40cef60 0x7f77d4161850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55232/0 (socket says 172.21.15.5:55232) 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d3fff640 1 -- 172.21.15.5:0/1202109482 learned_addr learned my addr 172.21.15.5:0/1202109482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d9292640 1 --2- 172.21.15.5:0/1202109482 >> v2:172.21.15.80:3300/0 conn(0x7f77d40b94a0 0x7f77d40d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d3fff640 1 -- 172.21.15.5:0/1202109482 >> v2:172.21.15.80:3300/0 conn(0x7f77d40b94a0 msgr2=0x7f77d40d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d3fff640 1 --2- 172.21.15.5:0/1202109482 >> v2:172.21.15.80:3300/0 conn(0x7f77d40b94a0 0x7f77d40d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d3fff640 1 -- 172.21.15.5:0/1202109482 >> v1:172.21.15.80:6789/0 conn(0x7f77d415dc70 legacy=0x7f77d40ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.360+0000 7f77d3fff640 1 -- 172.21.15.5:0/1202109482 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d41622a0 con 0x7f77d40cef60 2024-04-25T09:01:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.361+0000 7f77d3fff640 1 --2- 172.21.15.5:0/1202109482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40cef60 0x7f77d4161850 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f77d40d14e0 tx=0x7f77c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f570024143919da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.361+0000 7f77d37fe640 1 -- 172.21.15.5:0/1202109482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8037070 con 0x7f77d40cef60 2024-04-25T09:01:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.361+0000 7f77d37fe640 1 -- 172.21.15.5:0/1202109482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c8032440 con 0x7f77d40cef60 2024-04-25T09:01:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.361+0000 7f77d37fe640 1 -- 172.21.15.5:0/1202109482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8032810 con 0x7f77d40cef60 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 -- 172.21.15.5:0/1202109482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40cef60 msgr2=0x7f77d4161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 --2- 172.21.15.5:0/1202109482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40cef60 0x7f77d4161850 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f77d40d14e0 tx=0x7f77c802a270 comp rx=0 tx=0).stop 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 -- 172.21.15.5:0/1202109482 shutdown_connections 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 --2- 172.21.15.5:0/1202109482 >> v2:172.21.15.80:3300/0 conn(0x7f77d40b94a0 0x7f77d40d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 --2- 172.21.15.5:0/1202109482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40cef60 0x7f77d4161850 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 -- 172.21.15.5:0/1202109482 >> 172.21.15.5:0/1202109482 conn(0x7f77d40668f0 msgr2=0x7f77d4066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 -- 172.21.15.5:0/1202109482 shutdown_connections 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.362+0000 7f77dacf5640 1 -- 172.21.15.5:0/1202109482 wait complete. 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.363+0000 7f77dacf5640 1 Processor -- start 2024-04-25T09:01:02.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.363+0000 7f77dacf5640 1 -- start start 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77dacf5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40b94a0 0x7f77d40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77dacf5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77d40cef60 0x7f77d40b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77dacf5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77d415dc70 0x7f77d414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77dacf5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415e050 con 0x7f77d40b94a0 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77dacf5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40d11f0 con 0x7f77d415dc70 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77dacf5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415e1d0 con 0x7f77d40cef60 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40b94a0 0x7f77d40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40b94a0 0x7f77d40c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55238/0 (socket says 172.21.15.5:55238) 2024-04-25T09:01:02.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 -- 172.21.15.5:0/4179469232 learned_addr learned my addr 172.21.15.5:0/4179469232 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d9292640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77d415dc70 0x7f77d414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 -- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77d40cef60 msgr2=0x7f77d40b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77d40cef60 0x7f77d40b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 -- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77d415dc70 msgr2=0x7f77d414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77d415dc70 0x7f77d414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.364+0000 7f77d8a91640 1 -- 172.21.15.5:0/4179469232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40b4e90 con 0x7f77d40b94a0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.365+0000 7f77d8a91640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40b94a0 0x7f77d40c9d30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c3f0 tx=0x7f77c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.365+0000 7f77d17fa640 1 -- 172.21.15.5:0/4179469232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40052d0 con 0x7f77d40b94a0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.365+0000 7f77d17fa640 1 -- 172.21.15.5:0/4179469232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4005470 con 0x7f77d40b94a0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.365+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40b5170 con 0x7f77d40b94a0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.365+0000 7f77d17fa640 1 -- 172.21.15.5:0/4179469232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4007260 con 0x7f77d40b94a0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.365+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d40b5730 con 0x7f77d40b94a0 2024-04-25T09:01:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.366+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d404ef20 con 0x7f77d40b94a0 2024-04-25T09:01:02.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.366+0000 7f77d17fa640 1 -- 172.21.15.5:0/4179469232 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77c4007400 con 0x7f77d40b94a0 2024-04-25T09:01:02.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.367+0000 7f77d17fa640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77c006b4d0 0x7f77c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.367+0000 7f77d17fa640 1 -- 172.21.15.5:0/4179469232 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77c4089700 con 0x7f77d40b94a0 2024-04-25T09:01:02.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.367+0000 7f77d3fff640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77c006b4d0 0x7f77c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.368+0000 7f77d3fff640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77c006b4d0 0x7f77c006d990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f77c8034000 tx=0x7f77c802c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.371+0000 7f77d17fa640 1 -- 172.21.15.5:0/4179469232 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f77c40584f0 con 0x7f77d40b94a0 2024-04-25T09:01:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.552+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77d40b7050 con 0x7f77d40b94a0 2024-04-25T09:01:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.553+0000 7f77d17fa640 1 -- 172.21.15.5:0/4179469232 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16597 (secure 0 0 0) 0x7f77c4057df0 con 0x7f77d40b94a0 2024-04-25T09:01:02.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:02.543 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:01:01.584671+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:59.869846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:00.565749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77c006b4d0 msgr2=0x7f77c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77c006b4d0 0x7f77c006d990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f77c8034000 tx=0x7f77c802c000 comp rx=0 tx=0).stop 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40b94a0 msgr2=0x7f77d40c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40b94a0 0x7f77d40c9d30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c3f0 tx=0x7f77c400c8b0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 shutdown_connections 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77c006b4d0 0x7f77c006d990 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77d415dc70 0x7f77d414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77d40cef60 0x7f77d40b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 --2- 172.21.15.5:0/4179469232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40b94a0 0x7f77d40c9d30 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 >> 172.21.15.5:0/4179469232 conn(0x7f77d40668f0 msgr2=0x7f77d40b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 shutdown_connections 2024-04-25T09:01:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.555+0000 7f77dacf5640 1 -- 172.21.15.5:0/4179469232 wait complete. 2024-04-25T09:01:02.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.667+0000 7f346cf4f640 1 Processor -- start 2024-04-25T09:01:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.667+0000 7f346cf4f640 1 -- start start 2024-04-25T09:01:02.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f346cf4f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34680b2cc0 0x7f34680b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f346cf4f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b7130 0x7f34680ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f346cf4f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34680d20e0 con 0x7f346815de70 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f346cf4f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34680d2a10 con 0x7f34680b2cc0 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f346cf4f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34680d23c0 con 0x7f34680b7130 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f345ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34680b2cc0 0x7f34680b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f3466d9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b7130 0x7f34680ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f346659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f346815de70 0x7f34680b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:50422/0 (socket says 172.21.15.5:50422) 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.668+0000 7f346659c640 1 -- 172.21.15.5:0/2956318394 learned_addr learned my addr 172.21.15.5:0/2956318394 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.669+0000 7f345ffff640 1 -- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b7130 msgr2=0x7f34680ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.669+0000 7f345ffff640 1 --2- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b7130 0x7f34680ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.669+0000 7f345ffff640 1 -- 172.21.15.5:0/2956318394 >> v1:172.21.15.80:6789/0 conn(0x7f346815de70 legacy=0x7f34680b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.669+0000 7f345ffff640 1 -- 172.21.15.5:0/2956318394 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34680d26a0 con 0x7f34680b2cc0 2024-04-25T09:01:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.669+0000 7f3466d9d640 1 --2- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b7130 0x7f34680ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:02.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.669+0000 7f345ffff640 1 --2- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b2cc0 0x7f34680b6bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f34500097a0 tx=0x7f345002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e0886cc4b736623 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.669+0000 7f3465d9b640 1 -- 172.21.15.5:0/2956318394 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450037070 con 0x7f34680b2cc0 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f3465d9b640 1 -- 172.21.15.5:0/2956318394 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450032440 con 0x7f34680b2cc0 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f3465d9b640 1 -- 172.21.15.5:0/2956318394 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450032810 con 0x7f34680b2cc0 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 -- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b2cc0 msgr2=0x7f34680b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b2cc0 0x7f34680b6bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f34500097a0 tx=0x7f345002a180 comp rx=0 tx=0).stop 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 -- 172.21.15.5:0/2956318394 shutdown_connections 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b7130 0x7f34680ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2956318394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b2cc0 0x7f34680b6bf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 -- 172.21.15.5:0/2956318394 >> 172.21.15.5:0/2956318394 conn(0x7f346806b000 msgr2=0x7f346806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 -- 172.21.15.5:0/2956318394 shutdown_connections 2024-04-25T09:01:02.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.670+0000 7f346cf4f640 1 -- 172.21.15.5:0/2956318394 wait complete. 2024-04-25T09:01:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.671+0000 7f346cf4f640 1 Processor -- start 2024-04-25T09:01:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.671+0000 7f346cf4f640 1 -- start start 2024-04-25T09:01:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f346cf4f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b2cc0 0x7f3468149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f346cf4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b7130 0x7f34680b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f346cf4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f346815de70 0x7f34680b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f346cf4f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34680cf100 con 0x7f346815de70 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f346cf4f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34680cef80 con 0x7f34680b7130 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f346cf4f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34680d2ea0 con 0x7f34680b2cc0 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f3466d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f346815de70 0x7f34680b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f3466d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f346815de70 0x7f34680b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55254/0 (socket says 172.21.15.5:55254) 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f3466d9d640 1 -- 172.21.15.5:0/2214052807 learned_addr learned my addr 172.21.15.5:0/2214052807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f346659c640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b2cc0 0x7f3468149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.672+0000 7f345ffff640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b7130 0x7f34680b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f3466d9d640 1 -- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b2cc0 msgr2=0x7f3468149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f3466d9d640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b2cc0 0x7f3468149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f3466d9d640 1 -- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b7130 msgr2=0x7f34680b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f3466d9d640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b7130 0x7f34680b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f3466d9d640 1 -- 172.21.15.5:0/2214052807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346814c590 con 0x7f346815de70 2024-04-25T09:01:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f346659c640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b2cc0 0x7f3468149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f3466d9d640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f346815de70 0x7f34680b5600 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f346000efc0 tx=0x7f3460009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f345effd640 1 -- 172.21.15.5:0/2214052807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460018030 con 0x7f346815de70 2024-04-25T09:01:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f345effd640 1 -- 172.21.15.5:0/2214052807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000cde0 con 0x7f346815de70 2024-04-25T09:01:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f345effd640 1 -- 172.21.15.5:0/2214052807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460003bb0 con 0x7f346815de70 2024-04-25T09:01:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346814c870 con 0x7f346815de70 2024-04-25T09:01:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.673+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346814ce30 con 0x7f346815de70 2024-04-25T09:01:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.674+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346804ef20 con 0x7f346815de70 2024-04-25T09:01:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.675+0000 7f345effd640 1 -- 172.21.15.5:0/2214052807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f346001b070 con 0x7f346815de70 2024-04-25T09:01:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.675+0000 7f345effd640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f344806b4d0 0x7f344806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.675+0000 7f345effd640 1 -- 172.21.15.5:0/2214052807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f346008ad10 con 0x7f346815de70 2024-04-25T09:01:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.675+0000 7f346659c640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f344806b4d0 0x7f344806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.676+0000 7f346659c640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f344806b4d0 0x7f344806d990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3458000f60 tx=0x7f3458009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.679+0000 7f345effd640 1 -- 172.21.15.5:0/2214052807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3460010040 con 0x7f346815de70 2024-04-25T09:01:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.862+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34681610d0 con 0x7f346815de70 2024-04-25T09:01:02.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.863+0000 7f345effd640 1 -- 172.21.15.5:0/2214052807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16597 (secure 0 0 0) 0x7f3460059b10 con 0x7f346815de70 2024-04-25T09:01:02.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:02.853 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:01:01.584671+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:59.869846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:00.565749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f344806b4d0 msgr2=0x7f344806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f344806b4d0 0x7f344806d990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3458000f60 tx=0x7f3458009040 comp rx=0 tx=0).stop 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f346815de70 msgr2=0x7f34680b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f346815de70 0x7f34680b5600 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f346000efc0 tx=0x7f3460009f90 comp rx=0 tx=0).stop 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 shutdown_connections 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f344806b4d0 0x7f344806d990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f346815de70 0x7f34680b5600 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34680b7130 0x7f34680b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 --2- 172.21.15.5:0/2214052807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34680b2cc0 0x7f3468149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.865+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 >> 172.21.15.5:0/2214052807 conn(0x7f346806b000 msgr2=0x7f346815e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.866+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 shutdown_connections 2024-04-25T09:01:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.866+0000 7f346cf4f640 1 -- 172.21.15.5:0/2214052807 wait complete. 2024-04-25T09:01:02.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:01:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.983+0000 7fd2c0cb3640 1 Processor -- start 2024-04-25T09:01:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.983+0000 7fd2c0cb3640 1 -- start start 2024-04-25T09:01:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.984+0000 7fd2c0cb3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2bc0b96e0 0x7fd2bc0d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.984+0000 7fd2c0cb3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0b9b20 con 0x7fd2bc0d4060 2024-04-25T09:01:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.984+0000 7fd2c0cb3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0d2740 con 0x7fd2bc1614b0 2024-04-25T09:01:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.984+0000 7fd2c0cb3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0d44d0 con 0x7fd2bc0b96e0 2024-04-25T09:01:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2bad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd2bc0d4060 0x7fd2bc0b6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37860/0 (socket says 172.21.15.5:37860) 2024-04-25T09:01:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2bad9d640 1 -- 172.21.15.5:0/3743093770 learned_addr learned my addr 172.21.15.5:0/3743093770 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2b9d9b640 1 --2- 172.21.15.5:0/3743093770 >> v2:172.21.15.80:3300/0 conn(0x7fd2bc0b96e0 0x7fd2bc0d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2b959a640 1 -- 172.21.15.5:0/3743093770 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889273550 0 0) 0x7fd2bc0b9b20 con 0x7fd2bc0d4060 2024-04-25T09:01:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2b959a640 1 -- 172.21.15.5:0/3743093770 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a8003520 con 0x7fd2bc0d4060 2024-04-25T09:01:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2b9d9b640 1 -- 172.21.15.5:0/3743093770 >> v1:172.21.15.80:6789/0 conn(0x7fd2bc1614b0 legacy=0x7fd2bc0d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2b9d9b640 1 -- 172.21.15.5:0/3743093770 >> v1:172.21.15.5:6789/0 conn(0x7fd2bc0d4060 legacy=0x7fd2bc0b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2b959a640 1 -- 172.21.15.5:0/3743093770 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2842630751 0 0) 0x7fd2a8003520 con 0x7fd2bc0d4060 2024-04-25T09:01:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.985+0000 7fd2b9d9b640 1 -- 172.21.15.5:0/3743093770 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0d2a20 con 0x7fd2bc0b96e0 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.986+0000 7fd2b9d9b640 1 --2- 172.21.15.5:0/3743093770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0b96e0 0x7fd2bc0d3b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d712ab51b913e8ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.986+0000 7fd2b959a640 1 -- 172.21.15.5:0/3743093770 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4037070 con 0x7fd2bc0b96e0 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.986+0000 7fd2b959a640 1 -- 172.21.15.5:0/3743093770 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a402ac50 con 0x7fd2bc0b96e0 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.986+0000 7fd2b959a640 1 -- 172.21.15.5:0/3743093770 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac001a10 con 0x7fd2bc0b96e0 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.986+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/3743093770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0b96e0 msgr2=0x7fd2bc0d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.986+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/3743093770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0b96e0 0x7fd2bc0d3b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402a1c0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.987+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/3743093770 shutdown_connections 2024-04-25T09:01:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.987+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/3743093770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0b96e0 0x7fd2bc0d3b20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.987+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/3743093770 >> 172.21.15.5:0/3743093770 conn(0x7fd2bc06b000 msgr2=0x7fd2bc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.987+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/3743093770 shutdown_connections 2024-04-25T09:01:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.987+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/3743093770 wait complete. 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.988+0000 7fd2c0cb3640 1 Processor -- start 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.988+0000 7fd2c0cb3640 1 -- start start 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2c0cb3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2bc0b96e0 0x7fd2bc14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2c0cb3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0d4060 0x7fd2bc1f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2c0cb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2bc1614b0 0x7fd2bc0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2c0cb3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0d32c0 con 0x7fd2bc1614b0 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2c0cb3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0d2fe0 con 0x7fd2bc0d4060 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2c0cb3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0d37e0 con 0x7fd2bc0b96e0 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2bc1614b0 0x7fd2bc0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2bc1614b0 0x7fd2bc0c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55258/0 (socket says 172.21.15.5:55258) 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 -- 172.21.15.5:0/2051842532 learned_addr learned my addr 172.21.15.5:0/2051842532 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2b9d9b640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0d4060 0x7fd2bc1f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2ba59c640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2bc0b96e0 0x7fd2bc14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 -- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2bc0b96e0 msgr2=0x7fd2bc14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2bc0b96e0 0x7fd2bc14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 -- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0d4060 msgr2=0x7fd2bc1f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0d4060 0x7fd2bc1f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 -- 172.21.15.5:0/2051842532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0ca540 con 0x7fd2bc1614b0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2ba59c640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2bc0b96e0 0x7fd2bc14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2bad9d640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2bc1614b0 0x7fd2bc0c76c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00cb70 tx=0x7fd2ac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.989+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/2051842532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac018070 con 0x7fd2bc1614b0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.990+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc1f8080 con 0x7fd2bc1614b0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.990+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/2051842532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac004d60 con 0x7fd2bc1614b0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.990+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/2051842532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00ad40 con 0x7fd2bc1614b0 2024-04-25T09:01:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.990+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0b3740 con 0x7fd2bc1614b0 2024-04-25T09:01:02.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.990+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc04ef20 con 0x7fd2bc1614b0 2024-04-25T09:01:02.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.991+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/2051842532 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2ac0070d0 con 0x7fd2bc1614b0 2024-04-25T09:01:02.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.991+0000 7fd2b2ffd640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd29c06b500 0x7fd29c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.991+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/2051842532 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2ac089a10 con 0x7fd2bc1614b0 2024-04-25T09:01:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.992+0000 7fd2ba59c640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd29c06b500 0x7fd29c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.992+0000 7fd2ba59c640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd29c06b500 0x7fd29c06d9c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4007fd0 tx=0x7fd2b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:02.996+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/2051842532 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2ac058120 con 0x7fd2bc1614b0 2024-04-25T09:01:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.213+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd2bc15e680 con 0x7fd2bc1614b0 2024-04-25T09:01:03.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.227+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/2051842532 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd2ac05c1c0 con 0x7fd2bc1614b0 2024-04-25T09:01:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd29c06b500 msgr2=0x7fd29c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd29c06b500 0x7fd29c06d9c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4007fd0 tx=0x7fd2b4009040 comp rx=0 tx=0).stop 2024-04-25T09:01:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2bc1614b0 msgr2=0x7fd2bc0c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2bc1614b0 0x7fd2bc0c76c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00cb70 tx=0x7fd2ac00a430 comp rx=0 tx=0).stop 2024-04-25T09:01:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 shutdown_connections 2024-04-25T09:01:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd29c06b500 0x7fd29c06d9c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2bc1614b0 0x7fd2bc0c76c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2bc0d4060 0x7fd2bc1f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 --2- 172.21.15.5:0/2051842532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2bc0b96e0 0x7fd2bc14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 >> 172.21.15.5:0/2051842532 conn(0x7fd2bc06b000 msgr2=0x7fd2bc0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 shutdown_connections 2024-04-25T09:01:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.230+0000 7fd2c0cb3640 1 -- 172.21.15.5:0/2051842532 wait complete. 2024-04-25T09:01:03.230 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:01:03.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:01:03.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.345+0000 7ff7d8c88640 1 Processor -- start 2024-04-25T09:01:03.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.345+0000 7ff7d8c88640 1 -- start start 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d8c88640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7d40d0c80 0x7ff7d406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d8c88640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d40cc780 0x7ff7d40ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d8c88640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d40d27f0 con 0x7ff7d415e0b0 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d8c88640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d40cfee0 con 0x7ff7d40d0c80 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d8c88640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40d01c0 con 0x7ff7d40cc780 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7cbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7d40d0c80 0x7ff7d406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d2d9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d40cc780 0x7ff7d40ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d259c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff7d415e0b0 0x7ff7d40cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:50444/0 (socket says 172.21.15.5:50444) 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.346+0000 7ff7d259c640 1 -- 172.21.15.5:0/2910575646 learned_addr learned my addr 172.21.15.5:0/2910575646 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.347+0000 7ff7d1d9b640 1 -- 172.21.15.5:0/2910575646 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439484719 0 0) 0x7ff7d40d27f0 con 0x7ff7d415e0b0 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.347+0000 7ff7d1d9b640 1 -- 172.21.15.5:0/2910575646 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c0003520 con 0x7ff7d415e0b0 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.347+0000 7ff7cbfff640 1 -- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d40cc780 msgr2=0x7ff7d40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.347+0000 7ff7cbfff640 1 --2- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d40cc780 0x7ff7d40ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.347+0000 7ff7cbfff640 1 -- 172.21.15.5:0/2910575646 >> v1:172.21.15.80:6789/0 conn(0x7ff7d415e0b0 legacy=0x7ff7d40cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.347+0000 7ff7cbfff640 1 -- 172.21.15.5:0/2910575646 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40d04a0 con 0x7ff7d40d0c80 2024-04-25T09:01:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.347+0000 7ff7d2d9d640 1 --2- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d40cc780 0x7ff7d40ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7cbfff640 1 --2- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40d0c80 0x7ff7d406adf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097d0 tx=0x7ff7bc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b4cce9a51ee3cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d1d9b640 1 -- 172.21.15.5:0/2910575646 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc037070 con 0x7ff7d40d0c80 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d1d9b640 1 -- 172.21.15.5:0/2910575646 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc032440 con 0x7ff7d40d0c80 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d1d9b640 1 -- 172.21.15.5:0/2910575646 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0327f0 con 0x7ff7d40d0c80 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 -- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40d0c80 msgr2=0x7ff7d406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40d0c80 0x7ff7d406adf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097d0 tx=0x7ff7bc02a1c0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 -- 172.21.15.5:0/2910575646 shutdown_connections 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d40cc780 0x7ff7d40ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/2910575646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40d0c80 0x7ff7d406adf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 -- 172.21.15.5:0/2910575646 >> 172.21.15.5:0/2910575646 conn(0x7ff7d40d1a20 msgr2=0x7ff7d40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 -- 172.21.15.5:0/2910575646 shutdown_connections 2024-04-25T09:01:03.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.348+0000 7ff7d8c88640 1 -- 172.21.15.5:0/2910575646 wait complete. 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 Processor -- start 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 -- start start 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40cc780 0x7ff7d41f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0c80 0x7ff7d41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d415e0b0 0x7ff7d40cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40cfb90 con 0x7ff7d40d0c80 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d415e490 con 0x7ff7d40cc780 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7d8c88640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40ccc30 con 0x7ff7d415e0b0 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.350+0000 7ff7cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0c80 0x7ff7d41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0c80 0x7ff7d41590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55264/0 (socket says 172.21.15.5:55264) 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7d259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40cc780 0x7ff7d41f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 -- 172.21.15.5:0/144935501 learned_addr learned my addr 172.21.15.5:0/144935501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7d2d9d640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d415e0b0 0x7ff7d40cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 -- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d415e0b0 msgr2=0x7ff7d40cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d415e0b0 0x7ff7d40cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 -- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40cc780 msgr2=0x7ff7d41f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40cc780 0x7ff7d41f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 -- 172.21.15.5:0/144935501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40cafb0 con 0x7ff7d40d0c80 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7d259c640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40cc780 0x7ff7d41f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7cbfff640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0c80 0x7ff7d41590a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc000c00 tx=0x7ff7bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7caffd640 1 -- 172.21.15.5:0/144935501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc041020 con 0x7ff7d40d0c80 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7caffd640 1 -- 172.21.15.5:0/144935501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc03d620 con 0x7ff7d40d0c80 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7caffd640 1 -- 172.21.15.5:0/144935501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc037040 con 0x7ff7d40d0c80 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d40cb290 con 0x7ff7d40d0c80 2024-04-25T09:01:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.351+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d40cb850 con 0x7ff7d40d0c80 2024-04-25T09:01:03.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.352+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d404ef20 con 0x7ff7d40d0c80 2024-04-25T09:01:03.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.353+0000 7ff7caffd640 1 -- 172.21.15.5:0/144935501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff7bc044020 con 0x7ff7d40d0c80 2024-04-25T09:01:03.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.353+0000 7ff7caffd640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff7b406b4d0 0x7ff7b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.353+0000 7ff7caffd640 1 -- 172.21.15.5:0/144935501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7bc0aa8c0 con 0x7ff7d40d0c80 2024-04-25T09:01:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.353+0000 7ff7d259c640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff7b406b4d0 0x7ff7b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.354+0000 7ff7d259c640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff7b406b4d0 0x7ff7b406d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4005880 tx=0x7ff7c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.358+0000 7ff7caffd640 1 -- 172.21.15.5:0/144935501 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7bc04b030 con 0x7ff7d40d0c80 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:03.574+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff7d40b79a0 con 0x7ff7d40d0c80 2024-04-25T09:01:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.229+0000 7ff7caffd640 1 -- 172.21.15.5:0/144935501 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff7bc0796b0 con 0x7ff7d40d0c80 2024-04-25T09:01:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff7b406b4d0 msgr2=0x7ff7b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff7b406b4d0 0x7ff7b406d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4005880 tx=0x7ff7c4009040 comp rx=0 tx=0).stop 2024-04-25T09:01:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0c80 msgr2=0x7ff7d41590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0c80 0x7ff7d41590a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc000c00 tx=0x7ff7bc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 shutdown_connections 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff7b406b4d0 0x7ff7b406d990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7d415e0b0 0x7ff7d40cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0c80 0x7ff7d41590a0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 --2- 172.21.15.5:0/144935501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7d40cc780 0x7ff7d41f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 >> 172.21.15.5:0/144935501 conn(0x7ff7d40d1a20 msgr2=0x7ff7d406f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 shutdown_connections 2024-04-25T09:01:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.232+0000 7ff7d8c88640 1 -- 172.21.15.5:0/144935501 wait complete. 2024-04-25T09:01:04.235 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:01:04.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.353+0000 7feb8361f640 1 Processor -- start 2024-04-25T09:01:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.353+0000 7feb8361f640 1 -- start start 2024-04-25T09:01:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb8361f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c15e0a0 0x7feb7c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb8361f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb7c0d3df0 0x7feb7c0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb8361f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0b7f60 con 0x7feb7c0d3990 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb8361f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c0b29c0 con 0x7feb7c0d3df0 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb8361f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0d2080 con 0x7feb7c15e0a0 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb80bba640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb7c0d3990 0x7feb7c0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37872/0 (socket says 172.21.15.5:37872) 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb80bba640 1 -- 172.21.15.5:0/3757053960 learned_addr learned my addr 172.21.15.5:0/3757053960 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb813bb640 1 --2- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c15e0a0 0x7feb7c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.354+0000 7feb81bbc640 1 --2- 172.21.15.5:0/3757053960 >> v2:172.21.15.80:3300/0 conn(0x7feb7c0d3df0 0x7feb7c0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb7bfff640 1 -- 172.21.15.5:0/3757053960 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971394382 0 0) 0x7feb7c0b7f60 con 0x7feb7c0d3990 2024-04-25T09:01:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb7bfff640 1 -- 172.21.15.5:0/3757053960 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb64003520 con 0x7feb7c0d3990 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb81bbc640 1 -- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c15e0a0 msgr2=0x7feb7c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb81bbc640 1 --2- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c15e0a0 0x7feb7c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb81bbc640 1 -- 172.21.15.5:0/3757053960 >> v1:172.21.15.5:6789/0 conn(0x7feb7c0d3990 legacy=0x7feb7c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb7bfff640 1 -- 172.21.15.5:0/3757053960 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712750327 0 0) 0x7feb64003520 con 0x7feb7c0d3990 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb81bbc640 1 -- 172.21.15.5:0/3757053960 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c0d2360 con 0x7feb7c0d3df0 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.355+0000 7feb813bb640 1 --2- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c15e0a0 0x7feb7c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb81bbc640 1 --2- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c0d3df0 0x7feb7c0cecf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0097a0 tx=0x7feb6c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a394232416d0497 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb7bfff640 1 -- 172.21.15.5:0/3757053960 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c037070 con 0x7feb7c0d3df0 2024-04-25T09:01:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb7bfff640 1 -- 172.21.15.5:0/3757053960 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c02aba0 con 0x7feb7c0d3df0 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb7bfff640 1 -- 172.21.15.5:0/3757053960 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70001670 con 0x7feb7c0d3df0 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb8361f640 1 -- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c0d3df0 msgr2=0x7feb7c0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb8361f640 1 --2- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c0d3df0 0x7feb7c0cecf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0097a0 tx=0x7feb6c02a110 comp rx=0 tx=0).stop 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb8361f640 1 -- 172.21.15.5:0/3757053960 shutdown_connections 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb8361f640 1 --2- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c0d3df0 0x7feb7c0cecf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb8361f640 1 --2- 172.21.15.5:0/3757053960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c15e0a0 0x7feb7c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb8361f640 1 -- 172.21.15.5:0/3757053960 >> 172.21.15.5:0/3757053960 conn(0x7feb7c0668f0 msgr2=0x7feb7c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.356+0000 7feb8361f640 1 -- 172.21.15.5:0/3757053960 shutdown_connections 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.357+0000 7feb8361f640 1 -- 172.21.15.5:0/3757053960 wait complete. 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 Processor -- start 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 -- start start 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb7c0d3990 0x7feb7c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c0d3df0 0x7feb7c0ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c15e0a0 0x7feb7c0ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0d2c00 con 0x7feb7c0d3990 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0d2920 con 0x7feb7c15e0a0 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb8361f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0d4280 con 0x7feb7c0d3df0 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb813bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb7c0d3990 0x7feb7c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb813bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb7c0d3990 0x7feb7c15b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55274/0 (socket says 172.21.15.5:55274) 2024-04-25T09:01:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.358+0000 7feb813bb640 1 -- 172.21.15.5:0/1991800083 learned_addr learned my addr 172.21.15.5:0/1991800083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb81bbc640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c15e0a0 0x7feb7c0ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb80bba640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c0d3df0 0x7feb7c0ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb813bb640 1 -- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c0d3df0 msgr2=0x7feb7c0ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb813bb640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c0d3df0 0x7feb7c0ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb813bb640 1 -- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c15e0a0 msgr2=0x7feb7c0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb813bb640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c15e0a0 0x7feb7c0ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb813bb640 1 -- 172.21.15.5:0/1991800083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c15b6a0 con 0x7feb7c0d3990 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb813bb640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb7c0d3990 0x7feb7c15b160 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7feb7400efc0 tx=0x7feb7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb79ffb640 1 -- 172.21.15.5:0/1991800083 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74018020 con 0x7feb7c0d3990 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb79ffb640 1 -- 172.21.15.5:0/1991800083 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74014680 con 0x7feb7c0d3990 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb79ffb640 1 -- 172.21.15.5:0/1991800083 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74014a50 con 0x7feb7c0d3990 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c0cc8e0 con 0x7feb7c0d3990 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.359+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c0ccea0 con 0x7feb7c0d3990 2024-04-25T09:01:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.360+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c04ef20 con 0x7feb7c0d3990 2024-04-25T09:01:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.361+0000 7feb79ffb640 1 -- 172.21.15.5:0/1991800083 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feb74005d10 con 0x7feb7c0d3990 2024-04-25T09:01:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.361+0000 7feb79ffb640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb6806b4d0 0x7feb6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.361+0000 7feb79ffb640 1 -- 172.21.15.5:0/1991800083 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb7408af70 con 0x7feb7c0d3990 2024-04-25T09:01:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.362+0000 7feb80bba640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb6806b4d0 0x7feb6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.362+0000 7feb80bba640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb6806b4d0 0x7feb6806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0b8670 tx=0x7feb700016d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.366+0000 7feb79ffb640 1 -- 172.21.15.5:0/1991800083 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb74022030 con 0x7feb7c0d3990 2024-04-25T09:01:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.582+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb7c15d790 con 0x7feb7c0d3990 2024-04-25T09:01:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.583+0000 7feb79ffb640 1 -- 172.21.15.5:0/1991800083 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4928 (secure 0 0 0) 0x7feb74010040 con 0x7feb7c0d3990 2024-04-25T09:01:04.572 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:04.572 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/551194531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":551194531},{"type":"v1","addr":"172.21.15.5:6835","nonce":551194531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3514707104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3514707104},{"type":"v1","addr":"172.21.15.80:6836","nonce":3514707104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/546123103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":546123103},{"type":"v1","addr":"172.21.15.5:6833","nonce":546123103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:01.584978+0000","modified":"2024-04-25T09:01:03.576248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7038":{"gid":7038,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1546784484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1546784484},{"type":"v1","addr":"172.21.15.80:6837","nonce":1546784484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:01:04.573 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 45 2024-04-25T09:01:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb6806b4d0 msgr2=0x7feb6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb6806b4d0 0x7feb6806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0b8670 tx=0x7feb700016d0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb7c0d3990 msgr2=0x7feb7c15b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb7c0d3990 0x7feb7c15b160 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7feb7400efc0 tx=0x7feb7400c490 comp rx=0 tx=0).stop 2024-04-25T09:01:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 shutdown_connections 2024-04-25T09:01:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb6806b4d0 0x7feb6806d990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb7c15e0a0 0x7feb7c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb7c0d3df0 0x7feb7c0ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 --2- 172.21.15.5:0/1991800083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb7c0d3990 0x7feb7c15b160 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 >> 172.21.15.5:0/1991800083 conn(0x7feb7c0668f0 msgr2=0x7feb7c0b8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 shutdown_connections 2024-04-25T09:01:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.585+0000 7feb8361f640 1 -- 172.21.15.5:0/1991800083 wait complete. 2024-04-25T09:01:04.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.696+0000 7f8317ccb640 1 Processor -- start 2024-04-25T09:01:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.697+0000 7f8317ccb640 1 -- start start 2024-04-25T09:01:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.697+0000 7f8317ccb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83100b0a50 0x7f83100ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.697+0000 7f8317ccb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83100cbf40 0x7f83100ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.697+0000 7f8317ccb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831006ba50 con 0x7f83100b0e30 2024-04-25T09:01:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.697+0000 7f8317ccb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831006b800 con 0x7f83100b0a50 2024-04-25T09:01:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.697+0000 7f8317ccb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831006bd30 con 0x7f83100cbf40 2024-04-25T09:01:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8315a67640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83100b0a50 0x7f83100ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8315266640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f83100b0e30 0x7f83100d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37884/0 (socket says 172.21.15.5:37884) 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8315266640 1 -- 172.21.15.5:0/471550467 learned_addr learned my addr 172.21.15.5:0/471550467 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8316268640 1 --2- 172.21.15.5:0/471550467 >> v2:172.21.15.80:3300/0 conn(0x7f83100cbf40 0x7f83100ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8315a67640 1 -- 172.21.15.5:0/471550467 >> v2:172.21.15.80:3300/0 conn(0x7f83100cbf40 msgr2=0x7f83100ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8315a67640 1 --2- 172.21.15.5:0/471550467 >> v2:172.21.15.80:3300/0 conn(0x7f83100cbf40 0x7f83100ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8315a67640 1 -- 172.21.15.5:0/471550467 >> v1:172.21.15.5:6789/0 conn(0x7f83100b0e30 legacy=0x7f83100d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8314a65640 1 -- 172.21.15.5:0/471550467 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908910942 0 0) 0x7f831006ba50 con 0x7f83100b0e30 2024-04-25T09:01:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.698+0000 7f8315a67640 1 -- 172.21.15.5:0/471550467 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831006c010 con 0x7f83100b0a50 2024-04-25T09:01:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8315a67640 1 --2- 172.21.15.5:0/471550467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0a50 0x7f83100ce200 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f83100cf8d0 tx=0x7f830c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf36d562f54b41b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8314a65640 1 -- 172.21.15.5:0/471550467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c037070 con 0x7f83100b0a50 2024-04-25T09:01:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8314a65640 1 -- 172.21.15.5:0/471550467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c032440 con 0x7f83100b0a50 2024-04-25T09:01:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8314a65640 1 -- 172.21.15.5:0/471550467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c02ae60 con 0x7f83100b0a50 2024-04-25T09:01:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8317ccb640 1 -- 172.21.15.5:0/471550467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0a50 msgr2=0x7f83100ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8317ccb640 1 --2- 172.21.15.5:0/471550467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0a50 0x7f83100ce200 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f83100cf8d0 tx=0x7f830c02a110 comp rx=0 tx=0).stop 2024-04-25T09:01:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8317ccb640 1 -- 172.21.15.5:0/471550467 shutdown_connections 2024-04-25T09:01:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8317ccb640 1 --2- 172.21.15.5:0/471550467 >> v2:172.21.15.80:3300/0 conn(0x7f83100cbf40 0x7f83100ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8317ccb640 1 --2- 172.21.15.5:0/471550467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0a50 0x7f83100ce200 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.699+0000 7f8317ccb640 1 -- 172.21.15.5:0/471550467 >> 172.21.15.5:0/471550467 conn(0x7f83100d18f0 msgr2=0x7f83100d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.700+0000 7f8317ccb640 1 -- 172.21.15.5:0/471550467 shutdown_connections 2024-04-25T09:01:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.700+0000 7f8317ccb640 1 -- 172.21.15.5:0/471550467 wait complete. 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 Processor -- start 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 -- start start 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83100b0a50 0x7f831014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0e30 0x7f83100c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83100cbf40 0x7f83100b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83100b2bf0 con 0x7f83100b0e30 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83100cfd60 con 0x7f83100b0a50 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.701+0000 7f8317ccb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831015b5d0 con 0x7f83100cbf40 2024-04-25T09:01:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0e30 0x7f83100c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0e30 0x7f83100c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55284/0 (socket says 172.21.15.5:55284) 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 -- 172.21.15.5:0/605456006 learned_addr learned my addr 172.21.15.5:0/605456006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315a67640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83100b0a50 0x7f831014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8316268640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83100cbf40 0x7f83100b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 -- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83100cbf40 msgr2=0x7f83100b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83100cbf40 0x7f83100b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 -- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83100b0a50 msgr2=0x7f831014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83100b0a50 0x7f831014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 -- 172.21.15.5:0/605456006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831015a6e0 con 0x7f83100b0e30 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8316268640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83100cbf40 0x7f83100b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8315266640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0e30 0x7f83100c9310 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f830000c430 tx=0x7f830000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f83067fc640 1 -- 172.21.15.5:0/605456006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000074e0 con 0x7f83100b0e30 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f83067fc640 1 -- 172.21.15.5:0/605456006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83000047e0 con 0x7f83100b0e30 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831015a9c0 con 0x7f83100b0e30 2024-04-25T09:01:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f83067fc640 1 -- 172.21.15.5:0/605456006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300004c10 con 0x7f83100b0e30 2024-04-25T09:01:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.702+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831015af80 con 0x7f83100b0e30 2024-04-25T09:01:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.703+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831006cd70 con 0x7f83100b0e30 2024-04-25T09:01:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.704+0000 7f83067fc640 1 -- 172.21.15.5:0/605456006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8300011070 con 0x7f83100b0e30 2024-04-25T09:01:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.704+0000 7f83067fc640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f82f406b4d0 0x7f82f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.704+0000 7f83067fc640 1 -- 172.21.15.5:0/605456006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8300089d80 con 0x7f83100b0e30 2024-04-25T09:01:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.704+0000 7f8315a67640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f82f406b4d0 0x7f82f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.705+0000 7f8315a67640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f82f406b4d0 0x7f82f406d990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f830c034000 tx=0x7f830c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.708+0000 7f83067fc640 1 -- 172.21.15.5:0/605456006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8300058c00 con 0x7f83100b0e30 2024-04-25T09:01:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.890+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f831004ef20 con 0x7f83100b0e30 2024-04-25T09:01:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.891+0000 7f83067fc640 1 -- 172.21.15.5:0/605456006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16584 (secure 0 0 0) 0x7f8300058500 con 0x7f83100b0e30 2024-04-25T09:01:04.880 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:04.880 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:01:03.225599+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:59.869846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:00.565749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f82f406b4d0 msgr2=0x7f82f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f82f406b4d0 0x7f82f406d990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f830c034000 tx=0x7f830c02e000 comp rx=0 tx=0).stop 2024-04-25T09:01:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0e30 msgr2=0x7f83100c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0e30 0x7f83100c9310 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f830000c430 tx=0x7f830000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 shutdown_connections 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f82f406b4d0 0x7f82f406d990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83100cbf40 0x7f83100b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83100b0e30 0x7f83100c9310 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 --2- 172.21.15.5:0/605456006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83100b0a50 0x7f831014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 >> 172.21.15.5:0/605456006 conn(0x7f83100d18f0 msgr2=0x7f83100b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 shutdown_connections 2024-04-25T09:01:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:04.893+0000 7f8317ccb640 1 -- 172.21.15.5:0/605456006 wait complete. 2024-04-25T09:01:04.893 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:01:04.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.005+0000 7fcefdb1b640 1 Processor -- start 2024-04-25T09:01:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.005+0000 7fcefdb1b640 1 -- start start 2024-04-25T09:01:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcefdb1b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcef815e0a0 0x7fcef80d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcefdb1b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcef80d3df0 0x7fcef80cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcefdb1b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80b7f60 con 0x7fcef80d3990 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcefdb1b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80b29c0 con 0x7fcef815e0a0 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcefdb1b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80d2080 con 0x7fcef80d3df0 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcef77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcef815e0a0 0x7fcef80d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcef6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcef80d3990 0x7fcef80ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37892/0 (socket says 172.21.15.5:37892) 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.006+0000 7fcef6ffd640 1 -- 172.21.15.5:0/2656054726 learned_addr learned my addr 172.21.15.5:0/2656054726 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.007+0000 7fcef7fff640 1 --2- 172.21.15.5:0/2656054726 >> v2:172.21.15.80:3300/0 conn(0x7fcef80d3df0 0x7fcef80cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.007+0000 7fcef77fe640 1 -- 172.21.15.5:0/2656054726 >> v2:172.21.15.80:3300/0 conn(0x7fcef80d3df0 msgr2=0x7fcef80cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.007+0000 7fcef77fe640 1 --2- 172.21.15.5:0/2656054726 >> v2:172.21.15.80:3300/0 conn(0x7fcef80d3df0 0x7fcef80cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.007+0000 7fcef77fe640 1 -- 172.21.15.5:0/2656054726 >> v1:172.21.15.5:6789/0 conn(0x7fcef80d3990 legacy=0x7fcef80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.007+0000 7fcef77fe640 1 -- 172.21.15.5:0/2656054726 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80d2360 con 0x7fcef815e0a0 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.007+0000 7fcef7fff640 1 --2- 172.21.15.5:0/2656054726 >> v2:172.21.15.80:3300/0 conn(0x7fcef80d3df0 0x7fcef80cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.007+0000 7fcef77fe640 1 --2- 172.21.15.5:0/2656054726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef815e0a0 0x7fcef80d0d50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b34f0 tx=0x7fcee802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ba4c4284e0d13c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcef67fc640 1 -- 172.21.15.5:0/2656054726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8037070 con 0x7fcef815e0a0 2024-04-25T09:01:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcef67fc640 1 -- 172.21.15.5:0/2656054726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8032440 con 0x7fcef815e0a0 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcef67fc640 1 -- 172.21.15.5:0/2656054726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8032810 con 0x7fcef815e0a0 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 -- 172.21.15.5:0/2656054726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef815e0a0 msgr2=0x7fcef80d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/2656054726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef815e0a0 0x7fcef80d0d50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b34f0 tx=0x7fcee802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 -- 172.21.15.5:0/2656054726 shutdown_connections 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/2656054726 >> v2:172.21.15.80:3300/0 conn(0x7fcef80d3df0 0x7fcef80cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/2656054726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef815e0a0 0x7fcef80d0d50 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 -- 172.21.15.5:0/2656054726 >> 172.21.15.5:0/2656054726 conn(0x7fcef80668f0 msgr2=0x7fcef8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 -- 172.21.15.5:0/2656054726 shutdown_connections 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.008+0000 7fcefdb1b640 1 -- 172.21.15.5:0/2656054726 wait complete. 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.009+0000 7fcefdb1b640 1 Processor -- start 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.009+0000 7fcefdb1b640 1 -- start start 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcefdb1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef80d3990 0x7fcef815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcefdb1b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef80d3df0 0x7fcef81f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcefdb1b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcef815e0a0 0x7fcef81f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcefdb1b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80d2c00 con 0x7fcef80d3990 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcefdb1b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80d2920 con 0x7fcef80d3df0 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcefdb1b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80d4280 con 0x7fcef815e0a0 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcef77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef80d3990 0x7fcef815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcef77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef80d3990 0x7fcef815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55308/0 (socket says 172.21.15.5:55308) 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.010+0000 7fcef77fe640 1 -- 172.21.15.5:0/703976809 learned_addr learned my addr 172.21.15.5:0/703976809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcef77fe640 1 -- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcef815e0a0 msgr2=0x7fcef81f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcef77fe640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcef815e0a0 0x7fcef81f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcef6ffd640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef80d3df0 0x7fcef81f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcef77fe640 1 -- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef80d3df0 msgr2=0x7fcef81f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcef77fe640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef80d3df0 0x7fcef81f7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcef77fe640 1 -- 172.21.15.5:0/703976809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8159ed0 con 0x7fcef80d3990 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcef77fe640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef80d3990 0x7fcef815b890 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000c00 tx=0x7fcee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcedffff640 1 -- 172.21.15.5:0/703976809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8041070 con 0x7fcef80d3990 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcedffff640 1 -- 172.21.15.5:0/703976809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee803c950 con 0x7fcef80d3990 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef815a1b0 con 0x7fcef80d3990 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcedffff640 1 -- 172.21.15.5:0/703976809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8037040 con 0x7fcef80d3990 2024-04-25T09:01:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.011+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef815a770 con 0x7fcef80d3990 2024-04-25T09:01:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.012+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef804ef20 con 0x7fcef80d3990 2024-04-25T09:01:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.012+0000 7fcedffff640 1 -- 172.21.15.5:0/703976809 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcee8044070 con 0x7fcef80d3990 2024-04-25T09:01:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.013+0000 7fcedffff640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.013+0000 7fcedffff640 1 -- 172.21.15.5:0/703976809 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcee80ab120 con 0x7fcef80d3990 2024-04-25T09:01:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.013+0000 7fcef6ffd640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.013+0000 7fcef6ffd640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b2840 tx=0x7fceec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.017+0000 7fcedffff640 1 -- 172.21.15.5:0/703976809 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcee807a0c0 con 0x7fcef80d3990 2024-04-25T09:01:05.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.196+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcef80c73a0 con 0x7fcee406b4d0 2024-04-25T09:01:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.203+0000 7fcedffff640 1 -- 172.21.15.5:0/703976809 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246750 (secure 0 0 0) 0x7fcef80c73a0 con 0x7fcee406b4d0 2024-04-25T09:01:05.195 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.205+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 msgr2=0x7fcee406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.205+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b2840 tx=0x7fceec009040 comp rx=0 tx=0).stop 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.205+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef80d3990 msgr2=0x7fcef815b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.205+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef80d3990 0x7fcef815b890 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000c00 tx=0x7fcee80046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 shutdown_connections 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcef815e0a0 0x7fcef81f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef80d3df0 0x7fcef81f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 --2- 172.21.15.5:0/703976809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef80d3990 0x7fcef815b890 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 >> 172.21.15.5:0/703976809 conn(0x7fcef80668f0 msgr2=0x7fcef81605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 shutdown_connections 2024-04-25T09:01:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.206+0000 7fcefdb1b640 1 -- 172.21.15.5:0/703976809 wait complete. 2024-04-25T09:01:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-25T09:01:04.446524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315568,"kb_used_data":7876,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754659152,"statfs":{"total":773094113280,"available":772770971648,"internally_reserved":0,"allocated":8065024,"data_stored":4083999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":314953265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.229709"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226674+0000","last_change":"2024-04-25T09:01:01.226674+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226674+0000","last_undegraded":"2024-04-25T09:01:01.226674+0000","last_fullsized":"2024-04-25T09:01:01.226674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228288+0000","last_change":"2024-04-25T09:01:01.228288+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228288+0000","last_undegraded":"2024-04-25T09:01:01.228288+0000","last_fullsized":"2024-04-25T09:01:01.228288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222644+0000","last_change":"2024-04-25T09:01:01.222644+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222644+0000","last_undegraded":"2024-04-25T09:01:01.222644+0000","last_fullsized":"2024-04-25T09:01:01.222644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228360+0000","last_change":"2024-04-25T09:01:01.228360+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228360+0000","last_undegraded":"2024-04-25T09:01:01.228360+0000","last_fullsized":"2024-04-25T09:01:01.228360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223760+0000","last_change":"2024-04-25T09:01:01.223760+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223760+0000","last_undegraded":"2024-04-25T09:01:01.223760+0000","last_fullsized":"2024-04-25T09:01:01.223760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229565+0000","last_change":"2024-04-25T09:01:01.229565+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229565+0000","last_undegraded":"2024-04-25T09:01:01.229565+0000","last_fullsized":"2024-04-25T09:01:01.229565+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223378+0000","last_change":"2024-04-25T09:01:01.223378+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223378+0000","last_undegraded":"2024-04-25T09:01:01.223378+0000","last_fullsized":"2024-04-25T09:01:01.223378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228440+0000","last_change":"2024-04-25T09:01:01.228440+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228440+0000","last_undegraded":"2024-04-25T09:01:01.228440+0000","last_fullsized":"2024-04-25T09:01:01.228440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223223+0000","last_change":"2024-04-25T09:01:01.223223+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223223+0000","last_undegraded":"2024-04-25T09:01:01.223223+0000","last_fullsized":"2024-04-25T09:01:01.223223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224089+0000","last_change":"2024-04-25T09:01:01.224089+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224089+0000","last_undegraded":"2024-04-25T09:01:01.224089+0000","last_fullsized":"2024-04-25T09:01:01.224089+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227739+0000","last_change":"2024-04-25T09:01:01.227739+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227739+0000","last_undegraded":"2024-04-25T09:01:01.227739+0000","last_fullsized":"2024-04-25T09:01:01.227739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226605+0000","last_change":"2024-04-25T09:01:01.226605+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226605+0000","last_undegraded":"2024-04-25T09:01:01.226605+0000","last_fullsized":"2024-04-25T09:01:01.226605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225339+0000","last_change":"2024-04-25T09:01:01.225339+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225339+0000","last_undegraded":"2024-04-25T09:01:01.225339+0000","last_fullsized":"2024-04-25T09:01:01.225339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223248+0000","last_change":"2024-04-25T09:01:01.223248+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223248+0000","last_undegraded":"2024-04-25T09:01:01.223248+0000","last_fullsized":"2024-04-25T09:01:01.223248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226450+0000","last_change":"2024-04-25T09:01:01.226450+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226450+0000","last_undegraded":"2024-04-25T09:01:01.226450+0000","last_fullsized":"2024-04-25T09:01:01.226450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223679+0000","last_change":"2024-04-25T09:01:01.223679+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223679+0000","last_undegraded":"2024-04-25T09:01:01.223679+0000","last_fullsized":"2024-04-25T09:01:01.223679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222743+0000","last_change":"2024-04-25T09:01:01.222743+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222743+0000","last_undegraded":"2024-04-25T09:01:01.222743+0000","last_fullsized":"2024-04-25T09:01:01.222743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226244+0000","last_change":"2024-04-25T09:01:01.226244+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226244+0000","last_undegraded":"2024-04-25T09:01:01.226244+0000","last_fullsized":"2024-04-25T09:01:01.226244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229348+0000","last_change":"2024-04-25T09:01:01.229348+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229348+0000","last_undegraded":"2024-04-25T09:01:01.229348+0000","last_fullsized":"2024-04-25T09:01:01.229348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227740+0000","last_change":"2024-04-25T09:01:01.227740+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227740+0000","last_undegraded":"2024-04-25T09:01:01.227740+0000","last_fullsized":"2024-04-25T09:01:01.227740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222675+0000","last_change":"2024-04-25T09:01:01.222675+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222675+0000","last_undegraded":"2024-04-25T09:01:01.222675+0000","last_fullsized":"2024-04-25T09:01:01.222675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222263+0000","last_change":"2024-04-25T09:01:01.222263+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222263+0000","last_undegraded":"2024-04-25T09:01:01.222263+0000","last_fullsized":"2024-04-25T09:01:01.222263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224950+0000","last_change":"2024-04-25T09:01:01.224950+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224950+0000","last_undegraded":"2024-04-25T09:01:01.224950+0000","last_fullsized":"2024-04-25T09:01:01.224950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224445+0000","last_change":"2024-04-25T09:01:01.224445+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224445+0000","last_undegraded":"2024-04-25T09:01:01.224445+0000","last_fullsized":"2024-04-25T09:01:01.224445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225606+0000","last_change":"2024-04-25T09:01:01.225606+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225606+0000","last_undegraded":"2024-04-25T09:01:01.225606+0000","last_fullsized":"2024-04-25T09:01:01.225606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223971+0000","last_change":"2024-04-25T09:01:01.223971+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223971+0000","last_undegraded":"2024-04-25T09:01:01.223971+0000","last_fullsized":"2024-04-25T09:01:01.223971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222149+0000","last_change":"2024-04-25T09:01:01.222149+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222149+0000","last_undegraded":"2024-04-25T09:01:01.222149+0000","last_fullsized":"2024-04-25T09:01:01.222149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224009+0000","last_change":"2024-04-25T09:01:01.224009+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224009+0000","last_undegraded":"2024-04-25T09:01:01.224009+0000","last_fullsized":"2024-04-25T09:01:01.224009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222769+0000","last_change":"2024-04-25T09:01:01.222769+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222769+0000","last_undegraded":"2024-04-25T09:01:01.222769+0000","last_fullsized":"2024-04-25T09:01:01.222769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222564+0000","last_change":"2024-04-25T09:01:01.222564+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222564+0000","last_undegraded":"2024-04-25T09:01:01.222564+0000","last_fullsized":"2024-04-25T09:01:01.222564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222623+0000","last_change":"2024-04-25T09:01:01.222623+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222623+0000","last_undegraded":"2024-04-25T09:01:01.222623+0000","last_fullsized":"2024-04-25T09:01:01.222623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227251+0000","last_change":"2024-04-25T09:01:01.227251+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227251+0000","last_undegraded":"2024-04-25T09:01:01.227251+0000","last_fullsized":"2024-04-25T09:01:01.227251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225318+0000","last_change":"2024-04-25T09:01:01.225318+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225318+0000","last_undegraded":"2024-04-25T09:01:01.225318+0000","last_fullsized":"2024-04-25T09:01:01.225318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240476+0000","last_change":"2024-04-25T09:01:01.239796+0000","last_active":"2024-04-25T09:01:01.240476+0000","last_peered":"2024-04-25T09:01:01.240476+0000","last_clean":"2024-04-25T09:01:01.240476+0000","last_became_active":"2024-04-25T09:01:01.239418+0000","last_became_peered":"2024-04-25T09:01:01.239418+0000","last_unstale":"2024-04-25T09:01:01.240476+0000","last_undegraded":"2024-04-25T09:01:01.240476+0000","last_fullsized":"2024-04-25T09:01:01.240476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:14.071547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222294+0000","last_change":"2024-04-25T09:01:01.222294+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222294+0000","last_undegraded":"2024-04-25T09:01:01.222294+0000","last_fullsized":"2024-04-25T09:01:01.222294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239552+0000","last_change":"2024-04-25T09:01:01.236292+0000","last_active":"2024-04-25T09:01:01.239552+0000","last_peered":"2024-04-25T09:01:01.239552+0000","last_clean":"2024-04-25T09:01:01.239552+0000","last_became_active":"2024-04-25T09:01:01.235994+0000","last_became_peered":"2024-04-25T09:01:01.235994+0000","last_unstale":"2024-04-25T09:01:01.239552+0000","last_undegraded":"2024-04-25T09:01:01.239552+0000","last_fullsized":"2024-04-25T09:01:01.239552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:09.973429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229901+0000","last_change":"2024-04-25T09:01:01.229901+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229901+0000","last_undegraded":"2024-04-25T09:01:01.229901+0000","last_fullsized":"2024-04-25T09:01:01.229901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239109+0000","last_change":"2024-04-25T09:01:01.235176+0000","last_active":"2024-04-25T09:01:01.239109+0000","last_peered":"2024-04-25T09:01:01.239109+0000","last_clean":"2024-04-25T09:01:01.239109+0000","last_became_active":"2024-04-25T09:01:01.234875+0000","last_became_peered":"2024-04-25T09:01:01.234875+0000","last_unstale":"2024-04-25T09:01:01.239109+0000","last_undegraded":"2024-04-25T09:01:01.239109+0000","last_fullsized":"2024-04-25T09:01:01.239109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:46.750140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227344+0000","last_change":"2024-04-25T09:01:01.227344+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227344+0000","last_undegraded":"2024-04-25T09:01:01.227344+0000","last_fullsized":"2024-04-25T09:01:01.227344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237496+0000","last_change":"2024-04-25T09:01:01.234022+0000","last_active":"2024-04-25T09:01:01.237496+0000","last_peered":"2024-04-25T09:01:01.237496+0000","last_clean":"2024-04-25T09:01:01.237496+0000","last_became_active":"2024-04-25T09:01:01.233403+0000","last_became_peered":"2024-04-25T09:01:01.233403+0000","last_unstale":"2024-04-25T09:01:01.237496+0000","last_undegraded":"2024-04-25T09:01:01.237496+0000","last_fullsized":"2024-04-25T09:01:01.237496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:02.209579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222054+0000","last_change":"2024-04-25T09:01:01.222054+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222054+0000","last_undegraded":"2024-04-25T09:01:01.222054+0000","last_fullsized":"2024-04-25T09:01:01.222054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231430+0000","last_change":"2024-04-25T09:01:01.229650+0000","last_active":"2024-04-25T09:01:01.231430+0000","last_peered":"2024-04-25T09:01:01.231430+0000","last_clean":"2024-04-25T09:01:01.231430+0000","last_became_active":"2024-04-25T09:01:01.229258+0000","last_became_peered":"2024-04-25T09:01:01.229258+0000","last_unstale":"2024-04-25T09:01:01.231430+0000","last_undegraded":"2024-04-25T09:01:01.231430+0000","last_fullsized":"2024-04-25T09:01:01.231430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:32.252719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222156+0000","last_change":"2024-04-25T09:01:01.222156+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222156+0000","last_undegraded":"2024-04-25T09:01:01.222156+0000","last_fullsized":"2024-04-25T09:01:01.222156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237130+0000","last_change":"2024-04-25T09:01:01.234016+0000","last_active":"2024-04-25T09:01:01.237130+0000","last_peered":"2024-04-25T09:01:01.237130+0000","last_clean":"2024-04-25T09:01:01.237130+0000","last_became_active":"2024-04-25T09:01:01.233595+0000","last_became_peered":"2024-04-25T09:01:01.233595+0000","last_unstale":"2024-04-25T09:01:01.237130+0000","last_undegraded":"2024-04-25T09:01:01.237130+0000","last_fullsized":"2024-04-25T09:01:01.237130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:23.317888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222234+0000","last_change":"2024-04-25T09:01:01.222234+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222234+0000","last_undegraded":"2024-04-25T09:01:01.222234+0000","last_fullsized":"2024-04-25T09:01:01.222234+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231221+0000","last_change":"2024-04-25T09:01:01.230135+0000","last_active":"2024-04-25T09:01:01.231221+0000","last_peered":"2024-04-25T09:01:01.231221+0000","last_clean":"2024-04-25T09:01:01.231221+0000","last_became_active":"2024-04-25T09:01:01.229853+0000","last_became_peered":"2024-04-25T09:01:01.229853+0000","last_unstale":"2024-04-25T09:01:01.231221+0000","last_undegraded":"2024-04-25T09:01:01.231221+0000","last_fullsized":"2024-04-25T09:01:01.231221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:26.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225867+0000","last_change":"2024-04-25T09:01:01.225867+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225867+0000","last_undegraded":"2024-04-25T09:01:01.225867+0000","last_fullsized":"2024-04-25T09:01:01.225867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.234352+0000","last_change":"2024-04-25T09:01:01.232041+0000","last_active":"2024-04-25T09:01:01.234352+0000","last_peered":"2024-04-25T09:01:01.234352+0000","last_clean":"2024-04-25T09:01:01.234352+0000","last_became_active":"2024-04-25T09:01:01.231752+0000","last_became_peered":"2024-04-25T09:01:01.231752+0000","last_unstale":"2024-04-25T09:01:01.234352+0000","last_undegraded":"2024-04-25T09:01:01.234352+0000","last_fullsized":"2024-04-25T09:01:01.234352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:53.291603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221876+0000","last_change":"2024-04-25T09:01:01.221876+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221876+0000","last_undegraded":"2024-04-25T09:01:01.221876+0000","last_fullsized":"2024-04-25T09:01:01.221876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239062+0000","last_change":"2024-04-25T09:01:01.233295+0000","last_active":"2024-04-25T09:01:01.239062+0000","last_peered":"2024-04-25T09:01:01.239062+0000","last_clean":"2024-04-25T09:01:01.239062+0000","last_became_active":"2024-04-25T09:01:01.233010+0000","last_became_peered":"2024-04-25T09:01:01.233010+0000","last_unstale":"2024-04-25T09:01:01.239062+0000","last_undegraded":"2024-04-25T09:01:01.239062+0000","last_fullsized":"2024-04-25T09:01:01.239062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:16.549011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226228+0000","last_change":"2024-04-25T09:01:01.226228+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226228+0000","last_undegraded":"2024-04-25T09:01:01.226228+0000","last_fullsized":"2024-04-25T09:01:01.226228+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239252+0000","last_change":"2024-04-25T09:01:01.238466+0000","last_active":"2024-04-25T09:01:01.239252+0000","last_peered":"2024-04-25T09:01:01.239252+0000","last_clean":"2024-04-25T09:01:01.239252+0000","last_became_active":"2024-04-25T09:01:01.236891+0000","last_became_peered":"2024-04-25T09:01:01.236891+0000","last_unstale":"2024-04-25T09:01:01.239252+0000","last_undegraded":"2024-04-25T09:01:01.239252+0000","last_fullsized":"2024-04-25T09:01:01.239252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:19.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229341+0000","last_change":"2024-04-25T09:01:01.229341+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229341+0000","last_undegraded":"2024-04-25T09:01:01.229341+0000","last_fullsized":"2024-04-25T09:01:01.229341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231211+0000","last_change":"2024-04-25T09:01:01.227525+0000","last_active":"2024-04-25T09:01:01.231211+0000","last_peered":"2024-04-25T09:01:01.231211+0000","last_clean":"2024-04-25T09:01:01.231211+0000","last_became_active":"2024-04-25T09:01:01.227183+0000","last_became_peered":"2024-04-25T09:01:01.227183+0000","last_unstale":"2024-04-25T09:01:01.231211+0000","last_undegraded":"2024-04-25T09:01:01.231211+0000","last_fullsized":"2024-04-25T09:01:01.231211+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:51.139787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221812+0000","last_change":"2024-04-25T09:01:01.221812+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221812+0000","last_undegraded":"2024-04-25T09:01:01.221812+0000","last_fullsized":"2024-04-25T09:01:01.221812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236279+0000","last_change":"2024-04-25T09:01:01.235651+0000","last_active":"2024-04-25T09:01:01.236279+0000","last_peered":"2024-04-25T09:01:01.236279+0000","last_clean":"2024-04-25T09:01:01.236279+0000","last_became_active":"2024-04-25T09:01:01.235376+0000","last_became_peered":"2024-04-25T09:01:01.235376+0000","last_unstale":"2024-04-25T09:01:01.236279+0000","last_undegraded":"2024-04-25T09:01:01.236279+0000","last_fullsized":"2024-04-25T09:01:01.236279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:02.209579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226579+0000","last_change":"2024-04-25T09:01:01.226579+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226579+0000","last_undegraded":"2024-04-25T09:01:01.226579+0000","last_fullsized":"2024-04-25T09:01:01.226579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240096+0000","last_change":"2024-04-25T09:01:01.239403+0000","last_active":"2024-04-25T09:01:01.240096+0000","last_peered":"2024-04-25T09:01:01.240096+0000","last_clean":"2024-04-25T09:01:01.240096+0000","last_became_active":"2024-04-25T09:01:01.239077+0000","last_became_peered":"2024-04-25T09:01:01.239077+0000","last_unstale":"2024-04-25T09:01:01.240096+0000","last_undegraded":"2024-04-25T09:01:01.240096+0000","last_fullsized":"2024-04-25T09:01:01.240096+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:53.341918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222774+0000","last_change":"2024-04-25T09:01:01.222774+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222774+0000","last_undegraded":"2024-04-25T09:01:01.222774+0000","last_fullsized":"2024-04-25T09:01:01.222774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238806+0000","last_change":"2024-04-25T09:01:01.237737+0000","last_active":"2024-04-25T09:01:01.238806+0000","last_peered":"2024-04-25T09:01:01.238806+0000","last_clean":"2024-04-25T09:01:01.238806+0000","last_became_active":"2024-04-25T09:01:01.236940+0000","last_became_peered":"2024-04-25T09:01:01.236940+0000","last_unstale":"2024-04-25T09:01:01.238806+0000","last_undegraded":"2024-04-25T09:01:01.238806+0000","last_fullsized":"2024-04-25T09:01:01.238806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:27.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226906+0000","last_change":"2024-04-25T09:01:01.226906+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226906+0000","last_undegraded":"2024-04-25T09:01:01.226906+0000","last_fullsized":"2024-04-25T09:01:01.226906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.232478+0000","last_change":"2024-04-25T09:01:01.231724+0000","last_active":"2024-04-25T09:01:01.232478+0000","last_peered":"2024-04-25T09:01:01.232478+0000","last_clean":"2024-04-25T09:01:01.232478+0000","last_became_active":"2024-04-25T09:01:01.231424+0000","last_became_peered":"2024-04-25T09:01:01.231424+0000","last_unstale":"2024-04-25T09:01:01.232478+0000","last_undegraded":"2024-04-25T09:01:01.232478+0000","last_fullsized":"2024-04-25T09:01:01.232478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:14.071547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221291+0000","last_change":"2024-04-25T09:01:01.221291+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221291+0000","last_undegraded":"2024-04-25T09:01:01.221291+0000","last_fullsized":"2024-04-25T09:01:01.221291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239191+0000","last_change":"2024-04-25T09:01:01.236893+0000","last_active":"2024-04-25T09:01:01.239191+0000","last_peered":"2024-04-25T09:01:01.239191+0000","last_clean":"2024-04-25T09:01:01.239191+0000","last_became_active":"2024-04-25T09:01:01.236494+0000","last_became_peered":"2024-04-25T09:01:01.236494+0000","last_unstale":"2024-04-25T09:01:01.239191+0000","last_undegraded":"2024-04-25T09:01:01.239191+0000","last_fullsized":"2024-04-25T09:01:01.239191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:53.737808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223082+0000","last_change":"2024-04-25T09:01:01.223082+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223082+0000","last_undegraded":"2024-04-25T09:01:01.223082+0000","last_fullsized":"2024-04-25T09:01:01.223082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236839+0000","last_change":"2024-04-25T09:01:01.235551+0000","last_active":"2024-04-25T09:01:01.236839+0000","last_peered":"2024-04-25T09:01:01.236839+0000","last_clean":"2024-04-25T09:01:01.236839+0000","last_became_active":"2024-04-25T09:01:01.234355+0000","last_became_peered":"2024-04-25T09:01:01.234355+0000","last_unstale":"2024-04-25T09:01:01.236839+0000","last_undegraded":"2024-04-25T09:01:01.236839+0000","last_fullsized":"2024-04-25T09:01:01.236839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:29.719073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225791+0000","last_change":"2024-04-25T09:01:01.225791+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225791+0000","last_undegraded":"2024-04-25T09:01:01.225791+0000","last_fullsized":"2024-04-25T09:01:01.225791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239428+0000","last_change":"2024-04-25T09:01:01.234423+0000","last_active":"2024-04-25T09:01:01.239428+0000","last_peered":"2024-04-25T09:01:01.239428+0000","last_clean":"2024-04-25T09:01:01.239428+0000","last_became_active":"2024-04-25T09:01:01.234153+0000","last_became_peered":"2024-04-25T09:01:01.234153+0000","last_unstale":"2024-04-25T09:01:01.239428+0000","last_undegraded":"2024-04-25T09:01:01.239428+0000","last_fullsized":"2024-04-25T09:01:01.239428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.542901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226139+0000","last_change":"2024-04-25T09:01:01.226139+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226139+0000","last_undegraded":"2024-04-25T09:01:01.226139+0000","last_fullsized":"2024-04-25T09:01:01.226139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236752+0000","last_change":"2024-04-25T09:01:01.233697+0000","last_active":"2024-04-25T09:01:01.236752+0000","last_peered":"2024-04-25T09:01:01.236752+0000","last_clean":"2024-04-25T09:01:01.236752+0000","last_became_active":"2024-04-25T09:01:01.233426+0000","last_became_peered":"2024-04-25T09:01:01.233426+0000","last_unstale":"2024-04-25T09:01:01.236752+0000","last_undegraded":"2024-04-25T09:01:01.236752+0000","last_fullsized":"2024-04-25T09:01:01.236752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:26.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221270+0000","last_change":"2024-04-25T09:01:01.221270+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221270+0000","last_undegraded":"2024-04-25T09:01:01.221270+0000","last_fullsized":"2024-04-25T09:01:01.221270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240767+0000","last_change":"2024-04-25T09:01:01.240177+0000","last_active":"2024-04-25T09:01:01.240767+0000","last_peered":"2024-04-25T09:01:01.240767+0000","last_clean":"2024-04-25T09:01:01.240767+0000","last_became_active":"2024-04-25T09:01:01.239854+0000","last_became_peered":"2024-04-25T09:01:01.239854+0000","last_unstale":"2024-04-25T09:01:01.240767+0000","last_undegraded":"2024-04-25T09:01:01.240767+0000","last_fullsized":"2024-04-25T09:01:01.240767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:00.672674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222111+0000","last_change":"2024-04-25T09:01:01.222111+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222111+0000","last_undegraded":"2024-04-25T09:01:01.222111+0000","last_fullsized":"2024-04-25T09:01:01.222111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237150+0000","last_change":"2024-04-25T09:01:01.234455+0000","last_active":"2024-04-25T09:01:01.237150+0000","last_peered":"2024-04-25T09:01:01.237150+0000","last_clean":"2024-04-25T09:01:01.237150+0000","last_became_active":"2024-04-25T09:01:01.234104+0000","last_became_peered":"2024-04-25T09:01:01.234104+0000","last_unstale":"2024-04-25T09:01:01.237150+0000","last_undegraded":"2024-04-25T09:01:01.237150+0000","last_fullsized":"2024-04-25T09:01:01.237150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:53.341918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224154+0000","last_change":"2024-04-25T09:01:01.224154+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224154+0000","last_undegraded":"2024-04-25T09:01:01.224154+0000","last_fullsized":"2024-04-25T09:01:01.224154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238072+0000","last_change":"2024-04-25T09:01:01.236375+0000","last_active":"2024-04-25T09:01:01.238072+0000","last_peered":"2024-04-25T09:01:01.238072+0000","last_clean":"2024-04-25T09:01:01.238072+0000","last_became_active":"2024-04-25T09:01:01.236074+0000","last_became_peered":"2024-04-25T09:01:01.236074+0000","last_unstale":"2024-04-25T09:01:01.238072+0000","last_undegraded":"2024-04-25T09:01:01.238072+0000","last_fullsized":"2024-04-25T09:01:01.238072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:00.672674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222861+0000","last_change":"2024-04-25T09:01:01.222861+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222861+0000","last_undegraded":"2024-04-25T09:01:01.222861+0000","last_fullsized":"2024-04-25T09:01:01.222861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239459+0000","last_change":"2024-04-25T09:01:01.236938+0000","last_active":"2024-04-25T09:01:01.239459+0000","last_peered":"2024-04-25T09:01:01.239459+0000","last_clean":"2024-04-25T09:01:01.239459+0000","last_became_active":"2024-04-25T09:01:01.236641+0000","last_became_peered":"2024-04-25T09:01:01.236641+0000","last_unstale":"2024-04-25T09:01:01.239459+0000","last_undegraded":"2024-04-25T09:01:01.239459+0000","last_fullsized":"2024-04-25T09:01:01.239459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:51.233630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228253+0000","last_change":"2024-04-25T09:01:01.228253+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228253+0000","last_undegraded":"2024-04-25T09:01:01.228253+0000","last_fullsized":"2024-04-25T09:01:01.228253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236815+0000","last_change":"2024-04-25T09:01:01.234642+0000","last_active":"2024-04-25T09:01:01.236815+0000","last_peered":"2024-04-25T09:01:01.236815+0000","last_clean":"2024-04-25T09:01:01.236815+0000","last_became_active":"2024-04-25T09:01:01.233993+0000","last_became_peered":"2024-04-25T09:01:01.233993+0000","last_unstale":"2024-04-25T09:01:01.236815+0000","last_undegraded":"2024-04-25T09:01:01.236815+0000","last_fullsized":"2024-04-25T09:01:01.236815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:55.924835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221843+0000","last_change":"2024-04-25T09:01:01.221843+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221843+0000","last_undegraded":"2024-04-25T09:01:01.221843+0000","last_fullsized":"2024-04-25T09:01:01.221843+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231483+0000","last_change":"2024-04-25T09:01:01.230328+0000","last_active":"2024-04-25T09:01:01.231483+0000","last_peered":"2024-04-25T09:01:01.231483+0000","last_clean":"2024-04-25T09:01:01.231483+0000","last_became_active":"2024-04-25T09:01:01.230056+0000","last_became_peered":"2024-04-25T09:01:01.230056+0000","last_unstale":"2024-04-25T09:01:01.231483+0000","last_undegraded":"2024-04-25T09:01:01.231483+0000","last_fullsized":"2024-04-25T09:01:01.231483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:11.184492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224444+0000","last_change":"2024-04-25T09:01:01.224444+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224444+0000","last_undegraded":"2024-04-25T09:01:01.224444+0000","last_fullsized":"2024-04-25T09:01:01.224444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.234054+0000","last_change":"2024-04-25T09:01:01.232109+0000","last_active":"2024-04-25T09:01:01.234054+0000","last_peered":"2024-04-25T09:01:01.234054+0000","last_clean":"2024-04-25T09:01:01.234054+0000","last_became_active":"2024-04-25T09:01:01.231725+0000","last_became_peered":"2024-04-25T09:01:01.231725+0000","last_unstale":"2024-04-25T09:01:01.234054+0000","last_undegraded":"2024-04-25T09:01:01.234054+0000","last_fullsized":"2024-04-25T09:01:01.234054+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:56.538105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224437+0000","last_change":"2024-04-25T09:01:01.224437+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224437+0000","last_undegraded":"2024-04-25T09:01:01.224437+0000","last_fullsized":"2024-04-25T09:01:01.224437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.235641+0000","last_change":"2024-04-25T09:01:01.234319+0000","last_active":"2024-04-25T09:01:01.235641+0000","last_peered":"2024-04-25T09:01:01.235641+0000","last_clean":"2024-04-25T09:01:01.235641+0000","last_became_active":"2024-04-25T09:01:01.233929+0000","last_became_peered":"2024-04-25T09:01:01.233929+0000","last_unstale":"2024-04-25T09:01:01.235641+0000","last_undegraded":"2024-04-25T09:01:01.235641+0000","last_fullsized":"2024-04-25T09:01:01.235641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:05.186239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221319+0000","last_change":"2024-04-25T09:01:01.221319+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221319+0000","last_undegraded":"2024-04-25T09:01:01.221319+0000","last_fullsized":"2024-04-25T09:01:01.221319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238082+0000","last_change":"2024-04-25T09:01:01.234998+0000","last_active":"2024-04-25T09:01:01.238082+0000","last_peered":"2024-04-25T09:01:01.238082+0000","last_clean":"2024-04-25T09:01:01.238082+0000","last_became_active":"2024-04-25T09:01:01.234729+0000","last_became_peered":"2024-04-25T09:01:01.234729+0000","last_unstale":"2024-04-25T09:01:01.238082+0000","last_undegraded":"2024-04-25T09:01:01.238082+0000","last_fullsized":"2024-04-25T09:01:01.238082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:14.158208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227903+0000","last_change":"2024-04-25T09:01:01.227903+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227903+0000","last_undegraded":"2024-04-25T09:01:01.227903+0000","last_fullsized":"2024-04-25T09:01:01.227903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236477+0000","last_change":"2024-04-25T09:01:01.233631+0000","last_active":"2024-04-25T09:01:01.236477+0000","last_peered":"2024-04-25T09:01:01.236477+0000","last_clean":"2024-04-25T09:01:01.236477+0000","last_became_active":"2024-04-25T09:01:01.233339+0000","last_became_peered":"2024-04-25T09:01:01.233339+0000","last_unstale":"2024-04-25T09:01:01.236477+0000","last_undegraded":"2024-04-25T09:01:01.236477+0000","last_fullsized":"2024-04-25T09:01:01.236477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:23.317888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225834+0000","last_change":"2024-04-25T09:01:01.225834+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225834+0000","last_undegraded":"2024-04-25T09:01:01.225834+0000","last_fullsized":"2024-04-25T09:01:01.225834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239782+0000","last_change":"2024-04-25T09:01:01.237715+0000","last_active":"2024-04-25T09:01:01.239782+0000","last_peered":"2024-04-25T09:01:01.239782+0000","last_clean":"2024-04-25T09:01:01.239782+0000","last_became_active":"2024-04-25T09:01:01.237450+0000","last_became_peered":"2024-04-25T09:01:01.237450+0000","last_unstale":"2024-04-25T09:01:01.239782+0000","last_undegraded":"2024-04-25T09:01:01.239782+0000","last_fullsized":"2024-04-25T09:01:01.239782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.625155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227249+0000","last_change":"2024-04-25T09:01:01.227249+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227249+0000","last_undegraded":"2024-04-25T09:01:01.227249+0000","last_fullsized":"2024-04-25T09:01:01.227249+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.235499+0000","last_change":"2024-04-25T09:01:01.232026+0000","last_active":"2024-04-25T09:01:01.235499+0000","last_peered":"2024-04-25T09:01:01.235499+0000","last_clean":"2024-04-25T09:01:01.235499+0000","last_became_active":"2024-04-25T09:01:01.231767+0000","last_became_peered":"2024-04-25T09:01:01.231767+0000","last_unstale":"2024-04-25T09:01:01.235499+0000","last_undegraded":"2024-04-25T09:01:01.235499+0000","last_fullsized":"2024-04-25T09:01:01.235499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221810+0000","last_change":"2024-04-25T09:01:01.221810+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221810+0000","last_undegraded":"2024-04-25T09:01:01.221810+0000","last_fullsized":"2024-04-25T09:01:01.221810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239223+0000","last_change":"2024-04-25T09:01:01.238350+0000","last_active":"2024-04-25T09:01:01.239223+0000","last_peered":"2024-04-25T09:01:01.239223+0000","last_clean":"2024-04-25T09:01:01.239223+0000","last_became_active":"2024-04-25T09:01:01.237873+0000","last_became_peered":"2024-04-25T09:01:01.237873+0000","last_unstale":"2024-04-25T09:01:01.239223+0000","last_undegraded":"2024-04-25T09:01:01.239223+0000","last_fullsized":"2024-04-25T09:01:01.239223+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.270714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":264,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.228117+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:01:01.228117+0000","last_peered":"2024-04-25T09:01:01.228117+0000","last_clean":"2024-04-25T09:01:01.228117+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:01:01.228117+0000","last_undegraded":"2024-04-25T09:01:01.228117+0000","last_fullsized":"2024-04-25T09:01:01.228117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1458176,"data_stored":955629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335652,"statfs":{"total":96636764160,"available":96599707648,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40332,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":851968,"data_stored":358986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44496,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327344,"statfs":{"total":96636764160,"available":96591200256,"internally_reserved":0,"allocated":851968,"data_stored":358986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40344,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331496,"statfs":{"total":96636764160,"available":96595451904,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44508,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327332,"statfs":{"total":96636764160,"available":96591187968,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36752,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335088,"statfs":{"total":96636764160,"available":96599130112,"internally_reserved":0,"allocated":1445888,"data_stored":949354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:05.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.359+0000 7f0500207640 1 Processor -- start 2024-04-25T09:01:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.359+0000 7f0500207640 1 -- start start 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f0500207640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04f815de70 0x7f04f80b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f0500207640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04f80b2cc0 0x7f04f80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f0500207640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b7130 0x7f04f80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f0500207640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80d2a10 con 0x7f04f80b2cc0 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f0500207640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80d20e0 con 0x7f04f815de70 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f0500207640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80d23c0 con 0x7f04f80b7130 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04f80b2cc0 0x7f04f80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04f80b2cc0 0x7f04f80b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55310/0 (socket says 172.21.15.5:55310) 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 -- 172.21.15.5:0/334488286 learned_addr learned my addr 172.21.15.5:0/334488286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fe7a4640 1 --2- 172.21.15.5:0/334488286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b7130 0x7f04f80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fdfa3640 1 --2- 172.21.15.5:0/334488286 >> v2:172.21.15.80:3300/0 conn(0x7f04f815de70 0x7f04f80b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 -- 172.21.15.5:0/334488286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b7130 msgr2=0x7f04f80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 --2- 172.21.15.5:0/334488286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b7130 0x7f04f80ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 -- 172.21.15.5:0/334488286 >> v2:172.21.15.80:3300/0 conn(0x7f04f815de70 msgr2=0x7f04f80b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 --2- 172.21.15.5:0/334488286 >> v2:172.21.15.80:3300/0 conn(0x7f04f815de70 0x7f04f80b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.360+0000 7f04fd7a2640 1 -- 172.21.15.5:0/334488286 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80d26a0 con 0x7f04f80b2cc0 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.361+0000 7f04fd7a2640 1 --2- 172.21.15.5:0/334488286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80b2cc0 0x7f04f80b6bf0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f04f80d1650 tx=0x7f04e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37df531cee1699fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.361+0000 7f04fcfa1640 1 -- 172.21.15.5:0/334488286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8037070 con 0x7f04f80b2cc0 2024-04-25T09:01:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.361+0000 7f04fcfa1640 1 -- 172.21.15.5:0/334488286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8032440 con 0x7f04f80b2cc0 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.361+0000 7f04fcfa1640 1 -- 172.21.15.5:0/334488286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8032810 con 0x7f04f80b2cc0 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.361+0000 7f0500207640 1 -- 172.21.15.5:0/334488286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80b2cc0 msgr2=0x7f04f80b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.361+0000 7f0500207640 1 --2- 172.21.15.5:0/334488286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80b2cc0 0x7f04f80b6bf0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f04f80d1650 tx=0x7f04e802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.362+0000 7f0500207640 1 -- 172.21.15.5:0/334488286 shutdown_connections 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.362+0000 7f0500207640 1 --2- 172.21.15.5:0/334488286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b7130 0x7f04f80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.362+0000 7f0500207640 1 --2- 172.21.15.5:0/334488286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80b2cc0 0x7f04f80b6bf0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.362+0000 7f0500207640 1 --2- 172.21.15.5:0/334488286 >> v2:172.21.15.80:3300/0 conn(0x7f04f815de70 0x7f04f80b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.362+0000 7f0500207640 1 -- 172.21.15.5:0/334488286 >> 172.21.15.5:0/334488286 conn(0x7f04f806b000 msgr2=0x7f04f806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.362+0000 7f0500207640 1 -- 172.21.15.5:0/334488286 shutdown_connections 2024-04-25T09:01:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.362+0000 7f0500207640 1 -- 172.21.15.5:0/334488286 wait complete. 2024-04-25T09:01:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 Processor -- start 2024-04-25T09:01:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 -- start start 2024-04-25T09:01:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b2cc0 0x7f04f81f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04f80b7130 0x7f04f8159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f815de70 0x7f04f8159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80ceeb0 con 0x7f04f815de70 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80ced30 con 0x7f04f80b7130 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.363+0000 7f0500207640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80cf030 con 0x7f04f80b2cc0 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f815de70 0x7f04f8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f815de70 0x7f04f8159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55320/0 (socket says 172.21.15.5:55320) 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 -- 172.21.15.5:0/1148946524 learned_addr learned my addr 172.21.15.5:0/1148946524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fdfa3640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b2cc0 0x7f04f81f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fd7a2640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04f80b7130 0x7f04f8159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 -- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b2cc0 msgr2=0x7f04f81f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b2cc0 0x7f04f81f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 -- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04f80b7130 msgr2=0x7f04f8159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04f80b7130 0x7f04f8159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 -- 172.21.15.5:0/1148946524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8144b10 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04fe7a4640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f815de70 0x7f04f8159980 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f04f000eed0 tx=0x7f04f000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04ee7fc640 1 -- 172.21.15.5:0/1148946524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0018020 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04ee7fc640 1 -- 172.21.15.5:0/1148946524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0014400 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f80b6450 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f04ee7fc640 1 -- 172.21.15.5:0/1148946524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00147f0 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.364+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f8145090 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.365+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f804ef20 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.366+0000 7f04ee7fc640 1 -- 172.21.15.5:0/1148946524 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04f0005d10 con 0x7f04f815de70 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.366+0000 7f04ee7fc640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04dc06b4d0 0x7f04dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.366+0000 7f04ee7fc640 1 -- 172.21.15.5:0/1148946524 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04f008a830 con 0x7f04f815de70 2024-04-25T09:01:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.366+0000 7f04fdfa3640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04dc06b4d0 0x7f04dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.367+0000 7f04fdfa3640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04dc06b4d0 0x7f04dc06d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f04f815e610 tx=0x7f04f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.370+0000 7f04ee7fc640 1 -- 172.21.15.5:0/1148946524 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04f0022070 con 0x7f04f815de70 2024-04-25T09:01:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.548+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04f80b6e30 con 0x7f04dc06b4d0 2024-04-25T09:01:05.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.555+0000 7f04ee7fc640 1 -- 172.21.15.5:0/1148946524 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246750 (secure 0 0 0) 0x7f04f80b6e30 con 0x7f04dc06b4d0 2024-04-25T09:01:05.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:05.675 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:01:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04dc06b4d0 msgr2=0x7f04dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04dc06b4d0 0x7f04dc06d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f04f815e610 tx=0x7f04f4008040 comp rx=0 tx=0).stop 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f815de70 msgr2=0x7f04f8159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f815de70 0x7f04f8159980 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f04f000eed0 tx=0x7f04f000b480 comp rx=0 tx=0).stop 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 shutdown_connections 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f04dc06b4d0 0x7f04dc06d990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f815de70 0x7f04f8159980 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04f80b7130 0x7f04f8159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 --2- 172.21.15.5:0/1148946524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04f80b2cc0 0x7f04f81f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 >> 172.21.15.5:0/1148946524 conn(0x7f04f806b000 msgr2=0x7f04f80d2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 shutdown_connections 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.558+0000 7f0500207640 1 -- 172.21.15.5:0/1148946524 wait complete. 2024-04-25T09:01:05.678 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-25T09:01:04.446524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315568,"kb_used_data":7876,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754659152,"statfs":{"total":773094113280,"available":772770971648,"internally_reserved":0,"allocated":8065024,"data_stored":4083999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":314953265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.229709"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226674+0000","last_change":"2024-04-25T09:01:01.226674+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226674+0000","last_undegraded":"2024-04-25T09:01:01.226674+0000","last_fullsized":"2024-04-25T09:01:01.226674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228288+0000","last_change":"2024-04-25T09:01:01.228288+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228288+0000","last_undegraded":"2024-04-25T09:01:01.228288+0000","last_fullsized":"2024-04-25T09:01:01.228288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222644+0000","last_change":"2024-04-25T09:01:01.222644+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222644+0000","last_undegraded":"2024-04-25T09:01:01.222644+0000","last_fullsized":"2024-04-25T09:01:01.222644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228360+0000","last_change":"2024-04-25T09:01:01.228360+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228360+0000","last_undegraded":"2024-04-25T09:01:01.228360+0000","last_fullsized":"2024-04-25T09:01:01.228360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223760+0000","last_change":"2024-04-25T09:01:01.223760+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223760+0000","last_undegraded":"2024-04-25T09:01:01.223760+0000","last_fullsized":"2024-04-25T09:01:01.223760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229565+0000","last_change":"2024-04-25T09:01:01.229565+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229565+0000","last_undegraded":"2024-04-25T09:01:01.229565+0000","last_fullsized":"2024-04-25T09:01:01.229565+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223378+0000","last_change":"2024-04-25T09:01:01.223378+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223378+0000","last_undegraded":"2024-04-25T09:01:01.223378+0000","last_fullsized":"2024-04-25T09:01:01.223378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228440+0000","last_change":"2024-04-25T09:01:01.228440+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228440+0000","last_undegraded":"2024-04-25T09:01:01.228440+0000","last_fullsized":"2024-04-25T09:01:01.228440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223223+0000","last_change":"2024-04-25T09:01:01.223223+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223223+0000","last_undegraded":"2024-04-25T09:01:01.223223+0000","last_fullsized":"2024-04-25T09:01:01.223223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224089+0000","last_change":"2024-04-25T09:01:01.224089+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224089+0000","last_undegraded":"2024-04-25T09:01:01.224089+0000","last_fullsized":"2024-04-25T09:01:01.224089+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227739+0000","last_change":"2024-04-25T09:01:01.227739+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227739+0000","last_undegraded":"2024-04-25T09:01:01.227739+0000","last_fullsized":"2024-04-25T09:01:01.227739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226605+0000","last_change":"2024-04-25T09:01:01.226605+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226605+0000","last_undegraded":"2024-04-25T09:01:01.226605+0000","last_fullsized":"2024-04-25T09:01:01.226605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225339+0000","last_change":"2024-04-25T09:01:01.225339+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225339+0000","last_undegraded":"2024-04-25T09:01:01.225339+0000","last_fullsized":"2024-04-25T09:01:01.225339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223248+0000","last_change":"2024-04-25T09:01:01.223248+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223248+0000","last_undegraded":"2024-04-25T09:01:01.223248+0000","last_fullsized":"2024-04-25T09:01:01.223248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226450+0000","last_change":"2024-04-25T09:01:01.226450+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226450+0000","last_undegraded":"2024-04-25T09:01:01.226450+0000","last_fullsized":"2024-04-25T09:01:01.226450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223679+0000","last_change":"2024-04-25T09:01:01.223679+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223679+0000","last_undegraded":"2024-04-25T09:01:01.223679+0000","last_fullsized":"2024-04-25T09:01:01.223679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222743+0000","last_change":"2024-04-25T09:01:01.222743+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222743+0000","last_undegraded":"2024-04-25T09:01:01.222743+0000","last_fullsized":"2024-04-25T09:01:01.222743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226244+0000","last_change":"2024-04-25T09:01:01.226244+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226244+0000","last_undegraded":"2024-04-25T09:01:01.226244+0000","last_fullsized":"2024-04-25T09:01:01.226244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229348+0000","last_change":"2024-04-25T09:01:01.229348+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229348+0000","last_undegraded":"2024-04-25T09:01:01.229348+0000","last_fullsized":"2024-04-25T09:01:01.229348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227740+0000","last_change":"2024-04-25T09:01:01.227740+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227740+0000","last_undegraded":"2024-04-25T09:01:01.227740+0000","last_fullsized":"2024-04-25T09:01:01.227740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222675+0000","last_change":"2024-04-25T09:01:01.222675+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222675+0000","last_undegraded":"2024-04-25T09:01:01.222675+0000","last_fullsized":"2024-04-25T09:01:01.222675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222263+0000","last_change":"2024-04-25T09:01:01.222263+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222263+0000","last_undegraded":"2024-04-25T09:01:01.222263+0000","last_fullsized":"2024-04-25T09:01:01.222263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224950+0000","last_change":"2024-04-25T09:01:01.224950+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224950+0000","last_undegraded":"2024-04-25T09:01:01.224950+0000","last_fullsized":"2024-04-25T09:01:01.224950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224445+0000","last_change":"2024-04-25T09:01:01.224445+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224445+0000","last_undegraded":"2024-04-25T09:01:01.224445+0000","last_fullsized":"2024-04-25T09:01:01.224445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225606+0000","last_change":"2024-04-25T09:01:01.225606+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225606+0000","last_undegraded":"2024-04-25T09:01:01.225606+0000","last_fullsized":"2024-04-25T09:01:01.225606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223971+0000","last_change":"2024-04-25T09:01:01.223971+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223971+0000","last_undegraded":"2024-04-25T09:01:01.223971+0000","last_fullsized":"2024-04-25T09:01:01.223971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222149+0000","last_change":"2024-04-25T09:01:01.222149+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222149+0000","last_undegraded":"2024-04-25T09:01:01.222149+0000","last_fullsized":"2024-04-25T09:01:01.222149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224009+0000","last_change":"2024-04-25T09:01:01.224009+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224009+0000","last_undegraded":"2024-04-25T09:01:01.224009+0000","last_fullsized":"2024-04-25T09:01:01.224009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222769+0000","last_change":"2024-04-25T09:01:01.222769+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222769+0000","last_undegraded":"2024-04-25T09:01:01.222769+0000","last_fullsized":"2024-04-25T09:01:01.222769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222564+0000","last_change":"2024-04-25T09:01:01.222564+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222564+0000","last_undegraded":"2024-04-25T09:01:01.222564+0000","last_fullsized":"2024-04-25T09:01:01.222564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222623+0000","last_change":"2024-04-25T09:01:01.222623+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222623+0000","last_undegraded":"2024-04-25T09:01:01.222623+0000","last_fullsized":"2024-04-25T09:01:01.222623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227251+0000","last_change":"2024-04-25T09:01:01.227251+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227251+0000","last_undegraded":"2024-04-25T09:01:01.227251+0000","last_fullsized":"2024-04-25T09:01:01.227251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225318+0000","last_change":"2024-04-25T09:01:01.225318+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225318+0000","last_undegraded":"2024-04-25T09:01:01.225318+0000","last_fullsized":"2024-04-25T09:01:01.225318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240476+0000","last_change":"2024-04-25T09:01:01.239796+0000","last_active":"2024-04-25T09:01:01.240476+0000","last_peered":"2024-04-25T09:01:01.240476+0000","last_clean":"2024-04-25T09:01:01.240476+0000","last_became_active":"2024-04-25T09:01:01.239418+0000","last_became_peered":"2024-04-25T09:01:01.239418+0000","last_unstale":"2024-04-25T09:01:01.240476+0000","last_undegraded":"2024-04-25T09:01:01.240476+0000","last_fullsized":"2024-04-25T09:01:01.240476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:14.071547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222294+0000","last_change":"2024-04-25T09:01:01.222294+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222294+0000","last_undegraded":"2024-04-25T09:01:01.222294+0000","last_fullsized":"2024-04-25T09:01:01.222294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239552+0000","last_change":"2024-04-25T09:01:01.236292+0000","last_active":"2024-04-25T09:01:01.239552+0000","last_peered":"2024-04-25T09:01:01.239552+0000","last_clean":"2024-04-25T09:01:01.239552+0000","last_became_active":"2024-04-25T09:01:01.235994+0000","last_became_peered":"2024-04-25T09:01:01.235994+0000","last_unstale":"2024-04-25T09:01:01.239552+0000","last_undegraded":"2024-04-25T09:01:01.239552+0000","last_fullsized":"2024-04-25T09:01:01.239552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:09.973429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229901+0000","last_change":"2024-04-25T09:01:01.229901+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229901+0000","last_undegraded":"2024-04-25T09:01:01.229901+0000","last_fullsized":"2024-04-25T09:01:01.229901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239109+0000","last_change":"2024-04-25T09:01:01.235176+0000","last_active":"2024-04-25T09:01:01.239109+0000","last_peered":"2024-04-25T09:01:01.239109+0000","last_clean":"2024-04-25T09:01:01.239109+0000","last_became_active":"2024-04-25T09:01:01.234875+0000","last_became_peered":"2024-04-25T09:01:01.234875+0000","last_unstale":"2024-04-25T09:01:01.239109+0000","last_undegraded":"2024-04-25T09:01:01.239109+0000","last_fullsized":"2024-04-25T09:01:01.239109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:46.750140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227344+0000","last_change":"2024-04-25T09:01:01.227344+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227344+0000","last_undegraded":"2024-04-25T09:01:01.227344+0000","last_fullsized":"2024-04-25T09:01:01.227344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237496+0000","last_change":"2024-04-25T09:01:01.234022+0000","last_active":"2024-04-25T09:01:01.237496+0000","last_peered":"2024-04-25T09:01:01.237496+0000","last_clean":"2024-04-25T09:01:01.237496+0000","last_became_active":"2024-04-25T09:01:01.233403+0000","last_became_peered":"2024-04-25T09:01:01.233403+0000","last_unstale":"2024-04-25T09:01:01.237496+0000","last_undegraded":"2024-04-25T09:01:01.237496+0000","last_fullsized":"2024-04-25T09:01:01.237496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:02.209579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222054+0000","last_change":"2024-04-25T09:01:01.222054+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222054+0000","last_undegraded":"2024-04-25T09:01:01.222054+0000","last_fullsized":"2024-04-25T09:01:01.222054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231430+0000","last_change":"2024-04-25T09:01:01.229650+0000","last_active":"2024-04-25T09:01:01.231430+0000","last_peered":"2024-04-25T09:01:01.231430+0000","last_clean":"2024-04-25T09:01:01.231430+0000","last_became_active":"2024-04-25T09:01:01.229258+0000","last_became_peered":"2024-04-25T09:01:01.229258+0000","last_unstale":"2024-04-25T09:01:01.231430+0000","last_undegraded":"2024-04-25T09:01:01.231430+0000","last_fullsized":"2024-04-25T09:01:01.231430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:32.252719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222156+0000","last_change":"2024-04-25T09:01:01.222156+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222156+0000","last_undegraded":"2024-04-25T09:01:01.222156+0000","last_fullsized":"2024-04-25T09:01:01.222156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237130+0000","last_change":"2024-04-25T09:01:01.234016+0000","last_active":"2024-04-25T09:01:01.237130+0000","last_peered":"2024-04-25T09:01:01.237130+0000","last_clean":"2024-04-25T09:01:01.237130+0000","last_became_active":"2024-04-25T09:01:01.233595+0000","last_became_peered":"2024-04-25T09:01:01.233595+0000","last_unstale":"2024-04-25T09:01:01.237130+0000","last_undegraded":"2024-04-25T09:01:01.237130+0000","last_fullsized":"2024-04-25T09:01:01.237130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:23.317888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222234+0000","last_change":"2024-04-25T09:01:01.222234+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222234+0000","last_undegraded":"2024-04-25T09:01:01.222234+0000","last_fullsized":"2024-04-25T09:01:01.222234+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231221+0000","last_change":"2024-04-25T09:01:01.230135+0000","last_active":"2024-04-25T09:01:01.231221+0000","last_peered":"2024-04-25T09:01:01.231221+0000","last_clean":"2024-04-25T09:01:01.231221+0000","last_became_active":"2024-04-25T09:01:01.229853+0000","last_became_peered":"2024-04-25T09:01:01.229853+0000","last_unstale":"2024-04-25T09:01:01.231221+0000","last_undegraded":"2024-04-25T09:01:01.231221+0000","last_fullsized":"2024-04-25T09:01:01.231221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:26.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225867+0000","last_change":"2024-04-25T09:01:01.225867+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225867+0000","last_undegraded":"2024-04-25T09:01:01.225867+0000","last_fullsized":"2024-04-25T09:01:01.225867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.234352+0000","last_change":"2024-04-25T09:01:01.232041+0000","last_active":"2024-04-25T09:01:01.234352+0000","last_peered":"2024-04-25T09:01:01.234352+0000","last_clean":"2024-04-25T09:01:01.234352+0000","last_became_active":"2024-04-25T09:01:01.231752+0000","last_became_peered":"2024-04-25T09:01:01.231752+0000","last_unstale":"2024-04-25T09:01:01.234352+0000","last_undegraded":"2024-04-25T09:01:01.234352+0000","last_fullsized":"2024-04-25T09:01:01.234352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:53.291603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221876+0000","last_change":"2024-04-25T09:01:01.221876+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221876+0000","last_undegraded":"2024-04-25T09:01:01.221876+0000","last_fullsized":"2024-04-25T09:01:01.221876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239062+0000","last_change":"2024-04-25T09:01:01.233295+0000","last_active":"2024-04-25T09:01:01.239062+0000","last_peered":"2024-04-25T09:01:01.239062+0000","last_clean":"2024-04-25T09:01:01.239062+0000","last_became_active":"2024-04-25T09:01:01.233010+0000","last_became_peered":"2024-04-25T09:01:01.233010+0000","last_unstale":"2024-04-25T09:01:01.239062+0000","last_undegraded":"2024-04-25T09:01:01.239062+0000","last_fullsized":"2024-04-25T09:01:01.239062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:16.549011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226228+0000","last_change":"2024-04-25T09:01:01.226228+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226228+0000","last_undegraded":"2024-04-25T09:01:01.226228+0000","last_fullsized":"2024-04-25T09:01:01.226228+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239252+0000","last_change":"2024-04-25T09:01:01.238466+0000","last_active":"2024-04-25T09:01:01.239252+0000","last_peered":"2024-04-25T09:01:01.239252+0000","last_clean":"2024-04-25T09:01:01.239252+0000","last_became_active":"2024-04-25T09:01:01.236891+0000","last_became_peered":"2024-04-25T09:01:01.236891+0000","last_unstale":"2024-04-25T09:01:01.239252+0000","last_undegraded":"2024-04-25T09:01:01.239252+0000","last_fullsized":"2024-04-25T09:01:01.239252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:19.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229341+0000","last_change":"2024-04-25T09:01:01.229341+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229341+0000","last_undegraded":"2024-04-25T09:01:01.229341+0000","last_fullsized":"2024-04-25T09:01:01.229341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231211+0000","last_change":"2024-04-25T09:01:01.227525+0000","last_active":"2024-04-25T09:01:01.231211+0000","last_peered":"2024-04-25T09:01:01.231211+0000","last_clean":"2024-04-25T09:01:01.231211+0000","last_became_active":"2024-04-25T09:01:01.227183+0000","last_became_peered":"2024-04-25T09:01:01.227183+0000","last_unstale":"2024-04-25T09:01:01.231211+0000","last_undegraded":"2024-04-25T09:01:01.231211+0000","last_fullsized":"2024-04-25T09:01:01.231211+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:51.139787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221812+0000","last_change":"2024-04-25T09:01:01.221812+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221812+0000","last_undegraded":"2024-04-25T09:01:01.221812+0000","last_fullsized":"2024-04-25T09:01:01.221812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236279+0000","last_change":"2024-04-25T09:01:01.235651+0000","last_active":"2024-04-25T09:01:01.236279+0000","last_peered":"2024-04-25T09:01:01.236279+0000","last_clean":"2024-04-25T09:01:01.236279+0000","last_became_active":"2024-04-25T09:01:01.235376+0000","last_became_peered":"2024-04-25T09:01:01.235376+0000","last_unstale":"2024-04-25T09:01:01.236279+0000","last_undegraded":"2024-04-25T09:01:01.236279+0000","last_fullsized":"2024-04-25T09:01:01.236279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:02.209579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226579+0000","last_change":"2024-04-25T09:01:01.226579+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226579+0000","last_undegraded":"2024-04-25T09:01:01.226579+0000","last_fullsized":"2024-04-25T09:01:01.226579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240096+0000","last_change":"2024-04-25T09:01:01.239403+0000","last_active":"2024-04-25T09:01:01.240096+0000","last_peered":"2024-04-25T09:01:01.240096+0000","last_clean":"2024-04-25T09:01:01.240096+0000","last_became_active":"2024-04-25T09:01:01.239077+0000","last_became_peered":"2024-04-25T09:01:01.239077+0000","last_unstale":"2024-04-25T09:01:01.240096+0000","last_undegraded":"2024-04-25T09:01:01.240096+0000","last_fullsized":"2024-04-25T09:01:01.240096+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:53.341918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222774+0000","last_change":"2024-04-25T09:01:01.222774+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222774+0000","last_undegraded":"2024-04-25T09:01:01.222774+0000","last_fullsized":"2024-04-25T09:01:01.222774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238806+0000","last_change":"2024-04-25T09:01:01.237737+0000","last_active":"2024-04-25T09:01:01.238806+0000","last_peered":"2024-04-25T09:01:01.238806+0000","last_clean":"2024-04-25T09:01:01.238806+0000","last_became_active":"2024-04-25T09:01:01.236940+0000","last_became_peered":"2024-04-25T09:01:01.236940+0000","last_unstale":"2024-04-25T09:01:01.238806+0000","last_undegraded":"2024-04-25T09:01:01.238806+0000","last_fullsized":"2024-04-25T09:01:01.238806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:27.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226906+0000","last_change":"2024-04-25T09:01:01.226906+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226906+0000","last_undegraded":"2024-04-25T09:01:01.226906+0000","last_fullsized":"2024-04-25T09:01:01.226906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.232478+0000","last_change":"2024-04-25T09:01:01.231724+0000","last_active":"2024-04-25T09:01:01.232478+0000","last_peered":"2024-04-25T09:01:01.232478+0000","last_clean":"2024-04-25T09:01:01.232478+0000","last_became_active":"2024-04-25T09:01:01.231424+0000","last_became_peered":"2024-04-25T09:01:01.231424+0000","last_unstale":"2024-04-25T09:01:01.232478+0000","last_undegraded":"2024-04-25T09:01:01.232478+0000","last_fullsized":"2024-04-25T09:01:01.232478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:14.071547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221291+0000","last_change":"2024-04-25T09:01:01.221291+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221291+0000","last_undegraded":"2024-04-25T09:01:01.221291+0000","last_fullsized":"2024-04-25T09:01:01.221291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239191+0000","last_change":"2024-04-25T09:01:01.236893+0000","last_active":"2024-04-25T09:01:01.239191+0000","last_peered":"2024-04-25T09:01:01.239191+0000","last_clean":"2024-04-25T09:01:01.239191+0000","last_became_active":"2024-04-25T09:01:01.236494+0000","last_became_peered":"2024-04-25T09:01:01.236494+0000","last_unstale":"2024-04-25T09:01:01.239191+0000","last_undegraded":"2024-04-25T09:01:01.239191+0000","last_fullsized":"2024-04-25T09:01:01.239191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:53.737808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223082+0000","last_change":"2024-04-25T09:01:01.223082+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223082+0000","last_undegraded":"2024-04-25T09:01:01.223082+0000","last_fullsized":"2024-04-25T09:01:01.223082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236839+0000","last_change":"2024-04-25T09:01:01.235551+0000","last_active":"2024-04-25T09:01:01.236839+0000","last_peered":"2024-04-25T09:01:01.236839+0000","last_clean":"2024-04-25T09:01:01.236839+0000","last_became_active":"2024-04-25T09:01:01.234355+0000","last_became_peered":"2024-04-25T09:01:01.234355+0000","last_unstale":"2024-04-25T09:01:01.236839+0000","last_undegraded":"2024-04-25T09:01:01.236839+0000","last_fullsized":"2024-04-25T09:01:01.236839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:29.719073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225791+0000","last_change":"2024-04-25T09:01:01.225791+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225791+0000","last_undegraded":"2024-04-25T09:01:01.225791+0000","last_fullsized":"2024-04-25T09:01:01.225791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239428+0000","last_change":"2024-04-25T09:01:01.234423+0000","last_active":"2024-04-25T09:01:01.239428+0000","last_peered":"2024-04-25T09:01:01.239428+0000","last_clean":"2024-04-25T09:01:01.239428+0000","last_became_active":"2024-04-25T09:01:01.234153+0000","last_became_peered":"2024-04-25T09:01:01.234153+0000","last_unstale":"2024-04-25T09:01:01.239428+0000","last_undegraded":"2024-04-25T09:01:01.239428+0000","last_fullsized":"2024-04-25T09:01:01.239428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.542901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226139+0000","last_change":"2024-04-25T09:01:01.226139+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226139+0000","last_undegraded":"2024-04-25T09:01:01.226139+0000","last_fullsized":"2024-04-25T09:01:01.226139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236752+0000","last_change":"2024-04-25T09:01:01.233697+0000","last_active":"2024-04-25T09:01:01.236752+0000","last_peered":"2024-04-25T09:01:01.236752+0000","last_clean":"2024-04-25T09:01:01.236752+0000","last_became_active":"2024-04-25T09:01:01.233426+0000","last_became_peered":"2024-04-25T09:01:01.233426+0000","last_unstale":"2024-04-25T09:01:01.236752+0000","last_undegraded":"2024-04-25T09:01:01.236752+0000","last_fullsized":"2024-04-25T09:01:01.236752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:26.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221270+0000","last_change":"2024-04-25T09:01:01.221270+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221270+0000","last_undegraded":"2024-04-25T09:01:01.221270+0000","last_fullsized":"2024-04-25T09:01:01.221270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240767+0000","last_change":"2024-04-25T09:01:01.240177+0000","last_active":"2024-04-25T09:01:01.240767+0000","last_peered":"2024-04-25T09:01:01.240767+0000","last_clean":"2024-04-25T09:01:01.240767+0000","last_became_active":"2024-04-25T09:01:01.239854+0000","last_became_peered":"2024-04-25T09:01:01.239854+0000","last_unstale":"2024-04-25T09:01:01.240767+0000","last_undegraded":"2024-04-25T09:01:01.240767+0000","last_fullsized":"2024-04-25T09:01:01.240767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:00.672674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222111+0000","last_change":"2024-04-25T09:01:01.222111+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222111+0000","last_undegraded":"2024-04-25T09:01:01.222111+0000","last_fullsized":"2024-04-25T09:01:01.222111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237150+0000","last_change":"2024-04-25T09:01:01.234455+0000","last_active":"2024-04-25T09:01:01.237150+0000","last_peered":"2024-04-25T09:01:01.237150+0000","last_clean":"2024-04-25T09:01:01.237150+0000","last_became_active":"2024-04-25T09:01:01.234104+0000","last_became_peered":"2024-04-25T09:01:01.234104+0000","last_unstale":"2024-04-25T09:01:01.237150+0000","last_undegraded":"2024-04-25T09:01:01.237150+0000","last_fullsized":"2024-04-25T09:01:01.237150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:53.341918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224154+0000","last_change":"2024-04-25T09:01:01.224154+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224154+0000","last_undegraded":"2024-04-25T09:01:01.224154+0000","last_fullsized":"2024-04-25T09:01:01.224154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238072+0000","last_change":"2024-04-25T09:01:01.236375+0000","last_active":"2024-04-25T09:01:01.238072+0000","last_peered":"2024-04-25T09:01:01.238072+0000","last_clean":"2024-04-25T09:01:01.238072+0000","last_became_active":"2024-04-25T09:01:01.236074+0000","last_became_peered":"2024-04-25T09:01:01.236074+0000","last_unstale":"2024-04-25T09:01:01.238072+0000","last_undegraded":"2024-04-25T09:01:01.238072+0000","last_fullsized":"2024-04-25T09:01:01.238072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:00.672674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222861+0000","last_change":"2024-04-25T09:01:01.222861+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222861+0000","last_undegraded":"2024-04-25T09:01:01.222861+0000","last_fullsized":"2024-04-25T09:01:01.222861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239459+0000","last_change":"2024-04-25T09:01:01.236938+0000","last_active":"2024-04-25T09:01:01.239459+0000","last_peered":"2024-04-25T09:01:01.239459+0000","last_clean":"2024-04-25T09:01:01.239459+0000","last_became_active":"2024-04-25T09:01:01.236641+0000","last_became_peered":"2024-04-25T09:01:01.236641+0000","last_unstale":"2024-04-25T09:01:01.239459+0000","last_undegraded":"2024-04-25T09:01:01.239459+0000","last_fullsized":"2024-04-25T09:01:01.239459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:51.233630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228253+0000","last_change":"2024-04-25T09:01:01.228253+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228253+0000","last_undegraded":"2024-04-25T09:01:01.228253+0000","last_fullsized":"2024-04-25T09:01:01.228253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236815+0000","last_change":"2024-04-25T09:01:01.234642+0000","last_active":"2024-04-25T09:01:01.236815+0000","last_peered":"2024-04-25T09:01:01.236815+0000","last_clean":"2024-04-25T09:01:01.236815+0000","last_became_active":"2024-04-25T09:01:01.233993+0000","last_became_peered":"2024-04-25T09:01:01.233993+0000","last_unstale":"2024-04-25T09:01:01.236815+0000","last_undegraded":"2024-04-25T09:01:01.236815+0000","last_fullsized":"2024-04-25T09:01:01.236815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:55.924835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221843+0000","last_change":"2024-04-25T09:01:01.221843+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221843+0000","last_undegraded":"2024-04-25T09:01:01.221843+0000","last_fullsized":"2024-04-25T09:01:01.221843+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231483+0000","last_change":"2024-04-25T09:01:01.230328+0000","last_active":"2024-04-25T09:01:01.231483+0000","last_peered":"2024-04-25T09:01:01.231483+0000","last_clean":"2024-04-25T09:01:01.231483+0000","last_became_active":"2024-04-25T09:01:01.230056+0000","last_became_peered":"2024-04-25T09:01:01.230056+0000","last_unstale":"2024-04-25T09:01:01.231483+0000","last_undegraded":"2024-04-25T09:01:01.231483+0000","last_fullsized":"2024-04-25T09:01:01.231483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:11.184492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224444+0000","last_change":"2024-04-25T09:01:01.224444+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224444+0000","last_undegraded":"2024-04-25T09:01:01.224444+0000","last_fullsized":"2024-04-25T09:01:01.224444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.234054+0000","last_change":"2024-04-25T09:01:01.232109+0000","last_active":"2024-04-25T09:01:01.234054+0000","last_peered":"2024-04-25T09:01:01.234054+0000","last_clean":"2024-04-25T09:01:01.234054+0000","last_became_active":"2024-04-25T09:01:01.231725+0000","last_became_peered":"2024-04-25T09:01:01.231725+0000","last_unstale":"2024-04-25T09:01:01.234054+0000","last_undegraded":"2024-04-25T09:01:01.234054+0000","last_fullsized":"2024-04-25T09:01:01.234054+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:56.538105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224437+0000","last_change":"2024-04-25T09:01:01.224437+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224437+0000","last_undegraded":"2024-04-25T09:01:01.224437+0000","last_fullsized":"2024-04-25T09:01:01.224437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.235641+0000","last_change":"2024-04-25T09:01:01.234319+0000","last_active":"2024-04-25T09:01:01.235641+0000","last_peered":"2024-04-25T09:01:01.235641+0000","last_clean":"2024-04-25T09:01:01.235641+0000","last_became_active":"2024-04-25T09:01:01.233929+0000","last_became_peered":"2024-04-25T09:01:01.233929+0000","last_unstale":"2024-04-25T09:01:01.235641+0000","last_undegraded":"2024-04-25T09:01:01.235641+0000","last_fullsized":"2024-04-25T09:01:01.235641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:05.186239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221319+0000","last_change":"2024-04-25T09:01:01.221319+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221319+0000","last_undegraded":"2024-04-25T09:01:01.221319+0000","last_fullsized":"2024-04-25T09:01:01.221319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238082+0000","last_change":"2024-04-25T09:01:01.234998+0000","last_active":"2024-04-25T09:01:01.238082+0000","last_peered":"2024-04-25T09:01:01.238082+0000","last_clean":"2024-04-25T09:01:01.238082+0000","last_became_active":"2024-04-25T09:01:01.234729+0000","last_became_peered":"2024-04-25T09:01:01.234729+0000","last_unstale":"2024-04-25T09:01:01.238082+0000","last_undegraded":"2024-04-25T09:01:01.238082+0000","last_fullsized":"2024-04-25T09:01:01.238082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:14.158208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227903+0000","last_change":"2024-04-25T09:01:01.227903+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227903+0000","last_undegraded":"2024-04-25T09:01:01.227903+0000","last_fullsized":"2024-04-25T09:01:01.227903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236477+0000","last_change":"2024-04-25T09:01:01.233631+0000","last_active":"2024-04-25T09:01:01.236477+0000","last_peered":"2024-04-25T09:01:01.236477+0000","last_clean":"2024-04-25T09:01:01.236477+0000","last_became_active":"2024-04-25T09:01:01.233339+0000","last_became_peered":"2024-04-25T09:01:01.233339+0000","last_unstale":"2024-04-25T09:01:01.236477+0000","last_undegraded":"2024-04-25T09:01:01.236477+0000","last_fullsized":"2024-04-25T09:01:01.236477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:23.317888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225834+0000","last_change":"2024-04-25T09:01:01.225834+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225834+0000","last_undegraded":"2024-04-25T09:01:01.225834+0000","last_fullsized":"2024-04-25T09:01:01.225834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239782+0000","last_change":"2024-04-25T09:01:01.237715+0000","last_active":"2024-04-25T09:01:01.239782+0000","last_peered":"2024-04-25T09:01:01.239782+0000","last_clean":"2024-04-25T09:01:01.239782+0000","last_became_active":"2024-04-25T09:01:01.237450+0000","last_became_peered":"2024-04-25T09:01:01.237450+0000","last_unstale":"2024-04-25T09:01:01.239782+0000","last_undegraded":"2024-04-25T09:01:01.239782+0000","last_fullsized":"2024-04-25T09:01:01.239782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.625155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227249+0000","last_change":"2024-04-25T09:01:01.227249+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227249+0000","last_undegraded":"2024-04-25T09:01:01.227249+0000","last_fullsized":"2024-04-25T09:01:01.227249+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.235499+0000","last_change":"2024-04-25T09:01:01.232026+0000","last_active":"2024-04-25T09:01:01.235499+0000","last_peered":"2024-04-25T09:01:01.235499+0000","last_clean":"2024-04-25T09:01:01.235499+0000","last_became_active":"2024-04-25T09:01:01.231767+0000","last_became_peered":"2024-04-25T09:01:01.231767+0000","last_unstale":"2024-04-25T09:01:01.235499+0000","last_undegraded":"2024-04-25T09:01:01.235499+0000","last_fullsized":"2024-04-25T09:01:01.235499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221810+0000","last_change":"2024-04-25T09:01:01.221810+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221810+0000","last_undegraded":"2024-04-25T09:01:01.221810+0000","last_fullsized":"2024-04-25T09:01:01.221810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239223+0000","last_change":"2024-04-25T09:01:01.238350+0000","last_active":"2024-04-25T09:01:01.239223+0000","last_peered":"2024-04-25T09:01:01.239223+0000","last_clean":"2024-04-25T09:01:01.239223+0000","last_became_active":"2024-04-25T09:01:01.237873+0000","last_became_peered":"2024-04-25T09:01:01.237873+0000","last_unstale":"2024-04-25T09:01:01.239223+0000","last_undegraded":"2024-04-25T09:01:01.239223+0000","last_fullsized":"2024-04-25T09:01:01.239223+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.270714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":264,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.228117+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:01:01.228117+0000","last_peered":"2024-04-25T09:01:01.228117+0000","last_clean":"2024-04-25T09:01:01.228117+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:01:01.228117+0000","last_undegraded":"2024-04-25T09:01:01.228117+0000","last_fullsized":"2024-04-25T09:01:01.228117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1458176,"data_stored":955629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335652,"statfs":{"total":96636764160,"available":96599707648,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40332,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":851968,"data_stored":358986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44496,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327344,"statfs":{"total":96636764160,"available":96591200256,"internally_reserved":0,"allocated":851968,"data_stored":358986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40344,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331496,"statfs":{"total":96636764160,"available":96595451904,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44508,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327332,"statfs":{"total":96636764160,"available":96591187968,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36752,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335088,"statfs":{"total":96636764160,"available":96599130112,"internally_reserved":0,"allocated":1445888,"data_stored":949354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:05.683 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.794+0000 7f8ac7afc640 1 Processor -- start 2024-04-25T09:01:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.794+0000 7f8ac7afc640 1 -- start start 2024-04-25T09:01:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.795+0000 7f8ac7afc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.795+0000 7f8ac7afc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ac00d3990 0x7f8ac00d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.795+0000 7f8ac7afc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac00b7f60 con 0x7f8ac00ce5e0 2024-04-25T09:01:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.795+0000 7f8ac7afc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac00d4330 con 0x7f8ac00d3990 2024-04-25T09:01:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.795+0000 7f8ac7afc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00b29c0 con 0x7f8ac015e0a0 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac5898640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac6099640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8ac00ce5e0 0x7f8ac00cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:50458/0 (socket says 172.21.15.5:50458) 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac6099640 1 -- 172.21.15.5:0/2792623315 learned_addr learned my addr 172.21.15.5:0/2792623315 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac5097640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ac00d3990 0x7f8ac00d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac4896640 1 -- 172.21.15.5:0/2792623315 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131224895 0 0) 0x7f8ac00b7f60 con 0x7f8ac00ce5e0 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac4896640 1 -- 172.21.15.5:0/2792623315 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa8003520 con 0x7f8ac00ce5e0 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac5898640 1 -- 172.21.15.5:0/2792623315 >> v2:172.21.15.80:3300/0 conn(0x7f8ac00d3990 msgr2=0x7f8ac00d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac5898640 1 --2- 172.21.15.5:0/2792623315 >> v2:172.21.15.80:3300/0 conn(0x7f8ac00d3990 0x7f8ac00d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac5898640 1 -- 172.21.15.5:0/2792623315 >> v1:172.21.15.80:6789/0 conn(0x7f8ac00ce5e0 legacy=0x7f8ac00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac5898640 1 -- 172.21.15.5:0/2792623315 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00d2080 con 0x7f8ac015e0a0 2024-04-25T09:01:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.796+0000 7f8ac5097640 1 --2- 172.21.15.5:0/2792623315 >> v2:172.21.15.80:3300/0 conn(0x7f8ac00d3990 0x7f8ac00d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.797+0000 7f8ac5898640 1 --2- 172.21.15.5:0/2792623315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00d0d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80097a0 tx=0x7f8ab802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2de4bb6ad006a04e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.797+0000 7f8ac4896640 1 -- 172.21.15.5:0/2792623315 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8037070 con 0x7f8ac015e0a0 2024-04-25T09:01:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.797+0000 7f8ac4896640 1 -- 172.21.15.5:0/2792623315 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab8032440 con 0x7f8ac015e0a0 2024-04-25T09:01:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.797+0000 7f8ac4896640 1 -- 172.21.15.5:0/2792623315 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80327f0 con 0x7f8ac015e0a0 2024-04-25T09:01:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.797+0000 7f8ac7afc640 1 -- 172.21.15.5:0/2792623315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 msgr2=0x7f8ac00d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.798+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/2792623315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00d0d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80097a0 tx=0x7f8ab802a180 comp rx=0 tx=0).stop 2024-04-25T09:01:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.798+0000 7f8ac7afc640 1 -- 172.21.15.5:0/2792623315 shutdown_connections 2024-04-25T09:01:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.798+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/2792623315 >> v2:172.21.15.80:3300/0 conn(0x7f8ac00d3990 0x7f8ac00d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.798+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/2792623315 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00d0d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.798+0000 7f8ac7afc640 1 -- 172.21.15.5:0/2792623315 >> 172.21.15.5:0/2792623315 conn(0x7f8ac00668f0 msgr2=0x7f8ac0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.798+0000 7f8ac7afc640 1 -- 172.21.15.5:0/2792623315 shutdown_connections 2024-04-25T09:01:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.798+0000 7f8ac7afc640 1 -- 172.21.15.5:0/2792623315 wait complete. 2024-04-25T09:01:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.799+0000 7f8ac7afc640 1 Processor -- start 2024-04-25T09:01:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.799+0000 7f8ac7afc640 1 -- start start 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac7afc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ac00ce5e0 0x7f8ac00ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac7afc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ac00d3990 0x7f8ac01597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac7afc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac7afc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00d2920 con 0x7f8ac00d3990 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac7afc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00d2640 con 0x7f8ac00ce5e0 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac7afc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00d2c00 con 0x7f8ac015e0a0 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ac00d3990 0x7f8ac01597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ac00d3990 0x7f8ac01597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55330/0 (socket says 172.21.15.5:55330) 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 -- 172.21.15.5:0/260838211 learned_addr learned my addr 172.21.15.5:0/260838211 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5898640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ac00ce5e0 0x7f8ac00ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac6099640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 -- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 msgr2=0x7f8ac00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 -- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ac00ce5e0 msgr2=0x7f8ac00ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ac00ce5e0 0x7f8ac00ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 -- 172.21.15.5:0/260838211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00ab2c0 con 0x7f8ac00d3990 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.800+0000 7f8ac5097640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ac00d3990 0x7f8ac01597c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ebe0 tx=0x7f8ab400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.801+0000 7f8abe7fc640 1 -- 172.21.15.5:0/260838211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4017070 con 0x7f8ac00d3990 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.801+0000 7f8abe7fc640 1 -- 172.21.15.5:0/260838211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab400cc30 con 0x7f8ac00d3990 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.801+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac00ab5a0 con 0x7f8ac00d3990 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.801+0000 7f8abe7fc640 1 -- 172.21.15.5:0/260838211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4013470 con 0x7f8ac00d3990 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.801+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac00abb60 con 0x7f8ac00d3990 2024-04-25T09:01:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.802+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac004ef20 con 0x7f8ac00d3990 2024-04-25T09:01:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.802+0000 7f8abe7fc640 1 -- 172.21.15.5:0/260838211 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ab401a070 con 0x7f8ac00d3990 2024-04-25T09:01:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.803+0000 7f8abe7fc640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8aac06b4d0 0x7f8aac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.803+0000 7f8abe7fc640 1 -- 172.21.15.5:0/260838211 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab408a180 con 0x7f8ac00d3990 2024-04-25T09:01:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.803+0000 7f8ac5898640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8aac06b4d0 0x7f8aac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.804+0000 7f8ac5898640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8aac06b4d0 0x7f8aac06d990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8034000 tx=0x7f8ab802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.807+0000 7f8abe7fc640 1 -- 172.21.15.5:0/260838211 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ab40588a0 con 0x7f8ac00d3990 2024-04-25T09:01:05.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.982+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ac00b6040 con 0x7f8aac06b4d0 2024-04-25T09:01:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.989+0000 7f8abe7fc640 1 -- 172.21.15.5:0/260838211 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246750 (secure 0 0 0) 0x7f8ac00b6040 con 0x7f8aac06b4d0 2024-04-25T09:01:05.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:05.981 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8aac06b4d0 msgr2=0x7f8aac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8aac06b4d0 0x7f8aac06d990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8034000 tx=0x7f8ab802e000 comp rx=0 tx=0).stop 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ac00d3990 msgr2=0x7f8ac01597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ac00d3990 0x7f8ac01597c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ebe0 tx=0x7f8ab400c520 comp rx=0 tx=0).stop 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 shutdown_connections 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8aac06b4d0 0x7f8aac06d990 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ac015e0a0 0x7f8ac00cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ac00d3990 0x7f8ac01597c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 --2- 172.21.15.5:0/260838211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ac00ce5e0 0x7f8ac00ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 >> 172.21.15.5:0/260838211 conn(0x7f8ac00668f0 msgr2=0x7f8ac00b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.991+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 shutdown_connections 2024-04-25T09:01:05.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:05.992+0000 7f8ac7afc640 1 -- 172.21.15.5:0/260838211 wait complete. 2024-04-25T09:01:05.991 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-25T09:01:04.446524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315568,"kb_used_data":7876,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754659152,"statfs":{"total":773094113280,"available":772770971648,"internally_reserved":0,"allocated":8065024,"data_stored":4083999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":314953265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.229709"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226674+0000","last_change":"2024-04-25T09:01:01.226674+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226674+0000","last_undegraded":"2024-04-25T09:01:01.226674+0000","last_fullsized":"2024-04-25T09:01:01.226674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228288+0000","last_change":"2024-04-25T09:01:01.228288+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228288+0000","last_undegraded":"2024-04-25T09:01:01.228288+0000","last_fullsized":"2024-04-25T09:01:01.228288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222644+0000","last_change":"2024-04-25T09:01:01.222644+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222644+0000","last_undegraded":"2024-04-25T09:01:01.222644+0000","last_fullsized":"2024-04-25T09:01:01.222644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228360+0000","last_change":"2024-04-25T09:01:01.228360+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228360+0000","last_undegraded":"2024-04-25T09:01:01.228360+0000","last_fullsized":"2024-04-25T09:01:01.228360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223760+0000","last_change":"2024-04-25T09:01:01.223760+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223760+0000","last_undegraded":"2024-04-25T09:01:01.223760+0000","last_fullsized":"2024-04-25T09:01:01.223760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229565+0000","last_change":"2024-04-25T09:01:01.229565+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229565+0000","last_undegraded":"2024-04-25T09:01:01.229565+0000","last_fullsized":"2024-04-25T09:01:01.229565+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223378+0000","last_change":"2024-04-25T09:01:01.223378+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223378+0000","last_undegraded":"2024-04-25T09:01:01.223378+0000","last_fullsized":"2024-04-25T09:01:01.223378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228440+0000","last_change":"2024-04-25T09:01:01.228440+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228440+0000","last_undegraded":"2024-04-25T09:01:01.228440+0000","last_fullsized":"2024-04-25T09:01:01.228440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223223+0000","last_change":"2024-04-25T09:01:01.223223+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223223+0000","last_undegraded":"2024-04-25T09:01:01.223223+0000","last_fullsized":"2024-04-25T09:01:01.223223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224089+0000","last_change":"2024-04-25T09:01:01.224089+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224089+0000","last_undegraded":"2024-04-25T09:01:01.224089+0000","last_fullsized":"2024-04-25T09:01:01.224089+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227739+0000","last_change":"2024-04-25T09:01:01.227739+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227739+0000","last_undegraded":"2024-04-25T09:01:01.227739+0000","last_fullsized":"2024-04-25T09:01:01.227739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226605+0000","last_change":"2024-04-25T09:01:01.226605+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226605+0000","last_undegraded":"2024-04-25T09:01:01.226605+0000","last_fullsized":"2024-04-25T09:01:01.226605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225339+0000","last_change":"2024-04-25T09:01:01.225339+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225339+0000","last_undegraded":"2024-04-25T09:01:01.225339+0000","last_fullsized":"2024-04-25T09:01:01.225339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223248+0000","last_change":"2024-04-25T09:01:01.223248+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223248+0000","last_undegraded":"2024-04-25T09:01:01.223248+0000","last_fullsized":"2024-04-25T09:01:01.223248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226450+0000","last_change":"2024-04-25T09:01:01.226450+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226450+0000","last_undegraded":"2024-04-25T09:01:01.226450+0000","last_fullsized":"2024-04-25T09:01:01.226450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223679+0000","last_change":"2024-04-25T09:01:01.223679+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223679+0000","last_undegraded":"2024-04-25T09:01:01.223679+0000","last_fullsized":"2024-04-25T09:01:01.223679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222743+0000","last_change":"2024-04-25T09:01:01.222743+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222743+0000","last_undegraded":"2024-04-25T09:01:01.222743+0000","last_fullsized":"2024-04-25T09:01:01.222743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226244+0000","last_change":"2024-04-25T09:01:01.226244+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226244+0000","last_undegraded":"2024-04-25T09:01:01.226244+0000","last_fullsized":"2024-04-25T09:01:01.226244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229348+0000","last_change":"2024-04-25T09:01:01.229348+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229348+0000","last_undegraded":"2024-04-25T09:01:01.229348+0000","last_fullsized":"2024-04-25T09:01:01.229348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227740+0000","last_change":"2024-04-25T09:01:01.227740+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227740+0000","last_undegraded":"2024-04-25T09:01:01.227740+0000","last_fullsized":"2024-04-25T09:01:01.227740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222675+0000","last_change":"2024-04-25T09:01:01.222675+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222675+0000","last_undegraded":"2024-04-25T09:01:01.222675+0000","last_fullsized":"2024-04-25T09:01:01.222675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222263+0000","last_change":"2024-04-25T09:01:01.222263+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222263+0000","last_undegraded":"2024-04-25T09:01:01.222263+0000","last_fullsized":"2024-04-25T09:01:01.222263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224950+0000","last_change":"2024-04-25T09:01:01.224950+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224950+0000","last_undegraded":"2024-04-25T09:01:01.224950+0000","last_fullsized":"2024-04-25T09:01:01.224950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224445+0000","last_change":"2024-04-25T09:01:01.224445+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224445+0000","last_undegraded":"2024-04-25T09:01:01.224445+0000","last_fullsized":"2024-04-25T09:01:01.224445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225606+0000","last_change":"2024-04-25T09:01:01.225606+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225606+0000","last_undegraded":"2024-04-25T09:01:01.225606+0000","last_fullsized":"2024-04-25T09:01:01.225606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223971+0000","last_change":"2024-04-25T09:01:01.223971+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223971+0000","last_undegraded":"2024-04-25T09:01:01.223971+0000","last_fullsized":"2024-04-25T09:01:01.223971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222149+0000","last_change":"2024-04-25T09:01:01.222149+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222149+0000","last_undegraded":"2024-04-25T09:01:01.222149+0000","last_fullsized":"2024-04-25T09:01:01.222149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224009+0000","last_change":"2024-04-25T09:01:01.224009+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224009+0000","last_undegraded":"2024-04-25T09:01:01.224009+0000","last_fullsized":"2024-04-25T09:01:01.224009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222769+0000","last_change":"2024-04-25T09:01:01.222769+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222769+0000","last_undegraded":"2024-04-25T09:01:01.222769+0000","last_fullsized":"2024-04-25T09:01:01.222769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222564+0000","last_change":"2024-04-25T09:01:01.222564+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222564+0000","last_undegraded":"2024-04-25T09:01:01.222564+0000","last_fullsized":"2024-04-25T09:01:01.222564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222623+0000","last_change":"2024-04-25T09:01:01.222623+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222623+0000","last_undegraded":"2024-04-25T09:01:01.222623+0000","last_fullsized":"2024-04-25T09:01:01.222623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227251+0000","last_change":"2024-04-25T09:01:01.227251+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227251+0000","last_undegraded":"2024-04-25T09:01:01.227251+0000","last_fullsized":"2024-04-25T09:01:01.227251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225318+0000","last_change":"2024-04-25T09:01:01.225318+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225318+0000","last_undegraded":"2024-04-25T09:01:01.225318+0000","last_fullsized":"2024-04-25T09:01:01.225318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240476+0000","last_change":"2024-04-25T09:01:01.239796+0000","last_active":"2024-04-25T09:01:01.240476+0000","last_peered":"2024-04-25T09:01:01.240476+0000","last_clean":"2024-04-25T09:01:01.240476+0000","last_became_active":"2024-04-25T09:01:01.239418+0000","last_became_peered":"2024-04-25T09:01:01.239418+0000","last_unstale":"2024-04-25T09:01:01.240476+0000","last_undegraded":"2024-04-25T09:01:01.240476+0000","last_fullsized":"2024-04-25T09:01:01.240476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:14.071547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222294+0000","last_change":"2024-04-25T09:01:01.222294+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222294+0000","last_undegraded":"2024-04-25T09:01:01.222294+0000","last_fullsized":"2024-04-25T09:01:01.222294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239552+0000","last_change":"2024-04-25T09:01:01.236292+0000","last_active":"2024-04-25T09:01:01.239552+0000","last_peered":"2024-04-25T09:01:01.239552+0000","last_clean":"2024-04-25T09:01:01.239552+0000","last_became_active":"2024-04-25T09:01:01.235994+0000","last_became_peered":"2024-04-25T09:01:01.235994+0000","last_unstale":"2024-04-25T09:01:01.239552+0000","last_undegraded":"2024-04-25T09:01:01.239552+0000","last_fullsized":"2024-04-25T09:01:01.239552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:09.973429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229901+0000","last_change":"2024-04-25T09:01:01.229901+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229901+0000","last_undegraded":"2024-04-25T09:01:01.229901+0000","last_fullsized":"2024-04-25T09:01:01.229901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239109+0000","last_change":"2024-04-25T09:01:01.235176+0000","last_active":"2024-04-25T09:01:01.239109+0000","last_peered":"2024-04-25T09:01:01.239109+0000","last_clean":"2024-04-25T09:01:01.239109+0000","last_became_active":"2024-04-25T09:01:01.234875+0000","last_became_peered":"2024-04-25T09:01:01.234875+0000","last_unstale":"2024-04-25T09:01:01.239109+0000","last_undegraded":"2024-04-25T09:01:01.239109+0000","last_fullsized":"2024-04-25T09:01:01.239109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:46.750140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227344+0000","last_change":"2024-04-25T09:01:01.227344+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227344+0000","last_undegraded":"2024-04-25T09:01:01.227344+0000","last_fullsized":"2024-04-25T09:01:01.227344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237496+0000","last_change":"2024-04-25T09:01:01.234022+0000","last_active":"2024-04-25T09:01:01.237496+0000","last_peered":"2024-04-25T09:01:01.237496+0000","last_clean":"2024-04-25T09:01:01.237496+0000","last_became_active":"2024-04-25T09:01:01.233403+0000","last_became_peered":"2024-04-25T09:01:01.233403+0000","last_unstale":"2024-04-25T09:01:01.237496+0000","last_undegraded":"2024-04-25T09:01:01.237496+0000","last_fullsized":"2024-04-25T09:01:01.237496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:02.209579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222054+0000","last_change":"2024-04-25T09:01:01.222054+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222054+0000","last_undegraded":"2024-04-25T09:01:01.222054+0000","last_fullsized":"2024-04-25T09:01:01.222054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231430+0000","last_change":"2024-04-25T09:01:01.229650+0000","last_active":"2024-04-25T09:01:01.231430+0000","last_peered":"2024-04-25T09:01:01.231430+0000","last_clean":"2024-04-25T09:01:01.231430+0000","last_became_active":"2024-04-25T09:01:01.229258+0000","last_became_peered":"2024-04-25T09:01:01.229258+0000","last_unstale":"2024-04-25T09:01:01.231430+0000","last_undegraded":"2024-04-25T09:01:01.231430+0000","last_fullsized":"2024-04-25T09:01:01.231430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:32.252719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222156+0000","last_change":"2024-04-25T09:01:01.222156+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222156+0000","last_undegraded":"2024-04-25T09:01:01.222156+0000","last_fullsized":"2024-04-25T09:01:01.222156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237130+0000","last_change":"2024-04-25T09:01:01.234016+0000","last_active":"2024-04-25T09:01:01.237130+0000","last_peered":"2024-04-25T09:01:01.237130+0000","last_clean":"2024-04-25T09:01:01.237130+0000","last_became_active":"2024-04-25T09:01:01.233595+0000","last_became_peered":"2024-04-25T09:01:01.233595+0000","last_unstale":"2024-04-25T09:01:01.237130+0000","last_undegraded":"2024-04-25T09:01:01.237130+0000","last_fullsized":"2024-04-25T09:01:01.237130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:23.317888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222234+0000","last_change":"2024-04-25T09:01:01.222234+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222234+0000","last_undegraded":"2024-04-25T09:01:01.222234+0000","last_fullsized":"2024-04-25T09:01:01.222234+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231221+0000","last_change":"2024-04-25T09:01:01.230135+0000","last_active":"2024-04-25T09:01:01.231221+0000","last_peered":"2024-04-25T09:01:01.231221+0000","last_clean":"2024-04-25T09:01:01.231221+0000","last_became_active":"2024-04-25T09:01:01.229853+0000","last_became_peered":"2024-04-25T09:01:01.229853+0000","last_unstale":"2024-04-25T09:01:01.231221+0000","last_undegraded":"2024-04-25T09:01:01.231221+0000","last_fullsized":"2024-04-25T09:01:01.231221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:26.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225867+0000","last_change":"2024-04-25T09:01:01.225867+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225867+0000","last_undegraded":"2024-04-25T09:01:01.225867+0000","last_fullsized":"2024-04-25T09:01:01.225867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.234352+0000","last_change":"2024-04-25T09:01:01.232041+0000","last_active":"2024-04-25T09:01:01.234352+0000","last_peered":"2024-04-25T09:01:01.234352+0000","last_clean":"2024-04-25T09:01:01.234352+0000","last_became_active":"2024-04-25T09:01:01.231752+0000","last_became_peered":"2024-04-25T09:01:01.231752+0000","last_unstale":"2024-04-25T09:01:01.234352+0000","last_undegraded":"2024-04-25T09:01:01.234352+0000","last_fullsized":"2024-04-25T09:01:01.234352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:53.291603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221876+0000","last_change":"2024-04-25T09:01:01.221876+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221876+0000","last_undegraded":"2024-04-25T09:01:01.221876+0000","last_fullsized":"2024-04-25T09:01:01.221876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239062+0000","last_change":"2024-04-25T09:01:01.233295+0000","last_active":"2024-04-25T09:01:01.239062+0000","last_peered":"2024-04-25T09:01:01.239062+0000","last_clean":"2024-04-25T09:01:01.239062+0000","last_became_active":"2024-04-25T09:01:01.233010+0000","last_became_peered":"2024-04-25T09:01:01.233010+0000","last_unstale":"2024-04-25T09:01:01.239062+0000","last_undegraded":"2024-04-25T09:01:01.239062+0000","last_fullsized":"2024-04-25T09:01:01.239062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:16.549011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226228+0000","last_change":"2024-04-25T09:01:01.226228+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226228+0000","last_undegraded":"2024-04-25T09:01:01.226228+0000","last_fullsized":"2024-04-25T09:01:01.226228+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239252+0000","last_change":"2024-04-25T09:01:01.238466+0000","last_active":"2024-04-25T09:01:01.239252+0000","last_peered":"2024-04-25T09:01:01.239252+0000","last_clean":"2024-04-25T09:01:01.239252+0000","last_became_active":"2024-04-25T09:01:01.236891+0000","last_became_peered":"2024-04-25T09:01:01.236891+0000","last_unstale":"2024-04-25T09:01:01.239252+0000","last_undegraded":"2024-04-25T09:01:01.239252+0000","last_fullsized":"2024-04-25T09:01:01.239252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:19.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.229341+0000","last_change":"2024-04-25T09:01:01.229341+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.229341+0000","last_undegraded":"2024-04-25T09:01:01.229341+0000","last_fullsized":"2024-04-25T09:01:01.229341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231211+0000","last_change":"2024-04-25T09:01:01.227525+0000","last_active":"2024-04-25T09:01:01.231211+0000","last_peered":"2024-04-25T09:01:01.231211+0000","last_clean":"2024-04-25T09:01:01.231211+0000","last_became_active":"2024-04-25T09:01:01.227183+0000","last_became_peered":"2024-04-25T09:01:01.227183+0000","last_unstale":"2024-04-25T09:01:01.231211+0000","last_undegraded":"2024-04-25T09:01:01.231211+0000","last_fullsized":"2024-04-25T09:01:01.231211+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:51.139787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221812+0000","last_change":"2024-04-25T09:01:01.221812+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221812+0000","last_undegraded":"2024-04-25T09:01:01.221812+0000","last_fullsized":"2024-04-25T09:01:01.221812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236279+0000","last_change":"2024-04-25T09:01:01.235651+0000","last_active":"2024-04-25T09:01:01.236279+0000","last_peered":"2024-04-25T09:01:01.236279+0000","last_clean":"2024-04-25T09:01:01.236279+0000","last_became_active":"2024-04-25T09:01:01.235376+0000","last_became_peered":"2024-04-25T09:01:01.235376+0000","last_unstale":"2024-04-25T09:01:01.236279+0000","last_undegraded":"2024-04-25T09:01:01.236279+0000","last_fullsized":"2024-04-25T09:01:01.236279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:02.209579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226579+0000","last_change":"2024-04-25T09:01:01.226579+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226579+0000","last_undegraded":"2024-04-25T09:01:01.226579+0000","last_fullsized":"2024-04-25T09:01:01.226579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240096+0000","last_change":"2024-04-25T09:01:01.239403+0000","last_active":"2024-04-25T09:01:01.240096+0000","last_peered":"2024-04-25T09:01:01.240096+0000","last_clean":"2024-04-25T09:01:01.240096+0000","last_became_active":"2024-04-25T09:01:01.239077+0000","last_became_peered":"2024-04-25T09:01:01.239077+0000","last_unstale":"2024-04-25T09:01:01.240096+0000","last_undegraded":"2024-04-25T09:01:01.240096+0000","last_fullsized":"2024-04-25T09:01:01.240096+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:53.341918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222774+0000","last_change":"2024-04-25T09:01:01.222774+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222774+0000","last_undegraded":"2024-04-25T09:01:01.222774+0000","last_fullsized":"2024-04-25T09:01:01.222774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238806+0000","last_change":"2024-04-25T09:01:01.237737+0000","last_active":"2024-04-25T09:01:01.238806+0000","last_peered":"2024-04-25T09:01:01.238806+0000","last_clean":"2024-04-25T09:01:01.238806+0000","last_became_active":"2024-04-25T09:01:01.236940+0000","last_became_peered":"2024-04-25T09:01:01.236940+0000","last_unstale":"2024-04-25T09:01:01.238806+0000","last_undegraded":"2024-04-25T09:01:01.238806+0000","last_fullsized":"2024-04-25T09:01:01.238806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:27.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226906+0000","last_change":"2024-04-25T09:01:01.226906+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226906+0000","last_undegraded":"2024-04-25T09:01:01.226906+0000","last_fullsized":"2024-04-25T09:01:01.226906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.232478+0000","last_change":"2024-04-25T09:01:01.231724+0000","last_active":"2024-04-25T09:01:01.232478+0000","last_peered":"2024-04-25T09:01:01.232478+0000","last_clean":"2024-04-25T09:01:01.232478+0000","last_became_active":"2024-04-25T09:01:01.231424+0000","last_became_peered":"2024-04-25T09:01:01.231424+0000","last_unstale":"2024-04-25T09:01:01.232478+0000","last_undegraded":"2024-04-25T09:01:01.232478+0000","last_fullsized":"2024-04-25T09:01:01.232478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:14.071547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221291+0000","last_change":"2024-04-25T09:01:01.221291+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221291+0000","last_undegraded":"2024-04-25T09:01:01.221291+0000","last_fullsized":"2024-04-25T09:01:01.221291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239191+0000","last_change":"2024-04-25T09:01:01.236893+0000","last_active":"2024-04-25T09:01:01.239191+0000","last_peered":"2024-04-25T09:01:01.239191+0000","last_clean":"2024-04-25T09:01:01.239191+0000","last_became_active":"2024-04-25T09:01:01.236494+0000","last_became_peered":"2024-04-25T09:01:01.236494+0000","last_unstale":"2024-04-25T09:01:01.239191+0000","last_undegraded":"2024-04-25T09:01:01.239191+0000","last_fullsized":"2024-04-25T09:01:01.239191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:53.737808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.223082+0000","last_change":"2024-04-25T09:01:01.223082+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.223082+0000","last_undegraded":"2024-04-25T09:01:01.223082+0000","last_fullsized":"2024-04-25T09:01:01.223082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236839+0000","last_change":"2024-04-25T09:01:01.235551+0000","last_active":"2024-04-25T09:01:01.236839+0000","last_peered":"2024-04-25T09:01:01.236839+0000","last_clean":"2024-04-25T09:01:01.236839+0000","last_became_active":"2024-04-25T09:01:01.234355+0000","last_became_peered":"2024-04-25T09:01:01.234355+0000","last_unstale":"2024-04-25T09:01:01.236839+0000","last_undegraded":"2024-04-25T09:01:01.236839+0000","last_fullsized":"2024-04-25T09:01:01.236839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:29.719073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225791+0000","last_change":"2024-04-25T09:01:01.225791+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225791+0000","last_undegraded":"2024-04-25T09:01:01.225791+0000","last_fullsized":"2024-04-25T09:01:01.225791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239428+0000","last_change":"2024-04-25T09:01:01.234423+0000","last_active":"2024-04-25T09:01:01.239428+0000","last_peered":"2024-04-25T09:01:01.239428+0000","last_clean":"2024-04-25T09:01:01.239428+0000","last_became_active":"2024-04-25T09:01:01.234153+0000","last_became_peered":"2024-04-25T09:01:01.234153+0000","last_unstale":"2024-04-25T09:01:01.239428+0000","last_undegraded":"2024-04-25T09:01:01.239428+0000","last_fullsized":"2024-04-25T09:01:01.239428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.542901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.226139+0000","last_change":"2024-04-25T09:01:01.226139+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.226139+0000","last_undegraded":"2024-04-25T09:01:01.226139+0000","last_fullsized":"2024-04-25T09:01:01.226139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236752+0000","last_change":"2024-04-25T09:01:01.233697+0000","last_active":"2024-04-25T09:01:01.236752+0000","last_peered":"2024-04-25T09:01:01.236752+0000","last_clean":"2024-04-25T09:01:01.236752+0000","last_became_active":"2024-04-25T09:01:01.233426+0000","last_became_peered":"2024-04-25T09:01:01.233426+0000","last_unstale":"2024-04-25T09:01:01.236752+0000","last_undegraded":"2024-04-25T09:01:01.236752+0000","last_fullsized":"2024-04-25T09:01:01.236752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:26.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221270+0000","last_change":"2024-04-25T09:01:01.221270+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221270+0000","last_undegraded":"2024-04-25T09:01:01.221270+0000","last_fullsized":"2024-04-25T09:01:01.221270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.240767+0000","last_change":"2024-04-25T09:01:01.240177+0000","last_active":"2024-04-25T09:01:01.240767+0000","last_peered":"2024-04-25T09:01:01.240767+0000","last_clean":"2024-04-25T09:01:01.240767+0000","last_became_active":"2024-04-25T09:01:01.239854+0000","last_became_peered":"2024-04-25T09:01:01.239854+0000","last_unstale":"2024-04-25T09:01:01.240767+0000","last_undegraded":"2024-04-25T09:01:01.240767+0000","last_fullsized":"2024-04-25T09:01:01.240767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:00.672674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222111+0000","last_change":"2024-04-25T09:01:01.222111+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222111+0000","last_undegraded":"2024-04-25T09:01:01.222111+0000","last_fullsized":"2024-04-25T09:01:01.222111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.237150+0000","last_change":"2024-04-25T09:01:01.234455+0000","last_active":"2024-04-25T09:01:01.237150+0000","last_peered":"2024-04-25T09:01:01.237150+0000","last_clean":"2024-04-25T09:01:01.237150+0000","last_became_active":"2024-04-25T09:01:01.234104+0000","last_became_peered":"2024-04-25T09:01:01.234104+0000","last_unstale":"2024-04-25T09:01:01.237150+0000","last_undegraded":"2024-04-25T09:01:01.237150+0000","last_fullsized":"2024-04-25T09:01:01.237150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:53.341918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224154+0000","last_change":"2024-04-25T09:01:01.224154+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224154+0000","last_undegraded":"2024-04-25T09:01:01.224154+0000","last_fullsized":"2024-04-25T09:01:01.224154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238072+0000","last_change":"2024-04-25T09:01:01.236375+0000","last_active":"2024-04-25T09:01:01.238072+0000","last_peered":"2024-04-25T09:01:01.238072+0000","last_clean":"2024-04-25T09:01:01.238072+0000","last_became_active":"2024-04-25T09:01:01.236074+0000","last_became_peered":"2024-04-25T09:01:01.236074+0000","last_unstale":"2024-04-25T09:01:01.238072+0000","last_undegraded":"2024-04-25T09:01:01.238072+0000","last_fullsized":"2024-04-25T09:01:01.238072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:00.672674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.222861+0000","last_change":"2024-04-25T09:01:01.222861+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.222861+0000","last_undegraded":"2024-04-25T09:01:01.222861+0000","last_fullsized":"2024-04-25T09:01:01.222861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239459+0000","last_change":"2024-04-25T09:01:01.236938+0000","last_active":"2024-04-25T09:01:01.239459+0000","last_peered":"2024-04-25T09:01:01.239459+0000","last_clean":"2024-04-25T09:01:01.239459+0000","last_became_active":"2024-04-25T09:01:01.236641+0000","last_became_peered":"2024-04-25T09:01:01.236641+0000","last_unstale":"2024-04-25T09:01:01.239459+0000","last_undegraded":"2024-04-25T09:01:01.239459+0000","last_fullsized":"2024-04-25T09:01:01.239459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:51.233630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.228253+0000","last_change":"2024-04-25T09:01:01.228253+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.228253+0000","last_undegraded":"2024-04-25T09:01:01.228253+0000","last_fullsized":"2024-04-25T09:01:01.228253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236815+0000","last_change":"2024-04-25T09:01:01.234642+0000","last_active":"2024-04-25T09:01:01.236815+0000","last_peered":"2024-04-25T09:01:01.236815+0000","last_clean":"2024-04-25T09:01:01.236815+0000","last_became_active":"2024-04-25T09:01:01.233993+0000","last_became_peered":"2024-04-25T09:01:01.233993+0000","last_unstale":"2024-04-25T09:01:01.236815+0000","last_undegraded":"2024-04-25T09:01:01.236815+0000","last_fullsized":"2024-04-25T09:01:01.236815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:55.924835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221843+0000","last_change":"2024-04-25T09:01:01.221843+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221843+0000","last_undegraded":"2024-04-25T09:01:01.221843+0000","last_fullsized":"2024-04-25T09:01:01.221843+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.231483+0000","last_change":"2024-04-25T09:01:01.230328+0000","last_active":"2024-04-25T09:01:01.231483+0000","last_peered":"2024-04-25T09:01:01.231483+0000","last_clean":"2024-04-25T09:01:01.231483+0000","last_became_active":"2024-04-25T09:01:01.230056+0000","last_became_peered":"2024-04-25T09:01:01.230056+0000","last_unstale":"2024-04-25T09:01:01.231483+0000","last_undegraded":"2024-04-25T09:01:01.231483+0000","last_fullsized":"2024-04-25T09:01:01.231483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:11.184492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224444+0000","last_change":"2024-04-25T09:01:01.224444+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224444+0000","last_undegraded":"2024-04-25T09:01:01.224444+0000","last_fullsized":"2024-04-25T09:01:01.224444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.234054+0000","last_change":"2024-04-25T09:01:01.232109+0000","last_active":"2024-04-25T09:01:01.234054+0000","last_peered":"2024-04-25T09:01:01.234054+0000","last_clean":"2024-04-25T09:01:01.234054+0000","last_became_active":"2024-04-25T09:01:01.231725+0000","last_became_peered":"2024-04-25T09:01:01.231725+0000","last_unstale":"2024-04-25T09:01:01.234054+0000","last_undegraded":"2024-04-25T09:01:01.234054+0000","last_fullsized":"2024-04-25T09:01:01.234054+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:56.538105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.224437+0000","last_change":"2024-04-25T09:01:01.224437+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.224437+0000","last_undegraded":"2024-04-25T09:01:01.224437+0000","last_fullsized":"2024-04-25T09:01:01.224437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.235641+0000","last_change":"2024-04-25T09:01:01.234319+0000","last_active":"2024-04-25T09:01:01.235641+0000","last_peered":"2024-04-25T09:01:01.235641+0000","last_clean":"2024-04-25T09:01:01.235641+0000","last_became_active":"2024-04-25T09:01:01.233929+0000","last_became_peered":"2024-04-25T09:01:01.233929+0000","last_unstale":"2024-04-25T09:01:01.235641+0000","last_undegraded":"2024-04-25T09:01:01.235641+0000","last_fullsized":"2024-04-25T09:01:01.235641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:05.186239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221319+0000","last_change":"2024-04-25T09:01:01.221319+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221319+0000","last_undegraded":"2024-04-25T09:01:01.221319+0000","last_fullsized":"2024-04-25T09:01:01.221319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.238082+0000","last_change":"2024-04-25T09:01:01.234998+0000","last_active":"2024-04-25T09:01:01.238082+0000","last_peered":"2024-04-25T09:01:01.238082+0000","last_clean":"2024-04-25T09:01:01.238082+0000","last_became_active":"2024-04-25T09:01:01.234729+0000","last_became_peered":"2024-04-25T09:01:01.234729+0000","last_unstale":"2024-04-25T09:01:01.238082+0000","last_undegraded":"2024-04-25T09:01:01.238082+0000","last_fullsized":"2024-04-25T09:01:01.238082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:14.158208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227903+0000","last_change":"2024-04-25T09:01:01.227903+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227903+0000","last_undegraded":"2024-04-25T09:01:01.227903+0000","last_fullsized":"2024-04-25T09:01:01.227903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.236477+0000","last_change":"2024-04-25T09:01:01.233631+0000","last_active":"2024-04-25T09:01:01.236477+0000","last_peered":"2024-04-25T09:01:01.236477+0000","last_clean":"2024-04-25T09:01:01.236477+0000","last_became_active":"2024-04-25T09:01:01.233339+0000","last_became_peered":"2024-04-25T09:01:01.233339+0000","last_unstale":"2024-04-25T09:01:01.236477+0000","last_undegraded":"2024-04-25T09:01:01.236477+0000","last_fullsized":"2024-04-25T09:01:01.236477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:23.317888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.225834+0000","last_change":"2024-04-25T09:01:01.225834+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.225834+0000","last_undegraded":"2024-04-25T09:01:01.225834+0000","last_fullsized":"2024-04-25T09:01:01.225834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239782+0000","last_change":"2024-04-25T09:01:01.237715+0000","last_active":"2024-04-25T09:01:01.239782+0000","last_peered":"2024-04-25T09:01:01.239782+0000","last_clean":"2024-04-25T09:01:01.239782+0000","last_became_active":"2024-04-25T09:01:01.237450+0000","last_became_peered":"2024-04-25T09:01:01.237450+0000","last_unstale":"2024-04-25T09:01:01.239782+0000","last_undegraded":"2024-04-25T09:01:01.239782+0000","last_fullsized":"2024-04-25T09:01:01.239782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.625155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.227249+0000","last_change":"2024-04-25T09:01:01.227249+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.227249+0000","last_undegraded":"2024-04-25T09:01:01.227249+0000","last_fullsized":"2024-04-25T09:01:01.227249+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.235499+0000","last_change":"2024-04-25T09:01:01.232026+0000","last_active":"2024-04-25T09:01:01.235499+0000","last_peered":"2024-04-25T09:01:01.235499+0000","last_clean":"2024-04-25T09:01:01.235499+0000","last_became_active":"2024-04-25T09:01:01.231767+0000","last_became_peered":"2024-04-25T09:01:01.231767+0000","last_unstale":"2024-04-25T09:01:01.235499+0000","last_undegraded":"2024-04-25T09:01:01.235499+0000","last_fullsized":"2024-04-25T09:01:01.235499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:30.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T09:01:01.221810+0000","last_change":"2024-04-25T09:01:01.221810+0000","last_active":"2024-04-25T09:01:01.211220+0000","last_peered":"2024-04-25T09:01:01.211220+0000","last_clean":"2024-04-25T09:01:01.211220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:01.221810+0000","last_undegraded":"2024-04-25T09:01:01.221810+0000","last_fullsized":"2024-04-25T09:01:01.221810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.239223+0000","last_change":"2024-04-25T09:01:01.238350+0000","last_active":"2024-04-25T09:01:01.239223+0000","last_peered":"2024-04-25T09:01:01.239223+0000","last_clean":"2024-04-25T09:01:01.239223+0000","last_became_active":"2024-04-25T09:01:01.237873+0000","last_became_peered":"2024-04-25T09:01:01.237873+0000","last_unstale":"2024-04-25T09:01:01.239223+0000","last_undegraded":"2024-04-25T09:01:01.239223+0000","last_fullsized":"2024-04-25T09:01:01.239223+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.270714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":264,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T09:01:01.228117+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:01:01.228117+0000","last_peered":"2024-04-25T09:01:01.228117+0000","last_clean":"2024-04-25T09:01:01.228117+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:01:01.228117+0000","last_undegraded":"2024-04-25T09:01:01.228117+0000","last_fullsized":"2024-04-25T09:01:01.228117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1458176,"data_stored":955629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335652,"statfs":{"total":96636764160,"available":96599707648,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40332,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":851968,"data_stored":358986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44496,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327344,"statfs":{"total":96636764160,"available":96591200256,"internally_reserved":0,"allocated":851968,"data_stored":358986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40344,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331496,"statfs":{"total":96636764160,"available":96595451904,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44508,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327332,"statfs":{"total":96636764160,"available":96591187968,"internally_reserved":0,"allocated":864256,"data_stored":365261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36752,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335088,"statfs":{"total":96636764160,"available":96599130112,"internally_reserved":0,"allocated":1445888,"data_stored":949354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:05.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-04-25T09:01:05.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226674+0000', 'last_change': '2024-04-25T09:01:01.226674+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226674+0000', 'last_undegraded': '2024-04-25T09:01:01.226674+0000', 'last_fullsized': '2024-04-25T09:01:01.226674+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.228288+0000', 'last_change': '2024-04-25T09:01:01.228288+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.228288+0000', 'last_undegraded': '2024-04-25T09:01:01.228288+0000', 'last_fullsized': '2024-04-25T09:01:01.228288+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222644+0000', 'last_change': '2024-04-25T09:01:01.222644+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222644+0000', 'last_undegraded': '2024-04-25T09:01:01.222644+0000', 'last_fullsized': '2024-04-25T09:01:01.222644+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.228360+0000', 'last_change': '2024-04-25T09:01:01.228360+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.228360+0000', 'last_undegraded': '2024-04-25T09:01:01.228360+0000', 'last_fullsized': '2024-04-25T09:01:01.228360+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.223760+0000', 'last_change': '2024-04-25T09:01:01.223760+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.223760+0000', 'last_undegraded': '2024-04-25T09:01:01.223760+0000', 'last_fullsized': '2024-04-25T09:01:01.223760+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.229565+0000', 'last_change': '2024-04-25T09:01:01.229565+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.229565+0000', 'last_undegraded': '2024-04-25T09:01:01.229565+0000', 'last_fullsized': '2024-04-25T09:01:01.229565+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:05.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.223378+0000', 'last_change': '2024-04-25T09:01:01.223378+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.223378+0000', 'last_undegraded': '2024-04-25T09:01:01.223378+0000', 'last_fullsized': '2024-04-25T09:01:01.223378+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.228440+0000', 'last_change': '2024-04-25T09:01:01.228440+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.228440+0000', 'last_undegraded': '2024-04-25T09:01:01.228440+0000', 'last_fullsized': '2024-04-25T09:01:01.228440+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.223223+0000', 'last_change': '2024-04-25T09:01:01.223223+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.223223+0000', 'last_undegraded': '2024-04-25T09:01:01.223223+0000', 'last_fullsized': '2024-04-25T09:01:01.223223+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.224089+0000', 'last_change': '2024-04-25T09:01:01.224089+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.224089+0000', 'last_undegraded': '2024-04-25T09:01:01.224089+0000', 'last_fullsized': '2024-04-25T09:01:01.224089+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.227739+0000', 'last_change': '2024-04-25T09:01:01.227739+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.227739+0000', 'last_undegraded': '2024-04-25T09:01:01.227739+0000', 'last_fullsized': '2024-04-25T09:01:01.227739+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226605+0000', 'last_change': '2024-04-25T09:01:01.226605+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226605+0000', 'last_undegraded': '2024-04-25T09:01:01.226605+0000', 'last_fullsized': '2024-04-25T09:01:01.226605+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:05.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.225339+0000', 'last_change': '2024-04-25T09:01:01.225339+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.225339+0000', 'last_undegraded': '2024-04-25T09:01:01.225339+0000', 'last_fullsized': '2024-04-25T09:01:01.225339+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.223248+0000', 'last_change': '2024-04-25T09:01:01.223248+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.223248+0000', 'last_undegraded': '2024-04-25T09:01:01.223248+0000', 'last_fullsized': '2024-04-25T09:01:01.223248+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226450+0000', 'last_change': '2024-04-25T09:01:01.226450+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226450+0000', 'last_undegraded': '2024-04-25T09:01:01.226450+0000', 'last_fullsized': '2024-04-25T09:01:01.226450+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.223679+0000', 'last_change': '2024-04-25T09:01:01.223679+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.223679+0000', 'last_undegraded': '2024-04-25T09:01:01.223679+0000', 'last_fullsized': '2024-04-25T09:01:01.223679+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222743+0000', 'last_change': '2024-04-25T09:01:01.222743+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222743+0000', 'last_undegraded': '2024-04-25T09:01:01.222743+0000', 'last_fullsized': '2024-04-25T09:01:01.222743+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-04-25T09:01:05.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226244+0000', 'last_change': '2024-04-25T09:01:01.226244+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226244+0000', 'last_undegraded': '2024-04-25T09:01:01.226244+0000', 'last_fullsized': '2024-04-25T09:01:01.226244+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.229348+0000', 'last_change': '2024-04-25T09:01:01.229348+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.229348+0000', 'last_undegraded': '2024-04-25T09:01:01.229348+0000', 'last_fullsized': '2024-04-25T09:01:01.229348+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.227740+0000', 'last_change': '2024-04-25T09:01:01.227740+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.227740+0000', 'last_undegraded': '2024-04-25T09:01:01.227740+0000', 'last_fullsized': '2024-04-25T09:01:01.227740+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222675+0000', 'last_change': '2024-04-25T09:01:01.222675+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222675+0000', 'last_undegraded': '2024-04-25T09:01:01.222675+0000', 'last_fullsized': '2024-04-25T09:01:01.222675+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222263+0000', 'last_change': '2024-04-25T09:01:01.222263+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222263+0000', 'last_undegraded': '2024-04-25T09:01:01.222263+0000', 'last_fullsized': '2024-04-25T09:01:01.222263+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.224950+0000', 'last_change': '2024-04-25T09:01:01.224950+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.224950+0000', 'last_undegraded': '2024-04-25T09:01:01.224950+0000', 'last_fullsized': '2024-04-25T09:01:01.224950+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:05.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.224445+0000', 'last_change': '2024-04-25T09:01:01.224445+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.224445+0000', 'last_undegraded': '2024-04-25T09:01:01.224445+0000', 'last_fullsized': '2024-04-25T09:01:01.224445+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.225606+0000', 'last_change': '2024-04-25T09:01:01.225606+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.225606+0000', 'last_undegraded': '2024-04-25T09:01:01.225606+0000', 'last_fullsized': '2024-04-25T09:01:01.225606+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.223971+0000', 'last_change': '2024-04-25T09:01:01.223971+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.223971+0000', 'last_undegraded': '2024-04-25T09:01:01.223971+0000', 'last_fullsized': '2024-04-25T09:01:01.223971+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222149+0000', 'last_change': '2024-04-25T09:01:01.222149+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222149+0000', 'last_undegraded': '2024-04-25T09:01:01.222149+0000', 'last_fullsized': '2024-04-25T09:01:01.222149+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.224009+0000', 'last_change': '2024-04-25T09:01:01.224009+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.224009+0000', 'last_undegraded': '2024-04-25T09:01:01.224009+0000', 'last_fullsized': '2024-04-25T09:01:01.224009+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222769+0000', 'last_change': '2024-04-25T09:01:01.222769+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222769+0000', 'last_undegraded': '2024-04-25T09:01:01.222769+0000', 'last_fullsized': '2024-04-25T09:01:01.222769+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:01:06.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222564+0000', 'last_change': '2024-04-25T09:01:01.222564+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222564+0000', 'last_undegraded': '2024-04-25T09:01:01.222564+0000', 'last_fullsized': '2024-04-25T09:01:01.222564+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222623+0000', 'last_change': '2024-04-25T09:01:01.222623+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222623+0000', 'last_undegraded': '2024-04-25T09:01:01.222623+0000', 'last_fullsized': '2024-04-25T09:01:01.222623+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.227251+0000', 'last_change': '2024-04-25T09:01:01.227251+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.227251+0000', 'last_undegraded': '2024-04-25T09:01:01.227251+0000', 'last_fullsized': '2024-04-25T09:01:01.227251+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.225318+0000', 'last_change': '2024-04-25T09:01:01.225318+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.225318+0000', 'last_undegraded': '2024-04-25T09:01:01.225318+0000', 'last_fullsized': '2024-04-25T09:01:01.225318+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222294+0000', 'last_change': '2024-04-25T09:01:01.222294+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222294+0000', 'last_undegraded': '2024-04-25T09:01:01.222294+0000', 'last_fullsized': '2024-04-25T09:01:01.222294+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-04-25T09:01:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.229901+0000', 'last_change': '2024-04-25T09:01:01.229901+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.229901+0000', 'last_undegraded': '2024-04-25T09:01:01.229901+0000', 'last_fullsized': '2024-04-25T09:01:01.229901+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.227344+0000', 'last_change': '2024-04-25T09:01:01.227344+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.227344+0000', 'last_undegraded': '2024-04-25T09:01:01.227344+0000', 'last_fullsized': '2024-04-25T09:01:01.227344+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222054+0000', 'last_change': '2024-04-25T09:01:01.222054+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222054+0000', 'last_undegraded': '2024-04-25T09:01:01.222054+0000', 'last_fullsized': '2024-04-25T09:01:01.222054+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222156+0000', 'last_change': '2024-04-25T09:01:01.222156+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222156+0000', 'last_undegraded': '2024-04-25T09:01:01.222156+0000', 'last_fullsized': '2024-04-25T09:01:01.222156+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222234+0000', 'last_change': '2024-04-25T09:01:01.222234+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222234+0000', 'last_undegraded': '2024-04-25T09:01:01.222234+0000', 'last_fullsized': '2024-04-25T09:01:01.222234+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.225867+0000', 'last_change': '2024-04-25T09:01:01.225867+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.225867+0000', 'last_undegraded': '2024-04-25T09:01:01.225867+0000', 'last_fullsized': '2024-04-25T09:01:01.225867+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:01:06.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.221876+0000', 'last_change': '2024-04-25T09:01:01.221876+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.221876+0000', 'last_undegraded': '2024-04-25T09:01:01.221876+0000', 'last_fullsized': '2024-04-25T09:01:01.221876+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226228+0000', 'last_change': '2024-04-25T09:01:01.226228+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226228+0000', 'last_undegraded': '2024-04-25T09:01:01.226228+0000', 'last_fullsized': '2024-04-25T09:01:01.226228+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.229341+0000', 'last_change': '2024-04-25T09:01:01.229341+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.229341+0000', 'last_undegraded': '2024-04-25T09:01:01.229341+0000', 'last_fullsized': '2024-04-25T09:01:01.229341+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.221812+0000', 'last_change': '2024-04-25T09:01:01.221812+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.221812+0000', 'last_undegraded': '2024-04-25T09:01:01.221812+0000', 'last_fullsized': '2024-04-25T09:01:01.221812+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226579+0000', 'last_change': '2024-04-25T09:01:01.226579+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226579+0000', 'last_undegraded': '2024-04-25T09:01:01.226579+0000', 'last_fullsized': '2024-04-25T09:01:01.226579+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222774+0000', 'last_change': '2024-04-25T09:01:01.222774+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222774+0000', 'last_undegraded': '2024-04-25T09:01:01.222774+0000', 'last_fullsized': '2024-04-25T09:01:01.222774+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226906+0000', 'last_change': '2024-04-25T09:01:01.226906+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226906+0000', 'last_undegraded': '2024-04-25T09:01:01.226906+0000', 'last_fullsized': '2024-04-25T09:01:01.226906+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.221291+0000', 'last_change': '2024-04-25T09:01:01.221291+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.221291+0000', 'last_undegraded': '2024-04-25T09:01:01.221291+0000', 'last_fullsized': '2024-04-25T09:01:01.221291+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.223082+0000', 'last_change': '2024-04-25T09:01:01.223082+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.223082+0000', 'last_undegraded': '2024-04-25T09:01:01.223082+0000', 'last_fullsized': '2024-04-25T09:01:01.223082+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.225791+0000', 'last_change': '2024-04-25T09:01:01.225791+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.225791+0000', 'last_undegraded': '2024-04-25T09:01:01.225791+0000', 'last_fullsized': '2024-04-25T09:01:01.225791+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-04-25T09:01:06.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.226139+0000', 'last_change': '2024-04-25T09:01:01.226139+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.226139+0000', 'last_undegraded': '2024-04-25T09:01:01.226139+0000', 'last_fullsized': '2024-04-25T09:01:01.226139+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.221270+0000', 'last_change': '2024-04-25T09:01:01.221270+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.221270+0000', 'last_undegraded': '2024-04-25T09:01:01.221270+0000', 'last_fullsized': '2024-04-25T09:01:01.221270+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222111+0000', 'last_change': '2024-04-25T09:01:01.222111+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222111+0000', 'last_undegraded': '2024-04-25T09:01:01.222111+0000', 'last_fullsized': '2024-04-25T09:01:01.222111+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.224154+0000', 'last_change': '2024-04-25T09:01:01.224154+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.224154+0000', 'last_undegraded': '2024-04-25T09:01:01.224154+0000', 'last_fullsized': '2024-04-25T09:01:01.224154+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.222861+0000', 'last_change': '2024-04-25T09:01:01.222861+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.222861+0000', 'last_undegraded': '2024-04-25T09:01:01.222861+0000', 'last_fullsized': '2024-04-25T09:01:01.222861+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.228253+0000', 'last_change': '2024-04-25T09:01:01.228253+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.228253+0000', 'last_undegraded': '2024-04-25T09:01:01.228253+0000', 'last_fullsized': '2024-04-25T09:01:01.228253+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-04-25T09:01:06.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.221843+0000', 'last_change': '2024-04-25T09:01:01.221843+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.221843+0000', 'last_undegraded': '2024-04-25T09:01:01.221843+0000', 'last_fullsized': '2024-04-25T09:01:01.221843+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.224444+0000', 'last_change': '2024-04-25T09:01:01.224444+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.224444+0000', 'last_undegraded': '2024-04-25T09:01:01.224444+0000', 'last_fullsized': '2024-04-25T09:01:01.224444+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.224437+0000', 'last_change': '2024-04-25T09:01:01.224437+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.224437+0000', 'last_undegraded': '2024-04-25T09:01:01.224437+0000', 'last_fullsized': '2024-04-25T09:01:01.224437+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.221319+0000', 'last_change': '2024-04-25T09:01:01.221319+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.221319+0000', 'last_undegraded': '2024-04-25T09:01:01.221319+0000', 'last_fullsized': '2024-04-25T09:01:01.221319+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.227903+0000', 'last_change': '2024-04-25T09:01:01.227903+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.227903+0000', 'last_undegraded': '2024-04-25T09:01:01.227903+0000', 'last_fullsized': '2024-04-25T09:01:01.227903+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.225834+0000', 'last_change': '2024-04-25T09:01:01.225834+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.225834+0000', 'last_undegraded': '2024-04-25T09:01:01.225834+0000', 'last_fullsized': '2024-04-25T09:01:01.225834+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-04-25T09:01:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.227249+0000', 'last_change': '2024-04-25T09:01:01.227249+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.227249+0000', 'last_undegraded': '2024-04-25T09:01:01.227249+0000', 'last_fullsized': '2024-04-25T09:01:01.227249+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:01:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-04-25T09:01:06.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:01.221810+0000', 'last_change': '2024-04-25T09:01:01.221810+0000', 'last_active': '2024-04-25T09:01:01.211220+0000', 'last_peered': '2024-04-25T09:01:01.211220+0000', 'last_clean': '2024-04-25T09:01:01.211220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:01.221810+0000', 'last_undegraded': '2024-04-25T09:01:01.221810+0000', 'last_fullsized': '2024-04-25T09:01:01.221810+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:01.211220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:01:06.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:01:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.143+0000 7f2e19330640 1 Processor -- start 2024-04-25T09:01:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.143+0000 7f2e19330640 1 -- start start 2024-04-25T09:01:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e19330640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e140cea80 0x7f2e1415f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e19330640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e1406bd00 0x7f2e140d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e19330640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1415ef10 con 0x7f2e1415fd80 2024-04-25T09:01:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e19330640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e140cfd60 con 0x7f2e140cea80 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e19330640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1415f480 con 0x7f2e1406bd00 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e12ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e140cea80 0x7f2e1415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e12ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e140cea80 0x7f2e1415f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55346/0 (socket says 172.21.15.5:55346) 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e12ffd640 1 -- 172.21.15.5:0/3204192603 learned_addr learned my addr 172.21.15.5:0/3204192603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e12ffd640 1 -- 172.21.15.5:0/3204192603 >> v2:172.21.15.80:3300/0 conn(0x7f2e1406bd00 msgr2=0x7f2e140d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e12ffd640 1 --2- 172.21.15.5:0/3204192603 >> v2:172.21.15.80:3300/0 conn(0x7f2e1406bd00 0x7f2e140d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e12ffd640 1 -- 172.21.15.5:0/3204192603 >> v1:172.21.15.80:6789/0 conn(0x7f2e1415fd80 legacy=0x7f2e1406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.144+0000 7f2e12ffd640 1 -- 172.21.15.5:0/3204192603 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1415f1a0 con 0x7f2e140cea80 2024-04-25T09:01:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.145+0000 7f2e12ffd640 1 --2- 172.21.15.5:0/3204192603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140cea80 0x7f2e1415f840 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2e140b3480 tx=0x7f2e0c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76deb586d3465033 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.145+0000 7f2e11ffb640 1 -- 172.21.15.5:0/3204192603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c037070 con 0x7f2e140cea80 2024-04-25T09:01:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.145+0000 7f2e11ffb640 1 -- 172.21.15.5:0/3204192603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c032440 con 0x7f2e140cea80 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.145+0000 7f2e11ffb640 1 -- 172.21.15.5:0/3204192603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c032810 con 0x7f2e140cea80 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.145+0000 7f2e19330640 1 -- 172.21.15.5:0/3204192603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140cea80 msgr2=0x7f2e1415f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.145+0000 7f2e19330640 1 --2- 172.21.15.5:0/3204192603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140cea80 0x7f2e1415f840 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2e140b3480 tx=0x7f2e0c02a230 comp rx=0 tx=0).stop 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.146+0000 7f2e19330640 1 -- 172.21.15.5:0/3204192603 shutdown_connections 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.146+0000 7f2e19330640 1 --2- 172.21.15.5:0/3204192603 >> v2:172.21.15.80:3300/0 conn(0x7f2e1406bd00 0x7f2e140d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.146+0000 7f2e19330640 1 --2- 172.21.15.5:0/3204192603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140cea80 0x7f2e1415f840 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.146+0000 7f2e19330640 1 -- 172.21.15.5:0/3204192603 >> 172.21.15.5:0/3204192603 conn(0x7f2e140d19f0 msgr2=0x7f2e140d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.146+0000 7f2e19330640 1 -- 172.21.15.5:0/3204192603 shutdown_connections 2024-04-25T09:01:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.146+0000 7f2e19330640 1 -- 172.21.15.5:0/3204192603 wait complete. 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.147+0000 7f2e19330640 1 Processor -- start 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.147+0000 7f2e19330640 1 -- start start 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e1406bd00 0x7f2e141e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e140cea80 0x7f2e140b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140b6ae0 0x7f2e140b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140d1660 con 0x7f2e140b6ae0 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140d0270 con 0x7f2e1406bd00 2024-04-25T09:01:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140d17e0 con 0x7f2e140cea80 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140b6ae0 0x7f2e140b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140b6ae0 0x7f2e140b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55354/0 (socket says 172.21.15.5:55354) 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 -- 172.21.15.5:0/209365325 learned_addr learned my addr 172.21.15.5:0/209365325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e12ffd640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e1406bd00 0x7f2e141e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e127fc640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e140cea80 0x7f2e140b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 -- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e140cea80 msgr2=0x7f2e140b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e140cea80 0x7f2e140b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 -- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e1406bd00 msgr2=0x7f2e141e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e1406bd00 0x7f2e141e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 -- 172.21.15.5:0/209365325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e141e7f40 con 0x7f2e140b6ae0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e137fe640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140b6ae0 0x7f2e140b50f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400b9a0 tx=0x7f2e0400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2dfb7fe640 1 -- 172.21.15.5:0/209365325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04019070 con 0x7f2e140b6ae0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2dfb7fe640 1 -- 172.21.15.5:0/209365325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400cbc0 con 0x7f2e140b6ae0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e141e8220 con 0x7f2e140b6ae0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2dfb7fe640 1 -- 172.21.15.5:0/209365325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04014440 con 0x7f2e140b6ae0 2024-04-25T09:01:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.148+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e141e87e0 con 0x7f2e140b6ae0 2024-04-25T09:01:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.149+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1404ef20 con 0x7f2e140b6ae0 2024-04-25T09:01:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.150+0000 7f2dfb7fe640 1 -- 172.21.15.5:0/209365325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e0401c070 con 0x7f2e140b6ae0 2024-04-25T09:01:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.150+0000 7f2dfb7fe640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e0006b4d0 0x7f2e0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.150+0000 7f2dfb7fe640 1 -- 172.21.15.5:0/209365325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e04089f10 con 0x7f2e140b6ae0 2024-04-25T09:01:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.150+0000 7f2e12ffd640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e0006b4d0 0x7f2e0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.151+0000 7f2e12ffd640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e0006b4d0 0x7f2e0006d990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c034000 tx=0x7f2e0c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.154+0000 7f2dfb7fe640 1 -- 172.21.15.5:0/209365325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e04058d90 con 0x7f2e140b6ae0 2024-04-25T09:01:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.405+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2e140cefa0 con 0x7f2e140b6ae0 2024-04-25T09:01:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.405+0000 7f2dfb7fe640 1 -- 172.21.15.5:0/209365325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1583 (secure 0 0 0) 0x7f2e04058690 con 0x7f2e140b6ae0 2024-04-25T09:01:06.395 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:06.395 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":286,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":73,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":323141632,"bytes_avail":772770971648,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":45,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":7038}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-04-25T09:00:50.443711+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:01:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e0006b4d0 msgr2=0x7f2e0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e0006b4d0 0x7f2e0006d990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c034000 tx=0x7f2e0c02e000 comp rx=0 tx=0).stop 2024-04-25T09:01:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140b6ae0 msgr2=0x7f2e140b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140b6ae0 0x7f2e140b50f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400b9a0 tx=0x7f2e0400be60 comp rx=0 tx=0).stop 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 shutdown_connections 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e0006b4d0 0x7f2e0006d990 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e140b6ae0 0x7f2e140b50f0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e140cea80 0x7f2e140b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 --2- 172.21.15.5:0/209365325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e1406bd00 0x7f2e141e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 >> 172.21.15.5:0/209365325 conn(0x7f2e140d19f0 msgr2=0x7f2e14161f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 shutdown_connections 2024-04-25T09:01:06.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.407+0000 7f2e19330640 1 -- 172.21.15.5:0/209365325 wait complete. 2024-04-25T09:01:06.408 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:01:06.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.520+0000 7fb3ece15640 1 Processor -- start 2024-04-25T09:01:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.520+0000 7fb3ece15640 1 -- start start 2024-04-25T09:01:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3ece15640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb3e806bd00 0x7fb3e80d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3ece15640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e815ef10 con 0x7fb3e806adf0 2024-04-25T09:01:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3ece15640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e815ff50 con 0x7fb3e80cea80 2024-04-25T09:01:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3ece15640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80cfd60 con 0x7fb3e806bd00 2024-04-25T09:01:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3dffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3e806adf0 0x7fb3e806b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37898/0 (socket says 172.21.15.5:37898) 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3dffff640 1 -- 172.21.15.5:0/1008487082 learned_addr learned my addr 172.21.15.5:0/1008487082 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3e6d9d640 1 --2- 172.21.15.5:0/1008487082 >> v2:172.21.15.80:3300/0 conn(0x7fb3e806bd00 0x7fb3e80d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655591683 0 0) 0x7fb3e815ef10 con 0x7fb3e806adf0 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.521+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d4003520 con 0x7fb3e806adf0 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876678670 0 0) 0x7fb3d4003520 con 0x7fb3e806adf0 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 >> v2:172.21.15.80:3300/0 conn(0x7fb3e806bd00 msgr2=0x7fb3e80d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 --2- 172.21.15.5:0/1008487082 >> v2:172.21.15.80:3300/0 conn(0x7fb3e806bd00 0x7fb3e80d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 >> v1:172.21.15.80:6789/0 conn(0x7fb3e80cea80 legacy=0x7fb3e815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e815f1a0 con 0x7fb3e806adf0 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb3d0001670 con 0x7fb3e806adf0 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 >> v1:172.21.15.5:6789/0 conn(0x7fb3e806adf0 legacy=0x7fb3e806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d40039b0 0x7fb3d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3d40043b0 0x7fb3d4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d4005080 0x7fb3d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d400bfb0 con 0x7fb3d4005080 2024-04-25T09:01:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d400c160 con 0x7fb3d40043b0 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d400c360 con 0x7fb3d40039b0 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e6d9d640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d4005080 0x7fb3d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3dffff640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3d40043b0 0x7fb3d4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e659c640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d40039b0 0x7fb3d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e6d9d640 1 -- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d40039b0 msgr2=0x7fb3d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e6d9d640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d40039b0 0x7fb3d4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e6d9d640 1 -- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3d40043b0 msgr2=0x7fb3d4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e6d9d640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3d40043b0 0x7fb3d4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.522+0000 7fb3e6d9d640 1 -- 172.21.15.5:0/1008487082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4003520 con 0x7fb3d4005080 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.523+0000 7fb3e6d9d640 1 -- 172.21.15.5:0/1008487082 reap_dead start 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.523+0000 7fb3e6d9d640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d4005080 0x7fb3d400b9c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009fc0 tx=0x7fb3d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5382c2d18d7ee151 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.523+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0035020 con 0x7fb3d4005080 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.523+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0003bd0 con 0x7fb3d4005080 2024-04-25T09:01:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.523+0000 7fb3e5d9b640 1 -- 172.21.15.5:0/1008487082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0009c10 con 0x7fb3d4005080 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.524+0000 7fb3ece15640 1 -- 172.21.15.5:0/1008487082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d4005080 msgr2=0x7fb3d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.524+0000 7fb3ece15640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d4005080 0x7fb3d400b9c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009fc0 tx=0x7fb3d4005830 comp rx=0 tx=0).stop 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.524+0000 7fb3ece15640 1 -- 172.21.15.5:0/1008487082 shutdown_connections 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.524+0000 7fb3ece15640 1 --2- 172.21.15.5:0/1008487082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d4005080 0x7fb3d400b9c0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.524+0000 7fb3ece15640 1 -- 172.21.15.5:0/1008487082 >> 172.21.15.5:0/1008487082 conn(0x7fb3e80d19f0 msgr2=0x7fb3e80d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.524+0000 7fb3ece15640 1 -- 172.21.15.5:0/1008487082 shutdown_connections 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.524+0000 7fb3ece15640 1 -- 172.21.15.5:0/1008487082 wait complete. 2024-04-25T09:01:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.525+0000 7fb3ece15640 1 Processor -- start 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.525+0000 7fb3ece15640 1 -- start start 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3ece15640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d4005080 0x7fb3e809da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3ece15640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80ccfc0 0x7fb3e80cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3ece15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e80b6b40 0x7fb3e80b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3ece15640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80d0270 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3ece15640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e815f480 con 0x7fb3e80b6b40 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3ece15640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80d1660 con 0x7fb3d4005080 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80ccfc0 0x7fb3e80cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80ccfc0 0x7fb3e80cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55372/0 (socket says 172.21.15.5:55372) 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 -- 172.21.15.5:0/2555632376 learned_addr learned my addr 172.21.15.5:0/2555632376 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 -- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d4005080 msgr2=0x7fb3e809da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d4005080 0x7fb3e809da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 -- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e80b6b40 msgr2=0x7fb3e80b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3e6d9d640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e80b6b40 0x7fb3e80b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e80b6b40 0x7fb3e80b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 -- 172.21.15.5:0/2555632376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e81f3840 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.526+0000 7fb3dffff640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80ccfc0 0x7fb3e80cd440 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00072f0 tx=0x7fb3d00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.527+0000 7fb3deffd640 1 -- 172.21.15.5:0/2555632376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d001a070 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.527+0000 7fb3deffd640 1 -- 172.21.15.5:0/2555632376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d000f960 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.527+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e81f3ae0 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.527+0000 7fb3deffd640 1 -- 172.21.15.5:0/2555632376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d000fd30 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.527+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e81f40a0 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.528+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e804ef20 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.528+0000 7fb3deffd640 1 -- 172.21.15.5:0/2555632376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3d001d070 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.528+0000 7fb3deffd640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3c806b4d0 0x7fb3c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.529+0000 7fb3deffd640 1 -- 172.21.15.5:0/2555632376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3d0089ad0 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.529+0000 7fb3e659c640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3c806b4d0 0x7fb3c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.529+0000 7fb3e659c640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3c806b4d0 0x7fb3c806d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb3e806eee0 tx=0x7fb3d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.532+0000 7fb3deffd640 1 -- 172.21.15.5:0/2555632376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3d0058950 con 0x7fb3e80ccfc0 2024-04-25T09:01:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.708+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3e80cefa0 con 0x7fb3c806b4d0 2024-04-25T09:01:06.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.715+0000 7fb3deffd640 1 -- 172.21.15.5:0/2555632376 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252069 (secure 0 0 0) 0x7fb3e80cefa0 con 0x7fb3c806b4d0 2024-04-25T09:01:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:06.707 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3c806b4d0 msgr2=0x7fb3c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3c806b4d0 0x7fb3c806d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb3e806eee0 tx=0x7fb3d8009040 comp rx=0 tx=0).stop 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80ccfc0 msgr2=0x7fb3e80cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80ccfc0 0x7fb3e80cd440 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00072f0 tx=0x7fb3d00077b0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 shutdown_connections 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb3c806b4d0 0x7fb3c806d990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3e80b6b40 0x7fb3e80b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e80ccfc0 0x7fb3e80cd440 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 --2- 172.21.15.5:0/2555632376 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3d4005080 0x7fb3e809da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 >> 172.21.15.5:0/2555632376 conn(0x7fb3e80d19f0 msgr2=0x7fb3e80b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 shutdown_connections 2024-04-25T09:01:06.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:06.717+0000 7fb3ece15640 1 -- 172.21.15.5:0/2555632376 wait complete. 2024-04-25T09:01:06.718 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-04-25T09:01:06.447091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315892,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754658828,"statfs":{"total":773094113280,"available":772770639872,"internally_reserved":0,"allocated":8364032,"data_stored":4212244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":314953265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001318"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232348+0000","last_change":"2024-04-25T09:01:02.242774+0000","last_active":"2024-04-25T09:01:03.232348+0000","last_peered":"2024-04-25T09:01:03.232348+0000","last_clean":"2024-04-25T09:01:03.232348+0000","last_became_active":"2024-04-25T09:01:02.242060+0000","last_became_peered":"2024-04-25T09:01:02.242060+0000","last_unstale":"2024-04-25T09:01:03.232348+0000","last_undegraded":"2024-04-25T09:01:03.232348+0000","last_fullsized":"2024-04-25T09:01:03.232348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:33.254570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233406+0000","last_change":"2024-04-25T09:01:02.240234+0000","last_active":"2024-04-25T09:01:03.233406+0000","last_peered":"2024-04-25T09:01:03.233406+0000","last_clean":"2024-04-25T09:01:03.233406+0000","last_became_active":"2024-04-25T09:01:02.237724+0000","last_became_peered":"2024-04-25T09:01:02.237724+0000","last_unstale":"2024-04-25T09:01:03.233406+0000","last_undegraded":"2024-04-25T09:01:03.233406+0000","last_fullsized":"2024-04-25T09:01:03.233406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:12.186343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675395+0000","last_change":"2024-04-25T09:01:02.233941+0000","last_active":"2024-04-25T09:01:03.675395+0000","last_peered":"2024-04-25T09:01:03.675395+0000","last_clean":"2024-04-25T09:01:03.675395+0000","last_became_active":"2024-04-25T09:01:02.233666+0000","last_became_peered":"2024-04-25T09:01:02.233666+0000","last_unstale":"2024-04-25T09:01:03.675395+0000","last_undegraded":"2024-04-25T09:01:03.675395+0000","last_fullsized":"2024-04-25T09:01:03.675395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:44.935107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709740+0000","last_change":"2024-04-25T09:01:02.237556+0000","last_active":"2024-04-25T09:01:03.709740+0000","last_peered":"2024-04-25T09:01:03.709740+0000","last_clean":"2024-04-25T09:01:03.709740+0000","last_became_active":"2024-04-25T09:01:02.237257+0000","last_became_peered":"2024-04-25T09:01:02.237257+0000","last_unstale":"2024-04-25T09:01:03.709740+0000","last_undegraded":"2024-04-25T09:01:03.709740+0000","last_fullsized":"2024-04-25T09:01:03.709740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:47.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230557+0000","last_change":"2024-04-25T09:01:02.236189+0000","last_active":"2024-04-25T09:01:03.230557+0000","last_peered":"2024-04-25T09:01:03.230557+0000","last_clean":"2024-04-25T09:01:03.230557+0000","last_became_active":"2024-04-25T09:01:02.235918+0000","last_became_peered":"2024-04-25T09:01:02.235918+0000","last_unstale":"2024-04-25T09:01:03.230557+0000","last_undegraded":"2024-04-25T09:01:03.230557+0000","last_fullsized":"2024-04-25T09:01:03.230557+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:56.926686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232106+0000","last_change":"2024-04-25T09:01:02.238070+0000","last_active":"2024-04-25T09:01:03.232106+0000","last_peered":"2024-04-25T09:01:03.232106+0000","last_clean":"2024-04-25T09:01:03.232106+0000","last_became_active":"2024-04-25T09:01:02.237699+0000","last_became_peered":"2024-04-25T09:01:02.237699+0000","last_unstale":"2024-04-25T09:01:03.232106+0000","last_undegraded":"2024-04-25T09:01:03.232106+0000","last_fullsized":"2024-04-25T09:01:03.232106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:10.975280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235767+0000","last_change":"2024-04-25T09:01:02.239545+0000","last_active":"2024-04-25T09:01:03.235767+0000","last_peered":"2024-04-25T09:01:03.235767+0000","last_clean":"2024-04-25T09:01:03.235767+0000","last_became_active":"2024-04-25T09:01:02.239271+0000","last_became_peered":"2024-04-25T09:01:02.239271+0000","last_unstale":"2024-04-25T09:01:03.235767+0000","last_undegraded":"2024-04-25T09:01:03.235767+0000","last_fullsized":"2024-04-25T09:01:03.235767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:53.862066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232559+0000","last_change":"2024-04-25T09:01:02.244483+0000","last_active":"2024-04-25T09:01:03.232559+0000","last_peered":"2024-04-25T09:01:03.232559+0000","last_clean":"2024-04-25T09:01:03.232559+0000","last_became_active":"2024-04-25T09:01:02.243277+0000","last_became_peered":"2024-04-25T09:01:02.243277+0000","last_unstale":"2024-04-25T09:01:03.232559+0000","last_undegraded":"2024-04-25T09:01:03.232559+0000","last_fullsized":"2024-04-25T09:01:03.232559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:12.975470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230705+0000","last_change":"2024-04-25T09:01:02.229614+0000","last_active":"2024-04-25T09:01:03.230705+0000","last_peered":"2024-04-25T09:01:03.230705+0000","last_clean":"2024-04-25T09:01:03.230705+0000","last_became_active":"2024-04-25T09:01:02.229333+0000","last_became_peered":"2024-04-25T09:01:02.229333+0000","last_unstale":"2024-04-25T09:01:03.230705+0000","last_undegraded":"2024-04-25T09:01:03.230705+0000","last_fullsized":"2024-04-25T09:01:03.230705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710177+0000","last_change":"2024-04-25T09:01:02.241312+0000","last_active":"2024-04-25T09:01:03.710177+0000","last_peered":"2024-04-25T09:01:03.710177+0000","last_clean":"2024-04-25T09:01:03.710177+0000","last_became_active":"2024-04-25T09:01:02.241014+0000","last_became_peered":"2024-04-25T09:01:02.241014+0000","last_unstale":"2024-04-25T09:01:03.710177+0000","last_undegraded":"2024-04-25T09:01:03.710177+0000","last_fullsized":"2024-04-25T09:01:03.710177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.485174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232674+0000","last_change":"2024-04-25T09:01:02.240607+0000","last_active":"2024-04-25T09:01:03.232674+0000","last_peered":"2024-04-25T09:01:03.232674+0000","last_clean":"2024-04-25T09:01:03.232674+0000","last_became_active":"2024-04-25T09:01:02.239854+0000","last_became_peered":"2024-04-25T09:01:02.239854+0000","last_unstale":"2024-04-25T09:01:03.232674+0000","last_undegraded":"2024-04-25T09:01:03.232674+0000","last_fullsized":"2024-04-25T09:01:03.232674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:01.905698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709783+0000","last_change":"2024-04-25T09:01:02.241855+0000","last_active":"2024-04-25T09:01:03.709783+0000","last_peered":"2024-04-25T09:01:03.709783+0000","last_clean":"2024-04-25T09:01:03.709783+0000","last_became_active":"2024-04-25T09:01:02.241178+0000","last_became_peered":"2024-04-25T09:01:02.241178+0000","last_unstale":"2024-04-25T09:01:03.709783+0000","last_undegraded":"2024-04-25T09:01:03.709783+0000","last_fullsized":"2024-04-25T09:01:03.709783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:54.739659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237910+0000","last_change":"2024-04-25T09:01:02.239982+0000","last_active":"2024-04-25T09:01:03.237910+0000","last_peered":"2024-04-25T09:01:03.237910+0000","last_clean":"2024-04-25T09:01:03.237910+0000","last_became_active":"2024-04-25T09:01:02.239642+0000","last_became_peered":"2024-04-25T09:01:02.239642+0000","last_unstale":"2024-04-25T09:01:03.237910+0000","last_undegraded":"2024-04-25T09:01:03.237910+0000","last_fullsized":"2024-04-25T09:01:03.237910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:44.632145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230789+0000","last_change":"2024-04-25T09:01:02.226238+0000","last_active":"2024-04-25T09:01:03.230789+0000","last_peered":"2024-04-25T09:01:03.230789+0000","last_clean":"2024-04-25T09:01:03.230789+0000","last_became_active":"2024-04-25T09:01:02.225919+0000","last_became_peered":"2024-04-25T09:01:02.225919+0000","last_unstale":"2024-04-25T09:01:03.230789+0000","last_undegraded":"2024-04-25T09:01:03.230789+0000","last_fullsized":"2024-04-25T09:01:03.230789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:51.272565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237759+0000","last_change":"2024-04-25T09:01:02.237124+0000","last_active":"2024-04-25T09:01:03.237759+0000","last_peered":"2024-04-25T09:01:03.237759+0000","last_clean":"2024-04-25T09:01:03.237759+0000","last_became_active":"2024-04-25T09:01:02.236834+0000","last_became_peered":"2024-04-25T09:01:02.236834+0000","last_unstale":"2024-04-25T09:01:03.237759+0000","last_undegraded":"2024-04-25T09:01:03.237759+0000","last_fullsized":"2024-04-25T09:01:03.237759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:58.091375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709847+0000","last_change":"2024-04-25T09:01:02.238563+0000","last_active":"2024-04-25T09:01:03.709847+0000","last_peered":"2024-04-25T09:01:03.709847+0000","last_clean":"2024-04-25T09:01:03.709847+0000","last_became_active":"2024-04-25T09:01:02.238306+0000","last_became_peered":"2024-04-25T09:01:02.238306+0000","last_unstale":"2024-04-25T09:01:03.709847+0000","last_undegraded":"2024-04-25T09:01:03.709847+0000","last_fullsized":"2024-04-25T09:01:03.709847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:52.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230847+0000","last_change":"2024-04-25T09:01:02.230945+0000","last_active":"2024-04-25T09:01:03.230847+0000","last_peered":"2024-04-25T09:01:03.230847+0000","last_clean":"2024-04-25T09:01:03.230847+0000","last_became_active":"2024-04-25T09:01:02.230652+0000","last_became_peered":"2024-04-25T09:01:02.230652+0000","last_unstale":"2024-04-25T09:01:03.230847+0000","last_undegraded":"2024-04-25T09:01:03.230847+0000","last_fullsized":"2024-04-25T09:01:03.230847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:18.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709833+0000","last_change":"2024-04-25T09:01:02.237878+0000","last_active":"2024-04-25T09:01:03.709833+0000","last_peered":"2024-04-25T09:01:03.709833+0000","last_clean":"2024-04-25T09:01:03.709833+0000","last_became_active":"2024-04-25T09:01:02.237605+0000","last_became_peered":"2024-04-25T09:01:02.237605+0000","last_unstale":"2024-04-25T09:01:03.709833+0000","last_undegraded":"2024-04-25T09:01:03.709833+0000","last_fullsized":"2024-04-25T09:01:03.709833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.627006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233140+0000","last_change":"2024-04-25T09:01:02.241819+0000","last_active":"2024-04-25T09:01:03.233140+0000","last_peered":"2024-04-25T09:01:03.233140+0000","last_clean":"2024-04-25T09:01:03.233140+0000","last_became_active":"2024-04-25T09:01:02.241525+0000","last_became_peered":"2024-04-25T09:01:02.241525+0000","last_unstale":"2024-04-25T09:01:03.233140+0000","last_undegraded":"2024-04-25T09:01:03.233140+0000","last_fullsized":"2024-04-25T09:01:03.233140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.485174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237857+0000","last_change":"2024-04-25T09:01:02.240233+0000","last_active":"2024-04-25T09:01:03.237857+0000","last_peered":"2024-04-25T09:01:03.237857+0000","last_clean":"2024-04-25T09:01:03.237857+0000","last_became_active":"2024-04-25T09:01:02.239945+0000","last_became_peered":"2024-04-25T09:01:02.239945+0000","last_unstale":"2024-04-25T09:01:03.237857+0000","last_undegraded":"2024-04-25T09:01:03.237857+0000","last_fullsized":"2024-04-25T09:01:03.237857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:40.397327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709979+0000","last_change":"2024-04-25T09:01:02.236660+0000","last_active":"2024-04-25T09:01:03.709979+0000","last_peered":"2024-04-25T09:01:03.709979+0000","last_clean":"2024-04-25T09:01:03.709979+0000","last_became_active":"2024-04-25T09:01:02.236302+0000","last_became_peered":"2024-04-25T09:01:02.236302+0000","last_unstale":"2024-04-25T09:01:03.709979+0000","last_undegraded":"2024-04-25T09:01:03.709979+0000","last_fullsized":"2024-04-25T09:01:03.709979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:29.296608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709994+0000","last_change":"2024-04-25T09:01:02.226962+0000","last_active":"2024-04-25T09:01:03.709994+0000","last_peered":"2024-04-25T09:01:03.709994+0000","last_clean":"2024-04-25T09:01:03.709994+0000","last_became_active":"2024-04-25T09:01:02.226668+0000","last_became_peered":"2024-04-25T09:01:02.226668+0000","last_unstale":"2024-04-25T09:01:03.709994+0000","last_undegraded":"2024-04-25T09:01:03.709994+0000","last_fullsized":"2024-04-25T09:01:03.709994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:12.975470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231748+0000","last_change":"2024-04-25T09:01:02.240155+0000","last_active":"2024-04-25T09:01:03.231748+0000","last_peered":"2024-04-25T09:01:03.231748+0000","last_clean":"2024-04-25T09:01:03.231748+0000","last_became_active":"2024-04-25T09:01:02.239843+0000","last_became_peered":"2024-04-25T09:01:02.239843+0000","last_unstale":"2024-04-25T09:01:03.231748+0000","last_undegraded":"2024-04-25T09:01:03.231748+0000","last_fullsized":"2024-04-25T09:01:03.231748+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:08.549449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231452+0000","last_change":"2024-04-25T09:01:02.245962+0000","last_active":"2024-04-25T09:01:03.231452+0000","last_peered":"2024-04-25T09:01:03.231452+0000","last_clean":"2024-04-25T09:01:03.231452+0000","last_became_active":"2024-04-25T09:01:02.245522+0000","last_became_peered":"2024-04-25T09:01:02.245522+0000","last_unstale":"2024-04-25T09:01:03.231452+0000","last_undegraded":"2024-04-25T09:01:03.231452+0000","last_fullsized":"2024-04-25T09:01:03.231452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:24.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710156+0000","last_change":"2024-04-25T09:01:02.238054+0000","last_active":"2024-04-25T09:01:03.710156+0000","last_peered":"2024-04-25T09:01:03.710156+0000","last_clean":"2024-04-25T09:01:03.710156+0000","last_became_active":"2024-04-25T09:01:02.237730+0000","last_became_peered":"2024-04-25T09:01:02.237730+0000","last_unstale":"2024-04-25T09:01:03.710156+0000","last_undegraded":"2024-04-25T09:01:03.710156+0000","last_fullsized":"2024-04-25T09:01:03.710156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:25.012053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236076+0000","last_change":"2024-04-25T09:01:02.234521+0000","last_active":"2024-04-25T09:01:03.236076+0000","last_peered":"2024-04-25T09:01:03.236076+0000","last_clean":"2024-04-25T09:01:03.236076+0000","last_became_active":"2024-04-25T09:01:02.234256+0000","last_became_peered":"2024-04-25T09:01:02.234256+0000","last_unstale":"2024-04-25T09:01:03.236076+0000","last_undegraded":"2024-04-25T09:01:03.236076+0000","last_fullsized":"2024-04-25T09:01:03.236076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:08.549449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675436+0000","last_change":"2024-04-25T09:01:02.236458+0000","last_active":"2024-04-25T09:01:03.675436+0000","last_peered":"2024-04-25T09:01:03.675436+0000","last_clean":"2024-04-25T09:01:03.675436+0000","last_became_active":"2024-04-25T09:01:02.236173+0000","last_became_peered":"2024-04-25T09:01:02.236173+0000","last_unstale":"2024-04-25T09:01:03.675436+0000","last_undegraded":"2024-04-25T09:01:03.675436+0000","last_fullsized":"2024-04-25T09:01:03.675436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:58.445886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710244+0000","last_change":"2024-04-25T09:01:02.242519+0000","last_active":"2024-04-25T09:01:03.710244+0000","last_peered":"2024-04-25T09:01:03.710244+0000","last_clean":"2024-04-25T09:01:03.710244+0000","last_became_active":"2024-04-25T09:01:02.241602+0000","last_became_peered":"2024-04-25T09:01:02.241602+0000","last_unstale":"2024-04-25T09:01:03.710244+0000","last_undegraded":"2024-04-25T09:01:03.710244+0000","last_fullsized":"2024-04-25T09:01:03.710244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:15.073398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675392+0000","last_change":"2024-04-25T09:01:02.229077+0000","last_active":"2024-04-25T09:01:03.675392+0000","last_peered":"2024-04-25T09:01:03.675392+0000","last_clean":"2024-04-25T09:01:03.675392+0000","last_became_active":"2024-04-25T09:01:02.228746+0000","last_became_peered":"2024-04-25T09:01:02.228746+0000","last_unstale":"2024-04-25T09:01:03.675392+0000","last_undegraded":"2024-04-25T09:01:03.675392+0000","last_fullsized":"2024-04-25T09:01:03.675392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:37.933057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235828+0000","last_change":"2024-04-25T09:01:02.243391+0000","last_active":"2024-04-25T09:01:03.235828+0000","last_peered":"2024-04-25T09:01:03.235828+0000","last_clean":"2024-04-25T09:01:03.235828+0000","last_became_active":"2024-04-25T09:01:02.243126+0000","last_became_peered":"2024-04-25T09:01:02.243126+0000","last_unstale":"2024-04-25T09:01:03.235828+0000","last_undegraded":"2024-04-25T09:01:03.235828+0000","last_fullsized":"2024-04-25T09:01:03.235828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:10.756232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235961+0000","last_change":"2024-04-25T09:01:02.225401+0000","last_active":"2024-04-25T09:01:03.235961+0000","last_peered":"2024-04-25T09:01:03.235961+0000","last_clean":"2024-04-25T09:01:03.235961+0000","last_became_active":"2024-04-25T09:01:02.225081+0000","last_became_peered":"2024-04-25T09:01:02.225081+0000","last_unstale":"2024-04-25T09:01:03.235961+0000","last_undegraded":"2024-04-25T09:01:03.235961+0000","last_fullsized":"2024-04-25T09:01:03.235961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:50.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232493+0000","last_change":"2024-04-25T09:01:02.236534+0000","last_active":"2024-04-25T09:01:03.232493+0000","last_peered":"2024-04-25T09:01:03.232493+0000","last_clean":"2024-04-25T09:01:03.232493+0000","last_became_active":"2024-04-25T09:01:02.236262+0000","last_became_peered":"2024-04-25T09:01:02.236262+0000","last_unstale":"2024-04-25T09:01:03.232493+0000","last_undegraded":"2024-04-25T09:01:03.232493+0000","last_fullsized":"2024-04-25T09:01:03.232493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:29.296608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231782+0000","last_change":"2024-04-25T09:01:02.247289+0000","last_active":"2024-04-25T09:01:03.231782+0000","last_peered":"2024-04-25T09:01:03.231782+0000","last_clean":"2024-04-25T09:01:03.231782+0000","last_became_active":"2024-04-25T09:01:02.246995+0000","last_became_peered":"2024-04-25T09:01:02.246995+0000","last_unstale":"2024-04-25T09:01:03.231782+0000","last_undegraded":"2024-04-25T09:01:03.231782+0000","last_fullsized":"2024-04-25T09:01:03.231782+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:37.554190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232783+0000","last_change":"2024-04-25T09:01:01.239796+0000","last_active":"2024-04-25T09:01:03.232783+0000","last_peered":"2024-04-25T09:01:03.232783+0000","last_clean":"2024-04-25T09:01:03.232783+0000","last_became_active":"2024-04-25T09:01:01.239418+0000","last_became_peered":"2024-04-25T09:01:01.239418+0000","last_unstale":"2024-04-25T09:01:03.232783+0000","last_undegraded":"2024-04-25T09:01:03.232783+0000","last_fullsized":"2024-04-25T09:01:03.232783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:24.061944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230995+0000","last_change":"2024-04-25T09:01:02.228304+0000","last_active":"2024-04-25T09:01:03.230995+0000","last_peered":"2024-04-25T09:01:03.230995+0000","last_clean":"2024-04-25T09:01:03.230995+0000","last_became_active":"2024-04-25T09:01:02.228024+0000","last_became_peered":"2024-04-25T09:01:02.228024+0000","last_unstale":"2024-04-25T09:01:03.230995+0000","last_undegraded":"2024-04-25T09:01:03.230995+0000","last_fullsized":"2024-04-25T09:01:03.230995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:24.600491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.238023+0000","last_change":"2024-04-25T09:01:01.236292+0000","last_active":"2024-04-25T09:01:03.238023+0000","last_peered":"2024-04-25T09:01:03.238023+0000","last_clean":"2024-04-25T09:01:03.238023+0000","last_became_active":"2024-04-25T09:01:01.235994+0000","last_became_peered":"2024-04-25T09:01:01.235994+0000","last_unstale":"2024-04-25T09:01:03.238023+0000","last_undegraded":"2024-04-25T09:01:03.238023+0000","last_fullsized":"2024-04-25T09:01:03.238023+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:44.366158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233098+0000","last_change":"2024-04-25T09:01:02.234645+0000","last_active":"2024-04-25T09:01:03.233098+0000","last_peered":"2024-04-25T09:01:03.233098+0000","last_clean":"2024-04-25T09:01:03.233098+0000","last_became_active":"2024-04-25T09:01:02.234353+0000","last_became_peered":"2024-04-25T09:01:02.234353+0000","last_unstale":"2024-04-25T09:01:03.233098+0000","last_undegraded":"2024-04-25T09:01:03.233098+0000","last_fullsized":"2024-04-25T09:01:03.233098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:45.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710253+0000","last_change":"2024-04-25T09:01:01.235176+0000","last_active":"2024-04-25T09:01:03.710253+0000","last_peered":"2024-04-25T09:01:03.710253+0000","last_clean":"2024-04-25T09:01:03.710253+0000","last_became_active":"2024-04-25T09:01:01.234875+0000","last_became_peered":"2024-04-25T09:01:01.234875+0000","last_unstale":"2024-04-25T09:01:03.710253+0000","last_undegraded":"2024-04-25T09:01:03.710253+0000","last_fullsized":"2024-04-25T09:01:03.710253+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:45.055232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232833+0000","last_change":"2024-04-25T09:01:02.240387+0000","last_active":"2024-04-25T09:01:03.232833+0000","last_peered":"2024-04-25T09:01:03.232833+0000","last_clean":"2024-04-25T09:01:03.232833+0000","last_became_active":"2024-04-25T09:01:02.239493+0000","last_became_peered":"2024-04-25T09:01:02.239493+0000","last_unstale":"2024-04-25T09:01:03.232833+0000","last_undegraded":"2024-04-25T09:01:03.232833+0000","last_fullsized":"2024-04-25T09:01:03.232833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:10.616428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233224+0000","last_change":"2024-04-25T09:01:01.234022+0000","last_active":"2024-04-25T09:01:03.233224+0000","last_peered":"2024-04-25T09:01:03.233224+0000","last_clean":"2024-04-25T09:01:03.233224+0000","last_became_active":"2024-04-25T09:01:01.233403+0000","last_became_peered":"2024-04-25T09:01:01.233403+0000","last_unstale":"2024-04-25T09:01:03.233224+0000","last_undegraded":"2024-04-25T09:01:03.233224+0000","last_fullsized":"2024-04-25T09:01:03.233224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:23.598640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235984+0000","last_change":"2024-04-25T09:01:02.230205+0000","last_active":"2024-04-25T09:01:03.235984+0000","last_peered":"2024-04-25T09:01:03.235984+0000","last_clean":"2024-04-25T09:01:03.235984+0000","last_became_active":"2024-04-25T09:01:02.229943+0000","last_became_peered":"2024-04-25T09:01:02.229943+0000","last_unstale":"2024-04-25T09:01:03.235984+0000","last_undegraded":"2024-04-25T09:01:03.235984+0000","last_fullsized":"2024-04-25T09:01:03.235984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:24.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675474+0000","last_change":"2024-04-25T09:01:01.229650+0000","last_active":"2024-04-25T09:01:03.675474+0000","last_peered":"2024-04-25T09:01:03.675474+0000","last_clean":"2024-04-25T09:01:03.675474+0000","last_became_active":"2024-04-25T09:01:01.229258+0000","last_became_peered":"2024-04-25T09:01:01.229258+0000","last_unstale":"2024-04-25T09:01:03.675474+0000","last_undegraded":"2024-04-25T09:01:03.675474+0000","last_fullsized":"2024-04-25T09:01:03.675474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:00.903847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710109+0000","last_change":"2024-04-25T09:01:02.237801+0000","last_active":"2024-04-25T09:01:03.710109+0000","last_peered":"2024-04-25T09:01:03.710109+0000","last_clean":"2024-04-25T09:01:03.710109+0000","last_became_active":"2024-04-25T09:01:02.237543+0000","last_became_peered":"2024-04-25T09:01:02.237543+0000","last_unstale":"2024-04-25T09:01:03.710109+0000","last_undegraded":"2024-04-25T09:01:03.710109+0000","last_fullsized":"2024-04-25T09:01:03.710109+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:45.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232226+0000","last_change":"2024-04-25T09:01:01.234016+0000","last_active":"2024-04-25T09:01:03.232226+0000","last_peered":"2024-04-25T09:01:03.232226+0000","last_clean":"2024-04-25T09:01:03.232226+0000","last_became_active":"2024-04-25T09:01:01.233595+0000","last_became_peered":"2024-04-25T09:01:01.233595+0000","last_unstale":"2024-04-25T09:01:03.232226+0000","last_undegraded":"2024-04-25T09:01:03.232226+0000","last_fullsized":"2024-04-25T09:01:03.232226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:53.737808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230406+0000","last_change":"2024-04-25T09:01:02.234654+0000","last_active":"2024-04-25T09:01:03.230406+0000","last_peered":"2024-04-25T09:01:03.230406+0000","last_clean":"2024-04-25T09:01:03.230406+0000","last_became_active":"2024-04-25T09:01:02.234369+0000","last_became_peered":"2024-04-25T09:01:02.234369+0000","last_unstale":"2024-04-25T09:01:03.230406+0000","last_undegraded":"2024-04-25T09:01:03.230406+0000","last_fullsized":"2024-04-25T09:01:03.230406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.211430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709560+0000","last_change":"2024-04-25T09:01:01.230135+0000","last_active":"2024-04-25T09:01:03.709560+0000","last_peered":"2024-04-25T09:01:03.709560+0000","last_clean":"2024-04-25T09:01:03.709560+0000","last_became_active":"2024-04-25T09:01:01.229853+0000","last_became_peered":"2024-04-25T09:01:01.229853+0000","last_unstale":"2024-04-25T09:01:03.709560+0000","last_undegraded":"2024-04-25T09:01:03.709560+0000","last_fullsized":"2024-04-25T09:01:03.709560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:29.719073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237807+0000","last_change":"2024-04-25T09:01:02.235669+0000","last_active":"2024-04-25T09:01:03.237807+0000","last_peered":"2024-04-25T09:01:03.237807+0000","last_clean":"2024-04-25T09:01:03.237807+0000","last_became_active":"2024-04-25T09:01:02.235386+0000","last_became_peered":"2024-04-25T09:01:02.235386+0000","last_unstale":"2024-04-25T09:01:03.237807+0000","last_undegraded":"2024-04-25T09:01:03.237807+0000","last_fullsized":"2024-04-25T09:01:03.237807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:04.207840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230397+0000","last_change":"2024-04-25T09:01:01.232041+0000","last_active":"2024-04-25T09:01:03.230397+0000","last_peered":"2024-04-25T09:01:03.230397+0000","last_clean":"2024-04-25T09:01:03.230397+0000","last_became_active":"2024-04-25T09:01:01.231752+0000","last_became_peered":"2024-04-25T09:01:01.231752+0000","last_unstale":"2024-04-25T09:01:03.230397+0000","last_undegraded":"2024-04-25T09:01:03.230397+0000","last_fullsized":"2024-04-25T09:01:03.230397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:56.842557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236127+0000","last_change":"2024-04-25T09:01:02.238786+0000","last_active":"2024-04-25T09:01:03.236127+0000","last_peered":"2024-04-25T09:01:03.236127+0000","last_clean":"2024-04-25T09:01:03.236127+0000","last_became_active":"2024-04-25T09:01:02.238537+0000","last_became_peered":"2024-04-25T09:01:02.238537+0000","last_unstale":"2024-04-25T09:01:03.236127+0000","last_undegraded":"2024-04-25T09:01:03.236127+0000","last_fullsized":"2024-04-25T09:01:03.236127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:37.554190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710179+0000","last_change":"2024-04-25T09:01:01.233295+0000","last_active":"2024-04-25T09:01:03.710179+0000","last_peered":"2024-04-25T09:01:03.710179+0000","last_clean":"2024-04-25T09:01:03.710179+0000","last_became_active":"2024-04-25T09:01:01.233010+0000","last_became_peered":"2024-04-25T09:01:01.233010+0000","last_unstale":"2024-04-25T09:01:03.710179+0000","last_undegraded":"2024-04-25T09:01:03.710179+0000","last_fullsized":"2024-04-25T09:01:03.710179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:43.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232534+0000","last_change":"2024-04-25T09:01:02.247892+0000","last_active":"2024-04-25T09:01:03.232534+0000","last_peered":"2024-04-25T09:01:03.232534+0000","last_clean":"2024-04-25T09:01:03.232534+0000","last_became_active":"2024-04-25T09:01:02.247613+0000","last_became_peered":"2024-04-25T09:01:02.247613+0000","last_unstale":"2024-04-25T09:01:03.232534+0000","last_undegraded":"2024-04-25T09:01:03.232534+0000","last_fullsized":"2024-04-25T09:01:03.232534+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:42.531040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233430+0000","last_change":"2024-04-25T09:01:01.238466+0000","last_active":"2024-04-25T09:01:03.233430+0000","last_peered":"2024-04-25T09:01:03.233430+0000","last_clean":"2024-04-25T09:01:03.233430+0000","last_became_active":"2024-04-25T09:01:01.236891+0000","last_became_peered":"2024-04-25T09:01:01.236891+0000","last_unstale":"2024-04-25T09:01:03.233430+0000","last_undegraded":"2024-04-25T09:01:03.233430+0000","last_fullsized":"2024-04-25T09:01:03.233430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:46.750140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233098+0000","last_change":"2024-04-25T09:01:02.239842+0000","last_active":"2024-04-25T09:01:03.233098+0000","last_peered":"2024-04-25T09:01:03.233098+0000","last_clean":"2024-04-25T09:01:03.233098+0000","last_became_active":"2024-04-25T09:01:02.239569+0000","last_became_peered":"2024-04-25T09:01:02.239569+0000","last_unstale":"2024-04-25T09:01:03.233098+0000","last_undegraded":"2024-04-25T09:01:03.233098+0000","last_fullsized":"2024-04-25T09:01:03.233098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:25.012053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675497+0000","last_change":"2024-04-25T09:01:01.227525+0000","last_active":"2024-04-25T09:01:03.675497+0000","last_peered":"2024-04-25T09:01:03.675497+0000","last_clean":"2024-04-25T09:01:03.675497+0000","last_became_active":"2024-04-25T09:01:01.227183+0000","last_became_peered":"2024-04-25T09:01:01.227183+0000","last_unstale":"2024-04-25T09:01:03.675497+0000","last_undegraded":"2024-04-25T09:01:03.675497+0000","last_fullsized":"2024-04-25T09:01:03.675497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:41.529189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230893+0000","last_change":"2024-04-25T09:01:02.233652+0000","last_active":"2024-04-25T09:01:03.230893+0000","last_peered":"2024-04-25T09:01:03.230893+0000","last_clean":"2024-04-25T09:01:03.230893+0000","last_became_active":"2024-04-25T09:01:02.233232+0000","last_became_peered":"2024-04-25T09:01:02.233232+0000","last_unstale":"2024-04-25T09:01:03.230893+0000","last_undegraded":"2024-04-25T09:01:03.230893+0000","last_fullsized":"2024-04-25T09:01:03.230893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:34.006041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709906+0000","last_change":"2024-04-25T09:01:01.235651+0000","last_active":"2024-04-25T09:01:03.709906+0000","last_peered":"2024-04-25T09:01:03.709906+0000","last_clean":"2024-04-25T09:01:03.709906+0000","last_became_active":"2024-04-25T09:01:01.235376+0000","last_became_peered":"2024-04-25T09:01:01.235376+0000","last_unstale":"2024-04-25T09:01:03.709906+0000","last_undegraded":"2024-04-25T09:01:03.709906+0000","last_fullsized":"2024-04-25T09:01:03.709906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.270714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231554+0000","last_change":"2024-04-25T09:01:02.233109+0000","last_active":"2024-04-25T09:01:03.231554+0000","last_peered":"2024-04-25T09:01:03.231554+0000","last_clean":"2024-04-25T09:01:03.231554+0000","last_became_active":"2024-04-25T09:01:02.232820+0000","last_became_peered":"2024-04-25T09:01:02.232820+0000","last_unstale":"2024-04-25T09:01:03.231554+0000","last_undegraded":"2024-04-25T09:01:03.231554+0000","last_fullsized":"2024-04-25T09:01:03.231554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:12.397482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709619+0000","last_change":"2024-04-25T09:01:01.239403+0000","last_active":"2024-04-25T09:01:03.709619+0000","last_peered":"2024-04-25T09:01:03.709619+0000","last_clean":"2024-04-25T09:01:03.709619+0000","last_became_active":"2024-04-25T09:01:01.239077+0000","last_became_peered":"2024-04-25T09:01:01.239077+0000","last_unstale":"2024-04-25T09:01:03.709619+0000","last_undegraded":"2024-04-25T09:01:03.709619+0000","last_fullsized":"2024-04-25T09:01:03.709619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:19.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235989+0000","last_change":"2024-04-25T09:01:02.228050+0000","last_active":"2024-04-25T09:01:03.235989+0000","last_peered":"2024-04-25T09:01:03.235989+0000","last_clean":"2024-04-25T09:01:03.235989+0000","last_became_active":"2024-04-25T09:01:02.227776+0000","last_became_peered":"2024-04-25T09:01:02.227776+0000","last_unstale":"2024-04-25T09:01:03.235989+0000","last_undegraded":"2024-04-25T09:01:03.235989+0000","last_fullsized":"2024-04-25T09:01:03.235989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:12.397482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232333+0000","last_change":"2024-04-25T09:01:01.237737+0000","last_active":"2024-04-25T09:01:03.232333+0000","last_peered":"2024-04-25T09:01:03.232333+0000","last_clean":"2024-04-25T09:01:03.232333+0000","last_became_active":"2024-04-25T09:01:01.236940+0000","last_became_peered":"2024-04-25T09:01:01.236940+0000","last_unstale":"2024-04-25T09:01:03.232333+0000","last_undegraded":"2024-04-25T09:01:03.232333+0000","last_fullsized":"2024-04-25T09:01:03.232333+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.625155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237722+0000","last_change":"2024-04-25T09:01:02.240873+0000","last_active":"2024-04-25T09:01:03.237722+0000","last_peered":"2024-04-25T09:01:03.237722+0000","last_clean":"2024-04-25T09:01:03.237722+0000","last_became_active":"2024-04-25T09:01:02.240607+0000","last_became_peered":"2024-04-25T09:01:02.240607+0000","last_unstale":"2024-04-25T09:01:03.237722+0000","last_undegraded":"2024-04-25T09:01:03.237722+0000","last_fullsized":"2024-04-25T09:01:03.237722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:25.063795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235763+0000","last_change":"2024-04-25T09:01:01.231724+0000","last_active":"2024-04-25T09:01:03.235763+0000","last_peered":"2024-04-25T09:01:03.235763+0000","last_clean":"2024-04-25T09:01:03.235763+0000","last_became_active":"2024-04-25T09:01:01.231424+0000","last_became_peered":"2024-04-25T09:01:01.231424+0000","last_unstale":"2024-04-25T09:01:03.235763+0000","last_undegraded":"2024-04-25T09:01:03.235763+0000","last_fullsized":"2024-04-25T09:01:03.235763+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:28.853580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230544+0000","last_change":"2024-04-25T09:01:02.229439+0000","last_active":"2024-04-25T09:01:03.230544+0000","last_peered":"2024-04-25T09:01:03.230544+0000","last_clean":"2024-04-25T09:01:03.230544+0000","last_became_active":"2024-04-25T09:01:02.228855+0000","last_became_peered":"2024-04-25T09:01:02.228855+0000","last_unstale":"2024-04-25T09:01:03.230544+0000","last_undegraded":"2024-04-25T09:01:03.230544+0000","last_fullsized":"2024-04-25T09:01:03.230544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:54.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709815+0000","last_change":"2024-04-25T09:01:01.236893+0000","last_active":"2024-04-25T09:01:03.709815+0000","last_peered":"2024-04-25T09:01:03.709815+0000","last_clean":"2024-04-25T09:01:03.709815+0000","last_became_active":"2024-04-25T09:01:01.236494+0000","last_became_peered":"2024-04-25T09:01:01.236494+0000","last_unstale":"2024-04-25T09:01:03.709815+0000","last_undegraded":"2024-04-25T09:01:03.709815+0000","last_fullsized":"2024-04-25T09:01:03.709815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:05.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710216+0000","last_change":"2024-04-25T09:01:02.239548+0000","last_active":"2024-04-25T09:01:03.710216+0000","last_peered":"2024-04-25T09:01:03.710216+0000","last_clean":"2024-04-25T09:01:03.710216+0000","last_became_active":"2024-04-25T09:01:02.238889+0000","last_became_peered":"2024-04-25T09:01:02.238889+0000","last_unstale":"2024-04-25T09:01:03.710216+0000","last_undegraded":"2024-04-25T09:01:03.710216+0000","last_fullsized":"2024-04-25T09:01:03.710216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:12.186343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233349+0000","last_change":"2024-04-25T09:01:01.235551+0000","last_active":"2024-04-25T09:01:03.233349+0000","last_peered":"2024-04-25T09:01:03.233349+0000","last_clean":"2024-04-25T09:01:03.233349+0000","last_became_active":"2024-04-25T09:01:01.234355+0000","last_became_peered":"2024-04-25T09:01:01.234355+0000","last_unstale":"2024-04-25T09:01:03.233349+0000","last_undegraded":"2024-04-25T09:01:03.233349+0000","last_fullsized":"2024-04-25T09:01:03.233349+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:17.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232688+0000","last_change":"2024-04-25T09:01:02.242330+0000","last_active":"2024-04-25T09:01:03.232688+0000","last_peered":"2024-04-25T09:01:03.232688+0000","last_clean":"2024-04-25T09:01:03.232688+0000","last_became_active":"2024-04-25T09:01:02.241627+0000","last_became_peered":"2024-04-25T09:01:02.241627+0000","last_unstale":"2024-04-25T09:01:03.232688+0000","last_undegraded":"2024-04-25T09:01:03.232688+0000","last_fullsized":"2024-04-25T09:01:03.232688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:24.278830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710279+0000","last_change":"2024-04-25T09:01:01.234423+0000","last_active":"2024-04-25T09:01:03.710279+0000","last_peered":"2024-04-25T09:01:03.710279+0000","last_clean":"2024-04-25T09:01:03.710279+0000","last_became_active":"2024-04-25T09:01:01.234153+0000","last_became_peered":"2024-04-25T09:01:01.234153+0000","last_unstale":"2024-04-25T09:01:03.710279+0000","last_undegraded":"2024-04-25T09:01:03.710279+0000","last_fullsized":"2024-04-25T09:01:03.710279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:07.686646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709874+0000","last_change":"2024-04-25T09:01:02.245308+0000","last_active":"2024-04-25T09:01:03.709874+0000","last_peered":"2024-04-25T09:01:03.709874+0000","last_clean":"2024-04-25T09:01:03.709874+0000","last_became_active":"2024-04-25T09:01:02.241555+0000","last_became_peered":"2024-04-25T09:01:02.241555+0000","last_unstale":"2024-04-25T09:01:03.709874+0000","last_undegraded":"2024-04-25T09:01:03.709874+0000","last_fullsized":"2024-04-25T09:01:03.709874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:44.080726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233189+0000","last_change":"2024-04-25T09:01:01.233697+0000","last_active":"2024-04-25T09:01:03.233189+0000","last_peered":"2024-04-25T09:01:03.233189+0000","last_clean":"2024-04-25T09:01:03.233189+0000","last_became_active":"2024-04-25T09:01:01.233426+0000","last_became_peered":"2024-04-25T09:01:01.233426+0000","last_unstale":"2024-04-25T09:01:03.233189+0000","last_undegraded":"2024-04-25T09:01:03.233189+0000","last_fullsized":"2024-04-25T09:01:03.233189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:16.549011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230682+0000","last_change":"2024-04-25T09:01:02.239593+0000","last_active":"2024-04-25T09:01:03.230682+0000","last_peered":"2024-04-25T09:01:03.230682+0000","last_clean":"2024-04-25T09:01:03.230682+0000","last_became_active":"2024-04-25T09:01:02.239276+0000","last_became_peered":"2024-04-25T09:01:02.239276+0000","last_unstale":"2024-04-25T09:01:03.230682+0000","last_undegraded":"2024-04-25T09:01:03.230682+0000","last_fullsized":"2024-04-25T09:01:03.230682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:30.720924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232109+0000","last_change":"2024-04-25T09:01:01.240177+0000","last_active":"2024-04-25T09:01:03.232109+0000","last_peered":"2024-04-25T09:01:03.232109+0000","last_clean":"2024-04-25T09:01:03.232109+0000","last_became_active":"2024-04-25T09:01:01.239854+0000","last_became_peered":"2024-04-25T09:01:01.239854+0000","last_unstale":"2024-04-25T09:01:03.232109+0000","last_undegraded":"2024-04-25T09:01:03.232109+0000","last_fullsized":"2024-04-25T09:01:03.232109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:46.866368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675303+0000","last_change":"2024-04-25T09:01:02.232120+0000","last_active":"2024-04-25T09:01:03.675303+0000","last_peered":"2024-04-25T09:01:03.675303+0000","last_clean":"2024-04-25T09:01:03.675303+0000","last_became_active":"2024-04-25T09:01:02.231842+0000","last_became_peered":"2024-04-25T09:01:02.231842+0000","last_unstale":"2024-04-25T09:01:03.675303+0000","last_undegraded":"2024-04-25T09:01:03.675303+0000","last_fullsized":"2024-04-25T09:01:03.675303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:19.259759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232439+0000","last_change":"2024-04-25T09:01:01.234455+0000","last_active":"2024-04-25T09:01:03.232439+0000","last_peered":"2024-04-25T09:01:03.232439+0000","last_clean":"2024-04-25T09:01:03.232439+0000","last_became_active":"2024-04-25T09:01:01.234104+0000","last_became_peered":"2024-04-25T09:01:01.234104+0000","last_unstale":"2024-04-25T09:01:03.232439+0000","last_undegraded":"2024-04-25T09:01:03.232439+0000","last_fullsized":"2024-04-25T09:01:03.232439+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:43.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675227+0000","last_change":"2024-04-25T09:01:02.239157+0000","last_active":"2024-04-25T09:01:03.675227+0000","last_peered":"2024-04-25T09:01:03.675227+0000","last_clean":"2024-04-25T09:01:03.675227+0000","last_became_active":"2024-04-25T09:01:02.238826+0000","last_became_peered":"2024-04-25T09:01:02.238826+0000","last_unstale":"2024-04-25T09:01:03.675227+0000","last_undegraded":"2024-04-25T09:01:03.675227+0000","last_fullsized":"2024-04-25T09:01:03.675227+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:55.407185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235898+0000","last_change":"2024-04-25T09:01:01.236375+0000","last_active":"2024-04-25T09:01:03.235898+0000","last_peered":"2024-04-25T09:01:03.235898+0000","last_clean":"2024-04-25T09:01:03.235898+0000","last_became_active":"2024-04-25T09:01:01.236074+0000","last_became_peered":"2024-04-25T09:01:01.236074+0000","last_unstale":"2024-04-25T09:01:03.235898+0000","last_undegraded":"2024-04-25T09:01:03.235898+0000","last_fullsized":"2024-04-25T09:01:03.235898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:46.866368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675238+0000","last_change":"2024-04-25T09:01:02.234819+0000","last_active":"2024-04-25T09:01:03.675238+0000","last_peered":"2024-04-25T09:01:03.675238+0000","last_clean":"2024-04-25T09:01:03.675238+0000","last_became_active":"2024-04-25T09:01:02.234528+0000","last_became_peered":"2024-04-25T09:01:02.234528+0000","last_unstale":"2024-04-25T09:01:03.675238+0000","last_undegraded":"2024-04-25T09:01:03.675238+0000","last_fullsized":"2024-04-25T09:01:03.675238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:48.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237649+0000","last_change":"2024-04-25T09:01:01.236938+0000","last_active":"2024-04-25T09:01:03.237649+0000","last_peered":"2024-04-25T09:01:03.237649+0000","last_clean":"2024-04-25T09:01:03.237649+0000","last_became_active":"2024-04-25T09:01:01.236641+0000","last_became_peered":"2024-04-25T09:01:01.236641+0000","last_unstale":"2024-04-25T09:01:03.237649+0000","last_undegraded":"2024-04-25T09:01:03.237649+0000","last_fullsized":"2024-04-25T09:01:03.237649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:11.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237910+0000","last_change":"2024-04-25T09:01:02.243450+0000","last_active":"2024-04-25T09:01:03.237910+0000","last_peered":"2024-04-25T09:01:03.237910+0000","last_clean":"2024-04-25T09:01:03.237910+0000","last_became_active":"2024-04-25T09:01:02.241708+0000","last_became_peered":"2024-04-25T09:01:02.241708+0000","last_unstale":"2024-04-25T09:01:03.237910+0000","last_undegraded":"2024-04-25T09:01:03.237910+0000","last_fullsized":"2024-04-25T09:01:03.237910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:57.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233427+0000","last_change":"2024-04-25T09:01:01.234642+0000","last_active":"2024-04-25T09:01:03.233427+0000","last_peered":"2024-04-25T09:01:03.233427+0000","last_clean":"2024-04-25T09:01:03.233427+0000","last_became_active":"2024-04-25T09:01:01.233993+0000","last_became_peered":"2024-04-25T09:01:01.233993+0000","last_unstale":"2024-04-25T09:01:03.233427+0000","last_undegraded":"2024-04-25T09:01:03.233427+0000","last_fullsized":"2024-04-25T09:01:03.233427+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:33.004190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236172+0000","last_change":"2024-04-25T09:01:02.239651+0000","last_active":"2024-04-25T09:01:03.236172+0000","last_peered":"2024-04-25T09:01:03.236172+0000","last_clean":"2024-04-25T09:01:03.236172+0000","last_became_active":"2024-04-25T09:01:02.239344+0000","last_became_peered":"2024-04-25T09:01:02.239344+0000","last_unstale":"2024-04-25T09:01:03.236172+0000","last_undegraded":"2024-04-25T09:01:03.236172+0000","last_fullsized":"2024-04-25T09:01:03.236172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:52.141638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236187+0000","last_change":"2024-04-25T09:01:01.230328+0000","last_active":"2024-04-25T09:01:03.236187+0000","last_peered":"2024-04-25T09:01:03.236187+0000","last_clean":"2024-04-25T09:01:03.236187+0000","last_became_active":"2024-04-25T09:01:01.230056+0000","last_became_peered":"2024-04-25T09:01:01.230056+0000","last_unstale":"2024-04-25T09:01:03.236187+0000","last_undegraded":"2024-04-25T09:01:03.236187+0000","last_fullsized":"2024-04-25T09:01:03.236187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:24.061944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232002+0000","last_change":"2024-04-25T09:01:02.234567+0000","last_active":"2024-04-25T09:01:03.232002+0000","last_peered":"2024-04-25T09:01:03.232002+0000","last_clean":"2024-04-25T09:01:03.232002+0000","last_became_active":"2024-04-25T09:01:02.234286+0000","last_became_peered":"2024-04-25T09:01:02.234286+0000","last_unstale":"2024-04-25T09:01:03.232002+0000","last_undegraded":"2024-04-25T09:01:03.232002+0000","last_fullsized":"2024-04-25T09:01:03.232002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:52.141638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230760+0000","last_change":"2024-04-25T09:01:01.232109+0000","last_active":"2024-04-25T09:01:03.230760+0000","last_peered":"2024-04-25T09:01:03.230760+0000","last_clean":"2024-04-25T09:01:03.230760+0000","last_became_active":"2024-04-25T09:01:01.231725+0000","last_became_peered":"2024-04-25T09:01:01.231725+0000","last_unstale":"2024-04-25T09:01:03.230760+0000","last_undegraded":"2024-04-25T09:01:03.230760+0000","last_fullsized":"2024-04-25T09:01:03.230760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:37.577935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232987+0000","last_change":"2024-04-25T09:01:02.241203+0000","last_active":"2024-04-25T09:01:03.232987+0000","last_peered":"2024-04-25T09:01:03.232987+0000","last_clean":"2024-04-25T09:01:03.232987+0000","last_became_active":"2024-04-25T09:01:02.240910+0000","last_became_peered":"2024-04-25T09:01:02.240910+0000","last_unstale":"2024-04-25T09:01:03.232987+0000","last_undegraded":"2024-04-25T09:01:03.232987+0000","last_fullsized":"2024-04-25T09:01:03.232987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:13.669948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237948+0000","last_change":"2024-04-25T09:01:01.234319+0000","last_active":"2024-04-25T09:01:03.237948+0000","last_peered":"2024-04-25T09:01:03.237948+0000","last_clean":"2024-04-25T09:01:03.237948+0000","last_became_active":"2024-04-25T09:01:01.233929+0000","last_became_peered":"2024-04-25T09:01:01.233929+0000","last_unstale":"2024-04-25T09:01:03.237948+0000","last_undegraded":"2024-04-25T09:01:03.237948+0000","last_fullsized":"2024-04-25T09:01:03.237948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:28.294757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230804+0000","last_change":"2024-04-25T09:01:02.233855+0000","last_active":"2024-04-25T09:01:03.230804+0000","last_peered":"2024-04-25T09:01:03.230804+0000","last_clean":"2024-04-25T09:01:03.230804+0000","last_became_active":"2024-04-25T09:01:02.232082+0000","last_became_peered":"2024-04-25T09:01:02.232082+0000","last_unstale":"2024-04-25T09:01:03.230804+0000","last_undegraded":"2024-04-25T09:01:03.230804+0000","last_fullsized":"2024-04-25T09:01:03.230804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.400591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230513+0000","last_change":"2024-04-25T09:01:01.234998+0000","last_active":"2024-04-25T09:01:03.230513+0000","last_peered":"2024-04-25T09:01:03.230513+0000","last_clean":"2024-04-25T09:01:03.230513+0000","last_became_active":"2024-04-25T09:01:01.234729+0000","last_became_peered":"2024-04-25T09:01:01.234729+0000","last_unstale":"2024-04-25T09:01:03.230513+0000","last_undegraded":"2024-04-25T09:01:03.230513+0000","last_fullsized":"2024-04-25T09:01:03.230513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:00.594465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232181+0000","last_change":"2024-04-25T09:01:02.235805+0000","last_active":"2024-04-25T09:01:03.232181+0000","last_peered":"2024-04-25T09:01:03.232181+0000","last_clean":"2024-04-25T09:01:03.232181+0000","last_became_active":"2024-04-25T09:01:02.235543+0000","last_became_peered":"2024-04-25T09:01:02.235543+0000","last_unstale":"2024-04-25T09:01:03.232181+0000","last_undegraded":"2024-04-25T09:01:03.232181+0000","last_fullsized":"2024-04-25T09:01:03.232181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:52.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709525+0000","last_change":"2024-04-25T09:01:01.233631+0000","last_active":"2024-04-25T09:01:03.709525+0000","last_peered":"2024-04-25T09:01:03.709525+0000","last_clean":"2024-04-25T09:01:03.709525+0000","last_became_active":"2024-04-25T09:01:01.233339+0000","last_became_peered":"2024-04-25T09:01:01.233339+0000","last_unstale":"2024-04-25T09:01:03.709525+0000","last_undegraded":"2024-04-25T09:01:03.709525+0000","last_fullsized":"2024-04-25T09:01:03.709525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:27.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709650+0000","last_change":"2024-04-25T09:01:02.234774+0000","last_active":"2024-04-25T09:01:03.709650+0000","last_peered":"2024-04-25T09:01:03.709650+0000","last_clean":"2024-04-25T09:01:03.709650+0000","last_became_active":"2024-04-25T09:01:02.233995+0000","last_became_peered":"2024-04-25T09:01:02.233995+0000","last_unstale":"2024-04-25T09:01:03.709650+0000","last_undegraded":"2024-04-25T09:01:03.709650+0000","last_fullsized":"2024-04-25T09:01:03.709650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.544752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709726+0000","last_change":"2024-04-25T09:01:01.237715+0000","last_active":"2024-04-25T09:01:03.709726+0000","last_peered":"2024-04-25T09:01:03.709726+0000","last_clean":"2024-04-25T09:01:03.709726+0000","last_became_active":"2024-04-25T09:01:01.237450+0000","last_became_peered":"2024-04-25T09:01:01.237450+0000","last_unstale":"2024-04-25T09:01:03.709726+0000","last_undegraded":"2024-04-25T09:01:03.709726+0000","last_fullsized":"2024-04-25T09:01:03.709726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:43.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231932+0000","last_change":"2024-04-25T09:01:02.235637+0000","last_active":"2024-04-25T09:01:03.231932+0000","last_peered":"2024-04-25T09:01:03.231932+0000","last_clean":"2024-04-25T09:01:03.231932+0000","last_became_active":"2024-04-25T09:01:02.235306+0000","last_became_peered":"2024-04-25T09:01:02.235306+0000","last_unstale":"2024-04-25T09:01:03.231932+0000","last_undegraded":"2024-04-25T09:01:03.231932+0000","last_fullsized":"2024-04-25T09:01:03.231932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:06.188090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232587+0000","last_change":"2024-04-25T09:01:01.232026+0000","last_active":"2024-04-25T09:01:03.232587+0000","last_peered":"2024-04-25T09:01:03.232587+0000","last_clean":"2024-04-25T09:01:03.232587+0000","last_became_active":"2024-04-25T09:01:01.231767+0000","last_became_peered":"2024-04-25T09:01:01.231767+0000","last_unstale":"2024-04-25T09:01:03.232587+0000","last_undegraded":"2024-04-25T09:01:03.232587+0000","last_fullsized":"2024-04-25T09:01:03.232587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.542901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675330+0000","last_change":"2024-04-25T09:01:02.239893+0000","last_active":"2024-04-25T09:01:03.675330+0000","last_peered":"2024-04-25T09:01:03.675330+0000","last_clean":"2024-04-25T09:01:03.675330+0000","last_became_active":"2024-04-25T09:01:02.239557+0000","last_became_peered":"2024-04-25T09:01:02.239557+0000","last_unstale":"2024-04-25T09:01:03.675330+0000","last_undegraded":"2024-04-25T09:01:03.675330+0000","last_fullsized":"2024-04-25T09:01:03.675330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:34.936437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232074+0000","last_change":"2024-04-25T09:01:01.238350+0000","last_active":"2024-04-25T09:01:03.232074+0000","last_peered":"2024-04-25T09:01:03.232074+0000","last_clean":"2024-04-25T09:01:03.232074+0000","last_became_active":"2024-04-25T09:01:01.237873+0000","last_became_peered":"2024-04-25T09:01:01.237873+0000","last_unstale":"2024-04-25T09:01:03.232074+0000","last_undegraded":"2024-04-25T09:01:03.232074+0000","last_fullsized":"2024-04-25T09:01:03.232074+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:16:28.445313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231402+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:01:03.231402+0000","last_peered":"2024-04-25T09:01:03.231402+0000","last_clean":"2024-04-25T09:01:03.231402+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:01:03.231402+0000","last_undegraded":"2024-04-25T09:01:03.231402+0000","last_fullsized":"2024-04-25T09:01:03.231402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":1490944,"data_stored":969320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":378428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":892928,"data_stored":378426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331464,"statfs":{"total":96636764160,"available":96595419136,"internally_reserved":0,"allocated":892928,"data_stored":378406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44544,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327296,"statfs":{"total":96636764160,"available":96591151104,"internally_reserved":0,"allocated":897024,"data_stored":378448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40388,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331452,"statfs":{"total":96636764160,"available":96595406848,"internally_reserved":0,"allocated":901120,"data_stored":379948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44552,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327288,"statfs":{"total":96636764160,"available":96591142912,"internally_reserved":0,"allocated":909312,"data_stored":380564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36788,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335052,"statfs":{"total":96636764160,"available":96599093248,"internally_reserved":0,"allocated":1482752,"data_stored":968704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:07.885 INFO:tasks.ceph.mds.d.smithi080.stderr:2024-04-25T09:01:07.896+0000 7f31e49c3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:01:09.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.848+0000 7f78a530a640 1 Processor -- start 2024-04-25T09:01:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.848+0000 7f78a530a640 1 -- start start 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f78a530a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78a00d3990 0x7f78a00d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f78a530a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78a00b6f50 0x7f78a00b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f78a530a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00b29c0 con 0x7f78a015e0a0 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f78a530a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a00d4330 con 0x7f78a00b6f50 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f78a530a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a00d1460 con 0x7f78a00d3990 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f789effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f78a015e0a0 0x7f78a00d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37914/0 (socket says 172.21.15.5:37914) 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f789effd640 1 -- 172.21.15.5:0/987095534 learned_addr learned my addr 172.21.15.5:0/987095534 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f789f7fe640 1 --2- 172.21.15.5:0/987095534 >> v2:172.21.15.5:3300/0 conn(0x7f78a00b6f50 0x7f78a00b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.849+0000 7f7897fff640 1 --2- 172.21.15.5:0/987095534 >> v2:172.21.15.80:3300/0 conn(0x7f78a00d3990 0x7f78a00d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.850+0000 7f789e7fc640 1 -- 172.21.15.5:0/987095534 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774416854 0 0) 0x7f78a00b29c0 con 0x7f78a015e0a0 2024-04-25T09:01:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.850+0000 7f789e7fc640 1 -- 172.21.15.5:0/987095534 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f788c003520 con 0x7f78a015e0a0 2024-04-25T09:01:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.850+0000 7f789f7fe640 1 -- 172.21.15.5:0/987095534 >> v2:172.21.15.80:3300/0 conn(0x7f78a00d3990 msgr2=0x7f78a00d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.850+0000 7f789f7fe640 1 --2- 172.21.15.5:0/987095534 >> v2:172.21.15.80:3300/0 conn(0x7f78a00d3990 0x7f78a00d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.850+0000 7f789f7fe640 1 -- 172.21.15.5:0/987095534 >> v1:172.21.15.5:6789/0 conn(0x7f78a015e0a0 legacy=0x7f78a00d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.850+0000 7f789f7fe640 1 -- 172.21.15.5:0/987095534 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a00d2080 con 0x7f78a00b6f50 2024-04-25T09:01:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.850+0000 7f789f7fe640 1 --2- 172.21.15.5:0/987095534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00b6f50 0x7f78a00b73e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f78a00676e0 tx=0x7f789802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaefd6a9a4308c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f789e7fc640 1 -- 172.21.15.5:0/987095534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898007740 con 0x7f78a00b6f50 2024-04-25T09:01:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f789e7fc640 1 -- 172.21.15.5:0/987095534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78980078e0 con 0x7f78a00b6f50 2024-04-25T09:01:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f789e7fc640 1 -- 172.21.15.5:0/987095534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898007cb0 con 0x7f78a00b6f50 2024-04-25T09:01:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 -- 172.21.15.5:0/987095534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00b6f50 msgr2=0x7f78a00b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 --2- 172.21.15.5:0/987095534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00b6f50 0x7f78a00b73e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f78a00676e0 tx=0x7f789802a680 comp rx=0 tx=0).stop 2024-04-25T09:01:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 -- 172.21.15.5:0/987095534 shutdown_connections 2024-04-25T09:01:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 --2- 172.21.15.5:0/987095534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00b6f50 0x7f78a00b73e0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 --2- 172.21.15.5:0/987095534 >> v2:172.21.15.80:3300/0 conn(0x7f78a00d3990 0x7f78a00d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 -- 172.21.15.5:0/987095534 >> 172.21.15.5:0/987095534 conn(0x7f78a00668f0 msgr2=0x7f78a0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 -- 172.21.15.5:0/987095534 shutdown_connections 2024-04-25T09:01:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.851+0000 7f78a530a640 1 -- 172.21.15.5:0/987095534 wait complete. 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.852+0000 7f78a530a640 1 Processor -- start 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f78a530a640 1 -- start start 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f78a530a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78a00b6f50 0x7f78a014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f78a530a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00d3990 0x7f78a014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f78a530a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a015e0a0 0x7f78a00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f78a530a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00d2920 con 0x7f78a00d3990 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f78a530a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00d2640 con 0x7f78a015e0a0 2024-04-25T09:01:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f78a530a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00d2c00 con 0x7f78a00b6f50 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f7897fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00d3990 0x7f78a014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f7897fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00d3990 0x7f78a014c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55398/0 (socket says 172.21.15.5:55398) 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.853+0000 7f7897fff640 1 -- 172.21.15.5:0/1489687580 learned_addr learned my addr 172.21.15.5:0/1489687580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f789f7fe640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a015e0a0 0x7f78a00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f789effd640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78a00b6f50 0x7f78a014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f7897fff640 1 -- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78a00b6f50 msgr2=0x7f78a014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f7897fff640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78a00b6f50 0x7f78a014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f7897fff640 1 -- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a015e0a0 msgr2=0x7f78a00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f7897fff640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a015e0a0 0x7f78a00b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f7897fff640 1 -- 172.21.15.5:0/1489687580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a014de60 con 0x7f78a00d3990 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f789f7fe640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a015e0a0 0x7f78a00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f789effd640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78a00b6f50 0x7f78a014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f7897fff640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00d3990 0x7f78a014c610 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f788800e9b0 tx=0x7f788800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f78977fe640 1 -- 172.21.15.5:0/1489687580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888017070 con 0x7f78a00d3990 2024-04-25T09:01:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f78977fe640 1 -- 172.21.15.5:0/1489687580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788800c9a0 con 0x7f78a00d3990 2024-04-25T09:01:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a00cdc30 con 0x7f78a00d3990 2024-04-25T09:01:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f78977fe640 1 -- 172.21.15.5:0/1489687580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788800cd90 con 0x7f78a00d3990 2024-04-25T09:01:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.854+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a014f290 con 0x7f78a00d3990 2024-04-25T09:01:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.855+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a004ef20 con 0x7f78a00d3990 2024-04-25T09:01:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.856+0000 7f78977fe640 1 -- 172.21.15.5:0/1489687580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f788801a070 con 0x7f78a00d3990 2024-04-25T09:01:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.856+0000 7f78977fe640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f788006b4d0 0x7f788006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.856+0000 7f78977fe640 1 -- 172.21.15.5:0/1489687580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f788808a290 con 0x7f78a00d3990 2024-04-25T09:01:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.857+0000 7f789effd640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f788006b4d0 0x7f788006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.857+0000 7f789effd640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f788006b4d0 0x7f788006d990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7890007fd0 tx=0x7f7890009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:09.861+0000 7f78977fe640 1 -- 172.21.15.5:0/1489687580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7888059070 con 0x7f78a00d3990 2024-04-25T09:01:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.036+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78a01f3be0 con 0x7f788006b4d0 2024-04-25T09:01:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.042+0000 7f78977fe640 1 -- 172.21.15.5:0/1489687580 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252069 (secure 0 0 0) 0x7f78a01f3be0 con 0x7f788006b4d0 2024-04-25T09:01:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:01:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f788006b4d0 msgr2=0x7f788006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f788006b4d0 0x7f788006d990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7890007fd0 tx=0x7f7890009040 comp rx=0 tx=0).stop 2024-04-25T09:01:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00d3990 msgr2=0x7f78a014c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00d3990 0x7f78a014c610 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f788800e9b0 tx=0x7f788800ee70 comp rx=0 tx=0).stop 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 shutdown_connections 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f788006b4d0 0x7f788006d990 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a015e0a0 0x7f78a00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78a00d3990 0x7f78a014c610 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 --2- 172.21.15.5:0/1489687580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78a00b6f50 0x7f78a014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 >> 172.21.15.5:0/1489687580 conn(0x7f78a00668f0 msgr2=0x7f78a00b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 shutdown_connections 2024-04-25T09:01:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.045+0000 7f78a530a640 1 -- 172.21.15.5:0/1489687580 wait complete. 2024-04-25T09:01:10.044 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-25T09:01:08.447722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315892,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754658828,"statfs":{"total":773094113280,"available":772770639872,"internally_reserved":0,"allocated":8364032,"data_stored":4212244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":314953265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.228390"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232348+0000","last_change":"2024-04-25T09:01:02.242774+0000","last_active":"2024-04-25T09:01:03.232348+0000","last_peered":"2024-04-25T09:01:03.232348+0000","last_clean":"2024-04-25T09:01:03.232348+0000","last_became_active":"2024-04-25T09:01:02.242060+0000","last_became_peered":"2024-04-25T09:01:02.242060+0000","last_unstale":"2024-04-25T09:01:03.232348+0000","last_undegraded":"2024-04-25T09:01:03.232348+0000","last_fullsized":"2024-04-25T09:01:03.232348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:33.254570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233406+0000","last_change":"2024-04-25T09:01:02.240234+0000","last_active":"2024-04-25T09:01:03.233406+0000","last_peered":"2024-04-25T09:01:03.233406+0000","last_clean":"2024-04-25T09:01:03.233406+0000","last_became_active":"2024-04-25T09:01:02.237724+0000","last_became_peered":"2024-04-25T09:01:02.237724+0000","last_unstale":"2024-04-25T09:01:03.233406+0000","last_undegraded":"2024-04-25T09:01:03.233406+0000","last_fullsized":"2024-04-25T09:01:03.233406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:12.186343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675395+0000","last_change":"2024-04-25T09:01:02.233941+0000","last_active":"2024-04-25T09:01:03.675395+0000","last_peered":"2024-04-25T09:01:03.675395+0000","last_clean":"2024-04-25T09:01:03.675395+0000","last_became_active":"2024-04-25T09:01:02.233666+0000","last_became_peered":"2024-04-25T09:01:02.233666+0000","last_unstale":"2024-04-25T09:01:03.675395+0000","last_undegraded":"2024-04-25T09:01:03.675395+0000","last_fullsized":"2024-04-25T09:01:03.675395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:44.935107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709740+0000","last_change":"2024-04-25T09:01:02.237556+0000","last_active":"2024-04-25T09:01:03.709740+0000","last_peered":"2024-04-25T09:01:03.709740+0000","last_clean":"2024-04-25T09:01:03.709740+0000","last_became_active":"2024-04-25T09:01:02.237257+0000","last_became_peered":"2024-04-25T09:01:02.237257+0000","last_unstale":"2024-04-25T09:01:03.709740+0000","last_undegraded":"2024-04-25T09:01:03.709740+0000","last_fullsized":"2024-04-25T09:01:03.709740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:47.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230557+0000","last_change":"2024-04-25T09:01:02.236189+0000","last_active":"2024-04-25T09:01:03.230557+0000","last_peered":"2024-04-25T09:01:03.230557+0000","last_clean":"2024-04-25T09:01:03.230557+0000","last_became_active":"2024-04-25T09:01:02.235918+0000","last_became_peered":"2024-04-25T09:01:02.235918+0000","last_unstale":"2024-04-25T09:01:03.230557+0000","last_undegraded":"2024-04-25T09:01:03.230557+0000","last_fullsized":"2024-04-25T09:01:03.230557+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:56.926686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232106+0000","last_change":"2024-04-25T09:01:02.238070+0000","last_active":"2024-04-25T09:01:03.232106+0000","last_peered":"2024-04-25T09:01:03.232106+0000","last_clean":"2024-04-25T09:01:03.232106+0000","last_became_active":"2024-04-25T09:01:02.237699+0000","last_became_peered":"2024-04-25T09:01:02.237699+0000","last_unstale":"2024-04-25T09:01:03.232106+0000","last_undegraded":"2024-04-25T09:01:03.232106+0000","last_fullsized":"2024-04-25T09:01:03.232106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:10.975280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235767+0000","last_change":"2024-04-25T09:01:02.239545+0000","last_active":"2024-04-25T09:01:03.235767+0000","last_peered":"2024-04-25T09:01:03.235767+0000","last_clean":"2024-04-25T09:01:03.235767+0000","last_became_active":"2024-04-25T09:01:02.239271+0000","last_became_peered":"2024-04-25T09:01:02.239271+0000","last_unstale":"2024-04-25T09:01:03.235767+0000","last_undegraded":"2024-04-25T09:01:03.235767+0000","last_fullsized":"2024-04-25T09:01:03.235767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:53.862066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232559+0000","last_change":"2024-04-25T09:01:02.244483+0000","last_active":"2024-04-25T09:01:03.232559+0000","last_peered":"2024-04-25T09:01:03.232559+0000","last_clean":"2024-04-25T09:01:03.232559+0000","last_became_active":"2024-04-25T09:01:02.243277+0000","last_became_peered":"2024-04-25T09:01:02.243277+0000","last_unstale":"2024-04-25T09:01:03.232559+0000","last_undegraded":"2024-04-25T09:01:03.232559+0000","last_fullsized":"2024-04-25T09:01:03.232559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:12.975470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230705+0000","last_change":"2024-04-25T09:01:02.229614+0000","last_active":"2024-04-25T09:01:03.230705+0000","last_peered":"2024-04-25T09:01:03.230705+0000","last_clean":"2024-04-25T09:01:03.230705+0000","last_became_active":"2024-04-25T09:01:02.229333+0000","last_became_peered":"2024-04-25T09:01:02.229333+0000","last_unstale":"2024-04-25T09:01:03.230705+0000","last_undegraded":"2024-04-25T09:01:03.230705+0000","last_fullsized":"2024-04-25T09:01:03.230705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710177+0000","last_change":"2024-04-25T09:01:02.241312+0000","last_active":"2024-04-25T09:01:03.710177+0000","last_peered":"2024-04-25T09:01:03.710177+0000","last_clean":"2024-04-25T09:01:03.710177+0000","last_became_active":"2024-04-25T09:01:02.241014+0000","last_became_peered":"2024-04-25T09:01:02.241014+0000","last_unstale":"2024-04-25T09:01:03.710177+0000","last_undegraded":"2024-04-25T09:01:03.710177+0000","last_fullsized":"2024-04-25T09:01:03.710177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.485174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232674+0000","last_change":"2024-04-25T09:01:02.240607+0000","last_active":"2024-04-25T09:01:03.232674+0000","last_peered":"2024-04-25T09:01:03.232674+0000","last_clean":"2024-04-25T09:01:03.232674+0000","last_became_active":"2024-04-25T09:01:02.239854+0000","last_became_peered":"2024-04-25T09:01:02.239854+0000","last_unstale":"2024-04-25T09:01:03.232674+0000","last_undegraded":"2024-04-25T09:01:03.232674+0000","last_fullsized":"2024-04-25T09:01:03.232674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:01.905698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709783+0000","last_change":"2024-04-25T09:01:02.241855+0000","last_active":"2024-04-25T09:01:03.709783+0000","last_peered":"2024-04-25T09:01:03.709783+0000","last_clean":"2024-04-25T09:01:03.709783+0000","last_became_active":"2024-04-25T09:01:02.241178+0000","last_became_peered":"2024-04-25T09:01:02.241178+0000","last_unstale":"2024-04-25T09:01:03.709783+0000","last_undegraded":"2024-04-25T09:01:03.709783+0000","last_fullsized":"2024-04-25T09:01:03.709783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:54.739659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237910+0000","last_change":"2024-04-25T09:01:02.239982+0000","last_active":"2024-04-25T09:01:03.237910+0000","last_peered":"2024-04-25T09:01:03.237910+0000","last_clean":"2024-04-25T09:01:03.237910+0000","last_became_active":"2024-04-25T09:01:02.239642+0000","last_became_peered":"2024-04-25T09:01:02.239642+0000","last_unstale":"2024-04-25T09:01:03.237910+0000","last_undegraded":"2024-04-25T09:01:03.237910+0000","last_fullsized":"2024-04-25T09:01:03.237910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:44.632145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230789+0000","last_change":"2024-04-25T09:01:02.226238+0000","last_active":"2024-04-25T09:01:03.230789+0000","last_peered":"2024-04-25T09:01:03.230789+0000","last_clean":"2024-04-25T09:01:03.230789+0000","last_became_active":"2024-04-25T09:01:02.225919+0000","last_became_peered":"2024-04-25T09:01:02.225919+0000","last_unstale":"2024-04-25T09:01:03.230789+0000","last_undegraded":"2024-04-25T09:01:03.230789+0000","last_fullsized":"2024-04-25T09:01:03.230789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:51.272565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237759+0000","last_change":"2024-04-25T09:01:02.237124+0000","last_active":"2024-04-25T09:01:03.237759+0000","last_peered":"2024-04-25T09:01:03.237759+0000","last_clean":"2024-04-25T09:01:03.237759+0000","last_became_active":"2024-04-25T09:01:02.236834+0000","last_became_peered":"2024-04-25T09:01:02.236834+0000","last_unstale":"2024-04-25T09:01:03.237759+0000","last_undegraded":"2024-04-25T09:01:03.237759+0000","last_fullsized":"2024-04-25T09:01:03.237759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:58.091375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709847+0000","last_change":"2024-04-25T09:01:02.238563+0000","last_active":"2024-04-25T09:01:03.709847+0000","last_peered":"2024-04-25T09:01:03.709847+0000","last_clean":"2024-04-25T09:01:03.709847+0000","last_became_active":"2024-04-25T09:01:02.238306+0000","last_became_peered":"2024-04-25T09:01:02.238306+0000","last_unstale":"2024-04-25T09:01:03.709847+0000","last_undegraded":"2024-04-25T09:01:03.709847+0000","last_fullsized":"2024-04-25T09:01:03.709847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:52.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230847+0000","last_change":"2024-04-25T09:01:02.230945+0000","last_active":"2024-04-25T09:01:03.230847+0000","last_peered":"2024-04-25T09:01:03.230847+0000","last_clean":"2024-04-25T09:01:03.230847+0000","last_became_active":"2024-04-25T09:01:02.230652+0000","last_became_peered":"2024-04-25T09:01:02.230652+0000","last_unstale":"2024-04-25T09:01:03.230847+0000","last_undegraded":"2024-04-25T09:01:03.230847+0000","last_fullsized":"2024-04-25T09:01:03.230847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:18.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709833+0000","last_change":"2024-04-25T09:01:02.237878+0000","last_active":"2024-04-25T09:01:03.709833+0000","last_peered":"2024-04-25T09:01:03.709833+0000","last_clean":"2024-04-25T09:01:03.709833+0000","last_became_active":"2024-04-25T09:01:02.237605+0000","last_became_peered":"2024-04-25T09:01:02.237605+0000","last_unstale":"2024-04-25T09:01:03.709833+0000","last_undegraded":"2024-04-25T09:01:03.709833+0000","last_fullsized":"2024-04-25T09:01:03.709833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.627006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233140+0000","last_change":"2024-04-25T09:01:02.241819+0000","last_active":"2024-04-25T09:01:03.233140+0000","last_peered":"2024-04-25T09:01:03.233140+0000","last_clean":"2024-04-25T09:01:03.233140+0000","last_became_active":"2024-04-25T09:01:02.241525+0000","last_became_peered":"2024-04-25T09:01:02.241525+0000","last_unstale":"2024-04-25T09:01:03.233140+0000","last_undegraded":"2024-04-25T09:01:03.233140+0000","last_fullsized":"2024-04-25T09:01:03.233140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.485174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237857+0000","last_change":"2024-04-25T09:01:02.240233+0000","last_active":"2024-04-25T09:01:03.237857+0000","last_peered":"2024-04-25T09:01:03.237857+0000","last_clean":"2024-04-25T09:01:03.237857+0000","last_became_active":"2024-04-25T09:01:02.239945+0000","last_became_peered":"2024-04-25T09:01:02.239945+0000","last_unstale":"2024-04-25T09:01:03.237857+0000","last_undegraded":"2024-04-25T09:01:03.237857+0000","last_fullsized":"2024-04-25T09:01:03.237857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:40.397327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709979+0000","last_change":"2024-04-25T09:01:02.236660+0000","last_active":"2024-04-25T09:01:03.709979+0000","last_peered":"2024-04-25T09:01:03.709979+0000","last_clean":"2024-04-25T09:01:03.709979+0000","last_became_active":"2024-04-25T09:01:02.236302+0000","last_became_peered":"2024-04-25T09:01:02.236302+0000","last_unstale":"2024-04-25T09:01:03.709979+0000","last_undegraded":"2024-04-25T09:01:03.709979+0000","last_fullsized":"2024-04-25T09:01:03.709979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:29.296608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709994+0000","last_change":"2024-04-25T09:01:02.226962+0000","last_active":"2024-04-25T09:01:03.709994+0000","last_peered":"2024-04-25T09:01:03.709994+0000","last_clean":"2024-04-25T09:01:03.709994+0000","last_became_active":"2024-04-25T09:01:02.226668+0000","last_became_peered":"2024-04-25T09:01:02.226668+0000","last_unstale":"2024-04-25T09:01:03.709994+0000","last_undegraded":"2024-04-25T09:01:03.709994+0000","last_fullsized":"2024-04-25T09:01:03.709994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:12.975470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231748+0000","last_change":"2024-04-25T09:01:02.240155+0000","last_active":"2024-04-25T09:01:03.231748+0000","last_peered":"2024-04-25T09:01:03.231748+0000","last_clean":"2024-04-25T09:01:03.231748+0000","last_became_active":"2024-04-25T09:01:02.239843+0000","last_became_peered":"2024-04-25T09:01:02.239843+0000","last_unstale":"2024-04-25T09:01:03.231748+0000","last_undegraded":"2024-04-25T09:01:03.231748+0000","last_fullsized":"2024-04-25T09:01:03.231748+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:08.549449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231452+0000","last_change":"2024-04-25T09:01:02.245962+0000","last_active":"2024-04-25T09:01:03.231452+0000","last_peered":"2024-04-25T09:01:03.231452+0000","last_clean":"2024-04-25T09:01:03.231452+0000","last_became_active":"2024-04-25T09:01:02.245522+0000","last_became_peered":"2024-04-25T09:01:02.245522+0000","last_unstale":"2024-04-25T09:01:03.231452+0000","last_undegraded":"2024-04-25T09:01:03.231452+0000","last_fullsized":"2024-04-25T09:01:03.231452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:24.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710156+0000","last_change":"2024-04-25T09:01:02.238054+0000","last_active":"2024-04-25T09:01:03.710156+0000","last_peered":"2024-04-25T09:01:03.710156+0000","last_clean":"2024-04-25T09:01:03.710156+0000","last_became_active":"2024-04-25T09:01:02.237730+0000","last_became_peered":"2024-04-25T09:01:02.237730+0000","last_unstale":"2024-04-25T09:01:03.710156+0000","last_undegraded":"2024-04-25T09:01:03.710156+0000","last_fullsized":"2024-04-25T09:01:03.710156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:25.012053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236076+0000","last_change":"2024-04-25T09:01:02.234521+0000","last_active":"2024-04-25T09:01:03.236076+0000","last_peered":"2024-04-25T09:01:03.236076+0000","last_clean":"2024-04-25T09:01:03.236076+0000","last_became_active":"2024-04-25T09:01:02.234256+0000","last_became_peered":"2024-04-25T09:01:02.234256+0000","last_unstale":"2024-04-25T09:01:03.236076+0000","last_undegraded":"2024-04-25T09:01:03.236076+0000","last_fullsized":"2024-04-25T09:01:03.236076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:08.549449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675436+0000","last_change":"2024-04-25T09:01:02.236458+0000","last_active":"2024-04-25T09:01:03.675436+0000","last_peered":"2024-04-25T09:01:03.675436+0000","last_clean":"2024-04-25T09:01:03.675436+0000","last_became_active":"2024-04-25T09:01:02.236173+0000","last_became_peered":"2024-04-25T09:01:02.236173+0000","last_unstale":"2024-04-25T09:01:03.675436+0000","last_undegraded":"2024-04-25T09:01:03.675436+0000","last_fullsized":"2024-04-25T09:01:03.675436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:58.445886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710244+0000","last_change":"2024-04-25T09:01:02.242519+0000","last_active":"2024-04-25T09:01:03.710244+0000","last_peered":"2024-04-25T09:01:03.710244+0000","last_clean":"2024-04-25T09:01:03.710244+0000","last_became_active":"2024-04-25T09:01:02.241602+0000","last_became_peered":"2024-04-25T09:01:02.241602+0000","last_unstale":"2024-04-25T09:01:03.710244+0000","last_undegraded":"2024-04-25T09:01:03.710244+0000","last_fullsized":"2024-04-25T09:01:03.710244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:15.073398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675392+0000","last_change":"2024-04-25T09:01:02.229077+0000","last_active":"2024-04-25T09:01:03.675392+0000","last_peered":"2024-04-25T09:01:03.675392+0000","last_clean":"2024-04-25T09:01:03.675392+0000","last_became_active":"2024-04-25T09:01:02.228746+0000","last_became_peered":"2024-04-25T09:01:02.228746+0000","last_unstale":"2024-04-25T09:01:03.675392+0000","last_undegraded":"2024-04-25T09:01:03.675392+0000","last_fullsized":"2024-04-25T09:01:03.675392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:37.933057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235828+0000","last_change":"2024-04-25T09:01:02.243391+0000","last_active":"2024-04-25T09:01:03.235828+0000","last_peered":"2024-04-25T09:01:03.235828+0000","last_clean":"2024-04-25T09:01:03.235828+0000","last_became_active":"2024-04-25T09:01:02.243126+0000","last_became_peered":"2024-04-25T09:01:02.243126+0000","last_unstale":"2024-04-25T09:01:03.235828+0000","last_undegraded":"2024-04-25T09:01:03.235828+0000","last_fullsized":"2024-04-25T09:01:03.235828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:10.756232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235961+0000","last_change":"2024-04-25T09:01:02.225401+0000","last_active":"2024-04-25T09:01:03.235961+0000","last_peered":"2024-04-25T09:01:03.235961+0000","last_clean":"2024-04-25T09:01:03.235961+0000","last_became_active":"2024-04-25T09:01:02.225081+0000","last_became_peered":"2024-04-25T09:01:02.225081+0000","last_unstale":"2024-04-25T09:01:03.235961+0000","last_undegraded":"2024-04-25T09:01:03.235961+0000","last_fullsized":"2024-04-25T09:01:03.235961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:50.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232493+0000","last_change":"2024-04-25T09:01:02.236534+0000","last_active":"2024-04-25T09:01:03.232493+0000","last_peered":"2024-04-25T09:01:03.232493+0000","last_clean":"2024-04-25T09:01:03.232493+0000","last_became_active":"2024-04-25T09:01:02.236262+0000","last_became_peered":"2024-04-25T09:01:02.236262+0000","last_unstale":"2024-04-25T09:01:03.232493+0000","last_undegraded":"2024-04-25T09:01:03.232493+0000","last_fullsized":"2024-04-25T09:01:03.232493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:29.296608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231782+0000","last_change":"2024-04-25T09:01:02.247289+0000","last_active":"2024-04-25T09:01:03.231782+0000","last_peered":"2024-04-25T09:01:03.231782+0000","last_clean":"2024-04-25T09:01:03.231782+0000","last_became_active":"2024-04-25T09:01:02.246995+0000","last_became_peered":"2024-04-25T09:01:02.246995+0000","last_unstale":"2024-04-25T09:01:03.231782+0000","last_undegraded":"2024-04-25T09:01:03.231782+0000","last_fullsized":"2024-04-25T09:01:03.231782+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:37.554190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232783+0000","last_change":"2024-04-25T09:01:01.239796+0000","last_active":"2024-04-25T09:01:03.232783+0000","last_peered":"2024-04-25T09:01:03.232783+0000","last_clean":"2024-04-25T09:01:03.232783+0000","last_became_active":"2024-04-25T09:01:01.239418+0000","last_became_peered":"2024-04-25T09:01:01.239418+0000","last_unstale":"2024-04-25T09:01:03.232783+0000","last_undegraded":"2024-04-25T09:01:03.232783+0000","last_fullsized":"2024-04-25T09:01:03.232783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:24.061944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230995+0000","last_change":"2024-04-25T09:01:02.228304+0000","last_active":"2024-04-25T09:01:03.230995+0000","last_peered":"2024-04-25T09:01:03.230995+0000","last_clean":"2024-04-25T09:01:03.230995+0000","last_became_active":"2024-04-25T09:01:02.228024+0000","last_became_peered":"2024-04-25T09:01:02.228024+0000","last_unstale":"2024-04-25T09:01:03.230995+0000","last_undegraded":"2024-04-25T09:01:03.230995+0000","last_fullsized":"2024-04-25T09:01:03.230995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:24.600491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.238023+0000","last_change":"2024-04-25T09:01:01.236292+0000","last_active":"2024-04-25T09:01:03.238023+0000","last_peered":"2024-04-25T09:01:03.238023+0000","last_clean":"2024-04-25T09:01:03.238023+0000","last_became_active":"2024-04-25T09:01:01.235994+0000","last_became_peered":"2024-04-25T09:01:01.235994+0000","last_unstale":"2024-04-25T09:01:03.238023+0000","last_undegraded":"2024-04-25T09:01:03.238023+0000","last_fullsized":"2024-04-25T09:01:03.238023+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:44.366158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233098+0000","last_change":"2024-04-25T09:01:02.234645+0000","last_active":"2024-04-25T09:01:03.233098+0000","last_peered":"2024-04-25T09:01:03.233098+0000","last_clean":"2024-04-25T09:01:03.233098+0000","last_became_active":"2024-04-25T09:01:02.234353+0000","last_became_peered":"2024-04-25T09:01:02.234353+0000","last_unstale":"2024-04-25T09:01:03.233098+0000","last_undegraded":"2024-04-25T09:01:03.233098+0000","last_fullsized":"2024-04-25T09:01:03.233098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:45.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710253+0000","last_change":"2024-04-25T09:01:01.235176+0000","last_active":"2024-04-25T09:01:03.710253+0000","last_peered":"2024-04-25T09:01:03.710253+0000","last_clean":"2024-04-25T09:01:03.710253+0000","last_became_active":"2024-04-25T09:01:01.234875+0000","last_became_peered":"2024-04-25T09:01:01.234875+0000","last_unstale":"2024-04-25T09:01:03.710253+0000","last_undegraded":"2024-04-25T09:01:03.710253+0000","last_fullsized":"2024-04-25T09:01:03.710253+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:45.055232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232833+0000","last_change":"2024-04-25T09:01:02.240387+0000","last_active":"2024-04-25T09:01:03.232833+0000","last_peered":"2024-04-25T09:01:03.232833+0000","last_clean":"2024-04-25T09:01:03.232833+0000","last_became_active":"2024-04-25T09:01:02.239493+0000","last_became_peered":"2024-04-25T09:01:02.239493+0000","last_unstale":"2024-04-25T09:01:03.232833+0000","last_undegraded":"2024-04-25T09:01:03.232833+0000","last_fullsized":"2024-04-25T09:01:03.232833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:10.616428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233224+0000","last_change":"2024-04-25T09:01:01.234022+0000","last_active":"2024-04-25T09:01:03.233224+0000","last_peered":"2024-04-25T09:01:03.233224+0000","last_clean":"2024-04-25T09:01:03.233224+0000","last_became_active":"2024-04-25T09:01:01.233403+0000","last_became_peered":"2024-04-25T09:01:01.233403+0000","last_unstale":"2024-04-25T09:01:03.233224+0000","last_undegraded":"2024-04-25T09:01:03.233224+0000","last_fullsized":"2024-04-25T09:01:03.233224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:23.598640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235984+0000","last_change":"2024-04-25T09:01:02.230205+0000","last_active":"2024-04-25T09:01:03.235984+0000","last_peered":"2024-04-25T09:01:03.235984+0000","last_clean":"2024-04-25T09:01:03.235984+0000","last_became_active":"2024-04-25T09:01:02.229943+0000","last_became_peered":"2024-04-25T09:01:02.229943+0000","last_unstale":"2024-04-25T09:01:03.235984+0000","last_undegraded":"2024-04-25T09:01:03.235984+0000","last_fullsized":"2024-04-25T09:01:03.235984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:24.823228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675474+0000","last_change":"2024-04-25T09:01:01.229650+0000","last_active":"2024-04-25T09:01:03.675474+0000","last_peered":"2024-04-25T09:01:03.675474+0000","last_clean":"2024-04-25T09:01:03.675474+0000","last_became_active":"2024-04-25T09:01:01.229258+0000","last_became_peered":"2024-04-25T09:01:01.229258+0000","last_unstale":"2024-04-25T09:01:03.675474+0000","last_undegraded":"2024-04-25T09:01:03.675474+0000","last_fullsized":"2024-04-25T09:01:03.675474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:00.903847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710109+0000","last_change":"2024-04-25T09:01:02.237801+0000","last_active":"2024-04-25T09:01:03.710109+0000","last_peered":"2024-04-25T09:01:03.710109+0000","last_clean":"2024-04-25T09:01:03.710109+0000","last_became_active":"2024-04-25T09:01:02.237543+0000","last_became_peered":"2024-04-25T09:01:02.237543+0000","last_unstale":"2024-04-25T09:01:03.710109+0000","last_undegraded":"2024-04-25T09:01:03.710109+0000","last_fullsized":"2024-04-25T09:01:03.710109+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:45.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232226+0000","last_change":"2024-04-25T09:01:01.234016+0000","last_active":"2024-04-25T09:01:03.232226+0000","last_peered":"2024-04-25T09:01:03.232226+0000","last_clean":"2024-04-25T09:01:03.232226+0000","last_became_active":"2024-04-25T09:01:01.233595+0000","last_became_peered":"2024-04-25T09:01:01.233595+0000","last_unstale":"2024-04-25T09:01:03.232226+0000","last_undegraded":"2024-04-25T09:01:03.232226+0000","last_fullsized":"2024-04-25T09:01:03.232226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:53.737808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230406+0000","last_change":"2024-04-25T09:01:02.234654+0000","last_active":"2024-04-25T09:01:03.230406+0000","last_peered":"2024-04-25T09:01:03.230406+0000","last_clean":"2024-04-25T09:01:03.230406+0000","last_became_active":"2024-04-25T09:01:02.234369+0000","last_became_peered":"2024-04-25T09:01:02.234369+0000","last_unstale":"2024-04-25T09:01:03.230406+0000","last_undegraded":"2024-04-25T09:01:03.230406+0000","last_fullsized":"2024-04-25T09:01:03.230406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.211430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709560+0000","last_change":"2024-04-25T09:01:01.230135+0000","last_active":"2024-04-25T09:01:03.709560+0000","last_peered":"2024-04-25T09:01:03.709560+0000","last_clean":"2024-04-25T09:01:03.709560+0000","last_became_active":"2024-04-25T09:01:01.229853+0000","last_became_peered":"2024-04-25T09:01:01.229853+0000","last_unstale":"2024-04-25T09:01:03.709560+0000","last_undegraded":"2024-04-25T09:01:03.709560+0000","last_fullsized":"2024-04-25T09:01:03.709560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:29.719073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237807+0000","last_change":"2024-04-25T09:01:02.235669+0000","last_active":"2024-04-25T09:01:03.237807+0000","last_peered":"2024-04-25T09:01:03.237807+0000","last_clean":"2024-04-25T09:01:03.237807+0000","last_became_active":"2024-04-25T09:01:02.235386+0000","last_became_peered":"2024-04-25T09:01:02.235386+0000","last_unstale":"2024-04-25T09:01:03.237807+0000","last_undegraded":"2024-04-25T09:01:03.237807+0000","last_fullsized":"2024-04-25T09:01:03.237807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:04.207840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230397+0000","last_change":"2024-04-25T09:01:01.232041+0000","last_active":"2024-04-25T09:01:03.230397+0000","last_peered":"2024-04-25T09:01:03.230397+0000","last_clean":"2024-04-25T09:01:03.230397+0000","last_became_active":"2024-04-25T09:01:01.231752+0000","last_became_peered":"2024-04-25T09:01:01.231752+0000","last_unstale":"2024-04-25T09:01:03.230397+0000","last_undegraded":"2024-04-25T09:01:03.230397+0000","last_fullsized":"2024-04-25T09:01:03.230397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:56.842557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236127+0000","last_change":"2024-04-25T09:01:02.238786+0000","last_active":"2024-04-25T09:01:03.236127+0000","last_peered":"2024-04-25T09:01:03.236127+0000","last_clean":"2024-04-25T09:01:03.236127+0000","last_became_active":"2024-04-25T09:01:02.238537+0000","last_became_peered":"2024-04-25T09:01:02.238537+0000","last_unstale":"2024-04-25T09:01:03.236127+0000","last_undegraded":"2024-04-25T09:01:03.236127+0000","last_fullsized":"2024-04-25T09:01:03.236127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:37.554190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710179+0000","last_change":"2024-04-25T09:01:01.233295+0000","last_active":"2024-04-25T09:01:03.710179+0000","last_peered":"2024-04-25T09:01:03.710179+0000","last_clean":"2024-04-25T09:01:03.710179+0000","last_became_active":"2024-04-25T09:01:01.233010+0000","last_became_peered":"2024-04-25T09:01:01.233010+0000","last_unstale":"2024-04-25T09:01:03.710179+0000","last_undegraded":"2024-04-25T09:01:03.710179+0000","last_fullsized":"2024-04-25T09:01:03.710179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:43.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232534+0000","last_change":"2024-04-25T09:01:02.247892+0000","last_active":"2024-04-25T09:01:03.232534+0000","last_peered":"2024-04-25T09:01:03.232534+0000","last_clean":"2024-04-25T09:01:03.232534+0000","last_became_active":"2024-04-25T09:01:02.247613+0000","last_became_peered":"2024-04-25T09:01:02.247613+0000","last_unstale":"2024-04-25T09:01:03.232534+0000","last_undegraded":"2024-04-25T09:01:03.232534+0000","last_fullsized":"2024-04-25T09:01:03.232534+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:42.531040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233430+0000","last_change":"2024-04-25T09:01:01.238466+0000","last_active":"2024-04-25T09:01:03.233430+0000","last_peered":"2024-04-25T09:01:03.233430+0000","last_clean":"2024-04-25T09:01:03.233430+0000","last_became_active":"2024-04-25T09:01:01.236891+0000","last_became_peered":"2024-04-25T09:01:01.236891+0000","last_unstale":"2024-04-25T09:01:03.233430+0000","last_undegraded":"2024-04-25T09:01:03.233430+0000","last_fullsized":"2024-04-25T09:01:03.233430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:46.750140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233098+0000","last_change":"2024-04-25T09:01:02.239842+0000","last_active":"2024-04-25T09:01:03.233098+0000","last_peered":"2024-04-25T09:01:03.233098+0000","last_clean":"2024-04-25T09:01:03.233098+0000","last_became_active":"2024-04-25T09:01:02.239569+0000","last_became_peered":"2024-04-25T09:01:02.239569+0000","last_unstale":"2024-04-25T09:01:03.233098+0000","last_undegraded":"2024-04-25T09:01:03.233098+0000","last_fullsized":"2024-04-25T09:01:03.233098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:25.012053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675497+0000","last_change":"2024-04-25T09:01:01.227525+0000","last_active":"2024-04-25T09:01:03.675497+0000","last_peered":"2024-04-25T09:01:03.675497+0000","last_clean":"2024-04-25T09:01:03.675497+0000","last_became_active":"2024-04-25T09:01:01.227183+0000","last_became_peered":"2024-04-25T09:01:01.227183+0000","last_unstale":"2024-04-25T09:01:03.675497+0000","last_undegraded":"2024-04-25T09:01:03.675497+0000","last_fullsized":"2024-04-25T09:01:03.675497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:41.529189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230893+0000","last_change":"2024-04-25T09:01:02.233652+0000","last_active":"2024-04-25T09:01:03.230893+0000","last_peered":"2024-04-25T09:01:03.230893+0000","last_clean":"2024-04-25T09:01:03.230893+0000","last_became_active":"2024-04-25T09:01:02.233232+0000","last_became_peered":"2024-04-25T09:01:02.233232+0000","last_unstale":"2024-04-25T09:01:03.230893+0000","last_undegraded":"2024-04-25T09:01:03.230893+0000","last_fullsized":"2024-04-25T09:01:03.230893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:34.006041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709906+0000","last_change":"2024-04-25T09:01:01.235651+0000","last_active":"2024-04-25T09:01:03.709906+0000","last_peered":"2024-04-25T09:01:03.709906+0000","last_clean":"2024-04-25T09:01:03.709906+0000","last_became_active":"2024-04-25T09:01:01.235376+0000","last_became_peered":"2024-04-25T09:01:01.235376+0000","last_unstale":"2024-04-25T09:01:03.709906+0000","last_undegraded":"2024-04-25T09:01:03.709906+0000","last_fullsized":"2024-04-25T09:01:03.709906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.270714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231554+0000","last_change":"2024-04-25T09:01:02.233109+0000","last_active":"2024-04-25T09:01:03.231554+0000","last_peered":"2024-04-25T09:01:03.231554+0000","last_clean":"2024-04-25T09:01:03.231554+0000","last_became_active":"2024-04-25T09:01:02.232820+0000","last_became_peered":"2024-04-25T09:01:02.232820+0000","last_unstale":"2024-04-25T09:01:03.231554+0000","last_undegraded":"2024-04-25T09:01:03.231554+0000","last_fullsized":"2024-04-25T09:01:03.231554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:12.397482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709619+0000","last_change":"2024-04-25T09:01:01.239403+0000","last_active":"2024-04-25T09:01:03.709619+0000","last_peered":"2024-04-25T09:01:03.709619+0000","last_clean":"2024-04-25T09:01:03.709619+0000","last_became_active":"2024-04-25T09:01:01.239077+0000","last_became_peered":"2024-04-25T09:01:01.239077+0000","last_unstale":"2024-04-25T09:01:03.709619+0000","last_undegraded":"2024-04-25T09:01:03.709619+0000","last_fullsized":"2024-04-25T09:01:03.709619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:19.398741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235989+0000","last_change":"2024-04-25T09:01:02.228050+0000","last_active":"2024-04-25T09:01:03.235989+0000","last_peered":"2024-04-25T09:01:03.235989+0000","last_clean":"2024-04-25T09:01:03.235989+0000","last_became_active":"2024-04-25T09:01:02.227776+0000","last_became_peered":"2024-04-25T09:01:02.227776+0000","last_unstale":"2024-04-25T09:01:03.235989+0000","last_undegraded":"2024-04-25T09:01:03.235989+0000","last_fullsized":"2024-04-25T09:01:03.235989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:12.397482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232333+0000","last_change":"2024-04-25T09:01:01.237737+0000","last_active":"2024-04-25T09:01:03.232333+0000","last_peered":"2024-04-25T09:01:03.232333+0000","last_clean":"2024-04-25T09:01:03.232333+0000","last_became_active":"2024-04-25T09:01:01.236940+0000","last_became_peered":"2024-04-25T09:01:01.236940+0000","last_unstale":"2024-04-25T09:01:03.232333+0000","last_undegraded":"2024-04-25T09:01:03.232333+0000","last_fullsized":"2024-04-25T09:01:03.232333+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.625155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237722+0000","last_change":"2024-04-25T09:01:02.240873+0000","last_active":"2024-04-25T09:01:03.237722+0000","last_peered":"2024-04-25T09:01:03.237722+0000","last_clean":"2024-04-25T09:01:03.237722+0000","last_became_active":"2024-04-25T09:01:02.240607+0000","last_became_peered":"2024-04-25T09:01:02.240607+0000","last_unstale":"2024-04-25T09:01:03.237722+0000","last_undegraded":"2024-04-25T09:01:03.237722+0000","last_fullsized":"2024-04-25T09:01:03.237722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:25.063795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235763+0000","last_change":"2024-04-25T09:01:01.231724+0000","last_active":"2024-04-25T09:01:03.235763+0000","last_peered":"2024-04-25T09:01:03.235763+0000","last_clean":"2024-04-25T09:01:03.235763+0000","last_became_active":"2024-04-25T09:01:01.231424+0000","last_became_peered":"2024-04-25T09:01:01.231424+0000","last_unstale":"2024-04-25T09:01:03.235763+0000","last_undegraded":"2024-04-25T09:01:03.235763+0000","last_fullsized":"2024-04-25T09:01:03.235763+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:28.853580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230544+0000","last_change":"2024-04-25T09:01:02.229439+0000","last_active":"2024-04-25T09:01:03.230544+0000","last_peered":"2024-04-25T09:01:03.230544+0000","last_clean":"2024-04-25T09:01:03.230544+0000","last_became_active":"2024-04-25T09:01:02.228855+0000","last_became_peered":"2024-04-25T09:01:02.228855+0000","last_unstale":"2024-04-25T09:01:03.230544+0000","last_undegraded":"2024-04-25T09:01:03.230544+0000","last_fullsized":"2024-04-25T09:01:03.230544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:54.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709815+0000","last_change":"2024-04-25T09:01:01.236893+0000","last_active":"2024-04-25T09:01:03.709815+0000","last_peered":"2024-04-25T09:01:03.709815+0000","last_clean":"2024-04-25T09:01:03.709815+0000","last_became_active":"2024-04-25T09:01:01.236494+0000","last_became_peered":"2024-04-25T09:01:01.236494+0000","last_unstale":"2024-04-25T09:01:03.709815+0000","last_undegraded":"2024-04-25T09:01:03.709815+0000","last_fullsized":"2024-04-25T09:01:03.709815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:05.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710216+0000","last_change":"2024-04-25T09:01:02.239548+0000","last_active":"2024-04-25T09:01:03.710216+0000","last_peered":"2024-04-25T09:01:03.710216+0000","last_clean":"2024-04-25T09:01:03.710216+0000","last_became_active":"2024-04-25T09:01:02.238889+0000","last_became_peered":"2024-04-25T09:01:02.238889+0000","last_unstale":"2024-04-25T09:01:03.710216+0000","last_undegraded":"2024-04-25T09:01:03.710216+0000","last_fullsized":"2024-04-25T09:01:03.710216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:12.186343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233349+0000","last_change":"2024-04-25T09:01:01.235551+0000","last_active":"2024-04-25T09:01:03.233349+0000","last_peered":"2024-04-25T09:01:03.233349+0000","last_clean":"2024-04-25T09:01:03.233349+0000","last_became_active":"2024-04-25T09:01:01.234355+0000","last_became_peered":"2024-04-25T09:01:01.234355+0000","last_unstale":"2024-04-25T09:01:03.233349+0000","last_undegraded":"2024-04-25T09:01:03.233349+0000","last_fullsized":"2024-04-25T09:01:03.233349+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:17.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232688+0000","last_change":"2024-04-25T09:01:02.242330+0000","last_active":"2024-04-25T09:01:03.232688+0000","last_peered":"2024-04-25T09:01:03.232688+0000","last_clean":"2024-04-25T09:01:03.232688+0000","last_became_active":"2024-04-25T09:01:02.241627+0000","last_became_peered":"2024-04-25T09:01:02.241627+0000","last_unstale":"2024-04-25T09:01:03.232688+0000","last_undegraded":"2024-04-25T09:01:03.232688+0000","last_fullsized":"2024-04-25T09:01:03.232688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:24.278830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.710279+0000","last_change":"2024-04-25T09:01:01.234423+0000","last_active":"2024-04-25T09:01:03.710279+0000","last_peered":"2024-04-25T09:01:03.710279+0000","last_clean":"2024-04-25T09:01:03.710279+0000","last_became_active":"2024-04-25T09:01:01.234153+0000","last_became_peered":"2024-04-25T09:01:01.234153+0000","last_unstale":"2024-04-25T09:01:03.710279+0000","last_undegraded":"2024-04-25T09:01:03.710279+0000","last_fullsized":"2024-04-25T09:01:03.710279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:07.686646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709874+0000","last_change":"2024-04-25T09:01:02.245308+0000","last_active":"2024-04-25T09:01:03.709874+0000","last_peered":"2024-04-25T09:01:03.709874+0000","last_clean":"2024-04-25T09:01:03.709874+0000","last_became_active":"2024-04-25T09:01:02.241555+0000","last_became_peered":"2024-04-25T09:01:02.241555+0000","last_unstale":"2024-04-25T09:01:03.709874+0000","last_undegraded":"2024-04-25T09:01:03.709874+0000","last_fullsized":"2024-04-25T09:01:03.709874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:44.080726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233189+0000","last_change":"2024-04-25T09:01:01.233697+0000","last_active":"2024-04-25T09:01:03.233189+0000","last_peered":"2024-04-25T09:01:03.233189+0000","last_clean":"2024-04-25T09:01:03.233189+0000","last_became_active":"2024-04-25T09:01:01.233426+0000","last_became_peered":"2024-04-25T09:01:01.233426+0000","last_unstale":"2024-04-25T09:01:03.233189+0000","last_undegraded":"2024-04-25T09:01:03.233189+0000","last_fullsized":"2024-04-25T09:01:03.233189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:16.549011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230682+0000","last_change":"2024-04-25T09:01:02.239593+0000","last_active":"2024-04-25T09:01:03.230682+0000","last_peered":"2024-04-25T09:01:03.230682+0000","last_clean":"2024-04-25T09:01:03.230682+0000","last_became_active":"2024-04-25T09:01:02.239276+0000","last_became_peered":"2024-04-25T09:01:02.239276+0000","last_unstale":"2024-04-25T09:01:03.230682+0000","last_undegraded":"2024-04-25T09:01:03.230682+0000","last_fullsized":"2024-04-25T09:01:03.230682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:30.720924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232109+0000","last_change":"2024-04-25T09:01:01.240177+0000","last_active":"2024-04-25T09:01:03.232109+0000","last_peered":"2024-04-25T09:01:03.232109+0000","last_clean":"2024-04-25T09:01:03.232109+0000","last_became_active":"2024-04-25T09:01:01.239854+0000","last_became_peered":"2024-04-25T09:01:01.239854+0000","last_unstale":"2024-04-25T09:01:03.232109+0000","last_undegraded":"2024-04-25T09:01:03.232109+0000","last_fullsized":"2024-04-25T09:01:03.232109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:46.866368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675303+0000","last_change":"2024-04-25T09:01:02.232120+0000","last_active":"2024-04-25T09:01:03.675303+0000","last_peered":"2024-04-25T09:01:03.675303+0000","last_clean":"2024-04-25T09:01:03.675303+0000","last_became_active":"2024-04-25T09:01:02.231842+0000","last_became_peered":"2024-04-25T09:01:02.231842+0000","last_unstale":"2024-04-25T09:01:03.675303+0000","last_undegraded":"2024-04-25T09:01:03.675303+0000","last_fullsized":"2024-04-25T09:01:03.675303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:19.259759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232439+0000","last_change":"2024-04-25T09:01:01.234455+0000","last_active":"2024-04-25T09:01:03.232439+0000","last_peered":"2024-04-25T09:01:03.232439+0000","last_clean":"2024-04-25T09:01:03.232439+0000","last_became_active":"2024-04-25T09:01:01.234104+0000","last_became_peered":"2024-04-25T09:01:01.234104+0000","last_unstale":"2024-04-25T09:01:03.232439+0000","last_undegraded":"2024-04-25T09:01:03.232439+0000","last_fullsized":"2024-04-25T09:01:03.232439+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:43.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675227+0000","last_change":"2024-04-25T09:01:02.239157+0000","last_active":"2024-04-25T09:01:03.675227+0000","last_peered":"2024-04-25T09:01:03.675227+0000","last_clean":"2024-04-25T09:01:03.675227+0000","last_became_active":"2024-04-25T09:01:02.238826+0000","last_became_peered":"2024-04-25T09:01:02.238826+0000","last_unstale":"2024-04-25T09:01:03.675227+0000","last_undegraded":"2024-04-25T09:01:03.675227+0000","last_fullsized":"2024-04-25T09:01:03.675227+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:55.407185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.235898+0000","last_change":"2024-04-25T09:01:01.236375+0000","last_active":"2024-04-25T09:01:03.235898+0000","last_peered":"2024-04-25T09:01:03.235898+0000","last_clean":"2024-04-25T09:01:03.235898+0000","last_became_active":"2024-04-25T09:01:01.236074+0000","last_became_peered":"2024-04-25T09:01:01.236074+0000","last_unstale":"2024-04-25T09:01:03.235898+0000","last_undegraded":"2024-04-25T09:01:03.235898+0000","last_fullsized":"2024-04-25T09:01:03.235898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:46.866368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675238+0000","last_change":"2024-04-25T09:01:02.234819+0000","last_active":"2024-04-25T09:01:03.675238+0000","last_peered":"2024-04-25T09:01:03.675238+0000","last_clean":"2024-04-25T09:01:03.675238+0000","last_became_active":"2024-04-25T09:01:02.234528+0000","last_became_peered":"2024-04-25T09:01:02.234528+0000","last_unstale":"2024-04-25T09:01:03.675238+0000","last_undegraded":"2024-04-25T09:01:03.675238+0000","last_fullsized":"2024-04-25T09:01:03.675238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:48.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237649+0000","last_change":"2024-04-25T09:01:01.236938+0000","last_active":"2024-04-25T09:01:03.237649+0000","last_peered":"2024-04-25T09:01:03.237649+0000","last_clean":"2024-04-25T09:01:03.237649+0000","last_became_active":"2024-04-25T09:01:01.236641+0000","last_became_peered":"2024-04-25T09:01:01.236641+0000","last_unstale":"2024-04-25T09:01:03.237649+0000","last_undegraded":"2024-04-25T09:01:03.237649+0000","last_fullsized":"2024-04-25T09:01:03.237649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:11.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237910+0000","last_change":"2024-04-25T09:01:02.243450+0000","last_active":"2024-04-25T09:01:03.237910+0000","last_peered":"2024-04-25T09:01:03.237910+0000","last_clean":"2024-04-25T09:01:03.237910+0000","last_became_active":"2024-04-25T09:01:02.241708+0000","last_became_peered":"2024-04-25T09:01:02.241708+0000","last_unstale":"2024-04-25T09:01:03.237910+0000","last_undegraded":"2024-04-25T09:01:03.237910+0000","last_fullsized":"2024-04-25T09:01:03.237910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:57.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.233427+0000","last_change":"2024-04-25T09:01:01.234642+0000","last_active":"2024-04-25T09:01:03.233427+0000","last_peered":"2024-04-25T09:01:03.233427+0000","last_clean":"2024-04-25T09:01:03.233427+0000","last_became_active":"2024-04-25T09:01:01.233993+0000","last_became_peered":"2024-04-25T09:01:01.233993+0000","last_unstale":"2024-04-25T09:01:03.233427+0000","last_undegraded":"2024-04-25T09:01:03.233427+0000","last_fullsized":"2024-04-25T09:01:03.233427+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:33.004190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236172+0000","last_change":"2024-04-25T09:01:02.239651+0000","last_active":"2024-04-25T09:01:03.236172+0000","last_peered":"2024-04-25T09:01:03.236172+0000","last_clean":"2024-04-25T09:01:03.236172+0000","last_became_active":"2024-04-25T09:01:02.239344+0000","last_became_peered":"2024-04-25T09:01:02.239344+0000","last_unstale":"2024-04-25T09:01:03.236172+0000","last_undegraded":"2024-04-25T09:01:03.236172+0000","last_fullsized":"2024-04-25T09:01:03.236172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:52.141638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.236187+0000","last_change":"2024-04-25T09:01:01.230328+0000","last_active":"2024-04-25T09:01:03.236187+0000","last_peered":"2024-04-25T09:01:03.236187+0000","last_clean":"2024-04-25T09:01:03.236187+0000","last_became_active":"2024-04-25T09:01:01.230056+0000","last_became_peered":"2024-04-25T09:01:01.230056+0000","last_unstale":"2024-04-25T09:01:03.236187+0000","last_undegraded":"2024-04-25T09:01:03.236187+0000","last_fullsized":"2024-04-25T09:01:03.236187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:24.061944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232002+0000","last_change":"2024-04-25T09:01:02.234567+0000","last_active":"2024-04-25T09:01:03.232002+0000","last_peered":"2024-04-25T09:01:03.232002+0000","last_clean":"2024-04-25T09:01:03.232002+0000","last_became_active":"2024-04-25T09:01:02.234286+0000","last_became_peered":"2024-04-25T09:01:02.234286+0000","last_unstale":"2024-04-25T09:01:03.232002+0000","last_undegraded":"2024-04-25T09:01:03.232002+0000","last_fullsized":"2024-04-25T09:01:03.232002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:52.141638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230760+0000","last_change":"2024-04-25T09:01:01.232109+0000","last_active":"2024-04-25T09:01:03.230760+0000","last_peered":"2024-04-25T09:01:03.230760+0000","last_clean":"2024-04-25T09:01:03.230760+0000","last_became_active":"2024-04-25T09:01:01.231725+0000","last_became_peered":"2024-04-25T09:01:01.231725+0000","last_unstale":"2024-04-25T09:01:03.230760+0000","last_undegraded":"2024-04-25T09:01:03.230760+0000","last_fullsized":"2024-04-25T09:01:03.230760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:37.577935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232987+0000","last_change":"2024-04-25T09:01:02.241203+0000","last_active":"2024-04-25T09:01:03.232987+0000","last_peered":"2024-04-25T09:01:03.232987+0000","last_clean":"2024-04-25T09:01:03.232987+0000","last_became_active":"2024-04-25T09:01:02.240910+0000","last_became_peered":"2024-04-25T09:01:02.240910+0000","last_unstale":"2024-04-25T09:01:03.232987+0000","last_undegraded":"2024-04-25T09:01:03.232987+0000","last_fullsized":"2024-04-25T09:01:03.232987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:13.669948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.237948+0000","last_change":"2024-04-25T09:01:01.234319+0000","last_active":"2024-04-25T09:01:03.237948+0000","last_peered":"2024-04-25T09:01:03.237948+0000","last_clean":"2024-04-25T09:01:03.237948+0000","last_became_active":"2024-04-25T09:01:01.233929+0000","last_became_peered":"2024-04-25T09:01:01.233929+0000","last_unstale":"2024-04-25T09:01:03.237948+0000","last_undegraded":"2024-04-25T09:01:03.237948+0000","last_fullsized":"2024-04-25T09:01:03.237948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:28.294757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230804+0000","last_change":"2024-04-25T09:01:02.233855+0000","last_active":"2024-04-25T09:01:03.230804+0000","last_peered":"2024-04-25T09:01:03.230804+0000","last_clean":"2024-04-25T09:01:03.230804+0000","last_became_active":"2024-04-25T09:01:02.232082+0000","last_became_peered":"2024-04-25T09:01:02.232082+0000","last_unstale":"2024-04-25T09:01:03.230804+0000","last_undegraded":"2024-04-25T09:01:03.230804+0000","last_fullsized":"2024-04-25T09:01:03.230804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.400591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.230513+0000","last_change":"2024-04-25T09:01:01.234998+0000","last_active":"2024-04-25T09:01:03.230513+0000","last_peered":"2024-04-25T09:01:03.230513+0000","last_clean":"2024-04-25T09:01:03.230513+0000","last_became_active":"2024-04-25T09:01:01.234729+0000","last_became_peered":"2024-04-25T09:01:01.234729+0000","last_unstale":"2024-04-25T09:01:03.230513+0000","last_undegraded":"2024-04-25T09:01:03.230513+0000","last_fullsized":"2024-04-25T09:01:03.230513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:00.594465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232181+0000","last_change":"2024-04-25T09:01:02.235805+0000","last_active":"2024-04-25T09:01:03.232181+0000","last_peered":"2024-04-25T09:01:03.232181+0000","last_clean":"2024-04-25T09:01:03.232181+0000","last_became_active":"2024-04-25T09:01:02.235543+0000","last_became_peered":"2024-04-25T09:01:02.235543+0000","last_unstale":"2024-04-25T09:01:03.232181+0000","last_undegraded":"2024-04-25T09:01:03.232181+0000","last_fullsized":"2024-04-25T09:01:03.232181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:52.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709525+0000","last_change":"2024-04-25T09:01:01.233631+0000","last_active":"2024-04-25T09:01:03.709525+0000","last_peered":"2024-04-25T09:01:03.709525+0000","last_clean":"2024-04-25T09:01:03.709525+0000","last_became_active":"2024-04-25T09:01:01.233339+0000","last_became_peered":"2024-04-25T09:01:01.233339+0000","last_unstale":"2024-04-25T09:01:03.709525+0000","last_undegraded":"2024-04-25T09:01:03.709525+0000","last_fullsized":"2024-04-25T09:01:03.709525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:27.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709650+0000","last_change":"2024-04-25T09:01:02.234774+0000","last_active":"2024-04-25T09:01:03.709650+0000","last_peered":"2024-04-25T09:01:03.709650+0000","last_clean":"2024-04-25T09:01:03.709650+0000","last_became_active":"2024-04-25T09:01:02.233995+0000","last_became_peered":"2024-04-25T09:01:02.233995+0000","last_unstale":"2024-04-25T09:01:03.709650+0000","last_undegraded":"2024-04-25T09:01:03.709650+0000","last_fullsized":"2024-04-25T09:01:03.709650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.544752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.709726+0000","last_change":"2024-04-25T09:01:01.237715+0000","last_active":"2024-04-25T09:01:03.709726+0000","last_peered":"2024-04-25T09:01:03.709726+0000","last_clean":"2024-04-25T09:01:03.709726+0000","last_became_active":"2024-04-25T09:01:01.237450+0000","last_became_peered":"2024-04-25T09:01:01.237450+0000","last_unstale":"2024-04-25T09:01:03.709726+0000","last_undegraded":"2024-04-25T09:01:03.709726+0000","last_fullsized":"2024-04-25T09:01:03.709726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:43.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231932+0000","last_change":"2024-04-25T09:01:02.235637+0000","last_active":"2024-04-25T09:01:03.231932+0000","last_peered":"2024-04-25T09:01:03.231932+0000","last_clean":"2024-04-25T09:01:03.231932+0000","last_became_active":"2024-04-25T09:01:02.235306+0000","last_became_peered":"2024-04-25T09:01:02.235306+0000","last_unstale":"2024-04-25T09:01:03.231932+0000","last_undegraded":"2024-04-25T09:01:03.231932+0000","last_fullsized":"2024-04-25T09:01:03.231932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:06.188090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232587+0000","last_change":"2024-04-25T09:01:01.232026+0000","last_active":"2024-04-25T09:01:03.232587+0000","last_peered":"2024-04-25T09:01:03.232587+0000","last_clean":"2024-04-25T09:01:03.232587+0000","last_became_active":"2024-04-25T09:01:01.231767+0000","last_became_peered":"2024-04-25T09:01:01.231767+0000","last_unstale":"2024-04-25T09:01:03.232587+0000","last_undegraded":"2024-04-25T09:01:03.232587+0000","last_fullsized":"2024-04-25T09:01:03.232587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.542901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.675330+0000","last_change":"2024-04-25T09:01:02.239893+0000","last_active":"2024-04-25T09:01:03.675330+0000","last_peered":"2024-04-25T09:01:03.675330+0000","last_clean":"2024-04-25T09:01:03.675330+0000","last_became_active":"2024-04-25T09:01:02.239557+0000","last_became_peered":"2024-04-25T09:01:02.239557+0000","last_unstale":"2024-04-25T09:01:03.675330+0000","last_undegraded":"2024-04-25T09:01:03.675330+0000","last_fullsized":"2024-04-25T09:01:03.675330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:01.211220+0000","last_clean_scrub_stamp":"2024-04-25T09:01:01.211220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:34.936437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.232074+0000","last_change":"2024-04-25T09:01:01.238350+0000","last_active":"2024-04-25T09:01:03.232074+0000","last_peered":"2024-04-25T09:01:03.232074+0000","last_clean":"2024-04-25T09:01:03.232074+0000","last_became_active":"2024-04-25T09:01:01.237873+0000","last_became_peered":"2024-04-25T09:01:01.237873+0000","last_unstale":"2024-04-25T09:01:03.232074+0000","last_undegraded":"2024-04-25T09:01:03.232074+0000","last_fullsized":"2024-04-25T09:01:03.232074+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:00.209369+0000","last_clean_scrub_stamp":"2024-04-25T09:01:00.209369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:16:28.445313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:01:03.231402+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:01:03.231402+0000","last_peered":"2024-04-25T09:01:03.231402+0000","last_clean":"2024-04-25T09:01:03.231402+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:01:03.231402+0000","last_undegraded":"2024-04-25T09:01:03.231402+0000","last_fullsized":"2024-04-25T09:01:03.231402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":1490944,"data_stored":969320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":378428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":892928,"data_stored":378426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331464,"statfs":{"total":96636764160,"available":96595419136,"internally_reserved":0,"allocated":892928,"data_stored":378406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44544,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327296,"statfs":{"total":96636764160,"available":96591151104,"internally_reserved":0,"allocated":897024,"data_stored":378448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40388,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331452,"statfs":{"total":96636764160,"available":96595406848,"internally_reserved":0,"allocated":901120,"data_stored":379948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44552,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327288,"statfs":{"total":96636764160,"available":96591142912,"internally_reserved":0,"allocated":909312,"data_stored":380564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36788,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335052,"statfs":{"total":96636764160,"available":96599093248,"internally_reserved":0,"allocated":1482752,"data_stored":968704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:10.048 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:01:10.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:01:10.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.205+0000 7fbe1a3d5640 1 Processor -- start 2024-04-25T09:01:10.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.205+0000 7fbe1a3d5640 1 -- start start 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe1a3d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe1415aac0 0x7fbe140cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe1a3d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe14071dc0 0x7fbe140ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe1a3d5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe140b3450 con 0x7fbe140cff60 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe1a3d5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe140d03c0 con 0x7fbe1415aac0 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe1a3d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1415aea0 con 0x7fbe14071dc0 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe13fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe1415aac0 0x7fbe140cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe137fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe140cff60 0x7fbe140716b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37922/0 (socket says 172.21.15.5:37922) 2024-04-25T09:01:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe137fe640 1 -- 172.21.15.5:0/140994999 learned_addr learned my addr 172.21.15.5:0/140994999 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe18972640 1 --2- 172.21.15.5:0/140994999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe14071dc0 0x7fbe140ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe13fff640 1 -- 172.21.15.5:0/140994999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe14071dc0 msgr2=0x7fbe140ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe13fff640 1 --2- 172.21.15.5:0/140994999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe14071dc0 0x7fbe140ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe13fff640 1 -- 172.21.15.5:0/140994999 >> v1:172.21.15.5:6789/0 conn(0x7fbe140cff60 legacy=0x7fbe140716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe13fff640 1 -- 172.21.15.5:0/140994999 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140b3730 con 0x7fbe1415aac0 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.206+0000 7fbe12ffd640 1 -- 172.21.15.5:0/140994999 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170367471 0 0) 0x7fbe140b3450 con 0x7fbe140cff60 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.207+0000 7fbe13fff640 1 --2- 172.21.15.5:0/140994999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe140cfa20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097a0 tx=0x7fbe0402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fa03ea7649edae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.207+0000 7fbe12ffd640 1 -- 172.21.15.5:0/140994999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04037070 con 0x7fbe1415aac0 2024-04-25T09:01:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.207+0000 7fbe12ffd640 1 -- 172.21.15.5:0/140994999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04032440 con 0x7fbe1415aac0 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.207+0000 7fbe12ffd640 1 -- 172.21.15.5:0/140994999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04032810 con 0x7fbe1415aac0 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/140994999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 msgr2=0x7fbe140cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/140994999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe140cfa20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097a0 tx=0x7fbe0402a180 comp rx=0 tx=0).stop 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/140994999 shutdown_connections 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/140994999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe14071dc0 0x7fbe140ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/140994999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe140cfa20 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/140994999 >> 172.21.15.5:0/140994999 conn(0x7fbe14066ad0 msgr2=0x7fbe14066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/140994999 shutdown_connections 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.208+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/140994999 wait complete. 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.209+0000 7fbe1a3d5640 1 Processor -- start 2024-04-25T09:01:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.209+0000 7fbe1a3d5640 1 -- start start 2024-04-25T09:01:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe1a3d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe14071dc0 0x7fbe141449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe1a3d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe140cff60 0x7fbe14158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe1a3d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe14158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe1a3d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140b4210 con 0x7fbe1415aac0 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe1a3d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140b3cf0 con 0x7fbe14071dc0 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe1a3d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140ccff0 con 0x7fbe140cff60 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe14158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe14158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55418/0 (socket says 172.21.15.5:55418) 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 -- 172.21.15.5:0/3966049016 learned_addr learned my addr 172.21.15.5:0/3966049016 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe13fff640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe14071dc0 0x7fbe141449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe137fe640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe140cff60 0x7fbe14158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 -- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe140cff60 msgr2=0x7fbe14158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe140cff60 0x7fbe14158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 -- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe14071dc0 msgr2=0x7fbe141449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe14071dc0 0x7fbe141449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 -- 172.21.15.5:0/3966049016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe141453c0 con 0x7fbe1415aac0 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe137fe640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe140cff60 0x7fbe14158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.210+0000 7fbe18972640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe14158580 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007e40 tx=0x7fbe0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.211+0000 7fbe10ff9640 1 -- 172.21.15.5:0/3966049016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c014620 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.211+0000 7fbe10ff9640 1 -- 172.21.15.5:0/3966049016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c019070 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.211+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14148000 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.211+0000 7fbe10ff9640 1 -- 172.21.15.5:0/3966049016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c014a20 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.211+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe14145960 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.212+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe14145b60 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.212+0000 7fbe10ff9640 1 -- 172.21.15.5:0/3966049016 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe0c014bc0 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.213+0000 7fbe10ff9640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe0006b4d0 0x7fbe0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.213+0000 7fbe10ff9640 1 -- 172.21.15.5:0/3966049016 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe0c08aa50 con 0x7fbe1415aac0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.213+0000 7fbe13fff640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe0006b4d0 0x7fbe0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.214+0000 7fbe13fff640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe0006b4d0 0x7fbe0006d990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbe04034000 tx=0x7fbe0402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.217+0000 7fbe10ff9640 1 -- 172.21.15.5:0/3966049016 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe14145b60 con 0x7fbe1415aac0 2024-04-25T09:01:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.468+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbe1404ef20 con 0x7fbe1415aac0 2024-04-25T09:01:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.470+0000 7fbe10ff9640 1 -- 172.21.15.5:0/3966049016 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbe0c0598d0 con 0x7fbe1415aac0 2024-04-25T09:01:10.459 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T09:01:10.459 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T09:01:10.459 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T09:01:10.459 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T09:01:10.459 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:01:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T09:01:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.472+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe0006b4d0 msgr2=0x7fbe0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.472+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe0006b4d0 0x7fbe0006d990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbe04034000 tx=0x7fbe0402e000 comp rx=0 tx=0).stop 2024-04-25T09:01:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 msgr2=0x7fbe14158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe14158580 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007e40 tx=0x7fbe0c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 shutdown_connections 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbe0006b4d0 0x7fbe0006d990 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe1415aac0 0x7fbe14158580 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbe140cff60 0x7fbe14158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 --2- 172.21.15.5:0/3966049016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe14071dc0 0x7fbe141449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 >> 172.21.15.5:0/3966049016 conn(0x7fbe14066ad0 msgr2=0x7fbe1406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 shutdown_connections 2024-04-25T09:01:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.473+0000 7fbe1a3d5640 1 -- 172.21.15.5:0/3966049016 wait complete. 2024-04-25T09:01:10.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.585+0000 7f02c4370640 1 Processor -- start 2024-04-25T09:01:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.585+0000 7f02c4370640 1 -- start start 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c4370640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc0cea80 0x7f02bc15f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c4370640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc15ef10 con 0x7f02bc15fd80 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c4370640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc15f1a0 con 0x7f02bc06bd00 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c4370640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0cfd60 con 0x7f02bc0cea80 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c190b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02bc15fd80 0x7f02bc06b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37928/0 (socket says 172.21.15.5:37928) 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c190b640 1 -- 172.21.15.5:0/1923250188 learned_addr learned my addr 172.21.15.5:0/1923250188 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c210c640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc0cea80 0x7f02bc15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432861730 0 0) 0x7f02bc15ef10 con 0x7f02bc15fd80 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.586+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a8003520 con 0x7f02bc15fd80 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549914759 0 0) 0x7f02bc15f1a0 con 0x7f02bc06bd00 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02bc15ef10 con 0x7f02bc06bd00 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659089156 0 0) 0x7f02a8003520 con 0x7f02bc15fd80 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc0cea80 msgr2=0x7f02bc15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc0cea80 0x7f02bc15f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 >> v1:172.21.15.80:6789/0 conn(0x7f02bc06bd00 legacy=0x7f02bc0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0cff90 con 0x7f02bc15fd80 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f02ac001670 con 0x7f02bc15fd80 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 >> v1:172.21.15.5:6789/0 conn(0x7f02bc15fd80 legacy=0x7f02bc06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a8003b70 0x7f02a8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a8004800 0x7f02a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a80051c0 0x7f02a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800bfb0 con 0x7f02a80051c0 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800c130 con 0x7f02a8003b70 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800c330 con 0x7f02a8004800 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c210c640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc0cea80 0x7f02bc15f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c290d640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a80051c0 0x7f02a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c190b640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a8004800 0x7f02a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c210c640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a8003b70 0x7f02a8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c290d640 1 -- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a8004800 msgr2=0x7f02a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c290d640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a8004800 0x7f02a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c290d640 1 -- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a8003b70 msgr2=0x7f02a8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c290d640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a8003b70 0x7f02a8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c290d640 1 -- 172.21.15.5:0/1923250188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8003520 con 0x7f02a80051c0 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.587+0000 7f02c210c640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a8003b70 0x7f02a8003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.588+0000 7f02c290d640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a80051c0 0x7f02a800b9c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f02b4001f90 tx=0x7f02a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5043cbf7e86e6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.588+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4001be0 con 0x7f02a80051c0 2024-04-25T09:01:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.588+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4003b90 con 0x7f02a80051c0 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.588+0000 7f02c110a640 1 -- 172.21.15.5:0/1923250188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40050d0 con 0x7f02a80051c0 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.589+0000 7f02c4370640 1 -- 172.21.15.5:0/1923250188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a80051c0 msgr2=0x7f02a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.589+0000 7f02c4370640 1 --2- 172.21.15.5:0/1923250188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a80051c0 0x7f02a800b9c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f02b4001f90 tx=0x7f02a8005830 comp rx=0 tx=0).stop 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.589+0000 7f02c290d640 1 -- 172.21.15.5:0/1923250188 reap_dead start 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.589+0000 7f02c4370640 1 -- 172.21.15.5:0/1923250188 shutdown_connections 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.589+0000 7f02c4370640 1 -- 172.21.15.5:0/1923250188 >> 172.21.15.5:0/1923250188 conn(0x7f02bc0d19f0 msgr2=0x7f02bc0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.589+0000 7f02c4370640 1 -- 172.21.15.5:0/1923250188 shutdown_connections 2024-04-25T09:01:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.589+0000 7f02c4370640 1 -- 172.21.15.5:0/1923250188 wait complete. 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.590+0000 7f02c4370640 1 Processor -- start 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.590+0000 7f02c4370640 1 -- start start 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c4370640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a80051c0 0x7f02bc1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c4370640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02bc0b6fe0 0x7f02bc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c4370640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc1571a0 0x7f02bc157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c4370640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0d1660 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c4370640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc15f480 con 0x7f02a80051c0 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c4370640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0d17e0 con 0x7f02bc1571a0 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02bc0b6fe0 0x7f02bc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02bc0b6fe0 0x7f02bc156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55436/0 (socket says 172.21.15.5:55436) 2024-04-25T09:01:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 -- 172.21.15.5:0/1120313296 learned_addr learned my addr 172.21.15.5:0/1120313296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c210c640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a80051c0 0x7f02bc1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c290d640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc1571a0 0x7f02bc157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 -- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc1571a0 msgr2=0x7f02bc157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc1571a0 0x7f02bc157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 -- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a80051c0 msgr2=0x7f02bc1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a80051c0 0x7f02bc1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c190b640 1 -- 172.21.15.5:0/1120313296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0b7460 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.591+0000 7f02c290d640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc1571a0 0x7f02bc157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.592+0000 7f02c190b640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02bc0b6fe0 0x7f02bc156c60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f02ac007340 tx=0x7f02ac007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.592+0000 7f02b2ffd640 1 -- 172.21.15.5:0/1120313296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac001610 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.592+0000 7f02b2ffd640 1 -- 172.21.15.5:0/1120313296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac018070 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.592+0000 7f02b2ffd640 1 -- 172.21.15.5:0/1120313296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00fae0 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.592+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc0b50e0 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.592+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc0b56a0 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.593+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc04ef20 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.593+0000 7f02b2ffd640 1 -- 172.21.15.5:0/1120313296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02ac00fc80 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.594+0000 7f02b2ffd640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a006b4d0 0x7f02a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.594+0000 7f02b2ffd640 1 -- 172.21.15.5:0/1120313296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02ac08a110 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.594+0000 7f02c210c640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a006b4d0 0x7f02a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.594+0000 7f02c210c640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a006b4d0 0x7f02a006d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0b03b0 tx=0x7f02b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.598+0000 7f02b2ffd640 1 -- 172.21.15.5:0/1120313296 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02ac059020 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.815+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02bc0cefa0 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.815+0000 7f02b2ffd640 1 -- 172.21.15.5:0/1120313296 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f02ac058920 con 0x7f02bc0b6fe0 2024-04-25T09:01:10.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:01:10.804 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/551194531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":551194531},{"type":"v1","addr":"172.21.15.5:6835","nonce":551194531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3514707104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3514707104},{"type":"v1","addr":"172.21.15.80:6836","nonce":3514707104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/546123103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":546123103},{"type":"v1","addr":"172.21.15.5:6833","nonce":546123103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:01.584978+0000","modified":"2024-04-25T09:01:03.576248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7038":{"gid":7038,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1546784484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1546784484},{"type":"v1","addr":"172.21.15.80:6837","nonce":1546784484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:01:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 45 2024-04-25T09:01:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a006b4d0 msgr2=0x7f02a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a006b4d0 0x7f02a006d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0b03b0 tx=0x7f02b8008040 comp rx=0 tx=0).stop 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02bc0b6fe0 msgr2=0x7f02bc156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02bc0b6fe0 0x7f02bc156c60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f02ac007340 tx=0x7f02ac007740 comp rx=0 tx=0).stop 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 shutdown_connections 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a006b4d0 0x7f02a006d990 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02bc1571a0 0x7f02bc157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02bc0b6fe0 0x7f02bc156c60 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 --2- 172.21.15.5:0/1120313296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a80051c0 0x7f02bc1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 >> 172.21.15.5:0/1120313296 conn(0x7f02bc0d19f0 msgr2=0x7f02bc156230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 shutdown_connections 2024-04-25T09:01:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:10.817+0000 7f02c4370640 1 -- 172.21.15.5:0/1120313296 wait complete. 2024-04-25T09:01:11.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:01:01.584978+0000', 'modified': '2024-04-25T09:01:03.576248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7038}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7038': {'gid': 7038, 'name': 'd', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/1546784484', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6835', 'nonce': 1546784484}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 1546784484}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:01:11.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:01:11.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:01:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.338+0000 7fcf5bb29640 1 Processor -- start 2024-04-25T09:01:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf5bb29640 1 -- start start 2024-04-25T09:01:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf5bb29640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf5406b7d0 0x7fcf5406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf5bb29640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf5406bbb0 0x7fcf540d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf5bb29640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf540b4730 con 0x7fcf5415da10 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf5bb29640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf540d0b70 con 0x7fcf5406bbb0 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf5bb29640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf540cbf30 con 0x7fcf5406b7d0 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf590c4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf5406bbb0 0x7fcf540d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf590c4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf5406bbb0 0x7fcf540d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35890/0 (socket says 172.21.15.5:35890) 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.339+0000 7fcf590c4640 1 -- 172.21.15.5:0/1773422087 learned_addr learned my addr 172.21.15.5:0/1773422087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.340+0000 7fcf598c5640 1 --2- 172.21.15.5:0/1773422087 >> v2:172.21.15.80:3300/0 conn(0x7fcf5406b7d0 0x7fcf5406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.340+0000 7fcf590c4640 1 -- 172.21.15.5:0/1773422087 >> v2:172.21.15.80:3300/0 conn(0x7fcf5406b7d0 msgr2=0x7fcf5406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.340+0000 7fcf590c4640 1 --2- 172.21.15.5:0/1773422087 >> v2:172.21.15.80:3300/0 conn(0x7fcf5406b7d0 0x7fcf5406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.340+0000 7fcf590c4640 1 -- 172.21.15.5:0/1773422087 >> v1:172.21.15.80:6789/0 conn(0x7fcf5415da10 legacy=0x7fcf5415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.340+0000 7fcf590c4640 1 -- 172.21.15.5:0/1773422087 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf540d0da0 con 0x7fcf5406bbb0 2024-04-25T09:01:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.340+0000 7fcf598c5640 1 --2- 172.21.15.5:0/1773422087 >> v2:172.21.15.80:3300/0 conn(0x7fcf5406b7d0 0x7fcf5406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.340+0000 7fcf590c4640 1 --2- 172.21.15.5:0/1773422087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406bbb0 0x7fcf540d0630 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fcf540b4400 tx=0x7fcf4402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b9003aba9bc249 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf588c3640 1 -- 172.21.15.5:0/1773422087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037070 con 0x7fcf5406bbb0 2024-04-25T09:01:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf588c3640 1 -- 172.21.15.5:0/1773422087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44032440 con 0x7fcf5406bbb0 2024-04-25T09:01:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf588c3640 1 -- 172.21.15.5:0/1773422087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44032810 con 0x7fcf5406bbb0 2024-04-25T09:01:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 -- 172.21.15.5:0/1773422087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406bbb0 msgr2=0x7fcf540d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/1773422087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406bbb0 0x7fcf540d0630 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fcf540b4400 tx=0x7fcf4402a2c0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 -- 172.21.15.5:0/1773422087 shutdown_connections 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/1773422087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406bbb0 0x7fcf540d0630 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/1773422087 >> v2:172.21.15.80:3300/0 conn(0x7fcf5406b7d0 0x7fcf5406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 -- 172.21.15.5:0/1773422087 >> 172.21.15.5:0/1773422087 conn(0x7fcf540d18e0 msgr2=0x7fcf540d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 -- 172.21.15.5:0/1773422087 shutdown_connections 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.341+0000 7fcf5bb29640 1 -- 172.21.15.5:0/1773422087 wait complete. 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.342+0000 7fcf5bb29640 1 Processor -- start 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf5bb29640 1 -- start start 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf5bb29640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406b7d0 0x7fcf540b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf5bb29640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf5406bbb0 0x7fcf5415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf5bb29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5415da10 0x7fcf54152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf5bb29640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf540cc460 con 0x7fcf5406b7d0 2024-04-25T09:01:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf5bb29640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf540cc7d0 con 0x7fcf5415da10 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf5bb29640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf540ccc60 con 0x7fcf5406bbb0 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406b7d0 0x7fcf540b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406b7d0 0x7fcf540b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35902/0 (socket says 172.21.15.5:35902) 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.343+0000 7fcf598c5640 1 -- 172.21.15.5:0/362081382 learned_addr learned my addr 172.21.15.5:0/362081382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf590c4640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf5406bbb0 0x7fcf5415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf5a0c6640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5415da10 0x7fcf54152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf598c5640 1 -- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf5406bbb0 msgr2=0x7fcf5415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf598c5640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf5406bbb0 0x7fcf5415ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf598c5640 1 -- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5415da10 msgr2=0x7fcf54152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf598c5640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5415da10 0x7fcf54152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf598c5640 1 -- 172.21.15.5:0/362081382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5415fb60 con 0x7fcf5406b7d0 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf598c5640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406b7d0 0x7fcf540b6010 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c820 tx=0x7fcf5000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf4a7fc640 1 -- 172.21.15.5:0/362081382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50015070 con 0x7fcf5406b7d0 2024-04-25T09:01:11.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf4a7fc640 1 -- 172.21.15.5:0/362081382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50007a30 con 0x7fcf5406b7d0 2024-04-25T09:01:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf4a7fc640 1 -- 172.21.15.5:0/362081382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50007e00 con 0x7fcf5406b7d0 2024-04-25T09:01:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5415f880 con 0x7fcf5406b7d0 2024-04-25T09:01:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.344+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf54155280 con 0x7fcf5406b7d0 2024-04-25T09:01:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.346+0000 7fcf4a7fc640 1 -- 172.21.15.5:0/362081382 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf50018070 con 0x7fcf5406b7d0 2024-04-25T09:01:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.346+0000 7fcf4a7fc640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf3806b4d0 0x7fcf3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.347+0000 7fcf4a7fc640 1 -- 172.21.15.5:0/362081382 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf5008a0a0 con 0x7fcf5406b7d0 2024-04-25T09:01:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.347+0000 7fcf590c4640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf3806b4d0 0x7fcf3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.347+0000 7fcf590c4640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf3806b4d0 0x7fcf3806d990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcf44034000 tx=0x7fcf4402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.347+0000 7fcf5e82d740 1 Processor -- start 2024-04-25T09:01:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.347+0000 7fcf5e82d740 1 -- start start 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da14610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da32020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3d9e9f10 0x561f3da30190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f3d94ca10 con 0x561f3da14230 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f3d8f5b30 con 0x561f3da31ad0 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f3d948c50 con 0x561f3d9e9f10 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da14610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da14610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35914/0 (socket says 172.21.15.5:35914) 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf598c5640 1 -- 172.21.15.5:0/3498394093 learned_addr learned my addr 172.21.15.5:0/3498394093 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf590c4640 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da32020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.348+0000 7fcf5a0c6640 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3d9e9f10 0x561f3da30190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf598c5640 1 -- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3d9e9f10 msgr2=0x561f3da30190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf598c5640 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3d9e9f10 0x561f3da30190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf598c5640 1 -- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 msgr2=0x561f3da32020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf598c5640 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da32020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf598c5640 1 -- 172.21.15.5:0/3498394093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f3d90ae10 con 0x561f3da14230 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf598c5640 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da14610 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fcf50060a90 tx=0x7fcf5005ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f8e557b751bf69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf377fe640 1 -- 172.21.15.5:0/3498394093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50070020 con 0x561f3da14230 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf377fe640 1 -- 172.21.15.5:0/3498394093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50054fd0 con 0x561f3da14230 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.349+0000 7fcf377fe640 1 -- 172.21.15.5:0/3498394093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5001f040 con 0x561f3da14230 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3498394093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 msgr2=0x561f3da14610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da14610 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fcf50060a90 tx=0x7fcf5005ca00 comp rx=0 tx=0).stop 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3498394093 shutdown_connections 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3d9e9f10 0x561f3da30190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da32020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3498394093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da14610 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3498394093 >> 172.21.15.5:0/3498394093 conn(0x561f3d9e6840 msgr2=0x561f3da2f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3498394093 shutdown_connections 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3498394093 wait complete. 2024-04-25T09:01:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 -- start start 2024-04-25T09:01:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.350+0000 7fcf5e82d740 1 Processor -- start 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da3ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da16fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da174f0 0x561f3da12d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f3d9eacb0 con 0x561f3da14230 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f3d9090c0 con 0x561f3da31ad0 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f3d9e4770 con 0x561f3da174f0 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5e82d740 10 client.0 _ll_register_callbacks cb 0x561f3d8fcec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da3ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da3ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35926/0 (socket says 172.21.15.5:35926) 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf598c5640 1 -- 172.21.15.5:0/3210074656 learned_addr learned my addr 172.21.15.5:0/3210074656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf590c4640 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da16fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.351+0000 7fcf5a0c6640 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da174f0 0x561f3da12d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf598c5640 1 -- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da174f0 msgr2=0x561f3da12d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf598c5640 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da174f0 0x561f3da12d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf598c5640 1 -- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 msgr2=0x561f3da16fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf598c5640 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da16fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf598c5640 1 -- 172.21.15.5:0/3210074656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f3d6612d0 con 0x561f3da14230 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf598c5640 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da3ff60 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fcf50056c10 tx=0x7fcf50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876f15fcfe5ee70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf34ff9640 1 -- 172.21.15.5:0/3210074656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50085030 con 0x561f3da14230 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf34ff9640 1 -- 172.21.15.5:0/3210074656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf50088320 con 0x561f3da14230 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf50054fd0 con 0x561f3da14230 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf34ff9640 1 -- 172.21.15.5:0/3210074656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf50070040 con 0x561f3da14230 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 10 client.7191 fetch_fsmap learned FSMap version 45 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x561f3d72b6b0 con 0x561f3da14230 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf34ff9640 1 -- 172.21.15.5:0/3210074656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50054fd0 con 0x561f3da14230 2024-04-25T09:01:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf34ff9640 1 -- 172.21.15.5:0/3210074656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcf500771a0 con 0x561f3da14230 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 10 client.7191 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 10 client.7191 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 20 client.7191 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da4aef0 0x561f3da4d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 4 client.7191 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.352+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f3d9ab920 con 0x561f3da4aef0 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.353+0000 7fcf590c4640 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da4aef0 0x561f3da4d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.353+0000 7fcf590c4640 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da4aef0 0x561f3da4d2e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=806a5f178d6ad28f server_cookie=a91472b2569cf813 in_seq=0 out_seq=0 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.353+0000 7fcf34ff9640 10 client.7191 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf34ff9640 1 -- 172.21.15.5:0/3210074656 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561f3d9ab920 con 0x561f3da4aef0 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf34ff9640 10 client.7191 handle_command_reply: tid=0 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 client.7191 shutdown 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 msgr2=0x561f3da3ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da3ff60 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fcf50056c10 tx=0x7fcf50000bc0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 shutdown_connections 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da4aef0 0x561f3da4d2e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da174f0 0x561f3da12d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf34ff9640 0 client.7191 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da16fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/3210074656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da3ff60 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 >> 172.21.15.5:0/3210074656 conn(0x561f3d9e9f10 msgr2=0x561f3da325c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 shutdown_connections 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 1 -- 172.21.15.5:0/3210074656 wait complete. 2024-04-25T09:01:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.354+0000 7fcf5e82d740 20 client.7191 trim_cache size 0 max 16384 2024-04-25T09:01:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.370+0000 7fcf5e82d740 1 Processor -- start 2024-04-25T09:01:11.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.370+0000 7fcf5e82d740 1 -- start start 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da174f0 0x561f3da324f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da31ad0 0x561f3da249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf541ff230 con 0x561f3da14230 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf541f7aa0 con 0x561f3da174f0 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf54156620 con 0x561f3da31ad0 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da124d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35930/0 (socket says 172.21.15.5:35930) 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 -- 172.21.15.5:0/1395277222 learned_addr learned my addr 172.21.15.5:0/1395277222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 -- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da31ad0 msgr2=0x561f3da249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da31ad0 0x561f3da249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 -- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da174f0 msgr2=0x561f3da324f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf590c4640 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da174f0 0x561f3da324f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da174f0 0x561f3da324f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 -- 172.21.15.5:0/1395277222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f3da25f20 con 0x561f3da14230 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf590c4640 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da174f0 0x561f3da324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf598c5640 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da124d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fcf50058610 tx=0x7fcf5006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1092cbd768be8572 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf36ffd640 1 -- 172.21.15.5:0/1395277222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50085070 con 0x561f3da14230 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf36ffd640 1 -- 172.21.15.5:0/1395277222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf500703f0 con 0x561f3da14230 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.371+0000 7fcf36ffd640 1 -- 172.21.15.5:0/1395277222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5001f040 con 0x561f3da14230 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 -- 172.21.15.5:0/1395277222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 msgr2=0x561f3da124d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da124d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fcf50058610 tx=0x7fcf5006d000 comp rx=0 tx=0).stop 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 -- 172.21.15.5:0/1395277222 shutdown_connections 2024-04-25T09:01:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da31ad0 0x561f3da249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da174f0 0x561f3da324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/1395277222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da14230 0x561f3da124d0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 -- 172.21.15.5:0/1395277222 >> 172.21.15.5:0/1395277222 conn(0x561f3d9e9f10 msgr2=0x561f3da2e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 -- 172.21.15.5:0/1395277222 shutdown_connections 2024-04-25T09:01:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.372+0000 7fcf5e82d740 1 -- 172.21.15.5:0/1395277222 wait complete. 2024-04-25T09:01:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.373+0000 7fcf5e82d740 1 -- start start 2024-04-25T09:01:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.373+0000 7fcf5e82d740 1 Processor -- start 2024-04-25T09:01:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.373+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da14230 0x561f3da89d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da174f0 0x561f3da2b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5e82d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da93d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f3d9eacb0 con 0x561f3da174f0 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f3d9090c0 con 0x561f3da31ad0 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5e82d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f3da153c0 con 0x561f3da14230 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5e82d740 10 client.0 _ll_register_callbacks cb 0x561f3d9e4c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da174f0 0x561f3da2b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da174f0 0x561f3da2b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35944/0 (socket says 172.21.15.5:35944) 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 -- 172.21.15.5:0/220491377 learned_addr learned my addr 172.21.15.5:0/220491377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf598c5640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da14230 0x561f3da89d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5a0c6640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da93d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 -- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da14230 msgr2=0x561f3da89d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da14230 0x561f3da89d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 -- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 msgr2=0x561f3da93d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da93d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 -- 172.21.15.5:0/220491377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f3da2bd30 con 0x561f3da174f0 2024-04-25T09:01:11.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5a0c6640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da93d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf590c4640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da174f0 0x561f3da2b7f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fcf440090b0 tx=0x7fcf4402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33690001978549b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf34ff9640 1 -- 172.21.15.5:0/220491377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4405a060 con 0x561f3da174f0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf34ff9640 1 -- 172.21.15.5:0/220491377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf4403c440 con 0x561f3da174f0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf500703f0 con 0x561f3da174f0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.374+0000 7fcf34ff9640 1 -- 172.21.15.5:0/220491377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf44060050 con 0x561f3da174f0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 10 client.7197 fetch_fsmap learned FSMap version 45 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x561f3da2e110 con 0x561f3da174f0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf34ff9640 1 -- 172.21.15.5:0/220491377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf500703f0 con 0x561f3da174f0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf34ff9640 1 -- 172.21.15.5:0/220491377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcf44063020 con 0x561f3da174f0 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 10 client.7197 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 10 client.7197 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 20 client.7197 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da29730 0x561f3da272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 4 client.7197 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f3d959f50 con 0x561f3da29730 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf598c5640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da29730 0x561f3da272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf34ff9640 10 client.7197 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.375+0000 7fcf598c5640 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da29730 0x561f3da272c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ef6308bee020de1 server_cookie=cf4379d6f0dda23d in_seq=0 out_seq=0 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf34ff9640 1 -- 172.21.15.5:0/220491377 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561f3d959f50 con 0x561f3da29730 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf34ff9640 10 client.7197 handle_command_reply: tid=0 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 client.7197 shutdown 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da174f0 msgr2=0x561f3da2b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da174f0 0x561f3da2b7f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fcf440090b0 tx=0x7fcf4402c070 comp rx=0 tx=0).stop 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 shutdown_connections 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x561f3da29730 0x561f3da272c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f3da31ad0 0x561f3da93d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f3da174f0 0x561f3da2b7f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf34ff9640 0 client.7197 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 --2- 172.21.15.5:0/220491377 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561f3da14230 0x561f3da89d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 >> 172.21.15.5:0/220491377 conn(0x561f3d9e9f10 msgr2=0x561f3da2e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 shutdown_connections 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 1 -- 172.21.15.5:0/220491377 wait complete. 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5e82d740 20 client.7197 trim_cache size 0 max 16384 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7038, 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:01:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:01:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:01:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 9.1501693329999991, 2024-04-25T09:01:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 45, 2024-04-25T09:01:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 73, 2024-04-25T09:01:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 73, 2024-04-25T09:01:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 14.48023523 2024-04-25T09:01:11.372 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf3806b4d0 msgr2=0x7fcf3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf3806b4d0 0x7fcf3806d990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcf44034000 tx=0x7fcf4402e000 comp rx=0 tx=0).stop 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406b7d0 msgr2=0x7fcf540b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406b7d0 0x7fcf540b6010 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c820 tx=0x7fcf5000cc20 comp rx=0 tx=0).stop 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 shutdown_connections 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf3806b4d0 0x7fcf3806d990 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5415da10 0x7fcf54152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf5406bbb0 0x7fcf5415ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 --2- 172.21.15.5:0/362081382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5406b7d0 0x7fcf540b6010 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.376+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 >> 172.21.15.5:0/362081382 conn(0x7fcf540d18e0 msgr2=0x7fcf540ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.377+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 shutdown_connections 2024-04-25T09:01:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.377+0000 7fcf5bb29640 1 -- 172.21.15.5:0/362081382 wait complete. 2024-04-25T09:01:11.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:01:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.488+0000 7fca2d2d8640 1 Processor -- start 2024-04-25T09:01:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.488+0000 7fca2d2d8640 1 -- start start 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.489+0000 7fca2d2d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca28071b00 0x7fca281655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.489+0000 7fca2d2d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2806f160 con 0x7fca280afe80 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.489+0000 7fca2d2d8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca280b3820 con 0x7fca280b45e0 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.489+0000 7fca2d2d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca280b0260 con 0x7fca28071b00 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.489+0000 7fca277fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca28071b00 0x7fca281655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.489+0000 7fca26ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca280afe80 0x7fca2806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59464/0 (socket says 172.21.15.5:59464) 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.489+0000 7fca26ffd640 1 -- 172.21.15.5:0/564167503 learned_addr learned my addr 172.21.15.5:0/564167503 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca277fe640 1 -- 172.21.15.5:0/564167503 >> v1:172.21.15.80:6789/0 conn(0x7fca280b45e0 legacy=0x7fca280713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca277fe640 1 -- 172.21.15.5:0/564167503 >> v1:172.21.15.5:6789/0 conn(0x7fca280afe80 legacy=0x7fca2806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca277fe640 1 -- 172.21.15.5:0/564167503 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280b3b00 con 0x7fca28071b00 2024-04-25T09:01:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca25ffb640 1 -- 172.21.15.5:0/564167503 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577340069 0 0) 0x7fca2806f160 con 0x7fca280afe80 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca277fe640 1 --2- 172.21.15.5:0/564167503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca281655c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fca20009d90 tx=0x7fca2002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78cfc50b3e12be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca25ffb640 1 -- 172.21.15.5:0/564167503 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20036020 con 0x7fca28071b00 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca25ffb640 1 -- 172.21.15.5:0/564167503 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20032800 con 0x7fca28071b00 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.490+0000 7fca25ffb640 1 -- 172.21.15.5:0/564167503 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20032bd0 con 0x7fca28071b00 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.491+0000 7fca2d2d8640 1 -- 172.21.15.5:0/564167503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 msgr2=0x7fca281655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.491+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/564167503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca281655c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fca20009d90 tx=0x7fca2002c900 comp rx=0 tx=0).stop 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.491+0000 7fca2d2d8640 1 -- 172.21.15.5:0/564167503 shutdown_connections 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.491+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/564167503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca281655c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.491+0000 7fca2d2d8640 1 -- 172.21.15.5:0/564167503 >> 172.21.15.5:0/564167503 conn(0x7fca280d0870 msgr2=0x7fca280d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.491+0000 7fca2d2d8640 1 -- 172.21.15.5:0/564167503 shutdown_connections 2024-04-25T09:01:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.491+0000 7fca2d2d8640 1 -- 172.21.15.5:0/564167503 wait complete. 2024-04-25T09:01:11.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.492+0000 7fca2d2d8640 1 Processor -- start 2024-04-25T09:01:11.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.492+0000 7fca2d2d8640 1 -- start start 2024-04-25T09:01:11.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca2d2d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca28149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca2d2d8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca280afe80 0x7fca28155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca2d2d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca280b45e0 0x7fca28158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca2d2d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2815f2b0 con 0x7fca28071b00 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca2d2d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca280b40c0 con 0x7fca280b45e0 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca2d2d8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2806ed20 con 0x7fca280afe80 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca26ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca28149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca26ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca28149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35956/0 (socket says 172.21.15.5:35956) 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.493+0000 7fca26ffd640 1 -- 172.21.15.5:0/114703957 learned_addr learned my addr 172.21.15.5:0/114703957 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca26ffd640 1 -- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca280afe80 msgr2=0x7fca28155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca26ffd640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca280afe80 0x7fca28155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca277fe640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca280b45e0 0x7fca28158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca26ffd640 1 -- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca280b45e0 msgr2=0x7fca28158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca26ffd640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca280b45e0 0x7fca28158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca26ffd640 1 -- 172.21.15.5:0/114703957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28154260 con 0x7fca28071b00 2024-04-25T09:01:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca26ffd640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca28149390 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c420 tx=0x7fca1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca0f7fe640 1 -- 172.21.15.5:0/114703957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180074e0 con 0x7fca28071b00 2024-04-25T09:01:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca0f7fe640 1 -- 172.21.15.5:0/114703957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca180047e0 con 0x7fca28071b00 2024-04-25T09:01:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca28154540 con 0x7fca28071b00 2024-04-25T09:01:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca0f7fe640 1 -- 172.21.15.5:0/114703957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18004c10 con 0x7fca28071b00 2024-04-25T09:01:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.494+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca281560d0 con 0x7fca28071b00 2024-04-25T09:01:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.495+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca28072470 con 0x7fca28071b00 2024-04-25T09:01:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.495+0000 7fca0f7fe640 1 -- 172.21.15.5:0/114703957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca18011070 con 0x7fca28071b00 2024-04-25T09:01:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.496+0000 7fca0f7fe640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1406b500 0x7fca1406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.496+0000 7fca0f7fe640 1 -- 172.21.15.5:0/114703957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca18089e00 con 0x7fca28071b00 2024-04-25T09:01:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.496+0000 7fca267fc640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1406b500 0x7fca1406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.497+0000 7fca267fc640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1406b500 0x7fca1406d9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fca1c000f60 tx=0x7fca1c0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.500+0000 7fca0f7fe640 1 -- 172.21.15.5:0/114703957 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca28072470 con 0x7fca28071b00 2024-04-25T09:01:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.716+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca2804ef20 con 0x7fca28071b00 2024-04-25T09:01:11.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.716+0000 7fca0f7fe640 1 -- 172.21.15.5:0/114703957 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca1800e280 con 0x7fca28071b00 2024-04-25T09:01:11.705 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:01:11.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1406b500 msgr2=0x7fca1406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1406b500 0x7fca1406d9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fca1c000f60 tx=0x7fca1c0079b0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 msgr2=0x7fca28149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca28149390 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c420 tx=0x7fca1800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 shutdown_connections 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca1406b500 0x7fca1406d9c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca280b45e0 0x7fca28158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca280afe80 0x7fca28155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 --2- 172.21.15.5:0/114703957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca28071b00 0x7fca28149390 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 >> 172.21.15.5:0/114703957 conn(0x7fca280d0870 msgr2=0x7fca280b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 shutdown_connections 2024-04-25T09:01:11.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:11.718+0000 7fca2d2d8640 1 -- 172.21.15.5:0/114703957 wait complete. 2024-04-25T09:01:11.717 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:01:11.717 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:01:11.718 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:01:11.718 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:01:11.718 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:11.718 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:01:11.718 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:01:11.718 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:01:11.718 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:01:11.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:11.719 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:01:11.734 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42488sec preferred_lft 42488sec 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:11.735 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:01:11.736 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:11.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:11.737 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:01:11.797 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:01:11.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:11.799 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:01:11.855 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:01:11.855 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:01:11.855 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:01:11.855 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:01:11.855 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:01:11.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:11.856 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:01:11.856 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:01:11.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:01:11.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:01:11.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:01:11.856 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:01:11.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:11.942 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:01:11.957 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:01:11.957 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:01:11.957 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:01:11.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:11.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:01:12.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:01:12.021 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:12.077 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:01:12.077 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:01:12.077 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:12.132 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:01:12.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:12.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:01:12.214 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:01:12.214 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:01:12.222 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:01:12.222 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:01:12.222 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:01:12.222 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:01:12.222 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:01:12.223 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:01:12.223 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:01:12.223 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:01:12.223 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:01:12.223 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:01:12.224 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:01:12.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:12.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:12.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:12.290 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:01:12.351 INFO:teuthology.orchestra.run.smithi005.stdout:client5951 2024-04-25T09:01:12.351 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:01:12.351 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:12.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.563+0000 7fdd2a8bc640 1 Processor -- start 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.563+0000 7fdd2a8bc640 1 -- start start 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd2a8bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd2415dbd0 0x7fdd241617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd2a8bc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd24162070 con 0x7fdd240b9470 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd2a8bc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd24162350 con 0x7fdd240ceec0 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd2a8bc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240d1c50 con 0x7fdd2415dbd0 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd23fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd2415dbd0 0x7fdd241617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd237fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdd240b9470 0x7fdd240ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59474/0 (socket says 172.21.15.5:59474) 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd237fe640 1 -- 172.21.15.5:0/3044723335 learned_addr learned my addr 172.21.15.5:0/3044723335 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd23fff640 1 -- 172.21.15.5:0/3044723335 >> v1:172.21.15.80:6789/0 conn(0x7fdd240ceec0 legacy=0x7fdd240d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd23fff640 1 -- 172.21.15.5:0/3044723335 >> v1:172.21.15.5:6789/0 conn(0x7fdd240b9470 legacy=0x7fdd240ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd22ffd640 1 -- 172.21.15.5:0/3044723335 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789574003 0 0) 0x7fdd24162070 con 0x7fdd240b9470 2024-04-25T09:01:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.564+0000 7fdd23fff640 1 -- 172.21.15.5:0/3044723335 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd240d1f30 con 0x7fdd2415dbd0 2024-04-25T09:01:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.565+0000 7fdd23fff640 1 --2- 172.21.15.5:0/3044723335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2415dbd0 0x7fdd241617b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0097a0 tx=0x7fdd0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee3619508ad8d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.565+0000 7fdd22ffd640 1 -- 172.21.15.5:0/3044723335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c037070 con 0x7fdd2415dbd0 2024-04-25T09:01:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.565+0000 7fdd22ffd640 1 -- 172.21.15.5:0/3044723335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c032440 con 0x7fdd2415dbd0 2024-04-25T09:01:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.565+0000 7fdd22ffd640 1 -- 172.21.15.5:0/3044723335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c032810 con 0x7fdd2415dbd0 2024-04-25T09:01:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.566+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/3044723335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2415dbd0 msgr2=0x7fdd241617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.566+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/3044723335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2415dbd0 0x7fdd241617b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0097a0 tx=0x7fdd0c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.566+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/3044723335 shutdown_connections 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.566+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/3044723335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2415dbd0 0x7fdd241617b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.566+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/3044723335 >> 172.21.15.5:0/3044723335 conn(0x7fdd24066ad0 msgr2=0x7fdd24066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.566+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/3044723335 shutdown_connections 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.566+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/3044723335 wait complete. 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.567+0000 7fdd2a8bc640 1 Processor -- start 2024-04-25T09:01:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd2a8bc640 1 -- start start 2024-04-25T09:01:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd2a8bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd240b9470 0x7fdd2415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd2a8bc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd240ceec0 0x7fdd240c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd2a8bc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd2415dbd0 0x7fdd241f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd2a8bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2415dfb0 con 0x7fdd240b9470 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd2a8bc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd24161cf0 con 0x7fdd2415dbd0 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd2a8bc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2415e130 con 0x7fdd240ceec0 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd23fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd240b9470 0x7fdd2415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd23fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd240b9470 0x7fdd2415c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35966/0 (socket says 172.21.15.5:35966) 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd23fff640 1 -- 172.21.15.5:0/56265034 learned_addr learned my addr 172.21.15.5:0/56265034 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd237fe640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd240ceec0 0x7fdd240c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.568+0000 7fdd28e59640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd2415dbd0 0x7fdd241f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd23fff640 1 -- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd240ceec0 msgr2=0x7fdd240c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd23fff640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd240ceec0 0x7fdd240c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd23fff640 1 -- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd2415dbd0 msgr2=0x7fdd241f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd23fff640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd2415dbd0 0x7fdd241f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd23fff640 1 -- 172.21.15.5:0/56265034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd240c8f00 con 0x7fdd240b9470 2024-04-25T09:01:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd23fff640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd240b9470 0x7fdd2415c110 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0097a0 tx=0x7fdd0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd20ff9640 1 -- 172.21.15.5:0/56265034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c041070 con 0x7fdd240b9470 2024-04-25T09:01:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd20ff9640 1 -- 172.21.15.5:0/56265034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c03c870 con 0x7fdd240b9470 2024-04-25T09:01:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd20ff9640 1 -- 172.21.15.5:0/56265034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c037040 con 0x7fdd240b9470 2024-04-25T09:01:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd240c91e0 con 0x7fdd240b9470 2024-04-25T09:01:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.569+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd240c97a0 con 0x7fdd240b9470 2024-04-25T09:01:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.570+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2404ef20 con 0x7fdd240b9470 2024-04-25T09:01:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.570+0000 7fdd20ff9640 1 -- 172.21.15.5:0/56265034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd0c044070 con 0x7fdd240b9470 2024-04-25T09:01:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.571+0000 7fdd20ff9640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd0406b4d0 0x7fdd0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.571+0000 7fdd20ff9640 1 -- 172.21.15.5:0/56265034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd0c0aacb0 con 0x7fdd240b9470 2024-04-25T09:01:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.571+0000 7fdd237fe640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd0406b4d0 0x7fdd0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.572+0000 7fdd237fe640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd0406b4d0 0x7fdd0406d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdd2415b6d0 tx=0x7fdd14007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.575+0000 7fdd20ff9640 1 -- 172.21.15.5:0/56265034 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd0c079570 con 0x7fdd240b9470 2024-04-25T09:01:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:12.793+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdd241612e0 con 0x7fdd240b9470 2024-04-25T09:01:13.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.254+0000 7fdd20ff9640 1 -- 172.21.15.5:0/56265034 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v46) v1 ==== 167+0+0 (secure 0 0 0) 0x7fdd0c07d610 con 0x7fdd240b9470 2024-04-25T09:01:13.242 INFO:teuthology.orchestra.run.smithi005.stderr:enabled new snapshots 2024-04-25T09:01:13.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd0406b4d0 msgr2=0x7fdd0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd0406b4d0 0x7fdd0406d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdd2415b6d0 tx=0x7fdd14007d50 comp rx=0 tx=0).stop 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd240b9470 msgr2=0x7fdd2415c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd240b9470 0x7fdd2415c110 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0097a0 tx=0x7fdd0c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 shutdown_connections 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdd0406b4d0 0x7fdd0406d990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd2415dbd0 0x7fdd241f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdd240ceec0 0x7fdd240c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 --2- 172.21.15.5:0/56265034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd240b9470 0x7fdd2415c110 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 >> 172.21.15.5:0/56265034 conn(0x7fdd24066ad0 msgr2=0x7fdd240d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 shutdown_connections 2024-04-25T09:01:13.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:13.256+0000 7fdd2a8bc640 1 -- 172.21.15.5:0/56265034 wait complete. 2024-04-25T09:01:13.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:13.257 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-04-25T09:01:13.279 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:01:13.279 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> import uuid 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> n = 2000 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = False 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> if 3 > 0: 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = True 2024-04-25T09:01:13.336 DEBUG:teuthology.orchestra.run.smithi005:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> dpath = os.path.dirname(path) 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> fnameprefix = os.path.basename(path) 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> os.makedirs(dpath, exist_ok=True) 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> for i in range(n): 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> with open(fpath, '"'"'w'"'"') as f: 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> f.write(f"{i}") 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T09:01:13.337 DEBUG:teuthology.orchestra.run.smithi005:> f.flush() 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(f.fileno()) 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> os.unlink(fpath) 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> if create_hard_links: 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> for j in range(3): 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> finally: 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> os.close(dirfd) 2024-04-25T09:01:13.338 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-25T09:01:16.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:16.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:01:32.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:32.163 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T09:01:32.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:32.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-04-25T09:01:47.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:47.078 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:58.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:58.560 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T09:01:58.619 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:01:58.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-04-25T09:01:58.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.734+0000 7f11044f5640 1 Processor -- start 2024-04-25T09:01:58.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.734+0000 7f11044f5640 1 -- start start 2024-04-25T09:01:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f11044f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc15df10 0x7f10fc1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f11044f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10fc0cefe0 0x7f10fc0d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f11044f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc162150 con 0x7f10fc0b6250 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f11044f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0d20d0 con 0x7f10fc0cefe0 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f11044f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc162430 con 0x7f10fc15df10 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f1102a92640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10fc0cefe0 0x7f10fc0d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f1102a92640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10fc0cefe0 0x7f10fc0d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37828/0 (socket says 172.21.15.5:37828) 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.735+0000 7f1102a92640 1 -- 172.21.15.5:0/2909527076 learned_addr learned my addr 172.21.15.5:0/2909527076 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.736+0000 7f1102291640 1 --2- 172.21.15.5:0/2909527076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc15df10 0x7f10fc1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.736+0000 7f1102a92640 1 -- 172.21.15.5:0/2909527076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc15df10 msgr2=0x7f10fc1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.736+0000 7f1102a92640 1 --2- 172.21.15.5:0/2909527076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc15df10 0x7f10fc1618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.736+0000 7f1102a92640 1 -- 172.21.15.5:0/2909527076 >> v1:172.21.15.80:6789/0 conn(0x7f10fc0b6250 legacy=0x7f10fc0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.736+0000 7f1102a92640 1 -- 172.21.15.5:0/2909527076 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc162710 con 0x7f10fc0cefe0 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.736+0000 7f1102a92640 1 --2- 172.21.15.5:0/2909527076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc0cefe0 0x7f10fc0d2560 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009e80 tx=0x7f10f802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cece2f34c9c528f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f110128f640 1 -- 172.21.15.5:0/2909527076 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8036070 con 0x7f10fc0cefe0 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f110128f640 1 -- 172.21.15.5:0/2909527076 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8031600 con 0x7f10fc0cefe0 2024-04-25T09:01:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f110128f640 1 -- 172.21.15.5:0/2909527076 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80319d0 con 0x7f10fc0cefe0 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 -- 172.21.15.5:0/2909527076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc0cefe0 msgr2=0x7f10fc0d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 --2- 172.21.15.5:0/2909527076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc0cefe0 0x7f10fc0d2560 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009e80 tx=0x7f10f802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 -- 172.21.15.5:0/2909527076 shutdown_connections 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 --2- 172.21.15.5:0/2909527076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc0cefe0 0x7f10fc0d2560 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 --2- 172.21.15.5:0/2909527076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc15df10 0x7f10fc1618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 -- 172.21.15.5:0/2909527076 >> 172.21.15.5:0/2909527076 conn(0x7f10fc0668f0 msgr2=0x7f10fc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 -- 172.21.15.5:0/2909527076 shutdown_connections 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.737+0000 7f11044f5640 1 -- 172.21.15.5:0/2909527076 wait complete. 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.738+0000 7f11044f5640 1 Processor -- start 2024-04-25T09:01:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.738+0000 7f11044f5640 1 -- start start 2024-04-25T09:01:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f11044f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10fc0b6250 0x7f10fc14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f11044f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc0cefe0 0x7f10fc15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f11044f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc15df10 0x7f10fc14f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f11044f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0d2aa0 con 0x7f10fc15df10 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f11044f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc161e10 con 0x7f10fc0b6250 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f11044f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0d2c20 con 0x7f10fc0cefe0 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f1102a92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc15df10 0x7f10fc14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f1102a92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc15df10 0x7f10fc14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37832/0 (socket says 172.21.15.5:37832) 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.739+0000 7f1102a92640 1 -- 172.21.15.5:0/1842808992 learned_addr learned my addr 172.21.15.5:0/1842808992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102291640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10fc0b6250 0x7f10fc14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1101a90640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc0cefe0 0x7f10fc15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102a92640 1 -- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc0cefe0 msgr2=0x7f10fc15f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102a92640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc0cefe0 0x7f10fc15f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102a92640 1 -- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10fc0b6250 msgr2=0x7f10fc14f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102a92640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10fc0b6250 0x7f10fc14f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102a92640 1 -- 172.21.15.5:0/1842808992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0ca3e0 con 0x7f10fc15df10 2024-04-25T09:01:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102291640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10fc0b6250 0x7f10fc14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f1102a92640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc15df10 0x7f10fc14f870 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f10f8034040 tx=0x7f10f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f10f2ffd640 1 -- 172.21.15.5:0/1842808992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8036050 con 0x7f10fc15df10 2024-04-25T09:01:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f10f2ffd640 1 -- 172.21.15.5:0/1842808992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8042070 con 0x7f10fc15df10 2024-04-25T09:01:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f10f2ffd640 1 -- 172.21.15.5:0/1842808992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8009510 con 0x7f10fc15df10 2024-04-25T09:01:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc15e540 con 0x7f10fc15df10 2024-04-25T09:01:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.740+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc15f560 con 0x7f10fc15df10 2024-04-25T09:01:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.742+0000 7f10f2ffd640 1 -- 172.21.15.5:0/1842808992 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10f8007bd0 con 0x7f10fc15df10 2024-04-25T09:01:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.742+0000 7f10f2ffd640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10e006b4d0 0x7f10e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.742+0000 7f10f2ffd640 1 -- 172.21.15.5:0/1842808992 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f10f80ab080 con 0x7f10fc15df10 2024-04-25T09:01:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.742+0000 7f1102291640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10e006b4d0 0x7f10e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.743+0000 7f1102291640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10e006b4d0 0x7f10e006d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.743+0000 7f11071fc740 1 Processor -- start 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.743+0000 7f11071fc740 1 -- start start 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f11071fc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84cfae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84cf9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d23be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f11071fc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84c5bb90 con 0x55ce84cf8ca0 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84c04e40 con 0x55ce84d35370 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce84c57c30 con 0x55ce84d23760 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84cfae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84cfae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37834/0 (socket says 172.21.15.5:37834) 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 -- 172.21.15.5:0/3732068378 learned_addr learned my addr 172.21.15.5:0/3732068378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102a92640 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d23be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1101a90640 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84cf9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 -- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 msgr2=0x55ce84d23be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d23be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 -- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 msgr2=0x55ce84cf9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84cf9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 -- 172.21.15.5:0/3732068378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce84a3a7d0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.744+0000 7f1102291640 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84cfae00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004380 tx=0x7f10f4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c93fe58fdf17ce1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f10dffff640 1 -- 172.21.15.5:0/3732068378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400f040 con 0x55ce84cf8ca0 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f10dffff640 1 -- 172.21.15.5:0/3732068378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f40043b0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f10dffff640 1 -- 172.21.15.5:0/3732068378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400ee80 con 0x55ce84cf8ca0 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 -- 172.21.15.5:0/3732068378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 msgr2=0x55ce84cfae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84cfae00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004380 tx=0x7f10f4011000 comp rx=0 tx=0).stop 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 -- 172.21.15.5:0/3732068378 shutdown_connections 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d23be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84cf9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 --2- 172.21.15.5:0/3732068378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84cfae00 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 -- 172.21.15.5:0/3732068378 >> 172.21.15.5:0/3732068378 conn(0x55ce84cc0870 msgr2=0x55ce84d3e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 -- 172.21.15.5:0/3732068378 shutdown_connections 2024-04-25T09:01:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.745+0000 7f11071fc740 1 -- 172.21.15.5:0/3732068378 wait complete. 2024-04-25T09:01:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.746+0000 7f11071fc740 1 -- start start 2024-04-25T09:01:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.746+0000 7f11071fc740 1 Processor -- start 2024-04-25T09:01:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f11071fc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d40980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84d4e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f11071fc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84c183e0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84d212b0 con 0x55ce84d35370 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce84d4fc20 con 0x55ce84d23760 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f11071fc740 10 client.0 _ll_register_callbacks cb 0x55ce84c17db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1101a90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d40980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37838/0 (socket says 172.21.15.5:37838) 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 -- 172.21.15.5:0/360224244 learned_addr learned my addr 172.21.15.5:0/360224244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102a92640 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84d4e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 -- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 msgr2=0x55ce84d40980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d40980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 -- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 msgr2=0x55ce84d4e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84d4e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.747+0000 7f1102291640 1 -- 172.21.15.5:0/360224244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce849300f0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f1102291640 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d514f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f10f40095f0 tx=0x7f10f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ad3f74798f551f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f10dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f10dd7fa640 1 -- 172.21.15.5:0/360224244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4005ba0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f10dd7fa640 1 -- 172.21.15.5:0/360224244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f10f4005d40 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10f40043b0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f10dd7fa640 1 -- 172.21.15.5:0/360224244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10f4034050 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 10 client.7227 fetch_fsmap learned FSMap version 46 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55ce84a9af60 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f10dd7fa640 1 -- 172.21.15.5:0/360224244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f40043b0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f10dd7fa640 1 -- 172.21.15.5:0/360224244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f10f4037020 con 0x55ce84cf8ca0 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 10 client.7227 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 10 client.7227 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 20 client.7227 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d4f2f0 0x55ce84d25d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 4 client.7227 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce84c690d0 con 0x55ce84d4f2f0 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.748+0000 7f1101a90640 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d4f2f0 0x55ce84d25d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.749+0000 7f1101a90640 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d4f2f0 0x55ce84d25d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef14e2d8cc39bb2 server_cookie=51a266d5b392964 in_seq=0 out_seq=0 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.749+0000 7f10dd7fa640 10 client.7227 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.749+0000 7f10dd7fa640 1 -- 172.21.15.5:0/360224244 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ce84c690d0 con 0x55ce84d4f2f0 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.749+0000 7f10dd7fa640 10 client.7227 handle_command_reply: tid=0 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.749+0000 7f11071fc740 1 client.7227 shutdown 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.749+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 msgr2=0x55ce84d514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.749+0000 7f11071fc740 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d514f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f10f40095f0 tx=0x7f10f4004730 comp rx=0 tx=0).stop 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 shutdown_connections 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d4f2f0 0x55ce84d25d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d35370 0x55ce84d4e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d23760 0x55ce84d40980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 --2- 172.21.15.5:0/360224244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d514f0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 >> 172.21.15.5:0/360224244 conn(0x55ce84cc0870 msgr2=0x55ce84d209f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f10dd7fa640 0 client.7227 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 shutdown_connections 2024-04-25T09:01:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 1 -- 172.21.15.5:0/360224244 wait complete. 2024-04-25T09:01:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.750+0000 7f11071fc740 20 client.7227 trim_cache size 0 max 16384 2024-04-25T09:01:58.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.764+0000 7f11071fc740 1 Processor -- start 2024-04-25T09:01:58.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.764+0000 7f11071fc740 1 -- start start 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f11071fc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d1fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d23760 0x55ce84d25d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d262a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f11071fc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc200250 con 0x55ce84cf8ca0 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0c90e0 con 0x55ce84d23760 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0c84e0 con 0x55ce84d35370 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d1fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d1fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37850/0 (socket says 172.21.15.5:37850) 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 -- 172.21.15.5:0/1322855159 learned_addr learned my addr 172.21.15.5:0/1322855159 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102a92640 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1101a90640 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d23760 0x55ce84d25d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 -- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 msgr2=0x55ce84d262a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d262a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 -- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d23760 msgr2=0x55ce84d25d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d23760 0x55ce84d25d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 -- 172.21.15.5:0/1322855159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce849091b0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.765+0000 7f1102291640 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d1fb90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f10f4003fa0 tx=0x7f10f4024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be36b064f835cc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f10df7fe640 1 -- 172.21.15.5:0/1322855159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4004250 con 0x55ce84cf8ca0 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f10df7fe640 1 -- 172.21.15.5:0/1322855159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4005ba0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f10df7fe640 1 -- 172.21.15.5:0/1322855159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40138e0 con 0x55ce84cf8ca0 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 -- 172.21.15.5:0/1322855159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 msgr2=0x55ce84d1fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d1fb90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f10f4003fa0 tx=0x7f10f4024040 comp rx=0 tx=0).stop 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 -- 172.21.15.5:0/1322855159 shutdown_connections 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d262a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84d23760 0x55ce84d25d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 --2- 172.21.15.5:0/1322855159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84cf8ca0 0x55ce84d1fb90 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 -- 172.21.15.5:0/1322855159 >> 172.21.15.5:0/1322855159 conn(0x55ce84cc0870 msgr2=0x55ce84cfac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 -- 172.21.15.5:0/1322855159 shutdown_connections 2024-04-25T09:01:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.766+0000 7f11071fc740 1 -- 172.21.15.5:0/1322855159 wait complete. 2024-04-25T09:01:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.767+0000 7f11071fc740 1 -- start start 2024-04-25T09:01:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.767+0000 7f11071fc740 1 Processor -- start 2024-04-25T09:01:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84cf8ca0 0x55ce84d340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f11071fc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84d23760 0x55ce84d34630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f11071fc740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d4ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f11071fc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0c8ae0 con 0x55ce84d23760 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84d26f20 con 0x55ce84cf8ca0 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f11071fc740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce84d4e000 con 0x55ce84d35370 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f11071fc740 10 client.0 _ll_register_callbacks cb 0x7f10ec007e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84d23760 0x55ce84d34630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84d23760 0x55ce84d34630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37866/0 (socket says 172.21.15.5:37866) 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1102291640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84cf8ca0 0x55ce84d340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 -- 172.21.15.5:0/2313921554 learned_addr learned my addr 172.21.15.5:0/2313921554 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1102a92640 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d4ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 -- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 msgr2=0x55ce84d4ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d4ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 -- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84cf8ca0 msgr2=0x55ce84d340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84cf8ca0 0x55ce84d340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 -- 172.21.15.5:0/2313921554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce84d23c70 con 0x55ce84d23760 2024-04-25T09:01:58.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f1101a90640 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84d23760 0x55ce84d34630 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0cd8f0 tx=0x7f10ec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96f2e227ec2cf77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.768+0000 7f10dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f10dd7fa640 1 -- 172.21.15.5:0/2313921554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec01c5f0 con 0x55ce84d23760 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f10dd7fa640 1 -- 172.21.15.5:0/2313921554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f10ec01c790 con 0x55ce84d23760 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10f4005ba0 con 0x55ce84d23760 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f10dd7fa640 1 -- 172.21.15.5:0/2313921554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10ec007020 con 0x55ce84d23760 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 10 client.7233 fetch_fsmap learned FSMap version 46 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55ce84d4dd40 con 0x55ce84d23760 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f10dd7fa640 1 -- 172.21.15.5:0/2313921554 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4005ba0 con 0x55ce84d23760 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f10dd7fa640 1 -- 172.21.15.5:0/2313921554 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f10ec02c050 con 0x55ce84d23760 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 10 client.7233 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 10 client.7233 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 20 client.7233 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d91130 0x55ce84d4d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 4 client.7233 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T09:01:58.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55ce84cf4c30 con 0x55ce84d91130 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.769+0000 7f1102291640 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d91130 0x55ce84d4d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f1102291640 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d91130 0x55ce84d4d380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddabf392115bd3b8 server_cookie=f11d93e2d53db214 in_seq=0 out_seq=0 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f10dd7fa640 10 client.7233 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f10dd7fa640 1 -- 172.21.15.5:0/2313921554 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17925 (crc 0 0 0) 0x55ce84cf4c30 con 0x55ce84d91130 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f10dd7fa640 10 client.7233 handle_command_reply: tid=0 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 client.7233 shutdown 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84d23760 msgr2=0x55ce84d34630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84d23760 0x55ce84d34630 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0cd8f0 tx=0x7f10ec009040 comp rx=0 tx=0).stop 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 shutdown_connections 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55ce84d91130 0x55ce84d4d380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ce84d35370 0x55ce84d4ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce84d23760 0x55ce84d34630 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 --2- 172.21.15.5:0/2313921554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ce84cf8ca0 0x55ce84d340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f10dd7fa640 0 client.7233 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 >> 172.21.15.5:0/2313921554 conn(0x55ce84cc0870 msgr2=0x55ce84d25d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 shutdown_connections 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.770+0000 7f11071fc740 1 -- 172.21.15.5:0/2313921554 wait complete. 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11071fc740 20 client.7233 trim_cache size 0 max 16384 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1205, 2024-04-25T09:01:58.765 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1200, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 606893, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 17654191, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 3, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.172042231, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.095050979, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.034392438, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.038370236, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1199, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.363600936, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000303253 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.766 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000128, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000064 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 115936, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 18672 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 27445, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 49559, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 9108673, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 55333095, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 1.841673692, 2024-04-25T09:01:58.767 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.927816512, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.105488093, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.043939217, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 49558, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.217726744, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000024571 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 71478, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.008041850, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000112 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 108352 2024-04-25T09:01:58.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2445, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2445, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 609911, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 35871126, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.289507819, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.153271628, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.051666302, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.073724811, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2444, 2024-04-25T09:01:58.769 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.390614138, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000159825 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-04-25T09:01:58.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1326, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 15.212500132, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.011472473 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1719, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.923730089, 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000537364 2024-04-25T09:01:58.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 25653, 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 25653, 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 25653, 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 361.895493674, 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.014107336 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-04-25T09:01:58.772 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 19899, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 19899, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 19899, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 132, 2024-04-25T09:01:58.773 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 132, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 47581, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 47087, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 133, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-04-25T09:01:58.774 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2024-04-25T09:01:58.775 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 697, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4020, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 2732, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2220, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 65, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 13972 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-04-25T09:01:58.776 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 2000, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4147, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 1870, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2244, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T09:01:58.777 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 23734, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 23734, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 32, 2024-04-25T09:01:58.778 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 32, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 3, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 93391803, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2617, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 91.795713474, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.035076696 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.779 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 2014, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2014, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 0, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 19899, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19900, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 1, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 132, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 8727, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 8595, 2024-04-25T09:01:58.780 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 115104, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 215396 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 29040, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 25653, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 3, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.302620662, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000651310 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-04-25T09:01:58.781 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004237087, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000146106 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.730345375, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001288390 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-04-25T09:01:58.782 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7367, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 6.032384604, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000818838 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-04-25T09:01:58.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000235276, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000235276 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.784 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.002663371, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002663371 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-04-25T09:01:58.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.102996970, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.102996970 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.239516263, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.029939532 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-04-25T09:01:58.786 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2244, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 330.246418008, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.147168635 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-04-25T09:01:58.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.042105957, 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.042105957 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.788 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000288236, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000288236 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.789 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.790 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.191681865, 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002023960 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-04-25T09:01:58.791 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-04-25T09:01:58.792 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18617, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18617, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 44, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-04-25T09:01:58.793 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T09:01:58.794 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-04-25T09:01:58.795 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 16609763, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 6173, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 440, 2024-04-25T09:01:58.796 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 5, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5600, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 81, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 21171606, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 880643, 2024-04-25T09:01:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 4725, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 89675281, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 36, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 4725, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4725, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.859632419, 2024-04-25T09:01:58.798 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003568176 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4725, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 4816 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 4725, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 52, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 4673, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-04-25T09:01:58.799 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 52, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2669, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 32, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1870, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 33, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-04-25T09:01:58.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-04-25T09:01:58.801 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 75, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 3, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-04-25T09:01:58.802 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 101, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 26 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-04-25T09:01:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 1870, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 1870, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 31091, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 7522450, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:01:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 31091, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 31091, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 7522450, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T09:01:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4725, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 89879111, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4725, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 89879111, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-04-25T09:01:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4725, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 4725, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4725, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 4725, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 1870, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 203830, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 1870, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 52, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 203830, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.808 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x55e7d37006e0": { 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 84, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 23734, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 89197499, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 23734, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2617, 2024-04-25T09:01:58.809 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 89197415, 2024-04-25T09:01:58.810 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:01:58.810 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:01:58.810 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:01:58.810 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:01:58.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:58.810 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:01:58.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10e006b4d0 msgr2=0x7f10e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10e006b4d0 0x7f10e006d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4008040 comp rx=0 tx=0).stop 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc15df10 msgr2=0x7f10fc14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc15df10 0x7f10fc14f870 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f10f8034040 tx=0x7f10f8004a40 comp rx=0 tx=0).stop 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 shutdown_connections 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f10e006b4d0 0x7f10e006d990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10fc15df10 0x7f10fc14f870 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10fc0cefe0 0x7f10fc15f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 --2- 172.21.15.5:0/1842808992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10fc0b6250 0x7f10fc14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 >> 172.21.15.5:0/1842808992 conn(0x7f10fc0668f0 msgr2=0x7f10fc0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 shutdown_connections 2024-04-25T09:01:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.771+0000 7f11044f5640 1 -- 172.21.15.5:0/1842808992 wait complete. 2024-04-25T09:01:58.813 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-04-25T09:01:58.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:58.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start '~mdsdir' recursive 2024-04-25T09:01:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.930+0000 7fcb0fcac640 1 Processor -- start 2024-04-25T09:01:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.930+0000 7fcb0fcac640 1 -- start start 2024-04-25T09:01:58.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0fcac640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb080b72e0 0x7fcb080d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0fcac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080d0b50 0x7fcb080ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0fcac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb080ce590 0x7fcb0806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0fcac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080cbf10 con 0x7fcb080ce590 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0fcac640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080ce990 con 0x7fcb080b72e0 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0fcac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080cc160 con 0x7fcb080d0b50 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb080ce590 0x7fcb0806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb080ce590 0x7fcb0806adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37874/0 (socket says 172.21.15.5:37874) 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 -- 172.21.15.5:0/786350840 learned_addr learned my addr 172.21.15.5:0/786350840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0d247640 1 --2- 172.21.15.5:0/786350840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080d0b50 0x7fcb080ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0da48640 1 --2- 172.21.15.5:0/786350840 >> v2:172.21.15.80:3300/0 conn(0x7fcb080b72e0 0x7fcb080d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 -- 172.21.15.5:0/786350840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080d0b50 msgr2=0x7fcb080ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 --2- 172.21.15.5:0/786350840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080d0b50 0x7fcb080ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 -- 172.21.15.5:0/786350840 >> v2:172.21.15.80:3300/0 conn(0x7fcb080b72e0 msgr2=0x7fcb080d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 --2- 172.21.15.5:0/786350840 >> v2:172.21.15.80:3300/0 conn(0x7fcb080b72e0 0x7fcb080d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.931+0000 7fcb0e249640 1 -- 172.21.15.5:0/786350840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080cc440 con 0x7fcb080ce590 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.932+0000 7fcb0e249640 1 --2- 172.21.15.5:0/786350840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080ce590 0x7fcb0806adf0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fcb080b4490 tx=0x7fcb0002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a7d1b2a0d2a8b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.932+0000 7fcb0ca46640 1 -- 172.21.15.5:0/786350840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00036070 con 0x7fcb080ce590 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.932+0000 7fcb0ca46640 1 -- 172.21.15.5:0/786350840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb00031600 con 0x7fcb080ce590 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.932+0000 7fcb0ca46640 1 -- 172.21.15.5:0/786350840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000319d0 con 0x7fcb080ce590 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 -- 172.21.15.5:0/786350840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080ce590 msgr2=0x7fcb0806adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/786350840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080ce590 0x7fcb0806adf0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fcb080b4490 tx=0x7fcb0002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 -- 172.21.15.5:0/786350840 shutdown_connections 2024-04-25T09:01:58.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/786350840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080ce590 0x7fcb0806adf0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/786350840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080d0b50 0x7fcb080ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/786350840 >> v2:172.21.15.80:3300/0 conn(0x7fcb080b72e0 0x7fcb080d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 -- 172.21.15.5:0/786350840 >> 172.21.15.5:0/786350840 conn(0x7fcb080d18c0 msgr2=0x7fcb080d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 -- 172.21.15.5:0/786350840 shutdown_connections 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.933+0000 7fcb0fcac640 1 -- 172.21.15.5:0/786350840 wait complete. 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.934+0000 7fcb0fcac640 1 Processor -- start 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.934+0000 7fcb0fcac640 1 -- start start 2024-04-25T09:01:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0fcac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080b72e0 0x7fcb08147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0fcac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb080ce590 0x7fcb081593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0fcac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080d0b50 0x7fcb081598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0fcac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080b76c0 con 0x7fcb080d0b50 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0fcac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080cca00 con 0x7fcb080ce590 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0fcac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080b4710 con 0x7fcb080b72e0 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080d0b50 0x7fcb081598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080d0b50 0x7fcb081598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37886/0 (socket says 172.21.15.5:37886) 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 -- 172.21.15.5:0/140095350 learned_addr learned my addr 172.21.15.5:0/140095350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0da48640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080b72e0 0x7fcb08147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0d247640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb080ce590 0x7fcb081593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 -- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080b72e0 msgr2=0x7fcb08147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080b72e0 0x7fcb08147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 -- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb080ce590 msgr2=0x7fcb081593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb080ce590 0x7fcb081593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 -- 172.21.15.5:0/140095350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0814a360 con 0x7fcb080d0b50 2024-04-25T09:01:58.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcb0e249640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080d0b50 0x7fcb081598e0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009f40 tx=0x7fcb00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.935+0000 7fcafe7fc640 1 -- 172.21.15.5:0/140095350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00036050 con 0x7fcb080d0b50 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.936+0000 7fcafe7fc640 1 -- 172.21.15.5:0/140095350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb00042070 con 0x7fcb080d0b50 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.936+0000 7fcafe7fc640 1 -- 172.21.15.5:0/140095350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00009510 con 0x7fcb080d0b50 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.936+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0814a640 con 0x7fcb080d0b50 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.936+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0814ac00 con 0x7fcb080d0b50 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.937+0000 7fcafe7fc640 1 -- 172.21.15.5:0/140095350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb00007bf0 con 0x7fcb080d0b50 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.937+0000 7fcafe7fc640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaec06b500 0x7fcaec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.937+0000 7fcafe7fc640 1 -- 172.21.15.5:0/140095350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fcb000ab030 con 0x7fcb080d0b50 2024-04-25T09:01:58.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.938+0000 7fcb0da48640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaec06b500 0x7fcaec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.938+0000 7fcb0da48640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaec06b500 0x7fcaec06d9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcb04006fd0 tx=0x7fcb04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 Processor -- start 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 -- start start 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x5575534de460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534ae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534ae740 0x5575534d6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575534170a0 con 0x5575534deaa0 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575533bfd40 con 0x5575534de080 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x557553413140 con 0x5575534ae740 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb0d247640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb0d247640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37898/0 (socket says 172.21.15.5:37898) 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb0e249640 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534ae740 0x5575534d6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb0da48640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x5575534de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.939+0000 7fcb0d247640 1 -- 172.21.15.5:0/2268709686 learned_addr learned my addr 172.21.15.5:0/2268709686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcb0d247640 1 -- 172.21.15.5:0/2268709686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534ae740 msgr2=0x5575534d6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcb0d247640 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534ae740 0x5575534d6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcb0d247640 1 -- 172.21.15.5:0/2268709686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 msgr2=0x5575534de460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcb0d247640 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x5575534de460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcb0d247640 1 -- 172.21.15.5:0/2268709686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575531f7a20 con 0x5575534deaa0 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcb0d247640 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534ae200 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009ab0 tx=0x7fcaf8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168f4190d3f67fb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcaeb7fe640 1 -- 172.21.15.5:0/2268709686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8019070 con 0x5575534deaa0 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcaeb7fe640 1 -- 172.21.15.5:0/2268709686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8011bc0 con 0x5575534deaa0 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.940+0000 7fcaeb7fe640 1 -- 172.21.15.5:0/2268709686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8015460 con 0x5575534deaa0 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 -- 172.21.15.5:0/2268709686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 msgr2=0x5575534ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534ae200 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009ab0 tx=0x7fcaf8009190 comp rx=0 tx=0).stop 2024-04-25T09:01:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 -- 172.21.15.5:0/2268709686 shutdown_connections 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534ae740 0x5575534d6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534ae200 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2268709686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x5575534de460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 -- 172.21.15.5:0/2268709686 >> 172.21.15.5:0/2268709686 conn(0x5575534b0470 msgr2=0x5575534f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 -- 172.21.15.5:0/2268709686 shutdown_connections 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 -- 172.21.15.5:0/2268709686 wait complete. 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 -- start start 2024-04-25T09:01:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.941+0000 7fcb129ad740 1 Processor -- start 2024-04-25T09:01:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x5575534dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb129ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575534da7d0 con 0x55755350c0a0 2024-04-25T09:01:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575533b53d0 con 0x5575534deaa0 2024-04-25T09:01:58.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575534daa70 con 0x5575534de080 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb129ad740 10 client.0 _ll_register_callbacks cb 0x55755312ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb0e249640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb0e249640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37902/0 (socket says 172.21.15.5:37902) 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb0e249640 1 -- 172.21.15.5:0/4225786996 learned_addr learned my addr 172.21.15.5:0/4225786996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb0da48640 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.942+0000 7fcb0d247640 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x5575534dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb0e249640 1 -- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 msgr2=0x5575534e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb0e249640 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb0e249640 1 -- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 msgr2=0x5575534dceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb0e249640 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x5575534dceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb0e249640 1 -- 172.21.15.5:0/4225786996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575530eb310 con 0x55755350c0a0 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb0e249640 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dd3f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fcb0002a6e0 tx=0x7fcb00031600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f9adef7c2e3100 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcae8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcae8ff9640 1 -- 172.21.15.5:0/4225786996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000a7060 con 0x55755350c0a0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcae8ff9640 1 -- 172.21.15.5:0/4225786996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fcb000912d0 con 0x55755350c0a0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaf8011bc0 con 0x55755350c0a0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcae8ff9640 1 -- 172.21.15.5:0/4225786996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb00096050 con 0x55755350c0a0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 10 client.7245 fetch_fsmap learned FSMap version 46 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5575532581b0 con 0x55755350c0a0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcae8ff9640 1 -- 172.21.15.5:0/4225786996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8011bc0 con 0x55755350c0a0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcae8ff9640 1 -- 172.21.15.5:0/4225786996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcb00078c30 con 0x55755350c0a0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 10 client.7245 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 10 client.7245 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 20 client.7245 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534fef60 0x5575534ff370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 4 client.7245 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.943+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575534245e0 con 0x5575534fef60 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.944+0000 7fcb0da48640 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534fef60 0x5575534ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.944+0000 7fcb0da48640 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534fef60 0x5575534ff370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9043691bb247d3f8 server_cookie=a7b62d2033c32478 in_seq=0 out_seq=0 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.944+0000 7fcae8ff9640 10 client.7245 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcae8ff9640 1 -- 172.21.15.5:0/4225786996 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575534245e0 con 0x5575534fef60 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcae8ff9640 10 client.7245 handle_command_reply: tid=0 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 client.7245 shutdown 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 msgr2=0x5575534dd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dd3f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fcb0002a6e0 tx=0x7fcb00031600 comp rx=0 tx=0).stop 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 shutdown_connections 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534fef60 0x5575534ff370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dd3f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x5575534dceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcae8ff9640 0 client.7245 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 --2- 172.21.15.5:0/4225786996 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 >> 172.21.15.5:0/4225786996 conn(0x5575534ae740 msgr2=0x5575534ad8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 shutdown_connections 2024-04-25T09:01:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 1 -- 172.21.15.5:0/4225786996 wait complete. 2024-04-25T09:01:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.945+0000 7fcb129ad740 20 client.7245 trim_cache size 0 max 16384 2024-04-25T09:01:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.960+0000 7fcb129ad740 1 Processor -- start 2024-04-25T09:01:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.960+0000 7fcb129ad740 1 -- start start 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x55755351bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb129ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08200160 con 0x5575534deaa0 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081f4b80 con 0x5575534de080 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081f3f80 con 0x55755350c0a0 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534d97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37906/0 (socket says 172.21.15.5:37906) 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 -- 172.21.15.5:0/2852938572 learned_addr learned my addr 172.21.15.5:0/2852938572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0da48640 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x55755351bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0e249640 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 -- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55755350c0a0 msgr2=0x5575534dee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 -- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 msgr2=0x55755351bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x55755351bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 -- 172.21.15.5:0/2852938572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575534ff6e0 con 0x5575534deaa0 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0da48640 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x55755351bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.961+0000 7fcb0d247640 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534d97f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5575534af910 tx=0x7fcaf8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f77bec75f43c5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcaeaffd640 1 -- 172.21.15.5:0/2852938572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8019040 con 0x5575534deaa0 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcaeaffd640 1 -- 172.21.15.5:0/2852938572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf802e070 con 0x5575534deaa0 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcaeaffd640 1 -- 172.21.15.5:0/2852938572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8011de0 con 0x5575534deaa0 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 -- 172.21.15.5:0/2852938572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 msgr2=0x5575534d97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534d97f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5575534af910 tx=0x7fcaf8016000 comp rx=0 tx=0).stop 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 -- 172.21.15.5:0/2852938572 shutdown_connections 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575534deaa0 0x5575534d97f0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 --2- 172.21.15.5:0/2852938572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534de080 0x55755351bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 -- 172.21.15.5:0/2852938572 >> 172.21.15.5:0/2852938572 conn(0x5575534ae740 msgr2=0x5575534f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 -- 172.21.15.5:0/2852938572 shutdown_connections 2024-04-25T09:01:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.962+0000 7fcb129ad740 1 -- 172.21.15.5:0/2852938572 wait complete. 2024-04-25T09:01:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.963+0000 7fcb129ad740 1 -- start start 2024-04-25T09:01:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.963+0000 7fcb129ad740 1 Processor -- start 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534fc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x557553563590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575534a9e00 con 0x55755350c0a0 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081f4580 con 0x5575534deaa0 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575534da240 con 0x5575534de080 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 10 client.0 _ll_register_callbacks cb 0x7fcaf8009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37912/0 (socket says 172.21.15.5:37912) 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 -- 172.21.15.5:0/3932974869 learned_addr learned my addr 172.21.15.5:0/3932974869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0da48640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0d247640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x557553563590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 -- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 msgr2=0x5575534fc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534fc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 -- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 msgr2=0x557553563590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x557553563590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 -- 172.21.15.5:0/3932974869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575530c4490 con 0x55755350c0a0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0d247640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x557553563590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0da48640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534fc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb0e249640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dee80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fcb000794e0 tx=0x7fcb000a9460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8654e8dd47b6bc37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcae8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcae8ff9640 1 -- 172.21.15.5:0/3932974869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00079320 con 0x55755350c0a0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcae8ff9640 1 -- 172.21.15.5:0/3932974869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fcb0007ab10 con 0x55755350c0a0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaf802e070 con 0x55755350c0a0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcae8ff9640 1 -- 172.21.15.5:0/3932974869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb000a92b0 con 0x55755350c0a0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 10 client.7251 fetch_fsmap learned FSMap version 46 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.964+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x557553563eb0 con 0x55755350c0a0 2024-04-25T09:01:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcae8ff9640 1 -- 172.21.15.5:0/3932974869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf802e070 con 0x55755350c0a0 2024-04-25T09:01:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcae8ff9640 1 -- 172.21.15.5:0/3932974869 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcb00075530 con 0x55755350c0a0 2024-04-25T09:01:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb129ad740 10 client.7251 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:01:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb129ad740 10 client.7251 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:01:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb129ad740 20 client.7251 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb129ad740 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534dd520 0x5575534df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb129ad740 4 client.7251 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-04-25T09:01:58.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0x55755341e930 con 0x5575534dd520 2024-04-25T09:01:58.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb0da48640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534dd520 0x5575534df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcb0da48640 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534dd520 0x5575534df3c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da2b633144507116 server_cookie=f205946a509330ad in_seq=0 out_seq=0 2024-04-25T09:01:58.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.965+0000 7fcae8ff9640 10 client.7251 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcae8ff9640 1 -- 172.21.15.5:0/3932974869 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55755341e930 con 0x5575534dd520 2024-04-25T09:01:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcae8ff9640 10 client.7251 handle_command_reply: tid=0 2024-04-25T09:01:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 client.7251 shutdown 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 msgr2=0x5575534dee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dee80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fcb000794e0 tx=0x7fcb000a9460 comp rx=0 tx=0).stop 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 shutdown_connections 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x5575534dd520 0x5575534df3c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55755350c0a0 0x5575534dee80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5575534deaa0 0x557553563590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 --2- 172.21.15.5:0/3932974869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5575534de080 0x5575534fc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcae8ff9640 0 client.7251 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 >> 172.21.15.5:0/3932974869 conn(0x5575534ae740 msgr2=0x5575534d97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 shutdown_connections 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 1 -- 172.21.15.5:0/3932974869 wait complete. 2024-04-25T09:01:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.978+0000 7fcb129ad740 20 client.7251 trim_cache size 0 max 16384 2024-04-25T09:01:58.968 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:01:58.968 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T09:01:58.968 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "e6614a94-5311-49e5-aed3-49b8751d386b", 2024-04-25T09:01:58.968 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T09:01:58.968 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaec06b500 msgr2=0x7fcaec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaec06b500 0x7fcaec06d9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcb04006fd0 tx=0x7fcb04008040 comp rx=0 tx=0).stop 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080d0b50 msgr2=0x7fcb081598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080d0b50 0x7fcb081598e0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009f40 tx=0x7fcb00004a40 comp rx=0 tx=0).stop 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 shutdown_connections 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcaec06b500 0x7fcaec06d9c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb080d0b50 0x7fcb081598e0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb080ce590 0x7fcb081593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 --2- 172.21.15.5:0/140095350 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcb080b72e0 0x7fcb08147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 >> 172.21.15.5:0/140095350 conn(0x7fcb080d18c0 msgr2=0x7fcb0806e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 shutdown_connections 2024-04-25T09:01:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:58.979+0000 7fcb0fcac640 1 -- 172.21.15.5:0/140095350 wait complete. 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:58.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:01:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.110+0000 7f72d2c46640 1 Processor -- start 2024-04-25T09:01:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.111+0000 7f72d2c46640 1 -- start start 2024-04-25T09:01:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72d2c46640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc0668f0 0x7f72cc066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72d2c46640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0b3a00 con 0x7f72cc15dc00 2024-04-25T09:01:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72d2c46640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0b3ce0 con 0x7f72cc0ae250 2024-04-25T09:01:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72d2c46640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0b5b60 con 0x7f72cc0668f0 2024-04-25T09:01:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72d09e2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72cc15dc00 0x7f72cc0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37250/0 (socket says 172.21.15.5:37250) 2024-04-25T09:01:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72d09e2640 1 -- 172.21.15.5:0/2382069192 learned_addr learned my addr 172.21.15.5:0/2382069192 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:01:59.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cbfff640 1 --2- 172.21.15.5:0/2382069192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc0668f0 0x7f72cc066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038678644 0 0) 0x7f72cc0b3a00 con 0x7f72cc15dc00 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72bc003520 con 0x7f72cc15dc00 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957106780 0 0) 0x7f72cc0b3ce0 con 0x7f72cc0ae250 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72cc0b3a00 con 0x7f72cc0ae250 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cbfff640 1 -- 172.21.15.5:0/2382069192 >> v1:172.21.15.80:6789/0 conn(0x7f72cc0ae250 legacy=0x7f72cc0ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 916022097 0 0) 0x7f72bc003520 con 0x7f72cc15dc00 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cbfff640 1 -- 172.21.15.5:0/2382069192 >> v1:172.21.15.5:6789/0 conn(0x7f72cc15dc00 legacy=0x7f72cc0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.112+0000 7f72cbfff640 1 -- 172.21.15.5:0/2382069192 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0720a0 con 0x7f72cc0668f0 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.113+0000 7f72cbfff640 1 --2- 172.21.15.5:0/2382069192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc0668f0 0x7f72cc066d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72b80097d0 tx=0x7f72b802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb301b5bb9eac9cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.113+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8037070 con 0x7f72cc0668f0 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.113+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b802ac30 con 0x7f72cc0668f0 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.113+0000 7f72cb7fe640 1 -- 172.21.15.5:0/2382069192 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0001670 con 0x7f72cc0668f0 2024-04-25T09:01:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.114+0000 7f72d2c46640 1 -- 172.21.15.5:0/2382069192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc0668f0 msgr2=0x7f72cc066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.114+0000 7f72d2c46640 1 --2- 172.21.15.5:0/2382069192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc0668f0 0x7f72cc066d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72b80097d0 tx=0x7f72b802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.114+0000 7f72d2c46640 1 -- 172.21.15.5:0/2382069192 shutdown_connections 2024-04-25T09:01:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.114+0000 7f72d2c46640 1 --2- 172.21.15.5:0/2382069192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc0668f0 0x7f72cc066d50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.114+0000 7f72d2c46640 1 -- 172.21.15.5:0/2382069192 >> 172.21.15.5:0/2382069192 conn(0x7f72cc0b2560 msgr2=0x7f72cc0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.114+0000 7f72d2c46640 1 -- 172.21.15.5:0/2382069192 shutdown_connections 2024-04-25T09:01:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.114+0000 7f72d2c46640 1 -- 172.21.15.5:0/2382069192 wait complete. 2024-04-25T09:01:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.116+0000 7f72d2c46640 1 Processor -- start 2024-04-25T09:01:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.116+0000 7f72d2c46640 1 -- start start 2024-04-25T09:01:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d2c46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0668f0 0x7f72cc15e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d2c46640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0ae250 0x7f72cc15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d2c46640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc15dc00 0x7f72cc1f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d2c46640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc072410 con 0x7f72cc0668f0 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d2c46640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc15dfe0 con 0x7f72cc0ae250 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d2c46640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0afe30 con 0x7f72cc15dc00 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d09e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0668f0 0x7f72cc15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d11e3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc15dc00 0x7f72cc1f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0ae250 0x7f72cc15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0ae250 0x7f72cc15f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:46182/0 (socket says 172.21.15.5:46182) 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d11e3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc15dc00 0x7f72cc1f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:57066/0 (socket says 172.21.15.5:57066) 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72cbfff640 1 -- 172.21.15.5:0/3867213946 learned_addr learned my addr 172.21.15.5:0/3867213946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.117+0000 7f72d09e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0668f0 0x7f72cc15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37926/0 (socket says 172.21.15.5:37926) 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d11e3640 1 -- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0ae250 msgr2=0x7f72cc15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d11e3640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0ae250 0x7f72cc15f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d11e3640 1 -- 172.21.15.5:0/3867213946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0668f0 msgr2=0x7f72cc15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d11e3640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0668f0 0x7f72cc15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d11e3640 1 -- 172.21.15.5:0/3867213946 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc1f4b40 con 0x7f72cc15dc00 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d09e2640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0668f0 0x7f72cc15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d11e3640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc15dc00 0x7f72cc1f4600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c760 tx=0x7f72c400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72c97fa640 1 -- 172.21.15.5:0/3867213946 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4003b70 con 0x7f72cc15dc00 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72c97fa640 1 -- 172.21.15.5:0/3867213946 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4003d30 con 0x7f72cc15dc00 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72c97fa640 1 -- 172.21.15.5:0/3867213946 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400aa90 con 0x7f72cc15dc00 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc15e740 con 0x7f72cc15dc00 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.118+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc15ed00 con 0x7f72cc15dc00 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.120+0000 7f72c97fa640 1 -- 172.21.15.5:0/3867213946 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72c400ac30 con 0x7f72cc15dc00 2024-04-25T09:01:59.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.120+0000 7f72c97fa640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f72b006b4d0 0x7f72b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.121+0000 7f72c97fa640 1 -- 172.21.15.5:0/3867213946 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f72c408a090 con 0x7f72cc15dc00 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.121+0000 7f72d09e2640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f72b006b4d0 0x7f72b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.121+0000 7f72d09e2640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f72b006b4d0 0x7f72b006d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f72c0001eb0 tx=0x7f72c0001610 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 Processor -- start 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 -- start start 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51b10 0x555963b54320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b54860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b24770 0x555963b27f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555963a8dda0 con 0x555963b51ef0 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555963a36b80 con 0x555963b24770 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.122+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555963a89e40 con 0x555963b51b10 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b54860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b54860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37928/0 (socket says 172.21.15.5:37928) 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 -- 172.21.15.5:0/3354087049 learned_addr learned my addr 172.21.15.5:0/3354087049 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72d11e3640 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b24770 0x555963b27f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72d09e2640 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51b10 0x555963b54320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 -- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51b10 msgr2=0x555963b54320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51b10 0x555963b54320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 -- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b24770 msgr2=0x555963b27f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b24770 0x555963b27f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 -- 172.21.15.5:0/3354087049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555963a40f10 con 0x555963b51ef0 2024-04-25T09:01:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72d11e3640 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b24770 0x555963b27f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72cbfff640 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b54860 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f72b802a790 tx=0x7f72b802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde5bef09521a6b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.123+0000 7f72b67fc640 1 -- 172.21.15.5:0/3354087049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8037040 con 0x555963b51ef0 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.124+0000 7f72b67fc640 1 -- 172.21.15.5:0/3354087049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b8038040 con 0x555963b51ef0 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.124+0000 7f72b67fc640 1 -- 172.21.15.5:0/3354087049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8032840 con 0x555963b51ef0 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.124+0000 7f72d5a21740 1 -- 172.21.15.5:0/3354087049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 msgr2=0x555963b54860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.124+0000 7f72d5a21740 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b54860 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f72b802a790 tx=0x7f72b802c000 comp rx=0 tx=0).stop 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 -- 172.21.15.5:0/3354087049 shutdown_connections 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b24770 0x555963b27f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b54860 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 --2- 172.21.15.5:0/3354087049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51b10 0x555963b54320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 -- 172.21.15.5:0/3354087049 >> 172.21.15.5:0/3354087049 conn(0x555963b269e0 msgr2=0x555963b6f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 -- 172.21.15.5:0/3354087049 shutdown_connections 2024-04-25T09:01:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 -- 172.21.15.5:0/3354087049 wait complete. 2024-04-25T09:01:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.125+0000 7f72d5a21740 1 -- start start 2024-04-25T09:01:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.126+0000 7f72d5a21740 1 Processor -- start 2024-04-25T09:01:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.126+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b58340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.126+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b73f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b71dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d5a21740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555963b29b90 con 0x555963b51ef0 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555963a2c4b0 con 0x555963b51b10 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555963b29e70 con 0x555963b71940 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d5a21740 10 client.0 _ll_register_callbacks cb 0x555963a6c180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d11e3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b71dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d09e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b58340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d11e3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b71dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:57078/0 (socket says 172.21.15.5:57078) 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b73f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72d11e3640 1 -- 172.21.15.5:0/87179127 learned_addr learned my addr 172.21.15.5:0/87179127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72cbfff640 1 -- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 msgr2=0x555963b71dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72cbfff640 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b71dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72cbfff640 1 -- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 msgr2=0x555963b58340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72cbfff640 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b58340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72cbfff640 1 -- 172.21.15.5:0/87179127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55596386c7d0 con 0x555963b51ef0 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72cbfff640 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b73f40 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f72b803f000 tx=0x7f72b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40c6275e1faa494 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.127+0000 7f72ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72ab7fe640 1 -- 172.21.15.5:0/87179127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8032c80 con 0x555963b51ef0 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72ab7fe640 1 -- 172.21.15.5:0/87179127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f72b8051410 con 0x555963b51ef0 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72b8038040 con 0x555963b51ef0 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72ab7fe640 1 -- 172.21.15.5:0/87179127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72b8058050 con 0x555963b51ef0 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 10 client.7263 fetch_fsmap learned FSMap version 46 2024-04-25T09:01:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5559637a23f0 con 0x555963b51ef0 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72ab7fe640 1 -- 172.21.15.5:0/87179127 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b8038040 con 0x555963b51ef0 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72ab7fe640 1 -- 172.21.15.5:0/87179127 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f72b8051630 con 0x555963b51ef0 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 10 client.7263 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 10 client.7263 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 20 client.7263 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963b55320 0x555963b55720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 4 client.7263 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.128+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555963a9b2e0 con 0x555963b55320 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.129+0000 7f72d09e2640 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963b55320 0x555963b55720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.129+0000 7f72ab7fe640 10 client.7263 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.129+0000 7f72d09e2640 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963b55320 0x555963b55720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c61b16f1a0959201 server_cookie=79658d0e0e8ab4d0 in_seq=0 out_seq=0 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72ab7fe640 1 -- 172.21.15.5:0/87179127 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555963a9b2e0 con 0x555963b55320 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72ab7fe640 10 client.7263 handle_command_reply: tid=0 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 client.7263 shutdown 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 msgr2=0x555963b73f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b73f40 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f72b803f000 tx=0x7f72b8004730 comp rx=0 tx=0).stop 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 shutdown_connections 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963b55320 0x555963b55720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72ab7fe640 0 client.7263 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b71dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b73f40 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 --2- 172.21.15.5:0/87179127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b58340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 >> 172.21.15.5:0/87179127 conn(0x555963b24770 msgr2=0x555963b25420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.130+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 shutdown_connections 2024-04-25T09:01:59.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.131+0000 7f72d5a21740 1 -- 172.21.15.5:0/87179127 wait complete. 2024-04-25T09:01:59.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.131+0000 7f72d5a21740 20 client.7263 trim_cache size 0 max 16384 2024-04-25T09:01:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 Processor -- start 2024-04-25T09:01:59.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 -- start start 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b25030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc200130 con 0x555963b51ef0 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1ff460 con 0x555963b51b10 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.150+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc149810 con 0x555963b71940 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37932/0 (socket says 172.21.15.5:37932) 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 -- 172.21.15.5:0/2403093076 learned_addr learned my addr 172.21.15.5:0/2403093076 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72d09e2640 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b25030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72d11e3640 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 -- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 msgr2=0x555963b23b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 -- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 msgr2=0x555963b25030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b25030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 -- 172.21.15.5:0/2403093076 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555963b72130 con 0x555963b51ef0 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72d09e2640 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b25030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72cbfff640 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b23600 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f72b8035040 tx=0x7f72b8048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee69165cb0f979c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72b5ffb640 1 -- 172.21.15.5:0/2403093076 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8037030 con 0x555963b51ef0 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72b5ffb640 1 -- 172.21.15.5:0/2403093076 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b802ac30 con 0x555963b51ef0 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.151+0000 7f72b5ffb640 1 -- 172.21.15.5:0/2403093076 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b80093c0 con 0x555963b51ef0 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 -- 172.21.15.5:0/2403093076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 msgr2=0x555963b23600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b23600 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f72b8035040 tx=0x7f72b8048000 comp rx=0 tx=0).stop 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 -- 172.21.15.5:0/2403093076 shutdown_connections 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 --2- 172.21.15.5:0/2403093076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963b25030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 -- 172.21.15.5:0/2403093076 >> 172.21.15.5:0/2403093076 conn(0x555963b24770 msgr2=0x555963b2a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 -- 172.21.15.5:0/2403093076 shutdown_connections 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.152+0000 7f72d5a21740 1 -- 172.21.15.5:0/2403093076 wait complete. 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.153+0000 7f72d5a21740 1 -- start start 2024-04-25T09:01:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.153+0000 7f72d5a21740 1 Processor -- start 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963bc2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d5a21740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d5a21740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555963b92310 con 0x555963b71940 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0cd720 con 0x555963b51b10 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d5a21740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x555963b2a420 con 0x555963b51ef0 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d5a21740 10 client.0 _ll_register_callbacks cb 0x7f72bc0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37938/0 (socket says 172.21.15.5:37938) 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 -- 172.21.15.5:0/1479224339 learned_addr learned my addr 172.21.15.5:0/1479224339 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d09e2640 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963bc2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72cbfff640 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 -- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51ef0 msgr2=0x555963b23600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 -- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 msgr2=0x555963bc2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963bc2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 -- 172.21.15.5:0/1479224339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559637620f0 con 0x555963b71940 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72d11e3640 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b71940 0x555963b23b40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f72c400a430 tx=0x7f72c4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be89de2ca08e10a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:01:59.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.154+0000 7f72ab7fe640 1 -- 172.21.15.5:0/1479224339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4075060 con 0x555963b71940 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72ab7fe640 1 -- 172.21.15.5:0/1479224339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f72c4060910 con 0x555963b71940 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72b802ac30 con 0x555963b71940 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72ab7fe640 1 -- 172.21.15.5:0/1479224339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72c4070070 con 0x555963b71940 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 10 client.7269 fetch_fsmap learned FSMap version 46 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x555963b57160 con 0x555963b71940 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72ab7fe640 1 -- 172.21.15.5:0/1479224339 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b802ac30 con 0x555963b71940 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72ab7fe640 1 -- 172.21.15.5:0/1479224339 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f72c4057b90 con 0x555963b71940 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 10 client.7269 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 10 client.7269 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 20 client.7269 populate_metadata read hostname 'smithi005' 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963bd9a90 0x555963bd9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 4 client.7269 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555963a95630 con 0x555963bd9a90 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.155+0000 7f72d09e2640 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963bd9a90 0x555963bd9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.156+0000 7f72ab7fe640 10 client.7269 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.156+0000 7f72d09e2640 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963bd9a90 0x555963bd9e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2aca268dd06265a server_cookie=446185e52bb62fef in_seq=0 out_seq=0 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.156+0000 7f72ab7fe640 1 -- 172.21.15.5:0/1479224339 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x555963a95630 con 0x555963bd9a90 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.156+0000 7f72ab7fe640 10 client.7269 handle_command_reply: tid=0 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.156+0000 7f72d5a21740 1 client.7269 shutdown 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b71940 msgr2=0x555963b23b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b71940 0x555963b23b40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f72c400a430 tx=0x7f72c4001250 comp rx=0 tx=0).stop 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 shutdown_connections 2024-04-25T09:01:59.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x555963bd9a90 0x555963bd9e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555963b71940 0x555963b23b40 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x555963b51ef0 0x555963b23600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72ab7fe640 0 client.7269 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 --2- 172.21.15.5:0/1479224339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555963b51b10 0x555963bc2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 >> 172.21.15.5:0/1479224339 conn(0x555963b24770 msgr2=0x555963b773e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 shutdown_connections 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 1 -- 172.21.15.5:0/1479224339 wait complete. 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d5a21740 20 client.7269 trim_cache size 0 max 16384 2024-04-25T09:01:59.152 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "scrub active (324 inodes in the stack)", 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: "e6614a94-5311-49e5-aed3-49b8751d386b": { 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "~mds0", 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "e6614a94-5311-49e5-aed3-49b8751d386b", 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:01:59.153 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:01:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f72b006b4d0 msgr2=0x7f72b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d2c46640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f72b006b4d0 0x7f72b006d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f72c0001eb0 tx=0x7f72c0001610 comp rx=0 tx=0).stop 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc15dc00 msgr2=0x7f72cc1f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.157+0000 7f72d2c46640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc15dc00 0x7f72cc1f4600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c760 tx=0x7f72c400cc20 comp rx=0 tx=0).stop 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 shutdown_connections 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f72b006b4d0 0x7f72b006d990 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72cc15dc00 0x7f72cc1f4600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0ae250 0x7f72cc15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 --2- 172.21.15.5:0/3867213946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc0668f0 0x7f72cc15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 >> 172.21.15.5:0/3867213946 conn(0x7f72cc0b2560 msgr2=0x7f72cc15c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 shutdown_connections 2024-04-25T09:01:59.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:01:59.158+0000 7f72d2c46640 1 -- 172.21.15.5:0/3867213946 wait complete. 2024-04-25T09:01:59.158 INFO:tasks.cephfs.filesystem:scrub status for tag:e6614a94-5311-49e5-aed3-49b8751d386b - {'path': '~mds0', 'tag': 'e6614a94-5311-49e5-aed3-49b8751d386b', 'options': 'recursive'} 2024-04-25T09:02:17.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:17.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:29.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:29.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:02:29.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.286+0000 7f136fbc1640 1 Processor -- start 2024-04-25T09:02:29.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.287+0000 7f136fbc1640 1 -- start start 2024-04-25T09:02:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.287+0000 7f136fbc1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13680cf790 0x7f13680cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.287+0000 7f136fbc1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13680b3480 0x7f13680b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.287+0000 7f136fbc1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136815c0c0 con 0x7f136815bce0 2024-04-25T09:02:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.287+0000 7f136fbc1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136806cb10 con 0x7f13680b3480 2024-04-25T09:02:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.287+0000 7f136fbc1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1368070e90 con 0x7f13680cf790 2024-04-25T09:02:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136e15e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13680b3480 0x7f13680b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136e15e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13680b3480 0x7f13680b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48604/0 (socket says 172.21.15.5:48604) 2024-04-25T09:02:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136e15e640 1 -- 172.21.15.5:0/1608457091 learned_addr learned my addr 172.21.15.5:0/1608457091 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136d15c640 1 --2- 172.21.15.5:0/1608457091 >> v2:172.21.15.80:3300/0 conn(0x7f13680cf790 0x7f13680cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136e15e640 1 -- 172.21.15.5:0/1608457091 >> v2:172.21.15.80:3300/0 conn(0x7f13680cf790 msgr2=0x7f13680cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136e15e640 1 --2- 172.21.15.5:0/1608457091 >> v2:172.21.15.80:3300/0 conn(0x7f13680cf790 0x7f13680cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136e15e640 1 -- 172.21.15.5:0/1608457091 >> v1:172.21.15.80:6789/0 conn(0x7f136815bce0 legacy=0x7f136806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.288+0000 7f136e15e640 1 -- 172.21.15.5:0/1608457091 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368071170 con 0x7f13680b3480 2024-04-25T09:02:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.289+0000 7f136e15e640 1 --2- 172.21.15.5:0/1608457091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f13680b3890 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1368070160 tx=0x7f136002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45de9cfd1cb02666 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.289+0000 7f136c95b640 1 -- 172.21.15.5:0/1608457091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360036070 con 0x7f13680b3480 2024-04-25T09:02:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.289+0000 7f136c95b640 1 -- 172.21.15.5:0/1608457091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360031600 con 0x7f13680b3480 2024-04-25T09:02:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.289+0000 7f136c95b640 1 -- 172.21.15.5:0/1608457091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600319d0 con 0x7f13680b3480 2024-04-25T09:02:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 -- 172.21.15.5:0/1608457091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 msgr2=0x7f13680b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 --2- 172.21.15.5:0/1608457091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f13680b3890 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1368070160 tx=0x7f136002a730 comp rx=0 tx=0).stop 2024-04-25T09:02:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 -- 172.21.15.5:0/1608457091 shutdown_connections 2024-04-25T09:02:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 --2- 172.21.15.5:0/1608457091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f13680b3890 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 --2- 172.21.15.5:0/1608457091 >> v2:172.21.15.80:3300/0 conn(0x7f13680cf790 0x7f13680cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 -- 172.21.15.5:0/1608457091 >> 172.21.15.5:0/1608457091 conn(0x7f13680b1550 msgr2=0x7f13680b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 -- 172.21.15.5:0/1608457091 shutdown_connections 2024-04-25T09:02:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.290+0000 7f136fbc1640 1 -- 172.21.15.5:0/1608457091 wait complete. 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.291+0000 7f136fbc1640 1 Processor -- start 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.291+0000 7f136fbc1640 1 -- start start 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136fbc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f1368157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136fbc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13680cf790 0x7f13681512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136fbc1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136815bce0 0x7f136815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136fbc1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680b4140 con 0x7f13680b3480 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136fbc1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1368071730 con 0x7f136815bce0 2024-04-25T09:02:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136fbc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13680b3dd0 con 0x7f13680cf790 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f1368157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f1368157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48612/0 (socket says 172.21.15.5:48612) 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 -- 172.21.15.5:0/297884784 learned_addr learned my addr 172.21.15.5:0/297884784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d15c640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13680cf790 0x7f13681512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136e15e640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136815bce0 0x7f136815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 -- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13680cf790 msgr2=0x7f13681512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13680cf790 0x7f13681512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 -- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136815bce0 msgr2=0x7f136815cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136815bce0 0x7f136815cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 -- 172.21.15.5:0/297884784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13681f18d0 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f136d95d640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f1368157070 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f136400c400 tx=0x7f136400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.292+0000 7f135e7fc640 1 -- 172.21.15.5:0/297884784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640052d0 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.293+0000 7f135e7fc640 1 -- 172.21.15.5:0/297884784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1364005490 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.293+0000 7f135e7fc640 1 -- 172.21.15.5:0/297884784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364007260 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.293+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13681575b0 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.293+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1368157b60 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.294+0000 7f135e7fc640 1 -- 172.21.15.5:0/297884784 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1364007400 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.295+0000 7f135e7fc640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f134c06b4d0 0x7f134c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.295+0000 7f135e7fc640 1 -- 172.21.15.5:0/297884784 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f1364089710 con 0x7f13680b3480 2024-04-25T09:02:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.295+0000 7f136d15c640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f134c06b4d0 0x7f134c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.295+0000 7f136d15c640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f134c06b4d0 0x7f134c06d990 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f13681f5fe0 tx=0x7f1358008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 Processor -- start 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 -- start start 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461b10 0x55e545464320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461ef0 0x55e545464860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545434770 0x55e545437f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54539dda0 con 0x55e545461b10 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e545346b80 con 0x55e545434770 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e545399e40 con 0x55e545461ef0 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.296+0000 7f136d95d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461b10 0x55e545464320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461b10 0x55e545464320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48628/0 (socket says 172.21.15.5:48628) 2024-04-25T09:02:29.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 -- 172.21.15.5:0/1906685676 learned_addr learned my addr 172.21.15.5:0/1906685676 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136e15e640 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545434770 0x55e545437f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d15c640 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461ef0 0x55e545464860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 -- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461ef0 msgr2=0x55e545464860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461ef0 0x55e545464860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 -- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545434770 msgr2=0x55e545437f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545434770 0x55e545437f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 -- 172.21.15.5:0/1906685676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e545350f10 con 0x55e545461b10 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f136d95d640 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461b10 0x55e545464320 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1364060090 tx=0x7f1364000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5a2c8782dbfb6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f134b7fe640 1 -- 172.21.15.5:0/1906685676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364055f50 con 0x55e545461b10 2024-04-25T09:02:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f134b7fe640 1 -- 172.21.15.5:0/1906685676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640561b0 con 0x55e545461b10 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.297+0000 7f134b7fe640 1 -- 172.21.15.5:0/1906685676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136405e0c0 con 0x55e545461b10 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 -- 172.21.15.5:0/1906685676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461b10 msgr2=0x55e545464320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461b10 0x55e545464320 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1364060090 tx=0x7f1364000ed0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 -- 172.21.15.5:0/1906685676 shutdown_connections 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545434770 0x55e545437f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461ef0 0x55e545464860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 --2- 172.21.15.5:0/1906685676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461b10 0x55e545464320 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 -- 172.21.15.5:0/1906685676 >> 172.21.15.5:0/1906685676 conn(0x55e5454369e0 msgr2=0x55e54547f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 -- 172.21.15.5:0/1906685676 shutdown_connections 2024-04-25T09:02:29.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 -- 172.21.15.5:0/1906685676 wait complete. 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.298+0000 7f13729a2740 1 -- start start 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.299+0000 7f13729a2740 1 Processor -- start 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.299+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545461b10 0x55e5454651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.299+0000 7f13729a2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.299+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545433a00 0x55e545458aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.299+0000 7f13729a2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e545439b90 con 0x55e545461ef0 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.299+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54533c4b0 con 0x55e545461b10 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.299+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e545439e70 con 0x55e545433a00 2024-04-25T09:02:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f13729a2740 10 client.0 _ll_register_callbacks cb 0x55e54537c180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454671f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48638/0 (socket says 172.21.15.5:48638) 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 -- 172.21.15.5:0/3811759450 learned_addr learned my addr 172.21.15.5:0/3811759450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d95d640 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545461b10 0x55e5454651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136e15e640 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545433a00 0x55e545458aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 -- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545433a00 msgr2=0x55e545458aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545433a00 0x55e545458aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 -- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545461b10 msgr2=0x55e5454651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545461b10 0x55e5454651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 -- 172.21.15.5:0/3811759450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e54517c7d0 con 0x55e545461ef0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f136d15c640 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454671f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f1368072760 tx=0x7f13580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65dfcda9f8f121e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f1348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f1348ff9640 1 -- 172.21.15.5:0/3811759450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358014520 con 0x55e545461ef0 2024-04-25T09:02:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f1348ff9640 1 -- 172.21.15.5:0/3811759450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f13580146c0 con 0x55e545461ef0 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13640561b0 con 0x55e545461ef0 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.300+0000 7f1348ff9640 1 -- 172.21.15.5:0/3811759450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1358032050 con 0x55e545461ef0 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 10 client.7281 fetch_fsmap learned FSMap version 46 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55e5450b23f0 con 0x55e545461ef0 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f1348ff9640 1 -- 172.21.15.5:0/3811759450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640561b0 con 0x55e545461ef0 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f1348ff9640 1 -- 172.21.15.5:0/3811759450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1358035020 con 0x55e545461ef0 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 10 client.7281 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 10 client.7281 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 20 client.7281 populate_metadata read hostname 'smithi005' 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e545480920 0x55e545480d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 4 client.7281 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:29.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5453ab2e0 con 0x55e545480920 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f136d95d640 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e545480920 0x55e545480d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f1348ff9640 10 client.7281 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.301+0000 7f136d95d640 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e545480920 0x55e545480d70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e6696e848e0f98b server_cookie=886df8fcb63585f9 in_seq=0 out_seq=0 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f1348ff9640 1 -- 172.21.15.5:0/3811759450 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e5453ab2e0 con 0x55e545480920 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f1348ff9640 10 client.7281 handle_command_reply: tid=0 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 client.7281 shutdown 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 msgr2=0x55e5454671f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454671f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f1368072760 tx=0x7f13580046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 shutdown_connections 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e545480920 0x55e545480d70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545433a00 0x55e545458aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454671f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f1348ff9640 0 client.7281 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 --2- 172.21.15.5:0/3811759450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545461b10 0x55e5454651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.302+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 >> 172.21.15.5:0/3811759450 conn(0x55e545434770 msgr2=0x55e545439380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.303+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 shutdown_connections 2024-04-25T09:02:29.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.303+0000 7f13729a2740 1 -- 172.21.15.5:0/3811759450 wait complete. 2024-04-25T09:02:29.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.303+0000 7f13729a2740 20 client.7281 trim_cache size 0 max 16384 2024-04-25T09:02:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.318+0000 7f13729a2740 1 Processor -- start 2024-04-25T09:02:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.318+0000 7f13729a2740 1 -- start start 2024-04-25T09:02:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e545439e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e54545f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f13729a2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f13729a2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13681fe130 con 0x55e545461ef0 2024-04-25T09:02:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13681fd330 con 0x55e545433a00 2024-04-25T09:02:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1368152d10 con 0x55e545461b10 2024-04-25T09:02:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48646/0 (socket says 172.21.15.5:48646) 2024-04-25T09:02:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 -- 172.21.15.5:0/2748669078 learned_addr learned my addr 172.21.15.5:0/2748669078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136d15c640 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e54545f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136d95d640 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e545439e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 -- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 msgr2=0x55e54545f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e54545f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 -- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 msgr2=0x55e545439e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e545439e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 -- 172.21.15.5:0/2748669078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5450720f0 con 0x55e545461ef0 2024-04-25T09:02:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f136e15e640 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454644d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f1360034040 tx=0x7f136002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d847e3334e1e9da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.319+0000 7f134affd640 1 -- 172.21.15.5:0/2748669078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360036040 con 0x55e545461ef0 2024-04-25T09:02:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f134affd640 1 -- 172.21.15.5:0/2748669078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136003e640 con 0x55e545461ef0 2024-04-25T09:02:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f134affd640 1 -- 172.21.15.5:0/2748669078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136003ea30 con 0x55e545461ef0 2024-04-25T09:02:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 -- 172.21.15.5:0/2748669078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 msgr2=0x55e5454644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454644d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f1360034040 tx=0x7f136002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 -- 172.21.15.5:0/2748669078 shutdown_connections 2024-04-25T09:02:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454644d0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e54545f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 --2- 172.21.15.5:0/2748669078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e545439e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 -- 172.21.15.5:0/2748669078 >> 172.21.15.5:0/2748669078 conn(0x55e545434770 msgr2=0x55e54543b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 -- 172.21.15.5:0/2748669078 shutdown_connections 2024-04-25T09:02:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.320+0000 7f13729a2740 1 -- 172.21.15.5:0/2748669078 wait complete. 2024-04-25T09:02:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.321+0000 7f13729a2740 1 -- start start 2024-04-25T09:02:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.321+0000 7f13729a2740 1 Processor -- start 2024-04-25T09:02:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e54547fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e545482c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54535f4b0 con 0x55e545461ef0 2024-04-25T09:02:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1368153310 con 0x55e545433a00 2024-04-25T09:02:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e54548ee90 con 0x55e545461b10 2024-04-25T09:02:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 10 client.0 _ll_register_callbacks cb 0x7f1364054150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454831a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48658/0 (socket says 172.21.15.5:48658) 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 -- 172.21.15.5:0/49175131 learned_addr learned my addr 172.21.15.5:0/49175131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136d15c640 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e545482c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136d95d640 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e54547fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 -- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 msgr2=0x55e545482c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e545482c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 -- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 msgr2=0x55e54547fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e54547fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 -- 172.21.15.5:0/49175131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e545480150 con 0x55e545461ef0 2024-04-25T09:02:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f136e15e640 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454831a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f136002af10 tx=0x7f1360004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9edcf736fe8ddcb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f1348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f1348ff9640 1 -- 172.21.15.5:0/49175131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360050060 con 0x55e545461ef0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f1348ff9640 1 -- 172.21.15.5:0/49175131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f1360003ba0 con 0x55e545461ef0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.322+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f136003e640 con 0x55e545461ef0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f1348ff9640 1 -- 172.21.15.5:0/49175131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1360056050 con 0x55e545461ef0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 10 client.7287 fetch_fsmap learned FSMap version 46 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55e5454357a0 con 0x55e545461ef0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f1348ff9640 1 -- 172.21.15.5:0/49175131 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136003e640 con 0x55e545461ef0 2024-04-25T09:02:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f1348ff9640 1 -- 172.21.15.5:0/49175131 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1360059020 con 0x55e545461ef0 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 10 client.7287 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 10 client.7287 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 20 client.7287 populate_metadata read hostname 'smithi005' 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e5454eda60 0x55e545474cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 4 client.7287 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e5453a5630 con 0x55e5454eda60 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f136d95d640 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e5454eda60 0x55e545474cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f1348ff9640 10 client.7287 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.323+0000 7f136d95d640 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e5454eda60 0x55e545474cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8c661cb4d65dffd server_cookie=6e9a5132702a09cb in_seq=0 out_seq=0 2024-04-25T09:02:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f1348ff9640 1 -- 172.21.15.5:0/49175131 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e5453a5630 con 0x55e5454eda60 2024-04-25T09:02:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f1348ff9640 10 client.7287 handle_command_reply: tid=0 2024-04-25T09:02:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 client.7287 shutdown 2024-04-25T09:02:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 msgr2=0x55e5454831a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454831a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f136002af10 tx=0x7f1360004ab0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 shutdown_connections 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e5454eda60 0x55e545474cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e545461ef0 0x55e5454831a0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e545461b10 0x55e545482c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f1348ff9640 0 client.7287 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 --2- 172.21.15.5:0/49175131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e545433a00 0x55e54547fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 >> 172.21.15.5:0/49175131 conn(0x55e545434770 msgr2=0x55e545466520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 shutdown_connections 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 1 -- 172.21.15.5:0/49175131 wait complete. 2024-04-25T09:02:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f13729a2740 20 client.7287 trim_cache size 0 max 16384 2024-04-25T09:02:29.328 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:02:29.328 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-04-25T09:02:29.328 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T09:02:29.328 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:02:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f134c06b4d0 msgr2=0x7f134c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f136fbc1640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f134c06b4d0 0x7f134c06d990 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f13681f5fe0 tx=0x7f1358008040 comp rx=0 tx=0).stop 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 msgr2=0x7f1368157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f136fbc1640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f1368157070 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f136400c400 tx=0x7f136400c8c0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 shutdown_connections 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f136fbc1640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f134c06b4d0 0x7f134c06d990 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.324+0000 7f136fbc1640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136815bce0 0x7f136815cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.325+0000 7f136fbc1640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f13680cf790 0x7f13681512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.325+0000 7f136fbc1640 1 --2- 172.21.15.5:0/297884784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13680b3480 0x7f1368157070 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.325+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 >> 172.21.15.5:0/297884784 conn(0x7f13680b1550 msgr2=0x7f1368153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.325+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 shutdown_connections 2024-04-25T09:02:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.325+0000 7f136fbc1640 1 -- 172.21.15.5:0/297884784 wait complete. 2024-04-25T09:02:29.331 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:02:29.331 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:02:29.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.445+0000 7fc684fb0640 1 Processor -- start 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.445+0000 7fc684fb0640 1 -- start start 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.446+0000 7fc684fb0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6801614b0 0x7fc6800b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.446+0000 7fc684fb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d1f60 0x7fc6800d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.446+0000 7fc684fb0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6800d2740 con 0x7fc6800d4060 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.446+0000 7fc684fb0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800d2a20 con 0x7fc6801614b0 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.446+0000 7fc684fb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800d2d00 con 0x7fc6800d1f60 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.446+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d1f60 0x7fc6800d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.446+0000 7fc67e59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6801614b0 0x7fc6800b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.447+0000 7fc67e59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6801614b0 0x7fc6800b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:57594/0 (socket says 172.21.15.5:57594) 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.447+0000 7fc67ed9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6800d4060 0x7fc6800b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:45832/0 (socket says 172.21.15.5:45832) 2024-04-25T09:02:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.447+0000 7fc67e59c640 1 -- 172.21.15.5:0/349877569 learned_addr learned my addr 172.21.15.5:0/349877569 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.447+0000 7fc67dd9b640 1 -- 172.21.15.5:0/349877569 >> v2:172.21.15.80:3300/0 conn(0x7fc6801614b0 msgr2=0x7fc6800b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.447+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/349877569 >> v2:172.21.15.80:3300/0 conn(0x7fc6801614b0 0x7fc6800b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.447+0000 7fc67dd9b640 1 -- 172.21.15.5:0/349877569 >> v1:172.21.15.80:6789/0 conn(0x7fc6800d4060 legacy=0x7fc6800b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.447+0000 7fc67dd9b640 1 -- 172.21.15.5:0/349877569 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800d2fe0 con 0x7fc6800d1f60 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/349877569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d1f60 0x7fc6800d3b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6740097a0 tx=0x7fc67402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=286e6afc30ac179 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc67d59a640 1 -- 172.21.15.5:0/349877569 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674037070 con 0x7fc6800d1f60 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc67d59a640 1 -- 172.21.15.5:0/349877569 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc674032440 con 0x7fc6800d1f60 2024-04-25T09:02:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc67d59a640 1 -- 172.21.15.5:0/349877569 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674032810 con 0x7fc6800d1f60 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 -- 172.21.15.5:0/349877569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d1f60 msgr2=0x7fc6800d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 --2- 172.21.15.5:0/349877569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d1f60 0x7fc6800d3b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6740097a0 tx=0x7fc67402a180 comp rx=0 tx=0).stop 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 -- 172.21.15.5:0/349877569 shutdown_connections 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 --2- 172.21.15.5:0/349877569 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d1f60 0x7fc6800d3b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 --2- 172.21.15.5:0/349877569 >> v2:172.21.15.80:3300/0 conn(0x7fc6801614b0 0x7fc6800b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 -- 172.21.15.5:0/349877569 >> 172.21.15.5:0/349877569 conn(0x7fc68006b000 msgr2=0x7fc68006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 -- 172.21.15.5:0/349877569 shutdown_connections 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.448+0000 7fc684fb0640 1 -- 172.21.15.5:0/349877569 wait complete. 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 Processor -- start 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 -- start start 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6800d1f60 0x7fc6801575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d4060 0x7fc6800ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6801614b0 0x7fc6800ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800d23a0 con 0x7fc6801614b0 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800d37e0 con 0x7fc6800d1f60 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.450+0000 7fc684fb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800d2520 con 0x7fc6800d4060 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6801614b0 0x7fc6800ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6801614b0 0x7fc6800ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48670/0 (socket says 172.21.15.5:48670) 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1020126370 learned_addr learned my addr 172.21.15.5:0/1020126370 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d4060 0x7fc6800ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67e59c640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6800d1f60 0x7fc6801575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d4060 msgr2=0x7fc6800ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d4060 0x7fc6800ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6800d1f60 msgr2=0x7fc6801575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6800d1f60 0x7fc6801575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1020126370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800c8310 con 0x7fc6801614b0 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6801614b0 0x7fc6800ce720 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c3c0 tx=0x7fc67800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc66effd640 1 -- 172.21.15.5:0/1020126370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780074e0 con 0x7fc6801614b0 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc66effd640 1 -- 172.21.15.5:0/1020126370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678007680 con 0x7fc6801614b0 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6800c85f0 con 0x7fc6801614b0 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc66effd640 1 -- 172.21.15.5:0/1020126370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678004a00 con 0x7fc6801614b0 2024-04-25T09:02:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.451+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6800c8bb0 con 0x7fc6801614b0 2024-04-25T09:02:29.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.453+0000 7fc66effd640 1 -- 172.21.15.5:0/1020126370 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc67801a020 con 0x7fc6801614b0 2024-04-25T09:02:29.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.453+0000 7fc66effd640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc66006b4d0 0x7fc66006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.453+0000 7fc66effd640 1 -- 172.21.15.5:0/1020126370 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc678089920 con 0x7fc6801614b0 2024-04-25T09:02:29.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.454+0000 7fc67e59c640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc66006b4d0 0x7fc66006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.454+0000 7fc67e59c640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc66006b4d0 0x7fc66006d990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc670011340 tx=0x7fc67000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.454+0000 7fc687d8d740 1 Processor -- start 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc687d8d740 1 -- start start 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e46e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e45080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e6fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc687d8d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7da7b90 con 0x55e9c7e81370 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7d50e40 con 0x55e9c7e44ca0 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7da3c30 con 0x55e9c7e6f760 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e45080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48686/0 (socket says 172.21.15.5:48686) 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc67dd9b640 1 -- 172.21.15.5:0/2719303462 learned_addr learned my addr 172.21.15.5:0/2719303462 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc67e59c640 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e46e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.455+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e6fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc67dd9b640 1 -- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 msgr2=0x55e9c7e6fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e6fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc67dd9b640 1 -- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 msgr2=0x55e9c7e46e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e46e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc67dd9b640 1 -- 172.21.15.5:0/2719303462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9c7b867d0 con 0x55e9c7e81370 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e45080 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc674000c00 tx=0x7fc67402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0815a8b16cd2d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc65ffff640 1 -- 172.21.15.5:0/2719303462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674037040 con 0x55e9c7e81370 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc65ffff640 1 -- 172.21.15.5:0/2719303462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6740327a0 con 0x55e9c7e81370 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.456+0000 7fc65ffff640 1 -- 172.21.15.5:0/2719303462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674032b90 con 0x55e9c7e81370 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 -- 172.21.15.5:0/2719303462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 msgr2=0x55e9c7e45080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e45080 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc674000c00 tx=0x7fc67402c000 comp rx=0 tx=0).stop 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 -- 172.21.15.5:0/2719303462 shutdown_connections 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e6fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e45080 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2719303462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e46e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 -- 172.21.15.5:0/2719303462 >> 172.21.15.5:0/2719303462 conn(0x55e9c7e0c870 msgr2=0x55e9c7e8a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 -- 172.21.15.5:0/2719303462 shutdown_connections 2024-04-25T09:02:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 -- 172.21.15.5:0/2719303462 wait complete. 2024-04-25T09:02:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.457+0000 7fc687d8d740 1 -- start start 2024-04-25T09:02:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 1 Processor -- start 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e58820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e84090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e84c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7d643e0 con 0x55e9c7e81370 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7e6d2b0 con 0x55e9c7e44ca0 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7e71200 con 0x55e9c7e6f760 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.458+0000 7fc687d8d740 10 client.0 _ll_register_callbacks cb 0x55e9c7d63db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e84c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e84090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e84c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48700/0 (socket says 172.21.15.5:48700) 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 -- 172.21.15.5:0/2612412705 learned_addr learned my addr 172.21.15.5:0/2612412705 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67e59c640 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e58820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 -- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 msgr2=0x55e9c7e84090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e84090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 -- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 msgr2=0x55e9c7e58820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e58820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 -- 172.21.15.5:0/2612412705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9c7a7c0f0 con 0x55e9c7e81370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e84090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e84c70 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc678058000 tx=0x7fc67805c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ad9752809fc0ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc65d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc65d7fa640 1 -- 172.21.15.5:0/2612412705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678074060 con 0x55e9c7e81370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc65d7fa640 1 -- 172.21.15.5:0/2612412705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc678060240 con 0x55e9c7e81370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6740327a0 con 0x55e9c7e81370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc65d7fa640 1 -- 172.21.15.5:0/2612412705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc678056430 con 0x55e9c7e81370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc687d8d740 10 client.7296 fetch_fsmap learned FSMap version 46 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.459+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55e9c7be6f60 con 0x55e9c7e81370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc65d7fa640 1 -- 172.21.15.5:0/2612412705 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6740327a0 con 0x55e9c7e81370 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc65d7fa640 1 -- 172.21.15.5:0/2612412705 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc67805a030 con 0x55e9c7e81370 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc687d8d740 10 client.7296 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc687d8d740 10 client.7296 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc687d8d740 20 client.7296 populate_metadata read hostname 'smithi005' 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7e85340 0x55e9c7e5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc687d8d740 4 client.7296 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9c7db50d0 con 0x55e9c7e85340 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc67e59c640 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7e85340 0x55e9c7e5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc67e59c640 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7e85340 0x55e9c7e5a170 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e5fad0fbd72d44 server_cookie=6fd3e4ccc156c536 in_seq=0 out_seq=0 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.460+0000 7fc65d7fa640 10 client.7296 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc65d7fa640 1 -- 172.21.15.5:0/2612412705 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e9c7db50d0 con 0x55e9c7e85340 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc65d7fa640 10 client.7296 handle_command_reply: tid=0 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 client.7296 shutdown 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 msgr2=0x55e9c7e84c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e84c70 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc678058000 tx=0x7fc67805c1d0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 shutdown_connections 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7e85340 0x55e9c7e5a170 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e84c70 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e6f760 0x55e9c7e84090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc65d7fa640 0 client.7296 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 --2- 172.21.15.5:0/2612412705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e58820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 >> 172.21.15.5:0/2612412705 conn(0x55e9c7e0c870 msgr2=0x55e9c7e6a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 shutdown_connections 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 1 -- 172.21.15.5:0/2612412705 wait complete. 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.461+0000 7fc687d8d740 20 client.7296 trim_cache size 0 max 16384 2024-04-25T09:02:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.475+0000 7fc687d8d740 1 Processor -- start 2024-04-25T09:02:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.475+0000 7fc687d8d740 1 -- start start 2024-04-25T09:02:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e44ca0 0x55e9c7e6f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e6f760 0x55e9c7e575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e59f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc687d8d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6802001b0 con 0x55e9c7e81370 2024-04-25T09:02:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801ff390 con 0x55e9c7e6f760 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801f4650 con 0x55e9c7e44ca0 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e59f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e59f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48714/0 (socket says 172.21.15.5:48714) 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1345825372 learned_addr learned my addr 172.21.15.5:0/1345825372 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e6f760 0x55e9c7e575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.476+0000 7fc67e59c640 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e44ca0 0x55e9c7e6f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e44ca0 msgr2=0x55e9c7e6f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e44ca0 0x55e9c7e6f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e6f760 msgr2=0x55e9c7e575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e6f760 0x55e9c7e575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc67ed9d640 1 -- 172.21.15.5:0/1345825372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9c7a551b0 con 0x55e9c7e81370 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e59f30 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc678054480 tx=0x7fc67806d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60b2e5837f62b8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc65f7fe640 1 -- 172.21.15.5:0/1345825372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678074070 con 0x55e9c7e81370 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc65f7fe640 1 -- 172.21.15.5:0/1345825372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67806f030 con 0x55e9c7e81370 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc65f7fe640 1 -- 172.21.15.5:0/1345825372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678058070 con 0x55e9c7e81370 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 -- 172.21.15.5:0/1345825372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 msgr2=0x55e9c7e59f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e59f30 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc678054480 tx=0x7fc67806d000 comp rx=0 tx=0).stop 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 -- 172.21.15.5:0/1345825372 shutdown_connections 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e81370 0x55e9c7e59f30 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e6f760 0x55e9c7e575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 --2- 172.21.15.5:0/1345825372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e44ca0 0x55e9c7e6f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 -- 172.21.15.5:0/1345825372 >> 172.21.15.5:0/1345825372 conn(0x55e9c7e0c870 msgr2=0x55e9c7e58630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 -- 172.21.15.5:0/1345825372 shutdown_connections 2024-04-25T09:02:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.477+0000 7fc687d8d740 1 -- 172.21.15.5:0/1345825372 wait complete. 2024-04-25T09:02:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.478+0000 7fc687d8d740 1 -- start start 2024-04-25T09:02:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.478+0000 7fc687d8d740 1 Processor -- start 2024-04-25T09:02:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e83b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e6f760 0x55e9c7e8e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc687d8d740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e81370 0x55e9c7ef30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc687d8d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7e41c50 con 0x55e9c7e6f760 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801f4c50 con 0x55e9c7e44ca0 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc687d8d740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9c7e68970 con 0x55e9c7e81370 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc687d8d740 10 client.0 _ll_register_callbacks cb 0x55e9c7e417d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e6f760 0x55e9c7e8e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e6f760 0x55e9c7e8e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48720/0 (socket says 172.21.15.5:48720) 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 -- 172.21.15.5:0/536518598 learned_addr learned my addr 172.21.15.5:0/536518598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67ed9d640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e81370 0x55e9c7ef30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67e59c640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e83b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 -- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e81370 msgr2=0x55e9c7ef30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e81370 0x55e9c7ef30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 -- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 msgr2=0x55e9c7e83b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e83b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67dd9b640 1 -- 172.21.15.5:0/536518598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9c7e840c0 con 0x55e9c7e6f760 2024-04-25T09:02:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.479+0000 7fc67e59c640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e83b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc67dd9b640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e6f760 0x55e9c7e8e2f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc6740098c0 tx=0x7fc674004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10798266f0dab953 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc65d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc65d7fa640 1 -- 172.21.15.5:0/536518598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674037040 con 0x55e9c7e6f760 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc65d7fa640 1 -- 172.21.15.5:0/536518598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc674003b70 con 0x55e9c7e6f760 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc67806f030 con 0x55e9c7e6f760 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc65d7fa640 1 -- 172.21.15.5:0/536518598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc674003d70 con 0x55e9c7e6f760 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 10 client.7302 fetch_fsmap learned FSMap version 46 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55e9c7e68b10 con 0x55e9c7e6f760 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc65d7fa640 1 -- 172.21.15.5:0/536518598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67806f030 con 0x55e9c7e6f760 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc65d7fa640 1 -- 172.21.15.5:0/536518598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc674053030 con 0x55e9c7e6f760 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 10 client.7302 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 10 client.7302 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 20 client.7302 populate_metadata read hostname 'smithi005' 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7ef35f0 0x55e9c7e6a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 4 client.7302 mds_command: new command op to 7038 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 --> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55e9c7daf420 con 0x55e9c7ef35f0 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.480+0000 7fc67e59c640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7ef35f0 0x55e9c7e6a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.481+0000 7fc65d7fa640 10 client.7302 ms_handle_connect on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.481+0000 7fc67e59c640 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7ef35f0 0x55e9c7e6a430 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=823ba6ed2babd8a3 server_cookie=5d2c41701448e231 in_seq=0 out_seq=0 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.481+0000 7fc65d7fa640 1 -- 172.21.15.5:0/536518598 <== mds.0 v2:172.21.15.80:6835/1546784484 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17937 (crc 0 0 0) 0x55e9c7daf420 con 0x55e9c7ef35f0 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.481+0000 7fc65d7fa640 10 client.7302 handle_command_reply: tid=0 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.481+0000 7fc687d8d740 1 client.7302 shutdown 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.481+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e6f760 msgr2=0x55e9c7e8e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.481+0000 7fc687d8d740 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e6f760 0x55e9c7e8e2f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc6740098c0 tx=0x7fc674004730 comp rx=0 tx=0).stop 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 shutdown_connections 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:6835/1546784484,v1:172.21.15.80:6837/1546784484] conn(0x55e9c7ef35f0 0x55e9c7e6a430 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9c7e81370 0x55e9c7ef30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9c7e6f760 0x55e9c7e8e2f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 --2- 172.21.15.5:0/536518598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9c7e44ca0 0x55e9c7e83b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc65d7fa640 0 client.7302 ms_handle_reset on v2:172.21.15.80:6835/1546784484 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 >> 172.21.15.5:0/536518598 conn(0x55e9c7e0c870 msgr2=0x55e9c7e8d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 shutdown_connections 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 1 -- 172.21.15.5:0/536518598 wait complete. 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc687d8d740 20 client.7302 trim_cache size 0 max 16384 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2317, 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2312, 2024-04-25T09:02:29.476 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 1091389, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 18316995, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 16, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 6, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.251629786, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.128621407, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.052532955, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.060802468, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2311, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.430066870, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000186095 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 10, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000767, 2024-04-25T09:02:29.477 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000076 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 119808, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 24912 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 28354, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 50443, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 9347349, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 56845279, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 1.907727906, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.953587578, 2024-04-25T09:02:29.478 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.118197384, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.063837902, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 50442, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.277645760, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000025329 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 71513, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.008047870, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000112 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 119104 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.479 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 4514, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 4514, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 1136047, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 36551885, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.397522652, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.191037792, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.077099347, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.112508735, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4513, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.540645213, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000119797 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.480 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2844, 2024-04-25T09:02:29.481 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 15.530044549, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.005460634 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3751, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.136898034, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000303091 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 25653, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 25653, 2024-04-25T09:02:29.482 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 25653, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 361.895493674, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.014107336 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 17899, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 17899, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-04-25T09:02:29.483 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 17899, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 2, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 2, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 47582, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 47088, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 133, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-04-25T09:02:29.484 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 2011, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 2011, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 11, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 1, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 10, 2024-04-25T09:02:29.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 2000, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 697, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4020, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 2732, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2220, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 66, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 13972 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-04-25T09:02:29.486 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4147, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 3870, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2244, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 1, 2024-04-25T09:02:29.487 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 25742, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 25742, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 35, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-04-25T09:02:29.488 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 35, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 94604533, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2621, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 91.830818966, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.035036558 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-04-25T09:02:29.489 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 14, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2015, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 2001, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 17899, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19900, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 2001, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 2, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 8727, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 8725, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 102160, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 215396 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 29040, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 25653, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 5, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.302620662, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000651310 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004237087, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000146106 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.730345375, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001288390 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7367, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 6.032384604, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000818838 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-04-25T09:02:29.493 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000235276, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000235276 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-04-25T09:02:29.494 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.002663371, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002663371 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.102996970, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.102996970 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.239516263, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.029939532 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2244, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 330.246418008, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.147168635 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.042105957, 2024-04-25T09:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.042105957 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000288236, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000288236 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.191681865, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002023960 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-04-25T09:02:29.500 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18617, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18617, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 74, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T09:02:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-04-25T09:02:29.503 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 250091, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 92, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 440, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 5, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-04-25T09:02:29.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5704, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 83, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 13477925, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 661513, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-04-25T09:02:29.505 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 8761, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 91102819, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 36, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 8761, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8761, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 26.762416531, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003054721 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8761, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 8854 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 8761, 2024-04-25T09:02:29.506 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 2071, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 6690, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 59, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2679, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 36, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1870, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 2033, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-04-25T09:02:29.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 2012, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-04-25T09:02:29.508 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 77, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-04-25T09:02:29.509 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 5, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 105, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 27 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-04-25T09:02:29.510 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 3870, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 3870, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:02:29.511 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 35181, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 8403037, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 35181, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 35181, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8403037, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:02:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8761, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 91508649, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8761, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 91508649, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8761, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 8761, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8761, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8761, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3870, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 405830, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3870, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 58, 2024-04-25T09:02:29.515 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 405830, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x55e7d37006e0": { 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 25742, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 90410229, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 25742, 2024-04-25T09:02:29.516 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2621, 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 90410229, 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc66006b4d0 msgr2=0x7fc66006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc66006b4d0 0x7fc66006d990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc670011340 tx=0x7fc67000b040 comp rx=0 tx=0).stop 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6801614b0 msgr2=0x7fc6800ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6801614b0 0x7fc6800ce720 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c3c0 tx=0x7fc67800c880 comp rx=0 tx=0).stop 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 shutdown_connections 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc66006b4d0 0x7fc66006d990 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6801614b0 0x7fc6800ce720 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc6800d4060 0x7fc6800ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 --2- 172.21.15.5:0/1020126370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6800d1f60 0x7fc6801575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 >> 172.21.15.5:0/1020126370 conn(0x7fc68006b000 msgr2=0x7fc68006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 shutdown_connections 2024-04-25T09:02:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.482+0000 7fc684fb0640 1 -- 172.21.15.5:0/1020126370 wait complete. 2024-04-25T09:02:29.520 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:02:29.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:02:29.558 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:02:29.609 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:02:29.609 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:02:29.609 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:29.625 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:02:29.625 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:29.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.833+0000 7febf83b7640 1 Processor -- start 2024-04-25T09:02:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.833+0000 7febf83b7640 1 -- start start 2024-04-25T09:02:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.834+0000 7febf83b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febf0071de0 0x7febf00b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.834+0000 7febf83b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf015be80 con 0x7febf0154f80 2024-04-25T09:02:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.834+0000 7febf83b7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf015b5e0 con 0x7febf015af20 2024-04-25T09:02:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.834+0000 7febf83b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf015b3b0 con 0x7febf0071de0 2024-04-25T09:02:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.834+0000 7febf6153640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7febf0154f80 0x7febf015eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41014/0 (socket says 172.21.15.5:41014) 2024-04-25T09:02:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.834+0000 7febf6153640 1 -- 172.21.15.5:0/2649627294 learned_addr learned my addr 172.21.15.5:0/2649627294 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.834+0000 7febf6954640 1 --2- 172.21.15.5:0/2649627294 >> v2:172.21.15.80:3300/0 conn(0x7febf0071de0 0x7febf00b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950727362 0 0) 0x7febf015be80 con 0x7febf0154f80 2024-04-25T09:02:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd8003520 con 0x7febf0154f80 2024-04-25T09:02:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2473045529 0 0) 0x7febd8003520 con 0x7febf0154f80 2024-04-25T09:02:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 >> v2:172.21.15.80:3300/0 conn(0x7febf0071de0 msgr2=0x7febf00b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 --2- 172.21.15.5:0/2649627294 >> v2:172.21.15.80:3300/0 conn(0x7febf0071de0 0x7febf00b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 >> v1:172.21.15.80:6789/0 conn(0x7febf015af20 legacy=0x7febf0158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf015b8c0 con 0x7febf0154f80 2024-04-25T09:02:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7febe8001670 con 0x7febf0154f80 2024-04-25T09:02:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 >> v1:172.21.15.5:6789/0 conn(0x7febf0154f80 legacy=0x7febf015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febd80039b0 0x7febd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febd80051c0 0x7febd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd800c130 con 0x7febd8004800 2024-04-25T09:02:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd800c2e0 con 0x7febd80039b0 2024-04-25T09:02:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd800c4e0 con 0x7febd80051c0 2024-04-25T09:02:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5952640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf6153640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febd80039b0 0x7febd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf6954640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febd80051c0 0x7febd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5952640 1 -- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febd80051c0 msgr2=0x7febd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5952640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febd80051c0 0x7febd800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5952640 1 -- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febd80039b0 msgr2=0x7febd8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5952640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febd80039b0 0x7febd8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf5952640 1 -- 172.21.15.5:0/2649627294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8003520 con 0x7febd8004800 2024-04-25T09:02:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf6954640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febd80051c0 0x7febd800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.835+0000 7febf6954640 1 -- 172.21.15.5:0/2649627294 reap_dead start 2024-04-25T09:02:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.836+0000 7febf5952640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febd8004c80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7febe4001750 tx=0x7febd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cfe28db907e92a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.836+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4001370 con 0x7febd8004800 2024-04-25T09:02:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.836+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe40052d0 con 0x7febd8004800 2024-04-25T09:02:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.836+0000 7febf5151640 1 -- 172.21.15.5:0/2649627294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe402abc0 con 0x7febd8004800 2024-04-25T09:02:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.837+0000 7febf83b7640 1 -- 172.21.15.5:0/2649627294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 msgr2=0x7febd8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.837+0000 7febf83b7640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febd8004c80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7febe4001750 tx=0x7febd8005830 comp rx=0 tx=0).stop 2024-04-25T09:02:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.837+0000 7febf83b7640 1 -- 172.21.15.5:0/2649627294 shutdown_connections 2024-04-25T09:02:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.837+0000 7febf83b7640 1 --2- 172.21.15.5:0/2649627294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febd8004c80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.837+0000 7febf83b7640 1 -- 172.21.15.5:0/2649627294 >> 172.21.15.5:0/2649627294 conn(0x7febf00668f0 msgr2=0x7febf0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.837+0000 7febf83b7640 1 -- 172.21.15.5:0/2649627294 shutdown_connections 2024-04-25T09:02:29.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.837+0000 7febf83b7640 1 -- 172.21.15.5:0/2649627294 wait complete. 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.838+0000 7febf83b7640 1 Processor -- start 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.838+0000 7febf83b7640 1 -- start start 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf83b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febf00ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf83b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febf0148160 0x7febf014ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf83b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febf014b250 0x7febf00cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf83b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf0072250 con 0x7febd8004800 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf83b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf015e640 con 0x7febf0148160 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf83b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf0155360 con 0x7febf014b250 2024-04-25T09:02:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febf00ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febf00ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48742/0 (socket says 172.21.15.5:48742) 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 -- 172.21.15.5:0/1815792347 learned_addr learned my addr 172.21.15.5:0/1815792347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf5952640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febf0148160 0x7febf014ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6954640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febf014b250 0x7febf00cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 -- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febf014b250 msgr2=0x7febf00cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febf014b250 0x7febf00cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 -- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febf0148160 msgr2=0x7febf014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febf0148160 0x7febf014ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 -- 172.21.15.5:0/1815792347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf014b6d0 con 0x7febd8004800 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.839+0000 7febf6153640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febf00ce7e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7febe8004f30 tx=0x7febe80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.840+0000 7febeeffd640 1 -- 172.21.15.5:0/1815792347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe801a070 con 0x7febd8004800 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.840+0000 7febeeffd640 1 -- 172.21.15.5:0/1815792347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800f7b0 con 0x7febd8004800 2024-04-25T09:02:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.840+0000 7febeeffd640 1 -- 172.21.15.5:0/1815792347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800fba0 con 0x7febd8004800 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.840+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf00cd740 con 0x7febd8004800 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.840+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf00cdd00 con 0x7febd8004800 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.841+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf004ef20 con 0x7febd8004800 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.841+0000 7febeeffd640 1 -- 172.21.15.5:0/1815792347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7febe801d070 con 0x7febd8004800 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.842+0000 7febeeffd640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febdc06b4d0 0x7febdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.842+0000 7febeeffd640 1 -- 172.21.15.5:0/1815792347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7febe8089b80 con 0x7febd8004800 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.842+0000 7febf5952640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febdc06b4d0 0x7febdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.842+0000 7febf5952640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febdc06b4d0 0x7febdc06d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7febe4032000 tx=0x7febe402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:29.846+0000 7febeeffd640 1 -- 172.21.15.5:0/1815792347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febe8058910 con 0x7febd8004800 2024-04-25T09:02:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.027+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febf006b3a0 con 0x7febd8004800 2024-04-25T09:02:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.028+0000 7febeeffd640 1 -- 172.21.15.5:0/1815792347 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16796 (secure 0 0 0) 0x7febe8058210 con 0x7febd8004800 2024-04-25T09:02:30.017 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:30.017 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":77,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:10.117549+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:59.869846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:00.565749+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:30.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febdc06b4d0 msgr2=0x7febdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febdc06b4d0 0x7febdc06d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7febe4032000 tx=0x7febe402e000 comp rx=0 tx=0).stop 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 msgr2=0x7febf00ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febf00ce7e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7febe8004f30 tx=0x7febe80074f0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 shutdown_connections 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7febdc06b4d0 0x7febdc06d990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7febf014b250 0x7febf00cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febf0148160 0x7febf014ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 --2- 172.21.15.5:0/1815792347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febd8004800 0x7febf00ce7e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 >> 172.21.15.5:0/1815792347 conn(0x7febf00668f0 msgr2=0x7febf015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 shutdown_connections 2024-04-25T09:02:30.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.030+0000 7febf83b7640 1 -- 172.21.15.5:0/1815792347 wait complete. 2024-04-25T09:02:30.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:00:59.869846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:00.565749+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:30.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.145+0000 7f6988d7e640 1 Processor -- start 2024-04-25T09:02:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.146+0000 7f6988d7e640 1 -- start start 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.146+0000 7f6988d7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840b4550 0x7f69840b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.146+0000 7f6988d7e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69840ce190 0x7f69840cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.146+0000 7f6988d7e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6984072690 con 0x7f69840ae690 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.146+0000 7f6988d7e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6984071ff0 con 0x7f69840ce190 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.146+0000 7f6988d7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840b2f50 con 0x7f69840b4550 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f6982d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69840ce190 0x7f69840cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f698259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f69840ae690 0x7f69840aea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41022/0 (socket says 172.21.15.5:41022) 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f698259c640 1 -- 172.21.15.5:0/1494134889 learned_addr learned my addr 172.21.15.5:0/1494134889 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f6981d9b640 1 --2- 172.21.15.5:0/1494134889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840b4550 0x7f69840b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f6982d9d640 1 -- 172.21.15.5:0/1494134889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840b4550 msgr2=0x7f69840b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f6982d9d640 1 --2- 172.21.15.5:0/1494134889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840b4550 0x7f69840b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f6982d9d640 1 -- 172.21.15.5:0/1494134889 >> v1:172.21.15.5:6789/0 conn(0x7f69840ae690 legacy=0x7f69840aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f6982d9d640 1 -- 172.21.15.5:0/1494134889 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840cd3d0 con 0x7f69840ce190 2024-04-25T09:02:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.147+0000 7f698159a640 1 -- 172.21.15.5:0/1494134889 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050051797 0 0) 0x7f6984072690 con 0x7f69840ae690 2024-04-25T09:02:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6982d9d640 1 --2- 172.21.15.5:0/1494134889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f69840cefd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f697c009d90 tx=0x7f697c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8624ef6b2d334b12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f698159a640 1 -- 172.21.15.5:0/1494134889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c031600 con 0x7f69840ce190 2024-04-25T09:02:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f698159a640 1 -- 172.21.15.5:0/1494134889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c0317a0 con 0x7f69840ce190 2024-04-25T09:02:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f698159a640 1 -- 172.21.15.5:0/1494134889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c031b70 con 0x7f69840ce190 2024-04-25T09:02:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6988d7e640 1 -- 172.21.15.5:0/1494134889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 msgr2=0x7f69840cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6988d7e640 1 --2- 172.21.15.5:0/1494134889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f69840cefd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f697c009d90 tx=0x7f697c02a5d0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6988d7e640 1 -- 172.21.15.5:0/1494134889 shutdown_connections 2024-04-25T09:02:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6988d7e640 1 --2- 172.21.15.5:0/1494134889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f69840cefd0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6988d7e640 1 --2- 172.21.15.5:0/1494134889 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840b4550 0x7f69840b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6988d7e640 1 -- 172.21.15.5:0/1494134889 >> 172.21.15.5:0/1494134889 conn(0x7f69840b1550 msgr2=0x7f69840b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.148+0000 7f6988d7e640 1 -- 172.21.15.5:0/1494134889 shutdown_connections 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.149+0000 7f6988d7e640 1 -- 172.21.15.5:0/1494134889 wait complete. 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.150+0000 7f6988d7e640 1 Processor -- start 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.150+0000 7f6988d7e640 1 -- start start 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840ae690 0x7f69841e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69840b4550 0x7f69841f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f698406c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840cdc70 con 0x7f69840ce190 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840cd990 con 0x7f69840b4550 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698415ad60 con 0x7f69840ae690 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f698406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f698406c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48760/0 (socket says 172.21.15.5:48760) 2024-04-25T09:02:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 -- 172.21.15.5:0/3017724145 learned_addr learned my addr 172.21.15.5:0/3017724145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6981d9b640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69840b4550 0x7f69841f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f698259c640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840ae690 0x7f69841e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 -- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840ae690 msgr2=0x7f69841e67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840ae690 0x7f69841e67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 -- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69840b4550 msgr2=0x7f69841f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69840b4550 0x7f69841f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 -- 172.21.15.5:0/3017724145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69841e4590 con 0x7f69840ce190 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6982d9d640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f698406c400 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f697c02abc0 tx=0x7f697c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6972ffd640 1 -- 172.21.15.5:0/3017724145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c03f070 con 0x7f69840ce190 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6972ffd640 1 -- 172.21.15.5:0/3017724145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c030b60 con 0x7f69840ce190 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6972ffd640 1 -- 172.21.15.5:0/3017724145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c009450 con 0x7f69840ce190 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69841e4870 con 0x7f69840ce190 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.151+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69841e4e30 con 0x7f69840ce190 2024-04-25T09:02:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.152+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698404ef20 con 0x7f69840ce190 2024-04-25T09:02:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.153+0000 7f6972ffd640 1 -- 172.21.15.5:0/3017724145 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f697c03b410 con 0x7f69840ce190 2024-04-25T09:02:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.153+0000 7f6972ffd640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f696406b4d0 0x7f696406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.153+0000 7f6972ffd640 1 -- 172.21.15.5:0/3017724145 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f697c0ab890 con 0x7f69840ce190 2024-04-25T09:02:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.153+0000 7f698259c640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f696406b4d0 0x7f696406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.154+0000 7f698259c640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f696406b4d0 0x7f696406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6974007fd0 tx=0x7f6974009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.157+0000 7f6972ffd640 1 -- 172.21.15.5:0/3017724145 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f697c07a6a0 con 0x7f69840ce190 2024-04-25T09:02:30.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.340+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69840d03f0 con 0x7f69840ce190 2024-04-25T09:02:30.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.341+0000 7f6972ffd640 1 -- 172.21.15.5:0/3017724145 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f697c079fa0 con 0x7f69840ce190 2024-04-25T09:02:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f696406b4d0 msgr2=0x7f696406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f696406b4d0 0x7f696406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6974007fd0 tx=0x7f6974009040 comp rx=0 tx=0).stop 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 msgr2=0x7f698406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f698406c400 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f697c02abc0 tx=0x7f697c004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 shutdown_connections 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f696406b4d0 0x7f696406d990 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840ce190 0x7f698406c400 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69840b4550 0x7f69841f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 --2- 172.21.15.5:0/3017724145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f69840ae690 0x7f69841e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 >> 172.21.15.5:0/3017724145 conn(0x7f69840b1550 msgr2=0x7f69840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 shutdown_connections 2024-04-25T09:02:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.343+0000 7f6988d7e640 1 -- 172.21.15.5:0/3017724145 wait complete. 2024-04-25T09:02:30.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:30.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.458+0000 7f36bf15c640 1 Processor -- start 2024-04-25T09:02:30.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.458+0000 7f36bf15c640 1 -- start start 2024-04-25T09:02:30.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.458+0000 7f36bf15c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80d2f70 0x7f36b80ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.458+0000 7f36bf15c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36b80ced50 0x7f36b80b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.458+0000 7f36bf15c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b80d1ed0 con 0x7f36b815df70 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.458+0000 7f36bf15c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80d1c80 con 0x7f36b80ced50 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.458+0000 7f36bf15c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80d2ae0 con 0x7f36b80d2f70 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36bd6f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36b80ced50 0x7f36b80b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36bd6f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36b80ced50 0x7f36b80b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48772/0 (socket says 172.21.15.5:48772) 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36bd6f9640 1 -- 172.21.15.5:0/1681505793 learned_addr learned my addr 172.21.15.5:0/1681505793 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36b7fff640 1 --2- 172.21.15.5:0/1681505793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80d2f70 0x7f36b80ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36bd6f9640 1 -- 172.21.15.5:0/1681505793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80d2f70 msgr2=0x7f36b80ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36bd6f9640 1 --2- 172.21.15.5:0/1681505793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80d2f70 0x7f36b80ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36bd6f9640 1 -- 172.21.15.5:0/1681505793 >> v1:172.21.15.80:6789/0 conn(0x7f36b815df70 legacy=0x7f36b80b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.459+0000 7f36bd6f9640 1 -- 172.21.15.5:0/1681505793 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b80d21b0 con 0x7f36b80ced50 2024-04-25T09:02:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bd6f9640 1 --2- 172.21.15.5:0/1681505793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80ced50 0x7f36b80b6c50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009e50 tx=0x7f36b002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1611fcab95b374b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36b77fe640 1 -- 172.21.15.5:0/1681505793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0036070 con 0x7f36b80ced50 2024-04-25T09:02:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36b77fe640 1 -- 172.21.15.5:0/1681505793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b0031600 con 0x7f36b80ced50 2024-04-25T09:02:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36b77fe640 1 -- 172.21.15.5:0/1681505793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00319d0 con 0x7f36b80ced50 2024-04-25T09:02:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 -- 172.21.15.5:0/1681505793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80ced50 msgr2=0x7f36b80b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 --2- 172.21.15.5:0/1681505793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80ced50 0x7f36b80b6c50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009e50 tx=0x7f36b002a7a0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 -- 172.21.15.5:0/1681505793 shutdown_connections 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 --2- 172.21.15.5:0/1681505793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80ced50 0x7f36b80b6c50 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 --2- 172.21.15.5:0/1681505793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80d2f70 0x7f36b80ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 -- 172.21.15.5:0/1681505793 >> 172.21.15.5:0/1681505793 conn(0x7f36b806b000 msgr2=0x7f36b806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 -- 172.21.15.5:0/1681505793 shutdown_connections 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.460+0000 7f36bf15c640 1 -- 172.21.15.5:0/1681505793 wait complete. 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 Processor -- start 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 -- start start 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80ced50 0x7f36b80cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36b80d2f70 0x7f36b814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80aaac0 0x7f36b814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80d3720 con 0x7f36b80aaac0 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80d2770 con 0x7f36b80d2f70 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.462+0000 7f36bf15c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80d38a0 con 0x7f36b80ced50 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80aaac0 0x7f36b814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80aaac0 0x7f36b814dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48774/0 (socket says 172.21.15.5:48774) 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 -- 172.21.15.5:0/436674900 learned_addr learned my addr 172.21.15.5:0/436674900 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36b7fff640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36b80d2f70 0x7f36b814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bcef8640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80ced50 0x7f36b80cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 -- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80ced50 msgr2=0x7f36b80cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80ced50 0x7f36b80cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 -- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36b80d2f70 msgr2=0x7f36b814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36b80d2f70 0x7f36b814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 -- 172.21.15.5:0/436674900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b814e3e0 con 0x7f36b80aaac0 2024-04-25T09:02:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bd6f9640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80aaac0 0x7f36b814dae0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f36b0034040 tx=0x7f36b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36b57fa640 1 -- 172.21.15.5:0/436674900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0036050 con 0x7f36b80aaac0 2024-04-25T09:02:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36b57fa640 1 -- 172.21.15.5:0/436674900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b0042070 con 0x7f36b80aaac0 2024-04-25T09:02:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36b57fa640 1 -- 172.21.15.5:0/436674900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0009510 con 0x7f36b80aaac0 2024-04-25T09:02:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b814e6c0 con 0x7f36b80aaac0 2024-04-25T09:02:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.463+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b814ec80 con 0x7f36b80aaac0 2024-04-25T09:02:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.464+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b80c6a70 con 0x7f36b80aaac0 2024-04-25T09:02:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.465+0000 7f36b57fa640 1 -- 172.21.15.5:0/436674900 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36b0007b70 con 0x7f36b80aaac0 2024-04-25T09:02:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.465+0000 7f36b57fa640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f369c06b500 0x7f369c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.465+0000 7f36b57fa640 1 -- 172.21.15.5:0/436674900 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f36b00ab070 con 0x7f36b80aaac0 2024-04-25T09:02:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.465+0000 7f36bcef8640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f369c06b500 0x7f369c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.466+0000 7f36bcef8640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f369c06b500 0x7f369c06d9c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f36ac001780 tx=0x7f36ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.469+0000 7f36b57fa640 1 -- 172.21.15.5:0/436674900 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36b80c6a70 con 0x7f36b80aaac0 2024-04-25T09:02:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.652+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36b804ef20 con 0x7f36b80aaac0 2024-04-25T09:02:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.652+0000 7f36b57fa640 1 -- 172.21.15.5:0/436674900 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36b0079860 con 0x7f36b80aaac0 2024-04-25T09:02:30.642 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f369c06b500 msgr2=0x7f369c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f369c06b500 0x7f369c06d9c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f36ac001780 tx=0x7f36ac009040 comp rx=0 tx=0).stop 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80aaac0 msgr2=0x7f36b814dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80aaac0 0x7f36b814dae0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f36b0034040 tx=0x7f36b0004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 shutdown_connections 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f369c06b500 0x7f369c06d9c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36b80aaac0 0x7f36b814dae0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36b80d2f70 0x7f36b814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 --2- 172.21.15.5:0/436674900 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36b80ced50 0x7f36b80cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 >> 172.21.15.5:0/436674900 conn(0x7f36b806b000 msgr2=0x7f36b80c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 shutdown_connections 2024-04-25T09:02:30.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.655+0000 7f36bf15c640 1 -- 172.21.15.5:0/436674900 wait complete. 2024-04-25T09:02:30.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.770+0000 7f56876e4640 1 Processor -- start 2024-04-25T09:02:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.770+0000 7f56876e4640 1 -- start start 2024-04-25T09:02:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f56876e4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f56800d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f56876e4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f56800d4060 0x7f56800b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f56876e4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800b9b20 con 0x7f56801614b0 2024-04-25T09:02:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f56876e4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56800d2740 con 0x7f56800d4060 2024-04-25T09:02:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f56876e4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800d2a20 con 0x7f56800b96e0 2024-04-25T09:02:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685c81640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f56800d4060 0x7f56800b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685c81640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f56800d4060 0x7f56800b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:60892/0 (socket says 172.21.15.5:60892) 2024-04-25T09:02:30.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685480640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f56801614b0 0x7f56800d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41288/0 (socket says 172.21.15.5:41288) 2024-04-25T09:02:30.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5684c7f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f56800d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685c81640 1 -- 172.21.15.5:0/2295475083 learned_addr learned my addr 172.21.15.5:0/2295475083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:30.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685c81640 1 -- 172.21.15.5:0/2295475083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 msgr2=0x7f56800d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:30.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685c81640 1 --2- 172.21.15.5:0/2295475083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f56800d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685c81640 1 -- 172.21.15.5:0/2295475083 >> v1:172.21.15.80:6789/0 conn(0x7f56801614b0 legacy=0x7f56800d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.771+0000 7f5685c81640 1 -- 172.21.15.5:0/2295475083 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800d2d00 con 0x7f56800d4060 2024-04-25T09:02:30.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.772+0000 7f5685c81640 1 --2- 172.21.15.5:0/2295475083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56800d4060 0x7f56800b6cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5678009e50 tx=0x7f567802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69caa556c730c343 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.772+0000 7f5677fff640 1 -- 172.21.15.5:0/2295475083 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678036070 con 0x7f56800d4060 2024-04-25T09:02:30.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.772+0000 7f5677fff640 1 -- 172.21.15.5:0/2295475083 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678031600 con 0x7f56800d4060 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.772+0000 7f5677fff640 1 -- 172.21.15.5:0/2295475083 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56780319d0 con 0x7f56800d4060 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 -- 172.21.15.5:0/2295475083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56800d4060 msgr2=0x7f56800b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 --2- 172.21.15.5:0/2295475083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56800d4060 0x7f56800b6cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5678009e50 tx=0x7f567802a710 comp rx=0 tx=0).stop 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 -- 172.21.15.5:0/2295475083 shutdown_connections 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 --2- 172.21.15.5:0/2295475083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56800d4060 0x7f56800b6cc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 --2- 172.21.15.5:0/2295475083 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f56800d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 -- 172.21.15.5:0/2295475083 >> 172.21.15.5:0/2295475083 conn(0x7f568006b000 msgr2=0x7f568006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 -- 172.21.15.5:0/2295475083 shutdown_connections 2024-04-25T09:02:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.773+0000 7f56876e4640 1 -- 172.21.15.5:0/2295475083 wait complete. 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.774+0000 7f56876e4640 1 Processor -- start 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.774+0000 7f56876e4640 1 -- start start 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f56876e4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f5680149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f56876e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56800d4060 0x7f56800b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f56876e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56801614b0 0x7f56801f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f56876e4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800d37e0 con 0x7f56800d4060 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f56876e4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800d32c0 con 0x7f56801614b0 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f56876e4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800b7200 con 0x7f56800b96e0 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56800d4060 0x7f56800b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56800d4060 0x7f56800b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44894/0 (socket says 172.21.15.5:44894) 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 -- 172.21.15.5:0/2557024829 learned_addr learned my addr 172.21.15.5:0/2557024829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5685480640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f5680149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5685c81640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56801614b0 0x7f56801f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 -- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 msgr2=0x7f5680149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f5680149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 -- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56801614b0 msgr2=0x7f56801f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56801614b0 0x7f56801f3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 -- 172.21.15.5:0/2557024829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568015b1d0 con 0x7f56800d4060 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.775+0000 7f5684c7f640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56800d4060 0x7f56800b5d50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f567000e9b0 tx=0x7f567000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.776+0000 7f5675ffb640 1 -- 172.21.15.5:0/2557024829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670017070 con 0x7f56800d4060 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.776+0000 7f5675ffb640 1 -- 172.21.15.5:0/2557024829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567000c9a0 con 0x7f56800d4060 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.776+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568015b4b0 con 0x7f56800d4060 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.776+0000 7f5675ffb640 1 -- 172.21.15.5:0/2557024829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567000cd90 con 0x7f56800d4060 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.776+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56800b6290 con 0x7f56800d4060 2024-04-25T09:02:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.777+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568015bc60 con 0x7f56800d4060 2024-04-25T09:02:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.777+0000 7f5675ffb640 1 -- 172.21.15.5:0/2557024829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f567001a070 con 0x7f56800d4060 2024-04-25T09:02:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.778+0000 7f5675ffb640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f566406b500 0x7f566406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.778+0000 7f5675ffb640 1 -- 172.21.15.5:0/2557024829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f567008a690 con 0x7f56800d4060 2024-04-25T09:02:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.778+0000 7f5685480640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f566406b500 0x7f566406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.779+0000 7f5685480640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f566406b500 0x7f566406d9c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f567c000f60 tx=0x7f567c007ce0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.782+0000 7f5675ffb640 1 -- 172.21.15.5:0/2557024829 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5670059410 con 0x7f56800d4060 2024-04-25T09:02:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.961+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f568004ef20 con 0x7f56800d4060 2024-04-25T09:02:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.962+0000 7f5675ffb640 1 -- 172.21.15.5:0/2557024829 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5670058d10 con 0x7f56800d4060 2024-04-25T09:02:30.951 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f566406b500 msgr2=0x7f566406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f566406b500 0x7f566406d9c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f567c000f60 tx=0x7f567c007ce0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56800d4060 msgr2=0x7f56800b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56800d4060 0x7f56800b5d50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f567000e9b0 tx=0x7f567000ee70 comp rx=0 tx=0).stop 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 shutdown_connections 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f566406b500 0x7f566406d9c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56801614b0 0x7f56801f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56800d4060 0x7f56800b5d50 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 --2- 172.21.15.5:0/2557024829 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56800b96e0 0x7f5680149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 >> 172.21.15.5:0/2557024829 conn(0x7f568006b000 msgr2=0x7f56800ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 shutdown_connections 2024-04-25T09:02:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:30.964+0000 7f56876e4640 1 -- 172.21.15.5:0/2557024829 wait complete. 2024-04-25T09:02:30.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:02:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.076+0000 7f3cd8dc8640 1 Processor -- start 2024-04-25T09:02:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.076+0000 7f3cd8dc8640 1 -- start start 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.076+0000 7f3cd8dc8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cd4161fe0 0x7f3cd40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.076+0000 7f3cd8dc8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.076+0000 7f3cd8dc8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd40b5740 con 0x7f3cd40668f0 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.076+0000 7f3cd8dc8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd40b5a20 con 0x7f3cd4161fe0 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.076+0000 7f3cd8dc8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40b5d00 con 0x7f3cd40b3e10 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3ccbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cd4161fe0 0x7f3cd40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3cd259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3cd40668f0 0x7f3cd4066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46250/0 (socket says 172.21.15.5:46250) 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3cd259c640 1 -- 172.21.15.5:0/369226632 learned_addr learned my addr 172.21.15.5:0/369226632 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3cd2d9d640 1 --2- 172.21.15.5:0/369226632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3cd1d9b640 1 -- 172.21.15.5:0/369226632 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822141243 0 0) 0x7f3cd40b5740 con 0x7f3cd40668f0 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3cd1d9b640 1 -- 172.21.15.5:0/369226632 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc0003520 con 0x7f3cd40668f0 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3ccbfff640 1 -- 172.21.15.5:0/369226632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 msgr2=0x7f3cd406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3ccbfff640 1 --2- 172.21.15.5:0/369226632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd406d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3ccbfff640 1 -- 172.21.15.5:0/369226632 >> v1:172.21.15.5:6789/0 conn(0x7f3cd40668f0 legacy=0x7f3cd4066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.077+0000 7f3ccbfff640 1 -- 172.21.15.5:0/369226632 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd41617e0 con 0x7f3cd4161fe0 2024-04-25T09:02:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3ccbfff640 1 --2- 172.21.15.5:0/369226632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd40b38d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0097a0 tx=0x7f3cbc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bafebe6a692dad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd1d9b640 1 -- 172.21.15.5:0/369226632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc037070 con 0x7f3cd4161fe0 2024-04-25T09:02:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd1d9b640 1 -- 172.21.15.5:0/369226632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc032440 con 0x7f3cd4161fe0 2024-04-25T09:02:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd1d9b640 1 -- 172.21.15.5:0/369226632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc032810 con 0x7f3cd4161fe0 2024-04-25T09:02:31.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/369226632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 msgr2=0x7f3cd40b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/369226632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd40b38d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0097a0 tx=0x7f3cbc02a180 comp rx=0 tx=0).stop 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/369226632 shutdown_connections 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/369226632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/369226632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd40b38d0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/369226632 >> 172.21.15.5:0/369226632 conn(0x7f3cd40b25d0 msgr2=0x7f3cd40b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/369226632 shutdown_connections 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.078+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/369226632 wait complete. 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 Processor -- start 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 -- start start 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd40668f0 0x7f3cd415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd4140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd4159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd406f1b0 con 0x7f3cd4161fe0 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd406f030 con 0x7f3cd40668f0 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.080+0000 7f3cd8dc8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd4162460 con 0x7f3cd40b3e10 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd4159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd4159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44910/0 (socket says 172.21.15.5:44910) 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 -- 172.21.15.5:0/1506921563 learned_addr learned my addr 172.21.15.5:0/1506921563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3ccbfff640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd4140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd259c640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd40668f0 0x7f3cd415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 -- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 msgr2=0x7f3cd4140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd4140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 -- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd40668f0 msgr2=0x7f3cd415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd40668f0 0x7f3cd415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 -- 172.21.15.5:0/1506921563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd415abc0 con 0x7f3cd4161fe0 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3ccbfff640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd4140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd259c640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd40668f0 0x7f3cd415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd2d9d640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd4159480 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007e60 tx=0x7f3ccc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3ccaffd640 1 -- 172.21.15.5:0/1506921563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc014620 con 0x7f3cd4161fe0 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3ccaffd640 1 -- 172.21.15.5:0/1506921563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc019070 con 0x7f3cd4161fe0 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd415e340 con 0x7f3cd4161fe0 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3ccaffd640 1 -- 172.21.15.5:0/1506921563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc014a00 con 0x7f3cd4161fe0 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.081+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd415c5d0 con 0x7f3cd4161fe0 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.082+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd404ef20 con 0x7f3cd4161fe0 2024-04-25T09:02:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.083+0000 7f3ccaffd640 1 -- 172.21.15.5:0/1506921563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ccc014ba0 con 0x7f3cd4161fe0 2024-04-25T09:02:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.083+0000 7f3ccaffd640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3cb406b500 0x7f3cb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.083+0000 7f3ccaffd640 1 -- 172.21.15.5:0/1506921563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f3ccc08ab30 con 0x7f3cd4161fe0 2024-04-25T09:02:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.083+0000 7f3cd259c640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3cb406b500 0x7f3cb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.084+0000 7f3cd259c640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3cb406b500 0x7f3cb406d9c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4005880 tx=0x7f3cc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.087+0000 7f3ccaffd640 1 -- 172.21.15.5:0/1506921563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ccc059940 con 0x7f3cd4161fe0 2024-04-25T09:02:31.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.278+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3cd40b02b0 con 0x7f3cd4161fe0 2024-04-25T09:02:31.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.278+0000 7f3ccaffd640 1 -- 172.21.15.5:0/1506921563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v77) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ccc059240 con 0x7f3cd4161fe0 2024-04-25T09:02:31.268 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T09:02:31.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3cb406b500 msgr2=0x7f3cb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3cb406b500 0x7f3cb406d9c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4005880 tx=0x7f3cc4009040 comp rx=0 tx=0).stop 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 msgr2=0x7f3cd4159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd4159480 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007e60 tx=0x7f3ccc00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 shutdown_connections 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3cb406b500 0x7f3cb406d9c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4161fe0 0x7f3cd4159480 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3cd40b3e10 0x7f3cd4140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 --2- 172.21.15.5:0/1506921563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd40668f0 0x7f3cd415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 >> 172.21.15.5:0/1506921563 conn(0x7f3cd40b25d0 msgr2=0x7f3cd40b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 shutdown_connections 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.280+0000 7f3cd8dc8640 1 -- 172.21.15.5:0/1506921563 wait complete. 2024-04-25T09:02:31.280 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:31.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:31.317 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:02:31.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:31.317 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:02:31.372 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:02:31.372 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:31.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:02:31.390 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:02:31.390 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:31.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:02:31.428 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:02:31.428 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:31.446 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:02:31.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:31.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.580+0000 7f107c0b3640 1 Processor -- start 2024-04-25T09:02:31.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.580+0000 7f107c0b3640 1 -- start start 2024-04-25T09:02:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.580+0000 7f107c0b3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1074151460 0x7f107415b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f107c0b3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1074070e50 con 0x7f1074151080 2024-04-25T09:02:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f107c0b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1074071130 con 0x7f10740aed30 2024-04-25T09:02:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f107c0b3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1074070c00 con 0x7f1074151460 2024-04-25T09:02:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1079e4f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1074151080 0x7f1074071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46252/0 (socket says 172.21.15.5:46252) 2024-04-25T09:02:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1079e4f640 1 -- 172.21.15.5:0/3350926497 learned_addr learned my addr 172.21.15.5:0/3350926497 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f107964e640 1 --2- 172.21.15.5:0/3350926497 >> v2:172.21.15.80:3300/0 conn(0x7f1074151460 0x7f107415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717791940 0 0) 0x7f1074070e50 con 0x7f1074151080 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1060004630 con 0x7f1074151080 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405819964 0 0) 0x7f1060004630 con 0x7f1074151080 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 >> v2:172.21.15.80:3300/0 conn(0x7f1074151460 msgr2=0x7f107415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 --2- 172.21.15.5:0/3350926497 >> v2:172.21.15.80:3300/0 conn(0x7f1074151460 0x7f107415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 >> v1:172.21.15.80:6789/0 conn(0x7f10740aed30 legacy=0x7f10740b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074071410 con 0x7f1074151080 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1070001670 con 0x7f1074151080 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 >> v1:172.21.15.5:6789/0 conn(0x7f1074151080 legacy=0x7f1074071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1060004ac0 0x7f1060004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1060005910 0x7f1060005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10600062d0 0x7f106000cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074070c00 con 0x7f10600062d0 2024-04-25T09:02:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106000d270 con 0x7f1060005910 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.581+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106000d470 con 0x7f1060004ac0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10600062d0 0x7f106000cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107964e640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1060005910 0x7f1060005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f1079e4f640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1060004ac0 0x7f1060004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 -- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1060004ac0 msgr2=0x7f1060004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1060004ac0 0x7f1060004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 -- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1060005910 msgr2=0x7f1060005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1060005910 0x7f1060005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 -- 172.21.15.5:0/3350926497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060004630 con 0x7f10600062d0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 -- 172.21.15.5:0/3350926497 reap_dead start 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.582+0000 7f107a650640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10600062d0 0x7f106000cad0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f106c001a30 tx=0x7f1060006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44813266ea2451fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c001a70 con 0x7f10600062d0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c003b70 con 0x7f10600062d0 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f1078e4d640 1 -- 172.21.15.5:0/3350926497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0050d0 con 0x7f10600062d0 2024-04-25T09:02:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f107c0b3640 1 -- 172.21.15.5:0/3350926497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10600062d0 msgr2=0x7f106000cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f107c0b3640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10600062d0 0x7f106000cad0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f106c001a30 tx=0x7f1060006940 comp rx=0 tx=0).stop 2024-04-25T09:02:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f107c0b3640 1 -- 172.21.15.5:0/3350926497 shutdown_connections 2024-04-25T09:02:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f107c0b3640 1 --2- 172.21.15.5:0/3350926497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10600062d0 0x7f106000cad0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f107c0b3640 1 -- 172.21.15.5:0/3350926497 >> 172.21.15.5:0/3350926497 conn(0x7f10740668f0 msgr2=0x7f1074066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f107c0b3640 1 -- 172.21.15.5:0/3350926497 shutdown_connections 2024-04-25T09:02:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.583+0000 7f107c0b3640 1 -- 172.21.15.5:0/3350926497 wait complete. 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.584+0000 7f107c0b3640 1 Processor -- start 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.584+0000 7f107c0b3640 1 -- start start 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107c0b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10600062d0 0x7f1074143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107c0b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1074152890 0x7f1074156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107c0b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1074157130 0x7f1074158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107c0b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107415b230 con 0x7f1074157130 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107c0b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074071a60 con 0x7f1074152890 2024-04-25T09:02:31.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107c0b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107415b3b0 con 0x7f10600062d0 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107a650640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1074157130 0x7f1074158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107a650640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1074157130 0x7f1074158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44932/0 (socket says 172.21.15.5:44932) 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107a650640 1 -- 172.21.15.5:0/752253177 learned_addr learned my addr 172.21.15.5:0/752253177 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f107964e640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1074152890 0x7f1074156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.585+0000 7f1079e4f640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10600062d0 0x7f1074143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107a650640 1 -- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10600062d0 msgr2=0x7f1074143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107a650640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10600062d0 0x7f1074143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107a650640 1 -- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1074152890 msgr2=0x7f1074156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107a650640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1074152890 0x7f1074156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107a650640 1 -- 172.21.15.5:0/752253177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074159b50 con 0x7f1074157130 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107a650640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1074157130 0x7f1074158d90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f106c001ee0 tx=0x7f106c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f106a7fc640 1 -- 172.21.15.5:0/752253177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c007db0 con 0x7f1074157130 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f106a7fc640 1 -- 172.21.15.5:0/752253177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c006b50 con 0x7f1074157130 2024-04-25T09:02:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1074154f80 con 0x7f1074157130 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f106a7fc640 1 -- 172.21.15.5:0/752253177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c007030 con 0x7f1074157130 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.586+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1074152d10 con 0x7f1074157130 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.587+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107404ef20 con 0x7f1074157130 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.588+0000 7f106a7fc640 1 -- 172.21.15.5:0/752253177 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f106c0071d0 con 0x7f1074157130 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.588+0000 7f106a7fc640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f105806b500 0x7f105806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.588+0000 7f106a7fc640 1 -- 172.21.15.5:0/752253177 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f106c0abee0 con 0x7f1074157130 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.588+0000 7f1079e4f640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f105806b500 0x7f105806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.589+0000 7f1079e4f640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f105806b500 0x7f105806d9c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1070007d30 tx=0x7f10700078f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.592+0000 7f106a7fc640 1 -- 172.21.15.5:0/752253177 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f106c07adb0 con 0x7f1074157130 2024-04-25T09:02:31.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.810+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1074154b70 con 0x7f1074157130 2024-04-25T09:02:31.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.810+0000 7f106a7fc640 1 -- 172.21.15.5:0/752253177 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f106c07a6b0 con 0x7f1074157130 2024-04-25T09:02:31.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:31.800 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/551194531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":551194531},{"type":"v1","addr":"172.21.15.5:6835","nonce":551194531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3514707104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3514707104},{"type":"v1","addr":"172.21.15.80:6836","nonce":3514707104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/546123103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":546123103},{"type":"v1","addr":"172.21.15.5:6833","nonce":546123103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:01:01.584978+0000","modified":"2024-04-25T09:01:12.794491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7038":{"gid":7038,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1546784484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1546784484},{"type":"v1","addr":"172.21.15.80:6837","nonce":1546784484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:02:31.800 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 46 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f105806b500 msgr2=0x7f105806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f105806b500 0x7f105806d9c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1070007d30 tx=0x7f10700078f0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1074157130 msgr2=0x7f1074158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1074157130 0x7f1074158d90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f106c001ee0 tx=0x7f106c0014a0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 shutdown_connections 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f105806b500 0x7f105806d9c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1074157130 0x7f1074158d90 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1074152890 0x7f1074156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 --2- 172.21.15.5:0/752253177 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10600062d0 0x7f1074143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 >> 172.21.15.5:0/752253177 conn(0x7f10740668f0 msgr2=0x7f107406c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 shutdown_connections 2024-04-25T09:02:31.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.812+0000 7f107c0b3640 1 -- 172.21.15.5:0/752253177 wait complete. 2024-04-25T09:02:31.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.924+0000 7fa79549e640 1 Processor -- start 2024-04-25T09:02:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.924+0000 7fa79549e640 1 -- start start 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa79549e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79015ba90 0x7fa7900ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa79549e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790067000 0x7fa79015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa79549e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79006ba40 con 0x7fa790071f80 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa79549e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7900cd5f0 con 0x7fa79015ba90 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa79549e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79006abe0 con 0x7fa790067000 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa78effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79015ba90 0x7fa7900ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa78f7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790067000 0x7fa79015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa78effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79015ba90 0x7fa7900ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:60934/0 (socket says 172.21.15.5:60934) 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa78effd640 1 -- 172.21.15.5:0/2651821784 learned_addr learned my addr 172.21.15.5:0/2651821784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa787fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa790071f80 0x7fa7900668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41310/0 (socket says 172.21.15.5:41310) 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa78e7fc640 1 -- 172.21.15.5:0/2651821784 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198085068 0 0) 0x7fa778001110 con 0x7fa790071f80 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.925+0000 7fa78e7fc640 1 -- 172.21.15.5:0/2651821784 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa77c003520 con 0x7fa790071f80 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.926+0000 7fa78effd640 1 -- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790067000 msgr2=0x7fa79015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.926+0000 7fa78effd640 1 --2- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790067000 0x7fa79015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.926+0000 7fa78effd640 1 -- 172.21.15.5:0/2651821784 >> v1:172.21.15.80:6789/0 conn(0x7fa790071f80 legacy=0x7fa7900668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.926+0000 7fa78effd640 1 -- 172.21.15.5:0/2651821784 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7900cf0c0 con 0x7fa79015ba90 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.926+0000 7fa78f7fe640 1 --2- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790067000 0x7fa79015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.926+0000 7fa78effd640 1 --2- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7900ceb80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa780009870 tx=0x7fa78002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d4abfd377c67666 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.926+0000 7fa78e7fc640 1 -- 172.21.15.5:0/2651821784 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780037070 con 0x7fa79015ba90 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa78e7fc640 1 -- 172.21.15.5:0/2651821784 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780032440 con 0x7fa79015ba90 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa78e7fc640 1 -- 172.21.15.5:0/2651821784 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780032810 con 0x7fa79015ba90 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 -- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 msgr2=0x7fa7900ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 --2- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7900ceb80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa780009870 tx=0x7fa78002a270 comp rx=0 tx=0).stop 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 -- 172.21.15.5:0/2651821784 shutdown_connections 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 --2- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790067000 0x7fa79015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 --2- 172.21.15.5:0/2651821784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7900ceb80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 -- 172.21.15.5:0/2651821784 >> 172.21.15.5:0/2651821784 conn(0x7fa7900b25d0 msgr2=0x7fa7900b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 -- 172.21.15.5:0/2651821784 shutdown_connections 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.927+0000 7fa79549e640 1 -- 172.21.15.5:0/2651821784 wait complete. 2024-04-25T09:02:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.928+0000 7fa79549e640 1 Processor -- start 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.928+0000 7fa79549e640 1 -- start start 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa79549e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa790067000 0x7fa7900c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa79549e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790071f80 0x7fa7901f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa79549e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7901f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa79549e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79006b3f0 con 0x7fa790067000 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa79549e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79006b110 con 0x7fa79015ba90 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa79549e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79006b6d0 con 0x7fa790071f80 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa78effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa790067000 0x7fa7900c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa78effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa790067000 0x7fa7900c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44936/0 (socket says 172.21.15.5:44936) 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa78effd640 1 -- 172.21.15.5:0/4133161494 learned_addr learned my addr 172.21.15.5:0/4133161494 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa78f7fe640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7901f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.929+0000 7fa787fff640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790071f80 0x7fa7901f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa78effd640 1 -- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790071f80 msgr2=0x7fa7901f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa78effd640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790071f80 0x7fa7901f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa78effd640 1 -- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 msgr2=0x7fa7901f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa78effd640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7901f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa78effd640 1 -- 172.21.15.5:0/4133161494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7901581b0 con 0x7fa790067000 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa78f7fe640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7901f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa78effd640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa790067000 0x7fa7900c8f50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa780000c00 tx=0x7fa7800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa7877fe640 1 -- 172.21.15.5:0/4133161494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780041020 con 0x7fa790067000 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa7877fe640 1 -- 172.21.15.5:0/4133161494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78003d620 con 0x7fa790067000 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7901e7250 con 0x7fa790067000 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa7877fe640 1 -- 172.21.15.5:0/4133161494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780037040 con 0x7fa790067000 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.930+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7901e7af0 con 0x7fa790067000 2024-04-25T09:02:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.931+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79004ef20 con 0x7fa790067000 2024-04-25T09:02:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.932+0000 7fa7877fe640 1 -- 172.21.15.5:0/4133161494 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa780044020 con 0x7fa790067000 2024-04-25T09:02:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.932+0000 7fa7877fe640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa77006b4d0 0x7fa77006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.932+0000 7fa7877fe640 1 -- 172.21.15.5:0/4133161494 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fa7800aa8e0 con 0x7fa790067000 2024-04-25T09:02:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.932+0000 7fa787fff640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa77006b4d0 0x7fa77006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.933+0000 7fa787fff640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa77006b4d0 0x7fa77006d990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa7900c6020 tx=0x7fa7780079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:31.936+0000 7fa7877fe640 1 -- 172.21.15.5:0/4133161494 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa78004b030 con 0x7fa790067000 2024-04-25T09:02:32.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.117+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa79006c420 con 0x7fa790067000 2024-04-25T09:02:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.118+0000 7fa7877fe640 1 -- 172.21.15.5:0/4133161494 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16796 (secure 0 0 0) 0x7fa7900cf0c0 con 0x7fa790067000 2024-04-25T09:02:32.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:32.107 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":77,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:10.117549+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:59.869846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:00.565749+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa77006b4d0 msgr2=0x7fa77006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa77006b4d0 0x7fa77006d990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa7900c6020 tx=0x7fa7780079b0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa790067000 msgr2=0x7fa7900c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa790067000 0x7fa7900c8f50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa780000c00 tx=0x7fa7800046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 shutdown_connections 2024-04-25T09:02:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa77006b4d0 0x7fa77006d990 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79015ba90 0x7fa7901f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa790071f80 0x7fa7901f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 --2- 172.21.15.5:0/4133161494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa790067000 0x7fa7900c8f50 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 >> 172.21.15.5:0/4133161494 conn(0x7fa7900b25d0 msgr2=0x7fa7901593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 shutdown_connections 2024-04-25T09:02:32.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.120+0000 7fa79549e640 1 -- 172.21.15.5:0/4133161494 wait complete. 2024-04-25T09:02:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:00:59.869846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:00.565749+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:32.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:32.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.234+0000 7fcf0869e640 1 Processor -- start 2024-04-25T09:02:32.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.234+0000 7fcf0869e640 1 -- start start 2024-04-25T09:02:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.235+0000 7fcf0869e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf0015a9a0 0x7fcf000cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.235+0000 7fcf0869e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf00071ba0 0x7fcf0006e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.235+0000 7fcf0869e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0015b320 con 0x7fcf0015ad80 2024-04-25T09:02:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.235+0000 7fcf0869e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0015b600 con 0x7fcf0015a9a0 2024-04-25T09:02:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf0869e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0015b8e0 con 0x7fcf00071ba0 2024-04-25T09:02:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf0643a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf0015a9a0 0x7fcf000cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf05c39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf0015ad80 0x7fcf00071490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46268/0 (socket says 172.21.15.5:46268) 2024-04-25T09:02:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf05c39640 1 -- 172.21.15.5:0/3976061679 learned_addr learned my addr 172.21.15.5:0/3976061679 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf06c3b640 1 --2- 172.21.15.5:0/3976061679 >> v2:172.21.15.80:3300/0 conn(0x7fcf00071ba0 0x7fcf0006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf0643a640 1 -- 172.21.15.5:0/3976061679 >> v2:172.21.15.80:3300/0 conn(0x7fcf00071ba0 msgr2=0x7fcf0006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf0643a640 1 --2- 172.21.15.5:0/3976061679 >> v2:172.21.15.80:3300/0 conn(0x7fcf00071ba0 0x7fcf0006e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf0643a640 1 -- 172.21.15.5:0/3976061679 >> v1:172.21.15.5:6789/0 conn(0x7fcf0015ad80 legacy=0x7fcf00071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf05438640 1 -- 172.21.15.5:0/3976061679 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726284870 0 0) 0x7fcf0015b320 con 0x7fcf0015ad80 2024-04-25T09:02:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.236+0000 7fcf0643a640 1 -- 172.21.15.5:0/3976061679 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0015bbc0 con 0x7fcf0015a9a0 2024-04-25T09:02:32.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf0643a640 1 --2- 172.21.15.5:0/3976061679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0015a9a0 0x7fcf000cc5a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcf000d0840 tx=0x7fcefc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f077836eaad1523c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf05438640 1 -- 172.21.15.5:0/3976061679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc037070 con 0x7fcf0015a9a0 2024-04-25T09:02:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf05438640 1 -- 172.21.15.5:0/3976061679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc032440 con 0x7fcf0015a9a0 2024-04-25T09:02:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf05438640 1 -- 172.21.15.5:0/3976061679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc032810 con 0x7fcf0015a9a0 2024-04-25T09:02:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf0869e640 1 -- 172.21.15.5:0/3976061679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0015a9a0 msgr2=0x7fcf000cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf0869e640 1 --2- 172.21.15.5:0/3976061679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0015a9a0 0x7fcf000cc5a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcf000d0840 tx=0x7fcefc02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf0869e640 1 -- 172.21.15.5:0/3976061679 shutdown_connections 2024-04-25T09:02:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf0869e640 1 --2- 172.21.15.5:0/3976061679 >> v2:172.21.15.80:3300/0 conn(0x7fcf00071ba0 0x7fcf0006e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf0869e640 1 --2- 172.21.15.5:0/3976061679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0015a9a0 0x7fcf000cc5a0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.237+0000 7fcf0869e640 1 -- 172.21.15.5:0/3976061679 >> 172.21.15.5:0/3976061679 conn(0x7fcf000cd310 msgr2=0x7fcf000cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.238+0000 7fcf0869e640 1 -- 172.21.15.5:0/3976061679 shutdown_connections 2024-04-25T09:02:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.238+0000 7fcf0869e640 1 -- 172.21.15.5:0/3976061679 wait complete. 2024-04-25T09:02:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 Processor -- start 2024-04-25T09:02:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 -- start start 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf00071ba0 0x7fcf001f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf0015a9a0 0x7fcf001f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf0015ad80 0x7fcf000b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000afbf0 con 0x7fcf00071ba0 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000afa70 con 0x7fcf0015a9a0 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0869e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000afd70 con 0x7fcf0015ad80 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0643a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf00071ba0 0x7fcf001f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0643a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf00071ba0 0x7fcf001f3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44962/0 (socket says 172.21.15.5:44962) 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.239+0000 7fcf0643a640 1 -- 172.21.15.5:0/1939004767 learned_addr learned my addr 172.21.15.5:0/1939004767 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf05c39640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf0015a9a0 0x7fcf001f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf06c3b640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf0015ad80 0x7fcf000b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0643a640 1 -- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf0015ad80 msgr2=0x7fcf000b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0643a640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf0015ad80 0x7fcf000b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0643a640 1 -- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf0015a9a0 msgr2=0x7fcf001f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0643a640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf0015a9a0 0x7fcf001f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0643a640 1 -- 172.21.15.5:0/1939004767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0015d4c0 con 0x7fcf00071ba0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0643a640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf00071ba0 0x7fcf001f3940 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcefc000c00 tx=0x7fcefc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcef6ffd640 1 -- 172.21.15.5:0/1939004767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc037040 con 0x7fcf00071ba0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcef6ffd640 1 -- 172.21.15.5:0/1939004767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc042070 con 0x7fcf00071ba0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0015d7a0 con 0x7fcf00071ba0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcef6ffd640 1 -- 172.21.15.5:0/1939004767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc030960 con 0x7fcf00071ba0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.240+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0015dd60 con 0x7fcf00071ba0 2024-04-25T09:02:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.241+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0004ef20 con 0x7fcf00071ba0 2024-04-25T09:02:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.242+0000 7fcef6ffd640 1 -- 172.21.15.5:0/1939004767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcefc030b00 con 0x7fcf00071ba0 2024-04-25T09:02:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.242+0000 7fcef6ffd640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.242+0000 7fcef6ffd640 1 -- 172.21.15.5:0/1939004767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fcefc0aa9f0 con 0x7fcf00071ba0 2024-04-25T09:02:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.242+0000 7fcf05c39640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.243+0000 7fcf05c39640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcf00153580 tx=0x7fcef0007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.246+0000 7fcef6ffd640 1 -- 172.21.15.5:0/1939004767 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcefc079240 con 0x7fcf00071ba0 2024-04-25T09:02:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.428+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf00151930 con 0x7fcf00071ba0 2024-04-25T09:02:32.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.429+0000 7fcef6ffd640 1 -- 172.21.15.5:0/1939004767 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcefc07d2e0 con 0x7fcf00071ba0 2024-04-25T09:02:32.418 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 msgr2=0x7fcee406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcf00153580 tx=0x7fcef0007de0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf00071ba0 msgr2=0x7fcf001f3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf00071ba0 0x7fcf001f3940 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcefc000c00 tx=0x7fcefc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 shutdown_connections 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcee406b4d0 0x7fcee406d990 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf0015ad80 0x7fcf000b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf0015a9a0 0x7fcf001f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 --2- 172.21.15.5:0/1939004767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf00071ba0 0x7fcf001f3940 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 >> 172.21.15.5:0/1939004767 conn(0x7fcf000cd310 msgr2=0x7fcf0006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 shutdown_connections 2024-04-25T09:02:32.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.431+0000 7fcf0869e640 1 -- 172.21.15.5:0/1939004767 wait complete. 2024-04-25T09:02:32.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.548+0000 7fd1803d5640 1 Processor -- start 2024-04-25T09:02:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.548+0000 7fd1803d5640 1 -- start start 2024-04-25T09:02:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd1803d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd178067000 0x7fd1780af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd1803d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1780afdf0 0x7fd1781619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd1803d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17815e460 con 0x7fd178154d80 2024-04-25T09:02:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd1803d5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd178155160 con 0x7fd178067000 2024-04-25T09:02:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd1803d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17815f070 con 0x7fd1780afdf0 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17d970640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd178067000 0x7fd1780af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17d970640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd178067000 0x7fd1780af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44972/0 (socket says 172.21.15.5:44972) 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17d970640 1 -- 172.21.15.5:0/1251593678 learned_addr learned my addr 172.21.15.5:0/1251593678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17e972640 1 --2- 172.21.15.5:0/1251593678 >> v2:172.21.15.80:3300/0 conn(0x7fd1780afdf0 0x7fd1781619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17d970640 1 -- 172.21.15.5:0/1251593678 >> v2:172.21.15.80:3300/0 conn(0x7fd1780afdf0 msgr2=0x7fd1781619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17d970640 1 --2- 172.21.15.5:0/1251593678 >> v2:172.21.15.80:3300/0 conn(0x7fd1780afdf0 0x7fd1781619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17d970640 1 -- 172.21.15.5:0/1251593678 >> v1:172.21.15.80:6789/0 conn(0x7fd178154d80 legacy=0x7fd1780668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.549+0000 7fd17d970640 1 -- 172.21.15.5:0/1251593678 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17815e740 con 0x7fd178067000 2024-04-25T09:02:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.550+0000 7fd17d970640 1 --2- 172.21.15.5:0/1251593678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178067000 0x7fd1780af8b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd1780cae60 tx=0x7fd16802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5597e5fb794e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.550+0000 7fd17d16f640 1 -- 172.21.15.5:0/1251593678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168037070 con 0x7fd178067000 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.550+0000 7fd17d16f640 1 -- 172.21.15.5:0/1251593678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd168032440 con 0x7fd178067000 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.550+0000 7fd17d16f640 1 -- 172.21.15.5:0/1251593678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168032810 con 0x7fd178067000 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 -- 172.21.15.5:0/1251593678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178067000 msgr2=0x7fd1780af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 --2- 172.21.15.5:0/1251593678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178067000 0x7fd1780af8b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd1780cae60 tx=0x7fd16802a230 comp rx=0 tx=0).stop 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 -- 172.21.15.5:0/1251593678 shutdown_connections 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 --2- 172.21.15.5:0/1251593678 >> v2:172.21.15.80:3300/0 conn(0x7fd1780afdf0 0x7fd1781619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 --2- 172.21.15.5:0/1251593678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178067000 0x7fd1780af8b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 -- 172.21.15.5:0/1251593678 >> 172.21.15.5:0/1251593678 conn(0x7fd1780cd310 msgr2=0x7fd1780cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 -- 172.21.15.5:0/1251593678 shutdown_connections 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.551+0000 7fd1803d5640 1 -- 172.21.15.5:0/1251593678 wait complete. 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.552+0000 7fd1803d5640 1 Processor -- start 2024-04-25T09:02:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.552+0000 7fd1803d5640 1 -- start start 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd1803d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd178067000 0x7fd1781e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd1803d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1780afdf0 0x7fd17806e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd1803d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178154d80 0x7fd17806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd1803d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1780b0280 con 0x7fd178154d80 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd1803d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17815ed00 con 0x7fd178067000 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd1803d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd178161f30 con 0x7fd1780afdf0 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178154d80 0x7fd17806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178154d80 0x7fd17806ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44974/0 (socket says 172.21.15.5:44974) 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 -- 172.21.15.5:0/3220339604 learned_addr learned my addr 172.21.15.5:0/3220339604 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e171640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd178067000 0x7fd1781e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17d970640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1780afdf0 0x7fd17806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 -- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1780afdf0 msgr2=0x7fd17806e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1780afdf0 0x7fd17806e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 -- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd178067000 msgr2=0x7fd1781e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd178067000 0x7fd1781e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 -- 172.21.15.5:0/3220339604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1781e8210 con 0x7fd178154d80 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17d970640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1780afdf0 0x7fd17806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd17e972640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178154d80 0x7fd17806ecc0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd170007e40 tx=0x7fd17000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd16effd640 1 -- 172.21.15.5:0/3220339604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170014620 con 0x7fd178154d80 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd16effd640 1 -- 172.21.15.5:0/3220339604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd170019070 con 0x7fd178154d80 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1781e84f0 con 0x7fd178154d80 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.553+0000 7fd16effd640 1 -- 172.21.15.5:0/3220339604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170014a20 con 0x7fd178154d80 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.554+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd178155760 con 0x7fd178154d80 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.554+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17804ef20 con 0x7fd178154d80 2024-04-25T09:02:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.555+0000 7fd16effd640 1 -- 172.21.15.5:0/3220339604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd170014bc0 con 0x7fd178154d80 2024-04-25T09:02:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.555+0000 7fd16effd640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.555+0000 7fd16effd640 1 -- 172.21.15.5:0/3220339604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd17008ab00 con 0x7fd178154d80 2024-04-25T09:02:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.555+0000 7fd17e171640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.556+0000 7fd17e171640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd174006fd0 tx=0x7fd174009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.559+0000 7fd16effd640 1 -- 172.21.15.5:0/3220339604 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd170059910 con 0x7fd178154d80 2024-04-25T09:02:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.739+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1781e99e0 con 0x7fd178154d80 2024-04-25T09:02:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.740+0000 7fd16effd640 1 -- 172.21.15.5:0/3220339604 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd170059210 con 0x7fd178154d80 2024-04-25T09:02:32.729 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 msgr2=0x7fd15c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd174006fd0 tx=0x7fd174009060 comp rx=0 tx=0).stop 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178154d80 msgr2=0x7fd17806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178154d80 0x7fd17806ecc0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd170007e40 tx=0x7fd17000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 shutdown_connections 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd15c06b4d0 0x7fd15c06d990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd178154d80 0x7fd17806ecc0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1780afdf0 0x7fd17806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 --2- 172.21.15.5:0/3220339604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd178067000 0x7fd1781e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 >> 172.21.15.5:0/3220339604 conn(0x7fd1780cd310 msgr2=0x7fd1780cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 shutdown_connections 2024-04-25T09:02:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.742+0000 7fd1803d5640 1 -- 172.21.15.5:0/3220339604 wait complete. 2024-04-25T09:02:32.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.856+0000 7f8339053640 1 Processor -- start 2024-04-25T09:02:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.856+0000 7f8339053640 1 -- start start 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f8339053640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f833415df10 0x7f83341618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f8339053640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83340cefe0 0x7f83340d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f8339053640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8334162150 con 0x7f83340b6250 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f8339053640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83340d20d0 con 0x7f83340cefe0 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f8339053640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8334162430 con 0x7f833415df10 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f833359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83340cefe0 0x7f83340d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f833359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83340cefe0 0x7f83340d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44976/0 (socket says 172.21.15.5:44976) 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f833359e640 1 -- 172.21.15.5:0/880603792 learned_addr learned my addr 172.21.15.5:0/880603792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f833359e640 1 -- 172.21.15.5:0/880603792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f833415df10 msgr2=0x7f83341618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f833359e640 1 --2- 172.21.15.5:0/880603792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f833415df10 0x7f83341618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f833359e640 1 -- 172.21.15.5:0/880603792 >> v1:172.21.15.80:6789/0 conn(0x7f83340b6250 legacy=0x7f83340ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.857+0000 7f833359e640 1 -- 172.21.15.5:0/880603792 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334162710 con 0x7f83340cefe0 2024-04-25T09:02:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.858+0000 7f833359e640 1 --2- 172.21.15.5:0/880603792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f83340d2560 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f83240098a0 tx=0x7f832402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1467c105fdc43451 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.858+0000 7f8331d9b640 1 -- 172.21.15.5:0/880603792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324037070 con 0x7f83340cefe0 2024-04-25T09:02:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.858+0000 7f8331d9b640 1 -- 172.21.15.5:0/880603792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8324032440 con 0x7f83340cefe0 2024-04-25T09:02:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.858+0000 7f8331d9b640 1 -- 172.21.15.5:0/880603792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324032810 con 0x7f83340cefe0 2024-04-25T09:02:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 -- 172.21.15.5:0/880603792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 msgr2=0x7f83340d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 --2- 172.21.15.5:0/880603792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f83340d2560 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f83240098a0 tx=0x7f832402a250 comp rx=0 tx=0).stop 2024-04-25T09:02:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 -- 172.21.15.5:0/880603792 shutdown_connections 2024-04-25T09:02:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 --2- 172.21.15.5:0/880603792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f83340d2560 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 --2- 172.21.15.5:0/880603792 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f833415df10 0x7f83341618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 -- 172.21.15.5:0/880603792 >> 172.21.15.5:0/880603792 conn(0x7f83340668f0 msgr2=0x7f8334066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 -- 172.21.15.5:0/880603792 shutdown_connections 2024-04-25T09:02:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.859+0000 7f8339053640 1 -- 172.21.15.5:0/880603792 wait complete. 2024-04-25T09:02:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.860+0000 7f8339053640 1 Processor -- start 2024-04-25T09:02:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.860+0000 7f8339053640 1 -- start start 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8339053640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83340b6250 0x7f833415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8339053640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f8334153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8339053640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833415df10 0x7f8334160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8339053640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83340d2aa0 con 0x7f83340cefe0 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8339053640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8334161e10 con 0x7f833415df10 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8339053640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83340d2c20 con 0x7f83340b6250 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f8334153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f8334153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44986/0 (socket says 172.21.15.5:44986) 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 -- 172.21.15.5:0/2485623935 learned_addr learned my addr 172.21.15.5:0/2485623935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833359e640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833415df10 0x7f8334160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8332d9d640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83340b6250 0x7f833415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 -- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83340b6250 msgr2=0x7f833415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83340b6250 0x7f833415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 -- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833415df10 msgr2=0x7f8334160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833415df10 0x7f8334160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 -- 172.21.15.5:0/2485623935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833415a9e0 con 0x7f83340cefe0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f8332d9d640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83340b6250 0x7f833415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.861+0000 7f833259c640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f8334153f70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f832800c460 tx=0x7f832800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.862+0000 7f831b7fe640 1 -- 172.21.15.5:0/2485623935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328016020 con 0x7f83340cefe0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.862+0000 7f831b7fe640 1 -- 172.21.15.5:0/2485623935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328012870 con 0x7f83340cefe0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.862+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83341f4fc0 con 0x7f83340cefe0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.862+0000 7f831b7fe640 1 -- 172.21.15.5:0/2485623935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328012c60 con 0x7f83340cefe0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.862+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8334159ca0 con 0x7f83340cefe0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.863+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833404ef20 con 0x7f83340cefe0 2024-04-25T09:02:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.863+0000 7f831b7fe640 1 -- 172.21.15.5:0/2485623935 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8328019020 con 0x7f83340cefe0 2024-04-25T09:02:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.864+0000 7f831b7fe640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f832006b4d0 0x7f832006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.864+0000 7f831b7fe640 1 -- 172.21.15.5:0/2485623935 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8328089cf0 con 0x7f83340cefe0 2024-04-25T09:02:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.864+0000 7f8332d9d640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f832006b4d0 0x7f832006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.864+0000 7f8332d9d640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f832006b4d0 0x7f832006d990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f83340ca430 tx=0x7f832c0073e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:32.868+0000 7f831b7fe640 1 -- 172.21.15.5:0/2485623935 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f832808e070 con 0x7f83340cefe0 2024-04-25T09:02:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.046+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83340b78a0 con 0x7f83340cefe0 2024-04-25T09:02:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.047+0000 7f831b7fe640 1 -- 172.21.15.5:0/2485623935 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8328020070 con 0x7f83340cefe0 2024-04-25T09:02:33.036 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f832006b4d0 msgr2=0x7f832006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f832006b4d0 0x7f832006d990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f83340ca430 tx=0x7f832c0073e0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 msgr2=0x7f8334153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f8334153f70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f832800c460 tx=0x7f832800c920 comp rx=0 tx=0).stop 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 shutdown_connections 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f832006b4d0 0x7f832006d990 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833415df10 0x7f8334160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83340cefe0 0x7f8334153f70 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 --2- 172.21.15.5:0/2485623935 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83340b6250 0x7f833415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 >> 172.21.15.5:0/2485623935 conn(0x7f83340668f0 msgr2=0x7f833415d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 shutdown_connections 2024-04-25T09:02:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.048+0000 7f8339053640 1 -- 172.21.15.5:0/2485623935 wait complete. 2024-04-25T09:02:33.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.160+0000 7fd44f39b640 1 Processor -- start 2024-04-25T09:02:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.160+0000 7fd44f39b640 1 -- start start 2024-04-25T09:02:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44f39b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd44815de70 0x7fd4480b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44f39b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4480ce7f0 0x7fd4480cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44f39b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4480cf1c0 con 0x7fd4480b2cc0 2024-04-25T09:02:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44f39b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4480d2a10 con 0x7fd4480ce7f0 2024-04-25T09:02:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44f39b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4480d20e0 con 0x7fd44815de70 2024-04-25T09:02:33.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d938640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4480ce7f0 0x7fd4480cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d938640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4480ce7f0 0x7fd4480cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44992/0 (socket says 172.21.15.5:44992) 2024-04-25T09:02:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d938640 1 -- 172.21.15.5:0/1062156365 learned_addr learned my addr 172.21.15.5:0/1062156365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d137640 1 --2- 172.21.15.5:0/1062156365 >> v2:172.21.15.80:3300/0 conn(0x7fd44815de70 0x7fd4480b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d938640 1 -- 172.21.15.5:0/1062156365 >> v2:172.21.15.80:3300/0 conn(0x7fd44815de70 msgr2=0x7fd4480b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d938640 1 --2- 172.21.15.5:0/1062156365 >> v2:172.21.15.80:3300/0 conn(0x7fd44815de70 0x7fd4480b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d938640 1 -- 172.21.15.5:0/1062156365 >> v1:172.21.15.80:6789/0 conn(0x7fd4480b2cc0 legacy=0x7fd4480b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.161+0000 7fd44d938640 1 -- 172.21.15.5:0/1062156365 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4480d23c0 con 0x7fd4480ce7f0 2024-04-25T09:02:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.162+0000 7fd44d938640 1 --2- 172.21.15.5:0/1062156365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480ce7f0 0x7fd4480cec80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd4480d1650 tx=0x7fd44002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd420f980340694 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.162+0000 7fd43ffff640 1 -- 172.21.15.5:0/1062156365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440036070 con 0x7fd4480ce7f0 2024-04-25T09:02:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.162+0000 7fd43ffff640 1 -- 172.21.15.5:0/1062156365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440031600 con 0x7fd4480ce7f0 2024-04-25T09:02:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.162+0000 7fd43ffff640 1 -- 172.21.15.5:0/1062156365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400319d0 con 0x7fd4480ce7f0 2024-04-25T09:02:33.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 -- 172.21.15.5:0/1062156365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480ce7f0 msgr2=0x7fd4480cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 --2- 172.21.15.5:0/1062156365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480ce7f0 0x7fd4480cec80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd4480d1650 tx=0x7fd44002a6f0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 -- 172.21.15.5:0/1062156365 shutdown_connections 2024-04-25T09:02:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 --2- 172.21.15.5:0/1062156365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480ce7f0 0x7fd4480cec80 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 --2- 172.21.15.5:0/1062156365 >> v2:172.21.15.80:3300/0 conn(0x7fd44815de70 0x7fd4480b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 -- 172.21.15.5:0/1062156365 >> 172.21.15.5:0/1062156365 conn(0x7fd44806b000 msgr2=0x7fd44806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 -- 172.21.15.5:0/1062156365 shutdown_connections 2024-04-25T09:02:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.163+0000 7fd44f39b640 1 -- 172.21.15.5:0/1062156365 wait complete. 2024-04-25T09:02:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.164+0000 7fd44f39b640 1 Processor -- start 2024-04-25T09:02:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.164+0000 7fd44f39b640 1 -- start start 2024-04-25T09:02:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44f39b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480b2cc0 0x7fd4480cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44f39b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4480ce7f0 0x7fd4480c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44f39b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd44815de70 0x7fd44815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44f39b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480b7300 con 0x7fd4480b2cc0 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44f39b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480b9920 con 0x7fd4480ce7f0 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44f39b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480d2ea0 con 0x7fd44815de70 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480b2cc0 0x7fd4480cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480b2cc0 0x7fd4480cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45002/0 (socket says 172.21.15.5:45002) 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 -- 172.21.15.5:0/180814356 learned_addr learned my addr 172.21.15.5:0/180814356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44c936640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4480ce7f0 0x7fd4480c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d938640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd44815de70 0x7fd44815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 -- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd44815de70 msgr2=0x7fd44815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd44815de70 0x7fd44815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 -- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4480ce7f0 msgr2=0x7fd4480c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4480ce7f0 0x7fd4480c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.165+0000 7fd44d137640 1 -- 172.21.15.5:0/180814356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4480c9ab0 con 0x7fd4480b2cc0 2024-04-25T09:02:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.166+0000 7fd44c936640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4480ce7f0 0x7fd4480c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.166+0000 7fd44d137640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480b2cc0 0x7fd4480cd7b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c820 tx=0x7fd44400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.166+0000 7fd43dffb640 1 -- 172.21.15.5:0/180814356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444015070 con 0x7fd4480b2cc0 2024-04-25T09:02:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.166+0000 7fd43dffb640 1 -- 172.21.15.5:0/180814356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd444004020 con 0x7fd4480b2cc0 2024-04-25T09:02:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.166+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4481f7490 con 0x7fd4480b2cc0 2024-04-25T09:02:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.166+0000 7fd43dffb640 1 -- 172.21.15.5:0/180814356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440043f0 con 0x7fd4480b2cc0 2024-04-25T09:02:33.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.166+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4480c9d90 con 0x7fd4480b2cc0 2024-04-25T09:02:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.167+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44804ef20 con 0x7fd4480b2cc0 2024-04-25T09:02:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.167+0000 7fd43dffb640 1 -- 172.21.15.5:0/180814356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd444007830 con 0x7fd4480b2cc0 2024-04-25T09:02:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.168+0000 7fd43dffb640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd42c06b4d0 0x7fd42c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.168+0000 7fd43dffb640 1 -- 172.21.15.5:0/180814356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd44408a000 con 0x7fd4480b2cc0 2024-04-25T09:02:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.168+0000 7fd44c936640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd42c06b4d0 0x7fd42c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.168+0000 7fd44c936640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd42c06b4d0 0x7fd42c06d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd4481f72e0 tx=0x7fd438009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.172+0000 7fd43dffb640 1 -- 172.21.15.5:0/180814356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd444058ea0 con 0x7fd4480b2cc0 2024-04-25T09:02:33.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.391+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4480c6d30 con 0x7fd4480b2cc0 2024-04-25T09:02:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.392+0000 7fd43dffb640 1 -- 172.21.15.5:0/180814356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fd4440587a0 con 0x7fd4480b2cc0 2024-04-25T09:02:33.381 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:33.381 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/551194531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":551194531},{"type":"v1","addr":"172.21.15.5:6835","nonce":551194531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3514707104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3514707104},{"type":"v1","addr":"172.21.15.80:6836","nonce":3514707104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/546123103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":546123103},{"type":"v1","addr":"172.21.15.5:6833","nonce":546123103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:01:01.584978+0000","modified":"2024-04-25T09:01:12.794491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7038":{"gid":7038,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1546784484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1546784484},{"type":"v1","addr":"172.21.15.80:6837","nonce":1546784484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:02:33.381 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 46 2024-04-25T09:02:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd42c06b4d0 msgr2=0x7fd42c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd42c06b4d0 0x7fd42c06d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd4481f72e0 tx=0x7fd438009040 comp rx=0 tx=0).stop 2024-04-25T09:02:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480b2cc0 msgr2=0x7fd4480cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480b2cc0 0x7fd4480cd7b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c820 tx=0x7fd44400cce0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 shutdown_connections 2024-04-25T09:02:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd42c06b4d0 0x7fd42c06d990 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd44815de70 0x7fd44815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4480ce7f0 0x7fd4480c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 --2- 172.21.15.5:0/180814356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4480b2cc0 0x7fd4480cd7b0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 >> 172.21.15.5:0/180814356 conn(0x7fd44806b000 msgr2=0x7fd44815e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 shutdown_connections 2024-04-25T09:02:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.394+0000 7fd44f39b640 1 -- 172.21.15.5:0/180814356 wait complete. 2024-04-25T09:02:33.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:33.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.505+0000 7f145cb5c640 1 Processor -- start 2024-04-25T09:02:33.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.506+0000 7f145cb5c640 1 -- start start 2024-04-25T09:02:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.506+0000 7f145cb5c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1458154f10 0x7f14580b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.506+0000 7f145cb5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14580cfc90 0x7f1458070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.506+0000 7f145cb5c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14580b3f30 con 0x7f145815bbd0 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.506+0000 7f145cb5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145815b0f0 con 0x7f14580cfc90 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.506+0000 7f145cb5c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145815b3d0 con 0x7f1458154f10 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.506+0000 7f1456d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14580cfc90 0x7f1458070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f1456d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14580cfc90 0x7f1458070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45010/0 (socket says 172.21.15.5:45010) 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f1456d9d640 1 -- 172.21.15.5:0/3503925050 learned_addr learned my addr 172.21.15.5:0/3503925050 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f145659c640 1 --2- 172.21.15.5:0/3503925050 >> v2:172.21.15.80:3300/0 conn(0x7f1458154f10 0x7f14580b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f1456d9d640 1 -- 172.21.15.5:0/3503925050 >> v2:172.21.15.80:3300/0 conn(0x7f1458154f10 msgr2=0x7f14580b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:33.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f1456d9d640 1 --2- 172.21.15.5:0/3503925050 >> v2:172.21.15.80:3300/0 conn(0x7f1458154f10 0x7f14580b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f1456d9d640 1 -- 172.21.15.5:0/3503925050 >> v1:172.21.15.80:6789/0 conn(0x7f145815bbd0 legacy=0x7f14580cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f1456d9d640 1 -- 172.21.15.5:0/3503925050 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14581552f0 con 0x7f14580cfc90 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f145659c640 1 --2- 172.21.15.5:0/3503925050 >> v2:172.21.15.80:3300/0 conn(0x7f1458154f10 0x7f14580b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.507+0000 7f1456d9d640 1 --2- 172.21.15.5:0/3503925050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14580cfc90 0x7f1458070f50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f14580b2610 tx=0x7f145002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d24ae12b1ae6a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f1455d9b640 1 -- 172.21.15.5:0/3503925050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450036070 con 0x7f14580cfc90 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f1455d9b640 1 -- 172.21.15.5:0/3503925050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450031600 con 0x7f14580cfc90 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f1455d9b640 1 -- 172.21.15.5:0/3503925050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500319d0 con 0x7f14580cfc90 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 -- 172.21.15.5:0/3503925050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14580cfc90 msgr2=0x7f1458070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 --2- 172.21.15.5:0/3503925050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14580cfc90 0x7f1458070f50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f14580b2610 tx=0x7f145002a660 comp rx=0 tx=0).stop 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 -- 172.21.15.5:0/3503925050 shutdown_connections 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 --2- 172.21.15.5:0/3503925050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14580cfc90 0x7f1458070f50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 --2- 172.21.15.5:0/3503925050 >> v2:172.21.15.80:3300/0 conn(0x7f1458154f10 0x7f14580b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 -- 172.21.15.5:0/3503925050 >> 172.21.15.5:0/3503925050 conn(0x7f14580668f0 msgr2=0x7f1458066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 -- 172.21.15.5:0/3503925050 shutdown_connections 2024-04-25T09:02:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.508+0000 7f145cb5c640 1 -- 172.21.15.5:0/3503925050 wait complete. 2024-04-25T09:02:33.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 Processor -- start 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 -- start start 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14580cfc90 0x7f145814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1458154f10 0x7f1458158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145815bbd0 0x7f1458156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14580b3b30 con 0x7f145815bbd0 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14580b39b0 con 0x7f1458154f10 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f145cb5c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580b3cb0 con 0x7f14580cfc90 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f1456d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145815bbd0 0x7f1458156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f1456d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145815bbd0 0x7f1458156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45016/0 (socket says 172.21.15.5:45016) 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.510+0000 7f1456d9d640 1 -- 172.21.15.5:0/273497719 learned_addr learned my addr 172.21.15.5:0/273497719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f144ffff640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1458154f10 0x7f1458158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f145659c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14580cfc90 0x7f145814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f1456d9d640 1 -- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14580cfc90 msgr2=0x7f145814fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f1456d9d640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14580cfc90 0x7f145814fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f1456d9d640 1 -- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1458154f10 msgr2=0x7f1458158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f1456d9d640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1458154f10 0x7f1458158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f1456d9d640 1 -- 172.21.15.5:0/273497719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458155960 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f1456d9d640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145815bbd0 0x7f1458156a00 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f1450009f40 tx=0x7f1450004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f144effd640 1 -- 172.21.15.5:0/273497719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450036050 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f144effd640 1 -- 172.21.15.5:0/273497719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450042070 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1458155f20 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f144effd640 1 -- 172.21.15.5:0/273497719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450009510 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.511+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14581564e0 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.512+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145804ef20 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.513+0000 7f144effd640 1 -- 172.21.15.5:0/273497719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1450007bd0 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.513+0000 7f144effd640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f143806b4d0 0x7f143806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.513+0000 7f144effd640 1 -- 172.21.15.5:0/273497719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f14500ab050 con 0x7f145815bbd0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.513+0000 7f145659c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f143806b4d0 0x7f143806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.514+0000 7f145659c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f143806b4d0 0x7f143806d990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f14581508e0 tx=0x7f1448008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.517+0000 7f144effd640 1 -- 172.21.15.5:0/273497719 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14500799c0 con 0x7f145815bbd0 2024-04-25T09:02:33.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.703+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1458070d30 con 0x7f145815bbd0 2024-04-25T09:02:33.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.704+0000 7f144effd640 1 -- 172.21.15.5:0/273497719 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16796 (secure 0 0 0) 0x7f145007da60 con 0x7f145815bbd0 2024-04-25T09:02:33.693 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:33.694 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":77,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:10.117549+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:59.869846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:00.565749+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f143806b4d0 msgr2=0x7f143806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f143806b4d0 0x7f143806d990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f14581508e0 tx=0x7f1448008040 comp rx=0 tx=0).stop 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145815bbd0 msgr2=0x7f1458156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145815bbd0 0x7f1458156a00 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f1450009f40 tx=0x7f1450004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 shutdown_connections 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f143806b4d0 0x7f143806d990 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f145815bbd0 0x7f1458156a00 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1458154f10 0x7f1458158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 --2- 172.21.15.5:0/273497719 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14580cfc90 0x7f145814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 >> 172.21.15.5:0/273497719 conn(0x7f14580668f0 msgr2=0x7f145815d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 shutdown_connections 2024-04-25T09:02:33.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.706+0000 7f145cb5c640 1 -- 172.21.15.5:0/273497719 wait complete. 2024-04-25T09:02:33.706 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:02:33.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:33.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.818+0000 7eff5897e640 1 Processor -- start 2024-04-25T09:02:33.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.818+0000 7eff5897e640 1 -- start start 2024-04-25T09:02:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5897e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff54154f10 0x7eff540b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5897e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff540cfc90 0x7eff54070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5897e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff540b3f30 con 0x7eff5415bbd0 2024-04-25T09:02:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5897e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5415b0f0 con 0x7eff54154f10 2024-04-25T09:02:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5897e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5415b3d0 con 0x7eff540cfc90 2024-04-25T09:02:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff54154f10 0x7eff540b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff54154f10 0x7eff540b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45026/0 (socket says 172.21.15.5:45026) 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5259c640 1 -- 172.21.15.5:0/67401157 learned_addr learned my addr 172.21.15.5:0/67401157 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff52d9d640 1 --2- 172.21.15.5:0/67401157 >> v2:172.21.15.80:3300/0 conn(0x7eff540cfc90 0x7eff54070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5259c640 1 -- 172.21.15.5:0/67401157 >> v2:172.21.15.80:3300/0 conn(0x7eff540cfc90 msgr2=0x7eff54070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5259c640 1 --2- 172.21.15.5:0/67401157 >> v2:172.21.15.80:3300/0 conn(0x7eff540cfc90 0x7eff54070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5259c640 1 -- 172.21.15.5:0/67401157 >> v1:172.21.15.80:6789/0 conn(0x7eff5415bbd0 legacy=0x7eff540cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.819+0000 7eff5259c640 1 -- 172.21.15.5:0/67401157 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff541552f0 con 0x7eff54154f10 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.820+0000 7eff5259c640 1 --2- 172.21.15.5:0/67401157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff54154f10 0x7eff540b3470 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7eff540b4c10 tx=0x7eff4402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a321997b59fd30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.820+0000 7eff51d9b640 1 -- 172.21.15.5:0/67401157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44032710 con 0x7eff54154f10 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.820+0000 7eff51d9b640 1 -- 172.21.15.5:0/67401157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff440328b0 con 0x7eff54154f10 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.820+0000 7eff51d9b640 1 -- 172.21.15.5:0/67401157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44032ca0 con 0x7eff54154f10 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.820+0000 7eff5897e640 1 -- 172.21.15.5:0/67401157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff54154f10 msgr2=0x7eff540b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.820+0000 7eff5897e640 1 --2- 172.21.15.5:0/67401157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff54154f10 0x7eff540b3470 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7eff540b4c10 tx=0x7eff4402c850 comp rx=0 tx=0).stop 2024-04-25T09:02:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.821+0000 7eff5897e640 1 -- 172.21.15.5:0/67401157 shutdown_connections 2024-04-25T09:02:33.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.821+0000 7eff5897e640 1 --2- 172.21.15.5:0/67401157 >> v2:172.21.15.80:3300/0 conn(0x7eff540cfc90 0x7eff54070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.821+0000 7eff5897e640 1 --2- 172.21.15.5:0/67401157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff54154f10 0x7eff540b3470 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.821+0000 7eff5897e640 1 -- 172.21.15.5:0/67401157 >> 172.21.15.5:0/67401157 conn(0x7eff540668f0 msgr2=0x7eff54066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.821+0000 7eff5897e640 1 -- 172.21.15.5:0/67401157 shutdown_connections 2024-04-25T09:02:33.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.821+0000 7eff5897e640 1 -- 172.21.15.5:0/67401157 wait complete. 2024-04-25T09:02:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.822+0000 7eff5897e640 1 Processor -- start 2024-04-25T09:02:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.822+0000 7eff5897e640 1 -- start start 2024-04-25T09:02:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5897e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff540cfc90 0x7eff541f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5897e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7eff54154f10 0x7eff54147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5897e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5415bbd0 0x7eff541f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5897e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540b3b30 con 0x7eff540cfc90 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5897e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540b39b0 con 0x7eff5415bbd0 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5897e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540b3cb0 con 0x7eff54154f10 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff540cfc90 0x7eff541f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff540cfc90 0x7eff541f78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45032/0 (socket says 172.21.15.5:45032) 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 -- 172.21.15.5:0/800643130 learned_addr learned my addr 172.21.15.5:0/800643130 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff52d9d640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5415bbd0 0x7eff541f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff4bfff640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7eff54154f10 0x7eff54147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 -- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7eff54154f10 msgr2=0x7eff54147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7eff54154f10 0x7eff54147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 -- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5415bbd0 msgr2=0x7eff541f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5415bbd0 0x7eff541f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 -- 172.21.15.5:0/800643130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff541f4330 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff4bfff640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7eff54154f10 0x7eff54147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.823+0000 7eff5259c640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff540cfc90 0x7eff541f78e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7eff4400b2c0 tx=0x7eff440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.824+0000 7eff4affd640 1 -- 172.21.15.5:0/800643130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44041070 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.824+0000 7eff4affd640 1 -- 172.21.15.5:0/800643130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44003830 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.824+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff541f4610 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.824+0000 7eff4affd640 1 -- 172.21.15.5:0/800643130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44003c20 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.824+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff541f73c0 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.825+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5404ef20 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.825+0000 7eff4affd640 1 -- 172.21.15.5:0/800643130 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff44044070 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.826+0000 7eff4affd640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff3406b4d0 0x7eff3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.826+0000 7eff4affd640 1 -- 172.21.15.5:0/800643130 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7eff440ab200 con 0x7eff540cfc90 2024-04-25T09:02:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.826+0000 7eff4bfff640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff3406b4d0 0x7eff3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.826+0000 7eff4bfff640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff3406b4d0 0x7eff3406d990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff3c006fd0 tx=0x7eff3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:33.830+0000 7eff4affd640 1 -- 172.21.15.5:0/800643130 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff44079a60 con 0x7eff540cfc90 2024-04-25T09:02:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.047+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff5406c910 con 0x7eff540cfc90 2024-04-25T09:02:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.047+0000 7eff4affd640 1 -- 172.21.15.5:0/800643130 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4928 (secure 0 0 0) 0x7eff4407db00 con 0x7eff540cfc90 2024-04-25T09:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/551194531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":551194531},{"type":"v1","addr":"172.21.15.5:6835","nonce":551194531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3514707104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3514707104},{"type":"v1","addr":"172.21.15.80:6836","nonce":3514707104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/546123103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":546123103},{"type":"v1","addr":"172.21.15.5:6833","nonce":546123103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:01:01.584978+0000","modified":"2024-04-25T09:01:12.794491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7038":{"gid":7038,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1546784484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1546784484},{"type":"v1","addr":"172.21.15.80:6837","nonce":1546784484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:02:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 46 2024-04-25T09:02:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff3406b4d0 msgr2=0x7eff3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff3406b4d0 0x7eff3406d990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff3c006fd0 tx=0x7eff3c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff540cfc90 msgr2=0x7eff541f78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff540cfc90 0x7eff541f78e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7eff4400b2c0 tx=0x7eff440046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 shutdown_connections 2024-04-25T09:02:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7eff3406b4d0 0x7eff3406d990 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5415bbd0 0x7eff541f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7eff54154f10 0x7eff54147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 --2- 172.21.15.5:0/800643130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff540cfc90 0x7eff541f78e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 >> 172.21.15.5:0/800643130 conn(0x7eff540668f0 msgr2=0x7eff54154030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 shutdown_connections 2024-04-25T09:02:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.049+0000 7eff5897e640 1 -- 172.21.15.5:0/800643130 wait complete. 2024-04-25T09:02:34.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.161+0000 7f82b5cac640 1 Processor -- start 2024-04-25T09:02:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.161+0000 7f82b5cac640 1 -- start start 2024-04-25T09:02:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.161+0000 7f82b5cac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82b006b7d0 0x7f82b006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.161+0000 7f82b5cac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b015e120 0x7f82b00d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.161+0000 7f82b5cac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b00b4730 con 0x7f82b006bbb0 2024-04-25T09:02:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.161+0000 7f82b5cac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00d0b70 con 0x7f82b006b7d0 2024-04-25T09:02:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.161+0000 7f82b5cac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00cbf30 con 0x7f82b015e120 2024-04-25T09:02:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82af7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82b006b7d0 0x7f82b006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82af7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82b006b7d0 0x7f82b006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45048/0 (socket says 172.21.15.5:45048) 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82af7fe640 1 -- 172.21.15.5:0/1682730203 learned_addr learned my addr 172.21.15.5:0/1682730203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82affff640 1 --2- 172.21.15.5:0/1682730203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b015e120 0x7f82b00d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82af7fe640 1 -- 172.21.15.5:0/1682730203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b015e120 msgr2=0x7f82b00d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82af7fe640 1 --2- 172.21.15.5:0/1682730203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b015e120 0x7f82b00d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82af7fe640 1 -- 172.21.15.5:0/1682730203 >> v1:172.21.15.80:6789/0 conn(0x7f82b006bbb0 legacy=0x7f82b015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.162+0000 7f82af7fe640 1 -- 172.21.15.5:0/1682730203 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00d0da0 con 0x7f82b006b7d0 2024-04-25T09:02:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82af7fe640 1 --2- 172.21.15.5:0/1682730203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006b7d0 0x7f82b006aef0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009870 tx=0x7f82a002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa2c7dc7157111f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82aeffd640 1 -- 172.21.15.5:0/1682730203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0037070 con 0x7f82b006b7d0 2024-04-25T09:02:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82aeffd640 1 -- 172.21.15.5:0/1682730203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a002ae50 con 0x7f82b006b7d0 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82aeffd640 1 -- 172.21.15.5:0/1682730203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0032860 con 0x7f82b006b7d0 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 -- 172.21.15.5:0/1682730203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006b7d0 msgr2=0x7f82b006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 --2- 172.21.15.5:0/1682730203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006b7d0 0x7f82b006aef0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009870 tx=0x7f82a002a300 comp rx=0 tx=0).stop 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 -- 172.21.15.5:0/1682730203 shutdown_connections 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 --2- 172.21.15.5:0/1682730203 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b015e120 0x7f82b00d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 --2- 172.21.15.5:0/1682730203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006b7d0 0x7f82b006aef0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 -- 172.21.15.5:0/1682730203 >> 172.21.15.5:0/1682730203 conn(0x7f82b00d18e0 msgr2=0x7f82b00d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 -- 172.21.15.5:0/1682730203 shutdown_connections 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.163+0000 7f82b5cac640 1 -- 172.21.15.5:0/1682730203 wait complete. 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.165+0000 7f82b5cac640 1 Processor -- start 2024-04-25T09:02:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.165+0000 7f82b5cac640 1 -- start start 2024-04-25T09:02:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.165+0000 7f82b5cac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b006b7d0 0x7f82b015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.165+0000 7f82b5cac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006bbb0 0x7f82b01531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.165+0000 7f82b5cac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015e120 0x7f82b00b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82b5cac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00cc460 con 0x7f82b006bbb0 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82b5cac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00cc7d0 con 0x7f82b015e120 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82b5cac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00ccc60 con 0x7f82b006b7d0 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006bbb0 0x7f82b01531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006bbb0 0x7f82b01531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45056/0 (socket says 172.21.15.5:45056) 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 -- 172.21.15.5:0/3589511907 learned_addr learned my addr 172.21.15.5:0/3589511907 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82affff640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015e120 0x7f82b00b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82af7fe640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b006b7d0 0x7f82b015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 -- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b006b7d0 msgr2=0x7f82b015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b006b7d0 0x7f82b015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 -- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015e120 msgr2=0x7f82b00b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015e120 0x7f82b00b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 -- 172.21.15.5:0/3589511907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0160350 con 0x7f82b006bbb0 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82af7fe640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b006b7d0 0x7f82b015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82a6ffd640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006bbb0 0x7f82b01531b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f829800c400 tx=0x7f829800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82acff9640 1 -- 172.21.15.5:0/3589511907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980052d0 con 0x7f82b006bbb0 2024-04-25T09:02:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82acff9640 1 -- 172.21.15.5:0/3589511907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298005490 con 0x7f82b006bbb0 2024-04-25T09:02:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b00c8ae0 con 0x7f82b006bbb0 2024-04-25T09:02:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82acff9640 1 -- 172.21.15.5:0/3589511907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298007260 con 0x7f82b006bbb0 2024-04-25T09:02:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.166+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b00c90a0 con 0x7f82b006bbb0 2024-04-25T09:02:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.167+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b00c92a0 con 0x7f82b006bbb0 2024-04-25T09:02:34.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.168+0000 7f82acff9640 1 -- 172.21.15.5:0/3589511907 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8298007400 con 0x7f82b006bbb0 2024-04-25T09:02:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.168+0000 7f82acff9640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f829006b4d0 0x7f829006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.168+0000 7f82acff9640 1 -- 172.21.15.5:0/3589511907 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8298089680 con 0x7f82b006bbb0 2024-04-25T09:02:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.169+0000 7f82af7fe640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f829006b4d0 0x7f829006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.169+0000 7f82af7fe640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f829006b4d0 0x7f829006d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82a0034000 tx=0x7f82a002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.173+0000 7f82acff9640 1 -- 172.21.15.5:0/3589511907 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f82b00c92a0 con 0x7f82b006bbb0 2024-04-25T09:02:34.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.390+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82b004ef20 con 0x7f82b006bbb0 2024-04-25T09:02:34.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.390+0000 7f82acff9640 1 -- 172.21.15.5:0/3589511907 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f82b00b4730 con 0x7f82b006bbb0 2024-04-25T09:02:34.380 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:34.380 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/551194531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":551194531},{"type":"v1","addr":"172.21.15.5:6835","nonce":551194531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3514707104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3514707104},{"type":"v1","addr":"172.21.15.80:6836","nonce":3514707104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/546123103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":546123103},{"type":"v1","addr":"172.21.15.5:6833","nonce":546123103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:01:01.584978+0000","modified":"2024-04-25T09:01:12.794491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7038":{"gid":7038,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1546784484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1546784484},{"type":"v1","addr":"172.21.15.80:6837","nonce":1546784484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:02:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 46 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f829006b4d0 msgr2=0x7f829006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f829006b4d0 0x7f829006d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82a0034000 tx=0x7f82a002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006bbb0 msgr2=0x7f82b01531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006bbb0 0x7f82b01531b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f829800c400 tx=0x7f829800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 shutdown_connections 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f829006b4d0 0x7f829006d990 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015e120 0x7f82b00b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b006bbb0 0x7f82b01531b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 --2- 172.21.15.5:0/3589511907 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f82b006b7d0 0x7f82b015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 >> 172.21.15.5:0/3589511907 conn(0x7f82b00d18e0 msgr2=0x7f82b00cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 shutdown_connections 2024-04-25T09:02:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.392+0000 7f82b5cac640 1 -- 172.21.15.5:0/3589511907 wait complete. 2024-04-25T09:02:34.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.503+0000 7fda4865d640 1 Processor -- start 2024-04-25T09:02:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.503+0000 7fda4865d640 1 -- start start 2024-04-25T09:02:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.504+0000 7fda4865d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda4015de70 0x7fda400b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.504+0000 7fda4865d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda400b2cc0 0x7fda400b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.504+0000 7fda4865d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda400d20e0 con 0x7fda400b7130 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.504+0000 7fda4865d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda400d2a10 con 0x7fda4015de70 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.504+0000 7fda4865d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda400d23c0 con 0x7fda400b2cc0 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda463f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda4015de70 0x7fda400b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda463f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda4015de70 0x7fda400b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45060/0 (socket says 172.21.15.5:45060) 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda463f9640 1 -- 172.21.15.5:0/2051836818 learned_addr learned my addr 172.21.15.5:0/2051836818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda45bf8640 1 --2- 172.21.15.5:0/2051836818 >> v2:172.21.15.80:3300/0 conn(0x7fda400b2cc0 0x7fda400b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda463f9640 1 -- 172.21.15.5:0/2051836818 >> v2:172.21.15.80:3300/0 conn(0x7fda400b2cc0 msgr2=0x7fda400b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda463f9640 1 --2- 172.21.15.5:0/2051836818 >> v2:172.21.15.80:3300/0 conn(0x7fda400b2cc0 0x7fda400b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda463f9640 1 -- 172.21.15.5:0/2051836818 >> v1:172.21.15.80:6789/0 conn(0x7fda400b7130 legacy=0x7fda400ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.505+0000 7fda463f9640 1 -- 172.21.15.5:0/2051836818 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda400d26a0 con 0x7fda4015de70 2024-04-25T09:02:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.506+0000 7fda463f9640 1 --2- 172.21.15.5:0/2051836818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda4015de70 0x7fda400b93e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009870 tx=0x7fda3c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dd536eb1aca8b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.506+0000 7fda453f7640 1 -- 172.21.15.5:0/2051836818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c037070 con 0x7fda4015de70 2024-04-25T09:02:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.506+0000 7fda453f7640 1 -- 172.21.15.5:0/2051836818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c032440 con 0x7fda4015de70 2024-04-25T09:02:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.506+0000 7fda453f7640 1 -- 172.21.15.5:0/2051836818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c032810 con 0x7fda4015de70 2024-04-25T09:02:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.506+0000 7fda4865d640 1 -- 172.21.15.5:0/2051836818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda4015de70 msgr2=0x7fda400b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.506+0000 7fda4865d640 1 --2- 172.21.15.5:0/2051836818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda4015de70 0x7fda400b93e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009870 tx=0x7fda3c02a2a0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.507+0000 7fda4865d640 1 -- 172.21.15.5:0/2051836818 shutdown_connections 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.507+0000 7fda4865d640 1 --2- 172.21.15.5:0/2051836818 >> v2:172.21.15.80:3300/0 conn(0x7fda400b2cc0 0x7fda400b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.507+0000 7fda4865d640 1 --2- 172.21.15.5:0/2051836818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda4015de70 0x7fda400b93e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.507+0000 7fda4865d640 1 -- 172.21.15.5:0/2051836818 >> 172.21.15.5:0/2051836818 conn(0x7fda4006b000 msgr2=0x7fda4006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.507+0000 7fda4865d640 1 -- 172.21.15.5:0/2051836818 shutdown_connections 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.507+0000 7fda4865d640 1 -- 172.21.15.5:0/2051836818 wait complete. 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 Processor -- start 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 -- start start 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda400b2cc0 0x7fda4014d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda400b7130 0x7fda400cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda4015de70 0x7fda400cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda400cf080 con 0x7fda400b2cc0 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda400cef00 con 0x7fda4015de70 2024-04-25T09:02:34.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.508+0000 7fda4865d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda400cf200 con 0x7fda400b7130 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda400b2cc0 0x7fda4014d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda400b2cc0 0x7fda4014d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45064/0 (socket says 172.21.15.5:45064) 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 -- 172.21.15.5:0/2959333923 learned_addr learned my addr 172.21.15.5:0/2959333923 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda45bf8640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda400b7130 0x7fda400cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda46bfa640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda4015de70 0x7fda400cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 -- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda400b7130 msgr2=0x7fda400cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda400b7130 0x7fda400cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 -- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda4015de70 msgr2=0x7fda400cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda4015de70 0x7fda400cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 -- 172.21.15.5:0/2959333923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4014d780 con 0x7fda400b2cc0 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda463f9640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda400b2cc0 0x7fda4014d240 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fda3c000c00 tx=0x7fda3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda36ffd640 1 -- 172.21.15.5:0/2959333923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c037040 con 0x7fda400b2cc0 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda36ffd640 1 -- 172.21.15.5:0/2959333923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c042070 con 0x7fda400b2cc0 2024-04-25T09:02:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda400c7480 con 0x7fda400b2cc0 2024-04-25T09:02:34.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda36ffd640 1 -- 172.21.15.5:0/2959333923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c030880 con 0x7fda400b2cc0 2024-04-25T09:02:34.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.509+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda400c7a40 con 0x7fda400b2cc0 2024-04-25T09:02:34.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.510+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4004ef20 con 0x7fda400b2cc0 2024-04-25T09:02:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.511+0000 7fda36ffd640 1 -- 172.21.15.5:0/2959333923 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda3c030a20 con 0x7fda400b2cc0 2024-04-25T09:02:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.511+0000 7fda36ffd640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda2406b4d0 0x7fda2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.511+0000 7fda36ffd640 1 -- 172.21.15.5:0/2959333923 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fda3c0aaa70 con 0x7fda400b2cc0 2024-04-25T09:02:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.511+0000 7fda45bf8640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda2406b4d0 0x7fda2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.512+0000 7fda45bf8640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda2406b4d0 0x7fda2406d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fda40160b20 tx=0x7fda30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.515+0000 7fda36ffd640 1 -- 172.21.15.5:0/2959333923 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda3c079910 con 0x7fda400b2cc0 2024-04-25T09:02:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.696+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda4015c8b0 con 0x7fda400b2cc0 2024-04-25T09:02:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.697+0000 7fda36ffd640 1 -- 172.21.15.5:0/2959333923 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16796 (secure 0 0 0) 0x7fda3c079210 con 0x7fda400b2cc0 2024-04-25T09:02:34.687 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:34.687 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":77,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:10.117549+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:00:59.869846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:00.565749+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.22","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:34.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda2406b4d0 msgr2=0x7fda2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda2406b4d0 0x7fda2406d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fda40160b20 tx=0x7fda30008040 comp rx=0 tx=0).stop 2024-04-25T09:02:34.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda400b2cc0 msgr2=0x7fda4014d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda400b2cc0 0x7fda4014d240 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fda3c000c00 tx=0x7fda3c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 shutdown_connections 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda2406b4d0 0x7fda2406d990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda4015de70 0x7fda400cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda400b7130 0x7fda400cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 --2- 172.21.15.5:0/2959333923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda400b2cc0 0x7fda4014d240 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 >> 172.21.15.5:0/2959333923 conn(0x7fda4006b000 msgr2=0x7fda400d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 shutdown_connections 2024-04-25T09:02:34.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.699+0000 7fda4865d640 1 -- 172.21.15.5:0/2959333923 wait complete. 2024-04-25T09:02:34.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:02:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.812+0000 7fd1c3ce1640 1 Processor -- start 2024-04-25T09:02:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.812+0000 7fd1c3ce1640 1 -- start start 2024-04-25T09:02:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c3ce1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1bc0b9990 0x7fd1bc0d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c3ce1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc0d21f0 0x7fd1bc0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c3ce1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0d2670 con 0x7fd1bc0d05f0 2024-04-25T09:02:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c3ce1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d2950 con 0x7fd1bc0b9990 2024-04-25T09:02:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c3ce1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d2c30 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c127c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1bc0b9990 0x7fd1bc0d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c1a7d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1bc0d05f0 0x7fd1bc0d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46280/0 (socket says 172.21.15.5:46280) 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c1a7d640 1 -- 172.21.15.5:0/969605813 learned_addr learned my addr 172.21.15.5:0/969605813 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c127c640 1 --2- 172.21.15.5:0/969605813 >> v2:172.21.15.5:3300/0 conn(0x7fd1bc0b9990 0x7fd1bc0d1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45078/0 (socket says 172.21.15.5:45078) 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c227e640 1 --2- 172.21.15.5:0/969605813 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc0d21f0 0x7fd1bc0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c127c640 1 -- 172.21.15.5:0/969605813 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc0d21f0 msgr2=0x7fd1bc0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c127c640 1 --2- 172.21.15.5:0/969605813 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc0d21f0 0x7fd1bc0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c127c640 1 -- 172.21.15.5:0/969605813 >> v1:172.21.15.5:6789/0 conn(0x7fd1bc0d05f0 legacy=0x7fd1bc0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c0a7b640 1 -- 172.21.15.5:0/969605813 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793700740 0 0) 0x7fd1bc0d2670 con 0x7fd1bc0d05f0 2024-04-25T09:02:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.813+0000 7fd1c127c640 1 -- 172.21.15.5:0/969605813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0d2f10 con 0x7fd1bc0b9990 2024-04-25T09:02:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.814+0000 7fd1c127c640 1 --2- 172.21.15.5:0/969605813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0b9990 0x7fd1bc0d1cb0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0097a0 tx=0x7fd1ac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3469080f657cfc0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.814+0000 7fd1c0a7b640 1 -- 172.21.15.5:0/969605813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac037070 con 0x7fd1bc0b9990 2024-04-25T09:02:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.814+0000 7fd1c0a7b640 1 -- 172.21.15.5:0/969605813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac032440 con 0x7fd1bc0b9990 2024-04-25T09:02:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.814+0000 7fd1c0a7b640 1 -- 172.21.15.5:0/969605813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac032810 con 0x7fd1bc0b9990 2024-04-25T09:02:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/969605813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0b9990 msgr2=0x7fd1bc0d1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/969605813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0b9990 0x7fd1bc0d1cb0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0097a0 tx=0x7fd1ac02a210 comp rx=0 tx=0).stop 2024-04-25T09:02:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/969605813 shutdown_connections 2024-04-25T09:02:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/969605813 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc0d21f0 0x7fd1bc0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/969605813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0b9990 0x7fd1bc0d1cb0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/969605813 >> 172.21.15.5:0/969605813 conn(0x7fd1bc06b000 msgr2=0x7fd1bc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/969605813 shutdown_connections 2024-04-25T09:02:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.815+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/969605813 wait complete. 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.816+0000 7fd1c3ce1640 1 Processor -- start 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.816+0000 7fd1c3ce1640 1 -- start start 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c3ce1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc0d05f0 0x7fd1bc1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c3ce1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0d21f0 0x7fd1bc160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c3ce1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc1f3af0 0x7fd1bc15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c3ce1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d3890 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c3ce1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d3710 con 0x7fd1bc0d05f0 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c3ce1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d3a10 con 0x7fd1bc1f3af0 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0d21f0 0x7fd1bc160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0d21f0 0x7fd1bc160cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45092/0 (socket says 172.21.15.5:45092) 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 -- 172.21.15.5:0/2481562590 learned_addr learned my addr 172.21.15.5:0/2481562590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c227e640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc1f3af0 0x7fd1bc15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 -- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc1f3af0 msgr2=0x7fd1bc15bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c1a7d640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc0d05f0 0x7fd1bc1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc1f3af0 0x7fd1bc15bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 -- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc0d05f0 msgr2=0x7fd1bc1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc0d05f0 0x7fd1bc1511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 -- 172.21.15.5:0/2481562590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc151720 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c227e640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc1f3af0 0x7fd1bc15bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c127c640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0d21f0 0x7fd1bc160cf0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000c00 tx=0x7fd1ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1b27fc640 1 -- 172.21.15.5:0/2481562590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac037040 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1b27fc640 1 -- 172.21.15.5:0/2481562590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac042070 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.817+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0cc0a0 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.818+0000 7fd1b27fc640 1 -- 172.21.15.5:0/2481562590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac030bb0 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.818+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc0cc660 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.819+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc04ef20 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.819+0000 7fd1b27fc640 1 -- 172.21.15.5:0/2481562590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd1ac047460 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.820+0000 7fd1b27fc640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd1a006b500 0x7fd1a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.820+0000 7fd1b27fc640 1 -- 172.21.15.5:0/2481562590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd1ac0aad90 con 0x7fd1bc0d21f0 2024-04-25T09:02:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.820+0000 7fd1c1a7d640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd1a006b500 0x7fd1a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.820+0000 7fd1c1a7d640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd1a006b500 0x7fd1a006d9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8007fd0 tx=0x7fd1b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:34.824+0000 7fd1b27fc640 1 -- 172.21.15.5:0/2481562590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd1ac032e20 con 0x7fd1bc0d21f0 2024-04-25T09:02:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.044+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1bc0b3320 con 0x7fd1bc0d21f0 2024-04-25T09:02:35.034 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:02:35.045+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:02:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.046+0000 7fd1b27fc640 1 -- 172.21.15.5:0/2481562590 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1ac079c30 con 0x7fd1bc0d21f0 2024-04-25T09:02:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:02:35.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd1a006b500 msgr2=0x7fd1a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd1a006b500 0x7fd1a006d9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8007fd0 tx=0x7fd1b8009040 comp rx=0 tx=0).stop 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0d21f0 msgr2=0x7fd1bc160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0d21f0 0x7fd1bc160cf0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000c00 tx=0x7fd1ac0046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 shutdown_connections 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd1a006b500 0x7fd1a006d9c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd1bc1f3af0 0x7fd1bc15bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1bc0d21f0 0x7fd1bc160cf0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 --2- 172.21.15.5:0/2481562590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc0d05f0 0x7fd1bc1511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 >> 172.21.15.5:0/2481562590 conn(0x7fd1bc06b000 msgr2=0x7fd1bc0b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 shutdown_connections 2024-04-25T09:02:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.049+0000 7fd1c3ce1640 1 -- 172.21.15.5:0/2481562590 wait complete. 2024-04-25T09:02:35.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:02:35.078 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:02:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.163+0000 7f47ba56a640 1 Processor -- start 2024-04-25T09:02:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.163+0000 7f47ba56a640 1 -- start start 2024-04-25T09:02:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47ba56a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b4072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47ba56a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b40b0c70 con 0x7f47b415d8c0 2024-04-25T09:02:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47ba56a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b40b0f50 con 0x7f47b40b36f0 2024-04-25T09:02:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47ba56a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40b1a50 con 0x7f47b40b11b0 2024-04-25T09:02:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47b415d8c0 0x7f47b40b2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46296/0 (socket says 172.21.15.5:46296) 2024-04-25T09:02:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b3fff640 1 -- 172.21.15.5:0/4194200592 learned_addr learned my addr 172.21.15.5:0/4194200592 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b8b07640 1 --2- 172.21.15.5:0/4194200592 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b4072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b2ffd640 1 -- 172.21.15.5:0/4194200592 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915491153 0 0) 0x7f47b40b0c70 con 0x7f47b415d8c0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b2ffd640 1 -- 172.21.15.5:0/4194200592 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a0003440 con 0x7f47b415d8c0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b2ffd640 1 -- 172.21.15.5:0/4194200592 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123543826 0 0) 0x7f47b40b0f50 con 0x7f47b40b36f0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b8b07640 1 -- 172.21.15.5:0/4194200592 >> v1:172.21.15.80:6789/0 conn(0x7f47b40b36f0 legacy=0x7f47b40adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b8b07640 1 -- 172.21.15.5:0/4194200592 >> v1:172.21.15.5:6789/0 conn(0x7f47b415d8c0 legacy=0x7f47b40b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.164+0000 7f47b8b07640 1 -- 172.21.15.5:0/4194200592 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b40cc420 con 0x7f47b40b11b0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.165+0000 7f47b8b07640 1 --2- 172.21.15.5:0/4194200592 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b4072b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009dc0 tx=0x7f47ac02a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de8efe39817c6b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.165+0000 7f47b2ffd640 1 -- 172.21.15.5:0/4194200592 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac035020 con 0x7f47b40b11b0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.165+0000 7f47b2ffd640 1 -- 172.21.15.5:0/4194200592 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac007540 con 0x7f47b40b11b0 2024-04-25T09:02:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.165+0000 7f47b2ffd640 1 -- 172.21.15.5:0/4194200592 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c001690 con 0x7f47b40b11b0 2024-04-25T09:02:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.166+0000 7f47ba56a640 1 -- 172.21.15.5:0/4194200592 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 msgr2=0x7f47b4072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.166+0000 7f47ba56a640 1 --2- 172.21.15.5:0/4194200592 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b4072b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009dc0 tx=0x7f47ac02a530 comp rx=0 tx=0).stop 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.166+0000 7f47ba56a640 1 -- 172.21.15.5:0/4194200592 shutdown_connections 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.166+0000 7f47ba56a640 1 --2- 172.21.15.5:0/4194200592 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b4072b90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.166+0000 7f47ba56a640 1 -- 172.21.15.5:0/4194200592 >> 172.21.15.5:0/4194200592 conn(0x7f47b4072070 msgr2=0x7f47b4072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.166+0000 7f47ba56a640 1 -- 172.21.15.5:0/4194200592 shutdown_connections 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.166+0000 7f47ba56a640 1 -- 172.21.15.5:0/4194200592 wait complete. 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.167+0000 7f47ba56a640 1 Processor -- start 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.167+0000 7f47ba56a640 1 -- start start 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47ba56a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47ba56a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b40b36f0 0x7f47b4148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47ba56a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47b415d8c0 0x7f47b4151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47ba56a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b415dca0 con 0x7f47b40b36f0 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47ba56a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40ad9d0 con 0x7f47b415d8c0 2024-04-25T09:02:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47ba56a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4073fe0 con 0x7f47b40b11b0 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b40b36f0 0x7f47b4148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b40b36f0 0x7f47b4148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45106/0 (socket says 172.21.15.5:45106) 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47b37fe640 1 -- 172.21.15.5:0/2207718192 learned_addr learned my addr 172.21.15.5:0/2207718192 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47b3fff640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.168+0000 7f47b8b07640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47b415d8c0 0x7f47b4151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b37fe640 1 -- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 msgr2=0x7f47b414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b37fe640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b414ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b37fe640 1 -- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47b415d8c0 msgr2=0x7f47b4151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b37fe640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47b415d8c0 0x7f47b4151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b37fe640 1 -- 172.21.15.5:0/2207718192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b414f690 con 0x7f47b40b36f0 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b8b07640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47b415d8c0 0x7f47b4151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b37fe640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b40b36f0 0x7f47b4148600 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c550 tx=0x7f47a400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b0ff9640 1 -- 172.21.15.5:0/2207718192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4017070 con 0x7f47b40b36f0 2024-04-25T09:02:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b0ff9640 1 -- 172.21.15.5:0/2207718192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a40035f0 con 0x7f47b40b36f0 2024-04-25T09:02:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47b0ff9640 1 -- 172.21.15.5:0/2207718192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40039e0 con 0x7f47b40b36f0 2024-04-25T09:02:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b414d700 con 0x7f47b40b36f0 2024-04-25T09:02:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.169+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b414dcc0 con 0x7f47b40b36f0 2024-04-25T09:02:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.170+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b404ef20 con 0x7f47b40b36f0 2024-04-25T09:02:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.171+0000 7f47b0ff9640 1 -- 172.21.15.5:0/2207718192 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f47a401a070 con 0x7f47b40b36f0 2024-04-25T09:02:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.171+0000 7f47b0ff9640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f479406b4d0 0x7f479406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.171+0000 7f47b0ff9640 1 -- 172.21.15.5:0/2207718192 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f47a40896a0 con 0x7f47b40b36f0 2024-04-25T09:02:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.171+0000 7f47b3fff640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f479406b4d0 0x7f479406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.172+0000 7f47b3fff640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f479406b4d0 0x7f479406d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f479c001800 tx=0x7f479c001730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:35.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.175+0000 7f47b0ff9640 1 -- 172.21.15.5:0/2207718192 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47a4058500 con 0x7f47b40b36f0 2024-04-25T09:02:35.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:35.395+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f47b40ae390 con 0x7f47b40b36f0 2024-04-25T09:02:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.048+0000 7f47b0ff9640 1 -- 172.21.15.5:0/2207718192 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7f47a4057e00 con 0x7f47b40b36f0 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.051+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f479406b4d0 msgr2=0x7f479406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.051+0000 7f47ba56a640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f479406b4d0 0x7f479406d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f479c001800 tx=0x7f479c001730 comp rx=0 tx=0).stop 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.051+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b40b36f0 msgr2=0x7f47b4148600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.051+0000 7f47ba56a640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b40b36f0 0x7f47b4148600 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c550 tx=0x7f47a400ca10 comp rx=0 tx=0).stop 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.051+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 shutdown_connections 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.051+0000 7f47ba56a640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f479406b4d0 0x7f479406d990 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.052+0000 7f47ba56a640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47b415d8c0 0x7f47b4151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.052+0000 7f47ba56a640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b40b36f0 0x7f47b4148600 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.052+0000 7f47ba56a640 1 --2- 172.21.15.5:0/2207718192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f47b40b11b0 0x7f47b414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.052+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 >> 172.21.15.5:0/2207718192 conn(0x7f47b4072070 msgr2=0x7f47b40b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.052+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 shutdown_connections 2024-04-25T09:02:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.052+0000 7f47ba56a640 1 -- 172.21.15.5:0/2207718192 wait complete. 2024-04-25T09:02:36.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:02:36.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.175+0000 7f092017e640 1 Processor -- start 2024-04-25T09:02:36.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.176+0000 7f092017e640 1 -- start start 2024-04-25T09:02:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.176+0000 7f092017e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f091806d320 0x7f091815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f092017e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0918071040 0x7f09180ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f092017e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091815c040 con 0x7f0918154e20 2024-04-25T09:02:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f092017e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091815be70 con 0x7f0918071040 2024-04-25T09:02:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f092017e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09180717b0 con 0x7f091806d320 2024-04-25T09:02:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091e71b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0918071040 0x7f09180ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:36.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091d719640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f091806d320 0x7f091815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091e71b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0918071040 0x7f09180ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:32830/0 (socket says 172.21.15.5:32830) 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091df1a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0918154e20 0x7f091806cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41390/0 (socket says 172.21.15.5:41390) 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091e71b640 1 -- 172.21.15.5:0/2009401209 learned_addr learned my addr 172.21.15.5:0/2009401209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091d719640 1 -- 172.21.15.5:0/2009401209 >> v2:172.21.15.80:3300/0 conn(0x7f0918071040 msgr2=0x7f09180ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091d719640 1 --2- 172.21.15.5:0/2009401209 >> v2:172.21.15.80:3300/0 conn(0x7f0918071040 0x7f09180ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091d719640 1 -- 172.21.15.5:0/2009401209 >> v1:172.21.15.80:6789/0 conn(0x7f0918154e20 legacy=0x7f091806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091cf18640 1 -- 172.21.15.5:0/2009401209 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136293392 0 0) 0x7f091815c040 con 0x7f0918154e20 2024-04-25T09:02:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.177+0000 7f091d719640 1 -- 172.21.15.5:0/2009401209 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918071a90 con 0x7f091806d320 2024-04-25T09:02:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.178+0000 7f091d719640 1 --2- 172.21.15.5:0/2009401209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f091806d320 0x7f091815ae80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f091815bff0 tx=0x7f090802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5afce34a356a36f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.178+0000 7f091cf18640 1 -- 172.21.15.5:0/2009401209 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908037070 con 0x7f091806d320 2024-04-25T09:02:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.178+0000 7f091cf18640 1 -- 172.21.15.5:0/2009401209 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908032440 con 0x7f091806d320 2024-04-25T09:02:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.178+0000 7f091cf18640 1 -- 172.21.15.5:0/2009401209 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908032810 con 0x7f091806d320 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 -- 172.21.15.5:0/2009401209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f091806d320 msgr2=0x7f091815ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 --2- 172.21.15.5:0/2009401209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f091806d320 0x7f091815ae80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f091815bff0 tx=0x7f090802a180 comp rx=0 tx=0).stop 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 -- 172.21.15.5:0/2009401209 shutdown_connections 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 --2- 172.21.15.5:0/2009401209 >> v2:172.21.15.80:3300/0 conn(0x7f0918071040 0x7f09180ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 --2- 172.21.15.5:0/2009401209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f091806d320 0x7f091815ae80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 -- 172.21.15.5:0/2009401209 >> 172.21.15.5:0/2009401209 conn(0x7f09180668f0 msgr2=0x7f0918066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 -- 172.21.15.5:0/2009401209 shutdown_connections 2024-04-25T09:02:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.179+0000 7f092017e640 1 -- 172.21.15.5:0/2009401209 wait complete. 2024-04-25T09:02:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.180+0000 7f092017e640 1 Processor -- start 2024-04-25T09:02:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.180+0000 7f092017e640 1 -- start start 2024-04-25T09:02:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f092017e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091806d320 0x7f09180aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f092017e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0918071040 0x7f091815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f092017e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0918154e20 0x7f091815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f092017e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09180714d0 con 0x7f091806d320 2024-04-25T09:02:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f092017e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0918072050 con 0x7f0918071040 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f092017e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0918155200 con 0x7f0918154e20 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f091df1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091806d320 0x7f09180aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f091df1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091806d320 0x7f09180aaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45120/0 (socket says 172.21.15.5:45120) 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f091df1a640 1 -- 172.21.15.5:0/3032037252 learned_addr learned my addr 172.21.15.5:0/3032037252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f091d719640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0918071040 0x7f091815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.181+0000 7f091e71b640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0918154e20 0x7f091815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f091df1a640 1 -- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0918154e20 msgr2=0x7f091815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f091df1a640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0918154e20 0x7f091815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f091df1a640 1 -- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0918071040 msgr2=0x7f091815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f091df1a640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0918071040 0x7f091815ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f091df1a640 1 -- 172.21.15.5:0/3032037252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09181f3810 con 0x7f091806d320 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f091df1a640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091806d320 0x7f09180aaee0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f091400c430 tx=0x7f091400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f090e7fc640 1 -- 172.21.15.5:0/3032037252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09140074e0 con 0x7f091806d320 2024-04-25T09:02:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f090e7fc640 1 -- 172.21.15.5:0/3032037252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140047e0 con 0x7f091806d320 2024-04-25T09:02:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f090e7fc640 1 -- 172.21.15.5:0/3032037252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914004bd0 con 0x7f091806d320 2024-04-25T09:02:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09180ab9a0 con 0x7f091806d320 2024-04-25T09:02:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.182+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09181f3db0 con 0x7f091806d320 2024-04-25T09:02:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.183+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091804ef20 con 0x7f091806d320 2024-04-25T09:02:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.184+0000 7f090e7fc640 1 -- 172.21.15.5:0/3032037252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0914011070 con 0x7f091806d320 2024-04-25T09:02:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.184+0000 7f090e7fc640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08fc06b4d0 0x7f08fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.184+0000 7f090e7fc640 1 -- 172.21.15.5:0/3032037252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f0914089db0 con 0x7f091806d320 2024-04-25T09:02:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.184+0000 7f091d719640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08fc06b4d0 0x7f08fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.185+0000 7f091d719640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08fc06b4d0 0x7f08fc06d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0908034000 tx=0x7f090802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.188+0000 7f090e7fc640 1 -- 172.21.15.5:0/3032037252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0914058530 con 0x7f091806d320 2024-04-25T09:02:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:36.368+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f091814f930 con 0x7f091806d320 2024-04-25T09:02:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.050+0000 7f090e7fc640 1 -- 172.21.15.5:0/3032037252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7f091405c5d0 con 0x7f091806d320 2024-04-25T09:02:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08fc06b4d0 msgr2=0x7f08fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08fc06b4d0 0x7f08fc06d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0908034000 tx=0x7f090802e000 comp rx=0 tx=0).stop 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091806d320 msgr2=0x7f09180aaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091806d320 0x7f09180aaee0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f091400c430 tx=0x7f091400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 shutdown_connections 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08fc06b4d0 0x7f08fc06d990 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0918154e20 0x7f091815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0918071040 0x7f091815ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 --2- 172.21.15.5:0/3032037252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f091806d320 0x7f09180aaee0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.053+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 >> 172.21.15.5:0/3032037252 conn(0x7f09180668f0 msgr2=0x7f09180b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.054+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 shutdown_connections 2024-04-25T09:02:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.054+0000 7f092017e640 1 -- 172.21.15.5:0/3032037252 wait complete. 2024-04-25T09:02:37.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:02:37.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.179+0000 7f8708d68640 1 Processor -- start 2024-04-25T09:02:37.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.179+0000 7f8708d68640 1 -- start start 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8708d68640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f870415dbd0 0x7f87041617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8708d68640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87040b9470 0x7f87040ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8708d68640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8704162070 con 0x7f87040cecf0 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8708d68640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87040cf160 con 0x7f87040b9470 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8708d68640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8704162350 con 0x7f870415dbd0 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f86fbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87040b9470 0x7f87040ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8702d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f87040cecf0 0x7f87040b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46308/0 (socket says 172.21.15.5:46308) 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8702d9d640 1 -- 172.21.15.5:0/70071442 learned_addr learned my addr 172.21.15.5:0/70071442 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f86fbfff640 1 -- 172.21.15.5:0/70071442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f870415dbd0 msgr2=0x7f87041617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f86fbfff640 1 --2- 172.21.15.5:0/70071442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f870415dbd0 0x7f87041617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f86fbfff640 1 -- 172.21.15.5:0/70071442 >> v1:172.21.15.5:6789/0 conn(0x7f87040cecf0 legacy=0x7f87040b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f86fbfff640 1 -- 172.21.15.5:0/70071442 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040d1c50 con 0x7f87040b9470 2024-04-25T09:02:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.180+0000 7f8701d9b640 1 -- 172.21.15.5:0/70071442 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530529275 0 0) 0x7f8704162070 con 0x7f87040cecf0 2024-04-25T09:02:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.181+0000 7f86fbfff640 1 --2- 172.21.15.5:0/70071442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040b9470 0x7f87040ce7b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097a0 tx=0x7f86ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d709981b119f35de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.181+0000 7f8701d9b640 1 -- 172.21.15.5:0/70071442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec037070 con 0x7f87040b9470 2024-04-25T09:02:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.181+0000 7f8701d9b640 1 -- 172.21.15.5:0/70071442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec032440 con 0x7f87040b9470 2024-04-25T09:02:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.181+0000 7f8701d9b640 1 -- 172.21.15.5:0/70071442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec032810 con 0x7f87040b9470 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 -- 172.21.15.5:0/70071442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040b9470 msgr2=0x7f87040ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 --2- 172.21.15.5:0/70071442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040b9470 0x7f87040ce7b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097a0 tx=0x7f86ec02a180 comp rx=0 tx=0).stop 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 -- 172.21.15.5:0/70071442 shutdown_connections 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 --2- 172.21.15.5:0/70071442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040b9470 0x7f87040ce7b0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 --2- 172.21.15.5:0/70071442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f870415dbd0 0x7f87041617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 -- 172.21.15.5:0/70071442 >> 172.21.15.5:0/70071442 conn(0x7f8704066ad0 msgr2=0x7f8704066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 -- 172.21.15.5:0/70071442 shutdown_connections 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.182+0000 7f8708d68640 1 -- 172.21.15.5:0/70071442 wait complete. 2024-04-25T09:02:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.183+0000 7f8708d68640 1 Processor -- start 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.183+0000 7f8708d68640 1 -- start start 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8708d68640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87040b9470 0x7f870414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8708d68640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87040cecf0 0x7f87041609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8708d68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870415dbd0 0x7f870415f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8708d68640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704161cf0 con 0x7f870415dbd0 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8708d68640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704162630 con 0x7f87040b9470 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8708d68640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870415dfb0 con 0x7f87040cecf0 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870415dbd0 0x7f870415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870415dbd0 0x7f870415f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45130/0 (socket says 172.21.15.5:45130) 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 -- 172.21.15.5:0/2046610681 learned_addr learned my addr 172.21.15.5:0/2046610681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f870259c640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87040b9470 0x7f870414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f86fbfff640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87040cecf0 0x7f87041609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 -- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87040cecf0 msgr2=0x7f87041609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87040cecf0 0x7f87041609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 -- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87040b9470 msgr2=0x7f870414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87040b9470 0x7f870414a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 -- 172.21.15.5:0/2046610681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870415e770 con 0x7f870415dbd0 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.184+0000 7f8702d9d640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870415dbd0 0x7f870415f810 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00c7a0 tx=0x7f86fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.185+0000 7f86faffd640 1 -- 172.21.15.5:0/2046610681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc018070 con 0x7f870415dbd0 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.185+0000 7f86faffd640 1 -- 172.21.15.5:0/2046610681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc00a640 con 0x7f870415dbd0 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.185+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870415ea50 con 0x7f870415dbd0 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.185+0000 7f86faffd640 1 -- 172.21.15.5:0/2046610681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00aab0 con 0x7f870415dbd0 2024-04-25T09:02:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.185+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870415f010 con 0x7f870415dbd0 2024-04-25T09:02:37.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.186+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8704067fb0 con 0x7f870415dbd0 2024-04-25T09:02:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.186+0000 7f86faffd640 1 -- 172.21.15.5:0/2046610681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f86fc01b070 con 0x7f870415dbd0 2024-04-25T09:02:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.187+0000 7f86faffd640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86e406b4d0 0x7f86e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.187+0000 7f86faffd640 1 -- 172.21.15.5:0/2046610681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5444+0+0 (secure 0 0 0) 0x7f86fc089740 con 0x7f870415dbd0 2024-04-25T09:02:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.187+0000 7f870259c640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86e406b4d0 0x7f86e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.187+0000 7f870259c640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86e406b4d0 0x7f86e406d990 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86f400a770 tx=0x7f86f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.191+0000 7f86faffd640 1 -- 172.21.15.5:0/2046610681 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f86fc0586c0 con 0x7f870415dbd0 2024-04-25T09:02:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:37.372+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87040d1760 con 0x7f870415dbd0 2024-04-25T09:02:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.051+0000 7f86faffd640 1 -- 172.21.15.5:0/2046610681 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f86fc057fc0 con 0x7f870415dbd0 2024-04-25T09:02:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86e406b4d0 msgr2=0x7f86e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86e406b4d0 0x7f86e406d990 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86f400a770 tx=0x7f86f4008040 comp rx=0 tx=0).stop 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870415dbd0 msgr2=0x7f870415f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870415dbd0 0x7f870415f810 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00c7a0 tx=0x7f86fc00cc60 comp rx=0 tx=0).stop 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 shutdown_connections 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86e406b4d0 0x7f86e406d990 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870415dbd0 0x7f870415f810 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f87040cecf0 0x7f87041609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 --2- 172.21.15.5:0/2046610681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87040b9470 0x7f870414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.056+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 >> 172.21.15.5:0/2046610681 conn(0x7f8704066ad0 msgr2=0x7f87040b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.057+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 shutdown_connections 2024-04-25T09:02:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.057+0000 7f8708d68640 1 -- 172.21.15.5:0/2046610681 wait complete. 2024-04-25T09:02:38.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:02:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.182+0000 7f8fb9e4c640 1 Processor -- start 2024-04-25T09:02:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.182+0000 7f8fb9e4c640 1 -- start start 2024-04-25T09:02:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb9e4c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fb40d2f70 0x7f8fb40ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb9e4c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8fb40ced50 0x7f8fb40b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb9e4c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40d1ed0 con 0x7f8fb415df70 2024-04-25T09:02:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb9e4c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40d1c80 con 0x7f8fb40ced50 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb9e4c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40d2ae0 con 0x7f8fb40d2f70 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8fb415df70 0x7f8fb40b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46318/0 (socket says 172.21.15.5:46318) 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb37fe640 1 -- 172.21.15.5:0/1745509983 learned_addr learned my addr 172.21.15.5:0/1745509983 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb3fff640 1 --2- 172.21.15.5:0/1745509983 >> v2:172.21.15.5:3300/0 conn(0x7f8fb40ced50 0x7f8fb40b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb2ffd640 1 --2- 172.21.15.5:0/1745509983 >> v2:172.21.15.80:3300/0 conn(0x7f8fb40d2f70 0x7f8fb40ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb27fc640 1 -- 172.21.15.5:0/1745509983 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317981098 0 0) 0x7f8fb40d1ed0 con 0x7f8fb415df70 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb27fc640 1 -- 172.21.15.5:0/1745509983 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f9c003520 con 0x7f8fb415df70 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb3fff640 1 -- 172.21.15.5:0/1745509983 >> v2:172.21.15.80:3300/0 conn(0x7f8fb40d2f70 msgr2=0x7f8fb40ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb3fff640 1 --2- 172.21.15.5:0/1745509983 >> v2:172.21.15.80:3300/0 conn(0x7f8fb40d2f70 0x7f8fb40ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb3fff640 1 -- 172.21.15.5:0/1745509983 >> v1:172.21.15.5:6789/0 conn(0x7f8fb415df70 legacy=0x7f8fb40b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.183+0000 7f8fb3fff640 1 -- 172.21.15.5:0/1745509983 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40d21b0 con 0x7f8fb40ced50 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.184+0000 7f8fb3fff640 1 --2- 172.21.15.5:0/1745509983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40ced50 0x7f8fb40b6c50 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40ce2f0 tx=0x7f8fac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8482a1a7a67dc462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.184+0000 7f8fb27fc640 1 -- 172.21.15.5:0/1745509983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac007740 con 0x7f8fb40ced50 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.184+0000 7f8fb27fc640 1 -- 172.21.15.5:0/1745509983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac0078e0 con 0x7f8fb40ced50 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.184+0000 7f8fb27fc640 1 -- 172.21.15.5:0/1745509983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac007cb0 con 0x7f8fb40ced50 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1745509983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40ced50 msgr2=0x7f8fb40b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1745509983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40ced50 0x7f8fb40b6c50 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40ce2f0 tx=0x7f8fac02a710 comp rx=0 tx=0).stop 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1745509983 shutdown_connections 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1745509983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40ced50 0x7f8fb40b6c50 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1745509983 >> v2:172.21.15.80:3300/0 conn(0x7f8fb40d2f70 0x7f8fb40ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1745509983 >> 172.21.15.5:0/1745509983 conn(0x7f8fb406b000 msgr2=0x7f8fb406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1745509983 shutdown_connections 2024-04-25T09:02:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.185+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1745509983 wait complete. 2024-04-25T09:02:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.186+0000 7f8fb9e4c640 1 Processor -- start 2024-04-25T09:02:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.186+0000 7f8fb9e4c640 1 -- start start 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb9e4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40ced50 0x7f8fb4156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb9e4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40d2f70 0x7f8fb41545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb9e4c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fb40cd100 0x7f8fb4152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb9e4c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40d3720 con 0x7f8fb40d2f70 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb9e4c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40d2770 con 0x7f8fb40ced50 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb9e4c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40d38a0 con 0x7f8fb40cd100 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40d2f70 0x7f8fb41545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40d2f70 0x7f8fb41545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45150/0 (socket says 172.21.15.5:45150) 2024-04-25T09:02:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 -- 172.21.15.5:0/1643430879 learned_addr learned my addr 172.21.15.5:0/1643430879 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb37fe640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40ced50 0x7f8fb4156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 -- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fb40cd100 msgr2=0x7f8fb4152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fb40cd100 0x7f8fb4152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 -- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40ced50 msgr2=0x7f8fb4156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40ced50 0x7f8fb4156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb2ffd640 1 -- 172.21.15.5:0/1643430879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4154280 con 0x7f8fb40d2f70 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.187+0000 7f8fb37fe640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40ced50 0x7f8fb4156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.188+0000 7f8fb2ffd640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40d2f70 0x7f8fb41545e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800d800 tx=0x7f8fa800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.188+0000 7f8f9bfff640 1 -- 172.21.15.5:0/1643430879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800b6c0 con 0x7f8fb40d2f70 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.188+0000 7f8f9bfff640 1 -- 172.21.15.5:0/1643430879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa8019070 con 0x7f8fb40d2f70 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.188+0000 7f8f9bfff640 1 -- 172.21.15.5:0/1643430879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800ba80 con 0x7f8fb40d2f70 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.188+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb4153d00 con 0x7f8fb40d2f70 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.188+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb4153fa0 con 0x7f8fb40d2f70 2024-04-25T09:02:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.189+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb404ef20 con 0x7f8fb40d2f70 2024-04-25T09:02:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.189+0000 7f8f9bfff640 1 -- 172.21.15.5:0/1643430879 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8fa800bc20 con 0x7f8fb40d2f70 2024-04-25T09:02:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.190+0000 7f8f9bfff640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.190+0000 7f8f9bfff640 1 -- 172.21.15.5:0/1643430879 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8fa808a320 con 0x7f8fb40d2f70 2024-04-25T09:02:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.190+0000 7f8fb37fe640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.191+0000 7f8fb37fe640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4005880 tx=0x7f8fa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.194+0000 7f8f9bfff640 1 -- 172.21.15.5:0/1643430879 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8fa8059530 con 0x7f8fb40d2f70 2024-04-25T09:02:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.376+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8fb40cae80 con 0x7f8fb40d2f70 2024-04-25T09:02:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.379+0000 7f8f9bfff640 1 -- 172.21.15.5:0/1643430879 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fa8058e30 con 0x7f8fb40d2f70 2024-04-25T09:02:38.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 msgr2=0x7f8fa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4005880 tx=0x7f8fa4009040 comp rx=0 tx=0).stop 2024-04-25T09:02:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40d2f70 msgr2=0x7f8fb41545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40d2f70 0x7f8fb41545e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800d800 tx=0x7f8fa800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 shutdown_connections 2024-04-25T09:02:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fb40cd100 0x7f8fb4152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fb40d2f70 0x7f8fb41545e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 --2- 172.21.15.5:0/1643430879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40ced50 0x7f8fb4156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 >> 172.21.15.5:0/1643430879 conn(0x7f8fb406b000 msgr2=0x7f8fb415d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 shutdown_connections 2024-04-25T09:02:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.381+0000 7f8fb9e4c640 1 -- 172.21.15.5:0/1643430879 wait complete. 2024-04-25T09:02:38.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-04-25T09:02:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.493+0000 7f57e005a640 1 Processor -- start 2024-04-25T09:02:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.493+0000 7f57e005a640 1 -- start start 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57e005a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57d815e0a0 0x7f57d80d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57e005a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d80d3990 0x7f57d80d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57e005a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d80b7f60 con 0x7f57d80ce5e0 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57e005a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d80d4330 con 0x7f57d815e0a0 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57e005a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80b29c0 con 0x7f57d80d3990 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dddf6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57d815e0a0 0x7f57d80d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57de5f7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f57d80ce5e0 0x7f57d80cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46328/0 (socket says 172.21.15.5:46328) 2024-04-25T09:02:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57de5f7640 1 -- 172.21.15.5:0/3551437567 learned_addr learned my addr 172.21.15.5:0/3551437567 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dddf6640 1 -- 172.21.15.5:0/3551437567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d80d3990 msgr2=0x7f57d80d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dd5f5640 1 --2- 172.21.15.5:0/3551437567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d80d3990 0x7f57d80d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dddf6640 1 --2- 172.21.15.5:0/3551437567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d80d3990 0x7f57d80d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dcdf4640 1 -- 172.21.15.5:0/3551437567 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831913896 0 0) 0x7f57d80b7f60 con 0x7f57d80ce5e0 2024-04-25T09:02:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dddf6640 1 -- 172.21.15.5:0/3551437567 >> v1:172.21.15.5:6789/0 conn(0x7f57d80ce5e0 legacy=0x7f57d80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dddf6640 1 -- 172.21.15.5:0/3551437567 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d80d2080 con 0x7f57d815e0a0 2024-04-25T09:02:38.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.494+0000 7f57dd5f5640 1 --2- 172.21.15.5:0/3551437567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d80d3990 0x7f57d80d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.495+0000 7f57dddf6640 1 --2- 172.21.15.5:0/3551437567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d815e0a0 0x7f57d80d0d50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f57d40097a0 tx=0x7f57d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17296140debe0eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.495+0000 7f57dcdf4640 1 -- 172.21.15.5:0/3551437567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4037070 con 0x7f57d815e0a0 2024-04-25T09:02:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.495+0000 7f57dcdf4640 1 -- 172.21.15.5:0/3551437567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d4032440 con 0x7f57d815e0a0 2024-04-25T09:02:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.495+0000 7f57dcdf4640 1 -- 172.21.15.5:0/3551437567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4032810 con 0x7f57d815e0a0 2024-04-25T09:02:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 -- 172.21.15.5:0/3551437567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d815e0a0 msgr2=0x7f57d80d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 --2- 172.21.15.5:0/3551437567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d815e0a0 0x7f57d80d0d50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f57d40097a0 tx=0x7f57d402a180 comp rx=0 tx=0).stop 2024-04-25T09:02:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 -- 172.21.15.5:0/3551437567 shutdown_connections 2024-04-25T09:02:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 --2- 172.21.15.5:0/3551437567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d80d3990 0x7f57d80d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 --2- 172.21.15.5:0/3551437567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d815e0a0 0x7f57d80d0d50 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 -- 172.21.15.5:0/3551437567 >> 172.21.15.5:0/3551437567 conn(0x7f57d80668f0 msgr2=0x7f57d8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 -- 172.21.15.5:0/3551437567 shutdown_connections 2024-04-25T09:02:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.496+0000 7f57e005a640 1 -- 172.21.15.5:0/3551437567 wait complete. 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.497+0000 7f57e005a640 1 Processor -- start 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.497+0000 7f57e005a640 1 -- start start 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d80ce5e0 0x7f57d80caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d80d3990 0x7f57d80cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d815e0a0 0x7f57d80cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80d2920 con 0x7f57d80d3990 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80d2640 con 0x7f57d80ce5e0 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80d2c00 con 0x7f57d815e0a0 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d80d3990 0x7f57d80cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d80d3990 0x7f57d80cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45162/0 (socket says 172.21.15.5:45162) 2024-04-25T09:02:38.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 -- 172.21.15.5:0/2246608532 learned_addr learned my addr 172.21.15.5:0/2246608532 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 -- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d815e0a0 msgr2=0x7f57d80cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d815e0a0 0x7f57d80cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 -- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d80ce5e0 msgr2=0x7f57d80caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d80ce5e0 0x7f57d80caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 -- 172.21.15.5:0/2246608532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d80b27d0 con 0x7f57d80d3990 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57dd5f5640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d80d3990 0x7f57d80cd4e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c820 tx=0x7f57c800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57ce7fc640 1 -- 172.21.15.5:0/2246608532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8015070 con 0x7f57d80d3990 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57ce7fc640 1 -- 172.21.15.5:0/2246608532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8007a30 con 0x7f57d80d3990 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d80cca40 con 0x7f57d80d3990 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57ce7fc640 1 -- 172.21.15.5:0/2246608532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007e00 con 0x7f57d80d3990 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.498+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d80ab450 con 0x7f57d80d3990 2024-04-25T09:02:38.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.499+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d804ef20 con 0x7f57d80d3990 2024-04-25T09:02:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.500+0000 7f57ce7fc640 1 -- 172.21.15.5:0/2246608532 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57c8018070 con 0x7f57d80d3990 2024-04-25T09:02:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.500+0000 7f57ce7fc640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57bc06b4d0 0x7f57bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.500+0000 7f57ce7fc640 1 -- 172.21.15.5:0/2246608532 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57c8089e40 con 0x7f57d80d3990 2024-04-25T09:02:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.500+0000 7f57dddf6640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57bc06b4d0 0x7f57bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:38.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.501+0000 7f57dddf6640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57bc06b4d0 0x7f57bc06d990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f57d4034000 tx=0x7f57d402c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.504+0000 7f57ce7fc640 1 -- 172.21.15.5:0/2246608532 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57c8058fc0 con 0x7f57d80d3990 2024-04-25T09:02:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:38.765+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f57d8071750 con 0x7f57d80d3990 2024-04-25T09:02:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.060+0000 7f57ce7fc640 1 -- 172.21.15.5:0/2246608532 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v286) v1 ==== 158+0+0 (secure 0 0 0) 0x7f57c80588c0 con 0x7f57d80d3990 2024-04-25T09:02:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57bc06b4d0 msgr2=0x7f57bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57bc06b4d0 0x7f57bc06d990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f57d4034000 tx=0x7f57d402c000 comp rx=0 tx=0).stop 2024-04-25T09:02:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d80d3990 msgr2=0x7f57d80cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d80d3990 0x7f57d80cd4e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c820 tx=0x7f57c800cc20 comp rx=0 tx=0).stop 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 shutdown_connections 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f57bc06b4d0 0x7f57bc06d990 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57d815e0a0 0x7f57d80cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57d80d3990 0x7f57d80cd4e0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 --2- 172.21.15.5:0/2246608532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57d80ce5e0 0x7f57d80caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 >> 172.21.15.5:0/2246608532 conn(0x7f57d80668f0 msgr2=0x7f57d8066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 shutdown_connections 2024-04-25T09:02:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.062+0000 7f57e005a640 1 -- 172.21.15.5:0/2246608532 wait complete. 2024-04-25T09:02:39.063 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-04-25T09:02:39.063 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:02:39.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.176+0000 7f1194bc4640 1 Processor -- start 2024-04-25T09:02:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.176+0000 7f1194bc4640 1 -- start start 2024-04-25T09:02:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.177+0000 7f1194bc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 0x7f11901666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.177+0000 7f1194bc4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11900b4bd0 con 0x7f1190156250 2024-04-25T09:02:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.177+0000 7f1194bc4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11900b2aa0 con 0x7f119006dd20 2024-04-25T09:02:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.177+0000 7f1194bc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b2850 con 0x7f11900aeda0 2024-04-25T09:02:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.177+0000 7f118e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1190156250 0x7f11900b44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46338/0 (socket says 172.21.15.5:46338) 2024-04-25T09:02:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.177+0000 7f118e59c640 1 -- 172.21.15.5:0/2618026207 learned_addr learned my addr 172.21.15.5:0/2618026207 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118ed9d640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 0x7f11901666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487016985 0 0) 0x7f1188001110 con 0x7f1190156250 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c003520 con 0x7f1190156250 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4114408653 0 0) 0x7f117c003520 con 0x7f1190156250 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 msgr2=0x7f11901666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 0x7f11901666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 >> v1:172.21.15.80:6789/0 conn(0x7f119006dd20 legacy=0x7f11900ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900b2d80 con 0x7f1190156250 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1188001840 con 0x7f1190156250 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 >> v1:172.21.15.5:6789/0 conn(0x7f1190156250 legacy=0x7f11900b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c0039e0 0x7f117c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 0x7f117c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c004d40 0x7f117c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b2850 con 0x7f117c004d40 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c00ba70 con 0x7f117c0039e0 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c00bc70 con 0x7f11900aeda0 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118ed9d640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c004d40 0x7f117c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118e59c640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c0039e0 0x7f117c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118dd9b640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 0x7f117c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118ed9d640 1 -- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 msgr2=0x7f117c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118ed9d640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11900aeda0 0x7f117c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118ed9d640 1 -- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c0039e0 msgr2=0x7f117c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118ed9d640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c0039e0 0x7f117c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.178+0000 7f118ed9d640 1 -- 172.21.15.5:0/2618026207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c003520 con 0x7f117c004d40 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.179+0000 7f118ed9d640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c004d40 0x7f117c0051c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1180009f90 tx=0x7f117c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77d09c1c626859b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.179+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180009c10 con 0x7f117c004d40 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.179+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1180036070 con 0x7f117c004d40 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.179+0000 7f118d59a640 1 -- 172.21.15.5:0/2618026207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180031810 con 0x7f117c004d40 2024-04-25T09:02:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.180+0000 7f1194bc4640 1 -- 172.21.15.5:0/2618026207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c004d40 msgr2=0x7f117c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.180+0000 7f1194bc4640 1 --2- 172.21.15.5:0/2618026207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c004d40 0x7f117c0051c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1180009f90 tx=0x7f117c005830 comp rx=0 tx=0).stop 2024-04-25T09:02:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.180+0000 7f118ed9d640 1 -- 172.21.15.5:0/2618026207 reap_dead start 2024-04-25T09:02:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.180+0000 7f1194bc4640 1 -- 172.21.15.5:0/2618026207 shutdown_connections 2024-04-25T09:02:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.180+0000 7f1194bc4640 1 -- 172.21.15.5:0/2618026207 >> 172.21.15.5:0/2618026207 conn(0x7f11900668f0 msgr2=0x7f1190066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.180+0000 7f1194bc4640 1 -- 172.21.15.5:0/2618026207 shutdown_connections 2024-04-25T09:02:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.180+0000 7f1194bc4640 1 -- 172.21.15.5:0/2618026207 wait complete. 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.181+0000 7f1194bc4640 1 Processor -- start 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.181+0000 7f1194bc4640 1 -- start start 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f1194bc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f117c004d40 0x7f11900adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f1194bc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f119014d1e0 0x7f1190158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f1194bc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1190158bc0 0x7f11901f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f1194bc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b3860 con 0x7f1190158bc0 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f1194bc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b3340 con 0x7f119014d1e0 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f1194bc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900b39e0 con 0x7f117c004d40 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1190158bc0 0x7f11901f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1190158bc0 0x7f11901f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45178/0 (socket says 172.21.15.5:45178) 2024-04-25T09:02:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 -- 172.21.15.5:0/689763003 learned_addr learned my addr 172.21.15.5:0/689763003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118e59c640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f117c004d40 0x7f11900adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118dd9b640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f119014d1e0 0x7f1190158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 -- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f117c004d40 msgr2=0x7f11900adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f117c004d40 0x7f11900adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 -- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f119014d1e0 msgr2=0x7f1190158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f119014d1e0 0x7f1190158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118ed9d640 1 -- 172.21.15.5:0/689763003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900ae2e0 con 0x7f1190158bc0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.182+0000 7f118dd9b640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f119014d1e0 0x7f1190158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.183+0000 7f118ed9d640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1190158bc0 0x7f11901f1760 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f1180009f90 tx=0x7f1180009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.183+0000 7f1186ffd640 1 -- 172.21.15.5:0/689763003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180009c10 con 0x7f1190158bc0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.183+0000 7f1186ffd640 1 -- 172.21.15.5:0/689763003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1180045430 con 0x7f1190158bc0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.183+0000 7f1186ffd640 1 -- 172.21.15.5:0/689763003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180045800 con 0x7f1190158bc0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.183+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11900acfe0 con 0x7f1190158bc0 2024-04-25T09:02:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.183+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11900ad5a0 con 0x7f1190158bc0 2024-04-25T09:02:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.184+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119004ef20 con 0x7f1190158bc0 2024-04-25T09:02:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.184+0000 7f1186ffd640 1 -- 172.21.15.5:0/689763003 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1180005d10 con 0x7f1190158bc0 2024-04-25T09:02:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.185+0000 7f1186ffd640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f117006b4d0 0x7f117006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.185+0000 7f1186ffd640 1 -- 172.21.15.5:0/689763003 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f11800aad90 con 0x7f1190158bc0 2024-04-25T09:02:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.185+0000 7f118e59c640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f117006b4d0 0x7f117006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.185+0000 7f118e59c640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f117006b4d0 0x7f117006d990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1188007fd0 tx=0x7f1188007aa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.189+0000 7f1186ffd640 1 -- 172.21.15.5:0/689763003 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f118002e050 con 0x7f1190158bc0 2024-04-25T09:02:39.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.370+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11900cd340 con 0x7f1190158bc0 2024-04-25T09:02:39.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.371+0000 7f1186ffd640 1 -- 172.21.15.5:0/689763003 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+12937 (secure 0 0 0) 0x7f1180079f10 con 0x7f1190158bc0 2024-04-25T09:02:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:39.360 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":80,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:38.051351+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/1546784484":"2024-04-26T09:02:35.046541+0000","172.21.15.80:6835/1546784484":"2024-04-26T09:02:35.046541+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.372+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f117006b4d0 msgr2=0x7f117006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.372+0000 7f1194bc4640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f117006b4d0 0x7f117006d990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1188007fd0 tx=0x7f1188007aa0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1190158bc0 msgr2=0x7f11901f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1190158bc0 0x7f11901f1760 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f1180009f90 tx=0x7f1180009750 comp rx=0 tx=0).stop 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 shutdown_connections 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f117006b4d0 0x7f117006d990 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1190158bc0 0x7f11901f1760 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f119014d1e0 0x7f1190158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 --2- 172.21.15.5:0/689763003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f117c004d40 0x7f11900adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 >> 172.21.15.5:0/689763003 conn(0x7f11900668f0 msgr2=0x7f11900cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 shutdown_connections 2024-04-25T09:02:39.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.373+0000 7f1194bc4640 1 -- 172.21.15.5:0/689763003 wait complete. 2024-04-25T09:02:39.373 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:39.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.487+0000 7f998fbc4640 1 Processor -- start 2024-04-25T09:02:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.487+0000 7f998fbc4640 1 -- start start 2024-04-25T09:02:39.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998fbc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f998815df10 0x7f99881618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998fbc4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99880b6250 0x7f99880ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998fbc4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9988162150 con 0x7f99880cee10 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998fbc4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880cf260 con 0x7f99880b6250 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998fbc4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880d20d0 con 0x7f998815df10 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998d15f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99880b6250 0x7f99880ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998d15f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99880b6250 0x7f99880ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45190/0 (socket says 172.21.15.5:45190) 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.488+0000 7f998d15f640 1 -- 172.21.15.5:0/618435580 learned_addr learned my addr 172.21.15.5:0/618435580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998d960640 1 --2- 172.21.15.5:0/618435580 >> v2:172.21.15.80:3300/0 conn(0x7f998815df10 0x7f99881618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998d15f640 1 -- 172.21.15.5:0/618435580 >> v2:172.21.15.80:3300/0 conn(0x7f998815df10 msgr2=0x7f99881618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998d15f640 1 --2- 172.21.15.5:0/618435580 >> v2:172.21.15.80:3300/0 conn(0x7f998815df10 0x7f99881618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998d15f640 1 -- 172.21.15.5:0/618435580 >> v1:172.21.15.80:6789/0 conn(0x7f99880cee10 legacy=0x7f99880d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998d15f640 1 -- 172.21.15.5:0/618435580 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9988162430 con 0x7f99880b6250 2024-04-25T09:02:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998d15f640 1 --2- 172.21.15.5:0/618435580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6250 0x7f99880ce8d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9988075080 tx=0x7f997c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6971cb21b5d89096 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998c95e640 1 -- 172.21.15.5:0/618435580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c037070 con 0x7f99880b6250 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998c95e640 1 -- 172.21.15.5:0/618435580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c032440 con 0x7f99880b6250 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.489+0000 7f998c95e640 1 -- 172.21.15.5:0/618435580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c032810 con 0x7f99880b6250 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 -- 172.21.15.5:0/618435580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6250 msgr2=0x7f99880ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 --2- 172.21.15.5:0/618435580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6250 0x7f99880ce8d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9988075080 tx=0x7f997c02a230 comp rx=0 tx=0).stop 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 -- 172.21.15.5:0/618435580 shutdown_connections 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 --2- 172.21.15.5:0/618435580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6250 0x7f99880ce8d0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 --2- 172.21.15.5:0/618435580 >> v2:172.21.15.80:3300/0 conn(0x7f998815df10 0x7f99881618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 -- 172.21.15.5:0/618435580 >> 172.21.15.5:0/618435580 conn(0x7f99880668f0 msgr2=0x7f9988066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 -- 172.21.15.5:0/618435580 shutdown_connections 2024-04-25T09:02:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.490+0000 7f998fbc4640 1 -- 172.21.15.5:0/618435580 wait complete. 2024-04-25T09:02:39.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.491+0000 7f998fbc4640 1 Processor -- start 2024-04-25T09:02:39.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.491+0000 7f998fbc4640 1 -- start start 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998fbc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99880b6250 0x7f99881f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998fbc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f99880cee10 0x7f998814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998fbc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998815df10 0x7f998814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998fbc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988161e10 con 0x7f998815df10 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998fbc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880d1d60 con 0x7f99880b6250 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998fbc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880d3570 con 0x7f99880cee10 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998e161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998815df10 0x7f998814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998e161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998815df10 0x7f998814e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45206/0 (socket says 172.21.15.5:45206) 2024-04-25T09:02:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998e161640 1 -- 172.21.15.5:0/2467760035 learned_addr learned my addr 172.21.15.5:0/2467760035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998d960640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99880b6250 0x7f99881f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.492+0000 7f998d15f640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f99880cee10 0x7f998814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998e161640 1 -- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f99880cee10 msgr2=0x7f998814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998e161640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f99880cee10 0x7f998814ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998e161640 1 -- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99880b6250 msgr2=0x7f99881f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998e161640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99880b6250 0x7f99881f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998e161640 1 -- 172.21.15.5:0/2467760035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880ce180 con 0x7f998815df10 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998d15f640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f99880cee10 0x7f998814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998e161640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998815df10 0x7f998814e410 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f997800c7b0 tx=0x7f997800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f99867fc640 1 -- 172.21.15.5:0/2467760035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978004b60 con 0x7f998815df10 2024-04-25T09:02:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f99867fc640 1 -- 172.21.15.5:0/2467760035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9978004d00 con 0x7f998815df10 2024-04-25T09:02:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99880ce460 con 0x7f998815df10 2024-04-25T09:02:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f99867fc640 1 -- 172.21.15.5:0/2467760035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800aa90 con 0x7f998815df10 2024-04-25T09:02:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.493+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998815fa10 con 0x7f998815df10 2024-04-25T09:02:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.494+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998815f800 con 0x7f998815df10 2024-04-25T09:02:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.495+0000 7f99867fc640 1 -- 172.21.15.5:0/2467760035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f997800ac30 con 0x7f998815df10 2024-04-25T09:02:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.495+0000 7f99867fc640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f997406b4d0 0x7f997406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.495+0000 7f99867fc640 1 -- 172.21.15.5:0/2467760035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f997808a060 con 0x7f998815df10 2024-04-25T09:02:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.495+0000 7f998d960640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f997406b4d0 0x7f997406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.496+0000 7f998d960640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f997406b4d0 0x7f997406d990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f99800079a0 tx=0x7f9980008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.499+0000 7f99867fc640 1 -- 172.21.15.5:0/2467760035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9978020070 con 0x7f998815df10 2024-04-25T09:02:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.680+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f998804ef20 con 0x7f998815df10 2024-04-25T09:02:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.680+0000 7f99867fc640 1 -- 172.21.15.5:0/2467760035 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9978059270 con 0x7f998815df10 2024-04-25T09:02:39.669 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f997406b4d0 msgr2=0x7f997406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f997406b4d0 0x7f997406d990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f99800079a0 tx=0x7f9980008040 comp rx=0 tx=0).stop 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998815df10 msgr2=0x7f998814e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998815df10 0x7f998814e410 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f997800c7b0 tx=0x7f997800cc70 comp rx=0 tx=0).stop 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 shutdown_connections 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f997406b4d0 0x7f997406d990 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f998815df10 0x7f998814e410 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f99880cee10 0x7f998814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 --2- 172.21.15.5:0/2467760035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99880b6250 0x7f99881f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 >> 172.21.15.5:0/2467760035 conn(0x7f99880668f0 msgr2=0x7f99880c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 shutdown_connections 2024-04-25T09:02:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.682+0000 7f998fbc4640 1 -- 172.21.15.5:0/2467760035 wait complete. 2024-04-25T09:02:39.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-04-25T09:02:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.794+0000 7f2ad9a12640 1 Processor -- start 2024-04-25T09:02:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.794+0000 7f2ad9a12640 1 -- start start 2024-04-25T09:02:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad9a12640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 0x7f2ad40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad9a12640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40d20e0 con 0x7f2ad40ce7f0 2024-04-25T09:02:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad9a12640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40d23c0 con 0x7f2ad40b2cc0 2024-04-25T09:02:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad9a12640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40d2a10 con 0x7f2ad415de70 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2ad40ce7f0 0x7f2ad40cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46352/0 (socket says 172.21.15.5:46352) 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad37fe640 1 -- 172.21.15.5:0/4253827522 learned_addr learned my addr 172.21.15.5:0/4253827522 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 0x7f2ad40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830705605 0 0) 0x7f2ad40d20e0 con 0x7f2ad40ce7f0 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0003520 con 0x7f2ad40ce7f0 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3501628734 0 0) 0x7f2ac0003520 con 0x7f2ad40ce7f0 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 msgr2=0x7f2ad40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 0x7f2ad40b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 >> v1:172.21.15.80:6789/0 conn(0x7f2ad40b2cc0 legacy=0x7f2ad40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40d26a0 con 0x7f2ad40ce7f0 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2acc0019f0 con 0x7f2ad40ce7f0 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.795+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 >> v1:172.21.15.5:6789/0 conn(0x7f2ad40ce7f0 legacy=0x7f2ad40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad27fc640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad27fc640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac0004390 0x7f2ac0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad27fc640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 0x7f2ac00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40d2a10 con 0x7f2ac00039e0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000b9c0 con 0x7f2ac0004390 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000bbc0 con 0x7f2ad415de70 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad37fe640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 0x7f2ac00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2acbfff640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac0004390 0x7f2ac0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad2ffd640 1 -- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 msgr2=0x7f2ac00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415de70 0x7f2ac00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad2ffd640 1 -- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac0004390 msgr2=0x7f2ac0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac0004390 0x7f2ac0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.796+0000 7f2ad2ffd640 1 -- 172.21.15.5:0/4253827522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0003520 con 0x7f2ac00039e0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003dc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009ac0 tx=0x7f2ac0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5378078e8c9176e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4036070 con 0x7f2ac00039e0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4031400 con 0x7f2ac00039e0 2024-04-25T09:02:39.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad27fc640 1 -- 172.21.15.5:0/4253827522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4009690 con 0x7f2ac00039e0 2024-04-25T09:02:39.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad9a12640 1 -- 172.21.15.5:0/4253827522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac00039e0 msgr2=0x7f2ac0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad9a12640 1 --2- 172.21.15.5:0/4253827522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003dc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009ac0 tx=0x7f2ac0005830 comp rx=0 tx=0).stop 2024-04-25T09:02:39.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad37fe640 1 -- 172.21.15.5:0/4253827522 reap_dead start 2024-04-25T09:02:39.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad9a12640 1 -- 172.21.15.5:0/4253827522 shutdown_connections 2024-04-25T09:02:39.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad9a12640 1 -- 172.21.15.5:0/4253827522 >> 172.21.15.5:0/4253827522 conn(0x7f2ad406b000 msgr2=0x7f2ad406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:39.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad9a12640 1 -- 172.21.15.5:0/4253827522 shutdown_connections 2024-04-25T09:02:39.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.797+0000 7f2ad9a12640 1 -- 172.21.15.5:0/4253827522 wait complete. 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 Processor -- start 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 -- start start 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac00039e0 0x7f2ad4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415ac30 0x7f2ad40caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad41580f0 0x7f2ad4158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b9560 con 0x7f2ad41580f0 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b93e0 con 0x7f2ac00039e0 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad9a12640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b96e0 con 0x7f2ad415ac30 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad41580f0 0x7f2ad4158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad41580f0 0x7f2ad4158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45220/0 (socket says 172.21.15.5:45220) 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.799+0000 7f2ad37fe640 1 -- 172.21.15.5:0/57831897 learned_addr learned my addr 172.21.15.5:0/57831897 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac00039e0 0x7f2ad4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2acbfff640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415ac30 0x7f2ad40caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad37fe640 1 -- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415ac30 msgr2=0x7f2ad40caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad37fe640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415ac30 0x7f2ad40caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad37fe640 1 -- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac00039e0 msgr2=0x7f2ad4153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad37fe640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac00039e0 0x7f2ad4153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad37fe640 1 -- 172.21.15.5:0/57831897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40cb0e0 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad37fe640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad41580f0 0x7f2ad4158570 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40d1650 tx=0x7f2acc007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad0ff9640 1 -- 172.21.15.5:0/57831897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00ea40 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad0ff9640 1 -- 172.21.15.5:0/57831897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00ebe0 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad0ff9640 1 -- 172.21.15.5:0/57831897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00edd0 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad40cb380 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.800+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad40cb940 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.801+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad404ef20 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.802+0000 7f2ad0ff9640 1 -- 172.21.15.5:0/57831897 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2acc01a020 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.802+0000 7f2ad0ff9640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ab406b4d0 0x7f2ab406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.802+0000 7f2ad0ff9640 1 -- 172.21.15.5:0/57831897 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2acc089630 con 0x7f2ad41580f0 2024-04-25T09:02:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.802+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ab406b4d0 0x7f2ab406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.803+0000 7f2ad2ffd640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ab406b4d0 0x7f2ab406d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009ac0 tx=0x7f2ac4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:39.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:39.806+0000 7f2ad0ff9640 1 -- 172.21.15.5:0/57831897 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2acc021020 con 0x7f2ad41580f0 2024-04-25T09:02:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:40.060+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f2ad40b8f30 con 0x7f2ad41580f0 2024-04-25T09:02:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.066+0000 7f2ad0ff9640 1 -- 172.21.15.5:0/57831897 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v288) v1 ==== 147+0+0 (secure 0 0 0) 0x7f2acc05e020 con 0x7f2ad41580f0 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ab406b4d0 msgr2=0x7f2ab406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ab406b4d0 0x7f2ab406d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009ac0 tx=0x7f2ac4008030 comp rx=0 tx=0).stop 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad41580f0 msgr2=0x7f2ad4158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad41580f0 0x7f2ad4158570 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40d1650 tx=0x7f2acc007b10 comp rx=0 tx=0).stop 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 shutdown_connections 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ab406b4d0 0x7f2ab406d990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad41580f0 0x7f2ad4158570 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ad415ac30 0x7f2ad40caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 --2- 172.21.15.5:0/57831897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac00039e0 0x7f2ad4153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 >> 172.21.15.5:0/57831897 conn(0x7f2ad406b000 msgr2=0x7f2ad40d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 shutdown_connections 2024-04-25T09:02:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.069+0000 7f2ad9a12640 1 -- 172.21.15.5:0/57831897 wait complete. 2024-04-25T09:02:41.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:02:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.192+0000 7f7fba79e640 1 Processor -- start 2024-04-25T09:02:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.192+0000 7f7fba79e640 1 -- start start 2024-04-25T09:02:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.192+0000 7f7fba79e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb415df30 0x7f7fb40b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.192+0000 7f7fba79e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7fb4161970 0x7f7fb4161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fba79e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb41627a0 con 0x7f7fb4162310 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fba79e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40b5340 con 0x7f7fb4161970 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fba79e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4072f00 con 0x7f7fb415df30 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7fb4161970 0x7f7fb4161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7fb4161970 0x7f7fb4161dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50866/0 (socket says 172.21.15.5:50866) 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb37fe640 1 -- 172.21.15.5:0/97870239 learned_addr learned my addr 172.21.15.5:0/97870239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb3fff640 1 --2- 172.21.15.5:0/97870239 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb415df30 0x7f7fb40b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb37fe640 1 -- 172.21.15.5:0/97870239 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb415df30 msgr2=0x7f7fb40b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb37fe640 1 --2- 172.21.15.5:0/97870239 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb415df30 0x7f7fb40b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb37fe640 1 -- 172.21.15.5:0/97870239 >> v1:172.21.15.80:6789/0 conn(0x7f7fb4162310 legacy=0x7f7fb40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.193+0000 7f7fb37fe640 1 -- 172.21.15.5:0/97870239 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40cc450 con 0x7f7fb4161970 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.194+0000 7f7fb37fe640 1 --2- 172.21.15.5:0/97870239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb4161970 0x7f7fb4161dd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009870 tx=0x7f7fa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855da05f76238e73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.194+0000 7f7fb2ffd640 1 -- 172.21.15.5:0/97870239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8037070 con 0x7f7fb4161970 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.194+0000 7f7fb2ffd640 1 -- 172.21.15.5:0/97870239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa8032440 con 0x7f7fb4161970 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.194+0000 7f7fb2ffd640 1 -- 172.21.15.5:0/97870239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8032810 con 0x7f7fb4161970 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.194+0000 7f7fba79e640 1 -- 172.21.15.5:0/97870239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb4161970 msgr2=0x7f7fb4161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.194+0000 7f7fba79e640 1 --2- 172.21.15.5:0/97870239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb4161970 0x7f7fb4161dd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009870 tx=0x7f7fa802a270 comp rx=0 tx=0).stop 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.195+0000 7f7fba79e640 1 -- 172.21.15.5:0/97870239 shutdown_connections 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.195+0000 7f7fba79e640 1 --2- 172.21.15.5:0/97870239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb4161970 0x7f7fb4161dd0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.195+0000 7f7fba79e640 1 --2- 172.21.15.5:0/97870239 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb415df30 0x7f7fb40b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.195+0000 7f7fba79e640 1 -- 172.21.15.5:0/97870239 >> 172.21.15.5:0/97870239 conn(0x7f7fb4072070 msgr2=0x7f7fb4072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.195+0000 7f7fba79e640 1 -- 172.21.15.5:0/97870239 shutdown_connections 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.195+0000 7f7fba79e640 1 -- 172.21.15.5:0/97870239 wait complete. 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.196+0000 7f7fba79e640 1 Processor -- start 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.196+0000 7f7fba79e640 1 -- start start 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fba79e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb415df30 0x7f7fb41503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fba79e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb4161970 0x7f7fb41e8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fba79e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fb4162310 0x7f7fb41e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fba79e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40b5060 con 0x7f7fb415df30 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fba79e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40cafb0 con 0x7f7fb4162310 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fba79e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40b4a70 con 0x7f7fb4161970 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb415df30 0x7f7fb41503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb415df30 0x7f7fb41503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50880/0 (socket says 172.21.15.5:50880) 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 -- 172.21.15.5:0/1395930348 learned_addr learned my addr 172.21.15.5:0/1395930348 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb8d3b640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fb4162310 0x7f7fb41e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb37fe640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb4161970 0x7f7fb41e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 -- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb4161970 msgr2=0x7f7fb41e8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb4161970 0x7f7fb41e8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 -- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fb4162310 msgr2=0x7f7fb41e8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fb4162310 0x7f7fb41e8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 -- 172.21.15.5:0/1395930348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb41e93e0 con 0x7f7fb415df30 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb37fe640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb4161970 0x7f7fb41e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb8d3b640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fb4162310 0x7f7fb41e8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb3fff640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb415df30 0x7f7fb41503c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400d830 tx=0x7f7fa400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb0ff9640 1 -- 172.21.15.5:0/1395930348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400b6c0 con 0x7f7fb415df30 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb0ff9640 1 -- 172.21.15.5:0/1395930348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4019070 con 0x7f7fb415df30 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb41e96c0 con 0x7f7fb415df30 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.197+0000 7f7fb0ff9640 1 -- 172.21.15.5:0/1395930348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400bac0 con 0x7f7fb415df30 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.198+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb41e9c80 con 0x7f7fb415df30 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.198+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb40cc240 con 0x7f7fb415df30 2024-04-25T09:02:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.199+0000 7f7fb0ff9640 1 -- 172.21.15.5:0/1395930348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7fa401e460 con 0x7f7fb415df30 2024-04-25T09:02:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.199+0000 7f7fb0ff9640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fa006b4d0 0x7f7fa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.199+0000 7f7fb0ff9640 1 -- 172.21.15.5:0/1395930348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fa408a620 con 0x7f7fb415df30 2024-04-25T09:02:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.200+0000 7f7fb37fe640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fa006b4d0 0x7f7fa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.200+0000 7f7fb37fe640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fa006b4d0 0x7f7fa006d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8034000 tx=0x7f7fa802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.204+0000 7f7fb0ff9640 1 -- 172.21.15.5:0/1395930348 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7fb40cc240 con 0x7f7fb415df30 2024-04-25T09:02:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.389+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7fb40b3810 con 0x7f7fb415df30 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.392+0000 7f7fb0ff9640 1 -- 172.21.15.5:0/1395930348 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7fa40597a0 con 0x7f7fb415df30 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fa006b4d0 msgr2=0x7f7fa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fa006b4d0 0x7f7fa006d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8034000 tx=0x7f7fa802e000 comp rx=0 tx=0).stop 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb415df30 msgr2=0x7f7fb41503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb415df30 0x7f7fb41503c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400d830 tx=0x7f7fa400dcf0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 shutdown_connections 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fa006b4d0 0x7f7fa006d990 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fb4162310 0x7f7fb41e8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7fb4161970 0x7f7fb41e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 --2- 172.21.15.5:0/1395930348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fb415df30 0x7f7fb41503c0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 >> 172.21.15.5:0/1395930348 conn(0x7f7fb4072070 msgr2=0x7f7fb415ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 shutdown_connections 2024-04-25T09:02:41.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.395+0000 7f7fba79e640 1 -- 172.21.15.5:0/1395930348 wait complete. 2024-04-25T09:02:41.394 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:02:41.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:02:41.443 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:02:41.483 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:02:41.483 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:02:41.483 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:41.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:02:41.499 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:02:41.499 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:41.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:02:41.541 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:02:41.542 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:41.559 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:02:41.559 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:02:41.559 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:41.599 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:02:41.599 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:02:41.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:41.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 Processor -- start 2024-04-25T09:02:41.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 -- start start 2024-04-25T09:02:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa870154f10 0x7fa8700b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa87015bbd0 0x7fa8700cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8700b39b0 0x7fa8700cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8700b3f30 con 0x7fa87015bbd0 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87015b0f0 con 0x7fa8700b39b0 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.712+0000 7fa876e5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87015b3d0 con 0x7fa870154f10 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa87015bbd0 0x7fa8700cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa87015bbd0 0x7fa8700cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50892/0 (socket says 172.21.15.5:50892) 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 -- 172.21.15.5:0/2898419138 learned_addr learned my addr 172.21.15.5:0/2898419138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa874bf9640 1 --2- 172.21.15.5:0/2898419138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa870154f10 0x7fa8700b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa8753fa640 1 --2- 172.21.15.5:0/2898419138 >> v2:172.21.15.80:3300/0 conn(0x7fa8700b39b0 0x7fa8700cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 -- 172.21.15.5:0/2898419138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa870154f10 msgr2=0x7fa8700b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 --2- 172.21.15.5:0/2898419138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa870154f10 0x7fa8700b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 -- 172.21.15.5:0/2898419138 >> v2:172.21.15.80:3300/0 conn(0x7fa8700b39b0 msgr2=0x7fa8700cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 --2- 172.21.15.5:0/2898419138 >> v2:172.21.15.80:3300/0 conn(0x7fa8700b39b0 0x7fa8700cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa86ffff640 1 -- 172.21.15.5:0/2898419138 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8701552f0 con 0x7fa87015bbd0 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.713+0000 7fa8753fa640 1 --2- 172.21.15.5:0/2898419138 >> v2:172.21.15.80:3300/0 conn(0x7fa8700b39b0 0x7fa8700cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa86ffff640 1 --2- 172.21.15.5:0/2898419138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa87015bbd0 0x7fa8700cf580 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fa8700727a0 tx=0x7fa86402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d47168fd7199be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa86f7fe640 1 -- 172.21.15.5:0/2898419138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864037070 con 0x7fa87015bbd0 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa86f7fe640 1 -- 172.21.15.5:0/2898419138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864032440 con 0x7fa87015bbd0 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa86f7fe640 1 -- 172.21.15.5:0/2898419138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864032810 con 0x7fa87015bbd0 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 -- 172.21.15.5:0/2898419138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa87015bbd0 msgr2=0x7fa8700cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 --2- 172.21.15.5:0/2898419138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa87015bbd0 0x7fa8700cf580 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fa8700727a0 tx=0x7fa86402a140 comp rx=0 tx=0).stop 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 -- 172.21.15.5:0/2898419138 shutdown_connections 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 --2- 172.21.15.5:0/2898419138 >> v2:172.21.15.80:3300/0 conn(0x7fa8700b39b0 0x7fa8700cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 --2- 172.21.15.5:0/2898419138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa87015bbd0 0x7fa8700cf580 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 --2- 172.21.15.5:0/2898419138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa870154f10 0x7fa8700b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 -- 172.21.15.5:0/2898419138 >> 172.21.15.5:0/2898419138 conn(0x7fa8700668f0 msgr2=0x7fa870066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 -- 172.21.15.5:0/2898419138 shutdown_connections 2024-04-25T09:02:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.714+0000 7fa876e5d640 1 -- 172.21.15.5:0/2898419138 wait complete. 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 Processor -- start 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 -- start start 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700b39b0 0x7fa87013ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa870154f10 0x7fa8701e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa87015bbd0 0x7fa87014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87006d6b0 con 0x7fa8700b39b0 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87006d530 con 0x7fa870154f10 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.716+0000 7fa876e5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87006d830 con 0x7fa87015bbd0 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700b39b0 0x7fa87013ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700b39b0 0x7fa87013ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50908/0 (socket says 172.21.15.5:50908) 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 -- 172.21.15.5:0/3296506206 learned_addr learned my addr 172.21.15.5:0/3296506206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa8753fa640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa87015bbd0 0x7fa87014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa86ffff640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa870154f10 0x7fa8701e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 -- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa87015bbd0 msgr2=0x7fa87014a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa87015bbd0 0x7fa87014a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 -- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa870154f10 msgr2=0x7fa8701e43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa870154f10 0x7fa8701e43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 -- 172.21.15.5:0/3296506206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87014a680 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa874bf9640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700b39b0 0x7fa87013ac90 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fa868007ef0 tx=0x7fa86800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa86d7fa640 1 -- 172.21.15.5:0/3296506206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868014620 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa86d7fa640 1 -- 172.21.15.5:0/3296506206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868019070 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87014a950 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa86d7fa640 1 -- 172.21.15.5:0/3296506206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868014a00 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.717+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87014af10 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.718+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8700b40b0 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.719+0000 7fa86d7fa640 1 -- 172.21.15.5:0/3296506206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa868014ba0 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.719+0000 7fa86d7fa640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa85c06b4d0 0x7fa85c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.719+0000 7fa86d7fa640 1 -- 172.21.15.5:0/3296506206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa86808a6e0 con 0x7fa8700b39b0 2024-04-25T09:02:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.719+0000 7fa86ffff640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa85c06b4d0 0x7fa85c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.720+0000 7fa86ffff640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa85c06b4d0 0x7fa85c06d990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa864034000 tx=0x7fa86402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.724+0000 7fa86d7fa640 1 -- 172.21.15.5:0/3296506206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8700b40b0 con 0x7fa8700b39b0 2024-04-25T09:02:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.943+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa870070d30 con 0x7fa8700b39b0 2024-04-25T09:02:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.944+0000 7fa86d7fa640 1 -- 172.21.15.5:0/3296506206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3687 (secure 0 0 0) 0x7fa868059210 con 0x7fa8700b39b0 2024-04-25T09:02:41.933 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:41.933 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/551194531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":551194531},{"type":"v1","addr":"172.21.15.5:6835","nonce":551194531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3514707104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3514707104},{"type":"v1","addr":"172.21.15.80:6836","nonce":3514707104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1754839566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1754839566},{"type":"v1","addr":"172.21.15.80:6837","nonce":1754839566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/546123103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":546123103},{"type":"v1","addr":"172.21.15.5:6833","nonce":546123103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[]} 2024-04-25T09:02:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 48 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa85c06b4d0 msgr2=0x7fa85c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa85c06b4d0 0x7fa85c06d990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa864034000 tx=0x7fa86402e000 comp rx=0 tx=0).stop 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700b39b0 msgr2=0x7fa87013ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700b39b0 0x7fa87013ac90 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fa868007ef0 tx=0x7fa86800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 shutdown_connections 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa85c06b4d0 0x7fa85c06d990 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa87015bbd0 0x7fa87014a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa870154f10 0x7fa8701e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 --2- 172.21.15.5:0/3296506206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700b39b0 0x7fa87013ac90 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 >> 172.21.15.5:0/3296506206 conn(0x7fa8700668f0 msgr2=0x7fa8700b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 shutdown_connections 2024-04-25T09:02:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:41.946+0000 7fa876e5d640 1 -- 172.21.15.5:0/3296506206 wait complete. 2024-04-25T09:02:41.947 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:02:41.947 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:02:41.948 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:02:41.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:41.948 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:02:41.948 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:02:41.948 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:02:41.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:41.949 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:02:41.949 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:02:41.949 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:02:41.949 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:41.949 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:02:41.949 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:02:41.950 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:02:41.950 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:41.957 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:02:41.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:02:41.958 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:02:41.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:02:41.961 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:02:41.962 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:02:41.962 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:02:41.963 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:02:42.000 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:02:42.001 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:42.001 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:02:42.001 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:42.004 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:02:42.004 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:42.004 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:02:42.005 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:42.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:02:42.078 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:02:42.079 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:02:42.082 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:02:42.083 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:02:42.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.123+0000 7f5d82888640 1 Processor -- start 2024-04-25T09:02:42.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.123+0000 7f5d82888640 1 -- start start 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.124+0000 7f5d82888640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d7c0ce720 0x7f5d7c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.124+0000 7f5d82888640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0cdcb0 con 0x7f5d7c15bdc0 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.124+0000 7f5d82888640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0cdf90 con 0x7f5d7c0ce290 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.124+0000 7f5d82888640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c0b47e0 con 0x7f5d7c0ce720 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.124+0000 7f5d7bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5d7c15bdc0 0x7f5d7c0cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53372/0 (socket says 172.21.15.5:53372) 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.124+0000 7f5d7bfff640 1 -- 172.21.15.5:0/262206588 learned_addr learned my addr 172.21.15.5:0/262206588 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.124+0000 7f5d80e25640 1 --2- 172.21.15.5:0/262206588 >> v2:172.21.15.80:3300/0 conn(0x7f5d7c0ce720 0x7f5d7c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.125+0000 7f5d7affd640 1 -- 172.21.15.5:0/262206588 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095190301 0 0) 0x7f5d7c0cdcb0 con 0x7f5d7c15bdc0 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.125+0000 7f5d7affd640 1 -- 172.21.15.5:0/262206588 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d64003520 con 0x7f5d7c15bdc0 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.125+0000 7f5d80e25640 1 -- 172.21.15.5:0/262206588 >> v1:172.21.15.80:6789/0 conn(0x7f5d7c0ce290 legacy=0x7f5d7c0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.125+0000 7f5d80e25640 1 -- 172.21.15.5:0/262206588 >> v1:172.21.15.5:6789/0 conn(0x7f5d7c15bdc0 legacy=0x7f5d7c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.125+0000 7f5d7affd640 1 -- 172.21.15.5:0/262206588 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157045026 0 0) 0x7f5d7c0cdf90 con 0x7f5d7c0ce290 2024-04-25T09:02:42.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.125+0000 7f5d80e25640 1 -- 172.21.15.5:0/262206588 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0b4ac0 con 0x7f5d7c0ce720 2024-04-25T09:02:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d80e25640 1 --2- 172.21.15.5:0/262206588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce720 0x7f5d7c0b59d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009d90 tx=0x7f5d7402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e032ec16e14b96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d7affd640 1 -- 172.21.15.5:0/262206588 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74007740 con 0x7f5d7c0ce720 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d7affd640 1 -- 172.21.15.5:0/262206588 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d740078e0 con 0x7f5d7c0ce720 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d7affd640 1 -- 172.21.15.5:0/262206588 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74007cb0 con 0x7f5d7c0ce720 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d82888640 1 -- 172.21.15.5:0/262206588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce720 msgr2=0x7f5d7c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d82888640 1 --2- 172.21.15.5:0/262206588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce720 0x7f5d7c0b59d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009d90 tx=0x7f5d7402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d82888640 1 -- 172.21.15.5:0/262206588 shutdown_connections 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d82888640 1 --2- 172.21.15.5:0/262206588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce720 0x7f5d7c0b59d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d82888640 1 -- 172.21.15.5:0/262206588 >> 172.21.15.5:0/262206588 conn(0x7f5d7c0d18f0 msgr2=0x7f5d7c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d82888640 1 -- 172.21.15.5:0/262206588 shutdown_connections 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.126+0000 7f5d82888640 1 -- 172.21.15.5:0/262206588 wait complete. 2024-04-25T09:02:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.128+0000 7f5d82888640 1 Processor -- start 2024-04-25T09:02:42.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.128+0000 7f5d82888640 1 -- start start 2024-04-25T09:02:42.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.128+0000 7f5d82888640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce290 0x7f5d7c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d82888640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d7c0ce720 0x7f5d7c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d82888640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7c15bdc0 0x7f5d7c1f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d82888640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0d09a0 con 0x7f5d7c15bdc0 2024-04-25T09:02:42.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d82888640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0ceb50 con 0x7f5d7c0ce290 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d82888640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0cd8b0 con 0x7f5d7c0ce720 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d80e25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7c15bdc0 0x7f5d7c1f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce290 0x7f5d7c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d80e25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7c15bdc0 0x7f5d7c1f3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50938/0 (socket says 172.21.15.5:50938) 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d80e25640 1 -- 172.21.15.5:0/1303420440 learned_addr learned my addr 172.21.15.5:0/1303420440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7b7fe640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d7c0ce720 0x7f5d7c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7bfff640 1 -- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d7c0ce720 msgr2=0x7f5d7c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7bfff640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d7c0ce720 0x7f5d7c15c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7bfff640 1 -- 172.21.15.5:0/1303420440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7c15bdc0 msgr2=0x7f5d7c1f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7bfff640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7c15bdc0 0x7f5d7c1f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7bfff640 1 -- 172.21.15.5:0/1303420440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c1533e0 con 0x7f5d7c0ce290 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d80e25640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7c15bdc0 0x7f5d7c1f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d7bfff640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce290 0x7f5d7c152ea0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00c390 tx=0x7f5d6c001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:42.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d78ff9640 1 -- 172.21.15.5:0/1303420440 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c017070 con 0x7f5d7c0ce290 2024-04-25T09:02:42.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d78ff9640 1 -- 172.21.15.5:0/1303420440 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c005ce0 con 0x7f5d7c0ce290 2024-04-25T09:02:42.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c15c9f0 con 0x7f5d7c0ce290 2024-04-25T09:02:42.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d78ff9640 1 -- 172.21.15.5:0/1303420440 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0072f0 con 0x7f5d7c0ce290 2024-04-25T09:02:42.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.129+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c15cfb0 con 0x7f5d7c0ce290 2024-04-25T09:02:42.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.130+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c04ef20 con 0x7f5d7c0ce290 2024-04-25T09:02:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.131+0000 7f5d78ff9640 1 -- 172.21.15.5:0/1303420440 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d6c01a070 con 0x7f5d7c0ce290 2024-04-25T09:02:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.131+0000 7f5d78ff9640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d6806b4d0 0x7f5d6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.131+0000 7f5d78ff9640 1 -- 172.21.15.5:0/1303420440 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5d6c0891c0 con 0x7f5d7c0ce290 2024-04-25T09:02:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.131+0000 7f5d7b7fe640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d6806b4d0 0x7f5d6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.132+0000 7f5d7b7fe640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d6806b4d0 0x7f5d6806d990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000f60 tx=0x7f5d70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.136+0000 7f5d78ff9640 1 -- 172.21.15.5:0/1303420440 <== mon.1 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d7c1533e0 con 0x7f5d7c0ce290 2024-04-25T09:02:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:42.328+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5d7c06c810 con 0x7f5d7c0ce290 2024-04-25T09:02:43.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.087+0000 7f5d78ff9640 1 -- 172.21.15.5:0/1303420440 <== mon.1 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5d6c057c50 con 0x7f5d7c0ce290 2024-04-25T09:02:43.077 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d6806b4d0 msgr2=0x7f5d6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d6806b4d0 0x7f5d6806d990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000f60 tx=0x7f5d70009040 comp rx=0 tx=0).stop 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce290 msgr2=0x7f5d7c152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce290 0x7f5d7c152ea0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00c390 tx=0x7f5d6c001e70 comp rx=0 tx=0).stop 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 shutdown_connections 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d6806b4d0 0x7f5d6806d990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7c15bdc0 0x7f5d7c1f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d7c0ce720 0x7f5d7c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 --2- 172.21.15.5:0/1303420440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7c0ce290 0x7f5d7c152ea0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.090+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 >> 172.21.15.5:0/1303420440 conn(0x7f5d7c0d18f0 msgr2=0x7f5d7c06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.091+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 shutdown_connections 2024-04-25T09:02:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.091+0000 7f5d82888640 1 -- 172.21.15.5:0/1303420440 wait complete. 2024-04-25T09:02:43.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:02:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.213+0000 7f4e11df5640 1 Processor -- start 2024-04-25T09:02:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.213+0000 7f4e11df5640 1 -- start start 2024-04-25T09:02:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e11df5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e0c0cfd80 0x7f4e0c15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e11df5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c06d280 con 0x7f4e0c0cc120 2024-04-25T09:02:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e11df5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c06c4c0 con 0x7f4e0c15c620 2024-04-25T09:02:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e11df5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c06c7a0 con 0x7f4e0c0cfd80 2024-04-25T09:02:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4e0c0cc120 0x7f4e0c0cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53388/0 (socket says 172.21.15.5:53388) 2024-04-25T09:02:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0b7fe640 1 -- 172.21.15.5:0/2970114309 learned_addr learned my addr 172.21.15.5:0/2970114309 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0affd640 1 --2- 172.21.15.5:0/2970114309 >> v2:172.21.15.80:3300/0 conn(0x7f4e0c0cfd80 0x7f4e0c15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768715071 0 0) 0x7f4e0c06d280 con 0x7f4e0c0cc120 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df4003520 con 0x7f4e0c0cc120 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700263500 0 0) 0x7f4df4003520 con 0x7f4e0c0cc120 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 >> v2:172.21.15.80:3300/0 conn(0x7f4e0c0cfd80 msgr2=0x7f4e0c15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 --2- 172.21.15.5:0/2970114309 >> v2:172.21.15.80:3300/0 conn(0x7f4e0c0cfd80 0x7f4e0c15c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 >> v1:172.21.15.80:6789/0 conn(0x7f4e0c15c620 legacy=0x7f4e0c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c06ca80 con 0x7f4e0c0cc120 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f4dfc001670 con 0x7f4e0c0cc120 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 >> v1:172.21.15.5:6789/0 conn(0x7f4e0c0cc120 legacy=0x7f4e0c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df40039b0 0x7f4df4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df4004800 0x7f4df4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4df40051c0 0x7f4df400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c06c7a0 con 0x7f4df40039b0 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df400c060 con 0x7f4df4004800 2024-04-25T09:02:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df400c260 con 0x7f4df40051c0 2024-04-25T09:02:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.214+0000 7f4e0b7fe640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df40039b0 0x7f4df4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0affd640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df4004800 0x7f4df4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0bfff640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4df40051c0 0x7f4df400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0b7fe640 1 -- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4df40051c0 msgr2=0x7f4df400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0b7fe640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4df40051c0 0x7f4df400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0b7fe640 1 -- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df4004800 msgr2=0x7f4df4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0b7fe640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df4004800 0x7f4df4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0b7fe640 1 -- 172.21.15.5:0/2970114309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4003520 con 0x7f4df40039b0 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0bfff640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4df40051c0 0x7f4df400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0bfff640 1 -- 172.21.15.5:0/2970114309 reap_dead start 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.215+0000 7f4e0b7fe640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df40039b0 0x7f4df4003dd0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c210 tx=0x7f4df4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19008ac681538a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc007d30 con 0x7f4df40039b0 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc005ad0 con 0x7f4df40039b0 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e0a7fc640 1 -- 172.21.15.5:0/2970114309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc007070 con 0x7f4df40039b0 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e11df5640 1 -- 172.21.15.5:0/2970114309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df40039b0 msgr2=0x7f4df4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e11df5640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df40039b0 0x7f4df4003dd0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c210 tx=0x7f4df4005830 comp rx=0 tx=0).stop 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e11df5640 1 -- 172.21.15.5:0/2970114309 shutdown_connections 2024-04-25T09:02:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e11df5640 1 --2- 172.21.15.5:0/2970114309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df40039b0 0x7f4df4003dd0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e11df5640 1 -- 172.21.15.5:0/2970114309 >> 172.21.15.5:0/2970114309 conn(0x7f4e0c0668f0 msgr2=0x7f4e0c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e11df5640 1 -- 172.21.15.5:0/2970114309 shutdown_connections 2024-04-25T09:02:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.216+0000 7f4e11df5640 1 -- 172.21.15.5:0/2970114309 wait complete. 2024-04-25T09:02:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.217+0000 7f4e11df5640 1 Processor -- start 2024-04-25T09:02:43.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e11df5640 1 -- start start 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e11df5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df40039b0 0x7f4e0c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e11df5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e0c141060 0x7f4e0c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e11df5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e0c0c66a0 0x7f4e0c0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e11df5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0cc500 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e11df5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c15ce50 con 0x7f4df40039b0 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e11df5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0cc680 con 0x7f4e0c141060 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e0c0c66a0 0x7f4e0c0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.218+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e0c0c66a0 0x7f4e0c0c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50964/0 (socket says 172.21.15.5:50964) 2024-04-25T09:02:43.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0bfff640 1 -- 172.21.15.5:0/255091471 learned_addr learned my addr 172.21.15.5:0/255091471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0b7fe640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df40039b0 0x7f4e0c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0affd640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e0c141060 0x7f4e0c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0bfff640 1 -- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e0c141060 msgr2=0x7f4e0c14e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0bfff640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e0c141060 0x7f4e0c14e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0bfff640 1 -- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df40039b0 msgr2=0x7f4e0c14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0bfff640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df40039b0 0x7f4e0c14d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0bfff640 1 -- 172.21.15.5:0/255091471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0c5b90 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e0bfff640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e0c0c66a0 0x7f4e0c0c6b50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0cd060 tx=0x7f4e0400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4df3fff640 1 -- 172.21.15.5:0/255091471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04019070 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4df3fff640 1 -- 172.21.15.5:0/255091471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e04003b80 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4df3fff640 1 -- 172.21.15.5:0/255091471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e040050d0 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c0c5e70 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.219+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c14ca00 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.220+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c04ef20 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.221+0000 7f4df3fff640 1 -- 172.21.15.5:0/255091471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e0401c070 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.221+0000 7f4df3fff640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4df806b500 0x7f4df806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.221+0000 7f4df3fff640 1 -- 172.21.15.5:0/255091471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e040890d0 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.221+0000 7f4e0b7fe640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4df806b500 0x7f4df806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.222+0000 7f4e0b7fe640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4df806b500 0x7f4df806d9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc033000 tx=0x7f4dfc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.225+0000 7f4df3fff640 1 -- 172.21.15.5:0/255091471 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e04057c50 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.472+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4e0c0cf760 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.473+0000 7f4df3fff640 1 -- 172.21.15.5:0/255091471 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4e0405bcf0 con 0x7f4e0c0c66a0 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.462 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.464 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T09:02:43.466 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.468 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:02:43.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:02:43.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T09:02:43.472 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:02:43.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T09:02:43.474 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T09:02:43.475 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:02:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4df806b500 msgr2=0x7f4df806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4df806b500 0x7f4df806d9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc033000 tx=0x7f4dfc02e000 comp rx=0 tx=0).stop 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e0c0c66a0 msgr2=0x7f4e0c0c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e0c0c66a0 0x7f4e0c0c6b50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0cd060 tx=0x7f4e0400ead0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 shutdown_connections 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4df806b500 0x7f4df806d9c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e0c0c66a0 0x7f4e0c0c6b50 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4e0c141060 0x7f4e0c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 --2- 172.21.15.5:0/255091471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4df40039b0 0x7f4e0c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 >> 172.21.15.5:0/255091471 conn(0x7f4e0c0668f0 msgr2=0x7f4e0c152370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 shutdown_connections 2024-04-25T09:02:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.475+0000 7f4e11df5640 1 -- 172.21.15.5:0/255091471 wait complete. 2024-04-25T09:02:43.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:43.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.589+0000 7fd84f4f5640 1 Processor -- start 2024-04-25T09:02:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.590+0000 7fd84f4f5640 1 -- start start 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.590+0000 7fd84f4f5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd84815e0a0 0x7fd8480d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.590+0000 7fd84f4f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.590+0000 7fd84f4f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8480ce5e0 0x7fd8480cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.590+0000 7fd84f4f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480d4330 con 0x7fd8480ce5e0 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.590+0000 7fd84f4f5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480b29c0 con 0x7fd84815e0a0 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.590+0000 7fd84f4f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480d2080 con 0x7fd8480d3990 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8480ce5e0 0x7fd8480cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8480ce5e0 0x7fd8480cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50974/0 (socket says 172.21.15.5:50974) 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 -- 172.21.15.5:0/1581864240 learned_addr learned my addr 172.21.15.5:0/1581864240 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84d291640 1 --2- 172.21.15.5:0/1581864240 >> v2:172.21.15.80:3300/0 conn(0x7fd84815e0a0 0x7fd8480d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84ca90640 1 --2- 172.21.15.5:0/1581864240 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 -- 172.21.15.5:0/1581864240 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 msgr2=0x7fd8480d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 --2- 172.21.15.5:0/1581864240 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 -- 172.21.15.5:0/1581864240 >> v2:172.21.15.80:3300/0 conn(0x7fd84815e0a0 msgr2=0x7fd8480d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 --2- 172.21.15.5:0/1581864240 >> v2:172.21.15.80:3300/0 conn(0x7fd84815e0a0 0x7fd8480d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.591+0000 7fd84da92640 1 -- 172.21.15.5:0/1581864240 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480d2360 con 0x7fd8480ce5e0 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84da92640 1 --2- 172.21.15.5:0/1581864240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8480ce5e0 0x7fd8480cea70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd8480b6680 tx=0x7fd83802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d868e20c3dfa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd847fff640 1 -- 172.21.15.5:0/1581864240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838036070 con 0x7fd8480ce5e0 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd847fff640 1 -- 172.21.15.5:0/1581864240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838031600 con 0x7fd8480ce5e0 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd847fff640 1 -- 172.21.15.5:0/1581864240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380319d0 con 0x7fd8480ce5e0 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 -- 172.21.15.5:0/1581864240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8480ce5e0 msgr2=0x7fd8480cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/1581864240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8480ce5e0 0x7fd8480cea70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd8480b6680 tx=0x7fd83802a6a0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 -- 172.21.15.5:0/1581864240 shutdown_connections 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/1581864240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8480ce5e0 0x7fd8480cea70 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/1581864240 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/1581864240 >> v2:172.21.15.80:3300/0 conn(0x7fd84815e0a0 0x7fd8480d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 -- 172.21.15.5:0/1581864240 >> 172.21.15.5:0/1581864240 conn(0x7fd8480668f0 msgr2=0x7fd848066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.592+0000 7fd84f4f5640 1 -- 172.21.15.5:0/1581864240 shutdown_connections 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.593+0000 7fd84f4f5640 1 -- 172.21.15.5:0/1581864240 wait complete. 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 Processor -- start 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 -- start start 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8480ce5e0 0x7fd8481540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd84815e0a0 0x7fd8480cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480d2c00 con 0x7fd84815e0a0 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480d2920 con 0x7fd8480ce5e0 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.594+0000 7fd84f4f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84815e480 con 0x7fd8480d3990 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd84815e0a0 0x7fd8480cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd84815e0a0 0x7fd8480cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50980/0 (socket says 172.21.15.5:50980) 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 -- 172.21.15.5:0/2234169317 learned_addr learned my addr 172.21.15.5:0/2234169317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84d291640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8480ce5e0 0x7fd8481540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84ca90640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 -- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 msgr2=0x7fd8480ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 -- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8480ce5e0 msgr2=0x7fd8481540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8480ce5e0 0x7fd8481540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 -- 172.21.15.5:0/2234169317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848157da0 con 0x7fd84815e0a0 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84da92640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd84815e0a0 0x7fd8480cd0f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd838009f40 tx=0x7fd838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd845ffb640 1 -- 172.21.15.5:0/2234169317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83803f020 con 0x7fd84815e0a0 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd845ffb640 1 -- 172.21.15.5:0/2234169317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838037040 con 0x7fd84815e0a0 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd845ffb640 1 -- 172.21.15.5:0/2234169317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838036070 con 0x7fd84815e0a0 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.595+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8481545e0 con 0x7fd84815e0a0 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.596+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481f3de0 con 0x7fd84815e0a0 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.597+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480cfaa0 con 0x7fd84815e0a0 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.597+0000 7fd845ffb640 1 -- 172.21.15.5:0/2234169317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd838042020 con 0x7fd84815e0a0 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.597+0000 7fd845ffb640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd83406b4d0 0x7fd83406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.597+0000 7fd845ffb640 1 -- 172.21.15.5:0/2234169317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8380aa230 con 0x7fd84815e0a0 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.598+0000 7fd84d291640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd83406b4d0 0x7fd83406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.598+0000 7fd84d291640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd83406b4d0 0x7fd83406d990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd840006fd0 tx=0x7fd840008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.602+0000 7fd845ffb640 1 -- 172.21.15.5:0/2234169317 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8480cfaa0 con 0x7fd84815e0a0 2024-04-25T09:02:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.784+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd84804ef20 con 0x7fd84815e0a0 2024-04-25T09:02:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.785+0000 7fd845ffb640 1 -- 172.21.15.5:0/2234169317 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+12808 (secure 0 0 0) 0x7fd838049030 con 0x7fd84815e0a0 2024-04-25T09:02:43.773 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:43.774 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":84,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:43.094824+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd83406b4d0 msgr2=0x7fd83406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd83406b4d0 0x7fd83406d990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd840006fd0 tx=0x7fd840008040 comp rx=0 tx=0).stop 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd84815e0a0 msgr2=0x7fd8480cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd84815e0a0 0x7fd8480cd0f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd838009f40 tx=0x7fd838004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 shutdown_connections 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd83406b4d0 0x7fd83406d990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd84815e0a0 0x7fd8480cd0f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8480d3990 0x7fd8480ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 --2- 172.21.15.5:0/2234169317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8480ce5e0 0x7fd8481540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 >> 172.21.15.5:0/2234169317 conn(0x7fd8480668f0 msgr2=0x7fd84815f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 shutdown_connections 2024-04-25T09:02:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.787+0000 7fd84f4f5640 1 -- 172.21.15.5:0/2234169317 wait complete. 2024-04-25T09:02:43.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:43.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.903+0000 7ff994038640 1 Processor -- start 2024-04-25T09:02:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.903+0000 7ff994038640 1 -- start start 2024-04-25T09:02:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff994038640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff98c15df10 0x7ff98c1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff994038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff98c0b6250 0x7ff98c0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff994038640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98c162150 con 0x7ff98c0cee10 2024-04-25T09:02:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff994038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0cf260 con 0x7ff98c0b6250 2024-04-25T09:02:43.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff994038640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0d20d0 con 0x7ff98c15df10 2024-04-25T09:02:43.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff9915d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff98c0b6250 0x7ff98c0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff9925d5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff98c0cee10 0x7ff98c0d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53390/0 (socket says 172.21.15.5:53390) 2024-04-25T09:02:43.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff9925d5640 1 -- 172.21.15.5:0/415181193 learned_addr learned my addr 172.21.15.5:0/415181193 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:43.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff991dd4640 1 --2- 172.21.15.5:0/415181193 >> v2:172.21.15.80:3300/0 conn(0x7ff98c15df10 0x7ff98c1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff9915d3640 1 -- 172.21.15.5:0/415181193 >> v2:172.21.15.80:3300/0 conn(0x7ff98c15df10 msgr2=0x7ff98c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff9915d3640 1 --2- 172.21.15.5:0/415181193 >> v2:172.21.15.80:3300/0 conn(0x7ff98c15df10 0x7ff98c1618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff9915d3640 1 -- 172.21.15.5:0/415181193 >> v1:172.21.15.5:6789/0 conn(0x7ff98c0cee10 legacy=0x7ff98c0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff9915d3640 1 -- 172.21.15.5:0/415181193 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c162430 con 0x7ff98c0b6250 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.904+0000 7ff990dd2640 1 -- 172.21.15.5:0/415181193 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042056286 0 0) 0x7ff98c162150 con 0x7ff98c0cee10 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.905+0000 7ff9915d3640 1 --2- 172.21.15.5:0/415181193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0ce8d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff98c075080 tx=0x7ff97c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25aed7125c990b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.905+0000 7ff990dd2640 1 -- 172.21.15.5:0/415181193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c037070 con 0x7ff98c0b6250 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.905+0000 7ff990dd2640 1 -- 172.21.15.5:0/415181193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c032440 con 0x7ff98c0b6250 2024-04-25T09:02:43.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.905+0000 7ff990dd2640 1 -- 172.21.15.5:0/415181193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c032810 con 0x7ff98c0b6250 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.905+0000 7ff994038640 1 -- 172.21.15.5:0/415181193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 msgr2=0x7ff98c0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.905+0000 7ff994038640 1 --2- 172.21.15.5:0/415181193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0ce8d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff98c075080 tx=0x7ff97c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.906+0000 7ff994038640 1 -- 172.21.15.5:0/415181193 shutdown_connections 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.906+0000 7ff994038640 1 --2- 172.21.15.5:0/415181193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0ce8d0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.906+0000 7ff994038640 1 --2- 172.21.15.5:0/415181193 >> v2:172.21.15.80:3300/0 conn(0x7ff98c15df10 0x7ff98c1618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.906+0000 7ff994038640 1 -- 172.21.15.5:0/415181193 >> 172.21.15.5:0/415181193 conn(0x7ff98c0668f0 msgr2=0x7ff98c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.906+0000 7ff994038640 1 -- 172.21.15.5:0/415181193 shutdown_connections 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.906+0000 7ff994038640 1 -- 172.21.15.5:0/415181193 wait complete. 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.907+0000 7ff994038640 1 Processor -- start 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.907+0000 7ff994038640 1 -- start start 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98c0cee10 0x7ff98c1607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff98c15df10 0x7ff98c0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c161e10 con 0x7ff98c0b6250 2024-04-25T09:02:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0d1d60 con 0x7ff98c0cee10 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0d3570 con 0x7ff98c15df10 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51002/0 (socket says 172.21.15.5:51002) 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 -- 172.21.15.5:0/1229329899 learned_addr learned my addr 172.21.15.5:0/1229329899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 -- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff98c15df10 msgr2=0x7ff98c0c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff98c15df10 0x7ff98c0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 -- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98c0cee10 msgr2=0x7ff98c1607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98c0cee10 0x7ff98c1607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 -- 172.21.15.5:0/1229329899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c15f700 con 0x7ff98c0b6250 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff991dd4640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0b2bb0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff98800d5f0 tx=0x7ff98800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff9827fc640 1 -- 172.21.15.5:0/1229329899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880125f0 con 0x7ff98c0b6250 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff9827fc640 1 -- 172.21.15.5:0/1229329899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988019070 con 0x7ff98c0b6250 2024-04-25T09:02:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c15f9e0 con 0x7ff98c0b6250 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff9827fc640 1 -- 172.21.15.5:0/1229329899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880129d0 con 0x7ff98c0b6250 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.908+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c15ffa0 con 0x7ff98c0b6250 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.909+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c04ef20 con 0x7ff98c0b6250 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.910+0000 7ff9827fc640 1 -- 172.21.15.5:0/1229329899 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff988012b70 con 0x7ff98c0b6250 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.910+0000 7ff9827fc640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff97006b500 0x7ff97006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.910+0000 7ff9827fc640 1 -- 172.21.15.5:0/1229329899 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff98808a310 con 0x7ff98c0b6250 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.910+0000 7ff9915d3640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff97006b500 0x7ff97006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.911+0000 7ff9915d3640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff97006b500 0x7ff97006d9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff97c034000 tx=0x7ff97c02c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:43.914+0000 7ff9827fc640 1 -- 172.21.15.5:0/1229329899 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff988059440 con 0x7ff98c0b6250 2024-04-25T09:02:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.095+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff98c0c6e60 con 0x7ff98c0b6250 2024-04-25T09:02:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.095+0000 7ff9827fc640 1 -- 172.21.15.5:0/1229329899 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff988058d40 con 0x7ff98c0b6250 2024-04-25T09:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:02:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff97006b500 msgr2=0x7ff97006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff97006b500 0x7ff97006d9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff97c034000 tx=0x7ff97c02c000 comp rx=0 tx=0).stop 2024-04-25T09:02:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 msgr2=0x7ff98c0b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0b2bb0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff98800d5f0 tx=0x7ff98800dab0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 shutdown_connections 2024-04-25T09:02:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff97006b500 0x7ff97006d9c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff98c15df10 0x7ff98c0c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98c0cee10 0x7ff98c1607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 --2- 172.21.15.5:0/1229329899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff98c0b6250 0x7ff98c0b2bb0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 >> 172.21.15.5:0/1229329899 conn(0x7ff98c0668f0 msgr2=0x7ff98c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 shutdown_connections 2024-04-25T09:02:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.097+0000 7ff994038640 1 -- 172.21.15.5:0/1229329899 wait complete. 2024-04-25T09:02:44.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:02:44.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.209+0000 7f28c1bf4640 1 Processor -- start 2024-04-25T09:02:44.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.209+0000 7f28c1bf4640 1 -- start start 2024-04-25T09:02:44.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28c1bf4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28bc0ce7f0 0x7f28bc0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28c1bf4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc0cf1c0 con 0x7f28bc0b2cc0 2024-04-25T09:02:44.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28c1bf4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc0d20e0 con 0x7f28bc15de70 2024-04-25T09:02:44.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28c1bf4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0d2a10 con 0x7f28bc0ce7f0 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28baffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f28bc0b2cc0 0x7f28bc0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53404/0 (socket says 172.21.15.5:53404) 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28baffd640 1 -- 172.21.15.5:0/1028238378 learned_addr learned my addr 172.21.15.5:0/1028238378 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28bbfff640 1 --2- 172.21.15.5:0/1028238378 >> v2:172.21.15.80:3300/0 conn(0x7f28bc0ce7f0 0x7f28bc0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945471070 0 0) 0x7f28bc0cf1c0 con 0x7f28bc0b2cc0 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a4003520 con 0x7f28bc0b2cc0 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501339721 0 0) 0x7f28a4003520 con 0x7f28bc0b2cc0 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 >> v2:172.21.15.80:3300/0 conn(0x7f28bc0ce7f0 msgr2=0x7f28bc0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 --2- 172.21.15.5:0/1028238378 >> v2:172.21.15.80:3300/0 conn(0x7f28bc0ce7f0 0x7f28bc0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 >> v1:172.21.15.80:6789/0 conn(0x7f28bc15de70 legacy=0x7f28bc0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0d23c0 con 0x7f28bc0b2cc0 2024-04-25T09:02:44.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.210+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f28b0001670 con 0x7f28bc0b2cc0 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 >> v1:172.21.15.5:6789/0 conn(0x7f28bc0b2cc0 legacy=0x7f28bc0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28ba7fc640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28a40039b0 0x7f28a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28ba7fc640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a4004800 0x7f28a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28ba7fc640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a40051c0 0x7f28a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0d2a10 con 0x7f28a40051c0 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a400c060 con 0x7f28a40039b0 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a400c260 con 0x7f28a4004800 2024-04-25T09:02:44.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28bbfff640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a40051c0 0x7f28a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28bb7fe640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28a40039b0 0x7f28a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28baffd640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a4004800 0x7f28a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28bbfff640 1 -- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a4004800 msgr2=0x7f28a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28bbfff640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a4004800 0x7f28a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28bbfff640 1 -- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28a40039b0 msgr2=0x7f28a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28bbfff640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28a40039b0 0x7f28a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.211+0000 7f28bbfff640 1 -- 172.21.15.5:0/1028238378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4003520 con 0x7f28a40051c0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28bbfff640 1 -- 172.21.15.5:0/1028238378 reap_dead start 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28bbfff640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a40051c0 0x7f28a400b9c0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009fc0 tx=0x7f28a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5bf416b67f2106 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4035020 con 0x7f28a40051c0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4003bd0 con 0x7f28a40051c0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28ba7fc640 1 -- 172.21.15.5:0/1028238378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4009c10 con 0x7f28a40051c0 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28c1bf4640 1 -- 172.21.15.5:0/1028238378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a40051c0 msgr2=0x7f28a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a40051c0 0x7f28a400b9c0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009fc0 tx=0x7f28a4005830 comp rx=0 tx=0).stop 2024-04-25T09:02:44.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28c1bf4640 1 -- 172.21.15.5:0/1028238378 shutdown_connections 2024-04-25T09:02:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/1028238378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a40051c0 0x7f28a400b9c0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28c1bf4640 1 -- 172.21.15.5:0/1028238378 >> 172.21.15.5:0/1028238378 conn(0x7f28bc06b000 msgr2=0x7f28bc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28c1bf4640 1 -- 172.21.15.5:0/1028238378 shutdown_connections 2024-04-25T09:02:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.212+0000 7f28c1bf4640 1 -- 172.21.15.5:0/1028238378 wait complete. 2024-04-25T09:02:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 Processor -- start 2024-04-25T09:02:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 -- start start 2024-04-25T09:02:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a40051c0 0x7f28bc0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28bc0cd480 0x7f28bc0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28bc0c9360 0x7f28bc0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0cee00 con 0x7f28bc0c9360 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0cec80 con 0x7f28bc0cd480 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.214+0000 7f28c1bf4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0cef80 con 0x7f28a40051c0 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28bc0c9360 0x7f28bc0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28bc0c9360 0x7f28bc0c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51026/0 (socket says 172.21.15.5:51026) 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 -- 172.21.15.5:0/3413400510 learned_addr learned my addr 172.21.15.5:0/3413400510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28baffd640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28bc0cd480 0x7f28bc0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bb7fe640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a40051c0 0x7f28bc0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 -- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a40051c0 msgr2=0x7f28bc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a40051c0 0x7f28bc0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 -- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28bc0cd480 msgr2=0x7f28bc0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28bc0cd480 0x7f28bc0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 -- 172.21.15.5:0/3413400510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0b4510 con 0x7f28bc0c9360 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bb7fe640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a40051c0 0x7f28bc0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28bbfff640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28bc0c9360 0x7f28bc0c97e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e230 tx=0x7f28b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28a3fff640 1 -- 172.21.15.5:0/3413400510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4040070 con 0x7f28bc0c9360 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28a3fff640 1 -- 172.21.15.5:0/3413400510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b403c680 con 0x7f28bc0c9360 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0b4790 con 0x7f28bc0c9360 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28a3fff640 1 -- 172.21.15.5:0/3413400510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4035030 con 0x7f28bc0c9360 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.215+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc0c8b60 con 0x7f28bc0c9360 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.216+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc04ef20 con 0x7f28bc0c9360 2024-04-25T09:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.217+0000 7f28a3fff640 1 -- 172.21.15.5:0/3413400510 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f28b4043070 con 0x7f28bc0c9360 2024-04-25T09:02:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.217+0000 7f28a3fff640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f28a806b500 0x7f28a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.217+0000 7f28a3fff640 1 -- 172.21.15.5:0/3413400510 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28b40aafb0 con 0x7f28bc0c9360 2024-04-25T09:02:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.217+0000 7f28bb7fe640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f28a806b500 0x7f28a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.218+0000 7f28bb7fe640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f28a806b500 0x7f28a806d9c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ccfb0 tx=0x7f28ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.221+0000 7f28a3fff640 1 -- 172.21.15.5:0/3413400510 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28bc0b4510 con 0x7f28bc0c9360 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.403+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28bc0b2aa0 con 0x7f28bc0c9360 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.403+0000 7f28a3fff640 1 -- 172.21.15.5:0/3413400510 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+65 (secure 0 0 0) 0x7f28b4079bc0 con 0x7f28bc0c9360 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:02:44.392 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T09:02:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f28a806b500 msgr2=0x7f28a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f28a806b500 0x7f28a806d9c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ccfb0 tx=0x7f28ac009040 comp rx=0 tx=0).stop 2024-04-25T09:02:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28bc0c9360 msgr2=0x7f28bc0c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28bc0c9360 0x7f28bc0c97e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e230 tx=0x7f28b4009750 comp rx=0 tx=0).stop 2024-04-25T09:02:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 shutdown_connections 2024-04-25T09:02:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f28a806b500 0x7f28a806d9c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28bc0c9360 0x7f28bc0c97e0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28bc0cd480 0x7f28bc0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 --2- 172.21.15.5:0/3413400510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f28a40051c0 0x7f28bc0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 >> 172.21.15.5:0/3413400510 conn(0x7f28bc06b000 msgr2=0x7f28bc0b8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 shutdown_connections 2024-04-25T09:02:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.405+0000 7f28c1bf4640 1 -- 172.21.15.5:0/3413400510 wait complete. 2024-04-25T09:02:44.405 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:02:44.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:02:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.522+0000 7fc563a10640 1 Processor -- start 2024-04-25T09:02:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.522+0000 7fc563a10640 1 -- start start 2024-04-25T09:02:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc563a10640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc55c15bf60 0x7fc55c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc563a10640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c15fbf0 0x7fc55c160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc563a10640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c15c410 con 0x7fc55c155f50 2024-04-25T09:02:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc563a10640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c0b4a10 con 0x7fc55c15bf60 2024-04-25T09:02:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc563a10640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c15cf50 con 0x7fc55c15fbf0 2024-04-25T09:02:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc560fab640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc55c15bf60 0x7fc55c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc5617ac640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc55c155f50 0x7fc55c06c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53406/0 (socket says 172.21.15.5:53406) 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc5617ac640 1 -- 172.21.15.5:0/2739838876 learned_addr learned my addr 172.21.15.5:0/2739838876 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc561fad640 1 --2- 172.21.15.5:0/2739838876 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c15fbf0 0x7fc55c160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc560fab640 1 -- 172.21.15.5:0/2739838876 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c15fbf0 msgr2=0x7fc55c160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc560fab640 1 --2- 172.21.15.5:0/2739838876 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c15fbf0 0x7fc55c160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc560fab640 1 -- 172.21.15.5:0/2739838876 >> v1:172.21.15.5:6789/0 conn(0x7fc55c155f50 legacy=0x7fc55c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.523+0000 7fc560fab640 1 -- 172.21.15.5:0/2739838876 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c15c6b0 con 0x7fc55c15bf60 2024-04-25T09:02:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.524+0000 7fc560fab640 1 --2- 172.21.15.5:0/2739838876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c0b44d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0097a0 tx=0x7fc54c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be4b246975848fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.524+0000 7fc553fff640 1 -- 172.21.15.5:0/2739838876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c037070 con 0x7fc55c15bf60 2024-04-25T09:02:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.524+0000 7fc553fff640 1 -- 172.21.15.5:0/2739838876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c02ae50 con 0x7fc55c15bf60 2024-04-25T09:02:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.524+0000 7fc553fff640 1 -- 172.21.15.5:0/2739838876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c032660 con 0x7fc55c15bf60 2024-04-25T09:02:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 -- 172.21.15.5:0/2739838876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 msgr2=0x7fc55c0b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 --2- 172.21.15.5:0/2739838876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c0b44d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0097a0 tx=0x7fc54c02a100 comp rx=0 tx=0).stop 2024-04-25T09:02:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 -- 172.21.15.5:0/2739838876 shutdown_connections 2024-04-25T09:02:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 --2- 172.21.15.5:0/2739838876 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c15fbf0 0x7fc55c160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 --2- 172.21.15.5:0/2739838876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c0b44d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 -- 172.21.15.5:0/2739838876 >> 172.21.15.5:0/2739838876 conn(0x7fc55c0668f0 msgr2=0x7fc55c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 -- 172.21.15.5:0/2739838876 shutdown_connections 2024-04-25T09:02:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.525+0000 7fc563a10640 1 -- 172.21.15.5:0/2739838876 wait complete. 2024-04-25T09:02:44.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.526+0000 7fc563a10640 1 Processor -- start 2024-04-25T09:02:44.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.526+0000 7fc563a10640 1 -- start start 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc563a10640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c155f50 0x7fc55c154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc563a10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc563a10640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc55c15fbf0 0x7fc55c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc563a10640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c15f6d0 con 0x7fc55c15bf60 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc563a10640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c15cc70 con 0x7fc55c15fbf0 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc563a10640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c06c870 con 0x7fc55c155f50 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51050/0 (socket says 172.21.15.5:51050) 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 -- 172.21.15.5:0/2327836154 learned_addr learned my addr 172.21.15.5:0/2327836154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc561fad640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc55c15fbf0 0x7fc55c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc5617ac640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c155f50 0x7fc55c154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 -- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c155f50 msgr2=0x7fc55c154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c155f50 0x7fc55c154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 -- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc55c15fbf0 msgr2=0x7fc55c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc55c15fbf0 0x7fc55c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 -- 172.21.15.5:0/2327836154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c159320 con 0x7fc55c15bf60 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc561fad640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc55c15fbf0 0x7fc55c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc560fab640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c158a60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fc54c035040 tx=0x7fc54c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc551ffb640 1 -- 172.21.15.5:0/2327836154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c041070 con 0x7fc55c15bf60 2024-04-25T09:02:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc551ffb640 1 -- 172.21.15.5:0/2327836154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c03c670 con 0x7fc55c15bf60 2024-04-25T09:02:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.527+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c157520 con 0x7fc55c15bf60 2024-04-25T09:02:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.528+0000 7fc551ffb640 1 -- 172.21.15.5:0/2327836154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c037040 con 0x7fc55c15bf60 2024-04-25T09:02:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.528+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c157ae0 con 0x7fc55c15bf60 2024-04-25T09:02:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.529+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c04ef20 con 0x7fc55c15bf60 2024-04-25T09:02:44.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.529+0000 7fc551ffb640 1 -- 172.21.15.5:0/2327836154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc54c03a070 con 0x7fc55c15bf60 2024-04-25T09:02:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.530+0000 7fc551ffb640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc54006b4d0 0x7fc54006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.530+0000 7fc551ffb640 1 -- 172.21.15.5:0/2327836154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc54c0aa2b0 con 0x7fc55c15bf60 2024-04-25T09:02:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.530+0000 7fc5617ac640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc54006b4d0 0x7fc54006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.530+0000 7fc5617ac640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc54006b4d0 0x7fc54006d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc558000f60 tx=0x7fc558009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.534+0000 7fc551ffb640 1 -- 172.21.15.5:0/2327836154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc54c0793e0 con 0x7fc55c15bf60 2024-04-25T09:02:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:44.712+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc55c0b4720 con 0x7fc55c15bf60 2024-04-25T09:02:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.087+0000 7fc551ffb640 1 -- 172.21.15.5:0/2327836154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc54c078ce0 con 0x7fc55c15bf60 2024-04-25T09:02:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc54006b4d0 msgr2=0x7fc54006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc54006b4d0 0x7fc54006d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc558000f60 tx=0x7fc558009040 comp rx=0 tx=0).stop 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 msgr2=0x7fc55c158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c158a60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fc54c035040 tx=0x7fc54c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 shutdown_connections 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc54006b4d0 0x7fc54006d990 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc55c15fbf0 0x7fc55c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc55c15bf60 0x7fc55c158a60 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 --2- 172.21.15.5:0/2327836154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc55c155f50 0x7fc55c154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 >> 172.21.15.5:0/2327836154 conn(0x7fc55c0668f0 msgr2=0x7fc55c066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 shutdown_connections 2024-04-25T09:02:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.090+0000 7fc563a10640 1 -- 172.21.15.5:0/2327836154 wait complete. 2024-04-25T09:02:45.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:02:45.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.214+0000 7f76c0b7e640 1 Processor -- start 2024-04-25T09:02:45.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.214+0000 7f76c0b7e640 1 -- start start 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.215+0000 7f76c0b7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc06bfb0 0x7f76bc0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.215+0000 7f76c0b7e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76bc0b2c60 0x7f76bc0d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.215+0000 7f76c0b7e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc06ae90 con 0x7f76bc0b2340 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.215+0000 7f76c0b7e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0d03c0 con 0x7f76bc0b2c60 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.215+0000 7f76c0b7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0cfdb0 con 0x7f76bc06bfb0 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76ba59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f76bc0b2340 0x7f76bc0b1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53418/0 (socket says 172.21.15.5:53418) 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76bad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76bc0b2c60 0x7f76bc0d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76ba59c640 1 -- 172.21.15.5:0/2319418046 learned_addr learned my addr 172.21.15.5:0/2319418046 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76b9d9b640 1 --2- 172.21.15.5:0/2319418046 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc06bfb0 0x7f76bc0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76bad9d640 1 -- 172.21.15.5:0/2319418046 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc06bfb0 msgr2=0x7f76bc0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:45.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76bad9d640 1 --2- 172.21.15.5:0/2319418046 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc06bfb0 0x7f76bc0b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76bad9d640 1 -- 172.21.15.5:0/2319418046 >> v1:172.21.15.5:6789/0 conn(0x7f76bc0b2340 legacy=0x7f76bc0b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76b959a640 1 -- 172.21.15.5:0/2319418046 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392259273 0 0) 0x7f76bc06ae90 con 0x7f76bc0b2340 2024-04-25T09:02:45.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.216+0000 7f76bad9d640 1 -- 172.21.15.5:0/2319418046 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc06b130 con 0x7f76bc0b2c60 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76bad9d640 1 --2- 172.21.15.5:0/2319418046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc0b2c60 0x7f76bc0d0850 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009d90 tx=0x7f76b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c64de8fd331103 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76b959a640 1 -- 172.21.15.5:0/2319418046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4007740 con 0x7f76bc0b2c60 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76b959a640 1 -- 172.21.15.5:0/2319418046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b40078e0 con 0x7f76bc0b2c60 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76b959a640 1 -- 172.21.15.5:0/2319418046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4007cb0 con 0x7f76bc0b2c60 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 -- 172.21.15.5:0/2319418046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc0b2c60 msgr2=0x7f76bc0d0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/2319418046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc0b2c60 0x7f76bc0d0850 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009d90 tx=0x7f76b402a660 comp rx=0 tx=0).stop 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 -- 172.21.15.5:0/2319418046 shutdown_connections 2024-04-25T09:02:45.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/2319418046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc0b2c60 0x7f76bc0d0850 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/2319418046 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc06bfb0 0x7f76bc0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 -- 172.21.15.5:0/2319418046 >> 172.21.15.5:0/2319418046 conn(0x7f76bc0d1a40 msgr2=0x7f76bc0d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 -- 172.21.15.5:0/2319418046 shutdown_connections 2024-04-25T09:02:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.217+0000 7f76c0b7e640 1 -- 172.21.15.5:0/2319418046 wait complete. 2024-04-25T09:02:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 Processor -- start 2024-04-25T09:02:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 -- start start 2024-04-25T09:02:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc06bfb0 0x7f76bc0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76bc0b2340 0x7f76bc0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc0b2c60 0x7f76bc0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0d16b0 con 0x7f76bc06bfb0 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0b1a90 con 0x7f76bc0b2340 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.219+0000 7f76c0b7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0d1830 con 0x7f76bc0b2c60 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc06bfb0 0x7f76bc0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc06bfb0 0x7f76bc0c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51058/0 (socket says 172.21.15.5:51058) 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 -- 172.21.15.5:0/3524333888 learned_addr learned my addr 172.21.15.5:0/3524333888 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76b9d9b640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76bc0b2340 0x7f76bc0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76bad9d640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc0b2c60 0x7f76bc0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 -- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc0b2c60 msgr2=0x7f76bc0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc0b2c60 0x7f76bc0ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 -- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76bc0b2340 msgr2=0x7f76bc0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76bc0b2340 0x7f76bc0c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 -- 172.21.15.5:0/3524333888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0ca6d0 con 0x7f76bc06bfb0 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76b9d9b640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76bc0b2340 0x7f76bc0c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76ba59c640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc06bfb0 0x7f76bc0c8150 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c500 tx=0x7f76ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76aaffd640 1 -- 172.21.15.5:0/3524333888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac018070 con 0x7f76bc06bfb0 2024-04-25T09:02:45.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76aaffd640 1 -- 172.21.15.5:0/3524333888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac007580 con 0x7f76bc06bfb0 2024-04-25T09:02:45.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc0ca9b0 con 0x7f76bc06bfb0 2024-04-25T09:02:45.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76aaffd640 1 -- 172.21.15.5:0/3524333888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac004a20 con 0x7f76bc06bfb0 2024-04-25T09:02:45.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.220+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc0caf70 con 0x7f76bc06bfb0 2024-04-25T09:02:45.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.221+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc04ef20 con 0x7f76bc06bfb0 2024-04-25T09:02:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.222+0000 7f76aaffd640 1 -- 172.21.15.5:0/3524333888 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f76ac01b070 con 0x7f76bc06bfb0 2024-04-25T09:02:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.222+0000 7f76aaffd640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f769c06b4d0 0x7f769c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.222+0000 7f76aaffd640 1 -- 172.21.15.5:0/3524333888 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f76ac0892c0 con 0x7f76bc06bfb0 2024-04-25T09:02:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.223+0000 7f76b9d9b640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f769c06b4d0 0x7f769c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.223+0000 7f76b9d9b640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f769c06b4d0 0x7f769c06d990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0b7660 tx=0x7f76b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.227+0000 7f76aaffd640 1 -- 172.21.15.5:0/3524333888 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76ac0583b0 con 0x7f76bc06bfb0 2024-04-25T09:02:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:45.408+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f76bc0b79c0 con 0x7f76bc06bfb0 2024-04-25T09:02:46.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.093+0000 7f76aaffd640 1 -- 172.21.15.5:0/3524333888 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) v1 ==== 170+0+0 (secure 0 0 0) 0x7f76ac057cb0 con 0x7f76bc06bfb0 2024-04-25T09:02:46.082 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f769c06b4d0 msgr2=0x7f769c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f769c06b4d0 0x7f769c06d990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0b7660 tx=0x7f76b0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc06bfb0 msgr2=0x7f76bc0c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc06bfb0 0x7f76bc0c8150 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c500 tx=0x7f76ac00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 shutdown_connections 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f769c06b4d0 0x7f769c06d990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f76bc0b2c60 0x7f76bc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76bc0b2340 0x7f76bc0c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 --2- 172.21.15.5:0/3524333888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76bc06bfb0 0x7f76bc0c8150 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 >> 172.21.15.5:0/3524333888 conn(0x7f76bc0d1a40 msgr2=0x7f76bc0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 shutdown_connections 2024-04-25T09:02:46.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.097+0000 7f76c0b7e640 1 -- 172.21.15.5:0/3524333888 wait complete. 2024-04-25T09:02:46.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:02:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.231+0000 7f7268190640 1 Processor -- start 2024-04-25T09:02:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.231+0000 7f7268190640 1 -- start start 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f7268190640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72600d0c80 0x7f726006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f7268190640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600cc780 0x7f72600ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f7268190640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72600d27f0 con 0x7f726015e0b0 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f7268190640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72600cfee0 con 0x7f72600d0c80 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f7268190640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600d01c0 con 0x7f72600cc780 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726572b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72600d0c80 0x7f726006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726572b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72600d0c80 0x7f726006adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51066/0 (socket says 172.21.15.5:51066) 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726572b640 1 -- 172.21.15.5:0/3248000399 learned_addr learned my addr 172.21.15.5:0/3248000399 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726672d640 1 --2- 172.21.15.5:0/3248000399 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600cc780 0x7f72600ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726572b640 1 -- 172.21.15.5:0/3248000399 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600cc780 msgr2=0x7f72600ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726572b640 1 --2- 172.21.15.5:0/3248000399 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600cc780 0x7f72600ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726572b640 1 -- 172.21.15.5:0/3248000399 >> v1:172.21.15.80:6789/0 conn(0x7f726015e0b0 legacy=0x7f72600cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.232+0000 7f726572b640 1 -- 172.21.15.5:0/3248000399 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600d04a0 con 0x7f72600d0c80 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.233+0000 7f726572b640 1 --2- 172.21.15.5:0/3248000399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600d0c80 0x7f726006adf0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f72500098a0 tx=0x7f725002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa6ed9bd1db5b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.233+0000 7f7264f2a640 1 -- 172.21.15.5:0/3248000399 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250037070 con 0x7f72600d0c80 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.233+0000 7f7264f2a640 1 -- 172.21.15.5:0/3248000399 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250032440 con 0x7f72600d0c80 2024-04-25T09:02:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.233+0000 7f7264f2a640 1 -- 172.21.15.5:0/3248000399 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250032810 con 0x7f72600d0c80 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 -- 172.21.15.5:0/3248000399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600d0c80 msgr2=0x7f726006adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 --2- 172.21.15.5:0/3248000399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600d0c80 0x7f726006adf0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f72500098a0 tx=0x7f725002a250 comp rx=0 tx=0).stop 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 -- 172.21.15.5:0/3248000399 shutdown_connections 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 --2- 172.21.15.5:0/3248000399 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600cc780 0x7f72600ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 --2- 172.21.15.5:0/3248000399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600d0c80 0x7f726006adf0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 -- 172.21.15.5:0/3248000399 >> 172.21.15.5:0/3248000399 conn(0x7f72600d1a20 msgr2=0x7f72600d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 -- 172.21.15.5:0/3248000399 shutdown_connections 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.234+0000 7f7268190640 1 -- 172.21.15.5:0/3248000399 wait complete. 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.235+0000 7f7268190640 1 Processor -- start 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.235+0000 7f7268190640 1 -- start start 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7268190640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600cc780 0x7f726015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7268190640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600d0c80 0x7f72600b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7268190640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726015e0b0 0x7f72600b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7268190640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600cfb90 con 0x7f72600cc780 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7268190640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726015e490 con 0x7f726015e0b0 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7268190640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600ccc30 con 0x7f72600d0c80 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600cc780 0x7f726015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600cc780 0x7f726015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51070/0 (socket says 172.21.15.5:51070) 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 -- 172.21.15.5:0/853661196 learned_addr learned my addr 172.21.15.5:0/853661196 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f726672d640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726015e0b0 0x7f72600b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f726572b640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600d0c80 0x7f72600b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 -- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600d0c80 msgr2=0x7f72600b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600d0c80 0x7f72600b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 -- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726015e0b0 msgr2=0x7f72600b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726015e0b0 0x7f72600b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 -- 172.21.15.5:0/853661196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72601e7de0 con 0x7f72600cc780 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f726572b640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600d0c80 0x7f72600b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.236+0000 7f7265f2c640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600cc780 0x7f726015bdc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f725c00b3f0 tx=0x7f725c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.237+0000 7f72567fc640 1 -- 172.21.15.5:0/853661196 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c015020 con 0x7f72600cc780 2024-04-25T09:02:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.237+0000 7f72567fc640 1 -- 172.21.15.5:0/853661196 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c011830 con 0x7f72600cc780 2024-04-25T09:02:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.237+0000 7f72567fc640 1 -- 172.21.15.5:0/853661196 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c011c20 con 0x7f72600cc780 2024-04-25T09:02:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.237+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72601e8080 con 0x7f72600cc780 2024-04-25T09:02:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.237+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72601e8640 con 0x7f72600cc780 2024-04-25T09:02:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.238+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726006c1b0 con 0x7f72600cc780 2024-04-25T09:02:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.238+0000 7f72567fc640 1 -- 172.21.15.5:0/853661196 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f725c018020 con 0x7f72600cc780 2024-04-25T09:02:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.239+0000 7f72567fc640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f724406b4d0 0x7f724406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.239+0000 7f72567fc640 1 -- 172.21.15.5:0/853661196 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f725c089d10 con 0x7f72600cc780 2024-04-25T09:02:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.239+0000 7f726572b640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f724406b4d0 0x7f724406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.240+0000 7f726572b640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f724406b4d0 0x7f724406d990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f725002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.243+0000 7f72567fc640 1 -- 172.21.15.5:0/853661196 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f726006c1b0 con 0x7f72600cc780 2024-04-25T09:02:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:46.465+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f726004ef20 con 0x7f72600cc780 2024-04-25T09:02:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 12 and data pool 13 2024-04-25T09:02:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.104+0000 7f72567fc640 1 -- 172.21.15.5:0/853661196 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f725c01f030 con 0x7f72600cc780 2024-04-25T09:02:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.116+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f724406b4d0 msgr2=0x7f724406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.116+0000 7f7268190640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f724406b4d0 0x7f724406d990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f725002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.116+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600cc780 msgr2=0x7f726015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.116+0000 7f7268190640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600cc780 0x7f726015bdc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f725c00b3f0 tx=0x7f725c00b8b0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.116+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 shutdown_connections 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.116+0000 7f7268190640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f724406b4d0 0x7f724406d990 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.117+0000 7f7268190640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726015e0b0 0x7f72600b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.117+0000 7f7268190640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f72600d0c80 0x7f72600b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.117+0000 7f7268190640 1 --2- 172.21.15.5:0/853661196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600cc780 0x7f726015bdc0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.117+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 >> 172.21.15.5:0/853661196 conn(0x7f72600d1a20 msgr2=0x7f726006e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.119+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 shutdown_connections 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.124+0000 7f7268190640 1 -- 172.21.15.5:0/853661196 wait complete. 2024-04-25T09:02:47.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:47.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:47.225 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.247+0000 7fdea5589640 1 Processor -- start 2024-04-25T09:02:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.247+0000 7fdea5589640 1 -- start start 2024-04-25T09:02:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fdea5589640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdea00710f0 0x7fdea015e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fdea5589640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00cd1d0 0x7fdea00ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fdea5589640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea015edc0 con 0x7fdea00714d0 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fdea5589640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea015eb90 con 0x7fdea00710f0 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fdea5589640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea015f0a0 con 0x7fdea00cd1d0 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdea00710f0 0x7fdea015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdea00710f0 0x7fdea015e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51080/0 (socket says 172.21.15.5:51080) 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9effd640 1 -- 172.21.15.5:0/2209095580 learned_addr learned my addr 172.21.15.5:0/2209095580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9f7fe640 1 --2- 172.21.15.5:0/2209095580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00cd1d0 0x7fdea00ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9effd640 1 -- 172.21.15.5:0/2209095580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00cd1d0 msgr2=0x7fdea00ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9effd640 1 --2- 172.21.15.5:0/2209095580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00cd1d0 0x7fdea00ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9effd640 1 -- 172.21.15.5:0/2209095580 >> v1:172.21.15.80:6789/0 conn(0x7fdea00714d0 legacy=0x7fdea00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.248+0000 7fde9effd640 1 -- 172.21.15.5:0/2209095580 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea015f380 con 0x7fdea00710f0 2024-04-25T09:02:47.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.249+0000 7fde9effd640 1 --2- 172.21.15.5:0/2209095580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00710f0 0x7fdea015e650 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fde90009870 tx=0x7fde9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57f6e8fac6d7395 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.249+0000 7fde9e7fc640 1 -- 172.21.15.5:0/2209095580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90037070 con 0x7fdea00710f0 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.249+0000 7fde9e7fc640 1 -- 172.21.15.5:0/2209095580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90032440 con 0x7fdea00710f0 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.249+0000 7fde9e7fc640 1 -- 172.21.15.5:0/2209095580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90032810 con 0x7fdea00710f0 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 -- 172.21.15.5:0/2209095580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00710f0 msgr2=0x7fdea015e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 --2- 172.21.15.5:0/2209095580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00710f0 0x7fdea015e650 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fde90009870 tx=0x7fde9002a270 comp rx=0 tx=0).stop 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 -- 172.21.15.5:0/2209095580 shutdown_connections 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 --2- 172.21.15.5:0/2209095580 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00cd1d0 0x7fdea00ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 --2- 172.21.15.5:0/2209095580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00710f0 0x7fdea015e650 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 -- 172.21.15.5:0/2209095580 >> 172.21.15.5:0/2209095580 conn(0x7fdea00b1da0 msgr2=0x7fdea00b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 -- 172.21.15.5:0/2209095580 shutdown_connections 2024-04-25T09:02:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.250+0000 7fdea5589640 1 -- 172.21.15.5:0/2209095580 wait complete. 2024-04-25T09:02:47.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 Processor -- start 2024-04-25T09:02:47.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 -- start start 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdea00710f0 0x7fdea013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00cd1d0 0x7fdea00d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00d0630 0x7fdea00b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0143e20 con 0x7fdea00cd1d0 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0143ca0 con 0x7fdea00710f0 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.252+0000 7fdea5589640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0143fa0 con 0x7fdea00d0630 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00cd1d0 0x7fdea00d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde9effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdea00710f0 0x7fdea013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00cd1d0 0x7fdea00d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51092/0 (socket says 172.21.15.5:51092) 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 -- 172.21.15.5:0/2887345678 learned_addr learned my addr 172.21.15.5:0/2887345678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde9f7fe640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00d0630 0x7fdea00b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 -- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00d0630 msgr2=0x7fdea00b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00d0630 0x7fdea00b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 -- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdea00710f0 msgr2=0x7fdea013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdea00710f0 0x7fdea013fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 -- 172.21.15.5:0/2887345678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00b3ef0 con 0x7fdea00cd1d0 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde97fff640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00cd1d0 0x7fdea00d00f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c400 tx=0x7fde8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde977fe640 1 -- 172.21.15.5:0/2887345678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880052d0 con 0x7fdea00cd1d0 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde977fe640 1 -- 172.21.15.5:0/2887345678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88005490 con 0x7fdea00cd1d0 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fde977fe640 1 -- 172.21.15.5:0/2887345678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88007260 con 0x7fdea00cd1d0 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea014edd0 con 0x7fdea00cd1d0 2024-04-25T09:02:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.253+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea014c2e0 con 0x7fdea00cd1d0 2024-04-25T09:02:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.254+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea00d0a40 con 0x7fdea00cd1d0 2024-04-25T09:02:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.255+0000 7fde977fe640 1 -- 172.21.15.5:0/2887345678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde88007400 con 0x7fdea00cd1d0 2024-04-25T09:02:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.255+0000 7fde977fe640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fde8006b4d0 0x7fde8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.255+0000 7fde977fe640 1 -- 172.21.15.5:0/2887345678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde880896b0 con 0x7fdea00cd1d0 2024-04-25T09:02:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.255+0000 7fde9effd640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fde8006b4d0 0x7fde8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.256+0000 7fde9effd640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fde8006b4d0 0x7fde8006d990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde90034000 tx=0x7fde9002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.260+0000 7fde977fe640 1 -- 172.21.15.5:0/2887345678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdea00d0a40 con 0x7fdea00cd1d0 2024-04-25T09:02:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.447+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdea0143a60 con 0x7fdea00cd1d0 2024-04-25T09:02:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.448+0000 7fde977fe640 1 -- 172.21.15.5:0/2887345678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fde88057ee0 con 0x7fdea00cd1d0 2024-04-25T09:02:47.436 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:47.436 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:46.467412+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:44.744734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:45.440447+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fde8006b4d0 msgr2=0x7fde8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fde8006b4d0 0x7fde8006d990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde90034000 tx=0x7fde9002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00cd1d0 msgr2=0x7fdea00d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00cd1d0 0x7fdea00d00f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c400 tx=0x7fde8800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 shutdown_connections 2024-04-25T09:02:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fde8006b4d0 0x7fde8006d990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdea00d0630 0x7fdea00b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdea00cd1d0 0x7fdea00d00f0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 --2- 172.21.15.5:0/2887345678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdea00710f0 0x7fdea013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 >> 172.21.15.5:0/2887345678 conn(0x7fdea00b1da0 msgr2=0x7fdea00b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 shutdown_connections 2024-04-25T09:02:47.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.450+0000 7fdea5589640 1 -- 172.21.15.5:0/2887345678 wait complete. 2024-04-25T09:02:47.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:47.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.562+0000 7fc0e23d5640 1 Processor -- start 2024-04-25T09:02:47.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.562+0000 7fc0e23d5640 1 -- start start 2024-04-25T09:02:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.563+0000 7fc0e23d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0dc15e0a0 0x7fc0dc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.563+0000 7fc0e23d5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc0b7f60 con 0x7fc0dc0d3df0 2024-04-25T09:02:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.563+0000 7fc0e23d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc0cf400 con 0x7fc0dc0d3990 2024-04-25T09:02:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.563+0000 7fc0e23d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc0b29c0 con 0x7fc0dc15e0a0 2024-04-25T09:02:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.563+0000 7fc0e0972640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0dc0d3df0 0x7fc0dc0cecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53426/0 (socket says 172.21.15.5:53426) 2024-04-25T09:02:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.563+0000 7fc0e0972640 1 -- 172.21.15.5:0/3779881180 learned_addr learned my addr 172.21.15.5:0/3779881180 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.564+0000 7fc0dbfff640 1 --2- 172.21.15.5:0/3779881180 >> v2:172.21.15.80:3300/0 conn(0x7fc0dc15e0a0 0x7fc0dc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.564+0000 7fc0daffd640 1 -- 172.21.15.5:0/3779881180 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046717630 0 0) 0x7fc0dc0b7f60 con 0x7fc0dc0d3df0 2024-04-25T09:02:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.564+0000 7fc0daffd640 1 -- 172.21.15.5:0/3779881180 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c4003520 con 0x7fc0dc0d3df0 2024-04-25T09:02:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.564+0000 7fc0daffd640 1 -- 172.21.15.5:0/3779881180 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394000599 0 0) 0x7fc0c4003520 con 0x7fc0dc0d3df0 2024-04-25T09:02:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.564+0000 7fc0dbfff640 1 -- 172.21.15.5:0/3779881180 >> v1:172.21.15.80:6789/0 conn(0x7fc0dc0d3990 legacy=0x7fc0dc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.564+0000 7fc0dbfff640 1 -- 172.21.15.5:0/3779881180 >> v1:172.21.15.5:6789/0 conn(0x7fc0dc0d3df0 legacy=0x7fc0dc0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.564+0000 7fc0dbfff640 1 -- 172.21.15.5:0/3779881180 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0d2080 con 0x7fc0dc15e0a0 2024-04-25T09:02:47.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.565+0000 7fc0dbfff640 1 --2- 172.21.15.5:0/3779881180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc0d0d50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097a0 tx=0x7fc0cc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa5a308b64f7b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.565+0000 7fc0daffd640 1 -- 172.21.15.5:0/3779881180 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc037070 con 0x7fc0dc15e0a0 2024-04-25T09:02:47.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.565+0000 7fc0daffd640 1 -- 172.21.15.5:0/3779881180 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc02ac50 con 0x7fc0dc15e0a0 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.565+0000 7fc0daffd640 1 -- 172.21.15.5:0/3779881180 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40019f0 con 0x7fc0dc15e0a0 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.565+0000 7fc0e23d5640 1 -- 172.21.15.5:0/3779881180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 msgr2=0x7fc0dc0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.565+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/3779881180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc0d0d50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097a0 tx=0x7fc0cc02a1c0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.566+0000 7fc0e23d5640 1 -- 172.21.15.5:0/3779881180 shutdown_connections 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.566+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/3779881180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc0d0d50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.566+0000 7fc0e23d5640 1 -- 172.21.15.5:0/3779881180 >> 172.21.15.5:0/3779881180 conn(0x7fc0dc0668f0 msgr2=0x7fc0dc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.566+0000 7fc0e23d5640 1 -- 172.21.15.5:0/3779881180 shutdown_connections 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.566+0000 7fc0e23d5640 1 -- 172.21.15.5:0/3779881180 wait complete. 2024-04-25T09:02:47.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.567+0000 7fc0e23d5640 1 Processor -- start 2024-04-25T09:02:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.567+0000 7fc0e23d5640 1 -- start start 2024-04-25T09:02:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e23d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0dc0d3990 0x7fc0dc14a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e23d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc0dc0d3df0 0x7fc0dc160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e23d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e23d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0d2920 con 0x7fc0dc0d3990 2024-04-25T09:02:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e23d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0d2640 con 0x7fc0dc15e0a0 2024-04-25T09:02:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e23d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0d2c00 con 0x7fc0dc0d3df0 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0dc0d3990 0x7fc0dc14a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0dc0d3990 0x7fc0dc14a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51102/0 (socket says 172.21.15.5:51102) 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 -- 172.21.15.5:0/1205133135 learned_addr learned my addr 172.21.15.5:0/1205133135 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 -- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc0dc0d3df0 msgr2=0x7fc0dc160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc0dc0d3df0 0x7fc0dc160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 -- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 msgr2=0x7fc0dc148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e0972640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 -- 172.21.15.5:0/1205133135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc1496c0 con 0x7fc0dc0d3990 2024-04-25T09:02:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0e0972640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0dbfff640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0dc0d3990 0x7fc0dc14a760 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc035040 tx=0x7fc0cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.568+0000 7fc0d8ff9640 1 -- 172.21.15.5:0/1205133135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc041020 con 0x7fc0dc0d3990 2024-04-25T09:02:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.569+0000 7fc0d8ff9640 1 -- 172.21.15.5:0/1205133135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc03d420 con 0x7fc0dc0d3990 2024-04-25T09:02:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.569+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc1499a0 con 0x7fc0dc0d3990 2024-04-25T09:02:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.569+0000 7fc0d8ff9640 1 -- 172.21.15.5:0/1205133135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc037040 con 0x7fc0dc0d3990 2024-04-25T09:02:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.569+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc149f60 con 0x7fc0dc0d3990 2024-04-25T09:02:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.570+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc04ef20 con 0x7fc0dc0d3990 2024-04-25T09:02:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.570+0000 7fc0d8ff9640 1 -- 172.21.15.5:0/1205133135 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc0cc044020 con 0x7fc0dc0d3990 2024-04-25T09:02:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.571+0000 7fc0d8ff9640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc0c806b4d0 0x7fc0c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.571+0000 7fc0d8ff9640 1 -- 172.21.15.5:0/1205133135 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0cc0aa640 con 0x7fc0dc0d3990 2024-04-25T09:02:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.571+0000 7fc0db7fe640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc0c806b4d0 0x7fc0c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.571+0000 7fc0db7fe640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc0c806b4d0 0x7fc0c806d990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0000f60 tx=0x7fc0d00079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.575+0000 7fc0d8ff9640 1 -- 172.21.15.5:0/1205133135 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc0cc04b030 con 0x7fc0dc0d3990 2024-04-25T09:02:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.755+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0dc0b5810 con 0x7fc0dc0d3990 2024-04-25T09:02:47.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.756+0000 7fc0d8ff9640 1 -- 172.21.15.5:0/1205133135 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fc0cc078e70 con 0x7fc0dc0d3990 2024-04-25T09:02:47.745 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:47.745 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:46.467412+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:44.744734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:45.440447+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc0c806b4d0 msgr2=0x7fc0c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc0c806b4d0 0x7fc0c806d990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0000f60 tx=0x7fc0d00079b0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0dc0d3990 msgr2=0x7fc0dc14a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0dc0d3990 0x7fc0dc14a760 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc035040 tx=0x7fc0cc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 shutdown_connections 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc0c806b4d0 0x7fc0c806d990 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0dc15e0a0 0x7fc0dc148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc0dc0d3df0 0x7fc0dc160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 --2- 172.21.15.5:0/1205133135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0dc0d3990 0x7fc0dc14a760 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.758+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 >> 172.21.15.5:0/1205133135 conn(0x7fc0dc0668f0 msgr2=0x7fc0dc0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.759+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 shutdown_connections 2024-04-25T09:02:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.759+0000 7fc0e23d5640 1 -- 172.21.15.5:0/1205133135 wait complete. 2024-04-25T09:02:47.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:02:47.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.874+0000 7fd9d653b640 1 Processor -- start 2024-04-25T09:02:47.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.874+0000 7fd9d653b640 1 -- start start 2024-04-25T09:02:47.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9d653b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9d00b24b0 0x7fd9d00b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9d653b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9d00cff00 0x7fd9d00d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9d653b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00cdef0 con 0x7fd9d015c0f0 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9d653b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d00cd350 con 0x7fd9d00b24b0 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9d653b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d00d0870 con 0x7fd9d00cff00 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9d00b24b0 0x7fd9d00b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9d015c0f0 0x7fd9d00cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53434/0 (socket says 172.21.15.5:53434) 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9d00b24b0 0x7fd9d00b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51116/0 (socket says 172.21.15.5:51116) 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cffff640 1 -- 172.21.15.5:0/1323623112 learned_addr learned my addr 172.21.15.5:0/1323623112 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9d4ad8640 1 --2- 172.21.15.5:0/1323623112 >> v2:172.21.15.80:3300/0 conn(0x7fd9d00cff00 0x7fd9d00d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cf7fe640 1 -- 172.21.15.5:0/1323623112 >> v2:172.21.15.80:3300/0 conn(0x7fd9d00cff00 msgr2=0x7fd9d00d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cf7fe640 1 --2- 172.21.15.5:0/1323623112 >> v2:172.21.15.80:3300/0 conn(0x7fd9d00cff00 0x7fd9d00d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cf7fe640 1 -- 172.21.15.5:0/1323623112 >> v1:172.21.15.5:6789/0 conn(0x7fd9d015c0f0 legacy=0x7fd9d00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9cf7fe640 1 -- 172.21.15.5:0/1323623112 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00cf7a0 con 0x7fd9d00b24b0 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9ceffd640 1 -- 172.21.15.5:0/1323623112 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187339141 0 0) 0x7fd9d00cdef0 con 0x7fd9d015c0f0 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.875+0000 7fd9d4ad8640 1 --2- 172.21.15.5:0/1323623112 >> v2:172.21.15.80:3300/0 conn(0x7fd9d00cff00 0x7fd9d00d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.876+0000 7fd9cf7fe640 1 --2- 172.21.15.5:0/1323623112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00b24b0 0x7fd9d00b2960 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00cd4d0 tx=0x7fd9c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c0cca2f273eead server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.876+0000 7fd9ceffd640 1 -- 172.21.15.5:0/1323623112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0037070 con 0x7fd9d00b24b0 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.876+0000 7fd9ceffd640 1 -- 172.21.15.5:0/1323623112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c0032440 con 0x7fd9d00b24b0 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.876+0000 7fd9ceffd640 1 -- 172.21.15.5:0/1323623112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0032810 con 0x7fd9d00b24b0 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 -- 172.21.15.5:0/1323623112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00b24b0 msgr2=0x7fd9d00b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 --2- 172.21.15.5:0/1323623112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00b24b0 0x7fd9d00b2960 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00cd4d0 tx=0x7fd9c002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 -- 172.21.15.5:0/1323623112 shutdown_connections 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 --2- 172.21.15.5:0/1323623112 >> v2:172.21.15.80:3300/0 conn(0x7fd9d00cff00 0x7fd9d00d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 --2- 172.21.15.5:0/1323623112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00b24b0 0x7fd9d00b2960 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 -- 172.21.15.5:0/1323623112 >> 172.21.15.5:0/1323623112 conn(0x7fd9d00d1920 msgr2=0x7fd9d00d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 -- 172.21.15.5:0/1323623112 shutdown_connections 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.877+0000 7fd9d653b640 1 -- 172.21.15.5:0/1323623112 wait complete. 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.878+0000 7fd9d653b640 1 Processor -- start 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.878+0000 7fd9d653b640 1 -- start start 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9d653b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9d00b24b0 0x7fd9d015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9d653b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00cff00 0x7fd9d00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9d653b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d015c0f0 0x7fd9d01f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9d653b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b3170 con 0x7fd9d00cff00 2024-04-25T09:02:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9d653b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00d27c0 con 0x7fd9d015c0f0 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9d653b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00cfa40 con 0x7fd9d00b24b0 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00cff00 0x7fd9d00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00cff00 0x7fd9d00ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51118/0 (socket says 172.21.15.5:51118) 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 -- 172.21.15.5:0/3117071080 learned_addr learned my addr 172.21.15.5:0/3117071080 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9d4ad8640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d015c0f0 0x7fd9d01f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cffff640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9d00b24b0 0x7fd9d015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 -- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9d00b24b0 msgr2=0x7fd9d015f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9d00b24b0 0x7fd9d015f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 -- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d015c0f0 msgr2=0x7fd9d01f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d015c0f0 0x7fd9d01f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.879+0000 7fd9cf7fe640 1 -- 172.21.15.5:0/3117071080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00caba0 con 0x7fd9d00cff00 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.880+0000 7fd9cf7fe640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00cff00 0x7fd9d00ca450 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0000c00 tx=0x7fd9c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.880+0000 7fd9ccff9640 1 -- 172.21.15.5:0/3117071080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0037040 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.880+0000 7fd9ccff9640 1 -- 172.21.15.5:0/3117071080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c0042070 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.880+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d00cae80 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.880+0000 7fd9ccff9640 1 -- 172.21.15.5:0/3117071080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0030a50 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.880+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d006af90 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.881+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d00cb3a0 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.881+0000 7fd9ccff9640 1 -- 172.21.15.5:0/3117071080 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9c0030bf0 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.882+0000 7fd9ccff9640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b006b4d0 0x7fd9b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.882+0000 7fd9ccff9640 1 -- 172.21.15.5:0/3117071080 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9c00ab7d0 con 0x7fd9d00cff00 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.882+0000 7fd9cffff640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b006b4d0 0x7fd9b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.883+0000 7fd9cffff640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b006b4d0 0x7fd9b006d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8000f60 tx=0x7fd9b8007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:47.886+0000 7fd9ccff9640 1 -- 172.21.15.5:0/3117071080 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9d00cb3a0 con 0x7fd9d00cff00 2024-04-25T09:02:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:48.104+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9d004ef20 con 0x7fd9d00cff00 2024-04-25T09:02:49.074 INFO:tasks.ceph.mds.d.smithi080.stderr:2024-04-25T09:02:49.086+0000 7f25662e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:02:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.114+0000 7fd9ccff9640 1 -- 172.21.15.5:0/3117071080 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9c0079b90 con 0x7fd9d00cff00 2024-04-25T09:02:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b006b4d0 msgr2=0x7fd9b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b006b4d0 0x7fd9b006d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8000f60 tx=0x7fd9b8007c00 comp rx=0 tx=0).stop 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00cff00 msgr2=0x7fd9d00ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00cff00 0x7fd9d00ca450 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0000c00 tx=0x7fd9c00046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 shutdown_connections 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9b006b4d0 0x7fd9b006d990 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d015c0f0 0x7fd9d01f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d00cff00 0x7fd9d00ca450 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 --2- 172.21.15.5:0/3117071080 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9d00b24b0 0x7fd9d015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 >> 172.21.15.5:0/3117071080 conn(0x7fd9d00d1920 msgr2=0x7fd9d00c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.117+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 shutdown_connections 2024-04-25T09:02:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.118+0000 7fd9d653b640 1 -- 172.21.15.5:0/3117071080 wait complete. 2024-04-25T09:02:49.119 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:02:49.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:02:49.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.241+0000 7fadb946f640 1 Processor -- start 2024-04-25T09:02:49.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.241+0000 7fadb946f640 1 -- start start 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb946f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadb415c0f0 0x7fadb40cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb946f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadb40b24b0 0x7fadb40b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb946f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb40cf7a0 con 0x7fadb40cff00 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb946f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb40cd350 con 0x7fadb415c0f0 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb946f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb40d24e0 con 0x7fadb40b24b0 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadb415c0f0 0x7fadb40cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fadb40cff00 0x7fadb40c5470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53450/0 (socket says 172.21.15.5:53450) 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb37fe640 1 -- 172.21.15.5:0/1478508806 learned_addr learned my addr 172.21.15.5:0/1478508806 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.242+0000 7fadb27fc640 1 --2- 172.21.15.5:0/1478508806 >> v2:172.21.15.80:3300/0 conn(0x7fadb40b24b0 0x7fadb40b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.243+0000 7fadb2ffd640 1 -- 172.21.15.5:0/1478508806 >> v2:172.21.15.80:3300/0 conn(0x7fadb40b24b0 msgr2=0x7fadb40b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.243+0000 7fadb2ffd640 1 --2- 172.21.15.5:0/1478508806 >> v2:172.21.15.80:3300/0 conn(0x7fadb40b24b0 0x7fadb40b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.243+0000 7fadb2ffd640 1 -- 172.21.15.5:0/1478508806 >> v1:172.21.15.5:6789/0 conn(0x7fadb40cff00 legacy=0x7fadb40c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.243+0000 7fadb1ffb640 1 -- 172.21.15.5:0/1478508806 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055024342 0 0) 0x7fadb40cf7a0 con 0x7fadb40cff00 2024-04-25T09:02:49.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.243+0000 7fadb2ffd640 1 -- 172.21.15.5:0/1478508806 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb40d27c0 con 0x7fadb415c0f0 2024-04-25T09:02:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.243+0000 7fadb2ffd640 1 --2- 172.21.15.5:0/1478508806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb415c0f0 0x7fadb40cd7e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fadb40cf970 tx=0x7fadac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93da6b1601f19990 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb1ffb640 1 -- 172.21.15.5:0/1478508806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac037070 con 0x7fadb415c0f0 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb1ffb640 1 -- 172.21.15.5:0/1478508806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac032440 con 0x7fadb415c0f0 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb1ffb640 1 -- 172.21.15.5:0/1478508806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac032810 con 0x7fadb415c0f0 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 -- 172.21.15.5:0/1478508806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb415c0f0 msgr2=0x7fadb40cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 --2- 172.21.15.5:0/1478508806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb415c0f0 0x7fadb40cd7e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fadb40cf970 tx=0x7fadac02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 -- 172.21.15.5:0/1478508806 shutdown_connections 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 --2- 172.21.15.5:0/1478508806 >> v2:172.21.15.80:3300/0 conn(0x7fadb40b24b0 0x7fadb40b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 --2- 172.21.15.5:0/1478508806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb415c0f0 0x7fadb40cd7e0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 -- 172.21.15.5:0/1478508806 >> 172.21.15.5:0/1478508806 conn(0x7fadb40d1920 msgr2=0x7fadb40d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 -- 172.21.15.5:0/1478508806 shutdown_connections 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.244+0000 7fadb946f640 1 -- 172.21.15.5:0/1478508806 wait complete. 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 Processor -- start 2024-04-25T09:02:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 -- start start 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb40b24b0 0x7fadb40b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb40cff00 0x7fadb40aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadb415c0f0 0x7fadb40cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40cdd20 con 0x7fadb40cff00 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40cfa40 con 0x7fadb40b24b0 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.246+0000 7fadb946f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40cdea0 con 0x7fadb415c0f0 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb40cff00 0x7fadb40aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb40cff00 0x7fadb40aff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51136/0 (socket says 172.21.15.5:51136) 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 -- 172.21.15.5:0/841263937 learned_addr learned my addr 172.21.15.5:0/841263937 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb2ffd640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb40b24b0 0x7fadb40b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb37fe640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadb415c0f0 0x7fadb40cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 -- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadb415c0f0 msgr2=0x7fadb40cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadb415c0f0 0x7fadb40cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 -- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb40b24b0 msgr2=0x7fadb40b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb40b24b0 0x7fadb40b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 -- 172.21.15.5:0/841263937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb40b1440 con 0x7fadb40cff00 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb2ffd640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb40b24b0 0x7fadb40b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb27fc640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb40cff00 0x7fadb40aff20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00e9b0 tx=0x7fad9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadab7fe640 1 -- 172.21.15.5:0/841263937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c017070 con 0x7fadb40cff00 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadab7fe640 1 -- 172.21.15.5:0/841263937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c00c9a0 con 0x7fadb40cff00 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadab7fe640 1 -- 172.21.15.5:0/841263937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00cd90 con 0x7fadb40cff00 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb40c9a40 con 0x7fadb40cff00 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.247+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb40ca000 con 0x7fadb40cff00 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.248+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb404ef20 con 0x7fadb40cff00 2024-04-25T09:02:49.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.249+0000 7fadab7fe640 1 -- 172.21.15.5:0/841263937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad9c01a070 con 0x7fadb40cff00 2024-04-25T09:02:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.249+0000 7fadab7fe640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad9406b4d0 0x7fad9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.249+0000 7fadab7fe640 1 -- 172.21.15.5:0/841263937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad9c08a550 con 0x7fadb40cff00 2024-04-25T09:02:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.249+0000 7fadb2ffd640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad9406b4d0 0x7fad9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.250+0000 7fadb2ffd640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad9406b4d0 0x7fad9406d990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fadac034000 tx=0x7fadac02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.254+0000 7fadab7fe640 1 -- 172.21.15.5:0/841263937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad9c059460 con 0x7fadb40cff00 2024-04-25T09:02:49.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:49.472+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fadb40cfce0 con 0x7fadb40cff00 2024-04-25T09:02:50.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.116+0000 7fadab7fe640 1 -- 172.21.15.5:0/841263937 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7fad9c058d60 con 0x7fadb40cff00 2024-04-25T09:02:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad9406b4d0 msgr2=0x7fad9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad9406b4d0 0x7fad9406d990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fadac034000 tx=0x7fadac02e000 comp rx=0 tx=0).stop 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb40cff00 msgr2=0x7fadb40aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb40cff00 0x7fadb40aff20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00e9b0 tx=0x7fad9c00ee70 comp rx=0 tx=0).stop 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 shutdown_connections 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad9406b4d0 0x7fad9406d990 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadb415c0f0 0x7fadb40cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb40cff00 0x7fadb40aff20 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 --2- 172.21.15.5:0/841263937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb40b24b0 0x7fadb40b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.118+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 >> 172.21.15.5:0/841263937 conn(0x7fadb40d1920 msgr2=0x7fadb415a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.119+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 shutdown_connections 2024-04-25T09:02:50.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.119+0000 7fadb946f640 1 -- 172.21.15.5:0/841263937 wait complete. 2024-04-25T09:02:50.120 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:02:50.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.239+0000 7f71186e1640 1 Processor -- start 2024-04-25T09:02:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.239+0000 7f71186e1640 1 -- start start 2024-04-25T09:02:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.240+0000 7f71186e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 0x7f71100d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.240+0000 7f71186e1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71100d3df0 0x7f71100cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.240+0000 7f71186e1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71100b7f60 con 0x7f71100d3990 2024-04-25T09:02:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.240+0000 7f71186e1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71100b29c0 con 0x7f71100d3df0 2024-04-25T09:02:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.240+0000 7f71186e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71100d2080 con 0x7f711015e0a0 2024-04-25T09:02:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f7115c7c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f71100d3990 0x7f71100ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53456/0 (socket says 172.21.15.5:53456) 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f7115c7c640 1 -- 172.21.15.5:0/2795603492 learned_addr learned my addr 172.21.15.5:0/2795603492 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f7116c7e640 1 --2- 172.21.15.5:0/2795603492 >> v2:172.21.15.80:3300/0 conn(0x7f71100d3df0 0x7f71100cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711647d640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 0x7f71100d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129972467 0 0) 0x7f71100b7f60 con 0x7f71100d3990 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70fc003520 con 0x7f71100d3990 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371206662 0 0) 0x7f70fc003520 con 0x7f71100d3990 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 msgr2=0x7f71100d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 0x7f71100d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 >> v2:172.21.15.80:3300/0 conn(0x7f71100d3df0 msgr2=0x7f71100cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 --2- 172.21.15.5:0/2795603492 >> v2:172.21.15.80:3300/0 conn(0x7f71100d3df0 0x7f71100cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100d2360 con 0x7f71100d3990 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f7100001670 con 0x7f71100d3990 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 >> v1:172.21.15.5:6789/0 conn(0x7f71100d3990 legacy=0x7f71100ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc0039b0 0x7f70fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc004800 0x7f70fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 0x7f70fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100b29c0 con 0x7f70fc004800 2024-04-25T09:02:50.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100d2080 con 0x7f70fc0039b0 2024-04-25T09:02:50.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc00b9c0 con 0x7f711015e0a0 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.241+0000 7f7115c7c640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc004800 0x7f70fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f711647d640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc0039b0 0x7f70fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f7116c7e640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 0x7f70fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f7115c7c640 1 -- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 msgr2=0x7f70fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f7115c7c640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f711015e0a0 0x7f70fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f7115c7c640 1 -- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc0039b0 msgr2=0x7f70fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f7115c7c640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc0039b0 0x7f70fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f7115c7c640 1 -- 172.21.15.5:0/2795603492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc003520 con 0x7f70fc004800 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.242+0000 7f7115c7c640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc004800 0x7f70fc004c80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7100001050 tx=0x7f70fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ddc8a263c88733 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710002e070 con 0x7f70fc004800 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100005af0 con 0x7f70fc004800 2024-04-25T09:02:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f711547b640 1 -- 172.21.15.5:0/2795603492 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100007d70 con 0x7f70fc004800 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f71186e1640 1 -- 172.21.15.5:0/2795603492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc004800 msgr2=0x7f70fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f71186e1640 1 --2- 172.21.15.5:0/2795603492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc004800 0x7f70fc004c80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7100001050 tx=0x7f70fc005830 comp rx=0 tx=0).stop 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f7116c7e640 1 -- 172.21.15.5:0/2795603492 reap_dead start 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f71186e1640 1 -- 172.21.15.5:0/2795603492 shutdown_connections 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f71186e1640 1 -- 172.21.15.5:0/2795603492 >> 172.21.15.5:0/2795603492 conn(0x7f71100668f0 msgr2=0x7f7110066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f71186e1640 1 -- 172.21.15.5:0/2795603492 shutdown_connections 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.243+0000 7f71186e1640 1 -- 172.21.15.5:0/2795603492 wait complete. 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.244+0000 7f71186e1640 1 Processor -- start 2024-04-25T09:02:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.244+0000 7f71186e1640 1 -- start start 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f71186e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70fc004800 0x7f71100cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f71186e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71101f7670 0x7f71101f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f71186e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7110156c00 0x7f7110157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f71186e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100d2c00 con 0x7f7110156c00 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f71186e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100d2920 con 0x7f71101f7670 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f71186e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71100d4280 con 0x7f70fc004800 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f7116c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7110156c00 0x7f7110157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f7116c7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7110156c00 0x7f7110157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51158/0 (socket says 172.21.15.5:51158) 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f7116c7e640 1 -- 172.21.15.5:0/2127214520 learned_addr learned my addr 172.21.15.5:0/2127214520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f711647d640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70fc004800 0x7f71100cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.245+0000 7f7115c7c640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71101f7670 0x7f71101f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7116c7e640 1 -- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70fc004800 msgr2=0x7f71100cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7116c7e640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70fc004800 0x7f71100cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7116c7e640 1 -- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71101f7670 msgr2=0x7f71101f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7116c7e640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71101f7670 0x7f71101f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7116c7e640 1 -- 172.21.15.5:0/2127214520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110157880 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7116c7e640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7110156c00 0x7f7110157080 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f71100b6680 tx=0x7f710800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7106ffd640 1 -- 172.21.15.5:0/2127214520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108015430 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7106ffd640 1 -- 172.21.15.5:0/2127214520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71080155f0 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7110157b20 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f7106ffd640 1 -- 172.21.15.5:0/2127214520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71080159e0 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.246+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71101580e0 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.247+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711004ef20 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.247+0000 7f7106ffd640 1 -- 172.21.15.5:0/2127214520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7108015b80 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.248+0000 7f7106ffd640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f70f406b500 0x7f70f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.248+0000 7f7106ffd640 1 -- 172.21.15.5:0/2127214520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f710808b060 con 0x7f7110156c00 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.248+0000 7f711647d640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f70f406b500 0x7f70f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.248+0000 7f711647d640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f70f406b500 0x7f70f406d9c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f710c0099c0 tx=0x7f710c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.252+0000 7f7106ffd640 1 -- 172.21.15.5:0/2127214520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7108019030 con 0x7f7110156c00 2024-04-25T09:02:50.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.468+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7110161320 con 0x7f7110156c00 2024-04-25T09:02:50.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.469+0000 7f7106ffd640 1 -- 172.21.15.5:0/2127214520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f7108010040 con 0x7f7110156c00 2024-04-25T09:02:50.458 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:50.458 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:46.467722+0000","modified":"2024-04-25T09:02:49.472605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7497":{"gid":7497,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1143707602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1143707602},{"type":"v1","addr":"172.21.15.80:6837","nonce":1143707602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:02:50.459 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-04-25T09:02:50.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f70f406b500 msgr2=0x7f70f406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f70f406b500 0x7f70f406d9c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f710c0099c0 tx=0x7f710c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7110156c00 msgr2=0x7f7110157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7110156c00 0x7f7110157080 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f71100b6680 tx=0x7f710800f580 comp rx=0 tx=0).stop 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 shutdown_connections 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f70f406b500 0x7f70f406d9c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7110156c00 0x7f7110157080 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71101f7670 0x7f71101f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 --2- 172.21.15.5:0/2127214520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f70fc004800 0x7f71100cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 >> 172.21.15.5:0/2127214520 conn(0x7f71100668f0 msgr2=0x7f711015e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 shutdown_connections 2024-04-25T09:02:50.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.471+0000 7f71186e1640 1 -- 172.21.15.5:0/2127214520 wait complete. 2024-04-25T09:02:50.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.583+0000 7f8c24d9d640 1 Processor -- start 2024-04-25T09:02:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.583+0000 7f8c24d9d640 1 -- start start 2024-04-25T09:02:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c24d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c2006adf0 0x7f8c2006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c24d9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c2006bb30 0x7f8c200d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c24d9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2006bf40 con 0x7f8c200cea80 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c24d9d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200cfd60 con 0x7f8c2006adf0 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c24d9d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2015f480 con 0x7f8c2006bb30 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c1e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c200cea80 0x7f8c2015f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53472/0 (socket says 172.21.15.5:53472) 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c1e59c640 1 -- 172.21.15.5:0/2226057526 learned_addr learned my addr 172.21.15.5:0/2226057526 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c17fff640 1 --2- 172.21.15.5:0/2226057526 >> v2:172.21.15.80:3300/0 conn(0x7f8c2006adf0 0x7f8c2006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040702008 0 0) 0x7f8c10001110 con 0x7f8c200cea80 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c0c003520 con 0x7f8c200cea80 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.584+0000 7f8c1ed9d640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c2006bb30 0x7f8c200d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916606347 0 0) 0x7f8c0c003520 con 0x7f8c200cea80 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c2006bb30 msgr2=0x7f8c200d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c2006bb30 0x7f8c200d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 >> v2:172.21.15.80:3300/0 conn(0x7f8c2006adf0 msgr2=0x7f8c2006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 --2- 172.21.15.5:0/2226057526 >> v2:172.21.15.80:3300/0 conn(0x7f8c2006adf0 0x7f8c2006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2015ef10 con 0x7f8c200cea80 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f8c10001840 con 0x7f8c200cea80 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 >> v1:172.21.15.5:6789/0 conn(0x7f8c200cea80 legacy=0x7f8c2015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c0c0039b0 0x7f8c0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c0c004800 0x7f8c0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2015f480 con 0x7f8c0c0051c0 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c00bf00 con 0x7f8c0c0039b0 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c00c0b0 con 0x7f8c0c004800 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1ed9d640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c2006bb30 0x7f8c200d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1e59c640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c0c0039b0 0x7f8c0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1ed9d640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c17fff640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c0c004800 0x7f8c0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1ed9d640 1 -- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c0c004800 msgr2=0x7f8c0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1ed9d640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c0c004800 0x7f8c0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1ed9d640 1 -- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c0c0039b0 msgr2=0x7f8c0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1ed9d640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c0c0039b0 0x7f8c0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.585+0000 7f8c1ed9d640 1 -- 172.21.15.5:0/2226057526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c003520 con 0x7f8c0c0051c0 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.586+0000 7f8c1ed9d640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8c2006bf10 tx=0x7f8c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e3f2d57b29c405 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.586+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18030050 con 0x7f8c0c0051c0 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.586+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c18003b90 con 0x7f8c0c0051c0 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.586+0000 7f8c1dd9b640 1 -- 172.21.15.5:0/2226057526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18009b50 con 0x7f8c0c0051c0 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.587+0000 7f8c24d9d640 1 -- 172.21.15.5:0/2226057526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 msgr2=0x7f8c0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.587+0000 7f8c24d9d640 1 --2- 172.21.15.5:0/2226057526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8c2006bf10 tx=0x7f8c0c005830 comp rx=0 tx=0).stop 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.587+0000 7f8c1ed9d640 1 -- 172.21.15.5:0/2226057526 reap_dead start 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.587+0000 7f8c24d9d640 1 -- 172.21.15.5:0/2226057526 shutdown_connections 2024-04-25T09:02:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.587+0000 7f8c24d9d640 1 -- 172.21.15.5:0/2226057526 >> 172.21.15.5:0/2226057526 conn(0x7f8c200d19f0 msgr2=0x7f8c200d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.587+0000 7f8c24d9d640 1 -- 172.21.15.5:0/2226057526 shutdown_connections 2024-04-25T09:02:50.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.587+0000 7f8c24d9d640 1 -- 172.21.15.5:0/2226057526 wait complete. 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.588+0000 7f8c24d9d640 1 Processor -- start 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.588+0000 7f8c24d9d640 1 -- start start 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c24d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c2014acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c24d9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c201f45e0 0x7f8c200b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c24d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c200b6cb0 0x7f8c2015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c24d9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200cff90 con 0x7f8c0c0051c0 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c24d9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2015f1a0 con 0x7f8c200b6cb0 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c24d9d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200d0270 con 0x7f8c201f45e0 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c2014acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c2014acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51178/0 (socket says 172.21.15.5:51178) 2024-04-25T09:02:50.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 -- 172.21.15.5:0/1340623839 learned_addr learned my addr 172.21.15.5:0/1340623839 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1ed9d640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c200b6cb0 0x7f8c2015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c17fff640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c201f45e0 0x7f8c200b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 -- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c201f45e0 msgr2=0x7f8c200b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c201f45e0 0x7f8c200b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 -- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c200b6cb0 msgr2=0x7f8c2015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c200b6cb0 0x7f8c2015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 -- 172.21.15.5:0/1340623839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20157ed0 con 0x7f8c0c0051c0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.589+0000 7f8c1e59c640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c2014acf0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c100072f0 tx=0x7f8c100077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.590+0000 7f8c16ffd640 1 -- 172.21.15.5:0/1340623839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1001a070 con 0x7f8c0c0051c0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.590+0000 7f8c16ffd640 1 -- 172.21.15.5:0/1340623839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000f990 con 0x7f8c0c0051c0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.590+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c20158170 con 0x7f8c0c0051c0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.590+0000 7f8c16ffd640 1 -- 172.21.15.5:0/1340623839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000fd80 con 0x7f8c0c0051c0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.590+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c20158730 con 0x7f8c0c0051c0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.591+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2004ef20 con 0x7f8c0c0051c0 2024-04-25T09:02:50.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.591+0000 7f8c16ffd640 1 -- 172.21.15.5:0/1340623839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c1001d070 con 0x7f8c0c0051c0 2024-04-25T09:02:50.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.591+0000 7f8c16ffd640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c0006b4d0 0x7f8c0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.592+0000 7f8c16ffd640 1 -- 172.21.15.5:0/1340623839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c10089aa0 con 0x7f8c0c0051c0 2024-04-25T09:02:50.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.592+0000 7f8c17fff640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c0006b4d0 0x7f8c0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.592+0000 7f8c17fff640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c0006b4d0 0x7f8c0006d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8c20155c60 tx=0x7f8c08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.596+0000 7f8c16ffd640 1 -- 172.21.15.5:0/1340623839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c2006bf40 con 0x7f8c0c0051c0 2024-04-25T09:02:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.777+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c200aefa0 con 0x7f8c0c0051c0 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.778+0000 7f8c16ffd640 1 -- 172.21.15.5:0/1340623839 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16576 (secure 0 0 0) 0x7f8c10058360 con 0x7f8c0c0051c0 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:50.767 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:48.102831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:44.744734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:45.440447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.780+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c0006b4d0 msgr2=0x7f8c0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.780+0000 7f8c24d9d640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c0006b4d0 0x7f8c0006d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8c20155c60 tx=0x7f8c08008040 comp rx=0 tx=0).stop 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 msgr2=0x7f8c2014acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c2014acf0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c100072f0 tx=0x7f8c100077b0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 shutdown_connections 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c0006b4d0 0x7f8c0006d990 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c200b6cb0 0x7f8c2015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c201f45e0 0x7f8c200b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 --2- 172.21.15.5:0/1340623839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c0c0051c0 0x7f8c2014acf0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 >> 172.21.15.5:0/1340623839 conn(0x7f8c200d19f0 msgr2=0x7f8c200afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 shutdown_connections 2024-04-25T09:02:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.781+0000 7f8c24d9d640 1 -- 172.21.15.5:0/1340623839 wait complete. 2024-04-25T09:02:50.780 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:02:50.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.892+0000 7f49e1d16640 1 Processor -- start 2024-04-25T09:02:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49e1d16640 1 -- start start 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49e1d16640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49dc0ce9f0 0x7f49dc0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49e1d16640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49dc0c5440 con 0x7f49dc0c6930 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49e1d16640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49dc0cff70 con 0x7f49dc15f280 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49e1d16640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc15f660 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49daffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49dc0ce9f0 0x7f49dc0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49dbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49dc0c6930 0x7f49dc0cca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48160/0 (socket says 172.21.15.5:48160) 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49dbfff640 1 -- 172.21.15.5:0/3746624506 learned_addr learned my addr 172.21.15.5:0/3746624506 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.893+0000 7f49daffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49dc0ce9f0 0x7f49dc0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47218/0 (socket says 172.21.15.5:47218) 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.894+0000 7f49daffd640 1 -- 172.21.15.5:0/3746624506 >> v1:172.21.15.80:6789/0 conn(0x7f49dc15f280 legacy=0x7f49dc0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.894+0000 7f49daffd640 1 -- 172.21.15.5:0/3746624506 >> v1:172.21.15.5:6789/0 conn(0x7f49dc0c6930 legacy=0x7f49dc0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.894+0000 7f49da7fc640 1 -- 172.21.15.5:0/3746624506 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207978769 0 0) 0x7f49dc0c5440 con 0x7f49dc0c6930 2024-04-25T09:02:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.894+0000 7f49daffd640 1 -- 172.21.15.5:0/3746624506 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0d0230 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.894+0000 7f49daffd640 1 --2- 172.21.15.5:0/3746624506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc0cc500 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f49d00097a0 tx=0x7f49d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369cf5d29b2a81aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49da7fc640 1 -- 172.21.15.5:0/3746624506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0037070 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49da7fc640 1 -- 172.21.15.5:0/3746624506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d002ae50 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49da7fc640 1 -- 172.21.15.5:0/3746624506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0032660 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49e1d16640 1 -- 172.21.15.5:0/3746624506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 msgr2=0x7f49dc0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49e1d16640 1 --2- 172.21.15.5:0/3746624506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc0cc500 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f49d00097a0 tx=0x7f49d002a140 comp rx=0 tx=0).stop 2024-04-25T09:02:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49e1d16640 1 -- 172.21.15.5:0/3746624506 shutdown_connections 2024-04-25T09:02:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49e1d16640 1 --2- 172.21.15.5:0/3746624506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc0cc500 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49e1d16640 1 -- 172.21.15.5:0/3746624506 >> 172.21.15.5:0/3746624506 conn(0x7f49dc0d18f0 msgr2=0x7f49dc0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49e1d16640 1 -- 172.21.15.5:0/3746624506 shutdown_connections 2024-04-25T09:02:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.895+0000 7f49e1d16640 1 -- 172.21.15.5:0/3746624506 wait complete. 2024-04-25T09:02:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.896+0000 7f49e1d16640 1 Processor -- start 2024-04-25T09:02:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.897+0000 7f49e1d16640 1 -- start start 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.897+0000 7f49e1d16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49dc0c6930 0x7f49dc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.897+0000 7f49e1d16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.897+0000 7f49e1d16640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49dc15f280 0x7f49dc0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.897+0000 7f49e1d16640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0cf190 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.897+0000 7f49e1d16640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0d07f0 con 0x7f49dc0c6930 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.897+0000 7f49e1d16640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0d2480 con 0x7f49dc15f280 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc06f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47226/0 (socket says 172.21.15.5:47226) 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 -- 172.21.15.5:0/4246683097 learned_addr learned my addr 172.21.15.5:0/4246683097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49db7fe640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49dc0c6930 0x7f49dc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49dbfff640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49dc15f280 0x7f49dc0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 -- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49dc15f280 msgr2=0x7f49dc0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49dc15f280 0x7f49dc0c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 -- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49dc0c6930 msgr2=0x7f49dc06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49dc0c6930 0x7f49dc06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 -- 172.21.15.5:0/4246683097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0caf30 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49db7fe640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49dc0c6930 0x7f49dc06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49daffd640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc06f9b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f49d0035040 tx=0x7f49d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49c3fff640 1 -- 172.21.15.5:0/4246683097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0037040 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49c3fff640 1 -- 172.21.15.5:0/4246683097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0004030 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc0cb210 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49c3fff640 1 -- 172.21.15.5:0/4246683097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0006e10 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.898+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc0cb7d0 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.899+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc0c5400 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.900+0000 7f49c3fff640 1 -- 172.21.15.5:0/4246683097 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49d003d650 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.900+0000 7f49c3fff640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49c806b500 0x7f49c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.900+0000 7f49c3fff640 1 -- 172.21.15.5:0/4246683097 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49d00aa9d0 con 0x7f49dc0ce9f0 2024-04-25T09:02:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.900+0000 7f49db7fe640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49c806b500 0x7f49c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.901+0000 7f49db7fe640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49c806b500 0x7f49c806d9c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f49cc006fd0 tx=0x7f49cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:50.904+0000 7f49c3fff640 1 -- 172.21.15.5:0/4246683097 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49dc0c5400 con 0x7f49dc0ce9f0 2024-04-25T09:02:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.080+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49dc04ef20 con 0x7f49c806b500 2024-04-25T09:02:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.086+0000 7f49c3fff640 1 -- 172.21.15.5:0/4246683097 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246766 (secure 0 0 0) 0x7f49dc04ef20 con 0x7f49c806b500 2024-04-25T09:02:51.077 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:51.078 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:02:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49c806b500 msgr2=0x7f49c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49c806b500 0x7f49c806d9c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f49cc006fd0 tx=0x7f49cc008040 comp rx=0 tx=0).stop 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 msgr2=0x7f49dc06f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc06f9b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f49d0035040 tx=0x7f49d00046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 shutdown_connections 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49c806b500 0x7f49c806d9c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49dc15f280 0x7f49dc0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49dc0ce9f0 0x7f49dc06f9b0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 --2- 172.21.15.5:0/4246683097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49dc0c6930 0x7f49dc06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 >> 172.21.15.5:0/4246683097 conn(0x7f49dc0d18f0 msgr2=0x7f49dc0cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 shutdown_connections 2024-04-25T09:02:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.089+0000 7f49e1d16640 1 -- 172.21.15.5:0/4246683097 wait complete. 2024-04-25T09:02:51.088 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-04-25T09:02:50.470013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":353224,"kb_used_data":9368,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754621496,"statfs":{"total":773094113280,"available":772732411904,"internally_reserved":0,"allocated":9592832,"data_stored":4782068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.380364"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105103+0000","last_change":"2024-04-25T09:02:46.105103+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105103+0000","last_undegraded":"2024-04-25T09:02:46.105103+0000","last_fullsized":"2024-04-25T09:02:46.105103+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101307+0000","last_change":"2024-04-25T09:02:46.101307+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101307+0000","last_undegraded":"2024-04-25T09:02:46.101307+0000","last_fullsized":"2024-04-25T09:02:46.101307+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099410+0000","last_change":"2024-04-25T09:02:46.099410+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099410+0000","last_undegraded":"2024-04-25T09:02:46.099410+0000","last_fullsized":"2024-04-25T09:02:46.099410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103515+0000","last_change":"2024-04-25T09:02:46.103515+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103515+0000","last_undegraded":"2024-04-25T09:02:46.103515+0000","last_fullsized":"2024-04-25T09:02:46.103515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102637+0000","last_change":"2024-04-25T09:02:46.102637+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102637+0000","last_undegraded":"2024-04-25T09:02:46.102637+0000","last_fullsized":"2024-04-25T09:02:46.102637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099269+0000","last_change":"2024-04-25T09:02:46.099269+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099269+0000","last_undegraded":"2024-04-25T09:02:46.099269+0000","last_fullsized":"2024-04-25T09:02:46.099269+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103027+0000","last_change":"2024-04-25T09:02:46.103027+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103027+0000","last_undegraded":"2024-04-25T09:02:46.103027+0000","last_fullsized":"2024-04-25T09:02:46.103027+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099716+0000","last_change":"2024-04-25T09:02:46.099716+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099716+0000","last_undegraded":"2024-04-25T09:02:46.099716+0000","last_fullsized":"2024-04-25T09:02:46.099716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099762+0000","last_change":"2024-04-25T09:02:46.099762+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099762+0000","last_undegraded":"2024-04-25T09:02:46.099762+0000","last_fullsized":"2024-04-25T09:02:46.099762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102820+0000","last_change":"2024-04-25T09:02:46.102820+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102820+0000","last_undegraded":"2024-04-25T09:02:46.102820+0000","last_fullsized":"2024-04-25T09:02:46.102820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100796+0000","last_change":"2024-04-25T09:02:46.100796+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100796+0000","last_undegraded":"2024-04-25T09:02:46.100796+0000","last_fullsized":"2024-04-25T09:02:46.100796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.106181+0000","last_change":"2024-04-25T09:02:46.106181+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.106181+0000","last_undegraded":"2024-04-25T09:02:46.106181+0000","last_fullsized":"2024-04-25T09:02:46.106181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098331+0000","last_change":"2024-04-25T09:02:46.098331+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098331+0000","last_undegraded":"2024-04-25T09:02:46.098331+0000","last_fullsized":"2024-04-25T09:02:46.098331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104072+0000","last_change":"2024-04-25T09:02:46.104072+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104072+0000","last_undegraded":"2024-04-25T09:02:46.104072+0000","last_fullsized":"2024-04-25T09:02:46.104072+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103675+0000","last_change":"2024-04-25T09:02:46.103675+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103675+0000","last_undegraded":"2024-04-25T09:02:46.103675+0000","last_fullsized":"2024-04-25T09:02:46.103675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101198+0000","last_change":"2024-04-25T09:02:46.101198+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101198+0000","last_undegraded":"2024-04-25T09:02:46.101198+0000","last_fullsized":"2024-04-25T09:02:46.101198+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103055+0000","last_change":"2024-04-25T09:02:46.103055+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103055+0000","last_undegraded":"2024-04-25T09:02:46.103055+0000","last_fullsized":"2024-04-25T09:02:46.103055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101671+0000","last_change":"2024-04-25T09:02:46.101671+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101671+0000","last_undegraded":"2024-04-25T09:02:46.101671+0000","last_fullsized":"2024-04-25T09:02:46.101671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101204+0000","last_change":"2024-04-25T09:02:46.101204+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101204+0000","last_undegraded":"2024-04-25T09:02:46.101204+0000","last_fullsized":"2024-04-25T09:02:46.101204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101321+0000","last_change":"2024-04-25T09:02:46.101321+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101321+0000","last_undegraded":"2024-04-25T09:02:46.101321+0000","last_fullsized":"2024-04-25T09:02:46.101321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100400+0000","last_change":"2024-04-25T09:02:46.100400+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100400+0000","last_undegraded":"2024-04-25T09:02:46.100400+0000","last_fullsized":"2024-04-25T09:02:46.100400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102404+0000","last_change":"2024-04-25T09:02:46.102404+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102404+0000","last_undegraded":"2024-04-25T09:02:46.102404+0000","last_fullsized":"2024-04-25T09:02:46.102404+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102131+0000","last_change":"2024-04-25T09:02:46.102131+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102131+0000","last_undegraded":"2024-04-25T09:02:46.102131+0000","last_fullsized":"2024-04-25T09:02:46.102131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100856+0000","last_change":"2024-04-25T09:02:46.100856+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100856+0000","last_undegraded":"2024-04-25T09:02:46.100856+0000","last_fullsized":"2024-04-25T09:02:46.100856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101737+0000","last_change":"2024-04-25T09:02:46.101737+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101737+0000","last_undegraded":"2024-04-25T09:02:46.101737+0000","last_fullsized":"2024-04-25T09:02:46.101737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098115+0000","last_change":"2024-04-25T09:02:46.098115+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098115+0000","last_undegraded":"2024-04-25T09:02:46.098115+0000","last_fullsized":"2024-04-25T09:02:46.098115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103112+0000","last_change":"2024-04-25T09:02:46.103112+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103112+0000","last_undegraded":"2024-04-25T09:02:46.103112+0000","last_fullsized":"2024-04-25T09:02:46.103112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105774+0000","last_change":"2024-04-25T09:02:46.105774+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105774+0000","last_undegraded":"2024-04-25T09:02:46.105774+0000","last_fullsized":"2024-04-25T09:02:46.105774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101735+0000","last_change":"2024-04-25T09:02:46.101735+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101735+0000","last_undegraded":"2024-04-25T09:02:46.101735+0000","last_fullsized":"2024-04-25T09:02:46.101735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100420+0000","last_change":"2024-04-25T09:02:46.100420+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100420+0000","last_undegraded":"2024-04-25T09:02:46.100420+0000","last_fullsized":"2024-04-25T09:02:46.100420+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100964+0000","last_change":"2024-04-25T09:02:46.100964+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100964+0000","last_undegraded":"2024-04-25T09:02:46.100964+0000","last_fullsized":"2024-04-25T09:02:46.100964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103151+0000","last_change":"2024-04-25T09:02:46.103151+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103151+0000","last_undegraded":"2024-04-25T09:02:46.103151+0000","last_fullsized":"2024-04-25T09:02:46.103151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103837+0000","last_change":"2024-04-25T09:02:46.103837+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103837+0000","last_undegraded":"2024-04-25T09:02:46.103837+0000","last_fullsized":"2024-04-25T09:02:46.103837+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112415+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:46.112415+0000","last_peered":"2024-04-25T09:02:46.112415+0000","last_clean":"2024-04-25T09:02:46.112415+0000","last_became_active":"2024-04-25T09:02:46.111552+0000","last_became_peered":"2024-04-25T09:02:46.111552+0000","last_unstale":"2024-04-25T09:02:46.112415+0000","last_undegraded":"2024-04-25T09:02:46.112415+0000","last_fullsized":"2024-04-25T09:02:46.112415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:50.181552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104186+0000","last_change":"2024-04-25T09:02:46.104186+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104186+0000","last_undegraded":"2024-04-25T09:02:46.104186+0000","last_fullsized":"2024-04-25T09:02:46.104186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.113103+0000","last_change":"2024-04-25T09:02:46.112288+0000","last_active":"2024-04-25T09:02:46.113103+0000","last_peered":"2024-04-25T09:02:46.113103+0000","last_clean":"2024-04-25T09:02:46.113103+0000","last_became_active":"2024-04-25T09:02:46.111207+0000","last_became_peered":"2024-04-25T09:02:46.111207+0000","last_unstale":"2024-04-25T09:02:46.113103+0000","last_undegraded":"2024-04-25T09:02:46.113103+0000","last_fullsized":"2024-04-25T09:02:46.113103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:18.520317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105355+0000","last_change":"2024-04-25T09:02:46.105355+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105355+0000","last_undegraded":"2024-04-25T09:02:46.105355+0000","last_fullsized":"2024-04-25T09:02:46.105355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114648+0000","last_change":"2024-04-25T09:02:46.114067+0000","last_active":"2024-04-25T09:02:46.114648+0000","last_peered":"2024-04-25T09:02:46.114648+0000","last_clean":"2024-04-25T09:02:46.114648+0000","last_became_active":"2024-04-25T09:02:46.113719+0000","last_became_peered":"2024-04-25T09:02:46.113719+0000","last_unstale":"2024-04-25T09:02:46.114648+0000","last_undegraded":"2024-04-25T09:02:46.114648+0000","last_fullsized":"2024-04-25T09:02:46.114648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:20.855675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098137+0000","last_change":"2024-04-25T09:02:46.098137+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098137+0000","last_undegraded":"2024-04-25T09:02:46.098137+0000","last_fullsized":"2024-04-25T09:02:46.098137+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115066+0000","last_change":"2024-04-25T09:02:46.114156+0000","last_active":"2024-04-25T09:02:46.115066+0000","last_peered":"2024-04-25T09:02:46.115066+0000","last_clean":"2024-04-25T09:02:46.115066+0000","last_became_active":"2024-04-25T09:02:46.113803+0000","last_became_peered":"2024-04-25T09:02:46.113803+0000","last_unstale":"2024-04-25T09:02:46.115066+0000","last_undegraded":"2024-04-25T09:02:46.115066+0000","last_fullsized":"2024-04-25T09:02:46.115066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:46.458086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100884+0000","last_change":"2024-04-25T09:02:46.100884+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100884+0000","last_undegraded":"2024-04-25T09:02:46.100884+0000","last_fullsized":"2024-04-25T09:02:46.100884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114842+0000","last_change":"2024-04-25T09:02:46.114380+0000","last_active":"2024-04-25T09:02:46.114842+0000","last_peered":"2024-04-25T09:02:46.114842+0000","last_clean":"2024-04-25T09:02:46.114842+0000","last_became_active":"2024-04-25T09:02:46.113834+0000","last_became_peered":"2024-04-25T09:02:46.113834+0000","last_unstale":"2024-04-25T09:02:46.114842+0000","last_undegraded":"2024-04-25T09:02:46.114842+0000","last_fullsized":"2024-04-25T09:02:46.114842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:22.527019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101710+0000","last_change":"2024-04-25T09:02:46.101710+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101710+0000","last_undegraded":"2024-04-25T09:02:46.101710+0000","last_fullsized":"2024-04-25T09:02:46.101710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112827+0000","last_change":"2024-04-25T09:02:46.112267+0000","last_active":"2024-04-25T09:02:46.112827+0000","last_peered":"2024-04-25T09:02:46.112827+0000","last_clean":"2024-04-25T09:02:46.112827+0000","last_became_active":"2024-04-25T09:02:46.111817+0000","last_became_peered":"2024-04-25T09:02:46.111817+0000","last_unstale":"2024-04-25T09:02:46.112827+0000","last_undegraded":"2024-04-25T09:02:46.112827+0000","last_fullsized":"2024-04-25T09:02:46.112827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.251134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098778+0000","last_change":"2024-04-25T09:02:46.098778+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098778+0000","last_undegraded":"2024-04-25T09:02:46.098778+0000","last_fullsized":"2024-04-25T09:02:46.098778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112157+0000","last_change":"2024-04-25T09:02:46.109390+0000","last_active":"2024-04-25T09:02:46.112157+0000","last_peered":"2024-04-25T09:02:46.112157+0000","last_clean":"2024-04-25T09:02:46.112157+0000","last_became_active":"2024-04-25T09:02:46.109096+0000","last_became_peered":"2024-04-25T09:02:46.109096+0000","last_unstale":"2024-04-25T09:02:46.112157+0000","last_undegraded":"2024-04-25T09:02:46.112157+0000","last_fullsized":"2024-04-25T09:02:46.112157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:13.631276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102814+0000","last_change":"2024-04-25T09:02:46.102814+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102814+0000","last_undegraded":"2024-04-25T09:02:46.102814+0000","last_fullsized":"2024-04-25T09:02:46.102814+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115004+0000","last_change":"2024-04-25T09:02:46.112851+0000","last_active":"2024-04-25T09:02:46.115004+0000","last_peered":"2024-04-25T09:02:46.115004+0000","last_clean":"2024-04-25T09:02:46.115004+0000","last_became_active":"2024-04-25T09:02:46.112581+0000","last_became_peered":"2024-04-25T09:02:46.112581+0000","last_unstale":"2024-04-25T09:02:46.115004+0000","last_undegraded":"2024-04-25T09:02:46.115004+0000","last_fullsized":"2024-04-25T09:02:46.115004+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:26.404498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103060+0000","last_change":"2024-04-25T09:02:46.103060+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103060+0000","last_undegraded":"2024-04-25T09:02:46.103060+0000","last_fullsized":"2024-04-25T09:02:46.103060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114526+0000","last_change":"2024-04-25T09:02:46.113990+0000","last_active":"2024-04-25T09:02:46.114526+0000","last_peered":"2024-04-25T09:02:46.114526+0000","last_clean":"2024-04-25T09:02:46.114526+0000","last_became_active":"2024-04-25T09:02:46.113649+0000","last_became_peered":"2024-04-25T09:02:46.113649+0000","last_unstale":"2024-04-25T09:02:46.114526+0000","last_undegraded":"2024-04-25T09:02:46.114526+0000","last_fullsized":"2024-04-25T09:02:46.114526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.563667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098779+0000","last_change":"2024-04-25T09:02:46.098779+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098779+0000","last_undegraded":"2024-04-25T09:02:46.098779+0000","last_fullsized":"2024-04-25T09:02:46.098779+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112131+0000","last_change":"2024-04-25T09:02:46.110608+0000","last_active":"2024-04-25T09:02:46.112131+0000","last_peered":"2024-04-25T09:02:46.112131+0000","last_clean":"2024-04-25T09:02:46.112131+0000","last_became_active":"2024-04-25T09:02:46.110313+0000","last_became_peered":"2024-04-25T09:02:46.110313+0000","last_unstale":"2024-04-25T09:02:46.112131+0000","last_undegraded":"2024-04-25T09:02:46.112131+0000","last_fullsized":"2024-04-25T09:02:46.112131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:18.520317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102008+0000","last_change":"2024-04-25T09:02:46.102008+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102008+0000","last_undegraded":"2024-04-25T09:02:46.102008+0000","last_fullsized":"2024-04-25T09:02:46.102008+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109596+0000","last_change":"2024-04-25T09:02:46.107640+0000","last_active":"2024-04-25T09:02:46.109596+0000","last_peered":"2024-04-25T09:02:46.109596+0000","last_clean":"2024-04-25T09:02:46.109596+0000","last_became_active":"2024-04-25T09:02:46.107347+0000","last_became_peered":"2024-04-25T09:02:46.107347+0000","last_unstale":"2024-04-25T09:02:46.109596+0000","last_undegraded":"2024-04-25T09:02:46.109596+0000","last_fullsized":"2024-04-25T09:02:46.109596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:11.182109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102539+0000","last_change":"2024-04-25T09:02:46.102539+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102539+0000","last_undegraded":"2024-04-25T09:02:46.102539+0000","last_fullsized":"2024-04-25T09:02:46.102539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111101+0000","last_change":"2024-04-25T09:02:46.110106+0000","last_active":"2024-04-25T09:02:46.111101+0000","last_peered":"2024-04-25T09:02:46.111101+0000","last_clean":"2024-04-25T09:02:46.111101+0000","last_became_active":"2024-04-25T09:02:46.109792+0000","last_became_peered":"2024-04-25T09:02:46.109792+0000","last_unstale":"2024-04-25T09:02:46.111101+0000","last_undegraded":"2024-04-25T09:02:46.111101+0000","last_fullsized":"2024-04-25T09:02:46.111101+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:09.311901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100736+0000","last_change":"2024-04-25T09:02:46.100736+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100736+0000","last_undegraded":"2024-04-25T09:02:46.100736+0000","last_fullsized":"2024-04-25T09:02:46.100736+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115267+0000","last_change":"2024-04-25T09:02:46.113211+0000","last_active":"2024-04-25T09:02:46.115267+0000","last_peered":"2024-04-25T09:02:46.115267+0000","last_clean":"2024-04-25T09:02:46.115267+0000","last_became_active":"2024-04-25T09:02:46.112471+0000","last_became_peered":"2024-04-25T09:02:46.112471+0000","last_unstale":"2024-04-25T09:02:46.115267+0000","last_undegraded":"2024-04-25T09:02:46.115267+0000","last_fullsized":"2024-04-25T09:02:46.115267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.779157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097702+0000","last_change":"2024-04-25T09:02:46.097702+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097702+0000","last_undegraded":"2024-04-25T09:02:46.097702+0000","last_fullsized":"2024-04-25T09:02:46.097702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.117155+0000","last_change":"2024-04-25T09:02:46.116619+0000","last_active":"2024-04-25T09:02:46.117155+0000","last_peered":"2024-04-25T09:02:46.117155+0000","last_clean":"2024-04-25T09:02:46.117155+0000","last_became_active":"2024-04-25T09:02:46.116270+0000","last_became_peered":"2024-04-25T09:02:46.116270+0000","last_unstale":"2024-04-25T09:02:46.117155+0000","last_undegraded":"2024-04-25T09:02:46.117155+0000","last_fullsized":"2024-04-25T09:02:46.117155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:52.446351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100539+0000","last_change":"2024-04-25T09:02:46.100539+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100539+0000","last_undegraded":"2024-04-25T09:02:46.100539+0000","last_fullsized":"2024-04-25T09:02:46.100539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110463+0000","last_change":"2024-04-25T09:02:46.108915+0000","last_active":"2024-04-25T09:02:46.110463+0000","last_peered":"2024-04-25T09:02:46.110463+0000","last_clean":"2024-04-25T09:02:46.110463+0000","last_became_active":"2024-04-25T09:02:46.108574+0000","last_became_peered":"2024-04-25T09:02:46.108574+0000","last_unstale":"2024-04-25T09:02:46.110463+0000","last_undegraded":"2024-04-25T09:02:46.110463+0000","last_fullsized":"2024-04-25T09:02:46.110463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:07.251501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100210+0000","last_change":"2024-04-25T09:02:46.100210+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100210+0000","last_undegraded":"2024-04-25T09:02:46.100210+0000","last_fullsized":"2024-04-25T09:02:46.100210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109374+0000","last_change":"2024-04-25T09:02:46.107845+0000","last_active":"2024-04-25T09:02:46.109374+0000","last_peered":"2024-04-25T09:02:46.109374+0000","last_clean":"2024-04-25T09:02:46.109374+0000","last_became_active":"2024-04-25T09:02:46.106961+0000","last_became_peered":"2024-04-25T09:02:46.106961+0000","last_unstale":"2024-04-25T09:02:46.109374+0000","last_undegraded":"2024-04-25T09:02:46.109374+0000","last_fullsized":"2024-04-25T09:02:46.109374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097504+0000","last_change":"2024-04-25T09:02:46.097504+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097504+0000","last_undegraded":"2024-04-25T09:02:46.097504+0000","last_fullsized":"2024-04-25T09:02:46.097504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109847+0000","last_change":"2024-04-25T09:02:46.107715+0000","last_active":"2024-04-25T09:02:46.109847+0000","last_peered":"2024-04-25T09:02:46.109847+0000","last_clean":"2024-04-25T09:02:46.109847+0000","last_became_active":"2024-04-25T09:02:46.107421+0000","last_became_peered":"2024-04-25T09:02:46.107421+0000","last_unstale":"2024-04-25T09:02:46.109847+0000","last_undegraded":"2024-04-25T09:02:46.109847+0000","last_fullsized":"2024-04-25T09:02:46.109847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:46.184069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104719+0000","last_change":"2024-04-25T09:02:46.104719+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104719+0000","last_undegraded":"2024-04-25T09:02:46.104719+0000","last_fullsized":"2024-04-25T09:02:46.104719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114526+0000","last_change":"2024-04-25T09:02:46.111553+0000","last_active":"2024-04-25T09:02:46.114526+0000","last_peered":"2024-04-25T09:02:46.114526+0000","last_clean":"2024-04-25T09:02:46.114526+0000","last_became_active":"2024-04-25T09:02:46.111284+0000","last_became_peered":"2024-04-25T09:02:46.111284+0000","last_unstale":"2024-04-25T09:02:46.114526+0000","last_undegraded":"2024-04-25T09:02:46.114526+0000","last_fullsized":"2024-04-25T09:02:46.114526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101654+0000","last_change":"2024-04-25T09:02:46.101654+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101654+0000","last_undegraded":"2024-04-25T09:02:46.101654+0000","last_fullsized":"2024-04-25T09:02:46.101654+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111587+0000","last_change":"2024-04-25T09:02:46.108891+0000","last_active":"2024-04-25T09:02:46.111587+0000","last_peered":"2024-04-25T09:02:46.111587+0000","last_clean":"2024-04-25T09:02:46.111587+0000","last_became_active":"2024-04-25T09:02:46.108612+0000","last_became_peered":"2024-04-25T09:02:46.108612+0000","last_unstale":"2024-04-25T09:02:46.111587+0000","last_undegraded":"2024-04-25T09:02:46.111587+0000","last_fullsized":"2024-04-25T09:02:46.111587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.876030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101553+0000","last_change":"2024-04-25T09:02:46.101553+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101553+0000","last_undegraded":"2024-04-25T09:02:46.101553+0000","last_fullsized":"2024-04-25T09:02:46.101553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112358+0000","last_change":"2024-04-25T09:02:46.111031+0000","last_active":"2024-04-25T09:02:46.112358+0000","last_peered":"2024-04-25T09:02:46.112358+0000","last_clean":"2024-04-25T09:02:46.112358+0000","last_became_active":"2024-04-25T09:02:46.110664+0000","last_became_peered":"2024-04-25T09:02:46.110664+0000","last_unstale":"2024-04-25T09:02:46.112358+0000","last_undegraded":"2024-04-25T09:02:46.112358+0000","last_fullsized":"2024-04-25T09:02:46.112358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:07.412157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098745+0000","last_change":"2024-04-25T09:02:46.098745+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098745+0000","last_undegraded":"2024-04-25T09:02:46.098745+0000","last_fullsized":"2024-04-25T09:02:46.098745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.113409+0000","last_change":"2024-04-25T09:02:46.111562+0000","last_active":"2024-04-25T09:02:46.113409+0000","last_peered":"2024-04-25T09:02:46.113409+0000","last_clean":"2024-04-25T09:02:46.113409+0000","last_became_active":"2024-04-25T09:02:46.111293+0000","last_became_peered":"2024-04-25T09:02:46.111293+0000","last_unstale":"2024-04-25T09:02:46.113409+0000","last_undegraded":"2024-04-25T09:02:46.113409+0000","last_fullsized":"2024-04-25T09:02:46.113409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:21.427649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099749+0000","last_change":"2024-04-25T09:02:46.099749+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099749+0000","last_undegraded":"2024-04-25T09:02:46.099749+0000","last_fullsized":"2024-04-25T09:02:46.099749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110651+0000","last_change":"2024-04-25T09:02:46.106809+0000","last_active":"2024-04-25T09:02:46.110651+0000","last_peered":"2024-04-25T09:02:46.110651+0000","last_clean":"2024-04-25T09:02:46.110651+0000","last_became_active":"2024-04-25T09:02:46.106520+0000","last_became_peered":"2024-04-25T09:02:46.106520+0000","last_unstale":"2024-04-25T09:02:46.110651+0000","last_undegraded":"2024-04-25T09:02:46.110651+0000","last_fullsized":"2024-04-25T09:02:46.110651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:52.422907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099608+0000","last_change":"2024-04-25T09:02:46.099608+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099608+0000","last_undegraded":"2024-04-25T09:02:46.099608+0000","last_fullsized":"2024-04-25T09:02:46.099608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111218+0000","last_change":"2024-04-25T09:02:46.109982+0000","last_active":"2024-04-25T09:02:46.111218+0000","last_peered":"2024-04-25T09:02:46.111218+0000","last_clean":"2024-04-25T09:02:46.111218+0000","last_became_active":"2024-04-25T09:02:46.109619+0000","last_became_peered":"2024-04-25T09:02:46.109619+0000","last_unstale":"2024-04-25T09:02:46.111218+0000","last_undegraded":"2024-04-25T09:02:46.111218+0000","last_fullsized":"2024-04-25T09:02:46.111218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:54.002553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103412+0000","last_change":"2024-04-25T09:02:46.103412+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103412+0000","last_undegraded":"2024-04-25T09:02:46.103412+0000","last_fullsized":"2024-04-25T09:02:46.103412+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114768+0000","last_change":"2024-04-25T09:02:46.111543+0000","last_active":"2024-04-25T09:02:46.114768+0000","last_peered":"2024-04-25T09:02:46.114768+0000","last_clean":"2024-04-25T09:02:46.114768+0000","last_became_active":"2024-04-25T09:02:46.111246+0000","last_became_peered":"2024-04-25T09:02:46.111246+0000","last_unstale":"2024-04-25T09:02:46.114768+0000","last_undegraded":"2024-04-25T09:02:46.114768+0000","last_fullsized":"2024-04-25T09:02:46.114768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:36.015097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097618+0000","last_change":"2024-04-25T09:02:46.097618+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097618+0000","last_undegraded":"2024-04-25T09:02:46.097618+0000","last_fullsized":"2024-04-25T09:02:46.097618+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114959+0000","last_change":"2024-04-25T09:02:46.112103+0000","last_active":"2024-04-25T09:02:46.114959+0000","last_peered":"2024-04-25T09:02:46.114959+0000","last_clean":"2024-04-25T09:02:46.114959+0000","last_became_active":"2024-04-25T09:02:46.111812+0000","last_became_peered":"2024-04-25T09:02:46.111812+0000","last_unstale":"2024-04-25T09:02:46.114959+0000","last_undegraded":"2024-04-25T09:02:46.114959+0000","last_fullsized":"2024-04-25T09:02:46.114959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:17.128028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104948+0000","last_change":"2024-04-25T09:02:46.104948+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104948+0000","last_undegraded":"2024-04-25T09:02:46.104948+0000","last_fullsized":"2024-04-25T09:02:46.104948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110008+0000","last_change":"2024-04-25T09:02:46.108910+0000","last_active":"2024-04-25T09:02:46.110008+0000","last_peered":"2024-04-25T09:02:46.110008+0000","last_clean":"2024-04-25T09:02:46.110008+0000","last_became_active":"2024-04-25T09:02:46.108573+0000","last_became_peered":"2024-04-25T09:02:46.108573+0000","last_unstale":"2024-04-25T09:02:46.110008+0000","last_undegraded":"2024-04-25T09:02:46.110008+0000","last_fullsized":"2024-04-25T09:02:46.110008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.251134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101217+0000","last_change":"2024-04-25T09:02:46.101217+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101217+0000","last_undegraded":"2024-04-25T09:02:46.101217+0000","last_fullsized":"2024-04-25T09:02:46.101217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114540+0000","last_change":"2024-04-25T09:02:46.113989+0000","last_active":"2024-04-25T09:02:46.114540+0000","last_peered":"2024-04-25T09:02:46.114540+0000","last_clean":"2024-04-25T09:02:46.114540+0000","last_became_active":"2024-04-25T09:02:46.113641+0000","last_became_peered":"2024-04-25T09:02:46.113641+0000","last_unstale":"2024-04-25T09:02:46.114540+0000","last_undegraded":"2024-04-25T09:02:46.114540+0000","last_fullsized":"2024-04-25T09:02:46.114540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098719+0000","last_change":"2024-04-25T09:02:46.098719+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098719+0000","last_undegraded":"2024-04-25T09:02:46.098719+0000","last_fullsized":"2024-04-25T09:02:46.098719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112124+0000","last_change":"2024-04-25T09:02:46.110506+0000","last_active":"2024-04-25T09:02:46.112124+0000","last_peered":"2024-04-25T09:02:46.112124+0000","last_clean":"2024-04-25T09:02:46.112124+0000","last_became_active":"2024-04-25T09:02:46.110209+0000","last_became_peered":"2024-04-25T09:02:46.110209+0000","last_unstale":"2024-04-25T09:02:46.112124+0000","last_undegraded":"2024-04-25T09:02:46.112124+0000","last_fullsized":"2024-04-25T09:02:46.112124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.252066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103407+0000","last_change":"2024-04-25T09:02:46.103407+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103407+0000","last_undegraded":"2024-04-25T09:02:46.103407+0000","last_fullsized":"2024-04-25T09:02:46.103407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112780+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:46.112780+0000","last_peered":"2024-04-25T09:02:46.112780+0000","last_clean":"2024-04-25T09:02:46.112780+0000","last_became_active":"2024-04-25T09:02:46.111500+0000","last_became_peered":"2024-04-25T09:02:46.111500+0000","last_unstale":"2024-04-25T09:02:46.112780+0000","last_undegraded":"2024-04-25T09:02:46.112780+0000","last_fullsized":"2024-04-25T09:02:46.112780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:46.184069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097507+0000","last_change":"2024-04-25T09:02:46.097507+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097507+0000","last_undegraded":"2024-04-25T09:02:46.097507+0000","last_fullsized":"2024-04-25T09:02:46.097507+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112124+0000","last_change":"2024-04-25T09:02:46.110806+0000","last_active":"2024-04-25T09:02:46.112124+0000","last_peered":"2024-04-25T09:02:46.112124+0000","last_clean":"2024-04-25T09:02:46.112124+0000","last_became_active":"2024-04-25T09:02:46.110506+0000","last_became_peered":"2024-04-25T09:02:46.110506+0000","last_unstale":"2024-04-25T09:02:46.112124+0000","last_undegraded":"2024-04-25T09:02:46.112124+0000","last_fullsized":"2024-04-25T09:02:46.112124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:22.527019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101709+0000","last_change":"2024-04-25T09:02:46.101709+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101709+0000","last_undegraded":"2024-04-25T09:02:46.101709+0000","last_fullsized":"2024-04-25T09:02:46.101709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109901+0000","last_change":"2024-04-25T09:02:46.108946+0000","last_active":"2024-04-25T09:02:46.109901+0000","last_peered":"2024-04-25T09:02:46.109901+0000","last_clean":"2024-04-25T09:02:46.109901+0000","last_became_active":"2024-04-25T09:02:46.108676+0000","last_became_peered":"2024-04-25T09:02:46.108676+0000","last_unstale":"2024-04-25T09:02:46.109901+0000","last_undegraded":"2024-04-25T09:02:46.109901+0000","last_fullsized":"2024-04-25T09:02:46.109901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:11.182109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101189+0000","last_change":"2024-04-25T09:02:46.101189+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101189+0000","last_undegraded":"2024-04-25T09:02:46.101189+0000","last_fullsized":"2024-04-25T09:02:46.101189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.116006+0000","last_change":"2024-04-25T09:02:46.115578+0000","last_active":"2024-04-25T09:02:46.116006+0000","last_peered":"2024-04-25T09:02:46.116006+0000","last_clean":"2024-04-25T09:02:46.116006+0000","last_became_active":"2024-04-25T09:02:46.115366+0000","last_became_peered":"2024-04-25T09:02:46.115366+0000","last_unstale":"2024-04-25T09:02:46.116006+0000","last_undegraded":"2024-04-25T09:02:46.116006+0000","last_fullsized":"2024-04-25T09:02:46.116006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:33.183002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.105522+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:02:46.105522+0000","last_peered":"2024-04-25T09:02:46.105522+0000","last_clean":"2024-04-25T09:02:46.105522+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:02:46.105522+0000","last_undegraded":"2024-04-25T09:02:46.105522+0000","last_fullsized":"2024-04-25T09:02:46.105522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46684,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325156,"statfs":{"total":96636764160,"available":96588959744,"internally_reserved":0,"allocated":1650688,"data_stored":1043672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46088,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325752,"statfs":{"total":96636764160,"available":96589570048,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50260,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321580,"statfs":{"total":96636764160,"available":96585297920,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50252,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321588,"statfs":{"total":96636764160,"available":96585306112,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58568,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313272,"statfs":{"total":96636764160,"available":96576790528,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343220,"statfs":{"total":96636764160,"available":96607457280,"internally_reserved":0,"allocated":1638400,"data_stored":1037397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:51.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.241+0000 7fa31ba1f640 1 Processor -- start 2024-04-25T09:02:51.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.242+0000 7fa31ba1f640 1 -- start start 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.242+0000 7fa31ba1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa31415def0 0x7fa3140d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.242+0000 7fa31ba1f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3140b94c0 0x7fa3140d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.242+0000 7fa31ba1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3140d2550 con 0x7fa3140d0400 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.242+0000 7fa31ba1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31415e2d0 con 0x7fa31415def0 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.242+0000 7fa31ba1f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3140d2830 con 0x7fa3140b94c0 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa3197bb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa31415def0 0x7fa3140d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa319fbc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa3140d0400 0x7fa3140d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48168/0 (socket says 172.21.15.5:48168) 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa319fbc640 1 -- 172.21.15.5:0/2542626440 learned_addr learned my addr 172.21.15.5:0/2542626440 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa3197bb640 1 --2- 172.21.15.5:0/2542626440 >> v2:172.21.15.5:3300/0 conn(0x7fa31415def0 0x7fa3140d35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47240/0 (socket says 172.21.15.5:47240) 2024-04-25T09:02:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa318fba640 1 --2- 172.21.15.5:0/2542626440 >> v2:172.21.15.80:3300/0 conn(0x7fa3140b94c0 0x7fa3140d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa3197bb640 1 -- 172.21.15.5:0/2542626440 >> v2:172.21.15.80:3300/0 conn(0x7fa3140b94c0 msgr2=0x7fa3140d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa3197bb640 1 --2- 172.21.15.5:0/2542626440 >> v2:172.21.15.80:3300/0 conn(0x7fa3140b94c0 0x7fa3140d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa3197bb640 1 -- 172.21.15.5:0/2542626440 >> v1:172.21.15.5:6789/0 conn(0x7fa3140d0400 legacy=0x7fa3140d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa30bfff640 1 -- 172.21.15.5:0/2542626440 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264794618 0 0) 0x7fa3140d2550 con 0x7fa3140d0400 2024-04-25T09:02:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa3197bb640 1 -- 172.21.15.5:0/2542626440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140d2b10 con 0x7fa31415def0 2024-04-25T09:02:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.243+0000 7fa318fba640 1 --2- 172.21.15.5:0/2542626440 >> v2:172.21.15.80:3300/0 conn(0x7fa3140b94c0 0x7fa3140d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa3197bb640 1 --2- 172.21.15.5:0/2542626440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31415def0 0x7fa3140d35f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa3140b9950 tx=0x7fa31002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b1d51fa379636c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa30bfff640 1 -- 172.21.15.5:0/2542626440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310037070 con 0x7fa31415def0 2024-04-25T09:02:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa30bfff640 1 -- 172.21.15.5:0/2542626440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310032440 con 0x7fa31415def0 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa30bfff640 1 -- 172.21.15.5:0/2542626440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310032810 con 0x7fa31415def0 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 -- 172.21.15.5:0/2542626440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31415def0 msgr2=0x7fa3140d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/2542626440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31415def0 0x7fa3140d35f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa3140b9950 tx=0x7fa31002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 -- 172.21.15.5:0/2542626440 shutdown_connections 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/2542626440 >> v2:172.21.15.80:3300/0 conn(0x7fa3140b94c0 0x7fa3140d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/2542626440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31415def0 0x7fa3140d35f0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 -- 172.21.15.5:0/2542626440 >> 172.21.15.5:0/2542626440 conn(0x7fa31406b000 msgr2=0x7fa31406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 -- 172.21.15.5:0/2542626440 shutdown_connections 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.244+0000 7fa31ba1f640 1 -- 172.21.15.5:0/2542626440 wait complete. 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 Processor -- start 2024-04-25T09:02:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 -- start start 2024-04-25T09:02:51.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3140b94c0 0x7fa3140b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3140d0400 0x7fa3140cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa31415def0 0x7fa31415fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140d2260 con 0x7fa3140b94c0 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140d30d0 con 0x7fa31415def0 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa31ba1f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140b6c60 con 0x7fa3140d0400 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa3197bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3140b94c0 0x7fa3140b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa3197bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3140b94c0 0x7fa3140b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47242/0 (socket says 172.21.15.5:47242) 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa3197bb640 1 -- 172.21.15.5:0/4094391637 learned_addr learned my addr 172.21.15.5:0/4094391637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.246+0000 7fa319fbc640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa31415def0 0x7fa31415fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa318fba640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3140d0400 0x7fa3140cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa3197bb640 1 -- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3140d0400 msgr2=0x7fa3140cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa3197bb640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3140d0400 0x7fa3140cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa3197bb640 1 -- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa31415def0 msgr2=0x7fa31415fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa3197bb640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa31415def0 0x7fa31415fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa3197bb640 1 -- 172.21.15.5:0/4094391637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140ccc80 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa318fba640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3140d0400 0x7fa3140cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa3197bb640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3140b94c0 0x7fa3140b20f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa310000c00 tx=0x7fa3100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa309ffb640 1 -- 172.21.15.5:0/4094391637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310037040 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa309ffb640 1 -- 172.21.15.5:0/4094391637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310042070 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa309ffb640 1 -- 172.21.15.5:0/4094391637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310030a50 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3140ccf60 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.247+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3141f3650 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.248+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3140cd480 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.249+0000 7fa309ffb640 1 -- 172.21.15.5:0/4094391637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa310030bf0 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.249+0000 7fa309ffb640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2f806b4d0 0x7fa2f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.249+0000 7fa309ffb640 1 -- 172.21.15.5:0/4094391637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3100aac00 con 0x7fa3140b94c0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.249+0000 7fa318fba640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2f806b4d0 0x7fa2f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.250+0000 7fa318fba640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2f806b4d0 0x7fa2f806d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa3140b2630 tx=0x7fa304008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.253+0000 7fa309ffb640 1 -- 172.21.15.5:0/4094391637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3140cd480 con 0x7fa3140b94c0 2024-04-25T09:02:51.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.429+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3141f3890 con 0x7fa2f806b4d0 2024-04-25T09:02:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.435+0000 7fa309ffb640 1 -- 172.21.15.5:0/4094391637 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246766 (secure 0 0 0) 0x7fa3141f3890 con 0x7fa2f806b4d0 2024-04-25T09:02:51.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:51.427 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:02:51.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2f806b4d0 msgr2=0x7fa2f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2f806b4d0 0x7fa2f806d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa3140b2630 tx=0x7fa304008040 comp rx=0 tx=0).stop 2024-04-25T09:02:51.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3140b94c0 msgr2=0x7fa3140b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3140b94c0 0x7fa3140b20f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa310000c00 tx=0x7fa3100046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 shutdown_connections 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa2f806b4d0 0x7fa2f806d990 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa31415def0 0x7fa31415fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa3140d0400 0x7fa3140cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 --2- 172.21.15.5:0/4094391637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3140b94c0 0x7fa3140b20f0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 >> 172.21.15.5:0/4094391637 conn(0x7fa31406b000 msgr2=0x7fa31415d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 shutdown_connections 2024-04-25T09:02:51.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.438+0000 7fa31ba1f640 1 -- 172.21.15.5:0/4094391637 wait complete. 2024-04-25T09:02:51.437 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-04-25T09:02:50.470013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":353224,"kb_used_data":9368,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754621496,"statfs":{"total":773094113280,"available":772732411904,"internally_reserved":0,"allocated":9592832,"data_stored":4782068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.380364"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105103+0000","last_change":"2024-04-25T09:02:46.105103+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105103+0000","last_undegraded":"2024-04-25T09:02:46.105103+0000","last_fullsized":"2024-04-25T09:02:46.105103+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101307+0000","last_change":"2024-04-25T09:02:46.101307+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101307+0000","last_undegraded":"2024-04-25T09:02:46.101307+0000","last_fullsized":"2024-04-25T09:02:46.101307+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099410+0000","last_change":"2024-04-25T09:02:46.099410+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099410+0000","last_undegraded":"2024-04-25T09:02:46.099410+0000","last_fullsized":"2024-04-25T09:02:46.099410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103515+0000","last_change":"2024-04-25T09:02:46.103515+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103515+0000","last_undegraded":"2024-04-25T09:02:46.103515+0000","last_fullsized":"2024-04-25T09:02:46.103515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102637+0000","last_change":"2024-04-25T09:02:46.102637+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102637+0000","last_undegraded":"2024-04-25T09:02:46.102637+0000","last_fullsized":"2024-04-25T09:02:46.102637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099269+0000","last_change":"2024-04-25T09:02:46.099269+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099269+0000","last_undegraded":"2024-04-25T09:02:46.099269+0000","last_fullsized":"2024-04-25T09:02:46.099269+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103027+0000","last_change":"2024-04-25T09:02:46.103027+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103027+0000","last_undegraded":"2024-04-25T09:02:46.103027+0000","last_fullsized":"2024-04-25T09:02:46.103027+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099716+0000","last_change":"2024-04-25T09:02:46.099716+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099716+0000","last_undegraded":"2024-04-25T09:02:46.099716+0000","last_fullsized":"2024-04-25T09:02:46.099716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099762+0000","last_change":"2024-04-25T09:02:46.099762+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099762+0000","last_undegraded":"2024-04-25T09:02:46.099762+0000","last_fullsized":"2024-04-25T09:02:46.099762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102820+0000","last_change":"2024-04-25T09:02:46.102820+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102820+0000","last_undegraded":"2024-04-25T09:02:46.102820+0000","last_fullsized":"2024-04-25T09:02:46.102820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100796+0000","last_change":"2024-04-25T09:02:46.100796+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100796+0000","last_undegraded":"2024-04-25T09:02:46.100796+0000","last_fullsized":"2024-04-25T09:02:46.100796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.106181+0000","last_change":"2024-04-25T09:02:46.106181+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.106181+0000","last_undegraded":"2024-04-25T09:02:46.106181+0000","last_fullsized":"2024-04-25T09:02:46.106181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098331+0000","last_change":"2024-04-25T09:02:46.098331+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098331+0000","last_undegraded":"2024-04-25T09:02:46.098331+0000","last_fullsized":"2024-04-25T09:02:46.098331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104072+0000","last_change":"2024-04-25T09:02:46.104072+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104072+0000","last_undegraded":"2024-04-25T09:02:46.104072+0000","last_fullsized":"2024-04-25T09:02:46.104072+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103675+0000","last_change":"2024-04-25T09:02:46.103675+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103675+0000","last_undegraded":"2024-04-25T09:02:46.103675+0000","last_fullsized":"2024-04-25T09:02:46.103675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101198+0000","last_change":"2024-04-25T09:02:46.101198+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101198+0000","last_undegraded":"2024-04-25T09:02:46.101198+0000","last_fullsized":"2024-04-25T09:02:46.101198+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103055+0000","last_change":"2024-04-25T09:02:46.103055+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103055+0000","last_undegraded":"2024-04-25T09:02:46.103055+0000","last_fullsized":"2024-04-25T09:02:46.103055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101671+0000","last_change":"2024-04-25T09:02:46.101671+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101671+0000","last_undegraded":"2024-04-25T09:02:46.101671+0000","last_fullsized":"2024-04-25T09:02:46.101671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101204+0000","last_change":"2024-04-25T09:02:46.101204+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101204+0000","last_undegraded":"2024-04-25T09:02:46.101204+0000","last_fullsized":"2024-04-25T09:02:46.101204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101321+0000","last_change":"2024-04-25T09:02:46.101321+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101321+0000","last_undegraded":"2024-04-25T09:02:46.101321+0000","last_fullsized":"2024-04-25T09:02:46.101321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100400+0000","last_change":"2024-04-25T09:02:46.100400+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100400+0000","last_undegraded":"2024-04-25T09:02:46.100400+0000","last_fullsized":"2024-04-25T09:02:46.100400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102404+0000","last_change":"2024-04-25T09:02:46.102404+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102404+0000","last_undegraded":"2024-04-25T09:02:46.102404+0000","last_fullsized":"2024-04-25T09:02:46.102404+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102131+0000","last_change":"2024-04-25T09:02:46.102131+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102131+0000","last_undegraded":"2024-04-25T09:02:46.102131+0000","last_fullsized":"2024-04-25T09:02:46.102131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100856+0000","last_change":"2024-04-25T09:02:46.100856+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100856+0000","last_undegraded":"2024-04-25T09:02:46.100856+0000","last_fullsized":"2024-04-25T09:02:46.100856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101737+0000","last_change":"2024-04-25T09:02:46.101737+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101737+0000","last_undegraded":"2024-04-25T09:02:46.101737+0000","last_fullsized":"2024-04-25T09:02:46.101737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098115+0000","last_change":"2024-04-25T09:02:46.098115+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098115+0000","last_undegraded":"2024-04-25T09:02:46.098115+0000","last_fullsized":"2024-04-25T09:02:46.098115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103112+0000","last_change":"2024-04-25T09:02:46.103112+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103112+0000","last_undegraded":"2024-04-25T09:02:46.103112+0000","last_fullsized":"2024-04-25T09:02:46.103112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105774+0000","last_change":"2024-04-25T09:02:46.105774+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105774+0000","last_undegraded":"2024-04-25T09:02:46.105774+0000","last_fullsized":"2024-04-25T09:02:46.105774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101735+0000","last_change":"2024-04-25T09:02:46.101735+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101735+0000","last_undegraded":"2024-04-25T09:02:46.101735+0000","last_fullsized":"2024-04-25T09:02:46.101735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100420+0000","last_change":"2024-04-25T09:02:46.100420+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100420+0000","last_undegraded":"2024-04-25T09:02:46.100420+0000","last_fullsized":"2024-04-25T09:02:46.100420+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100964+0000","last_change":"2024-04-25T09:02:46.100964+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100964+0000","last_undegraded":"2024-04-25T09:02:46.100964+0000","last_fullsized":"2024-04-25T09:02:46.100964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103151+0000","last_change":"2024-04-25T09:02:46.103151+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103151+0000","last_undegraded":"2024-04-25T09:02:46.103151+0000","last_fullsized":"2024-04-25T09:02:46.103151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103837+0000","last_change":"2024-04-25T09:02:46.103837+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103837+0000","last_undegraded":"2024-04-25T09:02:46.103837+0000","last_fullsized":"2024-04-25T09:02:46.103837+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112415+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:46.112415+0000","last_peered":"2024-04-25T09:02:46.112415+0000","last_clean":"2024-04-25T09:02:46.112415+0000","last_became_active":"2024-04-25T09:02:46.111552+0000","last_became_peered":"2024-04-25T09:02:46.111552+0000","last_unstale":"2024-04-25T09:02:46.112415+0000","last_undegraded":"2024-04-25T09:02:46.112415+0000","last_fullsized":"2024-04-25T09:02:46.112415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:50.181552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104186+0000","last_change":"2024-04-25T09:02:46.104186+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104186+0000","last_undegraded":"2024-04-25T09:02:46.104186+0000","last_fullsized":"2024-04-25T09:02:46.104186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.113103+0000","last_change":"2024-04-25T09:02:46.112288+0000","last_active":"2024-04-25T09:02:46.113103+0000","last_peered":"2024-04-25T09:02:46.113103+0000","last_clean":"2024-04-25T09:02:46.113103+0000","last_became_active":"2024-04-25T09:02:46.111207+0000","last_became_peered":"2024-04-25T09:02:46.111207+0000","last_unstale":"2024-04-25T09:02:46.113103+0000","last_undegraded":"2024-04-25T09:02:46.113103+0000","last_fullsized":"2024-04-25T09:02:46.113103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:18.520317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105355+0000","last_change":"2024-04-25T09:02:46.105355+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105355+0000","last_undegraded":"2024-04-25T09:02:46.105355+0000","last_fullsized":"2024-04-25T09:02:46.105355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114648+0000","last_change":"2024-04-25T09:02:46.114067+0000","last_active":"2024-04-25T09:02:46.114648+0000","last_peered":"2024-04-25T09:02:46.114648+0000","last_clean":"2024-04-25T09:02:46.114648+0000","last_became_active":"2024-04-25T09:02:46.113719+0000","last_became_peered":"2024-04-25T09:02:46.113719+0000","last_unstale":"2024-04-25T09:02:46.114648+0000","last_undegraded":"2024-04-25T09:02:46.114648+0000","last_fullsized":"2024-04-25T09:02:46.114648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:20.855675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098137+0000","last_change":"2024-04-25T09:02:46.098137+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098137+0000","last_undegraded":"2024-04-25T09:02:46.098137+0000","last_fullsized":"2024-04-25T09:02:46.098137+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115066+0000","last_change":"2024-04-25T09:02:46.114156+0000","last_active":"2024-04-25T09:02:46.115066+0000","last_peered":"2024-04-25T09:02:46.115066+0000","last_clean":"2024-04-25T09:02:46.115066+0000","last_became_active":"2024-04-25T09:02:46.113803+0000","last_became_peered":"2024-04-25T09:02:46.113803+0000","last_unstale":"2024-04-25T09:02:46.115066+0000","last_undegraded":"2024-04-25T09:02:46.115066+0000","last_fullsized":"2024-04-25T09:02:46.115066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:46.458086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100884+0000","last_change":"2024-04-25T09:02:46.100884+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100884+0000","last_undegraded":"2024-04-25T09:02:46.100884+0000","last_fullsized":"2024-04-25T09:02:46.100884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114842+0000","last_change":"2024-04-25T09:02:46.114380+0000","last_active":"2024-04-25T09:02:46.114842+0000","last_peered":"2024-04-25T09:02:46.114842+0000","last_clean":"2024-04-25T09:02:46.114842+0000","last_became_active":"2024-04-25T09:02:46.113834+0000","last_became_peered":"2024-04-25T09:02:46.113834+0000","last_unstale":"2024-04-25T09:02:46.114842+0000","last_undegraded":"2024-04-25T09:02:46.114842+0000","last_fullsized":"2024-04-25T09:02:46.114842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:22.527019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101710+0000","last_change":"2024-04-25T09:02:46.101710+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101710+0000","last_undegraded":"2024-04-25T09:02:46.101710+0000","last_fullsized":"2024-04-25T09:02:46.101710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112827+0000","last_change":"2024-04-25T09:02:46.112267+0000","last_active":"2024-04-25T09:02:46.112827+0000","last_peered":"2024-04-25T09:02:46.112827+0000","last_clean":"2024-04-25T09:02:46.112827+0000","last_became_active":"2024-04-25T09:02:46.111817+0000","last_became_peered":"2024-04-25T09:02:46.111817+0000","last_unstale":"2024-04-25T09:02:46.112827+0000","last_undegraded":"2024-04-25T09:02:46.112827+0000","last_fullsized":"2024-04-25T09:02:46.112827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.251134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098778+0000","last_change":"2024-04-25T09:02:46.098778+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098778+0000","last_undegraded":"2024-04-25T09:02:46.098778+0000","last_fullsized":"2024-04-25T09:02:46.098778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112157+0000","last_change":"2024-04-25T09:02:46.109390+0000","last_active":"2024-04-25T09:02:46.112157+0000","last_peered":"2024-04-25T09:02:46.112157+0000","last_clean":"2024-04-25T09:02:46.112157+0000","last_became_active":"2024-04-25T09:02:46.109096+0000","last_became_peered":"2024-04-25T09:02:46.109096+0000","last_unstale":"2024-04-25T09:02:46.112157+0000","last_undegraded":"2024-04-25T09:02:46.112157+0000","last_fullsized":"2024-04-25T09:02:46.112157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:13.631276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102814+0000","last_change":"2024-04-25T09:02:46.102814+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102814+0000","last_undegraded":"2024-04-25T09:02:46.102814+0000","last_fullsized":"2024-04-25T09:02:46.102814+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115004+0000","last_change":"2024-04-25T09:02:46.112851+0000","last_active":"2024-04-25T09:02:46.115004+0000","last_peered":"2024-04-25T09:02:46.115004+0000","last_clean":"2024-04-25T09:02:46.115004+0000","last_became_active":"2024-04-25T09:02:46.112581+0000","last_became_peered":"2024-04-25T09:02:46.112581+0000","last_unstale":"2024-04-25T09:02:46.115004+0000","last_undegraded":"2024-04-25T09:02:46.115004+0000","last_fullsized":"2024-04-25T09:02:46.115004+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:26.404498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103060+0000","last_change":"2024-04-25T09:02:46.103060+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103060+0000","last_undegraded":"2024-04-25T09:02:46.103060+0000","last_fullsized":"2024-04-25T09:02:46.103060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114526+0000","last_change":"2024-04-25T09:02:46.113990+0000","last_active":"2024-04-25T09:02:46.114526+0000","last_peered":"2024-04-25T09:02:46.114526+0000","last_clean":"2024-04-25T09:02:46.114526+0000","last_became_active":"2024-04-25T09:02:46.113649+0000","last_became_peered":"2024-04-25T09:02:46.113649+0000","last_unstale":"2024-04-25T09:02:46.114526+0000","last_undegraded":"2024-04-25T09:02:46.114526+0000","last_fullsized":"2024-04-25T09:02:46.114526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.563667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098779+0000","last_change":"2024-04-25T09:02:46.098779+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098779+0000","last_undegraded":"2024-04-25T09:02:46.098779+0000","last_fullsized":"2024-04-25T09:02:46.098779+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112131+0000","last_change":"2024-04-25T09:02:46.110608+0000","last_active":"2024-04-25T09:02:46.112131+0000","last_peered":"2024-04-25T09:02:46.112131+0000","last_clean":"2024-04-25T09:02:46.112131+0000","last_became_active":"2024-04-25T09:02:46.110313+0000","last_became_peered":"2024-04-25T09:02:46.110313+0000","last_unstale":"2024-04-25T09:02:46.112131+0000","last_undegraded":"2024-04-25T09:02:46.112131+0000","last_fullsized":"2024-04-25T09:02:46.112131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:18.520317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102008+0000","last_change":"2024-04-25T09:02:46.102008+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102008+0000","last_undegraded":"2024-04-25T09:02:46.102008+0000","last_fullsized":"2024-04-25T09:02:46.102008+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109596+0000","last_change":"2024-04-25T09:02:46.107640+0000","last_active":"2024-04-25T09:02:46.109596+0000","last_peered":"2024-04-25T09:02:46.109596+0000","last_clean":"2024-04-25T09:02:46.109596+0000","last_became_active":"2024-04-25T09:02:46.107347+0000","last_became_peered":"2024-04-25T09:02:46.107347+0000","last_unstale":"2024-04-25T09:02:46.109596+0000","last_undegraded":"2024-04-25T09:02:46.109596+0000","last_fullsized":"2024-04-25T09:02:46.109596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:11.182109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102539+0000","last_change":"2024-04-25T09:02:46.102539+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102539+0000","last_undegraded":"2024-04-25T09:02:46.102539+0000","last_fullsized":"2024-04-25T09:02:46.102539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111101+0000","last_change":"2024-04-25T09:02:46.110106+0000","last_active":"2024-04-25T09:02:46.111101+0000","last_peered":"2024-04-25T09:02:46.111101+0000","last_clean":"2024-04-25T09:02:46.111101+0000","last_became_active":"2024-04-25T09:02:46.109792+0000","last_became_peered":"2024-04-25T09:02:46.109792+0000","last_unstale":"2024-04-25T09:02:46.111101+0000","last_undegraded":"2024-04-25T09:02:46.111101+0000","last_fullsized":"2024-04-25T09:02:46.111101+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:09.311901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100736+0000","last_change":"2024-04-25T09:02:46.100736+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100736+0000","last_undegraded":"2024-04-25T09:02:46.100736+0000","last_fullsized":"2024-04-25T09:02:46.100736+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115267+0000","last_change":"2024-04-25T09:02:46.113211+0000","last_active":"2024-04-25T09:02:46.115267+0000","last_peered":"2024-04-25T09:02:46.115267+0000","last_clean":"2024-04-25T09:02:46.115267+0000","last_became_active":"2024-04-25T09:02:46.112471+0000","last_became_peered":"2024-04-25T09:02:46.112471+0000","last_unstale":"2024-04-25T09:02:46.115267+0000","last_undegraded":"2024-04-25T09:02:46.115267+0000","last_fullsized":"2024-04-25T09:02:46.115267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.779157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097702+0000","last_change":"2024-04-25T09:02:46.097702+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097702+0000","last_undegraded":"2024-04-25T09:02:46.097702+0000","last_fullsized":"2024-04-25T09:02:46.097702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.117155+0000","last_change":"2024-04-25T09:02:46.116619+0000","last_active":"2024-04-25T09:02:46.117155+0000","last_peered":"2024-04-25T09:02:46.117155+0000","last_clean":"2024-04-25T09:02:46.117155+0000","last_became_active":"2024-04-25T09:02:46.116270+0000","last_became_peered":"2024-04-25T09:02:46.116270+0000","last_unstale":"2024-04-25T09:02:46.117155+0000","last_undegraded":"2024-04-25T09:02:46.117155+0000","last_fullsized":"2024-04-25T09:02:46.117155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:52.446351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100539+0000","last_change":"2024-04-25T09:02:46.100539+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100539+0000","last_undegraded":"2024-04-25T09:02:46.100539+0000","last_fullsized":"2024-04-25T09:02:46.100539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110463+0000","last_change":"2024-04-25T09:02:46.108915+0000","last_active":"2024-04-25T09:02:46.110463+0000","last_peered":"2024-04-25T09:02:46.110463+0000","last_clean":"2024-04-25T09:02:46.110463+0000","last_became_active":"2024-04-25T09:02:46.108574+0000","last_became_peered":"2024-04-25T09:02:46.108574+0000","last_unstale":"2024-04-25T09:02:46.110463+0000","last_undegraded":"2024-04-25T09:02:46.110463+0000","last_fullsized":"2024-04-25T09:02:46.110463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:07.251501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100210+0000","last_change":"2024-04-25T09:02:46.100210+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100210+0000","last_undegraded":"2024-04-25T09:02:46.100210+0000","last_fullsized":"2024-04-25T09:02:46.100210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109374+0000","last_change":"2024-04-25T09:02:46.107845+0000","last_active":"2024-04-25T09:02:46.109374+0000","last_peered":"2024-04-25T09:02:46.109374+0000","last_clean":"2024-04-25T09:02:46.109374+0000","last_became_active":"2024-04-25T09:02:46.106961+0000","last_became_peered":"2024-04-25T09:02:46.106961+0000","last_unstale":"2024-04-25T09:02:46.109374+0000","last_undegraded":"2024-04-25T09:02:46.109374+0000","last_fullsized":"2024-04-25T09:02:46.109374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097504+0000","last_change":"2024-04-25T09:02:46.097504+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097504+0000","last_undegraded":"2024-04-25T09:02:46.097504+0000","last_fullsized":"2024-04-25T09:02:46.097504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109847+0000","last_change":"2024-04-25T09:02:46.107715+0000","last_active":"2024-04-25T09:02:46.109847+0000","last_peered":"2024-04-25T09:02:46.109847+0000","last_clean":"2024-04-25T09:02:46.109847+0000","last_became_active":"2024-04-25T09:02:46.107421+0000","last_became_peered":"2024-04-25T09:02:46.107421+0000","last_unstale":"2024-04-25T09:02:46.109847+0000","last_undegraded":"2024-04-25T09:02:46.109847+0000","last_fullsized":"2024-04-25T09:02:46.109847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:46.184069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104719+0000","last_change":"2024-04-25T09:02:46.104719+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104719+0000","last_undegraded":"2024-04-25T09:02:46.104719+0000","last_fullsized":"2024-04-25T09:02:46.104719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114526+0000","last_change":"2024-04-25T09:02:46.111553+0000","last_active":"2024-04-25T09:02:46.114526+0000","last_peered":"2024-04-25T09:02:46.114526+0000","last_clean":"2024-04-25T09:02:46.114526+0000","last_became_active":"2024-04-25T09:02:46.111284+0000","last_became_peered":"2024-04-25T09:02:46.111284+0000","last_unstale":"2024-04-25T09:02:46.114526+0000","last_undegraded":"2024-04-25T09:02:46.114526+0000","last_fullsized":"2024-04-25T09:02:46.114526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101654+0000","last_change":"2024-04-25T09:02:46.101654+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101654+0000","last_undegraded":"2024-04-25T09:02:46.101654+0000","last_fullsized":"2024-04-25T09:02:46.101654+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111587+0000","last_change":"2024-04-25T09:02:46.108891+0000","last_active":"2024-04-25T09:02:46.111587+0000","last_peered":"2024-04-25T09:02:46.111587+0000","last_clean":"2024-04-25T09:02:46.111587+0000","last_became_active":"2024-04-25T09:02:46.108612+0000","last_became_peered":"2024-04-25T09:02:46.108612+0000","last_unstale":"2024-04-25T09:02:46.111587+0000","last_undegraded":"2024-04-25T09:02:46.111587+0000","last_fullsized":"2024-04-25T09:02:46.111587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.876030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101553+0000","last_change":"2024-04-25T09:02:46.101553+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101553+0000","last_undegraded":"2024-04-25T09:02:46.101553+0000","last_fullsized":"2024-04-25T09:02:46.101553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112358+0000","last_change":"2024-04-25T09:02:46.111031+0000","last_active":"2024-04-25T09:02:46.112358+0000","last_peered":"2024-04-25T09:02:46.112358+0000","last_clean":"2024-04-25T09:02:46.112358+0000","last_became_active":"2024-04-25T09:02:46.110664+0000","last_became_peered":"2024-04-25T09:02:46.110664+0000","last_unstale":"2024-04-25T09:02:46.112358+0000","last_undegraded":"2024-04-25T09:02:46.112358+0000","last_fullsized":"2024-04-25T09:02:46.112358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:07.412157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098745+0000","last_change":"2024-04-25T09:02:46.098745+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098745+0000","last_undegraded":"2024-04-25T09:02:46.098745+0000","last_fullsized":"2024-04-25T09:02:46.098745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.113409+0000","last_change":"2024-04-25T09:02:46.111562+0000","last_active":"2024-04-25T09:02:46.113409+0000","last_peered":"2024-04-25T09:02:46.113409+0000","last_clean":"2024-04-25T09:02:46.113409+0000","last_became_active":"2024-04-25T09:02:46.111293+0000","last_became_peered":"2024-04-25T09:02:46.111293+0000","last_unstale":"2024-04-25T09:02:46.113409+0000","last_undegraded":"2024-04-25T09:02:46.113409+0000","last_fullsized":"2024-04-25T09:02:46.113409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:21.427649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099749+0000","last_change":"2024-04-25T09:02:46.099749+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099749+0000","last_undegraded":"2024-04-25T09:02:46.099749+0000","last_fullsized":"2024-04-25T09:02:46.099749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110651+0000","last_change":"2024-04-25T09:02:46.106809+0000","last_active":"2024-04-25T09:02:46.110651+0000","last_peered":"2024-04-25T09:02:46.110651+0000","last_clean":"2024-04-25T09:02:46.110651+0000","last_became_active":"2024-04-25T09:02:46.106520+0000","last_became_peered":"2024-04-25T09:02:46.106520+0000","last_unstale":"2024-04-25T09:02:46.110651+0000","last_undegraded":"2024-04-25T09:02:46.110651+0000","last_fullsized":"2024-04-25T09:02:46.110651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:52.422907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099608+0000","last_change":"2024-04-25T09:02:46.099608+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099608+0000","last_undegraded":"2024-04-25T09:02:46.099608+0000","last_fullsized":"2024-04-25T09:02:46.099608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111218+0000","last_change":"2024-04-25T09:02:46.109982+0000","last_active":"2024-04-25T09:02:46.111218+0000","last_peered":"2024-04-25T09:02:46.111218+0000","last_clean":"2024-04-25T09:02:46.111218+0000","last_became_active":"2024-04-25T09:02:46.109619+0000","last_became_peered":"2024-04-25T09:02:46.109619+0000","last_unstale":"2024-04-25T09:02:46.111218+0000","last_undegraded":"2024-04-25T09:02:46.111218+0000","last_fullsized":"2024-04-25T09:02:46.111218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:54.002553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103412+0000","last_change":"2024-04-25T09:02:46.103412+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103412+0000","last_undegraded":"2024-04-25T09:02:46.103412+0000","last_fullsized":"2024-04-25T09:02:46.103412+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114768+0000","last_change":"2024-04-25T09:02:46.111543+0000","last_active":"2024-04-25T09:02:46.114768+0000","last_peered":"2024-04-25T09:02:46.114768+0000","last_clean":"2024-04-25T09:02:46.114768+0000","last_became_active":"2024-04-25T09:02:46.111246+0000","last_became_peered":"2024-04-25T09:02:46.111246+0000","last_unstale":"2024-04-25T09:02:46.114768+0000","last_undegraded":"2024-04-25T09:02:46.114768+0000","last_fullsized":"2024-04-25T09:02:46.114768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:36.015097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097618+0000","last_change":"2024-04-25T09:02:46.097618+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097618+0000","last_undegraded":"2024-04-25T09:02:46.097618+0000","last_fullsized":"2024-04-25T09:02:46.097618+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114959+0000","last_change":"2024-04-25T09:02:46.112103+0000","last_active":"2024-04-25T09:02:46.114959+0000","last_peered":"2024-04-25T09:02:46.114959+0000","last_clean":"2024-04-25T09:02:46.114959+0000","last_became_active":"2024-04-25T09:02:46.111812+0000","last_became_peered":"2024-04-25T09:02:46.111812+0000","last_unstale":"2024-04-25T09:02:46.114959+0000","last_undegraded":"2024-04-25T09:02:46.114959+0000","last_fullsized":"2024-04-25T09:02:46.114959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:17.128028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104948+0000","last_change":"2024-04-25T09:02:46.104948+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104948+0000","last_undegraded":"2024-04-25T09:02:46.104948+0000","last_fullsized":"2024-04-25T09:02:46.104948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110008+0000","last_change":"2024-04-25T09:02:46.108910+0000","last_active":"2024-04-25T09:02:46.110008+0000","last_peered":"2024-04-25T09:02:46.110008+0000","last_clean":"2024-04-25T09:02:46.110008+0000","last_became_active":"2024-04-25T09:02:46.108573+0000","last_became_peered":"2024-04-25T09:02:46.108573+0000","last_unstale":"2024-04-25T09:02:46.110008+0000","last_undegraded":"2024-04-25T09:02:46.110008+0000","last_fullsized":"2024-04-25T09:02:46.110008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.251134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101217+0000","last_change":"2024-04-25T09:02:46.101217+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101217+0000","last_undegraded":"2024-04-25T09:02:46.101217+0000","last_fullsized":"2024-04-25T09:02:46.101217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114540+0000","last_change":"2024-04-25T09:02:46.113989+0000","last_active":"2024-04-25T09:02:46.114540+0000","last_peered":"2024-04-25T09:02:46.114540+0000","last_clean":"2024-04-25T09:02:46.114540+0000","last_became_active":"2024-04-25T09:02:46.113641+0000","last_became_peered":"2024-04-25T09:02:46.113641+0000","last_unstale":"2024-04-25T09:02:46.114540+0000","last_undegraded":"2024-04-25T09:02:46.114540+0000","last_fullsized":"2024-04-25T09:02:46.114540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098719+0000","last_change":"2024-04-25T09:02:46.098719+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098719+0000","last_undegraded":"2024-04-25T09:02:46.098719+0000","last_fullsized":"2024-04-25T09:02:46.098719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112124+0000","last_change":"2024-04-25T09:02:46.110506+0000","last_active":"2024-04-25T09:02:46.112124+0000","last_peered":"2024-04-25T09:02:46.112124+0000","last_clean":"2024-04-25T09:02:46.112124+0000","last_became_active":"2024-04-25T09:02:46.110209+0000","last_became_peered":"2024-04-25T09:02:46.110209+0000","last_unstale":"2024-04-25T09:02:46.112124+0000","last_undegraded":"2024-04-25T09:02:46.112124+0000","last_fullsized":"2024-04-25T09:02:46.112124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.252066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103407+0000","last_change":"2024-04-25T09:02:46.103407+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103407+0000","last_undegraded":"2024-04-25T09:02:46.103407+0000","last_fullsized":"2024-04-25T09:02:46.103407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112780+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:46.112780+0000","last_peered":"2024-04-25T09:02:46.112780+0000","last_clean":"2024-04-25T09:02:46.112780+0000","last_became_active":"2024-04-25T09:02:46.111500+0000","last_became_peered":"2024-04-25T09:02:46.111500+0000","last_unstale":"2024-04-25T09:02:46.112780+0000","last_undegraded":"2024-04-25T09:02:46.112780+0000","last_fullsized":"2024-04-25T09:02:46.112780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:46.184069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097507+0000","last_change":"2024-04-25T09:02:46.097507+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097507+0000","last_undegraded":"2024-04-25T09:02:46.097507+0000","last_fullsized":"2024-04-25T09:02:46.097507+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112124+0000","last_change":"2024-04-25T09:02:46.110806+0000","last_active":"2024-04-25T09:02:46.112124+0000","last_peered":"2024-04-25T09:02:46.112124+0000","last_clean":"2024-04-25T09:02:46.112124+0000","last_became_active":"2024-04-25T09:02:46.110506+0000","last_became_peered":"2024-04-25T09:02:46.110506+0000","last_unstale":"2024-04-25T09:02:46.112124+0000","last_undegraded":"2024-04-25T09:02:46.112124+0000","last_fullsized":"2024-04-25T09:02:46.112124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:22.527019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101709+0000","last_change":"2024-04-25T09:02:46.101709+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101709+0000","last_undegraded":"2024-04-25T09:02:46.101709+0000","last_fullsized":"2024-04-25T09:02:46.101709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109901+0000","last_change":"2024-04-25T09:02:46.108946+0000","last_active":"2024-04-25T09:02:46.109901+0000","last_peered":"2024-04-25T09:02:46.109901+0000","last_clean":"2024-04-25T09:02:46.109901+0000","last_became_active":"2024-04-25T09:02:46.108676+0000","last_became_peered":"2024-04-25T09:02:46.108676+0000","last_unstale":"2024-04-25T09:02:46.109901+0000","last_undegraded":"2024-04-25T09:02:46.109901+0000","last_fullsized":"2024-04-25T09:02:46.109901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:11.182109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101189+0000","last_change":"2024-04-25T09:02:46.101189+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101189+0000","last_undegraded":"2024-04-25T09:02:46.101189+0000","last_fullsized":"2024-04-25T09:02:46.101189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.116006+0000","last_change":"2024-04-25T09:02:46.115578+0000","last_active":"2024-04-25T09:02:46.116006+0000","last_peered":"2024-04-25T09:02:46.116006+0000","last_clean":"2024-04-25T09:02:46.116006+0000","last_became_active":"2024-04-25T09:02:46.115366+0000","last_became_peered":"2024-04-25T09:02:46.115366+0000","last_unstale":"2024-04-25T09:02:46.116006+0000","last_undegraded":"2024-04-25T09:02:46.116006+0000","last_fullsized":"2024-04-25T09:02:46.116006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:33.183002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.105522+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:02:46.105522+0000","last_peered":"2024-04-25T09:02:46.105522+0000","last_clean":"2024-04-25T09:02:46.105522+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:02:46.105522+0000","last_undegraded":"2024-04-25T09:02:46.105522+0000","last_fullsized":"2024-04-25T09:02:46.105522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46684,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325156,"statfs":{"total":96636764160,"available":96588959744,"internally_reserved":0,"allocated":1650688,"data_stored":1043672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46088,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325752,"statfs":{"total":96636764160,"available":96589570048,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50260,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321580,"statfs":{"total":96636764160,"available":96585297920,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50252,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321588,"statfs":{"total":96636764160,"available":96585306112,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58568,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313272,"statfs":{"total":96636764160,"available":96576790528,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343220,"statfs":{"total":96636764160,"available":96607457280,"internally_reserved":0,"allocated":1638400,"data_stored":1037397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:51.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:51.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.590+0000 7f6dbaf53640 1 Processor -- start 2024-04-25T09:02:51.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.590+0000 7f6dbaf53640 1 -- start start 2024-04-25T09:02:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6dbaf53640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6db40668f0 0x7f6db4066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6dbaf53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6dbaf53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db4067210 con 0x7f6db4161fe0 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6dbaf53640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40b5740 con 0x7f6db40668f0 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6dbaf53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40b5a20 con 0x7f6db4162460 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6db3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6db4161fe0 0x7f6db40b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48172/0 (socket says 172.21.15.5:48172) 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6db3fff640 1 -- 172.21.15.5:0/4073576730 learned_addr learned my addr 172.21.15.5:0/4073576730 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6db8cef640 1 --2- 172.21.15.5:0/4073576730 >> v2:172.21.15.80:3300/0 conn(0x7f6db40668f0 0x7f6db4066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6db94f0640 1 --2- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6db37fe640 1 -- 172.21.15.5:0/4073576730 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283101772 0 0) 0x7f6db4067210 con 0x7f6db4161fe0 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.591+0000 7f6db37fe640 1 -- 172.21.15.5:0/4073576730 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da0003520 con 0x7f6db4161fe0 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.592+0000 7f6db8cef640 1 -- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 msgr2=0x7f6db406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.592+0000 7f6db8cef640 1 --2- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db406d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.592+0000 7f6db8cef640 1 -- 172.21.15.5:0/4073576730 >> v1:172.21.15.5:6789/0 conn(0x7f6db4161fe0 legacy=0x7f6db40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.592+0000 7f6db8cef640 1 -- 172.21.15.5:0/4073576730 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40b5d00 con 0x7f6db40668f0 2024-04-25T09:02:51.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.592+0000 7f6db8cef640 1 --2- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db40668f0 0x7f6db4066cd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae5d42c2202da14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.592+0000 7f6db37fe640 1 -- 172.21.15.5:0/4073576730 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac007740 con 0x7f6db40668f0 2024-04-25T09:02:51.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6db37fe640 1 -- 172.21.15.5:0/4073576730 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac0078e0 con 0x7f6db40668f0 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6db37fe640 1 -- 172.21.15.5:0/4073576730 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac007c90 con 0x7f6db40668f0 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 -- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db40668f0 msgr2=0x7f6db4066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db40668f0 0x7f6db4066cd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac02a660 comp rx=0 tx=0).stop 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 -- 172.21.15.5:0/4073576730 shutdown_connections 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/4073576730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db40668f0 0x7f6db4066cd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 -- 172.21.15.5:0/4073576730 >> 172.21.15.5:0/4073576730 conn(0x7f6db40b25d0 msgr2=0x7f6db40b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 -- 172.21.15.5:0/4073576730 shutdown_connections 2024-04-25T09:02:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.593+0000 7f6dbaf53640 1 -- 172.21.15.5:0/4073576730 wait complete. 2024-04-25T09:02:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.594+0000 7f6dbaf53640 1 Processor -- start 2024-04-25T09:02:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.594+0000 7f6dbaf53640 1 -- start start 2024-04-25T09:02:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6dbaf53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db40668f0 0x7f6db4143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6dbaf53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db4161fe0 0x7f6db41f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6dbaf53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6dbaf53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40b3fe0 con 0x7f6db40668f0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6dbaf53640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4161ac0 con 0x7f6db4161fe0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6dbaf53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db406f030 con 0x7f6db4162460 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6db8cef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db40668f0 0x7f6db4143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6db8cef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db40668f0 0x7f6db4143340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47244/0 (socket says 172.21.15.5:47244) 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6db8cef640 1 -- 172.21.15.5:0/2628004682 learned_addr learned my addr 172.21.15.5:0/2628004682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6db94f0640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.595+0000 7f6db3fff640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db4161fe0 0x7f6db41f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db8cef640 1 -- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 msgr2=0x7f6db415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db8cef640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db415a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db8cef640 1 -- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db4161fe0 msgr2=0x7f6db41f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db8cef640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db4161fe0 0x7f6db41f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db8cef640 1 -- 172.21.15.5:0/2628004682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4143880 con 0x7f6db40668f0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db8cef640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db40668f0 0x7f6db4143340 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6dac02ac50 tx=0x7f6dac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db17fa640 1 -- 172.21.15.5:0/2628004682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac03f070 con 0x7f6db40668f0 2024-04-25T09:02:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db17fa640 1 -- 172.21.15.5:0/2628004682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac031c40 con 0x7f6db40668f0 2024-04-25T09:02:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db4145040 con 0x7f6db40668f0 2024-04-25T09:02:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6db17fa640 1 -- 172.21.15.5:0/2628004682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac009450 con 0x7f6db40668f0 2024-04-25T09:02:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.596+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db4145600 con 0x7f6db40668f0 2024-04-25T09:02:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.597+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db404ef20 con 0x7f6db40668f0 2024-04-25T09:02:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.597+0000 7f6db17fa640 1 -- 172.21.15.5:0/2628004682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6dac03b410 con 0x7f6db40668f0 2024-04-25T09:02:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.598+0000 7f6db17fa640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d9406b4d0 0x7f6d9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.598+0000 7f6db17fa640 1 -- 172.21.15.5:0/2628004682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dac0ab750 con 0x7f6db40668f0 2024-04-25T09:02:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.598+0000 7f6db3fff640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d9406b4d0 0x7f6d9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.599+0000 7f6db3fff640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d9406b4d0 0x7f6d9406d990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6db415b8b0 tx=0x7f6da4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.602+0000 7f6db17fa640 1 -- 172.21.15.5:0/2628004682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6dac07a010 con 0x7f6db40668f0 2024-04-25T09:02:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.780+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6db4071c30 con 0x7f6d9406b4d0 2024-04-25T09:02:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.787+0000 7f6db17fa640 1 -- 172.21.15.5:0/2628004682 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246766 (secure 0 0 0) 0x7f6db4071c30 con 0x7f6d9406b4d0 2024-04-25T09:02:51.777 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:51.779 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d9406b4d0 msgr2=0x7f6d9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d9406b4d0 0x7f6d9406d990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6db415b8b0 tx=0x7f6da4009040 comp rx=0 tx=0).stop 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db40668f0 msgr2=0x7f6db4143340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db40668f0 0x7f6db4143340 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6dac02ac50 tx=0x7f6dac004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 shutdown_connections 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6d9406b4d0 0x7f6d9406d990 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6db4162460 0x7f6db415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6db4161fe0 0x7f6db41f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 --2- 172.21.15.5:0/2628004682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db40668f0 0x7f6db4143340 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 >> 172.21.15.5:0/2628004682 conn(0x7f6db40b25d0 msgr2=0x7f6db40b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 shutdown_connections 2024-04-25T09:02:51.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.790+0000 7f6dbaf53640 1 -- 172.21.15.5:0/2628004682 wait complete. 2024-04-25T09:02:51.789 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-04-25T09:02:50.470013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":353224,"kb_used_data":9368,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754621496,"statfs":{"total":773094113280,"available":772732411904,"internally_reserved":0,"allocated":9592832,"data_stored":4782068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.380364"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105103+0000","last_change":"2024-04-25T09:02:46.105103+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105103+0000","last_undegraded":"2024-04-25T09:02:46.105103+0000","last_fullsized":"2024-04-25T09:02:46.105103+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101307+0000","last_change":"2024-04-25T09:02:46.101307+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101307+0000","last_undegraded":"2024-04-25T09:02:46.101307+0000","last_fullsized":"2024-04-25T09:02:46.101307+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099410+0000","last_change":"2024-04-25T09:02:46.099410+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099410+0000","last_undegraded":"2024-04-25T09:02:46.099410+0000","last_fullsized":"2024-04-25T09:02:46.099410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103515+0000","last_change":"2024-04-25T09:02:46.103515+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103515+0000","last_undegraded":"2024-04-25T09:02:46.103515+0000","last_fullsized":"2024-04-25T09:02:46.103515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102637+0000","last_change":"2024-04-25T09:02:46.102637+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102637+0000","last_undegraded":"2024-04-25T09:02:46.102637+0000","last_fullsized":"2024-04-25T09:02:46.102637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099269+0000","last_change":"2024-04-25T09:02:46.099269+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099269+0000","last_undegraded":"2024-04-25T09:02:46.099269+0000","last_fullsized":"2024-04-25T09:02:46.099269+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103027+0000","last_change":"2024-04-25T09:02:46.103027+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103027+0000","last_undegraded":"2024-04-25T09:02:46.103027+0000","last_fullsized":"2024-04-25T09:02:46.103027+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099716+0000","last_change":"2024-04-25T09:02:46.099716+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099716+0000","last_undegraded":"2024-04-25T09:02:46.099716+0000","last_fullsized":"2024-04-25T09:02:46.099716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099762+0000","last_change":"2024-04-25T09:02:46.099762+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099762+0000","last_undegraded":"2024-04-25T09:02:46.099762+0000","last_fullsized":"2024-04-25T09:02:46.099762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102820+0000","last_change":"2024-04-25T09:02:46.102820+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102820+0000","last_undegraded":"2024-04-25T09:02:46.102820+0000","last_fullsized":"2024-04-25T09:02:46.102820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100796+0000","last_change":"2024-04-25T09:02:46.100796+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100796+0000","last_undegraded":"2024-04-25T09:02:46.100796+0000","last_fullsized":"2024-04-25T09:02:46.100796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.106181+0000","last_change":"2024-04-25T09:02:46.106181+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.106181+0000","last_undegraded":"2024-04-25T09:02:46.106181+0000","last_fullsized":"2024-04-25T09:02:46.106181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098331+0000","last_change":"2024-04-25T09:02:46.098331+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098331+0000","last_undegraded":"2024-04-25T09:02:46.098331+0000","last_fullsized":"2024-04-25T09:02:46.098331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104072+0000","last_change":"2024-04-25T09:02:46.104072+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104072+0000","last_undegraded":"2024-04-25T09:02:46.104072+0000","last_fullsized":"2024-04-25T09:02:46.104072+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103675+0000","last_change":"2024-04-25T09:02:46.103675+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103675+0000","last_undegraded":"2024-04-25T09:02:46.103675+0000","last_fullsized":"2024-04-25T09:02:46.103675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101198+0000","last_change":"2024-04-25T09:02:46.101198+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101198+0000","last_undegraded":"2024-04-25T09:02:46.101198+0000","last_fullsized":"2024-04-25T09:02:46.101198+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103055+0000","last_change":"2024-04-25T09:02:46.103055+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103055+0000","last_undegraded":"2024-04-25T09:02:46.103055+0000","last_fullsized":"2024-04-25T09:02:46.103055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101671+0000","last_change":"2024-04-25T09:02:46.101671+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101671+0000","last_undegraded":"2024-04-25T09:02:46.101671+0000","last_fullsized":"2024-04-25T09:02:46.101671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101204+0000","last_change":"2024-04-25T09:02:46.101204+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101204+0000","last_undegraded":"2024-04-25T09:02:46.101204+0000","last_fullsized":"2024-04-25T09:02:46.101204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101321+0000","last_change":"2024-04-25T09:02:46.101321+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101321+0000","last_undegraded":"2024-04-25T09:02:46.101321+0000","last_fullsized":"2024-04-25T09:02:46.101321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100400+0000","last_change":"2024-04-25T09:02:46.100400+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100400+0000","last_undegraded":"2024-04-25T09:02:46.100400+0000","last_fullsized":"2024-04-25T09:02:46.100400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102404+0000","last_change":"2024-04-25T09:02:46.102404+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102404+0000","last_undegraded":"2024-04-25T09:02:46.102404+0000","last_fullsized":"2024-04-25T09:02:46.102404+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102131+0000","last_change":"2024-04-25T09:02:46.102131+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102131+0000","last_undegraded":"2024-04-25T09:02:46.102131+0000","last_fullsized":"2024-04-25T09:02:46.102131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100856+0000","last_change":"2024-04-25T09:02:46.100856+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100856+0000","last_undegraded":"2024-04-25T09:02:46.100856+0000","last_fullsized":"2024-04-25T09:02:46.100856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101737+0000","last_change":"2024-04-25T09:02:46.101737+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101737+0000","last_undegraded":"2024-04-25T09:02:46.101737+0000","last_fullsized":"2024-04-25T09:02:46.101737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098115+0000","last_change":"2024-04-25T09:02:46.098115+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098115+0000","last_undegraded":"2024-04-25T09:02:46.098115+0000","last_fullsized":"2024-04-25T09:02:46.098115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103112+0000","last_change":"2024-04-25T09:02:46.103112+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103112+0000","last_undegraded":"2024-04-25T09:02:46.103112+0000","last_fullsized":"2024-04-25T09:02:46.103112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105774+0000","last_change":"2024-04-25T09:02:46.105774+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105774+0000","last_undegraded":"2024-04-25T09:02:46.105774+0000","last_fullsized":"2024-04-25T09:02:46.105774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101735+0000","last_change":"2024-04-25T09:02:46.101735+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101735+0000","last_undegraded":"2024-04-25T09:02:46.101735+0000","last_fullsized":"2024-04-25T09:02:46.101735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100420+0000","last_change":"2024-04-25T09:02:46.100420+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100420+0000","last_undegraded":"2024-04-25T09:02:46.100420+0000","last_fullsized":"2024-04-25T09:02:46.100420+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100964+0000","last_change":"2024-04-25T09:02:46.100964+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100964+0000","last_undegraded":"2024-04-25T09:02:46.100964+0000","last_fullsized":"2024-04-25T09:02:46.100964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103151+0000","last_change":"2024-04-25T09:02:46.103151+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103151+0000","last_undegraded":"2024-04-25T09:02:46.103151+0000","last_fullsized":"2024-04-25T09:02:46.103151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103837+0000","last_change":"2024-04-25T09:02:46.103837+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103837+0000","last_undegraded":"2024-04-25T09:02:46.103837+0000","last_fullsized":"2024-04-25T09:02:46.103837+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112415+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:46.112415+0000","last_peered":"2024-04-25T09:02:46.112415+0000","last_clean":"2024-04-25T09:02:46.112415+0000","last_became_active":"2024-04-25T09:02:46.111552+0000","last_became_peered":"2024-04-25T09:02:46.111552+0000","last_unstale":"2024-04-25T09:02:46.112415+0000","last_undegraded":"2024-04-25T09:02:46.112415+0000","last_fullsized":"2024-04-25T09:02:46.112415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:50.181552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104186+0000","last_change":"2024-04-25T09:02:46.104186+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104186+0000","last_undegraded":"2024-04-25T09:02:46.104186+0000","last_fullsized":"2024-04-25T09:02:46.104186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.113103+0000","last_change":"2024-04-25T09:02:46.112288+0000","last_active":"2024-04-25T09:02:46.113103+0000","last_peered":"2024-04-25T09:02:46.113103+0000","last_clean":"2024-04-25T09:02:46.113103+0000","last_became_active":"2024-04-25T09:02:46.111207+0000","last_became_peered":"2024-04-25T09:02:46.111207+0000","last_unstale":"2024-04-25T09:02:46.113103+0000","last_undegraded":"2024-04-25T09:02:46.113103+0000","last_fullsized":"2024-04-25T09:02:46.113103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:18.520317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.105355+0000","last_change":"2024-04-25T09:02:46.105355+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.105355+0000","last_undegraded":"2024-04-25T09:02:46.105355+0000","last_fullsized":"2024-04-25T09:02:46.105355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114648+0000","last_change":"2024-04-25T09:02:46.114067+0000","last_active":"2024-04-25T09:02:46.114648+0000","last_peered":"2024-04-25T09:02:46.114648+0000","last_clean":"2024-04-25T09:02:46.114648+0000","last_became_active":"2024-04-25T09:02:46.113719+0000","last_became_peered":"2024-04-25T09:02:46.113719+0000","last_unstale":"2024-04-25T09:02:46.114648+0000","last_undegraded":"2024-04-25T09:02:46.114648+0000","last_fullsized":"2024-04-25T09:02:46.114648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:20.855675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098137+0000","last_change":"2024-04-25T09:02:46.098137+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098137+0000","last_undegraded":"2024-04-25T09:02:46.098137+0000","last_fullsized":"2024-04-25T09:02:46.098137+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115066+0000","last_change":"2024-04-25T09:02:46.114156+0000","last_active":"2024-04-25T09:02:46.115066+0000","last_peered":"2024-04-25T09:02:46.115066+0000","last_clean":"2024-04-25T09:02:46.115066+0000","last_became_active":"2024-04-25T09:02:46.113803+0000","last_became_peered":"2024-04-25T09:02:46.113803+0000","last_unstale":"2024-04-25T09:02:46.115066+0000","last_undegraded":"2024-04-25T09:02:46.115066+0000","last_fullsized":"2024-04-25T09:02:46.115066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:46.458086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100884+0000","last_change":"2024-04-25T09:02:46.100884+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100884+0000","last_undegraded":"2024-04-25T09:02:46.100884+0000","last_fullsized":"2024-04-25T09:02:46.100884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114842+0000","last_change":"2024-04-25T09:02:46.114380+0000","last_active":"2024-04-25T09:02:46.114842+0000","last_peered":"2024-04-25T09:02:46.114842+0000","last_clean":"2024-04-25T09:02:46.114842+0000","last_became_active":"2024-04-25T09:02:46.113834+0000","last_became_peered":"2024-04-25T09:02:46.113834+0000","last_unstale":"2024-04-25T09:02:46.114842+0000","last_undegraded":"2024-04-25T09:02:46.114842+0000","last_fullsized":"2024-04-25T09:02:46.114842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:22.527019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101710+0000","last_change":"2024-04-25T09:02:46.101710+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101710+0000","last_undegraded":"2024-04-25T09:02:46.101710+0000","last_fullsized":"2024-04-25T09:02:46.101710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112827+0000","last_change":"2024-04-25T09:02:46.112267+0000","last_active":"2024-04-25T09:02:46.112827+0000","last_peered":"2024-04-25T09:02:46.112827+0000","last_clean":"2024-04-25T09:02:46.112827+0000","last_became_active":"2024-04-25T09:02:46.111817+0000","last_became_peered":"2024-04-25T09:02:46.111817+0000","last_unstale":"2024-04-25T09:02:46.112827+0000","last_undegraded":"2024-04-25T09:02:46.112827+0000","last_fullsized":"2024-04-25T09:02:46.112827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.251134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098778+0000","last_change":"2024-04-25T09:02:46.098778+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098778+0000","last_undegraded":"2024-04-25T09:02:46.098778+0000","last_fullsized":"2024-04-25T09:02:46.098778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112157+0000","last_change":"2024-04-25T09:02:46.109390+0000","last_active":"2024-04-25T09:02:46.112157+0000","last_peered":"2024-04-25T09:02:46.112157+0000","last_clean":"2024-04-25T09:02:46.112157+0000","last_became_active":"2024-04-25T09:02:46.109096+0000","last_became_peered":"2024-04-25T09:02:46.109096+0000","last_unstale":"2024-04-25T09:02:46.112157+0000","last_undegraded":"2024-04-25T09:02:46.112157+0000","last_fullsized":"2024-04-25T09:02:46.112157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:13.631276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102814+0000","last_change":"2024-04-25T09:02:46.102814+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102814+0000","last_undegraded":"2024-04-25T09:02:46.102814+0000","last_fullsized":"2024-04-25T09:02:46.102814+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115004+0000","last_change":"2024-04-25T09:02:46.112851+0000","last_active":"2024-04-25T09:02:46.115004+0000","last_peered":"2024-04-25T09:02:46.115004+0000","last_clean":"2024-04-25T09:02:46.115004+0000","last_became_active":"2024-04-25T09:02:46.112581+0000","last_became_peered":"2024-04-25T09:02:46.112581+0000","last_unstale":"2024-04-25T09:02:46.115004+0000","last_undegraded":"2024-04-25T09:02:46.115004+0000","last_fullsized":"2024-04-25T09:02:46.115004+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:26.404498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103060+0000","last_change":"2024-04-25T09:02:46.103060+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103060+0000","last_undegraded":"2024-04-25T09:02:46.103060+0000","last_fullsized":"2024-04-25T09:02:46.103060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114526+0000","last_change":"2024-04-25T09:02:46.113990+0000","last_active":"2024-04-25T09:02:46.114526+0000","last_peered":"2024-04-25T09:02:46.114526+0000","last_clean":"2024-04-25T09:02:46.114526+0000","last_became_active":"2024-04-25T09:02:46.113649+0000","last_became_peered":"2024-04-25T09:02:46.113649+0000","last_unstale":"2024-04-25T09:02:46.114526+0000","last_undegraded":"2024-04-25T09:02:46.114526+0000","last_fullsized":"2024-04-25T09:02:46.114526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.563667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098779+0000","last_change":"2024-04-25T09:02:46.098779+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098779+0000","last_undegraded":"2024-04-25T09:02:46.098779+0000","last_fullsized":"2024-04-25T09:02:46.098779+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112131+0000","last_change":"2024-04-25T09:02:46.110608+0000","last_active":"2024-04-25T09:02:46.112131+0000","last_peered":"2024-04-25T09:02:46.112131+0000","last_clean":"2024-04-25T09:02:46.112131+0000","last_became_active":"2024-04-25T09:02:46.110313+0000","last_became_peered":"2024-04-25T09:02:46.110313+0000","last_unstale":"2024-04-25T09:02:46.112131+0000","last_undegraded":"2024-04-25T09:02:46.112131+0000","last_fullsized":"2024-04-25T09:02:46.112131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:18.520317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102008+0000","last_change":"2024-04-25T09:02:46.102008+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102008+0000","last_undegraded":"2024-04-25T09:02:46.102008+0000","last_fullsized":"2024-04-25T09:02:46.102008+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109596+0000","last_change":"2024-04-25T09:02:46.107640+0000","last_active":"2024-04-25T09:02:46.109596+0000","last_peered":"2024-04-25T09:02:46.109596+0000","last_clean":"2024-04-25T09:02:46.109596+0000","last_became_active":"2024-04-25T09:02:46.107347+0000","last_became_peered":"2024-04-25T09:02:46.107347+0000","last_unstale":"2024-04-25T09:02:46.109596+0000","last_undegraded":"2024-04-25T09:02:46.109596+0000","last_fullsized":"2024-04-25T09:02:46.109596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:11.182109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.102539+0000","last_change":"2024-04-25T09:02:46.102539+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.102539+0000","last_undegraded":"2024-04-25T09:02:46.102539+0000","last_fullsized":"2024-04-25T09:02:46.102539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111101+0000","last_change":"2024-04-25T09:02:46.110106+0000","last_active":"2024-04-25T09:02:46.111101+0000","last_peered":"2024-04-25T09:02:46.111101+0000","last_clean":"2024-04-25T09:02:46.111101+0000","last_became_active":"2024-04-25T09:02:46.109792+0000","last_became_peered":"2024-04-25T09:02:46.109792+0000","last_unstale":"2024-04-25T09:02:46.111101+0000","last_undegraded":"2024-04-25T09:02:46.111101+0000","last_fullsized":"2024-04-25T09:02:46.111101+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:09.311901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100736+0000","last_change":"2024-04-25T09:02:46.100736+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100736+0000","last_undegraded":"2024-04-25T09:02:46.100736+0000","last_fullsized":"2024-04-25T09:02:46.100736+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.115267+0000","last_change":"2024-04-25T09:02:46.113211+0000","last_active":"2024-04-25T09:02:46.115267+0000","last_peered":"2024-04-25T09:02:46.115267+0000","last_clean":"2024-04-25T09:02:46.115267+0000","last_became_active":"2024-04-25T09:02:46.112471+0000","last_became_peered":"2024-04-25T09:02:46.112471+0000","last_unstale":"2024-04-25T09:02:46.115267+0000","last_undegraded":"2024-04-25T09:02:46.115267+0000","last_fullsized":"2024-04-25T09:02:46.115267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.779157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097702+0000","last_change":"2024-04-25T09:02:46.097702+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097702+0000","last_undegraded":"2024-04-25T09:02:46.097702+0000","last_fullsized":"2024-04-25T09:02:46.097702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.117155+0000","last_change":"2024-04-25T09:02:46.116619+0000","last_active":"2024-04-25T09:02:46.117155+0000","last_peered":"2024-04-25T09:02:46.117155+0000","last_clean":"2024-04-25T09:02:46.117155+0000","last_became_active":"2024-04-25T09:02:46.116270+0000","last_became_peered":"2024-04-25T09:02:46.116270+0000","last_unstale":"2024-04-25T09:02:46.117155+0000","last_undegraded":"2024-04-25T09:02:46.117155+0000","last_fullsized":"2024-04-25T09:02:46.117155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:52.446351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100539+0000","last_change":"2024-04-25T09:02:46.100539+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100539+0000","last_undegraded":"2024-04-25T09:02:46.100539+0000","last_fullsized":"2024-04-25T09:02:46.100539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110463+0000","last_change":"2024-04-25T09:02:46.108915+0000","last_active":"2024-04-25T09:02:46.110463+0000","last_peered":"2024-04-25T09:02:46.110463+0000","last_clean":"2024-04-25T09:02:46.110463+0000","last_became_active":"2024-04-25T09:02:46.108574+0000","last_became_peered":"2024-04-25T09:02:46.108574+0000","last_unstale":"2024-04-25T09:02:46.110463+0000","last_undegraded":"2024-04-25T09:02:46.110463+0000","last_fullsized":"2024-04-25T09:02:46.110463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:07.251501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.100210+0000","last_change":"2024-04-25T09:02:46.100210+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.100210+0000","last_undegraded":"2024-04-25T09:02:46.100210+0000","last_fullsized":"2024-04-25T09:02:46.100210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109374+0000","last_change":"2024-04-25T09:02:46.107845+0000","last_active":"2024-04-25T09:02:46.109374+0000","last_peered":"2024-04-25T09:02:46.109374+0000","last_clean":"2024-04-25T09:02:46.109374+0000","last_became_active":"2024-04-25T09:02:46.106961+0000","last_became_peered":"2024-04-25T09:02:46.106961+0000","last_unstale":"2024-04-25T09:02:46.109374+0000","last_undegraded":"2024-04-25T09:02:46.109374+0000","last_fullsized":"2024-04-25T09:02:46.109374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097504+0000","last_change":"2024-04-25T09:02:46.097504+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097504+0000","last_undegraded":"2024-04-25T09:02:46.097504+0000","last_fullsized":"2024-04-25T09:02:46.097504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109847+0000","last_change":"2024-04-25T09:02:46.107715+0000","last_active":"2024-04-25T09:02:46.109847+0000","last_peered":"2024-04-25T09:02:46.109847+0000","last_clean":"2024-04-25T09:02:46.109847+0000","last_became_active":"2024-04-25T09:02:46.107421+0000","last_became_peered":"2024-04-25T09:02:46.107421+0000","last_unstale":"2024-04-25T09:02:46.109847+0000","last_undegraded":"2024-04-25T09:02:46.109847+0000","last_fullsized":"2024-04-25T09:02:46.109847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:46.184069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104719+0000","last_change":"2024-04-25T09:02:46.104719+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104719+0000","last_undegraded":"2024-04-25T09:02:46.104719+0000","last_fullsized":"2024-04-25T09:02:46.104719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114526+0000","last_change":"2024-04-25T09:02:46.111553+0000","last_active":"2024-04-25T09:02:46.114526+0000","last_peered":"2024-04-25T09:02:46.114526+0000","last_clean":"2024-04-25T09:02:46.114526+0000","last_became_active":"2024-04-25T09:02:46.111284+0000","last_became_peered":"2024-04-25T09:02:46.111284+0000","last_unstale":"2024-04-25T09:02:46.114526+0000","last_undegraded":"2024-04-25T09:02:46.114526+0000","last_fullsized":"2024-04-25T09:02:46.114526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101654+0000","last_change":"2024-04-25T09:02:46.101654+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101654+0000","last_undegraded":"2024-04-25T09:02:46.101654+0000","last_fullsized":"2024-04-25T09:02:46.101654+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111587+0000","last_change":"2024-04-25T09:02:46.108891+0000","last_active":"2024-04-25T09:02:46.111587+0000","last_peered":"2024-04-25T09:02:46.111587+0000","last_clean":"2024-04-25T09:02:46.111587+0000","last_became_active":"2024-04-25T09:02:46.108612+0000","last_became_peered":"2024-04-25T09:02:46.108612+0000","last_unstale":"2024-04-25T09:02:46.111587+0000","last_undegraded":"2024-04-25T09:02:46.111587+0000","last_fullsized":"2024-04-25T09:02:46.111587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.876030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101553+0000","last_change":"2024-04-25T09:02:46.101553+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101553+0000","last_undegraded":"2024-04-25T09:02:46.101553+0000","last_fullsized":"2024-04-25T09:02:46.101553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112358+0000","last_change":"2024-04-25T09:02:46.111031+0000","last_active":"2024-04-25T09:02:46.112358+0000","last_peered":"2024-04-25T09:02:46.112358+0000","last_clean":"2024-04-25T09:02:46.112358+0000","last_became_active":"2024-04-25T09:02:46.110664+0000","last_became_peered":"2024-04-25T09:02:46.110664+0000","last_unstale":"2024-04-25T09:02:46.112358+0000","last_undegraded":"2024-04-25T09:02:46.112358+0000","last_fullsized":"2024-04-25T09:02:46.112358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:07.412157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098745+0000","last_change":"2024-04-25T09:02:46.098745+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098745+0000","last_undegraded":"2024-04-25T09:02:46.098745+0000","last_fullsized":"2024-04-25T09:02:46.098745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.113409+0000","last_change":"2024-04-25T09:02:46.111562+0000","last_active":"2024-04-25T09:02:46.113409+0000","last_peered":"2024-04-25T09:02:46.113409+0000","last_clean":"2024-04-25T09:02:46.113409+0000","last_became_active":"2024-04-25T09:02:46.111293+0000","last_became_peered":"2024-04-25T09:02:46.111293+0000","last_unstale":"2024-04-25T09:02:46.113409+0000","last_undegraded":"2024-04-25T09:02:46.113409+0000","last_fullsized":"2024-04-25T09:02:46.113409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:21.427649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099749+0000","last_change":"2024-04-25T09:02:46.099749+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099749+0000","last_undegraded":"2024-04-25T09:02:46.099749+0000","last_fullsized":"2024-04-25T09:02:46.099749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110651+0000","last_change":"2024-04-25T09:02:46.106809+0000","last_active":"2024-04-25T09:02:46.110651+0000","last_peered":"2024-04-25T09:02:46.110651+0000","last_clean":"2024-04-25T09:02:46.110651+0000","last_became_active":"2024-04-25T09:02:46.106520+0000","last_became_peered":"2024-04-25T09:02:46.106520+0000","last_unstale":"2024-04-25T09:02:46.110651+0000","last_undegraded":"2024-04-25T09:02:46.110651+0000","last_fullsized":"2024-04-25T09:02:46.110651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:52.422907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.099608+0000","last_change":"2024-04-25T09:02:46.099608+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.099608+0000","last_undegraded":"2024-04-25T09:02:46.099608+0000","last_fullsized":"2024-04-25T09:02:46.099608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.111218+0000","last_change":"2024-04-25T09:02:46.109982+0000","last_active":"2024-04-25T09:02:46.111218+0000","last_peered":"2024-04-25T09:02:46.111218+0000","last_clean":"2024-04-25T09:02:46.111218+0000","last_became_active":"2024-04-25T09:02:46.109619+0000","last_became_peered":"2024-04-25T09:02:46.109619+0000","last_unstale":"2024-04-25T09:02:46.111218+0000","last_undegraded":"2024-04-25T09:02:46.111218+0000","last_fullsized":"2024-04-25T09:02:46.111218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:54.002553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103412+0000","last_change":"2024-04-25T09:02:46.103412+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103412+0000","last_undegraded":"2024-04-25T09:02:46.103412+0000","last_fullsized":"2024-04-25T09:02:46.103412+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114768+0000","last_change":"2024-04-25T09:02:46.111543+0000","last_active":"2024-04-25T09:02:46.114768+0000","last_peered":"2024-04-25T09:02:46.114768+0000","last_clean":"2024-04-25T09:02:46.114768+0000","last_became_active":"2024-04-25T09:02:46.111246+0000","last_became_peered":"2024-04-25T09:02:46.111246+0000","last_unstale":"2024-04-25T09:02:46.114768+0000","last_undegraded":"2024-04-25T09:02:46.114768+0000","last_fullsized":"2024-04-25T09:02:46.114768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:36.015097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097618+0000","last_change":"2024-04-25T09:02:46.097618+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097618+0000","last_undegraded":"2024-04-25T09:02:46.097618+0000","last_fullsized":"2024-04-25T09:02:46.097618+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114959+0000","last_change":"2024-04-25T09:02:46.112103+0000","last_active":"2024-04-25T09:02:46.114959+0000","last_peered":"2024-04-25T09:02:46.114959+0000","last_clean":"2024-04-25T09:02:46.114959+0000","last_became_active":"2024-04-25T09:02:46.111812+0000","last_became_peered":"2024-04-25T09:02:46.111812+0000","last_unstale":"2024-04-25T09:02:46.114959+0000","last_undegraded":"2024-04-25T09:02:46.114959+0000","last_fullsized":"2024-04-25T09:02:46.114959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:17.128028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.104948+0000","last_change":"2024-04-25T09:02:46.104948+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.104948+0000","last_undegraded":"2024-04-25T09:02:46.104948+0000","last_fullsized":"2024-04-25T09:02:46.104948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.110008+0000","last_change":"2024-04-25T09:02:46.108910+0000","last_active":"2024-04-25T09:02:46.110008+0000","last_peered":"2024-04-25T09:02:46.110008+0000","last_clean":"2024-04-25T09:02:46.110008+0000","last_became_active":"2024-04-25T09:02:46.108573+0000","last_became_peered":"2024-04-25T09:02:46.108573+0000","last_unstale":"2024-04-25T09:02:46.110008+0000","last_undegraded":"2024-04-25T09:02:46.110008+0000","last_fullsized":"2024-04-25T09:02:46.110008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.251134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101217+0000","last_change":"2024-04-25T09:02:46.101217+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101217+0000","last_undegraded":"2024-04-25T09:02:46.101217+0000","last_fullsized":"2024-04-25T09:02:46.101217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.114540+0000","last_change":"2024-04-25T09:02:46.113989+0000","last_active":"2024-04-25T09:02:46.114540+0000","last_peered":"2024-04-25T09:02:46.114540+0000","last_clean":"2024-04-25T09:02:46.114540+0000","last_became_active":"2024-04-25T09:02:46.113641+0000","last_became_peered":"2024-04-25T09:02:46.113641+0000","last_unstale":"2024-04-25T09:02:46.114540+0000","last_undegraded":"2024-04-25T09:02:46.114540+0000","last_fullsized":"2024-04-25T09:02:46.114540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.098719+0000","last_change":"2024-04-25T09:02:46.098719+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.098719+0000","last_undegraded":"2024-04-25T09:02:46.098719+0000","last_fullsized":"2024-04-25T09:02:46.098719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112124+0000","last_change":"2024-04-25T09:02:46.110506+0000","last_active":"2024-04-25T09:02:46.112124+0000","last_peered":"2024-04-25T09:02:46.112124+0000","last_clean":"2024-04-25T09:02:46.112124+0000","last_became_active":"2024-04-25T09:02:46.110209+0000","last_became_peered":"2024-04-25T09:02:46.110209+0000","last_unstale":"2024-04-25T09:02:46.112124+0000","last_undegraded":"2024-04-25T09:02:46.112124+0000","last_fullsized":"2024-04-25T09:02:46.112124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.252066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.103407+0000","last_change":"2024-04-25T09:02:46.103407+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.103407+0000","last_undegraded":"2024-04-25T09:02:46.103407+0000","last_fullsized":"2024-04-25T09:02:46.103407+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112780+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:46.112780+0000","last_peered":"2024-04-25T09:02:46.112780+0000","last_clean":"2024-04-25T09:02:46.112780+0000","last_became_active":"2024-04-25T09:02:46.111500+0000","last_became_peered":"2024-04-25T09:02:46.111500+0000","last_unstale":"2024-04-25T09:02:46.112780+0000","last_undegraded":"2024-04-25T09:02:46.112780+0000","last_fullsized":"2024-04-25T09:02:46.112780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:46.184069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.097507+0000","last_change":"2024-04-25T09:02:46.097507+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.097507+0000","last_undegraded":"2024-04-25T09:02:46.097507+0000","last_fullsized":"2024-04-25T09:02:46.097507+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.112124+0000","last_change":"2024-04-25T09:02:46.110806+0000","last_active":"2024-04-25T09:02:46.112124+0000","last_peered":"2024-04-25T09:02:46.112124+0000","last_clean":"2024-04-25T09:02:46.112124+0000","last_became_active":"2024-04-25T09:02:46.110506+0000","last_became_peered":"2024-04-25T09:02:46.110506+0000","last_unstale":"2024-04-25T09:02:46.112124+0000","last_undegraded":"2024-04-25T09:02:46.112124+0000","last_fullsized":"2024-04-25T09:02:46.112124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:22.527019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101709+0000","last_change":"2024-04-25T09:02:46.101709+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101709+0000","last_undegraded":"2024-04-25T09:02:46.101709+0000","last_fullsized":"2024-04-25T09:02:46.101709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.109901+0000","last_change":"2024-04-25T09:02:46.108946+0000","last_active":"2024-04-25T09:02:46.109901+0000","last_peered":"2024-04-25T09:02:46.109901+0000","last_clean":"2024-04-25T09:02:46.109901+0000","last_became_active":"2024-04-25T09:02:46.108676+0000","last_became_peered":"2024-04-25T09:02:46.108676+0000","last_unstale":"2024-04-25T09:02:46.109901+0000","last_undegraded":"2024-04-25T09:02:46.109901+0000","last_fullsized":"2024-04-25T09:02:46.109901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:11.182109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-04-25T09:02:46.101189+0000","last_change":"2024-04-25T09:02:46.101189+0000","last_active":"2024-04-25T09:02:46.089276+0000","last_peered":"2024-04-25T09:02:46.089276+0000","last_clean":"2024-04-25T09:02:46.089276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:46.101189+0000","last_undegraded":"2024-04-25T09:02:46.101189+0000","last_fullsized":"2024-04-25T09:02:46.101189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.116006+0000","last_change":"2024-04-25T09:02:46.115578+0000","last_active":"2024-04-25T09:02:46.116006+0000","last_peered":"2024-04-25T09:02:46.116006+0000","last_clean":"2024-04-25T09:02:46.116006+0000","last_became_active":"2024-04-25T09:02:46.115366+0000","last_became_peered":"2024-04-25T09:02:46.115366+0000","last_unstale":"2024-04-25T09:02:46.116006+0000","last_undegraded":"2024-04-25T09:02:46.116006+0000","last_fullsized":"2024-04-25T09:02:46.116006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:33.183002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T09:02:46.105522+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:02:46.105522+0000","last_peered":"2024-04-25T09:02:46.105522+0000","last_clean":"2024-04-25T09:02:46.105522+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:02:46.105522+0000","last_undegraded":"2024-04-25T09:02:46.105522+0000","last_fullsized":"2024-04-25T09:02:46.105522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46684,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325156,"statfs":{"total":96636764160,"available":96588959744,"internally_reserved":0,"allocated":1650688,"data_stored":1043672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46088,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325752,"statfs":{"total":96636764160,"available":96589570048,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50260,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321580,"statfs":{"total":96636764160,"available":96585297920,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50252,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321588,"statfs":{"total":96636764160,"available":96585306112,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1056768,"data_stored":453304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58568,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313272,"statfs":{"total":96636764160,"available":96576790528,"internally_reserved":0,"allocated":1044480,"data_stored":447029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28620,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343220,"statfs":{"total":96636764160,"available":96607457280,"internally_reserved":0,"allocated":1638400,"data_stored":1037397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-04-25T09:02:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.105103+0000', 'last_change': '2024-04-25T09:02:46.105103+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.105103+0000', 'last_undegraded': '2024-04-25T09:02:46.105103+0000', 'last_fullsized': '2024-04-25T09:02:46.105103+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-04-25T09:02:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101307+0000', 'last_change': '2024-04-25T09:02:46.101307+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101307+0000', 'last_undegraded': '2024-04-25T09:02:46.101307+0000', 'last_fullsized': '2024-04-25T09:02:46.101307+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-04-25T09:02:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.099410+0000', 'last_change': '2024-04-25T09:02:46.099410+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.099410+0000', 'last_undegraded': '2024-04-25T09:02:46.099410+0000', 'last_fullsized': '2024-04-25T09:02:46.099410+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103515+0000', 'last_change': '2024-04-25T09:02:46.103515+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103515+0000', 'last_undegraded': '2024-04-25T09:02:46.103515+0000', 'last_fullsized': '2024-04-25T09:02:46.103515+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.102637+0000', 'last_change': '2024-04-25T09:02:46.102637+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.102637+0000', 'last_undegraded': '2024-04-25T09:02:46.102637+0000', 'last_fullsized': '2024-04-25T09:02:46.102637+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.099269+0000', 'last_change': '2024-04-25T09:02:46.099269+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.099269+0000', 'last_undegraded': '2024-04-25T09:02:46.099269+0000', 'last_fullsized': '2024-04-25T09:02:46.099269+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103027+0000', 'last_change': '2024-04-25T09:02:46.103027+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103027+0000', 'last_undegraded': '2024-04-25T09:02:46.103027+0000', 'last_fullsized': '2024-04-25T09:02:46.103027+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.099716+0000', 'last_change': '2024-04-25T09:02:46.099716+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.099716+0000', 'last_undegraded': '2024-04-25T09:02:46.099716+0000', 'last_fullsized': '2024-04-25T09:02:46.099716+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.099762+0000', 'last_change': '2024-04-25T09:02:46.099762+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.099762+0000', 'last_undegraded': '2024-04-25T09:02:46.099762+0000', 'last_fullsized': '2024-04-25T09:02:46.099762+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.102820+0000', 'last_change': '2024-04-25T09:02:46.102820+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.102820+0000', 'last_undegraded': '2024-04-25T09:02:46.102820+0000', 'last_fullsized': '2024-04-25T09:02:46.102820+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100796+0000', 'last_change': '2024-04-25T09:02:46.100796+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100796+0000', 'last_undegraded': '2024-04-25T09:02:46.100796+0000', 'last_fullsized': '2024-04-25T09:02:46.100796+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.106181+0000', 'last_change': '2024-04-25T09:02:46.106181+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.106181+0000', 'last_undegraded': '2024-04-25T09:02:46.106181+0000', 'last_fullsized': '2024-04-25T09:02:46.106181+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.098331+0000', 'last_change': '2024-04-25T09:02:46.098331+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.098331+0000', 'last_undegraded': '2024-04-25T09:02:46.098331+0000', 'last_fullsized': '2024-04-25T09:02:46.098331+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-04-25T09:02:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.104072+0000', 'last_change': '2024-04-25T09:02:46.104072+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.104072+0000', 'last_undegraded': '2024-04-25T09:02:46.104072+0000', 'last_fullsized': '2024-04-25T09:02:46.104072+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103675+0000', 'last_change': '2024-04-25T09:02:46.103675+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103675+0000', 'last_undegraded': '2024-04-25T09:02:46.103675+0000', 'last_fullsized': '2024-04-25T09:02:46.103675+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101198+0000', 'last_change': '2024-04-25T09:02:46.101198+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101198+0000', 'last_undegraded': '2024-04-25T09:02:46.101198+0000', 'last_fullsized': '2024-04-25T09:02:46.101198+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103055+0000', 'last_change': '2024-04-25T09:02:46.103055+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103055+0000', 'last_undegraded': '2024-04-25T09:02:46.103055+0000', 'last_fullsized': '2024-04-25T09:02:46.103055+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101671+0000', 'last_change': '2024-04-25T09:02:46.101671+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101671+0000', 'last_undegraded': '2024-04-25T09:02:46.101671+0000', 'last_fullsized': '2024-04-25T09:02:46.101671+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101204+0000', 'last_change': '2024-04-25T09:02:46.101204+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101204+0000', 'last_undegraded': '2024-04-25T09:02:46.101204+0000', 'last_fullsized': '2024-04-25T09:02:46.101204+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-04-25T09:02:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101321+0000', 'last_change': '2024-04-25T09:02:46.101321+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101321+0000', 'last_undegraded': '2024-04-25T09:02:46.101321+0000', 'last_fullsized': '2024-04-25T09:02:46.101321+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100400+0000', 'last_change': '2024-04-25T09:02:46.100400+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100400+0000', 'last_undegraded': '2024-04-25T09:02:46.100400+0000', 'last_fullsized': '2024-04-25T09:02:46.100400+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.102404+0000', 'last_change': '2024-04-25T09:02:46.102404+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.102404+0000', 'last_undegraded': '2024-04-25T09:02:46.102404+0000', 'last_fullsized': '2024-04-25T09:02:46.102404+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.102131+0000', 'last_change': '2024-04-25T09:02:46.102131+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.102131+0000', 'last_undegraded': '2024-04-25T09:02:46.102131+0000', 'last_fullsized': '2024-04-25T09:02:46.102131+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100856+0000', 'last_change': '2024-04-25T09:02:46.100856+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100856+0000', 'last_undegraded': '2024-04-25T09:02:46.100856+0000', 'last_fullsized': '2024-04-25T09:02:46.100856+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101737+0000', 'last_change': '2024-04-25T09:02:46.101737+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101737+0000', 'last_undegraded': '2024-04-25T09:02:46.101737+0000', 'last_fullsized': '2024-04-25T09:02:46.101737+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-04-25T09:02:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.098115+0000', 'last_change': '2024-04-25T09:02:46.098115+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.098115+0000', 'last_undegraded': '2024-04-25T09:02:46.098115+0000', 'last_fullsized': '2024-04-25T09:02:46.098115+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103112+0000', 'last_change': '2024-04-25T09:02:46.103112+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103112+0000', 'last_undegraded': '2024-04-25T09:02:46.103112+0000', 'last_fullsized': '2024-04-25T09:02:46.103112+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.105774+0000', 'last_change': '2024-04-25T09:02:46.105774+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.105774+0000', 'last_undegraded': '2024-04-25T09:02:46.105774+0000', 'last_fullsized': '2024-04-25T09:02:46.105774+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101735+0000', 'last_change': '2024-04-25T09:02:46.101735+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101735+0000', 'last_undegraded': '2024-04-25T09:02:46.101735+0000', 'last_fullsized': '2024-04-25T09:02:46.101735+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100420+0000', 'last_change': '2024-04-25T09:02:46.100420+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100420+0000', 'last_undegraded': '2024-04-25T09:02:46.100420+0000', 'last_fullsized': '2024-04-25T09:02:46.100420+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100964+0000', 'last_change': '2024-04-25T09:02:46.100964+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100964+0000', 'last_undegraded': '2024-04-25T09:02:46.100964+0000', 'last_fullsized': '2024-04-25T09:02:46.100964+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-04-25T09:02:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103151+0000', 'last_change': '2024-04-25T09:02:46.103151+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103151+0000', 'last_undegraded': '2024-04-25T09:02:46.103151+0000', 'last_fullsized': '2024-04-25T09:02:46.103151+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103837+0000', 'last_change': '2024-04-25T09:02:46.103837+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103837+0000', 'last_undegraded': '2024-04-25T09:02:46.103837+0000', 'last_fullsized': '2024-04-25T09:02:46.103837+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.104186+0000', 'last_change': '2024-04-25T09:02:46.104186+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.104186+0000', 'last_undegraded': '2024-04-25T09:02:46.104186+0000', 'last_fullsized': '2024-04-25T09:02:46.104186+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.105355+0000', 'last_change': '2024-04-25T09:02:46.105355+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.105355+0000', 'last_undegraded': '2024-04-25T09:02:46.105355+0000', 'last_fullsized': '2024-04-25T09:02:46.105355+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.098137+0000', 'last_change': '2024-04-25T09:02:46.098137+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.098137+0000', 'last_undegraded': '2024-04-25T09:02:46.098137+0000', 'last_fullsized': '2024-04-25T09:02:46.098137+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100884+0000', 'last_change': '2024-04-25T09:02:46.100884+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100884+0000', 'last_undegraded': '2024-04-25T09:02:46.100884+0000', 'last_fullsized': '2024-04-25T09:02:46.100884+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-04-25T09:02:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101710+0000', 'last_change': '2024-04-25T09:02:46.101710+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101710+0000', 'last_undegraded': '2024-04-25T09:02:46.101710+0000', 'last_fullsized': '2024-04-25T09:02:46.101710+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.098778+0000', 'last_change': '2024-04-25T09:02:46.098778+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.098778+0000', 'last_undegraded': '2024-04-25T09:02:46.098778+0000', 'last_fullsized': '2024-04-25T09:02:46.098778+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.102814+0000', 'last_change': '2024-04-25T09:02:46.102814+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.102814+0000', 'last_undegraded': '2024-04-25T09:02:46.102814+0000', 'last_fullsized': '2024-04-25T09:02:46.102814+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103060+0000', 'last_change': '2024-04-25T09:02:46.103060+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103060+0000', 'last_undegraded': '2024-04-25T09:02:46.103060+0000', 'last_fullsized': '2024-04-25T09:02:46.103060+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.098779+0000', 'last_change': '2024-04-25T09:02:46.098779+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.098779+0000', 'last_undegraded': '2024-04-25T09:02:46.098779+0000', 'last_fullsized': '2024-04-25T09:02:46.098779+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.102008+0000', 'last_change': '2024-04-25T09:02:46.102008+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.102008+0000', 'last_undegraded': '2024-04-25T09:02:46.102008+0000', 'last_fullsized': '2024-04-25T09:02:46.102008+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-04-25T09:02:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.102539+0000', 'last_change': '2024-04-25T09:02:46.102539+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.102539+0000', 'last_undegraded': '2024-04-25T09:02:46.102539+0000', 'last_fullsized': '2024-04-25T09:02:46.102539+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100736+0000', 'last_change': '2024-04-25T09:02:46.100736+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100736+0000', 'last_undegraded': '2024-04-25T09:02:46.100736+0000', 'last_fullsized': '2024-04-25T09:02:46.100736+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.097702+0000', 'last_change': '2024-04-25T09:02:46.097702+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.097702+0000', 'last_undegraded': '2024-04-25T09:02:46.097702+0000', 'last_fullsized': '2024-04-25T09:02:46.097702+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100539+0000', 'last_change': '2024-04-25T09:02:46.100539+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100539+0000', 'last_undegraded': '2024-04-25T09:02:46.100539+0000', 'last_fullsized': '2024-04-25T09:02:46.100539+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.100210+0000', 'last_change': '2024-04-25T09:02:46.100210+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.100210+0000', 'last_undegraded': '2024-04-25T09:02:46.100210+0000', 'last_fullsized': '2024-04-25T09:02:46.100210+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.097504+0000', 'last_change': '2024-04-25T09:02:46.097504+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.097504+0000', 'last_undegraded': '2024-04-25T09:02:46.097504+0000', 'last_fullsized': '2024-04-25T09:02:46.097504+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.104719+0000', 'last_change': '2024-04-25T09:02:46.104719+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.104719+0000', 'last_undegraded': '2024-04-25T09:02:46.104719+0000', 'last_fullsized': '2024-04-25T09:02:46.104719+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101654+0000', 'last_change': '2024-04-25T09:02:46.101654+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101654+0000', 'last_undegraded': '2024-04-25T09:02:46.101654+0000', 'last_fullsized': '2024-04-25T09:02:46.101654+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101553+0000', 'last_change': '2024-04-25T09:02:46.101553+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101553+0000', 'last_undegraded': '2024-04-25T09:02:46.101553+0000', 'last_fullsized': '2024-04-25T09:02:46.101553+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.098745+0000', 'last_change': '2024-04-25T09:02:46.098745+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.098745+0000', 'last_undegraded': '2024-04-25T09:02:46.098745+0000', 'last_fullsized': '2024-04-25T09:02:46.098745+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.099749+0000', 'last_change': '2024-04-25T09:02:46.099749+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.099749+0000', 'last_undegraded': '2024-04-25T09:02:46.099749+0000', 'last_fullsized': '2024-04-25T09:02:46.099749+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2024-04-25T09:02:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.099608+0000', 'last_change': '2024-04-25T09:02:46.099608+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.099608+0000', 'last_undegraded': '2024-04-25T09:02:46.099608+0000', 'last_fullsized': '2024-04-25T09:02:46.099608+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103412+0000', 'last_change': '2024-04-25T09:02:46.103412+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103412+0000', 'last_undegraded': '2024-04-25T09:02:46.103412+0000', 'last_fullsized': '2024-04-25T09:02:46.103412+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.097618+0000', 'last_change': '2024-04-25T09:02:46.097618+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.097618+0000', 'last_undegraded': '2024-04-25T09:02:46.097618+0000', 'last_fullsized': '2024-04-25T09:02:46.097618+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.104948+0000', 'last_change': '2024-04-25T09:02:46.104948+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.104948+0000', 'last_undegraded': '2024-04-25T09:02:46.104948+0000', 'last_fullsized': '2024-04-25T09:02:46.104948+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101217+0000', 'last_change': '2024-04-25T09:02:46.101217+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101217+0000', 'last_undegraded': '2024-04-25T09:02:46.101217+0000', 'last_fullsized': '2024-04-25T09:02:46.101217+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.098719+0000', 'last_change': '2024-04-25T09:02:46.098719+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.098719+0000', 'last_undegraded': '2024-04-25T09:02:46.098719+0000', 'last_fullsized': '2024-04-25T09:02:46.098719+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2024-04-25T09:02:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.103407+0000', 'last_change': '2024-04-25T09:02:46.103407+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.103407+0000', 'last_undegraded': '2024-04-25T09:02:46.103407+0000', 'last_fullsized': '2024-04-25T09:02:46.103407+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-04-25T09:02:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.097507+0000', 'last_change': '2024-04-25T09:02:46.097507+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.097507+0000', 'last_undegraded': '2024-04-25T09:02:46.097507+0000', 'last_fullsized': '2024-04-25T09:02:46.097507+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-04-25T09:02:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101709+0000', 'last_change': '2024-04-25T09:02:46.101709+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101709+0000', 'last_undegraded': '2024-04-25T09:02:46.101709+0000', 'last_fullsized': '2024-04-25T09:02:46.101709+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-04-25T09:02:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:46.101189+0000', 'last_change': '2024-04-25T09:02:46.101189+0000', 'last_active': '2024-04-25T09:02:46.089276+0000', 'last_peered': '2024-04-25T09:02:46.089276+0000', 'last_clean': '2024-04-25T09:02:46.089276+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:46.101189+0000', 'last_undegraded': '2024-04-25T09:02:46.101189+0000', 'last_fullsized': '2024-04-25T09:02:46.101189+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:46.089276+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:51.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:02:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.942+0000 7fee013be640 1 Processor -- start 2024-04-25T09:02:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.942+0000 7fee013be640 1 -- start start 2024-04-25T09:02:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fee013be640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedfc15de70 0x7fedfc0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fee013be640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fee013be640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc0d20e0 con 0x7fedfc0b7130 2024-04-25T09:02:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fee013be640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedfc0d2a10 con 0x7fedfc15de70 2024-04-25T09:02:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fee013be640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0d23c0 con 0x7fedfc0b2cc0 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedfc15de70 0x7fedfc0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fedfc0b7130 0x7fedfc0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48186/0 (socket says 172.21.15.5:48186) 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfb7fe640 1 -- 172.21.15.5:0/1876378288 learned_addr learned my addr 172.21.15.5:0/1876378288 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedf3fff640 1 --2- 172.21.15.5:0/1876378288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfaffd640 1 -- 172.21.15.5:0/1876378288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 msgr2=0x7fedfc0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfaffd640 1 --2- 172.21.15.5:0/1876378288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfaffd640 1 -- 172.21.15.5:0/1876378288 >> v1:172.21.15.5:6789/0 conn(0x7fedfc0b7130 legacy=0x7fedfc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfaffd640 1 -- 172.21.15.5:0/1876378288 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0d26a0 con 0x7fedfc15de70 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedfa7fc640 1 -- 172.21.15.5:0/1876378288 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462740209 0 0) 0x7fedfc0d20e0 con 0x7fedfc0b7130 2024-04-25T09:02:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.943+0000 7fedf3fff640 1 --2- 172.21.15.5:0/1876378288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.944+0000 7fedfaffd640 1 --2- 172.21.15.5:0/1876378288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc15de70 0x7fedfc0b93e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fedec0097a0 tx=0x7fedec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4ab2f1b12af63f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.944+0000 7fedfa7fc640 1 -- 172.21.15.5:0/1876378288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec037070 con 0x7fedfc15de70 2024-04-25T09:02:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.944+0000 7fedfa7fc640 1 -- 172.21.15.5:0/1876378288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec032440 con 0x7fedfc15de70 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.944+0000 7fedfa7fc640 1 -- 172.21.15.5:0/1876378288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec032810 con 0x7fedfc15de70 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 -- 172.21.15.5:0/1876378288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc15de70 msgr2=0x7fedfc0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 --2- 172.21.15.5:0/1876378288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc15de70 0x7fedfc0b93e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fedec0097a0 tx=0x7fedec02a180 comp rx=0 tx=0).stop 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 -- 172.21.15.5:0/1876378288 shutdown_connections 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 --2- 172.21.15.5:0/1876378288 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 --2- 172.21.15.5:0/1876378288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc15de70 0x7fedfc0b93e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 -- 172.21.15.5:0/1876378288 >> 172.21.15.5:0/1876378288 conn(0x7fedfc06b000 msgr2=0x7fedfc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 -- 172.21.15.5:0/1876378288 shutdown_connections 2024-04-25T09:02:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.945+0000 7fee013be640 1 -- 172.21.15.5:0/1876378288 wait complete. 2024-04-25T09:02:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.946+0000 7fee013be640 1 Processor -- start 2024-04-25T09:02:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.946+0000 7fee013be640 1 -- start start 2024-04-25T09:02:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fee013be640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fee013be640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc0b7130 0x7fedfc14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fee013be640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedfc15de70 0x7fedfc14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fee013be640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0cf080 con 0x7fedfc0b7130 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fee013be640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0cef00 con 0x7fedfc15de70 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fee013be640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0cf200 con 0x7fedfc0b2cc0 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc0b7130 0x7fedfc14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc0b7130 0x7fedfc14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47264/0 (socket says 172.21.15.5:47264) 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 -- 172.21.15.5:0/2856954088 learned_addr learned my addr 172.21.15.5:0/2856954088 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedfaffd640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedfb7fe640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedfc15de70 0x7fedfc14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 -- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 msgr2=0x7fedfc0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 -- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedfc15de70 msgr2=0x7fedfc14c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedfc15de70 0x7fedfc14c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedf3fff640 1 -- 172.21.15.5:0/2856954088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0c8ee0 con 0x7fedfc0b7130 2024-04-25T09:02:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.947+0000 7fedfb7fe640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedfc15de70 0x7fedfc14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.948+0000 7fedf3fff640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc0b7130 0x7fedfc14bb50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fede400c820 tx=0x7fede400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.948+0000 7fedf37fe640 1 -- 172.21.15.5:0/2856954088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4015070 con 0x7fedfc0b7130 2024-04-25T09:02:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.948+0000 7fedf37fe640 1 -- 172.21.15.5:0/2856954088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4007a30 con 0x7fedfc0b7130 2024-04-25T09:02:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.948+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc0c8c00 con 0x7fedfc0b7130 2024-04-25T09:02:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.948+0000 7fedf37fe640 1 -- 172.21.15.5:0/2856954088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4007e00 con 0x7fedfc0b7130 2024-04-25T09:02:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.948+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc0caf20 con 0x7fedfc0b7130 2024-04-25T09:02:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.949+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc04ef20 con 0x7fedfc0b7130 2024-04-25T09:02:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.949+0000 7fedf37fe640 1 -- 172.21.15.5:0/2856954088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fede4018070 con 0x7fedfc0b7130 2024-04-25T09:02:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.949+0000 7fedf37fe640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feddc06b4d0 0x7feddc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.950+0000 7fedf37fe640 1 -- 172.21.15.5:0/2856954088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fede408a150 con 0x7fedfc0b7130 2024-04-25T09:02:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.950+0000 7fedfaffd640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feddc06b4d0 0x7feddc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.950+0000 7fedfaffd640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feddc06b4d0 0x7feddc06d990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fedec034000 tx=0x7fedec02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:51.954+0000 7fedf37fe640 1 -- 172.21.15.5:0/2856954088 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fede4059060 con 0x7fedfc0b7130 2024-04-25T09:02:52.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.205+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fedfc071800 con 0x7fedfc0b7130 2024-04-25T09:02:52.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.205+0000 7fedf37fe640 1 -- 172.21.15.5:0/2856954088 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1196 (secure 0 0 0) 0x7fede4058960 con 0x7fedfc0b7130 2024-04-25T09:02:52.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:52.193 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":391,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":88,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":361701376,"bytes_avail":772732411904,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":55,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7497}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-04-25T09:01:58.457242+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feddc06b4d0 msgr2=0x7feddc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feddc06b4d0 0x7feddc06d990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fedec034000 tx=0x7fedec02e000 comp rx=0 tx=0).stop 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc0b7130 msgr2=0x7fedfc14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc0b7130 0x7fedfc14bb50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fede400c820 tx=0x7fede400cc20 comp rx=0 tx=0).stop 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 shutdown_connections 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feddc06b4d0 0x7feddc06d990 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedfc15de70 0x7fedfc14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedfc0b7130 0x7fedfc14bb50 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 --2- 172.21.15.5:0/2856954088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fedfc0b2cc0 0x7fedfc0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.207+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 >> 172.21.15.5:0/2856954088 conn(0x7fedfc06b000 msgr2=0x7fedfc0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.208+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 shutdown_connections 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.208+0000 7fee013be640 1 -- 172.21.15.5:0/2856954088 wait complete. 2024-04-25T09:02:52.206 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:02:52.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.320+0000 7f2e9d4e1640 1 Processor -- start 2024-04-25T09:02:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.320+0000 7f2e9d4e1640 1 -- start start 2024-04-25T09:02:52.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.320+0000 7f2e9d4e1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e9806cbf0 0x7f2e980cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.320+0000 7f2e9d4e1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e980cd220 0x7f2e9806cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.320+0000 7f2e9d4e1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e98072150 con 0x7f2e980ce190 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.320+0000 7f2e9d4e1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e980cbd50 con 0x7f2e980cd220 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.320+0000 7f2e9d4e1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e980cc030 con 0x7f2e9806cbf0 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e977fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e980cd220 0x7f2e9806cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e977fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e980cd220 0x7f2e9806cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47278/0 (socket says 172.21.15.5:47278) 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e977fe640 1 -- 172.21.15.5:0/4114428980 learned_addr learned my addr 172.21.15.5:0/4114428980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e96ffd640 1 --2- 172.21.15.5:0/4114428980 >> v2:172.21.15.80:3300/0 conn(0x7f2e9806cbf0 0x7f2e980cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e977fe640 1 -- 172.21.15.5:0/4114428980 >> v2:172.21.15.80:3300/0 conn(0x7f2e9806cbf0 msgr2=0x7f2e980cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e977fe640 1 --2- 172.21.15.5:0/4114428980 >> v2:172.21.15.80:3300/0 conn(0x7f2e9806cbf0 0x7f2e980cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e977fe640 1 -- 172.21.15.5:0/4114428980 >> v1:172.21.15.80:6789/0 conn(0x7f2e980ce190 legacy=0x7f2e980ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.321+0000 7f2e977fe640 1 -- 172.21.15.5:0/4114428980 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980cc310 con 0x7f2e980cd220 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e977fe640 1 --2- 172.21.15.5:0/4114428980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980cd220 0x7f2e9806cfd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2e9806c890 tx=0x7f2e9002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8da2d01541c35dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e95ffb640 1 -- 172.21.15.5:0/4114428980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90036070 con 0x7f2e980cd220 2024-04-25T09:02:52.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e95ffb640 1 -- 172.21.15.5:0/4114428980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90031600 con 0x7f2e980cd220 2024-04-25T09:02:52.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e95ffb640 1 -- 172.21.15.5:0/4114428980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e900319f0 con 0x7f2e980cd220 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/4114428980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980cd220 msgr2=0x7f2e9806cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/4114428980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980cd220 0x7f2e9806cfd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2e9806c890 tx=0x7f2e9002a7c0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/4114428980 shutdown_connections 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/4114428980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980cd220 0x7f2e9806cfd0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/4114428980 >> v2:172.21.15.80:3300/0 conn(0x7f2e9806cbf0 0x7f2e980cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/4114428980 >> 172.21.15.5:0/4114428980 conn(0x7f2e980b1c50 msgr2=0x7f2e980b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/4114428980 shutdown_connections 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.322+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/4114428980 wait complete. 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 Processor -- start 2024-04-25T09:02:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 -- start start 2024-04-25T09:02:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e9806cbf0 0x7f2e981534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e980cd220 0x7f2e980b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980ce190 0x7f2e980b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9815e100 con 0x7f2e980ce190 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9815df80 con 0x7f2e980cd220 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.324+0000 7f2e9d4e1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98071bd0 con 0x7f2e9806cbf0 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980ce190 0x7f2e980b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980ce190 0x7f2e980b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47286/0 (socket says 172.21.15.5:47286) 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 -- 172.21.15.5:0/30533055 learned_addr learned my addr 172.21.15.5:0/30533055 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e967fc640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e980cd220 0x7f2e980b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e96ffd640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e9806cbf0 0x7f2e981534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 -- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e9806cbf0 msgr2=0x7f2e981534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e9806cbf0 0x7f2e981534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 -- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e980cd220 msgr2=0x7f2e980b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e980cd220 0x7f2e980b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 -- 172.21.15.5:0/30533055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980b4240 con 0x7f2e980ce190 2024-04-25T09:02:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e96ffd640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e9806cbf0 0x7f2e981534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e977fe640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980ce190 0x7f2e980b3be0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2e9002a800 tx=0x7f2e90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e7f7fe640 1 -- 172.21.15.5:0/30533055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90036050 con 0x7f2e980ce190 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e7f7fe640 1 -- 172.21.15.5:0/30533055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90042070 con 0x7f2e980ce190 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e980b4520 con 0x7f2e980ce190 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e7f7fe640 1 -- 172.21.15.5:0/30533055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90009510 con 0x7f2e980ce190 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.325+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e980b4ae0 con 0x7f2e980ce190 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.326+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9804ef20 con 0x7f2e980ce190 2024-04-25T09:02:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.327+0000 7f2e7f7fe640 1 -- 172.21.15.5:0/30533055 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e90004450 con 0x7f2e980ce190 2024-04-25T09:02:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.327+0000 7f2e7f7fe640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e8406b4d0 0x7f2e8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.327+0000 7f2e7f7fe640 1 -- 172.21.15.5:0/30533055 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e900ab020 con 0x7f2e980ce190 2024-04-25T09:02:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.328+0000 7f2e96ffd640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e8406b4d0 0x7f2e8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.328+0000 7f2e96ffd640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e8406b4d0 0x7f2e8406d990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009ac0 tx=0x7f2e88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.332+0000 7f2e7f7fe640 1 -- 172.21.15.5:0/30533055 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e90079ea0 con 0x7f2e980ce190 2024-04-25T09:02:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.510+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e980b03d0 con 0x7f2e8406b4d0 2024-04-25T09:02:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.516+0000 7f2e7f7fe640 1 -- 172.21.15.5:0/30533055 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252086 (secure 0 0 0) 0x7f2e980b03d0 con 0x7f2e8406b4d0 2024-04-25T09:02:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:52.508 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:02:52.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e8406b4d0 msgr2=0x7f2e8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e8406b4d0 0x7f2e8406d990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009ac0 tx=0x7f2e88008040 comp rx=0 tx=0).stop 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980ce190 msgr2=0x7f2e980b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980ce190 0x7f2e980b3be0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2e9002a800 tx=0x7f2e90004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 shutdown_connections 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e8406b4d0 0x7f2e8406d990 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e980ce190 0x7f2e980b3be0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e980cd220 0x7f2e980b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 --2- 172.21.15.5:0/30533055 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e9806cbf0 0x7f2e981534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 >> 172.21.15.5:0/30533055 conn(0x7f2e980b1c50 msgr2=0x7f2e980ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 shutdown_connections 2024-04-25T09:02:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:52.519+0000 7f2e9d4e1640 1 -- 172.21.15.5:0/30533055 wait complete. 2024-04-25T09:02:52.518 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-25T09:02:52.470469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":353528,"kb_used_data":9672,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754621192,"statfs":{"total":773094113280,"available":772732100608,"internally_reserved":0,"allocated":9904128,"data_stored":4916588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.374629"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449809+0000","last_change":"2024-04-25T09:02:47.121766+0000","last_active":"2024-04-25T09:02:49.449809+0000","last_peered":"2024-04-25T09:02:49.449809+0000","last_clean":"2024-04-25T09:02:49.449809+0000","last_became_active":"2024-04-25T09:02:47.121484+0000","last_became_peered":"2024-04-25T09:02:47.121484+0000","last_unstale":"2024-04-25T09:02:49.449809+0000","last_undegraded":"2024-04-25T09:02:49.449809+0000","last_fullsized":"2024-04-25T09:02:49.449809+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:30.974414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118772+0000","last_change":"2024-04-25T09:02:47.113567+0000","last_active":"2024-04-25T09:02:48.118772+0000","last_peered":"2024-04-25T09:02:48.118772+0000","last_clean":"2024-04-25T09:02:48.118772+0000","last_became_active":"2024-04-25T09:02:47.113124+0000","last_became_peered":"2024-04-25T09:02:47.113124+0000","last_unstale":"2024-04-25T09:02:48.118772+0000","last_undegraded":"2024-04-25T09:02:48.118772+0000","last_fullsized":"2024-04-25T09:02:48.118772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:39.524498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450017+0000","last_change":"2024-04-25T09:02:47.111152+0000","last_active":"2024-04-25T09:02:49.450017+0000","last_peered":"2024-04-25T09:02:49.450017+0000","last_clean":"2024-04-25T09:02:49.450017+0000","last_became_active":"2024-04-25T09:02:47.110806+0000","last_became_peered":"2024-04-25T09:02:47.110806+0000","last_unstale":"2024-04-25T09:02:49.450017+0000","last_undegraded":"2024-04-25T09:02:49.450017+0000","last_fullsized":"2024-04-25T09:02:49.450017+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:45.161313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109408+0000","last_change":"2024-04-25T09:02:47.119597+0000","last_active":"2024-04-25T09:02:48.109408+0000","last_peered":"2024-04-25T09:02:48.109408+0000","last_clean":"2024-04-25T09:02:48.109408+0000","last_became_active":"2024-04-25T09:02:47.119241+0000","last_became_peered":"2024-04-25T09:02:47.119241+0000","last_unstale":"2024-04-25T09:02:48.109408+0000","last_undegraded":"2024-04-25T09:02:48.109408+0000","last_fullsized":"2024-04-25T09:02:48.109408+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:13.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115538+0000","last_change":"2024-04-25T09:02:47.117639+0000","last_active":"2024-04-25T09:02:48.115538+0000","last_peered":"2024-04-25T09:02:48.115538+0000","last_clean":"2024-04-25T09:02:48.115538+0000","last_became_active":"2024-04-25T09:02:47.117223+0000","last_became_peered":"2024-04-25T09:02:47.117223+0000","last_unstale":"2024-04-25T09:02:48.115538+0000","last_undegraded":"2024-04-25T09:02:48.115538+0000","last_fullsized":"2024-04-25T09:02:48.115538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:52.387681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116213+0000","last_change":"2024-04-25T09:02:47.112321+0000","last_active":"2024-04-25T09:02:48.116213+0000","last_peered":"2024-04-25T09:02:48.116213+0000","last_clean":"2024-04-25T09:02:48.116213+0000","last_became_active":"2024-04-25T09:02:47.111953+0000","last_became_peered":"2024-04-25T09:02:47.111953+0000","last_unstale":"2024-04-25T09:02:48.116213+0000","last_undegraded":"2024-04-25T09:02:48.116213+0000","last_fullsized":"2024-04-25T09:02:48.116213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:30.974414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109016+0000","last_change":"2024-04-25T09:02:47.120222+0000","last_active":"2024-04-25T09:02:48.109016+0000","last_peered":"2024-04-25T09:02:48.109016+0000","last_clean":"2024-04-25T09:02:48.109016+0000","last_became_active":"2024-04-25T09:02:47.119837+0000","last_became_peered":"2024-04-25T09:02:47.119837+0000","last_unstale":"2024-04-25T09:02:48.109016+0000","last_undegraded":"2024-04-25T09:02:48.109016+0000","last_fullsized":"2024-04-25T09:02:48.109016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:19.814493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115800+0000","last_change":"2024-04-25T09:02:47.115566+0000","last_active":"2024-04-25T09:02:48.115800+0000","last_peered":"2024-04-25T09:02:48.115800+0000","last_clean":"2024-04-25T09:02:48.115800+0000","last_became_active":"2024-04-25T09:02:47.114920+0000","last_became_peered":"2024-04-25T09:02:47.114920+0000","last_unstale":"2024-04-25T09:02:48.115800+0000","last_undegraded":"2024-04-25T09:02:48.115800+0000","last_fullsized":"2024-04-25T09:02:48.115800+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:21.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116661+0000","last_change":"2024-04-25T09:02:47.122324+0000","last_active":"2024-04-25T09:02:48.116661+0000","last_peered":"2024-04-25T09:02:48.116661+0000","last_clean":"2024-04-25T09:02:48.116661+0000","last_became_active":"2024-04-25T09:02:47.122002+0000","last_became_peered":"2024-04-25T09:02:47.122002+0000","last_unstale":"2024-04-25T09:02:48.116661+0000","last_undegraded":"2024-04-25T09:02:48.116661+0000","last_fullsized":"2024-04-25T09:02:48.116661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:53.450949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449987+0000","last_change":"2024-04-25T09:02:47.120743+0000","last_active":"2024-04-25T09:02:49.449987+0000","last_peered":"2024-04-25T09:02:49.449987+0000","last_clean":"2024-04-25T09:02:49.449987+0000","last_became_active":"2024-04-25T09:02:47.119185+0000","last_became_peered":"2024-04-25T09:02:47.119185+0000","last_unstale":"2024-04-25T09:02:49.449987+0000","last_undegraded":"2024-04-25T09:02:49.449987+0000","last_fullsized":"2024-04-25T09:02:49.449987+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:55.007150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118789+0000","last_change":"2024-04-25T09:02:47.118105+0000","last_active":"2024-04-25T09:02:48.118789+0000","last_peered":"2024-04-25T09:02:48.118789+0000","last_clean":"2024-04-25T09:02:48.118789+0000","last_became_active":"2024-04-25T09:02:47.117680+0000","last_became_peered":"2024-04-25T09:02:47.117680+0000","last_unstale":"2024-04-25T09:02:48.118789+0000","last_undegraded":"2024-04-25T09:02:48.118789+0000","last_fullsized":"2024-04-25T09:02:48.118789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:23.338528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450022+0000","last_change":"2024-04-25T09:02:47.120592+0000","last_active":"2024-04-25T09:02:49.450022+0000","last_peered":"2024-04-25T09:02:49.450022+0000","last_clean":"2024-04-25T09:02:49.450022+0000","last_became_active":"2024-04-25T09:02:47.120327+0000","last_became_peered":"2024-04-25T09:02:47.120327+0000","last_unstale":"2024-04-25T09:02:49.450022+0000","last_undegraded":"2024-04-25T09:02:49.450022+0000","last_fullsized":"2024-04-25T09:02:49.450022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:08.416754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450163+0000","last_change":"2024-04-25T09:02:47.109330+0000","last_active":"2024-04-25T09:02:49.450163+0000","last_peered":"2024-04-25T09:02:49.450163+0000","last_clean":"2024-04-25T09:02:49.450163+0000","last_became_active":"2024-04-25T09:02:47.108967+0000","last_became_peered":"2024-04-25T09:02:47.108967+0000","last_unstale":"2024-04-25T09:02:49.450163+0000","last_undegraded":"2024-04-25T09:02:49.450163+0000","last_fullsized":"2024-04-25T09:02:49.450163+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:35.653742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109282+0000","last_change":"2024-04-25T09:02:47.121970+0000","last_active":"2024-04-25T09:02:48.109282+0000","last_peered":"2024-04-25T09:02:48.109282+0000","last_clean":"2024-04-25T09:02:48.109282+0000","last_became_active":"2024-04-25T09:02:47.121645+0000","last_became_peered":"2024-04-25T09:02:47.121645+0000","last_unstale":"2024-04-25T09:02:48.109282+0000","last_undegraded":"2024-04-25T09:02:48.109282+0000","last_fullsized":"2024-04-25T09:02:48.109282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:22.811113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448824+0000","last_change":"2024-04-25T09:02:47.103454+0000","last_active":"2024-04-25T09:02:49.448824+0000","last_peered":"2024-04-25T09:02:49.448824+0000","last_clean":"2024-04-25T09:02:49.448824+0000","last_became_active":"2024-04-25T09:02:47.103134+0000","last_became_peered":"2024-04-25T09:02:47.103134+0000","last_unstale":"2024-04-25T09:02:49.448824+0000","last_undegraded":"2024-04-25T09:02:49.448824+0000","last_fullsized":"2024-04-25T09:02:49.448824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:29.475038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115169+0000","last_change":"2024-04-25T09:02:47.117919+0000","last_active":"2024-04-25T09:02:48.115169+0000","last_peered":"2024-04-25T09:02:48.115169+0000","last_clean":"2024-04-25T09:02:48.115169+0000","last_became_active":"2024-04-25T09:02:47.117590+0000","last_became_peered":"2024-04-25T09:02:47.117590+0000","last_unstale":"2024-04-25T09:02:48.115169+0000","last_undegraded":"2024-04-25T09:02:48.115169+0000","last_fullsized":"2024-04-25T09:02:48.115169+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:07.551144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116211+0000","last_change":"2024-04-25T09:02:47.113140+0000","last_active":"2024-04-25T09:02:48.116211+0000","last_peered":"2024-04-25T09:02:48.116211+0000","last_clean":"2024-04-25T09:02:48.116211+0000","last_became_active":"2024-04-25T09:02:47.112878+0000","last_became_peered":"2024-04-25T09:02:47.112878+0000","last_unstale":"2024-04-25T09:02:48.116211+0000","last_undegraded":"2024-04-25T09:02:48.116211+0000","last_fullsized":"2024-04-25T09:02:48.116211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:21.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109136+0000","last_change":"2024-04-25T09:02:47.111993+0000","last_active":"2024-04-25T09:02:48.109136+0000","last_peered":"2024-04-25T09:02:48.109136+0000","last_clean":"2024-04-25T09:02:48.109136+0000","last_became_active":"2024-04-25T09:02:47.111666+0000","last_became_peered":"2024-04-25T09:02:47.111666+0000","last_unstale":"2024-04-25T09:02:48.109136+0000","last_undegraded":"2024-04-25T09:02:48.109136+0000","last_fullsized":"2024-04-25T09:02:48.109136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:04.137815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120916+0000","last_change":"2024-04-25T09:02:47.118784+0000","last_active":"2024-04-25T09:02:48.120916+0000","last_peered":"2024-04-25T09:02:48.120916+0000","last_clean":"2024-04-25T09:02:48.120916+0000","last_became_active":"2024-04-25T09:02:47.118148+0000","last_became_peered":"2024-04-25T09:02:47.118148+0000","last_unstale":"2024-04-25T09:02:48.120916+0000","last_undegraded":"2024-04-25T09:02:48.120916+0000","last_fullsized":"2024-04-25T09:02:48.120916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:34.187600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109437+0000","last_change":"2024-04-25T09:02:47.121537+0000","last_active":"2024-04-25T09:02:48.109437+0000","last_peered":"2024-04-25T09:02:48.109437+0000","last_clean":"2024-04-25T09:02:48.109437+0000","last_became_active":"2024-04-25T09:02:47.121198+0000","last_became_peered":"2024-04-25T09:02:47.121198+0000","last_unstale":"2024-04-25T09:02:48.109437+0000","last_undegraded":"2024-04-25T09:02:48.109437+0000","last_fullsized":"2024-04-25T09:02:48.109437+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:19.336172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109210+0000","last_change":"2024-04-25T09:02:47.121114+0000","last_active":"2024-04-25T09:02:48.109210+0000","last_peered":"2024-04-25T09:02:48.109210+0000","last_clean":"2024-04-25T09:02:48.109210+0000","last_became_active":"2024-04-25T09:02:47.120604+0000","last_became_peered":"2024-04-25T09:02:47.120604+0000","last_unstale":"2024-04-25T09:02:48.109210+0000","last_undegraded":"2024-04-25T09:02:48.109210+0000","last_fullsized":"2024-04-25T09:02:48.109210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:29.813163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118599+0000","last_change":"2024-04-25T09:02:47.129148+0000","last_active":"2024-04-25T09:02:48.118599+0000","last_peered":"2024-04-25T09:02:48.118599+0000","last_clean":"2024-04-25T09:02:48.118599+0000","last_became_active":"2024-04-25T09:02:47.128701+0000","last_became_peered":"2024-04-25T09:02:47.128701+0000","last_unstale":"2024-04-25T09:02:48.118599+0000","last_undegraded":"2024-04-25T09:02:48.118599+0000","last_fullsized":"2024-04-25T09:02:48.118599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:13.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449341+0000","last_change":"2024-04-25T09:02:47.123259+0000","last_active":"2024-04-25T09:02:49.449341+0000","last_peered":"2024-04-25T09:02:49.449341+0000","last_clean":"2024-04-25T09:02:49.449341+0000","last_became_active":"2024-04-25T09:02:47.122986+0000","last_became_peered":"2024-04-25T09:02:47.122986+0000","last_unstale":"2024-04-25T09:02:49.449341+0000","last_undegraded":"2024-04-25T09:02:49.449341+0000","last_fullsized":"2024-04-25T09:02:49.449341+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:31.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.108999+0000","last_change":"2024-04-25T09:02:47.122294+0000","last_active":"2024-04-25T09:02:48.108999+0000","last_peered":"2024-04-25T09:02:48.108999+0000","last_clean":"2024-04-25T09:02:48.108999+0000","last_became_active":"2024-04-25T09:02:47.120550+0000","last_became_peered":"2024-04-25T09:02:47.120550+0000","last_unstale":"2024-04-25T09:02:48.108999+0000","last_undegraded":"2024-04-25T09:02:48.108999+0000","last_fullsized":"2024-04-25T09:02:48.108999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:40.285241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118917+0000","last_change":"2024-04-25T09:02:47.114917+0000","last_active":"2024-04-25T09:02:48.118917+0000","last_peered":"2024-04-25T09:02:48.118917+0000","last_clean":"2024-04-25T09:02:48.118917+0000","last_became_active":"2024-04-25T09:02:47.114627+0000","last_became_peered":"2024-04-25T09:02:47.114627+0000","last_unstale":"2024-04-25T09:02:48.118917+0000","last_undegraded":"2024-04-25T09:02:48.118917+0000","last_fullsized":"2024-04-25T09:02:48.118917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:47.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449968+0000","last_change":"2024-04-25T09:02:47.116889+0000","last_active":"2024-04-25T09:02:49.449968+0000","last_peered":"2024-04-25T09:02:49.449968+0000","last_clean":"2024-04-25T09:02:49.449968+0000","last_became_active":"2024-04-25T09:02:47.116613+0000","last_became_peered":"2024-04-25T09:02:47.116613+0000","last_unstale":"2024-04-25T09:02:49.449968+0000","last_undegraded":"2024-04-25T09:02:49.449968+0000","last_fullsized":"2024-04-25T09:02:49.449968+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.774231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116009+0000","last_change":"2024-04-25T09:02:47.115365+0000","last_active":"2024-04-25T09:02:48.116009+0000","last_peered":"2024-04-25T09:02:48.116009+0000","last_clean":"2024-04-25T09:02:48.116009+0000","last_became_active":"2024-04-25T09:02:47.114257+0000","last_became_peered":"2024-04-25T09:02:47.114257+0000","last_unstale":"2024-04-25T09:02:48.116009+0000","last_undegraded":"2024-04-25T09:02:48.116009+0000","last_fullsized":"2024-04-25T09:02:48.116009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:29.875044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449575+0000","last_change":"2024-04-25T09:02:47.113562+0000","last_active":"2024-04-25T09:02:49.449575+0000","last_peered":"2024-04-25T09:02:49.449575+0000","last_clean":"2024-04-25T09:02:49.449575+0000","last_became_active":"2024-04-25T09:02:47.112956+0000","last_became_peered":"2024-04-25T09:02:47.112956+0000","last_unstale":"2024-04-25T09:02:49.449575+0000","last_undegraded":"2024-04-25T09:02:49.449575+0000","last_fullsized":"2024-04-25T09:02:49.449575+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:34.187600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118884+0000","last_change":"2024-04-25T09:02:47.117386+0000","last_active":"2024-04-25T09:02:48.118884+0000","last_peered":"2024-04-25T09:02:48.118884+0000","last_clean":"2024-04-25T09:02:48.118884+0000","last_became_active":"2024-04-25T09:02:47.115672+0000","last_became_peered":"2024-04-25T09:02:47.115672+0000","last_unstale":"2024-04-25T09:02:48.118884+0000","last_undegraded":"2024-04-25T09:02:48.118884+0000","last_fullsized":"2024-04-25T09:02:48.118884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:12.186706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118772+0000","last_change":"2024-04-25T09:02:47.111278+0000","last_active":"2024-04-25T09:02:48.118772+0000","last_peered":"2024-04-25T09:02:48.118772+0000","last_clean":"2024-04-25T09:02:48.118772+0000","last_became_active":"2024-04-25T09:02:47.110978+0000","last_became_peered":"2024-04-25T09:02:47.110978+0000","last_unstale":"2024-04-25T09:02:48.118772+0000","last_undegraded":"2024-04-25T09:02:48.118772+0000","last_fullsized":"2024-04-25T09:02:48.118772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:30.925813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115168+0000","last_change":"2024-04-25T09:02:47.120323+0000","last_active":"2024-04-25T09:02:48.115168+0000","last_peered":"2024-04-25T09:02:48.115168+0000","last_clean":"2024-04-25T09:02:48.115168+0000","last_became_active":"2024-04-25T09:02:47.120054+0000","last_became_peered":"2024-04-25T09:02:47.120054+0000","last_unstale":"2024-04-25T09:02:48.115168+0000","last_undegraded":"2024-04-25T09:02:48.115168+0000","last_fullsized":"2024-04-25T09:02:48.115168+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:44.977935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449362+0000","last_change":"2024-04-25T09:02:47.118662+0000","last_active":"2024-04-25T09:02:49.449362+0000","last_peered":"2024-04-25T09:02:49.449362+0000","last_clean":"2024-04-25T09:02:49.449362+0000","last_became_active":"2024-04-25T09:02:47.118372+0000","last_became_peered":"2024-04-25T09:02:47.118372+0000","last_unstale":"2024-04-25T09:02:49.449362+0000","last_undegraded":"2024-04-25T09:02:49.449362+0000","last_fullsized":"2024-04-25T09:02:49.449362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:55.474082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116018+0000","last_change":"2024-04-25T09:02:47.117969+0000","last_active":"2024-04-25T09:02:48.116018+0000","last_peered":"2024-04-25T09:02:48.116018+0000","last_clean":"2024-04-25T09:02:48.116018+0000","last_became_active":"2024-04-25T09:02:47.117652+0000","last_became_peered":"2024-04-25T09:02:47.117652+0000","last_unstale":"2024-04-25T09:02:48.116018+0000","last_undegraded":"2024-04-25T09:02:48.116018+0000","last_fullsized":"2024-04-25T09:02:48.116018+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:34.187600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450331+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:49.450331+0000","last_peered":"2024-04-25T09:02:49.450331+0000","last_clean":"2024-04-25T09:02:49.450331+0000","last_became_active":"2024-04-25T09:02:46.111552+0000","last_became_peered":"2024-04-25T09:02:46.111552+0000","last_unstale":"2024-04-25T09:02:49.450331+0000","last_undegraded":"2024-04-25T09:02:49.450331+0000","last_fullsized":"2024-04-25T09:02:49.450331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:46.458086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450343+0000","last_change":"2024-04-25T09:02:47.123695+0000","last_active":"2024-04-25T09:02:49.450343+0000","last_peered":"2024-04-25T09:02:49.450343+0000","last_clean":"2024-04-25T09:02:49.450343+0000","last_became_active":"2024-04-25T09:02:47.123382+0000","last_became_peered":"2024-04-25T09:02:47.123382+0000","last_unstale":"2024-04-25T09:02:49.450343+0000","last_undegraded":"2024-04-25T09:02:49.450343+0000","last_fullsized":"2024-04-25T09:02:49.450343+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:00.486118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116143+0000","last_change":"2024-04-25T09:02:46.112288+0000","last_active":"2024-04-25T09:02:48.116143+0000","last_peered":"2024-04-25T09:02:48.116143+0000","last_clean":"2024-04-25T09:02:48.116143+0000","last_became_active":"2024-04-25T09:02:46.111207+0000","last_became_peered":"2024-04-25T09:02:46.111207+0000","last_unstale":"2024-04-25T09:02:48.116143+0000","last_undegraded":"2024-04-25T09:02:48.116143+0000","last_fullsized":"2024-04-25T09:02:48.116143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.252066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449743+0000","last_change":"2024-04-25T09:02:47.118680+0000","last_active":"2024-04-25T09:02:49.449743+0000","last_peered":"2024-04-25T09:02:49.449743+0000","last_clean":"2024-04-25T09:02:49.449743+0000","last_became_active":"2024-04-25T09:02:47.118357+0000","last_became_peered":"2024-04-25T09:02:47.118357+0000","last_unstale":"2024-04-25T09:02:49.449743+0000","last_undegraded":"2024-04-25T09:02:49.449743+0000","last_fullsized":"2024-04-25T09:02:49.449743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:21.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120904+0000","last_change":"2024-04-25T09:02:46.114067+0000","last_active":"2024-04-25T09:02:48.120904+0000","last_peered":"2024-04-25T09:02:48.120904+0000","last_clean":"2024-04-25T09:02:48.120904+0000","last_became_active":"2024-04-25T09:02:46.113719+0000","last_became_peered":"2024-04-25T09:02:46.113719+0000","last_unstale":"2024-04-25T09:02:48.120904+0000","last_undegraded":"2024-04-25T09:02:48.120904+0000","last_fullsized":"2024-04-25T09:02:48.120904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:25.898949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450213+0000","last_change":"2024-04-25T09:02:47.111690+0000","last_active":"2024-04-25T09:02:49.450213+0000","last_peered":"2024-04-25T09:02:49.450213+0000","last_clean":"2024-04-25T09:02:49.450213+0000","last_became_active":"2024-04-25T09:02:47.111315+0000","last_became_peered":"2024-04-25T09:02:47.111315+0000","last_unstale":"2024-04-25T09:02:49.450213+0000","last_undegraded":"2024-04-25T09:02:49.450213+0000","last_fullsized":"2024-04-25T09:02:49.450213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:39.588482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120703+0000","last_change":"2024-04-25T09:02:46.114156+0000","last_active":"2024-04-25T09:02:48.120703+0000","last_peered":"2024-04-25T09:02:48.120703+0000","last_clean":"2024-04-25T09:02:48.120703+0000","last_became_active":"2024-04-25T09:02:46.113803+0000","last_became_peered":"2024-04-25T09:02:46.113803+0000","last_unstale":"2024-04-25T09:02:48.120703+0000","last_undegraded":"2024-04-25T09:02:48.120703+0000","last_fullsized":"2024-04-25T09:02:48.120703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:51.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118605+0000","last_change":"2024-04-25T09:02:47.114193+0000","last_active":"2024-04-25T09:02:48.118605+0000","last_peered":"2024-04-25T09:02:48.118605+0000","last_clean":"2024-04-25T09:02:48.118605+0000","last_became_active":"2024-04-25T09:02:47.113885+0000","last_became_peered":"2024-04-25T09:02:47.113885+0000","last_unstale":"2024-04-25T09:02:48.118605+0000","last_undegraded":"2024-04-25T09:02:48.118605+0000","last_fullsized":"2024-04-25T09:02:48.118605+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:19.336172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115825+0000","last_change":"2024-04-25T09:02:46.114380+0000","last_active":"2024-04-25T09:02:48.115825+0000","last_peered":"2024-04-25T09:02:48.115825+0000","last_clean":"2024-04-25T09:02:48.115825+0000","last_became_active":"2024-04-25T09:02:46.113834+0000","last_became_peered":"2024-04-25T09:02:46.113834+0000","last_unstale":"2024-04-25T09:02:48.115825+0000","last_undegraded":"2024-04-25T09:02:48.115825+0000","last_fullsized":"2024-04-25T09:02:48.115825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:13.631276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115543+0000","last_change":"2024-04-25T09:02:47.121836+0000","last_active":"2024-04-25T09:02:48.115543+0000","last_peered":"2024-04-25T09:02:48.115543+0000","last_clean":"2024-04-25T09:02:48.115543+0000","last_became_active":"2024-04-25T09:02:47.121576+0000","last_became_peered":"2024-04-25T09:02:47.121576+0000","last_unstale":"2024-04-25T09:02:48.115543+0000","last_undegraded":"2024-04-25T09:02:48.115543+0000","last_fullsized":"2024-04-25T09:02:48.115543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:18.224831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115454+0000","last_change":"2024-04-25T09:02:46.112267+0000","last_active":"2024-04-25T09:02:48.115454+0000","last_peered":"2024-04-25T09:02:48.115454+0000","last_clean":"2024-04-25T09:02:48.115454+0000","last_became_active":"2024-04-25T09:02:46.111817+0000","last_became_peered":"2024-04-25T09:02:46.111817+0000","last_unstale":"2024-04-25T09:02:48.115454+0000","last_undegraded":"2024-04-25T09:02:48.115454+0000","last_fullsized":"2024-04-25T09:02:48.115454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.563667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449385+0000","last_change":"2024-04-25T09:02:47.121037+0000","last_active":"2024-04-25T09:02:49.449385+0000","last_peered":"2024-04-25T09:02:49.449385+0000","last_clean":"2024-04-25T09:02:49.449385+0000","last_became_active":"2024-04-25T09:02:47.120716+0000","last_became_peered":"2024-04-25T09:02:47.120716+0000","last_unstale":"2024-04-25T09:02:49.449385+0000","last_undegraded":"2024-04-25T09:02:49.449385+0000","last_fullsized":"2024-04-25T09:02:49.449385+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:17.492319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120481+0000","last_change":"2024-04-25T09:02:46.109390+0000","last_active":"2024-04-25T09:02:48.120481+0000","last_peered":"2024-04-25T09:02:48.120481+0000","last_clean":"2024-04-25T09:02:48.120481+0000","last_became_active":"2024-04-25T09:02:46.109096+0000","last_became_peered":"2024-04-25T09:02:46.109096+0000","last_unstale":"2024-04-25T09:02:48.120481+0000","last_undegraded":"2024-04-25T09:02:48.120481+0000","last_fullsized":"2024-04-25T09:02:48.120481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:57.067398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448934+0000","last_change":"2024-04-25T09:02:47.105884+0000","last_active":"2024-04-25T09:02:49.448934+0000","last_peered":"2024-04-25T09:02:49.448934+0000","last_clean":"2024-04-25T09:02:49.448934+0000","last_became_active":"2024-04-25T09:02:47.105567+0000","last_became_peered":"2024-04-25T09:02:47.105567+0000","last_unstale":"2024-04-25T09:02:49.448934+0000","last_undegraded":"2024-04-25T09:02:49.448934+0000","last_fullsized":"2024-04-25T09:02:49.448934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.774231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118534+0000","last_change":"2024-04-25T09:02:46.112851+0000","last_active":"2024-04-25T09:02:48.118534+0000","last_peered":"2024-04-25T09:02:48.118534+0000","last_clean":"2024-04-25T09:02:48.118534+0000","last_became_active":"2024-04-25T09:02:46.112581+0000","last_became_peered":"2024-04-25T09:02:46.112581+0000","last_unstale":"2024-04-25T09:02:48.118534+0000","last_undegraded":"2024-04-25T09:02:48.118534+0000","last_fullsized":"2024-04-25T09:02:48.118534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:52.309097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449113+0000","last_change":"2024-04-25T09:02:47.114128+0000","last_active":"2024-04-25T09:02:49.449113+0000","last_peered":"2024-04-25T09:02:49.449113+0000","last_clean":"2024-04-25T09:02:49.449113+0000","last_became_active":"2024-04-25T09:02:47.113823+0000","last_became_peered":"2024-04-25T09:02:47.113823+0000","last_unstale":"2024-04-25T09:02:49.449113+0000","last_undegraded":"2024-04-25T09:02:49.449113+0000","last_fullsized":"2024-04-25T09:02:49.449113+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:45.161313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450416+0000","last_change":"2024-04-25T09:02:46.113990+0000","last_active":"2024-04-25T09:02:49.450416+0000","last_peered":"2024-04-25T09:02:49.450416+0000","last_clean":"2024-04-25T09:02:49.450416+0000","last_became_active":"2024-04-25T09:02:46.113649+0000","last_became_peered":"2024-04-25T09:02:46.113649+0000","last_unstale":"2024-04-25T09:02:49.450416+0000","last_undegraded":"2024-04-25T09:02:49.450416+0000","last_fullsized":"2024-04-25T09:02:49.450416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:39.055197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116728+0000","last_change":"2024-04-25T09:02:47.111610+0000","last_active":"2024-04-25T09:02:48.116728+0000","last_peered":"2024-04-25T09:02:48.116728+0000","last_clean":"2024-04-25T09:02:48.116728+0000","last_became_active":"2024-04-25T09:02:47.111287+0000","last_became_peered":"2024-04-25T09:02:47.111287+0000","last_unstale":"2024-04-25T09:02:48.116728+0000","last_undegraded":"2024-04-25T09:02:48.116728+0000","last_fullsized":"2024-04-25T09:02:48.116728+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:00.486118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450117+0000","last_change":"2024-04-25T09:02:46.110608+0000","last_active":"2024-04-25T09:02:49.450117+0000","last_peered":"2024-04-25T09:02:49.450117+0000","last_clean":"2024-04-25T09:02:49.450117+0000","last_became_active":"2024-04-25T09:02:46.110313+0000","last_became_peered":"2024-04-25T09:02:46.110313+0000","last_unstale":"2024-04-25T09:02:49.450117+0000","last_undegraded":"2024-04-25T09:02:49.450117+0000","last_fullsized":"2024-04-25T09:02:49.450117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:20.855675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120703+0000","last_change":"2024-04-25T09:02:47.130230+0000","last_active":"2024-04-25T09:02:48.120703+0000","last_peered":"2024-04-25T09:02:48.120703+0000","last_clean":"2024-04-25T09:02:48.120703+0000","last_became_active":"2024-04-25T09:02:47.129334+0000","last_became_peered":"2024-04-25T09:02:47.129334+0000","last_unstale":"2024-04-25T09:02:48.120703+0000","last_undegraded":"2024-04-25T09:02:48.120703+0000","last_fullsized":"2024-04-25T09:02:48.120703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:55.474082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449508+0000","last_change":"2024-04-25T09:02:46.107640+0000","last_active":"2024-04-25T09:02:49.449508+0000","last_peered":"2024-04-25T09:02:49.449508+0000","last_clean":"2024-04-25T09:02:49.449508+0000","last_became_active":"2024-04-25T09:02:46.107347+0000","last_became_peered":"2024-04-25T09:02:46.107347+0000","last_unstale":"2024-04-25T09:02:49.449508+0000","last_undegraded":"2024-04-25T09:02:49.449508+0000","last_fullsized":"2024-04-25T09:02:49.449508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.876030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115500+0000","last_change":"2024-04-25T09:02:47.120500+0000","last_active":"2024-04-25T09:02:48.115500+0000","last_peered":"2024-04-25T09:02:48.115500+0000","last_clean":"2024-04-25T09:02:48.115500+0000","last_became_active":"2024-04-25T09:02:47.120166+0000","last_became_peered":"2024-04-25T09:02:47.120166+0000","last_unstale":"2024-04-25T09:02:48.115500+0000","last_undegraded":"2024-04-25T09:02:48.115500+0000","last_fullsized":"2024-04-25T09:02:48.115500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:37.772205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116585+0000","last_change":"2024-04-25T09:02:46.110106+0000","last_active":"2024-04-25T09:02:48.116585+0000","last_peered":"2024-04-25T09:02:48.116585+0000","last_clean":"2024-04-25T09:02:48.116585+0000","last_became_active":"2024-04-25T09:02:46.109792+0000","last_became_peered":"2024-04-25T09:02:46.109792+0000","last_unstale":"2024-04-25T09:02:48.116585+0000","last_undegraded":"2024-04-25T09:02:48.116585+0000","last_fullsized":"2024-04-25T09:02:48.116585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:43.973337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120519+0000","last_change":"2024-04-25T09:02:47.119349+0000","last_active":"2024-04-25T09:02:48.120519+0000","last_peered":"2024-04-25T09:02:48.120519+0000","last_clean":"2024-04-25T09:02:48.120519+0000","last_became_active":"2024-04-25T09:02:47.119060+0000","last_became_peered":"2024-04-25T09:02:47.119060+0000","last_unstale":"2024-04-25T09:02:48.120519+0000","last_undegraded":"2024-04-25T09:02:48.120519+0000","last_fullsized":"2024-04-25T09:02:48.120519+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:31.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118800+0000","last_change":"2024-04-25T09:02:46.113211+0000","last_active":"2024-04-25T09:02:48.118800+0000","last_peered":"2024-04-25T09:02:48.118800+0000","last_clean":"2024-04-25T09:02:48.118800+0000","last_became_active":"2024-04-25T09:02:46.112471+0000","last_became_peered":"2024-04-25T09:02:46.112471+0000","last_unstale":"2024-04-25T09:02:48.118800+0000","last_undegraded":"2024-04-25T09:02:48.118800+0000","last_fullsized":"2024-04-25T09:02:48.118800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:08.152288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450322+0000","last_change":"2024-04-25T09:02:47.122293+0000","last_active":"2024-04-25T09:02:49.450322+0000","last_peered":"2024-04-25T09:02:49.450322+0000","last_clean":"2024-04-25T09:02:49.450322+0000","last_became_active":"2024-04-25T09:02:47.122013+0000","last_became_peered":"2024-04-25T09:02:47.122013+0000","last_unstale":"2024-04-25T09:02:49.450322+0000","last_undegraded":"2024-04-25T09:02:49.450322+0000","last_fullsized":"2024-04-25T09:02:49.450322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.328136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448940+0000","last_change":"2024-04-25T09:02:46.116619+0000","last_active":"2024-04-25T09:02:49.448940+0000","last_peered":"2024-04-25T09:02:49.448940+0000","last_clean":"2024-04-25T09:02:49.448940+0000","last_became_active":"2024-04-25T09:02:46.116270+0000","last_became_peered":"2024-04-25T09:02:46.116270+0000","last_unstale":"2024-04-25T09:02:49.448940+0000","last_undegraded":"2024-04-25T09:02:49.448940+0000","last_fullsized":"2024-04-25T09:02:49.448940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:28.028119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118873+0000","last_change":"2024-04-25T09:02:47.127555+0000","last_active":"2024-04-25T09:02:48.118873+0000","last_peered":"2024-04-25T09:02:48.118873+0000","last_clean":"2024-04-25T09:02:48.118873+0000","last_became_active":"2024-04-25T09:02:47.127232+0000","last_became_peered":"2024-04-25T09:02:47.127232+0000","last_unstale":"2024-04-25T09:02:48.118873+0000","last_undegraded":"2024-04-25T09:02:48.118873+0000","last_fullsized":"2024-04-25T09:02:48.118873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:49.069490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116365+0000","last_change":"2024-04-25T09:02:46.108915+0000","last_active":"2024-04-25T09:02:48.116365+0000","last_peered":"2024-04-25T09:02:48.116365+0000","last_clean":"2024-04-25T09:02:48.116365+0000","last_became_active":"2024-04-25T09:02:46.108574+0000","last_became_peered":"2024-04-25T09:02:46.108574+0000","last_unstale":"2024-04-25T09:02:48.116365+0000","last_undegraded":"2024-04-25T09:02:48.116365+0000","last_fullsized":"2024-04-25T09:02:48.116365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:06.546547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118431+0000","last_change":"2024-04-25T09:02:47.111323+0000","last_active":"2024-04-25T09:02:48.118431+0000","last_peered":"2024-04-25T09:02:48.118431+0000","last_clean":"2024-04-25T09:02:48.118431+0000","last_became_active":"2024-04-25T09:02:47.111033+0000","last_became_peered":"2024-04-25T09:02:47.111033+0000","last_unstale":"2024-04-25T09:02:48.118431+0000","last_undegraded":"2024-04-25T09:02:48.118431+0000","last_fullsized":"2024-04-25T09:02:48.118431+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:43.323941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120392+0000","last_change":"2024-04-25T09:02:46.107845+0000","last_active":"2024-04-25T09:02:48.120392+0000","last_peered":"2024-04-25T09:02:48.120392+0000","last_clean":"2024-04-25T09:02:48.120392+0000","last_became_active":"2024-04-25T09:02:46.106961+0000","last_became_peered":"2024-04-25T09:02:46.106961+0000","last_unstale":"2024-04-25T09:02:48.120392+0000","last_undegraded":"2024-04-25T09:02:48.120392+0000","last_fullsized":"2024-04-25T09:02:48.120392+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:39.055197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449873+0000","last_change":"2024-04-25T09:02:47.104017+0000","last_active":"2024-04-25T09:02:49.449873+0000","last_peered":"2024-04-25T09:02:49.449873+0000","last_clean":"2024-04-25T09:02:49.449873+0000","last_became_active":"2024-04-25T09:02:47.103731+0000","last_became_peered":"2024-04-25T09:02:47.103731+0000","last_unstale":"2024-04-25T09:02:49.449873+0000","last_undegraded":"2024-04-25T09:02:49.449873+0000","last_fullsized":"2024-04-25T09:02:49.449873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:56.719708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450486+0000","last_change":"2024-04-25T09:02:46.107715+0000","last_active":"2024-04-25T09:02:49.450486+0000","last_peered":"2024-04-25T09:02:49.450486+0000","last_clean":"2024-04-25T09:02:49.450486+0000","last_became_active":"2024-04-25T09:02:46.107421+0000","last_became_peered":"2024-04-25T09:02:46.107421+0000","last_unstale":"2024-04-25T09:02:49.450486+0000","last_undegraded":"2024-04-25T09:02:49.450486+0000","last_fullsized":"2024-04-25T09:02:49.450486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:57.067398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449980+0000","last_change":"2024-04-25T09:02:47.117133+0000","last_active":"2024-04-25T09:02:49.449980+0000","last_peered":"2024-04-25T09:02:49.449980+0000","last_clean":"2024-04-25T09:02:49.449980+0000","last_became_active":"2024-04-25T09:02:47.116241+0000","last_became_peered":"2024-04-25T09:02:47.116241+0000","last_unstale":"2024-04-25T09:02:49.449980+0000","last_undegraded":"2024-04-25T09:02:49.449980+0000","last_fullsized":"2024-04-25T09:02:49.449980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:48.354076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120821+0000","last_change":"2024-04-25T09:02:46.111553+0000","last_active":"2024-04-25T09:02:48.120821+0000","last_peered":"2024-04-25T09:02:48.120821+0000","last_clean":"2024-04-25T09:02:48.120821+0000","last_became_active":"2024-04-25T09:02:46.111284+0000","last_became_peered":"2024-04-25T09:02:46.111284+0000","last_unstale":"2024-04-25T09:02:48.120821+0000","last_undegraded":"2024-04-25T09:02:48.120821+0000","last_fullsized":"2024-04-25T09:02:48.120821+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:09.311901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115715+0000","last_change":"2024-04-25T09:02:47.113945+0000","last_active":"2024-04-25T09:02:48.115715+0000","last_peered":"2024-04-25T09:02:48.115715+0000","last_clean":"2024-04-25T09:02:48.115715+0000","last_became_active":"2024-04-25T09:02:47.113636+0000","last_became_peered":"2024-04-25T09:02:47.113636+0000","last_unstale":"2024-04-25T09:02:48.115715+0000","last_undegraded":"2024-04-25T09:02:48.115715+0000","last_fullsized":"2024-04-25T09:02:48.115715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:31.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120800+0000","last_change":"2024-04-25T09:02:46.108891+0000","last_active":"2024-04-25T09:02:48.120800+0000","last_peered":"2024-04-25T09:02:48.120800+0000","last_clean":"2024-04-25T09:02:48.120800+0000","last_became_active":"2024-04-25T09:02:46.108612+0000","last_became_peered":"2024-04-25T09:02:46.108612+0000","last_unstale":"2024-04-25T09:02:48.120800+0000","last_undegraded":"2024-04-25T09:02:48.120800+0000","last_fullsized":"2024-04-25T09:02:48.120800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:07.251501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109360+0000","last_change":"2024-04-25T09:02:47.121169+0000","last_active":"2024-04-25T09:02:48.109360+0000","last_peered":"2024-04-25T09:02:48.109360+0000","last_clean":"2024-04-25T09:02:48.109360+0000","last_became_active":"2024-04-25T09:02:47.120078+0000","last_became_peered":"2024-04-25T09:02:47.120078+0000","last_unstale":"2024-04-25T09:02:48.109360+0000","last_undegraded":"2024-04-25T09:02:48.109360+0000","last_fullsized":"2024-04-25T09:02:48.109360+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:43.323941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449031+0000","last_change":"2024-04-25T09:02:46.111031+0000","last_active":"2024-04-25T09:02:49.449031+0000","last_peered":"2024-04-25T09:02:49.449031+0000","last_clean":"2024-04-25T09:02:49.449031+0000","last_became_active":"2024-04-25T09:02:46.110664+0000","last_became_peered":"2024-04-25T09:02:46.110664+0000","last_unstale":"2024-04-25T09:02:49.449031+0000","last_undegraded":"2024-04-25T09:02:49.449031+0000","last_fullsized":"2024-04-25T09:02:49.449031+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:58.237683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116239+0000","last_change":"2024-04-25T09:02:47.110097+0000","last_active":"2024-04-25T09:02:48.116239+0000","last_peered":"2024-04-25T09:02:48.116239+0000","last_clean":"2024-04-25T09:02:48.116239+0000","last_became_active":"2024-04-25T09:02:47.109788+0000","last_became_peered":"2024-04-25T09:02:47.109788+0000","last_unstale":"2024-04-25T09:02:48.116239+0000","last_undegraded":"2024-04-25T09:02:48.116239+0000","last_fullsized":"2024-04-25T09:02:48.116239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:48.354076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109367+0000","last_change":"2024-04-25T09:02:46.111562+0000","last_active":"2024-04-25T09:02:48.109367+0000","last_peered":"2024-04-25T09:02:48.109367+0000","last_clean":"2024-04-25T09:02:48.109367+0000","last_became_active":"2024-04-25T09:02:46.111293+0000","last_became_peered":"2024-04-25T09:02:46.111293+0000","last_unstale":"2024-04-25T09:02:48.109367+0000","last_undegraded":"2024-04-25T09:02:48.109367+0000","last_fullsized":"2024-04-25T09:02:48.109367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:17.128028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109012+0000","last_change":"2024-04-25T09:02:47.119382+0000","last_active":"2024-04-25T09:02:48.109012+0000","last_peered":"2024-04-25T09:02:48.109012+0000","last_clean":"2024-04-25T09:02:48.109012+0000","last_became_active":"2024-04-25T09:02:47.118704+0000","last_became_peered":"2024-04-25T09:02:47.118704+0000","last_unstale":"2024-04-25T09:02:48.109012+0000","last_undegraded":"2024-04-25T09:02:48.109012+0000","last_fullsized":"2024-04-25T09:02:48.109012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:32.933009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109119+0000","last_change":"2024-04-25T09:02:46.106809+0000","last_active":"2024-04-25T09:02:48.109119+0000","last_peered":"2024-04-25T09:02:48.109119+0000","last_clean":"2024-04-25T09:02:48.109119+0000","last_became_active":"2024-04-25T09:02:46.106520+0000","last_became_peered":"2024-04-25T09:02:46.106520+0000","last_unstale":"2024-04-25T09:02:48.109119+0000","last_undegraded":"2024-04-25T09:02:48.109119+0000","last_fullsized":"2024-04-25T09:02:48.109119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:36.015097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116256+0000","last_change":"2024-04-25T09:02:47.123474+0000","last_active":"2024-04-25T09:02:48.116256+0000","last_peered":"2024-04-25T09:02:48.116256+0000","last_clean":"2024-04-25T09:02:48.116256+0000","last_became_active":"2024-04-25T09:02:47.123228+0000","last_became_peered":"2024-04-25T09:02:47.123228+0000","last_unstale":"2024-04-25T09:02:48.116256+0000","last_undegraded":"2024-04-25T09:02:48.116256+0000","last_fullsized":"2024-04-25T09:02:48.116256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:55.007150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448739+0000","last_change":"2024-04-25T09:02:46.109982+0000","last_active":"2024-04-25T09:02:49.448739+0000","last_peered":"2024-04-25T09:02:49.448739+0000","last_clean":"2024-04-25T09:02:49.448739+0000","last_became_active":"2024-04-25T09:02:46.109619+0000","last_became_peered":"2024-04-25T09:02:46.109619+0000","last_unstale":"2024-04-25T09:02:49.448739+0000","last_undegraded":"2024-04-25T09:02:49.448739+0000","last_fullsized":"2024-04-25T09:02:49.448739+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:54.341703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116372+0000","last_change":"2024-04-25T09:02:47.114546+0000","last_active":"2024-04-25T09:02:48.116372+0000","last_peered":"2024-04-25T09:02:48.116372+0000","last_clean":"2024-04-25T09:02:48.116372+0000","last_became_active":"2024-04-25T09:02:47.113616+0000","last_became_peered":"2024-04-25T09:02:47.113616+0000","last_unstale":"2024-04-25T09:02:48.116372+0000","last_undegraded":"2024-04-25T09:02:48.116372+0000","last_fullsized":"2024-04-25T09:02:48.116372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:30.974414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118807+0000","last_change":"2024-04-25T09:02:46.111543+0000","last_active":"2024-04-25T09:02:48.118807+0000","last_peered":"2024-04-25T09:02:48.118807+0000","last_clean":"2024-04-25T09:02:48.118807+0000","last_became_active":"2024-04-25T09:02:46.111246+0000","last_became_peered":"2024-04-25T09:02:46.111246+0000","last_unstale":"2024-04-25T09:02:48.118807+0000","last_undegraded":"2024-04-25T09:02:48.118807+0000","last_fullsized":"2024-04-25T09:02:48.118807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:57.543406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449956+0000","last_change":"2024-04-25T09:02:47.111691+0000","last_active":"2024-04-25T09:02:49.449956+0000","last_peered":"2024-04-25T09:02:49.449956+0000","last_clean":"2024-04-25T09:02:49.449956+0000","last_became_active":"2024-04-25T09:02:47.111448+0000","last_became_peered":"2024-04-25T09:02:47.111448+0000","last_unstale":"2024-04-25T09:02:49.449956+0000","last_undegraded":"2024-04-25T09:02:49.449956+0000","last_fullsized":"2024-04-25T09:02:49.449956+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:29.475038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"88'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118832+0000","last_change":"2024-04-25T09:02:46.112103+0000","last_active":"2024-04-25T09:02:48.118832+0000","last_peered":"2024-04-25T09:02:48.118832+0000","last_clean":"2024-04-25T09:02:48.118832+0000","last_became_active":"2024-04-25T09:02:46.111812+0000","last_became_peered":"2024-04-25T09:02:46.111812+0000","last_unstale":"2024-04-25T09:02:48.118832+0000","last_undegraded":"2024-04-25T09:02:48.118832+0000","last_fullsized":"2024-04-25T09:02:48.118832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:54.489886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450164+0000","last_change":"2024-04-25T09:02:47.121205+0000","last_active":"2024-04-25T09:02:49.450164+0000","last_peered":"2024-04-25T09:02:49.450164+0000","last_clean":"2024-04-25T09:02:49.450164+0000","last_became_active":"2024-04-25T09:02:47.120902+0000","last_became_peered":"2024-04-25T09:02:47.120902+0000","last_unstale":"2024-04-25T09:02:49.450164+0000","last_undegraded":"2024-04-25T09:02:49.450164+0000","last_fullsized":"2024-04-25T09:02:49.450164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:53.450949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449633+0000","last_change":"2024-04-25T09:02:46.108910+0000","last_active":"2024-04-25T09:02:49.449633+0000","last_peered":"2024-04-25T09:02:49.449633+0000","last_clean":"2024-04-25T09:02:49.449633+0000","last_became_active":"2024-04-25T09:02:46.108573+0000","last_became_peered":"2024-04-25T09:02:46.108573+0000","last_unstale":"2024-04-25T09:02:49.449633+0000","last_undegraded":"2024-04-25T09:02:49.449633+0000","last_fullsized":"2024-04-25T09:02:49.449633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:13.631276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115860+0000","last_change":"2024-04-25T09:02:47.120364+0000","last_active":"2024-04-25T09:02:48.115860+0000","last_peered":"2024-04-25T09:02:48.115860+0000","last_clean":"2024-04-25T09:02:48.115860+0000","last_became_active":"2024-04-25T09:02:47.120015+0000","last_became_peered":"2024-04-25T09:02:47.120015+0000","last_unstale":"2024-04-25T09:02:48.115860+0000","last_undegraded":"2024-04-25T09:02:48.115860+0000","last_fullsized":"2024-04-25T09:02:48.115860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:55.474082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450151+0000","last_change":"2024-04-25T09:02:46.113989+0000","last_active":"2024-04-25T09:02:49.450151+0000","last_peered":"2024-04-25T09:02:49.450151+0000","last_clean":"2024-04-25T09:02:49.450151+0000","last_became_active":"2024-04-25T09:02:46.113641+0000","last_became_peered":"2024-04-25T09:02:46.113641+0000","last_unstale":"2024-04-25T09:02:49.450151+0000","last_undegraded":"2024-04-25T09:02:49.450151+0000","last_fullsized":"2024-04-25T09:02:49.450151+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.252066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116393+0000","last_change":"2024-04-25T09:02:47.109197+0000","last_active":"2024-04-25T09:02:48.116393+0000","last_peered":"2024-04-25T09:02:48.116393+0000","last_clean":"2024-04-25T09:02:48.116393+0000","last_became_active":"2024-04-25T09:02:47.108931+0000","last_became_peered":"2024-04-25T09:02:47.108931+0000","last_unstale":"2024-04-25T09:02:48.116393+0000","last_undegraded":"2024-04-25T09:02:48.116393+0000","last_fullsized":"2024-04-25T09:02:48.116393+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:08.416754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120760+0000","last_change":"2024-04-25T09:02:46.110506+0000","last_active":"2024-04-25T09:02:48.120760+0000","last_peered":"2024-04-25T09:02:48.120760+0000","last_clean":"2024-04-25T09:02:48.120760+0000","last_became_active":"2024-04-25T09:02:46.110209+0000","last_became_peered":"2024-04-25T09:02:46.110209+0000","last_unstale":"2024-04-25T09:02:48.120760+0000","last_undegraded":"2024-04-25T09:02:48.120760+0000","last_fullsized":"2024-04-25T09:02:48.120760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:33.526304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120720+0000","last_change":"2024-04-25T09:02:47.122066+0000","last_active":"2024-04-25T09:02:48.120720+0000","last_peered":"2024-04-25T09:02:48.120720+0000","last_clean":"2024-04-25T09:02:48.120720+0000","last_became_active":"2024-04-25T09:02:47.121720+0000","last_became_peered":"2024-04-25T09:02:47.121720+0000","last_unstale":"2024-04-25T09:02:48.120720+0000","last_undegraded":"2024-04-25T09:02:48.120720+0000","last_fullsized":"2024-04-25T09:02:48.120720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:29.875044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115387+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:48.115387+0000","last_peered":"2024-04-25T09:02:48.115387+0000","last_clean":"2024-04-25T09:02:48.115387+0000","last_became_active":"2024-04-25T09:02:46.111500+0000","last_became_peered":"2024-04-25T09:02:46.111500+0000","last_unstale":"2024-04-25T09:02:48.115387+0000","last_undegraded":"2024-04-25T09:02:48.115387+0000","last_fullsized":"2024-04-25T09:02:48.115387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449592+0000","last_change":"2024-04-25T09:02:47.117254+0000","last_active":"2024-04-25T09:02:49.449592+0000","last_peered":"2024-04-25T09:02:49.449592+0000","last_clean":"2024-04-25T09:02:49.449592+0000","last_became_active":"2024-04-25T09:02:47.116783+0000","last_became_peered":"2024-04-25T09:02:47.116783+0000","last_unstale":"2024-04-25T09:02:49.449592+0000","last_undegraded":"2024-04-25T09:02:49.449592+0000","last_fullsized":"2024-04-25T09:02:49.449592+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:04.803713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449545+0000","last_change":"2024-04-25T09:02:46.110806+0000","last_active":"2024-04-25T09:02:49.449545+0000","last_peered":"2024-04-25T09:02:49.449545+0000","last_clean":"2024-04-25T09:02:49.449545+0000","last_became_active":"2024-04-25T09:02:46.110506+0000","last_became_peered":"2024-04-25T09:02:46.110506+0000","last_unstale":"2024-04-25T09:02:49.449545+0000","last_undegraded":"2024-04-25T09:02:49.449545+0000","last_fullsized":"2024-04-25T09:02:49.449545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449412+0000","last_change":"2024-04-25T09:02:47.121136+0000","last_active":"2024-04-25T09:02:49.449412+0000","last_peered":"2024-04-25T09:02:49.449412+0000","last_clean":"2024-04-25T09:02:49.449412+0000","last_became_active":"2024-04-25T09:02:47.120810+0000","last_became_peered":"2024-04-25T09:02:47.120810+0000","last_unstale":"2024-04-25T09:02:49.449412+0000","last_undegraded":"2024-04-25T09:02:49.449412+0000","last_fullsized":"2024-04-25T09:02:49.449412+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:29.875044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115167+0000","last_change":"2024-04-25T09:02:46.108946+0000","last_active":"2024-04-25T09:02:48.115167+0000","last_peered":"2024-04-25T09:02:48.115167+0000","last_clean":"2024-04-25T09:02:48.115167+0000","last_became_active":"2024-04-25T09:02:46.108676+0000","last_became_peered":"2024-04-25T09:02:46.108676+0000","last_unstale":"2024-04-25T09:02:48.115167+0000","last_undegraded":"2024-04-25T09:02:48.115167+0000","last_fullsized":"2024-04-25T09:02:48.115167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.876030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118819+0000","last_change":"2024-04-25T09:02:47.116962+0000","last_active":"2024-04-25T09:02:48.118819+0000","last_peered":"2024-04-25T09:02:48.118819+0000","last_clean":"2024-04-25T09:02:48.118819+0000","last_became_active":"2024-04-25T09:02:47.116694+0000","last_became_peered":"2024-04-25T09:02:47.116694+0000","last_unstale":"2024-04-25T09:02:48.118819+0000","last_undegraded":"2024-04-25T09:02:48.118819+0000","last_fullsized":"2024-04-25T09:02:48.118819+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:23.576638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450165+0000","last_change":"2024-04-25T09:02:46.115578+0000","last_active":"2024-04-25T09:02:49.450165+0000","last_peered":"2024-04-25T09:02:49.450165+0000","last_clean":"2024-04-25T09:02:49.450165+0000","last_became_active":"2024-04-25T09:02:46.115366+0000","last_became_peered":"2024-04-25T09:02:46.115366+0000","last_unstale":"2024-04-25T09:02:49.450165+0000","last_undegraded":"2024-04-25T09:02:49.450165+0000","last_fullsized":"2024-04-25T09:02:49.450165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:20.566894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":297,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449695+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:02:49.449695+0000","last_peered":"2024-04-25T09:02:49.449695+0000","last_clean":"2024-04-25T09:02:49.449695+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:02:49.449695+0000","last_undegraded":"2024-04-25T09:02:49.449695+0000","last_fullsized":"2024-04-25T09:02:49.449695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46708,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325132,"statfs":{"total":96636764160,"available":96588935168,"internally_reserved":0,"allocated":1679360,"data_stored":1056817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46140,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325700,"statfs":{"total":96636764160,"available":96589516800,"internally_reserved":0,"allocated":1093632,"data_stored":467073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40576,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331264,"statfs":{"total":96636764160,"available":96595214336,"internally_reserved":0,"allocated":1097728,"data_stored":468013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50292,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321548,"statfs":{"total":96636764160,"available":96585265152,"internally_reserved":0,"allocated":1081344,"data_stored":466379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50296,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321544,"statfs":{"total":96636764160,"available":96585261056,"internally_reserved":0,"allocated":1093632,"data_stored":467991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":466961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58616,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313224,"statfs":{"total":96636764160,"available":96576741376,"internally_reserved":0,"allocated":1093632,"data_stored":466573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28660,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343180,"statfs":{"total":96636764160,"available":96607416320,"internally_reserved":0,"allocated":1679360,"data_stored":1056781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:55.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:55.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.651+0000 7f4d7dd90640 1 Processor -- start 2024-04-25T09:02:55.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.651+0000 7f4d7dd90640 1 -- start start 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.652+0000 7f4d7dd90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d78156250 0x7f4d780b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.652+0000 7f4d7dd90640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d780b2aa0 con 0x7f4d780aeda0 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.652+0000 7f4d7dd90640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d780b2d80 con 0x7f4d7806dd20 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.652+0000 7f4d7dd90640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d780b2850 con 0x7f4d78156250 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.652+0000 7f4d777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d78156250 0x7f4d780b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.653+0000 7f4d77fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4d780aeda0 0x7f4d7815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48200/0 (socket says 172.21.15.5:48200) 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.653+0000 7f4d77fff640 1 -- 172.21.15.5:0/2677714974 learned_addr learned my addr 172.21.15.5:0/2677714974 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.653+0000 7f4d777fe640 1 -- 172.21.15.5:0/2677714974 >> v1:172.21.15.80:6789/0 conn(0x7f4d7806dd20 legacy=0x7f4d780ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.653+0000 7f4d777fe640 1 -- 172.21.15.5:0/2677714974 >> v1:172.21.15.5:6789/0 conn(0x7f4d780aeda0 legacy=0x7f4d7815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.653+0000 7f4d767fc640 1 -- 172.21.15.5:0/2677714974 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678453326 0 0) 0x7f4d780b2aa0 con 0x7f4d780aeda0 2024-04-25T09:02:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.653+0000 7f4d777fe640 1 -- 172.21.15.5:0/2677714974 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780b3060 con 0x7f4d78156250 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d777fe640 1 --2- 172.21.15.5:0/2677714974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78156250 0x7f4d780b44c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4d780b29d0 tx=0x7f4d6802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452b2833140d054a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d767fc640 1 -- 172.21.15.5:0/2677714974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68037070 con 0x7f4d78156250 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d767fc640 1 -- 172.21.15.5:0/2677714974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d68032440 con 0x7f4d78156250 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d767fc640 1 -- 172.21.15.5:0/2677714974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68032810 con 0x7f4d78156250 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2677714974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78156250 msgr2=0x7f4d780b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2677714974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78156250 0x7f4d780b44c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4d780b29d0 tx=0x7f4d6802a180 comp rx=0 tx=0).stop 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2677714974 shutdown_connections 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2677714974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78156250 0x7f4d780b44c0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2677714974 >> 172.21.15.5:0/2677714974 conn(0x7f4d780668f0 msgr2=0x7f4d78066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2677714974 shutdown_connections 2024-04-25T09:02:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.654+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2677714974 wait complete. 2024-04-25T09:02:55.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.656+0000 7f4d7dd90640 1 Processor -- start 2024-04-25T09:02:55.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.656+0000 7f4d7dd90640 1 -- start start 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d7dd90640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d780aeda0 0x7f4d78072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d7dd90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d78156250 0x7f4d78146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d7dd90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78158000 0x7f4d780ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d7dd90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780b4b80 con 0x7f4d78158000 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d7dd90640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780b4a00 con 0x7f4d780aeda0 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d7dd90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780b3860 con 0x7f4d78156250 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78158000 0x7f4d780ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78158000 0x7f4d780ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47310/0 (socket says 172.21.15.5:47310) 2024-04-25T09:02:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 -- 172.21.15.5:0/2500797069 learned_addr learned my addr 172.21.15.5:0/2500797069 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d777fe640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d780aeda0 0x7f4d78072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d76ffd640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d78156250 0x7f4d78146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 -- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d78156250 msgr2=0x7f4d78146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d78156250 0x7f4d78146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 -- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d780aeda0 msgr2=0x7f4d78072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d780aeda0 0x7f4d78072010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 -- 172.21.15.5:0/2500797069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d781588a0 con 0x7f4d78158000 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.657+0000 7f4d77fff640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78158000 0x7f4d780ad840 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000c7b0 tx=0x7f4d7000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.658+0000 7f4d5ffff640 1 -- 172.21.15.5:0/2500797069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70018070 con 0x7f4d78158000 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.658+0000 7f4d5ffff640 1 -- 172.21.15.5:0/2500797069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7000a640 con 0x7f4d78158000 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.658+0000 7f4d5ffff640 1 -- 172.21.15.5:0/2500797069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000aa30 con 0x7f4d78158000 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.658+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d78158b80 con 0x7f4d78158000 2024-04-25T09:02:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.658+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d78159140 con 0x7f4d78158000 2024-04-25T09:02:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.659+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d78159520 con 0x7f4d78158000 2024-04-25T09:02:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.659+0000 7f4d5ffff640 1 -- 172.21.15.5:0/2500797069 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d7001b070 con 0x7f4d78158000 2024-04-25T09:02:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.660+0000 7f4d5ffff640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d6406b4d0 0x7f4d6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.660+0000 7f4d5ffff640 1 -- 172.21.15.5:0/2500797069 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d70089760 con 0x7f4d78158000 2024-04-25T09:02:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.660+0000 7f4d777fe640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d6406b4d0 0x7f4d6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.660+0000 7f4d777fe640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d6406b4d0 0x7f4d6406d990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4d68034000 tx=0x7f4d6802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.664+0000 7f4d5ffff640 1 -- 172.21.15.5:0/2500797069 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d78159520 con 0x7f4d78158000 2024-04-25T09:02:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.843+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d7804ef20 con 0x7f4d6406b4d0 2024-04-25T09:02:55.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.849+0000 7f4d5ffff640 1 -- 172.21.15.5:0/2500797069 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252086 (secure 0 0 0) 0x7f4d7804ef20 con 0x7f4d6406b4d0 2024-04-25T09:02:55.839 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:02:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d6406b4d0 msgr2=0x7f4d6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d6406b4d0 0x7f4d6406d990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4d68034000 tx=0x7f4d6802e000 comp rx=0 tx=0).stop 2024-04-25T09:02:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78158000 msgr2=0x7f4d780ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78158000 0x7f4d780ad840 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000c7b0 tx=0x7f4d7000cc70 comp rx=0 tx=0).stop 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 shutdown_connections 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d6406b4d0 0x7f4d6406d990 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d78158000 0x7f4d780ad840 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d78156250 0x7f4d78146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 --2- 172.21.15.5:0/2500797069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d780aeda0 0x7f4d78072010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 >> 172.21.15.5:0/2500797069 conn(0x7f4d780668f0 msgr2=0x7f4d780cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 shutdown_connections 2024-04-25T09:02:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:55.852+0000 7f4d7dd90640 1 -- 172.21.15.5:0/2500797069 wait complete. 2024-04-25T09:02:55.851 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-04-25T09:02:54.471093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":353528,"kb_used_data":9672,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754621192,"statfs":{"total":773094113280,"available":772732100608,"internally_reserved":0,"allocated":9904128,"data_stored":4916588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002245"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449809+0000","last_change":"2024-04-25T09:02:47.121766+0000","last_active":"2024-04-25T09:02:49.449809+0000","last_peered":"2024-04-25T09:02:49.449809+0000","last_clean":"2024-04-25T09:02:49.449809+0000","last_became_active":"2024-04-25T09:02:47.121484+0000","last_became_peered":"2024-04-25T09:02:47.121484+0000","last_unstale":"2024-04-25T09:02:49.449809+0000","last_undegraded":"2024-04-25T09:02:49.449809+0000","last_fullsized":"2024-04-25T09:02:49.449809+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:30.974414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118772+0000","last_change":"2024-04-25T09:02:47.113567+0000","last_active":"2024-04-25T09:02:48.118772+0000","last_peered":"2024-04-25T09:02:48.118772+0000","last_clean":"2024-04-25T09:02:48.118772+0000","last_became_active":"2024-04-25T09:02:47.113124+0000","last_became_peered":"2024-04-25T09:02:47.113124+0000","last_unstale":"2024-04-25T09:02:48.118772+0000","last_undegraded":"2024-04-25T09:02:48.118772+0000","last_fullsized":"2024-04-25T09:02:48.118772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:39.524498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450017+0000","last_change":"2024-04-25T09:02:47.111152+0000","last_active":"2024-04-25T09:02:49.450017+0000","last_peered":"2024-04-25T09:02:49.450017+0000","last_clean":"2024-04-25T09:02:49.450017+0000","last_became_active":"2024-04-25T09:02:47.110806+0000","last_became_peered":"2024-04-25T09:02:47.110806+0000","last_unstale":"2024-04-25T09:02:49.450017+0000","last_undegraded":"2024-04-25T09:02:49.450017+0000","last_fullsized":"2024-04-25T09:02:49.450017+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:45.161313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109408+0000","last_change":"2024-04-25T09:02:47.119597+0000","last_active":"2024-04-25T09:02:48.109408+0000","last_peered":"2024-04-25T09:02:48.109408+0000","last_clean":"2024-04-25T09:02:48.109408+0000","last_became_active":"2024-04-25T09:02:47.119241+0000","last_became_peered":"2024-04-25T09:02:47.119241+0000","last_unstale":"2024-04-25T09:02:48.109408+0000","last_undegraded":"2024-04-25T09:02:48.109408+0000","last_fullsized":"2024-04-25T09:02:48.109408+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:13.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115538+0000","last_change":"2024-04-25T09:02:47.117639+0000","last_active":"2024-04-25T09:02:48.115538+0000","last_peered":"2024-04-25T09:02:48.115538+0000","last_clean":"2024-04-25T09:02:48.115538+0000","last_became_active":"2024-04-25T09:02:47.117223+0000","last_became_peered":"2024-04-25T09:02:47.117223+0000","last_unstale":"2024-04-25T09:02:48.115538+0000","last_undegraded":"2024-04-25T09:02:48.115538+0000","last_fullsized":"2024-04-25T09:02:48.115538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:52.387681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116213+0000","last_change":"2024-04-25T09:02:47.112321+0000","last_active":"2024-04-25T09:02:48.116213+0000","last_peered":"2024-04-25T09:02:48.116213+0000","last_clean":"2024-04-25T09:02:48.116213+0000","last_became_active":"2024-04-25T09:02:47.111953+0000","last_became_peered":"2024-04-25T09:02:47.111953+0000","last_unstale":"2024-04-25T09:02:48.116213+0000","last_undegraded":"2024-04-25T09:02:48.116213+0000","last_fullsized":"2024-04-25T09:02:48.116213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:30.974414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109016+0000","last_change":"2024-04-25T09:02:47.120222+0000","last_active":"2024-04-25T09:02:48.109016+0000","last_peered":"2024-04-25T09:02:48.109016+0000","last_clean":"2024-04-25T09:02:48.109016+0000","last_became_active":"2024-04-25T09:02:47.119837+0000","last_became_peered":"2024-04-25T09:02:47.119837+0000","last_unstale":"2024-04-25T09:02:48.109016+0000","last_undegraded":"2024-04-25T09:02:48.109016+0000","last_fullsized":"2024-04-25T09:02:48.109016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:19.814493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115800+0000","last_change":"2024-04-25T09:02:47.115566+0000","last_active":"2024-04-25T09:02:48.115800+0000","last_peered":"2024-04-25T09:02:48.115800+0000","last_clean":"2024-04-25T09:02:48.115800+0000","last_became_active":"2024-04-25T09:02:47.114920+0000","last_became_peered":"2024-04-25T09:02:47.114920+0000","last_unstale":"2024-04-25T09:02:48.115800+0000","last_undegraded":"2024-04-25T09:02:48.115800+0000","last_fullsized":"2024-04-25T09:02:48.115800+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:21.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116661+0000","last_change":"2024-04-25T09:02:47.122324+0000","last_active":"2024-04-25T09:02:48.116661+0000","last_peered":"2024-04-25T09:02:48.116661+0000","last_clean":"2024-04-25T09:02:48.116661+0000","last_became_active":"2024-04-25T09:02:47.122002+0000","last_became_peered":"2024-04-25T09:02:47.122002+0000","last_unstale":"2024-04-25T09:02:48.116661+0000","last_undegraded":"2024-04-25T09:02:48.116661+0000","last_fullsized":"2024-04-25T09:02:48.116661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:53.450949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449987+0000","last_change":"2024-04-25T09:02:47.120743+0000","last_active":"2024-04-25T09:02:49.449987+0000","last_peered":"2024-04-25T09:02:49.449987+0000","last_clean":"2024-04-25T09:02:49.449987+0000","last_became_active":"2024-04-25T09:02:47.119185+0000","last_became_peered":"2024-04-25T09:02:47.119185+0000","last_unstale":"2024-04-25T09:02:49.449987+0000","last_undegraded":"2024-04-25T09:02:49.449987+0000","last_fullsized":"2024-04-25T09:02:49.449987+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:55.007150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118789+0000","last_change":"2024-04-25T09:02:47.118105+0000","last_active":"2024-04-25T09:02:48.118789+0000","last_peered":"2024-04-25T09:02:48.118789+0000","last_clean":"2024-04-25T09:02:48.118789+0000","last_became_active":"2024-04-25T09:02:47.117680+0000","last_became_peered":"2024-04-25T09:02:47.117680+0000","last_unstale":"2024-04-25T09:02:48.118789+0000","last_undegraded":"2024-04-25T09:02:48.118789+0000","last_fullsized":"2024-04-25T09:02:48.118789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:23.338528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450022+0000","last_change":"2024-04-25T09:02:47.120592+0000","last_active":"2024-04-25T09:02:49.450022+0000","last_peered":"2024-04-25T09:02:49.450022+0000","last_clean":"2024-04-25T09:02:49.450022+0000","last_became_active":"2024-04-25T09:02:47.120327+0000","last_became_peered":"2024-04-25T09:02:47.120327+0000","last_unstale":"2024-04-25T09:02:49.450022+0000","last_undegraded":"2024-04-25T09:02:49.450022+0000","last_fullsized":"2024-04-25T09:02:49.450022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:08.416754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450163+0000","last_change":"2024-04-25T09:02:47.109330+0000","last_active":"2024-04-25T09:02:49.450163+0000","last_peered":"2024-04-25T09:02:49.450163+0000","last_clean":"2024-04-25T09:02:49.450163+0000","last_became_active":"2024-04-25T09:02:47.108967+0000","last_became_peered":"2024-04-25T09:02:47.108967+0000","last_unstale":"2024-04-25T09:02:49.450163+0000","last_undegraded":"2024-04-25T09:02:49.450163+0000","last_fullsized":"2024-04-25T09:02:49.450163+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:35.653742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109282+0000","last_change":"2024-04-25T09:02:47.121970+0000","last_active":"2024-04-25T09:02:48.109282+0000","last_peered":"2024-04-25T09:02:48.109282+0000","last_clean":"2024-04-25T09:02:48.109282+0000","last_became_active":"2024-04-25T09:02:47.121645+0000","last_became_peered":"2024-04-25T09:02:47.121645+0000","last_unstale":"2024-04-25T09:02:48.109282+0000","last_undegraded":"2024-04-25T09:02:48.109282+0000","last_fullsized":"2024-04-25T09:02:48.109282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:22.811113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448824+0000","last_change":"2024-04-25T09:02:47.103454+0000","last_active":"2024-04-25T09:02:49.448824+0000","last_peered":"2024-04-25T09:02:49.448824+0000","last_clean":"2024-04-25T09:02:49.448824+0000","last_became_active":"2024-04-25T09:02:47.103134+0000","last_became_peered":"2024-04-25T09:02:47.103134+0000","last_unstale":"2024-04-25T09:02:49.448824+0000","last_undegraded":"2024-04-25T09:02:49.448824+0000","last_fullsized":"2024-04-25T09:02:49.448824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:29.475038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115169+0000","last_change":"2024-04-25T09:02:47.117919+0000","last_active":"2024-04-25T09:02:48.115169+0000","last_peered":"2024-04-25T09:02:48.115169+0000","last_clean":"2024-04-25T09:02:48.115169+0000","last_became_active":"2024-04-25T09:02:47.117590+0000","last_became_peered":"2024-04-25T09:02:47.117590+0000","last_unstale":"2024-04-25T09:02:48.115169+0000","last_undegraded":"2024-04-25T09:02:48.115169+0000","last_fullsized":"2024-04-25T09:02:48.115169+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:07.551144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116211+0000","last_change":"2024-04-25T09:02:47.113140+0000","last_active":"2024-04-25T09:02:48.116211+0000","last_peered":"2024-04-25T09:02:48.116211+0000","last_clean":"2024-04-25T09:02:48.116211+0000","last_became_active":"2024-04-25T09:02:47.112878+0000","last_became_peered":"2024-04-25T09:02:47.112878+0000","last_unstale":"2024-04-25T09:02:48.116211+0000","last_undegraded":"2024-04-25T09:02:48.116211+0000","last_fullsized":"2024-04-25T09:02:48.116211+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:21.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109136+0000","last_change":"2024-04-25T09:02:47.111993+0000","last_active":"2024-04-25T09:02:48.109136+0000","last_peered":"2024-04-25T09:02:48.109136+0000","last_clean":"2024-04-25T09:02:48.109136+0000","last_became_active":"2024-04-25T09:02:47.111666+0000","last_became_peered":"2024-04-25T09:02:47.111666+0000","last_unstale":"2024-04-25T09:02:48.109136+0000","last_undegraded":"2024-04-25T09:02:48.109136+0000","last_fullsized":"2024-04-25T09:02:48.109136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:04.137815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120916+0000","last_change":"2024-04-25T09:02:47.118784+0000","last_active":"2024-04-25T09:02:48.120916+0000","last_peered":"2024-04-25T09:02:48.120916+0000","last_clean":"2024-04-25T09:02:48.120916+0000","last_became_active":"2024-04-25T09:02:47.118148+0000","last_became_peered":"2024-04-25T09:02:47.118148+0000","last_unstale":"2024-04-25T09:02:48.120916+0000","last_undegraded":"2024-04-25T09:02:48.120916+0000","last_fullsized":"2024-04-25T09:02:48.120916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:34.187600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109437+0000","last_change":"2024-04-25T09:02:47.121537+0000","last_active":"2024-04-25T09:02:48.109437+0000","last_peered":"2024-04-25T09:02:48.109437+0000","last_clean":"2024-04-25T09:02:48.109437+0000","last_became_active":"2024-04-25T09:02:47.121198+0000","last_became_peered":"2024-04-25T09:02:47.121198+0000","last_unstale":"2024-04-25T09:02:48.109437+0000","last_undegraded":"2024-04-25T09:02:48.109437+0000","last_fullsized":"2024-04-25T09:02:48.109437+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:19.336172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109210+0000","last_change":"2024-04-25T09:02:47.121114+0000","last_active":"2024-04-25T09:02:48.109210+0000","last_peered":"2024-04-25T09:02:48.109210+0000","last_clean":"2024-04-25T09:02:48.109210+0000","last_became_active":"2024-04-25T09:02:47.120604+0000","last_became_peered":"2024-04-25T09:02:47.120604+0000","last_unstale":"2024-04-25T09:02:48.109210+0000","last_undegraded":"2024-04-25T09:02:48.109210+0000","last_fullsized":"2024-04-25T09:02:48.109210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:29.813163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118599+0000","last_change":"2024-04-25T09:02:47.129148+0000","last_active":"2024-04-25T09:02:48.118599+0000","last_peered":"2024-04-25T09:02:48.118599+0000","last_clean":"2024-04-25T09:02:48.118599+0000","last_became_active":"2024-04-25T09:02:47.128701+0000","last_became_peered":"2024-04-25T09:02:47.128701+0000","last_unstale":"2024-04-25T09:02:48.118599+0000","last_undegraded":"2024-04-25T09:02:48.118599+0000","last_fullsized":"2024-04-25T09:02:48.118599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:13.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449341+0000","last_change":"2024-04-25T09:02:47.123259+0000","last_active":"2024-04-25T09:02:49.449341+0000","last_peered":"2024-04-25T09:02:49.449341+0000","last_clean":"2024-04-25T09:02:49.449341+0000","last_became_active":"2024-04-25T09:02:47.122986+0000","last_became_peered":"2024-04-25T09:02:47.122986+0000","last_unstale":"2024-04-25T09:02:49.449341+0000","last_undegraded":"2024-04-25T09:02:49.449341+0000","last_fullsized":"2024-04-25T09:02:49.449341+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:31.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.108999+0000","last_change":"2024-04-25T09:02:47.122294+0000","last_active":"2024-04-25T09:02:48.108999+0000","last_peered":"2024-04-25T09:02:48.108999+0000","last_clean":"2024-04-25T09:02:48.108999+0000","last_became_active":"2024-04-25T09:02:47.120550+0000","last_became_peered":"2024-04-25T09:02:47.120550+0000","last_unstale":"2024-04-25T09:02:48.108999+0000","last_undegraded":"2024-04-25T09:02:48.108999+0000","last_fullsized":"2024-04-25T09:02:48.108999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:40.285241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118917+0000","last_change":"2024-04-25T09:02:47.114917+0000","last_active":"2024-04-25T09:02:48.118917+0000","last_peered":"2024-04-25T09:02:48.118917+0000","last_clean":"2024-04-25T09:02:48.118917+0000","last_became_active":"2024-04-25T09:02:47.114627+0000","last_became_peered":"2024-04-25T09:02:47.114627+0000","last_unstale":"2024-04-25T09:02:48.118917+0000","last_undegraded":"2024-04-25T09:02:48.118917+0000","last_fullsized":"2024-04-25T09:02:48.118917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:47.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449968+0000","last_change":"2024-04-25T09:02:47.116889+0000","last_active":"2024-04-25T09:02:49.449968+0000","last_peered":"2024-04-25T09:02:49.449968+0000","last_clean":"2024-04-25T09:02:49.449968+0000","last_became_active":"2024-04-25T09:02:47.116613+0000","last_became_peered":"2024-04-25T09:02:47.116613+0000","last_unstale":"2024-04-25T09:02:49.449968+0000","last_undegraded":"2024-04-25T09:02:49.449968+0000","last_fullsized":"2024-04-25T09:02:49.449968+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.774231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116009+0000","last_change":"2024-04-25T09:02:47.115365+0000","last_active":"2024-04-25T09:02:48.116009+0000","last_peered":"2024-04-25T09:02:48.116009+0000","last_clean":"2024-04-25T09:02:48.116009+0000","last_became_active":"2024-04-25T09:02:47.114257+0000","last_became_peered":"2024-04-25T09:02:47.114257+0000","last_unstale":"2024-04-25T09:02:48.116009+0000","last_undegraded":"2024-04-25T09:02:48.116009+0000","last_fullsized":"2024-04-25T09:02:48.116009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:29.875044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449575+0000","last_change":"2024-04-25T09:02:47.113562+0000","last_active":"2024-04-25T09:02:49.449575+0000","last_peered":"2024-04-25T09:02:49.449575+0000","last_clean":"2024-04-25T09:02:49.449575+0000","last_became_active":"2024-04-25T09:02:47.112956+0000","last_became_peered":"2024-04-25T09:02:47.112956+0000","last_unstale":"2024-04-25T09:02:49.449575+0000","last_undegraded":"2024-04-25T09:02:49.449575+0000","last_fullsized":"2024-04-25T09:02:49.449575+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:34.187600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118884+0000","last_change":"2024-04-25T09:02:47.117386+0000","last_active":"2024-04-25T09:02:48.118884+0000","last_peered":"2024-04-25T09:02:48.118884+0000","last_clean":"2024-04-25T09:02:48.118884+0000","last_became_active":"2024-04-25T09:02:47.115672+0000","last_became_peered":"2024-04-25T09:02:47.115672+0000","last_unstale":"2024-04-25T09:02:48.118884+0000","last_undegraded":"2024-04-25T09:02:48.118884+0000","last_fullsized":"2024-04-25T09:02:48.118884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:12.186706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118772+0000","last_change":"2024-04-25T09:02:47.111278+0000","last_active":"2024-04-25T09:02:48.118772+0000","last_peered":"2024-04-25T09:02:48.118772+0000","last_clean":"2024-04-25T09:02:48.118772+0000","last_became_active":"2024-04-25T09:02:47.110978+0000","last_became_peered":"2024-04-25T09:02:47.110978+0000","last_unstale":"2024-04-25T09:02:48.118772+0000","last_undegraded":"2024-04-25T09:02:48.118772+0000","last_fullsized":"2024-04-25T09:02:48.118772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:30.925813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115168+0000","last_change":"2024-04-25T09:02:47.120323+0000","last_active":"2024-04-25T09:02:48.115168+0000","last_peered":"2024-04-25T09:02:48.115168+0000","last_clean":"2024-04-25T09:02:48.115168+0000","last_became_active":"2024-04-25T09:02:47.120054+0000","last_became_peered":"2024-04-25T09:02:47.120054+0000","last_unstale":"2024-04-25T09:02:48.115168+0000","last_undegraded":"2024-04-25T09:02:48.115168+0000","last_fullsized":"2024-04-25T09:02:48.115168+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:44.977935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449362+0000","last_change":"2024-04-25T09:02:47.118662+0000","last_active":"2024-04-25T09:02:49.449362+0000","last_peered":"2024-04-25T09:02:49.449362+0000","last_clean":"2024-04-25T09:02:49.449362+0000","last_became_active":"2024-04-25T09:02:47.118372+0000","last_became_peered":"2024-04-25T09:02:47.118372+0000","last_unstale":"2024-04-25T09:02:49.449362+0000","last_undegraded":"2024-04-25T09:02:49.449362+0000","last_fullsized":"2024-04-25T09:02:49.449362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:55.474082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116018+0000","last_change":"2024-04-25T09:02:47.117969+0000","last_active":"2024-04-25T09:02:48.116018+0000","last_peered":"2024-04-25T09:02:48.116018+0000","last_clean":"2024-04-25T09:02:48.116018+0000","last_became_active":"2024-04-25T09:02:47.117652+0000","last_became_peered":"2024-04-25T09:02:47.117652+0000","last_unstale":"2024-04-25T09:02:48.116018+0000","last_undegraded":"2024-04-25T09:02:48.116018+0000","last_fullsized":"2024-04-25T09:02:48.116018+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:34.187600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450331+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:49.450331+0000","last_peered":"2024-04-25T09:02:49.450331+0000","last_clean":"2024-04-25T09:02:49.450331+0000","last_became_active":"2024-04-25T09:02:46.111552+0000","last_became_peered":"2024-04-25T09:02:46.111552+0000","last_unstale":"2024-04-25T09:02:49.450331+0000","last_undegraded":"2024-04-25T09:02:49.450331+0000","last_fullsized":"2024-04-25T09:02:49.450331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:46.458086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450343+0000","last_change":"2024-04-25T09:02:47.123695+0000","last_active":"2024-04-25T09:02:49.450343+0000","last_peered":"2024-04-25T09:02:49.450343+0000","last_clean":"2024-04-25T09:02:49.450343+0000","last_became_active":"2024-04-25T09:02:47.123382+0000","last_became_peered":"2024-04-25T09:02:47.123382+0000","last_unstale":"2024-04-25T09:02:49.450343+0000","last_undegraded":"2024-04-25T09:02:49.450343+0000","last_fullsized":"2024-04-25T09:02:49.450343+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:00.486118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116143+0000","last_change":"2024-04-25T09:02:46.112288+0000","last_active":"2024-04-25T09:02:48.116143+0000","last_peered":"2024-04-25T09:02:48.116143+0000","last_clean":"2024-04-25T09:02:48.116143+0000","last_became_active":"2024-04-25T09:02:46.111207+0000","last_became_peered":"2024-04-25T09:02:46.111207+0000","last_unstale":"2024-04-25T09:02:48.116143+0000","last_undegraded":"2024-04-25T09:02:48.116143+0000","last_fullsized":"2024-04-25T09:02:48.116143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.252066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449743+0000","last_change":"2024-04-25T09:02:47.118680+0000","last_active":"2024-04-25T09:02:49.449743+0000","last_peered":"2024-04-25T09:02:49.449743+0000","last_clean":"2024-04-25T09:02:49.449743+0000","last_became_active":"2024-04-25T09:02:47.118357+0000","last_became_peered":"2024-04-25T09:02:47.118357+0000","last_unstale":"2024-04-25T09:02:49.449743+0000","last_undegraded":"2024-04-25T09:02:49.449743+0000","last_fullsized":"2024-04-25T09:02:49.449743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:21.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120904+0000","last_change":"2024-04-25T09:02:46.114067+0000","last_active":"2024-04-25T09:02:48.120904+0000","last_peered":"2024-04-25T09:02:48.120904+0000","last_clean":"2024-04-25T09:02:48.120904+0000","last_became_active":"2024-04-25T09:02:46.113719+0000","last_became_peered":"2024-04-25T09:02:46.113719+0000","last_unstale":"2024-04-25T09:02:48.120904+0000","last_undegraded":"2024-04-25T09:02:48.120904+0000","last_fullsized":"2024-04-25T09:02:48.120904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:25.898949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450213+0000","last_change":"2024-04-25T09:02:47.111690+0000","last_active":"2024-04-25T09:02:49.450213+0000","last_peered":"2024-04-25T09:02:49.450213+0000","last_clean":"2024-04-25T09:02:49.450213+0000","last_became_active":"2024-04-25T09:02:47.111315+0000","last_became_peered":"2024-04-25T09:02:47.111315+0000","last_unstale":"2024-04-25T09:02:49.450213+0000","last_undegraded":"2024-04-25T09:02:49.450213+0000","last_fullsized":"2024-04-25T09:02:49.450213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:39.588482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120703+0000","last_change":"2024-04-25T09:02:46.114156+0000","last_active":"2024-04-25T09:02:48.120703+0000","last_peered":"2024-04-25T09:02:48.120703+0000","last_clean":"2024-04-25T09:02:48.120703+0000","last_became_active":"2024-04-25T09:02:46.113803+0000","last_became_peered":"2024-04-25T09:02:46.113803+0000","last_unstale":"2024-04-25T09:02:48.120703+0000","last_undegraded":"2024-04-25T09:02:48.120703+0000","last_fullsized":"2024-04-25T09:02:48.120703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:51.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118605+0000","last_change":"2024-04-25T09:02:47.114193+0000","last_active":"2024-04-25T09:02:48.118605+0000","last_peered":"2024-04-25T09:02:48.118605+0000","last_clean":"2024-04-25T09:02:48.118605+0000","last_became_active":"2024-04-25T09:02:47.113885+0000","last_became_peered":"2024-04-25T09:02:47.113885+0000","last_unstale":"2024-04-25T09:02:48.118605+0000","last_undegraded":"2024-04-25T09:02:48.118605+0000","last_fullsized":"2024-04-25T09:02:48.118605+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:19.336172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115825+0000","last_change":"2024-04-25T09:02:46.114380+0000","last_active":"2024-04-25T09:02:48.115825+0000","last_peered":"2024-04-25T09:02:48.115825+0000","last_clean":"2024-04-25T09:02:48.115825+0000","last_became_active":"2024-04-25T09:02:46.113834+0000","last_became_peered":"2024-04-25T09:02:46.113834+0000","last_unstale":"2024-04-25T09:02:48.115825+0000","last_undegraded":"2024-04-25T09:02:48.115825+0000","last_fullsized":"2024-04-25T09:02:48.115825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:13.631276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115543+0000","last_change":"2024-04-25T09:02:47.121836+0000","last_active":"2024-04-25T09:02:48.115543+0000","last_peered":"2024-04-25T09:02:48.115543+0000","last_clean":"2024-04-25T09:02:48.115543+0000","last_became_active":"2024-04-25T09:02:47.121576+0000","last_became_peered":"2024-04-25T09:02:47.121576+0000","last_unstale":"2024-04-25T09:02:48.115543+0000","last_undegraded":"2024-04-25T09:02:48.115543+0000","last_fullsized":"2024-04-25T09:02:48.115543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:18.224831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115454+0000","last_change":"2024-04-25T09:02:46.112267+0000","last_active":"2024-04-25T09:02:48.115454+0000","last_peered":"2024-04-25T09:02:48.115454+0000","last_clean":"2024-04-25T09:02:48.115454+0000","last_became_active":"2024-04-25T09:02:46.111817+0000","last_became_peered":"2024-04-25T09:02:46.111817+0000","last_unstale":"2024-04-25T09:02:48.115454+0000","last_undegraded":"2024-04-25T09:02:48.115454+0000","last_fullsized":"2024-04-25T09:02:48.115454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.563667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449385+0000","last_change":"2024-04-25T09:02:47.121037+0000","last_active":"2024-04-25T09:02:49.449385+0000","last_peered":"2024-04-25T09:02:49.449385+0000","last_clean":"2024-04-25T09:02:49.449385+0000","last_became_active":"2024-04-25T09:02:47.120716+0000","last_became_peered":"2024-04-25T09:02:47.120716+0000","last_unstale":"2024-04-25T09:02:49.449385+0000","last_undegraded":"2024-04-25T09:02:49.449385+0000","last_fullsized":"2024-04-25T09:02:49.449385+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:17.492319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120481+0000","last_change":"2024-04-25T09:02:46.109390+0000","last_active":"2024-04-25T09:02:48.120481+0000","last_peered":"2024-04-25T09:02:48.120481+0000","last_clean":"2024-04-25T09:02:48.120481+0000","last_became_active":"2024-04-25T09:02:46.109096+0000","last_became_peered":"2024-04-25T09:02:46.109096+0000","last_unstale":"2024-04-25T09:02:48.120481+0000","last_undegraded":"2024-04-25T09:02:48.120481+0000","last_fullsized":"2024-04-25T09:02:48.120481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:57.067398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448934+0000","last_change":"2024-04-25T09:02:47.105884+0000","last_active":"2024-04-25T09:02:49.448934+0000","last_peered":"2024-04-25T09:02:49.448934+0000","last_clean":"2024-04-25T09:02:49.448934+0000","last_became_active":"2024-04-25T09:02:47.105567+0000","last_became_peered":"2024-04-25T09:02:47.105567+0000","last_unstale":"2024-04-25T09:02:49.448934+0000","last_undegraded":"2024-04-25T09:02:49.448934+0000","last_fullsized":"2024-04-25T09:02:49.448934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.774231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118534+0000","last_change":"2024-04-25T09:02:46.112851+0000","last_active":"2024-04-25T09:02:48.118534+0000","last_peered":"2024-04-25T09:02:48.118534+0000","last_clean":"2024-04-25T09:02:48.118534+0000","last_became_active":"2024-04-25T09:02:46.112581+0000","last_became_peered":"2024-04-25T09:02:46.112581+0000","last_unstale":"2024-04-25T09:02:48.118534+0000","last_undegraded":"2024-04-25T09:02:48.118534+0000","last_fullsized":"2024-04-25T09:02:48.118534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:52.309097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449113+0000","last_change":"2024-04-25T09:02:47.114128+0000","last_active":"2024-04-25T09:02:49.449113+0000","last_peered":"2024-04-25T09:02:49.449113+0000","last_clean":"2024-04-25T09:02:49.449113+0000","last_became_active":"2024-04-25T09:02:47.113823+0000","last_became_peered":"2024-04-25T09:02:47.113823+0000","last_unstale":"2024-04-25T09:02:49.449113+0000","last_undegraded":"2024-04-25T09:02:49.449113+0000","last_fullsized":"2024-04-25T09:02:49.449113+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:45.161313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450416+0000","last_change":"2024-04-25T09:02:46.113990+0000","last_active":"2024-04-25T09:02:49.450416+0000","last_peered":"2024-04-25T09:02:49.450416+0000","last_clean":"2024-04-25T09:02:49.450416+0000","last_became_active":"2024-04-25T09:02:46.113649+0000","last_became_peered":"2024-04-25T09:02:46.113649+0000","last_unstale":"2024-04-25T09:02:49.450416+0000","last_undegraded":"2024-04-25T09:02:49.450416+0000","last_fullsized":"2024-04-25T09:02:49.450416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:39.055197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116728+0000","last_change":"2024-04-25T09:02:47.111610+0000","last_active":"2024-04-25T09:02:48.116728+0000","last_peered":"2024-04-25T09:02:48.116728+0000","last_clean":"2024-04-25T09:02:48.116728+0000","last_became_active":"2024-04-25T09:02:47.111287+0000","last_became_peered":"2024-04-25T09:02:47.111287+0000","last_unstale":"2024-04-25T09:02:48.116728+0000","last_undegraded":"2024-04-25T09:02:48.116728+0000","last_fullsized":"2024-04-25T09:02:48.116728+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:00.486118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450117+0000","last_change":"2024-04-25T09:02:46.110608+0000","last_active":"2024-04-25T09:02:49.450117+0000","last_peered":"2024-04-25T09:02:49.450117+0000","last_clean":"2024-04-25T09:02:49.450117+0000","last_became_active":"2024-04-25T09:02:46.110313+0000","last_became_peered":"2024-04-25T09:02:46.110313+0000","last_unstale":"2024-04-25T09:02:49.450117+0000","last_undegraded":"2024-04-25T09:02:49.450117+0000","last_fullsized":"2024-04-25T09:02:49.450117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:20.855675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120703+0000","last_change":"2024-04-25T09:02:47.130230+0000","last_active":"2024-04-25T09:02:48.120703+0000","last_peered":"2024-04-25T09:02:48.120703+0000","last_clean":"2024-04-25T09:02:48.120703+0000","last_became_active":"2024-04-25T09:02:47.129334+0000","last_became_peered":"2024-04-25T09:02:47.129334+0000","last_unstale":"2024-04-25T09:02:48.120703+0000","last_undegraded":"2024-04-25T09:02:48.120703+0000","last_fullsized":"2024-04-25T09:02:48.120703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:55.474082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449508+0000","last_change":"2024-04-25T09:02:46.107640+0000","last_active":"2024-04-25T09:02:49.449508+0000","last_peered":"2024-04-25T09:02:49.449508+0000","last_clean":"2024-04-25T09:02:49.449508+0000","last_became_active":"2024-04-25T09:02:46.107347+0000","last_became_peered":"2024-04-25T09:02:46.107347+0000","last_unstale":"2024-04-25T09:02:49.449508+0000","last_undegraded":"2024-04-25T09:02:49.449508+0000","last_fullsized":"2024-04-25T09:02:49.449508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.876030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115500+0000","last_change":"2024-04-25T09:02:47.120500+0000","last_active":"2024-04-25T09:02:48.115500+0000","last_peered":"2024-04-25T09:02:48.115500+0000","last_clean":"2024-04-25T09:02:48.115500+0000","last_became_active":"2024-04-25T09:02:47.120166+0000","last_became_peered":"2024-04-25T09:02:47.120166+0000","last_unstale":"2024-04-25T09:02:48.115500+0000","last_undegraded":"2024-04-25T09:02:48.115500+0000","last_fullsized":"2024-04-25T09:02:48.115500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:37.772205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116585+0000","last_change":"2024-04-25T09:02:46.110106+0000","last_active":"2024-04-25T09:02:48.116585+0000","last_peered":"2024-04-25T09:02:48.116585+0000","last_clean":"2024-04-25T09:02:48.116585+0000","last_became_active":"2024-04-25T09:02:46.109792+0000","last_became_peered":"2024-04-25T09:02:46.109792+0000","last_unstale":"2024-04-25T09:02:48.116585+0000","last_undegraded":"2024-04-25T09:02:48.116585+0000","last_fullsized":"2024-04-25T09:02:48.116585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:43.973337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120519+0000","last_change":"2024-04-25T09:02:47.119349+0000","last_active":"2024-04-25T09:02:48.120519+0000","last_peered":"2024-04-25T09:02:48.120519+0000","last_clean":"2024-04-25T09:02:48.120519+0000","last_became_active":"2024-04-25T09:02:47.119060+0000","last_became_peered":"2024-04-25T09:02:47.119060+0000","last_unstale":"2024-04-25T09:02:48.120519+0000","last_undegraded":"2024-04-25T09:02:48.120519+0000","last_fullsized":"2024-04-25T09:02:48.120519+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:31.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118800+0000","last_change":"2024-04-25T09:02:46.113211+0000","last_active":"2024-04-25T09:02:48.118800+0000","last_peered":"2024-04-25T09:02:48.118800+0000","last_clean":"2024-04-25T09:02:48.118800+0000","last_became_active":"2024-04-25T09:02:46.112471+0000","last_became_peered":"2024-04-25T09:02:46.112471+0000","last_unstale":"2024-04-25T09:02:48.118800+0000","last_undegraded":"2024-04-25T09:02:48.118800+0000","last_fullsized":"2024-04-25T09:02:48.118800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:08.152288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450322+0000","last_change":"2024-04-25T09:02:47.122293+0000","last_active":"2024-04-25T09:02:49.450322+0000","last_peered":"2024-04-25T09:02:49.450322+0000","last_clean":"2024-04-25T09:02:49.450322+0000","last_became_active":"2024-04-25T09:02:47.122013+0000","last_became_peered":"2024-04-25T09:02:47.122013+0000","last_unstale":"2024-04-25T09:02:49.450322+0000","last_undegraded":"2024-04-25T09:02:49.450322+0000","last_fullsized":"2024-04-25T09:02:49.450322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.328136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448940+0000","last_change":"2024-04-25T09:02:46.116619+0000","last_active":"2024-04-25T09:02:49.448940+0000","last_peered":"2024-04-25T09:02:49.448940+0000","last_clean":"2024-04-25T09:02:49.448940+0000","last_became_active":"2024-04-25T09:02:46.116270+0000","last_became_peered":"2024-04-25T09:02:46.116270+0000","last_unstale":"2024-04-25T09:02:49.448940+0000","last_undegraded":"2024-04-25T09:02:49.448940+0000","last_fullsized":"2024-04-25T09:02:49.448940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:28.028119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118873+0000","last_change":"2024-04-25T09:02:47.127555+0000","last_active":"2024-04-25T09:02:48.118873+0000","last_peered":"2024-04-25T09:02:48.118873+0000","last_clean":"2024-04-25T09:02:48.118873+0000","last_became_active":"2024-04-25T09:02:47.127232+0000","last_became_peered":"2024-04-25T09:02:47.127232+0000","last_unstale":"2024-04-25T09:02:48.118873+0000","last_undegraded":"2024-04-25T09:02:48.118873+0000","last_fullsized":"2024-04-25T09:02:48.118873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:49.069490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116365+0000","last_change":"2024-04-25T09:02:46.108915+0000","last_active":"2024-04-25T09:02:48.116365+0000","last_peered":"2024-04-25T09:02:48.116365+0000","last_clean":"2024-04-25T09:02:48.116365+0000","last_became_active":"2024-04-25T09:02:46.108574+0000","last_became_peered":"2024-04-25T09:02:46.108574+0000","last_unstale":"2024-04-25T09:02:48.116365+0000","last_undegraded":"2024-04-25T09:02:48.116365+0000","last_fullsized":"2024-04-25T09:02:48.116365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:06.546547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118431+0000","last_change":"2024-04-25T09:02:47.111323+0000","last_active":"2024-04-25T09:02:48.118431+0000","last_peered":"2024-04-25T09:02:48.118431+0000","last_clean":"2024-04-25T09:02:48.118431+0000","last_became_active":"2024-04-25T09:02:47.111033+0000","last_became_peered":"2024-04-25T09:02:47.111033+0000","last_unstale":"2024-04-25T09:02:48.118431+0000","last_undegraded":"2024-04-25T09:02:48.118431+0000","last_fullsized":"2024-04-25T09:02:48.118431+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:43.323941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120392+0000","last_change":"2024-04-25T09:02:46.107845+0000","last_active":"2024-04-25T09:02:48.120392+0000","last_peered":"2024-04-25T09:02:48.120392+0000","last_clean":"2024-04-25T09:02:48.120392+0000","last_became_active":"2024-04-25T09:02:46.106961+0000","last_became_peered":"2024-04-25T09:02:46.106961+0000","last_unstale":"2024-04-25T09:02:48.120392+0000","last_undegraded":"2024-04-25T09:02:48.120392+0000","last_fullsized":"2024-04-25T09:02:48.120392+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:39.055197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449873+0000","last_change":"2024-04-25T09:02:47.104017+0000","last_active":"2024-04-25T09:02:49.449873+0000","last_peered":"2024-04-25T09:02:49.449873+0000","last_clean":"2024-04-25T09:02:49.449873+0000","last_became_active":"2024-04-25T09:02:47.103731+0000","last_became_peered":"2024-04-25T09:02:47.103731+0000","last_unstale":"2024-04-25T09:02:49.449873+0000","last_undegraded":"2024-04-25T09:02:49.449873+0000","last_fullsized":"2024-04-25T09:02:49.449873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:56.719708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450486+0000","last_change":"2024-04-25T09:02:46.107715+0000","last_active":"2024-04-25T09:02:49.450486+0000","last_peered":"2024-04-25T09:02:49.450486+0000","last_clean":"2024-04-25T09:02:49.450486+0000","last_became_active":"2024-04-25T09:02:46.107421+0000","last_became_peered":"2024-04-25T09:02:46.107421+0000","last_unstale":"2024-04-25T09:02:49.450486+0000","last_undegraded":"2024-04-25T09:02:49.450486+0000","last_fullsized":"2024-04-25T09:02:49.450486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:57.067398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449980+0000","last_change":"2024-04-25T09:02:47.117133+0000","last_active":"2024-04-25T09:02:49.449980+0000","last_peered":"2024-04-25T09:02:49.449980+0000","last_clean":"2024-04-25T09:02:49.449980+0000","last_became_active":"2024-04-25T09:02:47.116241+0000","last_became_peered":"2024-04-25T09:02:47.116241+0000","last_unstale":"2024-04-25T09:02:49.449980+0000","last_undegraded":"2024-04-25T09:02:49.449980+0000","last_fullsized":"2024-04-25T09:02:49.449980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:48.354076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120821+0000","last_change":"2024-04-25T09:02:46.111553+0000","last_active":"2024-04-25T09:02:48.120821+0000","last_peered":"2024-04-25T09:02:48.120821+0000","last_clean":"2024-04-25T09:02:48.120821+0000","last_became_active":"2024-04-25T09:02:46.111284+0000","last_became_peered":"2024-04-25T09:02:46.111284+0000","last_unstale":"2024-04-25T09:02:48.120821+0000","last_undegraded":"2024-04-25T09:02:48.120821+0000","last_fullsized":"2024-04-25T09:02:48.120821+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:09.311901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115715+0000","last_change":"2024-04-25T09:02:47.113945+0000","last_active":"2024-04-25T09:02:48.115715+0000","last_peered":"2024-04-25T09:02:48.115715+0000","last_clean":"2024-04-25T09:02:48.115715+0000","last_became_active":"2024-04-25T09:02:47.113636+0000","last_became_peered":"2024-04-25T09:02:47.113636+0000","last_unstale":"2024-04-25T09:02:48.115715+0000","last_undegraded":"2024-04-25T09:02:48.115715+0000","last_fullsized":"2024-04-25T09:02:48.115715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:31.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120800+0000","last_change":"2024-04-25T09:02:46.108891+0000","last_active":"2024-04-25T09:02:48.120800+0000","last_peered":"2024-04-25T09:02:48.120800+0000","last_clean":"2024-04-25T09:02:48.120800+0000","last_became_active":"2024-04-25T09:02:46.108612+0000","last_became_peered":"2024-04-25T09:02:46.108612+0000","last_unstale":"2024-04-25T09:02:48.120800+0000","last_undegraded":"2024-04-25T09:02:48.120800+0000","last_fullsized":"2024-04-25T09:02:48.120800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:07.251501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109360+0000","last_change":"2024-04-25T09:02:47.121169+0000","last_active":"2024-04-25T09:02:48.109360+0000","last_peered":"2024-04-25T09:02:48.109360+0000","last_clean":"2024-04-25T09:02:48.109360+0000","last_became_active":"2024-04-25T09:02:47.120078+0000","last_became_peered":"2024-04-25T09:02:47.120078+0000","last_unstale":"2024-04-25T09:02:48.109360+0000","last_undegraded":"2024-04-25T09:02:48.109360+0000","last_fullsized":"2024-04-25T09:02:48.109360+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:43.323941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449031+0000","last_change":"2024-04-25T09:02:46.111031+0000","last_active":"2024-04-25T09:02:49.449031+0000","last_peered":"2024-04-25T09:02:49.449031+0000","last_clean":"2024-04-25T09:02:49.449031+0000","last_became_active":"2024-04-25T09:02:46.110664+0000","last_became_peered":"2024-04-25T09:02:46.110664+0000","last_unstale":"2024-04-25T09:02:49.449031+0000","last_undegraded":"2024-04-25T09:02:49.449031+0000","last_fullsized":"2024-04-25T09:02:49.449031+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:58.237683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116239+0000","last_change":"2024-04-25T09:02:47.110097+0000","last_active":"2024-04-25T09:02:48.116239+0000","last_peered":"2024-04-25T09:02:48.116239+0000","last_clean":"2024-04-25T09:02:48.116239+0000","last_became_active":"2024-04-25T09:02:47.109788+0000","last_became_peered":"2024-04-25T09:02:47.109788+0000","last_unstale":"2024-04-25T09:02:48.116239+0000","last_undegraded":"2024-04-25T09:02:48.116239+0000","last_fullsized":"2024-04-25T09:02:48.116239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:48.354076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109367+0000","last_change":"2024-04-25T09:02:46.111562+0000","last_active":"2024-04-25T09:02:48.109367+0000","last_peered":"2024-04-25T09:02:48.109367+0000","last_clean":"2024-04-25T09:02:48.109367+0000","last_became_active":"2024-04-25T09:02:46.111293+0000","last_became_peered":"2024-04-25T09:02:46.111293+0000","last_unstale":"2024-04-25T09:02:48.109367+0000","last_undegraded":"2024-04-25T09:02:48.109367+0000","last_fullsized":"2024-04-25T09:02:48.109367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:17.128028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109012+0000","last_change":"2024-04-25T09:02:47.119382+0000","last_active":"2024-04-25T09:02:48.109012+0000","last_peered":"2024-04-25T09:02:48.109012+0000","last_clean":"2024-04-25T09:02:48.109012+0000","last_became_active":"2024-04-25T09:02:47.118704+0000","last_became_peered":"2024-04-25T09:02:47.118704+0000","last_unstale":"2024-04-25T09:02:48.109012+0000","last_undegraded":"2024-04-25T09:02:48.109012+0000","last_fullsized":"2024-04-25T09:02:48.109012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:32.933009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.109119+0000","last_change":"2024-04-25T09:02:46.106809+0000","last_active":"2024-04-25T09:02:48.109119+0000","last_peered":"2024-04-25T09:02:48.109119+0000","last_clean":"2024-04-25T09:02:48.109119+0000","last_became_active":"2024-04-25T09:02:46.106520+0000","last_became_peered":"2024-04-25T09:02:46.106520+0000","last_unstale":"2024-04-25T09:02:48.109119+0000","last_undegraded":"2024-04-25T09:02:48.109119+0000","last_fullsized":"2024-04-25T09:02:48.109119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:36.015097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116256+0000","last_change":"2024-04-25T09:02:47.123474+0000","last_active":"2024-04-25T09:02:48.116256+0000","last_peered":"2024-04-25T09:02:48.116256+0000","last_clean":"2024-04-25T09:02:48.116256+0000","last_became_active":"2024-04-25T09:02:47.123228+0000","last_became_peered":"2024-04-25T09:02:47.123228+0000","last_unstale":"2024-04-25T09:02:48.116256+0000","last_undegraded":"2024-04-25T09:02:48.116256+0000","last_fullsized":"2024-04-25T09:02:48.116256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:55.007150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.448739+0000","last_change":"2024-04-25T09:02:46.109982+0000","last_active":"2024-04-25T09:02:49.448739+0000","last_peered":"2024-04-25T09:02:49.448739+0000","last_clean":"2024-04-25T09:02:49.448739+0000","last_became_active":"2024-04-25T09:02:46.109619+0000","last_became_peered":"2024-04-25T09:02:46.109619+0000","last_unstale":"2024-04-25T09:02:49.448739+0000","last_undegraded":"2024-04-25T09:02:49.448739+0000","last_fullsized":"2024-04-25T09:02:49.448739+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:54.341703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116372+0000","last_change":"2024-04-25T09:02:47.114546+0000","last_active":"2024-04-25T09:02:48.116372+0000","last_peered":"2024-04-25T09:02:48.116372+0000","last_clean":"2024-04-25T09:02:48.116372+0000","last_became_active":"2024-04-25T09:02:47.113616+0000","last_became_peered":"2024-04-25T09:02:47.113616+0000","last_unstale":"2024-04-25T09:02:48.116372+0000","last_undegraded":"2024-04-25T09:02:48.116372+0000","last_fullsized":"2024-04-25T09:02:48.116372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:30.974414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118807+0000","last_change":"2024-04-25T09:02:46.111543+0000","last_active":"2024-04-25T09:02:48.118807+0000","last_peered":"2024-04-25T09:02:48.118807+0000","last_clean":"2024-04-25T09:02:48.118807+0000","last_became_active":"2024-04-25T09:02:46.111246+0000","last_became_peered":"2024-04-25T09:02:46.111246+0000","last_unstale":"2024-04-25T09:02:48.118807+0000","last_undegraded":"2024-04-25T09:02:48.118807+0000","last_fullsized":"2024-04-25T09:02:48.118807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:57.543406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449956+0000","last_change":"2024-04-25T09:02:47.111691+0000","last_active":"2024-04-25T09:02:49.449956+0000","last_peered":"2024-04-25T09:02:49.449956+0000","last_clean":"2024-04-25T09:02:49.449956+0000","last_became_active":"2024-04-25T09:02:47.111448+0000","last_became_peered":"2024-04-25T09:02:47.111448+0000","last_unstale":"2024-04-25T09:02:49.449956+0000","last_undegraded":"2024-04-25T09:02:49.449956+0000","last_fullsized":"2024-04-25T09:02:49.449956+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:29.475038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"88'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118832+0000","last_change":"2024-04-25T09:02:46.112103+0000","last_active":"2024-04-25T09:02:48.118832+0000","last_peered":"2024-04-25T09:02:48.118832+0000","last_clean":"2024-04-25T09:02:48.118832+0000","last_became_active":"2024-04-25T09:02:46.111812+0000","last_became_peered":"2024-04-25T09:02:46.111812+0000","last_unstale":"2024-04-25T09:02:48.118832+0000","last_undegraded":"2024-04-25T09:02:48.118832+0000","last_fullsized":"2024-04-25T09:02:48.118832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:54.489886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450164+0000","last_change":"2024-04-25T09:02:47.121205+0000","last_active":"2024-04-25T09:02:49.450164+0000","last_peered":"2024-04-25T09:02:49.450164+0000","last_clean":"2024-04-25T09:02:49.450164+0000","last_became_active":"2024-04-25T09:02:47.120902+0000","last_became_peered":"2024-04-25T09:02:47.120902+0000","last_unstale":"2024-04-25T09:02:49.450164+0000","last_undegraded":"2024-04-25T09:02:49.450164+0000","last_fullsized":"2024-04-25T09:02:49.450164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:53.450949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449633+0000","last_change":"2024-04-25T09:02:46.108910+0000","last_active":"2024-04-25T09:02:49.449633+0000","last_peered":"2024-04-25T09:02:49.449633+0000","last_clean":"2024-04-25T09:02:49.449633+0000","last_became_active":"2024-04-25T09:02:46.108573+0000","last_became_peered":"2024-04-25T09:02:46.108573+0000","last_unstale":"2024-04-25T09:02:49.449633+0000","last_undegraded":"2024-04-25T09:02:49.449633+0000","last_fullsized":"2024-04-25T09:02:49.449633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:13.631276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115860+0000","last_change":"2024-04-25T09:02:47.120364+0000","last_active":"2024-04-25T09:02:48.115860+0000","last_peered":"2024-04-25T09:02:48.115860+0000","last_clean":"2024-04-25T09:02:48.115860+0000","last_became_active":"2024-04-25T09:02:47.120015+0000","last_became_peered":"2024-04-25T09:02:47.120015+0000","last_unstale":"2024-04-25T09:02:48.115860+0000","last_undegraded":"2024-04-25T09:02:48.115860+0000","last_fullsized":"2024-04-25T09:02:48.115860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:55.474082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450151+0000","last_change":"2024-04-25T09:02:46.113989+0000","last_active":"2024-04-25T09:02:49.450151+0000","last_peered":"2024-04-25T09:02:49.450151+0000","last_clean":"2024-04-25T09:02:49.450151+0000","last_became_active":"2024-04-25T09:02:46.113641+0000","last_became_peered":"2024-04-25T09:02:46.113641+0000","last_unstale":"2024-04-25T09:02:49.450151+0000","last_undegraded":"2024-04-25T09:02:49.450151+0000","last_fullsized":"2024-04-25T09:02:49.450151+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.252066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.116393+0000","last_change":"2024-04-25T09:02:47.109197+0000","last_active":"2024-04-25T09:02:48.116393+0000","last_peered":"2024-04-25T09:02:48.116393+0000","last_clean":"2024-04-25T09:02:48.116393+0000","last_became_active":"2024-04-25T09:02:47.108931+0000","last_became_peered":"2024-04-25T09:02:47.108931+0000","last_unstale":"2024-04-25T09:02:48.116393+0000","last_undegraded":"2024-04-25T09:02:48.116393+0000","last_fullsized":"2024-04-25T09:02:48.116393+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:08.416754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120760+0000","last_change":"2024-04-25T09:02:46.110506+0000","last_active":"2024-04-25T09:02:48.120760+0000","last_peered":"2024-04-25T09:02:48.120760+0000","last_clean":"2024-04-25T09:02:48.120760+0000","last_became_active":"2024-04-25T09:02:46.110209+0000","last_became_peered":"2024-04-25T09:02:46.110209+0000","last_unstale":"2024-04-25T09:02:48.120760+0000","last_undegraded":"2024-04-25T09:02:48.120760+0000","last_fullsized":"2024-04-25T09:02:48.120760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:33.526304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.120720+0000","last_change":"2024-04-25T09:02:47.122066+0000","last_active":"2024-04-25T09:02:48.120720+0000","last_peered":"2024-04-25T09:02:48.120720+0000","last_clean":"2024-04-25T09:02:48.120720+0000","last_became_active":"2024-04-25T09:02:47.121720+0000","last_became_peered":"2024-04-25T09:02:47.121720+0000","last_unstale":"2024-04-25T09:02:48.120720+0000","last_undegraded":"2024-04-25T09:02:48.120720+0000","last_fullsized":"2024-04-25T09:02:48.120720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:29.875044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115387+0000","last_change":"2024-04-25T09:02:46.111800+0000","last_active":"2024-04-25T09:02:48.115387+0000","last_peered":"2024-04-25T09:02:48.115387+0000","last_clean":"2024-04-25T09:02:48.115387+0000","last_became_active":"2024-04-25T09:02:46.111500+0000","last_became_peered":"2024-04-25T09:02:46.111500+0000","last_unstale":"2024-04-25T09:02:48.115387+0000","last_undegraded":"2024-04-25T09:02:48.115387+0000","last_fullsized":"2024-04-25T09:02:48.115387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:03.846838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449592+0000","last_change":"2024-04-25T09:02:47.117254+0000","last_active":"2024-04-25T09:02:49.449592+0000","last_peered":"2024-04-25T09:02:49.449592+0000","last_clean":"2024-04-25T09:02:49.449592+0000","last_became_active":"2024-04-25T09:02:47.116783+0000","last_became_peered":"2024-04-25T09:02:47.116783+0000","last_unstale":"2024-04-25T09:02:49.449592+0000","last_undegraded":"2024-04-25T09:02:49.449592+0000","last_fullsized":"2024-04-25T09:02:49.449592+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:04.803713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449545+0000","last_change":"2024-04-25T09:02:46.110806+0000","last_active":"2024-04-25T09:02:49.449545+0000","last_peered":"2024-04-25T09:02:49.449545+0000","last_clean":"2024-04-25T09:02:49.449545+0000","last_became_active":"2024-04-25T09:02:46.110506+0000","last_became_peered":"2024-04-25T09:02:46.110506+0000","last_unstale":"2024-04-25T09:02:49.449545+0000","last_undegraded":"2024-04-25T09:02:49.449545+0000","last_fullsized":"2024-04-25T09:02:49.449545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:03.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449412+0000","last_change":"2024-04-25T09:02:47.121136+0000","last_active":"2024-04-25T09:02:49.449412+0000","last_peered":"2024-04-25T09:02:49.449412+0000","last_clean":"2024-04-25T09:02:49.449412+0000","last_became_active":"2024-04-25T09:02:47.120810+0000","last_became_peered":"2024-04-25T09:02:47.120810+0000","last_unstale":"2024-04-25T09:02:49.449412+0000","last_undegraded":"2024-04-25T09:02:49.449412+0000","last_fullsized":"2024-04-25T09:02:49.449412+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:29.875044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.115167+0000","last_change":"2024-04-25T09:02:46.108946+0000","last_active":"2024-04-25T09:02:48.115167+0000","last_peered":"2024-04-25T09:02:48.115167+0000","last_clean":"2024-04-25T09:02:48.115167+0000","last_became_active":"2024-04-25T09:02:46.108676+0000","last_became_peered":"2024-04-25T09:02:46.108676+0000","last_unstale":"2024-04-25T09:02:48.115167+0000","last_undegraded":"2024-04-25T09:02:48.115167+0000","last_fullsized":"2024-04-25T09:02:48.115167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.876030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:48.118819+0000","last_change":"2024-04-25T09:02:47.116962+0000","last_active":"2024-04-25T09:02:48.118819+0000","last_peered":"2024-04-25T09:02:48.118819+0000","last_clean":"2024-04-25T09:02:48.118819+0000","last_became_active":"2024-04-25T09:02:47.116694+0000","last_became_peered":"2024-04-25T09:02:47.116694+0000","last_unstale":"2024-04-25T09:02:48.118819+0000","last_undegraded":"2024-04-25T09:02:48.118819+0000","last_fullsized":"2024-04-25T09:02:48.118819+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:46.089276+0000","last_clean_scrub_stamp":"2024-04-25T09:02:46.089276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:23.576638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.450165+0000","last_change":"2024-04-25T09:02:46.115578+0000","last_active":"2024-04-25T09:02:49.450165+0000","last_peered":"2024-04-25T09:02:49.450165+0000","last_clean":"2024-04-25T09:02:49.450165+0000","last_became_active":"2024-04-25T09:02:46.115366+0000","last_became_peered":"2024-04-25T09:02:46.115366+0000","last_unstale":"2024-04-25T09:02:49.450165+0000","last_undegraded":"2024-04-25T09:02:49.450165+0000","last_fullsized":"2024-04-25T09:02:49.450165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:45.084679+0000","last_clean_scrub_stamp":"2024-04-25T09:02:45.084679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:20.566894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":297,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.449695+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:02:49.449695+0000","last_peered":"2024-04-25T09:02:49.449695+0000","last_clean":"2024-04-25T09:02:49.449695+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:02:49.449695+0000","last_undegraded":"2024-04-25T09:02:49.449695+0000","last_fullsized":"2024-04-25T09:02:49.449695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46708,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325132,"statfs":{"total":96636764160,"available":96588935168,"internally_reserved":0,"allocated":1679360,"data_stored":1056817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46140,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325700,"statfs":{"total":96636764160,"available":96589516800,"internally_reserved":0,"allocated":1093632,"data_stored":467073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40576,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331264,"statfs":{"total":96636764160,"available":96595214336,"internally_reserved":0,"allocated":1097728,"data_stored":468013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50292,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321548,"statfs":{"total":96636764160,"available":96585265152,"internally_reserved":0,"allocated":1081344,"data_stored":466379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50296,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321544,"statfs":{"total":96636764160,"available":96585261056,"internally_reserved":0,"allocated":1093632,"data_stored":467991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":466961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58616,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313224,"statfs":{"total":96636764160,"available":96576741376,"internally_reserved":0,"allocated":1093632,"data_stored":466573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28660,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343180,"statfs":{"total":96636764160,"available":96607416320,"internally_reserved":0,"allocated":1679360,"data_stored":1056781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:55.888 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:02:55.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:02:55.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.010+0000 7f9347bd5640 1 Processor -- start 2024-04-25T09:02:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.010+0000 7f9347bd5640 1 -- start start 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.011+0000 7f9347bd5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93400cfd70 0x7f93400ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.011+0000 7f9347bd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400ce6e0 0x7f93400ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.011+0000 7f9347bd5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93400cc010 con 0x7f93400b72b0 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.011+0000 7f9347bd5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93400ceb50 con 0x7f93400cfd70 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.011+0000 7f9347bd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93400cc2f0 con 0x7f93400ce6e0 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9346172640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400ce6e0 0x7f93400ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9345170640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93400cfd70 0x7f93400ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9345971640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f93400b72b0 0x7f93400d0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:56092/0 (socket says 172.21.15.5:56092) 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9345971640 1 -- 172.21.15.5:0/4137707668 learned_addr learned my addr 172.21.15.5:0/4137707668 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f934496f640 1 -- 172.21.15.5:0/4137707668 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234706501 0 0) 0x7f93400cc010 con 0x7f93400b72b0 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f934496f640 1 -- 172.21.15.5:0/4137707668 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9328003520 con 0x7f93400b72b0 2024-04-25T09:02:56.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9346172640 1 -- 172.21.15.5:0/4137707668 >> v2:172.21.15.80:3300/0 conn(0x7f93400cfd70 msgr2=0x7f93400ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9346172640 1 --2- 172.21.15.5:0/4137707668 >> v2:172.21.15.80:3300/0 conn(0x7f93400cfd70 0x7f93400ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9346172640 1 -- 172.21.15.5:0/4137707668 >> v1:172.21.15.80:6789/0 conn(0x7f93400b72b0 legacy=0x7f93400d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.012+0000 7f9346172640 1 -- 172.21.15.5:0/4137707668 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93400cc5d0 con 0x7f93400ce6e0 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.013+0000 7f9346172640 1 --2- 172.21.15.5:0/4137707668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400ce6e0 0x7f93400ccdd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9330009d90 tx=0x7f933002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8115a205e22bf60a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.013+0000 7f934496f640 1 -- 172.21.15.5:0/4137707668 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330007740 con 0x7f93400ce6e0 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.013+0000 7f934496f640 1 -- 172.21.15.5:0/4137707668 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93300078e0 con 0x7f93400ce6e0 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.013+0000 7f934496f640 1 -- 172.21.15.5:0/4137707668 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330007cb0 con 0x7f93400ce6e0 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.013+0000 7f9347bd5640 1 -- 172.21.15.5:0/4137707668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400ce6e0 msgr2=0x7f93400ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.013+0000 7f9347bd5640 1 --2- 172.21.15.5:0/4137707668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400ce6e0 0x7f93400ccdd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9330009d90 tx=0x7f933002a660 comp rx=0 tx=0).stop 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.014+0000 7f9347bd5640 1 -- 172.21.15.5:0/4137707668 shutdown_connections 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.014+0000 7f9347bd5640 1 --2- 172.21.15.5:0/4137707668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400ce6e0 0x7f93400ccdd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.014+0000 7f9347bd5640 1 --2- 172.21.15.5:0/4137707668 >> v2:172.21.15.80:3300/0 conn(0x7f93400cfd70 0x7f93400ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.014+0000 7f9347bd5640 1 -- 172.21.15.5:0/4137707668 >> 172.21.15.5:0/4137707668 conn(0x7f93400d1920 msgr2=0x7f93400d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.014+0000 7f9347bd5640 1 -- 172.21.15.5:0/4137707668 shutdown_connections 2024-04-25T09:02:56.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.014+0000 7f9347bd5640 1 -- 172.21.15.5:0/4137707668 wait complete. 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.015+0000 7f9347bd5640 1 Processor -- start 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.015+0000 7f9347bd5640 1 -- start start 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.015+0000 7f9347bd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93400b72b0 0x7f934015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.015+0000 7f9347bd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93400ce6e0 0x7f93401f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.015+0000 7f9347bd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400cfd70 0x7f93401f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9347bd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400d1550 con 0x7f93400ce6e0 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9347bd5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400b4770 con 0x7f93400b72b0 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9347bd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93400b7690 con 0x7f93400cfd70 2024-04-25T09:02:56.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93400ce6e0 0x7f93401f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93400ce6e0 0x7f93401f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47324/0 (socket says 172.21.15.5:47324) 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 -- 172.21.15.5:0/2826820854 learned_addr learned my addr 172.21.15.5:0/2826820854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345971640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93400b72b0 0x7f934015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9346172640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400cfd70 0x7f93401f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 -- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400cfd70 msgr2=0x7f93401f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400cfd70 0x7f93401f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 -- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93400b72b0 msgr2=0x7f934015da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93400b72b0 0x7f934015da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 -- 172.21.15.5:0/2826820854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93401f40f0 con 0x7f93400ce6e0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9345170640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93400ce6e0 0x7f93401f3730 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f933400e9b0 tx=0x7f933400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f933e7fc640 1 -- 172.21.15.5:0/2826820854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334017070 con 0x7f93400ce6e0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f933e7fc640 1 -- 172.21.15.5:0/2826820854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933400c9a0 con 0x7f93400ce6e0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93401f4430 con 0x7f93400ce6e0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f933e7fc640 1 -- 172.21.15.5:0/2826820854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400cd90 con 0x7f93400ce6e0 2024-04-25T09:02:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.016+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93400c7140 con 0x7f93400ce6e0 2024-04-25T09:02:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.017+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934004ef20 con 0x7f93400ce6e0 2024-04-25T09:02:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.018+0000 7f933e7fc640 1 -- 172.21.15.5:0/2826820854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f933401a070 con 0x7f93400ce6e0 2024-04-25T09:02:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.018+0000 7f933e7fc640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932c06b4d0 0x7f932c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.018+0000 7f933e7fc640 1 -- 172.21.15.5:0/2826820854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f933408a200 con 0x7f93400ce6e0 2024-04-25T09:02:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.018+0000 7f9345971640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932c06b4d0 0x7f932c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.019+0000 7f9345971640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932c06b4d0 0x7f932c06d990 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9338007fd0 tx=0x7f9338009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.022+0000 7f933e7fc640 1 -- 172.21.15.5:0/2826820854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93401f4430 con 0x7f93400ce6e0 2024-04-25T09:02:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.273+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9340156600 con 0x7f93400ce6e0 2024-04-25T09:02:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.275+0000 7f933e7fc640 1 -- 172.21.15.5:0/2826820854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9334059110 con 0x7f93400ce6e0 2024-04-25T09:02:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T09:02:56.263 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T09:02:56.263 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T09:02:56.263 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T09:02:56.263 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:02:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932c06b4d0 msgr2=0x7f932c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932c06b4d0 0x7f932c06d990 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9338007fd0 tx=0x7f9338009040 comp rx=0 tx=0).stop 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93400ce6e0 msgr2=0x7f93401f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93400ce6e0 0x7f93401f3730 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f933400e9b0 tx=0x7f933400ee70 comp rx=0 tx=0).stop 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 shutdown_connections 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932c06b4d0 0x7f932c06d990 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93400cfd70 0x7f93401f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93400ce6e0 0x7f93401f3730 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 --2- 172.21.15.5:0/2826820854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93400b72b0 0x7f934015da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 >> 172.21.15.5:0/2826820854 conn(0x7f93400d1920 msgr2=0x7f934006b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 shutdown_connections 2024-04-25T09:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.277+0000 7f9347bd5640 1 -- 172.21.15.5:0/2826820854 wait complete. 2024-04-25T09:02:56.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.388+0000 7f4fb637e640 1 Processor -- start 2024-04-25T09:02:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.388+0000 7f4fb637e640 1 -- start start 2024-04-25T09:02:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4fb637e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4fb637e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fb00d3df0 0x7f4fb00cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4fb637e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb00b7f60 con 0x7f4fb00d3990 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4fb637e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00b29c0 con 0x7f4fb00d3df0 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4fb637e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00d2080 con 0x7f4fb015e0a0 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4faf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4fb00d3990 0x7f4fb00ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48214/0 (socket says 172.21.15.5:48214) 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4faf7fe640 1 -- 172.21.15.5:0/3514162387 learned_addr learned my addr 172.21.15.5:0/3514162387 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4faffff640 1 --2- 172.21.15.5:0/3514162387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4fb491b640 1 --2- 172.21.15.5:0/3514162387 >> v2:172.21.15.80:3300/0 conn(0x7f4fb00d3df0 0x7f4fb00cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.389+0000 7f4faeffd640 1 -- 172.21.15.5:0/3514162387 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606396690 0 0) 0x7f4fb00b7f60 con 0x7f4fb00d3990 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.390+0000 7f4faeffd640 1 -- 172.21.15.5:0/3514162387 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f98003520 con 0x7f4fb00d3990 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.390+0000 7f4faeffd640 1 -- 172.21.15.5:0/3514162387 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4202778664 0 0) 0x7f4f98003520 con 0x7f4fb00d3990 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.390+0000 7f4faffff640 1 -- 172.21.15.5:0/3514162387 >> v2:172.21.15.80:3300/0 conn(0x7f4fb00d3df0 msgr2=0x7f4fb00cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.390+0000 7f4faffff640 1 --2- 172.21.15.5:0/3514162387 >> v2:172.21.15.80:3300/0 conn(0x7f4fb00d3df0 0x7f4fb00cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.390+0000 7f4faffff640 1 -- 172.21.15.5:0/3514162387 >> v1:172.21.15.5:6789/0 conn(0x7f4fb00d3990 legacy=0x7f4fb00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.390+0000 7f4faffff640 1 -- 172.21.15.5:0/3514162387 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00d2360 con 0x7f4fb015e0a0 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.390+0000 7f4faffff640 1 --2- 172.21.15.5:0/3514162387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00d0d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00097a0 tx=0x7f4fa002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8d0edee56329d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4faeffd640 1 -- 172.21.15.5:0/3514162387 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0037070 con 0x7f4fb015e0a0 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4faeffd640 1 -- 172.21.15.5:0/3514162387 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa002aba0 con 0x7f4fb015e0a0 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4faeffd640 1 -- 172.21.15.5:0/3514162387 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4001670 con 0x7f4fb015e0a0 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 -- 172.21.15.5:0/3514162387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 msgr2=0x7f4fb00d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 --2- 172.21.15.5:0/3514162387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00d0d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00097a0 tx=0x7f4fa002a110 comp rx=0 tx=0).stop 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 -- 172.21.15.5:0/3514162387 shutdown_connections 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 --2- 172.21.15.5:0/3514162387 >> v2:172.21.15.80:3300/0 conn(0x7f4fb00d3df0 0x7f4fb00cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 --2- 172.21.15.5:0/3514162387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00d0d50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 -- 172.21.15.5:0/3514162387 >> 172.21.15.5:0/3514162387 conn(0x7f4fb00668f0 msgr2=0x7f4fb0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 -- 172.21.15.5:0/3514162387 shutdown_connections 2024-04-25T09:02:56.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.391+0000 7f4fb637e640 1 -- 172.21.15.5:0/3514162387 wait complete. 2024-04-25T09:02:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.392+0000 7f4fb637e640 1 Processor -- start 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.393+0000 7f4fb637e640 1 -- start start 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.393+0000 7f4fb637e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fb00d3990 0x7f4fb00cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.393+0000 7f4fb637e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d3df0 0x7f4fb00accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.393+0000 7f4fb637e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.393+0000 7f4fb637e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00d2c00 con 0x7f4fb00d3df0 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.393+0000 7f4fb637e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00d2920 con 0x7f4fb00d3990 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.393+0000 7f4fb637e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00d4280 con 0x7f4fb015e0a0 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d3df0 0x7f4fb00accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d3df0 0x7f4fb00accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47328/0 (socket says 172.21.15.5:47328) 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 -- 172.21.15.5:0/2451229286 learned_addr learned my addr 172.21.15.5:0/2451229286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faffff640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fb00d3990 0x7f4fb00cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4fb491b640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 -- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 msgr2=0x7f4fb00ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 -- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fb00d3990 msgr2=0x7f4fb00cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fb00d3990 0x7f4fb00cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 -- 172.21.15.5:0/2451229286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00cd630 con 0x7f4fb00d3df0 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4faf7fe640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d3df0 0x7f4fb00accf0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c730 tx=0x7f4fa400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4facff9640 1 -- 172.21.15.5:0/2451229286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4017070 con 0x7f4fb00d3df0 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4facff9640 1 -- 172.21.15.5:0/2451229286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4005ad0 con 0x7f4fb00d3df0 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0153410 con 0x7f4fb00d3df0 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4facff9640 1 -- 172.21.15.5:0/2451229286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4007070 con 0x7f4fb00d3df0 2024-04-25T09:02:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.394+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb00cc330 con 0x7f4fb00d3df0 2024-04-25T09:02:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.395+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb00d00c0 con 0x7f4fb00d3df0 2024-04-25T09:02:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.396+0000 7f4facff9640 1 -- 172.21.15.5:0/2451229286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4fa401a070 con 0x7f4fb00d3df0 2024-04-25T09:02:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.396+0000 7f4facff9640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.396+0000 7f4facff9640 1 -- 172.21.15.5:0/2451229286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fa4089530 con 0x7f4fb00d3df0 2024-04-25T09:02:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.397+0000 7f4faffff640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.397+0000 7f4faffff640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0034000 tx=0x7f4fa002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.400+0000 7f4facff9640 1 -- 172.21.15.5:0/2451229286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4fb00d00c0 con 0x7f4fb00d3df0 2024-04-25T09:02:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.619+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fb004ef20 con 0x7f4fb00d3df0 2024-04-25T09:02:56.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.620+0000 7f4facff9640 1 -- 172.21.15.5:0/2451229286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f4fa4057df0 con 0x7f4fb00d3df0 2024-04-25T09:02:56.608 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:02:56.608 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:46.467722+0000","modified":"2024-04-25T09:02:49.472605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7497":{"gid":7497,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1143707602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1143707602},{"type":"v1","addr":"172.21.15.80:6837","nonce":1143707602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:02:56.608 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-04-25T09:02:56.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4f9c06b4d0 msgr2=0x7f4f9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0034000 tx=0x7f4fa002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:56.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d3df0 msgr2=0x7f4fb00accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d3df0 0x7f4fb00accf0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c730 tx=0x7f4fa400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 shutdown_connections 2024-04-25T09:02:56.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fb015e0a0 0x7f4fb00ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb00d3df0 0x7f4fb00accf0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 --2- 172.21.15.5:0/2451229286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fb00d3990 0x7f4fb00cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 >> 172.21.15.5:0/2451229286 conn(0x7f4fb00668f0 msgr2=0x7f4fb00b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:56.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 shutdown_connections 2024-04-25T09:02:56.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:56.622+0000 7f4fb637e640 1 -- 172.21.15.5:0/2451229286 wait complete. 2024-04-25T09:02:57.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:02:46.467722+0000', 'modified': '2024-04-25T09:02:49.472605+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7497': {'gid': 7497, 'name': 'd', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/1143707602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6835', 'nonce': 1143707602}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 1143707602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:02:57.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:02:57.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:02:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.146+0000 7f53afab3640 1 Processor -- start 2024-04-25T09:02:57.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.146+0000 7f53afab3640 1 -- start start 2024-04-25T09:02:57.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53afab3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53a80ce910 0x7f53a8168b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53afab3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a806ba50 con 0x7f53a80b0e30 2024-04-25T09:02:57.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53afab3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a806bd30 con 0x7f53a80b0a50 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53afab3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a806b800 con 0x7f53a80ce910 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53ae050640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53a80ce910 0x7f53a8168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53ad04e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f53a80b0e30 0x7f53a80b1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48216/0 (socket says 172.21.15.5:48216) 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53ae050640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53a80ce910 0x7f53a8168b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47330/0 (socket says 172.21.15.5:47330) 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.147+0000 7f53ad04e640 1 -- 172.21.15.5:0/801955557 learned_addr learned my addr 172.21.15.5:0/801955557 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.148+0000 7f53ae050640 1 -- 172.21.15.5:0/801955557 >> v1:172.21.15.80:6789/0 conn(0x7f53a80b0a50 legacy=0x7f53a80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.148+0000 7f53ae050640 1 -- 172.21.15.5:0/801955557 >> v1:172.21.15.5:6789/0 conn(0x7f53a80b0e30 legacy=0x7f53a80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.148+0000 7f53ae050640 1 -- 172.21.15.5:0/801955557 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a806c010 con 0x7f53a80ce910 2024-04-25T09:02:57.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.148+0000 7f53ac84d640 1 -- 172.21.15.5:0/801955557 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040091395 0 0) 0x7f53a806ba50 con 0x7f53a80b0e30 2024-04-25T09:02:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.148+0000 7f53ae050640 1 --2- 172.21.15.5:0/801955557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80ce910 0x7f53a8168b90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982bf64cfbc100e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53ac84d640 1 -- 172.21.15.5:0/801955557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398037070 con 0x7f53a80ce910 2024-04-25T09:02:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53ac84d640 1 -- 172.21.15.5:0/801955557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398032440 con 0x7f53a80ce910 2024-04-25T09:02:57.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53ac84d640 1 -- 172.21.15.5:0/801955557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398032810 con 0x7f53a80ce910 2024-04-25T09:02:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53afab3640 1 -- 172.21.15.5:0/801955557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80ce910 msgr2=0x7f53a8168b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53afab3640 1 --2- 172.21.15.5:0/801955557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80ce910 0x7f53a8168b90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53afab3640 1 -- 172.21.15.5:0/801955557 shutdown_connections 2024-04-25T09:02:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53afab3640 1 --2- 172.21.15.5:0/801955557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80ce910 0x7f53a8168b90 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53afab3640 1 -- 172.21.15.5:0/801955557 >> 172.21.15.5:0/801955557 conn(0x7f53a80d18f0 msgr2=0x7f53a80d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53afab3640 1 -- 172.21.15.5:0/801955557 shutdown_connections 2024-04-25T09:02:57.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.149+0000 7f53afab3640 1 -- 172.21.15.5:0/801955557 wait complete. 2024-04-25T09:02:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.150+0000 7f53afab3640 1 Processor -- start 2024-04-25T09:02:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.150+0000 7f53afab3640 1 -- start start 2024-04-25T09:02:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53afab3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80b0a50 0x7f53a80c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53afab3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53a80b0e30 0x7f53a8157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53afab3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53a80ce910 0x7f53a815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53afab3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b2bf0 con 0x7f53a80b0a50 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53afab3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80cfd60 con 0x7f53a80ce910 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53afab3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80c81b0 con 0x7f53a80b0e30 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53ad84f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80b0a50 0x7f53a80c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53ad84f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80b0a50 0x7f53a80c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47344/0 (socket says 172.21.15.5:47344) 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.151+0000 7f53ad84f640 1 -- 172.21.15.5:0/4042957253 learned_addr learned my addr 172.21.15.5:0/4042957253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ae050640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53a80ce910 0x7f53a815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ad04e640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53a80b0e30 0x7f53a8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ad84f640 1 -- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53a80b0e30 msgr2=0x7f53a8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ad84f640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53a80b0e30 0x7f53a8157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ad84f640 1 -- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53a80ce910 msgr2=0x7f53a815c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ad84f640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53a80ce910 0x7f53a815c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ad84f640 1 -- 172.21.15.5:0/4042957253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a8157cb0 con 0x7f53a80b0a50 2024-04-25T09:02:57.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ae050640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53a80ce910 0x7f53a815c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:57.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53ad84f640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80b0a50 0x7f53a80c7c70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c8a0 tx=0x7f53a000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53a67fc640 1 -- 172.21.15.5:0/4042957253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0003b70 con 0x7f53a80b0a50 2024-04-25T09:02:57.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53a67fc640 1 -- 172.21.15.5:0/4042957253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a0003d30 con 0x7f53a80b0a50 2024-04-25T09:02:57.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a80c83e0 con 0x7f53a80b0a50 2024-04-25T09:02:57.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53a67fc640 1 -- 172.21.15.5:0/4042957253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a000aa90 con 0x7f53a80b0a50 2024-04-25T09:02:57.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.152+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a815b170 con 0x7f53a80b0a50 2024-04-25T09:02:57.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.154+0000 7f53a67fc640 1 -- 172.21.15.5:0/4042957253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f53a000ac30 con 0x7f53a80b0a50 2024-04-25T09:02:57.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.154+0000 7f53a67fc640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f539406b500 0x7f539406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.154+0000 7f53a67fc640 1 -- 172.21.15.5:0/4042957253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53a008a1a0 con 0x7f53a80b0a50 2024-04-25T09:02:57.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.154+0000 7f53ad04e640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f539406b500 0x7f539406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.155+0000 7f53ad04e640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f539406b500 0x7f539406d9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f53a806b030 tx=0x7f539c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.155+0000 7f53b27b9740 1 Processor -- start 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.155+0000 7f53b27b9740 1 -- start start 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672cb5230 0x561672cb5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672c8af10 0x561672cd1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53b27b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561672beda10 con 0x561672c8af10 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561672b96b30 con 0x561672cd2ad0 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561672be9c50 con 0x561672cb5230 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672c8af10 0x561672cd1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672c8af10 0x561672cd1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47358/0 (socket says 172.21.15.5:47358) 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 -- 172.21.15.5:0/922623418 learned_addr learned my addr 172.21.15.5:0/922623418 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ad84f640 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672cb5230 0x561672cb5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ad04e640 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 -- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672cb5230 msgr2=0x561672cb5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672cb5230 0x561672cb5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 -- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 msgr2=0x561672cd3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 -- 172.21.15.5:0/922623418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561672babe10 con 0x561672c8af10 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ad84f640 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672cb5230 0x561672cb5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ad04e640 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f53ae050640 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672c8af10 0x561672cd1190 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5398035040 tx=0x7f539802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f978c650ea695d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.156+0000 7f538f7fe640 1 -- 172.21.15.5:0/922623418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398037040 con 0x561672c8af10 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f538f7fe640 1 -- 172.21.15.5:0/922623418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398032740 con 0x561672c8af10 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f538f7fe640 1 -- 172.21.15.5:0/922623418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398032af0 con 0x561672c8af10 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 -- 172.21.15.5:0/922623418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672c8af10 msgr2=0x561672cd1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672c8af10 0x561672cd1190 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5398035040 tx=0x7f539802c000 comp rx=0 tx=0).stop 2024-04-25T09:02:57.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 -- 172.21.15.5:0/922623418 shutdown_connections 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672c8af10 0x561672cd1190 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 --2- 172.21.15.5:0/922623418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672cb5230 0x561672cb5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 -- 172.21.15.5:0/922623418 >> 172.21.15.5:0/922623418 conn(0x561672c87840 msgr2=0x561672cd0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 -- 172.21.15.5:0/922623418 shutdown_connections 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.157+0000 7f53b27b9740 1 -- 172.21.15.5:0/922623418 wait complete. 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.158+0000 7f53b27b9740 1 -- start start 2024-04-25T09:02:57.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.158+0000 7f53b27b9740 1 Processor -- start 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672ca1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cc70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672cc7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561672c8bcb0 con 0x561672cb5230 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561672baa0c0 con 0x561672cd2ad0 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561672c85770 con 0x561672c9e830 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 10 client.0 _ll_register_callbacks cb 0x561672b9dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672ca1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672ca1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47374/0 (socket says 172.21.15.5:47374) 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 -- 172.21.15.5:0/525158988 learned_addr learned my addr 172.21.15.5:0/525158988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad04e640 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cc70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ae050640 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672cc7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 -- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 msgr2=0x561672cc7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672cc7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 -- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 msgr2=0x561672cc70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cc70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 -- 172.21.15.5:0/525158988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616729022d0 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53ad84f640 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672ca1770 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f53a0007ed0 tx=0x7f53a0058370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563d5f11d5651043 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f538cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f538cff9640 1 -- 172.21.15.5:0/525158988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0070020 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f538cff9640 1 -- 172.21.15.5:0/525158988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53a0054f90 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.159+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5398032740 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f538cff9640 1 -- 172.21.15.5:0/525158988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53a0061030 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 10 client.7671 fetch_fsmap learned FSMap version 55 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5616729cc6b0 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f538cff9640 1 -- 172.21.15.5:0/525158988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398032740 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f538cff9640 1 -- 172.21.15.5:0/525158988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f53a00701c0 con 0x561672cb5230 2024-04-25T09:02:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 10 client.7671 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 10 client.7671 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 20 client.7671 populate_metadata read hostname 'smithi005' 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672c9f6a0 0x561672c9fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 4 client.7671 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561672c4c920 con 0x561672c9f6a0 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.160+0000 7f53ad04e640 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672c9f6a0 0x561672c9fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53ad04e640 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672c9f6a0 0x561672c9fa80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7fdb39c6242c0d7 server_cookie=84f5ded1c019f0fc in_seq=0 out_seq=0 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f538cff9640 10 client.7671 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f538cff9640 1 -- 172.21.15.5:0/525158988 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561672c4c920 con 0x561672c9f6a0 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f538cff9640 10 client.7671 handle_command_reply: tid=0 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 client.7671 shutdown 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 msgr2=0x561672ca1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672ca1770 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f53a0007ed0 tx=0x7f53a0058370 comp rx=0 tx=0).stop 2024-04-25T09:02:57.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 shutdown_connections 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672c9f6a0 0x561672c9fa80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672cc7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cc70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 --2- 172.21.15.5:0/525158988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672ca1770 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f538cff9640 0 client.7671 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.161+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 >> 172.21.15.5:0/525158988 conn(0x561672c8af10 msgr2=0x561672ccf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.162+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 shutdown_connections 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.162+0000 7f53b27b9740 1 -- 172.21.15.5:0/525158988 wait complete. 2024-04-25T09:02:57.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.162+0000 7f53b27b9740 20 client.7671 trim_cache size 0 max 16384 2024-04-25T09:02:57.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.177+0000 7f53b27b9740 1 Processor -- start 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.177+0000 7f53b27b9740 1 -- start start 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672ccf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672cc7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53b27b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a81ffde0 con 0x561672cb5230 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b6370 con 0x561672cd2ad0 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b5770 con 0x561672c9e830 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53ad04e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672cc7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53ad04e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672cc7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47390/0 (socket says 172.21.15.5:47390) 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53ad04e640 1 -- 172.21.15.5:0/1713102813 learned_addr learned my addr 172.21.15.5:0/1713102813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53ad04e640 1 -- 172.21.15.5:0/1713102813 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 msgr2=0x561672ccf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53ad04e640 1 --2- 172.21.15.5:0/1713102813 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672ccf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53ad04e640 1 -- 172.21.15.5:0/1713102813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 msgr2=0x561672cd10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.178+0000 7f53ad04e640 1 --2- 172.21.15.5:0/1713102813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53ad04e640 1 -- 172.21.15.5:0/1713102813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561672ca1ae0 con 0x561672cb5230 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53ad04e640 1 --2- 172.21.15.5:0/1713102813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672cc7140 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f53a80d29f0 tx=0x7f539c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c436437a7deebf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f538effd640 1 -- 172.21.15.5:0/1713102813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c023850 con 0x561672cb5230 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f538effd640 1 -- 172.21.15.5:0/1713102813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c005c40 con 0x561672cb5230 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f538effd640 1 -- 172.21.15.5:0/1713102813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00d4f0 con 0x561672cb5230 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 -- 172.21.15.5:0/1713102813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 msgr2=0x561672cc7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 --2- 172.21.15.5:0/1713102813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672cc7140 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f53a80d29f0 tx=0x7f539c016040 comp rx=0 tx=0).stop 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 -- 172.21.15.5:0/1713102813 shutdown_connections 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 --2- 172.21.15.5:0/1713102813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 --2- 172.21.15.5:0/1713102813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672cc7140 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 --2- 172.21.15.5:0/1713102813 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672ccf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 -- 172.21.15.5:0/1713102813 >> 172.21.15.5:0/1713102813 conn(0x561672c8af10 msgr2=0x561672c9fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 -- 172.21.15.5:0/1713102813 shutdown_connections 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.179+0000 7f53b27b9740 1 -- 172.21.15.5:0/1713102813 wait complete. 2024-04-25T09:02:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.180+0000 7f53b27b9740 1 -- start start 2024-04-25T09:02:57.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.180+0000 7f53b27b9740 1 Processor -- start 2024-04-25T09:02:57.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672c84580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672c89280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53b27b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53b27b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561672ce07d0 con 0x561672cb5230 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b5d70 con 0x561672cd2ad0 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53b27b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x561672ce1070 con 0x561672c9e830 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53b27b9740 10 client.0 _ll_register_callbacks cb 0x561672c85c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672c89280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672c89280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47400/0 (socket says 172.21.15.5:47400) 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 -- 172.21.15.5:0/3492419609 learned_addr learned my addr 172.21.15.5:0/3492419609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad84f640 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672c84580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ae050640 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 -- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 msgr2=0x561672c84580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672c84580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 -- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 msgr2=0x561672cd2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.181+0000 7f53ad04e640 1 -- 172.21.15.5:0/3492419609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561672cc75a0 con 0x561672cb5230 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53ad04e640 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672c89280 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f539c000f60 tx=0x7f539c001100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4e9881a6c67085 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f538cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f538cff9640 1 -- 172.21.15.5:0/3492419609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c034060 con 0x561672cb5230 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f538cff9640 1 -- 172.21.15.5:0/3492419609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f539c00d900 con 0x561672cb5230 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f539c005c40 con 0x561672cb5230 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f538cff9640 1 -- 172.21.15.5:0/3492419609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f539c03a050 con 0x561672cb5230 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 10 client.7677 fetch_fsmap learned FSMap version 55 2024-04-25T09:02:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x561672c84ac0 con 0x561672cb5230 2024-04-25T09:02:57.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f538cff9640 1 -- 172.21.15.5:0/3492419609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c005c40 con 0x561672cb5230 2024-04-25T09:02:57.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f538cff9640 1 -- 172.21.15.5:0/3492419609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f539c03d020 con 0x561672cb5230 2024-04-25T09:02:57.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 10 client.7677 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 10 client.7677 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 20 client.7677 populate_metadata read hostname 'smithi005' 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672cd34c0 0x561672ca0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 4 client.7677 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561672bfaf50 con 0x561672cd34c0 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.182+0000 7f53ad84f640 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672cd34c0 0x561672ca0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f538cff9640 10 client.7677 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53ad84f640 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672cd34c0 0x561672ca0240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0435aaf4ae2752a server_cookie=34db30bc714d4581 in_seq=0 out_seq=0 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f538cff9640 1 -- 172.21.15.5:0/3492419609 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561672bfaf50 con 0x561672cd34c0 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f538cff9640 10 client.7677 handle_command_reply: tid=0 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 client.7677 shutdown 2024-04-25T09:02:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 msgr2=0x561672c89280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672c89280 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f539c000f60 tx=0x7f539c001100 comp rx=0 tx=0).stop 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 shutdown_connections 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x561672cd34c0 0x561672ca0240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561672cd2ad0 0x561672cd2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561672cb5230 0x561672c89280 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f538cff9640 0 client.7677 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 --2- 172.21.15.5:0/3492419609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561672c9e830 0x561672c84580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 >> 172.21.15.5:0/3492419609 conn(0x561672c8af10 msgr2=0x561672c8a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 shutdown_connections 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 1 -- 172.21.15.5:0/3492419609 wait complete. 2024-04-25T09:02:57.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.183+0000 7f53b27b9740 20 client.7677 trim_cache size 0 max 16384 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7497, 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.07998478, 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 55, 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 88, 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.086652666000001 2024-04-25T09:02:57.179 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:02:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f539406b500 msgr2=0x7f539406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f539406b500 0x7f539406d9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f53a806b030 tx=0x7f539c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80b0a50 msgr2=0x7f53a80c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80b0a50 0x7f53a80c7c70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c8a0 tx=0x7f53a000cd60 comp rx=0 tx=0).stop 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 shutdown_connections 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f539406b500 0x7f539406d9c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53a80ce910 0x7f53a815c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53a80b0e30 0x7f53a8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 --2- 172.21.15.5:0/4042957253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53a80b0a50 0x7f53a80c7c70 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 >> 172.21.15.5:0/4042957253 conn(0x7f53a80d18f0 msgr2=0x7f53a80cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 shutdown_connections 2024-04-25T09:02:57.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.184+0000 7f53afab3640 1 -- 172.21.15.5:0/4042957253 wait complete. 2024-04-25T09:02:57.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:02:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.295+0000 7fcddae7c640 1 Processor -- start 2024-04-25T09:02:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.295+0000 7fcddae7c640 1 -- start start 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcddae7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcddae7c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcdd40b2cc0 0x7fcdd40b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcddae7c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdd40b7130 0x7fcdd40ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcddae7c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd40d2a10 con 0x7fcdd40b7130 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcddae7c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd40d20e0 con 0x7fcdd40b2cc0 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcddae7c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40d23c0 con 0x7fcdd415de70 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdd40b7130 0x7fcdd40ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdd40b7130 0x7fcdd40ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47410/0 (socket says 172.21.15.5:47410) 2024-04-25T09:02:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 -- 172.21.15.5:0/2819848220 learned_addr learned my addr 172.21.15.5:0/2819848220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd8c18640 1 --2- 172.21.15.5:0/2819848220 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdcbfff640 1 --2- 172.21.15.5:0/2819848220 >> v2:172.21.15.80:3300/0 conn(0x7fcdd40b2cc0 0x7fcdd40b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 -- 172.21.15.5:0/2819848220 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 msgr2=0x7fcdd40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 --2- 172.21.15.5:0/2819848220 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd40b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 -- 172.21.15.5:0/2819848220 >> v2:172.21.15.80:3300/0 conn(0x7fcdd40b2cc0 msgr2=0x7fcdd40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 --2- 172.21.15.5:0/2819848220 >> v2:172.21.15.80:3300/0 conn(0x7fcdd40b2cc0 0x7fcdd40b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdd9419640 1 -- 172.21.15.5:0/2819848220 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40d26a0 con 0x7fcdd40b7130 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.296+0000 7fcdcbfff640 1 --2- 172.21.15.5:0/2819848220 >> v2:172.21.15.80:3300/0 conn(0x7fcdd40b2cc0 0x7fcdd40b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.297+0000 7fcdd9419640 1 --2- 172.21.15.5:0/2819848220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40ce7f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fcdd408c640 tx=0x7fcdcc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a245bff919689c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.297+0000 7fcdcb7fe640 1 -- 172.21.15.5:0/2819848220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc036070 con 0x7fcdd40b7130 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.297+0000 7fcdcb7fe640 1 -- 172.21.15.5:0/2819848220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc031600 con 0x7fcdd40b7130 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.297+0000 7fcdcb7fe640 1 -- 172.21.15.5:0/2819848220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0319d0 con 0x7fcdd40b7130 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 -- 172.21.15.5:0/2819848220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 msgr2=0x7fcdd40ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 --2- 172.21.15.5:0/2819848220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40ce7f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fcdd408c640 tx=0x7fcdcc02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 -- 172.21.15.5:0/2819848220 shutdown_connections 2024-04-25T09:02:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 --2- 172.21.15.5:0/2819848220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40ce7f0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 --2- 172.21.15.5:0/2819848220 >> v2:172.21.15.80:3300/0 conn(0x7fcdd40b2cc0 0x7fcdd40b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 --2- 172.21.15.5:0/2819848220 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd40b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 -- 172.21.15.5:0/2819848220 >> 172.21.15.5:0/2819848220 conn(0x7fcdd406b000 msgr2=0x7fcdd406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 -- 172.21.15.5:0/2819848220 shutdown_connections 2024-04-25T09:02:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.298+0000 7fcddae7c640 1 -- 172.21.15.5:0/2819848220 wait complete. 2024-04-25T09:02:57.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.299+0000 7fcddae7c640 1 Processor -- start 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.299+0000 7fcddae7c640 1 -- start start 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcddae7c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd40b2cc0 0x7fcdd414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcddae7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcddae7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcddae7c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40ceeb0 con 0x7fcdd40b7130 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcddae7c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40ced30 con 0x7fcdd40b2cc0 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcddae7c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40cf030 con 0x7fcdd415de70 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47414/0 (socket says 172.21.15.5:47414) 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 -- 172.21.15.5:0/602495887 learned_addr learned my addr 172.21.15.5:0/602495887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdd8c18640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd40b2cc0 0x7fcdd414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdd9419640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 -- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 msgr2=0x7fcdd415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 -- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd40b2cc0 msgr2=0x7fcdd414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd40b2cc0 0x7fcdd414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 -- 172.21.15.5:0/602495887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40b52f0 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdcbfff640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40b4910 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e810 tx=0x7fcdc400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.300+0000 7fcdc97fa640 1 -- 172.21.15.5:0/602495887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400f040 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.301+0000 7fcdc97fa640 1 -- 172.21.15.5:0/602495887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc4004030 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.301+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd40b55d0 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.301+0000 7fcdc97fa640 1 -- 172.21.15.5:0/602495887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4004400 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.301+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd40b5b90 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.302+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd40b6070 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.302+0000 7fcdc97fa640 1 -- 172.21.15.5:0/602495887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcdc400c6d0 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.303+0000 7fcdc97fa640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcdc006b500 0x7fcdc006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.303+0000 7fcdc97fa640 1 -- 172.21.15.5:0/602495887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdc4089ec0 con 0x7fcdd40b7130 2024-04-25T09:02:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.303+0000 7fcdd8c18640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcdc006b500 0x7fcdc006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.303+0000 7fcdd8c18640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcdc006b500 0x7fcdc006d9c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009a30 tx=0x7fcdd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.307+0000 7fcdc97fa640 1 -- 172.21.15.5:0/602495887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcdd40b6070 con 0x7fcdd40b7130 2024-04-25T09:02:57.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.523+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcdd404ef20 con 0x7fcdd40b7130 2024-04-25T09:02:57.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.524+0000 7fcdc97fa640 1 -- 172.21.15.5:0/602495887 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcdc4017020 con 0x7fcdd40b7130 2024-04-25T09:02:57.512 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcdc006b500 msgr2=0x7fcdc006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcdc006b500 0x7fcdc006d9c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009a30 tx=0x7fcdd0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 msgr2=0x7fcdd40b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40b4910 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e810 tx=0x7fcdc400ecd0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 shutdown_connections 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcdc006b500 0x7fcdc006d9c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcdd415de70 0x7fcdd415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40b7130 0x7fcdd40b4910 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 --2- 172.21.15.5:0/602495887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd40b2cc0 0x7fcdd414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 >> 172.21.15.5:0/602495887 conn(0x7fcdd406b000 msgr2=0x7fcdd40cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 shutdown_connections 2024-04-25T09:02:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:02:57.526+0000 7fcddae7c640 1 -- 172.21.15.5:0/602495887 wait complete. 2024-04-25T09:02:57.524 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:02:57.525 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:57.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:57.525 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:02:57.541 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:02:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42382sec preferred_lft 42382sec 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:02:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:02:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:57.544 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:02:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:02:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:57.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:57.544 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:57.605 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:02:57.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:57.606 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:02:57.663 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:02:57.663 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:02:57.664 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:02:57.664 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:02:57.664 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:02:57.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:57.664 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:02:57.664 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:02:57.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:02:57.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:02:57.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:02:57.665 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:02:57.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:57.749 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:02:57.764 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:02:57.764 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:02:57.764 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:57.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:57.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:02:57.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:57.829 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:57.885 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:57.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:57.885 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:57.940 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:02:57.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:57.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:02:58.023 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:02:58.023 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:02:58.031 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:02:58.031 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:02:58.031 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:02:58.031 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:02:58.031 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:02:58.032 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:02:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:02:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:02:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:02:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:02:58.034 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:02:58.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:58.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:58.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:58.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:58.163 INFO:teuthology.orchestra.run.smithi005.stdout:client6245 2024-04-25T09:02:58.164 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:02:58.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:58.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:58.219 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:02:58.219 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:02:58.219 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:02:58.219 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:02:58.219 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:02:58.219 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:02:58.219 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:02:58.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999407 s, 105 MB/s 2024-04-25T09:02:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714984 s, 147 MB/s 2024-04-25T09:02:58.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085503 s, 123 MB/s 2024-04-25T09:02:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825044 s, 127 MB/s 2024-04-25T09:02:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789613 s, 133 MB/s 2024-04-25T09:02:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886456 s, 118 MB/s 2024-04-25T09:02:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080171 s, 131 MB/s 2024-04-25T09:02:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872984 s, 120 MB/s 2024-04-25T09:02:58.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817143 s, 128 MB/s 2024-04-25T09:02:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796283 s, 132 MB/s 2024-04-25T09:02:58.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678114 s, 155 MB/s 2024-04-25T09:02:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089452 s, 117 MB/s 2024-04-25T09:02:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759591 s, 138 MB/s 2024-04-25T09:02:58.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785344 s, 134 MB/s 2024-04-25T09:02:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765008 s, 137 MB/s 2024-04-25T09:02:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729007 s, 144 MB/s 2024-04-25T09:02:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076765 s, 137 MB/s 2024-04-25T09:02:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690712 s, 152 MB/s 2024-04-25T09:02:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689329 s, 152 MB/s 2024-04-25T09:02:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852131 s, 123 MB/s 2024-04-25T09:02:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782419 s, 134 MB/s 2024-04-25T09:02:58.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722651 s, 145 MB/s 2024-04-25T09:02:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668678 s, 157 MB/s 2024-04-25T09:02:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771124 s, 136 MB/s 2024-04-25T09:02:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793879 s, 132 MB/s 2024-04-25T09:02:58.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.513 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786411 s, 133 MB/s 2024-04-25T09:02:58.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789344 s, 133 MB/s 2024-04-25T09:02:58.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724058 s, 145 MB/s 2024-04-25T09:02:58.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.538 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697432 s, 150 MB/s 2024-04-25T09:02:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077025 s, 136 MB/s 2024-04-25T09:02:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708911 s, 148 MB/s 2024-04-25T09:02:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770627 s, 136 MB/s 2024-04-25T09:02:58.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:58.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:02:58.564 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:02:58.565 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:02:58.565 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:02:58.565 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:02:58.565 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:02:58.565 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798175 s, 131 MB/s 2024-04-25T09:02:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756026 s, 139 MB/s 2024-04-25T09:02:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788851 s, 133 MB/s 2024-04-25T09:02:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786334 s, 133 MB/s 2024-04-25T09:02:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775332 s, 135 MB/s 2024-04-25T09:02:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671613 s, 156 MB/s 2024-04-25T09:02:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730813 s, 143 MB/s 2024-04-25T09:02:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744517 s, 141 MB/s 2024-04-25T09:02:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073302 s, 143 MB/s 2024-04-25T09:02:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698873 s, 150 MB/s 2024-04-25T09:02:58.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745795 s, 141 MB/s 2024-04-25T09:02:58.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732847 s, 143 MB/s 2024-04-25T09:02:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007434 s, 141 MB/s 2024-04-25T09:02:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749035 s, 140 MB/s 2024-04-25T09:02:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673785 s, 156 MB/s 2024-04-25T09:02:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743826 s, 141 MB/s 2024-04-25T09:02:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731676 s, 143 MB/s 2024-04-25T09:02:58.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732812 s, 143 MB/s 2024-04-25T09:02:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745127 s, 141 MB/s 2024-04-25T09:02:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766092 s, 137 MB/s 2024-04-25T09:02:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722862 s, 145 MB/s 2024-04-25T09:02:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701356 s, 150 MB/s 2024-04-25T09:02:58.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665727 s, 158 MB/s 2024-04-25T09:02:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766111 s, 137 MB/s 2024-04-25T09:02:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682361 s, 154 MB/s 2024-04-25T09:02:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635457 s, 165 MB/s 2024-04-25T09:02:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710867 s, 148 MB/s 2024-04-25T09:02:58.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718989 s, 146 MB/s 2024-04-25T09:02:58.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672268 s, 156 MB/s 2024-04-25T09:02:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702305 s, 149 MB/s 2024-04-25T09:02:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784734 s, 134 MB/s 2024-04-25T09:02:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724499 s, 145 MB/s 2024-04-25T09:02:58.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:58.886 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:02:58.886 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:02:58.886 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:02:58.886 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:02:58.886 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:02:58.886 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:02:58.886 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:02:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681948 s, 154 MB/s 2024-04-25T09:02:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070567 s, 149 MB/s 2024-04-25T09:02:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642837 s, 163 MB/s 2024-04-25T09:02:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684526 s, 153 MB/s 2024-04-25T09:02:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680716 s, 154 MB/s 2024-04-25T09:02:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745225 s, 141 MB/s 2024-04-25T09:02:59.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745737 s, 141 MB/s 2024-04-25T09:02:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074497 s, 141 MB/s 2024-04-25T09:02:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742625 s, 141 MB/s 2024-04-25T09:02:59.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632935 s, 166 MB/s 2024-04-25T09:02:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769414 s, 136 MB/s 2024-04-25T09:02:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728996 s, 144 MB/s 2024-04-25T09:02:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738275 s, 142 MB/s 2024-04-25T09:02:59.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746503 s, 140 MB/s 2024-04-25T09:02:59.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722235 s, 145 MB/s 2024-04-25T09:02:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707245 s, 148 MB/s 2024-04-25T09:02:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812237 s, 129 MB/s 2024-04-25T09:02:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746863 s, 140 MB/s 2024-04-25T09:02:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763537 s, 137 MB/s 2024-04-25T09:02:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686626 s, 153 MB/s 2024-04-25T09:02:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737166 s, 142 MB/s 2024-04-25T09:02:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686327 s, 153 MB/s 2024-04-25T09:02:59.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697809 s, 150 MB/s 2024-04-25T09:02:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755951 s, 139 MB/s 2024-04-25T09:02:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726899 s, 144 MB/s 2024-04-25T09:02:59.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830947 s, 126 MB/s 2024-04-25T09:02:59.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793919 s, 132 MB/s 2024-04-25T09:02:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730135 s, 144 MB/s 2024-04-25T09:02:59.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627276 s, 167 MB/s 2024-04-25T09:02:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704242 s, 149 MB/s 2024-04-25T09:02:59.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744757 s, 141 MB/s 2024-04-25T09:02:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691031 s, 152 MB/s 2024-04-25T09:02:59.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:59.207 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:02:59.207 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:02:59.207 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:02:59.207 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:02:59.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:02:59.207 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:02:59.207 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:02:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830051 s, 126 MB/s 2024-04-25T09:02:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745224 s, 141 MB/s 2024-04-25T09:02:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743422 s, 141 MB/s 2024-04-25T09:02:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669032 s, 157 MB/s 2024-04-25T09:02:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073169 s, 143 MB/s 2024-04-25T09:02:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722706 s, 145 MB/s 2024-04-25T09:02:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624279 s, 168 MB/s 2024-04-25T09:02:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752146 s, 139 MB/s 2024-04-25T09:02:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737159 s, 142 MB/s 2024-04-25T09:02:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719533 s, 146 MB/s 2024-04-25T09:02:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722896 s, 145 MB/s 2024-04-25T09:02:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761048 s, 138 MB/s 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742132 s, 141 MB/s 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699874 s, 150 MB/s 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756832 s, 139 MB/s 2024-04-25T09:02:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747951 s, 140 MB/s 2024-04-25T09:02:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751308 s, 140 MB/s 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810781 s, 129 MB/s 2024-04-25T09:02:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672229 s, 156 MB/s 2024-04-25T09:02:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714323 s, 147 MB/s 2024-04-25T09:02:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659832 s, 159 MB/s 2024-04-25T09:02:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694112 s, 151 MB/s 2024-04-25T09:02:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736978 s, 142 MB/s 2024-04-25T09:02:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756637 s, 139 MB/s 2024-04-25T09:02:59.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731713 s, 143 MB/s 2024-04-25T09:02:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730733 s, 143 MB/s 2024-04-25T09:02:59.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685075 s, 153 MB/s 2024-04-25T09:02:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732859 s, 143 MB/s 2024-04-25T09:02:59.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651066 s, 161 MB/s 2024-04-25T09:02:59.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.510 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755796 s, 139 MB/s 2024-04-25T09:02:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.518 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682372 s, 154 MB/s 2024-04-25T09:02:59.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691791 s, 152 MB/s 2024-04-25T09:02:59.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:59.527 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:02:59.527 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:02:59.527 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:02:59.527 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:02:59.527 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:02:59.527 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:02:59.527 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:02:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755752 s, 139 MB/s 2024-04-25T09:02:59.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626459 s, 167 MB/s 2024-04-25T09:02:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612922 s, 171 MB/s 2024-04-25T09:02:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841222 s, 125 MB/s 2024-04-25T09:02:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719053 s, 146 MB/s 2024-04-25T09:02:59.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718266 s, 146 MB/s 2024-04-25T09:02:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766337 s, 137 MB/s 2024-04-25T09:02:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727232 s, 144 MB/s 2024-04-25T09:02:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721244 s, 145 MB/s 2024-04-25T09:02:59.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743848 s, 141 MB/s 2024-04-25T09:02:59.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.674 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730101 s, 144 MB/s 2024-04-25T09:02:59.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795327 s, 132 MB/s 2024-04-25T09:02:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767146 s, 137 MB/s 2024-04-25T09:02:59.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747252 s, 140 MB/s 2024-04-25T09:02:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696608 s, 151 MB/s 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733902 s, 143 MB/s 2024-04-25T09:02:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738272 s, 142 MB/s 2024-04-25T09:02:59.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698804 s, 150 MB/s 2024-04-25T09:02:59.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071325 s, 147 MB/s 2024-04-25T09:02:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749309 s, 140 MB/s 2024-04-25T09:02:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706184 s, 148 MB/s 2024-04-25T09:02:59.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725984 s, 144 MB/s 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732819 s, 143 MB/s 2024-04-25T09:02:59.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748161 s, 140 MB/s 2024-04-25T09:02:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617588 s, 170 MB/s 2024-04-25T09:02:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656479 s, 160 MB/s 2024-04-25T09:02:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746161 s, 141 MB/s 2024-04-25T09:02:59.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696078 s, 151 MB/s 2024-04-25T09:02:59.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720992 s, 145 MB/s 2024-04-25T09:02:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760644 s, 138 MB/s 2024-04-25T09:02:59.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741601 s, 141 MB/s 2024-04-25T09:02:59.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749278 s, 140 MB/s 2024-04-25T09:02:59.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:59.846 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:02:59.846 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:02:59.846 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:02:59.846 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:02:59.846 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:02:59.846 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:02:59.847 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:02:59.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723819 s, 145 MB/s 2024-04-25T09:02:59.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662665 s, 158 MB/s 2024-04-25T09:02:59.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637406 s, 165 MB/s 2024-04-25T09:02:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714611 s, 147 MB/s 2024-04-25T09:02:59.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764517 s, 137 MB/s 2024-04-25T09:02:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689829 s, 152 MB/s 2024-04-25T09:02:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758281 s, 138 MB/s 2024-04-25T09:02:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732295 s, 143 MB/s 2024-04-25T09:02:59.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740109 s, 142 MB/s 2024-04-25T09:02:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700376 s, 150 MB/s 2024-04-25T09:02:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685516 s, 153 MB/s 2024-04-25T09:02:59.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:02:59.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:02:59.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681819 s, 154 MB/s 2024-04-25T09:03:00.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738541 s, 142 MB/s 2024-04-25T09:03:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747842 s, 140 MB/s 2024-04-25T09:03:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692336 s, 151 MB/s 2024-04-25T09:03:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716878 s, 146 MB/s 2024-04-25T09:03:00.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692651 s, 151 MB/s 2024-04-25T09:03:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803593 s, 130 MB/s 2024-04-25T09:03:00.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766901 s, 137 MB/s 2024-04-25T09:03:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723984 s, 145 MB/s 2024-04-25T09:03:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729684 s, 144 MB/s 2024-04-25T09:03:00.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723773 s, 145 MB/s 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728556 s, 144 MB/s 2024-04-25T09:03:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627876 s, 167 MB/s 2024-04-25T09:03:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777946 s, 135 MB/s 2024-04-25T09:03:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770726 s, 136 MB/s 2024-04-25T09:03:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737182 s, 142 MB/s 2024-04-25T09:03:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810519 s, 129 MB/s 2024-04-25T09:03:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067639 s, 155 MB/s 2024-04-25T09:03:00.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709062 s, 148 MB/s 2024-04-25T09:03:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712383 s, 147 MB/s 2024-04-25T09:03:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730938 s, 143 MB/s 2024-04-25T09:03:00.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.165 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:00.165 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:00.165 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:03:00.165 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:00.165 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:00.165 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:00.165 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704731 s, 149 MB/s 2024-04-25T09:03:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717562 s, 146 MB/s 2024-04-25T09:03:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758521 s, 138 MB/s 2024-04-25T09:03:00.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708884 s, 148 MB/s 2024-04-25T09:03:00.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.264 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746714 s, 140 MB/s 2024-04-25T09:03:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.273 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760363 s, 138 MB/s 2024-04-25T09:03:00.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.281 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756273 s, 139 MB/s 2024-04-25T09:03:00.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722709 s, 145 MB/s 2024-04-25T09:03:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731568 s, 143 MB/s 2024-04-25T09:03:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735414 s, 143 MB/s 2024-04-25T09:03:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769869 s, 136 MB/s 2024-04-25T09:03:00.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772398 s, 136 MB/s 2024-04-25T09:03:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648857 s, 162 MB/s 2024-04-25T09:03:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074401 s, 141 MB/s 2024-04-25T09:03:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772735 s, 136 MB/s 2024-04-25T09:03:00.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.356 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744973 s, 141 MB/s 2024-04-25T09:03:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007608 s, 138 MB/s 2024-04-25T09:03:00.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636078 s, 165 MB/s 2024-04-25T09:03:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852158 s, 123 MB/s 2024-04-25T09:03:00.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731499 s, 143 MB/s 2024-04-25T09:03:00.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746593 s, 140 MB/s 2024-04-25T09:03:00.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722727 s, 145 MB/s 2024-04-25T09:03:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742246 s, 141 MB/s 2024-04-25T09:03:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742767 s, 141 MB/s 2024-04-25T09:03:00.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.430 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007174 s, 146 MB/s 2024-04-25T09:03:00.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.438 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735845 s, 142 MB/s 2024-04-25T09:03:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802671 s, 131 MB/s 2024-04-25T09:03:00.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753637 s, 139 MB/s 2024-04-25T09:03:00.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638532 s, 164 MB/s 2024-04-25T09:03:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670673 s, 156 MB/s 2024-04-25T09:03:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740362 s, 142 MB/s 2024-04-25T09:03:00.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690806 s, 152 MB/s 2024-04-25T09:03:00.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.487 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:00.488 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:00.488 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:03:00.488 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:00.488 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:00.488 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:00.488 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:00.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752599 s, 139 MB/s 2024-04-25T09:03:00.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758727 s, 138 MB/s 2024-04-25T09:03:00.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743056 s, 141 MB/s 2024-04-25T09:03:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656664 s, 160 MB/s 2024-04-25T09:03:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007249 s, 145 MB/s 2024-04-25T09:03:00.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730464 s, 144 MB/s 2024-04-25T09:03:00.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746404 s, 140 MB/s 2024-04-25T09:03:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717954 s, 146 MB/s 2024-04-25T09:03:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736792 s, 142 MB/s 2024-04-25T09:03:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756524 s, 139 MB/s 2024-04-25T09:03:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711843 s, 147 MB/s 2024-04-25T09:03:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708949 s, 148 MB/s 2024-04-25T09:03:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727444 s, 144 MB/s 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719088 s, 146 MB/s 2024-04-25T09:03:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704763 s, 149 MB/s 2024-04-25T09:03:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682032 s, 154 MB/s 2024-04-25T09:03:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729402 s, 144 MB/s 2024-04-25T09:03:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699812 s, 150 MB/s 2024-04-25T09:03:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727194 s, 144 MB/s 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609438 s, 172 MB/s 2024-04-25T09:03:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720538 s, 146 MB/s 2024-04-25T09:03:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718558 s, 146 MB/s 2024-04-25T09:03:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664378 s, 158 MB/s 2024-04-25T09:03:00.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626996 s, 167 MB/s 2024-04-25T09:03:00.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.745 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719172 s, 146 MB/s 2024-04-25T09:03:00.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740807 s, 142 MB/s 2024-04-25T09:03:00.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687851 s, 152 MB/s 2024-04-25T09:03:00.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768613 s, 136 MB/s 2024-04-25T09:03:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713203 s, 147 MB/s 2024-04-25T09:03:00.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745335 s, 141 MB/s 2024-04-25T09:03:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652515 s, 161 MB/s 2024-04-25T09:03:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736217 s, 142 MB/s 2024-04-25T09:03:00.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:00.803 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:00.803 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:03:00.803 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:00.803 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:00.803 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:00.803 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744695 s, 141 MB/s 2024-04-25T09:03:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707889 s, 148 MB/s 2024-04-25T09:03:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765336 s, 137 MB/s 2024-04-25T09:03:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695846 s, 151 MB/s 2024-04-25T09:03:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647524 s, 162 MB/s 2024-04-25T09:03:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748615 s, 140 MB/s 2024-04-25T09:03:00.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709192 s, 148 MB/s 2024-04-25T09:03:00.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076276 s, 137 MB/s 2024-04-25T09:03:00.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750193 s, 140 MB/s 2024-04-25T09:03:00.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.942 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743425 s, 141 MB/s 2024-04-25T09:03:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751815 s, 139 MB/s 2024-04-25T09:03:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718002 s, 146 MB/s 2024-04-25T09:03:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730425 s, 144 MB/s 2024-04-25T09:03:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669136 s, 157 MB/s 2024-04-25T09:03:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633316 s, 166 MB/s 2024-04-25T09:03:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730107 s, 144 MB/s 2024-04-25T09:03:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740003 s, 142 MB/s 2024-04-25T09:03:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006296 s, 167 MB/s 2024-04-25T09:03:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739413 s, 142 MB/s 2024-04-25T09:03:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733014 s, 143 MB/s 2024-04-25T09:03:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706308 s, 148 MB/s 2024-04-25T09:03:01.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644825 s, 163 MB/s 2024-04-25T09:03:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735032 s, 143 MB/s 2024-04-25T09:03:01.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683775 s, 153 MB/s 2024-04-25T09:03:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710841 s, 148 MB/s 2024-04-25T09:03:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073447 s, 143 MB/s 2024-04-25T09:03:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729702 s, 144 MB/s 2024-04-25T09:03:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707526 s, 148 MB/s 2024-04-25T09:03:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725637 s, 145 MB/s 2024-04-25T09:03:01.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686089 s, 153 MB/s 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751647 s, 140 MB/s 2024-04-25T09:03:01.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734787 s, 143 MB/s 2024-04-25T09:03:01.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.119 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:01.119 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:01.119 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:03:01.119 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:01.119 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:01.119 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:01.119 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:01.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754011 s, 139 MB/s 2024-04-25T09:03:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686734 s, 153 MB/s 2024-04-25T09:03:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752423 s, 139 MB/s 2024-04-25T09:03:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709848 s, 148 MB/s 2024-04-25T09:03:01.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731324 s, 143 MB/s 2024-04-25T09:03:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681942 s, 154 MB/s 2024-04-25T09:03:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701277 s, 150 MB/s 2024-04-25T09:03:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072628 s, 144 MB/s 2024-04-25T09:03:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693114 s, 151 MB/s 2024-04-25T09:03:01.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635012 s, 165 MB/s 2024-04-25T09:03:01.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721184 s, 145 MB/s 2024-04-25T09:03:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.274 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771056 s, 136 MB/s 2024-04-25T09:03:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742407 s, 141 MB/s 2024-04-25T09:03:01.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764059 s, 137 MB/s 2024-04-25T09:03:01.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738585 s, 142 MB/s 2024-04-25T09:03:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709863 s, 148 MB/s 2024-04-25T09:03:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733731 s, 143 MB/s 2024-04-25T09:03:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713745 s, 147 MB/s 2024-04-25T09:03:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712465 s, 147 MB/s 2024-04-25T09:03:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669723 s, 157 MB/s 2024-04-25T09:03:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709482 s, 148 MB/s 2024-04-25T09:03:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745689 s, 141 MB/s 2024-04-25T09:03:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733563 s, 143 MB/s 2024-04-25T09:03:01.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756922 s, 139 MB/s 2024-04-25T09:03:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741537 s, 141 MB/s 2024-04-25T09:03:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710913 s, 147 MB/s 2024-04-25T09:03:01.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.396 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642432 s, 163 MB/s 2024-04-25T09:03:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731359 s, 143 MB/s 2024-04-25T09:03:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657742 s, 159 MB/s 2024-04-25T09:03:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074952 s, 140 MB/s 2024-04-25T09:03:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762383 s, 138 MB/s 2024-04-25T09:03:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638603 s, 164 MB/s 2024-04-25T09:03:01.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.437 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:01.437 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:01.437 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:03:01.437 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:01.437 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:01.437 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:01.437 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697047 s, 150 MB/s 2024-04-25T09:03:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779406 s, 135 MB/s 2024-04-25T09:03:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657131 s, 160 MB/s 2024-04-25T09:03:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745324 s, 141 MB/s 2024-04-25T09:03:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730024 s, 144 MB/s 2024-04-25T09:03:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661685 s, 158 MB/s 2024-04-25T09:03:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745818 s, 141 MB/s 2024-04-25T09:03:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816473 s, 128 MB/s 2024-04-25T09:03:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733344 s, 143 MB/s 2024-04-25T09:03:01.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715931 s, 146 MB/s 2024-04-25T09:03:01.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750812 s, 140 MB/s 2024-04-25T09:03:01.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767955 s, 137 MB/s 2024-04-25T09:03:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649559 s, 161 MB/s 2024-04-25T09:03:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686098 s, 153 MB/s 2024-04-25T09:03:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623196 s, 168 MB/s 2024-04-25T09:03:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699086 s, 150 MB/s 2024-04-25T09:03:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705985 s, 149 MB/s 2024-04-25T09:03:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754218 s, 139 MB/s 2024-04-25T09:03:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742831 s, 141 MB/s 2024-04-25T09:03:01.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639065 s, 164 MB/s 2024-04-25T09:03:01.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.664 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735202 s, 143 MB/s 2024-04-25T09:03:01.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748217 s, 140 MB/s 2024-04-25T09:03:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728286 s, 144 MB/s 2024-04-25T09:03:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075734 s, 138 MB/s 2024-04-25T09:03:01.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751149 s, 140 MB/s 2024-04-25T09:03:01.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758281 s, 138 MB/s 2024-04-25T09:03:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724287 s, 145 MB/s 2024-04-25T09:03:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723626 s, 145 MB/s 2024-04-25T09:03:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723636 s, 145 MB/s 2024-04-25T09:03:01.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079582 s, 132 MB/s 2024-04-25T09:03:01.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735816 s, 143 MB/s 2024-04-25T09:03:01.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677272 s, 155 MB/s 2024-04-25T09:03:01.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.756 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:01.756 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:01.756 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:03:01.756 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:01.756 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:01.756 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:01.757 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708125 s, 148 MB/s 2024-04-25T09:03:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727994 s, 144 MB/s 2024-04-25T09:03:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748582 s, 140 MB/s 2024-04-25T09:03:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741128 s, 141 MB/s 2024-04-25T09:03:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767206 s, 137 MB/s 2024-04-25T09:03:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621192 s, 169 MB/s 2024-04-25T09:03:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733254 s, 143 MB/s 2024-04-25T09:03:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775085 s, 135 MB/s 2024-04-25T09:03:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632069 s, 166 MB/s 2024-04-25T09:03:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061528 s, 170 MB/s 2024-04-25T09:03:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721963 s, 145 MB/s 2024-04-25T09:03:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697662 s, 150 MB/s 2024-04-25T09:03:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644955 s, 163 MB/s 2024-04-25T09:03:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720522 s, 146 MB/s 2024-04-25T09:03:01.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750221 s, 140 MB/s 2024-04-25T09:03:01.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708126 s, 148 MB/s 2024-04-25T09:03:01.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645452 s, 162 MB/s 2024-04-25T09:03:01.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709594 s, 148 MB/s 2024-04-25T09:03:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648838 s, 162 MB/s 2024-04-25T09:03:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729759 s, 144 MB/s 2024-04-25T09:03:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632413 s, 166 MB/s 2024-04-25T09:03:01.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707383 s, 148 MB/s 2024-04-25T09:03:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721705 s, 145 MB/s 2024-04-25T09:03:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637522 s, 164 MB/s 2024-04-25T09:03:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723435 s, 145 MB/s 2024-04-25T09:03:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762934 s, 137 MB/s 2024-04-25T09:03:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731909 s, 143 MB/s 2024-04-25T09:03:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735222 s, 143 MB/s 2024-04-25T09:03:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696062 s, 151 MB/s 2024-04-25T09:03:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070723 s, 148 MB/s 2024-04-25T09:03:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706241 s, 148 MB/s 2024-04-25T09:03:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737758 s, 142 MB/s 2024-04-25T09:03:02.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.069 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:02.069 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:02.069 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:03:02.069 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:02.069 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:02.069 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:02.069 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767902 s, 137 MB/s 2024-04-25T09:03:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749586 s, 140 MB/s 2024-04-25T09:03:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753945 s, 139 MB/s 2024-04-25T09:03:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696817 s, 150 MB/s 2024-04-25T09:03:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736875 s, 142 MB/s 2024-04-25T09:03:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683609 s, 153 MB/s 2024-04-25T09:03:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746086 s, 141 MB/s 2024-04-25T09:03:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074132 s, 141 MB/s 2024-04-25T09:03:02.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720035 s, 146 MB/s 2024-04-25T09:03:02.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731097 s, 143 MB/s 2024-04-25T09:03:02.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644252 s, 163 MB/s 2024-04-25T09:03:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749114 s, 140 MB/s 2024-04-25T09:03:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702955 s, 149 MB/s 2024-04-25T09:03:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634893 s, 165 MB/s 2024-04-25T09:03:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743117 s, 141 MB/s 2024-04-25T09:03:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784473 s, 134 MB/s 2024-04-25T09:03:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727751 s, 144 MB/s 2024-04-25T09:03:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686607 s, 153 MB/s 2024-04-25T09:03:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067634 s, 155 MB/s 2024-04-25T09:03:02.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742919 s, 141 MB/s 2024-04-25T09:03:02.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766414 s, 137 MB/s 2024-04-25T09:03:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736025 s, 142 MB/s 2024-04-25T09:03:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734733 s, 143 MB/s 2024-04-25T09:03:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722699 s, 145 MB/s 2024-04-25T09:03:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717934 s, 146 MB/s 2024-04-25T09:03:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711965 s, 147 MB/s 2024-04-25T09:03:02.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725659 s, 144 MB/s 2024-04-25T09:03:02.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.357 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735397 s, 143 MB/s 2024-04-25T09:03:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763347 s, 137 MB/s 2024-04-25T09:03:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741319 s, 141 MB/s 2024-04-25T09:03:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701062 s, 150 MB/s 2024-04-25T09:03:02.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747753 s, 140 MB/s 2024-04-25T09:03:02.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.391 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:02.391 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:02.391 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:03:02.391 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:02.391 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:02.391 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:02.391 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778002 s, 135 MB/s 2024-04-25T09:03:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643473 s, 163 MB/s 2024-04-25T09:03:02.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672783 s, 156 MB/s 2024-04-25T09:03:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654173 s, 160 MB/s 2024-04-25T09:03:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648895 s, 162 MB/s 2024-04-25T09:03:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740269 s, 142 MB/s 2024-04-25T09:03:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720889 s, 145 MB/s 2024-04-25T09:03:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654537 s, 160 MB/s 2024-04-25T09:03:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075636 s, 139 MB/s 2024-04-25T09:03:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723929 s, 145 MB/s 2024-04-25T09:03:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634326 s, 165 MB/s 2024-04-25T09:03:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658319 s, 159 MB/s 2024-04-25T09:03:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716729 s, 146 MB/s 2024-04-25T09:03:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675939 s, 155 MB/s 2024-04-25T09:03:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762186 s, 138 MB/s 2024-04-25T09:03:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761544 s, 138 MB/s 2024-04-25T09:03:02.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679755 s, 154 MB/s 2024-04-25T09:03:02.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739607 s, 142 MB/s 2024-04-25T09:03:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773344 s, 136 MB/s 2024-04-25T09:03:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748534 s, 140 MB/s 2024-04-25T09:03:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.615 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675605 s, 155 MB/s 2024-04-25T09:03:02.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756437 s, 139 MB/s 2024-04-25T09:03:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714468 s, 147 MB/s 2024-04-25T09:03:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065178 s, 161 MB/s 2024-04-25T09:03:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703157 s, 149 MB/s 2024-04-25T09:03:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673751 s, 156 MB/s 2024-04-25T09:03:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726254 s, 144 MB/s 2024-04-25T09:03:02.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692328 s, 151 MB/s 2024-04-25T09:03:02.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734057 s, 143 MB/s 2024-04-25T09:03:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743029 s, 141 MB/s 2024-04-25T09:03:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711993 s, 147 MB/s 2024-04-25T09:03:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639488 s, 164 MB/s 2024-04-25T09:03:02.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.704 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:02.704 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:02.704 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:03:02.704 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:02.704 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:02.704 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:02.704 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671493 s, 156 MB/s 2024-04-25T09:03:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747449 s, 140 MB/s 2024-04-25T09:03:02.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750892 s, 140 MB/s 2024-04-25T09:03:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756092 s, 139 MB/s 2024-04-25T09:03:02.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734897 s, 143 MB/s 2024-04-25T09:03:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683137 s, 153 MB/s 2024-04-25T09:03:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715071 s, 147 MB/s 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727414 s, 144 MB/s 2024-04-25T09:03:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749102 s, 140 MB/s 2024-04-25T09:03:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070937 s, 148 MB/s 2024-04-25T09:03:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694953 s, 151 MB/s 2024-04-25T09:03:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718957 s, 146 MB/s 2024-04-25T09:03:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722372 s, 145 MB/s 2024-04-25T09:03:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728693 s, 144 MB/s 2024-04-25T09:03:02.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698538 s, 150 MB/s 2024-04-25T09:03:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706815 s, 148 MB/s 2024-04-25T09:03:02.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.899 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760563 s, 138 MB/s 2024-04-25T09:03:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714 s, 147 MB/s 2024-04-25T09:03:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073677 s, 142 MB/s 2024-04-25T09:03:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726629 s, 144 MB/s 2024-04-25T09:03:02.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742203 s, 141 MB/s 2024-04-25T09:03:02.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.940 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739408 s, 142 MB/s 2024-04-25T09:03:02.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069821 s, 150 MB/s 2024-04-25T09:03:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646258 s, 162 MB/s 2024-04-25T09:03:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725276 s, 145 MB/s 2024-04-25T09:03:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744372 s, 141 MB/s 2024-04-25T09:03:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742885 s, 141 MB/s 2024-04-25T09:03:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658584 s, 159 MB/s 2024-04-25T09:03:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729048 s, 144 MB/s 2024-04-25T09:03:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686787 s, 153 MB/s 2024-04-25T09:03:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693727 s, 151 MB/s 2024-04-25T09:03:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007812 s, 134 MB/s 2024-04-25T09:03:03.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:03.022 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:03.022 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:03.022 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:03:03.022 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:03.022 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:03.022 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:03.022 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074606 s, 141 MB/s 2024-04-25T09:03:03.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753894 s, 139 MB/s 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722205 s, 145 MB/s 2024-04-25T09:03:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767022 s, 137 MB/s 2024-04-25T09:03:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683585 s, 153 MB/s 2024-04-25T09:03:03.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735595 s, 143 MB/s 2024-04-25T09:03:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644265 s, 163 MB/s 2024-04-25T09:03:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767312 s, 137 MB/s 2024-04-25T09:03:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630984 s, 166 MB/s 2024-04-25T09:03:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784113 s, 134 MB/s 2024-04-25T09:03:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726281 s, 144 MB/s 2024-04-25T09:03:03.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730814 s, 143 MB/s 2024-04-25T09:03:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722626 s, 145 MB/s 2024-04-25T09:03:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728119 s, 144 MB/s 2024-04-25T09:03:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067888 s, 154 MB/s 2024-04-25T09:03:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679599 s, 154 MB/s 2024-04-25T09:03:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721489 s, 145 MB/s 2024-04-25T09:03:03.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776843 s, 135 MB/s 2024-04-25T09:03:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674154 s, 156 MB/s 2024-04-25T09:03:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743552 s, 141 MB/s 2024-04-25T09:03:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661695 s, 158 MB/s 2024-04-25T09:03:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074274 s, 141 MB/s 2024-04-25T09:03:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654824 s, 160 MB/s 2024-04-25T09:03:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809322 s, 130 MB/s 2024-04-25T09:03:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678222 s, 155 MB/s 2024-04-25T09:03:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685025 s, 153 MB/s 2024-04-25T09:03:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766132 s, 137 MB/s 2024-04-25T09:03:03.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075415 s, 139 MB/s 2024-04-25T09:03:03.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.314 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683716 s, 153 MB/s 2024-04-25T09:03:03.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733459 s, 143 MB/s 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676471 s, 155 MB/s 2024-04-25T09:03:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770295 s, 136 MB/s 2024-04-25T09:03:03.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:03.340 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:03.340 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:03.340 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:03:03.340 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:03.340 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:03.340 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:03.340 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076381 s, 137 MB/s 2024-04-25T09:03:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713404 s, 147 MB/s 2024-04-25T09:03:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721757 s, 145 MB/s 2024-04-25T09:03:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752457 s, 139 MB/s 2024-04-25T09:03:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710132 s, 148 MB/s 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677642 s, 155 MB/s 2024-04-25T09:03:03.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824282 s, 127 MB/s 2024-04-25T09:03:03.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818014 s, 128 MB/s 2024-04-25T09:03:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647976 s, 162 MB/s 2024-04-25T09:03:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742663 s, 141 MB/s 2024-04-25T09:03:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649685 s, 161 MB/s 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751438 s, 140 MB/s 2024-04-25T09:03:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690146 s, 152 MB/s 2024-04-25T09:03:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737398 s, 142 MB/s 2024-04-25T09:03:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738998 s, 142 MB/s 2024-04-25T09:03:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720571 s, 146 MB/s 2024-04-25T09:03:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072153 s, 145 MB/s 2024-04-25T09:03:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711943 s, 147 MB/s 2024-04-25T09:03:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725032 s, 145 MB/s 2024-04-25T09:03:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721382 s, 145 MB/s 2024-04-25T09:03:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729057 s, 144 MB/s 2024-04-25T09:03:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746061 s, 141 MB/s 2024-04-25T09:03:03.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.586 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069544 s, 151 MB/s 2024-04-25T09:03:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652911 s, 161 MB/s 2024-04-25T09:03:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737229 s, 142 MB/s 2024-04-25T09:03:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701518 s, 149 MB/s 2024-04-25T09:03:03.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664125 s, 158 MB/s 2024-04-25T09:03:03.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655785 s, 160 MB/s 2024-04-25T09:03:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710002 s, 148 MB/s 2024-04-25T09:03:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644642 s, 163 MB/s 2024-04-25T09:03:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708608 s, 148 MB/s 2024-04-25T09:03:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734378 s, 143 MB/s 2024-04-25T09:03:03.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:03.657 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:03.657 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:03.657 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:03:03.657 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:03.657 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:03.657 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:03.657 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759128 s, 138 MB/s 2024-04-25T09:03:03.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750904 s, 140 MB/s 2024-04-25T09:03:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672168 s, 156 MB/s 2024-04-25T09:03:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073722 s, 142 MB/s 2024-04-25T09:03:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751189 s, 140 MB/s 2024-04-25T09:03:03.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709614 s, 148 MB/s 2024-04-25T09:03:03.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652989 s, 161 MB/s 2024-04-25T09:03:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631769 s, 166 MB/s 2024-04-25T09:03:03.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845697 s, 124 MB/s 2024-04-25T09:03:03.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708515 s, 148 MB/s 2024-04-25T09:03:03.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629466 s, 167 MB/s 2024-04-25T09:03:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743584 s, 141 MB/s 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074164 s, 141 MB/s 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653962 s, 160 MB/s 2024-04-25T09:03:03.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006361 s, 165 MB/s 2024-04-25T09:03:03.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754908 s, 139 MB/s 2024-04-25T09:03:03.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654214 s, 160 MB/s 2024-04-25T09:03:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655978 s, 160 MB/s 2024-04-25T09:03:03.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715954 s, 146 MB/s 2024-04-25T09:03:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626353 s, 167 MB/s 2024-04-25T09:03:03.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697893 s, 150 MB/s 2024-04-25T09:03:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712287 s, 147 MB/s 2024-04-25T09:03:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766321 s, 137 MB/s 2024-04-25T09:03:03.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754292 s, 139 MB/s 2024-04-25T09:03:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774946 s, 135 MB/s 2024-04-25T09:03:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734529 s, 143 MB/s 2024-04-25T09:03:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686192 s, 153 MB/s 2024-04-25T09:03:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742409 s, 141 MB/s 2024-04-25T09:03:03.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067922 s, 154 MB/s 2024-04-25T09:03:03.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.954 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695162 s, 151 MB/s 2024-04-25T09:03:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676928 s, 155 MB/s 2024-04-25T09:03:03.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:03.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:03.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735383 s, 143 MB/s 2024-04-25T09:03:03.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:03.971 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:03.971 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:03.971 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:03:03.971 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:03.971 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:03.971 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:03.971 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:04.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749368 s, 140 MB/s 2024-04-25T09:03:04.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757324 s, 138 MB/s 2024-04-25T09:03:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739099 s, 142 MB/s 2024-04-25T09:03:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720418 s, 146 MB/s 2024-04-25T09:03:04.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636178 s, 165 MB/s 2024-04-25T09:03:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688621 s, 152 MB/s 2024-04-25T09:03:04.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755766 s, 139 MB/s 2024-04-25T09:03:04.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729038 s, 144 MB/s 2024-04-25T09:03:04.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664029 s, 158 MB/s 2024-04-25T09:03:04.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072492 s, 145 MB/s 2024-04-25T09:03:04.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747921 s, 140 MB/s 2024-04-25T09:03:04.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710607 s, 148 MB/s 2024-04-25T09:03:04.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676107 s, 155 MB/s 2024-04-25T09:03:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728791 s, 144 MB/s 2024-04-25T09:03:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612723 s, 171 MB/s 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839579 s, 125 MB/s 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062671 s, 167 MB/s 2024-04-25T09:03:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716441 s, 146 MB/s 2024-04-25T09:03:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684292 s, 153 MB/s 2024-04-25T09:03:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075022 s, 140 MB/s 2024-04-25T09:03:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763593 s, 137 MB/s 2024-04-25T09:03:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752088 s, 139 MB/s 2024-04-25T09:03:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746006 s, 141 MB/s 2024-04-25T09:03:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689944 s, 152 MB/s 2024-04-25T09:03:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738207 s, 142 MB/s 2024-04-25T09:03:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733264 s, 143 MB/s 2024-04-25T09:03:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710191 s, 148 MB/s 2024-04-25T09:03:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070073 s, 150 MB/s 2024-04-25T09:03:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731001 s, 143 MB/s 2024-04-25T09:03:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652628 s, 161 MB/s 2024-04-25T09:03:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725459 s, 145 MB/s 2024-04-25T09:03:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776404 s, 135 MB/s 2024-04-25T09:03:04.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:04.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:04.287 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:04.288 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:03:04.288 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:04.288 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:04.288 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:04.288 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761483 s, 138 MB/s 2024-04-25T09:03:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075918 s, 138 MB/s 2024-04-25T09:03:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720585 s, 146 MB/s 2024-04-25T09:03:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641534 s, 163 MB/s 2024-04-25T09:03:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725366 s, 145 MB/s 2024-04-25T09:03:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669789 s, 157 MB/s 2024-04-25T09:03:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686812 s, 153 MB/s 2024-04-25T09:03:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725134 s, 145 MB/s 2024-04-25T09:03:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724049 s, 145 MB/s 2024-04-25T09:03:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622023 s, 169 MB/s 2024-04-25T09:03:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731275 s, 143 MB/s 2024-04-25T09:03:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764532 s, 137 MB/s 2024-04-25T09:03:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738004 s, 142 MB/s 2024-04-25T09:03:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723994 s, 145 MB/s 2024-04-25T09:03:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749241 s, 140 MB/s 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730843 s, 143 MB/s 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711702 s, 147 MB/s 2024-04-25T09:03:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720111 s, 146 MB/s 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717738 s, 146 MB/s 2024-04-25T09:03:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694664 s, 151 MB/s 2024-04-25T09:03:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758642 s, 138 MB/s 2024-04-25T09:03:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720057 s, 146 MB/s 2024-04-25T09:03:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711098 s, 147 MB/s 2024-04-25T09:03:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743443 s, 141 MB/s 2024-04-25T09:03:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657171 s, 160 MB/s 2024-04-25T09:03:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084775 s, 124 MB/s 2024-04-25T09:03:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651564 s, 161 MB/s 2024-04-25T09:03:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637462 s, 164 MB/s 2024-04-25T09:03:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733693 s, 143 MB/s 2024-04-25T09:03:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701962 s, 149 MB/s 2024-04-25T09:03:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733435 s, 143 MB/s 2024-04-25T09:03:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738976 s, 142 MB/s 2024-04-25T09:03:04.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:04.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:04.604 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:04.604 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:03:04.604 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:04.604 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:04.605 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:04.605 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737867 s, 142 MB/s 2024-04-25T09:03:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751337 s, 140 MB/s 2024-04-25T09:03:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633119 s, 166 MB/s 2024-04-25T09:03:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754505 s, 139 MB/s 2024-04-25T09:03:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.703 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720145 s, 146 MB/s 2024-04-25T09:03:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718296 s, 146 MB/s 2024-04-25T09:03:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072835 s, 144 MB/s 2024-04-25T09:03:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702532 s, 149 MB/s 2024-04-25T09:03:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646019 s, 162 MB/s 2024-04-25T09:03:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736919 s, 142 MB/s 2024-04-25T09:03:04.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.751 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725595 s, 145 MB/s 2024-04-25T09:03:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724089 s, 145 MB/s 2024-04-25T09:03:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718065 s, 146 MB/s 2024-04-25T09:03:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681542 s, 154 MB/s 2024-04-25T09:03:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717438 s, 146 MB/s 2024-04-25T09:03:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729284 s, 144 MB/s 2024-04-25T09:03:04.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698144 s, 150 MB/s 2024-04-25T09:03:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678418 s, 155 MB/s 2024-04-25T09:03:04.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658805 s, 159 MB/s 2024-04-25T09:03:04.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762699 s, 137 MB/s 2024-04-25T09:03:04.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739104 s, 142 MB/s 2024-04-25T09:03:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737596 s, 142 MB/s 2024-04-25T09:03:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681829 s, 154 MB/s 2024-04-25T09:03:04.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767547 s, 137 MB/s 2024-04-25T09:03:04.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731828 s, 143 MB/s 2024-04-25T09:03:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729026 s, 144 MB/s 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679474 s, 154 MB/s 2024-04-25T09:03:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007465 s, 140 MB/s 2024-04-25T09:03:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074419 s, 141 MB/s 2024-04-25T09:03:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710657 s, 148 MB/s 2024-04-25T09:03:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060949 s, 172 MB/s 2024-04-25T09:03:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711111 s, 147 MB/s 2024-04-25T09:03:04.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:04.920 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:04.920 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:04.921 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:03:04.921 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:04.921 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:04.921 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:04.921 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772695 s, 136 MB/s 2024-04-25T09:03:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676734 s, 155 MB/s 2024-04-25T09:03:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749834 s, 140 MB/s 2024-04-25T09:03:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720307 s, 146 MB/s 2024-04-25T09:03:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719033 s, 146 MB/s 2024-04-25T09:03:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765727 s, 137 MB/s 2024-04-25T09:03:05.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743616 s, 141 MB/s 2024-04-25T09:03:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691409 s, 152 MB/s 2024-04-25T09:03:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717198 s, 146 MB/s 2024-04-25T09:03:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717203 s, 146 MB/s 2024-04-25T09:03:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745451 s, 141 MB/s 2024-04-25T09:03:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073171 s, 143 MB/s 2024-04-25T09:03:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655979 s, 160 MB/s 2024-04-25T09:03:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695803 s, 151 MB/s 2024-04-25T09:03:05.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778947 s, 135 MB/s 2024-04-25T09:03:05.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738244 s, 142 MB/s 2024-04-25T09:03:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734437 s, 143 MB/s 2024-04-25T09:03:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684046 s, 153 MB/s 2024-04-25T09:03:05.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762778 s, 137 MB/s 2024-04-25T09:03:05.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724463 s, 145 MB/s 2024-04-25T09:03:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773721 s, 136 MB/s 2024-04-25T09:03:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684682 s, 153 MB/s 2024-04-25T09:03:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690041 s, 152 MB/s 2024-04-25T09:03:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750395 s, 140 MB/s 2024-04-25T09:03:05.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742949 s, 141 MB/s 2024-04-25T09:03:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730277 s, 144 MB/s 2024-04-25T09:03:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761078 s, 138 MB/s 2024-04-25T09:03:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730338 s, 144 MB/s 2024-04-25T09:03:05.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077443 s, 135 MB/s 2024-04-25T09:03:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725673 s, 144 MB/s 2024-04-25T09:03:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703292 s, 149 MB/s 2024-04-25T09:03:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.241 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712136 s, 147 MB/s 2024-04-25T09:03:05.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:05.242 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:05.242 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:05.242 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:03:05.242 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:05.242 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:05.242 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:05.242 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747186 s, 140 MB/s 2024-04-25T09:03:05.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726879 s, 144 MB/s 2024-04-25T09:03:05.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716711 s, 146 MB/s 2024-04-25T09:03:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732493 s, 143 MB/s 2024-04-25T09:03:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716058 s, 146 MB/s 2024-04-25T09:03:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739192 s, 142 MB/s 2024-04-25T09:03:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749265 s, 140 MB/s 2024-04-25T09:03:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733598 s, 143 MB/s 2024-04-25T09:03:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739407 s, 142 MB/s 2024-04-25T09:03:05.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650144 s, 161 MB/s 2024-04-25T09:03:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753873 s, 139 MB/s 2024-04-25T09:03:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737475 s, 142 MB/s 2024-04-25T09:03:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739346 s, 142 MB/s 2024-04-25T09:03:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719208 s, 146 MB/s 2024-04-25T09:03:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070909 s, 148 MB/s 2024-04-25T09:03:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645813 s, 162 MB/s 2024-04-25T09:03:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694767 s, 151 MB/s 2024-04-25T09:03:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722026 s, 145 MB/s 2024-04-25T09:03:05.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725682 s, 144 MB/s 2024-04-25T09:03:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745442 s, 141 MB/s 2024-04-25T09:03:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718039 s, 146 MB/s 2024-04-25T09:03:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073353 s, 143 MB/s 2024-04-25T09:03:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686152 s, 153 MB/s 2024-04-25T09:03:05.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738637 s, 142 MB/s 2024-04-25T09:03:05.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734358 s, 143 MB/s 2024-04-25T09:03:05.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.510 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742825 s, 141 MB/s 2024-04-25T09:03:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670944 s, 156 MB/s 2024-04-25T09:03:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741073 s, 141 MB/s 2024-04-25T09:03:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869371 s, 121 MB/s 2024-04-25T09:03:05.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727439 s, 144 MB/s 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641785 s, 163 MB/s 2024-04-25T09:03:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718181 s, 146 MB/s 2024-04-25T09:03:05.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:05.560 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:05.560 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:05.560 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:03:05.561 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:05.561 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:05.561 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:05.561 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066751 s, 157 MB/s 2024-04-25T09:03:05.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066283 s, 158 MB/s 2024-04-25T09:03:05.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801789 s, 131 MB/s 2024-04-25T09:03:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741806 s, 141 MB/s 2024-04-25T09:03:05.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696458 s, 151 MB/s 2024-04-25T09:03:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813553 s, 129 MB/s 2024-04-25T09:03:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729175 s, 144 MB/s 2024-04-25T09:03:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734488 s, 143 MB/s 2024-04-25T09:03:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667503 s, 157 MB/s 2024-04-25T09:03:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710966 s, 147 MB/s 2024-04-25T09:03:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700296 s, 150 MB/s 2024-04-25T09:03:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763221 s, 137 MB/s 2024-04-25T09:03:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734406 s, 143 MB/s 2024-04-25T09:03:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745604 s, 141 MB/s 2024-04-25T09:03:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639385 s, 164 MB/s 2024-04-25T09:03:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074908 s, 140 MB/s 2024-04-25T09:03:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740718 s, 142 MB/s 2024-04-25T09:03:05.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705418 s, 149 MB/s 2024-04-25T09:03:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672989 s, 156 MB/s 2024-04-25T09:03:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706755 s, 148 MB/s 2024-04-25T09:03:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741602 s, 141 MB/s 2024-04-25T09:03:05.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.796 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659013 s, 159 MB/s 2024-04-25T09:03:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743548 s, 141 MB/s 2024-04-25T09:03:05.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722882 s, 145 MB/s 2024-04-25T09:03:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825391 s, 127 MB/s 2024-04-25T09:03:05.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737592 s, 142 MB/s 2024-04-25T09:03:05.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669203 s, 157 MB/s 2024-04-25T09:03:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791063 s, 133 MB/s 2024-04-25T09:03:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682616 s, 154 MB/s 2024-04-25T09:03:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734992 s, 143 MB/s 2024-04-25T09:03:05.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681314 s, 154 MB/s 2024-04-25T09:03:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763857 s, 137 MB/s 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:05.880 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:05.880 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:05.880 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:03:05.880 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:05.880 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:05.880 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:05.880 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:05.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751752 s, 139 MB/s 2024-04-25T09:03:05.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681699 s, 154 MB/s 2024-04-25T09:03:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756461 s, 139 MB/s 2024-04-25T09:03:05.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692639 s, 151 MB/s 2024-04-25T09:03:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744788 s, 141 MB/s 2024-04-25T09:03:05.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659401 s, 159 MB/s 2024-04-25T09:03:05.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:05.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:05.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710032 s, 148 MB/s 2024-04-25T09:03:06.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069417 s, 151 MB/s 2024-04-25T09:03:06.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736811 s, 142 MB/s 2024-04-25T09:03:06.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064404 s, 163 MB/s 2024-04-25T09:03:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735303 s, 143 MB/s 2024-04-25T09:03:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642343 s, 163 MB/s 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721008 s, 145 MB/s 2024-04-25T09:03:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725044 s, 145 MB/s 2024-04-25T09:03:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633622 s, 165 MB/s 2024-04-25T09:03:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073791 s, 142 MB/s 2024-04-25T09:03:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719872 s, 146 MB/s 2024-04-25T09:03:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747249 s, 140 MB/s 2024-04-25T09:03:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725314 s, 145 MB/s 2024-04-25T09:03:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659106 s, 159 MB/s 2024-04-25T09:03:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654028 s, 160 MB/s 2024-04-25T09:03:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722166 s, 145 MB/s 2024-04-25T09:03:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750702 s, 140 MB/s 2024-04-25T09:03:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730497 s, 144 MB/s 2024-04-25T09:03:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710866 s, 148 MB/s 2024-04-25T09:03:06.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721973 s, 145 MB/s 2024-04-25T09:03:06.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.153 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751156 s, 140 MB/s 2024-04-25T09:03:06.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068417 s, 153 MB/s 2024-04-25T09:03:06.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738556 s, 142 MB/s 2024-04-25T09:03:06.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733935 s, 143 MB/s 2024-04-25T09:03:06.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808752 s, 130 MB/s 2024-04-25T09:03:06.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007512 s, 140 MB/s 2024-04-25T09:03:06.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:06.195 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:06.196 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:06.196 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:03:06.196 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:06.196 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:06.196 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:06.196 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:06.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728182 s, 144 MB/s 2024-04-25T09:03:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737587 s, 142 MB/s 2024-04-25T09:03:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077867 s, 135 MB/s 2024-04-25T09:03:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734799 s, 143 MB/s 2024-04-25T09:03:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735395 s, 143 MB/s 2024-04-25T09:03:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730809 s, 143 MB/s 2024-04-25T09:03:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748192 s, 140 MB/s 2024-04-25T09:03:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719196 s, 146 MB/s 2024-04-25T09:03:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682132 s, 154 MB/s 2024-04-25T09:03:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733097 s, 143 MB/s 2024-04-25T09:03:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726139 s, 144 MB/s 2024-04-25T09:03:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633799 s, 165 MB/s 2024-04-25T09:03:06.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756569 s, 139 MB/s 2024-04-25T09:03:06.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654004 s, 160 MB/s 2024-04-25T09:03:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728072 s, 144 MB/s 2024-04-25T09:03:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699194 s, 150 MB/s 2024-04-25T09:03:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734408 s, 143 MB/s 2024-04-25T09:03:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761288 s, 138 MB/s 2024-04-25T09:03:06.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726858 s, 144 MB/s 2024-04-25T09:03:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735036 s, 143 MB/s 2024-04-25T09:03:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671418 s, 156 MB/s 2024-04-25T09:03:06.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685716 s, 153 MB/s 2024-04-25T09:03:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690984 s, 152 MB/s 2024-04-25T09:03:06.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774827 s, 135 MB/s 2024-04-25T09:03:06.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704555 s, 149 MB/s 2024-04-25T09:03:06.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719572 s, 146 MB/s 2024-04-25T09:03:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666481 s, 157 MB/s 2024-04-25T09:03:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721072 s, 145 MB/s 2024-04-25T09:03:06.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721239 s, 145 MB/s 2024-04-25T09:03:06.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734399 s, 143 MB/s 2024-04-25T09:03:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690286 s, 152 MB/s 2024-04-25T09:03:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738938 s, 142 MB/s 2024-04-25T09:03:06.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:06.514 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:06.514 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:06.514 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:03:06.514 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:06.514 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:06.514 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:06.514 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740758 s, 142 MB/s 2024-04-25T09:03:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641904 s, 163 MB/s 2024-04-25T09:03:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701606 s, 149 MB/s 2024-04-25T09:03:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699394 s, 150 MB/s 2024-04-25T09:03:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725573 s, 145 MB/s 2024-04-25T09:03:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732964 s, 143 MB/s 2024-04-25T09:03:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711782 s, 147 MB/s 2024-04-25T09:03:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734242 s, 143 MB/s 2024-04-25T09:03:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695092 s, 151 MB/s 2024-04-25T09:03:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687426 s, 153 MB/s 2024-04-25T09:03:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071623 s, 146 MB/s 2024-04-25T09:03:06.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750255 s, 140 MB/s 2024-04-25T09:03:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723296 s, 145 MB/s 2024-04-25T09:03:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745153 s, 141 MB/s 2024-04-25T09:03:06.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.693 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069644 s, 151 MB/s 2024-04-25T09:03:06.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749198 s, 140 MB/s 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728293 s, 144 MB/s 2024-04-25T09:03:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692735 s, 151 MB/s 2024-04-25T09:03:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888641 s, 118 MB/s 2024-04-25T09:03:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734525 s, 143 MB/s 2024-04-25T09:03:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749993 s, 140 MB/s 2024-04-25T09:03:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757904 s, 138 MB/s 2024-04-25T09:03:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760542 s, 138 MB/s 2024-04-25T09:03:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739069 s, 142 MB/s 2024-04-25T09:03:06.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728687 s, 144 MB/s 2024-04-25T09:03:06.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074656 s, 140 MB/s 2024-04-25T09:03:06.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748166 s, 140 MB/s 2024-04-25T09:03:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692225 s, 151 MB/s 2024-04-25T09:03:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073164 s, 143 MB/s 2024-04-25T09:03:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670595 s, 156 MB/s 2024-04-25T09:03:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742743 s, 141 MB/s 2024-04-25T09:03:06.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783119 s, 134 MB/s 2024-04-25T09:03:06.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:06.836 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:06.836 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:06.836 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:03:06.836 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:06.836 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:06.836 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:06.836 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746295 s, 141 MB/s 2024-04-25T09:03:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742207 s, 141 MB/s 2024-04-25T09:03:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710093 s, 148 MB/s 2024-04-25T09:03:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749833 s, 140 MB/s 2024-04-25T09:03:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651205 s, 161 MB/s 2024-04-25T09:03:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754138 s, 139 MB/s 2024-04-25T09:03:06.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718233 s, 146 MB/s 2024-04-25T09:03:06.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739353 s, 142 MB/s 2024-04-25T09:03:06.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727145 s, 144 MB/s 2024-04-25T09:03:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722268 s, 145 MB/s 2024-04-25T09:03:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740118 s, 142 MB/s 2024-04-25T09:03:06.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657932 s, 159 MB/s 2024-04-25T09:03:06.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:06.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:06.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652376 s, 161 MB/s 2024-04-25T09:03:07.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830818 s, 126 MB/s 2024-04-25T09:03:07.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.015 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673903 s, 156 MB/s 2024-04-25T09:03:07.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076285 s, 137 MB/s 2024-04-25T09:03:07.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715126 s, 147 MB/s 2024-04-25T09:03:07.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754229 s, 139 MB/s 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744628 s, 141 MB/s 2024-04-25T09:03:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728515 s, 144 MB/s 2024-04-25T09:03:07.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070591 s, 149 MB/s 2024-04-25T09:03:07.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755532 s, 139 MB/s 2024-04-25T09:03:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702438 s, 149 MB/s 2024-04-25T09:03:07.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745176 s, 141 MB/s 2024-04-25T09:03:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071057 s, 148 MB/s 2024-04-25T09:03:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768134 s, 137 MB/s 2024-04-25T09:03:07.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732247 s, 143 MB/s 2024-04-25T09:03:07.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743559 s, 141 MB/s 2024-04-25T09:03:07.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776212 s, 135 MB/s 2024-04-25T09:03:07.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073259 s, 143 MB/s 2024-04-25T09:03:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681136 s, 154 MB/s 2024-04-25T09:03:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679593 s, 154 MB/s 2024-04-25T09:03:07.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:07.156 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:07.156 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:07.156 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:03:07.156 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:07.156 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:07.156 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:07.156 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650972 s, 161 MB/s 2024-04-25T09:03:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712418 s, 147 MB/s 2024-04-25T09:03:07.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721904 s, 145 MB/s 2024-04-25T09:03:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719954 s, 146 MB/s 2024-04-25T09:03:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707255 s, 148 MB/s 2024-04-25T09:03:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747926 s, 140 MB/s 2024-04-25T09:03:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718131 s, 146 MB/s 2024-04-25T09:03:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830366 s, 126 MB/s 2024-04-25T09:03:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712984 s, 147 MB/s 2024-04-25T09:03:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644931 s, 163 MB/s 2024-04-25T09:03:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764785 s, 137 MB/s 2024-04-25T09:03:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683352 s, 153 MB/s 2024-04-25T09:03:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074096 s, 142 MB/s 2024-04-25T09:03:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743943 s, 141 MB/s 2024-04-25T09:03:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726498 s, 144 MB/s 2024-04-25T09:03:07.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711471 s, 147 MB/s 2024-04-25T09:03:07.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651594 s, 161 MB/s 2024-04-25T09:03:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740746 s, 142 MB/s 2024-04-25T09:03:07.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749501 s, 140 MB/s 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672156 s, 156 MB/s 2024-04-25T09:03:07.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658838 s, 159 MB/s 2024-04-25T09:03:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726742 s, 144 MB/s 2024-04-25T09:03:07.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681469 s, 154 MB/s 2024-04-25T09:03:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685991 s, 153 MB/s 2024-04-25T09:03:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711677 s, 147 MB/s 2024-04-25T09:03:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736063 s, 142 MB/s 2024-04-25T09:03:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725472 s, 145 MB/s 2024-04-25T09:03:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671218 s, 156 MB/s 2024-04-25T09:03:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077934 s, 135 MB/s 2024-04-25T09:03:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723392 s, 145 MB/s 2024-04-25T09:03:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695443 s, 151 MB/s 2024-04-25T09:03:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064265 s, 163 MB/s 2024-04-25T09:03:07.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:07.475 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:07.475 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:07.476 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:03:07.476 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:07.476 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:07.476 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:07.476 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734132 s, 143 MB/s 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651465 s, 161 MB/s 2024-04-25T09:03:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750844 s, 140 MB/s 2024-04-25T09:03:07.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649837 s, 161 MB/s 2024-04-25T09:03:07.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730264 s, 144 MB/s 2024-04-25T09:03:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752189 s, 139 MB/s 2024-04-25T09:03:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649173 s, 162 MB/s 2024-04-25T09:03:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721841 s, 145 MB/s 2024-04-25T09:03:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741237 s, 141 MB/s 2024-04-25T09:03:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639258 s, 164 MB/s 2024-04-25T09:03:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731706 s, 143 MB/s 2024-04-25T09:03:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697445 s, 150 MB/s 2024-04-25T09:03:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706117 s, 148 MB/s 2024-04-25T09:03:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746843 s, 140 MB/s 2024-04-25T09:03:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677536 s, 155 MB/s 2024-04-25T09:03:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745322 s, 141 MB/s 2024-04-25T09:03:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681043 s, 154 MB/s 2024-04-25T09:03:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693503 s, 151 MB/s 2024-04-25T09:03:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742587 s, 141 MB/s 2024-04-25T09:03:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745473 s, 141 MB/s 2024-04-25T09:03:07.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753968 s, 139 MB/s 2024-04-25T09:03:07.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.711 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855382 s, 123 MB/s 2024-04-25T09:03:07.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683672 s, 153 MB/s 2024-04-25T09:03:07.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782344 s, 134 MB/s 2024-04-25T09:03:07.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692742 s, 151 MB/s 2024-04-25T09:03:07.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769138 s, 136 MB/s 2024-04-25T09:03:07.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757472 s, 138 MB/s 2024-04-25T09:03:07.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636312 s, 165 MB/s 2024-04-25T09:03:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737086 s, 142 MB/s 2024-04-25T09:03:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717934 s, 146 MB/s 2024-04-25T09:03:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729586 s, 144 MB/s 2024-04-25T09:03:07.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647985 s, 162 MB/s 2024-04-25T09:03:07.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:07.792 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:07.793 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:07.793 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:03:07.793 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:07.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:07.793 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:07.793 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762516 s, 138 MB/s 2024-04-25T09:03:07.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679597 s, 154 MB/s 2024-04-25T09:03:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632408 s, 166 MB/s 2024-04-25T09:03:07.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702595 s, 149 MB/s 2024-04-25T09:03:07.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730204 s, 144 MB/s 2024-04-25T09:03:07.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752188 s, 139 MB/s 2024-04-25T09:03:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771193 s, 136 MB/s 2024-04-25T09:03:07.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640445 s, 164 MB/s 2024-04-25T09:03:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644932 s, 163 MB/s 2024-04-25T09:03:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757233 s, 138 MB/s 2024-04-25T09:03:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725546 s, 145 MB/s 2024-04-25T09:03:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885983 s, 118 MB/s 2024-04-25T09:03:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732737 s, 143 MB/s 2024-04-25T09:03:07.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.963 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067508 s, 155 MB/s 2024-04-25T09:03:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692566 s, 151 MB/s 2024-04-25T09:03:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642314 s, 163 MB/s 2024-04-25T09:03:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712861 s, 147 MB/s 2024-04-25T09:03:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651569 s, 161 MB/s 2024-04-25T09:03:08.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717301 s, 146 MB/s 2024-04-25T09:03:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656337 s, 160 MB/s 2024-04-25T09:03:08.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696052 s, 151 MB/s 2024-04-25T09:03:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731929 s, 143 MB/s 2024-04-25T09:03:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760476 s, 138 MB/s 2024-04-25T09:03:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733188 s, 143 MB/s 2024-04-25T09:03:08.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686055 s, 153 MB/s 2024-04-25T09:03:08.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676013 s, 155 MB/s 2024-04-25T09:03:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645953 s, 162 MB/s 2024-04-25T09:03:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682496 s, 154 MB/s 2024-04-25T09:03:08.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766614 s, 137 MB/s 2024-04-25T09:03:08.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721855 s, 145 MB/s 2024-04-25T09:03:08.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722718 s, 145 MB/s 2024-04-25T09:03:08.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.107 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816674 s, 128 MB/s 2024-04-25T09:03:08.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:08.108 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:08.108 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:08.108 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:03:08.108 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:08.108 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:08.108 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:08.108 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745448 s, 141 MB/s 2024-04-25T09:03:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757112 s, 138 MB/s 2024-04-25T09:03:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.191 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065584 s, 160 MB/s 2024-04-25T09:03:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736779 s, 142 MB/s 2024-04-25T09:03:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713769 s, 147 MB/s 2024-04-25T09:03:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755062 s, 139 MB/s 2024-04-25T09:03:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716792 s, 146 MB/s 2024-04-25T09:03:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724781 s, 145 MB/s 2024-04-25T09:03:08.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723881 s, 145 MB/s 2024-04-25T09:03:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733605 s, 143 MB/s 2024-04-25T09:03:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725642 s, 145 MB/s 2024-04-25T09:03:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635464 s, 165 MB/s 2024-04-25T09:03:08.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648956 s, 162 MB/s 2024-04-25T09:03:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877546 s, 119 MB/s 2024-04-25T09:03:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650424 s, 161 MB/s 2024-04-25T09:03:08.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675663 s, 155 MB/s 2024-04-25T09:03:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646464 s, 162 MB/s 2024-04-25T09:03:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790345 s, 133 MB/s 2024-04-25T09:03:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721093 s, 145 MB/s 2024-04-25T09:03:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737355 s, 142 MB/s 2024-04-25T09:03:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752663 s, 139 MB/s 2024-04-25T09:03:08.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.344 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709846 s, 148 MB/s 2024-04-25T09:03:08.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734697 s, 143 MB/s 2024-04-25T09:03:08.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732757 s, 143 MB/s 2024-04-25T09:03:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065427 s, 160 MB/s 2024-04-25T09:03:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738119 s, 142 MB/s 2024-04-25T09:03:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633971 s, 165 MB/s 2024-04-25T09:03:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688192 s, 152 MB/s 2024-04-25T09:03:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690049 s, 152 MB/s 2024-04-25T09:03:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731249 s, 143 MB/s 2024-04-25T09:03:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736726 s, 142 MB/s 2024-04-25T09:03:08.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:08.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:08.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738224 s, 142 MB/s 2024-04-25T09:03:08.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:08.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:03:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.581+0000 7ff1ee6c4640 1 Processor -- start 2024-04-25T09:03:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.581+0000 7ff1ee6c4640 1 -- start start 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ee6c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e815dc50 0x7ff1e806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ee6c4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1e8162080 0x7ff1e80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ee6c4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e80b0e80 con 0x7ff1e815e030 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ee6c4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e806be20 con 0x7ff1e8162080 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ee6c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80b1120 con 0x7ff1e815dc50 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1e77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff1e815e030 0x7ff1e8161970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41934/0 (socket says 172.21.15.5:41934) 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1e77fe640 1 -- 172.21.15.5:0/1547192304 learned_addr learned my addr 172.21.15.5:0/1547192304 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/1547192304 >> v2:172.21.15.80:3300/0 conn(0x7ff1e8162080 0x7ff1e80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e815dc50 0x7ff1e806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/1547192304 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219085760 0 0) 0x7ff1e80b0e80 con 0x7ff1e815e030 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/1547192304 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d4003520 con 0x7ff1e815e030 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ecc61640 1 -- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e815dc50 msgr2=0x7ff1e806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e815dc50 0x7ff1e806b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ecc61640 1 -- 172.21.15.5:0/1547192304 >> v1:172.21.15.5:6789/0 conn(0x7ff1e815e030 legacy=0x7ff1e8161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1ecc61640 1 -- 172.21.15.5:0/1547192304 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80b1400 con 0x7ff1e8162080 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.582+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e815dc50 0x7ff1e806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.583+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e8162080 0x7ff1e80b1c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009d90 tx=0x7ff1e002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f852a43a14921f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.583+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/1547192304 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007740 con 0x7ff1e8162080 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.583+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/1547192304 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e00078e0 con 0x7ff1e8162080 2024-04-25T09:03:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.583+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/1547192304 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007c90 con 0x7ff1e8162080 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e8162080 msgr2=0x7ff1e80b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e8162080 0x7ff1e80b1c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009d90 tx=0x7ff1e002a660 comp rx=0 tx=0).stop 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/1547192304 shutdown_connections 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e8162080 0x7ff1e80b1c00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/1547192304 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e815dc50 0x7ff1e806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/1547192304 >> 172.21.15.5:0/1547192304 conn(0x7ff1e80b34a0 msgr2=0x7ff1e80b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/1547192304 shutdown_connections 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.584+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/1547192304 wait complete. 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.585+0000 7ff1ee6c4640 1 Processor -- start 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.585+0000 7ff1ee6c4640 1 -- start start 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1ee6c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e815dc50 0x7ff1e80d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1ee6c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e815e030 0x7ff1e8154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1ee6c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e8162080 0x7ff1e8155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1ee6c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8162530 con 0x7ff1e815dc50 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1ee6c4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e806bb30 con 0x7ff1e815e030 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1ee6c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81626b0 con 0x7ff1e8162080 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e815dc50 0x7ff1e80d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e815dc50 0x7ff1e80d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41998/0 (socket says 172.21.15.5:41998) 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2900918991 learned_addr learned my addr 172.21.15.5:0/2900918991 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e8162080 0x7ff1e8155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e815e030 0x7ff1e8154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e8162080 msgr2=0x7ff1e8155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e8162080 0x7ff1e8155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e815e030 msgr2=0x7ff1e8154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e815e030 0x7ff1e8154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.586+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2900918991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e8160fb0 con 0x7ff1e815dc50 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.587+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e815dc50 0x7ff1e80d1b50 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000ec10 tx=0x7ff1d000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.587+0000 7ff1e4ff9640 1 -- 172.21.15.5:0/2900918991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0017070 con 0x7ff1e815dc50 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.587+0000 7ff1e4ff9640 1 -- 172.21.15.5:0/2900918991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d000cc30 con 0x7ff1e815dc50 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.587+0000 7ff1e4ff9640 1 -- 172.21.15.5:0/2900918991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0013470 con 0x7ff1e815dc50 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.587+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e8161290 con 0x7ff1e815dc50 2024-04-25T09:03:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.587+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e80c5840 con 0x7ff1e815dc50 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.588+0000 7ff1e4ff9640 1 -- 172.21.15.5:0/2900918991 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1d001a070 con 0x7ff1e815dc50 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.589+0000 7ff1e4ff9640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c806b4d0 0x7ff1c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.589+0000 7ff1e4ff9640 1 -- 172.21.15.5:0/2900918991 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1d008a550 con 0x7ff1e815dc50 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.589+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c806b4d0 0x7ff1c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.589+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c806b4d0 0x7ff1c806d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80b7490 tx=0x7ff1d8000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.589+0000 7ff1f13c7740 1 Processor -- start 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1f13c7740 1 -- start start 2024-04-25T09:03:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22c0200 0x5610c22c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22fc8d0 0x5610c22c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22eacc0 0x5610c22eb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c2224000 con 0x5610c22eacc0 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c21ccf20 con 0x5610c22c0200 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610c22200a0 con 0x5610c22fc8d0 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1ecc61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22eacc0 0x5610c22eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22c0200 0x5610c22c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22c0200 0x5610c22c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:53278/0 (socket says 172.21.15.5:53278) 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1ecc61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22eacc0 0x5610c22eb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42004/0 (socket says 172.21.15.5:42004) 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1e7fff640 1 -- 172.21.15.5:0/775661552 learned_addr learned my addr 172.21.15.5:0/775661552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.590+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22fc8d0 0x5610c22c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1e7fff640 1 -- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22fc8d0 msgr2=0x5610c22c05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22fc8d0 0x5610c22c05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1e7fff640 1 -- 172.21.15.5:0/775661552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22eacc0 msgr2=0x5610c22eb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22eacc0 0x5610c22eb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1e7fff640 1 -- 172.21.15.5:0/775661552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c2004ba0 con 0x5610c22c0200 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22eacc0 0x5610c22eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22c0200 0x5610c22c2360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0088920 tx=0x7ff1d0058c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cde9402fe1488194 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1ddffb640 1 -- 172.21.15.5:0/775661552 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0021040 con 0x5610c22c0200 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1ddffb640 1 -- 172.21.15.5:0/775661552 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0061340 con 0x5610c22c0200 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1ddffb640 1 -- 172.21.15.5:0/775661552 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00552c0 con 0x5610c22c0200 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 -- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22c0200 msgr2=0x5610c22c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22c0200 0x5610c22c2360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0088920 tx=0x7ff1d0058c50 comp rx=0 tx=0).stop 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 -- 172.21.15.5:0/775661552 shutdown_connections 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22eacc0 0x5610c22eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22fc8d0 0x5610c22c05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/775661552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22c0200 0x5610c22c2360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 -- 172.21.15.5:0/775661552 >> 172.21.15.5:0/775661552 conn(0x5610c2288050 msgr2=0x5610c2305cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.591+0000 7ff1f13c7740 1 -- 172.21.15.5:0/775661552 shutdown_connections 2024-04-25T09:03:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.592+0000 7ff1f13c7740 1 -- 172.21.15.5:0/775661552 wait complete. 2024-04-25T09:03:08.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.592+0000 7ff1f13c7740 1 -- start start 2024-04-25T09:03:08.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.592+0000 7ff1f13c7740 1 Processor -- start 2024-04-25T09:03:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22dc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22eacc0 0x5610c22ed130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22fc8d0 0x5610c22ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c21c2610 con 0x5610c22c0200 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c22e8810 con 0x5610c22fc8d0 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610c22fed30 con 0x5610c22eacc0 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1f13c7740 10 client.0 _ll_register_callbacks cb 0x5610c21daf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22dc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22dc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42018/0 (socket says 172.21.15.5:42018) 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2962727696 learned_addr learned my addr 172.21.15.5:0/2962727696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22fc8d0 0x5610c22ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22eacc0 msgr2=0x5610c22ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22eacc0 0x5610c22ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22fc8d0 msgr2=0x5610c22ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22fc8d0 0x5610c22ffb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 -- 172.21.15.5:0/2962727696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610c1ef8490 con 0x5610c22c0200 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22dc500 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00550b0 tx=0x7ff1d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793b5852695b83f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.593+0000 7ff1c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/2962727696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0021040 con 0x5610c22c0200 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/2962727696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1d008a0c0 con 0x5610c22c0200 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1d0061340 con 0x5610c22c0200 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/2962727696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1d008a2c0 con 0x5610c22c0200 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 10 client.7695 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5610c2065330 con 0x5610c22c0200 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/2962727696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0061340 con 0x5610c22c0200 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/2962727696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff1d00580a0 con 0x5610c22c0200 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 10 client.7695 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 10 client.7695 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 20 client.7695 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22e7a40 0x5610c2318db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 4 client.7695 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610c2231540 con 0x5610c22e7a40 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.594+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22e7a40 0x5610c2318db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22e7a40 0x5610c2318db0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c4c4c77b931ee8e server_cookie=7b2a69a74e550780 in_seq=0 out_seq=0 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1c6ffd640 10 client.7695 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/2962727696 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5610c2231540 con 0x5610c22e7a40 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1c6ffd640 10 client.7695 handle_command_reply: tid=0 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 client.7695 shutdown 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 msgr2=0x5610c22dc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22dc500 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00550b0 tx=0x7ff1d0000bc0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 shutdown_connections 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22e7a40 0x5610c2318db0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22fc8d0 0x5610c22ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c22eacc0 0x5610c22ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1c6ffd640 0 client.7695 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2962727696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22dc500 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.595+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 >> 172.21.15.5:0/2962727696 conn(0x5610c2288050 msgr2=0x5610c22e7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.596+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 shutdown_connections 2024-04-25T09:03:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.596+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2962727696 wait complete. 2024-04-25T09:03:08.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.596+0000 7ff1f13c7740 20 client.7695 trim_cache size 0 max 16384 2024-04-25T09:03:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 Processor -- start 2024-04-25T09:03:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 -- start start 2024-04-25T09:03:08.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c23282d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c2300820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c23143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81fffd0 con 0x5610c22c0200 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81ff150 con 0x5610c22eacc0 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.611+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e815f220 con 0x5610c2288050 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c2300820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c2300820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42032/0 (socket says 172.21.15.5:42032) 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 -- 172.21.15.5:0/2100558183 learned_addr learned my addr 172.21.15.5:0/2100558183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c23143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c23282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 -- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 msgr2=0x5610c23282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c23282d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 -- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 msgr2=0x5610c23143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c23143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 -- 172.21.15.5:0/2100558183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c1ed1610 con 0x5610c22c0200 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c23143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c2300820 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80cf510 tx=0x7ff1d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dafaeaabb5e0ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1dd7fa640 1 -- 172.21.15.5:0/2100558183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8029070 con 0x5610c22c0200 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1dd7fa640 1 -- 172.21.15.5:0/2100558183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d801b040 con 0x5610c22c0200 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.612+0000 7ff1dd7fa640 1 -- 172.21.15.5:0/2100558183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8015c10 con 0x5610c22c0200 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2100558183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 msgr2=0x5610c2300820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c2300820 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80cf510 tx=0x7ff1d8000ed0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2100558183 shutdown_connections 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c23143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c2300820 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/2100558183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c23282d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2100558183 >> 172.21.15.5:0/2100558183 conn(0x5610c2308c50 msgr2=0x5610c2317780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2100558183 shutdown_connections 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 -- 172.21.15.5:0/2100558183 wait complete. 2024-04-25T09:03:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.613+0000 7ff1f13c7740 1 -- start start 2024-04-25T09:03:08.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 1 Processor -- start 2024-04-25T09:03:08.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c2367c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c2305720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c22c28f0 con 0x5610c22c0200 2024-04-25T09:03:08.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81feb50 con 0x5610c22eacc0 2024-04-25T09:03:08.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610c22b70d0 con 0x5610c2288050 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1f13c7740 10 client.0 _ll_register_callbacks cb 0x7ff1d40036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22e6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42040/0 (socket says 172.21.15.5:42040) 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1e77fe640 1 -- 172.21.15.5:0/737596264 learned_addr learned my addr 172.21.15.5:0/737596264 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1ecc61640 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c2305720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.614+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c2367c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1e77fe640 1 -- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 msgr2=0x5610c2367c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c2367c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1e77fe640 1 -- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 msgr2=0x5610c2305720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c2305720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1e77fe640 1 -- 172.21.15.5:0/737596264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610c22ea070 con 0x5610c22c0200 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22e6ad0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80016c0 tx=0x7ff1d80010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4362059ca427d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:08.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/737596264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8029050 con 0x5610c22c0200 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/737596264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1d8038ab0 con 0x5610c22c0200 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1d801b040 con 0x5610c22c0200 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/737596264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1d8007d80 con 0x5610c22c0200 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 10 client.7701 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5610c22dab50 con 0x5610c22c0200 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/737596264 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d801b040 con 0x5610c22c0200 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/737596264 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff1d8020040 con 0x5610c22c0200 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 10 client.7701 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 10 client.7701 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 20 client.7701 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22fc8d0 0x5610c22fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 4 client.7701 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.615+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x5610c222b890 con 0x5610c22fc8d0 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.616+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22fc8d0 0x5610c22fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.616+0000 7ff1c6ffd640 10 client.7701 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.616+0000 7ff1e7fff640 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22fc8d0 0x5610c22fbb70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3526e4c24481ecf server_cookie=4b88554c991021b0 in_seq=0 out_seq=0 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1c6ffd640 1 -- 172.21.15.5:0/737596264 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5610c222b890 con 0x5610c22fc8d0 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1c6ffd640 10 client.7701 handle_command_reply: tid=0 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 client.7701 shutdown 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 msgr2=0x5610c22e6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22e6ad0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80016c0 tx=0x7ff1d80010a0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 shutdown_connections 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5610c22fc8d0 0x5610c22fbb70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610c22eacc0 0x5610c2305720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610c22c0200 0x5610c22e6ad0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1c6ffd640 0 client.7701 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 --2- 172.21.15.5:0/737596264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5610c2288050 0x5610c2367c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.618+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 >> 172.21.15.5:0/737596264 conn(0x5610c2308c50 msgr2=0x5610c22e7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 shutdown_connections 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1f13c7740 1 -- 172.21.15.5:0/737596264 wait complete. 2024-04-25T09:03:08.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1f13c7740 20 client.7701 trim_cache size 0 max 16384 2024-04-25T09:03:08.612 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T09:03:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "e51546d8-0f19-4124-8d5d-48238f2c3550", 2024-04-25T09:03:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T09:03:08.612 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:08.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c806b4d0 msgr2=0x7ff1c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c806b4d0 0x7ff1c806d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80b7490 tx=0x7ff1d8000bc0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e815dc50 msgr2=0x7ff1e80d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e815dc50 0x7ff1e80d1b50 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000ec10 tx=0x7ff1d000c520 comp rx=0 tx=0).stop 2024-04-25T09:03:08.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 shutdown_connections 2024-04-25T09:03:08.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff1c806b4d0 0x7ff1c806d990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff1e8162080 0x7ff1e8155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e815e030 0x7ff1e8154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 --2- 172.21.15.5:0/2900918991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e815dc50 0x7ff1e80d1b50 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 >> 172.21.15.5:0/2900918991 conn(0x7ff1e80b34a0 msgr2=0x7ff1e80ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 shutdown_connections 2024-04-25T09:03:08.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.619+0000 7ff1ee6c4640 1 -- 172.21.15.5:0/2900918991 wait complete. 2024-04-25T09:03:08.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:08.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub abort 2024-04-25T09:03:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.744+0000 7f2b94efc640 1 Processor -- start 2024-04-25T09:03:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.744+0000 7f2b94efc640 1 -- start start 2024-04-25T09:03:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b94efc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b9015e0b0 0x7f2b9006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b94efc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b900d27f0 con 0x7f2b900d0c80 2024-04-25T09:03:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b94efc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b900cfee0 con 0x7f2b900cc780 2024-04-25T09:03:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b94efc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b900d01c0 con 0x7f2b9015e0b0 2024-04-25T09:03:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b8e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b9015e0b0 0x7f2b9006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b8e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b9015e0b0 0x7f2b9006adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42044/0 (socket says 172.21.15.5:42044) 2024-04-25T09:03:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b87fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b900d0c80 0x7f2b900cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41942/0 (socket says 172.21.15.5:41942) 2024-04-25T09:03:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2610226190 learned_addr learned my addr 172.21.15.5:0/2610226190 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2610226190 >> v1:172.21.15.80:6789/0 conn(0x7f2b900cc780 legacy=0x7f2b900ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2610226190 >> v1:172.21.15.5:6789/0 conn(0x7f2b900d0c80 legacy=0x7f2b900cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.745+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2610226190 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b900d04a0 con 0x7f2b9015e0b0 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.746+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/2610226190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b9006adf0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f2b800098a0 tx=0x7f2b8002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af149e65290638f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.746+0000 7f2b8dd9b640 1 -- 172.21.15.5:0/2610226190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80037070 con 0x7f2b9015e0b0 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.746+0000 7f2b8dd9b640 1 -- 172.21.15.5:0/2610226190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80032640 con 0x7f2b9015e0b0 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.746+0000 7f2b8dd9b640 1 -- 172.21.15.5:0/2610226190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80032a10 con 0x7f2b9015e0b0 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.746+0000 7f2b94efc640 1 -- 172.21.15.5:0/2610226190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 msgr2=0x7f2b9006adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.746+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2610226190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b9006adf0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f2b800098a0 tx=0x7f2b8002a320 comp rx=0 tx=0).stop 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.747+0000 7f2b94efc640 1 -- 172.21.15.5:0/2610226190 shutdown_connections 2024-04-25T09:03:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.747+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2610226190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b9006adf0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.747+0000 7f2b94efc640 1 -- 172.21.15.5:0/2610226190 >> 172.21.15.5:0/2610226190 conn(0x7f2b900d1a20 msgr2=0x7f2b900d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.747+0000 7f2b94efc640 1 -- 172.21.15.5:0/2610226190 shutdown_connections 2024-04-25T09:03:08.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.747+0000 7f2b94efc640 1 -- 172.21.15.5:0/2610226190 wait complete. 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.748+0000 7f2b94efc640 1 Processor -- start 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.748+0000 7f2b94efc640 1 -- start start 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b900cc780 0x7f2b9015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b900d0c80 0x7f2b90159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b900c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900cfb90 con 0x7f2b9015e0b0 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9015e490 con 0x7f2b900cc780 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900ccc30 con 0x7f2b900d0c80 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b900c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b900c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42048/0 (socket says 172.21.15.5:42048) 2024-04-25T09:03:08.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 -- 172.21.15.5:0/2212011360 learned_addr learned my addr 172.21.15.5:0/2212011360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b900cc780 0x7f2b9015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b87fff640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b900d0c80 0x7f2b90159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 -- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b900d0c80 msgr2=0x7f2b90159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b900d0c80 0x7f2b90159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 -- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b900cc780 msgr2=0x7f2b9015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b900cc780 0x7f2b9015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 -- 172.21.15.5:0/2212011360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9015ebf0 con 0x7f2b9015e0b0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b900c7fc0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c7a0 tx=0x7f2b8800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b86ffd640 1 -- 172.21.15.5:0/2212011360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88003b70 con 0x7f2b9015e0b0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b86ffd640 1 -- 172.21.15.5:0/2212011360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88003d30 con 0x7f2b9015e0b0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9015eed0 con 0x7f2b9015e0b0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b86ffd640 1 -- 172.21.15.5:0/2212011360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800aa90 con 0x7f2b9015e0b0 2024-04-25T09:03:08.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.749+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9015f490 con 0x7f2b9015e0b0 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.751+0000 7f2b86ffd640 1 -- 172.21.15.5:0/2212011360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b8800ac30 con 0x7f2b9015e0b0 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.751+0000 7f2b86ffd640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b7006b4d0 0x7f2b7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.751+0000 7f2b86ffd640 1 -- 172.21.15.5:0/2212011360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b8808a000 con 0x7f2b9015e0b0 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.751+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b7006b4d0 0x7f2b7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.752+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b7006b4d0 0x7f2b7006d990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2b80034000 tx=0x7f2b8002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.752+0000 7f2b97c01740 1 Processor -- start 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.752+0000 7f2b97c01740 1 -- start start 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad01e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad00080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b97c01740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e30ac62b90 con 0x55e30acffca0 2024-04-25T09:03:08.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e30ac0be40 con 0x55e30ad2a760 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e30ac5ec30 con 0x55e30ad3c370 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad01e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad01e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42056/0 (socket says 172.21.15.5:42056) 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b8e59c640 1 -- 172.21.15.5:0/3570802854 learned_addr learned my addr 172.21.15.5:0/3570802854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b8ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.753+0000 7f2b87fff640 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad00080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b8ed9d640 1 -- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 msgr2=0x55e30ad00080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad00080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b8ed9d640 1 -- 172.21.15.5:0/3570802854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 msgr2=0x55e30ad01e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad01e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b8ed9d640 1 -- 172.21.15.5:0/3570802854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e30aa417d0 con 0x55e30ad2a760 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad01e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b87fff640 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad00080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2abe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b88088500 tx=0x7f2b88011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3141aa64d72da605 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b6ffff640 1 -- 172.21.15.5:0/3570802854 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8805c8d0 con 0x55e30ad2a760 2024-04-25T09:03:08.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b6ffff640 1 -- 172.21.15.5:0/3570802854 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88060e90 con 0x55e30ad2a760 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b6ffff640 1 -- 172.21.15.5:0/3570802854 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880701d0 con 0x55e30ad2a760 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b97c01740 1 -- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 msgr2=0x55e30ad2abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.754+0000 7f2b97c01740 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2abe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b88088500 tx=0x7f2b88011000 comp rx=0 tx=0).stop 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 -- 172.21.15.5:0/3570802854 shutdown_connections 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2abe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad00080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 --2- 172.21.15.5:0/3570802854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad01e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 -- 172.21.15.5:0/3570802854 >> 172.21.15.5:0/3570802854 conn(0x55e30acc7870 msgr2=0x55e30ad45760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 -- 172.21.15.5:0/3570802854 shutdown_connections 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 -- 172.21.15.5:0/3570802854 wait complete. 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 -- start start 2024-04-25T09:03:08.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.755+0000 7f2b97c01740 1 Processor -- start 2024-04-25T09:03:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30acffca0 0x55e30ad2df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30ad2a760 0x55e30ad2bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad3c370 0x55e30ad2c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b97c01740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e30ac1f3e0 con 0x55e30ad2a760 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e30ad282b0 con 0x55e30ad3c370 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e30ad186f0 con 0x55e30acffca0 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b97c01740 10 client.0 _ll_register_callbacks cb 0x55e30ac1edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30ad2a760 0x55e30ad2bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30ad2a760 0x55e30ad2bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42060/0 (socket says 172.21.15.5:42060) 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b87fff640 1 -- 172.21.15.5:0/1936877872 learned_addr learned my addr 172.21.15.5:0/1936877872 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.756+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad3c370 0x55e30ad2c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30acffca0 0x55e30ad2df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b87fff640 1 -- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30acffca0 msgr2=0x55e30ad2df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30acffca0 0x55e30ad2df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b87fff640 1 -- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad3c370 msgr2=0x55e30ad2c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad3c370 0x55e30ad2c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b87fff640 1 -- 172.21.15.5:0/1936877872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e30a9370f0 con 0x55e30ad2a760 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30ad2a760 0x55e30ad2bfc0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000f60 tx=0x7f2b78001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d19757f7098ca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1936877872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780145b0 con 0x55e30ad2a760 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1936877872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b7800c780 con 0x55e30ad2a760 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b88060e90 con 0x55e30ad2a760 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1936877872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b7800c980 con 0x55e30ad2a760 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b97c01740 10 client.7716 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e30aaa1f60 con 0x55e30ad2a760 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1936877872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88060e90 con 0x55e30ad2a760 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.757+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1936877872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b7800cb20 con 0x55e30ad2a760 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b97c01740 10 client.7716 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b97c01740 10 client.7716 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b97c01740 20 client.7716 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad1a3a0 0x55e30ad17c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b97c01740 4 client.7716 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e30ac700d0 con 0x55e30ad1a3a0 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad1a3a0 0x55e30ad17c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad1a3a0 0x55e30ad17c50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c824e662bc925dc2 server_cookie=f2d9fbb5bed4afda in_seq=0 out_seq=0 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.758+0000 7f2b6d7fa640 10 client.7716 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1936877872 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e30ac700d0 con 0x55e30ad1a3a0 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b6d7fa640 10 client.7716 handle_command_reply: tid=0 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 client.7716 shutdown 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30ad2a760 msgr2=0x55e30ad2bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30ad2a760 0x55e30ad2bfc0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000f60 tx=0x7f2b78001680 comp rx=0 tx=0).stop 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 shutdown_connections 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad1a3a0 0x55e30ad17c50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad3c370 0x55e30ad2c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b6d7fa640 0 client.7716 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30ad2a760 0x55e30ad2bfc0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1936877872 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30acffca0 0x55e30ad2df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 >> 172.21.15.5:0/1936877872 conn(0x55e30acc7870 msgr2=0x55e30ad25860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 shutdown_connections 2024-04-25T09:03:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 1 -- 172.21.15.5:0/1936877872 wait complete. 2024-04-25T09:03:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.759+0000 7f2b97c01740 20 client.7716 trim_cache size 0 max 16384 2024-04-25T09:03:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 Processor -- start 2024-04-25T09:03:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 -- start start 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad5f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30adaa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b902000d0 con 0x55e30acffca0 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c6a20 con 0x55e30ad2a760 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c9700 con 0x55e30ad3c370 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad5f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad5f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42070/0 (socket says 172.21.15.5:42070) 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.774+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2032627242 learned_addr learned my addr 172.21.15.5:0/2032627242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b87fff640 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30adaa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 msgr2=0x55e30adaa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30adaa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 msgr2=0x55e30ad2c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b8e59c640 1 -- 172.21.15.5:0/2032627242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e30a9101b0 con 0x55e30acffca0 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad5f6e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2b80035040 tx=0x7f2b8002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482aaaa131a70629 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b6f7fe640 1 -- 172.21.15.5:0/2032627242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80037040 con 0x55e30acffca0 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b6f7fe640 1 -- 172.21.15.5:0/2032627242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8003c640 con 0x55e30acffca0 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.775+0000 7f2b6f7fe640 1 -- 172.21.15.5:0/2032627242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8003c9f0 con 0x55e30acffca0 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 -- 172.21.15.5:0/2032627242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 msgr2=0x55e30ad5f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad5f6e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2b80035040 tx=0x7f2b8002c000 comp rx=0 tx=0).stop 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 -- 172.21.15.5:0/2032627242 shutdown_connections 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30adaa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad2c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 --2- 172.21.15.5:0/2032627242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad5f6e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 -- 172.21.15.5:0/2032627242 >> 172.21.15.5:0/2032627242 conn(0x55e30acc7870 msgr2=0x55e30ad3e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 -- 172.21.15.5:0/2032627242 shutdown_connections 2024-04-25T09:03:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 -- 172.21.15.5:0/2032627242 wait complete. 2024-04-25T09:03:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 -- start start 2024-04-25T09:03:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.776+0000 7f2b97c01740 1 Processor -- start 2024-04-25T09:03:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad993a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad54fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b97c01740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad57800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b97c01740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e30ad005a0 con 0x55e30acffca0 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c6420 con 0x55e30ad2a760 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b97c01740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e30ad184f0 con 0x55e30ad3c370 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b97c01740 10 client.0 _ll_register_callbacks cb 0x7f2b78007310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42080/0 (socket says 172.21.15.5:42080) 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 -- 172.21.15.5:0/1727810629 learned_addr learned my addr 172.21.15.5:0/1727810629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad54fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8ed9d640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad57800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 -- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 msgr2=0x55e30ad57800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad57800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 -- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 msgr2=0x55e30ad54fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad54fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b8e59c640 1 -- 172.21.15.5:0/1727810629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e30ad3b4d0 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.777+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad54fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b8e59c640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad993a0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f2b80032aa0 tx=0x7f2b80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86002bced2a4bf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1727810629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80062060 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1727810629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b8003c9f0 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b8003c640 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1727810629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b80037040 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 10 client.7722 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e30ad18b80 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1727810629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8003c640 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1727810629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b8003cbf0 con 0x55e30acffca0 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 10 client.7722 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 10 client.7722 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 20 client.7722 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad57d40 0x55e30ad474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 4 client.7722 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x55e30ad00fc0 con 0x55e30ad57d40 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.778+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad57d40 0x55e30ad474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b87fff640 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad57d40 0x55e30ad474a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f36caed2fae44dd2 server_cookie=a70d453c14466ff in_seq=0 out_seq=0 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b6d7fa640 10 client.7722 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b6d7fa640 1 -- 172.21.15.5:0/1727810629 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55e30ad00fc0 con 0x55e30ad57d40 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b6d7fa640 10 client.7722 handle_command_reply: tid=0 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 client.7722 shutdown 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 msgr2=0x55e30ad993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad993a0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f2b80032aa0 tx=0x7f2b80004730 comp rx=0 tx=0).stop 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 shutdown_connections 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55e30ad57d40 0x55e30ad474a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e30ad3c370 0x55e30ad57800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b6d7fa640 0 client.7722 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e30ad2a760 0x55e30ad54fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 --2- 172.21.15.5:0/1727810629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e30acffca0 0x55e30ad993a0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 >> 172.21.15.5:0/1727810629 conn(0x55e30acc7870 msgr2=0x55e30ad3e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 shutdown_connections 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 1 -- 172.21.15.5:0/1727810629 wait complete. 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.779+0000 7f2b97c01740 20 client.7722 trim_cache size 0 max 16384 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T09:03:08.774 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b7006b4d0 msgr2=0x7f2b7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b7006b4d0 0x7f2b7006d990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2b80034000 tx=0x7f2b8002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 msgr2=0x7f2b900c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b900c7fc0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c7a0 tx=0x7f2b8800cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 shutdown_connections 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2b7006b4d0 0x7f2b7006d990 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b9015e0b0 0x7f2b900c7fc0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2b900d0c80 0x7f2b90159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 --2- 172.21.15.5:0/2212011360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b900cc780 0x7f2b9015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 >> 172.21.15.5:0/2212011360 conn(0x7f2b900d1a20 msgr2=0x7f2b9006e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 shutdown_connections 2024-04-25T09:03:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.780+0000 7f2b94efc640 1 -- 172.21.15.5:0/2212011360 wait complete. 2024-04-25T09:03:08.779 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:03:08.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:03:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.893+0000 7fc2e8815640 1 Processor -- start 2024-04-25T09:03:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.893+0000 7fc2e8815640 1 -- start start 2024-04-25T09:03:08.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e8815640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e8815640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2e40d4230 0x7fc2e40b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e8815640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40d2740 con 0x7fc2e40d1f60 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e8815640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40d2a20 con 0x7fc2e40d4230 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e8815640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40d2d00 con 0x7fc2e41614b0 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2e40d4230 0x7fc2e40b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e1d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2e40d1f60 0x7fc2e40d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41958/0 (socket says 172.21.15.5:41958) 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/3903536330 learned_addr learned my addr 172.21.15.5:0/3903536330 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.894+0000 7fc2e259c640 1 --2- 172.21.15.5:0/3903536330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e2d9d640 1 -- 172.21.15.5:0/3903536330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 msgr2=0x7fc2e40b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/3903536330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e2d9d640 1 -- 172.21.15.5:0/3903536330 >> v1:172.21.15.5:6789/0 conn(0x7fc2e40d1f60 legacy=0x7fc2e40d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e2d9d640 1 -- 172.21.15.5:0/3903536330 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40d2fe0 con 0x7fc2e40d4230 2024-04-25T09:03:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e159a640 1 -- 172.21.15.5:0/3903536330 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523053213 0 0) 0x7fc2e40d2740 con 0x7fc2e40d1f60 2024-04-25T09:03:08.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/3903536330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d4230 0x7fc2e40b6cc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0097a0 tx=0x7fc2dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8d63990eea667 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e159a640 1 -- 172.21.15.5:0/3903536330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc037070 con 0x7fc2e40d4230 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e159a640 1 -- 172.21.15.5:0/3903536330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc032440 con 0x7fc2e40d4230 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.895+0000 7fc2e159a640 1 -- 172.21.15.5:0/3903536330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc032810 con 0x7fc2e40d4230 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 -- 172.21.15.5:0/3903536330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d4230 msgr2=0x7fc2e40b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 --2- 172.21.15.5:0/3903536330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d4230 0x7fc2e40b6cc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0097a0 tx=0x7fc2dc02a180 comp rx=0 tx=0).stop 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 -- 172.21.15.5:0/3903536330 shutdown_connections 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 --2- 172.21.15.5:0/3903536330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d4230 0x7fc2e40b6cc0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 --2- 172.21.15.5:0/3903536330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 -- 172.21.15.5:0/3903536330 >> 172.21.15.5:0/3903536330 conn(0x7fc2e406b000 msgr2=0x7fc2e406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 -- 172.21.15.5:0/3903536330 shutdown_connections 2024-04-25T09:03:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.896+0000 7fc2e8815640 1 -- 172.21.15.5:0/3903536330 wait complete. 2024-04-25T09:03:08.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.897+0000 7fc2e8815640 1 Processor -- start 2024-04-25T09:03:08.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.897+0000 7fc2e8815640 1 -- start start 2024-04-25T09:03:08.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e8815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d1f60 0x7fc2e40b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e8815640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2e40d4230 0x7fc2e40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e8815640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e8815640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40d23a0 con 0x7fc2e40d1f60 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e8815640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40d37e0 con 0x7fc2e40d4230 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e8815640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40d2520 con 0x7fc2e41614b0 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d1f60 0x7fc2e40b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d1f60 0x7fc2e40b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42100/0 (socket says 172.21.15.5:42100) 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e259c640 1 -- 172.21.15.5:0/86823393 learned_addr learned my addr 172.21.15.5:0/86823393 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2e40d4230 0x7fc2e40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.898+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e259c640 1 -- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 msgr2=0x7fc2e40cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e259c640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e259c640 1 -- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2e40d4230 msgr2=0x7fc2e40cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e259c640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2e40d4230 0x7fc2e40cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e259c640 1 -- 172.21.15.5:0/86823393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e414a870 con 0x7fc2e40d1f60 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2e40d4230 0x7fc2e40cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e259c640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d1f60 0x7fc2e40b3cb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009d10 tx=0x7fc2d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2d2ffd640 1 -- 172.21.15.5:0/86823393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4018020 con 0x7fc2e40d1f60 2024-04-25T09:03:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2d2ffd640 1 -- 172.21.15.5:0/86823393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d4014480 con 0x7fc2e40d1f60 2024-04-25T09:03:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e40cc890 con 0x7fc2e40d1f60 2024-04-25T09:03:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2d2ffd640 1 -- 172.21.15.5:0/86823393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4014830 con 0x7fc2e40d1f60 2024-04-25T09:03:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.899+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40cce50 con 0x7fc2e40d1f60 2024-04-25T09:03:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.900+0000 7fc2d2ffd640 1 -- 172.21.15.5:0/86823393 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc2d4005d10 con 0x7fc2e40d1f60 2024-04-25T09:03:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.901+0000 7fc2d2ffd640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2c406b500 0x7fc2c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.901+0000 7fc2d2ffd640 1 -- 172.21.15.5:0/86823393 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2d408acb0 con 0x7fc2e40d1f60 2024-04-25T09:03:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.901+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2c406b500 0x7fc2c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.902+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2c406b500 0x7fc2c406d9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc2e41544b0 tx=0x7fc2d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.902+0000 7fc2eb5fb740 1 Processor -- start 2024-04-25T09:03:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.902+0000 7fc2eb5fb740 1 -- start start 2024-04-25T09:03:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabb10 0x55ec08cae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabef0 0x55ec08cae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08c7e770 0x55ec08c81f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec08be7da0 con 0x55ec08cabb10 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec08b90b80 con 0x55ec08cabef0 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec08be3e40 con 0x55ec08c7e770 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabb10 0x55ec08cae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabb10 0x55ec08cae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42112/0 (socket says 172.21.15.5:42112) 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 -- 172.21.15.5:0/3910394661 learned_addr learned my addr 172.21.15.5:0/3910394661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabef0 0x55ec08cae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08c7e770 0x55ec08c81f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 -- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08c7e770 msgr2=0x55ec08c81f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08c7e770 0x55ec08c81f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 -- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabef0 msgr2=0x55ec08cae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabef0 0x55ec08cae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 -- 172.21.15.5:0/3910394661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec08b9af10 con 0x55ec08cabb10 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2e259c640 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabb10 0x55ec08cae320 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4061570 tx=0x7fc2d4059390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b9bffd9ef090bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3910394661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4087070 con 0x55ec08cabb10 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3910394661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d4061aa0 con 0x55ec08cabb10 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.903+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3910394661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d405d160 con 0x55ec08cabb10 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3910394661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabb10 msgr2=0x55ec08cae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabb10 0x55ec08cae320 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4061570 tx=0x7fc2d4059390 comp rx=0 tx=0).stop 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3910394661 shutdown_connections 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08c7e770 0x55ec08c81f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabef0 0x55ec08cae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3910394661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabb10 0x55ec08cae320 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3910394661 >> 172.21.15.5:0/3910394661 conn(0x55ec08c809e0 msgr2=0x55ec08cc9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3910394661 shutdown_connections 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.904+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3910394661 wait complete. 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.905+0000 7fc2eb5fb740 1 -- start start 2024-04-25T09:03:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.905+0000 7fc2eb5fb740 1 Processor -- start 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cabb10 0x55ec08ccb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cc4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08ca3280 0x55ec08caf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec08c83b90 con 0x55ec08cabef0 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec08b864b0 con 0x55ec08ca3280 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec08c83e70 con 0x55ec08cabb10 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 10 client.0 _ll_register_callbacks cb 0x55ec08bc6180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cc4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cc4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42124/0 (socket says 172.21.15.5:42124) 2024-04-25T09:03:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/860202278 learned_addr learned my addr 172.21.15.5:0/860202278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08ca3280 0x55ec08caf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e259c640 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cabb10 0x55ec08ccb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cabb10 msgr2=0x55ec08ccb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cabb10 0x55ec08ccb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08ca3280 msgr2=0x55ec08caf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08ca3280 0x55ec08caf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/860202278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec089c67d0 con 0x55ec08cabef0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cc4af0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8000f60 tx=0x7fc2d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de60e8c2df2285f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2c17fa640 1 -- 172.21.15.5:0/860202278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8027060 con 0x55ec08cabef0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2c17fa640 1 -- 172.21.15.5:0/860202278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2d8010040 con 0x55ec08cabef0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.906+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2d4061aa0 con 0x55ec08cabef0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2c17fa640 1 -- 172.21.15.5:0/860202278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d800ed00 con 0x55ec08cabef0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 10 client.7737 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55ec088fc3f0 con 0x55ec08cabef0 2024-04-25T09:03:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2c17fa640 1 -- 172.21.15.5:0/860202278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d4061aa0 con 0x55ec08cabef0 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2c17fa640 1 -- 172.21.15.5:0/860202278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc2d8013420 con 0x55ec08cabef0 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 10 client.7737 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 10 client.7737 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 20 client.7737 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08cae340 0x55ec08cc3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 4 client.7737 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec08bf52e0 con 0x55ec08cae340 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2e259c640 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08cae340 0x55ec08cc3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2e259c640 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08cae340 0x55ec08cc3950 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b8a23f8e65897f1 server_cookie=b83c05d678593dac in_seq=0 out_seq=0 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.907+0000 7fc2c17fa640 10 client.7737 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2c17fa640 1 -- 172.21.15.5:0/860202278 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ec08bf52e0 con 0x55ec08cae340 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2c17fa640 10 client.7737 handle_command_reply: tid=0 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 client.7737 shutdown 2024-04-25T09:03:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 msgr2=0x55ec08cc4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cc4af0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8000f60 tx=0x7fc2d80057f0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 shutdown_connections 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08cae340 0x55ec08cc3950 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08ca3280 0x55ec08caf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cc4af0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/860202278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cabb10 0x55ec08ccb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2c17fa640 0 client.7737 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 >> 172.21.15.5:0/860202278 conn(0x55ec08c7e770 msgr2=0x55ec08c81f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 shutdown_connections 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/860202278 wait complete. 2024-04-25T09:03:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.908+0000 7fc2eb5fb740 20 client.7737 trim_cache size 0 max 16384 2024-04-25T09:03:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.923+0000 7fc2eb5fb740 1 Processor -- start 2024-04-25T09:03:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.923+0000 7fc2eb5fb740 1 -- start start 2024-04-25T09:03:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08cad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41ffed0 con 0x55ec08cabef0 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41ff090 con 0x55ec08cabb10 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41f5760 con 0x55ec08cebcf0 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42140/0 (socket says 172.21.15.5:42140) 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/4101437999 learned_addr learned my addr 172.21.15.5:0/4101437999 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e259c640 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08cad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 msgr2=0x55ec08c7ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 msgr2=0x55ec08cad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08cad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/4101437999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec088bc0f0 con 0x55ec08cabef0 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.924+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cad820 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8005da0 tx=0x7fc2d801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475147cd353df802 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2c37fe640 1 -- 172.21.15.5:0/4101437999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d800eea0 con 0x55ec08cabef0 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2c37fe640 1 -- 172.21.15.5:0/4101437999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8013420 con 0x55ec08cabef0 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2c37fe640 1 -- 172.21.15.5:0/4101437999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8013920 con 0x55ec08cabef0 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/4101437999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 msgr2=0x55ec08cad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cad820 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8005da0 tx=0x7fc2d801a000 comp rx=0 tx=0).stop 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/4101437999 shutdown_connections 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08cad820 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/4101437999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08cad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/4101437999 >> 172.21.15.5:0/4101437999 conn(0x55ec08c7e770 msgr2=0x55ec08ca9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/4101437999 shutdown_connections 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.925+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/4101437999 wait complete. 2024-04-25T09:03:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.926+0000 7fc2eb5fb740 1 -- start start 2024-04-25T09:03:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.926+0000 7fc2eb5fb740 1 Processor -- start 2024-04-25T09:03:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08d334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08c7ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2eb5fb740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec08ca3100 con 0x55ec08cabef0 2024-04-25T09:03:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41fec10 con 0x55ec08cabb10 2024-04-25T09:03:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2eb5fb740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec08c828f0 con 0x55ec08cebcf0 2024-04-25T09:03:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2eb5fb740 10 client.0 _ll_register_callbacks cb 0x7fc2d4009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08c7ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08c7ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42146/0 (socket says 172.21.15.5:42146) 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/3072042804 learned_addr learned my addr 172.21.15.5:0/3072042804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e259c640 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08d334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e2d9d640 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 msgr2=0x55ec08c7f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 msgr2=0x55ec08d334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08d334a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 -- 172.21.15.5:0/3072042804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec08cc5000 con 0x55ec08cabef0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2e1d9b640 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08c7ec50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8033040 tx=0x7fc2d8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11df91bc926bd16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.927+0000 7fc2c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2c17fa640 1 -- 172.21.15.5:0/3072042804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80055e0 con 0x55ec08cabef0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2c17fa640 1 -- 172.21.15.5:0/3072042804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2d8041ad0 con 0x55ec08cabef0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2d8013420 con 0x55ec08cabef0 2024-04-25T09:03:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2c17fa640 1 -- 172.21.15.5:0/3072042804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d8041cd0 con 0x55ec08cabef0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 10 client.7743 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55ec08cc3b50 con 0x55ec08cabef0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2c17fa640 1 -- 172.21.15.5:0/3072042804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8013420 con 0x55ec08cabef0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2c17fa640 1 -- 172.21.15.5:0/3072042804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc2d80047e0 con 0x55ec08cabef0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 10 client.7743 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 10 client.7743 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 20 client.7743 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08ce1cc0 0x55ec08ce20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 4 client.7743 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ec08bef630 con 0x55ec08ce1cc0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2e259c640 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08ce1cc0 0x55ec08ce20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2c17fa640 10 client.7743 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.928+0000 7fc2e259c640 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08ce1cc0 0x55ec08ce20a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa337b372af2d753 server_cookie=e936a72d615c5d02 in_seq=0 out_seq=0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2c17fa640 1 -- 172.21.15.5:0/3072042804 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55ec08bef630 con 0x55ec08ce1cc0 2024-04-25T09:03:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2c17fa640 10 client.7743 handle_command_reply: tid=0 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 client.7743 shutdown 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 msgr2=0x55ec08c7ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08c7ec50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8033040 tx=0x7fc2d8013000 comp rx=0 tx=0).stop 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 shutdown_connections 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x55ec08ce1cc0 0x55ec08ce20a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ec08cebcf0 0x55ec08c7f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec08cabef0 0x55ec08c7ec50 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 --2- 172.21.15.5:0/3072042804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ec08cabb10 0x55ec08d334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2c17fa640 0 client.7743 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 >> 172.21.15.5:0/3072042804 conn(0x55ec08c7e770 msgr2=0x55ec08cc9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 shutdown_connections 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 1 -- 172.21.15.5:0/3072042804 wait complete. 2024-04-25T09:03:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2eb5fb740 20 client.7743 trim_cache size 0 max 16384 2024-04-25T09:03:08.924 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "e51546d8-0f19-4124-8d5d-48238f2c3550": { 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "e51546d8-0f19-4124-8d5d-48238f2c3550", 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:08.925 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2c406b500 msgr2=0x7fc2c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2c406b500 0x7fc2c406d9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc2e41544b0 tx=0x7fc2d8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d1f60 msgr2=0x7fc2e40b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d1f60 0x7fc2e40b3cb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009d10 tx=0x7fc2d400c490 comp rx=0 tx=0).stop 2024-04-25T09:03:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 shutdown_connections 2024-04-25T09:03:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2c406b500 0x7fc2c406d9c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2e41614b0 0x7fc2e40cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2e40d4230 0x7fc2e40cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 --2- 172.21.15.5:0/86823393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e40d1f60 0x7fc2e40b3cb0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.929+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 >> 172.21.15.5:0/86823393 conn(0x7fc2e406b000 msgr2=0x7fc2e40b74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.930+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 shutdown_connections 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:08.930+0000 7fc2e8815640 1 -- 172.21.15.5:0/86823393 wait complete. 2024-04-25T09:03:13.930 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:03:13.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:03:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.057+0000 7f24a9db0640 1 Processor -- start 2024-04-25T09:03:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.057+0000 7f24a9db0640 1 -- start start 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a9db0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24a40ae690 0x7f24a40b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a9db0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a40aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a9db0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40b2ce0 con 0x7f24a40ce190 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a9db0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a4071ff0 con 0x7f24a40ae690 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a9db0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4072690 con 0x7f24a40b2850 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f24a40ce190 0x7f24a40cefd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33844/0 (socket says 172.21.15.5:33844) 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a3fff640 1 -- 172.21.15.5:0/3658216263 learned_addr learned my addr 172.21.15.5:0/3658216263 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a37fe640 1 --2- 172.21.15.5:0/3658216263 >> v2:172.21.15.80:3300/0 conn(0x7f24a40ae690 0x7f24a40b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/3658216263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a40aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a27fc640 1 -- 172.21.15.5:0/3658216263 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157581152 0 0) 0x7f24a40b2ce0 con 0x7f24a40ce190 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a27fc640 1 -- 172.21.15.5:0/3658216263 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c003520 con 0x7f24a40ce190 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a2ffd640 1 -- 172.21.15.5:0/3658216263 >> v2:172.21.15.80:3300/0 conn(0x7f24a40ae690 msgr2=0x7f24a40b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/3658216263 >> v2:172.21.15.80:3300/0 conn(0x7f24a40ae690 0x7f24a40b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a2ffd640 1 -- 172.21.15.5:0/3658216263 >> v1:172.21.15.5:6789/0 conn(0x7f24a40ce190 legacy=0x7f24a40cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a2ffd640 1 -- 172.21.15.5:0/3658216263 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40aefb0 con 0x7f24a40b2850 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.058+0000 7f24a37fe640 1 --2- 172.21.15.5:0/3658216263 >> v2:172.21.15.80:3300/0 conn(0x7f24a40ae690 0x7f24a40b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.059+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/3658216263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a40aea70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24980097a0 tx=0x7f249802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62dd3840c7bcf1cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.059+0000 7f24a27fc640 1 -- 172.21.15.5:0/3658216263 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498037070 con 0x7f24a40b2850 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.059+0000 7f24a27fc640 1 -- 172.21.15.5:0/3658216263 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249802ae50 con 0x7f24a40b2850 2024-04-25T09:03:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.059+0000 7f24a27fc640 1 -- 172.21.15.5:0/3658216263 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498032640 con 0x7f24a40b2850 2024-04-25T09:03:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 -- 172.21.15.5:0/3658216263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 msgr2=0x7f24a40aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 --2- 172.21.15.5:0/3658216263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a40aea70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24980097a0 tx=0x7f249802a100 comp rx=0 tx=0).stop 2024-04-25T09:03:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 -- 172.21.15.5:0/3658216263 shutdown_connections 2024-04-25T09:03:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 --2- 172.21.15.5:0/3658216263 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a40aea70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 --2- 172.21.15.5:0/3658216263 >> v2:172.21.15.80:3300/0 conn(0x7f24a40ae690 0x7f24a40b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 -- 172.21.15.5:0/3658216263 >> 172.21.15.5:0/3658216263 conn(0x7f24a40b1550 msgr2=0x7f24a40b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 -- 172.21.15.5:0/3658216263 shutdown_connections 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.060+0000 7f24a9db0640 1 -- 172.21.15.5:0/3658216263 wait complete. 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.061+0000 7f24a9db0640 1 Processor -- start 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.061+0000 7f24a9db0640 1 -- start start 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a9db0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24a40ae690 0x7f24a4154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a9db0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a4070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a9db0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24a40ce190 0x7f24a4070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a9db0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40cd6b0 con 0x7f24a40ce190 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a9db0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40cd3d0 con 0x7f24a40ae690 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a9db0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40cd990 con 0x7f24a40b2850 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24a40ce190 0x7f24a4070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24a40ce190 0x7f24a4070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43842/0 (socket says 172.21.15.5:43842) 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a3fff640 1 -- 172.21.15.5:0/2138811141 learned_addr learned my addr 172.21.15.5:0/2138811141 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a4070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.062+0000 7f24a37fe640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24a40ae690 0x7f24a4154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a3fff640 1 -- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 msgr2=0x7f24a4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a3fff640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a4070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a3fff640 1 -- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24a40ae690 msgr2=0x7f24a4154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a3fff640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24a40ae690 0x7f24a4154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a3fff640 1 -- 172.21.15.5:0/2138811141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40ac9e0 con 0x7f24a40ce190 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a3fff640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24a40ce190 0x7f24a4070a40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f249c00caa0 tx=0x7f249c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f248bfff640 1 -- 172.21.15.5:0/2138811141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c017070 con 0x7f24a40ce190 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f248bfff640 1 -- 172.21.15.5:0/2138811141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c00ac00 con 0x7f24a40ce190 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f248bfff640 1 -- 172.21.15.5:0/2138811141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c012400 con 0x7f24a40ce190 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a40accc0 con 0x7f24a40ce190 2024-04-25T09:03:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.063+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40ad280 con 0x7f24a40ce190 2024-04-25T09:03:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.065+0000 7f248bfff640 1 -- 172.21.15.5:0/2138811141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f249c01a070 con 0x7f24a40ce190 2024-04-25T09:03:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.065+0000 7f248bfff640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f249006b4d0 0x7f249006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.065+0000 7f248bfff640 1 -- 172.21.15.5:0/2138811141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f249c089ee0 con 0x7f24a40ce190 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.066+0000 7f24a37fe640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f249006b4d0 0x7f249006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.066+0000 7f24acb91740 1 Processor -- start 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.066+0000 7f24acb91740 1 -- start start 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.066+0000 7f24a37fe640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f249006b4d0 0x7f249006d990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2494009560 tx=0x7f2494008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24acb91740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5599276fb770 0x5599277017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559927747470 0x5599277478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24acb91740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927664da0 con 0x55992772b510 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992760db80 con 0x559927747470 2024-04-25T09:03:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x559927660e40 con 0x5599276fb770 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43856/0 (socket says 172.21.15.5:43856) 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 -- 172.21.15.5:0/77047526 learned_addr learned my addr 172.21.15.5:0/77047526 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a3fff640 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559927747470 0x5599277478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5599276fb770 0x5599277017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 -- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5599276fb770 msgr2=0x5599277017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5599276fb770 0x5599277017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 -- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559927747470 msgr2=0x5599277478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559927747470 0x5599277478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a37fe640 1 -- 172.21.15.5:0/77047526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559927617f10 con 0x55992772b510 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5599276fb770 0x5599277017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.067+0000 7f24a3fff640 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559927747470 0x5599277478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.068+0000 7f24a37fe640 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772b8f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f2494011df0 tx=0x7f2494014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d344efff58c0878e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.068+0000 7f24897fa640 1 -- 172.21.15.5:0/77047526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494011e20 con 0x55992772b510 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.068+0000 7f24897fa640 1 -- 172.21.15.5:0/77047526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2494026070 con 0x55992772b510 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.068+0000 7f24897fa640 1 -- 172.21.15.5:0/77047526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494021640 con 0x55992772b510 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 -- 172.21.15.5:0/77047526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 msgr2=0x55992772b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772b8f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f2494011df0 tx=0x7f2494014000 comp rx=0 tx=0).stop 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 -- 172.21.15.5:0/77047526 shutdown_connections 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559927747470 0x5599277478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5599276fb770 0x5599277017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 --2- 172.21.15.5:0/77047526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772b8f0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 -- 172.21.15.5:0/77047526 >> 172.21.15.5:0/77047526 conn(0x5599276fd9e0 msgr2=0x559927746320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 -- 172.21.15.5:0/77047526 shutdown_connections 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 -- 172.21.15.5:0/77047526 wait complete. 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 -- start start 2024-04-25T09:03:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.069+0000 7f24acb91740 1 Processor -- start 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55992772b510 0x559927710160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x5599277106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24acb91740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599277529d0 0x559927710be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24acb91740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927701ce0 con 0x5599277529d0 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599276034b0 con 0x55992772b510 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x559927701310 con 0x559927747470 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24acb91740 10 client.0 _ll_register_callbacks cb 0x559927643180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599277529d0 0x559927710be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599277529d0 0x559927710be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43872/0 (socket says 172.21.15.5:43872) 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24a3fff640 1 -- 172.21.15.5:0/4095492481 learned_addr learned my addr 172.21.15.5:0/4095492481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24a37fe640 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55992772b510 0x559927710160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.070+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x5599277106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24a3fff640 1 -- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 msgr2=0x5599277106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24a3fff640 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x5599277106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24a3fff640 1 -- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55992772b510 msgr2=0x559927710160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24a3fff640 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55992772b510 0x559927710160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24a3fff640 1 -- 172.21.15.5:0/4095492481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599274437d0 con 0x5599277529d0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24a3fff640 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599277529d0 0x559927710be0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f249c058680 tx=0x7f249c05c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4002ab0a5e4cd725 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24827fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24827fc640 1 -- 172.21.15.5:0/4095492481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c056ab0 con 0x5599277529d0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24827fc640 1 -- 172.21.15.5:0/4095492481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f249c060b80 con 0x5599277529d0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2494026070 con 0x5599277529d0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24827fc640 1 -- 172.21.15.5:0/4095492481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f249c088120 con 0x5599277529d0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 10 client.7755 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5599273793f0 con 0x5599277529d0 2024-04-25T09:03:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24827fc640 1 -- 172.21.15.5:0/4095492481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2494026070 con 0x5599277529d0 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24827fc640 1 -- 172.21.15.5:0/4095492481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f249c004b60 con 0x5599277529d0 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 10 client.7755 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 10 client.7755 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 20 client.7755 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x559927712100 0x559927712510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.071+0000 7f24acb91740 4 client.7755 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.072+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599276722e0 con 0x559927712100 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.072+0000 7f24a37fe640 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x559927712100 0x559927712510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.072+0000 7f24a37fe640 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x559927712100 0x559927712510 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9cbd576e34df9f server_cookie=3d56a2b0904c5c62 in_seq=0 out_seq=0 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.072+0000 7f24827fc640 10 client.7755 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24827fc640 1 -- 172.21.15.5:0/4095492481 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5599276722e0 con 0x559927712100 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24827fc640 10 client.7755 handle_command_reply: tid=0 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 client.7755 shutdown 2024-04-25T09:03:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599277529d0 msgr2=0x559927710be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599277529d0 0x559927710be0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f249c058680 tx=0x7f249c05c840 comp rx=0 tx=0).stop 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 shutdown_connections 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x559927712100 0x559927712510 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599277529d0 0x559927710be0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x5599277106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24827fc640 0 client.7755 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 --2- 172.21.15.5:0/4095492481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55992772b510 0x559927710160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 >> 172.21.15.5:0/4095492481 conn(0x5599276fb770 msgr2=0x5599276fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 shutdown_connections 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 1 -- 172.21.15.5:0/4095492481 wait complete. 2024-04-25T09:03:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.073+0000 7f24acb91740 20 client.7755 trim_cache size 0 max 16384 2024-04-25T09:03:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.088+0000 7f24acb91740 1 Processor -- start 2024-04-25T09:03:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.088+0000 7f24acb91740 1 -- start start 2024-04-25T09:03:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24acb91740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x5599277124e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927702570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x559927702ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24acb91740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4157c50 con 0x55992772b510 2024-04-25T09:03:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415dd40 con 0x5599277529d0 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415d140 con 0x559927747470 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x5599277124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x5599277124e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43886/0 (socket says 172.21.15.5:43886) 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24a37fe640 1 -- 172.21.15.5:0/3502373418 learned_addr learned my addr 172.21.15.5:0/3502373418 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24a3fff640 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x559927702ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.089+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927702570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24a37fe640 1 -- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 msgr2=0x559927702570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24a37fe640 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927702570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24a37fe640 1 -- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 msgr2=0x559927702ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24a37fe640 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x559927702ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24a37fe640 1 -- 172.21.15.5:0/3502373418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599273390f0 con 0x55992772b510 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927702570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24a37fe640 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x5599277124e0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2494023040 tx=0x7f2494018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70f5997a54c2b70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f2488ff9640 1 -- 172.21.15.5:0/3502373418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494037470 con 0x55992772b510 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f2488ff9640 1 -- 172.21.15.5:0/3502373418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249403d070 con 0x55992772b510 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f2488ff9640 1 -- 172.21.15.5:0/3502373418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494037830 con 0x55992772b510 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24acb91740 1 -- 172.21.15.5:0/3502373418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 msgr2=0x5599277124e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.090+0000 7f24acb91740 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x5599277124e0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2494023040 tx=0x7f2494018000 comp rx=0 tx=0).stop 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 -- 172.21.15.5:0/3502373418 shutdown_connections 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x559927702ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927702570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 --2- 172.21.15.5:0/3502373418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x5599277124e0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 -- 172.21.15.5:0/3502373418 >> 172.21.15.5:0/3502373418 conn(0x5599276fb770 msgr2=0x5599277003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 -- 172.21.15.5:0/3502373418 shutdown_connections 2024-04-25T09:03:14.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 -- 172.21.15.5:0/3502373418 wait complete. 2024-04-25T09:03:14.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 -- start start 2024-04-25T09:03:14.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.091+0000 7f24acb91740 1 Processor -- start 2024-04-25T09:03:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24acb91740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927747c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24acb91740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x5599276ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24acb91740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992774a980 con 0x55992772b510 2024-04-25T09:03:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415d740 con 0x5599277529d0 2024-04-25T09:03:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24acb91740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x559927746be0 con 0x559927747470 2024-04-25T09:03:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24acb91740 10 client.0 _ll_register_callbacks cb 0x7f2494009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43902/0 (socket says 172.21.15.5:43902) 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24a37fe640 1 -- 172.21.15.5:0/2956516498 learned_addr learned my addr 172.21.15.5:0/2956516498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24a3fff640 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x5599276ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.092+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927747c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24a37fe640 1 -- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 msgr2=0x559927747c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24a37fe640 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927747c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24a37fe640 1 -- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 msgr2=0x5599276ff4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24a37fe640 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x5599276ff4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24a37fe640 1 -- 172.21.15.5:0/2956516498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559927748e00 con 0x55992772b510 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24a37fe640 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772e860 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f24940098c0 tx=0x7f24940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e936fe5a8e326a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24827fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24827fc640 1 -- 172.21.15.5:0/2956516498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494045020 con 0x55992772b510 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24827fc640 1 -- 172.21.15.5:0/2956516498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24940374f0 con 0x55992772b510 2024-04-25T09:03:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f249403d070 con 0x55992772b510 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24827fc640 1 -- 172.21.15.5:0/2956516498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f249404f050 con 0x55992772b510 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 10 client.7761 fetch_fsmap learned FSMap version 55 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5599277453d0 con 0x55992772b510 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24827fc640 1 -- 172.21.15.5:0/2956516498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249403d070 con 0x55992772b510 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24827fc640 1 -- 172.21.15.5:0/2956516498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2494052020 con 0x55992772b510 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 10 client.7761 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 10 client.7761 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 20 client.7761 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5599277b4720 0x5599277b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 4 client.7761 mds_command: new command op to 7497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.093+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 --> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55992766c630 con 0x5599277b4720 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5599277b4720 0x5599277b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24a2ffd640 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5599277b4720 0x5599277b4b30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df6d90432681b3af server_cookie=2f567f97724c1c26 in_seq=0 out_seq=0 2024-04-25T09:03:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24827fc640 10 client.7761 ms_handle_connect on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24827fc640 1 -- 172.21.15.5:0/2956516498 <== mds.0 v2:172.21.15.80:6835/1143707602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55992766c630 con 0x5599277b4720 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24827fc640 10 client.7761 handle_command_reply: tid=0 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 client.7761 shutdown 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 msgr2=0x55992772e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772e860 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f24940098c0 tx=0x7f24940046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 shutdown_connections 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:6835/1143707602,v1:172.21.15.80:6837/1143707602] conn(0x5599277b4720 0x5599277b4b30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599277529d0 0x5599276ff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559927747470 0x559927747c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24827fc640 0 client.7761 ms_handle_reset on v2:172.21.15.80:6835/1143707602 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 --2- 172.21.15.5:0/2956516498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55992772b510 0x55992772e860 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 >> 172.21.15.5:0/2956516498 conn(0x5599276fb770 msgr2=0x559927702570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 shutdown_connections 2024-04-25T09:03:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.094+0000 7f24acb91740 1 -- 172.21.15.5:0/2956516498 wait complete. 2024-04-25T09:03:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24acb91740 20 client.7761 trim_cache size 0 max 16384 2024-04-25T09:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-04-25T09:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T09:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f249006b4d0 msgr2=0x7f249006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f249006b4d0 0x7f249006d990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2494009560 tx=0x7f2494008040 comp rx=0 tx=0).stop 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24a40ce190 msgr2=0x7f24a4070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24a40ce190 0x7f24a4070a40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f249c00caa0 tx=0x7f249c00cf60 comp rx=0 tx=0).stop 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 shutdown_connections 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f249006b4d0 0x7f249006d990 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24a40ce190 0x7f24a4070a40 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f24a40b2850 0x7f24a4070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 --2- 172.21.15.5:0/2138811141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24a40ae690 0x7f24a4154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 >> 172.21.15.5:0/2138811141 conn(0x7f24a40b1550 msgr2=0x7f24a406cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 shutdown_connections 2024-04-25T09:03:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.095+0000 7f24a9db0640 1 -- 172.21.15.5:0/2138811141 wait complete. 2024-04-25T09:03:14.095 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:03:14.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.207+0000 7ffb0543f640 1 Processor -- start 2024-04-25T09:03:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.207+0000 7ffb0543f640 1 -- start start 2024-04-25T09:03:14.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffb0543f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb0015de70 0x7ffb000b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffb0543f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb000d20e0 con 0x7ffb000ce7f0 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffb0543f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb000d23c0 con 0x7ffb000b2cc0 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffb0543f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb000d2a10 con 0x7ffb0015de70 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffafeffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb0015de70 0x7ffb000b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffaff7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb000ce7f0 0x7ffb000cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33850/0 (socket says 172.21.15.5:33850) 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffaff7fe640 1 -- 172.21.15.5:0/2608976324 learned_addr learned my addr 172.21.15.5:0/2608976324 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffafeffd640 1 -- 172.21.15.5:0/2608976324 >> v1:172.21.15.80:6789/0 conn(0x7ffb000b2cc0 legacy=0x7ffb000b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.208+0000 7ffafeffd640 1 -- 172.21.15.5:0/2608976324 >> v1:172.21.15.5:6789/0 conn(0x7ffb000ce7f0 legacy=0x7ffb000cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.209+0000 7ffafeffd640 1 -- 172.21.15.5:0/2608976324 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000d26a0 con 0x7ffb0015de70 2024-04-25T09:03:14.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.209+0000 7ffafeffd640 1 --2- 172.21.15.5:0/2608976324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0015de70 0x7ffb000b93e0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80097a0 tx=0x7ffaf802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c56f3420fc838b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.209+0000 7ffafdffb640 1 -- 172.21.15.5:0/2608976324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8037070 con 0x7ffb0015de70 2024-04-25T09:03:14.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.209+0000 7ffafdffb640 1 -- 172.21.15.5:0/2608976324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf8032440 con 0x7ffb0015de70 2024-04-25T09:03:14.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.209+0000 7ffafdffb640 1 -- 172.21.15.5:0/2608976324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8032810 con 0x7ffb0015de70 2024-04-25T09:03:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.210+0000 7ffb0543f640 1 -- 172.21.15.5:0/2608976324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0015de70 msgr2=0x7ffb000b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.210+0000 7ffb0543f640 1 --2- 172.21.15.5:0/2608976324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0015de70 0x7ffb000b93e0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80097a0 tx=0x7ffaf802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.210+0000 7ffb0543f640 1 -- 172.21.15.5:0/2608976324 shutdown_connections 2024-04-25T09:03:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.210+0000 7ffb0543f640 1 --2- 172.21.15.5:0/2608976324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0015de70 0x7ffb000b93e0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.210+0000 7ffb0543f640 1 -- 172.21.15.5:0/2608976324 >> 172.21.15.5:0/2608976324 conn(0x7ffb0006b000 msgr2=0x7ffb0006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.210+0000 7ffb0543f640 1 -- 172.21.15.5:0/2608976324 shutdown_connections 2024-04-25T09:03:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.210+0000 7ffb0543f640 1 -- 172.21.15.5:0/2608976324 wait complete. 2024-04-25T09:03:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.211+0000 7ffb0543f640 1 Processor -- start 2024-04-25T09:03:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.211+0000 7ffb0543f640 1 -- start start 2024-04-25T09:03:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffb0543f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb000b2cc0 0x7ffb000c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffb0543f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb000ce7f0 0x7ffb000c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffb0543f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb0015de70 0x7ffb000cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffb0543f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000d2ea0 con 0x7ffb000ce7f0 2024-04-25T09:03:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffb0543f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000b7300 con 0x7ffb0015de70 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffb0543f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000d3020 con 0x7ffb000b2cc0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffafe7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb000ce7f0 0x7ffb000c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffafe7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb000ce7f0 0x7ffb000c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43910/0 (socket says 172.21.15.5:43910) 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffafe7fc640 1 -- 172.21.15.5:0/1301366821 learned_addr learned my addr 172.21.15.5:0/1301366821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffafeffd640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb000b2cc0 0x7ffb000c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.212+0000 7ffaff7fe640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb0015de70 0x7ffb000cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffafe7fc640 1 -- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb000b2cc0 msgr2=0x7ffb000c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffafe7fc640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb000b2cc0 0x7ffb000c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffafe7fc640 1 -- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb0015de70 msgr2=0x7ffb000cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffafe7fc640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb0015de70 0x7ffb000cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffafe7fc640 1 -- 172.21.15.5:0/1301366821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000cc350 con 0x7ffb000ce7f0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffafe7fc640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb000ce7f0 0x7ffb000c9f30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c460 tx=0x7ffae800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffaf77fe640 1 -- 172.21.15.5:0/1301366821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8016020 con 0x7ffb000ce7f0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffaf77fe640 1 -- 172.21.15.5:0/1301366821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae8012870 con 0x7ffb000ce7f0 2024-04-25T09:03:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb00149f60 con 0x7ffb000ce7f0 2024-04-25T09:03:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffaf77fe640 1 -- 172.21.15.5:0/1301366821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8012c60 con 0x7ffb000ce7f0 2024-04-25T09:03:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.213+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0014a520 con 0x7ffb000ce7f0 2024-04-25T09:03:14.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.214+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0014a720 con 0x7ffb000ce7f0 2024-04-25T09:03:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.214+0000 7ffaf77fe640 1 -- 172.21.15.5:0/1301366821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffae8019020 con 0x7ffb000ce7f0 2024-04-25T09:03:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.215+0000 7ffaf77fe640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffae006b4d0 0x7ffae006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.215+0000 7ffaf77fe640 1 -- 172.21.15.5:0/1301366821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffae8089b00 con 0x7ffb000ce7f0 2024-04-25T09:03:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.215+0000 7ffafeffd640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffae006b4d0 0x7ffae006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.216+0000 7ffafeffd640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffae006b4d0 0x7ffae006d990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.219+0000 7ffaf77fe640 1 -- 172.21.15.5:0/1301366821 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb0014a720 con 0x7ffb000ce7f0 2024-04-25T09:03:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.439+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb00149d50 con 0x7ffb000ce7f0 2024-04-25T09:03:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.439+0000 7ffaf77fe640 1 -- 172.21.15.5:0/1301366821 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4934 (secure 0 0 0) 0x7ffae8020070 con 0x7ffb000ce7f0 2024-04-25T09:03:14.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:14.429 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:46.467722+0000","modified":"2024-04-25T09:02:49.472605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7497":{"gid":7497,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1143707602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1143707602},{"type":"v1","addr":"172.21.15.80:6837","nonce":1143707602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:03:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffae006b4d0 msgr2=0x7ffae006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffae006b4d0 0x7ffae006d990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb000ce7f0 msgr2=0x7ffb000c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb000ce7f0 0x7ffb000c9f30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c460 tx=0x7ffae800c920 comp rx=0 tx=0).stop 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 shutdown_connections 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffae006b4d0 0x7ffae006d990 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb0015de70 0x7ffb000cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb000ce7f0 0x7ffb000c9f30 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.441+0000 7ffb0543f640 1 --2- 172.21.15.5:0/1301366821 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb000b2cc0 0x7ffb000c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.442+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 >> 172.21.15.5:0/1301366821 conn(0x7ffb0006b000 msgr2=0x7ffb000b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.442+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 shutdown_connections 2024-04-25T09:03:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.442+0000 7ffb0543f640 1 -- 172.21.15.5:0/1301366821 wait complete. 2024-04-25T09:03:14.442 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:03:14.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:03:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.553+0000 7f1e406f5640 1 Processor -- start 2024-04-25T09:03:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.553+0000 7f1e406f5640 1 -- start start 2024-04-25T09:03:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e406f5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e3815dc70 0x7f1e38161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e406f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e380b94a0 0x7f1e380ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e406f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e406f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e380d2180 con 0x7f1e380b94a0 2024-04-25T09:03:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e406f5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e38161d90 con 0x7f1e3815dc70 2024-04-25T09:03:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e406f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e380d11f0 con 0x7f1e380ced90 2024-04-25T09:03:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e380b94a0 0x7f1e380ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e380b94a0 0x7f1e380ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43912/0 (socket says 172.21.15.5:43912) 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 -- 172.21.15.5:0/3718680005 learned_addr learned my addr 172.21.15.5:0/3718680005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3e491640 1 --2- 172.21.15.5:0/3718680005 >> v2:172.21.15.80:3300/0 conn(0x7f1e3815dc70 0x7f1e38161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3ec92640 1 --2- 172.21.15.5:0/3718680005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 -- 172.21.15.5:0/3718680005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 msgr2=0x7f1e380b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 --2- 172.21.15.5:0/3718680005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 -- 172.21.15.5:0/3718680005 >> v2:172.21.15.80:3300/0 conn(0x7f1e3815dc70 msgr2=0x7f1e38161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 --2- 172.21.15.5:0/3718680005 >> v2:172.21.15.80:3300/0 conn(0x7f1e3815dc70 0x7f1e38161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3dc90640 1 -- 172.21.15.5:0/3718680005 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38161fc0 con 0x7f1e380b94a0 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.554+0000 7f1e3e491640 1 --2- 172.21.15.5:0/3718680005 >> v2:172.21.15.80:3300/0 conn(0x7f1e3815dc70 0x7f1e38161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.555+0000 7f1e3dc90640 1 --2- 172.21.15.5:0/3718680005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380b94a0 0x7f1e380ce850 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1e380d4c50 tx=0x7f1e2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f87a8a388b6158 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.555+0000 7f1e3d48f640 1 -- 172.21.15.5:0/3718680005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28037070 con 0x7f1e380b94a0 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.555+0000 7f1e3d48f640 1 -- 172.21.15.5:0/3718680005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28032440 con 0x7f1e380b94a0 2024-04-25T09:03:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.555+0000 7f1e3d48f640 1 -- 172.21.15.5:0/3718680005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28032810 con 0x7f1e380b94a0 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 -- 172.21.15.5:0/3718680005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380b94a0 msgr2=0x7f1e380ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3718680005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380b94a0 0x7f1e380ce850 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1e380d4c50 tx=0x7f1e2802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 -- 172.21.15.5:0/3718680005 shutdown_connections 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3718680005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3718680005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380b94a0 0x7f1e380ce850 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3718680005 >> v2:172.21.15.80:3300/0 conn(0x7f1e3815dc70 0x7f1e38161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 -- 172.21.15.5:0/3718680005 >> 172.21.15.5:0/3718680005 conn(0x7f1e380668f0 msgr2=0x7f1e38066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 -- 172.21.15.5:0/3718680005 shutdown_connections 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.556+0000 7f1e406f5640 1 -- 172.21.15.5:0/3718680005 wait complete. 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.557+0000 7f1e406f5640 1 Processor -- start 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.557+0000 7f1e406f5640 1 -- start start 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e406f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e380b94a0 0x7f1e380b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e406f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e406f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3815dc70 0x7f1e380aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e406f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3815e050 con 0x7f1e3815dc70 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e406f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38162580 con 0x7f1e380b94a0 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e406f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3815e1d0 con 0x7f1e380ced90 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3815dc70 0x7f1e380aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3815dc70 0x7f1e380aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43914/0 (socket says 172.21.15.5:43914) 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 -- 172.21.15.5:0/3736145378 learned_addr learned my addr 172.21.15.5:0/3736145378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3e491640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e380b94a0 0x7f1e380b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3dc90640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 -- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 msgr2=0x7f1e380aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 -- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e380b94a0 msgr2=0x7f1e380b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e380b94a0 0x7f1e380b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3ec92640 1 -- 172.21.15.5:0/3736145378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38160ba0 con 0x7f1e3815dc70 2024-04-25T09:03:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.558+0000 7f1e3e491640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e380b94a0 0x7f1e380b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.559+0000 7f1e3ec92640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3815dc70 0x7f1e380aaab0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f1e30007dc0 tx=0x7f1e3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.559+0000 7f1e2effd640 1 -- 172.21.15.5:0/3736145378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30014420 con 0x7f1e3815dc70 2024-04-25T09:03:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.559+0000 7f1e2effd640 1 -- 172.21.15.5:0/3736145378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30019070 con 0x7f1e3815dc70 2024-04-25T09:03:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.559+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e380b44c0 con 0x7f1e3815dc70 2024-04-25T09:03:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.559+0000 7f1e2effd640 1 -- 172.21.15.5:0/3736145378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30014820 con 0x7f1e3815dc70 2024-04-25T09:03:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.559+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e380b1fa0 con 0x7f1e3815dc70 2024-04-25T09:03:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.560+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3804ef20 con 0x7f1e3815dc70 2024-04-25T09:03:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.560+0000 7f1e2effd640 1 -- 172.21.15.5:0/3736145378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e300149c0 con 0x7f1e3815dc70 2024-04-25T09:03:14.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.560+0000 7f1e2effd640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e1c06b4d0 0x7f1e1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.561+0000 7f1e2effd640 1 -- 172.21.15.5:0/3736145378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e3008a980 con 0x7f1e3815dc70 2024-04-25T09:03:14.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.561+0000 7f1e3e491640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e1c06b4d0 0x7f1e1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.561+0000 7f1e3e491640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e1c06b4d0 0x7f1e1c06d990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e38160fe0 tx=0x7f1e34008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.565+0000 7f1e2effd640 1 -- 172.21.15.5:0/3736145378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e30059800 con 0x7f1e3815dc70 2024-04-25T09:03:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.814+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1e380cdf40 con 0x7f1e3815dc70 2024-04-25T09:03:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.815+0000 7f1e2effd640 1 -- 172.21.15.5:0/3736145378 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1187 (secure 0 0 0) 0x7f1e30059100 con 0x7f1e3815dc70 2024-04-25T09:03:14.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:14.804 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":414,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":88,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076284450,"bytes_used":2536087552,"bytes_avail":770558025728,"bytes_total":773094113280,"write_bytes_sec":89633822,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":55,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7497}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-04-25T09:01:58.457242+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e1c06b4d0 msgr2=0x7f1e1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e1c06b4d0 0x7f1e1c06d990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e38160fe0 tx=0x7f1e34008040 comp rx=0 tx=0).stop 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3815dc70 msgr2=0x7f1e380aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3815dc70 0x7f1e380aaab0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f1e30007dc0 tx=0x7f1e3000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 shutdown_connections 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e1c06b4d0 0x7f1e1c06d990 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3815dc70 0x7f1e380aaab0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e380ced90 0x7f1e380aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 --2- 172.21.15.5:0/3736145378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e380b94a0 0x7f1e380b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 >> 172.21.15.5:0/3736145378 conn(0x7f1e380668f0 msgr2=0x7f1e380c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 shutdown_connections 2024-04-25T09:03:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:14.817+0000 7f1e406f5640 1 -- 172.21.15.5:0/3736145378 wait complete. 2024-04-25T09:03:14.816 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:03:14.816 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:03:14.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:14.853 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:14.892 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:03:14.893 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:03:14.893 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:14.909 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:03:14.909 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:14.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.117+0000 7f984906b640 1 Processor -- start 2024-04-25T09:03:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.117+0000 7f984906b640 1 -- start start 2024-04-25T09:03:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984906b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f984406adf0 0x7f984406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984906b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f984406bb30 0x7f98440d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984906b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984415ef10 con 0x7f98440cea80 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984906b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98440cfd60 con 0x7f984406bb30 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984906b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984415f480 con 0x7f984406adf0 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f984406bb30 0x7f98440d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f984406bb30 0x7f98440d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43926/0 (socket says 172.21.15.5:43926) 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984359e640 1 -- 172.21.15.5:0/2425672796 learned_addr learned my addr 172.21.15.5:0/2425672796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984259c640 1 --2- 172.21.15.5:0/2425672796 >> v2:172.21.15.80:3300/0 conn(0x7f984406adf0 0x7f984406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984359e640 1 -- 172.21.15.5:0/2425672796 >> v2:172.21.15.80:3300/0 conn(0x7f984406adf0 msgr2=0x7f984406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984359e640 1 --2- 172.21.15.5:0/2425672796 >> v2:172.21.15.80:3300/0 conn(0x7f984406adf0 0x7f984406b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984359e640 1 -- 172.21.15.5:0/2425672796 >> v1:172.21.15.80:6789/0 conn(0x7f98440cea80 legacy=0x7f984415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.118+0000 7f984359e640 1 -- 172.21.15.5:0/2425672796 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984406bf10 con 0x7f984406bb30 2024-04-25T09:03:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.119+0000 7f984359e640 1 --2- 172.21.15.5:0/2425672796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406bb30 0x7f98440d0770 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9844070e90 tx=0x7f983c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e704bfcc359d59a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.119+0000 7f9841d9b640 1 -- 172.21.15.5:0/2425672796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c037070 con 0x7f984406bb30 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.119+0000 7f9841d9b640 1 -- 172.21.15.5:0/2425672796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c032440 con 0x7f984406bb30 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.119+0000 7f9841d9b640 1 -- 172.21.15.5:0/2425672796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c032810 con 0x7f984406bb30 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 -- 172.21.15.5:0/2425672796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406bb30 msgr2=0x7f98440d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 --2- 172.21.15.5:0/2425672796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406bb30 0x7f98440d0770 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9844070e90 tx=0x7f983c02a270 comp rx=0 tx=0).stop 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 -- 172.21.15.5:0/2425672796 shutdown_connections 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 --2- 172.21.15.5:0/2425672796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406bb30 0x7f98440d0770 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 --2- 172.21.15.5:0/2425672796 >> v2:172.21.15.80:3300/0 conn(0x7f984406adf0 0x7f984406b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 -- 172.21.15.5:0/2425672796 >> 172.21.15.5:0/2425672796 conn(0x7f98440d19f0 msgr2=0x7f98440d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 -- 172.21.15.5:0/2425672796 shutdown_connections 2024-04-25T09:03:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.120+0000 7f984906b640 1 -- 172.21.15.5:0/2425672796 wait complete. 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.121+0000 7f984906b640 1 Processor -- start 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.121+0000 7f984906b640 1 -- start start 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984906b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406adf0 0x7f984409f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984906b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f984406bb30 0x7f98441f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984906b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98440cea80 0x7f98441f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984906b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98440cff90 con 0x7f984406adf0 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984906b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984415f1a0 con 0x7f984406bb30 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984906b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98440d0270 con 0x7f98440cea80 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f9842d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406adf0 0x7f984409f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f9842d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406adf0 0x7f984409f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43928/0 (socket says 172.21.15.5:43928) 2024-04-25T09:03:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f9842d9d640 1 -- 172.21.15.5:0/2255064993 learned_addr learned my addr 172.21.15.5:0/2255064993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984259c640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f984406bb30 0x7f98441f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f984359e640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98440cea80 0x7f98441f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f9842d9d640 1 -- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98440cea80 msgr2=0x7f98441f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f9842d9d640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98440cea80 0x7f98441f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f9842d9d640 1 -- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f984406bb30 msgr2=0x7f98441f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.122+0000 7f9842d9d640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f984406bb30 0x7f98441f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f9842d9d640 1 -- 172.21.15.5:0/2255064993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98441f50b0 con 0x7f984406adf0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f984359e640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98440cea80 0x7f98441f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f9842d9d640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406adf0 0x7f984409f3c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f983400c730 tx=0x7f983400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f982b7fe640 1 -- 172.21.15.5:0/2255064993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834016020 con 0x7f984406adf0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f982b7fe640 1 -- 172.21.15.5:0/2255064993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9834006d50 con 0x7f984406adf0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98440b0e30 con 0x7f984406adf0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f982b7fe640 1 -- 172.21.15.5:0/2255064993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834003bb0 con 0x7f984406adf0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.123+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98440b13f0 con 0x7f984406adf0 2024-04-25T09:03:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.124+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984404ef20 con 0x7f984406adf0 2024-04-25T09:03:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.124+0000 7f982b7fe640 1 -- 172.21.15.5:0/2255064993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f983400a850 con 0x7f984406adf0 2024-04-25T09:03:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.125+0000 7f982b7fe640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983006b4d0 0x7f983006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.125+0000 7f982b7fe640 1 -- 172.21.15.5:0/2255064993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9834089d40 con 0x7f984406adf0 2024-04-25T09:03:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.125+0000 7f984259c640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983006b4d0 0x7f983006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.126+0000 7f984259c640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983006b4d0 0x7f983006d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f98440b7490 tx=0x7f9838008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.129+0000 7f982b7fe640 1 -- 172.21.15.5:0/2255064993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9834020020 con 0x7f984406adf0 2024-04-25T09:03:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.310+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98440cefa0 con 0x7f984406adf0 2024-04-25T09:03:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.312+0000 7f982b7fe640 1 -- 172.21.15.5:0/2255064993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16576 (secure 0 0 0) 0x7f9834058c50 con 0x7f984406adf0 2024-04-25T09:03:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:15.301 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:48.102831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:44.744734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:45.440447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983006b4d0 msgr2=0x7f983006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983006b4d0 0x7f983006d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f98440b7490 tx=0x7f9838008040 comp rx=0 tx=0).stop 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406adf0 msgr2=0x7f984409f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406adf0 0x7f984409f3c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f983400c730 tx=0x7f983400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 shutdown_connections 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f983006b4d0 0x7f983006d990 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98440cea80 0x7f98441f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f984406bb30 0x7f98441f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 --2- 172.21.15.5:0/2255064993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984406adf0 0x7f984409f3c0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 >> 172.21.15.5:0/2255064993 conn(0x7f98440d19f0 msgr2=0x7f98441620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 shutdown_connections 2024-04-25T09:03:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.314+0000 7f984906b640 1 -- 172.21.15.5:0/2255064993 wait complete. 2024-04-25T09:03:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:44.744734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:45.440447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:15.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.428+0000 7f6a6b6ac640 1 Processor -- start 2024-04-25T09:03:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.428+0000 7f6a6b6ac640 1 -- start start 2024-04-25T09:03:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a6b6ac640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a6415c0f0 0x7f6a640cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a6b6ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a640b24b0 0x7f6a640b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a6b6ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a640cff00 0x7f6a640d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a6b6ac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640cd350 con 0x7f6a640cff00 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a6b6ac640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640cf7a0 con 0x7f6a6415c0f0 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a6b6ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640d24e0 con 0x7f6a640b24b0 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a69c49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a640cff00 0x7f6a640d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a69c49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a640cff00 0x7f6a640d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43944/0 (socket says 172.21.15.5:43944) 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.429+0000 7f6a69c49640 1 -- 172.21.15.5:0/3410939875 learned_addr learned my addr 172.21.15.5:0/3410939875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a69448640 1 --2- 172.21.15.5:0/3410939875 >> v2:172.21.15.80:3300/0 conn(0x7f6a6415c0f0 0x7f6a640cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a68c47640 1 --2- 172.21.15.5:0/3410939875 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a640b24b0 0x7f6a640b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a69c49640 1 -- 172.21.15.5:0/3410939875 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a640b24b0 msgr2=0x7f6a640b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a69c49640 1 --2- 172.21.15.5:0/3410939875 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a640b24b0 0x7f6a640b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a69c49640 1 -- 172.21.15.5:0/3410939875 >> v2:172.21.15.80:3300/0 conn(0x7f6a6415c0f0 msgr2=0x7f6a640cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a69c49640 1 --2- 172.21.15.5:0/3410939875 >> v2:172.21.15.80:3300/0 conn(0x7f6a6415c0f0 0x7f6a640cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a69c49640 1 -- 172.21.15.5:0/3410939875 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640d27c0 con 0x7f6a640cff00 2024-04-25T09:03:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.430+0000 7f6a69c49640 1 --2- 172.21.15.5:0/3410939875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640cff00 0x7f6a640d0390 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6a640d2a20 tx=0x7f6a5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477f9abaf71344f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a63fff640 1 -- 172.21.15.5:0/3410939875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c037070 con 0x7f6a640cff00 2024-04-25T09:03:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a63fff640 1 -- 172.21.15.5:0/3410939875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c032440 con 0x7f6a640cff00 2024-04-25T09:03:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a63fff640 1 -- 172.21.15.5:0/3410939875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c032810 con 0x7f6a640cff00 2024-04-25T09:03:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3410939875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640cff00 msgr2=0x7f6a640d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3410939875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640cff00 0x7f6a640d0390 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6a640d2a20 tx=0x7f6a5c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3410939875 shutdown_connections 2024-04-25T09:03:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3410939875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640cff00 0x7f6a640d0390 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3410939875 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a640b24b0 0x7f6a640b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3410939875 >> v2:172.21.15.80:3300/0 conn(0x7f6a6415c0f0 0x7f6a640cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3410939875 >> 172.21.15.5:0/3410939875 conn(0x7f6a640d1920 msgr2=0x7f6a640d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3410939875 shutdown_connections 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.431+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3410939875 wait complete. 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.432+0000 7f6a6b6ac640 1 Processor -- start 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a6b6ac640 1 -- start start 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a6b6ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640b24b0 0x7f6a6415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a6b6ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a640cff00 0x7f6a640b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a6b6ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6415c0f0 0x7f6a6406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a6b6ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640cdd20 con 0x7f6a640b24b0 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a6b6ac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640cfa40 con 0x7f6a640cff00 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a6b6ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640cdea0 con 0x7f6a6415c0f0 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a69448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640b24b0 0x7f6a6415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a69448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640b24b0 0x7f6a6415cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43960/0 (socket says 172.21.15.5:43960) 2024-04-25T09:03:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a69448640 1 -- 172.21.15.5:0/3702301498 learned_addr learned my addr 172.21.15.5:0/3702301498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a68c47640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a640cff00 0x7f6a640b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.433+0000 7f6a69c49640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6415c0f0 0x7f6a6406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a69448640 1 -- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6415c0f0 msgr2=0x7f6a6406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a69448640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6415c0f0 0x7f6a6406c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a69448640 1 -- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a640cff00 msgr2=0x7f6a640b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a69448640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a640cff00 0x7f6a640b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a69448640 1 -- 172.21.15.5:0/3702301498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6415d5a0 con 0x7f6a640b24b0 2024-04-25T09:03:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a69448640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640b24b0 0x7f6a6415cec0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f6a54007ef0 tx=0x7f6a5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a61ffb640 1 -- 172.21.15.5:0/3702301498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54014620 con 0x7f6a640b24b0 2024-04-25T09:03:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a61ffb640 1 -- 172.21.15.5:0/3702301498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54019070 con 0x7f6a640b24b0 2024-04-25T09:03:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6415d880 con 0x7f6a640b24b0 2024-04-25T09:03:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a61ffb640 1 -- 172.21.15.5:0/3702301498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54014a00 con 0x7f6a640b24b0 2024-04-25T09:03:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.434+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6415de40 con 0x7f6a640b24b0 2024-04-25T09:03:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.435+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6404ef20 con 0x7f6a640b24b0 2024-04-25T09:03:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.436+0000 7f6a61ffb640 1 -- 172.21.15.5:0/3702301498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a54014ba0 con 0x7f6a640b24b0 2024-04-25T09:03:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.436+0000 7f6a61ffb640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b500 0x7f6a5006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.436+0000 7f6a61ffb640 1 -- 172.21.15.5:0/3702301498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a5408a9e0 con 0x7f6a640b24b0 2024-04-25T09:03:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.436+0000 7f6a68c47640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b500 0x7f6a5006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.437+0000 7f6a68c47640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b500 0x7f6a5006d9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a640b75d0 tx=0x7f6a58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.440+0000 7f6a61ffb640 1 -- 172.21.15.5:0/3702301498 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a54059210 con 0x7f6a640b24b0 2024-04-25T09:03:15.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.620+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a640cfce0 con 0x7f6a640b24b0 2024-04-25T09:03:15.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.620+0000 7f6a61ffb640 1 -- 172.21.15.5:0/3702301498 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a5405d2b0 con 0x7f6a640b24b0 2024-04-25T09:03:15.609 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:03:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b500 msgr2=0x7f6a5006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b500 0x7f6a5006d9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a640b75d0 tx=0x7f6a58008040 comp rx=0 tx=0).stop 2024-04-25T09:03:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640b24b0 msgr2=0x7f6a6415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640b24b0 0x7f6a6415cec0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f6a54007ef0 tx=0x7f6a5400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 shutdown_connections 2024-04-25T09:03:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b500 0x7f6a5006d9c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6415c0f0 0x7f6a6406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a640cff00 0x7f6a640b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 --2- 172.21.15.5:0/3702301498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a640b24b0 0x7f6a6415cec0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 >> 172.21.15.5:0/3702301498 conn(0x7f6a640d1920 msgr2=0x7f6a6415ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 shutdown_connections 2024-04-25T09:03:15.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.622+0000 7f6a6b6ac640 1 -- 172.21.15.5:0/3702301498 wait complete. 2024-04-25T09:03:15.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.737+0000 7fbb8b34c640 1 Processor -- start 2024-04-25T09:03:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.737+0000 7fbb8b34c640 1 -- start start 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb8b34c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb8415e040 0x7fbb840d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb8b34c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb840d0de0 con 0x7fbb8415dc60 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb8b34c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb840ce7b0 con 0x7fbb840d09b0 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb8b34c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb840b6cd0 con 0x7fbb8415e040 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb890e8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbb8415dc60 0x7fbb84162380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33862/0 (socket says 172.21.15.5:33862) 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb890e8640 1 -- 172.21.15.5:0/2580339863 learned_addr learned my addr 172.21.15.5:0/2580339863 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb888e7640 1 --2- 172.21.15.5:0/2580339863 >> v2:172.21.15.80:3300/0 conn(0x7fbb8415e040 0x7fbb840d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb7bfff640 1 -- 172.21.15.5:0/2580339863 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273118698 0 0) 0x7fbb80001110 con 0x7fbb8415dc60 2024-04-25T09:03:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb7bfff640 1 -- 172.21.15.5:0/2580339863 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb70003520 con 0x7fbb8415dc60 2024-04-25T09:03:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb888e7640 1 -- 172.21.15.5:0/2580339863 >> v1:172.21.15.80:6789/0 conn(0x7fbb840d09b0 legacy=0x7fbb840d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb888e7640 1 -- 172.21.15.5:0/2580339863 >> v1:172.21.15.5:6789/0 conn(0x7fbb8415dc60 legacy=0x7fbb84162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.738+0000 7fbb888e7640 1 -- 172.21.15.5:0/2580339863 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840cea90 con 0x7fbb8415e040 2024-04-25T09:03:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.739+0000 7fbb888e7640 1 --2- 172.21.15.5:0/2580339863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb8415e040 0x7fbb840d0470 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097a0 tx=0x7fbb7402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bffbe41ee48ea014 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.739+0000 7fbb7bfff640 1 -- 172.21.15.5:0/2580339863 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74037070 con 0x7fbb8415e040 2024-04-25T09:03:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.739+0000 7fbb7bfff640 1 -- 172.21.15.5:0/2580339863 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74032640 con 0x7fbb8415e040 2024-04-25T09:03:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.739+0000 7fbb7bfff640 1 -- 172.21.15.5:0/2580339863 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74032a10 con 0x7fbb8415e040 2024-04-25T09:03:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.740+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2580339863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb8415e040 msgr2=0x7fbb840d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.740+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2580339863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb8415e040 0x7fbb840d0470 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097a0 tx=0x7fbb7402a2c0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.740+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2580339863 shutdown_connections 2024-04-25T09:03:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.740+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2580339863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb8415e040 0x7fbb840d0470 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.740+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2580339863 >> 172.21.15.5:0/2580339863 conn(0x7fbb840668f0 msgr2=0x7fbb84066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.740+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2580339863 shutdown_connections 2024-04-25T09:03:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.740+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2580339863 wait complete. 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.741+0000 7fbb8b34c640 1 Processor -- start 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.741+0000 7fbb8b34c640 1 -- start start 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb8b34c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb840d09b0 0x7fbb840b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb8b34c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb8415dc60 0x7fbb840b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb8b34c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8415e040 0x7fbb840b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb8b34c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840b3220 con 0x7fbb8415e040 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb8b34c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840cf050 con 0x7fbb840d09b0 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb8b34c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840cf330 con 0x7fbb8415dc60 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8415e040 0x7fbb840b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8415e040 0x7fbb840b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43974/0 (socket says 172.21.15.5:43974) 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 -- 172.21.15.5:0/2621482832 learned_addr learned my addr 172.21.15.5:0/2621482832 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:15.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb890e8640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb840d09b0 0x7fbb840b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb888e7640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb8415dc60 0x7fbb840b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 -- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb8415dc60 msgr2=0x7fbb840b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb8415dc60 0x7fbb840b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 -- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb840d09b0 msgr2=0x7fbb840b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb840d09b0 0x7fbb840b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 -- 172.21.15.5:0/2621482832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840b3a10 con 0x7fbb8415e040 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb898e9640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8415e040 0x7fbb840b5fc0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00c7a0 tx=0x7fbb7c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb79ffb640 1 -- 172.21.15.5:0/2621482832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c003b70 con 0x7fbb8415e040 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb79ffb640 1 -- 172.21.15.5:0/2621482832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c003d30 con 0x7fbb8415e040 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb840b3cf0 con 0x7fbb8415e040 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.742+0000 7fbb79ffb640 1 -- 172.21.15.5:0/2621482832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00aa90 con 0x7fbb8415e040 2024-04-25T09:03:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.743+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb840b42b0 con 0x7fbb8415e040 2024-04-25T09:03:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.744+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8404ef20 con 0x7fbb8415e040 2024-04-25T09:03:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.744+0000 7fbb79ffb640 1 -- 172.21.15.5:0/2621482832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb7c00ac30 con 0x7fbb8415e040 2024-04-25T09:03:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.744+0000 7fbb79ffb640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb6806b4d0 0x7fbb6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.745+0000 7fbb79ffb640 1 -- 172.21.15.5:0/2621482832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb7c08a000 con 0x7fbb8415e040 2024-04-25T09:03:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.745+0000 7fbb890e8640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb6806b4d0 0x7fbb6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.745+0000 7fbb890e8640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb6806b4d0 0x7fbb6806d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb800012b0 tx=0x7fbb80007b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.749+0000 7fbb79ffb640 1 -- 172.21.15.5:0/2621482832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb7c058830 con 0x7fbb8415e040 2024-04-25T09:03:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.929+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb840d1910 con 0x7fbb8415e040 2024-04-25T09:03:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.929+0000 7fbb79ffb640 1 -- 172.21.15.5:0/2621482832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb7c05c8d0 con 0x7fbb8415e040 2024-04-25T09:03:15.918 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb6806b4d0 msgr2=0x7fbb6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb6806b4d0 0x7fbb6806d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb800012b0 tx=0x7fbb80007b70 comp rx=0 tx=0).stop 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8415e040 msgr2=0x7fbb840b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8415e040 0x7fbb840b5fc0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00c7a0 tx=0x7fbb7c00cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 shutdown_connections 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbb6806b4d0 0x7fbb6806d990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb8415e040 0x7fbb840b5fc0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb8415dc60 0x7fbb840b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 --2- 172.21.15.5:0/2621482832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb840d09b0 0x7fbb840b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 >> 172.21.15.5:0/2621482832 conn(0x7fbb840668f0 msgr2=0x7fbb840ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 shutdown_connections 2024-04-25T09:03:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:15.932+0000 7fbb8b34c640 1 -- 172.21.15.5:0/2621482832 wait complete. 2024-04-25T09:03:15.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.046+0000 7fb55b215640 1 Processor -- start 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.046+0000 7fb55b215640 1 -- start start 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb55b215640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb55415a340 0x7fb5540b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb55b215640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb554071ed0 0x7fb5540b4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb55b215640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540cf600 con 0x7fb55415e880 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb55b215640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5540b4740 con 0x7fb554071ed0 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb55b215640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55415a720 con 0x7fb55415a340 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb5597b2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb554071ed0 0x7fb5540b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb553fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb55415e880 0x7fb5540cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33868/0 (socket says 172.21.15.5:33868) 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb553fff640 1 -- 172.21.15.5:0/42146221 learned_addr learned my addr 172.21.15.5:0/42146221 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb558fb1640 1 --2- 172.21.15.5:0/42146221 >> v2:172.21.15.80:3300/0 conn(0x7fb55415a340 0x7fb5540b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb5597b2640 1 -- 172.21.15.5:0/42146221 >> v2:172.21.15.80:3300/0 conn(0x7fb55415a340 msgr2=0x7fb5540b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb5597b2640 1 --2- 172.21.15.5:0/42146221 >> v2:172.21.15.80:3300/0 conn(0x7fb55415a340 0x7fb5540b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb5597b2640 1 -- 172.21.15.5:0/42146221 >> v1:172.21.15.5:6789/0 conn(0x7fb55415e880 legacy=0x7fb5540cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb5537fe640 1 -- 172.21.15.5:0/42146221 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452342951 0 0) 0x7fb5540cf600 con 0x7fb55415e880 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb5597b2640 1 -- 172.21.15.5:0/42146221 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540aeef0 con 0x7fb554071ed0 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.047+0000 7fb558fb1640 1 --2- 172.21.15.5:0/42146221 >> v2:172.21.15.80:3300/0 conn(0x7fb55415a340 0x7fb5540b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.048+0000 7fb5597b2640 1 --2- 172.21.15.5:0/42146221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540b4200 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb55406c320 tx=0x7fb54c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd30d023ead8ea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.048+0000 7fb5537fe640 1 -- 172.21.15.5:0/42146221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c007740 con 0x7fb554071ed0 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.048+0000 7fb5537fe640 1 -- 172.21.15.5:0/42146221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c0078e0 con 0x7fb554071ed0 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.048+0000 7fb5537fe640 1 -- 172.21.15.5:0/42146221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c007cb0 con 0x7fb554071ed0 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 -- 172.21.15.5:0/42146221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 msgr2=0x7fb5540b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 --2- 172.21.15.5:0/42146221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540b4200 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb55406c320 tx=0x7fb54c02a680 comp rx=0 tx=0).stop 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 -- 172.21.15.5:0/42146221 shutdown_connections 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 --2- 172.21.15.5:0/42146221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540b4200 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 --2- 172.21.15.5:0/42146221 >> v2:172.21.15.80:3300/0 conn(0x7fb55415a340 0x7fb5540b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 -- 172.21.15.5:0/42146221 >> 172.21.15.5:0/42146221 conn(0x7fb5540b1550 msgr2=0x7fb5540b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 -- 172.21.15.5:0/42146221 shutdown_connections 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.049+0000 7fb55b215640 1 -- 172.21.15.5:0/42146221 wait complete. 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.050+0000 7fb55b215640 1 Processor -- start 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.050+0000 7fb55b215640 1 -- start start 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb55b215640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb55b215640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb55415a340 0x7fb5541f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb55b215640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb55415e880 0x7fb5541ef160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb55b215640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540725b0 con 0x7fb554071ed0 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb55b215640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540d0370 con 0x7fb55415a340 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb55b215640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540703a0 con 0x7fb55415e880 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540ac6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43990/0 (socket says 172.21.15.5:43990) 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 -- 172.21.15.5:0/2833676754 learned_addr learned my addr 172.21.15.5:0/2833676754 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb553fff640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb55415a340 0x7fb5541f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb5597b2640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb55415e880 0x7fb5541ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 -- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb55415e880 msgr2=0x7fb5541ef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb55415e880 0x7fb5541ef160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 -- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb55415a340 msgr2=0x7fb5541f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb55415a340 0x7fb5541f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 -- 172.21.15.5:0/2833676754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55415c3f0 con 0x7fb554071ed0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb553fff640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb55415a340 0x7fb5541f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb558fb1640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540ac6f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb54800e810 tx=0x7fb54800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.051+0000 7fb5517fa640 1 -- 172.21.15.5:0/2833676754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800f040 con 0x7fb554071ed0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.052+0000 7fb5517fa640 1 -- 172.21.15.5:0/2833676754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548004030 con 0x7fb554071ed0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.052+0000 7fb5517fa640 1 -- 172.21.15.5:0/2833676754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548004400 con 0x7fb554071ed0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.052+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5541f3770 con 0x7fb554071ed0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.052+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5541f3d30 con 0x7fb554071ed0 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.053+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55404ef20 con 0x7fb554071ed0 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.053+0000 7fb5517fa640 1 -- 172.21.15.5:0/2833676754 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb54800c6d0 con 0x7fb554071ed0 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.053+0000 7fb5517fa640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb53806b4d0 0x7fb53806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.054+0000 7fb5517fa640 1 -- 172.21.15.5:0/2833676754 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb548089f90 con 0x7fb554071ed0 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.054+0000 7fb553fff640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb53806b4d0 0x7fb53806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.054+0000 7fb553fff640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb53806b4d0 0x7fb53806d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb55415c380 tx=0x7fb540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.058+0000 7fb5517fa640 1 -- 172.21.15.5:0/2833676754 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb548017020 con 0x7fb554071ed0 2024-04-25T09:03:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.237+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb55415e5f0 con 0x7fb554071ed0 2024-04-25T09:03:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.237+0000 7fb5517fa640 1 -- 172.21.15.5:0/2833676754 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb548058e10 con 0x7fb554071ed0 2024-04-25T09:03:16.226 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:03:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb53806b4d0 msgr2=0x7fb53806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb53806b4d0 0x7fb53806d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb55415c380 tx=0x7fb540009040 comp rx=0 tx=0).stop 2024-04-25T09:03:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 msgr2=0x7fb5540ac6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540ac6f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb54800e810 tx=0x7fb54800ecd0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 shutdown_connections 2024-04-25T09:03:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb53806b4d0 0x7fb53806d990 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb55415e880 0x7fb5541ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb55415a340 0x7fb5541f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 --2- 172.21.15.5:0/2833676754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb554071ed0 0x7fb5540ac6f0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 >> 172.21.15.5:0/2833676754 conn(0x7fb5540b1550 msgr2=0x7fb554151580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 shutdown_connections 2024-04-25T09:03:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.239+0000 7fb55b215640 1 -- 172.21.15.5:0/2833676754 wait complete. 2024-04-25T09:03:16.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.353+0000 7f02c8bc1640 1 Processor -- start 2024-04-25T09:03:16.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.353+0000 7f02c8bc1640 1 -- start start 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c8bc1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02c415de70 0x7f02c40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c8bc1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c40d20e0 con 0x7f02c40b2cc0 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c8bc1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c40d23c0 con 0x7f02c40ce7f0 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c8bc1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c40d2a10 con 0x7f02c415de70 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02c415de70 0x7f02c40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02bbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02c40b2cc0 0x7f02c40b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33874/0 (socket says 172.21.15.5:33874) 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02bbfff640 1 -- 172.21.15.5:0/705966278 learned_addr learned my addr 172.21.15.5:0/705966278 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c259c640 1 -- 172.21.15.5:0/705966278 >> v1:172.21.15.80:6789/0 conn(0x7f02c40ce7f0 legacy=0x7f02c40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c259c640 1 -- 172.21.15.5:0/705966278 >> v1:172.21.15.5:6789/0 conn(0x7f02c40b2cc0 legacy=0x7f02c40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c259c640 1 -- 172.21.15.5:0/705966278 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40d26a0 con 0x7f02c415de70 2024-04-25T09:03:16.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.354+0000 7f02c1d9b640 1 -- 172.21.15.5:0/705966278 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311753464 0 0) 0x7f02c40d20e0 con 0x7f02c40b2cc0 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c259c640 1 --2- 172.21.15.5:0/705966278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c415de70 0x7f02c40b93e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097a0 tx=0x7f02b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc421312fadfaee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c1d9b640 1 -- 172.21.15.5:0/705966278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4037070 con 0x7f02c415de70 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c1d9b640 1 -- 172.21.15.5:0/705966278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4032440 con 0x7f02c415de70 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c1d9b640 1 -- 172.21.15.5:0/705966278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4032810 con 0x7f02c415de70 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c8bc1640 1 -- 172.21.15.5:0/705966278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c415de70 msgr2=0x7f02c40b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/705966278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c415de70 0x7f02c40b93e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097a0 tx=0x7f02b402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c8bc1640 1 -- 172.21.15.5:0/705966278 shutdown_connections 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.355+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/705966278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c415de70 0x7f02c40b93e0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.356+0000 7f02c8bc1640 1 -- 172.21.15.5:0/705966278 >> 172.21.15.5:0/705966278 conn(0x7f02c406b000 msgr2=0x7f02c406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.356+0000 7f02c8bc1640 1 -- 172.21.15.5:0/705966278 shutdown_connections 2024-04-25T09:03:16.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.356+0000 7f02c8bc1640 1 -- 172.21.15.5:0/705966278 wait complete. 2024-04-25T09:03:16.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.357+0000 7f02c8bc1640 1 Processor -- start 2024-04-25T09:03:16.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.357+0000 7f02c8bc1640 1 -- start start 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c40b2cc0 0x7f02c414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c40ce7f0 0x7f02c41f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02c415de70 0x7f02c41f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40d2ea0 con 0x7f02c40ce7f0 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40b7300 con 0x7f02c40b2cc0 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40d3020 con 0x7f02c415de70 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c40ce7f0 0x7f02c41f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c40ce7f0 0x7f02c41f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44012/0 (socket says 172.21.15.5:44012) 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 -- 172.21.15.5:0/839591335 learned_addr learned my addr 172.21.15.5:0/839591335 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c2d9d640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02c415de70 0x7f02c41f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c259c640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c40b2cc0 0x7f02c414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 -- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02c415de70 msgr2=0x7f02c41f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02c415de70 0x7f02c41f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 -- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c40b2cc0 msgr2=0x7f02c414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c40b2cc0 0x7f02c414f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 -- 172.21.15.5:0/839591335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40c92c0 con 0x7f02c40ce7f0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c2d9d640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02c415de70 0x7f02c41f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c259c640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c40b2cc0 0x7f02c414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02bbfff640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c40ce7f0 0x7f02c41f2c10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c4d0 tx=0x7f02ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02baffd640 1 -- 172.21.15.5:0/839591335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac018070 con 0x7f02c40ce7f0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02baffd640 1 -- 172.21.15.5:0/839591335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac007500 con 0x7f02c40ce7f0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02baffd640 1 -- 172.21.15.5:0/839591335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac004a20 con 0x7f02c40ce7f0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c40c95a0 con 0x7f02c40ce7f0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.358+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c40c9b60 con 0x7f02c40ce7f0 2024-04-25T09:03:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.359+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c404ef20 con 0x7f02c40ce7f0 2024-04-25T09:03:16.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.360+0000 7f02baffd640 1 -- 172.21.15.5:0/839591335 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02ac01b070 con 0x7f02c40ce7f0 2024-04-25T09:03:16.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.360+0000 7f02baffd640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a406b500 0x7f02a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.361+0000 7f02baffd640 1 -- 172.21.15.5:0/839591335 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02ac089490 con 0x7f02c40ce7f0 2024-04-25T09:03:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.361+0000 7f02c259c640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a406b500 0x7f02a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.361+0000 7f02c259c640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a406b500 0x7f02a406d9c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f02b4034000 tx=0x7f02b402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.365+0000 7f02baffd640 1 -- 172.21.15.5:0/839591335 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02ac0583a0 con 0x7f02c40ce7f0 2024-04-25T09:03:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.557+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02c40cf8d0 con 0x7f02c40ce7f0 2024-04-25T09:03:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.557+0000 7f02baffd640 1 -- 172.21.15.5:0/839591335 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) v1 ==== 80+0+0 (secure 0 0 0) 0x7f02ac057ca0 con 0x7f02c40ce7f0 2024-04-25T09:03:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T09:03:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a406b500 msgr2=0x7f02a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a406b500 0x7f02a406d9c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f02b4034000 tx=0x7f02b402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c40ce7f0 msgr2=0x7f02c41f2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c40ce7f0 0x7f02c41f2c10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c4d0 tx=0x7f02ac00c990 comp rx=0 tx=0).stop 2024-04-25T09:03:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 shutdown_connections 2024-04-25T09:03:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02a406b500 0x7f02a406d9c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02c415de70 0x7f02c41f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c40ce7f0 0x7f02c41f2c10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 --2- 172.21.15.5:0/839591335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c40b2cc0 0x7f02c414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 >> 172.21.15.5:0/839591335 conn(0x7f02c406b000 msgr2=0x7f02c40b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 shutdown_connections 2024-04-25T09:03:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:16.559+0000 7f02c8bc1640 1 -- 172.21.15.5:0/839591335 wait complete. 2024-04-25T09:03:16.559 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:03:16.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:16.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:17.191 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:03:17.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:17.192 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:03:17.207 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:03:17.207 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:17.223 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:17.223 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:03:17.223 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:17.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:17.263 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:03:17.263 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:17.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:17.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:17.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:17.307 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.417+0000 7fadf54ac640 1 Processor -- start 2024-04-25T09:03:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.417+0000 7fadf54ac640 1 -- start start 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadf54ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf015de70 0x7fadf00b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadf54ac640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadf00b2cc0 0x7fadf00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadf54ac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00d20e0 con 0x7fadf00b7130 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadf54ac640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf00d2a10 con 0x7fadf00b2cc0 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadf54ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00d23c0 con 0x7fadf015de70 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fade7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadf00b2cc0 0x7fadf00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadef7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fadf00b7130 0x7fadf00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:42350/0 (socket says 172.21.15.5:42350) 2024-04-25T09:03:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadef7fe640 1 -- 172.21.15.5:0/3061178196 learned_addr learned my addr 172.21.15.5:0/3061178196 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadeeffd640 1 --2- 172.21.15.5:0/3061178196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf015de70 0x7fadf00b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadeeffd640 1 -- 172.21.15.5:0/3061178196 >> v2:172.21.15.80:3300/0 conn(0x7fadf00b2cc0 msgr2=0x7fadf00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadeeffd640 1 --2- 172.21.15.5:0/3061178196 >> v2:172.21.15.80:3300/0 conn(0x7fadf00b2cc0 0x7fadf00b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadeeffd640 1 -- 172.21.15.5:0/3061178196 >> v1:172.21.15.80:6789/0 conn(0x7fadf00b7130 legacy=0x7fadf00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadeeffd640 1 -- 172.21.15.5:0/3061178196 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00d26a0 con 0x7fadf015de70 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fadee7fc640 1 -- 172.21.15.5:0/3061178196 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907145753 0 0) 0x7fadf00d20e0 con 0x7fadf00b7130 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.418+0000 7fade7fff640 1 --2- 172.21.15.5:0/3061178196 >> v2:172.21.15.80:3300/0 conn(0x7fadf00b2cc0 0x7fadf00b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.419+0000 7fadeeffd640 1 --2- 172.21.15.5:0/3061178196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf015de70 0x7fadf00b93e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fade00097a0 tx=0x7fade002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6b4afc68654f81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.419+0000 7fadee7fc640 1 -- 172.21.15.5:0/3061178196 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0037070 con 0x7fadf015de70 2024-04-25T09:03:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.419+0000 7fadee7fc640 1 -- 172.21.15.5:0/3061178196 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0032440 con 0x7fadf015de70 2024-04-25T09:03:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.419+0000 7fadee7fc640 1 -- 172.21.15.5:0/3061178196 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0032810 con 0x7fadf015de70 2024-04-25T09:03:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 -- 172.21.15.5:0/3061178196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf015de70 msgr2=0x7fadf00b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 --2- 172.21.15.5:0/3061178196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf015de70 0x7fadf00b93e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fade00097a0 tx=0x7fade002a180 comp rx=0 tx=0).stop 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 -- 172.21.15.5:0/3061178196 shutdown_connections 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 --2- 172.21.15.5:0/3061178196 >> v2:172.21.15.80:3300/0 conn(0x7fadf00b2cc0 0x7fadf00b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 --2- 172.21.15.5:0/3061178196 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf015de70 0x7fadf00b93e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 -- 172.21.15.5:0/3061178196 >> 172.21.15.5:0/3061178196 conn(0x7fadf006b000 msgr2=0x7fadf006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 -- 172.21.15.5:0/3061178196 shutdown_connections 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.420+0000 7fadf54ac640 1 -- 172.21.15.5:0/3061178196 wait complete. 2024-04-25T09:03:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.421+0000 7fadf54ac640 1 Processor -- start 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.421+0000 7fadf54ac640 1 -- start start 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadf54ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf00b2cc0 0x7fadf0155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadf54ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf00b7130 0x7fadf00c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadf54ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadf015de70 0x7fadf00b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadf54ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cf080 con 0x7fadf00b7130 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadf54ac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cef00 con 0x7fadf015de70 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadf54ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cf200 con 0x7fadf00b2cc0 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf00b7130 0x7fadf00c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf00b7130 0x7fadf00c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44022/0 (socket says 172.21.15.5:44022) 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 -- 172.21.15.5:0/1660717904 learned_addr learned my addr 172.21.15.5:0/1660717904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadeeffd640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf00b2cc0 0x7fadf0155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fadef7fe640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadf015de70 0x7fadf00b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 -- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf00b2cc0 msgr2=0x7fadf0155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf00b2cc0 0x7fadf0155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 -- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadf015de70 msgr2=0x7fadf00b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadf015de70 0x7fadf00b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.422+0000 7fade7fff640 1 -- 172.21.15.5:0/1660717904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00c7e00 con 0x7fadf00b7130 2024-04-25T09:03:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.423+0000 7fade7fff640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf00b7130 0x7fadf00c7480 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fadd800ec10 tx=0x7fadd800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.423+0000 7fade77fe640 1 -- 172.21.15.5:0/1660717904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8017070 con 0x7fadf00b7130 2024-04-25T09:03:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.423+0000 7fade77fe640 1 -- 172.21.15.5:0/1660717904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800cc30 con 0x7fadf00b7130 2024-04-25T09:03:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.423+0000 7fade77fe640 1 -- 172.21.15.5:0/1660717904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8013470 con 0x7fadf00b7130 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.423+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00c80e0 con 0x7fadf00b7130 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.423+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00c86a0 con 0x7fadf00b7130 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.424+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf00b3220 con 0x7fadf00b7130 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.424+0000 7fade77fe640 1 -- 172.21.15.5:0/1660717904 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fadd801a070 con 0x7fadf00b7130 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.425+0000 7fade77fe640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadd006b4d0 0x7fadd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.425+0000 7fade77fe640 1 -- 172.21.15.5:0/1660717904 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadd808a4a0 con 0x7fadf00b7130 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.425+0000 7fadeeffd640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadd006b4d0 0x7fadd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.425+0000 7fadeeffd640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadd006b4d0 0x7fadd006d990 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fade0034000 tx=0x7fade002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.429+0000 7fade77fe640 1 -- 172.21.15.5:0/1660717904 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fadf00b3220 con 0x7fadf00b7130 2024-04-25T09:03:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.646+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf00b2760 con 0x7fadf00b7130 2024-04-25T09:03:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.647+0000 7fade77fe640 1 -- 172.21.15.5:0/1660717904 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fadd80593b0 con 0x7fadf00b7130 2024-04-25T09:03:17.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:17.636 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:46.467722+0000","modified":"2024-04-25T09:02:49.472605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7497":{"gid":7497,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1143707602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1143707602},{"type":"v1","addr":"172.21.15.80:6837","nonce":1143707602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:03:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-04-25T09:03:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadd006b4d0 msgr2=0x7fadd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadd006b4d0 0x7fadd006d990 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fade0034000 tx=0x7fade002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf00b7130 msgr2=0x7fadf00c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf00b7130 0x7fadf00c7480 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fadd800ec10 tx=0x7fadd800c520 comp rx=0 tx=0).stop 2024-04-25T09:03:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 shutdown_connections 2024-04-25T09:03:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadd006b4d0 0x7fadd006d990 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadf015de70 0x7fadf00b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf00b7130 0x7fadf00c7480 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 --2- 172.21.15.5:0/1660717904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadf00b2cc0 0x7fadf0155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 >> 172.21.15.5:0/1660717904 conn(0x7fadf006b000 msgr2=0x7fadf015a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 shutdown_connections 2024-04-25T09:03:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.649+0000 7fadf54ac640 1 -- 172.21.15.5:0/1660717904 wait complete. 2024-04-25T09:03:17.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:17.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.762+0000 7f50a199e640 1 Processor -- start 2024-04-25T09:03:17.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.762+0000 7f50a199e640 1 -- start start 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.762+0000 7f50a199e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c15ba80 0x7f509c0d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.762+0000 7f50a199e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f509c0cf340 0x7f509c0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.762+0000 7f50a199e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c0b3040 con 0x7f509c0ce6a0 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.762+0000 7f50a199e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c0b1270 con 0x7f509c0cf340 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.762+0000 7f50a199e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0b1550 con 0x7f509c15ba80 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f509bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f509c0cf340 0x7f509c0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f50a119d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f509c0ce6a0 0x7f509c0cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33886/0 (socket says 172.21.15.5:33886) 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f50a119d640 1 -- 172.21.15.5:0/1069592461 learned_addr learned my addr 172.21.15.5:0/1069592461 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f50a099c640 1 --2- 172.21.15.5:0/1069592461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c15ba80 0x7f509c0d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f509bfff640 1 -- 172.21.15.5:0/1069592461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c15ba80 msgr2=0x7f509c0d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f509bfff640 1 --2- 172.21.15.5:0/1069592461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c15ba80 0x7f509c0d2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f509bfff640 1 -- 172.21.15.5:0/1069592461 >> v1:172.21.15.5:6789/0 conn(0x7f509c0ce6a0 legacy=0x7f509c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f509bfff640 1 -- 172.21.15.5:0/1069592461 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0b1830 con 0x7f509c0cf340 2024-04-25T09:03:17.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.763+0000 7f509b7fe640 1 -- 172.21.15.5:0/1069592461 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908954486 0 0) 0x7f509c0b3040 con 0x7f509c0ce6a0 2024-04-25T09:03:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f509bfff640 1 --2- 172.21.15.5:0/1069592461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c0ce160 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f50900097a0 tx=0x7f509002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952f7fefee352ff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f509b7fe640 1 -- 172.21.15.5:0/1069592461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090037070 con 0x7f509c0cf340 2024-04-25T09:03:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f509b7fe640 1 -- 172.21.15.5:0/1069592461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090032440 con 0x7f509c0cf340 2024-04-25T09:03:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f509b7fe640 1 -- 172.21.15.5:0/1069592461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090032810 con 0x7f509c0cf340 2024-04-25T09:03:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 -- 172.21.15.5:0/1069592461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 msgr2=0x7f509c0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 --2- 172.21.15.5:0/1069592461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c0ce160 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f50900097a0 tx=0x7f509002a210 comp rx=0 tx=0).stop 2024-04-25T09:03:17.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 -- 172.21.15.5:0/1069592461 shutdown_connections 2024-04-25T09:03:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 --2- 172.21.15.5:0/1069592461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c0ce160 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 --2- 172.21.15.5:0/1069592461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c15ba80 0x7f509c0d2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 -- 172.21.15.5:0/1069592461 >> 172.21.15.5:0/1069592461 conn(0x7f509c0d1770 msgr2=0x7f509c0d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 -- 172.21.15.5:0/1069592461 shutdown_connections 2024-04-25T09:03:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.764+0000 7f50a199e640 1 -- 172.21.15.5:0/1069592461 wait complete. 2024-04-25T09:03:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.766+0000 7f50a199e640 1 Processor -- start 2024-04-25T09:03:17.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.766+0000 7f50a199e640 1 -- start start 2024-04-25T09:03:17.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.766+0000 7f50a199e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c0ce6a0 0x7f509c154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.766+0000 7f50a199e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c1f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.766+0000 7f50a199e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f509c15ba80 0x7f509c0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.766+0000 7f50a199e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0cd5d0 con 0x7f509c0cf340 2024-04-25T09:03:17.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50a199e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c15be60 con 0x7f509c15ba80 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50a199e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0cd750 con 0x7f509c0ce6a0 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c1f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c1f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44050/0 (socket says 172.21.15.5:44050) 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 -- 172.21.15.5:0/3339831629 learned_addr learned my addr 172.21.15.5:0/3339831629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50a119d640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f509c15ba80 0x7f509c0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50a099c640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c0ce6a0 0x7f509c154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 -- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c0ce6a0 msgr2=0x7f509c154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c0ce6a0 0x7f509c154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 -- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f509c15ba80 msgr2=0x7f509c0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f509c15ba80 0x7f509c0c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 -- 172.21.15.5:0/3339831629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0c7380 con 0x7f509c0cf340 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50a119d640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f509c15ba80 0x7f509c0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f509bfff640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c1f1dc0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f5090035040 tx=0x7f50900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50997fa640 1 -- 172.21.15.5:0/3339831629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090037050 con 0x7f509c0cf340 2024-04-25T09:03:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50997fa640 1 -- 172.21.15.5:0/3339831629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090038040 con 0x7f509c0cf340 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c0c7660 con 0x7f509c0cf340 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50997fa640 1 -- 172.21.15.5:0/3339831629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090004490 con 0x7f509c0cf340 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.767+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c0c7c20 con 0x7f509c0cf340 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.768+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c074f70 con 0x7f509c0cf340 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.769+0000 7f50997fa640 1 -- 172.21.15.5:0/3339831629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f509003c6d0 con 0x7f509c0cf340 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.769+0000 7f50997fa640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f508806b500 0x7f508806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.769+0000 7f50997fa640 1 -- 172.21.15.5:0/3339831629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50900aabc0 con 0x7f509c0cf340 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.769+0000 7f50a099c640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f508806b500 0x7f508806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.770+0000 7f50a099c640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f508806b500 0x7f508806d9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f509c15ec80 tx=0x7f508c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.774+0000 7f50997fa640 1 -- 172.21.15.5:0/3339831629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5090079b60 con 0x7f509c0cf340 2024-04-25T09:03:17.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.957+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f509c0b7540 con 0x7f509c0cf340 2024-04-25T09:03:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.959+0000 7f50997fa640 1 -- 172.21.15.5:0/3339831629 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16576 (secure 0 0 0) 0x7f5090079460 con 0x7f509c0cf340 2024-04-25T09:03:17.948 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:17.948 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:48.102831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:44.744734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:45.440447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f508806b500 msgr2=0x7f508806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f508806b500 0x7f508806d9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f509c15ec80 tx=0x7f508c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 msgr2=0x7f509c1f1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c1f1dc0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f5090035040 tx=0x7f50900046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 shutdown_connections 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f508806b500 0x7f508806d9c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f509c15ba80 0x7f509c0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f509c0cf340 0x7f509c1f1dc0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 --2- 172.21.15.5:0/3339831629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f509c0ce6a0 0x7f509c154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 >> 172.21.15.5:0/3339831629 conn(0x7f509c0d1770 msgr2=0x7f509c0d1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 shutdown_connections 2024-04-25T09:03:17.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:17.961+0000 7f50a199e640 1 -- 172.21.15.5:0/3339831629 wait complete. 2024-04-25T09:03:17.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:44.744734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:45.440447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:17.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.076+0000 7fb9ec132640 1 Processor -- start 2024-04-25T09:03:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.076+0000 7fb9ec132640 1 -- start start 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.076+0000 7fb9ec132640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e415bce0 0x7fb9e406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ec132640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9e40b3b90 0x7fb9e40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ec132640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e415c0c0 con 0x7fb9e40cf790 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ec132640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40d0130 con 0x7fb9e40b3b90 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ec132640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4070e90 con 0x7fb9e415bce0 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ea6cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9e40b3b90 0x7fb9e40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ea6cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9e40b3b90 0x7fb9e40cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44054/0 (socket says 172.21.15.5:44054) 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/2220083443 learned_addr learned my addr 172.21.15.5:0/2220083443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9e9ece640 1 --2- 172.21.15.5:0/2220083443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e415bce0 0x7fb9e406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/2220083443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e415bce0 msgr2=0x7fb9e406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ea6cf640 1 --2- 172.21.15.5:0/2220083443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e415bce0 0x7fb9e406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/2220083443 >> v1:172.21.15.80:6789/0 conn(0x7fb9e40cf790 legacy=0x7fb9e40b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.077+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/2220083443 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4071170 con 0x7fb9e40b3b90 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9ea6cf640 1 --2- 172.21.15.5:0/2220083443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e40b3b90 0x7fb9e40cfbf0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009e50 tx=0x7fb9dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcf12576840e5bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9e8ecc640 1 -- 172.21.15.5:0/2220083443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc036070 con 0x7fb9e40b3b90 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9e8ecc640 1 -- 172.21.15.5:0/2220083443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc031600 con 0x7fb9e40b3b90 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9e8ecc640 1 -- 172.21.15.5:0/2220083443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0319d0 con 0x7fb9e40b3b90 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9ec132640 1 -- 172.21.15.5:0/2220083443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e40b3b90 msgr2=0x7fb9e40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9ec132640 1 --2- 172.21.15.5:0/2220083443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e40b3b90 0x7fb9e40cfbf0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009e50 tx=0x7fb9dc02a710 comp rx=0 tx=0).stop 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9ec132640 1 -- 172.21.15.5:0/2220083443 shutdown_connections 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9ec132640 1 --2- 172.21.15.5:0/2220083443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e40b3b90 0x7fb9e40cfbf0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9ec132640 1 --2- 172.21.15.5:0/2220083443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e415bce0 0x7fb9e406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.078+0000 7fb9ec132640 1 -- 172.21.15.5:0/2220083443 >> 172.21.15.5:0/2220083443 conn(0x7fb9e40b1550 msgr2=0x7fb9e40b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.079+0000 7fb9ec132640 1 -- 172.21.15.5:0/2220083443 shutdown_connections 2024-04-25T09:03:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.079+0000 7fb9ec132640 1 -- 172.21.15.5:0/2220083443 wait complete. 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 Processor -- start 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 -- start start 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e40b3b90 0x7fb9e415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e40cf790 0x7fb9e4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e415bce0 0x7fb9e414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b4140 con 0x7fb9e415bce0 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4071730 con 0x7fb9e40cf790 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.080+0000 7fb9ec132640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e406c940 con 0x7fb9e40b3b90 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e415bce0 0x7fb9e414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e415bce0 0x7fb9e414ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44068/0 (socket says 172.21.15.5:44068) 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/3585007433 learned_addr learned my addr 172.21.15.5:0/3585007433 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9e9ece640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e40b3b90 0x7fb9e415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9e96cd640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e40cf790 0x7fb9e4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e40b3b90 msgr2=0x7fb9e415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e40b3b90 0x7fb9e415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e40cf790 msgr2=0x7fb9e4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e40cf790 0x7fb9e4152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 -- 172.21.15.5:0/3585007433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e41530e0 con 0x7fb9e415bce0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ea6cf640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e415bce0 0x7fb9e414ab40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009e50 tx=0x7fb9dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9da7fc640 1 -- 172.21.15.5:0/3585007433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc036050 con 0x7fb9e415bce0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9da7fc640 1 -- 172.21.15.5:0/3585007433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc042070 con 0x7fb9e415bce0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9da7fc640 1 -- 172.21.15.5:0/3585007433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc009510 con 0x7fb9e415bce0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e4153390 con 0x7fb9e415bce0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.081+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4153950 con 0x7fb9e415bce0 2024-04-25T09:03:18.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.082+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e404ef20 con 0x7fb9e415bce0 2024-04-25T09:03:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.083+0000 7fb9da7fc640 1 -- 172.21.15.5:0/3585007433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9dc007bd0 con 0x7fb9e415bce0 2024-04-25T09:03:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.083+0000 7fb9da7fc640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9c806b4d0 0x7fb9c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.083+0000 7fb9da7fc640 1 -- 172.21.15.5:0/3585007433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9dc0aaf30 con 0x7fb9e415bce0 2024-04-25T09:03:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.083+0000 7fb9e9ece640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9c806b4d0 0x7fb9c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.084+0000 7fb9e9ece640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9c806b4d0 0x7fb9c806d990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0006fd0 tx=0x7fb9e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.087+0000 7fb9da7fc640 1 -- 172.21.15.5:0/3585007433 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9dc079760 con 0x7fb9e415bce0 2024-04-25T09:03:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.268+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9e406e240 con 0x7fb9e415bce0 2024-04-25T09:03:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.269+0000 7fb9da7fc640 1 -- 172.21.15.5:0/3585007433 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9dc07d800 con 0x7fb9e415bce0 2024-04-25T09:03:18.258 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:03:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9c806b4d0 msgr2=0x7fb9c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9c806b4d0 0x7fb9c806d990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0006fd0 tx=0x7fb9e0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e415bce0 msgr2=0x7fb9e414ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e415bce0 0x7fb9e414ab40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009e50 tx=0x7fb9dc004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 shutdown_connections 2024-04-25T09:03:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb9c806b4d0 0x7fb9c806d990 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9e415bce0 0x7fb9e414ab40 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e40cf790 0x7fb9e4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 --2- 172.21.15.5:0/3585007433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb9e40b3b90 0x7fb9e415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 >> 172.21.15.5:0/3585007433 conn(0x7fb9e40b1550 msgr2=0x7fb9e406db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 shutdown_connections 2024-04-25T09:03:18.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.271+0000 7fb9ec132640 1 -- 172.21.15.5:0/3585007433 wait complete. 2024-04-25T09:03:18.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:18.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.386+0000 7fca9349e640 1 Processor -- start 2024-04-25T09:03:18.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.386+0000 7fca9349e640 1 -- start start 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca9349e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca8c0cf790 0x7fca8c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca9349e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c15c0c0 con 0x7fca8c15bce0 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca9349e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c06cb10 con 0x7fca8c0b3480 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca9349e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c070e90 con 0x7fca8c0cf790 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca9123a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca8c15bce0 0x7fca8c06c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33896/0 (socket says 172.21.15.5:33896) 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca9123a640 1 -- 172.21.15.5:0/1524244575 learned_addr learned my addr 172.21.15.5:0/1524244575 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca90a39640 1 --2- 172.21.15.5:0/1524244575 >> v2:172.21.15.80:3300/0 conn(0x7fca8c0cf790 0x7fca8c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017128318 0 0) 0x7fca8c15c0c0 con 0x7fca8c15bce0 2024-04-25T09:03:18.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.387+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca74003520 con 0x7fca8c15bce0 2024-04-25T09:03:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.388+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709405893 0 0) 0x7fca8c06cb10 con 0x7fca8c0b3480 2024-04-25T09:03:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.388+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca8c15c0c0 con 0x7fca8c0b3480 2024-04-25T09:03:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.388+0000 7fca90a39640 1 -- 172.21.15.5:0/1524244575 >> v1:172.21.15.80:6789/0 conn(0x7fca8c0b3480 legacy=0x7fca8c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.388+0000 7fca90a39640 1 -- 172.21.15.5:0/1524244575 >> v1:172.21.15.5:6789/0 conn(0x7fca8c15bce0 legacy=0x7fca8c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.388+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899919893 0 0) 0x7fca74003520 con 0x7fca8c15bce0 2024-04-25T09:03:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.388+0000 7fca90a39640 1 -- 172.21.15.5:0/1524244575 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c071170 con 0x7fca8c0cf790 2024-04-25T09:03:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.388+0000 7fca90a39640 1 --2- 172.21.15.5:0/1524244575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0cf790 0x7fca8c0cfc20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fca800097a0 tx=0x7fca8002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71c64c775cb07c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80037070 con 0x7fca8c0cf790 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8002ac50 con 0x7fca8c0cf790 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca8bfff640 1 -- 172.21.15.5:0/1524244575 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca840019f0 con 0x7fca8c0cf790 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca9349e640 1 -- 172.21.15.5:0/1524244575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0cf790 msgr2=0x7fca8c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca9349e640 1 --2- 172.21.15.5:0/1524244575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0cf790 0x7fca8c0cfc20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fca800097a0 tx=0x7fca8002a1c0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca9349e640 1 -- 172.21.15.5:0/1524244575 shutdown_connections 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca9349e640 1 --2- 172.21.15.5:0/1524244575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0cf790 0x7fca8c0cfc20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca9349e640 1 -- 172.21.15.5:0/1524244575 >> 172.21.15.5:0/1524244575 conn(0x7fca8c0b1550 msgr2=0x7fca8c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca9349e640 1 -- 172.21.15.5:0/1524244575 shutdown_connections 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.389+0000 7fca9349e640 1 -- 172.21.15.5:0/1524244575 wait complete. 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 Processor -- start 2024-04-25T09:03:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 -- start start 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0b3480 0x7fca8c14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca8c0cf790 0x7fca8c15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca8c15bce0 0x7fca8c1f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0b4140 con 0x7fca8c15bce0 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c071730 con 0x7fca8c0b3480 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca9349e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c071c50 con 0x7fca8c0cf790 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.391+0000 7fca91a3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca8c15bce0 0x7fca8c1f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca8c15bce0 0x7fca8c1f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44080/0 (socket says 172.21.15.5:44080) 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 -- 172.21.15.5:0/1376221913 learned_addr learned my addr 172.21.15.5:0/1376221913 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca9123a640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0b3480 0x7fca8c14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca90a39640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca8c0cf790 0x7fca8c15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 -- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca8c0cf790 msgr2=0x7fca8c15e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca8c0cf790 0x7fca8c15e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 -- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0b3480 msgr2=0x7fca8c14bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0b3480 0x7fca8c14bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 -- 172.21.15.5:0/1376221913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c15f0b0 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca90a39640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca8c0cf790 0x7fca8c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca91a3b640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca8c15bce0 0x7fca8c1f2e40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c400 tx=0x7fca7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca89ffb640 1 -- 172.21.15.5:0/1376221913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c017070 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca89ffb640 1 -- 172.21.15.5:0/1376221913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0052d0 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca89ffb640 1 -- 172.21.15.5:0/1376221913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0037f0 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c15c290 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.392+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c15c850 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.393+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c1f5030 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.394+0000 7fca89ffb640 1 -- 172.21.15.5:0/1376221913 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca7c01a070 con 0x7fca8c15bce0 2024-04-25T09:03:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.394+0000 7fca89ffb640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca7806b4d0 0x7fca7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.394+0000 7fca89ffb640 1 -- 172.21.15.5:0/1376221913 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca7c0894f0 con 0x7fca8c15bce0 2024-04-25T09:03:18.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.394+0000 7fca9123a640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca7806b4d0 0x7fca7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.395+0000 7fca9123a640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca7806b4d0 0x7fca7806d990 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fca84001b60 tx=0x7fca84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.399+0000 7fca89ffb640 1 -- 172.21.15.5:0/1376221913 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca7c057d20 con 0x7fca8c15bce0 2024-04-25T09:03:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.578+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca8c04ef20 con 0x7fca8c15bce0 2024-04-25T09:03:18.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.578+0000 7fca89ffb640 1 -- 172.21.15.5:0/1376221913 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca7c05bdc0 con 0x7fca8c15bce0 2024-04-25T09:03:18.622 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:03:18.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca7806b4d0 msgr2=0x7fca7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca7806b4d0 0x7fca7806d990 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fca84001b60 tx=0x7fca84009040 comp rx=0 tx=0).stop 2024-04-25T09:03:18.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca8c15bce0 msgr2=0x7fca8c1f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca8c15bce0 0x7fca8c1f2e40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c400 tx=0x7fca7c00c8c0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 shutdown_connections 2024-04-25T09:03:18.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca7806b4d0 0x7fca7806d990 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca8c15bce0 0x7fca8c1f2e40 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fca8c0cf790 0x7fca8c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.580+0000 7fca9349e640 1 --2- 172.21.15.5:0/1376221913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca8c0b3480 0x7fca8c14bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.581+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 >> 172.21.15.5:0/1376221913 conn(0x7fca8c0b1550 msgr2=0x7fca8c06cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.581+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 shutdown_connections 2024-04-25T09:03:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.581+0000 7fca9349e640 1 -- 172.21.15.5:0/1376221913 wait complete. 2024-04-25T09:03:18.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.739+0000 7f1565142640 1 Processor -- start 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f1565142640 1 -- start start 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f1565142640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f156015df10 0x7f15601618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f1565142640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15600b6250 0x7f15600ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f1565142640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15600d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f1565142640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600d20d0 con 0x7f156015df10 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f1565142640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1560162150 con 0x7f15600b6250 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f1565142640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1560162430 con 0x7f15600cee10 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.740+0000 7f155ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f156015df10 0x7f15601618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f156015df10 0x7f15601618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44084/0 (socket says 172.21.15.5:44084) 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155ed9d640 1 -- 172.21.15.5:0/1756337415 learned_addr learned my addr 172.21.15.5:0/1756337415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155e59c640 1 --2- 172.21.15.5:0/1756337415 >> v2:172.21.15.80:3300/0 conn(0x7f15600b6250 0x7f15600ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155f59e640 1 --2- 172.21.15.5:0/1756337415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15600d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155ed9d640 1 -- 172.21.15.5:0/1756337415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 msgr2=0x7f15600d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155ed9d640 1 --2- 172.21.15.5:0/1756337415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15600d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155ed9d640 1 -- 172.21.15.5:0/1756337415 >> v2:172.21.15.80:3300/0 conn(0x7f15600b6250 msgr2=0x7f15600ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155ed9d640 1 --2- 172.21.15.5:0/1756337415 >> v2:172.21.15.80:3300/0 conn(0x7f15600b6250 0x7f15600ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155ed9d640 1 -- 172.21.15.5:0/1756337415 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560162710 con 0x7f156015df10 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.741+0000 7f155f59e640 1 --2- 172.21.15.5:0/1756337415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15600d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f155ed9d640 1 --2- 172.21.15.5:0/1756337415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15601618d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f15600b9d70 tx=0x7f155802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea892f2ffed23ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f155dd9b640 1 -- 172.21.15.5:0/1756337415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558037070 con 0x7f156015df10 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f155dd9b640 1 -- 172.21.15.5:0/1756337415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1558032440 con 0x7f156015df10 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f155dd9b640 1 -- 172.21.15.5:0/1756337415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558032810 con 0x7f156015df10 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 -- 172.21.15.5:0/1756337415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 msgr2=0x7f15601618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 --2- 172.21.15.5:0/1756337415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15601618d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f15600b9d70 tx=0x7f155802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 -- 172.21.15.5:0/1756337415 shutdown_connections 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 --2- 172.21.15.5:0/1756337415 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15600d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 --2- 172.21.15.5:0/1756337415 >> v2:172.21.15.80:3300/0 conn(0x7f15600b6250 0x7f15600ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 --2- 172.21.15.5:0/1756337415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15601618d0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 -- 172.21.15.5:0/1756337415 >> 172.21.15.5:0/1756337415 conn(0x7f15600668f0 msgr2=0x7f1560066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 -- 172.21.15.5:0/1756337415 shutdown_connections 2024-04-25T09:03:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.742+0000 7f1565142640 1 -- 172.21.15.5:0/1756337415 wait complete. 2024-04-25T09:03:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.744+0000 7f1565142640 1 Processor -- start 2024-04-25T09:03:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.744+0000 7f1565142640 1 -- start start 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15600b6250 0x7f15601f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15601f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15600cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600d0980 con 0x7f156015df10 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1560161e10 con 0x7f15600b6250 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15600d0b00 con 0x7f15600cee10 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15600cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15600cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44092/0 (socket says 172.21.15.5:44092) 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 -- 172.21.15.5:0/3411624521 learned_addr learned my addr 172.21.15.5:0/3411624521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155e59c640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15601f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155ed9d640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15600b6250 0x7f15601f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 -- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 msgr2=0x7f15601f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15601f7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 -- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15600b6250 msgr2=0x7f15601f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15600b6250 0x7f15601f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 -- 172.21.15.5:0/3411624521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600cd660 con 0x7f156015df10 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155ed9d640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15600b6250 0x7f15601f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f155f59e640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15600cc730 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f155000cf20 tx=0x7f155000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f15577fe640 1 -- 172.21.15.5:0/3411624521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155001a070 con 0x7f156015df10 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f15577fe640 1 -- 172.21.15.5:0/3411624521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155000d840 con 0x7f156015df10 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600cd380 con 0x7f156015df10 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f15577fe640 1 -- 172.21.15.5:0/3411624521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155000dc30 con 0x7f156015df10 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.745+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156014a330 con 0x7f156015df10 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.746+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156004ef20 con 0x7f156015df10 2024-04-25T09:03:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.747+0000 7f15577fe640 1 -- 172.21.15.5:0/3411624521 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f155001d070 con 0x7f156015df10 2024-04-25T09:03:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.747+0000 7f15577fe640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f154006b4d0 0x7f154006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.748+0000 7f15577fe640 1 -- 172.21.15.5:0/3411624521 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f155008aa60 con 0x7f156015df10 2024-04-25T09:03:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.748+0000 7f155ed9d640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f154006b4d0 0x7f154006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.748+0000 7f155ed9d640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f154006b4d0 0x7f154006d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1558034000 tx=0x7f155802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.752+0000 7f15577fe640 1 -- 172.21.15.5:0/3411624521 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1550059970 con 0x7f156015df10 2024-04-25T09:03:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.929+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15600b6030 con 0x7f156015df10 2024-04-25T09:03:18.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.930+0000 7f15577fe640 1 -- 172.21.15.5:0/3411624521 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1550059270 con 0x7f156015df10 2024-04-25T09:03:18.919 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:03:18.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f154006b4d0 msgr2=0x7f154006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f154006b4d0 0x7f154006d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1558034000 tx=0x7f155802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 msgr2=0x7f15600cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15600cc730 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f155000cf20 tx=0x7f155000a7d0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 shutdown_connections 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f154006b4d0 0x7f154006d990 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156015df10 0x7f15600cc730 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f15600cee10 0x7f15601f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 --2- 172.21.15.5:0/3411624521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15600b6250 0x7f15601f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 >> 172.21.15.5:0/3411624521 conn(0x7f15600668f0 msgr2=0x7f15600d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 shutdown_connections 2024-04-25T09:03:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:18.931+0000 7f1565142640 1 -- 172.21.15.5:0/3411624521 wait complete. 2024-04-25T09:03:18.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:19.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.044+0000 7f173d09e640 1 Processor -- start 2024-04-25T09:03:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.044+0000 7f173d09e640 1 -- start start 2024-04-25T09:03:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f173d09e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f173806b7d0 0x7f173806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f173d09e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f173d09e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17380b4730 con 0x7f173806bbb0 2024-04-25T09:03:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f173d09e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17380d0b70 con 0x7f173806b7d0 2024-04-25T09:03:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f173d09e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17380cbf30 con 0x7f173815e120 2024-04-25T09:03:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f1736d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f173806b7d0 0x7f173806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f1736d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f173806b7d0 0x7f173806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44096/0 (socket says 172.21.15.5:44096) 2024-04-25T09:03:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f1736d9d640 1 -- 172.21.15.5:0/1480003676 learned_addr learned my addr 172.21.15.5:0/1480003676 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f173759e640 1 --2- 172.21.15.5:0/1480003676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f1736d9d640 1 -- 172.21.15.5:0/1480003676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 msgr2=0x7f17380d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f1736d9d640 1 --2- 172.21.15.5:0/1480003676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f1736d9d640 1 -- 172.21.15.5:0/1480003676 >> v1:172.21.15.80:6789/0 conn(0x7f173806bbb0 legacy=0x7f173815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.045+0000 7f1736d9d640 1 -- 172.21.15.5:0/1480003676 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17380d0da0 con 0x7f173806b7d0 2024-04-25T09:03:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.046+0000 7f1736d9d640 1 --2- 172.21.15.5:0/1480003676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806b7d0 0x7f173806aef0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1728009870 tx=0x7f172802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cf166f5258f7b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.046+0000 7f173659c640 1 -- 172.21.15.5:0/1480003676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728037070 con 0x7f173806b7d0 2024-04-25T09:03:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.046+0000 7f173659c640 1 -- 172.21.15.5:0/1480003676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172802ae50 con 0x7f173806b7d0 2024-04-25T09:03:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.046+0000 7f173659c640 1 -- 172.21.15.5:0/1480003676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728032860 con 0x7f173806b7d0 2024-04-25T09:03:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 -- 172.21.15.5:0/1480003676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806b7d0 msgr2=0x7f173806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 --2- 172.21.15.5:0/1480003676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806b7d0 0x7f173806aef0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1728009870 tx=0x7f172802a300 comp rx=0 tx=0).stop 2024-04-25T09:03:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 -- 172.21.15.5:0/1480003676 shutdown_connections 2024-04-25T09:03:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 --2- 172.21.15.5:0/1480003676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 --2- 172.21.15.5:0/1480003676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806b7d0 0x7f173806aef0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 -- 172.21.15.5:0/1480003676 >> 172.21.15.5:0/1480003676 conn(0x7f17380d18e0 msgr2=0x7f17380d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 -- 172.21.15.5:0/1480003676 shutdown_connections 2024-04-25T09:03:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.047+0000 7f173d09e640 1 -- 172.21.15.5:0/1480003676 wait complete. 2024-04-25T09:03:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.048+0000 7f173d09e640 1 Processor -- start 2024-04-25T09:03:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.048+0000 7f173d09e640 1 -- start start 2024-04-25T09:03:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173d09e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f173806b7d0 0x7f1738152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173d09e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806bbb0 0x7f17380c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173d09e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173d09e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380cc460 con 0x7f173806bbb0 2024-04-25T09:03:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173d09e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380cc7d0 con 0x7f173806b7d0 2024-04-25T09:03:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173d09e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17380ccc60 con 0x7f173815e120 2024-04-25T09:03:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806bbb0 0x7f17380c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806bbb0 0x7f17380c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44100/0 (socket says 172.21.15.5:44100) 2024-04-25T09:03:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 -- 172.21.15.5:0/4027259960 learned_addr learned my addr 172.21.15.5:0/4027259960 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f1736d9d640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f173806b7d0 0x7f1738152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173759e640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 -- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 msgr2=0x7f17380b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 -- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f173806b7d0 msgr2=0x7f1738152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f173806b7d0 0x7f1738152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 -- 172.21.15.5:0/4027259960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738152780 con 0x7f173806bbb0 2024-04-25T09:03:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f1736d9d640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f173806b7d0 0x7f1738152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172ffff640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806bbb0 0x7f17380c5450 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f172000c400 tx=0x7f172000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172f7fe640 1 -- 172.21.15.5:0/4027259960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200052d0 con 0x7f173806bbb0 2024-04-25T09:03:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172f7fe640 1 -- 172.21.15.5:0/4027259960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720005490 con 0x7f173806bbb0 2024-04-25T09:03:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173815f990 con 0x7f173806bbb0 2024-04-25T09:03:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.049+0000 7f172f7fe640 1 -- 172.21.15.5:0/4027259960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720007260 con 0x7f173806bbb0 2024-04-25T09:03:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.050+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173815ff50 con 0x7f173806bbb0 2024-04-25T09:03:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.050+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173804ef20 con 0x7f173806bbb0 2024-04-25T09:03:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.051+0000 7f172f7fe640 1 -- 172.21.15.5:0/4027259960 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1720007400 con 0x7f173806bbb0 2024-04-25T09:03:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.051+0000 7f172f7fe640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.051+0000 7f172f7fe640 1 -- 172.21.15.5:0/4027259960 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17200897e0 con 0x7f173806bbb0 2024-04-25T09:03:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.052+0000 7f1736d9d640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.052+0000 7f1736d9d640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1728034000 tx=0x7f172802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.056+0000 7f172f7fe640 1 -- 172.21.15.5:0/4027259960 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1738152780 con 0x7f173806bbb0 2024-04-25T09:03:19.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.275+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f173806e790 con 0x7f173806bbb0 2024-04-25T09:03:19.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.276+0000 7f172f7fe640 1 -- 172.21.15.5:0/4027259960 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f17380b4730 con 0x7f173806bbb0 2024-04-25T09:03:19.265 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:19.266 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:46.467722+0000","modified":"2024-04-25T09:02:49.472605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7497":{"gid":7497,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1143707602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1143707602},{"type":"v1","addr":"172.21.15.80:6837","nonce":1143707602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:03:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 msgr2=0x7f171806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1728034000 tx=0x7f172802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806bbb0 msgr2=0x7f17380c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806bbb0 0x7f17380c5450 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f172000c400 tx=0x7f172000c8c0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 shutdown_connections 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f173815e120 0x7f17380b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173806bbb0 0x7f17380c5450 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 --2- 172.21.15.5:0/4027259960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f173806b7d0 0x7f1738152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 >> 172.21.15.5:0/4027259960 conn(0x7f17380d18e0 msgr2=0x7f17380cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 shutdown_connections 2024-04-25T09:03:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.278+0000 7f173d09e640 1 -- 172.21.15.5:0/4027259960 wait complete. 2024-04-25T09:03:19.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.391+0000 7fd744ab3640 1 Processor -- start 2024-04-25T09:03:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.392+0000 7fd744ab3640 1 -- start start 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.392+0000 7fd744ab3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd74015e0a0 0x7fd7400d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.392+0000 7fd744ab3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7400d3990 0x7fd7400d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.392+0000 7fd744ab3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7400b7f60 con 0x7fd7400ce5e0 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.392+0000 7fd744ab3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400d4330 con 0x7fd7400d3990 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.392+0000 7fd744ab3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400b29c0 con 0x7fd74015e0a0 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7400d3990 0x7fd7400d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd7400ce5e0 0x7fd7400cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33898/0 (socket says 172.21.15.5:33898) 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73ed9d640 1 -- 172.21.15.5:0/1448753966 learned_addr learned my addr 172.21.15.5:0/1448753966 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73e59c640 1 --2- 172.21.15.5:0/1448753966 >> v2:172.21.15.80:3300/0 conn(0x7fd74015e0a0 0x7fd7400d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73dd9b640 1 -- 172.21.15.5:0/1448753966 >> v2:172.21.15.80:3300/0 conn(0x7fd74015e0a0 msgr2=0x7fd7400d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73dd9b640 1 --2- 172.21.15.5:0/1448753966 >> v2:172.21.15.80:3300/0 conn(0x7fd74015e0a0 0x7fd7400d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73dd9b640 1 -- 172.21.15.5:0/1448753966 >> v1:172.21.15.5:6789/0 conn(0x7fd7400ce5e0 legacy=0x7fd7400cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73dd9b640 1 -- 172.21.15.5:0/1448753966 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400d2080 con 0x7fd7400d3990 2024-04-25T09:03:19.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.393+0000 7fd73d59a640 1 -- 172.21.15.5:0/1448753966 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571692577 0 0) 0x7fd7400b7f60 con 0x7fd7400ce5e0 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd73dd9b640 1 --2- 172.21.15.5:0/1448753966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400d3990 0x7fd7400d3df0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fd7400b6680 tx=0x7fd72802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39b7eea9ce8086b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd73d59a640 1 -- 172.21.15.5:0/1448753966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728037070 con 0x7fd7400d3990 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd73d59a640 1 -- 172.21.15.5:0/1448753966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd728032440 con 0x7fd7400d3990 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd73d59a640 1 -- 172.21.15.5:0/1448753966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728032810 con 0x7fd7400d3990 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 -- 172.21.15.5:0/1448753966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400d3990 msgr2=0x7fd7400d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 --2- 172.21.15.5:0/1448753966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400d3990 0x7fd7400d3df0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fd7400b6680 tx=0x7fd72802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 -- 172.21.15.5:0/1448753966 shutdown_connections 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 --2- 172.21.15.5:0/1448753966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400d3990 0x7fd7400d3df0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 --2- 172.21.15.5:0/1448753966 >> v2:172.21.15.80:3300/0 conn(0x7fd74015e0a0 0x7fd7400d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 -- 172.21.15.5:0/1448753966 >> 172.21.15.5:0/1448753966 conn(0x7fd7400668f0 msgr2=0x7fd740066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 -- 172.21.15.5:0/1448753966 shutdown_connections 2024-04-25T09:03:19.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.394+0000 7fd744ab3640 1 -- 172.21.15.5:0/1448753966 wait complete. 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 Processor -- start 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 -- start start 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400ce5e0 0x7fd74015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7400d3990 0x7fd7400ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74015e0a0 0x7fd7400cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400d2920 con 0x7fd7400ce5e0 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400d2640 con 0x7fd74015e0a0 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.396+0000 7fd744ab3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400d2c00 con 0x7fd7400d3990 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400ce5e0 0x7fd74015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400ce5e0 0x7fd74015c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44106/0 (socket says 172.21.15.5:44106) 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 -- 172.21.15.5:0/4185668264 learned_addr learned my addr 172.21.15.5:0/4185668264 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73ed9d640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74015e0a0 0x7fd7400cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73dd9b640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7400d3990 0x7fd7400ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 -- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7400d3990 msgr2=0x7fd7400ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7400d3990 0x7fd7400ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 -- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74015e0a0 msgr2=0x7fd7400cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74015e0a0 0x7fd7400cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 -- 172.21.15.5:0/4185668264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400b14f0 con 0x7fd7400ce5e0 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd73e59c640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400ce5e0 0x7fd74015c540 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fd73000efc0 tx=0x7fd73000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd736ffd640 1 -- 172.21.15.5:0/4185668264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730018020 con 0x7fd7400ce5e0 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd736ffd640 1 -- 172.21.15.5:0/4185668264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730014480 con 0x7fd7400ce5e0 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7400b17d0 con 0x7fd7400ce5e0 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd736ffd640 1 -- 172.21.15.5:0/4185668264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730014850 con 0x7fd7400ce5e0 2024-04-25T09:03:19.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.397+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7400b1d90 con 0x7fd7400ce5e0 2024-04-25T09:03:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.398+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740066f00 con 0x7fd7400ce5e0 2024-04-25T09:03:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.399+0000 7fd736ffd640 1 -- 172.21.15.5:0/4185668264 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd730005d10 con 0x7fd7400ce5e0 2024-04-25T09:03:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.399+0000 7fd736ffd640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd72006b4d0 0x7fd72006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.399+0000 7fd736ffd640 1 -- 172.21.15.5:0/4185668264 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd73008aff0 con 0x7fd7400ce5e0 2024-04-25T09:03:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.399+0000 7fd73dd9b640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd72006b4d0 0x7fd72006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.400+0000 7fd73dd9b640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd72006b4d0 0x7fd72006d990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd728034000 tx=0x7fd72802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.403+0000 7fd736ffd640 1 -- 172.21.15.5:0/4185668264 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd740066f00 con 0x7fd7400ce5e0 2024-04-25T09:03:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.584+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7400b21d0 con 0x7fd7400ce5e0 2024-04-25T09:03:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.586+0000 7fd736ffd640 1 -- 172.21.15.5:0/4185668264 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16576 (secure 0 0 0) 0x7fd730022030 con 0x7fd7400ce5e0 2024-04-25T09:03:19.575 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:19.575 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:48.102831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:44.744734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:45.440447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd72006b4d0 msgr2=0x7fd72006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd72006b4d0 0x7fd72006d990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd728034000 tx=0x7fd72802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400ce5e0 msgr2=0x7fd74015c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400ce5e0 0x7fd74015c540 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fd73000efc0 tx=0x7fd73000c490 comp rx=0 tx=0).stop 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 shutdown_connections 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd72006b4d0 0x7fd72006d990 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74015e0a0 0x7fd7400cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7400d3990 0x7fd7400ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 --2- 172.21.15.5:0/4185668264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7400ce5e0 0x7fd74015c540 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.587+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 >> 172.21.15.5:0/4185668264 conn(0x7fd7400668f0 msgr2=0x7fd7400b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.588+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 shutdown_connections 2024-04-25T09:03:19.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.588+0000 7fd744ab3640 1 -- 172.21.15.5:0/4185668264 wait complete. 2024-04-25T09:03:19.588 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:03:19.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.700+0000 7f341d2cb640 1 Processor -- start 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.700+0000 7f341d2cb640 1 -- start start 2024-04-25T09:03:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f341d2cb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f341815e0a0 0x7f34180d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f341d2cb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f341d2cb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34180b7f60 con 0x7f34180ce5e0 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f341d2cb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180d4330 con 0x7f341815e0a0 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f341d2cb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180b29c0 con 0x7f34180d3990 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f3416ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f341815e0a0 0x7f34180d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f34167fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f34177fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34180ce5e0 0x7f34180cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:42384/0 (socket says 172.21.15.5:42384) 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f34177fe640 1 -- 172.21.15.5:0/3531938638 learned_addr learned my addr 172.21.15.5:0/3531938638 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.701+0000 7f3415ffb640 1 -- 172.21.15.5:0/3531938638 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160628543 0 0) 0x7f34180b7f60 con 0x7f34180ce5e0 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.702+0000 7f3415ffb640 1 -- 172.21.15.5:0/3531938638 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3400003520 con 0x7f34180ce5e0 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.702+0000 7f3416ffd640 1 -- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 msgr2=0x7f34180d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.702+0000 7f3416ffd640 1 --2- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.702+0000 7f3416ffd640 1 -- 172.21.15.5:0/3531938638 >> v1:172.21.15.80:6789/0 conn(0x7f34180ce5e0 legacy=0x7f34180cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.702+0000 7f3416ffd640 1 -- 172.21.15.5:0/3531938638 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180d2080 con 0x7f341815e0a0 2024-04-25T09:03:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.702+0000 7f34167fc640 1 --2- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.702+0000 7f3416ffd640 1 --2- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341815e0a0 0x7f34180d0d50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f34100097a0 tx=0x7f341002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b90659b3bbecf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f3415ffb640 1 -- 172.21.15.5:0/3531938638 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410037070 con 0x7f341815e0a0 2024-04-25T09:03:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f3415ffb640 1 -- 172.21.15.5:0/3531938638 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3410032440 con 0x7f341815e0a0 2024-04-25T09:03:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f3415ffb640 1 -- 172.21.15.5:0/3531938638 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410032810 con 0x7f341815e0a0 2024-04-25T09:03:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 -- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341815e0a0 msgr2=0x7f34180d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341815e0a0 0x7f34180d0d50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f34100097a0 tx=0x7f341002a180 comp rx=0 tx=0).stop 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 -- 172.21.15.5:0/3531938638 shutdown_connections 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3531938638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341815e0a0 0x7f34180d0d50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 -- 172.21.15.5:0/3531938638 >> 172.21.15.5:0/3531938638 conn(0x7f34180668f0 msgr2=0x7f3418066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 -- 172.21.15.5:0/3531938638 shutdown_connections 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.703+0000 7f341d2cb640 1 -- 172.21.15.5:0/3531938638 wait complete. 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.704+0000 7f341d2cb640 1 Processor -- start 2024-04-25T09:03:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.704+0000 7f341d2cb640 1 -- start start 2024-04-25T09:03:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f341d2cb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34180ce5e0 0x7f34180b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f341d2cb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f341d2cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f341815e0a0 0x7f341815ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f341d2cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180d2920 con 0x7f341815e0a0 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f341d2cb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180d2640 con 0x7f34180ce5e0 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f341d2cb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180d2c00 con 0x7f34180d3990 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f34177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f341815e0a0 0x7f341815ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f34177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f341815e0a0 0x7f341815ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44108/0 (socket says 172.21.15.5:44108) 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f34177fe640 1 -- 172.21.15.5:0/3044741568 learned_addr learned my addr 172.21.15.5:0/3044741568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f3416ffd640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34180ce5e0 0x7f34180b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.705+0000 7f34167fc640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f34177fe640 1 -- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 msgr2=0x7f34180b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f34177fe640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f34177fe640 1 -- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34180ce5e0 msgr2=0x7f34180b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f34177fe640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34180ce5e0 0x7f34180b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f34177fe640 1 -- 172.21.15.5:0/3044741568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180b0af0 con 0x7f341815e0a0 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f34167fc640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f34177fe640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f341815e0a0 0x7f341815ffb0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f340800caa0 tx=0x7f340800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f33ff7fe640 1 -- 172.21.15.5:0/3044741568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408017070 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f33ff7fe640 1 -- 172.21.15.5:0/3044741568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340800ac00 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34180b0dd0 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f33ff7fe640 1 -- 172.21.15.5:0/3044741568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408012400 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.706+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34180b1390 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.707+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341804ef20 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.707+0000 7f33ff7fe640 1 -- 172.21.15.5:0/3044741568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f340801a070 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.708+0000 7f33ff7fe640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f340406b500 0x7f340406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.708+0000 7f33ff7fe640 1 -- 172.21.15.5:0/3044741568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3408089f00 con 0x7f341815e0a0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.708+0000 7f3416ffd640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f340406b500 0x7f340406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.709+0000 7f3416ffd640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f340406b500 0x7f340406d9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3410034000 tx=0x7f341002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.712+0000 7f33ff7fe640 1 -- 172.21.15.5:0/3044741568 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3408058730 con 0x7f341815e0a0 2024-04-25T09:03:19.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.930+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3418067050 con 0x7f341815e0a0 2024-04-25T09:03:19.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.930+0000 7f33ff7fe640 1 -- 172.21.15.5:0/3044741568 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f340805c7d0 con 0x7f341815e0a0 2024-04-25T09:03:19.919 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:19.920 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:46.467722+0000","modified":"2024-04-25T09:02:49.472605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7497":{"gid":7497,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1143707602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1143707602},{"type":"v1","addr":"172.21.15.80:6837","nonce":1143707602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:03:19.920 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f340406b500 msgr2=0x7f340406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f340406b500 0x7f340406d9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3410034000 tx=0x7f341002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f341815e0a0 msgr2=0x7f341815ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f341815e0a0 0x7f341815ffb0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f340800caa0 tx=0x7f340800cf60 comp rx=0 tx=0).stop 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 shutdown_connections 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f340406b500 0x7f340406d9c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f341815e0a0 0x7f341815ffb0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34180d3990 0x7f34180b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 --2- 172.21.15.5:0/3044741568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34180ce5e0 0x7f34180b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 >> 172.21.15.5:0/3044741568 conn(0x7f34180668f0 msgr2=0x7f34180d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 shutdown_connections 2024-04-25T09:03:19.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:19.933+0000 7f341d2cb640 1 -- 172.21.15.5:0/3044741568 wait complete. 2024-04-25T09:03:19.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.045+0000 7f3c05046640 1 Processor -- start 2024-04-25T09:03:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.045+0000 7f3c05046640 1 -- start start 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3c05046640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c0015de70 0x7f3c000b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3c05046640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c000b2cc0 0x7f3c000b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3c05046640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000d20e0 con 0x7f3c000b7130 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3c05046640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000d2a10 con 0x7f3c000b2cc0 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3c05046640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000d23c0 con 0x7f3c0015de70 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bf7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c000b2cc0 0x7f3c000b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bff59e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c000b7130 0x7f3c000ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33908/0 (socket says 172.21.15.5:33908) 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bff59e640 1 -- 172.21.15.5:0/88348180 learned_addr learned my addr 172.21.15.5:0/88348180 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bf7fff640 1 --2- 172.21.15.5:0/88348180 >> v2:172.21.15.5:3300/0 conn(0x7f3c000b2cc0 0x7f3c000b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44116/0 (socket says 172.21.15.5:44116) 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bfed9d640 1 --2- 172.21.15.5:0/88348180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c0015de70 0x7f3c000b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bf7fff640 1 -- 172.21.15.5:0/88348180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c0015de70 msgr2=0x7f3c000b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bf7fff640 1 --2- 172.21.15.5:0/88348180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c0015de70 0x7f3c000b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bf7fff640 1 -- 172.21.15.5:0/88348180 >> v1:172.21.15.5:6789/0 conn(0x7f3c000b7130 legacy=0x7f3c000ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bfe59c640 1 -- 172.21.15.5:0/88348180 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542411540 0 0) 0x7f3c000d20e0 con 0x7f3c000b7130 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bf7fff640 1 -- 172.21.15.5:0/88348180 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000d26a0 con 0x7f3c000b2cc0 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.046+0000 7f3bfed9d640 1 --2- 172.21.15.5:0/88348180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c0015de70 0x7f3c000b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.047+0000 7f3bf7fff640 1 --2- 172.21.15.5:0/88348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c000b2cc0 0x7f3c000b6bf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097a0 tx=0x7f3be802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1481034ff4d544 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.047+0000 7f3bfe59c640 1 -- 172.21.15.5:0/88348180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8037070 con 0x7f3c000b2cc0 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.047+0000 7f3bfe59c640 1 -- 172.21.15.5:0/88348180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8032440 con 0x7f3c000b2cc0 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.047+0000 7f3bfe59c640 1 -- 172.21.15.5:0/88348180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8032810 con 0x7f3c000b2cc0 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 -- 172.21.15.5:0/88348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c000b2cc0 msgr2=0x7f3c000b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 --2- 172.21.15.5:0/88348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c000b2cc0 0x7f3c000b6bf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097a0 tx=0x7f3be802a180 comp rx=0 tx=0).stop 2024-04-25T09:03:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 -- 172.21.15.5:0/88348180 shutdown_connections 2024-04-25T09:03:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 --2- 172.21.15.5:0/88348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c000b2cc0 0x7f3c000b6bf0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 --2- 172.21.15.5:0/88348180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c0015de70 0x7f3c000b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 -- 172.21.15.5:0/88348180 >> 172.21.15.5:0/88348180 conn(0x7f3c0006b000 msgr2=0x7f3c0006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 -- 172.21.15.5:0/88348180 shutdown_connections 2024-04-25T09:03:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.048+0000 7f3c05046640 1 -- 172.21.15.5:0/88348180 wait complete. 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.049+0000 7f3c05046640 1 Processor -- start 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.049+0000 7f3c05046640 1 -- start start 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3c05046640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c000b2cc0 0x7f3c000cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3c05046640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c000b7130 0x7f3c000b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3c05046640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c0015de70 0x7f3c0015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3c05046640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cf080 con 0x7f3c0015de70 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3c05046640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cef00 con 0x7f3c000b2cc0 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3c05046640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cf200 con 0x7f3c000b7130 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c0015de70 0x7f3c0015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c0015de70 0x7f3c0015fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44118/0 (socket says 172.21.15.5:44118) 2024-04-25T09:03:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 -- 172.21.15.5:0/3083293208 learned_addr learned my addr 172.21.15.5:0/3083293208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bf7fff640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c000b7130 0x7f3c000b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bfed9d640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c000b2cc0 0x7f3c000cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 -- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c000b7130 msgr2=0x7f3c000b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c000b7130 0x7f3c000b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 -- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c000b2cc0 msgr2=0x7f3c000cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c000b2cc0 0x7f3c000cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 -- 172.21.15.5:0/3083293208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000cdaf0 con 0x7f3c0015de70 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bf7fff640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c000b7130 0x7f3c000b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bfed9d640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c000b2cc0 0x7f3c000cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bff59e640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c0015de70 0x7f3c0015fda0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c7d0 tx=0x7f3bf800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bf77fe640 1 -- 172.21.15.5:0/3083293208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8018070 con 0x7f3c0015de70 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.050+0000 7f3bf77fe640 1 -- 172.21.15.5:0/3083293208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800a640 con 0x7f3c0015de70 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.051+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c000cc510 con 0x7f3c0015de70 2024-04-25T09:03:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.051+0000 7f3bf77fe640 1 -- 172.21.15.5:0/3083293208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800aa70 con 0x7f3c0015de70 2024-04-25T09:03:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.051+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c000ccad0 con 0x7f3c0015de70 2024-04-25T09:03:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.051+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0004ef20 con 0x7f3c0015de70 2024-04-25T09:03:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.052+0000 7f3bf77fe640 1 -- 172.21.15.5:0/3083293208 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3bf801b070 con 0x7f3c0015de70 2024-04-25T09:03:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.052+0000 7f3bf77fe640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3be006b4d0 0x7f3be006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.053+0000 7f3bf77fe640 1 -- 172.21.15.5:0/3083293208 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bf8089870 con 0x7f3c0015de70 2024-04-25T09:03:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.053+0000 7f3bfed9d640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3be006b4d0 0x7f3be006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.053+0000 7f3bfed9d640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3be006b4d0 0x7f3be006d990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a990 tx=0x7f3bf0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.056+0000 7f3bf77fe640 1 -- 172.21.15.5:0/3083293208 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3bf8058660 con 0x7f3c0015de70 2024-04-25T09:03:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.279+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c0015f000 con 0x7f3c0015de70 2024-04-25T09:03:20.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.280+0000 7f3bf77fe640 1 -- 172.21.15.5:0/3083293208 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f3bf8057f60 con 0x7f3c0015de70 2024-04-25T09:03:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:20.269 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:46.467722+0000","modified":"2024-04-25T09:02:49.472605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7497":{"gid":7497,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1143707602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1143707602},{"type":"v1","addr":"172.21.15.80:6837","nonce":1143707602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:03:20.269 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-04-25T09:03:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3be006b4d0 msgr2=0x7f3be006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3be006b4d0 0x7f3be006d990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a990 tx=0x7f3bf0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c0015de70 msgr2=0x7f3c0015fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c0015de70 0x7f3c0015fda0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c7d0 tx=0x7f3bf800cc90 comp rx=0 tx=0).stop 2024-04-25T09:03:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 shutdown_connections 2024-04-25T09:03:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3be006b4d0 0x7f3be006d990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c0015de70 0x7f3c0015fda0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c000b7130 0x7f3c000b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 --2- 172.21.15.5:0/3083293208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c000b2cc0 0x7f3c000cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 >> 172.21.15.5:0/3083293208 conn(0x7f3c0006b000 msgr2=0x7f3c0015e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 shutdown_connections 2024-04-25T09:03:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.282+0000 7f3c05046640 1 -- 172.21.15.5:0/3083293208 wait complete. 2024-04-25T09:03:20.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:20.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.394+0000 7f6c9e753640 1 Processor -- start 2024-04-25T09:03:20.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.394+0000 7f6c9e753640 1 -- start start 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c9e753640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c9815de70 0x7f6c980b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c9e753640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c980b2cc0 0x7f6c980b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c9e753640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980d20e0 con 0x7f6c980b7130 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c9e753640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980d2a10 con 0x7f6c9815de70 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c9e753640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980d23c0 con 0x7f6c980b2cc0 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c97fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c9815de70 0x7f6c980b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c9ccf0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6c980b7130 0x7f6c980ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33920/0 (socket says 172.21.15.5:33920) 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c9ccf0640 1 -- 172.21.15.5:0/692311155 learned_addr learned my addr 172.21.15.5:0/692311155 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c977fe640 1 --2- 172.21.15.5:0/692311155 >> v2:172.21.15.80:3300/0 conn(0x7f6c980b2cc0 0x7f6c980b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c97fff640 1 -- 172.21.15.5:0/692311155 >> v2:172.21.15.80:3300/0 conn(0x7f6c980b2cc0 msgr2=0x7f6c980b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c97fff640 1 --2- 172.21.15.5:0/692311155 >> v2:172.21.15.80:3300/0 conn(0x7f6c980b2cc0 0x7f6c980b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c97fff640 1 -- 172.21.15.5:0/692311155 >> v1:172.21.15.5:6789/0 conn(0x7f6c980b7130 legacy=0x7f6c980ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c96ffd640 1 -- 172.21.15.5:0/692311155 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692517543 0 0) 0x7f6c980d20e0 con 0x7f6c980b7130 2024-04-25T09:03:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c97fff640 1 -- 172.21.15.5:0/692311155 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980d26a0 con 0x7f6c9815de70 2024-04-25T09:03:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.395+0000 7f6c977fe640 1 --2- 172.21.15.5:0/692311155 >> v2:172.21.15.80:3300/0 conn(0x7f6c980b2cc0 0x7f6c980b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.396+0000 7f6c97fff640 1 --2- 172.21.15.5:0/692311155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9815de70 0x7f6c980b93e0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f6c800097a0 tx=0x7f6c8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8cce11ce272624 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.396+0000 7f6c96ffd640 1 -- 172.21.15.5:0/692311155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80037070 con 0x7f6c9815de70 2024-04-25T09:03:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.396+0000 7f6c96ffd640 1 -- 172.21.15.5:0/692311155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80032440 con 0x7f6c9815de70 2024-04-25T09:03:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.396+0000 7f6c96ffd640 1 -- 172.21.15.5:0/692311155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80032810 con 0x7f6c9815de70 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 -- 172.21.15.5:0/692311155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9815de70 msgr2=0x7f6c980b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 --2- 172.21.15.5:0/692311155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9815de70 0x7f6c980b93e0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f6c800097a0 tx=0x7f6c8002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 -- 172.21.15.5:0/692311155 shutdown_connections 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 --2- 172.21.15.5:0/692311155 >> v2:172.21.15.80:3300/0 conn(0x7f6c980b2cc0 0x7f6c980b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 --2- 172.21.15.5:0/692311155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9815de70 0x7f6c980b93e0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 -- 172.21.15.5:0/692311155 >> 172.21.15.5:0/692311155 conn(0x7f6c9806b000 msgr2=0x7f6c9806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 -- 172.21.15.5:0/692311155 shutdown_connections 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.397+0000 7f6c9e753640 1 -- 172.21.15.5:0/692311155 wait complete. 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.398+0000 7f6c9e753640 1 Processor -- start 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.398+0000 7f6c9e753640 1 -- start start 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9e753640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c980b2cc0 0x7f6c980ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9e753640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c980b7130 0x7f6c9814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9e753640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c9815de70 0x7f6c980b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9e753640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980cf080 con 0x7f6c980b2cc0 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9e753640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980cef00 con 0x7f6c980b7130 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9e753640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980cf200 con 0x7f6c9815de70 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c980b2cc0 0x7f6c980ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c980b2cc0 0x7f6c980ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44140/0 (socket says 172.21.15.5:44140) 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 -- 172.21.15.5:0/1764758993 learned_addr learned my addr 172.21.15.5:0/1764758993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9ccf0640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c9815de70 0x7f6c980b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c977fe640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c980b7130 0x7f6c9814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 -- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c9815de70 msgr2=0x7f6c980b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c9815de70 0x7f6c980b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 -- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c980b7130 msgr2=0x7f6c9814af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c980b7130 0x7f6c9814af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 -- 172.21.15.5:0/1764758993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9814b4b0 con 0x7f6c980b2cc0 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9ccf0640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c9815de70 0x7f6c980b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c977fe640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c980b7130 0x7f6c9814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c97fff640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c980b2cc0 0x7f6c980ca050 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6c80000c00 tx=0x7f6c800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c94ff9640 1 -- 172.21.15.5:0/1764758993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80037040 con 0x7f6c980b2cc0 2024-04-25T09:03:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c94ff9640 1 -- 172.21.15.5:0/1764758993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80042070 con 0x7f6c980b2cc0 2024-04-25T09:03:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.399+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c980c8fb0 con 0x7f6c980b2cc0 2024-04-25T09:03:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.400+0000 7f6c94ff9640 1 -- 172.21.15.5:0/1764758993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80030a70 con 0x7f6c980b2cc0 2024-04-25T09:03:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.400+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c980c9850 con 0x7f6c980b2cc0 2024-04-25T09:03:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.401+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c980c93a0 con 0x7f6c980b2cc0 2024-04-25T09:03:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.401+0000 7f6c94ff9640 1 -- 172.21.15.5:0/1764758993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c80030c10 con 0x7f6c980b2cc0 2024-04-25T09:03:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.401+0000 7f6c94ff9640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7806b4d0 0x7f6c7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.402+0000 7f6c94ff9640 1 -- 172.21.15.5:0/1764758993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c800aad10 con 0x7f6c980b2cc0 2024-04-25T09:03:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.402+0000 7f6c977fe640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7806b4d0 0x7f6c7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.402+0000 7f6c977fe640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7806b4d0 0x7f6c7806d990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6c88006fd0 tx=0x7f6c88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.406+0000 7f6c94ff9640 1 -- 172.21.15.5:0/1764758993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c9814b4b0 con 0x7f6c980b2cc0 2024-04-25T09:03:20.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.587+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c9815abb0 con 0x7f6c980b2cc0 2024-04-25T09:03:20.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.589+0000 7f6c94ff9640 1 -- 172.21.15.5:0/1764758993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16576 (secure 0 0 0) 0x7f6c80045360 con 0x7f6c980b2cc0 2024-04-25T09:03:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:20.578 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:02:48.102831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:44.744734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:45.440447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.590+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7806b4d0 msgr2=0x7f6c7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.590+0000 7f6c9e753640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7806b4d0 0x7f6c7806d990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6c88006fd0 tx=0x7f6c88008040 comp rx=0 tx=0).stop 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.590+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c980b2cc0 msgr2=0x7f6c980ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.590+0000 7f6c9e753640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c980b2cc0 0x7f6c980ca050 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6c80000c00 tx=0x7f6c800046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 shutdown_connections 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7806b4d0 0x7f6c7806d990 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c9815de70 0x7f6c980b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c980b7130 0x7f6c9814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 --2- 172.21.15.5:0/1764758993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c980b2cc0 0x7f6c980ca050 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 >> 172.21.15.5:0/1764758993 conn(0x7f6c9806b000 msgr2=0x7f6c980ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 shutdown_connections 2024-04-25T09:03:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.591+0000 7f6c9e753640 1 -- 172.21.15.5:0/1764758993 wait complete. 2024-04-25T09:03:20.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:03:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.704+0000 7f116f212640 1 Processor -- start 2024-04-25T09:03:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.704+0000 7f116f212640 1 -- start start 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f116f212640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11680b2cc0 0x7f11680b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f116f212640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f11680b7130 0x7f11680ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f116f212640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680d20e0 con 0x7f116815de70 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f116f212640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680d2a10 con 0x7f11680b2cc0 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f116f212640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680d23c0 con 0x7f11680b7130 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f1167fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11680b2cc0 0x7f11680b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f1167fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11680b2cc0 0x7f11680b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44144/0 (socket says 172.21.15.5:44144) 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f1167fff640 1 -- 172.21.15.5:0/1972469197 learned_addr learned my addr 172.21.15.5:0/1972469197 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f116d7af640 1 --2- 172.21.15.5:0/1972469197 >> v2:172.21.15.80:3300/0 conn(0x7f11680b7130 0x7f11680ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f1167fff640 1 -- 172.21.15.5:0/1972469197 >> v2:172.21.15.80:3300/0 conn(0x7f11680b7130 msgr2=0x7f11680ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f1167fff640 1 --2- 172.21.15.5:0/1972469197 >> v2:172.21.15.80:3300/0 conn(0x7f11680b7130 0x7f11680ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f1167fff640 1 -- 172.21.15.5:0/1972469197 >> v1:172.21.15.80:6789/0 conn(0x7f116815de70 legacy=0x7f11680b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.705+0000 7f1167fff640 1 -- 172.21.15.5:0/1972469197 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680d26a0 con 0x7f11680b2cc0 2024-04-25T09:03:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.706+0000 7f1167fff640 1 --2- 172.21.15.5:0/1972469197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b6bf0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f115c009870 tx=0x7f115c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db0f0c9405d2744 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.706+0000 7f11677fe640 1 -- 172.21.15.5:0/1972469197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c037070 con 0x7f11680b2cc0 2024-04-25T09:03:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.706+0000 7f11677fe640 1 -- 172.21.15.5:0/1972469197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c032440 con 0x7f11680b2cc0 2024-04-25T09:03:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.706+0000 7f11677fe640 1 -- 172.21.15.5:0/1972469197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c032810 con 0x7f11680b2cc0 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 -- 172.21.15.5:0/1972469197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 msgr2=0x7f11680b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 --2- 172.21.15.5:0/1972469197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b6bf0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f115c009870 tx=0x7f115c02a270 comp rx=0 tx=0).stop 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 -- 172.21.15.5:0/1972469197 shutdown_connections 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 --2- 172.21.15.5:0/1972469197 >> v2:172.21.15.80:3300/0 conn(0x7f11680b7130 0x7f11680ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 --2- 172.21.15.5:0/1972469197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b6bf0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 -- 172.21.15.5:0/1972469197 >> 172.21.15.5:0/1972469197 conn(0x7f116806b000 msgr2=0x7f116806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 -- 172.21.15.5:0/1972469197 shutdown_connections 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.707+0000 7f116f212640 1 -- 172.21.15.5:0/1972469197 wait complete. 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.708+0000 7f116f212640 1 Processor -- start 2024-04-25T09:03:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.708+0000 7f116f212640 1 -- start start 2024-04-25T09:03:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116f212640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116f212640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11680b7130 0x7f11681552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116f212640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f116815de70 0x7f11680cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116f212640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680cf0c0 con 0x7f11680b2cc0 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116f212640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680cef40 con 0x7f116815de70 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116f212640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11681557e0 con 0x7f11680b7130 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44158/0 (socket says 172.21.15.5:44158) 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 -- 172.21.15.5:0/1685524779 learned_addr learned my addr 172.21.15.5:0/1685524779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116d7af640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f116815de70 0x7f11680cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 -- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11680b7130 msgr2=0x7f11681552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11680b7130 0x7f11681552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 -- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f116815de70 msgr2=0x7f11680cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f116815de70 0x7f11680cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 -- 172.21.15.5:0/1685524779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680cc6c0 con 0x7f11680b2cc0 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116d7af640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f116815de70 0x7f11680cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.709+0000 7f116cfae640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b5220 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f115800b420 tx=0x7f115800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.710+0000 7f11657fa640 1 -- 172.21.15.5:0/1685524779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158011830 con 0x7f11680b2cc0 2024-04-25T09:03:20.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.710+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680cc960 con 0x7f11680b2cc0 2024-04-25T09:03:20.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.710+0000 7f11657fa640 1 -- 172.21.15.5:0/1685524779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1158016070 con 0x7f11680b2cc0 2024-04-25T09:03:20.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.710+0000 7f11657fa640 1 -- 172.21.15.5:0/1685524779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158011c10 con 0x7f11680b2cc0 2024-04-25T09:03:20.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.710+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11680ccf20 con 0x7f11680b2cc0 2024-04-25T09:03:20.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.711+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11680d4680 con 0x7f11680b2cc0 2024-04-25T09:03:20.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.711+0000 7f11657fa640 1 -- 172.21.15.5:0/1685524779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f115801b460 con 0x7f11680b2cc0 2024-04-25T09:03:20.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.712+0000 7f11657fa640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f115406b4d0 0x7f115406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.712+0000 7f11657fa640 1 -- 172.21.15.5:0/1685524779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f115808a120 con 0x7f11680b2cc0 2024-04-25T09:03:20.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.712+0000 7f1167fff640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f115406b4d0 0x7f115406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.712+0000 7f1167fff640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f115406b4d0 0x7f115406d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f115c034000 tx=0x7f115c02c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.716+0000 7f11657fa640 1 -- 172.21.15.5:0/1685524779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11680d4680 con 0x7f11680b2cc0 2024-04-25T09:03:20.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.940+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f116804ef20 con 0x7f11680b2cc0 2024-04-25T09:03:20.929 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:03:20.940+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:03:20.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.942+0000 7f11657fa640 1 -- 172.21.15.5:0/1685524779 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1158058df0 con 0x7f11680b2cc0 2024-04-25T09:03:20.930 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.944+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f115406b4d0 msgr2=0x7f115406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.944+0000 7f116f212640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f115406b4d0 0x7f115406d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f115c034000 tx=0x7f115c02c000 comp rx=0 tx=0).stop 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.944+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 msgr2=0x7f11680b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.944+0000 7f116f212640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b5220 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f115800b420 tx=0x7f115800b8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 shutdown_connections 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f115406b4d0 0x7f115406d990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f116815de70 0x7f11680cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f11680b7130 0x7f11681552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 --2- 172.21.15.5:0/1685524779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11680b2cc0 0x7f11680b5220 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 >> 172.21.15.5:0/1685524779 conn(0x7f116806b000 msgr2=0x7f11680d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 shutdown_connections 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:20.945+0000 7f116f212640 1 -- 172.21.15.5:0/1685524779 wait complete. 2024-04-25T09:03:20.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:03:20.974 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:03:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.060+0000 7f50785c8640 1 Processor -- start 2024-04-25T09:03:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.060+0000 7f50785c8640 1 -- start start 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f50785c8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f507015e0b0 0x7f507006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f50785c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50700d0c80 0x7f50700cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f50785c8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700d27f0 con 0x7f50700cc5b0 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f50785c8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700cfee0 con 0x7f50700d0c80 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f50785c8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700d01c0 con 0x7f507015e0b0 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5075b63640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50700d0c80 0x7f50700cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5076b65640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f50700cc5b0 0x7f5070161c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44148/0 (socket says 172.21.15.5:44148) 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5075b63640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50700d0c80 0x7f50700cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60382/0 (socket says 172.21.15.5:60382) 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5076b65640 1 -- 172.21.15.5:0/2372186048 learned_addr learned my addr 172.21.15.5:0/2372186048 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5076364640 1 --2- 172.21.15.5:0/2372186048 >> v2:172.21.15.80:3300/0 conn(0x7f507015e0b0 0x7f507006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5075b63640 1 -- 172.21.15.5:0/2372186048 >> v2:172.21.15.80:3300/0 conn(0x7f507015e0b0 msgr2=0x7f507006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5075b63640 1 --2- 172.21.15.5:0/2372186048 >> v2:172.21.15.80:3300/0 conn(0x7f507015e0b0 0x7f507006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5075b63640 1 -- 172.21.15.5:0/2372186048 >> v1:172.21.15.5:6789/0 conn(0x7f50700cc5b0 legacy=0x7f5070161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5075b63640 1 -- 172.21.15.5:0/2372186048 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700d04a0 con 0x7f50700d0c80 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.061+0000 7f5075362640 1 -- 172.21.15.5:0/2372186048 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556907193 0 0) 0x7f50700d27f0 con 0x7f50700cc5b0 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.062+0000 7f5075b63640 1 --2- 172.21.15.5:0/2372186048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700d0c80 0x7f50700cc070 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f50600097a0 tx=0x7f506002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b198a1f074718a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.062+0000 7f5075362640 1 -- 172.21.15.5:0/2372186048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060037070 con 0x7f50700d0c80 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.062+0000 7f5075362640 1 -- 172.21.15.5:0/2372186048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060032440 con 0x7f50700d0c80 2024-04-25T09:03:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.062+0000 7f5075362640 1 -- 172.21.15.5:0/2372186048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060032810 con 0x7f50700d0c80 2024-04-25T09:03:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 -- 172.21.15.5:0/2372186048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700d0c80 msgr2=0x7f50700cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 --2- 172.21.15.5:0/2372186048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700d0c80 0x7f50700cc070 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f50600097a0 tx=0x7f506002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 -- 172.21.15.5:0/2372186048 shutdown_connections 2024-04-25T09:03:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 --2- 172.21.15.5:0/2372186048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700d0c80 0x7f50700cc070 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 --2- 172.21.15.5:0/2372186048 >> v2:172.21.15.80:3300/0 conn(0x7f507015e0b0 0x7f507006adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 -- 172.21.15.5:0/2372186048 >> 172.21.15.5:0/2372186048 conn(0x7f50700d1a20 msgr2=0x7f50700d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 -- 172.21.15.5:0/2372186048 shutdown_connections 2024-04-25T09:03:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.063+0000 7f50785c8640 1 -- 172.21.15.5:0/2372186048 wait complete. 2024-04-25T09:03:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.064+0000 7f50785c8640 1 Processor -- start 2024-04-25T09:03:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.064+0000 7f50785c8640 1 -- start start 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f50785c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700cc5b0 0x7f5070161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f50785c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50700d0c80 0x7f50701f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f50785c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f507015e0b0 0x7f507015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f50785c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700cfb90 con 0x7f50700cc5b0 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f50785c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507015e490 con 0x7f50700d0c80 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f50785c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700cca40 con 0x7f507015e0b0 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700cc5b0 0x7f5070161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700cc5b0 0x7f5070161550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60386/0 (socket says 172.21.15.5:60386) 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 -- 172.21.15.5:0/3900614796 learned_addr learned my addr 172.21.15.5:0/3900614796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5075b63640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50700d0c80 0x7f50701f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076b65640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f507015e0b0 0x7f507015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 -- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f507015e0b0 msgr2=0x7f507015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f507015e0b0 0x7f507015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 -- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50700d0c80 msgr2=0x7f50701f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50700d0c80 0x7f50701f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.065+0000 7f5076364640 1 -- 172.21.15.5:0/3900614796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50701f3840 con 0x7f50700cc5b0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.066+0000 7f5076364640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700cc5b0 0x7f5070161550 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f506c00d620 tx=0x7f506c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.066+0000 7f5066ffd640 1 -- 172.21.15.5:0/3900614796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00b620 con 0x7f50700cc5b0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.066+0000 7f5066ffd640 1 -- 172.21.15.5:0/3900614796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c019070 con 0x7f50700cc5b0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.066+0000 7f5066ffd640 1 -- 172.21.15.5:0/3900614796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00ba00 con 0x7f50700cc5b0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.066+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50701f75a0 con 0x7f50700cc5b0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.066+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50701f7b60 con 0x7f50700cc5b0 2024-04-25T09:03:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.067+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507004ef20 con 0x7f50700cc5b0 2024-04-25T09:03:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.067+0000 7f5066ffd640 1 -- 172.21.15.5:0/3900614796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f506c00bba0 con 0x7f50700cc5b0 2024-04-25T09:03:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.068+0000 7f5066ffd640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f505406b4d0 0x7f505406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.068+0000 7f5066ffd640 1 -- 172.21.15.5:0/3900614796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f506c08a490 con 0x7f50700cc5b0 2024-04-25T09:03:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.068+0000 7f5075b63640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f505406b4d0 0x7f505406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.068+0000 7f5075b63640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f505406b4d0 0x7f505406d990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5060034000 tx=0x7f506002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.072+0000 7f5066ffd640 1 -- 172.21.15.5:0/3900614796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f506c058cf0 con 0x7f50700cc5b0 2024-04-25T09:03:21.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.289+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f50700b79a0 con 0x7f50700cc5b0 2024-04-25T09:03:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.943+0000 7f5066ffd640 1 -- 172.21.15.5:0/3900614796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f506c05cd90 con 0x7f50700cc5b0 2024-04-25T09:03:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f505406b4d0 msgr2=0x7f505406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f505406b4d0 0x7f505406d990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5060034000 tx=0x7f506002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700cc5b0 msgr2=0x7f5070161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700cc5b0 0x7f5070161550 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f506c00d620 tx=0x7f506c00dae0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 shutdown_connections 2024-04-25T09:03:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f505406b4d0 0x7f505406d990 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f507015e0b0 0x7f507015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50700d0c80 0x7f50701f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 --2- 172.21.15.5:0/3900614796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50700cc5b0 0x7f5070161550 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 >> 172.21.15.5:0/3900614796 conn(0x7f50700d1a20 msgr2=0x7f507006f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 shutdown_connections 2024-04-25T09:03:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:21.946+0000 7f50785c8640 1 -- 172.21.15.5:0/3900614796 wait complete. 2024-04-25T09:03:21.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:03:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.071+0000 7fadd4f63640 1 Processor -- start 2024-04-25T09:03:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.072+0000 7fadd4f63640 1 -- start start 2024-04-25T09:03:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.072+0000 7fadd4f63640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd0154e20 0x7fadd015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.072+0000 7fadd4f63640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadd0071040 0x7fadd006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.072+0000 7fadd4f63640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd015c040 con 0x7fadd006d150 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.072+0000 7fadd4f63640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd006d5c0 con 0x7fadd0154e20 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.072+0000 7fadd4f63640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd015be70 con 0x7fadd0071040 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.072+0000 7fadce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd0154e20 0x7fadd015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd0154e20 0x7fadd015ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60400/0 (socket says 172.21.15.5:60400) 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadce59c640 1 -- 172.21.15.5:0/4108841962 learned_addr learned my addr 172.21.15.5:0/4108841962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadc7fff640 1 --2- 172.21.15.5:0/4108841962 >> v2:172.21.15.80:3300/0 conn(0x7fadd0071040 0x7fadd006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadce59c640 1 -- 172.21.15.5:0/4108841962 >> v2:172.21.15.80:3300/0 conn(0x7fadd0071040 msgr2=0x7fadd006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadce59c640 1 --2- 172.21.15.5:0/4108841962 >> v2:172.21.15.80:3300/0 conn(0x7fadd0071040 0x7fadd006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadce59c640 1 -- 172.21.15.5:0/4108841962 >> v1:172.21.15.80:6789/0 conn(0x7fadd006d150 legacy=0x7fadd00ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadce59c640 1 -- 172.21.15.5:0/4108841962 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00714f0 con 0x7fadd0154e20 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.073+0000 7fadc7fff640 1 --2- 172.21.15.5:0/4108841962 >> v2:172.21.15.80:3300/0 conn(0x7fadd0071040 0x7fadd006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadce59c640 1 --2- 172.21.15.5:0/4108841962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0154e20 0x7fadd015ae80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fadd00cc3b0 tx=0x7fadc002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41daa075e94fcc9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadcdd9b640 1 -- 172.21.15.5:0/4108841962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0037070 con 0x7fadd0154e20 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadcdd9b640 1 -- 172.21.15.5:0/4108841962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0032440 con 0x7fadd0154e20 2024-04-25T09:03:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadcdd9b640 1 -- 172.21.15.5:0/4108841962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0032810 con 0x7fadd0154e20 2024-04-25T09:03:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 -- 172.21.15.5:0/4108841962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0154e20 msgr2=0x7fadd015ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 --2- 172.21.15.5:0/4108841962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0154e20 0x7fadd015ae80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fadd00cc3b0 tx=0x7fadc002a230 comp rx=0 tx=0).stop 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 -- 172.21.15.5:0/4108841962 shutdown_connections 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 --2- 172.21.15.5:0/4108841962 >> v2:172.21.15.80:3300/0 conn(0x7fadd0071040 0x7fadd006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 --2- 172.21.15.5:0/4108841962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0154e20 0x7fadd015ae80 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 -- 172.21.15.5:0/4108841962 >> 172.21.15.5:0/4108841962 conn(0x7fadd00668f0 msgr2=0x7fadd0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 -- 172.21.15.5:0/4108841962 shutdown_connections 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.074+0000 7fadd4f63640 1 -- 172.21.15.5:0/4108841962 wait complete. 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 Processor -- start 2024-04-25T09:03:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 -- start start 2024-04-25T09:03:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd006d150 0x7fadd0151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0071040 0x7fadd014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd0154e20 0x7fadd0149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0071d70 con 0x7fadd0071040 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0071a90 con 0x7fadd006d150 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.076+0000 7fadd4f63640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0072050 con 0x7fadd0154e20 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0071040 0x7fadd014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0071040 0x7fadd014b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60414/0 (socket says 172.21.15.5:60414) 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 -- 172.21.15.5:0/3174450284 learned_addr learned my addr 172.21.15.5:0/3174450284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadce59c640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd006d150 0x7fadd0151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadced9d640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd0154e20 0x7fadd0149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 -- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd0154e20 msgr2=0x7fadd0149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd0154e20 0x7fadd0149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 -- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd006d150 msgr2=0x7fadd0151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd006d150 0x7fadd0151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 -- 172.21.15.5:0/3174450284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0150db0 con 0x7fadd0071040 2024-04-25T09:03:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc7fff640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0071040 0x7fadd014b3b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c820 tx=0x7fadb800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc6ffd640 1 -- 172.21.15.5:0/3174450284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8015070 con 0x7fadd0071040 2024-04-25T09:03:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc6ffd640 1 -- 172.21.15.5:0/3174450284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb8007a30 con 0x7fadd0071040 2024-04-25T09:03:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd0151090 con 0x7fadd0071040 2024-04-25T09:03:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadc6ffd640 1 -- 172.21.15.5:0/3174450284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8007e00 con 0x7fadd0071040 2024-04-25T09:03:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.077+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0151650 con 0x7fadd0071040 2024-04-25T09:03:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.078+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd004ef20 con 0x7fadd0071040 2024-04-25T09:03:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.079+0000 7fadc6ffd640 1 -- 172.21.15.5:0/3174450284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fadb8018070 con 0x7fadd0071040 2024-04-25T09:03:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.079+0000 7fadc6ffd640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadb006b500 0x7fadb006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.079+0000 7fadc6ffd640 1 -- 172.21.15.5:0/3174450284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fadb808a060 con 0x7fadd0071040 2024-04-25T09:03:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.079+0000 7fadce59c640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadb006b500 0x7fadb006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.080+0000 7fadce59c640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadb006b500 0x7fadb006d9c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fadc0034000 tx=0x7fadc002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.083+0000 7fadc6ffd640 1 -- 172.21.15.5:0/3174450284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fadb80588c0 con 0x7fadd0071040 2024-04-25T09:03:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.265+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fadd015dbb0 con 0x7fadd0071040 2024-04-25T09:03:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.945+0000 7fadc6ffd640 1 -- 172.21.15.5:0/3174450284 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7fadb805c960 con 0x7fadd0071040 2024-04-25T09:03:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:03:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.949+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadb006b500 msgr2=0x7fadb006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.949+0000 7fadd4f63640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadb006b500 0x7fadb006d9c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fadc0034000 tx=0x7fadc002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.949+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0071040 msgr2=0x7fadd014b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.949+0000 7fadd4f63640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0071040 0x7fadd014b3b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c820 tx=0x7fadb800cc20 comp rx=0 tx=0).stop 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.949+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 shutdown_connections 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.949+0000 7fadd4f63640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fadb006b500 0x7fadb006d9c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.950+0000 7fadd4f63640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fadd0154e20 0x7fadd0149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.950+0000 7fadd4f63640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd0071040 0x7fadd014b3b0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.950+0000 7fadd4f63640 1 --2- 172.21.15.5:0/3174450284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd006d150 0x7fadd0151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.950+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 >> 172.21.15.5:0/3174450284 conn(0x7fadd00668f0 msgr2=0x7fadd015d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.950+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 shutdown_connections 2024-04-25T09:03:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:22.950+0000 7fadd4f63640 1 -- 172.21.15.5:0/3174450284 wait complete. 2024-04-25T09:03:22.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:03:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 Processor -- start 2024-04-25T09:03:23.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 -- start start 2024-04-25T09:03:23.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f32c80b72e0 0x7f32c80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32c80d0b50 0x7f32c80ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80ce590 0x7f32c806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c80cbf10 con 0x7f32c80d0b50 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c80cc160 con 0x7f32c80b72e0 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.076+0000 7f32cd39e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80cc440 con 0x7f32c80ce590 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32c80d0b50 0x7f32c80ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32c80d0b50 0x7f32c80ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60428/0 (socket says 172.21.15.5:60428) 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 -- 172.21.15.5:0/2264888692 learned_addr learned my addr 172.21.15.5:0/2264888692 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/2264888692 >> v2:172.21.15.80:3300/0 conn(0x7f32c80b72e0 0x7f32c80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c77fe640 1 --2- 172.21.15.5:0/2264888692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80ce590 0x7f32c806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 -- 172.21.15.5:0/2264888692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80ce590 msgr2=0x7f32c806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 --2- 172.21.15.5:0/2264888692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80ce590 0x7f32c806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 -- 172.21.15.5:0/2264888692 >> v2:172.21.15.80:3300/0 conn(0x7f32c80b72e0 msgr2=0x7f32c80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 --2- 172.21.15.5:0/2264888692 >> v2:172.21.15.80:3300/0 conn(0x7f32c80b72e0 0x7f32c80d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c67fc640 1 -- 172.21.15.5:0/2264888692 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80cc720 con 0x7f32c80d0b50 2024-04-25T09:03:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.077+0000 7f32c77fe640 1 --2- 172.21.15.5:0/2264888692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80ce590 0x7f32c806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32c67fc640 1 --2- 172.21.15.5:0/2264888692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80d0b50 0x7f32c80ce050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f32c80b4490 tx=0x7f32b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a0a7e1d45c9c06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32c5ffb640 1 -- 172.21.15.5:0/2264888692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0037070 con 0x7f32c80d0b50 2024-04-25T09:03:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32c5ffb640 1 -- 172.21.15.5:0/2264888692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b0032440 con 0x7f32c80d0b50 2024-04-25T09:03:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32c5ffb640 1 -- 172.21.15.5:0/2264888692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0032810 con 0x7f32c80d0b50 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 -- 172.21.15.5:0/2264888692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80d0b50 msgr2=0x7f32c80ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 --2- 172.21.15.5:0/2264888692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80d0b50 0x7f32c80ce050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f32c80b4490 tx=0x7f32b002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 -- 172.21.15.5:0/2264888692 shutdown_connections 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 --2- 172.21.15.5:0/2264888692 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80ce590 0x7f32c806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 --2- 172.21.15.5:0/2264888692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80d0b50 0x7f32c80ce050 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 --2- 172.21.15.5:0/2264888692 >> v2:172.21.15.80:3300/0 conn(0x7f32c80b72e0 0x7f32c80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 -- 172.21.15.5:0/2264888692 >> 172.21.15.5:0/2264888692 conn(0x7f32c80d18c0 msgr2=0x7f32c80d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 -- 172.21.15.5:0/2264888692 shutdown_connections 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.078+0000 7f32cd39e640 1 -- 172.21.15.5:0/2264888692 wait complete. 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.080+0000 7f32cd39e640 1 Processor -- start 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.080+0000 7f32cd39e640 1 -- start start 2024-04-25T09:03:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.080+0000 7f32cd39e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80b72e0 0x7f32c814ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.080+0000 7f32cd39e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80ce590 0x7f32c815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.080+0000 7f32cd39e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c80d0b50 0x7f32c815a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.080+0000 7f32cd39e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80b4710 con 0x7f32c80ce590 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.080+0000 7f32cd39e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80b76c0 con 0x7f32c80d0b50 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32cd39e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80b4890 con 0x7f32c80b72e0 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80ce590 0x7f32c815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80ce590 0x7f32c815b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60436/0 (socket says 172.21.15.5:60436) 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 -- 172.21.15.5:0/689160672 learned_addr learned my addr 172.21.15.5:0/689160672 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80b72e0 0x7f32c814ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c77fe640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c80d0b50 0x7f32c815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 -- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80b72e0 msgr2=0x7f32c814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80b72e0 0x7f32c814ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 -- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c80d0b50 msgr2=0x7f32c815a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c80d0b50 0x7f32c815a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 -- 172.21.15.5:0/689160672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c8159970 con 0x7f32c80ce590 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80b72e0 0x7f32c814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32c67fc640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80ce590 0x7f32c815b150 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f32b002a220 tx=0x7f32b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32bf7fe640 1 -- 172.21.15.5:0/689160672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0041020 con 0x7f32c80ce590 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32bf7fe640 1 -- 172.21.15.5:0/689160672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b00306c0 con 0x7f32c80ce590 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8159c50 con 0x7f32c80ce590 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32bf7fe640 1 -- 172.21.15.5:0/689160672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0037040 con 0x7f32c80ce590 2024-04-25T09:03:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.081+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c815a210 con 0x7f32c80ce590 2024-04-25T09:03:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.082+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c804ef20 con 0x7f32c80ce590 2024-04-25T09:03:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.083+0000 7f32bf7fe640 1 -- 172.21.15.5:0/689160672 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f32b0044020 con 0x7f32c80ce590 2024-04-25T09:03:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.083+0000 7f32bf7fe640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a806b4d0 0x7f32a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.083+0000 7f32bf7fe640 1 -- 172.21.15.5:0/689160672 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f32b00aa7b0 con 0x7f32c80ce590 2024-04-25T09:03:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.083+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a806b4d0 0x7f32a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.084+0000 7f32c6ffd640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a806b4d0 0x7f32a806d990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f32b800ba50 tx=0x7f32b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.087+0000 7f32bf7fe640 1 -- 172.21.15.5:0/689160672 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f32b004b030 con 0x7f32c80ce590 2024-04-25T09:03:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.276+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32c80cd510 con 0x7f32c80ce590 2024-04-25T09:03:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.950+0000 7f32bf7fe640 1 -- 172.21.15.5:0/689160672 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7f32b0079820 con 0x7f32c80ce590 2024-04-25T09:03:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T09:03:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.957+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a806b4d0 msgr2=0x7f32a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.957+0000 7f32cd39e640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a806b4d0 0x7f32a806d990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f32b800ba50 tx=0x7f32b8008040 comp rx=0 tx=0).stop 2024-04-25T09:03:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.957+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80ce590 msgr2=0x7f32c815b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.957+0000 7f32cd39e640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80ce590 0x7f32c815b150 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f32b002a220 tx=0x7f32b00046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.957+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 shutdown_connections 2024-04-25T09:03:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.957+0000 7f32cd39e640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f32a806b4d0 0x7f32a806d990 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.958+0000 7f32cd39e640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32c80d0b50 0x7f32c815a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.958+0000 7f32cd39e640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c80ce590 0x7f32c815b150 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.958+0000 7f32cd39e640 1 --2- 172.21.15.5:0/689160672 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f32c80b72e0 0x7f32c814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.958+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 >> 172.21.15.5:0/689160672 conn(0x7f32c80d18c0 msgr2=0x7f32c80ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.959+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 shutdown_connections 2024-04-25T09:03:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:23.959+0000 7f32cd39e640 1 -- 172.21.15.5:0/689160672 wait complete. 2024-04-25T09:03:23.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.094+0000 7f76043e2640 1 Processor -- start 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.094+0000 7f76043e2640 1 -- start start 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.095+0000 7f76043e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75fc0ce8b0 0x7f75fc168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.095+0000 7f76043e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc0cc010 con 0x7f75fc0b72b0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.095+0000 7f76043e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc0cc2f0 con 0x7f75fc0cfd70 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.095+0000 7f76043e2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc0cdde0 con 0x7f75fc0ce8b0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.095+0000 7f760297f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75fc0ce8b0 0x7f75fc168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.095+0000 7f760217e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75fc0b72b0 0x7f75fc0d0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44158/0 (socket says 172.21.15.5:44158) 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.095+0000 7f760217e640 1 -- 172.21.15.5:0/1641739388 learned_addr learned my addr 172.21.15.5:0/1641739388 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.096+0000 7f760297f640 1 -- 172.21.15.5:0/1641739388 >> v1:172.21.15.80:6789/0 conn(0x7f75fc0cfd70 legacy=0x7f75fc0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.096+0000 7f760297f640 1 -- 172.21.15.5:0/1641739388 >> v1:172.21.15.5:6789/0 conn(0x7f75fc0b72b0 legacy=0x7f75fc0d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.096+0000 7f760297f640 1 -- 172.21.15.5:0/1641739388 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0cc5d0 con 0x7f75fc0ce8b0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.096+0000 7f760117c640 1 -- 172.21.15.5:0/1641739388 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345287806 0 0) 0x7f75fc0cc010 con 0x7f75fc0b72b0 2024-04-25T09:03:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.096+0000 7f760297f640 1 --2- 172.21.15.5:0/1641739388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc168cf0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f75f40097a0 tx=0x7f75f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db33d273e1afa2de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f760117c640 1 -- 172.21.15.5:0/1641739388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4037070 con 0x7f75fc0ce8b0 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f760117c640 1 -- 172.21.15.5:0/1641739388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f4032440 con 0x7f75fc0ce8b0 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f760117c640 1 -- 172.21.15.5:0/1641739388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4032810 con 0x7f75fc0ce8b0 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f76043e2640 1 -- 172.21.15.5:0/1641739388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0ce8b0 msgr2=0x7f75fc168cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f76043e2640 1 --2- 172.21.15.5:0/1641739388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc168cf0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f75f40097a0 tx=0x7f75f402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f76043e2640 1 -- 172.21.15.5:0/1641739388 shutdown_connections 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f76043e2640 1 --2- 172.21.15.5:0/1641739388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc168cf0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f76043e2640 1 -- 172.21.15.5:0/1641739388 >> 172.21.15.5:0/1641739388 conn(0x7f75fc0d1920 msgr2=0x7f75fc0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f76043e2640 1 -- 172.21.15.5:0/1641739388 shutdown_connections 2024-04-25T09:03:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.097+0000 7f76043e2640 1 -- 172.21.15.5:0/1641739388 wait complete. 2024-04-25T09:03:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.098+0000 7f76043e2640 1 Processor -- start 2024-04-25T09:03:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.098+0000 7f76043e2640 1 -- start start 2024-04-25T09:03:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f76043e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75fc0b72b0 0x7f75fc0cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f76043e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f76043e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0cfd70 0x7f75fc0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f76043e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0d1550 con 0x7f75fc0cfd70 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f76043e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0b4770 con 0x7f75fc0ce8b0 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f76043e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0b7690 con 0x7f75fc0b72b0 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f760297f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0cfd70 0x7f75fc0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f760297f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0cfd70 0x7f75fc0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60460/0 (socket says 172.21.15.5:60460) 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.099+0000 7f760297f640 1 -- 172.21.15.5:0/1447325482 learned_addr learned my addr 172.21.15.5:0/1447325482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760197d640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760217e640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75fc0b72b0 0x7f75fc0cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760297f640 1 -- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75fc0b72b0 msgr2=0x7f75fc0cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760297f640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75fc0b72b0 0x7f75fc0cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760297f640 1 -- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75fc0ce8b0 msgr2=0x7f75fc0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760297f640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc0c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760297f640 1 -- 172.21.15.5:0/1447325482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0c9050 con 0x7f75fc0cfd70 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760197d640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760217e640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75fc0b72b0 0x7f75fc0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:24.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f760297f640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0cfd70 0x7f75fc0c69e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f75f40098c0 tx=0x7f75f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f75f2ffd640 1 -- 172.21.15.5:0/1447325482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4041070 con 0x7f75fc0cfd70 2024-04-25T09:03:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f75f2ffd640 1 -- 172.21.15.5:0/1447325482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f403c870 con 0x7f75fc0cfd70 2024-04-25T09:03:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc14f290 con 0x7f75fc0cfd70 2024-04-25T09:03:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f75f2ffd640 1 -- 172.21.15.5:0/1447325482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4037040 con 0x7f75fc0cfd70 2024-04-25T09:03:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.100+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc0c95d0 con 0x7f75fc0cfd70 2024-04-25T09:03:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.101+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc0c9810 con 0x7f75fc0cfd70 2024-04-25T09:03:24.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.101+0000 7f75f2ffd640 1 -- 172.21.15.5:0/1447325482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f75f4044070 con 0x7f75fc0cfd70 2024-04-25T09:03:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.102+0000 7f75f2ffd640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75e006b4d0 0x7f75e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.102+0000 7f75f2ffd640 1 -- 172.21.15.5:0/1447325482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f75f40aaaf0 con 0x7f75fc0cfd70 2024-04-25T09:03:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.102+0000 7f760217e640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75e006b4d0 0x7f75e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.103+0000 7f760217e640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75e006b4d0 0x7f75e006d990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f75f8007fd0 tx=0x7f75f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.106+0000 7f75f2ffd640 1 -- 172.21.15.5:0/1447325482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75f4079be0 con 0x7f75fc0cfd70 2024-04-25T09:03:24.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.287+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f75fc04ef20 con 0x7f75fc0cfd70 2024-04-25T09:03:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.290+0000 7f75f2ffd640 1 -- 172.21.15.5:0/1447325482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f75f40794e0 con 0x7f75fc0cfd70 2024-04-25T09:03:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.292+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75e006b4d0 msgr2=0x7f75e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.292+0000 7f76043e2640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75e006b4d0 0x7f75e006d990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f75f8007fd0 tx=0x7f75f8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0cfd70 msgr2=0x7f75fc0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0cfd70 0x7f75fc0c69e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f75f40098c0 tx=0x7f75f40046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 shutdown_connections 2024-04-25T09:03:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f75e006b4d0 0x7f75e006d990 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0cfd70 0x7f75fc0c69e0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75fc0ce8b0 0x7f75fc0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 --2- 172.21.15.5:0/1447325482 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75fc0b72b0 0x7f75fc0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 >> 172.21.15.5:0/1447325482 conn(0x7f75fc0d1920 msgr2=0x7f75fc0cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 shutdown_connections 2024-04-25T09:03:24.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.293+0000 7f76043e2640 1 -- 172.21.15.5:0/1447325482 wait complete. 2024-04-25T09:03:24.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-04-25T09:03:24.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.423+0000 7fe0f9ee1640 1 Processor -- start 2024-04-25T09:03:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.423+0000 7fe0f9ee1640 1 -- start start 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.423+0000 7fe0f9ee1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0f40b2cc0 0x7fe0f40b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.423+0000 7fe0f9ee1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f40d20e0 con 0x7fe0f40b7130 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.423+0000 7fe0f9ee1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f40d23c0 con 0x7fe0f415de70 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.423+0000 7fe0f9ee1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f40d2a10 con 0x7fe0f40b2cc0 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0f3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe0f40b7130 0x7fe0f40ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44174/0 (socket says 172.21.15.5:44174) 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0f3fff640 1 -- 172.21.15.5:0/3663705499 learned_addr learned my addr 172.21.15.5:0/3663705499 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0eaffd640 1 --2- 172.21.15.5:0/3663705499 >> v2:172.21.15.80:3300/0 conn(0x7fe0f40b2cc0 0x7fe0f40b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0f2ffd640 1 -- 172.21.15.5:0/3663705499 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552791014 0 0) 0x7fe0f40d20e0 con 0x7fe0f40b7130 2024-04-25T09:03:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0f2ffd640 1 -- 172.21.15.5:0/3663705499 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e0003520 con 0x7fe0f40b7130 2024-04-25T09:03:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0f2ffd640 1 -- 172.21.15.5:0/3663705499 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 266181121 0 0) 0x7fe0e0003520 con 0x7fe0f40b7130 2024-04-25T09:03:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0eaffd640 1 -- 172.21.15.5:0/3663705499 >> v1:172.21.15.80:6789/0 conn(0x7fe0f415de70 legacy=0x7fe0f40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0eaffd640 1 -- 172.21.15.5:0/3663705499 >> v1:172.21.15.5:6789/0 conn(0x7fe0f40b7130 legacy=0x7fe0f40ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.424+0000 7fe0eaffd640 1 -- 172.21.15.5:0/3663705499 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40d26a0 con 0x7fe0f40b2cc0 2024-04-25T09:03:24.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.425+0000 7fe0eaffd640 1 --2- 172.21.15.5:0/3663705499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40b6bf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0097d0 tx=0x7fe0dc02a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54310c156f8f59e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.425+0000 7fe0f2ffd640 1 -- 172.21.15.5:0/3663705499 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc037070 con 0x7fe0f40b2cc0 2024-04-25T09:03:24.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.425+0000 7fe0f2ffd640 1 -- 172.21.15.5:0/3663705499 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc02ac90 con 0x7fe0f40b2cc0 2024-04-25T09:03:24.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.425+0000 7fe0f2ffd640 1 -- 172.21.15.5:0/3663705499 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0019f0 con 0x7fe0f40b2cc0 2024-04-25T09:03:24.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.426+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/3663705499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 msgr2=0x7fe0f40b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.426+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/3663705499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40b6bf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0097d0 tx=0x7fe0dc02a200 comp rx=0 tx=0).stop 2024-04-25T09:03:24.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.426+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/3663705499 shutdown_connections 2024-04-25T09:03:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.426+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/3663705499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40b6bf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.426+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/3663705499 >> 172.21.15.5:0/3663705499 conn(0x7fe0f406b000 msgr2=0x7fe0f406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.426+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/3663705499 shutdown_connections 2024-04-25T09:03:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.426+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/3663705499 wait complete. 2024-04-25T09:03:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.427+0000 7fe0f9ee1640 1 Processor -- start 2024-04-25T09:03:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.427+0000 7fe0f9ee1640 1 -- start start 2024-04-25T09:03:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f9ee1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f9ee1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f40b7130 0x7fe0f414cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f9ee1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0f415de70 0x7fe0f40c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f9ee1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40d2ea0 con 0x7fe0f40b7130 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f9ee1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40cf110 con 0x7fe0f40b2cc0 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f9ee1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40d3020 con 0x7fe0f415de70 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f40b7130 0x7fe0f414cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f40b7130 0x7fe0f414cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60462/0 (socket says 172.21.15.5:60462) 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 -- 172.21.15.5:0/4197831056 learned_addr learned my addr 172.21.15.5:0/4197831056 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f3fff640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0f415de70 0x7fe0f40c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f37fe640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 -- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0f415de70 msgr2=0x7fe0f40c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0f415de70 0x7fe0f40c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 -- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 msgr2=0x7fe0f40c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 -- 172.21.15.5:0/4197831056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f414d5b0 con 0x7fe0f40b7130 2024-04-25T09:03:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0f37fe640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.428+0000 7fe0eaffd640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f40b7130 0x7fe0f414cb90 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc02a240 tx=0x7fe0dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.429+0000 7fe0f0ff9640 1 -- 172.21.15.5:0/4197831056 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc037050 con 0x7fe0f40b7130 2024-04-25T09:03:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.429+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f414d890 con 0x7fe0f40b7130 2024-04-25T09:03:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.429+0000 7fe0f0ff9640 1 -- 172.21.15.5:0/4197831056 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc043070 con 0x7fe0f40b7130 2024-04-25T09:03:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.429+0000 7fe0f0ff9640 1 -- 172.21.15.5:0/4197831056 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc03e670 con 0x7fe0f40b7130 2024-04-25T09:03:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.429+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f414ab60 con 0x7fe0f40b7130 2024-04-25T09:03:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.430+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f404ef20 con 0x7fe0f40b7130 2024-04-25T09:03:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.430+0000 7fe0f0ff9640 1 -- 172.21.15.5:0/4197831056 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe0dc03e810 con 0x7fe0f40b7130 2024-04-25T09:03:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.431+0000 7fe0f0ff9640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0d406b4d0 0x7fe0d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.431+0000 7fe0f0ff9640 1 -- 172.21.15.5:0/4197831056 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe0dc0aaab0 con 0x7fe0f40b7130 2024-04-25T09:03:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.431+0000 7fe0f37fe640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0d406b4d0 0x7fe0d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.431+0000 7fe0f37fe640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0d406b4d0 0x7fe0d406d990 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000f60 tx=0x7fe0e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.435+0000 7fe0f0ff9640 1 -- 172.21.15.5:0/4197831056 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe0dc079d60 con 0x7fe0f40b7130 2024-04-25T09:03:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.685+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7fe0f4160aa0 con 0x7fe0f40b7130 2024-04-25T09:03:24.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.951+0000 7fe0f0ff9640 1 -- 172.21.15.5:0/4197831056 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v323) v1 ==== 144+0+0 (secure 0 0 0) 0x7fe0dc079660 con 0x7fe0f40b7130 2024-04-25T09:03:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.953+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0d406b4d0 msgr2=0x7fe0d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.953+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0d406b4d0 0x7fe0d406d990 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000f60 tx=0x7fe0e4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f40b7130 msgr2=0x7fe0f414cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f40b7130 0x7fe0f414cb90 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc02a240 tx=0x7fe0dc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 shutdown_connections 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0d406b4d0 0x7fe0d406d990 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0f415de70 0x7fe0f40c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f40b7130 0x7fe0f414cb90 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 --2- 172.21.15.5:0/4197831056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f40b2cc0 0x7fe0f40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 >> 172.21.15.5:0/4197831056 conn(0x7fe0f406b000 msgr2=0x7fe0f40cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 shutdown_connections 2024-04-25T09:03:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:24.954+0000 7fe0f9ee1640 1 -- 172.21.15.5:0/4197831056 wait complete. 2024-04-25T09:03:24.955 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:03:24.955 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:03:24.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:25.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.070+0000 7fcfe57cf640 1 Processor -- start 2024-04-25T09:03:25.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.070+0000 7fcfe57cf640 1 -- start start 2024-04-25T09:03:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfe57cf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcfe00b2cc0 0x7fcfe00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfe57cf640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00d20e0 con 0x7fcfe00b7130 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfe57cf640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00d23c0 con 0x7fcfe015de70 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfe57cf640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00d2a10 con 0x7fcfe00b2cc0 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfdf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcfe00b7130 0x7fcfe00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44182/0 (socket says 172.21.15.5:44182) 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfdf7fe640 1 -- 172.21.15.5:0/1956384331 learned_addr learned my addr 172.21.15.5:0/1956384331 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927727975 0 0) 0x7fcfe00d20e0 con 0x7fcfe00b7130 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfd7fff640 1 --2- 172.21.15.5:0/1956384331 >> v2:172.21.15.80:3300/0 conn(0x7fcfe00b2cc0 0x7fcfe00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc003520 con 0x7fcfe00b7130 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685316671 0 0) 0x7fcfcc003520 con 0x7fcfe00b7130 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 >> v2:172.21.15.80:3300/0 conn(0x7fcfe00b2cc0 msgr2=0x7fcfe00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 --2- 172.21.15.5:0/1956384331 >> v2:172.21.15.80:3300/0 conn(0x7fcfe00b2cc0 0x7fcfe00b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 >> v1:172.21.15.80:6789/0 conn(0x7fcfe015de70 legacy=0x7fcfe00b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00d26a0 con 0x7fcfe00b7130 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fcfd80019f0 con 0x7fcfe00b7130 2024-04-25T09:03:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 >> v1:172.21.15.5:6789/0 conn(0x7fcfe00b7130 legacy=0x7fcfe00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0039b0 0x7fcfcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfcc004800 0x7fcfcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00d2a10 con 0x7fcfcc0051c0 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc00c060 con 0x7fcfcc004800 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.071+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc00c260 con 0x7fcfcc0039b0 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdf7fe640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdeffd640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0039b0 0x7fcfcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfd7fff640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfcc004800 0x7fcfcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdf7fe640 1 -- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0039b0 msgr2=0x7fcfcc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdf7fe640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0039b0 0x7fcfcc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdf7fe640 1 -- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfcc004800 msgr2=0x7fcfcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdf7fe640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfcc004800 0x7fcfcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdf7fe640 1 -- 172.21.15.5:0/1956384331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc003520 con 0x7fcfcc0051c0 2024-04-25T09:03:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.072+0000 7fcfdf7fe640 1 -- 172.21.15.5:0/1956384331 reap_dead start 2024-04-25T09:03:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfdf7fe640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800a830 tx=0x7fcfcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4ea53e414c895f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800a480 con 0x7fcfcc0051c0 2024-04-25T09:03:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd802f070 con 0x7fcfcc0051c0 2024-04-25T09:03:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfde7fc640 1 -- 172.21.15.5:0/1956384331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd802bc90 con 0x7fcfcc0051c0 2024-04-25T09:03:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfe57cf640 1 -- 172.21.15.5:0/1956384331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfcc0051c0 msgr2=0x7fcfcc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800a830 tx=0x7fcfcc005830 comp rx=0 tx=0).stop 2024-04-25T09:03:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfe57cf640 1 -- 172.21.15.5:0/1956384331 shutdown_connections 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/1956384331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfe57cf640 1 -- 172.21.15.5:0/1956384331 >> 172.21.15.5:0/1956384331 conn(0x7fcfe006b000 msgr2=0x7fcfe006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfe57cf640 1 -- 172.21.15.5:0/1956384331 shutdown_connections 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.073+0000 7fcfe57cf640 1 -- 172.21.15.5:0/1956384331 wait complete. 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 Processor -- start 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 -- start start 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0051c0 0x7fcfe0152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe00caba0 0x7fcfe0156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe00ccea0 0x7fcfe00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00b6f80 con 0x7fcfe00caba0 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00b6e00 con 0x7fcfe00ccea0 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfe57cf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00b93e0 con 0x7fcfcc0051c0 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe00caba0 0x7fcfe0156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfd7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe00caba0 0x7fcfe0156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60488/0 (socket says 172.21.15.5:60488) 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.075+0000 7fcfd7fff640 1 -- 172.21.15.5:0/2462565520 learned_addr learned my addr 172.21.15.5:0/2462565520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfdf7fe640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe00ccea0 0x7fcfe00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfdeffd640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0051c0 0x7fcfe0152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd7fff640 1 -- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0051c0 msgr2=0x7fcfe0152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd7fff640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0051c0 0x7fcfe0152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd7fff640 1 -- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe00ccea0 msgr2=0x7fcfe00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd7fff640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe00ccea0 0x7fcfe00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd7fff640 1 -- 172.21.15.5:0/2462565520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0153370 con 0x7fcfe00caba0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd7fff640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe00caba0 0x7fcfe0156ab0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8011910 tx=0x7fcfc8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd77fe640 1 -- 172.21.15.5:0/2462565520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800fa90 con 0x7fcfe00caba0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd77fe640 1 -- 172.21.15.5:0/2462565520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc800fc30 con 0x7fcfe00caba0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe00cb110 con 0x7fcfe00caba0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfd77fe640 1 -- 172.21.15.5:0/2462565520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8014440 con 0x7fcfe00caba0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.076+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe00cb6d0 con 0x7fcfe00caba0 2024-04-25T09:03:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.077+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe004ef20 con 0x7fcfe00caba0 2024-04-25T09:03:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.077+0000 7fcfd77fe640 1 -- 172.21.15.5:0/2462565520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfc8012040 con 0x7fcfe00caba0 2024-04-25T09:03:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.078+0000 7fcfd77fe640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc006b500 0x7fcfc006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.078+0000 7fcfd77fe640 1 -- 172.21.15.5:0/2462565520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcfc808a510 con 0x7fcfe00caba0 2024-04-25T09:03:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.078+0000 7fcfdeffd640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc006b500 0x7fcfc006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.078+0000 7fcfdeffd640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc006b500 0x7fcfc006d9c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0067fc0 tx=0x7fcfd0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.082+0000 7fcfd77fe640 1 -- 172.21.15.5:0/2462565520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfc8019030 con 0x7fcfe00caba0 2024-04-25T09:03:25.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.266+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe01604f0 con 0x7fcfe00caba0 2024-04-25T09:03:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.267+0000 7fcfd77fe640 1 -- 172.21.15.5:0/2462565520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+12937 (secure 0 0 0) 0x7fcfc8059610 con 0x7fcfe00caba0 2024-04-25T09:03:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:25.256 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:23.946910+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/1143707602":"2024-04-26T09:03:20.941871+0000","172.21.15.80:6835/1143707602":"2024-04-26T09:03:20.941871+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc006b500 msgr2=0x7fcfc006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc006b500 0x7fcfc006d9c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0067fc0 tx=0x7fcfd0009040 comp rx=0 tx=0).stop 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe00caba0 msgr2=0x7fcfe0156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe00caba0 0x7fcfe0156ab0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8011910 tx=0x7fcfc8011dd0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 shutdown_connections 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfc006b500 0x7fcfc006d9c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfe00ccea0 0x7fcfe00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe00caba0 0x7fcfe0156ab0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 --2- 172.21.15.5:0/2462565520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfcc0051c0 0x7fcfe0152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 >> 172.21.15.5:0/2462565520 conn(0x7fcfe006b000 msgr2=0x7fcfe015e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 shutdown_connections 2024-04-25T09:03:25.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.269+0000 7fcfe57cf640 1 -- 172.21.15.5:0/2462565520 wait complete. 2024-04-25T09:03:25.269 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:25.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:25.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.385+0000 7fbadc0db640 1 Processor -- start 2024-04-25T09:03:25.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.385+0000 7fbadc0db640 1 -- start start 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbadc0db640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbad415df10 0x7fbad41618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbadc0db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbad40b6250 0x7fbad40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbadc0db640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad4162150 con 0x7fbad40cee10 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbadc0db640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40cf260 con 0x7fbad40b6250 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbadc0db640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40d20d0 con 0x7fbad415df10 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbad9676640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbad40b6250 0x7fbad40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbada678640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbad40cee10 0x7fbad40d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44184/0 (socket says 172.21.15.5:44184) 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbada678640 1 -- 172.21.15.5:0/1373750914 learned_addr learned my addr 172.21.15.5:0/1373750914 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.386+0000 7fbad9e77640 1 --2- 172.21.15.5:0/1373750914 >> v2:172.21.15.80:3300/0 conn(0x7fbad415df10 0x7fbad41618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.387+0000 7fbad9676640 1 -- 172.21.15.5:0/1373750914 >> v2:172.21.15.80:3300/0 conn(0x7fbad415df10 msgr2=0x7fbad41618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.387+0000 7fbad9676640 1 --2- 172.21.15.5:0/1373750914 >> v2:172.21.15.80:3300/0 conn(0x7fbad415df10 0x7fbad41618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.387+0000 7fbad9676640 1 -- 172.21.15.5:0/1373750914 >> v1:172.21.15.5:6789/0 conn(0x7fbad40cee10 legacy=0x7fbad40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.387+0000 7fbad9676640 1 -- 172.21.15.5:0/1373750914 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4162430 con 0x7fbad40b6250 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.387+0000 7fbad8e75640 1 -- 172.21.15.5:0/1373750914 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432884986 0 0) 0x7fbad4162150 con 0x7fbad40cee10 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.387+0000 7fbad9676640 1 --2- 172.21.15.5:0/1373750914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b6250 0x7fbad40ce8d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbad4075080 tx=0x7fbac802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b26c5603035cce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.387+0000 7fbad8e75640 1 -- 172.21.15.5:0/1373750914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037070 con 0x7fbad40b6250 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbad8e75640 1 -- 172.21.15.5:0/1373750914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8032440 con 0x7fbad40b6250 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbad8e75640 1 -- 172.21.15.5:0/1373750914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8032810 con 0x7fbad40b6250 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 -- 172.21.15.5:0/1373750914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b6250 msgr2=0x7fbad40ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1373750914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b6250 0x7fbad40ce8d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbad4075080 tx=0x7fbac802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 -- 172.21.15.5:0/1373750914 shutdown_connections 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1373750914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b6250 0x7fbad40ce8d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1373750914 >> v2:172.21.15.80:3300/0 conn(0x7fbad415df10 0x7fbad41618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 -- 172.21.15.5:0/1373750914 >> 172.21.15.5:0/1373750914 conn(0x7fbad40668f0 msgr2=0x7fbad4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 -- 172.21.15.5:0/1373750914 shutdown_connections 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.388+0000 7fbadc0db640 1 -- 172.21.15.5:0/1373750914 wait complete. 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.389+0000 7fbadc0db640 1 Processor -- start 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.389+0000 7fbadc0db640 1 -- start start 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbadc0db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b6250 0x7fbad415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbadc0db640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad40cee10 0x7fbad415cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbadc0db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad415df10 0x7fbad415fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbadc0db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad4161e10 con 0x7fbad415df10 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbadc0db640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40d1d60 con 0x7fbad40b6250 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbadc0db640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40d3570 con 0x7fbad40cee10 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad415df10 0x7fbad415fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad415df10 0x7fbad415fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60506/0 (socket says 172.21.15.5:60506) 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 -- 172.21.15.5:0/1453916957 learned_addr learned my addr 172.21.15.5:0/1453916957 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbad9e77640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b6250 0x7fbad415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbad9676640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad40cee10 0x7fbad415cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 -- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad40cee10 msgr2=0x7fbad415cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad40cee10 0x7fbad415cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 -- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b6250 msgr2=0x7fbad415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b6250 0x7fbad415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbada678640 1 -- 172.21.15.5:0/1453916957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40cd620 con 0x7fbad415df10 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.390+0000 7fbad9676640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad40cee10 0x7fbad415cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.391+0000 7fbada678640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad415df10 0x7fbad415fed0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c7e0 tx=0x7fbac400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.391+0000 7fbad27fc640 1 -- 172.21.15.5:0/1453916957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4018070 con 0x7fbad415df10 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.391+0000 7fbad27fc640 1 -- 172.21.15.5:0/1453916957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400a640 con 0x7fbad415df10 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.391+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad40cc860 con 0x7fbad415df10 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.391+0000 7fbad27fc640 1 -- 172.21.15.5:0/1453916957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac400aa30 con 0x7fbad415df10 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.391+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad40cce20 con 0x7fbad415df10 2024-04-25T09:03:25.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.392+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad404ef20 con 0x7fbad415df10 2024-04-25T09:03:25.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.392+0000 7fbad27fc640 1 -- 172.21.15.5:0/1453916957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbac401b070 con 0x7fbad415df10 2024-04-25T09:03:25.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.393+0000 7fbad27fc640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbac006b4d0 0x7fbac006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.393+0000 7fbad27fc640 1 -- 172.21.15.5:0/1453916957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbac40894c0 con 0x7fbad415df10 2024-04-25T09:03:25.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.393+0000 7fbad9e77640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbac006b4d0 0x7fbac006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.393+0000 7fbad9e77640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbac006b4d0 0x7fbac006d990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbacc006fd0 tx=0x7fbacc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.397+0000 7fbad27fc640 1 -- 172.21.15.5:0/1453916957 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbac40586d0 con 0x7fbad415df10 2024-04-25T09:03:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.577+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbad40b3340 con 0x7fbad415df10 2024-04-25T09:03:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.577+0000 7fbad27fc640 1 -- 172.21.15.5:0/1453916957 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbac4057fd0 con 0x7fbad415df10 2024-04-25T09:03:25.566 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbac006b4d0 msgr2=0x7fbac006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbac006b4d0 0x7fbac006d990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbacc006fd0 tx=0x7fbacc008040 comp rx=0 tx=0).stop 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad415df10 msgr2=0x7fbad415fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad415df10 0x7fbad415fed0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c7e0 tx=0x7fbac400cca0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 shutdown_connections 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbac006b4d0 0x7fbac006d990 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad415df10 0x7fbad415fed0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad40cee10 0x7fbad415cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 --2- 172.21.15.5:0/1453916957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b6250 0x7fbad415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 >> 172.21.15.5:0/1453916957 conn(0x7fbad40668f0 msgr2=0x7fbad40b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 shutdown_connections 2024-04-25T09:03:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.579+0000 7fbadc0db640 1 -- 172.21.15.5:0/1453916957 wait complete. 2024-04-25T09:03:25.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-04-25T09:03:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.691+0000 7f38a185d640 1 Processor -- start 2024-04-25T09:03:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.691+0000 7f38a185d640 1 -- start start 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f38a185d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f389c1419d0 0x7f389c0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f38a185d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f389c15ff80 0x7f389c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f38a185d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389c1604d0 con 0x7f389c06e0c0 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f38a185d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0cdfd0 con 0x7f389c1419d0 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f38a185d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c1454d0 con 0x7f389c15ff80 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f389a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f389c1419d0 0x7f389c0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f389affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f389c06e0c0 0x7f389c1412c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44190/0 (socket says 172.21.15.5:44190) 2024-04-25T09:03:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f389affd640 1 -- 172.21.15.5:0/1777798886 learned_addr learned my addr 172.21.15.5:0/1777798886 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:25.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f389a7fc640 1 -- 172.21.15.5:0/1777798886 >> v2:172.21.15.80:3300/0 conn(0x7f389c15ff80 msgr2=0x7f389c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f389a7fc640 1 --2- 172.21.15.5:0/1777798886 >> v2:172.21.15.80:3300/0 conn(0x7f389c15ff80 0x7f389c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f389a7fc640 1 -- 172.21.15.5:0/1777798886 >> v1:172.21.15.5:6789/0 conn(0x7f389c06e0c0 legacy=0x7f389c1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.692+0000 7f389a7fc640 1 -- 172.21.15.5:0/1777798886 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c0b56a0 con 0x7f389c1419d0 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.693+0000 7f389a7fc640 1 --2- 172.21.15.5:0/1777798886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c1419d0 0x7f389c0b2c70 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f38840097a0 tx=0x7f388402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434fc5a2c732941d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.693+0000 7f3899ffb640 1 -- 172.21.15.5:0/1777798886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884037070 con 0x7f389c1419d0 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.693+0000 7f3899ffb640 1 -- 172.21.15.5:0/1777798886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388402ae50 con 0x7f389c1419d0 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.693+0000 7f3899ffb640 1 -- 172.21.15.5:0/1777798886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884032660 con 0x7f389c1419d0 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 -- 172.21.15.5:0/1777798886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c1419d0 msgr2=0x7f389c0b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 --2- 172.21.15.5:0/1777798886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c1419d0 0x7f389c0b2c70 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f38840097a0 tx=0x7f388402a140 comp rx=0 tx=0).stop 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 -- 172.21.15.5:0/1777798886 shutdown_connections 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 --2- 172.21.15.5:0/1777798886 >> v2:172.21.15.80:3300/0 conn(0x7f389c15ff80 0x7f389c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 --2- 172.21.15.5:0/1777798886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c1419d0 0x7f389c0b2c70 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 -- 172.21.15.5:0/1777798886 >> 172.21.15.5:0/1777798886 conn(0x7f389c0b1970 msgr2=0x7f389c0b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 -- 172.21.15.5:0/1777798886 shutdown_connections 2024-04-25T09:03:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.694+0000 7f38a185d640 1 -- 172.21.15.5:0/1777798886 wait complete. 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.695+0000 7f38a185d640 1 Processor -- start 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.695+0000 7f38a185d640 1 -- start start 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f38a185d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06e0c0 0x7f389c136550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f38a185d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f389c1419d0 0x7f389c071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f38a185d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f389c15ff80 0x7f389c143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f38a185d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c06e4a0 con 0x7f389c06e0c0 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f38a185d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c0b5c60 con 0x7f389c1419d0 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f38a185d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389c06e620 con 0x7f389c15ff80 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06e0c0 0x7f389c136550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06e0c0 0x7f389c136550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60522/0 (socket says 172.21.15.5:60522) 2024-04-25T09:03:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 -- 172.21.15.5:0/1021185687 learned_addr learned my addr 172.21.15.5:0/1021185687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389a7fc640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f389c1419d0 0x7f389c071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389b7fe640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f389c15ff80 0x7f389c143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 -- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f389c15ff80 msgr2=0x7f389c143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f389c15ff80 0x7f389c143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 -- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f389c1419d0 msgr2=0x7f389c071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f389c1419d0 0x7f389c071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 -- 172.21.15.5:0/1021185687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c13f380 con 0x7f389c06e0c0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f389affd640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06e0c0 0x7f389c136550 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f389400c400 tx=0x7f389400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f3893fff640 1 -- 172.21.15.5:0/1021185687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894017070 con 0x7f389c06e0c0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f3893fff640 1 -- 172.21.15.5:0/1021185687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894005ce0 con 0x7f389c06e0c0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.696+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c13f660 con 0x7f389c06e0c0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.697+0000 7f3893fff640 1 -- 172.21.15.5:0/1021185687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894007310 con 0x7f389c06e0c0 2024-04-25T09:03:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.697+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c13e5d0 con 0x7f389c06e0c0 2024-04-25T09:03:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.698+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c04ef20 con 0x7f389c06e0c0 2024-04-25T09:03:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.698+0000 7f3893fff640 1 -- 172.21.15.5:0/1021185687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f389401a070 con 0x7f389c06e0c0 2024-04-25T09:03:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.699+0000 7f3893fff640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f387c06b4d0 0x7f387c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.699+0000 7f3893fff640 1 -- 172.21.15.5:0/1021185687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3894089290 con 0x7f389c06e0c0 2024-04-25T09:03:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.699+0000 7f389a7fc640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f387c06b4d0 0x7f387c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.699+0000 7f389a7fc640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f387c06b4d0 0x7f387c06d990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3884034000 tx=0x7f388402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.703+0000 7f3893fff640 1 -- 172.21.15.5:0/1021185687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38940584a0 con 0x7f389c06e0c0 2024-04-25T09:03:25.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:25.951+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f389c15ef40 con 0x7f389c06e0c0 2024-04-25T09:03:26.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.957+0000 7f3893fff640 1 -- 172.21.15.5:0/1021185687 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v325) v1 ==== 158+0+0 (secure 0 0 0) 0x7f3894057da0 con 0x7f389c06e0c0 2024-04-25T09:03:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f387c06b4d0 msgr2=0x7f387c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f387c06b4d0 0x7f387c06d990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3884034000 tx=0x7f388402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06e0c0 msgr2=0x7f389c136550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06e0c0 0x7f389c136550 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f389400c400 tx=0x7f389400c8c0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 shutdown_connections 2024-04-25T09:03:26.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f387c06b4d0 0x7f387c06d990 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f389c15ff80 0x7f389c143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f389c1419d0 0x7f389c071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 --2- 172.21.15.5:0/1021185687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06e0c0 0x7f389c136550 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 >> 172.21.15.5:0/1021185687 conn(0x7f389c0b1970 msgr2=0x7f389c15d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 shutdown_connections 2024-04-25T09:03:26.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:26.960+0000 7f38a185d640 1 -- 172.21.15.5:0/1021185687 wait complete. 2024-04-25T09:03:26.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:03:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.084+0000 7f9b8ae7c640 1 Processor -- start 2024-04-25T09:03:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.084+0000 7f9b8ae7c640 1 -- start start 2024-04-25T09:03:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b8ae7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b840b96e0 0x7f9b840d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b8ae7c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b840d4060 0x7f9b840b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b8ae7c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840b9b20 con 0x7f9b841614b0 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b8ae7c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840d2740 con 0x7f9b840d4060 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b8ae7c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840d2a20 con 0x7f9b840b96e0 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b89419640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b840d4060 0x7f9b840b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b88c18640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9b841614b0 0x7f9b840d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44196/0 (socket says 172.21.15.5:44196) 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b88c18640 1 -- 172.21.15.5:0/3285439328 learned_addr learned my addr 172.21.15.5:0/3285439328 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b83fff640 1 --2- 172.21.15.5:0/3285439328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b840b96e0 0x7f9b840d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b89419640 1 -- 172.21.15.5:0/3285439328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b840b96e0 msgr2=0x7f9b840d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.085+0000 7f9b89419640 1 --2- 172.21.15.5:0/3285439328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b840b96e0 0x7f9b840d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.086+0000 7f9b89419640 1 -- 172.21.15.5:0/3285439328 >> v1:172.21.15.5:6789/0 conn(0x7f9b841614b0 legacy=0x7f9b840d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.086+0000 7f9b89419640 1 -- 172.21.15.5:0/3285439328 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840d2d00 con 0x7f9b840d4060 2024-04-25T09:03:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.086+0000 7f9b837fe640 1 -- 172.21.15.5:0/3285439328 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735547063 0 0) 0x7f9b840b9b20 con 0x7f9b841614b0 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.086+0000 7f9b89419640 1 --2- 172.21.15.5:0/3285439328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b840b6cc0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009d90 tx=0x7f9b7c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdacb55834bb84d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.086+0000 7f9b837fe640 1 -- 172.21.15.5:0/3285439328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c007740 con 0x7f9b840d4060 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.086+0000 7f9b837fe640 1 -- 172.21.15.5:0/3285439328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c0078e0 con 0x7f9b840d4060 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.086+0000 7f9b837fe640 1 -- 172.21.15.5:0/3285439328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c007cb0 con 0x7f9b840d4060 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/3285439328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 msgr2=0x7f9b840b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/3285439328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b840b6cc0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009d90 tx=0x7f9b7c02a660 comp rx=0 tx=0).stop 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/3285439328 shutdown_connections 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/3285439328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b840b6cc0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/3285439328 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b840b96e0 0x7f9b840d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/3285439328 >> 172.21.15.5:0/3285439328 conn(0x7f9b8406b000 msgr2=0x7f9b8406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/3285439328 shutdown_connections 2024-04-25T09:03:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.087+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/3285439328 wait complete. 2024-04-25T09:03:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.088+0000 7f9b8ae7c640 1 Processor -- start 2024-04-25T09:03:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.088+0000 7f9b8ae7c640 1 -- start start 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b8ae7c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b840b96e0 0x7f9b841496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b8ae7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b841f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b8ae7c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b841614b0 0x7f9b840b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b8ae7c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840d37e0 con 0x7f9b840d4060 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b8ae7c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840d32c0 con 0x7f9b840b96e0 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b8ae7c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840b7200 con 0x7f9b841614b0 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b83fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b841f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b83fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b841f0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60546/0 (socket says 172.21.15.5:60546) 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b83fff640 1 -- 172.21.15.5:0/2020418922 learned_addr learned my addr 172.21.15.5:0/2020418922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b89419640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b841614b0 0x7f9b840b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b88c18640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b840b96e0 0x7f9b841496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b83fff640 1 -- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b841614b0 msgr2=0x7f9b840b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b83fff640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b841614b0 0x7f9b840b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.089+0000 7f9b83fff640 1 -- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b840b96e0 msgr2=0x7f9b841496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b83fff640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b840b96e0 0x7f9b841496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b83fff640 1 -- 172.21.15.5:0/2020418922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840b5120 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b83fff640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b841f0b90 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800d800 tx=0x7f9b7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b817fa640 1 -- 172.21.15.5:0/2020418922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800b6c0 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b817fa640 1 -- 172.21.15.5:0/2020418922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78019070 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b840b5400 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b817fa640 1 -- 172.21.15.5:0/2020418922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800ba80 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.090+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840b59c0 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.091+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8404ef20 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.091+0000 7f9b817fa640 1 -- 172.21.15.5:0/2020418922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b7800bc20 con 0x7f9b840d4060 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.092+0000 7f9b817fa640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b7006b4d0 0x7f9b7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.092+0000 7f9b817fa640 1 -- 172.21.15.5:0/2020418922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b7808a440 con 0x7f9b840d4060 2024-04-25T09:03:27.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.092+0000 7f9b88c18640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b7006b4d0 0x7f9b7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.093+0000 7f9b88c18640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b7006b4d0 0x7f9b7006d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9b74000f60 tx=0x7f9b74007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.096+0000 7f9b817fa640 1 -- 172.21.15.5:0/2020418922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b78059540 con 0x7f9b840d4060 2024-04-25T09:03:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.274+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9b840cd330 con 0x7f9b840d4060 2024-04-25T09:03:27.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.277+0000 7f9b817fa640 1 -- 172.21.15.5:0/2020418922 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9b78058e40 con 0x7f9b840d4060 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.279+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b7006b4d0 msgr2=0x7f9b7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.279+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b7006b4d0 0x7f9b7006d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9b74000f60 tx=0x7f9b74007c00 comp rx=0 tx=0).stop 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.279+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 msgr2=0x7f9b841f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.279+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b841f0b90 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800d800 tx=0x7f9b7800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 shutdown_connections 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b7006b4d0 0x7f9b7006d990 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b841614b0 0x7f9b840b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b840d4060 0x7f9b841f0b90 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 --2- 172.21.15.5:0/2020418922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b840b96e0 0x7f9b841496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 >> 172.21.15.5:0/2020418922 conn(0x7f9b8406b000 msgr2=0x7f9b8406b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 shutdown_connections 2024-04-25T09:03:27.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.280+0000 7f9b8ae7c640 1 -- 172.21.15.5:0/2020418922 wait complete. 2024-04-25T09:03:27.280 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:03:27.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:27.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:27.367 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:03:27.367 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:03:27.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.383 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:27.383 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:03:27.383 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:27.400 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:03:27.401 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.439 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:27.439 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:03:27.439 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:27.457 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:03:27.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:27.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.590+0000 7fb38f53b640 1 Processor -- start 2024-04-25T09:03:27.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.591+0000 7fb38f53b640 1 -- start start 2024-04-25T09:03:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.591+0000 7fb38f53b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb38815e0a0 0x7fb3880d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.591+0000 7fb38f53b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 0x7fb3880d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.591+0000 7fb38f53b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3880b7f60 con 0x7fb3880ce5e0 2024-04-25T09:03:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.591+0000 7fb38f53b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880d4330 con 0x7fb38815e0a0 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.591+0000 7fb38f53b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880b29c0 con 0x7fb3880d3990 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb38dad8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3880ce5e0 0x7fb3880cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44210/0 (socket says 172.21.15.5:44210) 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb38dad8640 1 -- 172.21.15.5:0/2836665795 learned_addr learned my addr 172.21.15.5:0/2836665795 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb38d2d7640 1 --2- 172.21.15.5:0/2836665795 >> v2:172.21.15.80:3300/0 conn(0x7fb38815e0a0 0x7fb3880d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb38cad6640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 0x7fb3880d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118493688 0 0) 0x7fb3880b7f60 con 0x7fb3880ce5e0 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb374003520 con 0x7fb3880ce5e0 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2719139510 0 0) 0x7fb374003520 con 0x7fb3880ce5e0 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 msgr2=0x7fb3880d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 0x7fb3880d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 >> v2:172.21.15.80:3300/0 conn(0x7fb38815e0a0 msgr2=0x7fb3880d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 --2- 172.21.15.5:0/2836665795 >> v2:172.21.15.80:3300/0 conn(0x7fb38815e0a0 0x7fb3880d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880d2080 con 0x7fb3880ce5e0 2024-04-25T09:03:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb3840019f0 con 0x7fb3880ce5e0 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 >> v1:172.21.15.5:6789/0 conn(0x7fb3880ce5e0 legacy=0x7fb3880cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 0x7fb3740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb374003f30 0x7fb374004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb374004d40 0x7fb3740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880b29c0 con 0x7fb374004d40 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37400b9c0 con 0x7fb374003f30 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37400bb40 con 0x7fb3880d3990 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb38dad8640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb374004d40 0x7fb3740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb38d2d7640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 0x7fb3740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.592+0000 7fb38cad6640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb374003f30 0x7fb374004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.593+0000 7fb38dad8640 1 -- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 msgr2=0x7fb3740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.593+0000 7fb38dad8640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3880d3990 0x7fb3740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.593+0000 7fb38dad8640 1 -- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb374003f30 msgr2=0x7fb374004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.593+0000 7fb38dad8640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb374003f30 0x7fb374004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.593+0000 7fb38dad8640 1 -- 172.21.15.5:0/2836665795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb374003520 con 0x7fb374004d40 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.593+0000 7fb38dad8640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb374004d40 0x7fb3740051c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb3840013d0 tx=0x7fb374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8e5224d52d6f1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38400a4e0 con 0x7fb374004d40 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38402f070 con 0x7fb374004d40 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb37ffff640 1 -- 172.21.15.5:0/2836665795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38402bcd0 con 0x7fb374004d40 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb38f53b640 1 -- 172.21.15.5:0/2836665795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb374004d40 msgr2=0x7fb3740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb38f53b640 1 --2- 172.21.15.5:0/2836665795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb374004d40 0x7fb3740051c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb3840013d0 tx=0x7fb374005830 comp rx=0 tx=0).stop 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb38dad8640 1 -- 172.21.15.5:0/2836665795 reap_dead start 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb38f53b640 1 -- 172.21.15.5:0/2836665795 shutdown_connections 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb38f53b640 1 -- 172.21.15.5:0/2836665795 >> 172.21.15.5:0/2836665795 conn(0x7fb3880668f0 msgr2=0x7fb388066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb38f53b640 1 -- 172.21.15.5:0/2836665795 shutdown_connections 2024-04-25T09:03:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.594+0000 7fb38f53b640 1 -- 172.21.15.5:0/2836665795 wait complete. 2024-04-25T09:03:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.595+0000 7fb38f53b640 1 Processor -- start 2024-04-25T09:03:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.595+0000 7fb38f53b640 1 -- start start 2024-04-25T09:03:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38f53b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb388152530 0x7fb3880ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38f53b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb388152910 0x7fb3880cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38f53b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb388156620 0x7fb388157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38f53b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880d2920 con 0x7fb388152910 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38f53b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880d2640 con 0x7fb388156620 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38f53b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880d2c00 con 0x7fb388152530 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38cad6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb388152910 0x7fb3880cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38cad6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb388152910 0x7fb3880cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60564/0 (socket says 172.21.15.5:60564) 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38cad6640 1 -- 172.21.15.5:0/3605510225 learned_addr learned my addr 172.21.15.5:0/3605510225 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38d2d7640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb388152530 0x7fb3880ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.596+0000 7fb38dad8640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb388156620 0x7fb388157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38cad6640 1 -- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb388152530 msgr2=0x7fb3880ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38cad6640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb388152530 0x7fb3880ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38cad6640 1 -- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb388156620 msgr2=0x7fb388157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38cad6640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb388156620 0x7fb388157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38cad6640 1 -- 172.21.15.5:0/3605510225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388156b90 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38cad6640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb388152910 0x7fb3880cd050 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fb3780118e0 tx=0x7fb378011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb37dffb640 1 -- 172.21.15.5:0/3605510225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37800fa30 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb37dffb640 1 -- 172.21.15.5:0/3605510225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37800fbd0 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb37dffb640 1 -- 172.21.15.5:0/3605510225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378014440 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3881548c0 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.597+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb388152f10 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.598+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38804ef20 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.599+0000 7fb37dffb640 1 -- 172.21.15.5:0/3605510225 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb378012040 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.599+0000 7fb37dffb640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb36c06b4d0 0x7fb36c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.599+0000 7fb37dffb640 1 -- 172.21.15.5:0/3605510225 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb37808a440 con 0x7fb388152910 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.599+0000 7fb38d2d7640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb36c06b4d0 0x7fb36c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.600+0000 7fb38d2d7640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb36c06b4d0 0x7fb36c06d990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb380009c40 tx=0x7fb380009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.603+0000 7fb37dffb640 1 -- 172.21.15.5:0/3605510225 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb378019030 con 0x7fb388152910 2024-04-25T09:03:27.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.819+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3880b67e0 con 0x7fb388152910 2024-04-25T09:03:27.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.820+0000 7fb37dffb640 1 -- 172.21.15.5:0/3605510225 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3690 (secure 0 0 0) 0x7fb378059540 con 0x7fb388152910 2024-04-25T09:03:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:27.809 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2318378934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2318378934},{"type":"v1","addr":"172.21.15.80:6836","nonce":2318378934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7084,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/966266921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":966266921},{"type":"v1","addr":"172.21.15.80:6837","nonce":966266921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2556273441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2556273441},{"type":"v1","addr":"172.21.15.5:6834","nonce":2556273441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1701192009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1701192009},{"type":"v1","addr":"172.21.15.5:6835","nonce":1701192009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[]} 2024-04-25T09:03:27.809 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 57 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb36c06b4d0 msgr2=0x7fb36c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb36c06b4d0 0x7fb36c06d990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb380009c40 tx=0x7fb380009190 comp rx=0 tx=0).stop 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb388152910 msgr2=0x7fb3880cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb388152910 0x7fb3880cd050 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fb3780118e0 tx=0x7fb378011ce0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 shutdown_connections 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb36c06b4d0 0x7fb36c06d990 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb388156620 0x7fb388157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb388152910 0x7fb3880cd050 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 --2- 172.21.15.5:0/3605510225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb388152530 0x7fb3880ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 >> 172.21.15.5:0/3605510225 conn(0x7fb3880668f0 msgr2=0x7fb3881600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 shutdown_connections 2024-04-25T09:03:27.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.822+0000 7fb38f53b640 1 -- 172.21.15.5:0/3605510225 wait complete. 2024-04-25T09:03:27.823 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:03:27.823 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:03:27.823 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:03:27.823 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.823 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:03:27.823 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:03:27.824 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:03:27.824 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.824 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:03:27.824 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:03:27.824 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:03:27.824 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.824 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:03:27.824 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:03:27.825 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:03:27.825 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.832 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:03:27.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:03:27.833 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:03:27.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:03:27.836 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:03:27.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:03:27.837 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:03:27.837 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:03:27.875 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:03:27.875 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.876 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:03:27.876 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.879 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:03:27.879 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.880 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:03:27.880 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:03:27.951 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:03:27.952 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:03:27.959 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:03:27.960 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:03:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.997+0000 7f537966f640 1 Processor -- start 2024-04-25T09:03:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.997+0000 7f537966f640 1 -- start start 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f537966f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f537415def0 0x7f53740d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f537966f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53740b94c0 0x7f53740d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f537966f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53740d0400 0x7f53740d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f537966f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537415e2d0 con 0x7f537415def0 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f537966f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53740d0db0 con 0x7f53740d0400 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f537966f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53740d2550 con 0x7f53740b94c0 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f537415def0 0x7f53740d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f537415def0 0x7f53740d35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60586/0 (socket says 172.21.15.5:60586) 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 -- 172.21.15.5:0/4050470823 learned_addr learned my addr 172.21.15.5:0/4050470823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f53727fc640 1 --2- 172.21.15.5:0/4050470823 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53740b94c0 0x7f53740d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f53737fe640 1 --2- 172.21.15.5:0/4050470823 >> v2:172.21.15.80:3300/0 conn(0x7f53740d0400 0x7f53740d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 -- 172.21.15.5:0/4050470823 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53740b94c0 msgr2=0x7f53740d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 --2- 172.21.15.5:0/4050470823 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53740b94c0 0x7f53740d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 -- 172.21.15.5:0/4050470823 >> v2:172.21.15.80:3300/0 conn(0x7f53740d0400 msgr2=0x7f53740d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 --2- 172.21.15.5:0/4050470823 >> v2:172.21.15.80:3300/0 conn(0x7f53740d0400 0x7f53740d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.998+0000 7f5372ffd640 1 -- 172.21.15.5:0/4050470823 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740d2830 con 0x7f537415def0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.999+0000 7f5372ffd640 1 --2- 172.21.15.5:0/4050470823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537415def0 0x7f53740d35f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f53740d1370 tx=0x7f536802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b026cb1ec56e8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.999+0000 7f5371ffb640 1 -- 172.21.15.5:0/4050470823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368037070 con 0x7f537415def0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.999+0000 7f5371ffb640 1 -- 172.21.15.5:0/4050470823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5368032440 con 0x7f537415def0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:27.999+0000 7f5371ffb640 1 -- 172.21.15.5:0/4050470823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368032810 con 0x7f537415def0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 -- 172.21.15.5:0/4050470823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537415def0 msgr2=0x7f53740d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 --2- 172.21.15.5:0/4050470823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537415def0 0x7f53740d35f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f53740d1370 tx=0x7f536802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 -- 172.21.15.5:0/4050470823 shutdown_connections 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 --2- 172.21.15.5:0/4050470823 >> v2:172.21.15.80:3300/0 conn(0x7f53740d0400 0x7f53740d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 --2- 172.21.15.5:0/4050470823 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f53740b94c0 0x7f53740d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 --2- 172.21.15.5:0/4050470823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537415def0 0x7f53740d35f0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 -- 172.21.15.5:0/4050470823 >> 172.21.15.5:0/4050470823 conn(0x7f537406b000 msgr2=0x7f537406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 -- 172.21.15.5:0/4050470823 shutdown_connections 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.000+0000 7f537966f640 1 -- 172.21.15.5:0/4050470823 wait complete. 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.001+0000 7f537966f640 1 Processor -- start 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.001+0000 7f537966f640 1 -- start start 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f537966f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53740b94c0 0x7f53741f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f537966f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53740d0400 0x7f53740ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f537966f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f537415def0 0x7f53740cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f537966f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740d30d0 con 0x7f53740b94c0 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f537966f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740d2df0 con 0x7f53740d0400 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f537966f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53740d2260 con 0x7f537415def0 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53740b94c0 0x7f53741f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53740b94c0 0x7f53741f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60600/0 (socket says 172.21.15.5:60600) 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 -- 172.21.15.5:0/2501413107 learned_addr learned my addr 172.21.15.5:0/2501413107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f53727fc640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53740d0400 0x7f53740ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f53737fe640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f537415def0 0x7f53740cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 -- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f537415def0 msgr2=0x7f53740cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f537415def0 0x7f53740cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 -- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53740d0400 msgr2=0x7f53740ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53740d0400 0x7f53740ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.002+0000 7f5372ffd640 1 -- 172.21.15.5:0/2501413107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740ce050 con 0x7f53740b94c0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.003+0000 7f5372ffd640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53740b94c0 0x7f53741f7680 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f536802a220 tx=0x7f53680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.003+0000 7f535b7fe640 1 -- 172.21.15.5:0/2501413107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368041020 con 0x7f53740b94c0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.003+0000 7f535b7fe640 1 -- 172.21.15.5:0/2501413107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536803d620 con 0x7f53740b94c0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.003+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53740ce330 con 0x7f53740b94c0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.003+0000 7f535b7fe640 1 -- 172.21.15.5:0/2501413107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368037040 con 0x7f53740b94c0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.003+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53741f6e80 con 0x7f53740b94c0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.004+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537404ef20 con 0x7f53740b94c0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.005+0000 7f535b7fe640 1 -- 172.21.15.5:0/2501413107 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5368044020 con 0x7f53740b94c0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.005+0000 7f535b7fe640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f536006b4d0 0x7f536006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.005+0000 7f535b7fe640 1 -- 172.21.15.5:0/2501413107 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f53680aaa20 con 0x7f53740b94c0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.005+0000 7f53727fc640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f536006b4d0 0x7f536006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.006+0000 7f53727fc640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f536006b4d0 0x7f536006d990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f537406b9f0 tx=0x7f5364009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.009+0000 7f535b7fe640 1 -- 172.21.15.5:0/2501413107 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f536804b030 con 0x7f53740b94c0 2024-04-25T09:03:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.201+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f53740b8340 con 0x7f53740b94c0 2024-04-25T09:03:28.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.969+0000 7f535b7fe640 1 -- 172.21.15.5:0/2501413107 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v93) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5368079750 con 0x7f53740b94c0 2024-04-25T09:03:28.958 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T09:03:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.972+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f536006b4d0 msgr2=0x7f536006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.972+0000 7f537966f640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f536006b4d0 0x7f536006d990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f537406b9f0 tx=0x7f5364009190 comp rx=0 tx=0).stop 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.972+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53740b94c0 msgr2=0x7f53741f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.972+0000 7f537966f640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53740b94c0 0x7f53741f7680 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f536802a220 tx=0x7f53680046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 shutdown_connections 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f536006b4d0 0x7f536006d990 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f537415def0 0x7f53740cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53740d0400 0x7f53740ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 --2- 172.21.15.5:0/2501413107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53740b94c0 0x7f53741f7680 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 >> 172.21.15.5:0/2501413107 conn(0x7f537406b000 msgr2=0x7f537415e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 shutdown_connections 2024-04-25T09:03:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:28.973+0000 7f537966f640 1 -- 172.21.15.5:0/2501413107 wait complete. 2024-04-25T09:03:28.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:03:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.094+0000 7f6c9386f640 1 Processor -- start 2024-04-25T09:03:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.094+0000 7f6c9386f640 1 -- start start 2024-04-25T09:03:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c9386f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c8c0b2cc0 0x7f6c8c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c9386f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c9386f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0d20e0 con 0x7f6c8c15de70 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c9386f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0d2a10 con 0x7f6c8c0b2cc0 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c9386f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0d23c0 con 0x7f6c8c0b7130 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c90e0a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c8c0b2cc0 0x7f6c8c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c9160b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6c8c15de70 0x7f6c8c0b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44228/0 (socket says 172.21.15.5:44228) 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c9160b640 1 -- 172.21.15.5:0/1831400446 learned_addr learned my addr 172.21.15.5:0/1831400446 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.095+0000 7f6c91e0c640 1 --2- 172.21.15.5:0/1831400446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c90e0a640 1 -- 172.21.15.5:0/1831400446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 msgr2=0x7f6c8c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c90e0a640 1 --2- 172.21.15.5:0/1831400446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c90e0a640 1 -- 172.21.15.5:0/1831400446 >> v1:172.21.15.5:6789/0 conn(0x7f6c8c15de70 legacy=0x7f6c8c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c83fff640 1 -- 172.21.15.5:0/1831400446 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870341167 0 0) 0x7f6c8c0d20e0 con 0x7f6c8c15de70 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c90e0a640 1 -- 172.21.15.5:0/1831400446 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0d26a0 con 0x7f6c8c0b2cc0 2024-04-25T09:03:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c91e0c640 1 --2- 172.21.15.5:0/1831400446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:29.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c90e0a640 1 --2- 172.21.15.5:0/1831400446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c0b2cc0 0x7f6c8c0b6bf0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0097a0 tx=0x7f6c7c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bf5dbaf44a20de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.096+0000 7f6c83fff640 1 -- 172.21.15.5:0/1831400446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c037070 con 0x7f6c8c0b2cc0 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c83fff640 1 -- 172.21.15.5:0/1831400446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c032440 con 0x7f6c8c0b2cc0 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c83fff640 1 -- 172.21.15.5:0/1831400446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c032810 con 0x7f6c8c0b2cc0 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 -- 172.21.15.5:0/1831400446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c0b2cc0 msgr2=0x7f6c8c0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 --2- 172.21.15.5:0/1831400446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c0b2cc0 0x7f6c8c0b6bf0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0097a0 tx=0x7f6c7c02a180 comp rx=0 tx=0).stop 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 -- 172.21.15.5:0/1831400446 shutdown_connections 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 --2- 172.21.15.5:0/1831400446 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 --2- 172.21.15.5:0/1831400446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c0b2cc0 0x7f6c8c0b6bf0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 -- 172.21.15.5:0/1831400446 >> 172.21.15.5:0/1831400446 conn(0x7f6c8c06b000 msgr2=0x7f6c8c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 -- 172.21.15.5:0/1831400446 shutdown_connections 2024-04-25T09:03:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.097+0000 7f6c9386f640 1 -- 172.21.15.5:0/1831400446 wait complete. 2024-04-25T09:03:29.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.098+0000 7f6c9386f640 1 Processor -- start 2024-04-25T09:03:29.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.098+0000 7f6c9386f640 1 -- start start 2024-04-25T09:03:29.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c9386f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c0b2cc0 0x7f6c8c1f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c9386f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c9386f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c15de70 0x7f6c8c0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c9386f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0cf100 con 0x7f6c8c15de70 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c9386f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0cef80 con 0x7f6c8c0b2cc0 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c9386f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0d2ea0 con 0x7f6c8c0b7130 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c91e0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c15de70 0x7f6c8c0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c91e0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c15de70 0x7f6c8c0c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60626/0 (socket says 172.21.15.5:60626) 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c91e0c640 1 -- 172.21.15.5:0/2459513289 learned_addr learned my addr 172.21.15.5:0/2459513289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c9160b640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c0b2cc0 0x7f6c8c1f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.099+0000 7f6c90e0a640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c91e0c640 1 -- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 msgr2=0x7f6c8c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c91e0c640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c91e0c640 1 -- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c0b2cc0 msgr2=0x7f6c8c1f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c91e0c640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c0b2cc0 0x7f6c8c1f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c91e0c640 1 -- 172.21.15.5:0/2459513289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0b50d0 con 0x7f6c8c15de70 2024-04-25T09:03:29.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c90e0a640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:29.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c91e0c640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c15de70 0x7f6c8c0c7480 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f6c84007ef0 tx=0x7f6c8400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c81ffb640 1 -- 172.21.15.5:0/2459513289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8401a070 con 0x7f6c8c15de70 2024-04-25T09:03:29.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c81ffb640 1 -- 172.21.15.5:0/2459513289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84003b90 con 0x7f6c8c15de70 2024-04-25T09:03:29.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c0b53b0 con 0x7f6c8c15de70 2024-04-25T09:03:29.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c81ffb640 1 -- 172.21.15.5:0/2459513289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400de20 con 0x7f6c8c15de70 2024-04-25T09:03:29.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.100+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c0b5970 con 0x7f6c8c15de70 2024-04-25T09:03:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.101+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c04ef20 con 0x7f6c8c15de70 2024-04-25T09:03:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.101+0000 7f6c81ffb640 1 -- 172.21.15.5:0/2459513289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c8401d070 con 0x7f6c8c15de70 2024-04-25T09:03:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.102+0000 7f6c81ffb640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7006b4d0 0x7f6c7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.102+0000 7f6c81ffb640 1 -- 172.21.15.5:0/2459513289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c8408a040 con 0x7f6c8c15de70 2024-04-25T09:03:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.102+0000 7f6c9160b640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7006b4d0 0x7f6c7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.103+0000 7f6c9160b640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7006b4d0 0x7f6c7006d990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c88007fd0 tx=0x7f6c88007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.106+0000 7f6c81ffb640 1 -- 172.21.15.5:0/2459513289 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c84010070 con 0x7f6c8c15de70 2024-04-25T09:03:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.353+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6c8c071800 con 0x7f6c8c15de70 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.354+0000 7f6c81ffb640 1 -- 172.21.15.5:0/2459513289 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6c84058bc0 con 0x7f6c8c15de70 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:03:29.344 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T09:03:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T09:03:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T09:03:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:03:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:03:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:03:29.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:29.356 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T09:03:29.356 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T09:03:29.356 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:03:29.357 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:03:29.357 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:29.357 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:03:29.357 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.357 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:29.357 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T09:03:29.357 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7006b4d0 msgr2=0x7f6c7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7006b4d0 0x7f6c7006d990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c88007fd0 tx=0x7f6c88007de0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c15de70 msgr2=0x7f6c8c0c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c15de70 0x7f6c8c0c7480 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f6c84007ef0 tx=0x7f6c8400d4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 shutdown_connections 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6c7006b4d0 0x7f6c7006d990 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c8c15de70 0x7f6c8c0c7480 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c8c0b7130 0x7f6c8c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 --2- 172.21.15.5:0/2459513289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c0b2cc0 0x7f6c8c1f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 >> 172.21.15.5:0/2459513289 conn(0x7f6c8c06b000 msgr2=0x7f6c8c0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 shutdown_connections 2024-04-25T09:03:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.356+0000 7f6c9386f640 1 -- 172.21.15.5:0/2459513289 wait complete. 2024-04-25T09:03:29.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:29.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.472+0000 7f3441a58640 1 Processor -- start 2024-04-25T09:03:29.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.472+0000 7f3441a58640 1 -- start start 2024-04-25T09:03:29.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3441a58640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f343c15bbd0 0x7f343c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3441a58640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c0b3f30 con 0x7f343c154f10 2024-04-25T09:03:29.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3441a58640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c15b0f0 con 0x7f343c0cfac0 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3441a58640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c0cff30 con 0x7f343c15bbd0 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f343affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f343c154f10 0x7f343c0b3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44242/0 (socket says 172.21.15.5:44242) 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f343affd640 1 -- 172.21.15.5:0/3278847177 learned_addr learned my addr 172.21.15.5:0/3278847177 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f343a7fc640 1 --2- 172.21.15.5:0/3278847177 >> v2:172.21.15.80:3300/0 conn(0x7f343c15bbd0 0x7f343c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568393029 0 0) 0x7f343c0b3f30 con 0x7f343c154f10 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3424003520 con 0x7f343c154f10 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856446881 0 0) 0x7f343c15b0f0 con 0x7f343c0cfac0 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f343c0b3f30 con 0x7f343c0cfac0 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f343a7fc640 1 -- 172.21.15.5:0/3278847177 >> v1:172.21.15.80:6789/0 conn(0x7f343c0cfac0 legacy=0x7f343c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f343a7fc640 1 -- 172.21.15.5:0/3278847177 >> v1:172.21.15.5:6789/0 conn(0x7f343c154f10 legacy=0x7f343c0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3611316669 0 0) 0x7f3424003520 con 0x7f343c154f10 2024-04-25T09:03:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.473+0000 7f343a7fc640 1 -- 172.21.15.5:0/3278847177 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c15b3d0 con 0x7f343c15bbd0 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.474+0000 7f343a7fc640 1 --2- 172.21.15.5:0/3278847177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c0cf580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34300097a0 tx=0x7f343002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86d8cefaec989b6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.474+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430037070 con 0x7f343c15bbd0 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.474+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343002abc0 con 0x7f343c15bbd0 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.474+0000 7f3439ffb640 1 -- 172.21.15.5:0/3278847177 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c001670 con 0x7f343c15bbd0 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.475+0000 7f3441a58640 1 -- 172.21.15.5:0/3278847177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 msgr2=0x7f343c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.475+0000 7f3441a58640 1 --2- 172.21.15.5:0/3278847177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c0cf580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34300097a0 tx=0x7f343002a130 comp rx=0 tx=0).stop 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.475+0000 7f3441a58640 1 -- 172.21.15.5:0/3278847177 shutdown_connections 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.475+0000 7f3441a58640 1 --2- 172.21.15.5:0/3278847177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c0cf580 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.475+0000 7f3441a58640 1 -- 172.21.15.5:0/3278847177 >> 172.21.15.5:0/3278847177 conn(0x7f343c0668f0 msgr2=0x7f343c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.475+0000 7f3441a58640 1 -- 172.21.15.5:0/3278847177 shutdown_connections 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.475+0000 7f3441a58640 1 -- 172.21.15.5:0/3278847177 wait complete. 2024-04-25T09:03:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.476+0000 7f3441a58640 1 Processor -- start 2024-04-25T09:03:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.476+0000 7f3441a58640 1 -- start start 2024-04-25T09:03:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f3441a58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cfac0 0x7f343c14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f3441a58640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f343c154f10 0x7f343c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f3441a58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f3441a58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0b3b80 con 0x7f343c0cfac0 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f3441a58640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c15f290 con 0x7f343c15bbd0 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f3441a58640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0ccc30 con 0x7f343c154f10 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cfac0 0x7f343c14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cfac0 0x7f343c14ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60632/0 (socket says 172.21.15.5:60632) 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 -- 172.21.15.5:0/630719385 learned_addr learned my addr 172.21.15.5:0/630719385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343a7fc640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f343c154f10 0x7f343c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343b7fe640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 -- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f343c154f10 msgr2=0x7f343c1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f343c154f10 0x7f343c1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 -- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 msgr2=0x7f343c150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343affd640 1 -- 172.21.15.5:0/630719385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c151e20 con 0x7f343c0cfac0 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.477+0000 7f343b7fe640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.478+0000 7f343affd640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cfac0 0x7f343c14ed60 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c5f0 tx=0x7f342c00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.478+0000 7f3423fff640 1 -- 172.21.15.5:0/630719385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c017070 con 0x7f343c0cfac0 2024-04-25T09:03:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.478+0000 7f3423fff640 1 -- 172.21.15.5:0/630719385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c005d00 con 0x7f343c0cfac0 2024-04-25T09:03:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.478+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c151580 con 0x7f343c0cfac0 2024-04-25T09:03:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.478+0000 7f3423fff640 1 -- 172.21.15.5:0/630719385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c0072b0 con 0x7f343c0cfac0 2024-04-25T09:03:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.478+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c151b40 con 0x7f343c0cfac0 2024-04-25T09:03:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.479+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c14e360 con 0x7f343c0cfac0 2024-04-25T09:03:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.479+0000 7f3423fff640 1 -- 172.21.15.5:0/630719385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f342c01a070 con 0x7f343c0cfac0 2024-04-25T09:03:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.480+0000 7f3423fff640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f342806b4d0 0x7f342806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.480+0000 7f3423fff640 1 -- 172.21.15.5:0/630719385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f342c089410 con 0x7f343c0cfac0 2024-04-25T09:03:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.480+0000 7f343a7fc640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f342806b4d0 0x7f342806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.480+0000 7f343a7fc640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f342806b4d0 0x7f342806d990 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3430034000 tx=0x7f343002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.484+0000 7f3423fff640 1 -- 172.21.15.5:0/630719385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f342c0585e0 con 0x7f343c0cfac0 2024-04-25T09:03:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.667+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f343c04ef20 con 0x7f343c0cfac0 2024-04-25T09:03:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.668+0000 7f3423fff640 1 -- 172.21.15.5:0/630719385 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+12808 (secure 0 0 0) 0x7f342c057ee0 con 0x7f343c0cfac0 2024-04-25T09:03:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:29.657 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:28.977491+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.670+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f342806b4d0 msgr2=0x7f342806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.670+0000 7f3441a58640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f342806b4d0 0x7f342806d990 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3430034000 tx=0x7f343002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cfac0 msgr2=0x7f343c14ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cfac0 0x7f343c14ed60 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c5f0 tx=0x7f342c00cab0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 shutdown_connections 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f342806b4d0 0x7f342806d990 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c15bbd0 0x7f343c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f343c154f10 0x7f343c1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 --2- 172.21.15.5:0/630719385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cfac0 0x7f343c14ed60 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 >> 172.21.15.5:0/630719385 conn(0x7f343c0668f0 msgr2=0x7f343c15d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 shutdown_connections 2024-04-25T09:03:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.671+0000 7f3441a58640 1 -- 172.21.15.5:0/630719385 wait complete. 2024-04-25T09:03:29.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:29.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.786+0000 7ff70d4c4640 1 Processor -- start 2024-04-25T09:03:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.786+0000 7ff70d4c4640 1 -- start start 2024-04-25T09:03:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.787+0000 7ff70d4c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7080b6250 0x7ff7080ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.787+0000 7ff70d4c4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7080cee10 0x7ff7080d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.787+0000 7ff70d4c4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff708162150 con 0x7ff70815df10 2024-04-25T09:03:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.787+0000 7ff70d4c4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7080d20d0 con 0x7ff7080cee10 2024-04-25T09:03:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.787+0000 7ff70d4c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff708162430 con 0x7ff7080b6250 2024-04-25T09:03:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff7067fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7080b6250 0x7ff7080ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff7077fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7080cee10 0x7ff7080d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff706ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff70815df10 0x7ff7081618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:44830/0 (socket says 172.21.15.5:44830) 2024-04-25T09:03:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff706ffd640 1 -- 172.21.15.5:0/3581726170 learned_addr learned my addr 172.21.15.5:0/3581726170 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff7077fe640 1 -- 172.21.15.5:0/3581726170 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7080b6250 msgr2=0x7ff7080ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff7077fe640 1 --2- 172.21.15.5:0/3581726170 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7080b6250 0x7ff7080ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff7077fe640 1 -- 172.21.15.5:0/3581726170 >> v1:172.21.15.80:6789/0 conn(0x7ff70815df10 legacy=0x7ff7081618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.788+0000 7ff7077fe640 1 -- 172.21.15.5:0/3581726170 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708162710 con 0x7ff7080cee10 2024-04-25T09:03:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff7077fe640 1 --2- 172.21.15.5:0/3581726170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080cee10 0x7ff7080d2560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009d90 tx=0x7ff6f802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d807571a3702a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff705ffb640 1 -- 172.21.15.5:0/3581726170 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8007740 con 0x7ff7080cee10 2024-04-25T09:03:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff705ffb640 1 -- 172.21.15.5:0/3581726170 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f80078e0 con 0x7ff7080cee10 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff705ffb640 1 -- 172.21.15.5:0/3581726170 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8007cb0 con 0x7ff7080cee10 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3581726170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080cee10 msgr2=0x7ff7080d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3581726170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080cee10 0x7ff7080d2560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009d90 tx=0x7ff6f802a660 comp rx=0 tx=0).stop 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3581726170 shutdown_connections 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3581726170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080cee10 0x7ff7080d2560 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3581726170 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7080b6250 0x7ff7080ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3581726170 >> 172.21.15.5:0/3581726170 conn(0x7ff7080668f0 msgr2=0x7ff708066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3581726170 shutdown_connections 2024-04-25T09:03:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.789+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3581726170 wait complete. 2024-04-25T09:03:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 Processor -- start 2024-04-25T09:03:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 -- start start 2024-04-25T09:03:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080b6250 0x7ff70814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7080cee10 0x7ff7081e7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70815df10 0x7ff7080d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080d2c20 con 0x7ff7080cee10 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080d2aa0 con 0x7ff7080b6250 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.791+0000 7ff70d4c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080d2da0 con 0x7ff70815df10 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7080cee10 0x7ff7081e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7080cee10 0x7ff7081e7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60644/0 (socket says 172.21.15.5:60644) 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 -- 172.21.15.5:0/3071795807 learned_addr learned my addr 172.21.15.5:0/3071795807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff706ffd640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080b6250 0x7ff70814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7077fe640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70815df10 0x7ff7080d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 -- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70815df10 msgr2=0x7ff7080d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70815df10 0x7ff7080d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 -- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080b6250 msgr2=0x7ff70814fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080b6250 0x7ff70814fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 -- 172.21.15.5:0/3071795807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7081e8010 con 0x7ff7080cee10 2024-04-25T09:03:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff7067fc640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7080cee10 0x7ff7081e7710 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e9b0 tx=0x7ff6f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff6ff7fe640 1 -- 172.21.15.5:0/3071795807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0017070 con 0x7ff7080cee10 2024-04-25T09:03:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff6ff7fe640 1 -- 172.21.15.5:0/3071795807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000c9a0 con 0x7ff7080cee10 2024-04-25T09:03:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7081e82f0 con 0x7ff7080cee10 2024-04-25T09:03:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff6ff7fe640 1 -- 172.21.15.5:0/3071795807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000cd90 con 0x7ff7080cee10 2024-04-25T09:03:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.792+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7081e88b0 con 0x7ff7080cee10 2024-04-25T09:03:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.793+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7081e8da0 con 0x7ff7080cee10 2024-04-25T09:03:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.794+0000 7ff6ff7fe640 1 -- 172.21.15.5:0/3071795807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff6f001a070 con 0x7ff7080cee10 2024-04-25T09:03:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.794+0000 7ff6ff7fe640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e806b4d0 0x7ff6e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.794+0000 7ff6ff7fe640 1 -- 172.21.15.5:0/3071795807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff6f008a190 con 0x7ff7080cee10 2024-04-25T09:03:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.794+0000 7ff706ffd640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e806b4d0 0x7ff6e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.795+0000 7ff706ffd640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e806b4d0 0x7ff6e806d990 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff700007fd0 tx=0x7ff700007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.798+0000 7ff6ff7fe640 1 -- 172.21.15.5:0/3071795807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff6f0058d10 con 0x7ff7080cee10 2024-04-25T09:03:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.977+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff70804ef20 con 0x7ff7080cee10 2024-04-25T09:03:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.977+0000 7ff6ff7fe640 1 -- 172.21.15.5:0/3071795807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6f005cdb0 con 0x7ff7080cee10 2024-04-25T09:03:29.966 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e806b4d0 msgr2=0x7ff6e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e806b4d0 0x7ff6e806d990 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff700007fd0 tx=0x7ff700007e80 comp rx=0 tx=0).stop 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7080cee10 msgr2=0x7ff7081e7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7080cee10 0x7ff7081e7710 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e9b0 tx=0x7ff6f000ee70 comp rx=0 tx=0).stop 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 shutdown_connections 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff6e806b4d0 0x7ff6e806d990 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff70815df10 0x7ff7080d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7080cee10 0x7ff7081e7710 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 --2- 172.21.15.5:0/3071795807 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7080b6250 0x7ff70814fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 >> 172.21.15.5:0/3071795807 conn(0x7ff7080668f0 msgr2=0x7ff7080ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 shutdown_connections 2024-04-25T09:03:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:29.979+0000 7ff70d4c4640 1 -- 172.21.15.5:0/3071795807 wait complete. 2024-04-25T09:03:29.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:03:30.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.091+0000 7f84b8d89640 1 Processor -- start 2024-04-25T09:03:30.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.091+0000 7f84b8d89640 1 -- start start 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b8d89640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84b415de70 0x7f84b40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b8d89640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 0x7f84b40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b8d89640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b40cf1c0 con 0x7f84b40b2cc0 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b8d89640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40d2a10 con 0x7f84b415de70 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b8d89640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40d20e0 con 0x7f84b40ce7f0 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b1d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f84b40b2cc0 0x7f84b40b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44250/0 (socket says 172.21.15.5:44250) 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b1d9b640 1 -- 172.21.15.5:0/3484733048 learned_addr learned my addr 172.21.15.5:0/3484733048 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b2d9d640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 0x7f84b40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b259c640 1 --2- 172.21.15.5:0/3484733048 >> v2:172.21.15.80:3300/0 conn(0x7f84b415de70 0x7f84b40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413936894 0 0) 0x7f84b40cf1c0 con 0x7f84b40b2cc0 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.092+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a0003520 con 0x7f84b40b2cc0 2024-04-25T09:03:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172725459 0 0) 0x7f84a0003520 con 0x7f84b40b2cc0 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 msgr2=0x7f84b40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 0x7f84b40cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 >> v2:172.21.15.80:3300/0 conn(0x7f84b415de70 msgr2=0x7f84b40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 --2- 172.21.15.5:0/3484733048 >> v2:172.21.15.80:3300/0 conn(0x7f84b415de70 0x7f84b40b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40d23c0 con 0x7f84b40b2cc0 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f849c001670 con 0x7f84b40b2cc0 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 >> v1:172.21.15.5:6789/0 conn(0x7f84b40b2cc0 legacy=0x7f84b40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 0x7f84a00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84a0003f30 0x7f84a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a0004d40 0x7f84a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40d2a10 con 0x7f84a0004d40 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40d20e0 con 0x7f84a0003f30 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a000b9c0 con 0x7f84b40ce7f0 2024-04-25T09:03:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b2d9d640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a0004d40 0x7f84a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b259c640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 0x7f84a00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b1d9b640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84a0003f30 0x7f84a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b2d9d640 1 -- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 msgr2=0x7f84a00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b2d9d640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84b40ce7f0 0x7f84a00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b2d9d640 1 -- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84a0003f30 msgr2=0x7f84a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b2d9d640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84a0003f30 0x7f84a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.093+0000 7f84b2d9d640 1 -- 172.21.15.5:0/3484733048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0003520 con 0x7f84a0004d40 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.094+0000 7f84b2d9d640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a0004d40 0x7f84a00051c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009fc0 tx=0x7f84a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e561fefd7792c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.094+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4009c10 con 0x7f84a0004d40 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.094+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4036070 con 0x7f84a0004d40 2024-04-25T09:03:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.094+0000 7f84b159a640 1 -- 172.21.15.5:0/3484733048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4031670 con 0x7f84a0004d40 2024-04-25T09:03:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.095+0000 7f84b8d89640 1 -- 172.21.15.5:0/3484733048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a0004d40 msgr2=0x7f84a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.095+0000 7f84b8d89640 1 --2- 172.21.15.5:0/3484733048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a0004d40 0x7f84a00051c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009fc0 tx=0x7f84a0005830 comp rx=0 tx=0).stop 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.095+0000 7f84b2d9d640 1 -- 172.21.15.5:0/3484733048 reap_dead start 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.095+0000 7f84b8d89640 1 -- 172.21.15.5:0/3484733048 shutdown_connections 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.095+0000 7f84b8d89640 1 -- 172.21.15.5:0/3484733048 >> 172.21.15.5:0/3484733048 conn(0x7f84b406b000 msgr2=0x7f84b406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.095+0000 7f84b8d89640 1 -- 172.21.15.5:0/3484733048 shutdown_connections 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.095+0000 7f84b8d89640 1 -- 172.21.15.5:0/3484733048 wait complete. 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.096+0000 7f84b8d89640 1 Processor -- start 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.096+0000 7f84b8d89640 1 -- start start 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b8d89640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84a0004d40 0x7f84b41f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b8d89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b41f4c30 0x7f84b41f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b8d89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b41f6640 0x7f84b414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b8d89640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b7300 con 0x7f84b41f4c30 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b8d89640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b9920 con 0x7f84b41f6640 2024-04-25T09:03:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b8d89640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40cec80 con 0x7f84a0004d40 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b41f4c30 0x7f84b41f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b41f4c30 0x7f84b41f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60672/0 (socket says 172.21.15.5:60672) 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 -- 172.21.15.5:0/1124817898 learned_addr learned my addr 172.21.15.5:0/1124817898 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b259c640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84a0004d40 0x7f84b41f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b2d9d640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b41f6640 0x7f84b414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 -- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84a0004d40 msgr2=0x7f84b41f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84a0004d40 0x7f84b41f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 -- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b41f6640 msgr2=0x7f84b414dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b41f6640 0x7f84b414dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.097+0000 7f84b1d9b640 1 -- 172.21.15.5:0/1124817898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b414d200 con 0x7f84b41f4c30 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.098+0000 7f84b1d9b640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b41f4c30 0x7f84b41f6100 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f849c001a70 tx=0x7f849c0076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.098+0000 7f84aaffd640 1 -- 172.21.15.5:0/1124817898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00f9c0 con 0x7f84b41f4c30 2024-04-25T09:03:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.098+0000 7f84aaffd640 1 -- 172.21.15.5:0/1124817898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c018070 con 0x7f84b41f4c30 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.098+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b414d4e0 con 0x7f84b41f4c30 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.098+0000 7f84aaffd640 1 -- 172.21.15.5:0/1124817898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00fda0 con 0x7f84b41f4c30 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.098+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b41f42d0 con 0x7f84b41f4c30 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.099+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b404ef20 con 0x7f84b41f4c30 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.099+0000 7f84aaffd640 1 -- 172.21.15.5:0/1124817898 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f849c01d460 con 0x7f84b41f4c30 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.100+0000 7f84aaffd640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f849406b4d0 0x7f849406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.100+0000 7f84aaffd640 1 -- 172.21.15.5:0/1124817898 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f849c089e20 con 0x7f84b41f4c30 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.100+0000 7f84b259c640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f849406b4d0 0x7f849406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.100+0000 7f84b259c640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f849406b4d0 0x7f849406d990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009c40 tx=0x7f84ac009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.104+0000 7f84aaffd640 1 -- 172.21.15.5:0/1124817898 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f849c059080 con 0x7f84b41f4c30 2024-04-25T09:03:30.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.285+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f84b40b6e90 con 0x7f84b41f4c30 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.286+0000 7f84aaffd640 1 -- 172.21.15.5:0/1124817898 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) v1 ==== 84+0+65 (secure 0 0 0) 0x7f849c058980 con 0x7f84b41f4c30 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T09:03:30.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f849406b4d0 msgr2=0x7f849406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f849406b4d0 0x7f849406d990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009c40 tx=0x7f84ac009190 comp rx=0 tx=0).stop 2024-04-25T09:03:30.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b41f4c30 msgr2=0x7f84b41f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b41f4c30 0x7f84b41f6100 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f849c001a70 tx=0x7f849c0076e0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 shutdown_connections 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f849406b4d0 0x7f849406d990 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b41f6640 0x7f84b414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.287+0000 7f84b8d89640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b41f4c30 0x7f84b41f6100 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.288+0000 7f84b8d89640 1 --2- 172.21.15.5:0/1124817898 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f84a0004d40 0x7f84b41f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.288+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 >> 172.21.15.5:0/1124817898 conn(0x7f84b406b000 msgr2=0x7f84b40cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.288+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 shutdown_connections 2024-04-25T09:03:30.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.288+0000 7f84b8d89640 1 -- 172.21.15.5:0/1124817898 wait complete. 2024-04-25T09:03:30.287 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:03:30.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:03:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.404+0000 7f2fa801f640 1 Processor -- start 2024-04-25T09:03:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.404+0000 7f2fa801f640 1 -- start start 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa801f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa015dbd0 0x7f2fa01617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa801f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fa00b9470 0x7f2fa00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa801f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa0162070 con 0x7f2fa00cecf0 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa801f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00cf160 con 0x7f2fa00b9470 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa801f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0162350 con 0x7f2fa015dbd0 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa55ba640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fa00b9470 0x7f2fa00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa65bc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2fa00cecf0 0x7f2fa00b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44266/0 (socket says 172.21.15.5:44266) 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa65bc640 1 -- 172.21.15.5:0/3054131258 learned_addr learned my addr 172.21.15.5:0/3054131258 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa5dbb640 1 --2- 172.21.15.5:0/3054131258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa015dbd0 0x7f2fa01617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa55ba640 1 -- 172.21.15.5:0/3054131258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa015dbd0 msgr2=0x7f2fa01617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa55ba640 1 --2- 172.21.15.5:0/3054131258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa015dbd0 0x7f2fa01617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa55ba640 1 -- 172.21.15.5:0/3054131258 >> v1:172.21.15.5:6789/0 conn(0x7f2fa00cecf0 legacy=0x7f2fa00b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa55ba640 1 -- 172.21.15.5:0/3054131258 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00d1c50 con 0x7f2fa00b9470 2024-04-25T09:03:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.405+0000 7f2fa4db9640 1 -- 172.21.15.5:0/3054131258 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718938379 0 0) 0x7f2fa0162070 con 0x7f2fa00cecf0 2024-04-25T09:03:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa55ba640 1 --2- 172.21.15.5:0/3054131258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa00b9470 0x7f2fa00ce7b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097a0 tx=0x7f2f9002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ee88b9b4ee3b64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa4db9640 1 -- 172.21.15.5:0/3054131258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90037070 con 0x7f2fa00b9470 2024-04-25T09:03:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa4db9640 1 -- 172.21.15.5:0/3054131258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90032440 con 0x7f2fa00b9470 2024-04-25T09:03:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa4db9640 1 -- 172.21.15.5:0/3054131258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90032810 con 0x7f2fa00b9470 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa801f640 1 -- 172.21.15.5:0/3054131258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa00b9470 msgr2=0x7f2fa00ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3054131258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa00b9470 0x7f2fa00ce7b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097a0 tx=0x7f2f9002a180 comp rx=0 tx=0).stop 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa801f640 1 -- 172.21.15.5:0/3054131258 shutdown_connections 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3054131258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa00b9470 0x7f2fa00ce7b0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3054131258 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa015dbd0 0x7f2fa01617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.406+0000 7f2fa801f640 1 -- 172.21.15.5:0/3054131258 >> 172.21.15.5:0/3054131258 conn(0x7f2fa0066ad0 msgr2=0x7f2fa0066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.407+0000 7f2fa801f640 1 -- 172.21.15.5:0/3054131258 shutdown_connections 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.407+0000 7f2fa801f640 1 -- 172.21.15.5:0/3054131258 wait complete. 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 Processor -- start 2024-04-25T09:03:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 -- start start 2024-04-25T09:03:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa00b9470 0x7f2fa00cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cecf0 0x7f2fa01e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa015dbd0 0x7f2fa0149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0161cf0 con 0x7f2fa015dbd0 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0162630 con 0x7f2fa00b9470 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.408+0000 7f2fa801f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa015dfb0 con 0x7f2fa00cecf0 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa015dbd0 0x7f2fa0149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa015dbd0 0x7f2fa0149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60688/0 (socket says 172.21.15.5:60688) 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 -- 172.21.15.5:0/3684655693 learned_addr learned my addr 172.21.15.5:0/3684655693 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa5dbb640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa00b9470 0x7f2fa00cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa55ba640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cecf0 0x7f2fa01e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 -- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cecf0 msgr2=0x7f2fa01e86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cecf0 0x7f2fa01e86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 -- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa00b9470 msgr2=0x7f2fa00cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa00b9470 0x7f2fa00cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 -- 172.21.15.5:0/3684655693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00cd880 con 0x7f2fa015dbd0 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa65bc640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa015dbd0 0x7f2fa0149ad0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c7a0 tx=0x7f2f9800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2f967fc640 1 -- 172.21.15.5:0/3684655693 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98018070 con 0x7f2fa015dbd0 2024-04-25T09:03:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2f967fc640 1 -- 172.21.15.5:0/3684655693 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9800a640 con 0x7f2fa015dbd0 2024-04-25T09:03:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa00cdb20 con 0x7f2fa015dbd0 2024-04-25T09:03:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2f967fc640 1 -- 172.21.15.5:0/3684655693 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800aab0 con 0x7f2fa015dbd0 2024-04-25T09:03:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.409+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa00cb190 con 0x7f2fa015dbd0 2024-04-25T09:03:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.410+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa004ef20 con 0x7f2fa015dbd0 2024-04-25T09:03:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.411+0000 7f2f967fc640 1 -- 172.21.15.5:0/3684655693 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f9801b070 con 0x7f2fa015dbd0 2024-04-25T09:03:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.411+0000 7f2f967fc640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b4d0 0x7f2f8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.411+0000 7f2f967fc640 1 -- 172.21.15.5:0/3684655693 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f98089400 con 0x7f2fa015dbd0 2024-04-25T09:03:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.411+0000 7f2fa5dbb640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b4d0 0x7f2f8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.412+0000 7f2fa5dbb640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b4d0 0x7f2f8406d990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00ce100 tx=0x7f2f9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.415+0000 7f2f967fc640 1 -- 172.21.15.5:0/3684655693 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f98057f70 con 0x7f2fa015dbd0 2024-04-25T09:03:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.595+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2fa00d1760 con 0x7f2fa015dbd0 2024-04-25T09:03:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.977+0000 7f2f967fc640 1 -- 172.21.15.5:0/3684655693 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f9805c010 con 0x7f2fa015dbd0 2024-04-25T09:03:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b4d0 msgr2=0x7f2f8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b4d0 0x7f2f8406d990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00ce100 tx=0x7f2f9c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa015dbd0 msgr2=0x7f2fa0149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa015dbd0 0x7f2fa0149ad0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c7a0 tx=0x7f2f9800cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 shutdown_connections 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2f8406b4d0 0x7f2f8406d990 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fa015dbd0 0x7f2fa0149ad0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2fa00cecf0 0x7f2fa01e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 --2- 172.21.15.5:0/3684655693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fa00b9470 0x7f2fa00cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 >> 172.21.15.5:0/3684655693 conn(0x7f2fa0066ad0 msgr2=0x7f2fa00c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 shutdown_connections 2024-04-25T09:03:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:30.980+0000 7f2fa801f640 1 -- 172.21.15.5:0/3684655693 wait complete. 2024-04-25T09:03:30.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:03:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.106+0000 7f6cc98f5640 1 Processor -- start 2024-04-25T09:03:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.106+0000 7f6cc98f5640 1 -- start start 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc98f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cc40d2f70 0x7f6cc40ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc98f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc98f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc40d1ed0 con 0x7f6cc415df70 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc98f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40d1c80 con 0x7f6cc40d2f70 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc98f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40d2ae0 con 0x7f6cc40ced50 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc27fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cc40d2f70 0x7f6cc40ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc27fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cc40d2f70 0x7f6cc40ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55494/0 (socket says 172.21.15.5:55494) 2024-04-25T09:03:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc2ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6cc415df70 0x7f6cc40b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48612/0 (socket says 172.21.15.5:48612) 2024-04-25T09:03:31.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc27fc640 1 -- 172.21.15.5:0/3175032218 learned_addr learned my addr 172.21.15.5:0/3175032218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:31.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc27fc640 1 -- 172.21.15.5:0/3175032218 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 msgr2=0x7f6cc40b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc27fc640 1 --2- 172.21.15.5:0/3175032218 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc27fc640 1 -- 172.21.15.5:0/3175032218 >> v1:172.21.15.5:6789/0 conn(0x7f6cc415df70 legacy=0x7f6cc40b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc27fc640 1 -- 172.21.15.5:0/3175032218 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40d21b0 con 0x7f6cc40d2f70 2024-04-25T09:03:31.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.107+0000 7f6cc1ffb640 1 -- 172.21.15.5:0/3175032218 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375101696 0 0) 0x7f6cc40d1ed0 con 0x7f6cc415df70 2024-04-25T09:03:31.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.108+0000 7f6cc27fc640 1 --2- 172.21.15.5:0/3175032218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc40d2f70 0x7f6cc40ce810 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009870 tx=0x7f6cb802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb57ef65c6ef84e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.108+0000 7f6cc1ffb640 1 -- 172.21.15.5:0/3175032218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8037070 con 0x7f6cc40d2f70 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.108+0000 7f6cc1ffb640 1 -- 172.21.15.5:0/3175032218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb802ae50 con 0x7f6cc40d2f70 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.108+0000 7f6cc1ffb640 1 -- 172.21.15.5:0/3175032218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8032860 con 0x7f6cc40d2f70 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 -- 172.21.15.5:0/3175032218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc40d2f70 msgr2=0x7f6cc40ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/3175032218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc40d2f70 0x7f6cc40ce810 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009870 tx=0x7f6cb802a300 comp rx=0 tx=0).stop 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 -- 172.21.15.5:0/3175032218 shutdown_connections 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/3175032218 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/3175032218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc40d2f70 0x7f6cc40ce810 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 -- 172.21.15.5:0/3175032218 >> 172.21.15.5:0/3175032218 conn(0x7f6cc406b000 msgr2=0x7f6cc406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 -- 172.21.15.5:0/3175032218 shutdown_connections 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.109+0000 7f6cc98f5640 1 -- 172.21.15.5:0/3175032218 wait complete. 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.110+0000 7f6cc98f5640 1 Processor -- start 2024-04-25T09:03:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.110+0000 7f6cc98f5640 1 -- start start 2024-04-25T09:03:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc98f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc98f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cc40d2f70 0x7f6cc41e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc98f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc4149d70 0x7f6cc41e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc98f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40d3720 con 0x7f6cc4149d70 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc98f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40d2770 con 0x7f6cc40d2f70 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc98f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40d38a0 con 0x7f6cc40ced50 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc4149d70 0x7f6cc41e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc4149d70 0x7f6cc41e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55496/0 (socket says 172.21.15.5:55496) 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 -- 172.21.15.5:0/35773647 learned_addr learned my addr 172.21.15.5:0/35773647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc2ffd640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc27fc640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cc40d2f70 0x7f6cc41e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 -- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 msgr2=0x7f6cc40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 -- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cc40d2f70 msgr2=0x7f6cc41e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cc40d2f70 0x7f6cc41e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 -- 172.21.15.5:0/35773647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40b5330 con 0x7f6cc4149d70 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc27fc640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cc40d2f70 0x7f6cc41e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc2ffd640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cc37fe640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc4149d70 0x7f6cc41e7a60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00b9a0 tx=0x7f6cbc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.111+0000 7f6cabfff640 1 -- 172.21.15.5:0/35773647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc019070 con 0x7f6cc4149d70 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.112+0000 7f6cabfff640 1 -- 172.21.15.5:0/35773647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc00cbc0 con 0x7f6cc4149d70 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.112+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc40b5610 con 0x7f6cc4149d70 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.112+0000 7f6cabfff640 1 -- 172.21.15.5:0/35773647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc014440 con 0x7f6cc4149d70 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.112+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc40b5bd0 con 0x7f6cc4149d70 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.113+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc404ef20 con 0x7f6cc4149d70 2024-04-25T09:03:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.113+0000 7f6cabfff640 1 -- 172.21.15.5:0/35773647 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6cbc01c070 con 0x7f6cc4149d70 2024-04-25T09:03:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.114+0000 7f6cabfff640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6cb006b4d0 0x7f6cb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.114+0000 7f6cabfff640 1 -- 172.21.15.5:0/35773647 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6cbc089d10 con 0x7f6cc4149d70 2024-04-25T09:03:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.114+0000 7f6cc2ffd640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6cb006b4d0 0x7f6cb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.115+0000 7f6cc2ffd640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6cb006b4d0 0x7f6cb006d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4000f60 tx=0x7f6cb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.118+0000 7f6cabfff640 1 -- 172.21.15.5:0/35773647 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6cbc058e00 con 0x7f6cc4149d70 2024-04-25T09:03:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.297+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6cc4160fb0 con 0x7f6cc4149d70 2024-04-25T09:03:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.980+0000 7f6cabfff640 1 -- 172.21.15.5:0/35773647 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6cbc058700 con 0x7f6cc4149d70 2024-04-25T09:03:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T09:03:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6cb006b4d0 msgr2=0x7f6cb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6cb006b4d0 0x7f6cb006d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4000f60 tx=0x7f6cb4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc4149d70 msgr2=0x7f6cc41e7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc4149d70 0x7f6cc41e7a60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00b9a0 tx=0x7f6cbc00be60 comp rx=0 tx=0).stop 2024-04-25T09:03:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 shutdown_connections 2024-04-25T09:03:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6cb006b4d0 0x7f6cb006d990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cc4149d70 0x7f6cc41e7a60 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cc40d2f70 0x7f6cc41e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 --2- 172.21.15.5:0/35773647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6cc40ced50 0x7f6cc40b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 >> 172.21.15.5:0/35773647 conn(0x7f6cc406b000 msgr2=0x7f6cc4160170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 shutdown_connections 2024-04-25T09:03:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:31.983+0000 7f6cc98f5640 1 -- 172.21.15.5:0/35773647 wait complete. 2024-04-25T09:03:31.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:03:32.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.116+0000 7f2e83d53640 1 Processor -- start 2024-04-25T09:03:32.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.116+0000 7f2e83d53640 1 -- start start 2024-04-25T09:03:32.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e83d53640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e7c0ae690 0x7f2e7c0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e83d53640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e7c0b2850 0x7f2e7c0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e83d53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0ce190 0x7f2e7c0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e83d53640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c071ff0 con 0x7f2e7c0b2850 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e83d53640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0b2ce0 con 0x7f2e7c0ae690 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e83d53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c072690 con 0x7f2e7c0ce190 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e7c0b2850 0x7f2e7c0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e7c0b2850 0x7f2e7c0aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55500/0 (socket says 172.21.15.5:55500) 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 -- 172.21.15.5:0/940966309 learned_addr learned my addr 172.21.15.5:0/940966309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e81aef640 1 --2- 172.21.15.5:0/940966309 >> v2:172.21.15.80:3300/0 conn(0x7f2e7c0ae690 0x7f2e7c0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e822f0640 1 --2- 172.21.15.5:0/940966309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0ce190 0x7f2e7c0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 -- 172.21.15.5:0/940966309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0ce190 msgr2=0x7f2e7c0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 --2- 172.21.15.5:0/940966309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0ce190 0x7f2e7c0cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 -- 172.21.15.5:0/940966309 >> v2:172.21.15.80:3300/0 conn(0x7f2e7c0ae690 msgr2=0x7f2e7c0b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 --2- 172.21.15.5:0/940966309 >> v2:172.21.15.80:3300/0 conn(0x7f2e7c0ae690 0x7f2e7c0b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e812ee640 1 -- 172.21.15.5:0/940966309 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0aefb0 con 0x7f2e7c0b2850 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.117+0000 7f2e81aef640 1 --2- 172.21.15.5:0/940966309 >> v2:172.21.15.80:3300/0 conn(0x7f2e7c0ae690 0x7f2e7c0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.118+0000 7f2e812ee640 1 --2- 172.21.15.5:0/940966309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0b2850 0x7f2e7c0aea70 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0d0900 tx=0x7f2e6c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a404116f7e2f8d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.118+0000 7f2e80aed640 1 -- 172.21.15.5:0/940966309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c037070 con 0x7f2e7c0b2850 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.118+0000 7f2e80aed640 1 -- 172.21.15.5:0/940966309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c032440 con 0x7f2e7c0b2850 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.118+0000 7f2e80aed640 1 -- 172.21.15.5:0/940966309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c032810 con 0x7f2e7c0b2850 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 -- 172.21.15.5:0/940966309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0b2850 msgr2=0x7f2e7c0aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 --2- 172.21.15.5:0/940966309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0b2850 0x7f2e7c0aea70 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0d0900 tx=0x7f2e6c02a140 comp rx=0 tx=0).stop 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 -- 172.21.15.5:0/940966309 shutdown_connections 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 --2- 172.21.15.5:0/940966309 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0ce190 0x7f2e7c0cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 --2- 172.21.15.5:0/940966309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0b2850 0x7f2e7c0aea70 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 --2- 172.21.15.5:0/940966309 >> v2:172.21.15.80:3300/0 conn(0x7f2e7c0ae690 0x7f2e7c0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 -- 172.21.15.5:0/940966309 >> 172.21.15.5:0/940966309 conn(0x7f2e7c0b1550 msgr2=0x7f2e7c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 -- 172.21.15.5:0/940966309 shutdown_connections 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.119+0000 7f2e83d53640 1 -- 172.21.15.5:0/940966309 wait complete. 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.120+0000 7f2e83d53640 1 Processor -- start 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.120+0000 7f2e83d53640 1 -- start start 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e83d53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e7c0ae690 0x7f2e7c14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e83d53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0b2850 0x7f2e7c0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e83d53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0ce190 0x7f2e7c1e76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e83d53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0cd6b0 con 0x7f2e7c0ce190 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e83d53640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0cd3d0 con 0x7f2e7c0ae690 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e83d53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0cd990 con 0x7f2e7c0b2850 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0ce190 0x7f2e7c1e76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0ce190 0x7f2e7c1e76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55502/0 (socket says 172.21.15.5:55502) 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 -- 172.21.15.5:0/3383157667 learned_addr learned my addr 172.21.15.5:0/3383157667 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e81aef640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e7c0ae690 0x7f2e7c14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e812ee640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0b2850 0x7f2e7c0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 -- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0b2850 msgr2=0x7f2e7c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0b2850 0x7f2e7c0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 -- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e7c0ae690 msgr2=0x7f2e7c14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e7c0ae690 0x7f2e7c14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 -- 172.21.15.5:0/3383157667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0ab930 con 0x7f2e7c0ce190 2024-04-25T09:03:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e812ee640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0b2850 0x7f2e7c0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e822f0640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0ce190 0x7f2e7c1e76c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400cc30 tx=0x7f2e7400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e727fc640 1 -- 172.21.15.5:0/3383157667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400ce40 con 0x7f2e7c0ce190 2024-04-25T09:03:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.121+0000 7f2e727fc640 1 -- 172.21.15.5:0/3383157667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e74003990 con 0x7f2e7c0ce190 2024-04-25T09:03:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.122+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c0abc10 con 0x7f2e7c0ce190 2024-04-25T09:03:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.122+0000 7f2e727fc640 1 -- 172.21.15.5:0/3383157667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74003d40 con 0x7f2e7c0ce190 2024-04-25T09:03:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.122+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c0ac4b0 con 0x7f2e7c0ce190 2024-04-25T09:03:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.123+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0abde0 con 0x7f2e7c0ce190 2024-04-25T09:03:32.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.123+0000 7f2e727fc640 1 -- 172.21.15.5:0/3383157667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e74003ee0 con 0x7f2e7c0ce190 2024-04-25T09:03:32.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.124+0000 7f2e727fc640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6006b4d0 0x7f2e6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.124+0000 7f2e727fc640 1 -- 172.21.15.5:0/3383157667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2e7408a5d0 con 0x7f2e7c0ce190 2024-04-25T09:03:32.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.124+0000 7f2e81aef640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6006b4d0 0x7f2e6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.125+0000 7f2e81aef640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6006b4d0 0x7f2e6006d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006b10 tx=0x7f2e78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.128+0000 7f2e727fc640 1 -- 172.21.15.5:0/3383157667 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e74014030 con 0x7f2e7c0ce190 2024-04-25T09:03:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:32.345+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2e7c04ef20 con 0x7f2e7c0ce190 2024-04-25T09:03:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.014+0000 7f2e727fc640 1 -- 172.21.15.5:0/3383157667 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2e74059540 con 0x7f2e7c0ce190 2024-04-25T09:03:33.003 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 14 and data pool 15 2024-04-25T09:03:33.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.019+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6006b4d0 msgr2=0x7f2e6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.019+0000 7f2e83d53640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6006b4d0 0x7f2e6006d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006b10 tx=0x7f2e78008040 comp rx=0 tx=0).stop 2024-04-25T09:03:33.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.019+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0ce190 msgr2=0x7f2e7c1e76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.019+0000 7f2e83d53640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0ce190 0x7f2e7c1e76c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400cc30 tx=0x7f2e7400a5c0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.020+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 shutdown_connections 2024-04-25T09:03:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.020+0000 7f2e83d53640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2e6006b4d0 0x7f2e6006d990 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.020+0000 7f2e83d53640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0ce190 0x7f2e7c1e76c0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.020+0000 7f2e83d53640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2e7c0b2850 0x7f2e7c0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.020+0000 7f2e83d53640 1 --2- 172.21.15.5:0/3383157667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e7c0ae690 0x7f2e7c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.020+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 >> 172.21.15.5:0/3383157667 conn(0x7f2e7c0b1550 msgr2=0x7f2e7c0b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.020+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 shutdown_connections 2024-04-25T09:03:33.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.021+0000 7f2e83d53640 1 -- 172.21.15.5:0/3383157667 wait complete. 2024-04-25T09:03:33.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:33.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.141+0000 7efdf54cd640 1 Processor -- start 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.142+0000 7efdf54cd640 1 -- start start 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.142+0000 7efdf54cd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efdf015def0 0x7efdf00d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.142+0000 7efdf54cd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf00d2550 con 0x7efdf00d0400 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.142+0000 7efdf54cd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf00d2830 con 0x7efdf00b94c0 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.142+0000 7efdf54cd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf015e2d0 con 0x7efdf015def0 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.142+0000 7efdeeffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efdf015def0 0x7efdf00d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.142+0000 7efdef7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efdf00d0400 0x7efdf00d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48614/0 (socket says 172.21.15.5:48614) 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.143+0000 7efdef7fe640 1 -- 172.21.15.5:0/1100876992 learned_addr learned my addr 172.21.15.5:0/1100876992 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.143+0000 7efdeeffd640 1 -- 172.21.15.5:0/1100876992 >> v1:172.21.15.80:6789/0 conn(0x7efdf00b94c0 legacy=0x7efdf00d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.143+0000 7efdeeffd640 1 -- 172.21.15.5:0/1100876992 >> v1:172.21.15.5:6789/0 conn(0x7efdf00d0400 legacy=0x7efdf00d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.143+0000 7efdeeffd640 1 -- 172.21.15.5:0/1100876992 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf00d2b10 con 0x7efdf015def0 2024-04-25T09:03:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.143+0000 7efdedffb640 1 -- 172.21.15.5:0/1100876992 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327809251 0 0) 0x7efdf00d2550 con 0x7efdf00d0400 2024-04-25T09:03:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdeeffd640 1 --2- 172.21.15.5:0/1100876992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf00d35f0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7efde0009d90 tx=0x7efde002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a666476ff021ae40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdedffb640 1 -- 172.21.15.5:0/1100876992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0007740 con 0x7efdf015def0 2024-04-25T09:03:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdedffb640 1 -- 172.21.15.5:0/1100876992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde00078e0 con 0x7efdf015def0 2024-04-25T09:03:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdedffb640 1 -- 172.21.15.5:0/1100876992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0007cb0 con 0x7efdf015def0 2024-04-25T09:03:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdf54cd640 1 -- 172.21.15.5:0/1100876992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 msgr2=0x7efdf00d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdf54cd640 1 --2- 172.21.15.5:0/1100876992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf00d35f0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7efde0009d90 tx=0x7efde002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdf54cd640 1 -- 172.21.15.5:0/1100876992 shutdown_connections 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdf54cd640 1 --2- 172.21.15.5:0/1100876992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf00d35f0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdf54cd640 1 -- 172.21.15.5:0/1100876992 >> 172.21.15.5:0/1100876992 conn(0x7efdf006b000 msgr2=0x7efdf006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdf54cd640 1 -- 172.21.15.5:0/1100876992 shutdown_connections 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.144+0000 7efdf54cd640 1 -- 172.21.15.5:0/1100876992 wait complete. 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 Processor -- start 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 -- start start 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efdf00b94c0 0x7efdf00c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf00d0400 0x7efdf0160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0168990 con 0x7efdf015def0 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00d30d0 con 0x7efdf00d0400 2024-04-25T09:03:33.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdf54cd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0168b10 con 0x7efdf00b94c0 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.146+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf015c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55522/0 (socket says 172.21.15.5:55522) 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 -- 172.21.15.5:0/3181827082 learned_addr learned my addr 172.21.15.5:0/3181827082 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdee7fc640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf00d0400 0x7efdf0160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdeeffd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efdf00b94c0 0x7efdf00c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 -- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efdf00b94c0 msgr2=0x7efdf00c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efdf00b94c0 0x7efdf00c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 -- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf00d0400 msgr2=0x7efdf0160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf00d0400 0x7efdf0160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 -- 172.21.15.5:0/3181827082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf015afa0 con 0x7efdf015def0 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdeeffd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efdf00b94c0 0x7efdf00c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdef7fe640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf015c040 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7efde800c450 tx=0x7efde800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efde77fe640 1 -- 172.21.15.5:0/3181827082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8018070 con 0x7efdf015def0 2024-04-25T09:03:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efde77fe640 1 -- 172.21.15.5:0/3181827082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8007500 con 0x7efdf015def0 2024-04-25T09:03:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efde77fe640 1 -- 172.21.15.5:0/3181827082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8004a20 con 0x7efdf015def0 2024-04-25T09:03:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf015b280 con 0x7efdf015def0 2024-04-25T09:03:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.147+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf015b840 con 0x7efdf015def0 2024-04-25T09:03:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.148+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf004ef20 con 0x7efdf015def0 2024-04-25T09:03:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.149+0000 7efde77fe640 1 -- 172.21.15.5:0/3181827082 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efde8004bc0 con 0x7efdf015def0 2024-04-25T09:03:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.149+0000 7efde77fe640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efdd006b4d0 0x7efdd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.149+0000 7efde77fe640 1 -- 172.21.15.5:0/3181827082 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efde8089380 con 0x7efdf015def0 2024-04-25T09:03:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.149+0000 7efdeeffd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efdd006b4d0 0x7efdd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.150+0000 7efdeeffd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efdd006b4d0 0x7efdd006d990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efde0034000 tx=0x7efde002f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.154+0000 7efde77fe640 1 -- 172.21.15.5:0/3181827082 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efde8057bb0 con 0x7efdf015def0 2024-04-25T09:03:33.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.337+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdf01597a0 con 0x7efdf015def0 2024-04-25T09:03:33.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.338+0000 7efde77fe640 1 -- 172.21.15.5:0/3181827082 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16537 (secure 0 0 0) 0x7efde805bc50 con 0x7efdf015def0 2024-04-25T09:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:32.347598+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.627226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:31.329753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efdd006b4d0 msgr2=0x7efdd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efdd006b4d0 0x7efdd006d990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efde0034000 tx=0x7efde002f000 comp rx=0 tx=0).stop 2024-04-25T09:03:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 msgr2=0x7efdf015c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf015c040 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7efde800c450 tx=0x7efde800c910 comp rx=0 tx=0).stop 2024-04-25T09:03:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 shutdown_connections 2024-04-25T09:03:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efdd006b4d0 0x7efdd006d990 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdf015def0 0x7efdf015c040 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf00d0400 0x7efdf0160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 --2- 172.21.15.5:0/3181827082 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efdf00b94c0 0x7efdf00c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 >> 172.21.15.5:0/3181827082 conn(0x7efdf006b000 msgr2=0x7efdf015e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 shutdown_connections 2024-04-25T09:03:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.340+0000 7efdf54cd640 1 -- 172.21.15.5:0/3181827082 wait complete. 2024-04-25T09:03:33.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.452+0000 7f0b54f0a640 1 Processor -- start 2024-04-25T09:03:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.452+0000 7f0b54f0a640 1 -- start start 2024-04-25T09:03:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b54f0a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b5015a7e0 0x7f0b500aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b54f0a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500af9c0 0x7f0b5006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b54f0a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5006d8a0 con 0x7f0b5006b120 2024-04-25T09:03:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b54f0a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5006b570 con 0x7f0b5015a7e0 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b54f0a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5006e080 con 0x7f0b500af9c0 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b47fff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500af9c0 0x7f0b5006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4e59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b5015a7e0 0x7f0b500aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4ed9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b5006b120 0x7f0b50071440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:40556/0 (socket says 172.21.15.5:40556) 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4ed9d640 1 -- 172.21.15.5:0/1181252606 learned_addr learned my addr 172.21.15.5:0/1181252606 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4e59c640 1 -- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500af9c0 msgr2=0x7f0b5006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4e59c640 1 --2- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500af9c0 0x7f0b5006abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4e59c640 1 -- 172.21.15.5:0/1181252606 >> v1:172.21.15.80:6789/0 conn(0x7f0b5006b120 legacy=0x7f0b50071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4e59c640 1 -- 172.21.15.5:0/1181252606 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5006e320 con 0x7f0b5015a7e0 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b4dd9b640 1 -- 172.21.15.5:0/1181252606 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039468863 0 0) 0x7f0b5006d8a0 con 0x7f0b5006b120 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.453+0000 7f0b47fff640 1 --2- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500af9c0 0x7f0b5006abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.454+0000 7f0b4e59c640 1 --2- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b500aff10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0b400097a0 tx=0x7f0b4002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c1a08fc52212326 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.454+0000 7f0b4dd9b640 1 -- 172.21.15.5:0/1181252606 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40037070 con 0x7f0b5015a7e0 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.454+0000 7f0b4dd9b640 1 -- 172.21.15.5:0/1181252606 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40032440 con 0x7f0b5015a7e0 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.454+0000 7f0b4dd9b640 1 -- 172.21.15.5:0/1181252606 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40032810 con 0x7f0b5015a7e0 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 -- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 msgr2=0x7f0b500aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b500aff10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0b400097a0 tx=0x7f0b4002a180 comp rx=0 tx=0).stop 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 -- 172.21.15.5:0/1181252606 shutdown_connections 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b500af9c0 0x7f0b5006abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/1181252606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b500aff10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 -- 172.21.15.5:0/1181252606 >> 172.21.15.5:0/1181252606 conn(0x7f0b500b25d0 msgr2=0x7f0b500b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 -- 172.21.15.5:0/1181252606 shutdown_connections 2024-04-25T09:03:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.455+0000 7f0b54f0a640 1 -- 172.21.15.5:0/1181252606 wait complete. 2024-04-25T09:03:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.456+0000 7f0b54f0a640 1 Processor -- start 2024-04-25T09:03:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.456+0000 7f0b54f0a640 1 -- start start 2024-04-25T09:03:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b54f0a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b5006b120 0x7f0b50142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b54f0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500af9c0 0x7f0b501e3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b54f0a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b501e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b54f0a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5006ebc0 con 0x7f0b500af9c0 2024-04-25T09:03:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b54f0a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5006e8e0 con 0x7f0b5015a7e0 2024-04-25T09:03:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b54f0a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5015abc0 con 0x7f0b5006b120 2024-04-25T09:03:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500af9c0 0x7f0b501e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500af9c0 0x7f0b501e3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55538/0 (socket says 172.21.15.5:55538) 2024-04-25T09:03:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b47fff640 1 -- 172.21.15.5:0/3090533908 learned_addr learned my addr 172.21.15.5:0/3090533908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b4e59c640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b5006b120 0x7f0b50142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.457+0000 7f0b4ed9d640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b501e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b47fff640 1 -- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b5006b120 msgr2=0x7f0b50142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b47fff640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b5006b120 0x7f0b50142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b47fff640 1 -- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 msgr2=0x7f0b501e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b47fff640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b501e5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b47fff640 1 -- 172.21.15.5:0/3090533908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500ceee0 con 0x7f0b500af9c0 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b4e59c640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b5006b120 0x7f0b50142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b4ed9d640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b501e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b47fff640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500af9c0 0x7f0b501e3210 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ec10 tx=0x7f0b3800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b46ffd640 1 -- 172.21.15.5:0/3090533908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38017070 con 0x7f0b500af9c0 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b46ffd640 1 -- 172.21.15.5:0/3090533908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800cc30 con 0x7f0b500af9c0 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b500cf1c0 con 0x7f0b500af9c0 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b46ffd640 1 -- 172.21.15.5:0/3090533908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38013470 con 0x7f0b500af9c0 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.458+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b500cf780 con 0x7f0b500af9c0 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.459+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5004ef20 con 0x7f0b500af9c0 2024-04-25T09:03:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.459+0000 7f0b46ffd640 1 -- 172.21.15.5:0/3090533908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b3801a070 con 0x7f0b500af9c0 2024-04-25T09:03:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.460+0000 7f0b46ffd640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3006b4d0 0x7f0b3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.460+0000 7f0b46ffd640 1 -- 172.21.15.5:0/3090533908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b3808a420 con 0x7f0b500af9c0 2024-04-25T09:03:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.460+0000 7f0b4e59c640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3006b4d0 0x7f0b3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.461+0000 7f0b4e59c640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3006b4d0 0x7f0b3006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b40034000 tx=0x7f0b4002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.464+0000 7f0b46ffd640 1 -- 172.21.15.5:0/3090533908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b38059330 con 0x7f0b500af9c0 2024-04-25T09:03:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.645+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b5006d7e0 con 0x7f0b500af9c0 2024-04-25T09:03:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.646+0000 7f0b46ffd640 1 -- 172.21.15.5:0/3090533908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16537 (secure 0 0 0) 0x7f0b38058c30 con 0x7f0b500af9c0 2024-04-25T09:03:33.635 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:33.635 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:32.347598+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.627226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:31.329753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3006b4d0 msgr2=0x7f0b3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3006b4d0 0x7f0b3006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b40034000 tx=0x7f0b4002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500af9c0 msgr2=0x7f0b501e3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500af9c0 0x7f0b501e3210 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ec10 tx=0x7f0b3800c520 comp rx=0 tx=0).stop 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 shutdown_connections 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0b3006b4d0 0x7f0b3006d990 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5015a7e0 0x7f0b501e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b500af9c0 0x7f0b501e3210 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 --2- 172.21.15.5:0/3090533908 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b5006b120 0x7f0b50142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 >> 172.21.15.5:0/3090533908 conn(0x7f0b500b25d0 msgr2=0x7f0b500668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 shutdown_connections 2024-04-25T09:03:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.648+0000 7f0b54f0a640 1 -- 172.21.15.5:0/3090533908 wait complete. 2024-04-25T09:03:33.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:03:33.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.763+0000 7fd86fb6a640 1 Processor -- start 2024-04-25T09:03:33.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.763+0000 7fd86fb6a640 1 -- start start 2024-04-25T09:03:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86fb6a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8681614b0 0x7fd8680b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86fb6a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd8680d1f60 0x7fd8680d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86fb6a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8680d2740 con 0x7fd8680d4060 2024-04-25T09:03:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86fb6a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680d44b0 con 0x7fd8681614b0 2024-04-25T09:03:33.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86fb6a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680d2a20 con 0x7fd8680d1f60 2024-04-25T09:03:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86d906640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8681614b0 0x7fd8680b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86d906640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8681614b0 0x7fd8680b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55554/0 (socket says 172.21.15.5:55554) 2024-04-25T09:03:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86d906640 1 -- 172.21.15.5:0/2693160932 learned_addr learned my addr 172.21.15.5:0/2693160932 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86d105640 1 --2- 172.21.15.5:0/2693160932 >> v2:172.21.15.80:3300/0 conn(0x7fd8680d1f60 0x7fd8680d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86d906640 1 -- 172.21.15.5:0/2693160932 >> v2:172.21.15.80:3300/0 conn(0x7fd8680d1f60 msgr2=0x7fd8680d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86d906640 1 --2- 172.21.15.5:0/2693160932 >> v2:172.21.15.80:3300/0 conn(0x7fd8680d1f60 0x7fd8680d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.764+0000 7fd86d906640 1 -- 172.21.15.5:0/2693160932 >> v1:172.21.15.80:6789/0 conn(0x7fd8680d4060 legacy=0x7fd8680b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.765+0000 7fd86d906640 1 -- 172.21.15.5:0/2693160932 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680d2d00 con 0x7fd8681614b0 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.765+0000 7fd86d906640 1 --2- 172.21.15.5:0/2693160932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd8680b96e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b66e0 tx=0x7fd85802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0f288ed425b367 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.765+0000 7fd86c904640 1 -- 172.21.15.5:0/2693160932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858036070 con 0x7fd8681614b0 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.765+0000 7fd86c904640 1 -- 172.21.15.5:0/2693160932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858031600 con 0x7fd8681614b0 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.765+0000 7fd86c904640 1 -- 172.21.15.5:0/2693160932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580319d0 con 0x7fd8681614b0 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 -- 172.21.15.5:0/2693160932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 msgr2=0x7fd8680b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/2693160932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd8680b96e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b66e0 tx=0x7fd85802a730 comp rx=0 tx=0).stop 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 -- 172.21.15.5:0/2693160932 shutdown_connections 2024-04-25T09:03:33.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/2693160932 >> v2:172.21.15.80:3300/0 conn(0x7fd8680d1f60 0x7fd8680d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/2693160932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd8680b96e0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 -- 172.21.15.5:0/2693160932 >> 172.21.15.5:0/2693160932 conn(0x7fd86806b000 msgr2=0x7fd86806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 -- 172.21.15.5:0/2693160932 shutdown_connections 2024-04-25T09:03:33.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.766+0000 7fd86fb6a640 1 -- 172.21.15.5:0/2693160932 wait complete. 2024-04-25T09:03:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.767+0000 7fd86fb6a640 1 Processor -- start 2024-04-25T09:03:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.767+0000 7fd86fb6a640 1 -- start start 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86fb6a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8680d1f60 0x7fd868156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86fb6a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8680d4060 0x7fd8680c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86fb6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd868149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86fb6a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680d37e0 con 0x7fd8681614b0 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86fb6a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680d32c0 con 0x7fd8680d1f60 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86fb6a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680d23a0 con 0x7fd8680d4060 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd868149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd868149400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55564/0 (socket says 172.21.15.5:55564) 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 -- 172.21.15.5:0/409917585 learned_addr learned my addr 172.21.15.5:0/409917585 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 -- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8680d4060 msgr2=0x7fd8680c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8680d4060 0x7fd8680c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86d906640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8680d1f60 0x7fd868156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 -- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8680d1f60 msgr2=0x7fd868156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8680d1f60 0x7fd868156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86e107640 1 -- 172.21.15.5:0/409917585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680b3f10 con 0x7fd8681614b0 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.768+0000 7fd86d906640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8680d1f60 0x7fd868156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.769+0000 7fd86e107640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd868149400 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd860001eb0 tx=0x7fd86000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.769+0000 7fd8667fc640 1 -- 172.21.15.5:0/409917585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860017070 con 0x7fd8681614b0 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.769+0000 7fd8667fc640 1 -- 172.21.15.5:0/409917585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8600052d0 con 0x7fd8681614b0 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.769+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8680b41f0 con 0x7fd8681614b0 2024-04-25T09:03:33.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.769+0000 7fd8667fc640 1 -- 172.21.15.5:0/409917585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860003810 con 0x7fd8681614b0 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.769+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd868157170 con 0x7fd8681614b0 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.770+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86804ef20 con 0x7fd8681614b0 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.770+0000 7fd8667fc640 1 -- 172.21.15.5:0/409917585 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd86001a070 con 0x7fd8681614b0 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.771+0000 7fd8667fc640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd85406b4d0 0x7fd85406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.771+0000 7fd8667fc640 1 -- 172.21.15.5:0/409917585 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8600895f0 con 0x7fd8681614b0 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.771+0000 7fd86d906640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd85406b4d0 0x7fd85406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.771+0000 7fd86d906640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd85406b4d0 0x7fd85406d990 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd858033000 tx=0x7fd858009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.775+0000 7fd8667fc640 1 -- 172.21.15.5:0/409917585 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8600583e0 con 0x7fd8681614b0 2024-04-25T09:03:33.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:33.996+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd868159f70 con 0x7fd8681614b0 2024-04-25T09:03:34.967 INFO:tasks.ceph.mds.d.smithi080.stderr:2024-04-25T09:03:34.979+0000 7f715a71c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:34.999+0000 7fd8667fc640 1 -- 172.21.15.5:0/409917585 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd860057ce0 con 0x7fd8681614b0 2024-04-25T09:03:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd85406b4d0 msgr2=0x7fd85406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd85406b4d0 0x7fd85406d990 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd858033000 tx=0x7fd858009000 comp rx=0 tx=0).stop 2024-04-25T09:03:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 msgr2=0x7fd868149400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd868149400 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd860001eb0 tx=0x7fd86000c890 comp rx=0 tx=0).stop 2024-04-25T09:03:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 shutdown_connections 2024-04-25T09:03:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd85406b4d0 0x7fd85406d990 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8681614b0 0x7fd868149400 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd8680d4060 0x7fd8680c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 --2- 172.21.15.5:0/409917585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8680d1f60 0x7fd868156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 >> 172.21.15.5:0/409917585 conn(0x7fd86806b000 msgr2=0x7fd8681605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 shutdown_connections 2024-04-25T09:03:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.001+0000 7fd86fb6a640 1 -- 172.21.15.5:0/409917585 wait complete. 2024-04-25T09:03:35.004 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:03:35.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:03:35.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.126+0000 7fa80aadd640 1 Processor -- start 2024-04-25T09:03:35.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.126+0000 7fa80aadd640 1 -- start start 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa80aadd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8040d2f70 0x7fa8040ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa80aadd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040ced50 0x7fa8040b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa80aadd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040d1ed0 con 0x7fa80415df70 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa80aadd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8040d1c80 con 0x7fa8040d2f70 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa80aadd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040d2ae0 con 0x7fa8040ced50 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa803fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8040d2f70 0x7fa8040ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa803fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8040d2f70 0x7fa8040ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55570/0 (socket says 172.21.15.5:55570) 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa803fff640 1 -- 172.21.15.5:0/2051360516 learned_addr learned my addr 172.21.15.5:0/2051360516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa80907a640 1 --2- 172.21.15.5:0/2051360516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040ced50 0x7fa8040b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa803fff640 1 -- 172.21.15.5:0/2051360516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040ced50 msgr2=0x7fa8040b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:35.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa803fff640 1 --2- 172.21.15.5:0/2051360516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040ced50 0x7fa8040b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa803fff640 1 -- 172.21.15.5:0/2051360516 >> v1:172.21.15.80:6789/0 conn(0x7fa80415df70 legacy=0x7fa8040b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.127+0000 7fa803fff640 1 -- 172.21.15.5:0/2051360516 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040d21b0 con 0x7fa8040d2f70 2024-04-25T09:03:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.128+0000 7fa803fff640 1 --2- 172.21.15.5:0/2051360516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040d2f70 0x7fa8040ce810 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009870 tx=0x7fa7f002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f19cd8d51a58704 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.128+0000 7fa8037fe640 1 -- 172.21.15.5:0/2051360516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0037070 con 0x7fa8040d2f70 2024-04-25T09:03:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.128+0000 7fa8037fe640 1 -- 172.21.15.5:0/2051360516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f002ae50 con 0x7fa8040d2f70 2024-04-25T09:03:35.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.128+0000 7fa8037fe640 1 -- 172.21.15.5:0/2051360516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0032860 con 0x7fa8040d2f70 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.128+0000 7fa80aadd640 1 -- 172.21.15.5:0/2051360516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040d2f70 msgr2=0x7fa8040ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.128+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2051360516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040d2f70 0x7fa8040ce810 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009870 tx=0x7fa7f002a300 comp rx=0 tx=0).stop 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.129+0000 7fa80aadd640 1 -- 172.21.15.5:0/2051360516 shutdown_connections 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.129+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2051360516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040ced50 0x7fa8040b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.129+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2051360516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040d2f70 0x7fa8040ce810 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.129+0000 7fa80aadd640 1 -- 172.21.15.5:0/2051360516 >> 172.21.15.5:0/2051360516 conn(0x7fa80406b000 msgr2=0x7fa80406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.129+0000 7fa80aadd640 1 -- 172.21.15.5:0/2051360516 shutdown_connections 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.129+0000 7fa80aadd640 1 -- 172.21.15.5:0/2051360516 wait complete. 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.130+0000 7fa80aadd640 1 Processor -- start 2024-04-25T09:03:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.130+0000 7fa80aadd640 1 -- start start 2024-04-25T09:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80aadd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8040ced50 0x7fa80414ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80aadd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040d2f70 0x7fa8040c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80aadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040c7240 0x7fa8040c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80aadd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040d3720 con 0x7fa8040c7240 2024-04-25T09:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80aadd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040d2770 con 0x7fa8040ced50 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80aadd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040d38a0 con 0x7fa8040d2f70 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040c7240 0x7fa8040c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040c7240 0x7fa8040c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55574/0 (socket says 172.21.15.5:55574) 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 -- 172.21.15.5:0/2307033943 learned_addr learned my addr 172.21.15.5:0/2307033943 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa808879640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8040ced50 0x7fa80414ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa803fff640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040d2f70 0x7fa8040c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 -- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040d2f70 msgr2=0x7fa8040c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040d2f70 0x7fa8040c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 -- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8040ced50 msgr2=0x7fa80414ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8040ced50 0x7fa80414ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 -- 172.21.15.5:0/2307033943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80414f660 con 0x7fa8040c7240 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa808879640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8040ced50 0x7fa80414ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa803fff640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040d2f70 0x7fa8040c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.131+0000 7fa80907a640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040c7240 0x7fa8040c76f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc007e90 tx=0x7fa7fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.132+0000 7fa8017fa640 1 -- 172.21.15.5:0/2307033943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc014420 con 0x7fa8040c7240 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.132+0000 7fa8017fa640 1 -- 172.21.15.5:0/2307033943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc019070 con 0x7fa8040c7240 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.132+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80414f130 con 0x7fa8040c7240 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.132+0000 7fa8017fa640 1 -- 172.21.15.5:0/2307033943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc014800 con 0x7fa8040c7240 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.132+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8040c8070 con 0x7fa8040c7240 2024-04-25T09:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.133+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80404ef20 con 0x7fa8040c7240 2024-04-25T09:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.133+0000 7fa8017fa640 1 -- 172.21.15.5:0/2307033943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa7fc0149a0 con 0x7fa8040c7240 2024-04-25T09:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.134+0000 7fa8017fa640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa7e806b4d0 0x7fa7e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.134+0000 7fa8017fa640 1 -- 172.21.15.5:0/2307033943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7fc08ab60 con 0x7fa8040c7240 2024-04-25T09:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.134+0000 7fa808879640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa7e806b4d0 0x7fa7e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.135+0000 7fa808879640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa7e806b4d0 0x7fa7e806d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8001700 tx=0x7fa7f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.138+0000 7fa8017fa640 1 -- 172.21.15.5:0/2307033943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7fc0598b0 con 0x7fa8040c7240 2024-04-25T09:03:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:35.357+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa8040d0fe0 con 0x7fa8040c7240 2024-04-25T09:03:35.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.010+0000 7fa8017fa640 1 -- 172.21.15.5:0/2307033943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7fc0591b0 con 0x7fa8040c7240 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa7e806b4d0 msgr2=0x7fa7e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa7e806b4d0 0x7fa7e806d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8001700 tx=0x7fa7f8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040c7240 msgr2=0x7fa8040c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040c7240 0x7fa8040c76f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc007e90 tx=0x7fa7fc00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 shutdown_connections 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa7e806b4d0 0x7fa7e806d990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8040c7240 0x7fa8040c76f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa8040d2f70 0x7fa8040c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 --2- 172.21.15.5:0/2307033943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8040ced50 0x7fa80414ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 >> 172.21.15.5:0/2307033943 conn(0x7fa80406b000 msgr2=0x7fa8040b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 shutdown_connections 2024-04-25T09:03:36.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.013+0000 7fa80aadd640 1 -- 172.21.15.5:0/2307033943 wait complete. 2024-04-25T09:03:36.015 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:03:36.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.135+0000 7fcfb0a58640 1 Processor -- start 2024-04-25T09:03:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.135+0000 7fcfb0a58640 1 -- start start 2024-04-25T09:03:36.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfb0a58640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcfac071de0 0x7fcfac0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfb0a58640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac15be80 con 0x7fcfac15af20 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfb0a58640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac15b5e0 con 0x7fcfac154f80 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfb0a58640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac15b3b0 con 0x7fcfac071de0 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa9d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcfac15af20 0x7fcfac158b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48630/0 (socket says 172.21.15.5:48630) 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa9d9b640 1 -- 172.21.15.5:0/2555720639 learned_addr learned my addr 172.21.15.5:0/2555720639 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaad9d640 1 --2- 172.21.15.5:0/2555720639 >> v2:172.21.15.80:3300/0 conn(0x7fcfac071de0 0x7fcfac0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156348341 0 0) 0x7fcfac15be80 con 0x7fcfac15af20 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf98005730 con 0x7fcfac15af20 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807414365 0 0) 0x7fcf98005730 con 0x7fcfac15af20 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 >> v2:172.21.15.80:3300/0 conn(0x7fcfac071de0 msgr2=0x7fcfac0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 --2- 172.21.15.5:0/2555720639 >> v2:172.21.15.80:3300/0 conn(0x7fcfac071de0 0x7fcfac0b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 >> v1:172.21.15.80:6789/0 conn(0x7fcfac154f80 legacy=0x7fcfac15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac15b8c0 con 0x7fcfac15af20 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fcf94001670 con 0x7fcfac15af20 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 >> v1:172.21.15.5:6789/0 conn(0x7fcfac15af20 legacy=0x7fcfac158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf98005bc0 0x7fcf98005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf980065c0 0x7fcf98006a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98007330 0x7fcf9800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9800e240 con 0x7fcf98005bc0 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9800e3f0 con 0x7fcf980065c0 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9800e5f0 con 0x7fcf98007330 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaa59c640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf98005bc0 0x7fcf98005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfa9d9b640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf980065c0 0x7fcf98006a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaad9d640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98007330 0x7fcf9800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaa59c640 1 -- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98007330 msgr2=0x7fcf9800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaa59c640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98007330 0x7fcf9800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaa59c640 1 -- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf980065c0 msgr2=0x7fcf98006a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaa59c640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf980065c0 0x7fcf98006a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaa59c640 1 -- 172.21.15.5:0/2555720639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98005730 con 0x7fcf98005bc0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.136+0000 7fcfaad9d640 1 -- 172.21.15.5:0/2555720639 reap_dead start 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.137+0000 7fcfaa59c640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf98005bc0 0x7fcf98005fa0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4001860 tx=0x7fcf98007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114d07fd6b5b5b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.137+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4037070 con 0x7fcf98005bc0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.137+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa402abf0 con 0x7fcf98005bc0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.137+0000 7fcfa959a640 1 -- 172.21.15.5:0/2555720639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4001430 con 0x7fcf98005bc0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.138+0000 7fcfb0a58640 1 -- 172.21.15.5:0/2555720639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf98005bc0 msgr2=0x7fcf98005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.138+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf98005bc0 0x7fcf98005fa0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4001860 tx=0x7fcf98007a40 comp rx=0 tx=0).stop 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.138+0000 7fcfb0a58640 1 -- 172.21.15.5:0/2555720639 shutdown_connections 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.138+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/2555720639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf98005bc0 0x7fcf98005fa0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.138+0000 7fcfb0a58640 1 -- 172.21.15.5:0/2555720639 >> 172.21.15.5:0/2555720639 conn(0x7fcfac0668f0 msgr2=0x7fcfac066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.138+0000 7fcfb0a58640 1 -- 172.21.15.5:0/2555720639 shutdown_connections 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.138+0000 7fcfb0a58640 1 -- 172.21.15.5:0/2555720639 wait complete. 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.139+0000 7fcfb0a58640 1 Processor -- start 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.139+0000 7fcfb0a58640 1 -- start start 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfb0a58640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98005bc0 0x7fcfac142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfb0a58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfac14cca0 0x7fcfac154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfb0a58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfac14d120 0x7fcfac154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfb0a58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac072250 con 0x7fcfac14d120 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfb0a58640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac15e640 con 0x7fcfac14cca0 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfb0a58640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac155360 con 0x7fcf98005bc0 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfac14d120 0x7fcfac154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfac14d120 0x7fcfac154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55604/0 (socket says 172.21.15.5:55604) 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 -- 172.21.15.5:0/798347136 learned_addr learned my addr 172.21.15.5:0/798347136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 -- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98005bc0 msgr2=0x7fcfac142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98005bc0 0x7fcfac142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 -- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfac14cca0 msgr2=0x7fcfac154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfac14cca0 0x7fcfac154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 -- 172.21.15.5:0/798347136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac14d7d0 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.140+0000 7fcfaad9d640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfac14d120 0x7fcfac154580 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fcfac06e540 tx=0x7fcf9c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.141+0000 7fcfa2ffd640 1 -- 172.21.15.5:0/798347136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00fe10 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.141+0000 7fcfa2ffd640 1 -- 172.21.15.5:0/798347136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c01d070 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.141+0000 7fcfa2ffd640 1 -- 172.21.15.5:0/798347136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c015670 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.141+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac14da70 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.141+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac14e030 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.142+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac14d520 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.142+0000 7fcfa2ffd640 1 -- 172.21.15.5:0/798347136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf9c015810 con 0x7fcfac14d120 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.143+0000 7fcfa2ffd640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.143+0000 7fcfa2ffd640 1 -- 172.21.15.5:0/798347136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf9c08aab0 con 0x7fcfac14d120 2024-04-25T09:03:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.143+0000 7fcfaa59c640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.143+0000 7fcfaa59c640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4034000 tx=0x7fcfa402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.147+0000 7fcfa2ffd640 1 -- 172.21.15.5:0/798347136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf9c010040 con 0x7fcfac14d120 2024-04-25T09:03:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.362+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfac04ef20 con 0x7fcfac14d120 2024-04-25T09:03:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.362+0000 7fcfa2ffd640 1 -- 172.21.15.5:0/798347136 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fcf9c059930 con 0x7fcfac14d120 2024-04-25T09:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b4d0 msgr2=0x7fcf8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4034000 tx=0x7fcfa402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfac14d120 msgr2=0x7fcfac154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfac14d120 0x7fcfac154580 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fcfac06e540 tx=0x7fcf9c00f580 comp rx=0 tx=0).stop 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 shutdown_connections 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfac14d120 0x7fcfac154580 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfac14cca0 0x7fcfac154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 --2- 172.21.15.5:0/798347136 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf98005bc0 0x7fcfac142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 >> 172.21.15.5:0/798347136 conn(0x7fcfac0668f0 msgr2=0x7fcfac06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 shutdown_connections 2024-04-25T09:03:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.364+0000 7fcfb0a58640 1 -- 172.21.15.5:0/798347136 wait complete. 2024-04-25T09:03:36.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.477+0000 7f349c7cf640 1 Processor -- start 2024-04-25T09:03:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.477+0000 7f349c7cf640 1 -- start start 2024-04-25T09:03:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349c7cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f349415e0a0 0x7f34940d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349c7cf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34940d3990 0x7f34940d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349c7cf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34940ce5e0 0x7f34940cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349c7cf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940d4330 con 0x7f349415e0a0 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349c7cf640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940b29c0 con 0x7f34940d3990 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349c7cf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940d2080 con 0x7f34940ce5e0 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f349415e0a0 0x7f34940d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f349415e0a0 0x7f34940d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55606/0 (socket says 172.21.15.5:55606) 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 -- 172.21.15.5:0/2660094700 learned_addr learned my addr 172.21.15.5:0/2660094700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349ad6c640 1 --2- 172.21.15.5:0/2660094700 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34940ce5e0 0x7f34940cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f3499d6a640 1 --2- 172.21.15.5:0/2660094700 >> v2:172.21.15.80:3300/0 conn(0x7f34940d3990 0x7f34940d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 -- 172.21.15.5:0/2660094700 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34940ce5e0 msgr2=0x7f34940cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 --2- 172.21.15.5:0/2660094700 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34940ce5e0 0x7f34940cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 -- 172.21.15.5:0/2660094700 >> v2:172.21.15.80:3300/0 conn(0x7f34940d3990 msgr2=0x7f34940d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 --2- 172.21.15.5:0/2660094700 >> v2:172.21.15.80:3300/0 conn(0x7f34940d3990 0x7f34940d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.478+0000 7f349a56b640 1 -- 172.21.15.5:0/2660094700 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940d2360 con 0x7f349415e0a0 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.479+0000 7f349a56b640 1 --2- 172.21.15.5:0/2660094700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f349415e0a0 0x7f34940d0d50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f34940676e0 tx=0x7f348402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17df9c5b53a65f17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.479+0000 7f3499569640 1 -- 172.21.15.5:0/2660094700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484036070 con 0x7f349415e0a0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.479+0000 7f3499569640 1 -- 172.21.15.5:0/2660094700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484031600 con 0x7f349415e0a0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.479+0000 7f3499569640 1 -- 172.21.15.5:0/2660094700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840319d0 con 0x7f349415e0a0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 -- 172.21.15.5:0/2660094700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f349415e0a0 msgr2=0x7f34940d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2660094700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f349415e0a0 0x7f34940d0d50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f34940676e0 tx=0x7f348402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 -- 172.21.15.5:0/2660094700 shutdown_connections 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2660094700 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34940ce5e0 0x7f34940cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2660094700 >> v2:172.21.15.80:3300/0 conn(0x7f34940d3990 0x7f34940d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2660094700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f349415e0a0 0x7f34940d0d50 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 -- 172.21.15.5:0/2660094700 >> 172.21.15.5:0/2660094700 conn(0x7f34940668f0 msgr2=0x7f3494066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 -- 172.21.15.5:0/2660094700 shutdown_connections 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.480+0000 7f349c7cf640 1 -- 172.21.15.5:0/2660094700 wait complete. 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.481+0000 7f349c7cf640 1 Processor -- start 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.481+0000 7f349c7cf640 1 -- start start 2024-04-25T09:03:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f349c7cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ce5e0 0x7f34940b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f349c7cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34940d3990 0x7f34940cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f349c7cf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f349415e0a0 0x7f3494159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f349c7cf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940d2c00 con 0x7f34940d3990 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f349c7cf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940d2920 con 0x7f34940ce5e0 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f349c7cf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349415e480 con 0x7f349415e0a0 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34940d3990 0x7f34940cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34940d3990 0x7f34940cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55610/0 (socket says 172.21.15.5:55610) 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 -- 172.21.15.5:0/2758068541 learned_addr learned my addr 172.21.15.5:0/2758068541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 -- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f349415e0a0 msgr2=0x7f3494159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f349415e0a0 0x7f3494159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 -- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ce5e0 msgr2=0x7f34940b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ce5e0 0x7f34940b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 -- 172.21.15.5:0/2758068541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940b5280 con 0x7f34940d3990 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.482+0000 7f3499d6a640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34940d3990 0x7f34940cddd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f348800d830 tx=0x7f348800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.483+0000 7f3492ffd640 1 -- 172.21.15.5:0/2758068541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800b6c0 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.483+0000 7f3492ffd640 1 -- 172.21.15.5:0/2758068541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488019070 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.483+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34941f7140 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.483+0000 7f3492ffd640 1 -- 172.21.15.5:0/2758068541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800ba80 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.483+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34940ce310 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.484+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349404ef20 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.484+0000 7f3492ffd640 1 -- 172.21.15.5:0/2758068541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f348801e460 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.485+0000 7f3492ffd640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f348006b520 0x7f348006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.485+0000 7f3492ffd640 1 -- 172.21.15.5:0/2758068541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f348808a830 con 0x7f34940d3990 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.485+0000 7f349a56b640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f348006b520 0x7f348006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.485+0000 7f349a56b640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f348006b520 0x7f348006d9e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3484033000 tx=0x7f348402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.489+0000 7f3492ffd640 1 -- 172.21.15.5:0/2758068541 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3488059790 con 0x7f34940d3990 2024-04-25T09:03:36.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.669+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3494159fa0 con 0x7f34940d3990 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.670+0000 7f3492ffd640 1 -- 172.21.15.5:0/2758068541 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16524 (secure 0 0 0) 0x7f3488059090 con 0x7f34940d3990 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:33.997354+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.627226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:31.329753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:36.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f348006b520 msgr2=0x7f348006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f348006b520 0x7f348006d9e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3484033000 tx=0x7f348402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:36.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34940d3990 msgr2=0x7f34940cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34940d3990 0x7f34940cddd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f348800d830 tx=0x7f348800dcf0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 shutdown_connections 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f348006b520 0x7f348006d9e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f349415e0a0 0x7f3494159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34940d3990 0x7f34940cddd0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 --2- 172.21.15.5:0/2758068541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ce5e0 0x7f34940b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 >> 172.21.15.5:0/2758068541 conn(0x7f34940668f0 msgr2=0x7f349415e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 shutdown_connections 2024-04-25T09:03:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.672+0000 7f349c7cf640 1 -- 172.21.15.5:0/2758068541 wait complete. 2024-04-25T09:03:36.672 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:03:36.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:36.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.786+0000 7f04b4389640 1 Processor -- start 2024-04-25T09:03:36.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.786+0000 7f04b4389640 1 -- start start 2024-04-25T09:03:36.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b4389640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b4389640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 0x7f04ac0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b4389640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b4389640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0d2a10 con 0x7f04ac15de70 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b4389640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0d20e0 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b4389640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0d23c0 con 0x7f04ac0b7130 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55622/0 (socket says 172.21.15.5:55622) 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 -- 172.21.15.5:0/2092554008 learned_addr learned my addr 172.21.15.5:0/2092554008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 -- 172.21.15.5:0/2092554008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 msgr2=0x7f04ac0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 --2- 172.21.15.5:0/2092554008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 -- 172.21.15.5:0/2092554008 >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 msgr2=0x7f04ac0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 --2- 172.21.15.5:0/2092554008 >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 0x7f04ac0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.787+0000 7f04b2125640 1 -- 172.21.15.5:0/2092554008 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0d26a0 con 0x7f04ac15de70 2024-04-25T09:03:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.788+0000 7f04b2125640 1 --2- 172.21.15.5:0/2092554008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f04ac161740 tx=0x7f04a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cd971577bf6cc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.788+0000 7f04b1123640 1 -- 172.21.15.5:0/2092554008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8037070 con 0x7f04ac15de70 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.788+0000 7f04b1123640 1 -- 172.21.15.5:0/2092554008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8032440 con 0x7f04ac15de70 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.788+0000 7f04b1123640 1 -- 172.21.15.5:0/2092554008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8032810 con 0x7f04ac15de70 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 -- 172.21.15.5:0/2092554008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac15de70 msgr2=0x7f04ac0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 --2- 172.21.15.5:0/2092554008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f04ac161740 tx=0x7f04a802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 -- 172.21.15.5:0/2092554008 shutdown_connections 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 --2- 172.21.15.5:0/2092554008 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 --2- 172.21.15.5:0/2092554008 >> v2:172.21.15.80:3300/0 conn(0x7f04ac0b2cc0 0x7f04ac0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 --2- 172.21.15.5:0/2092554008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac15de70 0x7f04ac0b93e0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 -- 172.21.15.5:0/2092554008 >> 172.21.15.5:0/2092554008 conn(0x7f04ac06b000 msgr2=0x7f04ac06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 -- 172.21.15.5:0/2092554008 shutdown_connections 2024-04-25T09:03:36.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.789+0000 7f04b4389640 1 -- 172.21.15.5:0/2092554008 wait complete. 2024-04-25T09:03:36.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.790+0000 7f04b4389640 1 Processor -- start 2024-04-25T09:03:36.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.790+0000 7f04b4389640 1 -- start start 2024-04-25T09:03:36.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b4389640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b4389640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b4389640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac15de70 0x7f04ac0b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b4389640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0ceeb0 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b4389640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0ced30 con 0x7f04ac15de70 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b4389640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0cf030 con 0x7f04ac0b7130 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55628/0 (socket says 172.21.15.5:55628) 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 -- 172.21.15.5:0/3543884626 learned_addr learned my addr 172.21.15.5:0/3543884626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b1924640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2926640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac15de70 0x7f04ac0b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 -- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 msgr2=0x7f04ac0cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 -- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac15de70 msgr2=0x7f04ac0b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac15de70 0x7f04ac0b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 -- 172.21.15.5:0/3543884626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0cc0d0 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b1924640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2926640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac15de70 0x7f04ac0b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.791+0000 7f04b2125640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0cbb90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f04a8000c00 tx=0x7f04a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.792+0000 7f04a2ffd640 1 -- 172.21.15.5:0/3543884626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8041070 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.792+0000 7f04a2ffd640 1 -- 172.21.15.5:0/3543884626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a803c870 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.792+0000 7f04a2ffd640 1 -- 172.21.15.5:0/3543884626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8037040 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.792+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac0c7620 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.792+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac0c7be0 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.793+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac04ef20 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.793+0000 7f04a2ffd640 1 -- 172.21.15.5:0/3543884626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04a8044070 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.794+0000 7f04a2ffd640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.794+0000 7f04a2ffd640 1 -- 172.21.15.5:0/3543884626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04a80aad40 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.794+0000 7f04b1924640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.794+0000 7f04b1924640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f049c006fd0 tx=0x7f049c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.798+0000 7f04a2ffd640 1 -- 172.21.15.5:0/3543884626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04a8079c50 con 0x7f04ac0b2cc0 2024-04-25T09:03:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.974+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04ac15d520 con 0x7f049006b4d0 2024-04-25T09:03:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.980+0000 7f04a2ffd640 1 -- 172.21.15.5:0/3543884626 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252085 (secure 0 0 0) 0x7f04ac15d520 con 0x7f049006b4d0 2024-04-25T09:03:36.971 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:03:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 msgr2=0x7f049006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f049c006fd0 tx=0x7f049c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b2cc0 msgr2=0x7f04ac0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0cbb90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f04a8000c00 tx=0x7f04a80046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 shutdown_connections 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f049006b4d0 0x7f049006d990 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04ac15de70 0x7f04ac0b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04ac0b7130 0x7f04ac0cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.983+0000 7f04b4389640 1 --2- 172.21.15.5:0/3543884626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04ac0b2cc0 0x7f04ac0cbb90 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.984+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 >> 172.21.15.5:0/3543884626 conn(0x7f04ac06b000 msgr2=0x7f04ac068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.984+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 shutdown_connections 2024-04-25T09:03:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:36.984+0000 7f04b4389640 1 -- 172.21.15.5:0/3543884626 wait complete. 2024-04-25T09:03:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-04-25T09:03:36.480827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376880,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754597840,"statfs":{"total":773094113280,"available":772708188160,"internally_reserved":0,"allocated":11051008,"data_stored":5422188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":374722097},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.496927"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092255+0000","last_change":"2024-04-25T09:03:33.013835+0000","last_active":"2024-04-25T09:03:34.092255+0000","last_peered":"2024-04-25T09:03:34.092255+0000","last_clean":"2024-04-25T09:03:34.092255+0000","last_became_active":"2024-04-25T09:03:33.013566+0000","last_became_peered":"2024-04-25T09:03:33.013566+0000","last_unstale":"2024-04-25T09:03:34.092255+0000","last_undegraded":"2024-04-25T09:03:34.092255+0000","last_fullsized":"2024-04-25T09:03:34.092255+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:07.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014546+0000","last_change":"2024-04-25T09:03:33.014100+0000","last_active":"2024-04-25T09:03:34.014546+0000","last_peered":"2024-04-25T09:03:34.014546+0000","last_clean":"2024-04-25T09:03:34.014546+0000","last_became_active":"2024-04-25T09:03:33.013782+0000","last_became_peered":"2024-04-25T09:03:33.013782+0000","last_unstale":"2024-04-25T09:03:34.014546+0000","last_undegraded":"2024-04-25T09:03:34.014546+0000","last_fullsized":"2024-04-25T09:03:34.014546+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:04.578372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092254+0000","last_change":"2024-04-25T09:03:33.005318+0000","last_active":"2024-04-25T09:03:34.092254+0000","last_peered":"2024-04-25T09:03:34.092254+0000","last_clean":"2024-04-25T09:03:34.092254+0000","last_became_active":"2024-04-25T09:03:33.004987+0000","last_became_peered":"2024-04-25T09:03:33.004987+0000","last_unstale":"2024-04-25T09:03:34.092254+0000","last_undegraded":"2024-04-25T09:03:34.092254+0000","last_fullsized":"2024-04-25T09:03:34.092254+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:16.864012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003486+0000","last_change":"2024-04-25T09:03:33.010793+0000","last_active":"2024-04-25T09:03:34.003486+0000","last_peered":"2024-04-25T09:03:34.003486+0000","last_clean":"2024-04-25T09:03:34.003486+0000","last_became_active":"2024-04-25T09:03:33.010488+0000","last_became_peered":"2024-04-25T09:03:33.010488+0000","last_unstale":"2024-04-25T09:03:34.003486+0000","last_undegraded":"2024-04-25T09:03:34.003486+0000","last_fullsized":"2024-04-25T09:03:34.003486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:25.817231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092994+0000","last_change":"2024-04-25T09:03:33.008181+0000","last_active":"2024-04-25T09:03:34.092994+0000","last_peered":"2024-04-25T09:03:34.092994+0000","last_clean":"2024-04-25T09:03:34.092994+0000","last_became_active":"2024-04-25T09:03:33.007721+0000","last_became_peered":"2024-04-25T09:03:33.007721+0000","last_unstale":"2024-04-25T09:03:34.092994+0000","last_undegraded":"2024-04-25T09:03:34.092994+0000","last_fullsized":"2024-04-25T09:03:34.092994+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:05.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092864+0000","last_change":"2024-04-25T09:03:33.008821+0000","last_active":"2024-04-25T09:03:34.092864+0000","last_peered":"2024-04-25T09:03:34.092864+0000","last_clean":"2024-04-25T09:03:34.092864+0000","last_became_active":"2024-04-25T09:03:33.008539+0000","last_became_peered":"2024-04-25T09:03:33.008539+0000","last_unstale":"2024-04-25T09:03:34.092864+0000","last_undegraded":"2024-04-25T09:03:34.092864+0000","last_fullsized":"2024-04-25T09:03:34.092864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:08.023258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092468+0000","last_change":"2024-04-25T09:03:33.005565+0000","last_active":"2024-04-25T09:03:34.092468+0000","last_peered":"2024-04-25T09:03:34.092468+0000","last_clean":"2024-04-25T09:03:34.092468+0000","last_became_active":"2024-04-25T09:03:33.005289+0000","last_became_peered":"2024-04-25T09:03:33.005289+0000","last_unstale":"2024-04-25T09:03:34.092468+0000","last_undegraded":"2024-04-25T09:03:34.092468+0000","last_fullsized":"2024-04-25T09:03:34.092468+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:55.839978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014243+0000","last_change":"2024-04-25T09:03:33.008085+0000","last_active":"2024-04-25T09:03:34.014243+0000","last_peered":"2024-04-25T09:03:34.014243+0000","last_clean":"2024-04-25T09:03:34.014243+0000","last_became_active":"2024-04-25T09:03:33.006496+0000","last_became_peered":"2024-04-25T09:03:33.006496+0000","last_unstale":"2024-04-25T09:03:34.014243+0000","last_undegraded":"2024-04-25T09:03:34.014243+0000","last_fullsized":"2024-04-25T09:03:34.014243+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:34.081502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004564+0000","last_change":"2024-04-25T09:03:33.001195+0000","last_active":"2024-04-25T09:03:34.004564+0000","last_peered":"2024-04-25T09:03:34.004564+0000","last_clean":"2024-04-25T09:03:34.004564+0000","last_became_active":"2024-04-25T09:03:33.000832+0000","last_became_peered":"2024-04-25T09:03:33.000832+0000","last_unstale":"2024-04-25T09:03:34.004564+0000","last_undegraded":"2024-04-25T09:03:34.004564+0000","last_fullsized":"2024-04-25T09:03:34.004564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:42.201762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092570+0000","last_change":"2024-04-25T09:03:33.011666+0000","last_active":"2024-04-25T09:03:34.092570+0000","last_peered":"2024-04-25T09:03:34.092570+0000","last_clean":"2024-04-25T09:03:34.092570+0000","last_became_active":"2024-04-25T09:03:33.011408+0000","last_became_peered":"2024-04-25T09:03:33.011408+0000","last_unstale":"2024-04-25T09:03:34.092570+0000","last_undegraded":"2024-04-25T09:03:34.092570+0000","last_fullsized":"2024-04-25T09:03:34.092570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:09.098101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093055+0000","last_change":"2024-04-25T09:03:33.013660+0000","last_active":"2024-04-25T09:03:34.093055+0000","last_peered":"2024-04-25T09:03:34.093055+0000","last_clean":"2024-04-25T09:03:34.093055+0000","last_became_active":"2024-04-25T09:03:33.013091+0000","last_became_peered":"2024-04-25T09:03:33.013091+0000","last_unstale":"2024-04-25T09:03:34.093055+0000","last_undegraded":"2024-04-25T09:03:34.093055+0000","last_fullsized":"2024-04-25T09:03:34.093055+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:38.207803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005078+0000","last_change":"2024-04-25T09:03:33.008673+0000","last_active":"2024-04-25T09:03:34.005078+0000","last_peered":"2024-04-25T09:03:34.005078+0000","last_clean":"2024-04-25T09:03:34.005078+0000","last_became_active":"2024-04-25T09:03:33.008411+0000","last_became_peered":"2024-04-25T09:03:33.008411+0000","last_unstale":"2024-04-25T09:03:34.005078+0000","last_undegraded":"2024-04-25T09:03:34.005078+0000","last_fullsized":"2024-04-25T09:03:34.005078+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:24.542053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003400+0000","last_change":"2024-04-25T09:03:32.999126+0000","last_active":"2024-04-25T09:03:34.003400+0000","last_peered":"2024-04-25T09:03:34.003400+0000","last_clean":"2024-04-25T09:03:34.003400+0000","last_became_active":"2024-04-25T09:03:32.998835+0000","last_became_peered":"2024-04-25T09:03:32.998835+0000","last_unstale":"2024-04-25T09:03:34.003400+0000","last_undegraded":"2024-04-25T09:03:34.003400+0000","last_fullsized":"2024-04-25T09:03:34.003400+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:40.265663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016390+0000","last_change":"2024-04-25T09:03:33.012598+0000","last_active":"2024-04-25T09:03:34.016390+0000","last_peered":"2024-04-25T09:03:34.016390+0000","last_clean":"2024-04-25T09:03:34.016390+0000","last_became_active":"2024-04-25T09:03:33.012234+0000","last_became_peered":"2024-04-25T09:03:33.012234+0000","last_unstale":"2024-04-25T09:03:34.016390+0000","last_undegraded":"2024-04-25T09:03:34.016390+0000","last_fullsized":"2024-04-25T09:03:34.016390+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:34.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003218+0000","last_change":"2024-04-25T09:03:33.008158+0000","last_active":"2024-04-25T09:03:34.003218+0000","last_peered":"2024-04-25T09:03:34.003218+0000","last_clean":"2024-04-25T09:03:34.003218+0000","last_became_active":"2024-04-25T09:03:33.007857+0000","last_became_peered":"2024-04-25T09:03:33.007857+0000","last_unstale":"2024-04-25T09:03:34.003218+0000","last_undegraded":"2024-04-25T09:03:34.003218+0000","last_fullsized":"2024-04-25T09:03:34.003218+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:52.483863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092508+0000","last_change":"2024-04-25T09:03:33.006517+0000","last_active":"2024-04-25T09:03:34.092508+0000","last_peered":"2024-04-25T09:03:34.092508+0000","last_clean":"2024-04-25T09:03:34.092508+0000","last_became_active":"2024-04-25T09:03:33.006241+0000","last_became_peered":"2024-04-25T09:03:33.006241+0000","last_unstale":"2024-04-25T09:03:34.092508+0000","last_undegraded":"2024-04-25T09:03:34.092508+0000","last_fullsized":"2024-04-25T09:03:34.092508+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:58.303006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014669+0000","last_change":"2024-04-25T09:03:33.005137+0000","last_active":"2024-04-25T09:03:34.014669+0000","last_peered":"2024-04-25T09:03:34.014669+0000","last_clean":"2024-04-25T09:03:34.014669+0000","last_became_active":"2024-04-25T09:03:33.004856+0000","last_became_peered":"2024-04-25T09:03:33.004856+0000","last_unstale":"2024-04-25T09:03:34.014669+0000","last_undegraded":"2024-04-25T09:03:34.014669+0000","last_fullsized":"2024-04-25T09:03:34.014669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:40.265663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003583+0000","last_change":"2024-04-25T09:03:33.005880+0000","last_active":"2024-04-25T09:03:34.003583+0000","last_peered":"2024-04-25T09:03:34.003583+0000","last_clean":"2024-04-25T09:03:34.003583+0000","last_became_active":"2024-04-25T09:03:33.005532+0000","last_became_peered":"2024-04-25T09:03:33.005532+0000","last_unstale":"2024-04-25T09:03:34.003583+0000","last_undegraded":"2024-04-25T09:03:34.003583+0000","last_fullsized":"2024-04-25T09:03:34.003583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:55.839978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016643+0000","last_change":"2024-04-25T09:03:33.008528+0000","last_active":"2024-04-25T09:03:34.016643+0000","last_peered":"2024-04-25T09:03:34.016643+0000","last_clean":"2024-04-25T09:03:34.016643+0000","last_became_active":"2024-04-25T09:03:33.008236+0000","last_became_peered":"2024-04-25T09:03:33.008236+0000","last_unstale":"2024-04-25T09:03:34.016643+0000","last_undegraded":"2024-04-25T09:03:34.016643+0000","last_fullsized":"2024-04-25T09:03:34.016643+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:13.068532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005104+0000","last_change":"2024-04-25T09:03:33.001559+0000","last_active":"2024-04-25T09:03:34.005104+0000","last_peered":"2024-04-25T09:03:34.005104+0000","last_clean":"2024-04-25T09:03:34.005104+0000","last_became_active":"2024-04-25T09:03:33.001279+0000","last_became_peered":"2024-04-25T09:03:33.001279+0000","last_unstale":"2024-04-25T09:03:34.005104+0000","last_undegraded":"2024-04-25T09:03:34.005104+0000","last_fullsized":"2024-04-25T09:03:34.005104+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:32.423645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016466+0000","last_change":"2024-04-25T09:03:33.002071+0000","last_active":"2024-04-25T09:03:34.016466+0000","last_peered":"2024-04-25T09:03:34.016466+0000","last_clean":"2024-04-25T09:03:34.016466+0000","last_became_active":"2024-04-25T09:03:33.001804+0000","last_became_peered":"2024-04-25T09:03:33.001804+0000","last_unstale":"2024-04-25T09:03:34.016466+0000","last_undegraded":"2024-04-25T09:03:34.016466+0000","last_fullsized":"2024-04-25T09:03:34.016466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:40.896749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014272+0000","last_change":"2024-04-25T09:03:33.003138+0000","last_active":"2024-04-25T09:03:34.014272+0000","last_peered":"2024-04-25T09:03:34.014272+0000","last_clean":"2024-04-25T09:03:34.014272+0000","last_became_active":"2024-04-25T09:03:33.002860+0000","last_became_peered":"2024-04-25T09:03:33.002860+0000","last_unstale":"2024-04-25T09:03:34.014272+0000","last_undegraded":"2024-04-25T09:03:34.014272+0000","last_fullsized":"2024-04-25T09:03:34.014272+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:52.483863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014253+0000","last_change":"2024-04-25T09:03:33.005207+0000","last_active":"2024-04-25T09:03:34.014253+0000","last_peered":"2024-04-25T09:03:34.014253+0000","last_clean":"2024-04-25T09:03:34.014253+0000","last_became_active":"2024-04-25T09:03:33.004930+0000","last_became_peered":"2024-04-25T09:03:33.004930+0000","last_unstale":"2024-04-25T09:03:34.014253+0000","last_undegraded":"2024-04-25T09:03:34.014253+0000","last_fullsized":"2024-04-25T09:03:34.014253+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:05.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092549+0000","last_change":"2024-04-25T09:03:33.010311+0000","last_active":"2024-04-25T09:03:34.092549+0000","last_peered":"2024-04-25T09:03:34.092549+0000","last_clean":"2024-04-25T09:03:34.092549+0000","last_became_active":"2024-04-25T09:03:33.009985+0000","last_became_peered":"2024-04-25T09:03:33.009985+0000","last_unstale":"2024-04-25T09:03:34.092549+0000","last_undegraded":"2024-04-25T09:03:34.092549+0000","last_fullsized":"2024-04-25T09:03:34.092549+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:45.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092940+0000","last_change":"2024-04-25T09:03:33.011065+0000","last_active":"2024-04-25T09:03:34.092940+0000","last_peered":"2024-04-25T09:03:34.092940+0000","last_clean":"2024-04-25T09:03:34.092940+0000","last_became_active":"2024-04-25T09:03:33.010568+0000","last_became_peered":"2024-04-25T09:03:33.010568+0000","last_unstale":"2024-04-25T09:03:34.092940+0000","last_undegraded":"2024-04-25T09:03:34.092940+0000","last_fullsized":"2024-04-25T09:03:34.092940+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:34.081502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014579+0000","last_change":"2024-04-25T09:03:33.012249+0000","last_active":"2024-04-25T09:03:34.014579+0000","last_peered":"2024-04-25T09:03:34.014579+0000","last_clean":"2024-04-25T09:03:34.014579+0000","last_became_active":"2024-04-25T09:03:33.011888+0000","last_became_peered":"2024-04-25T09:03:33.011888+0000","last_unstale":"2024-04-25T09:03:34.014579+0000","last_undegraded":"2024-04-25T09:03:34.014579+0000","last_fullsized":"2024-04-25T09:03:34.014579+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:42.048309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093198+0000","last_change":"2024-04-25T09:03:33.013407+0000","last_active":"2024-04-25T09:03:34.093198+0000","last_peered":"2024-04-25T09:03:34.093198+0000","last_clean":"2024-04-25T09:03:34.093198+0000","last_became_active":"2024-04-25T09:03:33.012288+0000","last_became_peered":"2024-04-25T09:03:33.012288+0000","last_unstale":"2024-04-25T09:03:34.093198+0000","last_undegraded":"2024-04-25T09:03:34.093198+0000","last_fullsized":"2024-04-25T09:03:34.093198+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:12.645478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093106+0000","last_change":"2024-04-25T09:03:33.016796+0000","last_active":"2024-04-25T09:03:34.093106+0000","last_peered":"2024-04-25T09:03:34.093106+0000","last_clean":"2024-04-25T09:03:34.093106+0000","last_became_active":"2024-04-25T09:03:33.016319+0000","last_became_peered":"2024-04-25T09:03:33.016319+0000","last_unstale":"2024-04-25T09:03:34.093106+0000","last_undegraded":"2024-04-25T09:03:34.093106+0000","last_fullsized":"2024-04-25T09:03:34.093106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.766457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014512+0000","last_change":"2024-04-25T09:03:33.013490+0000","last_active":"2024-04-25T09:03:34.014512+0000","last_peered":"2024-04-25T09:03:34.014512+0000","last_clean":"2024-04-25T09:03:34.014512+0000","last_became_active":"2024-04-25T09:03:33.013196+0000","last_became_peered":"2024-04-25T09:03:33.013196+0000","last_unstale":"2024-04-25T09:03:34.014512+0000","last_undegraded":"2024-04-25T09:03:34.014512+0000","last_fullsized":"2024-04-25T09:03:34.014512+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.766457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016335+0000","last_change":"2024-04-25T09:03:33.013189+0000","last_active":"2024-04-25T09:03:34.016335+0000","last_peered":"2024-04-25T09:03:34.016335+0000","last_clean":"2024-04-25T09:03:34.016335+0000","last_became_active":"2024-04-25T09:03:33.012925+0000","last_became_peered":"2024-04-25T09:03:33.012925+0000","last_unstale":"2024-04-25T09:03:34.016335+0000","last_undegraded":"2024-04-25T09:03:34.016335+0000","last_fullsized":"2024-04-25T09:03:34.016335+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:16.864012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003251+0000","last_change":"2024-04-25T09:03:33.014853+0000","last_active":"2024-04-25T09:03:34.003251+0000","last_peered":"2024-04-25T09:03:34.003251+0000","last_clean":"2024-04-25T09:03:34.003251+0000","last_became_active":"2024-04-25T09:03:33.014445+0000","last_became_peered":"2024-04-25T09:03:33.014445+0000","last_unstale":"2024-04-25T09:03:34.003251+0000","last_undegraded":"2024-04-25T09:03:34.003251+0000","last_fullsized":"2024-04-25T09:03:34.003251+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:04.578372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092274+0000","last_change":"2024-04-25T09:03:33.008993+0000","last_active":"2024-04-25T09:03:34.092274+0000","last_peered":"2024-04-25T09:03:34.092274+0000","last_clean":"2024-04-25T09:03:34.092274+0000","last_became_active":"2024-04-25T09:03:33.008183+0000","last_became_peered":"2024-04-25T09:03:33.008183+0000","last_unstale":"2024-04-25T09:03:34.092274+0000","last_undegraded":"2024-04-25T09:03:34.092274+0000","last_fullsized":"2024-04-25T09:03:34.092274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:40.896749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016572+0000","last_change":"2024-04-25T09:03:33.009761+0000","last_active":"2024-04-25T09:03:34.016572+0000","last_peered":"2024-04-25T09:03:34.016572+0000","last_clean":"2024-04-25T09:03:34.016572+0000","last_became_active":"2024-04-25T09:03:33.009439+0000","last_became_peered":"2024-04-25T09:03:33.009439+0000","last_unstale":"2024-04-25T09:03:34.016572+0000","last_undegraded":"2024-04-25T09:03:34.016572+0000","last_fullsized":"2024-04-25T09:03:34.016572+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:39.340547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"98'4","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014600+0000","last_change":"2024-04-25T09:03:32.001769+0000","last_active":"2024-04-25T09:03:34.014600+0000","last_peered":"2024-04-25T09:03:34.014600+0000","last_clean":"2024-04-25T09:03:34.014600+0000","last_became_active":"2024-04-25T09:03:32.001379+0000","last_became_peered":"2024-04-25T09:03:32.001379+0000","last_unstale":"2024-04-25T09:03:34.014600+0000","last_undegraded":"2024-04-25T09:03:34.014600+0000","last_fullsized":"2024-04-25T09:03:34.014600+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:12.526380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003636+0000","last_change":"2024-04-25T09:03:33.015826+0000","last_active":"2024-04-25T09:03:34.003636+0000","last_peered":"2024-04-25T09:03:34.003636+0000","last_clean":"2024-04-25T09:03:34.003636+0000","last_became_active":"2024-04-25T09:03:33.014163+0000","last_became_peered":"2024-04-25T09:03:33.014163+0000","last_unstale":"2024-04-25T09:03:34.003636+0000","last_undegraded":"2024-04-25T09:03:34.003636+0000","last_fullsized":"2024-04-25T09:03:34.003636+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:58.303006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092757+0000","last_change":"2024-04-25T09:03:32.001944+0000","last_active":"2024-04-25T09:03:34.092757+0000","last_peered":"2024-04-25T09:03:34.092757+0000","last_clean":"2024-04-25T09:03:34.092757+0000","last_became_active":"2024-04-25T09:03:32.001654+0000","last_became_peered":"2024-04-25T09:03:32.001654+0000","last_unstale":"2024-04-25T09:03:34.092757+0000","last_undegraded":"2024-04-25T09:03:34.092757+0000","last_fullsized":"2024-04-25T09:03:34.092757+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:36.690581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092391+0000","last_change":"2024-04-25T09:03:33.010427+0000","last_active":"2024-04-25T09:03:34.092391+0000","last_peered":"2024-04-25T09:03:34.092391+0000","last_clean":"2024-04-25T09:03:34.092391+0000","last_became_active":"2024-04-25T09:03:33.010085+0000","last_became_peered":"2024-04-25T09:03:33.010085+0000","last_unstale":"2024-04-25T09:03:34.092391+0000","last_undegraded":"2024-04-25T09:03:34.092391+0000","last_fullsized":"2024-04-25T09:03:34.092391+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:46.375716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014438+0000","last_change":"2024-04-25T09:03:32.003949+0000","last_active":"2024-04-25T09:03:34.014438+0000","last_peered":"2024-04-25T09:03:34.014438+0000","last_clean":"2024-04-25T09:03:34.014438+0000","last_became_active":"2024-04-25T09:03:32.003625+0000","last_became_peered":"2024-04-25T09:03:32.003625+0000","last_unstale":"2024-04-25T09:03:34.014438+0000","last_undegraded":"2024-04-25T09:03:34.014438+0000","last_fullsized":"2024-04-25T09:03:34.014438+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:32.622276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005284+0000","last_change":"2024-04-25T09:03:33.005433+0000","last_active":"2024-04-25T09:03:34.005284+0000","last_peered":"2024-04-25T09:03:34.005284+0000","last_clean":"2024-04-25T09:03:34.005284+0000","last_became_active":"2024-04-25T09:03:33.005111+0000","last_became_peered":"2024-04-25T09:03:33.005111+0000","last_unstale":"2024-04-25T09:03:34.005284+0000","last_undegraded":"2024-04-25T09:03:34.005284+0000","last_fullsized":"2024-04-25T09:03:34.005284+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:45.618878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014357+0000","last_change":"2024-04-25T09:03:32.005036+0000","last_active":"2024-04-25T09:03:34.014357+0000","last_peered":"2024-04-25T09:03:34.014357+0000","last_clean":"2024-04-25T09:03:34.014357+0000","last_became_active":"2024-04-25T09:03:32.004511+0000","last_became_peered":"2024-04-25T09:03:32.004511+0000","last_unstale":"2024-04-25T09:03:34.014357+0000","last_undegraded":"2024-04-25T09:03:34.014357+0000","last_fullsized":"2024-04-25T09:03:34.014357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:40.694690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004348+0000","last_change":"2024-04-25T09:03:33.003271+0000","last_active":"2024-04-25T09:03:34.004348+0000","last_peered":"2024-04-25T09:03:34.004348+0000","last_clean":"2024-04-25T09:03:34.004348+0000","last_became_active":"2024-04-25T09:03:33.002994+0000","last_became_peered":"2024-04-25T09:03:33.002994+0000","last_unstale":"2024-04-25T09:03:34.004348+0000","last_undegraded":"2024-04-25T09:03:34.004348+0000","last_fullsized":"2024-04-25T09:03:34.004348+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:14.915601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092081+0000","last_change":"2024-04-25T09:03:32.000910+0000","last_active":"2024-04-25T09:03:34.092081+0000","last_peered":"2024-04-25T09:03:34.092081+0000","last_clean":"2024-04-25T09:03:34.092081+0000","last_became_active":"2024-04-25T09:03:32.000555+0000","last_became_peered":"2024-04-25T09:03:32.000555+0000","last_unstale":"2024-04-25T09:03:34.092081+0000","last_undegraded":"2024-04-25T09:03:34.092081+0000","last_fullsized":"2024-04-25T09:03:34.092081+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:55.512555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092782+0000","last_change":"2024-04-25T09:03:33.012662+0000","last_active":"2024-04-25T09:03:34.092782+0000","last_peered":"2024-04-25T09:03:34.092782+0000","last_clean":"2024-04-25T09:03:34.092782+0000","last_became_active":"2024-04-25T09:03:33.012394+0000","last_became_peered":"2024-04-25T09:03:33.012394+0000","last_unstale":"2024-04-25T09:03:34.092782+0000","last_undegraded":"2024-04-25T09:03:34.092782+0000","last_fullsized":"2024-04-25T09:03:34.092782+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:31.093535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014186+0000","last_change":"2024-04-25T09:03:32.008569+0000","last_active":"2024-04-25T09:03:34.014186+0000","last_peered":"2024-04-25T09:03:34.014186+0000","last_clean":"2024-04-25T09:03:34.014186+0000","last_became_active":"2024-04-25T09:03:32.008155+0000","last_became_peered":"2024-04-25T09:03:32.008155+0000","last_unstale":"2024-04-25T09:03:34.014186+0000","last_undegraded":"2024-04-25T09:03:34.014186+0000","last_fullsized":"2024-04-25T09:03:34.014186+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:06.227975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003219+0000","last_change":"2024-04-25T09:03:33.014672+0000","last_active":"2024-04-25T09:03:34.003219+0000","last_peered":"2024-04-25T09:03:34.003219+0000","last_clean":"2024-04-25T09:03:34.003219+0000","last_became_active":"2024-04-25T09:03:33.014305+0000","last_became_peered":"2024-04-25T09:03:33.014305+0000","last_unstale":"2024-04-25T09:03:34.003219+0000","last_undegraded":"2024-04-25T09:03:34.003219+0000","last_fullsized":"2024-04-25T09:03:34.003219+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.766457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092675+0000","last_change":"2024-04-25T09:03:32.006225+0000","last_active":"2024-04-25T09:03:34.092675+0000","last_peered":"2024-04-25T09:03:34.092675+0000","last_clean":"2024-04-25T09:03:34.092675+0000","last_became_active":"2024-04-25T09:03:32.005912+0000","last_became_peered":"2024-04-25T09:03:32.005912+0000","last_unstale":"2024-04-25T09:03:34.092675+0000","last_undegraded":"2024-04-25T09:03:34.092675+0000","last_fullsized":"2024-04-25T09:03:34.092675+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:32.622276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004957+0000","last_change":"2024-04-25T09:03:33.004870+0000","last_active":"2024-04-25T09:03:34.004957+0000","last_peered":"2024-04-25T09:03:34.004957+0000","last_clean":"2024-04-25T09:03:34.004957+0000","last_became_active":"2024-04-25T09:03:33.004540+0000","last_became_peered":"2024-04-25T09:03:33.004540+0000","last_unstale":"2024-04-25T09:03:34.004957+0000","last_undegraded":"2024-04-25T09:03:34.004957+0000","last_fullsized":"2024-04-25T09:03:34.004957+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:04.529240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092117+0000","last_change":"2024-04-25T09:03:31.997739+0000","last_active":"2024-04-25T09:03:34.092117+0000","last_peered":"2024-04-25T09:03:34.092117+0000","last_clean":"2024-04-25T09:03:34.092117+0000","last_became_active":"2024-04-25T09:03:31.997428+0000","last_became_peered":"2024-04-25T09:03:31.997428+0000","last_unstale":"2024-04-25T09:03:34.092117+0000","last_undegraded":"2024-04-25T09:03:34.092117+0000","last_fullsized":"2024-04-25T09:03:34.092117+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:52.436286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014703+0000","last_change":"2024-04-25T09:03:33.004437+0000","last_active":"2024-04-25T09:03:34.014703+0000","last_peered":"2024-04-25T09:03:34.014703+0000","last_clean":"2024-04-25T09:03:34.014703+0000","last_became_active":"2024-04-25T09:03:33.003926+0000","last_became_peered":"2024-04-25T09:03:33.003926+0000","last_unstale":"2024-04-25T09:03:34.014703+0000","last_undegraded":"2024-04-25T09:03:34.014703+0000","last_fullsized":"2024-04-25T09:03:34.014703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:25.817231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092324+0000","last_change":"2024-04-25T09:03:32.000954+0000","last_active":"2024-04-25T09:03:34.092324+0000","last_peered":"2024-04-25T09:03:34.092324+0000","last_clean":"2024-04-25T09:03:34.092324+0000","last_became_active":"2024-04-25T09:03:32.000609+0000","last_became_peered":"2024-04-25T09:03:32.000609+0000","last_unstale":"2024-04-25T09:03:34.092324+0000","last_undegraded":"2024-04-25T09:03:34.092324+0000","last_fullsized":"2024-04-25T09:03:34.092324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:55.201641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004698+0000","last_change":"2024-04-25T09:03:33.002952+0000","last_active":"2024-04-25T09:03:34.004698+0000","last_peered":"2024-04-25T09:03:34.004698+0000","last_clean":"2024-04-25T09:03:34.004698+0000","last_became_active":"2024-04-25T09:03:33.001965+0000","last_became_peered":"2024-04-25T09:03:33.001965+0000","last_unstale":"2024-04-25T09:03:34.004698+0000","last_undegraded":"2024-04-25T09:03:34.004698+0000","last_fullsized":"2024-04-25T09:03:34.004698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:18.026783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003552+0000","last_change":"2024-04-25T09:03:32.004208+0000","last_active":"2024-04-25T09:03:34.003552+0000","last_peered":"2024-04-25T09:03:34.003552+0000","last_clean":"2024-04-25T09:03:34.003552+0000","last_became_active":"2024-04-25T09:03:32.003897+0000","last_became_peered":"2024-04-25T09:03:32.003897+0000","last_unstale":"2024-04-25T09:03:34.003552+0000","last_undegraded":"2024-04-25T09:03:34.003552+0000","last_fullsized":"2024-04-25T09:03:34.003552+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:23.537597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093231+0000","last_change":"2024-04-25T09:03:33.015845+0000","last_active":"2024-04-25T09:03:34.093231+0000","last_peered":"2024-04-25T09:03:34.093231+0000","last_clean":"2024-04-25T09:03:34.093231+0000","last_became_active":"2024-04-25T09:03:33.014796+0000","last_became_peered":"2024-04-25T09:03:33.014796+0000","last_unstale":"2024-04-25T09:03:34.093231+0000","last_undegraded":"2024-04-25T09:03:34.093231+0000","last_fullsized":"2024-04-25T09:03:34.093231+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:04.578372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"98'3","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093399+0000","last_change":"2024-04-25T09:03:31.997226+0000","last_active":"2024-04-25T09:03:34.093399+0000","last_peered":"2024-04-25T09:03:34.093399+0000","last_clean":"2024-04-25T09:03:34.093399+0000","last_became_active":"2024-04-25T09:03:31.996873+0000","last_became_peered":"2024-04-25T09:03:31.996873+0000","last_unstale":"2024-04-25T09:03:34.093399+0000","last_undegraded":"2024-04-25T09:03:34.093399+0000","last_fullsized":"2024-04-25T09:03:34.093399+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:53.871446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093343+0000","last_change":"2024-04-25T09:03:33.006758+0000","last_active":"2024-04-25T09:03:34.093343+0000","last_peered":"2024-04-25T09:03:34.093343+0000","last_clean":"2024-04-25T09:03:34.093343+0000","last_became_active":"2024-04-25T09:03:33.006481+0000","last_became_peered":"2024-04-25T09:03:33.006481+0000","last_unstale":"2024-04-25T09:03:34.093343+0000","last_undegraded":"2024-04-25T09:03:34.093343+0000","last_fullsized":"2024-04-25T09:03:34.093343+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:02.861641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"98'6","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005138+0000","last_change":"2024-04-25T09:03:31.997242+0000","last_active":"2024-04-25T09:03:34.005138+0000","last_peered":"2024-04-25T09:03:34.005138+0000","last_clean":"2024-04-25T09:03:34.005138+0000","last_became_active":"2024-04-25T09:03:31.996911+0000","last_became_peered":"2024-04-25T09:03:31.996911+0000","last_unstale":"2024-04-25T09:03:34.005138+0000","last_undegraded":"2024-04-25T09:03:34.005138+0000","last_fullsized":"2024-04-25T09:03:34.005138+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:51.101936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003346+0000","last_change":"2024-04-25T09:03:33.004495+0000","last_active":"2024-04-25T09:03:34.003346+0000","last_peered":"2024-04-25T09:03:34.003346+0000","last_clean":"2024-04-25T09:03:34.003346+0000","last_became_active":"2024-04-25T09:03:33.004216+0000","last_became_peered":"2024-04-25T09:03:33.004216+0000","last_unstale":"2024-04-25T09:03:34.003346+0000","last_undegraded":"2024-04-25T09:03:34.003346+0000","last_fullsized":"2024-04-25T09:03:34.003346+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:42.048309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016529+0000","last_change":"2024-04-25T09:03:31.988055+0000","last_active":"2024-04-25T09:03:34.016529+0000","last_peered":"2024-04-25T09:03:34.016529+0000","last_clean":"2024-04-25T09:03:34.016529+0000","last_became_active":"2024-04-25T09:03:31.987764+0000","last_became_peered":"2024-04-25T09:03:31.987764+0000","last_unstale":"2024-04-25T09:03:34.016529+0000","last_undegraded":"2024-04-25T09:03:34.016529+0000","last_fullsized":"2024-04-25T09:03:34.016529+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:32.347825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092275+0000","last_change":"2024-04-25T09:03:33.016451+0000","last_active":"2024-04-25T09:03:34.092275+0000","last_peered":"2024-04-25T09:03:34.092275+0000","last_clean":"2024-04-25T09:03:34.092275+0000","last_became_active":"2024-04-25T09:03:33.016130+0000","last_became_peered":"2024-04-25T09:03:33.016130+0000","last_unstale":"2024-04-25T09:03:34.092275+0000","last_undegraded":"2024-04-25T09:03:34.092275+0000","last_fullsized":"2024-04-25T09:03:34.092275+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:34.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016651+0000","last_change":"2024-04-25T09:03:31.992144+0000","last_active":"2024-04-25T09:03:34.016651+0000","last_peered":"2024-04-25T09:03:34.016651+0000","last_clean":"2024-04-25T09:03:34.016651+0000","last_became_active":"2024-04-25T09:03:31.991862+0000","last_became_peered":"2024-04-25T09:03:31.991862+0000","last_unstale":"2024-04-25T09:03:34.016651+0000","last_undegraded":"2024-04-25T09:03:34.016651+0000","last_fullsized":"2024-04-25T09:03:34.016651+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:19.416043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004223+0000","last_change":"2024-04-25T09:03:33.002335+0000","last_active":"2024-04-25T09:03:34.004223+0000","last_peered":"2024-04-25T09:03:34.004223+0000","last_clean":"2024-04-25T09:03:34.004223+0000","last_became_active":"2024-04-25T09:03:33.002030+0000","last_became_peered":"2024-04-25T09:03:33.002030+0000","last_unstale":"2024-04-25T09:03:34.004223+0000","last_undegraded":"2024-04-25T09:03:34.004223+0000","last_fullsized":"2024-04-25T09:03:34.004223+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:09.108929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005005+0000","last_change":"2024-04-25T09:03:31.996613+0000","last_active":"2024-04-25T09:03:34.005005+0000","last_peered":"2024-04-25T09:03:34.005005+0000","last_clean":"2024-04-25T09:03:34.005005+0000","last_became_active":"2024-04-25T09:03:31.996331+0000","last_became_peered":"2024-04-25T09:03:31.996331+0000","last_unstale":"2024-04-25T09:03:34.005005+0000","last_undegraded":"2024-04-25T09:03:34.005005+0000","last_fullsized":"2024-04-25T09:03:34.005005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:49.011761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016300+0000","last_change":"2024-04-25T09:03:33.003786+0000","last_active":"2024-04-25T09:03:34.016300+0000","last_peered":"2024-04-25T09:03:34.016300+0000","last_clean":"2024-04-25T09:03:34.016300+0000","last_became_active":"2024-04-25T09:03:33.003521+0000","last_became_peered":"2024-04-25T09:03:33.003521+0000","last_unstale":"2024-04-25T09:03:34.016300+0000","last_undegraded":"2024-04-25T09:03:34.016300+0000","last_fullsized":"2024-04-25T09:03:34.016300+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:07.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"98'8","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092339+0000","last_change":"2024-04-25T09:03:31.997738+0000","last_active":"2024-04-25T09:03:34.092339+0000","last_peered":"2024-04-25T09:03:34.092339+0000","last_clean":"2024-04-25T09:03:34.092339+0000","last_became_active":"2024-04-25T09:03:31.997416+0000","last_became_peered":"2024-04-25T09:03:31.997416+0000","last_unstale":"2024-04-25T09:03:34.092339+0000","last_undegraded":"2024-04-25T09:03:34.092339+0000","last_fullsized":"2024-04-25T09:03:34.092339+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:29.863077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093054+0000","last_change":"2024-04-25T09:03:33.010287+0000","last_active":"2024-04-25T09:03:34.093054+0000","last_peered":"2024-04-25T09:03:34.093054+0000","last_clean":"2024-04-25T09:03:34.093054+0000","last_became_active":"2024-04-25T09:03:33.010029+0000","last_became_peered":"2024-04-25T09:03:33.010029+0000","last_unstale":"2024-04-25T09:03:34.093054+0000","last_undegraded":"2024-04-25T09:03:34.093054+0000","last_fullsized":"2024-04-25T09:03:34.093054+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:52.483863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004845+0000","last_change":"2024-04-25T09:03:31.987772+0000","last_active":"2024-04-25T09:03:34.004845+0000","last_peered":"2024-04-25T09:03:34.004845+0000","last_clean":"2024-04-25T09:03:34.004845+0000","last_became_active":"2024-04-25T09:03:31.987431+0000","last_became_peered":"2024-04-25T09:03:31.987431+0000","last_unstale":"2024-04-25T09:03:34.004845+0000","last_undegraded":"2024-04-25T09:03:34.004845+0000","last_fullsized":"2024-04-25T09:03:34.004845+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:44.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004617+0000","last_change":"2024-04-25T09:03:33.019530+0000","last_active":"2024-04-25T09:03:34.004617+0000","last_peered":"2024-04-25T09:03:34.004617+0000","last_clean":"2024-04-25T09:03:34.004617+0000","last_became_active":"2024-04-25T09:03:33.019168+0000","last_became_peered":"2024-04-25T09:03:33.019168+0000","last_unstale":"2024-04-25T09:03:34.004617+0000","last_undegraded":"2024-04-25T09:03:34.004617+0000","last_fullsized":"2024-04-25T09:03:34.004617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:09.108929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092390+0000","last_change":"2024-04-25T09:03:31.993228+0000","last_active":"2024-04-25T09:03:34.092390+0000","last_peered":"2024-04-25T09:03:34.092390+0000","last_clean":"2024-04-25T09:03:34.092390+0000","last_became_active":"2024-04-25T09:03:31.992920+0000","last_became_peered":"2024-04-25T09:03:31.992920+0000","last_unstale":"2024-04-25T09:03:34.092390+0000","last_undegraded":"2024-04-25T09:03:34.092390+0000","last_fullsized":"2024-04-25T09:03:34.092390+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:56.312148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093383+0000","last_change":"2024-04-25T09:03:33.013914+0000","last_active":"2024-04-25T09:03:34.093383+0000","last_peered":"2024-04-25T09:03:34.093383+0000","last_clean":"2024-04-25T09:03:34.093383+0000","last_became_active":"2024-04-25T09:03:33.012737+0000","last_became_peered":"2024-04-25T09:03:33.012737+0000","last_unstale":"2024-04-25T09:03:34.093383+0000","last_undegraded":"2024-04-25T09:03:34.093383+0000","last_fullsized":"2024-04-25T09:03:34.093383+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.855662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014364+0000","last_change":"2024-04-25T09:03:32.005265+0000","last_active":"2024-04-25T09:03:34.014364+0000","last_peered":"2024-04-25T09:03:34.014364+0000","last_clean":"2024-04-25T09:03:34.014364+0000","last_became_active":"2024-04-25T09:03:32.004788+0000","last_became_peered":"2024-04-25T09:03:32.004788+0000","last_unstale":"2024-04-25T09:03:34.014364+0000","last_undegraded":"2024-04-25T09:03:34.014364+0000","last_fullsized":"2024-04-25T09:03:34.014364+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016617+0000","last_change":"2024-04-25T09:03:33.007187+0000","last_active":"2024-04-25T09:03:34.016617+0000","last_peered":"2024-04-25T09:03:34.016617+0000","last_clean":"2024-04-25T09:03:34.016617+0000","last_became_active":"2024-04-25T09:03:33.006848+0000","last_became_peered":"2024-04-25T09:03:33.006848+0000","last_unstale":"2024-04-25T09:03:34.016617+0000","last_undegraded":"2024-04-25T09:03:34.016617+0000","last_fullsized":"2024-04-25T09:03:34.016617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:46.375716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014338+0000","last_change":"2024-04-25T09:03:32.007026+0000","last_active":"2024-04-25T09:03:34.014338+0000","last_peered":"2024-04-25T09:03:34.014338+0000","last_clean":"2024-04-25T09:03:34.014338+0000","last_became_active":"2024-04-25T09:03:32.006611+0000","last_became_peered":"2024-04-25T09:03:32.006611+0000","last_unstale":"2024-04-25T09:03:34.014338+0000","last_undegraded":"2024-04-25T09:03:34.014338+0000","last_fullsized":"2024-04-25T09:03:34.014338+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:13.911144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016673+0000","last_change":"2024-04-25T09:03:33.007211+0000","last_active":"2024-04-25T09:03:34.016673+0000","last_peered":"2024-04-25T09:03:34.016673+0000","last_clean":"2024-04-25T09:03:34.016673+0000","last_became_active":"2024-04-25T09:03:33.006889+0000","last_became_peered":"2024-04-25T09:03:33.006889+0000","last_unstale":"2024-04-25T09:03:34.016673+0000","last_undegraded":"2024-04-25T09:03:34.016673+0000","last_fullsized":"2024-04-25T09:03:34.016673+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:45.131879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004393+0000","last_change":"2024-04-25T09:03:31.995929+0000","last_active":"2024-04-25T09:03:34.004393+0000","last_peered":"2024-04-25T09:03:34.004393+0000","last_clean":"2024-04-25T09:03:34.004393+0000","last_became_active":"2024-04-25T09:03:31.995399+0000","last_became_peered":"2024-04-25T09:03:31.995399+0000","last_unstale":"2024-04-25T09:03:34.004393+0000","last_undegraded":"2024-04-25T09:03:34.004393+0000","last_fullsized":"2024-04-25T09:03:34.004393+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:12.526380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016207+0000","last_change":"2024-04-25T09:03:33.007366+0000","last_active":"2024-04-25T09:03:34.016207+0000","last_peered":"2024-04-25T09:03:34.016207+0000","last_clean":"2024-04-25T09:03:34.016207+0000","last_became_active":"2024-04-25T09:03:33.002838+0000","last_became_peered":"2024-04-25T09:03:33.002838+0000","last_unstale":"2024-04-25T09:03:34.016207+0000","last_undegraded":"2024-04-25T09:03:34.016207+0000","last_fullsized":"2024-04-25T09:03:34.016207+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:15.764642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004203+0000","last_change":"2024-04-25T09:03:31.996327+0000","last_active":"2024-04-25T09:03:34.004203+0000","last_peered":"2024-04-25T09:03:34.004203+0000","last_clean":"2024-04-25T09:03:34.004203+0000","last_became_active":"2024-04-25T09:03:31.995678+0000","last_became_peered":"2024-04-25T09:03:31.995678+0000","last_unstale":"2024-04-25T09:03:34.004203+0000","last_undegraded":"2024-04-25T09:03:34.004203+0000","last_fullsized":"2024-04-25T09:03:34.004203+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.237491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093274+0000","last_change":"2024-04-25T09:03:33.011055+0000","last_active":"2024-04-25T09:03:34.093274+0000","last_peered":"2024-04-25T09:03:34.093274+0000","last_clean":"2024-04-25T09:03:34.093274+0000","last_became_active":"2024-04-25T09:03:33.010789+0000","last_became_peered":"2024-04-25T09:03:33.010789+0000","last_unstale":"2024-04-25T09:03:34.093274+0000","last_undegraded":"2024-04-25T09:03:34.093274+0000","last_fullsized":"2024-04-25T09:03:34.093274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:42.048309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014205+0000","last_change":"2024-04-25T09:03:32.007356+0000","last_active":"2024-04-25T09:03:34.014205+0000","last_peered":"2024-04-25T09:03:34.014205+0000","last_clean":"2024-04-25T09:03:34.014205+0000","last_became_active":"2024-04-25T09:03:32.006940+0000","last_became_peered":"2024-04-25T09:03:32.006940+0000","last_unstale":"2024-04-25T09:03:34.014205+0000","last_undegraded":"2024-04-25T09:03:34.014205+0000","last_fullsized":"2024-04-25T09:03:34.014205+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.237491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014725+0000","last_change":"2024-04-25T09:03:33.004207+0000","last_active":"2024-04-25T09:03:34.014725+0000","last_peered":"2024-04-25T09:03:34.014725+0000","last_clean":"2024-04-25T09:03:34.014725+0000","last_became_active":"2024-04-25T09:03:33.003582+0000","last_became_peered":"2024-04-25T09:03:33.003582+0000","last_unstale":"2024-04-25T09:03:34.014725+0000","last_undegraded":"2024-04-25T09:03:34.014725+0000","last_fullsized":"2024-04-25T09:03:34.014725+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:55.839978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004749+0000","last_change":"2024-04-25T09:03:31.988342+0000","last_active":"2024-04-25T09:03:34.004749+0000","last_peered":"2024-04-25T09:03:34.004749+0000","last_clean":"2024-04-25T09:03:34.004749+0000","last_became_active":"2024-04-25T09:03:31.988030+0000","last_became_peered":"2024-04-25T09:03:31.988030+0000","last_unstale":"2024-04-25T09:03:34.004749+0000","last_undegraded":"2024-04-25T09:03:34.004749+0000","last_fullsized":"2024-04-25T09:03:34.004749+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092327+0000","last_change":"2024-04-25T09:03:33.012598+0000","last_active":"2024-04-25T09:03:34.092327+0000","last_peered":"2024-04-25T09:03:34.092327+0000","last_clean":"2024-04-25T09:03:34.092327+0000","last_became_active":"2024-04-25T09:03:33.010706+0000","last_became_peered":"2024-04-25T09:03:33.010706+0000","last_unstale":"2024-04-25T09:03:34.092327+0000","last_undegraded":"2024-04-25T09:03:34.092327+0000","last_fullsized":"2024-04-25T09:03:34.092327+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:54.306352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"99'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014797+0000","last_change":"2024-04-25T09:03:32.003606+0000","last_active":"2024-04-25T09:03:34.014797+0000","last_peered":"2024-04-25T09:03:34.014797+0000","last_clean":"2024-04-25T09:03:34.014797+0000","last_became_active":"2024-04-25T09:03:32.003325+0000","last_became_peered":"2024-04-25T09:03:32.003325+0000","last_unstale":"2024-04-25T09:03:34.014797+0000","last_undegraded":"2024-04-25T09:03:34.014797+0000","last_fullsized":"2024-04-25T09:03:34.014797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:08.104472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092368+0000","last_change":"2024-04-25T09:03:33.018159+0000","last_active":"2024-04-25T09:03:34.092368+0000","last_peered":"2024-04-25T09:03:34.092368+0000","last_clean":"2024-04-25T09:03:34.092368+0000","last_became_active":"2024-04-25T09:03:33.017882+0000","last_became_peered":"2024-04-25T09:03:33.017882+0000","last_unstale":"2024-04-25T09:03:34.092368+0000","last_undegraded":"2024-04-25T09:03:34.092368+0000","last_fullsized":"2024-04-25T09:03:34.092368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:39.340547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014460+0000","last_change":"2024-04-25T09:03:32.003915+0000","last_active":"2024-04-25T09:03:34.014460+0000","last_peered":"2024-04-25T09:03:34.014460+0000","last_clean":"2024-04-25T09:03:34.014460+0000","last_became_active":"2024-04-25T09:03:32.003247+0000","last_became_peered":"2024-04-25T09:03:32.003247+0000","last_unstale":"2024-04-25T09:03:34.014460+0000","last_undegraded":"2024-04-25T09:03:34.014460+0000","last_fullsized":"2024-04-25T09:03:34.014460+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:56.312148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092480+0000","last_change":"2024-04-25T09:03:33.012544+0000","last_active":"2024-04-25T09:03:34.092480+0000","last_peered":"2024-04-25T09:03:34.092480+0000","last_clean":"2024-04-25T09:03:34.092480+0000","last_became_active":"2024-04-25T09:03:33.012274+0000","last_became_peered":"2024-04-25T09:03:33.012274+0000","last_unstale":"2024-04-25T09:03:34.092480+0000","last_undegraded":"2024-04-25T09:03:34.092480+0000","last_fullsized":"2024-04-25T09:03:34.092480+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:15.367065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093155+0000","last_change":"2024-04-25T09:03:31.997489+0000","last_active":"2024-04-25T09:03:34.093155+0000","last_peered":"2024-04-25T09:03:34.093155+0000","last_clean":"2024-04-25T09:03:34.093155+0000","last_became_active":"2024-04-25T09:03:31.997064+0000","last_became_peered":"2024-04-25T09:03:31.997064+0000","last_unstale":"2024-04-25T09:03:34.093155+0000","last_undegraded":"2024-04-25T09:03:34.093155+0000","last_fullsized":"2024-04-25T09:03:34.093155+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:13.911144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016584+0000","last_change":"2024-04-25T09:03:33.004705+0000","last_active":"2024-04-25T09:03:34.016584+0000","last_peered":"2024-04-25T09:03:34.016584+0000","last_clean":"2024-04-25T09:03:34.016584+0000","last_became_active":"2024-04-25T09:03:33.004409+0000","last_became_peered":"2024-04-25T09:03:33.004409+0000","last_unstale":"2024-04-25T09:03:34.016584+0000","last_undegraded":"2024-04-25T09:03:34.016584+0000","last_fullsized":"2024-04-25T09:03:34.016584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:54.306352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014460+0000","last_change":"2024-04-25T09:03:32.007405+0000","last_active":"2024-04-25T09:03:34.014460+0000","last_peered":"2024-04-25T09:03:34.014460+0000","last_clean":"2024-04-25T09:03:34.014460+0000","last_became_active":"2024-04-25T09:03:32.007088+0000","last_became_peered":"2024-04-25T09:03:32.007088+0000","last_unstale":"2024-04-25T09:03:34.014460+0000","last_undegraded":"2024-04-25T09:03:34.014460+0000","last_fullsized":"2024-04-25T09:03:34.014460+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:41.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004611+0000","last_change":"2024-04-25T09:03:33.009526+0000","last_active":"2024-04-25T09:03:34.004611+0000","last_peered":"2024-04-25T09:03:34.004611+0000","last_clean":"2024-04-25T09:03:34.004611+0000","last_became_active":"2024-04-25T09:03:33.009200+0000","last_became_peered":"2024-04-25T09:03:33.009200+0000","last_unstale":"2024-04-25T09:03:34.004611+0000","last_undegraded":"2024-04-25T09:03:34.004611+0000","last_fullsized":"2024-04-25T09:03:34.004611+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:17.180400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092267+0000","last_change":"2024-04-25T09:03:31.995857+0000","last_active":"2024-04-25T09:03:34.092267+0000","last_peered":"2024-04-25T09:03:34.092267+0000","last_clean":"2024-04-25T09:03:34.092267+0000","last_became_active":"2024-04-25T09:03:31.995471+0000","last_became_peered":"2024-04-25T09:03:31.995471+0000","last_unstale":"2024-04-25T09:03:34.092267+0000","last_undegraded":"2024-04-25T09:03:34.092267+0000","last_fullsized":"2024-04-25T09:03:34.092267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016271+0000","last_change":"2024-04-25T09:03:33.003196+0000","last_active":"2024-04-25T09:03:34.016271+0000","last_peered":"2024-04-25T09:03:34.016271+0000","last_clean":"2024-04-25T09:03:34.016271+0000","last_became_active":"2024-04-25T09:03:33.002854+0000","last_became_peered":"2024-04-25T09:03:33.002854+0000","last_unstale":"2024-04-25T09:03:34.016271+0000","last_undegraded":"2024-04-25T09:03:34.016271+0000","last_fullsized":"2024-04-25T09:03:34.016271+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:20.077198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003311+0000","last_change":"2024-04-25T09:03:31.994485+0000","last_active":"2024-04-25T09:03:34.003311+0000","last_peered":"2024-04-25T09:03:34.003311+0000","last_clean":"2024-04-25T09:03:34.003311+0000","last_became_active":"2024-04-25T09:03:31.994105+0000","last_became_peered":"2024-04-25T09:03:31.994105+0000","last_unstale":"2024-04-25T09:03:34.003311+0000","last_undegraded":"2024-04-25T09:03:34.003311+0000","last_fullsized":"2024-04-25T09:03:34.003311+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:03.524784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092509+0000","last_change":"2024-04-25T09:03:33.013115+0000","last_active":"2024-04-25T09:03:34.092509+0000","last_peered":"2024-04-25T09:03:34.092509+0000","last_clean":"2024-04-25T09:03:34.092509+0000","last_became_active":"2024-04-25T09:03:33.012845+0000","last_became_peered":"2024-04-25T09:03:33.012845+0000","last_unstale":"2024-04-25T09:03:34.092509+0000","last_undegraded":"2024-04-25T09:03:34.092509+0000","last_fullsized":"2024-04-25T09:03:34.092509+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:54.875903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016273+0000","last_change":"2024-04-25T09:03:32.005373+0000","last_active":"2024-04-25T09:03:34.016273+0000","last_peered":"2024-04-25T09:03:34.016273+0000","last_clean":"2024-04-25T09:03:34.016273+0000","last_became_active":"2024-04-25T09:03:32.004559+0000","last_became_peered":"2024-04-25T09:03:32.004559+0000","last_unstale":"2024-04-25T09:03:34.016273+0000","last_undegraded":"2024-04-25T09:03:34.016273+0000","last_fullsized":"2024-04-25T09:03:34.016273+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:42.957137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016675+0000","last_change":"2024-04-25T09:03:33.002690+0000","last_active":"2024-04-25T09:03:34.016675+0000","last_peered":"2024-04-25T09:03:34.016675+0000","last_clean":"2024-04-25T09:03:34.016675+0000","last_became_active":"2024-04-25T09:03:33.002349+0000","last_became_peered":"2024-04-25T09:03:33.002349+0000","last_unstale":"2024-04-25T09:03:34.016675+0000","last_undegraded":"2024-04-25T09:03:34.016675+0000","last_fullsized":"2024-04-25T09:03:34.016675+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:14.922314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092657+0000","last_change":"2024-04-25T09:03:32.002662+0000","last_active":"2024-04-25T09:03:34.092657+0000","last_peered":"2024-04-25T09:03:34.092657+0000","last_clean":"2024-04-25T09:03:34.092657+0000","last_became_active":"2024-04-25T09:03:32.002343+0000","last_became_peered":"2024-04-25T09:03:32.002343+0000","last_unstale":"2024-04-25T09:03:34.092657+0000","last_undegraded":"2024-04-25T09:03:34.092657+0000","last_fullsized":"2024-04-25T09:03:34.092657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:14.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092567+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:03:34.092567+0000","last_peered":"2024-04-25T09:03:34.092567+0000","last_clean":"2024-04-25T09:03:34.092567+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:03:34.092567+0000","last_undegraded":"2024-04-25T09:03:34.092567+0000","last_fullsized":"2024-04-25T09:03:34.092567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46856,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324984,"statfs":{"total":96636764160,"available":96588783616,"internally_reserved":0,"allocated":1826816,"data_stored":1120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50440,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321400,"statfs":{"total":96636764160,"available":96585113600,"internally_reserved":0,"allocated":1232896,"data_stored":530231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40708,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331132,"statfs":{"total":96636764160,"available":96595079168,"internally_reserved":0,"allocated":1228800,"data_stored":529649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50444,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321396,"statfs":{"total":96636764160,"available":96585109504,"internally_reserved":0,"allocated":1245184,"data_stored":531315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50448,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321392,"statfs":{"total":96636764160,"available":96585105408,"internally_reserved":0,"allocated":1241088,"data_stored":531213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50432,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321408,"statfs":{"total":96636764160,"available":96585121792,"internally_reserved":0,"allocated":1228800,"data_stored":529613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58748,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313092,"statfs":{"total":96636764160,"available":96576606208,"internally_reserved":0,"allocated":1224704,"data_stored":529579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1822720,"data_stored":1120529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:36.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.135+0000 7fa79aaac640 1 Processor -- start 2024-04-25T09:03:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.135+0000 7fa79aaac640 1 -- start start 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.136+0000 7fa79aaac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 0x7fa7940b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.136+0000 7fa79aaac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940ceb90 con 0x7fa7940ce290 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.136+0000 7fa79aaac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940cdcb0 con 0x7fa79415bdc0 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.136+0000 7fa79aaac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940cdf90 con 0x7fa7940ce720 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.136+0000 7fa793fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7940ce290 0x7fa7940b52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48646/0 (socket says 172.21.15.5:48646) 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.136+0000 7fa793fff640 1 -- 172.21.15.5:0/838961421 learned_addr learned my addr 172.21.15.5:0/838961421 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374749322 0 0) 0x7fa7940ceb90 con 0x7fa7940ce290 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa77c003520 con 0x7fa7940ce290 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa799049640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 0x7fa7940b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2590688321 0 0) 0x7fa77c003520 con 0x7fa7940ce290 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 msgr2=0x7fa7940b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 0x7fa7940b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 >> v1:172.21.15.80:6789/0 conn(0x7fa79415bdc0 legacy=0x7fa7940cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940b47e0 con 0x7fa7940ce290 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fa788001670 con 0x7fa7940ce290 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 >> v1:172.21.15.5:6789/0 conn(0x7fa7940ce290 legacy=0x7fa7940b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77c0039e0 0x7fa77c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa77c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 0x7fa77c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940cdf90 con 0x7fa77c004800 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c00baf0 con 0x7fa77c0039e0 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c00bcf0 con 0x7fa7940ce720 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa793fff640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa77c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa798848640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77c0039e0 0x7fa77c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa799049640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 0x7fa77c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa793fff640 1 -- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 msgr2=0x7fa77c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.137+0000 7fa793fff640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940ce720 0x7fa77c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.138+0000 7fa793fff640 1 -- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77c0039e0 msgr2=0x7fa77c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.138+0000 7fa793fff640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77c0039e0 0x7fa77c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.138+0000 7fa793fff640 1 -- 172.21.15.5:0/838961421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c003520 con 0x7fa77c004800 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.138+0000 7fa793fff640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa77c004c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c210 tx=0x7fa77c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b675b9b6fc1bd45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.138+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788007d30 con 0x7fa77c004800 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.138+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788005ad0 con 0x7fa77c004800 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.138+0000 7fa7937fe640 1 -- 172.21.15.5:0/838961421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788007070 con 0x7fa77c004800 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.139+0000 7fa79aaac640 1 -- 172.21.15.5:0/838961421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 msgr2=0x7fa77c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.139+0000 7fa79aaac640 1 --2- 172.21.15.5:0/838961421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa77c004c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c210 tx=0x7fa77c005830 comp rx=0 tx=0).stop 2024-04-25T09:03:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.139+0000 7fa799049640 1 -- 172.21.15.5:0/838961421 reap_dead start 2024-04-25T09:03:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.139+0000 7fa79aaac640 1 -- 172.21.15.5:0/838961421 shutdown_connections 2024-04-25T09:03:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.139+0000 7fa79aaac640 1 -- 172.21.15.5:0/838961421 >> 172.21.15.5:0/838961421 conn(0x7fa7940d18f0 msgr2=0x7fa7940d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.139+0000 7fa79aaac640 1 -- 172.21.15.5:0/838961421 shutdown_connections 2024-04-25T09:03:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.139+0000 7fa79aaac640 1 -- 172.21.15.5:0/838961421 wait complete. 2024-04-25T09:03:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.140+0000 7fa79aaac640 1 Processor -- start 2024-04-25T09:03:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.140+0000 7fa79aaac640 1 -- start start 2024-04-25T09:03:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa79aaac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa794150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa79aaac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7941f1b50 0x7fa7941f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa79aaac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940c6ea0 0x7fa7940c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa79aaac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940d09a0 con 0x7fa77c004800 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa79aaac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940b4da0 con 0x7fa7941f1b50 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa79aaac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940cd8b0 con 0x7fa7940c6ea0 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa794150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa794150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55654/0 (socket says 172.21.15.5:55654) 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 -- 172.21.15.5:0/1196345857 learned_addr learned my addr 172.21.15.5:0/1196345857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa793fff640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7941f1b50 0x7fa7941f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa799049640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940c6ea0 0x7fa7940c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 -- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940c6ea0 msgr2=0x7fa7940c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940c6ea0 0x7fa7940c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 -- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7941f1b50 msgr2=0x7fa7941f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7941f1b50 0x7fa7941f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.141+0000 7fa798848640 1 -- 172.21.15.5:0/1196345857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7941513c0 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.142+0000 7fa798848640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa794150e80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fa78400f7d0 tx=0x7fa78400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.142+0000 7fa7917fa640 1 -- 172.21.15.5:0/1196345857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7840050d0 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.142+0000 7fa7917fa640 1 -- 172.21.15.5:0/1196345857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784018070 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.142+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7940c5e00 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.142+0000 7fa7917fa640 1 -- 172.21.15.5:0/1196345857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400d730 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.142+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7940c63c0 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.143+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79404ef20 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.143+0000 7fa7917fa640 1 -- 172.21.15.5:0/1196345857 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa78400d8d0 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.144+0000 7fa7917fa640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa78006b4d0 0x7fa78006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.144+0000 7fa7917fa640 1 -- 172.21.15.5:0/1196345857 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa78408a020 con 0x7fa77c004800 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.144+0000 7fa793fff640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa78006b4d0 0x7fa78006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.144+0000 7fa793fff640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa78006b4d0 0x7fa78006d990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa788033000 tx=0x7fa78802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.148+0000 7fa7917fa640 1 -- 172.21.15.5:0/1196345857 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7941513c0 con 0x7fa77c004800 2024-04-25T09:03:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.325+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7940b7240 con 0x7fa78006b4d0 2024-04-25T09:03:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.331+0000 7fa7917fa640 1 -- 172.21.15.5:0/1196345857 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252085 (secure 0 0 0) 0x7fa7940b7240 con 0x7fa78006b4d0 2024-04-25T09:03:37.321 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:37.323 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:03:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa78006b4d0 msgr2=0x7fa78006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa78006b4d0 0x7fa78006d990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa788033000 tx=0x7fa78802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 msgr2=0x7fa794150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa794150e80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fa78400f7d0 tx=0x7fa78400fc90 comp rx=0 tx=0).stop 2024-04-25T09:03:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 shutdown_connections 2024-04-25T09:03:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa78006b4d0 0x7fa78006d990 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7940c6ea0 0x7fa7940c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7941f1b50 0x7fa7941f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 --2- 172.21.15.5:0/1196345857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa77c004800 0x7fa794150e80 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 >> 172.21.15.5:0/1196345857 conn(0x7fa7940d18f0 msgr2=0x7fa7940b55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 shutdown_connections 2024-04-25T09:03:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.334+0000 7fa79aaac640 1 -- 172.21.15.5:0/1196345857 wait complete. 2024-04-25T09:03:37.333 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-04-25T09:03:36.480827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376880,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754597840,"statfs":{"total":773094113280,"available":772708188160,"internally_reserved":0,"allocated":11051008,"data_stored":5422188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":374722097},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.496927"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092255+0000","last_change":"2024-04-25T09:03:33.013835+0000","last_active":"2024-04-25T09:03:34.092255+0000","last_peered":"2024-04-25T09:03:34.092255+0000","last_clean":"2024-04-25T09:03:34.092255+0000","last_became_active":"2024-04-25T09:03:33.013566+0000","last_became_peered":"2024-04-25T09:03:33.013566+0000","last_unstale":"2024-04-25T09:03:34.092255+0000","last_undegraded":"2024-04-25T09:03:34.092255+0000","last_fullsized":"2024-04-25T09:03:34.092255+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:07.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014546+0000","last_change":"2024-04-25T09:03:33.014100+0000","last_active":"2024-04-25T09:03:34.014546+0000","last_peered":"2024-04-25T09:03:34.014546+0000","last_clean":"2024-04-25T09:03:34.014546+0000","last_became_active":"2024-04-25T09:03:33.013782+0000","last_became_peered":"2024-04-25T09:03:33.013782+0000","last_unstale":"2024-04-25T09:03:34.014546+0000","last_undegraded":"2024-04-25T09:03:34.014546+0000","last_fullsized":"2024-04-25T09:03:34.014546+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:04.578372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092254+0000","last_change":"2024-04-25T09:03:33.005318+0000","last_active":"2024-04-25T09:03:34.092254+0000","last_peered":"2024-04-25T09:03:34.092254+0000","last_clean":"2024-04-25T09:03:34.092254+0000","last_became_active":"2024-04-25T09:03:33.004987+0000","last_became_peered":"2024-04-25T09:03:33.004987+0000","last_unstale":"2024-04-25T09:03:34.092254+0000","last_undegraded":"2024-04-25T09:03:34.092254+0000","last_fullsized":"2024-04-25T09:03:34.092254+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:16.864012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003486+0000","last_change":"2024-04-25T09:03:33.010793+0000","last_active":"2024-04-25T09:03:34.003486+0000","last_peered":"2024-04-25T09:03:34.003486+0000","last_clean":"2024-04-25T09:03:34.003486+0000","last_became_active":"2024-04-25T09:03:33.010488+0000","last_became_peered":"2024-04-25T09:03:33.010488+0000","last_unstale":"2024-04-25T09:03:34.003486+0000","last_undegraded":"2024-04-25T09:03:34.003486+0000","last_fullsized":"2024-04-25T09:03:34.003486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:25.817231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092994+0000","last_change":"2024-04-25T09:03:33.008181+0000","last_active":"2024-04-25T09:03:34.092994+0000","last_peered":"2024-04-25T09:03:34.092994+0000","last_clean":"2024-04-25T09:03:34.092994+0000","last_became_active":"2024-04-25T09:03:33.007721+0000","last_became_peered":"2024-04-25T09:03:33.007721+0000","last_unstale":"2024-04-25T09:03:34.092994+0000","last_undegraded":"2024-04-25T09:03:34.092994+0000","last_fullsized":"2024-04-25T09:03:34.092994+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:05.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092864+0000","last_change":"2024-04-25T09:03:33.008821+0000","last_active":"2024-04-25T09:03:34.092864+0000","last_peered":"2024-04-25T09:03:34.092864+0000","last_clean":"2024-04-25T09:03:34.092864+0000","last_became_active":"2024-04-25T09:03:33.008539+0000","last_became_peered":"2024-04-25T09:03:33.008539+0000","last_unstale":"2024-04-25T09:03:34.092864+0000","last_undegraded":"2024-04-25T09:03:34.092864+0000","last_fullsized":"2024-04-25T09:03:34.092864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:08.023258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092468+0000","last_change":"2024-04-25T09:03:33.005565+0000","last_active":"2024-04-25T09:03:34.092468+0000","last_peered":"2024-04-25T09:03:34.092468+0000","last_clean":"2024-04-25T09:03:34.092468+0000","last_became_active":"2024-04-25T09:03:33.005289+0000","last_became_peered":"2024-04-25T09:03:33.005289+0000","last_unstale":"2024-04-25T09:03:34.092468+0000","last_undegraded":"2024-04-25T09:03:34.092468+0000","last_fullsized":"2024-04-25T09:03:34.092468+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:55.839978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014243+0000","last_change":"2024-04-25T09:03:33.008085+0000","last_active":"2024-04-25T09:03:34.014243+0000","last_peered":"2024-04-25T09:03:34.014243+0000","last_clean":"2024-04-25T09:03:34.014243+0000","last_became_active":"2024-04-25T09:03:33.006496+0000","last_became_peered":"2024-04-25T09:03:33.006496+0000","last_unstale":"2024-04-25T09:03:34.014243+0000","last_undegraded":"2024-04-25T09:03:34.014243+0000","last_fullsized":"2024-04-25T09:03:34.014243+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:34.081502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004564+0000","last_change":"2024-04-25T09:03:33.001195+0000","last_active":"2024-04-25T09:03:34.004564+0000","last_peered":"2024-04-25T09:03:34.004564+0000","last_clean":"2024-04-25T09:03:34.004564+0000","last_became_active":"2024-04-25T09:03:33.000832+0000","last_became_peered":"2024-04-25T09:03:33.000832+0000","last_unstale":"2024-04-25T09:03:34.004564+0000","last_undegraded":"2024-04-25T09:03:34.004564+0000","last_fullsized":"2024-04-25T09:03:34.004564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:42.201762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092570+0000","last_change":"2024-04-25T09:03:33.011666+0000","last_active":"2024-04-25T09:03:34.092570+0000","last_peered":"2024-04-25T09:03:34.092570+0000","last_clean":"2024-04-25T09:03:34.092570+0000","last_became_active":"2024-04-25T09:03:33.011408+0000","last_became_peered":"2024-04-25T09:03:33.011408+0000","last_unstale":"2024-04-25T09:03:34.092570+0000","last_undegraded":"2024-04-25T09:03:34.092570+0000","last_fullsized":"2024-04-25T09:03:34.092570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:09.098101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093055+0000","last_change":"2024-04-25T09:03:33.013660+0000","last_active":"2024-04-25T09:03:34.093055+0000","last_peered":"2024-04-25T09:03:34.093055+0000","last_clean":"2024-04-25T09:03:34.093055+0000","last_became_active":"2024-04-25T09:03:33.013091+0000","last_became_peered":"2024-04-25T09:03:33.013091+0000","last_unstale":"2024-04-25T09:03:34.093055+0000","last_undegraded":"2024-04-25T09:03:34.093055+0000","last_fullsized":"2024-04-25T09:03:34.093055+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:38.207803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005078+0000","last_change":"2024-04-25T09:03:33.008673+0000","last_active":"2024-04-25T09:03:34.005078+0000","last_peered":"2024-04-25T09:03:34.005078+0000","last_clean":"2024-04-25T09:03:34.005078+0000","last_became_active":"2024-04-25T09:03:33.008411+0000","last_became_peered":"2024-04-25T09:03:33.008411+0000","last_unstale":"2024-04-25T09:03:34.005078+0000","last_undegraded":"2024-04-25T09:03:34.005078+0000","last_fullsized":"2024-04-25T09:03:34.005078+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:24.542053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003400+0000","last_change":"2024-04-25T09:03:32.999126+0000","last_active":"2024-04-25T09:03:34.003400+0000","last_peered":"2024-04-25T09:03:34.003400+0000","last_clean":"2024-04-25T09:03:34.003400+0000","last_became_active":"2024-04-25T09:03:32.998835+0000","last_became_peered":"2024-04-25T09:03:32.998835+0000","last_unstale":"2024-04-25T09:03:34.003400+0000","last_undegraded":"2024-04-25T09:03:34.003400+0000","last_fullsized":"2024-04-25T09:03:34.003400+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:40.265663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016390+0000","last_change":"2024-04-25T09:03:33.012598+0000","last_active":"2024-04-25T09:03:34.016390+0000","last_peered":"2024-04-25T09:03:34.016390+0000","last_clean":"2024-04-25T09:03:34.016390+0000","last_became_active":"2024-04-25T09:03:33.012234+0000","last_became_peered":"2024-04-25T09:03:33.012234+0000","last_unstale":"2024-04-25T09:03:34.016390+0000","last_undegraded":"2024-04-25T09:03:34.016390+0000","last_fullsized":"2024-04-25T09:03:34.016390+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:34.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003218+0000","last_change":"2024-04-25T09:03:33.008158+0000","last_active":"2024-04-25T09:03:34.003218+0000","last_peered":"2024-04-25T09:03:34.003218+0000","last_clean":"2024-04-25T09:03:34.003218+0000","last_became_active":"2024-04-25T09:03:33.007857+0000","last_became_peered":"2024-04-25T09:03:33.007857+0000","last_unstale":"2024-04-25T09:03:34.003218+0000","last_undegraded":"2024-04-25T09:03:34.003218+0000","last_fullsized":"2024-04-25T09:03:34.003218+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:52.483863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092508+0000","last_change":"2024-04-25T09:03:33.006517+0000","last_active":"2024-04-25T09:03:34.092508+0000","last_peered":"2024-04-25T09:03:34.092508+0000","last_clean":"2024-04-25T09:03:34.092508+0000","last_became_active":"2024-04-25T09:03:33.006241+0000","last_became_peered":"2024-04-25T09:03:33.006241+0000","last_unstale":"2024-04-25T09:03:34.092508+0000","last_undegraded":"2024-04-25T09:03:34.092508+0000","last_fullsized":"2024-04-25T09:03:34.092508+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:58.303006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014669+0000","last_change":"2024-04-25T09:03:33.005137+0000","last_active":"2024-04-25T09:03:34.014669+0000","last_peered":"2024-04-25T09:03:34.014669+0000","last_clean":"2024-04-25T09:03:34.014669+0000","last_became_active":"2024-04-25T09:03:33.004856+0000","last_became_peered":"2024-04-25T09:03:33.004856+0000","last_unstale":"2024-04-25T09:03:34.014669+0000","last_undegraded":"2024-04-25T09:03:34.014669+0000","last_fullsized":"2024-04-25T09:03:34.014669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:40.265663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003583+0000","last_change":"2024-04-25T09:03:33.005880+0000","last_active":"2024-04-25T09:03:34.003583+0000","last_peered":"2024-04-25T09:03:34.003583+0000","last_clean":"2024-04-25T09:03:34.003583+0000","last_became_active":"2024-04-25T09:03:33.005532+0000","last_became_peered":"2024-04-25T09:03:33.005532+0000","last_unstale":"2024-04-25T09:03:34.003583+0000","last_undegraded":"2024-04-25T09:03:34.003583+0000","last_fullsized":"2024-04-25T09:03:34.003583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:55.839978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016643+0000","last_change":"2024-04-25T09:03:33.008528+0000","last_active":"2024-04-25T09:03:34.016643+0000","last_peered":"2024-04-25T09:03:34.016643+0000","last_clean":"2024-04-25T09:03:34.016643+0000","last_became_active":"2024-04-25T09:03:33.008236+0000","last_became_peered":"2024-04-25T09:03:33.008236+0000","last_unstale":"2024-04-25T09:03:34.016643+0000","last_undegraded":"2024-04-25T09:03:34.016643+0000","last_fullsized":"2024-04-25T09:03:34.016643+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:13.068532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005104+0000","last_change":"2024-04-25T09:03:33.001559+0000","last_active":"2024-04-25T09:03:34.005104+0000","last_peered":"2024-04-25T09:03:34.005104+0000","last_clean":"2024-04-25T09:03:34.005104+0000","last_became_active":"2024-04-25T09:03:33.001279+0000","last_became_peered":"2024-04-25T09:03:33.001279+0000","last_unstale":"2024-04-25T09:03:34.005104+0000","last_undegraded":"2024-04-25T09:03:34.005104+0000","last_fullsized":"2024-04-25T09:03:34.005104+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:32.423645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016466+0000","last_change":"2024-04-25T09:03:33.002071+0000","last_active":"2024-04-25T09:03:34.016466+0000","last_peered":"2024-04-25T09:03:34.016466+0000","last_clean":"2024-04-25T09:03:34.016466+0000","last_became_active":"2024-04-25T09:03:33.001804+0000","last_became_peered":"2024-04-25T09:03:33.001804+0000","last_unstale":"2024-04-25T09:03:34.016466+0000","last_undegraded":"2024-04-25T09:03:34.016466+0000","last_fullsized":"2024-04-25T09:03:34.016466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:40.896749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014272+0000","last_change":"2024-04-25T09:03:33.003138+0000","last_active":"2024-04-25T09:03:34.014272+0000","last_peered":"2024-04-25T09:03:34.014272+0000","last_clean":"2024-04-25T09:03:34.014272+0000","last_became_active":"2024-04-25T09:03:33.002860+0000","last_became_peered":"2024-04-25T09:03:33.002860+0000","last_unstale":"2024-04-25T09:03:34.014272+0000","last_undegraded":"2024-04-25T09:03:34.014272+0000","last_fullsized":"2024-04-25T09:03:34.014272+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:52.483863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014253+0000","last_change":"2024-04-25T09:03:33.005207+0000","last_active":"2024-04-25T09:03:34.014253+0000","last_peered":"2024-04-25T09:03:34.014253+0000","last_clean":"2024-04-25T09:03:34.014253+0000","last_became_active":"2024-04-25T09:03:33.004930+0000","last_became_peered":"2024-04-25T09:03:33.004930+0000","last_unstale":"2024-04-25T09:03:34.014253+0000","last_undegraded":"2024-04-25T09:03:34.014253+0000","last_fullsized":"2024-04-25T09:03:34.014253+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:05.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092549+0000","last_change":"2024-04-25T09:03:33.010311+0000","last_active":"2024-04-25T09:03:34.092549+0000","last_peered":"2024-04-25T09:03:34.092549+0000","last_clean":"2024-04-25T09:03:34.092549+0000","last_became_active":"2024-04-25T09:03:33.009985+0000","last_became_peered":"2024-04-25T09:03:33.009985+0000","last_unstale":"2024-04-25T09:03:34.092549+0000","last_undegraded":"2024-04-25T09:03:34.092549+0000","last_fullsized":"2024-04-25T09:03:34.092549+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:45.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092940+0000","last_change":"2024-04-25T09:03:33.011065+0000","last_active":"2024-04-25T09:03:34.092940+0000","last_peered":"2024-04-25T09:03:34.092940+0000","last_clean":"2024-04-25T09:03:34.092940+0000","last_became_active":"2024-04-25T09:03:33.010568+0000","last_became_peered":"2024-04-25T09:03:33.010568+0000","last_unstale":"2024-04-25T09:03:34.092940+0000","last_undegraded":"2024-04-25T09:03:34.092940+0000","last_fullsized":"2024-04-25T09:03:34.092940+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:34.081502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014579+0000","last_change":"2024-04-25T09:03:33.012249+0000","last_active":"2024-04-25T09:03:34.014579+0000","last_peered":"2024-04-25T09:03:34.014579+0000","last_clean":"2024-04-25T09:03:34.014579+0000","last_became_active":"2024-04-25T09:03:33.011888+0000","last_became_peered":"2024-04-25T09:03:33.011888+0000","last_unstale":"2024-04-25T09:03:34.014579+0000","last_undegraded":"2024-04-25T09:03:34.014579+0000","last_fullsized":"2024-04-25T09:03:34.014579+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:42.048309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093198+0000","last_change":"2024-04-25T09:03:33.013407+0000","last_active":"2024-04-25T09:03:34.093198+0000","last_peered":"2024-04-25T09:03:34.093198+0000","last_clean":"2024-04-25T09:03:34.093198+0000","last_became_active":"2024-04-25T09:03:33.012288+0000","last_became_peered":"2024-04-25T09:03:33.012288+0000","last_unstale":"2024-04-25T09:03:34.093198+0000","last_undegraded":"2024-04-25T09:03:34.093198+0000","last_fullsized":"2024-04-25T09:03:34.093198+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:12.645478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093106+0000","last_change":"2024-04-25T09:03:33.016796+0000","last_active":"2024-04-25T09:03:34.093106+0000","last_peered":"2024-04-25T09:03:34.093106+0000","last_clean":"2024-04-25T09:03:34.093106+0000","last_became_active":"2024-04-25T09:03:33.016319+0000","last_became_peered":"2024-04-25T09:03:33.016319+0000","last_unstale":"2024-04-25T09:03:34.093106+0000","last_undegraded":"2024-04-25T09:03:34.093106+0000","last_fullsized":"2024-04-25T09:03:34.093106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.766457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014512+0000","last_change":"2024-04-25T09:03:33.013490+0000","last_active":"2024-04-25T09:03:34.014512+0000","last_peered":"2024-04-25T09:03:34.014512+0000","last_clean":"2024-04-25T09:03:34.014512+0000","last_became_active":"2024-04-25T09:03:33.013196+0000","last_became_peered":"2024-04-25T09:03:33.013196+0000","last_unstale":"2024-04-25T09:03:34.014512+0000","last_undegraded":"2024-04-25T09:03:34.014512+0000","last_fullsized":"2024-04-25T09:03:34.014512+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.766457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016335+0000","last_change":"2024-04-25T09:03:33.013189+0000","last_active":"2024-04-25T09:03:34.016335+0000","last_peered":"2024-04-25T09:03:34.016335+0000","last_clean":"2024-04-25T09:03:34.016335+0000","last_became_active":"2024-04-25T09:03:33.012925+0000","last_became_peered":"2024-04-25T09:03:33.012925+0000","last_unstale":"2024-04-25T09:03:34.016335+0000","last_undegraded":"2024-04-25T09:03:34.016335+0000","last_fullsized":"2024-04-25T09:03:34.016335+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:16.864012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003251+0000","last_change":"2024-04-25T09:03:33.014853+0000","last_active":"2024-04-25T09:03:34.003251+0000","last_peered":"2024-04-25T09:03:34.003251+0000","last_clean":"2024-04-25T09:03:34.003251+0000","last_became_active":"2024-04-25T09:03:33.014445+0000","last_became_peered":"2024-04-25T09:03:33.014445+0000","last_unstale":"2024-04-25T09:03:34.003251+0000","last_undegraded":"2024-04-25T09:03:34.003251+0000","last_fullsized":"2024-04-25T09:03:34.003251+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:04.578372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092274+0000","last_change":"2024-04-25T09:03:33.008993+0000","last_active":"2024-04-25T09:03:34.092274+0000","last_peered":"2024-04-25T09:03:34.092274+0000","last_clean":"2024-04-25T09:03:34.092274+0000","last_became_active":"2024-04-25T09:03:33.008183+0000","last_became_peered":"2024-04-25T09:03:33.008183+0000","last_unstale":"2024-04-25T09:03:34.092274+0000","last_undegraded":"2024-04-25T09:03:34.092274+0000","last_fullsized":"2024-04-25T09:03:34.092274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:40.896749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016572+0000","last_change":"2024-04-25T09:03:33.009761+0000","last_active":"2024-04-25T09:03:34.016572+0000","last_peered":"2024-04-25T09:03:34.016572+0000","last_clean":"2024-04-25T09:03:34.016572+0000","last_became_active":"2024-04-25T09:03:33.009439+0000","last_became_peered":"2024-04-25T09:03:33.009439+0000","last_unstale":"2024-04-25T09:03:34.016572+0000","last_undegraded":"2024-04-25T09:03:34.016572+0000","last_fullsized":"2024-04-25T09:03:34.016572+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:39.340547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"98'4","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014600+0000","last_change":"2024-04-25T09:03:32.001769+0000","last_active":"2024-04-25T09:03:34.014600+0000","last_peered":"2024-04-25T09:03:34.014600+0000","last_clean":"2024-04-25T09:03:34.014600+0000","last_became_active":"2024-04-25T09:03:32.001379+0000","last_became_peered":"2024-04-25T09:03:32.001379+0000","last_unstale":"2024-04-25T09:03:34.014600+0000","last_undegraded":"2024-04-25T09:03:34.014600+0000","last_fullsized":"2024-04-25T09:03:34.014600+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:12.526380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003636+0000","last_change":"2024-04-25T09:03:33.015826+0000","last_active":"2024-04-25T09:03:34.003636+0000","last_peered":"2024-04-25T09:03:34.003636+0000","last_clean":"2024-04-25T09:03:34.003636+0000","last_became_active":"2024-04-25T09:03:33.014163+0000","last_became_peered":"2024-04-25T09:03:33.014163+0000","last_unstale":"2024-04-25T09:03:34.003636+0000","last_undegraded":"2024-04-25T09:03:34.003636+0000","last_fullsized":"2024-04-25T09:03:34.003636+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:58.303006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092757+0000","last_change":"2024-04-25T09:03:32.001944+0000","last_active":"2024-04-25T09:03:34.092757+0000","last_peered":"2024-04-25T09:03:34.092757+0000","last_clean":"2024-04-25T09:03:34.092757+0000","last_became_active":"2024-04-25T09:03:32.001654+0000","last_became_peered":"2024-04-25T09:03:32.001654+0000","last_unstale":"2024-04-25T09:03:34.092757+0000","last_undegraded":"2024-04-25T09:03:34.092757+0000","last_fullsized":"2024-04-25T09:03:34.092757+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:36.690581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092391+0000","last_change":"2024-04-25T09:03:33.010427+0000","last_active":"2024-04-25T09:03:34.092391+0000","last_peered":"2024-04-25T09:03:34.092391+0000","last_clean":"2024-04-25T09:03:34.092391+0000","last_became_active":"2024-04-25T09:03:33.010085+0000","last_became_peered":"2024-04-25T09:03:33.010085+0000","last_unstale":"2024-04-25T09:03:34.092391+0000","last_undegraded":"2024-04-25T09:03:34.092391+0000","last_fullsized":"2024-04-25T09:03:34.092391+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:46.375716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014438+0000","last_change":"2024-04-25T09:03:32.003949+0000","last_active":"2024-04-25T09:03:34.014438+0000","last_peered":"2024-04-25T09:03:34.014438+0000","last_clean":"2024-04-25T09:03:34.014438+0000","last_became_active":"2024-04-25T09:03:32.003625+0000","last_became_peered":"2024-04-25T09:03:32.003625+0000","last_unstale":"2024-04-25T09:03:34.014438+0000","last_undegraded":"2024-04-25T09:03:34.014438+0000","last_fullsized":"2024-04-25T09:03:34.014438+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:32.622276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005284+0000","last_change":"2024-04-25T09:03:33.005433+0000","last_active":"2024-04-25T09:03:34.005284+0000","last_peered":"2024-04-25T09:03:34.005284+0000","last_clean":"2024-04-25T09:03:34.005284+0000","last_became_active":"2024-04-25T09:03:33.005111+0000","last_became_peered":"2024-04-25T09:03:33.005111+0000","last_unstale":"2024-04-25T09:03:34.005284+0000","last_undegraded":"2024-04-25T09:03:34.005284+0000","last_fullsized":"2024-04-25T09:03:34.005284+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:45.618878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014357+0000","last_change":"2024-04-25T09:03:32.005036+0000","last_active":"2024-04-25T09:03:34.014357+0000","last_peered":"2024-04-25T09:03:34.014357+0000","last_clean":"2024-04-25T09:03:34.014357+0000","last_became_active":"2024-04-25T09:03:32.004511+0000","last_became_peered":"2024-04-25T09:03:32.004511+0000","last_unstale":"2024-04-25T09:03:34.014357+0000","last_undegraded":"2024-04-25T09:03:34.014357+0000","last_fullsized":"2024-04-25T09:03:34.014357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:40.694690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004348+0000","last_change":"2024-04-25T09:03:33.003271+0000","last_active":"2024-04-25T09:03:34.004348+0000","last_peered":"2024-04-25T09:03:34.004348+0000","last_clean":"2024-04-25T09:03:34.004348+0000","last_became_active":"2024-04-25T09:03:33.002994+0000","last_became_peered":"2024-04-25T09:03:33.002994+0000","last_unstale":"2024-04-25T09:03:34.004348+0000","last_undegraded":"2024-04-25T09:03:34.004348+0000","last_fullsized":"2024-04-25T09:03:34.004348+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:14.915601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092081+0000","last_change":"2024-04-25T09:03:32.000910+0000","last_active":"2024-04-25T09:03:34.092081+0000","last_peered":"2024-04-25T09:03:34.092081+0000","last_clean":"2024-04-25T09:03:34.092081+0000","last_became_active":"2024-04-25T09:03:32.000555+0000","last_became_peered":"2024-04-25T09:03:32.000555+0000","last_unstale":"2024-04-25T09:03:34.092081+0000","last_undegraded":"2024-04-25T09:03:34.092081+0000","last_fullsized":"2024-04-25T09:03:34.092081+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:55.512555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092782+0000","last_change":"2024-04-25T09:03:33.012662+0000","last_active":"2024-04-25T09:03:34.092782+0000","last_peered":"2024-04-25T09:03:34.092782+0000","last_clean":"2024-04-25T09:03:34.092782+0000","last_became_active":"2024-04-25T09:03:33.012394+0000","last_became_peered":"2024-04-25T09:03:33.012394+0000","last_unstale":"2024-04-25T09:03:34.092782+0000","last_undegraded":"2024-04-25T09:03:34.092782+0000","last_fullsized":"2024-04-25T09:03:34.092782+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:31.093535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014186+0000","last_change":"2024-04-25T09:03:32.008569+0000","last_active":"2024-04-25T09:03:34.014186+0000","last_peered":"2024-04-25T09:03:34.014186+0000","last_clean":"2024-04-25T09:03:34.014186+0000","last_became_active":"2024-04-25T09:03:32.008155+0000","last_became_peered":"2024-04-25T09:03:32.008155+0000","last_unstale":"2024-04-25T09:03:34.014186+0000","last_undegraded":"2024-04-25T09:03:34.014186+0000","last_fullsized":"2024-04-25T09:03:34.014186+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:06.227975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003219+0000","last_change":"2024-04-25T09:03:33.014672+0000","last_active":"2024-04-25T09:03:34.003219+0000","last_peered":"2024-04-25T09:03:34.003219+0000","last_clean":"2024-04-25T09:03:34.003219+0000","last_became_active":"2024-04-25T09:03:33.014305+0000","last_became_peered":"2024-04-25T09:03:33.014305+0000","last_unstale":"2024-04-25T09:03:34.003219+0000","last_undegraded":"2024-04-25T09:03:34.003219+0000","last_fullsized":"2024-04-25T09:03:34.003219+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.766457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092675+0000","last_change":"2024-04-25T09:03:32.006225+0000","last_active":"2024-04-25T09:03:34.092675+0000","last_peered":"2024-04-25T09:03:34.092675+0000","last_clean":"2024-04-25T09:03:34.092675+0000","last_became_active":"2024-04-25T09:03:32.005912+0000","last_became_peered":"2024-04-25T09:03:32.005912+0000","last_unstale":"2024-04-25T09:03:34.092675+0000","last_undegraded":"2024-04-25T09:03:34.092675+0000","last_fullsized":"2024-04-25T09:03:34.092675+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:32.622276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004957+0000","last_change":"2024-04-25T09:03:33.004870+0000","last_active":"2024-04-25T09:03:34.004957+0000","last_peered":"2024-04-25T09:03:34.004957+0000","last_clean":"2024-04-25T09:03:34.004957+0000","last_became_active":"2024-04-25T09:03:33.004540+0000","last_became_peered":"2024-04-25T09:03:33.004540+0000","last_unstale":"2024-04-25T09:03:34.004957+0000","last_undegraded":"2024-04-25T09:03:34.004957+0000","last_fullsized":"2024-04-25T09:03:34.004957+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:04.529240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092117+0000","last_change":"2024-04-25T09:03:31.997739+0000","last_active":"2024-04-25T09:03:34.092117+0000","last_peered":"2024-04-25T09:03:34.092117+0000","last_clean":"2024-04-25T09:03:34.092117+0000","last_became_active":"2024-04-25T09:03:31.997428+0000","last_became_peered":"2024-04-25T09:03:31.997428+0000","last_unstale":"2024-04-25T09:03:34.092117+0000","last_undegraded":"2024-04-25T09:03:34.092117+0000","last_fullsized":"2024-04-25T09:03:34.092117+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:52.436286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014703+0000","last_change":"2024-04-25T09:03:33.004437+0000","last_active":"2024-04-25T09:03:34.014703+0000","last_peered":"2024-04-25T09:03:34.014703+0000","last_clean":"2024-04-25T09:03:34.014703+0000","last_became_active":"2024-04-25T09:03:33.003926+0000","last_became_peered":"2024-04-25T09:03:33.003926+0000","last_unstale":"2024-04-25T09:03:34.014703+0000","last_undegraded":"2024-04-25T09:03:34.014703+0000","last_fullsized":"2024-04-25T09:03:34.014703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:25.817231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092324+0000","last_change":"2024-04-25T09:03:32.000954+0000","last_active":"2024-04-25T09:03:34.092324+0000","last_peered":"2024-04-25T09:03:34.092324+0000","last_clean":"2024-04-25T09:03:34.092324+0000","last_became_active":"2024-04-25T09:03:32.000609+0000","last_became_peered":"2024-04-25T09:03:32.000609+0000","last_unstale":"2024-04-25T09:03:34.092324+0000","last_undegraded":"2024-04-25T09:03:34.092324+0000","last_fullsized":"2024-04-25T09:03:34.092324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:55.201641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004698+0000","last_change":"2024-04-25T09:03:33.002952+0000","last_active":"2024-04-25T09:03:34.004698+0000","last_peered":"2024-04-25T09:03:34.004698+0000","last_clean":"2024-04-25T09:03:34.004698+0000","last_became_active":"2024-04-25T09:03:33.001965+0000","last_became_peered":"2024-04-25T09:03:33.001965+0000","last_unstale":"2024-04-25T09:03:34.004698+0000","last_undegraded":"2024-04-25T09:03:34.004698+0000","last_fullsized":"2024-04-25T09:03:34.004698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:18.026783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003552+0000","last_change":"2024-04-25T09:03:32.004208+0000","last_active":"2024-04-25T09:03:34.003552+0000","last_peered":"2024-04-25T09:03:34.003552+0000","last_clean":"2024-04-25T09:03:34.003552+0000","last_became_active":"2024-04-25T09:03:32.003897+0000","last_became_peered":"2024-04-25T09:03:32.003897+0000","last_unstale":"2024-04-25T09:03:34.003552+0000","last_undegraded":"2024-04-25T09:03:34.003552+0000","last_fullsized":"2024-04-25T09:03:34.003552+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:23.537597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093231+0000","last_change":"2024-04-25T09:03:33.015845+0000","last_active":"2024-04-25T09:03:34.093231+0000","last_peered":"2024-04-25T09:03:34.093231+0000","last_clean":"2024-04-25T09:03:34.093231+0000","last_became_active":"2024-04-25T09:03:33.014796+0000","last_became_peered":"2024-04-25T09:03:33.014796+0000","last_unstale":"2024-04-25T09:03:34.093231+0000","last_undegraded":"2024-04-25T09:03:34.093231+0000","last_fullsized":"2024-04-25T09:03:34.093231+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:04.578372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"98'3","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093399+0000","last_change":"2024-04-25T09:03:31.997226+0000","last_active":"2024-04-25T09:03:34.093399+0000","last_peered":"2024-04-25T09:03:34.093399+0000","last_clean":"2024-04-25T09:03:34.093399+0000","last_became_active":"2024-04-25T09:03:31.996873+0000","last_became_peered":"2024-04-25T09:03:31.996873+0000","last_unstale":"2024-04-25T09:03:34.093399+0000","last_undegraded":"2024-04-25T09:03:34.093399+0000","last_fullsized":"2024-04-25T09:03:34.093399+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:53.871446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093343+0000","last_change":"2024-04-25T09:03:33.006758+0000","last_active":"2024-04-25T09:03:34.093343+0000","last_peered":"2024-04-25T09:03:34.093343+0000","last_clean":"2024-04-25T09:03:34.093343+0000","last_became_active":"2024-04-25T09:03:33.006481+0000","last_became_peered":"2024-04-25T09:03:33.006481+0000","last_unstale":"2024-04-25T09:03:34.093343+0000","last_undegraded":"2024-04-25T09:03:34.093343+0000","last_fullsized":"2024-04-25T09:03:34.093343+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:02.861641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"98'6","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005138+0000","last_change":"2024-04-25T09:03:31.997242+0000","last_active":"2024-04-25T09:03:34.005138+0000","last_peered":"2024-04-25T09:03:34.005138+0000","last_clean":"2024-04-25T09:03:34.005138+0000","last_became_active":"2024-04-25T09:03:31.996911+0000","last_became_peered":"2024-04-25T09:03:31.996911+0000","last_unstale":"2024-04-25T09:03:34.005138+0000","last_undegraded":"2024-04-25T09:03:34.005138+0000","last_fullsized":"2024-04-25T09:03:34.005138+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:51.101936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003346+0000","last_change":"2024-04-25T09:03:33.004495+0000","last_active":"2024-04-25T09:03:34.003346+0000","last_peered":"2024-04-25T09:03:34.003346+0000","last_clean":"2024-04-25T09:03:34.003346+0000","last_became_active":"2024-04-25T09:03:33.004216+0000","last_became_peered":"2024-04-25T09:03:33.004216+0000","last_unstale":"2024-04-25T09:03:34.003346+0000","last_undegraded":"2024-04-25T09:03:34.003346+0000","last_fullsized":"2024-04-25T09:03:34.003346+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:42.048309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016529+0000","last_change":"2024-04-25T09:03:31.988055+0000","last_active":"2024-04-25T09:03:34.016529+0000","last_peered":"2024-04-25T09:03:34.016529+0000","last_clean":"2024-04-25T09:03:34.016529+0000","last_became_active":"2024-04-25T09:03:31.987764+0000","last_became_peered":"2024-04-25T09:03:31.987764+0000","last_unstale":"2024-04-25T09:03:34.016529+0000","last_undegraded":"2024-04-25T09:03:34.016529+0000","last_fullsized":"2024-04-25T09:03:34.016529+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:32.347825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092275+0000","last_change":"2024-04-25T09:03:33.016451+0000","last_active":"2024-04-25T09:03:34.092275+0000","last_peered":"2024-04-25T09:03:34.092275+0000","last_clean":"2024-04-25T09:03:34.092275+0000","last_became_active":"2024-04-25T09:03:33.016130+0000","last_became_peered":"2024-04-25T09:03:33.016130+0000","last_unstale":"2024-04-25T09:03:34.092275+0000","last_undegraded":"2024-04-25T09:03:34.092275+0000","last_fullsized":"2024-04-25T09:03:34.092275+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:34.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016651+0000","last_change":"2024-04-25T09:03:31.992144+0000","last_active":"2024-04-25T09:03:34.016651+0000","last_peered":"2024-04-25T09:03:34.016651+0000","last_clean":"2024-04-25T09:03:34.016651+0000","last_became_active":"2024-04-25T09:03:31.991862+0000","last_became_peered":"2024-04-25T09:03:31.991862+0000","last_unstale":"2024-04-25T09:03:34.016651+0000","last_undegraded":"2024-04-25T09:03:34.016651+0000","last_fullsized":"2024-04-25T09:03:34.016651+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:19.416043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004223+0000","last_change":"2024-04-25T09:03:33.002335+0000","last_active":"2024-04-25T09:03:34.004223+0000","last_peered":"2024-04-25T09:03:34.004223+0000","last_clean":"2024-04-25T09:03:34.004223+0000","last_became_active":"2024-04-25T09:03:33.002030+0000","last_became_peered":"2024-04-25T09:03:33.002030+0000","last_unstale":"2024-04-25T09:03:34.004223+0000","last_undegraded":"2024-04-25T09:03:34.004223+0000","last_fullsized":"2024-04-25T09:03:34.004223+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:09.108929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.005005+0000","last_change":"2024-04-25T09:03:31.996613+0000","last_active":"2024-04-25T09:03:34.005005+0000","last_peered":"2024-04-25T09:03:34.005005+0000","last_clean":"2024-04-25T09:03:34.005005+0000","last_became_active":"2024-04-25T09:03:31.996331+0000","last_became_peered":"2024-04-25T09:03:31.996331+0000","last_unstale":"2024-04-25T09:03:34.005005+0000","last_undegraded":"2024-04-25T09:03:34.005005+0000","last_fullsized":"2024-04-25T09:03:34.005005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:49.011761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016300+0000","last_change":"2024-04-25T09:03:33.003786+0000","last_active":"2024-04-25T09:03:34.016300+0000","last_peered":"2024-04-25T09:03:34.016300+0000","last_clean":"2024-04-25T09:03:34.016300+0000","last_became_active":"2024-04-25T09:03:33.003521+0000","last_became_peered":"2024-04-25T09:03:33.003521+0000","last_unstale":"2024-04-25T09:03:34.016300+0000","last_undegraded":"2024-04-25T09:03:34.016300+0000","last_fullsized":"2024-04-25T09:03:34.016300+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:07.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"98'8","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092339+0000","last_change":"2024-04-25T09:03:31.997738+0000","last_active":"2024-04-25T09:03:34.092339+0000","last_peered":"2024-04-25T09:03:34.092339+0000","last_clean":"2024-04-25T09:03:34.092339+0000","last_became_active":"2024-04-25T09:03:31.997416+0000","last_became_peered":"2024-04-25T09:03:31.997416+0000","last_unstale":"2024-04-25T09:03:34.092339+0000","last_undegraded":"2024-04-25T09:03:34.092339+0000","last_fullsized":"2024-04-25T09:03:34.092339+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:29.863077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093054+0000","last_change":"2024-04-25T09:03:33.010287+0000","last_active":"2024-04-25T09:03:34.093054+0000","last_peered":"2024-04-25T09:03:34.093054+0000","last_clean":"2024-04-25T09:03:34.093054+0000","last_became_active":"2024-04-25T09:03:33.010029+0000","last_became_peered":"2024-04-25T09:03:33.010029+0000","last_unstale":"2024-04-25T09:03:34.093054+0000","last_undegraded":"2024-04-25T09:03:34.093054+0000","last_fullsized":"2024-04-25T09:03:34.093054+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:52.483863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004845+0000","last_change":"2024-04-25T09:03:31.987772+0000","last_active":"2024-04-25T09:03:34.004845+0000","last_peered":"2024-04-25T09:03:34.004845+0000","last_clean":"2024-04-25T09:03:34.004845+0000","last_became_active":"2024-04-25T09:03:31.987431+0000","last_became_peered":"2024-04-25T09:03:31.987431+0000","last_unstale":"2024-04-25T09:03:34.004845+0000","last_undegraded":"2024-04-25T09:03:34.004845+0000","last_fullsized":"2024-04-25T09:03:34.004845+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:44.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004617+0000","last_change":"2024-04-25T09:03:33.019530+0000","last_active":"2024-04-25T09:03:34.004617+0000","last_peered":"2024-04-25T09:03:34.004617+0000","last_clean":"2024-04-25T09:03:34.004617+0000","last_became_active":"2024-04-25T09:03:33.019168+0000","last_became_peered":"2024-04-25T09:03:33.019168+0000","last_unstale":"2024-04-25T09:03:34.004617+0000","last_undegraded":"2024-04-25T09:03:34.004617+0000","last_fullsized":"2024-04-25T09:03:34.004617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:09.108929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092390+0000","last_change":"2024-04-25T09:03:31.993228+0000","last_active":"2024-04-25T09:03:34.092390+0000","last_peered":"2024-04-25T09:03:34.092390+0000","last_clean":"2024-04-25T09:03:34.092390+0000","last_became_active":"2024-04-25T09:03:31.992920+0000","last_became_peered":"2024-04-25T09:03:31.992920+0000","last_unstale":"2024-04-25T09:03:34.092390+0000","last_undegraded":"2024-04-25T09:03:34.092390+0000","last_fullsized":"2024-04-25T09:03:34.092390+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:56.312148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093383+0000","last_change":"2024-04-25T09:03:33.013914+0000","last_active":"2024-04-25T09:03:34.093383+0000","last_peered":"2024-04-25T09:03:34.093383+0000","last_clean":"2024-04-25T09:03:34.093383+0000","last_became_active":"2024-04-25T09:03:33.012737+0000","last_became_peered":"2024-04-25T09:03:33.012737+0000","last_unstale":"2024-04-25T09:03:34.093383+0000","last_undegraded":"2024-04-25T09:03:34.093383+0000","last_fullsized":"2024-04-25T09:03:34.093383+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.855662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014364+0000","last_change":"2024-04-25T09:03:32.005265+0000","last_active":"2024-04-25T09:03:34.014364+0000","last_peered":"2024-04-25T09:03:34.014364+0000","last_clean":"2024-04-25T09:03:34.014364+0000","last_became_active":"2024-04-25T09:03:32.004788+0000","last_became_peered":"2024-04-25T09:03:32.004788+0000","last_unstale":"2024-04-25T09:03:34.014364+0000","last_undegraded":"2024-04-25T09:03:34.014364+0000","last_fullsized":"2024-04-25T09:03:34.014364+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016617+0000","last_change":"2024-04-25T09:03:33.007187+0000","last_active":"2024-04-25T09:03:34.016617+0000","last_peered":"2024-04-25T09:03:34.016617+0000","last_clean":"2024-04-25T09:03:34.016617+0000","last_became_active":"2024-04-25T09:03:33.006848+0000","last_became_peered":"2024-04-25T09:03:33.006848+0000","last_unstale":"2024-04-25T09:03:34.016617+0000","last_undegraded":"2024-04-25T09:03:34.016617+0000","last_fullsized":"2024-04-25T09:03:34.016617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:46.375716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014338+0000","last_change":"2024-04-25T09:03:32.007026+0000","last_active":"2024-04-25T09:03:34.014338+0000","last_peered":"2024-04-25T09:03:34.014338+0000","last_clean":"2024-04-25T09:03:34.014338+0000","last_became_active":"2024-04-25T09:03:32.006611+0000","last_became_peered":"2024-04-25T09:03:32.006611+0000","last_unstale":"2024-04-25T09:03:34.014338+0000","last_undegraded":"2024-04-25T09:03:34.014338+0000","last_fullsized":"2024-04-25T09:03:34.014338+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:13.911144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016673+0000","last_change":"2024-04-25T09:03:33.007211+0000","last_active":"2024-04-25T09:03:34.016673+0000","last_peered":"2024-04-25T09:03:34.016673+0000","last_clean":"2024-04-25T09:03:34.016673+0000","last_became_active":"2024-04-25T09:03:33.006889+0000","last_became_peered":"2024-04-25T09:03:33.006889+0000","last_unstale":"2024-04-25T09:03:34.016673+0000","last_undegraded":"2024-04-25T09:03:34.016673+0000","last_fullsized":"2024-04-25T09:03:34.016673+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:45.131879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004393+0000","last_change":"2024-04-25T09:03:31.995929+0000","last_active":"2024-04-25T09:03:34.004393+0000","last_peered":"2024-04-25T09:03:34.004393+0000","last_clean":"2024-04-25T09:03:34.004393+0000","last_became_active":"2024-04-25T09:03:31.995399+0000","last_became_peered":"2024-04-25T09:03:31.995399+0000","last_unstale":"2024-04-25T09:03:34.004393+0000","last_undegraded":"2024-04-25T09:03:34.004393+0000","last_fullsized":"2024-04-25T09:03:34.004393+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:12.526380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016207+0000","last_change":"2024-04-25T09:03:33.007366+0000","last_active":"2024-04-25T09:03:34.016207+0000","last_peered":"2024-04-25T09:03:34.016207+0000","last_clean":"2024-04-25T09:03:34.016207+0000","last_became_active":"2024-04-25T09:03:33.002838+0000","last_became_peered":"2024-04-25T09:03:33.002838+0000","last_unstale":"2024-04-25T09:03:34.016207+0000","last_undegraded":"2024-04-25T09:03:34.016207+0000","last_fullsized":"2024-04-25T09:03:34.016207+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:15.764642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004203+0000","last_change":"2024-04-25T09:03:31.996327+0000","last_active":"2024-04-25T09:03:34.004203+0000","last_peered":"2024-04-25T09:03:34.004203+0000","last_clean":"2024-04-25T09:03:34.004203+0000","last_became_active":"2024-04-25T09:03:31.995678+0000","last_became_peered":"2024-04-25T09:03:31.995678+0000","last_unstale":"2024-04-25T09:03:34.004203+0000","last_undegraded":"2024-04-25T09:03:34.004203+0000","last_fullsized":"2024-04-25T09:03:34.004203+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.237491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093274+0000","last_change":"2024-04-25T09:03:33.011055+0000","last_active":"2024-04-25T09:03:34.093274+0000","last_peered":"2024-04-25T09:03:34.093274+0000","last_clean":"2024-04-25T09:03:34.093274+0000","last_became_active":"2024-04-25T09:03:33.010789+0000","last_became_peered":"2024-04-25T09:03:33.010789+0000","last_unstale":"2024-04-25T09:03:34.093274+0000","last_undegraded":"2024-04-25T09:03:34.093274+0000","last_fullsized":"2024-04-25T09:03:34.093274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:42.048309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014205+0000","last_change":"2024-04-25T09:03:32.007356+0000","last_active":"2024-04-25T09:03:34.014205+0000","last_peered":"2024-04-25T09:03:34.014205+0000","last_clean":"2024-04-25T09:03:34.014205+0000","last_became_active":"2024-04-25T09:03:32.006940+0000","last_became_peered":"2024-04-25T09:03:32.006940+0000","last_unstale":"2024-04-25T09:03:34.014205+0000","last_undegraded":"2024-04-25T09:03:34.014205+0000","last_fullsized":"2024-04-25T09:03:34.014205+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.237491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014725+0000","last_change":"2024-04-25T09:03:33.004207+0000","last_active":"2024-04-25T09:03:34.014725+0000","last_peered":"2024-04-25T09:03:34.014725+0000","last_clean":"2024-04-25T09:03:34.014725+0000","last_became_active":"2024-04-25T09:03:33.003582+0000","last_became_peered":"2024-04-25T09:03:33.003582+0000","last_unstale":"2024-04-25T09:03:34.014725+0000","last_undegraded":"2024-04-25T09:03:34.014725+0000","last_fullsized":"2024-04-25T09:03:34.014725+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:55.839978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004749+0000","last_change":"2024-04-25T09:03:31.988342+0000","last_active":"2024-04-25T09:03:34.004749+0000","last_peered":"2024-04-25T09:03:34.004749+0000","last_clean":"2024-04-25T09:03:34.004749+0000","last_became_active":"2024-04-25T09:03:31.988030+0000","last_became_peered":"2024-04-25T09:03:31.988030+0000","last_unstale":"2024-04-25T09:03:34.004749+0000","last_undegraded":"2024-04-25T09:03:34.004749+0000","last_fullsized":"2024-04-25T09:03:34.004749+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092327+0000","last_change":"2024-04-25T09:03:33.012598+0000","last_active":"2024-04-25T09:03:34.092327+0000","last_peered":"2024-04-25T09:03:34.092327+0000","last_clean":"2024-04-25T09:03:34.092327+0000","last_became_active":"2024-04-25T09:03:33.010706+0000","last_became_peered":"2024-04-25T09:03:33.010706+0000","last_unstale":"2024-04-25T09:03:34.092327+0000","last_undegraded":"2024-04-25T09:03:34.092327+0000","last_fullsized":"2024-04-25T09:03:34.092327+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:54.306352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"99'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014797+0000","last_change":"2024-04-25T09:03:32.003606+0000","last_active":"2024-04-25T09:03:34.014797+0000","last_peered":"2024-04-25T09:03:34.014797+0000","last_clean":"2024-04-25T09:03:34.014797+0000","last_became_active":"2024-04-25T09:03:32.003325+0000","last_became_peered":"2024-04-25T09:03:32.003325+0000","last_unstale":"2024-04-25T09:03:34.014797+0000","last_undegraded":"2024-04-25T09:03:34.014797+0000","last_fullsized":"2024-04-25T09:03:34.014797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:08.104472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092368+0000","last_change":"2024-04-25T09:03:33.018159+0000","last_active":"2024-04-25T09:03:34.092368+0000","last_peered":"2024-04-25T09:03:34.092368+0000","last_clean":"2024-04-25T09:03:34.092368+0000","last_became_active":"2024-04-25T09:03:33.017882+0000","last_became_peered":"2024-04-25T09:03:33.017882+0000","last_unstale":"2024-04-25T09:03:34.092368+0000","last_undegraded":"2024-04-25T09:03:34.092368+0000","last_fullsized":"2024-04-25T09:03:34.092368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:39.340547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014460+0000","last_change":"2024-04-25T09:03:32.003915+0000","last_active":"2024-04-25T09:03:34.014460+0000","last_peered":"2024-04-25T09:03:34.014460+0000","last_clean":"2024-04-25T09:03:34.014460+0000","last_became_active":"2024-04-25T09:03:32.003247+0000","last_became_peered":"2024-04-25T09:03:32.003247+0000","last_unstale":"2024-04-25T09:03:34.014460+0000","last_undegraded":"2024-04-25T09:03:34.014460+0000","last_fullsized":"2024-04-25T09:03:34.014460+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:56.312148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092480+0000","last_change":"2024-04-25T09:03:33.012544+0000","last_active":"2024-04-25T09:03:34.092480+0000","last_peered":"2024-04-25T09:03:34.092480+0000","last_clean":"2024-04-25T09:03:34.092480+0000","last_became_active":"2024-04-25T09:03:33.012274+0000","last_became_peered":"2024-04-25T09:03:33.012274+0000","last_unstale":"2024-04-25T09:03:34.092480+0000","last_undegraded":"2024-04-25T09:03:34.092480+0000","last_fullsized":"2024-04-25T09:03:34.092480+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:15.367065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.093155+0000","last_change":"2024-04-25T09:03:31.997489+0000","last_active":"2024-04-25T09:03:34.093155+0000","last_peered":"2024-04-25T09:03:34.093155+0000","last_clean":"2024-04-25T09:03:34.093155+0000","last_became_active":"2024-04-25T09:03:31.997064+0000","last_became_peered":"2024-04-25T09:03:31.997064+0000","last_unstale":"2024-04-25T09:03:34.093155+0000","last_undegraded":"2024-04-25T09:03:34.093155+0000","last_fullsized":"2024-04-25T09:03:34.093155+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:13.911144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016584+0000","last_change":"2024-04-25T09:03:33.004705+0000","last_active":"2024-04-25T09:03:34.016584+0000","last_peered":"2024-04-25T09:03:34.016584+0000","last_clean":"2024-04-25T09:03:34.016584+0000","last_became_active":"2024-04-25T09:03:33.004409+0000","last_became_peered":"2024-04-25T09:03:33.004409+0000","last_unstale":"2024-04-25T09:03:34.016584+0000","last_undegraded":"2024-04-25T09:03:34.016584+0000","last_fullsized":"2024-04-25T09:03:34.016584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:54.306352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.014460+0000","last_change":"2024-04-25T09:03:32.007405+0000","last_active":"2024-04-25T09:03:34.014460+0000","last_peered":"2024-04-25T09:03:34.014460+0000","last_clean":"2024-04-25T09:03:34.014460+0000","last_became_active":"2024-04-25T09:03:32.007088+0000","last_became_peered":"2024-04-25T09:03:32.007088+0000","last_unstale":"2024-04-25T09:03:34.014460+0000","last_undegraded":"2024-04-25T09:03:34.014460+0000","last_fullsized":"2024-04-25T09:03:34.014460+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:41.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.004611+0000","last_change":"2024-04-25T09:03:33.009526+0000","last_active":"2024-04-25T09:03:34.004611+0000","last_peered":"2024-04-25T09:03:34.004611+0000","last_clean":"2024-04-25T09:03:34.004611+0000","last_became_active":"2024-04-25T09:03:33.009200+0000","last_became_peered":"2024-04-25T09:03:33.009200+0000","last_unstale":"2024-04-25T09:03:34.004611+0000","last_undegraded":"2024-04-25T09:03:34.004611+0000","last_fullsized":"2024-04-25T09:03:34.004611+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:17.180400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092267+0000","last_change":"2024-04-25T09:03:31.995857+0000","last_active":"2024-04-25T09:03:34.092267+0000","last_peered":"2024-04-25T09:03:34.092267+0000","last_clean":"2024-04-25T09:03:34.092267+0000","last_became_active":"2024-04-25T09:03:31.995471+0000","last_became_peered":"2024-04-25T09:03:31.995471+0000","last_unstale":"2024-04-25T09:03:34.092267+0000","last_undegraded":"2024-04-25T09:03:34.092267+0000","last_fullsized":"2024-04-25T09:03:34.092267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:25.812820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016271+0000","last_change":"2024-04-25T09:03:33.003196+0000","last_active":"2024-04-25T09:03:34.016271+0000","last_peered":"2024-04-25T09:03:34.016271+0000","last_clean":"2024-04-25T09:03:34.016271+0000","last_became_active":"2024-04-25T09:03:33.002854+0000","last_became_peered":"2024-04-25T09:03:33.002854+0000","last_unstale":"2024-04-25T09:03:34.016271+0000","last_undegraded":"2024-04-25T09:03:34.016271+0000","last_fullsized":"2024-04-25T09:03:34.016271+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:20.077198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.003311+0000","last_change":"2024-04-25T09:03:31.994485+0000","last_active":"2024-04-25T09:03:34.003311+0000","last_peered":"2024-04-25T09:03:34.003311+0000","last_clean":"2024-04-25T09:03:34.003311+0000","last_became_active":"2024-04-25T09:03:31.994105+0000","last_became_peered":"2024-04-25T09:03:31.994105+0000","last_unstale":"2024-04-25T09:03:34.003311+0000","last_undegraded":"2024-04-25T09:03:34.003311+0000","last_fullsized":"2024-04-25T09:03:34.003311+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:03.524784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092509+0000","last_change":"2024-04-25T09:03:33.013115+0000","last_active":"2024-04-25T09:03:34.092509+0000","last_peered":"2024-04-25T09:03:34.092509+0000","last_clean":"2024-04-25T09:03:34.092509+0000","last_became_active":"2024-04-25T09:03:33.012845+0000","last_became_peered":"2024-04-25T09:03:33.012845+0000","last_unstale":"2024-04-25T09:03:34.092509+0000","last_undegraded":"2024-04-25T09:03:34.092509+0000","last_fullsized":"2024-04-25T09:03:34.092509+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:54.875903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016273+0000","last_change":"2024-04-25T09:03:32.005373+0000","last_active":"2024-04-25T09:03:34.016273+0000","last_peered":"2024-04-25T09:03:34.016273+0000","last_clean":"2024-04-25T09:03:34.016273+0000","last_became_active":"2024-04-25T09:03:32.004559+0000","last_became_peered":"2024-04-25T09:03:32.004559+0000","last_unstale":"2024-04-25T09:03:34.016273+0000","last_undegraded":"2024-04-25T09:03:34.016273+0000","last_fullsized":"2024-04-25T09:03:34.016273+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:42.957137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.016675+0000","last_change":"2024-04-25T09:03:33.002690+0000","last_active":"2024-04-25T09:03:34.016675+0000","last_peered":"2024-04-25T09:03:34.016675+0000","last_clean":"2024-04-25T09:03:34.016675+0000","last_became_active":"2024-04-25T09:03:33.002349+0000","last_became_peered":"2024-04-25T09:03:33.002349+0000","last_unstale":"2024-04-25T09:03:34.016675+0000","last_undegraded":"2024-04-25T09:03:34.016675+0000","last_fullsized":"2024-04-25T09:03:34.016675+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.978874+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:14.922314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092657+0000","last_change":"2024-04-25T09:03:32.002662+0000","last_active":"2024-04-25T09:03:34.092657+0000","last_peered":"2024-04-25T09:03:34.092657+0000","last_clean":"2024-04-25T09:03:34.092657+0000","last_became_active":"2024-04-25T09:03:32.002343+0000","last_became_peered":"2024-04-25T09:03:32.002343+0000","last_unstale":"2024-04-25T09:03:34.092657+0000","last_undegraded":"2024-04-25T09:03:34.092657+0000","last_fullsized":"2024-04-25T09:03:34.092657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.974418+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.974418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:14.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.092567+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:03:34.092567+0000","last_peered":"2024-04-25T09:03:34.092567+0000","last_clean":"2024-04-25T09:03:34.092567+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:03:34.092567+0000","last_undegraded":"2024-04-25T09:03:34.092567+0000","last_fullsized":"2024-04-25T09:03:34.092567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46856,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324984,"statfs":{"total":96636764160,"available":96588783616,"internally_reserved":0,"allocated":1826816,"data_stored":1120059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50440,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321400,"statfs":{"total":96636764160,"available":96585113600,"internally_reserved":0,"allocated":1232896,"data_stored":530231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40708,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331132,"statfs":{"total":96636764160,"available":96595079168,"internally_reserved":0,"allocated":1228800,"data_stored":529649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50444,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321396,"statfs":{"total":96636764160,"available":96585109504,"internally_reserved":0,"allocated":1245184,"data_stored":531315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50448,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321392,"statfs":{"total":96636764160,"available":96585105408,"internally_reserved":0,"allocated":1241088,"data_stored":531213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50432,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321408,"statfs":{"total":96636764160,"available":96585121792,"internally_reserved":0,"allocated":1228800,"data_stored":529613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58748,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313092,"statfs":{"total":96636764160,"available":96576606208,"internally_reserved":0,"allocated":1224704,"data_stored":529579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1822720,"data_stored":1120529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:37.336 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:03:37.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:03:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.493+0000 7f98695a5640 1 Processor -- start 2024-04-25T09:03:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.493+0000 7f98695a5640 1 -- start start 2024-04-25T09:03:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f98695a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9864161e90 0x7f98640b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f98695a5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986406b790 con 0x7f986415db80 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f98695a5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986406ba70 con 0x7f98640d0df0 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f98695a5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9864162980 con 0x7f9864161e90 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f98637fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f986415db80 0x7f986415df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48650/0 (socket says 172.21.15.5:48650) 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f98637fe640 1 -- 172.21.15.5:0/3926048587 learned_addr learned my addr 172.21.15.5:0/3926048587 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f9862ffd640 1 --2- 172.21.15.5:0/3926048587 >> v2:172.21.15.80:3300/0 conn(0x7f9864161e90 0x7f98640b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f9861ffb640 1 -- 172.21.15.5:0/3926048587 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289365018 0 0) 0x7f986406b790 con 0x7f986415db80 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.494+0000 7f9861ffb640 1 -- 172.21.15.5:0/3926048587 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f984c003520 con 0x7f986415db80 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.495+0000 7f9861ffb640 1 -- 172.21.15.5:0/3926048587 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 180544288 0 0) 0x7f984c003520 con 0x7f986415db80 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.495+0000 7f9862ffd640 1 -- 172.21.15.5:0/3926048587 >> v1:172.21.15.80:6789/0 conn(0x7f98640d0df0 legacy=0x7f9864162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.495+0000 7f9862ffd640 1 -- 172.21.15.5:0/3926048587 >> v1:172.21.15.5:6789/0 conn(0x7f986415db80 legacy=0x7f986415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.495+0000 7f9862ffd640 1 -- 172.21.15.5:0/3926048587 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986406bd50 con 0x7f9864161e90 2024-04-25T09:03:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f9862ffd640 1 --2- 172.21.15.5:0/3926048587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f98640b2b50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f985c0097a0 tx=0x7f985c02a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d37fdd5d920b17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f9861ffb640 1 -- 172.21.15.5:0/3926048587 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c037070 con 0x7f9864161e90 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f9861ffb640 1 -- 172.21.15.5:0/3926048587 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c02aad0 con 0x7f9864161e90 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f9861ffb640 1 -- 172.21.15.5:0/3926048587 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540019f0 con 0x7f9864161e90 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f98695a5640 1 -- 172.21.15.5:0/3926048587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 msgr2=0x7f98640b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f98695a5640 1 --2- 172.21.15.5:0/3926048587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f98640b2b50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f985c0097a0 tx=0x7f985c02a040 comp rx=0 tx=0).stop 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f98695a5640 1 -- 172.21.15.5:0/3926048587 shutdown_connections 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f98695a5640 1 --2- 172.21.15.5:0/3926048587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f98640b2b50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f98695a5640 1 -- 172.21.15.5:0/3926048587 >> 172.21.15.5:0/3926048587 conn(0x7f98640b3580 msgr2=0x7f98640b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f98695a5640 1 -- 172.21.15.5:0/3926048587 shutdown_connections 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.496+0000 7f98695a5640 1 -- 172.21.15.5:0/3926048587 wait complete. 2024-04-25T09:03:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 Processor -- start 2024-04-25T09:03:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 -- start start 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640d0df0 0x7f986415c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415db80 0x7f986415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f986415fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864168f50 con 0x7f986415db80 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640b5e10 con 0x7f9864161e90 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.498+0000 7f98695a5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98641690d0 con 0x7f98640d0df0 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415db80 0x7f986415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415db80 0x7f986415f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55664/0 (socket says 172.21.15.5:55664) 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 -- 172.21.15.5:0/1097088326 learned_addr learned my addr 172.21.15.5:0/1097088326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f9862ffd640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640d0df0 0x7f986415c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98637fe640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f986415fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 -- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640d0df0 msgr2=0x7f986415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640d0df0 0x7f986415c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 -- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 msgr2=0x7f986415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f986415fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 -- 172.21.15.5:0/1097088326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864160ab0 con 0x7f986415db80 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98637fe640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f986415fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98627fc640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415db80 0x7f986415f6c0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f985800c570 tx=0x7f985800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f984b7fe640 1 -- 172.21.15.5:0/1097088326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858005480 con 0x7f986415db80 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f984b7fe640 1 -- 172.21.15.5:0/1097088326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98580035f0 con 0x7f986415db80 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986415c870 con 0x7f986415db80 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f984b7fe640 1 -- 172.21.15.5:0/1097088326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98580039c0 con 0x7f986415db80 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.499+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98641604f0 con 0x7f986415db80 2024-04-25T09:03:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.500+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986404ef20 con 0x7f986415db80 2024-04-25T09:03:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.501+0000 7f984b7fe640 1 -- 172.21.15.5:0/1097088326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9858003b60 con 0x7f986415db80 2024-04-25T09:03:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.501+0000 7f984b7fe640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b670 0x7f985006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.501+0000 7f984b7fe640 1 -- 172.21.15.5:0/1097088326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9858089f70 con 0x7f986415db80 2024-04-25T09:03:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.501+0000 7f9862ffd640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b670 0x7f985006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.502+0000 7f9862ffd640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b670 0x7f985006db30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f985c034000 tx=0x7f985c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.505+0000 7f984b7fe640 1 -- 172.21.15.5:0/1097088326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f985800a2e0 con 0x7f986415db80 2024-04-25T09:03:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.758+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f98640b79b0 con 0x7f986415db80 2024-04-25T09:03:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.760+0000 7f984b7fe640 1 -- 172.21.15.5:0/1097088326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9858058df0 con 0x7f986415db80 2024-04-25T09:03:37.748 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T09:03:37.748 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T09:03:37.748 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T09:03:37.748 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T09:03:37.748 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:03:37.748 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T09:03:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b670 msgr2=0x7f985006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b670 0x7f985006db30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f985c034000 tx=0x7f985c02e000 comp rx=0 tx=0).stop 2024-04-25T09:03:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415db80 msgr2=0x7f986415f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415db80 0x7f986415f6c0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f985800c570 tx=0x7f985800ca30 comp rx=0 tx=0).stop 2024-04-25T09:03:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 shutdown_connections 2024-04-25T09:03:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f985006b670 0x7f985006db30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9864161e90 0x7f986415fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f986415db80 0x7f986415f6c0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 --2- 172.21.15.5:0/1097088326 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f98640d0df0 0x7f986415c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 >> 172.21.15.5:0/1097088326 conn(0x7f98640b3580 msgr2=0x7f98640d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 shutdown_connections 2024-04-25T09:03:37.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.762+0000 7f98695a5640 1 -- 172.21.15.5:0/1097088326 wait complete. 2024-04-25T09:03:37.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:37.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.873+0000 7fbadc741640 1 Processor -- start 2024-04-25T09:03:37.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.873+0000 7fbadc741640 1 -- start start 2024-04-25T09:03:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.874+0000 7fbadc741640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbad40b45e0 0x7fbad40713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.874+0000 7fbadc741640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad406f160 con 0x7fbad4071930 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.874+0000 7fbadc741640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40b3820 con 0x7fbad40afe80 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.874+0000 7fbadc741640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40b0260 con 0x7fbad40b45e0 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbad9cdc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbad40b45e0 0x7fbad40713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbad9cdc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbad40b45e0 0x7fbad40713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55672/0 (socket says 172.21.15.5:55672) 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbadacde640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbad4071930 0x7fbad40cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48654/0 (socket says 172.21.15.5:48654) 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbad9cdc640 1 -- 172.21.15.5:0/1533526539 learned_addr learned my addr 172.21.15.5:0/1533526539 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbad9cdc640 1 -- 172.21.15.5:0/1533526539 >> v1:172.21.15.80:6789/0 conn(0x7fbad40afe80 legacy=0x7fbad406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbad9cdc640 1 -- 172.21.15.5:0/1533526539 >> v1:172.21.15.5:6789/0 conn(0x7fbad4071930 legacy=0x7fbad40cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbad9cdc640 1 -- 172.21.15.5:0/1533526539 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40b3b00 con 0x7fbad40b45e0 2024-04-25T09:03:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.875+0000 7fbad94db640 1 -- 172.21.15.5:0/1533526539 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151091528 0 0) 0x7fbad406f160 con 0x7fbad4071930 2024-04-25T09:03:37.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbad9cdc640 1 --2- 172.21.15.5:0/1533526539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b45e0 0x7fbad40713f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009870 tx=0x7fbac402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba4ddf03b3d58c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbad94db640 1 -- 172.21.15.5:0/1533526539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4037070 con 0x7fbad40b45e0 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbad94db640 1 -- 172.21.15.5:0/1533526539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac402ae50 con 0x7fbad40b45e0 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbad94db640 1 -- 172.21.15.5:0/1533526539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4032860 con 0x7fbad40b45e0 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbadc741640 1 -- 172.21.15.5:0/1533526539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b45e0 msgr2=0x7fbad40713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbadc741640 1 --2- 172.21.15.5:0/1533526539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b45e0 0x7fbad40713f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009870 tx=0x7fbac402a300 comp rx=0 tx=0).stop 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbadc741640 1 -- 172.21.15.5:0/1533526539 shutdown_connections 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbadc741640 1 --2- 172.21.15.5:0/1533526539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40b45e0 0x7fbad40713f0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbadc741640 1 -- 172.21.15.5:0/1533526539 >> 172.21.15.5:0/1533526539 conn(0x7fbad40d0870 msgr2=0x7fbad40d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbadc741640 1 -- 172.21.15.5:0/1533526539 shutdown_connections 2024-04-25T09:03:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.876+0000 7fbadc741640 1 -- 172.21.15.5:0/1533526539 wait complete. 2024-04-25T09:03:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 Processor -- start 2024-04-25T09:03:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 -- start start 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad4071930 0x7fbad4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40afe80 0x7fbad414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b45e0 0x7fbad414f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad415f2b0 con 0x7fbad40afe80 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40b40c0 con 0x7fbad40b45e0 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.878+0000 7fbadc741640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad406ed20 con 0x7fbad4071930 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40afe80 0x7fbad414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40afe80 0x7fbad414f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55686/0 (socket says 172.21.15.5:55686) 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 -- 172.21.15.5:0/706335766 learned_addr learned my addr 172.21.15.5:0/706335766 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbada4dd640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad4071930 0x7fbad4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbadacde640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b45e0 0x7fbad414f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 -- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad4071930 msgr2=0x7fbad4151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad4071930 0x7fbad4151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 -- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b45e0 msgr2=0x7fbad414f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b45e0 0x7fbad414f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 -- 172.21.15.5:0/706335766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad414fce0 con 0x7fbad40afe80 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbada4dd640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad4071930 0x7fbad4151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbadacde640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b45e0 0x7fbad414f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbad9cdc640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40afe80 0x7fbad414f100 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fbac402a340 tx=0x7fbac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbacaffd640 1 -- 172.21.15.5:0/706335766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4041070 con 0x7fbad40afe80 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbacaffd640 1 -- 172.21.15.5:0/706335766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac403c890 con 0x7fbad40afe80 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad414ffc0 con 0x7fbad40afe80 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbacaffd640 1 -- 172.21.15.5:0/706335766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4037040 con 0x7fbad40afe80 2024-04-25T09:03:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.879+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad4150580 con 0x7fbad40afe80 2024-04-25T09:03:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.880+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad404ef20 con 0x7fbad40afe80 2024-04-25T09:03:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.881+0000 7fbacaffd640 1 -- 172.21.15.5:0/706335766 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbac4044070 con 0x7fbad40afe80 2024-04-25T09:03:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.881+0000 7fbacaffd640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab806b4d0 0x7fbab806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.881+0000 7fbacaffd640 1 -- 172.21.15.5:0/706335766 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbac40aaee0 con 0x7fbad40afe80 2024-04-25T09:03:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.881+0000 7fbada4dd640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab806b4d0 0x7fbab806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.882+0000 7fbada4dd640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab806b4d0 0x7fbab806d990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007fd0 tx=0x7fbad0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:37.885+0000 7fbacaffd640 1 -- 172.21.15.5:0/706335766 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbac4079f10 con 0x7fbad40afe80 2024-04-25T09:03:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.101+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad40b2260 con 0x7fbad40afe80 2024-04-25T09:03:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.101+0000 7fbacaffd640 1 -- 172.21.15.5:0/706335766 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fbac4079810 con 0x7fbad40afe80 2024-04-25T09:03:38.089 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:38.090 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.103+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab806b4d0 msgr2=0x7fbab806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.103+0000 7fbadc741640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab806b4d0 0x7fbab806d990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007fd0 tx=0x7fbad0009040 comp rx=0 tx=0).stop 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.103+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40afe80 msgr2=0x7fbad414f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.103+0000 7fbadc741640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40afe80 0x7fbad414f100 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fbac402a340 tx=0x7fbac40046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 shutdown_connections 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab806b4d0 0x7fbab806d990 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbad40b45e0 0x7fbad414f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad40afe80 0x7fbad414f100 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 --2- 172.21.15.5:0/706335766 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbad4071930 0x7fbad4151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 >> 172.21.15.5:0/706335766 conn(0x7fbad40d0870 msgr2=0x7fbad40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 shutdown_connections 2024-04-25T09:03:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.104+0000 7fbadc741640 1 -- 172.21.15.5:0/706335766 wait complete. 2024-04-25T09:03:38.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:32.347912+0000', 'modified': '2024-04-25T09:03:35.359491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7989}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7989': {'gid': 7989, 'name': 'd', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/1087126648', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6835', 'nonce': 1087126648}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 1087126648}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:38.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:03:38.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:03:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.623+0000 7fbf56f53640 1 Processor -- start 2024-04-25T09:03:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.623+0000 7fbf56f53640 1 -- start start 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.624+0000 7fbf56f53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 0x7fbf5006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.624+0000 7fbf56f53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf500b4730 con 0x7fbf5015e120 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.624+0000 7fbf56f53640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf500d0da0 con 0x7fbf5006bbb0 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.624+0000 7fbf56f53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500cbf30 con 0x7fbf5006b7d0 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.624+0000 7fbf554f0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf5015e120 0x7fbf500ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48660/0 (socket says 172.21.15.5:48660) 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.624+0000 7fbf554f0640 1 -- 172.21.15.5:0/3274935552 learned_addr learned my addr 172.21.15.5:0/3274935552 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034895476 0 0) 0x7fbf48001490 con 0x7fbf5015e120 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf54cef640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 0x7fbf5006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf38003520 con 0x7fbf5015e120 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3675471566 0 0) 0x7fbf38003520 con 0x7fbf5015e120 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 msgr2=0x7fbf5006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 0x7fbf5006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 >> v1:172.21.15.80:6789/0 conn(0x7fbf5006bbb0 legacy=0x7fbf5015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500cc180 con 0x7fbf5015e120 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fbf48001bc0 con 0x7fbf5015e120 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 >> v1:172.21.15.5:6789/0 conn(0x7fbf5015e120 legacy=0x7fbf500ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 0x7fbf380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf38003f20 0x7fbf38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500cbf30 con 0x7fbf38004d40 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3800ba20 con 0x7fbf38003f20 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3800bc20 con 0x7fbf5006b7d0 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf554f0640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf54cef640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 0x7fbf380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf38003f20 0x7fbf38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.625+0000 7fbf554f0640 1 -- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 msgr2=0x7fbf380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf554f0640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5006b7d0 0x7fbf380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf554f0640 1 -- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf38003f20 msgr2=0x7fbf38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf554f0640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf38003f20 0x7fbf38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf554f0640 1 -- 172.21.15.5:0/3274935552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38003520 con 0x7fbf38004d40 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf554f0640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf380051c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800aa30 tx=0x7fbf38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3fe2b3b97b0c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800a650 con 0x7fbf38004d40 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4802f070 con 0x7fbf38004d40 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.626+0000 7fbf4f7fe640 1 -- 172.21.15.5:0/3274935552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4802be60 con 0x7fbf38004d40 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.627+0000 7fbf56f53640 1 -- 172.21.15.5:0/3274935552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 msgr2=0x7fbf380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.627+0000 7fbf56f53640 1 --2- 172.21.15.5:0/3274935552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf380051c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800aa30 tx=0x7fbf38005830 comp rx=0 tx=0).stop 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.627+0000 7fbf554f0640 1 -- 172.21.15.5:0/3274935552 reap_dead start 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.627+0000 7fbf56f53640 1 -- 172.21.15.5:0/3274935552 shutdown_connections 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.627+0000 7fbf56f53640 1 -- 172.21.15.5:0/3274935552 >> 172.21.15.5:0/3274935552 conn(0x7fbf500d18e0 msgr2=0x7fbf500d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.627+0000 7fbf56f53640 1 -- 172.21.15.5:0/3274935552 shutdown_connections 2024-04-25T09:03:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.627+0000 7fbf56f53640 1 -- 172.21.15.5:0/3274935552 wait complete. 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.628+0000 7fbf56f53640 1 Processor -- start 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.628+0000 7fbf56f53640 1 -- start start 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf56f53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf500ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf56f53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf5014def0 0x7fbf5015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf56f53640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5015f880 0x7fbf500b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf56f53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5006aef0 con 0x7fbf38004d40 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf56f53640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500cc7d0 con 0x7fbf5014def0 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf56f53640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5006b070 con 0x7fbf5015f880 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf500ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf500ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55714/0 (socket says 172.21.15.5:55714) 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 -- 172.21.15.5:0/1439056777 learned_addr learned my addr 172.21.15.5:0/1439056777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf554f0640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5015f880 0x7fbf500b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf5014def0 0x7fbf5015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 -- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5015f880 msgr2=0x7fbf500b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5015f880 0x7fbf500b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 -- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf5014def0 msgr2=0x7fbf5015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf5014def0 0x7fbf5015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf54cef640 1 -- 172.21.15.5:0/1439056777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf501613a0 con 0x7fbf38004d40 2024-04-25T09:03:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.629+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf5014def0 0x7fbf5015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.630+0000 7fbf54cef640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf500ca300 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fbf400119d0 tx=0x7fbf40011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.630+0000 7fbf4d7fa640 1 -- 172.21.15.5:0/1439056777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000fb50 con 0x7fbf38004d40 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.630+0000 7fbf4d7fa640 1 -- 172.21.15.5:0/1439056777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000fcf0 con 0x7fbf38004d40 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.630+0000 7fbf4d7fa640 1 -- 172.21.15.5:0/1439056777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000fea0 con 0x7fbf38004d40 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.630+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5015e5a0 con 0x7fbf38004d40 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.630+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5015ee40 con 0x7fbf38004d40 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.631+0000 7fbf4d7fa640 1 -- 172.21.15.5:0/1439056777 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbf40012040 con 0x7fbf38004d40 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.632+0000 7fbf4d7fa640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.632+0000 7fbf4d7fa640 1 -- 172.21.15.5:0/1439056777 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf4008a9a0 con 0x7fbf38004d40 2024-04-25T09:03:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.632+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.632+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf5014e2d0 tx=0x7fbf44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.633+0000 7fbf59c52740 1 Processor -- start 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.633+0000 7fbf59c52740 1 -- start start 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.633+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c44f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.633+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c46d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c424f10 0x55ff5c46b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf59c52740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c387a10 con 0x55ff5c44f230 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c330b30 con 0x55ff5c46cad0 2024-04-25T09:03:38.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c383c50 con 0x55ff5c424f10 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c44f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c44f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55724/0 (socket says 172.21.15.5:55724) 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 -- 172.21.15.5:0/594429110 learned_addr learned my addr 172.21.15.5:0/594429110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c46d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf554f0640 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c424f10 0x55ff5c46b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 -- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c424f10 msgr2=0x55ff5c46b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c424f10 0x55ff5c46b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 -- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 msgr2=0x55ff5c46d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c46d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 -- 172.21.15.5:0/594429110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff5c345e10 con 0x55ff5c44f230 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf554f0640 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c424f10 0x55ff5c46b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf54cef640 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c44f610 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fbf40061300 tx=0x7fbf40059900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2535b2083ba037c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf367fc640 1 -- 172.21.15.5:0/594429110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40061830 con 0x55ff5c44f230 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf367fc640 1 -- 172.21.15.5:0/594429110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40087070 con 0x55ff5c44f230 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.634+0000 7fbf367fc640 1 -- 172.21.15.5:0/594429110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40055700 con 0x55ff5c44f230 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 -- 172.21.15.5:0/594429110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 msgr2=0x55ff5c44f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c44f610 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fbf40061300 tx=0x7fbf40059900 comp rx=0 tx=0).stop 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 -- 172.21.15.5:0/594429110 shutdown_connections 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c424f10 0x55ff5c46b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c46d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 --2- 172.21.15.5:0/594429110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c44f610 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 -- 172.21.15.5:0/594429110 >> 172.21.15.5:0/594429110 conn(0x55ff5c421840 msgr2=0x55ff5c46a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 -- 172.21.15.5:0/594429110 shutdown_connections 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 -- 172.21.15.5:0/594429110 wait complete. 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.635+0000 7fbf59c52740 1 -- start start 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 1 Processor -- start 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44f230 0x55ff5c462c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c46cad0 0x55ff5c4528f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c43d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c425cb0 con 0x55ff5c46cad0 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c3440c0 con 0x55ff5c44e560 2024-04-25T09:03:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c41f770 con 0x55ff5c44f230 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.636+0000 7fbf59c52740 10 client.0 _ll_register_callbacks cb 0x55ff5c337ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c46cad0 0x55ff5c4528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c46cad0 0x55ff5c4528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55726/0 (socket says 172.21.15.5:55726) 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 -- 172.21.15.5:0/3447102830 learned_addr learned my addr 172.21.15.5:0/3447102830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf554f0640 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c43d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf54cef640 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44f230 0x55ff5c462c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 -- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44f230 msgr2=0x55ff5c462c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44f230 0x55ff5c462c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 -- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 msgr2=0x55ff5c43d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c43d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 -- 172.21.15.5:0/3447102830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff5c09c2d0 con 0x55ff5c46cad0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c46cad0 0x55ff5c4528f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbf44001e40 tx=0x7fbf44007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71880d02effe0891 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/3447102830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44021780 con 0x55ff5c46cad0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/3447102830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf44021920 con 0x55ff5c46cad0 2024-04-25T09:03:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf40087070 con 0x55ff5c46cad0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/3447102830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf44014e50 con 0x55ff5c46cad0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf59c52740 10 client.8118 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.637+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55ff5c1666b0 con 0x55ff5c46cad0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/3447102830 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40087070 con 0x55ff5c46cad0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/3447102830 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbf44021b60 con 0x55ff5c46cad0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf59c52740 10 client.8118 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf59c52740 10 client.8118 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf59c52740 20 client.8118 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf59c52740 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c4614a0 0x55ff5c461880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf59c52740 4 client.8118 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff5c3e6920 con 0x55ff5c4614a0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf54cef640 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c4614a0 0x55ff5c461880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf54cef640 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c4614a0 0x55ff5c461880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bea7e14504eb6c7 server_cookie=dc2d4f2ad49f55c4 in_seq=0 out_seq=0 2024-04-25T09:03:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.638+0000 7fbf2f7fe640 10 client.8118 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/3447102830 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff5c3e6920 con 0x55ff5c4614a0 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf2f7fe640 10 client.8118 handle_command_reply: tid=0 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 client.8118 shutdown 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c46cad0 msgr2=0x55ff5c4528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c46cad0 0x55ff5c4528f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbf44001e40 tx=0x7fbf44007ca0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 shutdown_connections 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c43d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c46cad0 0x55ff5c4528f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c4614a0 0x55ff5c461880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 --2- 172.21.15.5:0/3447102830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44f230 0x55ff5c462c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 >> 172.21.15.5:0/3447102830 conn(0x55ff5c424f10 msgr2=0x55ff5c46de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.639+0000 7fbf2f7fe640 0 client.8118 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.640+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 shutdown_connections 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.640+0000 7fbf59c52740 1 -- 172.21.15.5:0/3447102830 wait complete. 2024-04-25T09:03:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.640+0000 7fbf59c52740 20 client.8118 trim_cache size 0 max 16384 2024-04-25T09:03:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.655+0000 7fbf59c52740 1 Processor -- start 2024-04-25T09:03:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf59c52740 1 -- start start 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c4266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c4254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c46cad0 0x55ff5c4613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf59c52740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf501ffa30 con 0x55ff5c44f230 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50160d10 con 0x55ff5c44e560 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf501ff460 con 0x55ff5c46cad0 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c4254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c4254e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55734/0 (socket says 172.21.15.5:55734) 2024-04-25T09:03:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf4ffff640 1 -- 172.21.15.5:0/2555295745 learned_addr learned my addr 172.21.15.5:0/2555295745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf554f0640 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c46cad0 0x55ff5c4613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.656+0000 7fbf54cef640 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c4266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf4ffff640 1 -- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c46cad0 msgr2=0x55ff5c4613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c46cad0 0x55ff5c4613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf4ffff640 1 -- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 msgr2=0x55ff5c4266c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c4266c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf4ffff640 1 -- 172.21.15.5:0/2555295745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff5c41a140 con 0x55ff5c44f230 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf54cef640 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c4266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c4254e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fbf44007ce0 tx=0x7fbf4401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9702bf200ed5bf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf35ffb640 1 -- 172.21.15.5:0/2555295745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4403d070 con 0x55ff5c44f230 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf35ffb640 1 -- 172.21.15.5:0/2555295745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44014e50 con 0x55ff5c44f230 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf35ffb640 1 -- 172.21.15.5:0/2555295745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44001910 con 0x55ff5c44f230 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf59c52740 1 -- 172.21.15.5:0/2555295745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 msgr2=0x55ff5c4254e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf59c52740 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c4254e0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fbf44007ce0 tx=0x7fbf4401c000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf59c52740 1 -- 172.21.15.5:0/2555295745 shutdown_connections 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf59c52740 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c46cad0 0x55ff5c4613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf59c52740 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c4254e0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf59c52740 1 --2- 172.21.15.5:0/2555295745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c44e560 0x55ff5c4266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.657+0000 7fbf59c52740 1 -- 172.21.15.5:0/2555295745 >> 172.21.15.5:0/2555295745 conn(0x55ff5c424f10 msgr2=0x55ff5c43dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.658+0000 7fbf59c52740 1 -- 172.21.15.5:0/2555295745 shutdown_connections 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.658+0000 7fbf59c52740 1 -- 172.21.15.5:0/2555295745 wait complete. 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.658+0000 7fbf59c52740 1 -- start start 2024-04-25T09:03:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.658+0000 7fbf59c52740 1 Processor -- start 2024-04-25T09:03:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44e560 0x55ff5c461f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c470720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf59c52740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c4bc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf59c52740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c464020 con 0x55ff5c44f230 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c463ca0 con 0x55ff5c46cad0 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf59c52740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff5c464b10 con 0x55ff5c44e560 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf59c52740 10 client.0 _ll_register_callbacks cb 0x55ff5c41fc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c470720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c470720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55742/0 (socket says 172.21.15.5:55742) 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf4ffff640 1 -- 172.21.15.5:0/939538058 learned_addr learned my addr 172.21.15.5:0/939538058 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf54cef640 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44e560 0x55ff5c461f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf554f0640 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c4bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf4ffff640 1 -- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44e560 msgr2=0x55ff5c461f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44e560 0x55ff5c461f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf4ffff640 1 -- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 msgr2=0x55ff5c4bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.659+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c4bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf4ffff640 1 -- 172.21.15.5:0/939538058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff5c4bc9a0 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf4ffff640 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c470720 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fbf4403b040 tx=0x7fbf44015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357e0193f13beaf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/939538058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44047060 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/939538058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf44024720 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf44014e50 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/939538058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf4403d040 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 10 client.8124 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55ff5c465aa0 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/939538058 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44014e50 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/939538058 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbf440240c0 con 0x55ff5c44f230 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 10 client.8124 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 10 client.8124 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 20 client.8124 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c46d810 0x55ff5c46dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 4 client.8124 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.660+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ff5c394f50 con 0x55ff5c46d810 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf54cef640 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c46d810 0x55ff5c46dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf54cef640 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c46d810 0x55ff5c46dbf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=523e0655832cf02c server_cookie=954a4d29acf930d2 in_seq=0 out_seq=0 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf2f7fe640 10 client.8124 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf2f7fe640 1 -- 172.21.15.5:0/939538058 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55ff5c394f50 con 0x55ff5c46d810 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf2f7fe640 10 client.8124 handle_command_reply: tid=0 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 client.8124 shutdown 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 msgr2=0x55ff5c470720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c470720 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fbf4403b040 tx=0x7fbf44015000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 shutdown_connections 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ff5c46cad0 0x55ff5c4bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff5c44f230 0x55ff5c470720 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55ff5c46d810 0x55ff5c46dbf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 --2- 172.21.15.5:0/939538058 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55ff5c44e560 0x55ff5c461f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf2f7fe640 0 client.8124 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 >> 172.21.15.5:0/939538058 conn(0x55ff5c424f10 msgr2=0x55ff5c426510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 shutdown_connections 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.661+0000 7fbf59c52740 1 -- 172.21.15.5:0/939538058 wait complete. 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf59c52740 20 client.8124 trim_cache size 0 max 16384 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7989, 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.655711384, 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 63, 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 99, 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 99, 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.687580730000001 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbf3c06b4d0 msgr2=0x7fbf3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf5014e2d0 tx=0x7fbf44009040 comp rx=0 tx=0).stop 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 msgr2=0x7fbf500ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf500ca300 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fbf400119d0 tx=0x7fbf40011e90 comp rx=0 tx=0).stop 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 shutdown_connections 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbf5015f880 0x7fbf500b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf5014def0 0x7fbf5015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 --2- 172.21.15.5:0/1439056777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38004d40 0x7fbf500ca300 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 >> 172.21.15.5:0/1439056777 conn(0x7fbf500d18e0 msgr2=0x7fbf500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 shutdown_connections 2024-04-25T09:03:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.662+0000 7fbf56f53640 1 -- 172.21.15.5:0/1439056777 wait complete. 2024-04-25T09:03:38.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.774+0000 7f8a761c1640 1 Processor -- start 2024-04-25T09:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.774+0000 7f8a761c1640 1 -- start start 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a761c1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a700b2cc0 0x7f8a700b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a761c1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700d20e0 con 0x7f8a7015de70 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a761c1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700d23c0 con 0x7f8a700b7130 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a761c1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700d2a10 con 0x7f8a700b2cc0 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a7015de70 0x7f8a700b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48666/0 (socket says 172.21.15.5:48666) 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6f7fe640 1 -- 172.21.15.5:0/1674564254 learned_addr learned my addr 172.21.15.5:0/1674564254 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6effd640 1 --2- 172.21.15.5:0/1674564254 >> v2:172.21.15.80:3300/0 conn(0x7f8a700b2cc0 0x7f8a700b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6e7fc640 1 -- 172.21.15.5:0/1674564254 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919658826 0 0) 0x7f8a700d20e0 con 0x7f8a7015de70 2024-04-25T09:03:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6e7fc640 1 -- 172.21.15.5:0/1674564254 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a58003520 con 0x7f8a7015de70 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6effd640 1 -- 172.21.15.5:0/1674564254 >> v1:172.21.15.80:6789/0 conn(0x7f8a700b7130 legacy=0x7f8a700ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6effd640 1 -- 172.21.15.5:0/1674564254 >> v1:172.21.15.5:6789/0 conn(0x7f8a7015de70 legacy=0x7f8a700b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.775+0000 7f8a6effd640 1 -- 172.21.15.5:0/1674564254 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700d26a0 con 0x7f8a700b2cc0 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.776+0000 7f8a6effd640 1 --2- 172.21.15.5:0/1674564254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 0x7f8a700b6bf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a600097d0 tx=0x7f8a6002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7462de733c6b2784 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.776+0000 7f8a6e7fc640 1 -- 172.21.15.5:0/1674564254 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60037070 con 0x7f8a700b2cc0 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.776+0000 7f8a6e7fc640 1 -- 172.21.15.5:0/1674564254 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60032440 con 0x7f8a700b2cc0 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.776+0000 7f8a6e7fc640 1 -- 172.21.15.5:0/1674564254 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a600327f0 con 0x7f8a700b2cc0 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.777+0000 7f8a761c1640 1 -- 172.21.15.5:0/1674564254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 msgr2=0x7f8a700b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.777+0000 7f8a761c1640 1 --2- 172.21.15.5:0/1674564254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 0x7f8a700b6bf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a600097d0 tx=0x7f8a6002a270 comp rx=0 tx=0).stop 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.777+0000 7f8a761c1640 1 -- 172.21.15.5:0/1674564254 shutdown_connections 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.777+0000 7f8a761c1640 1 --2- 172.21.15.5:0/1674564254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 0x7f8a700b6bf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.777+0000 7f8a761c1640 1 -- 172.21.15.5:0/1674564254 >> 172.21.15.5:0/1674564254 conn(0x7f8a7006b000 msgr2=0x7f8a7006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.777+0000 7f8a761c1640 1 -- 172.21.15.5:0/1674564254 shutdown_connections 2024-04-25T09:03:38.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.777+0000 7f8a761c1640 1 -- 172.21.15.5:0/1674564254 wait complete. 2024-04-25T09:03:38.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.778+0000 7f8a761c1640 1 Processor -- start 2024-04-25T09:03:38.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.778+0000 7f8a761c1640 1 -- start start 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a761c1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 0x7f8a700c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a761c1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8a700b7130 0x7f8a7014e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a761c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7015de70 0x7f8a701f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a761c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700d2ea0 con 0x7f8a7015de70 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a761c1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700cf110 con 0x7f8a700b2cc0 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a761c1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700d3020 con 0x7f8a700b7130 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7015de70 0x7f8a701f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7015de70 0x7f8a701f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55750/0 (socket says 172.21.15.5:55750) 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 -- 172.21.15.5:0/2365412338 learned_addr learned my addr 172.21.15.5:0/2365412338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6f7fe640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 0x7f8a700c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6effd640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8a700b7130 0x7f8a7014e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 -- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8a700b7130 msgr2=0x7f8a7014e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8a700b7130 0x7f8a7014e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 -- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 msgr2=0x7f8a700c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 0x7f8a700c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.779+0000 7f8a6ffff640 1 -- 172.21.15.5:0/2365412338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700cc200 con 0x7f8a7015de70 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.780+0000 7f8a6ffff640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7015de70 0x7f8a701f38d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800c730 tx=0x7f8a6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.780+0000 7f8a57fff640 1 -- 172.21.15.5:0/2365412338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68003b70 con 0x7f8a7015de70 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.780+0000 7f8a57fff640 1 -- 172.21.15.5:0/2365412338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68003d10 con 0x7f8a7015de70 2024-04-25T09:03:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.780+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a700cc4e0 con 0x7f8a7015de70 2024-04-25T09:03:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.780+0000 7f8a57fff640 1 -- 172.21.15.5:0/2365412338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800aa90 con 0x7f8a7015de70 2024-04-25T09:03:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.780+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a700ccaa0 con 0x7f8a7015de70 2024-04-25T09:03:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.781+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7004ef20 con 0x7f8a7015de70 2024-04-25T09:03:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.781+0000 7f8a57fff640 1 -- 172.21.15.5:0/2365412338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a6800ac30 con 0x7f8a7015de70 2024-04-25T09:03:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.782+0000 7f8a57fff640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a5c06b4d0 0x7f8a5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.782+0000 7f8a57fff640 1 -- 172.21.15.5:0/2365412338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a68089f10 con 0x7f8a7015de70 2024-04-25T09:03:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.782+0000 7f8a6f7fe640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a5c06b4d0 0x7f8a5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.783+0000 7f8a6f7fe640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a5c06b4d0 0x7f8a5c06d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8a640011e0 tx=0x7f8a64007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:38.786+0000 7f8a57fff640 1 -- 172.21.15.5:0/2365412338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a680587d0 con 0x7f8a7015de70 2024-04-25T09:03:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.007+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8a7006b560 con 0x7f8a7015de70 2024-04-25T09:03:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.007+0000 7f8a57fff640 1 -- 172.21.15.5:0/2365412338 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8a6805c870 con 0x7f8a7015de70 2024-04-25T09:03:38.995 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:03:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a5c06b4d0 msgr2=0x7f8a5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a5c06b4d0 0x7f8a5c06d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8a640011e0 tx=0x7f8a64007d30 comp rx=0 tx=0).stop 2024-04-25T09:03:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7015de70 msgr2=0x7f8a701f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7015de70 0x7f8a701f38d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800c730 tx=0x7f8a6800cbf0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 shutdown_connections 2024-04-25T09:03:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8a5c06b4d0 0x7f8a5c06d990 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7015de70 0x7f8a701f38d0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8a700b7130 0x7f8a7014e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 --2- 172.21.15.5:0/2365412338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a700b2cc0 0x7f8a700c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 >> 172.21.15.5:0/2365412338 conn(0x7f8a7006b000 msgr2=0x7f8a7015e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 shutdown_connections 2024-04-25T09:03:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:39.009+0000 7f8a761c1640 1 -- 172.21.15.5:0/2365412338 wait complete. 2024-04-25T09:03:39.008 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:03:39.008 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:39.008 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:03:39.008 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:03:39.008 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.008 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:03:39.009 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:03:39.009 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:39.009 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.009 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:03:39.024 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42341sec preferred_lft 42341sec 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:03:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.029 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:39.087 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:03:39.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.089 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:03:39.145 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:03:39.146 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:39.146 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:03:39.146 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:03:39.146 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:39.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.146 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:03:39.146 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:39.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:03:39.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:03:39.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:03:39.147 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:39.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.231 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:03:39.245 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:03:39.246 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:03:39.246 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:03:39.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:39.310 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.365 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.365 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:39.365 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.420 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:03:39.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:03:39.503 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:03:39.503 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:03:39.510 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:03:39.510 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:03:39.510 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:03:39.510 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:03:39.510 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:03:39.511 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:03:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:03:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:03:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:03:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:03:39.513 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:39.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.579 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:39.642 INFO:teuthology.orchestra.run.smithi005.stdout:client7264 2024-04-25T09:03:39.643 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:03:39.643 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:39.698 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.698 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-04-25T09:03:39.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:39.699 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:39.699 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:03:39.699 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:39.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:39.699 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:39.699 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954062 s, 110 MB/s 2024-04-25T09:03:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871464 s, 120 MB/s 2024-04-25T09:03:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083794 s, 125 MB/s 2024-04-25T09:03:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077139 s, 136 MB/s 2024-04-25T09:03:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852465 s, 123 MB/s 2024-04-25T09:03:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827234 s, 127 MB/s 2024-04-25T09:03:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692797 s, 151 MB/s 2024-04-25T09:03:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760717 s, 138 MB/s 2024-04-25T09:03:39.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659402 s, 159 MB/s 2024-04-25T09:03:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854444 s, 123 MB/s 2024-04-25T09:03:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709553 s, 148 MB/s 2024-04-25T09:03:39.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737385 s, 142 MB/s 2024-04-25T09:03:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077209 s, 136 MB/s 2024-04-25T09:03:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749707 s, 140 MB/s 2024-04-25T09:03:39.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779688 s, 134 MB/s 2024-04-25T09:03:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792569 s, 132 MB/s 2024-04-25T09:03:39.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722385 s, 145 MB/s 2024-04-25T09:03:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693891 s, 151 MB/s 2024-04-25T09:03:39.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755726 s, 139 MB/s 2024-04-25T09:03:39.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767332 s, 137 MB/s 2024-04-25T09:03:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770165 s, 136 MB/s 2024-04-25T09:03:39.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736453 s, 142 MB/s 2024-04-25T09:03:39.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858713 s, 122 MB/s 2024-04-25T09:03:39.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929796 s, 113 MB/s 2024-04-25T09:03:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.984 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669376 s, 157 MB/s 2024-04-25T09:03:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:39.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723185 s, 145 MB/s 2024-04-25T09:03:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00814203 s, 129 MB/s 2024-04-25T09:03:40.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765188 s, 137 MB/s 2024-04-25T09:03:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781594 s, 134 MB/s 2024-04-25T09:03:40.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678446 s, 155 MB/s 2024-04-25T09:03:40.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710949 s, 147 MB/s 2024-04-25T09:03:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681849 s, 154 MB/s 2024-04-25T09:03:40.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.042 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:40.042 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:40.043 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:03:40.043 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:40.043 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:40.043 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:40.043 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:40.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691943 s, 152 MB/s 2024-04-25T09:03:40.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676516 s, 155 MB/s 2024-04-25T09:03:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692463 s, 151 MB/s 2024-04-25T09:03:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704031 s, 149 MB/s 2024-04-25T09:03:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770891 s, 136 MB/s 2024-04-25T09:03:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796891 s, 132 MB/s 2024-04-25T09:03:40.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721355 s, 145 MB/s 2024-04-25T09:03:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669397 s, 157 MB/s 2024-04-25T09:03:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071043 s, 148 MB/s 2024-04-25T09:03:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691372 s, 152 MB/s 2024-04-25T09:03:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706012 s, 149 MB/s 2024-04-25T09:03:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729204 s, 144 MB/s 2024-04-25T09:03:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714324 s, 147 MB/s 2024-04-25T09:03:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745767 s, 141 MB/s 2024-04-25T09:03:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692767 s, 151 MB/s 2024-04-25T09:03:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676698 s, 155 MB/s 2024-04-25T09:03:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694228 s, 151 MB/s 2024-04-25T09:03:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687542 s, 153 MB/s 2024-04-25T09:03:40.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078812 s, 133 MB/s 2024-04-25T09:03:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748783 s, 140 MB/s 2024-04-25T09:03:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749578 s, 140 MB/s 2024-04-25T09:03:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780169 s, 134 MB/s 2024-04-25T09:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760108 s, 138 MB/s 2024-04-25T09:03:40.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674476 s, 155 MB/s 2024-04-25T09:03:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.302 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696876 s, 150 MB/s 2024-04-25T09:03:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655202 s, 160 MB/s 2024-04-25T09:03:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683138 s, 153 MB/s 2024-04-25T09:03:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684073 s, 153 MB/s 2024-04-25T09:03:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779642 s, 134 MB/s 2024-04-25T09:03:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736916 s, 142 MB/s 2024-04-25T09:03:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732722 s, 143 MB/s 2024-04-25T09:03:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684013 s, 153 MB/s 2024-04-25T09:03:40.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.361 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:40.361 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:40.361 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:03:40.361 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:40.361 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:40.361 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:40.362 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916806 s, 114 MB/s 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734988 s, 143 MB/s 2024-04-25T09:03:40.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847564 s, 124 MB/s 2024-04-25T09:03:40.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853374 s, 123 MB/s 2024-04-25T09:03:40.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700423 s, 150 MB/s 2024-04-25T09:03:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744519 s, 141 MB/s 2024-04-25T09:03:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678716 s, 154 MB/s 2024-04-25T09:03:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697816 s, 150 MB/s 2024-04-25T09:03:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728337 s, 144 MB/s 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632913 s, 166 MB/s 2024-04-25T09:03:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727545 s, 144 MB/s 2024-04-25T09:03:40.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.518 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633177 s, 166 MB/s 2024-04-25T09:03:40.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739684 s, 142 MB/s 2024-04-25T09:03:40.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728741 s, 144 MB/s 2024-04-25T09:03:40.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682741 s, 154 MB/s 2024-04-25T09:03:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727681 s, 144 MB/s 2024-04-25T09:03:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725345 s, 145 MB/s 2024-04-25T09:03:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637132 s, 165 MB/s 2024-04-25T09:03:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676627 s, 155 MB/s 2024-04-25T09:03:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729301 s, 144 MB/s 2024-04-25T09:03:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673629 s, 156 MB/s 2024-04-25T09:03:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732512 s, 143 MB/s 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739485 s, 142 MB/s 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683843 s, 153 MB/s 2024-04-25T09:03:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773229 s, 136 MB/s 2024-04-25T09:03:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712498 s, 147 MB/s 2024-04-25T09:03:40.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.638 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669731 s, 157 MB/s 2024-04-25T09:03:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667345 s, 157 MB/s 2024-04-25T09:03:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789492 s, 133 MB/s 2024-04-25T09:03:40.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699053 s, 150 MB/s 2024-04-25T09:03:40.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762646 s, 137 MB/s 2024-04-25T09:03:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730616 s, 144 MB/s 2024-04-25T09:03:40.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:40.681 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:40.681 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:03:40.681 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:40.681 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:40.681 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:40.681 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:40.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684053 s, 153 MB/s 2024-04-25T09:03:40.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066681 s, 157 MB/s 2024-04-25T09:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723883 s, 145 MB/s 2024-04-25T09:03:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787898 s, 133 MB/s 2024-04-25T09:03:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702846 s, 149 MB/s 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664816 s, 158 MB/s 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665837 s, 157 MB/s 2024-04-25T09:03:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766209 s, 137 MB/s 2024-04-25T09:03:40.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774555 s, 135 MB/s 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750648 s, 140 MB/s 2024-04-25T09:03:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639492 s, 164 MB/s 2024-04-25T09:03:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690372 s, 152 MB/s 2024-04-25T09:03:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660057 s, 159 MB/s 2024-04-25T09:03:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720034 s, 146 MB/s 2024-04-25T09:03:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779331 s, 135 MB/s 2024-04-25T09:03:40.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715686 s, 147 MB/s 2024-04-25T09:03:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729305 s, 144 MB/s 2024-04-25T09:03:40.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064345 s, 163 MB/s 2024-04-25T09:03:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630862 s, 166 MB/s 2024-04-25T09:03:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684043 s, 153 MB/s 2024-04-25T09:03:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728683 s, 144 MB/s 2024-04-25T09:03:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674063 s, 156 MB/s 2024-04-25T09:03:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855437 s, 123 MB/s 2024-04-25T09:03:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698828 s, 150 MB/s 2024-04-25T09:03:40.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666671 s, 157 MB/s 2024-04-25T09:03:40.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781914 s, 134 MB/s 2024-04-25T09:03:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661531 s, 159 MB/s 2024-04-25T09:03:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745646 s, 141 MB/s 2024-04-25T09:03:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067618 s, 155 MB/s 2024-04-25T09:03:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635571 s, 165 MB/s 2024-04-25T09:03:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757601 s, 138 MB/s 2024-04-25T09:03:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763991 s, 137 MB/s 2024-04-25T09:03:40.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.995 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:40.995 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:40.995 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:03:40.995 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:40.995 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:40.995 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:40.996 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:41.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768165 s, 137 MB/s 2024-04-25T09:03:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076134 s, 138 MB/s 2024-04-25T09:03:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744647 s, 141 MB/s 2024-04-25T09:03:41.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649359 s, 161 MB/s 2024-04-25T09:03:41.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706322 s, 148 MB/s 2024-04-25T09:03:41.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679298 s, 154 MB/s 2024-04-25T09:03:41.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766494 s, 137 MB/s 2024-04-25T09:03:41.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664029 s, 158 MB/s 2024-04-25T09:03:41.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007016 s, 149 MB/s 2024-04-25T09:03:41.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718873 s, 146 MB/s 2024-04-25T09:03:41.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692539 s, 151 MB/s 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772181 s, 136 MB/s 2024-04-25T09:03:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647375 s, 162 MB/s 2024-04-25T09:03:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716454 s, 146 MB/s 2024-04-25T09:03:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709408 s, 148 MB/s 2024-04-25T09:03:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699648 s, 150 MB/s 2024-04-25T09:03:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769614 s, 136 MB/s 2024-04-25T09:03:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671963 s, 156 MB/s 2024-04-25T09:03:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791408 s, 132 MB/s 2024-04-25T09:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750141 s, 140 MB/s 2024-04-25T09:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067971 s, 154 MB/s 2024-04-25T09:03:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653289 s, 161 MB/s 2024-04-25T09:03:41.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062584 s, 168 MB/s 2024-04-25T09:03:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736066 s, 142 MB/s 2024-04-25T09:03:41.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862758 s, 122 MB/s 2024-04-25T09:03:41.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066996 s, 157 MB/s 2024-04-25T09:03:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006787 s, 154 MB/s 2024-04-25T09:03:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825123 s, 127 MB/s 2024-04-25T09:03:41.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753621 s, 139 MB/s 2024-04-25T09:03:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717819 s, 146 MB/s 2024-04-25T09:03:41.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707051 s, 148 MB/s 2024-04-25T09:03:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723407 s, 145 MB/s 2024-04-25T09:03:41.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:41.314 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:41.314 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:41.315 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:03:41.315 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:41.315 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:41.315 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:41.315 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068198 s, 154 MB/s 2024-04-25T09:03:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689108 s, 152 MB/s 2024-04-25T09:03:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725696 s, 144 MB/s 2024-04-25T09:03:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757902 s, 138 MB/s 2024-04-25T09:03:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084711 s, 124 MB/s 2024-04-25T09:03:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877391 s, 120 MB/s 2024-04-25T09:03:41.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748698 s, 140 MB/s 2024-04-25T09:03:41.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659313 s, 159 MB/s 2024-04-25T09:03:41.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745611 s, 141 MB/s 2024-04-25T09:03:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735486 s, 143 MB/s 2024-04-25T09:03:41.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690569 s, 152 MB/s 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730107 s, 144 MB/s 2024-04-25T09:03:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072564 s, 145 MB/s 2024-04-25T09:03:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765185 s, 137 MB/s 2024-04-25T09:03:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712237 s, 147 MB/s 2024-04-25T09:03:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687973 s, 152 MB/s 2024-04-25T09:03:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663065 s, 158 MB/s 2024-04-25T09:03:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755702 s, 139 MB/s 2024-04-25T09:03:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670855 s, 156 MB/s 2024-04-25T09:03:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657907 s, 159 MB/s 2024-04-25T09:03:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727734 s, 144 MB/s 2024-04-25T09:03:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692021 s, 152 MB/s 2024-04-25T09:03:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680874 s, 154 MB/s 2024-04-25T09:03:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693478 s, 151 MB/s 2024-04-25T09:03:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672631 s, 156 MB/s 2024-04-25T09:03:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071536 s, 147 MB/s 2024-04-25T09:03:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072432 s, 145 MB/s 2024-04-25T09:03:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690235 s, 152 MB/s 2024-04-25T09:03:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744969 s, 141 MB/s 2024-04-25T09:03:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722574 s, 145 MB/s 2024-04-25T09:03:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756664 s, 139 MB/s 2024-04-25T09:03:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650036 s, 161 MB/s 2024-04-25T09:03:41.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:41.632 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:41.632 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:41.632 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:03:41.632 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:41.632 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:41.632 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:41.632 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751799 s, 139 MB/s 2024-04-25T09:03:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741443 s, 141 MB/s 2024-04-25T09:03:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664483 s, 158 MB/s 2024-04-25T09:03:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699916 s, 150 MB/s 2024-04-25T09:03:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681673 s, 154 MB/s 2024-04-25T09:03:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720705 s, 145 MB/s 2024-04-25T09:03:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735432 s, 143 MB/s 2024-04-25T09:03:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745054 s, 141 MB/s 2024-04-25T09:03:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743725 s, 141 MB/s 2024-04-25T09:03:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728698 s, 144 MB/s 2024-04-25T09:03:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655018 s, 160 MB/s 2024-04-25T09:03:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717186 s, 146 MB/s 2024-04-25T09:03:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636825 s, 165 MB/s 2024-04-25T09:03:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753467 s, 139 MB/s 2024-04-25T09:03:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721525 s, 145 MB/s 2024-04-25T09:03:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066831 s, 157 MB/s 2024-04-25T09:03:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745469 s, 141 MB/s 2024-04-25T09:03:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747839 s, 140 MB/s 2024-04-25T09:03:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750999 s, 140 MB/s 2024-04-25T09:03:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638999 s, 164 MB/s 2024-04-25T09:03:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630379 s, 166 MB/s 2024-04-25T09:03:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723944 s, 145 MB/s 2024-04-25T09:03:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737495 s, 142 MB/s 2024-04-25T09:03:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650596 s, 161 MB/s 2024-04-25T09:03:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693874 s, 151 MB/s 2024-04-25T09:03:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738508 s, 142 MB/s 2024-04-25T09:03:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738559 s, 142 MB/s 2024-04-25T09:03:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710399 s, 148 MB/s 2024-04-25T09:03:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758534 s, 138 MB/s 2024-04-25T09:03:41.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.929 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659976 s, 159 MB/s 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747788 s, 140 MB/s 2024-04-25T09:03:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:41.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:41.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758979 s, 138 MB/s 2024-04-25T09:03:41.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:41.947 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:41.947 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:41.947 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:03:41.947 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:41.947 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:41.947 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:41.947 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763819 s, 137 MB/s 2024-04-25T09:03:42.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068433 s, 153 MB/s 2024-04-25T09:03:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067566 s, 155 MB/s 2024-04-25T09:03:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631764 s, 166 MB/s 2024-04-25T09:03:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713085 s, 147 MB/s 2024-04-25T09:03:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639753 s, 164 MB/s 2024-04-25T09:03:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640309 s, 164 MB/s 2024-04-25T09:03:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737538 s, 142 MB/s 2024-04-25T09:03:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858954 s, 122 MB/s 2024-04-25T09:03:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673867 s, 156 MB/s 2024-04-25T09:03:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.091 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652971 s, 161 MB/s 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663956 s, 158 MB/s 2024-04-25T09:03:42.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764012 s, 137 MB/s 2024-04-25T09:03:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684088 s, 153 MB/s 2024-04-25T09:03:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074656 s, 140 MB/s 2024-04-25T09:03:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777842 s, 135 MB/s 2024-04-25T09:03:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705216 s, 149 MB/s 2024-04-25T09:03:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851069 s, 123 MB/s 2024-04-25T09:03:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641349 s, 163 MB/s 2024-04-25T09:03:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745699 s, 141 MB/s 2024-04-25T09:03:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665754 s, 158 MB/s 2024-04-25T09:03:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738743 s, 142 MB/s 2024-04-25T09:03:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762099 s, 138 MB/s 2024-04-25T09:03:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763104 s, 137 MB/s 2024-04-25T09:03:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653959 s, 160 MB/s 2024-04-25T09:03:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.212 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695703 s, 151 MB/s 2024-04-25T09:03:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790721 s, 133 MB/s 2024-04-25T09:03:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686059 s, 153 MB/s 2024-04-25T09:03:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727174 s, 144 MB/s 2024-04-25T09:03:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744033 s, 141 MB/s 2024-04-25T09:03:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063457 s, 165 MB/s 2024-04-25T09:03:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711297 s, 147 MB/s 2024-04-25T09:03:42.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:42.262 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:42.262 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:42.262 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:03:42.262 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:42.262 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:42.262 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:42.262 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753226 s, 139 MB/s 2024-04-25T09:03:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640517 s, 164 MB/s 2024-04-25T09:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729335 s, 144 MB/s 2024-04-25T09:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690533 s, 152 MB/s 2024-04-25T09:03:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725199 s, 145 MB/s 2024-04-25T09:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703802 s, 149 MB/s 2024-04-25T09:03:42.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713048 s, 147 MB/s 2024-04-25T09:03:42.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734731 s, 143 MB/s 2024-04-25T09:03:42.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687749 s, 152 MB/s 2024-04-25T09:03:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729316 s, 144 MB/s 2024-04-25T09:03:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742193 s, 141 MB/s 2024-04-25T09:03:42.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649326 s, 161 MB/s 2024-04-25T09:03:42.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759085 s, 138 MB/s 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732383 s, 143 MB/s 2024-04-25T09:03:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724931 s, 145 MB/s 2024-04-25T09:03:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713309 s, 147 MB/s 2024-04-25T09:03:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731499 s, 143 MB/s 2024-04-25T09:03:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711669 s, 147 MB/s 2024-04-25T09:03:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064265 s, 163 MB/s 2024-04-25T09:03:42.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695934 s, 151 MB/s 2024-04-25T09:03:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739239 s, 142 MB/s 2024-04-25T09:03:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734167 s, 143 MB/s 2024-04-25T09:03:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694956 s, 151 MB/s 2024-04-25T09:03:42.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.512 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692339 s, 151 MB/s 2024-04-25T09:03:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076086 s, 138 MB/s 2024-04-25T09:03:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067949 s, 154 MB/s 2024-04-25T09:03:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730369 s, 144 MB/s 2024-04-25T09:03:42.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732632 s, 143 MB/s 2024-04-25T09:03:42.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065458 s, 160 MB/s 2024-04-25T09:03:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731151 s, 143 MB/s 2024-04-25T09:03:42.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715099 s, 147 MB/s 2024-04-25T09:03:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654394 s, 160 MB/s 2024-04-25T09:03:42.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:42.576 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:42.577 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:42.577 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:03:42.577 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:42.577 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:42.577 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:42.577 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:42.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691429 s, 152 MB/s 2024-04-25T09:03:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748835 s, 140 MB/s 2024-04-25T09:03:42.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736699 s, 142 MB/s 2024-04-25T09:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731348 s, 143 MB/s 2024-04-25T09:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710581 s, 148 MB/s 2024-04-25T09:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668344 s, 157 MB/s 2024-04-25T09:03:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744374 s, 141 MB/s 2024-04-25T09:03:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710869 s, 148 MB/s 2024-04-25T09:03:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682835 s, 154 MB/s 2024-04-25T09:03:42.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088217 s, 119 MB/s 2024-04-25T09:03:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709455 s, 148 MB/s 2024-04-25T09:03:42.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731795 s, 143 MB/s 2024-04-25T09:03:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071967 s, 146 MB/s 2024-04-25T09:03:42.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.749 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758025 s, 138 MB/s 2024-04-25T09:03:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761822 s, 138 MB/s 2024-04-25T09:03:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705873 s, 149 MB/s 2024-04-25T09:03:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716871 s, 146 MB/s 2024-04-25T09:03:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732202 s, 143 MB/s 2024-04-25T09:03:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721483 s, 145 MB/s 2024-04-25T09:03:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070095 s, 150 MB/s 2024-04-25T09:03:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760046 s, 138 MB/s 2024-04-25T09:03:42.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.814 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732071 s, 143 MB/s 2024-04-25T09:03:42.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727623 s, 144 MB/s 2024-04-25T09:03:42.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747798 s, 140 MB/s 2024-04-25T09:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647965 s, 162 MB/s 2024-04-25T09:03:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737782 s, 142 MB/s 2024-04-25T09:03:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735366 s, 143 MB/s 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734288 s, 143 MB/s 2024-04-25T09:03:42.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711109 s, 147 MB/s 2024-04-25T09:03:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068699 s, 153 MB/s 2024-04-25T09:03:42.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063377 s, 165 MB/s 2024-04-25T09:03:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747491 s, 140 MB/s 2024-04-25T09:03:42.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:42.895 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:42.895 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:42.895 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:03:42.895 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:42.895 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:42.896 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:42.896 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:42.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784389 s, 134 MB/s 2024-04-25T09:03:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696793 s, 150 MB/s 2024-04-25T09:03:42.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672526 s, 156 MB/s 2024-04-25T09:03:42.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763282 s, 137 MB/s 2024-04-25T09:03:42.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:42.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734179 s, 143 MB/s 2024-04-25T09:03:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072976 s, 144 MB/s 2024-04-25T09:03:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677816 s, 155 MB/s 2024-04-25T09:03:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078995 s, 133 MB/s 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730163 s, 144 MB/s 2024-04-25T09:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662822 s, 158 MB/s 2024-04-25T09:03:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649335 s, 161 MB/s 2024-04-25T09:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788838 s, 133 MB/s 2024-04-25T09:03:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641444 s, 163 MB/s 2024-04-25T09:03:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640504 s, 164 MB/s 2024-04-25T09:03:43.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746054 s, 141 MB/s 2024-04-25T09:03:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702276 s, 149 MB/s 2024-04-25T09:03:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750599 s, 140 MB/s 2024-04-25T09:03:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072558 s, 145 MB/s 2024-04-25T09:03:43.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630278 s, 166 MB/s 2024-04-25T09:03:43.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.113 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724598 s, 145 MB/s 2024-04-25T09:03:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.121 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707155 s, 148 MB/s 2024-04-25T09:03:43.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655722 s, 160 MB/s 2024-04-25T09:03:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721235 s, 145 MB/s 2024-04-25T09:03:43.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.145 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720088 s, 146 MB/s 2024-04-25T09:03:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724219 s, 145 MB/s 2024-04-25T09:03:43.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686789 s, 153 MB/s 2024-04-25T09:03:43.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746193 s, 141 MB/s 2024-04-25T09:03:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672135 s, 156 MB/s 2024-04-25T09:03:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709872 s, 148 MB/s 2024-04-25T09:03:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690361 s, 152 MB/s 2024-04-25T09:03:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782524 s, 134 MB/s 2024-04-25T09:03:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712284 s, 147 MB/s 2024-04-25T09:03:43.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.211 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:43.211 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:43.211 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:03:43.211 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:43.211 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:43.211 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:43.211 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718668 s, 146 MB/s 2024-04-25T09:03:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072316 s, 145 MB/s 2024-04-25T09:03:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637797 s, 164 MB/s 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727169 s, 144 MB/s 2024-04-25T09:03:43.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730409 s, 144 MB/s 2024-04-25T09:03:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665919 s, 157 MB/s 2024-04-25T09:03:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086757 s, 121 MB/s 2024-04-25T09:03:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705644 s, 149 MB/s 2024-04-25T09:03:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635611 s, 165 MB/s 2024-04-25T09:03:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708759 s, 148 MB/s 2024-04-25T09:03:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649734 s, 161 MB/s 2024-04-25T09:03:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645514 s, 162 MB/s 2024-04-25T09:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758736 s, 138 MB/s 2024-04-25T09:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687531 s, 153 MB/s 2024-04-25T09:03:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690732 s, 152 MB/s 2024-04-25T09:03:43.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.394 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672414 s, 156 MB/s 2024-04-25T09:03:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707307 s, 148 MB/s 2024-04-25T09:03:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764499 s, 137 MB/s 2024-04-25T09:03:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703218 s, 149 MB/s 2024-04-25T09:03:43.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668116 s, 157 MB/s 2024-04-25T09:03:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752712 s, 139 MB/s 2024-04-25T09:03:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765759 s, 137 MB/s 2024-04-25T09:03:43.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680897 s, 154 MB/s 2024-04-25T09:03:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729269 s, 144 MB/s 2024-04-25T09:03:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762901 s, 137 MB/s 2024-04-25T09:03:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733314 s, 143 MB/s 2024-04-25T09:03:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687373 s, 153 MB/s 2024-04-25T09:03:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645216 s, 163 MB/s 2024-04-25T09:03:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662413 s, 158 MB/s 2024-04-25T09:03:43.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644968 s, 163 MB/s 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714321 s, 147 MB/s 2024-04-25T09:03:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695747 s, 151 MB/s 2024-04-25T09:03:43.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:43.523 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:43.523 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:03:43.523 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:43.523 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:43.523 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:43.523 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652558 s, 161 MB/s 2024-04-25T09:03:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723287 s, 145 MB/s 2024-04-25T09:03:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654265 s, 160 MB/s 2024-04-25T09:03:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714744 s, 147 MB/s 2024-04-25T09:03:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678751 s, 154 MB/s 2024-04-25T09:03:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691369 s, 152 MB/s 2024-04-25T09:03:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658049 s, 159 MB/s 2024-04-25T09:03:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745037 s, 141 MB/s 2024-04-25T09:03:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710376 s, 148 MB/s 2024-04-25T09:03:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071797 s, 146 MB/s 2024-04-25T09:03:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740957 s, 142 MB/s 2024-04-25T09:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640926 s, 164 MB/s 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686152 s, 153 MB/s 2024-04-25T09:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722386 s, 145 MB/s 2024-04-25T09:03:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756058 s, 139 MB/s 2024-04-25T09:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.708 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746571 s, 140 MB/s 2024-04-25T09:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651212 s, 161 MB/s 2024-04-25T09:03:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714226 s, 147 MB/s 2024-04-25T09:03:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.731 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714489 s, 147 MB/s 2024-04-25T09:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704098 s, 149 MB/s 2024-04-25T09:03:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786627 s, 133 MB/s 2024-04-25T09:03:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683326 s, 153 MB/s 2024-04-25T09:03:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067569 s, 155 MB/s 2024-04-25T09:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758012 s, 138 MB/s 2024-04-25T09:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678721 s, 154 MB/s 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754415 s, 139 MB/s 2024-04-25T09:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773006 s, 136 MB/s 2024-04-25T09:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669776 s, 157 MB/s 2024-04-25T09:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067442 s, 155 MB/s 2024-04-25T09:03:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652837 s, 161 MB/s 2024-04-25T09:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708345 s, 148 MB/s 2024-04-25T09:03:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629213 s, 167 MB/s 2024-04-25T09:03:43.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.836 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:43.836 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:43.836 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:03:43.836 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:43.836 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:43.836 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:43.836 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719872 s, 146 MB/s 2024-04-25T09:03:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.911 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859438 s, 122 MB/s 2024-04-25T09:03:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748468 s, 140 MB/s 2024-04-25T09:03:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731482 s, 143 MB/s 2024-04-25T09:03:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750117 s, 140 MB/s 2024-04-25T09:03:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664626 s, 158 MB/s 2024-04-25T09:03:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677045 s, 155 MB/s 2024-04-25T09:03:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716616 s, 146 MB/s 2024-04-25T09:03:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652446 s, 161 MB/s 2024-04-25T09:03:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694546 s, 151 MB/s 2024-04-25T09:03:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737715 s, 142 MB/s 2024-04-25T09:03:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723175 s, 145 MB/s 2024-04-25T09:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682621 s, 154 MB/s 2024-04-25T09:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713266 s, 147 MB/s 2024-04-25T09:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725793 s, 144 MB/s 2024-04-25T09:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790336 s, 133 MB/s 2024-04-25T09:03:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728961 s, 144 MB/s 2024-04-25T09:03:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676934 s, 155 MB/s 2024-04-25T09:03:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725977 s, 144 MB/s 2024-04-25T09:03:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664223 s, 158 MB/s 2024-04-25T09:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731103 s, 143 MB/s 2024-04-25T09:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718596 s, 146 MB/s 2024-04-25T09:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711777 s, 147 MB/s 2024-04-25T09:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.087 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673293 s, 156 MB/s 2024-04-25T09:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680445 s, 154 MB/s 2024-04-25T09:03:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648014 s, 162 MB/s 2024-04-25T09:03:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724408 s, 145 MB/s 2024-04-25T09:03:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723671 s, 145 MB/s 2024-04-25T09:03:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067336 s, 156 MB/s 2024-04-25T09:03:44.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069852 s, 150 MB/s 2024-04-25T09:03:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732102 s, 143 MB/s 2024-04-25T09:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699109 s, 150 MB/s 2024-04-25T09:03:44.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:44.152 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:44.152 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:44.152 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:03:44.152 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:44.152 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:44.152 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:44.152 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730675 s, 144 MB/s 2024-04-25T09:03:44.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739218 s, 142 MB/s 2024-04-25T09:03:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739982 s, 142 MB/s 2024-04-25T09:03:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062327 s, 168 MB/s 2024-04-25T09:03:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660655 s, 159 MB/s 2024-04-25T09:03:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739734 s, 142 MB/s 2024-04-25T09:03:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730089 s, 144 MB/s 2024-04-25T09:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718688 s, 146 MB/s 2024-04-25T09:03:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628903 s, 167 MB/s 2024-04-25T09:03:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735517 s, 143 MB/s 2024-04-25T09:03:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686783 s, 153 MB/s 2024-04-25T09:03:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648048 s, 162 MB/s 2024-04-25T09:03:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625941 s, 168 MB/s 2024-04-25T09:03:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761991 s, 138 MB/s 2024-04-25T09:03:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069909 s, 150 MB/s 2024-04-25T09:03:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731289 s, 143 MB/s 2024-04-25T09:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753189 s, 139 MB/s 2024-04-25T09:03:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006965 s, 151 MB/s 2024-04-25T09:03:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074208 s, 141 MB/s 2024-04-25T09:03:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736008 s, 142 MB/s 2024-04-25T09:03:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874307 s, 120 MB/s 2024-04-25T09:03:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696879 s, 150 MB/s 2024-04-25T09:03:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737869 s, 142 MB/s 2024-04-25T09:03:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736344 s, 142 MB/s 2024-04-25T09:03:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707509 s, 148 MB/s 2024-04-25T09:03:44.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.418 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722645 s, 145 MB/s 2024-04-25T09:03:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745324 s, 141 MB/s 2024-04-25T09:03:44.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685119 s, 153 MB/s 2024-04-25T09:03:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726436 s, 144 MB/s 2024-04-25T09:03:44.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718963 s, 146 MB/s 2024-04-25T09:03:44.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737925 s, 142 MB/s 2024-04-25T09:03:44.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729582 s, 144 MB/s 2024-04-25T09:03:44.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:44.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:44.469 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:44.469 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:03:44.469 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:44.469 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:44.469 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:44.469 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664996 s, 158 MB/s 2024-04-25T09:03:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722348 s, 145 MB/s 2024-04-25T09:03:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691879 s, 152 MB/s 2024-04-25T09:03:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687041 s, 153 MB/s 2024-04-25T09:03:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621004 s, 169 MB/s 2024-04-25T09:03:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616213 s, 170 MB/s 2024-04-25T09:03:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723257 s, 145 MB/s 2024-04-25T09:03:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727973 s, 144 MB/s 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734552 s, 143 MB/s 2024-04-25T09:03:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731148 s, 143 MB/s 2024-04-25T09:03:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738054 s, 142 MB/s 2024-04-25T09:03:44.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687909 s, 152 MB/s 2024-04-25T09:03:44.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731042 s, 143 MB/s 2024-04-25T09:03:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733565 s, 143 MB/s 2024-04-25T09:03:44.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745602 s, 141 MB/s 2024-04-25T09:03:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723825 s, 145 MB/s 2024-04-25T09:03:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683558 s, 153 MB/s 2024-04-25T09:03:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642659 s, 163 MB/s 2024-04-25T09:03:44.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684883 s, 153 MB/s 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740786 s, 142 MB/s 2024-04-25T09:03:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737819 s, 142 MB/s 2024-04-25T09:03:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719393 s, 146 MB/s 2024-04-25T09:03:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732839 s, 143 MB/s 2024-04-25T09:03:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743659 s, 141 MB/s 2024-04-25T09:03:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646767 s, 162 MB/s 2024-04-25T09:03:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627606 s, 167 MB/s 2024-04-25T09:03:44.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763738 s, 137 MB/s 2024-04-25T09:03:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689834 s, 152 MB/s 2024-04-25T09:03:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684904 s, 153 MB/s 2024-04-25T09:03:44.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700356 s, 150 MB/s 2024-04-25T09:03:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727216 s, 144 MB/s 2024-04-25T09:03:44.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690889 s, 152 MB/s 2024-04-25T09:03:44.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:44.781 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:44.781 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:44.781 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:03:44.781 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:44.781 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:44.781 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:44.781 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780691 s, 134 MB/s 2024-04-25T09:03:44.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664192 s, 158 MB/s 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785872 s, 133 MB/s 2024-04-25T09:03:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631016 s, 166 MB/s 2024-04-25T09:03:44.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722519 s, 145 MB/s 2024-04-25T09:03:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690454 s, 152 MB/s 2024-04-25T09:03:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743984 s, 141 MB/s 2024-04-25T09:03:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719056 s, 146 MB/s 2024-04-25T09:03:44.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00806071 s, 130 MB/s 2024-04-25T09:03:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676248 s, 155 MB/s 2024-04-25T09:03:44.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748951 s, 140 MB/s 2024-04-25T09:03:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734069 s, 143 MB/s 2024-04-25T09:03:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756383 s, 139 MB/s 2024-04-25T09:03:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720339 s, 146 MB/s 2024-04-25T09:03:44.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707074 s, 148 MB/s 2024-04-25T09:03:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735595 s, 143 MB/s 2024-04-25T09:03:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682475 s, 154 MB/s 2024-04-25T09:03:44.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866991 s, 121 MB/s 2024-04-25T09:03:44.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730992 s, 143 MB/s 2024-04-25T09:03:45.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670298 s, 156 MB/s 2024-04-25T09:03:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738551 s, 142 MB/s 2024-04-25T09:03:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656406 s, 160 MB/s 2024-04-25T09:03:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716407 s, 146 MB/s 2024-04-25T09:03:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870589 s, 120 MB/s 2024-04-25T09:03:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761353 s, 138 MB/s 2024-04-25T09:03:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712105 s, 147 MB/s 2024-04-25T09:03:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708237 s, 148 MB/s 2024-04-25T09:03:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759404 s, 138 MB/s 2024-04-25T09:03:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693877 s, 151 MB/s 2024-04-25T09:03:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071276 s, 147 MB/s 2024-04-25T09:03:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754206 s, 139 MB/s 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756664 s, 139 MB/s 2024-04-25T09:03:45.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:45.103 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:45.103 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:45.103 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:03:45.103 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:45.103 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:45.103 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:45.103 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722635 s, 145 MB/s 2024-04-25T09:03:45.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652794 s, 161 MB/s 2024-04-25T09:03:45.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735083 s, 143 MB/s 2024-04-25T09:03:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733247 s, 143 MB/s 2024-04-25T09:03:45.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818197 s, 128 MB/s 2024-04-25T09:03:45.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637315 s, 165 MB/s 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785742 s, 133 MB/s 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722933 s, 145 MB/s 2024-04-25T09:03:45.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719369 s, 146 MB/s 2024-04-25T09:03:45.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654739 s, 160 MB/s 2024-04-25T09:03:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791603 s, 132 MB/s 2024-04-25T09:03:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745798 s, 141 MB/s 2024-04-25T09:03:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755125 s, 139 MB/s 2024-04-25T09:03:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067241 s, 156 MB/s 2024-04-25T09:03:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693634 s, 151 MB/s 2024-04-25T09:03:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726629 s, 144 MB/s 2024-04-25T09:03:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736913 s, 142 MB/s 2024-04-25T09:03:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776036 s, 135 MB/s 2024-04-25T09:03:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751596 s, 140 MB/s 2024-04-25T09:03:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073613 s, 142 MB/s 2024-04-25T09:03:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706731 s, 148 MB/s 2024-04-25T09:03:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716059 s, 146 MB/s 2024-04-25T09:03:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723536 s, 145 MB/s 2024-04-25T09:03:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851214 s, 123 MB/s 2024-04-25T09:03:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675583 s, 155 MB/s 2024-04-25T09:03:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651643 s, 161 MB/s 2024-04-25T09:03:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674352 s, 155 MB/s 2024-04-25T09:03:45.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717005 s, 146 MB/s 2024-04-25T09:03:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687841 s, 152 MB/s 2024-04-25T09:03:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659565 s, 159 MB/s 2024-04-25T09:03:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683903 s, 153 MB/s 2024-04-25T09:03:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788721 s, 133 MB/s 2024-04-25T09:03:45.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:45.422 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:45.422 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:45.422 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:03:45.422 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:45.422 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:45.422 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:45.422 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640095 s, 164 MB/s 2024-04-25T09:03:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690801 s, 152 MB/s 2024-04-25T09:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695865 s, 151 MB/s 2024-04-25T09:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759399 s, 138 MB/s 2024-04-25T09:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744409 s, 141 MB/s 2024-04-25T09:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849528 s, 123 MB/s 2024-04-25T09:03:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675174 s, 155 MB/s 2024-04-25T09:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726456 s, 144 MB/s 2024-04-25T09:03:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689806 s, 152 MB/s 2024-04-25T09:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729435 s, 144 MB/s 2024-04-25T09:03:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068112 s, 154 MB/s 2024-04-25T09:03:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007175 s, 146 MB/s 2024-04-25T09:03:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.585 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812391 s, 129 MB/s 2024-04-25T09:03:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715439 s, 147 MB/s 2024-04-25T09:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729388 s, 144 MB/s 2024-04-25T09:03:45.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759414 s, 138 MB/s 2024-04-25T09:03:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722859 s, 145 MB/s 2024-04-25T09:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680053 s, 154 MB/s 2024-04-25T09:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691619 s, 152 MB/s 2024-04-25T09:03:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654692 s, 160 MB/s 2024-04-25T09:03:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720553 s, 146 MB/s 2024-04-25T09:03:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719019 s, 146 MB/s 2024-04-25T09:03:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764012 s, 137 MB/s 2024-04-25T09:03:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612237 s, 171 MB/s 2024-04-25T09:03:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067594 s, 155 MB/s 2024-04-25T09:03:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692848 s, 151 MB/s 2024-04-25T09:03:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649294 s, 161 MB/s 2024-04-25T09:03:45.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731354 s, 143 MB/s 2024-04-25T09:03:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072529 s, 145 MB/s 2024-04-25T09:03:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066498 s, 158 MB/s 2024-04-25T09:03:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710553 s, 148 MB/s 2024-04-25T09:03:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677367 s, 155 MB/s 2024-04-25T09:03:45.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:45.736 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:45.736 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:45.736 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:03:45.736 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:45.736 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:45.736 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:45.736 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:45.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788208 s, 133 MB/s 2024-04-25T09:03:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762043 s, 138 MB/s 2024-04-25T09:03:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702713 s, 149 MB/s 2024-04-25T09:03:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689424 s, 152 MB/s 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651882 s, 161 MB/s 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723935 s, 145 MB/s 2024-04-25T09:03:45.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731099 s, 143 MB/s 2024-04-25T09:03:45.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756608 s, 139 MB/s 2024-04-25T09:03:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.866 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662214 s, 158 MB/s 2024-04-25T09:03:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639224 s, 164 MB/s 2024-04-25T09:03:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765436 s, 137 MB/s 2024-04-25T09:03:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063954 s, 164 MB/s 2024-04-25T09:03:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726736 s, 144 MB/s 2024-04-25T09:03:45.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.906 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710187 s, 148 MB/s 2024-04-25T09:03:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700856 s, 150 MB/s 2024-04-25T09:03:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688219 s, 152 MB/s 2024-04-25T09:03:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648507 s, 162 MB/s 2024-04-25T09:03:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747683 s, 140 MB/s 2024-04-25T09:03:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717514 s, 146 MB/s 2024-04-25T09:03:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619547 s, 169 MB/s 2024-04-25T09:03:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731077 s, 143 MB/s 2024-04-25T09:03:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742825 s, 141 MB/s 2024-04-25T09:03:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687231 s, 153 MB/s 2024-04-25T09:03:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.984 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641236 s, 164 MB/s 2024-04-25T09:03:45.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634576 s, 165 MB/s 2024-04-25T09:03:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727518 s, 144 MB/s 2024-04-25T09:03:46.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688222 s, 152 MB/s 2024-04-25T09:03:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747468 s, 140 MB/s 2024-04-25T09:03:46.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787384 s, 133 MB/s 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683243 s, 153 MB/s 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712572 s, 147 MB/s 2024-04-25T09:03:46.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738152 s, 142 MB/s 2024-04-25T09:03:46.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:46.049 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:46.049 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:46.050 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:03:46.050 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:46.050 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:46.050 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:46.050 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738252 s, 142 MB/s 2024-04-25T09:03:46.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724562 s, 145 MB/s 2024-04-25T09:03:46.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074357 s, 141 MB/s 2024-04-25T09:03:46.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656248 s, 160 MB/s 2024-04-25T09:03:46.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727164 s, 144 MB/s 2024-04-25T09:03:46.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686638 s, 153 MB/s 2024-04-25T09:03:46.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738683 s, 142 MB/s 2024-04-25T09:03:46.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682761 s, 154 MB/s 2024-04-25T09:03:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731105 s, 143 MB/s 2024-04-25T09:03:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683779 s, 153 MB/s 2024-04-25T09:03:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758205 s, 138 MB/s 2024-04-25T09:03:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.204 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691562 s, 152 MB/s 2024-04-25T09:03:46.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762148 s, 138 MB/s 2024-04-25T09:03:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730435 s, 144 MB/s 2024-04-25T09:03:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634208 s, 165 MB/s 2024-04-25T09:03:46.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720096 s, 146 MB/s 2024-04-25T09:03:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689093 s, 152 MB/s 2024-04-25T09:03:46.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682039 s, 154 MB/s 2024-04-25T09:03:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695355 s, 151 MB/s 2024-04-25T09:03:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074196 s, 141 MB/s 2024-04-25T09:03:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710666 s, 148 MB/s 2024-04-25T09:03:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727963 s, 144 MB/s 2024-04-25T09:03:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639649 s, 164 MB/s 2024-04-25T09:03:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683808 s, 153 MB/s 2024-04-25T09:03:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738562 s, 142 MB/s 2024-04-25T09:03:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069365 s, 151 MB/s 2024-04-25T09:03:46.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765098 s, 137 MB/s 2024-04-25T09:03:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666162 s, 157 MB/s 2024-04-25T09:03:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737652 s, 142 MB/s 2024-04-25T09:03:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656749 s, 160 MB/s 2024-04-25T09:03:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758285 s, 138 MB/s 2024-04-25T09:03:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720934 s, 145 MB/s 2024-04-25T09:03:46.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:46.365 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:46.365 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:46.365 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:03:46.365 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:46.365 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:46.365 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:46.365 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713585 s, 147 MB/s 2024-04-25T09:03:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714183 s, 147 MB/s 2024-04-25T09:03:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680542 s, 154 MB/s 2024-04-25T09:03:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727004 s, 144 MB/s 2024-04-25T09:03:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718586 s, 146 MB/s 2024-04-25T09:03:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720699 s, 145 MB/s 2024-04-25T09:03:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073978 s, 142 MB/s 2024-04-25T09:03:46.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740812 s, 142 MB/s 2024-04-25T09:03:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677574 s, 155 MB/s 2024-04-25T09:03:46.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719491 s, 146 MB/s 2024-04-25T09:03:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007845 s, 134 MB/s 2024-04-25T09:03:46.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680885 s, 154 MB/s 2024-04-25T09:03:46.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711264 s, 147 MB/s 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711339 s, 147 MB/s 2024-04-25T09:03:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674728 s, 155 MB/s 2024-04-25T09:03:46.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626139 s, 167 MB/s 2024-04-25T09:03:46.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694419 s, 151 MB/s 2024-04-25T09:03:46.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.567 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727896 s, 144 MB/s 2024-04-25T09:03:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691223 s, 152 MB/s 2024-04-25T09:03:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722245 s, 145 MB/s 2024-04-25T09:03:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752981 s, 139 MB/s 2024-04-25T09:03:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648335 s, 162 MB/s 2024-04-25T09:03:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685403 s, 153 MB/s 2024-04-25T09:03:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643408 s, 163 MB/s 2024-04-25T09:03:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779162 s, 135 MB/s 2024-04-25T09:03:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659276 s, 159 MB/s 2024-04-25T09:03:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725459 s, 145 MB/s 2024-04-25T09:03:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624348 s, 168 MB/s 2024-04-25T09:03:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069154 s, 152 MB/s 2024-04-25T09:03:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744409 s, 141 MB/s 2024-04-25T09:03:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707754 s, 148 MB/s 2024-04-25T09:03:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620747 s, 169 MB/s 2024-04-25T09:03:46.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:46.677 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:46.677 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:46.677 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:03:46.677 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:46.677 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:46.678 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:46.678 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673035 s, 156 MB/s 2024-04-25T09:03:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747999 s, 140 MB/s 2024-04-25T09:03:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712103 s, 147 MB/s 2024-04-25T09:03:46.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762492 s, 138 MB/s 2024-04-25T09:03:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750336 s, 140 MB/s 2024-04-25T09:03:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694893 s, 151 MB/s 2024-04-25T09:03:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754782 s, 139 MB/s 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720301 s, 146 MB/s 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661511 s, 159 MB/s 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711724 s, 147 MB/s 2024-04-25T09:03:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721848 s, 145 MB/s 2024-04-25T09:03:46.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649205 s, 162 MB/s 2024-04-25T09:03:46.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737821 s, 142 MB/s 2024-04-25T09:03:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852097 s, 123 MB/s 2024-04-25T09:03:46.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843672 s, 124 MB/s 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736792 s, 142 MB/s 2024-04-25T09:03:46.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741003 s, 142 MB/s 2024-04-25T09:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691024 s, 152 MB/s 2024-04-25T09:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639804 s, 164 MB/s 2024-04-25T09:03:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677264 s, 155 MB/s 2024-04-25T09:03:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785819 s, 133 MB/s 2024-04-25T09:03:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684961 s, 153 MB/s 2024-04-25T09:03:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660721 s, 159 MB/s 2024-04-25T09:03:46.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672125 s, 156 MB/s 2024-04-25T09:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726952 s, 144 MB/s 2024-04-25T09:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710386 s, 148 MB/s 2024-04-25T09:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658396 s, 159 MB/s 2024-04-25T09:03:46.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639733 s, 164 MB/s 2024-04-25T09:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738584 s, 142 MB/s 2024-04-25T09:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745622 s, 141 MB/s 2024-04-25T09:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723254 s, 145 MB/s 2024-04-25T09:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716486 s, 146 MB/s 2024-04-25T09:03:46.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:46.994 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:46.994 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:46.995 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:03:46.995 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:46.995 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:46.995 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:46.995 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007126 s, 147 MB/s 2024-04-25T09:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086189 s, 122 MB/s 2024-04-25T09:03:47.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746009 s, 141 MB/s 2024-04-25T09:03:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682894 s, 154 MB/s 2024-04-25T09:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689866 s, 152 MB/s 2024-04-25T09:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757312 s, 138 MB/s 2024-04-25T09:03:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070723 s, 148 MB/s 2024-04-25T09:03:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639556 s, 164 MB/s 2024-04-25T09:03:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735426 s, 143 MB/s 2024-04-25T09:03:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639846 s, 164 MB/s 2024-04-25T09:03:47.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639311 s, 164 MB/s 2024-04-25T09:03:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733056 s, 143 MB/s 2024-04-25T09:03:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750491 s, 140 MB/s 2024-04-25T09:03:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695157 s, 151 MB/s 2024-04-25T09:03:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681737 s, 154 MB/s 2024-04-25T09:03:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644923 s, 163 MB/s 2024-04-25T09:03:47.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065652 s, 160 MB/s 2024-04-25T09:03:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632012 s, 166 MB/s 2024-04-25T09:03:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727045 s, 144 MB/s 2024-04-25T09:03:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064985 s, 161 MB/s 2024-04-25T09:03:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757476 s, 138 MB/s 2024-04-25T09:03:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723189 s, 145 MB/s 2024-04-25T09:03:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658309 s, 159 MB/s 2024-04-25T09:03:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629927 s, 166 MB/s 2024-04-25T09:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686852 s, 153 MB/s 2024-04-25T09:03:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744925 s, 141 MB/s 2024-04-25T09:03:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678311 s, 155 MB/s 2024-04-25T09:03:47.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697037 s, 150 MB/s 2024-04-25T09:03:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737947 s, 142 MB/s 2024-04-25T09:03:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642601 s, 163 MB/s 2024-04-25T09:03:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734267 s, 143 MB/s 2024-04-25T09:03:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658884 s, 159 MB/s 2024-04-25T09:03:47.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:47.304 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:47.304 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:47.304 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:03:47.304 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:47.305 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:47.305 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:47.305 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:47.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760411 s, 138 MB/s 2024-04-25T09:03:47.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:47.374 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:47.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698433 s, 150 MB/s 2024-04-25T09:03:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714019 s, 147 MB/s 2024-04-25T09:03:47.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073853 s, 142 MB/s 2024-04-25T09:03:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744406 s, 141 MB/s 2024-04-25T09:03:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065731 s, 160 MB/s 2024-04-25T09:03:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.420 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728519 s, 144 MB/s 2024-04-25T09:03:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685766 s, 153 MB/s 2024-04-25T09:03:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674319 s, 156 MB/s 2024-04-25T09:03:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829216 s, 126 MB/s 2024-04-25T09:03:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759156 s, 138 MB/s 2024-04-25T09:03:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064769 s, 162 MB/s 2024-04-25T09:03:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721439 s, 145 MB/s 2024-04-25T09:03:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007212 s, 145 MB/s 2024-04-25T09:03:47.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075118 s, 140 MB/s 2024-04-25T09:03:47.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770121 s, 136 MB/s 2024-04-25T09:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683874 s, 153 MB/s 2024-04-25T09:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071202 s, 147 MB/s 2024-04-25T09:03:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727104 s, 144 MB/s 2024-04-25T09:03:47.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739031 s, 142 MB/s 2024-04-25T09:03:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718064 s, 146 MB/s 2024-04-25T09:03:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006472 s, 162 MB/s 2024-04-25T09:03:47.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735102 s, 143 MB/s 2024-04-25T09:03:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068357 s, 153 MB/s 2024-04-25T09:03:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736251 s, 142 MB/s 2024-04-25T09:03:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681262 s, 154 MB/s 2024-04-25T09:03:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700187 s, 150 MB/s 2024-04-25T09:03:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722515 s, 145 MB/s 2024-04-25T09:03:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729653 s, 144 MB/s 2024-04-25T09:03:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678617 s, 155 MB/s 2024-04-25T09:03:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643756 s, 163 MB/s 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733721 s, 143 MB/s 2024-04-25T09:03:47.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:47.623 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:47.623 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:47.623 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:03:47.623 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:47.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:47.623 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:47.623 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747565 s, 140 MB/s 2024-04-25T09:03:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702872 s, 149 MB/s 2024-04-25T09:03:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752887 s, 139 MB/s 2024-04-25T09:03:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714707 s, 147 MB/s 2024-04-25T09:03:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.721 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703017 s, 149 MB/s 2024-04-25T09:03:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632278 s, 166 MB/s 2024-04-25T09:03:47.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667367 s, 157 MB/s 2024-04-25T09:03:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645127 s, 163 MB/s 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747822 s, 140 MB/s 2024-04-25T09:03:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758245 s, 138 MB/s 2024-04-25T09:03:47.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742269 s, 141 MB/s 2024-04-25T09:03:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673297 s, 156 MB/s 2024-04-25T09:03:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699125 s, 150 MB/s 2024-04-25T09:03:47.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743333 s, 141 MB/s 2024-04-25T09:03:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640326 s, 164 MB/s 2024-04-25T09:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737032 s, 142 MB/s 2024-04-25T09:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744916 s, 141 MB/s 2024-04-25T09:03:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650281 s, 161 MB/s 2024-04-25T09:03:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712236 s, 147 MB/s 2024-04-25T09:03:47.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717501 s, 146 MB/s 2024-04-25T09:03:47.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718568 s, 146 MB/s 2024-04-25T09:03:47.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737899 s, 142 MB/s 2024-04-25T09:03:47.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706155 s, 148 MB/s 2024-04-25T09:03:47.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758245 s, 138 MB/s 2024-04-25T09:03:47.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637039 s, 165 MB/s 2024-04-25T09:03:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704455 s, 149 MB/s 2024-04-25T09:03:47.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708702 s, 148 MB/s 2024-04-25T09:03:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724656 s, 145 MB/s 2024-04-25T09:03:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084578 s, 124 MB/s 2024-04-25T09:03:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644351 s, 163 MB/s 2024-04-25T09:03:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729675 s, 144 MB/s 2024-04-25T09:03:47.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:47.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:47.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713897 s, 147 MB/s 2024-04-25T09:03:47.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:47.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:47.938 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:47.938 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:03:47.938 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:47.938 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:47.938 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:47.938 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731962 s, 143 MB/s 2024-04-25T09:03:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749595 s, 140 MB/s 2024-04-25T09:03:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644381 s, 163 MB/s 2024-04-25T09:03:48.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.107 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717099 s, 146 MB/s 2024-04-25T09:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649506 s, 161 MB/s 2024-04-25T09:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754805 s, 139 MB/s 2024-04-25T09:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722248 s, 145 MB/s 2024-04-25T09:03:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738106 s, 142 MB/s 2024-04-25T09:03:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705792 s, 149 MB/s 2024-04-25T09:03:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006895 s, 152 MB/s 2024-04-25T09:03:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659894 s, 159 MB/s 2024-04-25T09:03:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691634 s, 152 MB/s 2024-04-25T09:03:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665375 s, 158 MB/s 2024-04-25T09:03:48.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007181 s, 146 MB/s 2024-04-25T09:03:48.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653432 s, 160 MB/s 2024-04-25T09:03:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694842 s, 151 MB/s 2024-04-25T09:03:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638081 s, 164 MB/s 2024-04-25T09:03:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697116 s, 150 MB/s 2024-04-25T09:03:48.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696331 s, 151 MB/s 2024-04-25T09:03:48.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781096 s, 134 MB/s 2024-04-25T09:03:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.241 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756549 s, 139 MB/s 2024-04-25T09:03:48.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731837 s, 143 MB/s 2024-04-25T09:03:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732997 s, 143 MB/s 2024-04-25T09:03:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618709 s, 169 MB/s 2024-04-25T09:03:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686285 s, 153 MB/s 2024-04-25T09:03:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642481 s, 163 MB/s 2024-04-25T09:03:48.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686245 s, 153 MB/s 2024-04-25T09:03:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760105 s, 138 MB/s 2024-04-25T09:03:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645574 s, 162 MB/s 2024-04-25T09:03:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717885 s, 146 MB/s 2024-04-25T09:03:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696066 s, 151 MB/s 2024-04-25T09:03:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069031 s, 152 MB/s 2024-04-25T09:03:48.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:48.328 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:48.328 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:48.328 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:03:48.328 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:48.328 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:48.329 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:48.329 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730702 s, 144 MB/s 2024-04-25T09:03:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727322 s, 144 MB/s 2024-04-25T09:03:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730328 s, 144 MB/s 2024-04-25T09:03:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631052 s, 166 MB/s 2024-04-25T09:03:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764263 s, 137 MB/s 2024-04-25T09:03:48.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716562 s, 146 MB/s 2024-04-25T09:03:48.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731832 s, 143 MB/s 2024-04-25T09:03:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686451 s, 153 MB/s 2024-04-25T09:03:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710381 s, 148 MB/s 2024-04-25T09:03:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711637 s, 147 MB/s 2024-04-25T09:03:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755452 s, 139 MB/s 2024-04-25T09:03:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733552 s, 143 MB/s 2024-04-25T09:03:48.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.452 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722647 s, 145 MB/s 2024-04-25T09:03:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701413 s, 149 MB/s 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726606 s, 144 MB/s 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725608 s, 145 MB/s 2024-04-25T09:03:48.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720215 s, 146 MB/s 2024-04-25T09:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735151 s, 143 MB/s 2024-04-25T09:03:48.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718315 s, 146 MB/s 2024-04-25T09:03:48.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714833 s, 147 MB/s 2024-04-25T09:03:48.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732265 s, 143 MB/s 2024-04-25T09:03:48.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.525 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720962 s, 145 MB/s 2024-04-25T09:03:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063354 s, 166 MB/s 2024-04-25T09:03:48.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671401 s, 156 MB/s 2024-04-25T09:03:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663066 s, 158 MB/s 2024-04-25T09:03:48.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667193 s, 157 MB/s 2024-04-25T09:03:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705069 s, 149 MB/s 2024-04-25T09:03:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736506 s, 142 MB/s 2024-04-25T09:03:48.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703592 s, 149 MB/s 2024-04-25T09:03:48.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.586 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660337 s, 159 MB/s 2024-04-25T09:03:48.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073837 s, 142 MB/s 2024-04-25T09:03:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740373 s, 142 MB/s 2024-04-25T09:03:48.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:48.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:48.604 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:48.604 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:03:48.604 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:48.604 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:48.604 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:48.604 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670311 s, 156 MB/s 2024-04-25T09:03:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670602 s, 156 MB/s 2024-04-25T09:03:48.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.687 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758309 s, 138 MB/s 2024-04-25T09:03:48.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.694 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665531 s, 158 MB/s 2024-04-25T09:03:48.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671134 s, 156 MB/s 2024-04-25T09:03:48.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709478 s, 148 MB/s 2024-04-25T09:03:48.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750113 s, 140 MB/s 2024-04-25T09:03:48.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839006 s, 125 MB/s 2024-04-25T09:03:48.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066867 s, 157 MB/s 2024-04-25T09:03:48.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.742 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637822 s, 164 MB/s 2024-04-25T09:03:48.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.750 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776079 s, 135 MB/s 2024-04-25T09:03:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689347 s, 152 MB/s 2024-04-25T09:03:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662753 s, 158 MB/s 2024-04-25T09:03:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751472 s, 140 MB/s 2024-04-25T09:03:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780262 s, 134 MB/s 2024-04-25T09:03:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076732 s, 137 MB/s 2024-04-25T09:03:48.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069795 s, 150 MB/s 2024-04-25T09:03:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727954 s, 144 MB/s 2024-04-25T09:03:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649691 s, 161 MB/s 2024-04-25T09:03:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072535 s, 145 MB/s 2024-04-25T09:03:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747468 s, 140 MB/s 2024-04-25T09:03:48.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659196 s, 159 MB/s 2024-04-25T09:03:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704555 s, 149 MB/s 2024-04-25T09:03:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672266 s, 156 MB/s 2024-04-25T09:03:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669607 s, 157 MB/s 2024-04-25T09:03:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718232 s, 146 MB/s 2024-04-25T09:03:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069264 s, 151 MB/s 2024-04-25T09:03:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686263 s, 153 MB/s 2024-04-25T09:03:48.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739903 s, 142 MB/s 2024-04-25T09:03:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745398 s, 141 MB/s 2024-04-25T09:03:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706369 s, 148 MB/s 2024-04-25T09:03:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646579 s, 162 MB/s 2024-04-25T09:03:48.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:48.919 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:48.919 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:48.919 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:03:48.919 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:48.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:48.919 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:48.919 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697553 s, 150 MB/s 2024-04-25T09:03:48.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:48.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781096 s, 134 MB/s 2024-04-25T09:03:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.004 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784854 s, 134 MB/s 2024-04-25T09:03:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735591 s, 143 MB/s 2024-04-25T09:03:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747455 s, 140 MB/s 2024-04-25T09:03:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721047 s, 145 MB/s 2024-04-25T09:03:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675784 s, 155 MB/s 2024-04-25T09:03:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720997 s, 145 MB/s 2024-04-25T09:03:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736952 s, 142 MB/s 2024-04-25T09:03:49.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759181 s, 138 MB/s 2024-04-25T09:03:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704383 s, 149 MB/s 2024-04-25T09:03:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712875 s, 147 MB/s 2024-04-25T09:03:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697273 s, 150 MB/s 2024-04-25T09:03:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646746 s, 162 MB/s 2024-04-25T09:03:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633051 s, 166 MB/s 2024-04-25T09:03:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753805 s, 139 MB/s 2024-04-25T09:03:49.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692971 s, 151 MB/s 2024-04-25T09:03:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719723 s, 146 MB/s 2024-04-25T09:03:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715526 s, 147 MB/s 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687068 s, 153 MB/s 2024-04-25T09:03:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719352 s, 146 MB/s 2024-04-25T09:03:49.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660658 s, 159 MB/s 2024-04-25T09:03:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725358 s, 145 MB/s 2024-04-25T09:03:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746971 s, 140 MB/s 2024-04-25T09:03:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650763 s, 161 MB/s 2024-04-25T09:03:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736327 s, 142 MB/s 2024-04-25T09:03:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745868 s, 141 MB/s 2024-04-25T09:03:49.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.204 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724774 s, 145 MB/s 2024-04-25T09:03:49.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.212 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702016 s, 149 MB/s 2024-04-25T09:03:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737784 s, 142 MB/s 2024-04-25T09:03:49.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647632 s, 162 MB/s 2024-04-25T09:03:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714627 s, 147 MB/s 2024-04-25T09:03:49.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:49.237 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:49.237 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:49.237 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:03:49.237 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:49.237 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:49.237 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:49.237 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075605 s, 139 MB/s 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701174 s, 150 MB/s 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766444 s, 137 MB/s 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732405 s, 143 MB/s 2024-04-25T09:03:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747554 s, 140 MB/s 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656289 s, 160 MB/s 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736541 s, 142 MB/s 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730279 s, 144 MB/s 2024-04-25T09:03:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789614 s, 133 MB/s 2024-04-25T09:03:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742567 s, 141 MB/s 2024-04-25T09:03:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744397 s, 141 MB/s 2024-04-25T09:03:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677659 s, 155 MB/s 2024-04-25T09:03:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072994 s, 144 MB/s 2024-04-25T09:03:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780191 s, 134 MB/s 2024-04-25T09:03:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776351 s, 135 MB/s 2024-04-25T09:03:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068977 s, 152 MB/s 2024-04-25T09:03:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713244 s, 147 MB/s 2024-04-25T09:03:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747058 s, 140 MB/s 2024-04-25T09:03:49.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.452 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071278 s, 147 MB/s 2024-04-25T09:03:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792228 s, 132 MB/s 2024-04-25T09:03:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760408 s, 138 MB/s 2024-04-25T09:03:49.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067086 s, 156 MB/s 2024-04-25T09:03:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686631 s, 153 MB/s 2024-04-25T09:03:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742455 s, 141 MB/s 2024-04-25T09:03:49.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722361 s, 145 MB/s 2024-04-25T09:03:49.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678648 s, 155 MB/s 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777236 s, 135 MB/s 2024-04-25T09:03:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694897 s, 151 MB/s 2024-04-25T09:03:49.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745826 s, 141 MB/s 2024-04-25T09:03:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680361 s, 154 MB/s 2024-04-25T09:03:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688808 s, 152 MB/s 2024-04-25T09:03:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701387 s, 150 MB/s 2024-04-25T09:03:49.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:49.558 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:03:49.559 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:03:49.559 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:03:49.559 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:03:49.559 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:03:49.559 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:03:49.559 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:03:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722669 s, 145 MB/s 2024-04-25T09:03:49.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641292 s, 164 MB/s 2024-04-25T09:03:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647108 s, 162 MB/s 2024-04-25T09:03:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067714 s, 155 MB/s 2024-04-25T09:03:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669414 s, 157 MB/s 2024-04-25T09:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067639 s, 155 MB/s 2024-04-25T09:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679582 s, 154 MB/s 2024-04-25T09:03:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741942 s, 141 MB/s 2024-04-25T09:03:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702344 s, 149 MB/s 2024-04-25T09:03:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698468 s, 150 MB/s 2024-04-25T09:03:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701269 s, 150 MB/s 2024-04-25T09:03:49.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.711 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741404 s, 141 MB/s 2024-04-25T09:03:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767993 s, 137 MB/s 2024-04-25T09:03:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737284 s, 142 MB/s 2024-04-25T09:03:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753812 s, 139 MB/s 2024-04-25T09:03:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840826 s, 125 MB/s 2024-04-25T09:03:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734202 s, 143 MB/s 2024-04-25T09:03:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751422 s, 140 MB/s 2024-04-25T09:03:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718517 s, 146 MB/s 2024-04-25T09:03:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711206 s, 147 MB/s 2024-04-25T09:03:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697755 s, 150 MB/s 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723785 s, 145 MB/s 2024-04-25T09:03:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734096 s, 143 MB/s 2024-04-25T09:03:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070354 s, 149 MB/s 2024-04-25T09:03:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765204 s, 137 MB/s 2024-04-25T09:03:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760847 s, 138 MB/s 2024-04-25T09:03:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753775 s, 139 MB/s 2024-04-25T09:03:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736484 s, 142 MB/s 2024-04-25T09:03:49.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699834 s, 150 MB/s 2024-04-25T09:03:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744872 s, 141 MB/s 2024-04-25T09:03:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646559 s, 162 MB/s 2024-04-25T09:03:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:03:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:03:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073903 s, 142 MB/s 2024-04-25T09:03:49.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:49.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:03:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.035+0000 7f02f7716640 1 Processor -- start 2024-04-25T09:03:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.035+0000 7f02f7716640 1 -- start start 2024-04-25T09:03:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f7716640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f015b7e0 0x7f02f00668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f7716640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f015bbc0 con 0x7f02f0066e30 2024-04-25T09:03:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f7716640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f015e3d0 con 0x7f02f00ae0c0 2024-04-25T09:03:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f7716640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f015f190 con 0x7f02f015b7e0 2024-04-25T09:03:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f4cb1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02f0066e30 0x7f02f00ad9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45762/0 (socket says 172.21.15.5:45762) 2024-04-25T09:03:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f4cb1640 1 -- 172.21.15.5:0/1186453657 learned_addr learned my addr 172.21.15.5:0/1186453657 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f54b2640 1 --2- 172.21.15.5:0/1186453657 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f015b7e0 0x7f02f00668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02e7fff640 1 -- 172.21.15.5:0/1186453657 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300954627 0 0) 0x7f02f015bbc0 con 0x7f02f0066e30 2024-04-25T09:03:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02e7fff640 1 -- 172.21.15.5:0/1186453657 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02dc003520 con 0x7f02f0066e30 2024-04-25T09:03:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f54b2640 1 -- 172.21.15.5:0/1186453657 >> v1:172.21.15.80:6789/0 conn(0x7f02f00ae0c0 legacy=0x7f02f00713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f54b2640 1 -- 172.21.15.5:0/1186453657 >> v1:172.21.15.5:6789/0 conn(0x7f02f0066e30 legacy=0x7f02f00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.036+0000 7f02f54b2640 1 -- 172.21.15.5:0/1186453657 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f015e6b0 con 0x7f02f015b7e0 2024-04-25T09:03:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.037+0000 7f02f54b2640 1 --2- 172.21.15.5:0/1186453657 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f015b7e0 0x7f02f00668f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0097d0 tx=0x7f02ec02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f8077d97878abfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.037+0000 7f02e7fff640 1 -- 172.21.15.5:0/1186453657 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec037070 con 0x7f02f015b7e0 2024-04-25T09:03:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.037+0000 7f02e7fff640 1 -- 172.21.15.5:0/1186453657 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec032440 con 0x7f02f015b7e0 2024-04-25T09:03:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.037+0000 7f02e7fff640 1 -- 172.21.15.5:0/1186453657 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec032810 con 0x7f02f015b7e0 2024-04-25T09:03:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.038+0000 7f02f7716640 1 -- 172.21.15.5:0/1186453657 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f015b7e0 msgr2=0x7f02f00668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.038+0000 7f02f7716640 1 --2- 172.21.15.5:0/1186453657 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f015b7e0 0x7f02f00668f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0097d0 tx=0x7f02ec02a180 comp rx=0 tx=0).stop 2024-04-25T09:03:50.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.038+0000 7f02f7716640 1 -- 172.21.15.5:0/1186453657 shutdown_connections 2024-04-25T09:03:50.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.038+0000 7f02f7716640 1 --2- 172.21.15.5:0/1186453657 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f015b7e0 0x7f02f00668f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.038+0000 7f02f7716640 1 -- 172.21.15.5:0/1186453657 >> 172.21.15.5:0/1186453657 conn(0x7f02f00d07f0 msgr2=0x7f02f00d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.038+0000 7f02f7716640 1 -- 172.21.15.5:0/1186453657 shutdown_connections 2024-04-25T09:03:50.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.038+0000 7f02f7716640 1 -- 172.21.15.5:0/1186453657 wait complete. 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.039+0000 7f02f7716640 1 Processor -- start 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.039+0000 7f02f7716640 1 -- start start 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f7716640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f0066e30 0x7f02f00b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f7716640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00ae0c0 0x7f02f0144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f7716640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02f015b7e0 0x7f02f015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f7716640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f015ed00 con 0x7f02f00ae0c0 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f7716640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0071b00 con 0x7f02f015b7e0 2024-04-25T09:03:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f7716640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0071c80 con 0x7f02f0066e30 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00ae0c0 0x7f02f0144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00ae0c0 0x7f02f0144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33290/0 (socket says 172.21.15.5:33290) 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 -- 172.21.15.5:0/501069161 learned_addr learned my addr 172.21.15.5:0/501069161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f54b2640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f0066e30 0x7f02f00b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02f015b7e0 0x7f02f015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 -- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f0066e30 msgr2=0x7f02f00b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f0066e30 0x7f02f00b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 -- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02f015b7e0 msgr2=0x7f02f015a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02f015b7e0 0x7f02f015a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f4cb1640 1 -- 172.21.15.5:0/501069161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f0146f80 con 0x7f02f00ae0c0 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.040+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02f015b7e0 0x7f02f015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.041+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00ae0c0 0x7f02f0144250 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c500 tx=0x7f02e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.041+0000 7f02e5ffb640 1 -- 172.21.15.5:0/501069161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0017070 con 0x7f02f00ae0c0 2024-04-25T09:03:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.041+0000 7f02e5ffb640 1 -- 172.21.15.5:0/501069161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0005ce0 con 0x7f02f00ae0c0 2024-04-25T09:03:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.041+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f0159760 con 0x7f02f00ae0c0 2024-04-25T09:03:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.041+0000 7f02e5ffb640 1 -- 172.21.15.5:0/501069161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0007330 con 0x7f02f00ae0c0 2024-04-25T09:03:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.041+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f00b1860 con 0x7f02f00ae0c0 2024-04-25T09:03:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.043+0000 7f02e5ffb640 1 -- 172.21.15.5:0/501069161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02e001a070 con 0x7f02f00ae0c0 2024-04-25T09:03:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.043+0000 7f02e5ffb640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02d406b4d0 0x7f02d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.043+0000 7f02e5ffb640 1 -- 172.21.15.5:0/501069161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02e00895e0 con 0x7f02f00ae0c0 2024-04-25T09:03:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.043+0000 7f02f54b2640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02d406b4d0 0x7f02d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.044+0000 7f02f54b2640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02d406b4d0 0x7f02d406d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f02ec034000 tx=0x7f02ec02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.044+0000 7f02fa417740 1 Processor -- start 2024-04-25T09:03:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.044+0000 7f02fa417740 1 -- start start 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02fa417740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58c0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58be5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a58e9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02fa417740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a5822000 con 0x55e9a58be200 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a57caf20 con 0x55e9a58fa8d0 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a581e0a0 con 0x55e9a58e8cc0 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58c0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33304/0 (socket says 172.21.15.5:33304) 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 -- 172.21.15.5:0/636977272 learned_addr learned my addr 172.21.15.5:0/636977272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a58e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58be5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 -- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 msgr2=0x55e9a58e9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a58e9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 -- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 msgr2=0x55e9a58be5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58be5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 -- 172.21.15.5:0/636977272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9a5602ba0 con 0x55e9a58be200 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a58e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02f54b2640 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58c0360 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0098c0 tx=0x7f02ec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a010eaf4ed3d29f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.045+0000 7f02daffd640 1 -- 172.21.15.5:0/636977272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec04e070 con 0x55e9a58be200 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02daffd640 1 -- 172.21.15.5:0/636977272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec032e30 con 0x55e9a58be200 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02daffd640 1 -- 172.21.15.5:0/636977272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec037040 con 0x55e9a58be200 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 -- 172.21.15.5:0/636977272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 msgr2=0x55e9a58c0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58c0360 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0098c0 tx=0x7f02ec02c000 comp rx=0 tx=0).stop 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 -- 172.21.15.5:0/636977272 shutdown_connections 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a58e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58be5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 --2- 172.21.15.5:0/636977272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58c0360 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 -- 172.21.15.5:0/636977272 >> 172.21.15.5:0/636977272 conn(0x55e9a5886050 msgr2=0x55e9a5903cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 -- 172.21.15.5:0/636977272 shutdown_connections 2024-04-25T09:03:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.046+0000 7f02fa417740 1 -- 172.21.15.5:0/636977272 wait complete. 2024-04-25T09:03:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.047+0000 7f02fa417740 1 -- start start 2024-04-25T09:03:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.047+0000 7f02fa417740 1 Processor -- start 2024-04-25T09:03:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58fd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58e8cc0 0x55e9a58fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58fa8d0 0x55e9a58d6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a57c0610 con 0x55e9a58be200 2024-04-25T09:03:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a58e6810 con 0x55e9a58e8cc0 2024-04-25T09:03:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a58d4080 con 0x55e9a58fa8d0 2024-04-25T09:03:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 10 client.0 _ll_register_callbacks cb 0x55e9a57d8f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58fd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33314/0 (socket says 172.21.15.5:33314) 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 -- 172.21.15.5:0/182252633 learned_addr learned my addr 172.21.15.5:0/182252633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58fa8d0 0x55e9a58d6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58e8cc0 0x55e9a58fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 -- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58fa8d0 msgr2=0x55e9a58d6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58fa8d0 0x55e9a58d6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 -- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58e8cc0 msgr2=0x55e9a58fd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58e8cc0 0x55e9a58fd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 -- 172.21.15.5:0/182252633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9a54f6490 con 0x55e9a58be200 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58e8cc0 0x55e9a58fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02f54b2640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58fd450 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f02ec032b80 tx=0x7f02ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6239d2d8fb9daaba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02cffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02cffff640 1 -- 172.21.15.5:0/182252633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec04e030 con 0x55e9a58be200 2024-04-25T09:03:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02cffff640 1 -- 172.21.15.5:0/182252633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02ec045040 con 0x55e9a58be200 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.048+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02ec032e30 con 0x55e9a58be200 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02cffff640 1 -- 172.21.15.5:0/182252633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02ec05e050 con 0x55e9a58be200 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 10 client.8142 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55e9a5663330 con 0x55e9a58be200 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02cffff640 1 -- 172.21.15.5:0/182252633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec032e30 con 0x55e9a58be200 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02cffff640 1 -- 172.21.15.5:0/182252633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02ec061020 con 0x55e9a58be200 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 10 client.8142 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 10 client.8142 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 20 client.8142 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a59049d0 0x55e9a58d5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 4 client.8142 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9a582f540 con 0x55e9a59049d0 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.049+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a59049d0 0x55e9a58d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02cffff640 10 client.8142 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a59049d0 0x55e9a58d5690 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62bcced8286dfff6 server_cookie=1aaded8b36d569d8 in_seq=0 out_seq=0 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02cffff640 1 -- 172.21.15.5:0/182252633 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e9a582f540 con 0x55e9a59049d0 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02cffff640 10 client.8142 handle_command_reply: tid=0 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 client.8142 shutdown 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 msgr2=0x55e9a58fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58fd450 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f02ec032b80 tx=0x7f02ec004730 comp rx=0 tx=0).stop 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 shutdown_connections 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a59049d0 0x55e9a58d5690 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58fa8d0 0x55e9a58d6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58e8cc0 0x55e9a58fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02cffff640 0 client.8142 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 --2- 172.21.15.5:0/182252633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a58fd450 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 >> 172.21.15.5:0/182252633 conn(0x55e9a5886050 msgr2=0x55e9a58e5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 shutdown_connections 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.050+0000 7f02fa417740 1 -- 172.21.15.5:0/182252633 wait complete. 2024-04-25T09:03:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.051+0000 7f02fa417740 20 client.8142 trim_cache size 0 max 16384 2024-04-25T09:03:50.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 Processor -- start 2024-04-25T09:03:50.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 -- start start 2024-04-25T09:03:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58be200 0x55e9a5965770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58e8cc0 0x55e9a5912810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01ffdd0 con 0x55e9a58e8cc0 2024-04-25T09:03:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0158660 con 0x55e9a58fa8d0 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0143f70 con 0x55e9a58be200 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.066+0000 7f02f4cb1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58e8cc0 0x55e9a5912810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58e8cc0 0x55e9a5912810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33316/0 (socket says 172.21.15.5:33316) 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 -- 172.21.15.5:0/4225490838 learned_addr learned my addr 172.21.15.5:0/4225490838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f54b2640 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58be200 0x55e9a5965770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 -- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58be200 msgr2=0x55e9a5965770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58be200 0x55e9a5965770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 -- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 msgr2=0x55e9a58e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 -- 172.21.15.5:0/4225490838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9a54cf610 con 0x55e9a58e8cc0 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58e8cc0 0x55e9a5912810 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f02e0005fd0 tx=0x7f02e0087a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c065428b6e55b304 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02da7fc640 1 -- 172.21.15.5:0/4225490838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0054520 con 0x55e9a58e8cc0 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02da7fc640 1 -- 172.21.15.5:0/4225490838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0058110 con 0x55e9a58e8cc0 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.067+0000 7f02da7fc640 1 -- 172.21.15.5:0/4225490838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00546c0 con 0x55e9a58e8cc0 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 -- 172.21.15.5:0/4225490838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58e8cc0 msgr2=0x55e9a5912810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58e8cc0 0x55e9a5912810 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f02e0005fd0 tx=0x7f02e0087a70 comp rx=0 tx=0).stop 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 -- 172.21.15.5:0/4225490838 shutdown_connections 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a58e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58e8cc0 0x55e9a5912810 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 --2- 172.21.15.5:0/4225490838 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58be200 0x55e9a5965770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 -- 172.21.15.5:0/4225490838 >> 172.21.15.5:0/4225490838 conn(0x55e9a5886050 msgr2=0x55e9a58fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 -- 172.21.15.5:0/4225490838 shutdown_connections 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 -- 172.21.15.5:0/4225490838 wait complete. 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 -- start start 2024-04-25T09:03:50.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.068+0000 7f02fa417740 1 Processor -- start 2024-04-25T09:03:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02fa417740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a5906e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a5962470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02fa417740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a59161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02fa417740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0158060 con 0x55e9a58be200 2024-04-25T09:03:50.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a5907650 con 0x55e9a58fa8d0 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02fa417740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a58bce60 con 0x55e9a58e8cc0 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02fa417740 10 client.0 _ll_register_callbacks cb 0x7f02ec035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02f54b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a5906e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02f54b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a5906e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33322/0 (socket says 172.21.15.5:33322) 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02f54b2640 1 -- 172.21.15.5:0/1696326744 learned_addr learned my addr 172.21.15.5:0/1696326744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a5962470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.069+0000 7f02f5cb3640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a59161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02f54b2640 1 -- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 msgr2=0x55e9a5962470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02f54b2640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a5962470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02f54b2640 1 -- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 msgr2=0x55e9a59161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02f54b2640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a59161e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02f54b2640 1 -- 172.21.15.5:0/1696326744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9a58feb80 con 0x55e9a58be200 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a5962470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02f54b2640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a5906e00 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009560 tx=0x7f02ec008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ec73a3f3892448 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02cffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02cffff640 1 -- 172.21.15.5:0/1696326744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec04e070 con 0x55e9a58be200 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02cffff640 1 -- 172.21.15.5:0/1696326744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02ec054640 con 0x55e9a58be200 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02e0058110 con 0x55e9a58be200 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02cffff640 1 -- 172.21.15.5:0/1696326744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02ec037040 con 0x55e9a58be200 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 10 client.8148 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55e9a58d3770 con 0x55e9a58be200 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02cffff640 1 -- 172.21.15.5:0/1696326744 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0058110 con 0x55e9a58be200 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02cffff640 1 -- 172.21.15.5:0/1696326744 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02ec061040 con 0x55e9a58be200 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 10 client.8148 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 10 client.8148 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 20 client.8148 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a5916720 0x55e9a58e7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 4 client.8148 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:03:50.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.070+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x55e9a5829890 con 0x55e9a5916720 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.071+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a5916720 0x55e9a58e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.071+0000 7f02f4cb1640 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a5916720 0x55e9a58e7720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b93f165ed4bb9e5 server_cookie=9c4526810eb39020 in_seq=0 out_seq=0 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.071+0000 7f02cffff640 10 client.8148 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02cffff640 1 -- 172.21.15.5:0/1696326744 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e9a5829890 con 0x55e9a5916720 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02cffff640 10 client.8148 handle_command_reply: tid=0 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 client.8148 shutdown 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 msgr2=0x55e9a5906e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a5906e00 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009560 tx=0x7f02ec008030 comp rx=0 tx=0).stop 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 shutdown_connections 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9a58fa8d0 0x55e9a59161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55e9a5916720 0x55e9a58e7720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e9a58e8cc0 0x55e9a5962470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 --2- 172.21.15.5:0/1696326744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9a58be200 0x55e9a5906e00 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02cffff640 0 client.8148 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 >> 172.21.15.5:0/1696326744 conn(0x55e9a5886050 msgr2=0x55e9a5964cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 shutdown_connections 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.073+0000 7f02fa417740 1 -- 172.21.15.5:0/1696326744 wait complete. 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02fa417740 20 client.8148 trim_cache size 0 max 16384 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "a0c610a3-abe3-473c-8010-a7e8fb11f525", 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T09:03:50.067 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02d406b4d0 msgr2=0x7f02d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02d406b4d0 0x7f02d406d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f02ec034000 tx=0x7f02ec02e000 comp rx=0 tx=0).stop 2024-04-25T09:03:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00ae0c0 msgr2=0x7f02f0144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00ae0c0 0x7f02f0144250 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c500 tx=0x7f02e000c9c0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 shutdown_connections 2024-04-25T09:03:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f02d406b4d0 0x7f02d406d990 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02f015b7e0 0x7f02f015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00ae0c0 0x7f02f0144250 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 --2- 172.21.15.5:0/501069161 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02f0066e30 0x7f02f00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 >> 172.21.15.5:0/501069161 conn(0x7f02f00d07f0 msgr2=0x7f02f00cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 shutdown_connections 2024-04-25T09:03:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.074+0000 7f02f7716640 1 -- 172.21.15.5:0/501069161 wait complete. 2024-04-25T09:03:50.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:50.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub pause 2024-04-25T09:03:50.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.200+0000 7f8f6b1fe640 1 Processor -- start 2024-04-25T09:03:50.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.200+0000 7f8f6b1fe640 1 -- start start 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f6b1fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f640d0c80 0x7f8f6406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f6b1fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f640cc780 0x7f8f640ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f6b1fe640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640d27f0 con 0x7f8f6415e0b0 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f6b1fe640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640cfee0 con 0x7f8f640d0c80 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f6b1fe640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640d01c0 con 0x7f8f640cc780 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f63fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f640d0c80 0x7f8f6406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f63fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f640d0c80 0x7f8f6406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33334/0 (socket says 172.21.15.5:33334) 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f68f9a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8f6415e0b0 0x7f8f640cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45776/0 (socket says 172.21.15.5:45776) 2024-04-25T09:03:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f63fff640 1 -- 172.21.15.5:0/2076579510 learned_addr learned my addr 172.21.15.5:0/2076579510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.201+0000 7f8f6979b640 1 --2- 172.21.15.5:0/2076579510 >> v2:172.21.15.80:3300/0 conn(0x7f8f640cc780 0x7f8f640ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f63fff640 1 -- 172.21.15.5:0/2076579510 >> v2:172.21.15.80:3300/0 conn(0x7f8f640cc780 msgr2=0x7f8f640ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2076579510 >> v2:172.21.15.80:3300/0 conn(0x7f8f640cc780 0x7f8f640ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f63fff640 1 -- 172.21.15.5:0/2076579510 >> v1:172.21.15.5:6789/0 conn(0x7f8f6415e0b0 legacy=0x7f8f640cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f637fe640 1 -- 172.21.15.5:0/2076579510 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611078350 0 0) 0x7f8f640d27f0 con 0x7f8f6415e0b0 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f63fff640 1 -- 172.21.15.5:0/2076579510 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640d04a0 con 0x7f8f640d0c80 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2076579510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640d0c80 0x7f8f6406adf0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009870 tx=0x7f8f5802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b598a4019a103cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f637fe640 1 -- 172.21.15.5:0/2076579510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58037070 con 0x7f8f640d0c80 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f637fe640 1 -- 172.21.15.5:0/2076579510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f58032440 con 0x7f8f640d0c80 2024-04-25T09:03:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.202+0000 7f8f637fe640 1 -- 172.21.15.5:0/2076579510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58032810 con 0x7f8f640d0c80 2024-04-25T09:03:50.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2076579510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640d0c80 msgr2=0x7f8f6406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2076579510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640d0c80 0x7f8f6406adf0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009870 tx=0x7f8f5802a2a0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2076579510 shutdown_connections 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2076579510 >> v2:172.21.15.80:3300/0 conn(0x7f8f640cc780 0x7f8f640ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2076579510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640d0c80 0x7f8f6406adf0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2076579510 >> 172.21.15.5:0/2076579510 conn(0x7f8f640d1a20 msgr2=0x7f8f640d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2076579510 shutdown_connections 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.203+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2076579510 wait complete. 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.204+0000 7f8f6b1fe640 1 Processor -- start 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.204+0000 7f8f6b1fe640 1 -- start start 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f6b1fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640cc780 0x7f8f6414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f6b1fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8f640d0c80 0x7f8f640cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f6b1fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f6415e0b0 0x7f8f64160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f6b1fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640cfb90 con 0x7f8f640cc780 2024-04-25T09:03:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f6b1fe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6415e490 con 0x7f8f6415e0b0 2024-04-25T09:03:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f6b1fe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640ccc30 con 0x7f8f640d0c80 2024-04-25T09:03:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f68f9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640cc780 0x7f8f6414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f68f9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640cc780 0x7f8f6414fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33346/0 (socket says 172.21.15.5:33346) 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f68f9a640 1 -- 172.21.15.5:0/2493445428 learned_addr learned my addr 172.21.15.5:0/2493445428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f6979b640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f6415e0b0 0x7f8f64160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.205+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8f640d0c80 0x7f8f640cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f68f9a640 1 -- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8f640d0c80 msgr2=0x7f8f640cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8f640d0c80 0x7f8f640cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f68f9a640 1 -- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f6415e0b0 msgr2=0x7f8f64160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f6415e0b0 0x7f8f64160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f68f9a640 1 -- 172.21.15.5:0/2493445428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6415fb00 con 0x7f8f640cc780 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8f640d0c80 0x7f8f640cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640cc780 0x7f8f6414fd00 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c430 tx=0x7f8f5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f617fa640 1 -- 172.21.15.5:0/2493445428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f540074e0 con 0x7f8f640cc780 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f617fa640 1 -- 172.21.15.5:0/2493445428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f540047e0 con 0x7f8f640cc780 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f617fa640 1 -- 172.21.15.5:0/2493445428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54004bd0 con 0x7f8f640cc780 2024-04-25T09:03:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6415fde0 con 0x7f8f640cc780 2024-04-25T09:03:50.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.206+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f641603a0 con 0x7f8f640cc780 2024-04-25T09:03:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.208+0000 7f8f617fa640 1 -- 172.21.15.5:0/2493445428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f54011070 con 0x7f8f640cc780 2024-04-25T09:03:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.208+0000 7f8f617fa640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8f5006b4d0 0x7f8f5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.208+0000 7f8f617fa640 1 -- 172.21.15.5:0/2493445428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f54089d50 con 0x7f8f640cc780 2024-04-25T09:03:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.208+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8f5006b4d0 0x7f8f5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.209+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8f5006b4d0 0x7f8f5006d990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f58034000 tx=0x7f8f5802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.209+0000 7f8f6dfd6740 1 Processor -- start 2024-04-25T09:03:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.209+0000 7f8f6dfd6740 1 -- start start 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 0x55922212de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222156760 0x559222156be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922208eb90 con 0x559222168370 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559222037e40 con 0x559222156760 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55922208ac30 con 0x55922212bca0 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33356/0 (socket says 172.21.15.5:33356) 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 -- 172.21.15.5:0/3579008007 learned_addr learned my addr 172.21.15.5:0/3579008007 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 0x55922212de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f6979b640 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222156760 0x559222156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 -- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 msgr2=0x55922212de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 0x55922212de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 -- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222156760 msgr2=0x559222156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222156760 0x559222156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 -- 172.21.15.5:0/3579008007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559221e6d7d0 con 0x559222168370 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f63fff640 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212c080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f8f5802a890 tx=0x7f8f5802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abae2135bb56b741 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f4a7fc640 1 -- 172.21.15.5:0/3579008007 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5804e070 con 0x559222168370 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f4a7fc640 1 -- 172.21.15.5:0/3579008007 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5803e460 con 0x559222168370 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.210+0000 7f8f4a7fc640 1 -- 172.21.15.5:0/3579008007 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58037040 con 0x559222168370 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3579008007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 msgr2=0x55922212c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212c080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f8f5802a890 tx=0x7f8f5802c000 comp rx=0 tx=0).stop 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3579008007 shutdown_connections 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222156760 0x559222156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212c080 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3579008007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 0x55922212de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3579008007 >> 172.21.15.5:0/3579008007 conn(0x5592220f3870 msgr2=0x559222171760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3579008007 shutdown_connections 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.211+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3579008007 wait complete. 2024-04-25T09:03:50.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.212+0000 7f8f6dfd6740 1 -- start start 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.212+0000 7f8f6dfd6740 1 Processor -- start 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x5592221816d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222168370 0x559222181c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922204b3e0 con 0x559222156760 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592221542b0 con 0x55922212bca0 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x559222182a10 con 0x559222168370 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6dfd6740 10 client.0 _ll_register_callbacks cb 0x55922204adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x5592221816d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x5592221816d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33364/0 (socket says 172.21.15.5:33364) 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 -- 172.21.15.5:0/2101530691 learned_addr learned my addr 172.21.15.5:0/2101530691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f6979b640 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222168370 0x559222181c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 -- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222168370 msgr2=0x559222181c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222168370 0x559222181c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 -- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 msgr2=0x5592221575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 -- 172.21.15.5:0/2101530691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559221d630f0 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x5592221816d0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009990 tx=0x7f8f58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4534c6740543cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f437fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.213+0000 7f8f437fe640 1 -- 172.21.15.5:0/2101530691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5804e030 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f437fe640 1 -- 172.21.15.5:0/2101530691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f5803ea80 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f5803e460 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f437fe640 1 -- 172.21.15.5:0/2101530691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f58037040 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 10 client.8163 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x559221ecdf60 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f437fe640 1 -- 172.21.15.5:0/2101530691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5803e460 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f437fe640 1 -- 172.21.15.5:0/2101530691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8f5803ec80 con 0x559222156760 2024-04-25T09:03:50.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 10 client.8163 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 10 client.8163 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 20 client.8163 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221513e0 0x5592221698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 4 client.8163 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55922209c0d0 con 0x5592221513e0 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.214+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221513e0 0x5592221698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f437fe640 10 client.8163 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221513e0 0x5592221698f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76331d70d2d91727 server_cookie=dfc9859dcfa3efb6 in_seq=0 out_seq=0 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f437fe640 1 -- 172.21.15.5:0/2101530691 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55922209c0d0 con 0x5592221513e0 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f437fe640 10 client.8163 handle_command_reply: tid=0 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 client.8163 shutdown 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 msgr2=0x5592221816d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x5592221816d0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009990 tx=0x7f8f58004730 comp rx=0 tx=0).stop 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 shutdown_connections 2024-04-25T09:03:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221513e0 0x5592221698f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222168370 0x559222181c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x5592221816d0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2101530691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f437fe640 0 client.8163 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 >> 172.21.15.5:0/2101530691 conn(0x5592220f3870 msgr2=0x559222174b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 shutdown_connections 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2101530691 wait complete. 2024-04-25T09:03:50.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.215+0000 7f8f6dfd6740 20 client.8163 trim_cache size 0 max 16384 2024-04-25T09:03:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.230+0000 7f8f6dfd6740 1 Processor -- start 2024-04-25T09:03:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.230+0000 7f8f6dfd6740 1 -- start start 2024-04-25T09:03:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 0x559222156b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x559222157080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222168370 0x559222154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641ffd50 con 0x559222156760 2024-04-25T09:03:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641fef00 con 0x559222168370 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641fe3c0 con 0x55922212bca0 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x559222157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x559222157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33366/0 (socket says 172.21.15.5:33366) 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 -- 172.21.15.5:0/3413314615 learned_addr learned my addr 172.21.15.5:0/3413314615 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 -- 172.21.15.5:0/3413314615 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 msgr2=0x559222156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 --2- 172.21.15.5:0/3413314615 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 0x559222156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 -- 172.21.15.5:0/3413314615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222168370 msgr2=0x559222154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 --2- 172.21.15.5:0/3413314615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222168370 0x559222154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 -- 172.21.15.5:0/3413314615 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559221d3c1b0 con 0x559222156760 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.231+0000 7f8f63fff640 1 --2- 172.21.15.5:0/3413314615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x559222157080 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8f580090b0 tx=0x7f8f58041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea75dc0e15f064 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f49ffb640 1 -- 172.21.15.5:0/3413314615 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5804e070 con 0x559222156760 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f49ffb640 1 -- 172.21.15.5:0/3413314615 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f58050070 con 0x559222156760 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f49ffb640 1 -- 172.21.15.5:0/3413314615 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5803e460 con 0x559222156760 2024-04-25T09:03:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3413314615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 msgr2=0x559222157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3413314615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x559222157080 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8f580090b0 tx=0x7f8f58041000 comp rx=0 tx=0).stop 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3413314615 shutdown_connections 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3413314615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559222168370 0x559222154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3413314615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222156760 0x559222157080 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/3413314615 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55922212bca0 0x559222156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3413314615 >> 172.21.15.5:0/3413314615 conn(0x5592220f3870 msgr2=0x559222150640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3413314615 shutdown_connections 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.232+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/3413314615 wait complete. 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.233+0000 7f8f6dfd6740 1 -- start start 2024-04-25T09:03:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.233+0000 7f8f6dfd6740 1 Processor -- start 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222156760 0x559222172f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592221721c0 con 0x559222168370 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641fe900 con 0x55922212bca0 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x559222157b30 con 0x559222156760 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 10 client.0 _ll_register_callbacks cb 0x7f8f5804c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33374/0 (socket says 172.21.15.5:33374) 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f68f9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 -- 172.21.15.5:0/2905173721 learned_addr learned my addr 172.21.15.5:0/2905173721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f63fff640 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222156760 0x559222172f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 -- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222156760 msgr2=0x559222172f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222156760 0x559222172f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 -- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 msgr2=0x5592221d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 -- 172.21.15.5:0/2905173721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559222173490 con 0x559222168370 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6979b640 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212b1e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0046c0 tx=0x7f8f5c0156a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c061a1fb921fdb06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f437fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f437fe640 1 -- 172.21.15.5:0/2905173721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c01c030 con 0x559222168370 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f437fe640 1 -- 172.21.15.5:0/2905173721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f5c012040 con 0x559222168370 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f58050070 con 0x559222168370 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.234+0000 7f8f437fe640 1 -- 172.21.15.5:0/2905173721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f5c009d70 con 0x559222168370 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 10 client.8169 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x5592221736a0 con 0x559222168370 2024-04-25T09:03:50.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f437fe640 1 -- 172.21.15.5:0/2905173721 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f58050070 con 0x559222168370 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f437fe640 1 -- 172.21.15.5:0/2905173721 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8f5c02b080 con 0x559222168370 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 10 client.8169 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 10 client.8169 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 20 client.8169 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221517d0 0x559222154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 4 client.8169 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x559222096420 con 0x5592221517d0 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221517d0 0x559222154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f68f9a640 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221517d0 0x559222154910 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b99e01618286319 server_cookie=68390fb2d388943f in_seq=0 out_seq=0 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f437fe640 10 client.8169 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f437fe640 1 -- 172.21.15.5:0/2905173721 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x559222096420 con 0x5592221517d0 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f437fe640 10 client.8169 handle_command_reply: tid=0 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.235+0000 7f8f6dfd6740 1 client.8169 shutdown 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 msgr2=0x55922212b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212b1e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0046c0 tx=0x7f8f5c0156a0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 shutdown_connections 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559222168370 0x55922212b1e0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x5592221517d0 0x559222154910 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x559222156760 0x559222172f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 --2- 172.21.15.5:0/2905173721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55922212bca0 0x5592221d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f437fe640 0 client.8169 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 >> 172.21.15.5:0/2905173721 conn(0x5592220f3870 msgr2=0x559222156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 shutdown_connections 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 1 -- 172.21.15.5:0/2905173721 wait complete. 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6dfd6740 20 client.8169 trim_cache size 0 max 16384 2024-04-25T09:03:50.230 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T09:03:50.231 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8f5006b4d0 msgr2=0x7f8f5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8f5006b4d0 0x7f8f5006d990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f58034000 tx=0x7f8f5802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640cc780 msgr2=0x7f8f6414fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640cc780 0x7f8f6414fd00 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c430 tx=0x7f8f5400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 shutdown_connections 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8f5006b4d0 0x7f8f5006d990 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f6415e0b0 0x7f8f64160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8f640d0c80 0x7f8f640cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 --2- 172.21.15.5:0/2493445428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f640cc780 0x7f8f6414fd00 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 >> 172.21.15.5:0/2493445428 conn(0x7f8f640d1a20 msgr2=0x7f8f640ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 shutdown_connections 2024-04-25T09:03:50.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.236+0000 7f8f6b1fe640 1 -- 172.21.15.5:0/2493445428 wait complete. 2024-04-25T09:03:50.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:50.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:03:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.349+0000 7f598b7c8640 1 Processor -- start 2024-04-25T09:03:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.349+0000 7f598b7c8640 1 -- start start 2024-04-25T09:03:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f598b7c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f598415df10 0x7f59841618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f598b7c8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59840cefe0 0x7f59840d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f598b7c8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5984162150 con 0x7f59840b6250 2024-04-25T09:03:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f598b7c8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59840d20d0 con 0x7f598415df10 2024-04-25T09:03:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f598b7c8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5984162430 con 0x7f59840cefe0 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f5989564640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f598415df10 0x7f59841618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f5988d63640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f59840b6250 0x7f59840ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45788/0 (socket says 172.21.15.5:45788) 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f5988d63640 1 -- 172.21.15.5:0/679874945 learned_addr learned my addr 172.21.15.5:0/679874945 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f5989564640 1 --2- 172.21.15.5:0/679874945 >> v2:172.21.15.5:3300/0 conn(0x7f598415df10 0x7f59841618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33382/0 (socket says 172.21.15.5:33382) 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.350+0000 7f5989d65640 1 --2- 172.21.15.5:0/679874945 >> v2:172.21.15.80:3300/0 conn(0x7f59840cefe0 0x7f59840d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5989564640 1 -- 172.21.15.5:0/679874945 >> v2:172.21.15.80:3300/0 conn(0x7f59840cefe0 msgr2=0x7f59840d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5989564640 1 --2- 172.21.15.5:0/679874945 >> v2:172.21.15.80:3300/0 conn(0x7f59840cefe0 0x7f59840d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5989564640 1 -- 172.21.15.5:0/679874945 >> v1:172.21.15.5:6789/0 conn(0x7f59840b6250 legacy=0x7f59840ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5983fff640 1 -- 172.21.15.5:0/679874945 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014231390 0 0) 0x7f5984162150 con 0x7f59840b6250 2024-04-25T09:03:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5989564640 1 -- 172.21.15.5:0/679874945 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984162710 con 0x7f598415df10 2024-04-25T09:03:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5989564640 1 --2- 172.21.15.5:0/679874945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f598415df10 0x7f59841618d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f59840b3610 tx=0x7f597402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c884c2a9e617b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5983fff640 1 -- 172.21.15.5:0/679874945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974007740 con 0x7f598415df10 2024-04-25T09:03:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.351+0000 7f5983fff640 1 -- 172.21.15.5:0/679874945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740078e0 con 0x7f598415df10 2024-04-25T09:03:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f5983fff640 1 -- 172.21.15.5:0/679874945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974007cb0 con 0x7f598415df10 2024-04-25T09:03:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 -- 172.21.15.5:0/679874945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f598415df10 msgr2=0x7f59841618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 --2- 172.21.15.5:0/679874945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f598415df10 0x7f59841618d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f59840b3610 tx=0x7f597402a680 comp rx=0 tx=0).stop 2024-04-25T09:03:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 -- 172.21.15.5:0/679874945 shutdown_connections 2024-04-25T09:03:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 --2- 172.21.15.5:0/679874945 >> v2:172.21.15.80:3300/0 conn(0x7f59840cefe0 0x7f59840d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 --2- 172.21.15.5:0/679874945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f598415df10 0x7f59841618d0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 -- 172.21.15.5:0/679874945 >> 172.21.15.5:0/679874945 conn(0x7f59840668f0 msgr2=0x7f5984066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 -- 172.21.15.5:0/679874945 shutdown_connections 2024-04-25T09:03:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.352+0000 7f598b7c8640 1 -- 172.21.15.5:0/679874945 wait complete. 2024-04-25T09:03:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.353+0000 7f598b7c8640 1 Processor -- start 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.353+0000 7f598b7c8640 1 -- start start 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f598b7c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59840b6250 0x7f5984158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f598b7c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59840cefe0 0x7f59840b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f598b7c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f598415df10 0x7f59841602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f598b7c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840d2aa0 con 0x7f59840b6250 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f598b7c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5984161e10 con 0x7f59840cefe0 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f598b7c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840d2c20 con 0x7f598415df10 2024-04-25T09:03:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59840b6250 0x7f5984158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59840b6250 0x7f5984158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33392/0 (socket says 172.21.15.5:33392) 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 -- 172.21.15.5:0/2867800271 learned_addr learned my addr 172.21.15.5:0/2867800271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989d65640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f598415df10 0x7f59841602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5988d63640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59840cefe0 0x7f59840b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 -- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f598415df10 msgr2=0x7f59841602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f598415df10 0x7f59841602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 -- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59840cefe0 msgr2=0x7f59840b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59840cefe0 0x7f59840b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5989564640 1 -- 172.21.15.5:0/2867800271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598415f290 con 0x7f59840b6250 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.354+0000 7f5988d63640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59840cefe0 0x7f59840b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.355+0000 7f5989564640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59840b6250 0x7f5984158a70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f597402ac70 tx=0x7f5974004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.355+0000 7f5981ffb640 1 -- 172.21.15.5:0/2867800271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597403f070 con 0x7f59840b6250 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.355+0000 7f5981ffb640 1 -- 172.21.15.5:0/2867800271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974031c40 con 0x7f59840b6250 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.355+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598415f530 con 0x7f59840b6250 2024-04-25T09:03:50.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.355+0000 7f5981ffb640 1 -- 172.21.15.5:0/2867800271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974009450 con 0x7f59840b6250 2024-04-25T09:03:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.355+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598415faf0 con 0x7f59840b6250 2024-04-25T09:03:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.356+0000 7f5981ffb640 1 -- 172.21.15.5:0/2867800271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5974043410 con 0x7f59840b6250 2024-04-25T09:03:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.357+0000 7f5981ffb640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f597006b4d0 0x7f597006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.357+0000 7f5981ffb640 1 -- 172.21.15.5:0/2867800271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59740ab530 con 0x7f59840b6250 2024-04-25T09:03:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.357+0000 7f5988d63640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f597006b4d0 0x7f597006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.357+0000 7f5988d63640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f597006b4d0 0x7f597006d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f59840ce500 tx=0x7f5978007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.358+0000 7f598e5a7740 1 Processor -- start 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.358+0000 7f598e5a7740 1 -- start start 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1ea320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1ba770 0x55d51e1bdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f598e5a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51e123da0 con 0x55d51e1e7ef0 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51e0ccb80 con 0x55d51e1ba770 2024-04-25T09:03:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d51e11fe40 con 0x55d51e1e7b10 2024-04-25T09:03:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33406/0 (socket says 172.21.15.5:33406) 2024-04-25T09:03:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 -- 172.21.15.5:0/2901553413 learned_addr learned my addr 172.21.15.5:0/2901553413 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5989564640 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5989d65640 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1ba770 0x55d51e1bdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 -- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 msgr2=0x55d51e1ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1ea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 -- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1ba770 msgr2=0x55d51e1bdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1ba770 0x55d51e1bdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 -- 172.21.15.5:0/2901553413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d51e0d6f10 con 0x55d51e1e7ef0 2024-04-25T09:03:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5989564640 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f5988d63640 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ea860 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f5978005db0 tx=0x7f5978012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9db5426d578c20c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f596affd640 1 -- 172.21.15.5:0/2901553413 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978015110 con 0x55d51e1e7ef0 2024-04-25T09:03:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f596affd640 1 -- 172.21.15.5:0/2901553413 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59780159c0 con 0x55d51e1e7ef0 2024-04-25T09:03:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.359+0000 7f596affd640 1 -- 172.21.15.5:0/2901553413 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978015d70 con 0x55d51e1e7ef0 2024-04-25T09:03:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 -- 172.21.15.5:0/2901553413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 msgr2=0x55d51e1ea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ea860 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f5978005db0 tx=0x7f5978012000 comp rx=0 tx=0).stop 2024-04-25T09:03:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 -- 172.21.15.5:0/2901553413 shutdown_connections 2024-04-25T09:03:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1ba770 0x55d51e1bdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ea860 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2901553413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 -- 172.21.15.5:0/2901553413 >> 172.21.15.5:0/2901553413 conn(0x55d51e1bc9e0 msgr2=0x55d51e205320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 -- 172.21.15.5:0/2901553413 shutdown_connections 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.360+0000 7f598e5a7740 1 -- 172.21.15.5:0/2901553413 wait complete. 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.361+0000 7f598e5a7740 1 -- start start 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.361+0000 7f598e5a7740 1 Processor -- start 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e208f20 0x55d51e1de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51e1bfb90 con 0x55d51e1e7ef0 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51e0c24b0 con 0x55d51e208f20 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d51e1bfe70 con 0x55d51e1e7b10 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 10 client.0 _ll_register_callbacks cb 0x55d51e102180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1de4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33410/0 (socket says 172.21.15.5:33410) 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 -- 172.21.15.5:0/3116258062 learned_addr learned my addr 172.21.15.5:0/3116258062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5989564640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5989d65640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e208f20 0x55d51e1de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 -- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 msgr2=0x55d51e1dd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1dd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 -- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e208f20 msgr2=0x55d51e1de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e208f20 0x55d51e1de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 -- 172.21.15.5:0/3116258062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d51df027d0 con 0x55d51e1e7ef0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5989d65640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e208f20 0x55d51e1de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5988d63640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1de4b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f59780011e0 tx=0x7f5978000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d360536d64968fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5963fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5963fff640 1 -- 172.21.15.5:0/3116258062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978015290 con 0x55d51e1e7ef0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5963fff640 1 -- 172.21.15.5:0/3116258062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5978010070 con 0x55d51e1e7ef0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59780159c0 con 0x55d51e1e7ef0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f5963fff640 1 -- 172.21.15.5:0/3116258062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5978034050 con 0x55d51e1e7ef0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 10 client.8184 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.362+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55d51de383f0 con 0x55d51e1e7ef0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f5963fff640 1 -- 172.21.15.5:0/3116258062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59780159c0 con 0x55d51e1e7ef0 2024-04-25T09:03:50.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f5963fff640 1 -- 172.21.15.5:0/3116258062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5978037020 con 0x55d51e1e7ef0 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f598e5a7740 10 client.8184 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f598e5a7740 10 client.8184 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f598e5a7740 20 client.8184 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f598e5a7740 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e1dfb60 0x55d51e206450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f598e5a7740 4 client.8184 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d51e1312e0 con 0x55d51e1dfb60 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f5989564640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e1dfb60 0x55d51e206450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f5963fff640 10 client.8184 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.363+0000 7f5989564640 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e1dfb60 0x55d51e206450 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2418f8c83686ea23 server_cookie=180f4686458190b6 in_seq=0 out_seq=0 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f5963fff640 1 -- 172.21.15.5:0/3116258062 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d51e1312e0 con 0x55d51e1dfb60 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f5963fff640 10 client.8184 handle_command_reply: tid=0 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 client.8184 shutdown 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 msgr2=0x55d51e1de4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1de4b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f59780011e0 tx=0x7f5978000ed0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 shutdown_connections 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e208f20 0x55d51e1de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7ef0 0x55d51e1de4b0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e1dfb60 0x55d51e206450 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 --2- 172.21.15.5:0/3116258062 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e1e7b10 0x55d51e1dd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f5963fff640 0 client.8184 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 >> 172.21.15.5:0/3116258062 conn(0x55d51e1ba770 msgr2=0x55d51e1e6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 shutdown_connections 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 1 -- 172.21.15.5:0/3116258062 wait complete. 2024-04-25T09:03:50.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.364+0000 7f598e5a7740 20 client.8184 trim_cache size 0 max 16384 2024-04-25T09:03:50.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 Processor -- start 2024-04-25T09:03:50.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 -- start start 2024-04-25T09:03:50.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e1de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ed160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1e6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59841ffe00 con 0x55d51e1e7b10 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840b4420 con 0x55d51e1e7ef0 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840c8da0 con 0x55d51e208f20 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f5989564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e1de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f5989564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e1de910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33416/0 (socket says 172.21.15.5:33416) 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.380+0000 7f5989564640 1 -- 172.21.15.5:0/1387918682 learned_addr learned my addr 172.21.15.5:0/1387918682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5988d63640 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989d65640 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989564640 1 -- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 msgr2=0x55d51e1e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989564640 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989564640 1 -- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 msgr2=0x55d51e1ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989564640 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ed160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989564640 1 -- 172.21.15.5:0/1387918682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d51ddf80f0 con 0x55d51e1e7b10 2024-04-25T09:03:50.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5988d63640 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989d65640 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f5989564640 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e1de910 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f5974080010 tx=0x7f59740a99a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaec52057697bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f596a7fc640 1 -- 172.21.15.5:0/1387918682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740a9e60 con 0x55d51e1e7b10 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f596a7fc640 1 -- 172.21.15.5:0/1387918682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740a9070 con 0x55d51e1e7b10 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f596a7fc640 1 -- 172.21.15.5:0/1387918682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740a9b50 con 0x55d51e1e7b10 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f598e5a7740 1 -- 172.21.15.5:0/1387918682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 msgr2=0x55d51e1de910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.381+0000 7f598e5a7740 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e1de910 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f5974080010 tx=0x7f59740a99a0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 -- 172.21.15.5:0/1387918682 shutdown_connections 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 --2- 172.21.15.5:0/1387918682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e1de910 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 -- 172.21.15.5:0/1387918682 >> 172.21.15.5:0/1387918682 conn(0x55d51e1ba770 msgr2=0x55d51e20d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 -- 172.21.15.5:0/1387918682 shutdown_connections 2024-04-25T09:03:50.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 -- 172.21.15.5:0/1387918682 wait complete. 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 -- start start 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.382+0000 7f598e5a7740 1 Processor -- start 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e26ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1b9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f598e5a7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1b9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f598e5a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840b3e20 con 0x55d51e1e7b10 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51e1fbbd0 con 0x55d51e1e7ef0 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f598e5a7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d51e217910 con 0x55d51e208f20 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f598e5a7740 10 client.0 _ll_register_callbacks cb 0x7f597c009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e26ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e26ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33426/0 (socket says 172.21.15.5:33426) 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 -- 172.21.15.5:0/2919469523 learned_addr learned my addr 172.21.15.5:0/2919469523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989d65640 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1b9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5988d63640 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 -- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 msgr2=0x55d51e1b9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1b9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 -- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 msgr2=0x55d51e1b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1b9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.383+0000 7f5989564640 1 -- 172.21.15.5:0/2919469523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d51e26f2d0 con 0x55d51e1e7b10 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5989564640 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e26ed90 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f5974076180 tx=0x7f59740ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb5a031fd7db9ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5963fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5963fff640 1 -- 172.21.15.5:0/2919469523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740a9e60 con 0x55d51e1e7b10 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5963fff640 1 -- 172.21.15.5:0/2919469523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5974098050 con 0x55d51e1e7b10 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59740a9070 con 0x55d51e1e7b10 2024-04-25T09:03:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5963fff640 1 -- 172.21.15.5:0/2919469523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59740a3120 con 0x55d51e1e7b10 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 10 client.8190 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55d51e1e6e70 con 0x55d51e1e7b10 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5963fff640 1 -- 172.21.15.5:0/2919469523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740a9070 con 0x55d51e1e7b10 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5963fff640 1 -- 172.21.15.5:0/2919469523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f597408dce0 con 0x55d51e1e7b10 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 10 client.8190 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 10 client.8190 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 20 client.8190 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e217da0 0x55d51e1facb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 4 client.8190 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d51e12b630 con 0x55d51e217da0 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.384+0000 7f5988d63640 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e217da0 0x55d51e1facb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f5988d63640 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e217da0 0x55d51e1facb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17946645413b7a6e server_cookie=50477a83c85d55c in_seq=0 out_seq=0 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f5963fff640 10 client.8190 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f5963fff640 1 -- 172.21.15.5:0/2919469523 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55d51e12b630 con 0x55d51e217da0 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f5963fff640 10 client.8190 handle_command_reply: tid=0 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 client.8190 shutdown 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 msgr2=0x55d51e26ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e26ed90 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f5974076180 tx=0x7f59740ab040 comp rx=0 tx=0).stop 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 shutdown_connections 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55d51e217da0 0x55d51e1facb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55d51e208f20 0x55d51e1b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d51e1e7ef0 0x55d51e1b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 --2- 172.21.15.5:0/2919469523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d51e1e7b10 0x55d51e26ed90 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f5963fff640 0 client.8190 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 >> 172.21.15.5:0/2919469523 conn(0x55d51e1ba770 msgr2=0x55d51e2053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 shutdown_connections 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 1 -- 172.21.15.5:0/2919469523 wait complete. 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.385+0000 7f598e5a7740 20 client.8190 trim_cache size 0 max 16384 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T09:03:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: "a0c610a3-abe3-473c-8010-a7e8fb11f525": { 2024-04-25T09:03:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:03:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "a0c610a3-abe3-473c-8010-a7e8fb11f525", 2024-04-25T09:03:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-04-25T09:03:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:50.383 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:03:50.383 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f597006b4d0 msgr2=0x7f597006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f597006b4d0 0x7f597006d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f59840ce500 tx=0x7f5978007c10 comp rx=0 tx=0).stop 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59840b6250 msgr2=0x7f5984158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59840b6250 0x7f5984158a70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f597402ac70 tx=0x7f5974004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 shutdown_connections 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f597006b4d0 0x7f597006d990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f598415df10 0x7f59841602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59840cefe0 0x7f59840b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 --2- 172.21.15.5:0/2867800271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59840b6250 0x7f5984158a70 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 >> 172.21.15.5:0/2867800271 conn(0x7f59840668f0 msgr2=0x7f598415c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 shutdown_connections 2024-04-25T09:03:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.386+0000 7f598b7c8640 1 -- 172.21.15.5:0/2867800271 wait complete. 2024-04-25T09:03:50.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.497+0000 7f252c35c640 1 Processor -- start 2024-04-25T09:03:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.497+0000 7f252c35c640 1 -- start start 2024-04-25T09:03:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252c35c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25240b9990 0x7f25240d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252c35c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25240b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252c35c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25240d2670 con 0x7f25240d05f0 2024-04-25T09:03:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252c35c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25240d2950 con 0x7f25240b9990 2024-04-25T09:03:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252c35c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25240d2c30 con 0x7f25240d21f0 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f25298f7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25240b9990 0x7f25240d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252a0f8640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f25240d05f0 0x7f25240d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:51888/0 (socket says 172.21.15.5:51888) 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252a0f8640 1 -- 172.21.15.5:0/2752908916 learned_addr learned my addr 172.21.15.5:0/2752908916 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.498+0000 7f252a8f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25240b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.499+0000 7f25298f7640 1 -- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 msgr2=0x7f25240b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.499+0000 7f25298f7640 1 --2- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25240b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.499+0000 7f25298f7640 1 -- 172.21.15.5:0/2752908916 >> v1:172.21.15.80:6789/0 conn(0x7f25240d05f0 legacy=0x7f25240d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.499+0000 7f25298f7640 1 -- 172.21.15.5:0/2752908916 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25240d2f10 con 0x7f25240b9990 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.499+0000 7f25290f6640 1 -- 172.21.15.5:0/2752908916 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761214041 0 0) 0x7f25240d2670 con 0x7f25240d05f0 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.499+0000 7f252a8f9640 1 --2- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25240b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.499+0000 7f25298f7640 1 --2- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25240b9990 0x7f25240d1cb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f25140097a0 tx=0x7f251402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6aaf54d88f4fd96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f25290f6640 1 -- 172.21.15.5:0/2752908916 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514037070 con 0x7f25240b9990 2024-04-25T09:03:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f25290f6640 1 -- 172.21.15.5:0/2752908916 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2514032440 con 0x7f25240b9990 2024-04-25T09:03:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f25290f6640 1 -- 172.21.15.5:0/2752908916 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514032810 con 0x7f25240b9990 2024-04-25T09:03:50.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 -- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25240b9990 msgr2=0x7f25240d1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 --2- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25240b9990 0x7f25240d1cb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f25140097a0 tx=0x7f251402a210 comp rx=0 tx=0).stop 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 -- 172.21.15.5:0/2752908916 shutdown_connections 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 --2- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25240b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 --2- 172.21.15.5:0/2752908916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25240b9990 0x7f25240d1cb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 -- 172.21.15.5:0/2752908916 >> 172.21.15.5:0/2752908916 conn(0x7f252406b000 msgr2=0x7f252406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 -- 172.21.15.5:0/2752908916 shutdown_connections 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.500+0000 7f252c35c640 1 -- 172.21.15.5:0/2752908916 wait complete. 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.501+0000 7f252c35c640 1 Processor -- start 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.501+0000 7f252c35c640 1 -- start start 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252c35c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25240d05f0 0x7f25240b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252c35c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25241f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252c35c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f252415e370 0x7f25240b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252c35c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25240d3890 con 0x7f25240d05f0 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252c35c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25240d3710 con 0x7f252415e370 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252c35c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25240d3a10 con 0x7f25240d21f0 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252a0f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25240d05f0 0x7f25240b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252a0f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25240d05f0 0x7f25240b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33438/0 (socket says 172.21.15.5:33438) 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252a0f8640 1 -- 172.21.15.5:0/768959158 learned_addr learned my addr 172.21.15.5:0/768959158 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f25298f7640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25241f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.502+0000 7f252a8f9640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f252415e370 0x7f25240b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252a0f8640 1 -- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 msgr2=0x7f25241f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252a0f8640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25241f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252a0f8640 1 -- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f252415e370 msgr2=0x7f25240b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252a0f8640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f252415e370 0x7f25240b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252a0f8640 1 -- 172.21.15.5:0/768959158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25241507b0 con 0x7f25240d05f0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252a0f8640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25240d05f0 0x7f25240b5420 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f252000c4d0 tx=0x7f252000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f251affd640 1 -- 172.21.15.5:0/768959158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520018070 con 0x7f25240d05f0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f251affd640 1 -- 172.21.15.5:0/768959158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520007500 con 0x7f25240d05f0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252415e870 con 0x7f25240d05f0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f251affd640 1 -- 172.21.15.5:0/768959158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520004a20 con 0x7f25240d05f0 2024-04-25T09:03:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.503+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252415ee30 con 0x7f25240d05f0 2024-04-25T09:03:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.504+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252404ef20 con 0x7f25240d05f0 2024-04-25T09:03:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.504+0000 7f251affd640 1 -- 172.21.15.5:0/768959158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f252001b070 con 0x7f25240d05f0 2024-04-25T09:03:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.505+0000 7f251affd640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f250806b4d0 0x7f250806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.505+0000 7f251affd640 1 -- 172.21.15.5:0/768959158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25200894a0 con 0x7f25240d05f0 2024-04-25T09:03:50.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.505+0000 7f25298f7640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f250806b4d0 0x7f250806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.505+0000 7f25298f7640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f250806b4d0 0x7f250806d990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2514034000 tx=0x7f251402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.509+0000 7f251affd640 1 -- 172.21.15.5:0/768959158 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25241507b0 con 0x7f25240d05f0 2024-04-25T09:03:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.727+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25240717c0 con 0x7f25240d05f0 2024-04-25T09:03:50.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.728+0000 7f251affd640 1 -- 172.21.15.5:0/768959158 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f2520057cd0 con 0x7f25240d05f0 2024-04-25T09:03:50.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:50.717 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:50.717 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f250806b4d0 msgr2=0x7f250806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f250806b4d0 0x7f250806d990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2514034000 tx=0x7f251402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25240d05f0 msgr2=0x7f25240b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25240d05f0 0x7f25240b5420 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f252000c4d0 tx=0x7f252000c990 comp rx=0 tx=0).stop 2024-04-25T09:03:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 shutdown_connections 2024-04-25T09:03:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f250806b4d0 0x7f250806d990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f252415e370 0x7f25240b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25240d21f0 0x7f25241f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 --2- 172.21.15.5:0/768959158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25240d05f0 0x7f25240b5420 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.729+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 >> 172.21.15.5:0/768959158 conn(0x7f252406b000 msgr2=0x7f25240b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.730+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 shutdown_connections 2024-04-25T09:03:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.730+0000 7f252c35c640 1 -- 172.21.15.5:0/768959158 wait complete. 2024-04-25T09:03:50.730 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:03:50.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:03:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.841+0000 7fe7c2e3a640 1 Processor -- start 2024-04-25T09:03:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.841+0000 7fe7c2e3a640 1 -- start start 2024-04-25T09:03:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c2e3a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc15df80 0x7fe7bc0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c2e3a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7bc071bd0 0x7fe7bc0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c2e3a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc072150 con 0x7fe7bc06cbf0 2024-04-25T09:03:50.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c2e3a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc0cbd50 con 0x7fe7bc071bd0 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c2e3a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0cc030 con 0x7fe7bc15df80 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c0bd6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe7bc06cbf0 0x7fe7bc0cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41824/0 (socket says 172.21.15.5:41824) 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c0bd6640 1 -- 172.21.15.5:0/483439541 learned_addr learned my addr 172.21.15.5:0/483439541 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7bbfff640 1 --2- 172.21.15.5:0/483439541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc15df80 0x7fe7bc0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7c13d7640 1 --2- 172.21.15.5:0/483439541 >> v2:172.21.15.80:3300/0 conn(0x7fe7bc071bd0 0x7fe7bc0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.842+0000 7fe7bb7fe640 1 -- 172.21.15.5:0/483439541 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901523246 0 0) 0x7fe7bc072150 con 0x7fe7bc06cbf0 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.843+0000 7fe7bb7fe640 1 -- 172.21.15.5:0/483439541 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a8003520 con 0x7fe7bc06cbf0 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.843+0000 7fe7bbfff640 1 -- 172.21.15.5:0/483439541 >> v2:172.21.15.80:3300/0 conn(0x7fe7bc071bd0 msgr2=0x7fe7bc0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.843+0000 7fe7bbfff640 1 --2- 172.21.15.5:0/483439541 >> v2:172.21.15.80:3300/0 conn(0x7fe7bc071bd0 0x7fe7bc0cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.843+0000 7fe7bbfff640 1 -- 172.21.15.5:0/483439541 >> v1:172.21.15.80:6789/0 conn(0x7fe7bc06cbf0 legacy=0x7fe7bc0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.843+0000 7fe7bbfff640 1 -- 172.21.15.5:0/483439541 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0cc310 con 0x7fe7bc15df80 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.843+0000 7fe7c13d7640 1 --2- 172.21.15.5:0/483439541 >> v2:172.21.15.80:3300/0 conn(0x7fe7bc071bd0 0x7fe7bc0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.843+0000 7fe7bbfff640 1 --2- 172.21.15.5:0/483439541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc15df80 0x7fe7bc0ccb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0097a0 tx=0x7fe7ac02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12260c61b755ccf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7bb7fe640 1 -- 172.21.15.5:0/483439541 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac037070 con 0x7fe7bc15df80 2024-04-25T09:03:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7bb7fe640 1 -- 172.21.15.5:0/483439541 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac032440 con 0x7fe7bc15df80 2024-04-25T09:03:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7bb7fe640 1 -- 172.21.15.5:0/483439541 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac032810 con 0x7fe7bc15df80 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/483439541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc15df80 msgr2=0x7fe7bc0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/483439541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc15df80 0x7fe7bc0ccb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0097a0 tx=0x7fe7ac02a210 comp rx=0 tx=0).stop 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/483439541 shutdown_connections 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/483439541 >> v2:172.21.15.80:3300/0 conn(0x7fe7bc071bd0 0x7fe7bc0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/483439541 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc15df80 0x7fe7bc0ccb10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/483439541 >> 172.21.15.5:0/483439541 conn(0x7fe7bc0b1c50 msgr2=0x7fe7bc0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/483439541 shutdown_connections 2024-04-25T09:03:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.844+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/483439541 wait complete. 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.845+0000 7fe7c2e3a640 1 Processor -- start 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.845+0000 7fe7c2e3a640 1 -- start start 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.846+0000 7fe7c2e3a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc06cbf0 0x7fe7bc160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.846+0000 7fe7c2e3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7bc071bd0 0x7fe7bc15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.846+0000 7fe7c2e3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc15df80 0x7fe7bc09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.846+0000 7fe7c2e3a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc06cfd0 con 0x7fe7bc15df80 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.846+0000 7fe7c2e3a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0ce360 con 0x7fe7bc071bd0 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.846+0000 7fe7c2e3a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc06d150 con 0x7fe7bc06cbf0 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.846+0000 7fe7c13d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc15df80 0x7fe7bc09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc15df80 0x7fe7bc09a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58476/0 (socket says 172.21.15.5:58476) 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 -- 172.21.15.5:0/2922934340 learned_addr learned my addr 172.21.15.5:0/2922934340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7bbfff640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7bc071bd0 0x7fe7bc15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c0bd6640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc06cbf0 0x7fe7bc160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 -- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc06cbf0 msgr2=0x7fe7bc160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc06cbf0 0x7fe7bc160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 -- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7bc071bd0 msgr2=0x7fe7bc15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7bc071bd0 0x7fe7bc15eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 -- 172.21.15.5:0/2922934340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc15f1a0 con 0x7fe7bc15df80 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7bbfff640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7bc071bd0 0x7fe7bc15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c0bd6640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc06cbf0 0x7fe7bc160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c13d7640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc15df80 0x7fe7bc09a9d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009f00 tx=0x7fe7b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7b97fa640 1 -- 172.21.15.5:0/2922934340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4018030 con 0x7fe7bc15df80 2024-04-25T09:03:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7b97fa640 1 -- 172.21.15.5:0/2922934340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b400ce50 con 0x7fe7bc15df80 2024-04-25T09:03:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc15f480 con 0x7fe7bc15df80 2024-04-25T09:03:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7b97fa640 1 -- 172.21.15.5:0/2922934340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4003bb0 con 0x7fe7bc15df80 2024-04-25T09:03:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.847+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc15fa40 con 0x7fe7bc15df80 2024-04-25T09:03:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.848+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc04ef20 con 0x7fe7bc15df80 2024-04-25T09:03:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.849+0000 7fe7b97fa640 1 -- 172.21.15.5:0/2922934340 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe7b401b070 con 0x7fe7bc15df80 2024-04-25T09:03:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.849+0000 7fe7b97fa640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe79c06b4d0 0x7fe79c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.849+0000 7fe7b97fa640 1 -- 172.21.15.5:0/2922934340 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7b408acf0 con 0x7fe7bc15df80 2024-04-25T09:03:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.849+0000 7fe7c0bd6640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe79c06b4d0 0x7fe79c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.850+0000 7fe7c0bd6640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe79c06b4d0 0x7fe79c06d990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007fd0 tx=0x7fe7a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:50.853+0000 7fe7b97fa640 1 -- 172.21.15.5:0/2922934340 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe7b408f070 con 0x7fe7bc15df80 2024-04-25T09:03:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.104+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe7bc15ce90 con 0x7fe7bc15df80 2024-04-25T09:03:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.104+0000 7fe7b97fa640 1 -- 172.21.15.5:0/2922934340 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1185 (secure 0 0 0) 0x7fe7b4010040 con 0x7fe7bc15df80 2024-04-25T09:03:51.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:51.093 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":450,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":696,"data_bytes":705938364,"bytes_used":1677131776,"bytes_avail":771416981504,"bytes_total":773094113280,"write_bytes_sec":58772957,"read_op_per_sec":0,"write_op_per_sec":57},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-04-25T09:01:58.457242+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:03:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe79c06b4d0 msgr2=0x7fe79c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe79c06b4d0 0x7fe79c06d990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007fd0 tx=0x7fe7a4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc15df80 msgr2=0x7fe7bc09a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc15df80 0x7fe7bc09a9d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009f00 tx=0x7fe7b400c490 comp rx=0 tx=0).stop 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 shutdown_connections 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe79c06b4d0 0x7fe79c06d990 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc15df80 0x7fe7bc09a9d0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7bc071bd0 0x7fe7bc15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 --2- 172.21.15.5:0/2922934340 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe7bc06cbf0 0x7fe7bc160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 >> 172.21.15.5:0/2922934340 conn(0x7fe7bc0b1c50 msgr2=0x7fe7bc0cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 shutdown_connections 2024-04-25T09:03:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:51.106+0000 7fe7c2e3a640 1 -- 172.21.15.5:0/2922934340 wait complete. 2024-04-25T09:03:51.106 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:03:52.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.231+0000 7f57992bd640 1 Processor -- start 2024-04-25T09:03:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.231+0000 7f57992bd640 1 -- start start 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57992bd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579406b7d0 0x7f579406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57992bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 0x7f57940d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57992bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57940b4730 con 0x7f579406bbb0 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57992bd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57940d0b70 con 0x7f579406b7d0 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57992bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57940cbf30 con 0x7f579415e120 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f578bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f579406bbb0 0x7f579415da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46284/0 (socket says 172.21.15.5:46284) 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f578bfff640 1 -- 172.21.15.5:0/2722660362 learned_addr learned my addr 172.21.15.5:0/2722660362 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763568513 0 0) 0x7f577c001110 con 0x7f579406bbb0 2024-04-25T09:03:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57937fe640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 0x7f57940d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f5792ffd640 1 --2- 172.21.15.5:0/2722660362 >> v2:172.21.15.80:3300/0 conn(0x7f579406b7d0 0x7f579406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003520 con 0x7f579406bbb0 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.232+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274318747 0 0) 0x7f5780003520 con 0x7f579406bbb0 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 msgr2=0x7f57940d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 0x7f57940d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 >> v2:172.21.15.80:3300/0 conn(0x7f579406b7d0 msgr2=0x7f579406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 --2- 172.21.15.5:0/2722660362 >> v2:172.21.15.80:3300/0 conn(0x7f579406b7d0 0x7f579406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940d0da0 con 0x7f579406bbb0 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f577c001840 con 0x7f579406bbb0 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 >> v1:172.21.15.5:6789/0 conn(0x7f579406bbb0 legacy=0x7f579415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 0x7f57800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f5780004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5780004d40 0x7f57800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940cbf30 con 0x7f5780003f30 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578000b9c0 con 0x7f5780004d40 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578000bb70 con 0x7f579415e120 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f578bfff640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f5780004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f5792ffd640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 0x7f57800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57937fe640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5780004d40 0x7f57800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f578bfff640 1 -- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 msgr2=0x7f57800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f578bfff640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415e120 0x7f57800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f578bfff640 1 -- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5780004d40 msgr2=0x7f57800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f578bfff640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5780004d40 0x7f57800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f578bfff640 1 -- 172.21.15.5:0/2722660362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780003520 con 0x7f5780003f30 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.233+0000 7f57937fe640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5780004d40 0x7f57800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.234+0000 7f578bfff640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f5780004800 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c4c0 tx=0x7f5780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3cbd483e6b2f13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.234+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00c0e0 con 0x7f5780003f30 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.234+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c034070 con 0x7f5780003f30 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.234+0000 7f57927fc640 1 -- 172.21.15.5:0/2722660362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c005d30 con 0x7f5780003f30 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.234+0000 7f57992bd640 1 -- 172.21.15.5:0/2722660362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 msgr2=0x7f5780004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.234+0000 7f57992bd640 1 --2- 172.21.15.5:0/2722660362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f5780004800 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c4c0 tx=0x7f5780005830 comp rx=0 tx=0).stop 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.235+0000 7f57937fe640 1 -- 172.21.15.5:0/2722660362 reap_dead start 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.235+0000 7f57992bd640 1 -- 172.21.15.5:0/2722660362 shutdown_connections 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.235+0000 7f57992bd640 1 -- 172.21.15.5:0/2722660362 >> 172.21.15.5:0/2722660362 conn(0x7f57940d18e0 msgr2=0x7f57940d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.235+0000 7f57992bd640 1 -- 172.21.15.5:0/2722660362 shutdown_connections 2024-04-25T09:03:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.235+0000 7f57992bd640 1 -- 172.21.15.5:0/2722660362 wait complete. 2024-04-25T09:03:52.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.236+0000 7f57992bd640 1 Processor -- start 2024-04-25T09:03:52.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.236+0000 7f57992bd640 1 -- start start 2024-04-25T09:03:52.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f57941f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415a8b0 0x7f579415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57941582f0 0x7f57941587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940cc460 con 0x7f5780003f30 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940cc7d0 con 0x7f57941582f0 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57940d0630 con 0x7f579415a8b0 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f57941f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f57941f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58498/0 (socket says 172.21.15.5:58498) 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 -- 172.21.15.5:0/1551720089 learned_addr learned my addr 172.21.15.5:0/1551720089 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57937fe640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57941582f0 0x7f57941587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f578bfff640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415a8b0 0x7f579415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 -- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415a8b0 msgr2=0x7f579415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415a8b0 0x7f579415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 -- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57941582f0 msgr2=0x7f57941587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57941582f0 0x7f57941587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 -- 172.21.15.5:0/1551720089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57941f4b30 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f578bfff640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415a8b0 0x7f579415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57937fe640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57941582f0 0x7f57941587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f5792ffd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f57941f45f0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5784011aa0 tx=0x7f5784011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f578b7fe640 1 -- 172.21.15.5:0/1551720089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578400fb80 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f578b7fe640 1 -- 172.21.15.5:0/1551720089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578400fd20 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57941f4e00 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f578b7fe640 1 -- 172.21.15.5:0/1551720089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784014660 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.237+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57941f53c0 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.238+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57940cf2a0 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.239+0000 7f578b7fe640 1 -- 172.21.15.5:0/1551720089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5784012040 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.239+0000 7f578b7fe640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f577406b4d0 0x7f577406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.239+0000 7f578b7fe640 1 -- 172.21.15.5:0/1551720089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f578408a960 con 0x7f5780003f30 2024-04-25T09:03:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.240+0000 7f578bfff640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f577406b4d0 0x7f577406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.240+0000 7f578bfff640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f577406b4d0 0x7f577406d990 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f577c033000 tx=0x7f577c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.244+0000 7f578b7fe640 1 -- 172.21.15.5:0/1551720089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5784019030 con 0x7f5780003f30 2024-04-25T09:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.461+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f579404ef20 con 0x7f5780003f30 2024-04-25T09:03:52.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.461+0000 7f578b7fe640 1 -- 172.21.15.5:0/1551720089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f57840597e0 con 0x7f5780003f30 2024-04-25T09:03:52.450 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:52.451 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f577406b4d0 msgr2=0x7f577406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f577406b4d0 0x7f577406d990 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f577c033000 tx=0x7f577c009030 comp rx=0 tx=0).stop 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 msgr2=0x7f57941f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f57941f45f0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5784011aa0 tx=0x7f5784011f60 comp rx=0 tx=0).stop 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 shutdown_connections 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f577406b4d0 0x7f577406d990 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57941582f0 0x7f57941587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f579415a8b0 0x7f579415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 --2- 172.21.15.5:0/1551720089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780003f30 0x7f57941f45f0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 >> 172.21.15.5:0/1551720089 conn(0x7f57940d18e0 msgr2=0x7f57940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 shutdown_connections 2024-04-25T09:03:52.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.463+0000 7f57992bd640 1 -- 172.21.15.5:0/1551720089 wait complete. 2024-04-25T09:03:52.463 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:03:52.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:03:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.574+0000 7f14e5b9e640 1 Processor -- start 2024-04-25T09:03:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.574+0000 7f14e5b9e640 1 -- start start 2024-04-25T09:03:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14e5b9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 0x7f14e00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14e5b9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14e00b7130 0x7f14e00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14e5b9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e00d20e0 con 0x7f14e015de70 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14e5b9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00d2a10 con 0x7f14e00b7130 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14e5b9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00d23c0 con 0x7f14e00b2cc0 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14df7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f14e015de70 0x7f14e00b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46300/0 (socket says 172.21.15.5:46300) 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14df7fe640 1 -- 172.21.15.5:0/18719059 learned_addr learned my addr 172.21.15.5:0/18719059 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057598621 0 0) 0x7f14e00d20e0 con 0x7f14e015de70 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14dffff640 1 --2- 172.21.15.5:0/18719059 >> v2:172.21.15.80:3300/0 conn(0x7f14e00b7130 0x7f14e00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14deffd640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 0x7f14e00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c8003520 con 0x7f14e015de70 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.575+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886268915 0 0) 0x7f14c8003520 con 0x7f14e015de70 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 msgr2=0x7f14e00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 0x7f14e00b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 >> v2:172.21.15.80:3300/0 conn(0x7f14e00b7130 msgr2=0x7f14e00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 --2- 172.21.15.5:0/18719059 >> v2:172.21.15.80:3300/0 conn(0x7f14e00b7130 0x7f14e00ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00d26a0 con 0x7f14e015de70 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f14d0001670 con 0x7f14e015de70 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 >> v1:172.21.15.5:6789/0 conn(0x7f14e015de70 legacy=0x7f14e00b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 0x7f14c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14c8003f30 0x7f14c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8004d40 0x7f14c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00d2a10 con 0x7f14c8003f30 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00d23c0 con 0x7f14c8004d40 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c800b9c0 con 0x7f14e00b2cc0 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14deffd640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14c8003f30 0x7f14c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14dffff640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8004d40 0x7f14c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14df7fe640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 0x7f14c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14deffd640 1 -- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 msgr2=0x7f14c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14deffd640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b2cc0 0x7f14c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14deffd640 1 -- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8004d40 msgr2=0x7f14c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14deffd640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8004d40 0x7f14c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.576+0000 7f14deffd640 1 -- 172.21.15.5:0/18719059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8003520 con 0x7f14c8003f30 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.577+0000 7f14deffd640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14c8003f30 0x7f14c8004800 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009ac0 tx=0x7f14c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33f7576c977a50c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.577+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4036070 con 0x7f14c8003f30 2024-04-25T09:03:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.577+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4031400 con 0x7f14c8003f30 2024-04-25T09:03:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.577+0000 7f14de7fc640 1 -- 172.21.15.5:0/18719059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4009690 con 0x7f14c8003f30 2024-04-25T09:03:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.577+0000 7f14e5b9e640 1 -- 172.21.15.5:0/18719059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14c8003f30 msgr2=0x7f14c8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.577+0000 7f14e5b9e640 1 --2- 172.21.15.5:0/18719059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14c8003f30 0x7f14c8004800 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009ac0 tx=0x7f14c8005830 comp rx=0 tx=0).stop 2024-04-25T09:03:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.577+0000 7f14dffff640 1 -- 172.21.15.5:0/18719059 reap_dead start 2024-04-25T09:03:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.578+0000 7f14e5b9e640 1 -- 172.21.15.5:0/18719059 shutdown_connections 2024-04-25T09:03:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.578+0000 7f14e5b9e640 1 -- 172.21.15.5:0/18719059 >> 172.21.15.5:0/18719059 conn(0x7f14e006b000 msgr2=0x7f14e006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.578+0000 7f14e5b9e640 1 -- 172.21.15.5:0/18719059 shutdown_connections 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.578+0000 7f14e5b9e640 1 -- 172.21.15.5:0/18719059 wait complete. 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.579+0000 7f14e5b9e640 1 Processor -- start 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.579+0000 7f14e5b9e640 1 -- start start 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14e5b9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8003f30 0x7f14e01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14e5b9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e00cd740 0x7f14e00cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14e5b9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b5af0 0x7f14e00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14e5b9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00b6f80 con 0x7f14e00cd740 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14e5b9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00b6e00 con 0x7f14c8003f30 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14e5b9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00ced30 con 0x7f14e00b5af0 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e00cd740 0x7f14e00cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e00cd740 0x7f14e00cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58524/0 (socket says 172.21.15.5:58524) 2024-04-25T09:03:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 -- 172.21.15.5:0/2196259507 learned_addr learned my addr 172.21.15.5:0/2196259507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14dffff640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b5af0 0x7f14e00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14df7fe640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8003f30 0x7f14e01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 -- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b5af0 msgr2=0x7f14e00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b5af0 0x7f14e00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 -- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8003f30 msgr2=0x7f14e01584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8003f30 0x7f14e01584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 -- 172.21.15.5:0/2196259507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00b35c0 con 0x7f14e00cd740 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14deffd640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e00cd740 0x7f14e00cb860 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f14d4000c00 tx=0x7f14d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14c7fff640 1 -- 172.21.15.5:0/2196259507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4040020 con 0x7f14e00cd740 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14c7fff640 1 -- 172.21.15.5:0/2196259507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4003c60 con 0x7f14e00cd740 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14c7fff640 1 -- 172.21.15.5:0/2196259507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4036040 con 0x7f14e00cd740 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.580+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e00c9dd0 con 0x7f14e00cd740 2024-04-25T09:03:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.581+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e00cc390 con 0x7f14e00cd740 2024-04-25T09:03:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.581+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e004ef20 con 0x7f14e00cd740 2024-04-25T09:03:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.582+0000 7f14c7fff640 1 -- 172.21.15.5:0/2196259507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f14d4043020 con 0x7f14e00cd740 2024-04-25T09:03:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.582+0000 7f14c7fff640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14cc06b4d0 0x7f14cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.582+0000 7f14c7fff640 1 -- 172.21.15.5:0/2196259507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14d40aa5a0 con 0x7f14e00cd740 2024-04-25T09:03:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.582+0000 7f14df7fe640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14cc06b4d0 0x7f14cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.583+0000 7f14df7fe640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14cc06b4d0 0x7f14cc06d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f14d0001550 tx=0x7f14d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.586+0000 7f14c7fff640 1 -- 172.21.15.5:0/2196259507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14d404a030 con 0x7f14e00cd740 2024-04-25T09:03:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.839+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f14e01610f0 con 0x7f14e00cd740 2024-04-25T09:03:52.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.839+0000 7f14c7fff640 1 -- 172.21.15.5:0/2196259507 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1185 (secure 0 0 0) 0x7f14d407de20 con 0x7f14e00cd740 2024-04-25T09:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:52.828 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":452,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":696,"data_bytes":705938364,"bytes_used":1677131776,"bytes_avail":771416981504,"bytes_total":773094113280,"write_bytes_sec":58772957,"read_op_per_sec":0,"write_op_per_sec":57},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-04-25T09:01:58.457242+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:03:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14cc06b4d0 msgr2=0x7f14cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14cc06b4d0 0x7f14cc06d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f14d0001550 tx=0x7f14d0009040 comp rx=0 tx=0).stop 2024-04-25T09:03:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e00cd740 msgr2=0x7f14e00cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e00cd740 0x7f14e00cb860 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f14d4000c00 tx=0x7f14d4004730 comp rx=0 tx=0).stop 2024-04-25T09:03:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 shutdown_connections 2024-04-25T09:03:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f14cc06b4d0 0x7f14cc06d990 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f14e00b5af0 0x7f14e00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e00cd740 0x7f14e00cb860 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 --2- 172.21.15.5:0/2196259507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14c8003f30 0x7f14e01584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 >> 172.21.15.5:0/2196259507 conn(0x7f14e006b000 msgr2=0x7f14e00ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 shutdown_connections 2024-04-25T09:03:52.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:52.841+0000 7f14e5b9e640 1 -- 172.21.15.5:0/2196259507 wait complete. 2024-04-25T09:03:52.841 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:03:53.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.967+0000 7f33f21b0640 1 Processor -- start 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.967+0000 7f33f21b0640 1 -- start start 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33f21b0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33ec0ce7f0 0x7f33ec0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33f21b0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0cf1c0 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33f21b0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0d20e0 con 0x7f33ec15de70 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33f21b0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0d2a10 con 0x7f33ec0ce7f0 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33ec0ce7f0 0x7f33ec0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33eaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33ec0b2cc0 0x7f33ec0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46312/0 (socket says 172.21.15.5:46312) 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33ec0ce7f0 0x7f33ec0cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58526/0 (socket says 172.21.15.5:58526) 2024-04-25T09:03:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33eaffd640 1 -- 172.21.15.5:0/713987905 learned_addr learned my addr 172.21.15.5:0/713987905 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33ebfff640 1 -- 172.21.15.5:0/713987905 >> v1:172.21.15.80:6789/0 conn(0x7f33ec15de70 legacy=0x7f33ec0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33ebfff640 1 -- 172.21.15.5:0/713987905 >> v1:172.21.15.5:6789/0 conn(0x7f33ec0b2cc0 legacy=0x7f33ec0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.968+0000 7f33ebfff640 1 -- 172.21.15.5:0/713987905 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0d23c0 con 0x7f33ec0ce7f0 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.969+0000 7f33ebfff640 1 --2- 172.21.15.5:0/713987905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0ce7f0 0x7f33ec0cec80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009d90 tx=0x7f33e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940a09d46df0f852 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.969+0000 7f33ea7fc640 1 -- 172.21.15.5:0/713987905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4007740 con 0x7f33ec0ce7f0 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.969+0000 7f33ea7fc640 1 -- 172.21.15.5:0/713987905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e40078e0 con 0x7f33ec0ce7f0 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.969+0000 7f33ea7fc640 1 -- 172.21.15.5:0/713987905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4007cb0 con 0x7f33ec0ce7f0 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.970+0000 7f33f21b0640 1 -- 172.21.15.5:0/713987905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0ce7f0 msgr2=0x7f33ec0cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.970+0000 7f33f21b0640 1 --2- 172.21.15.5:0/713987905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0ce7f0 0x7f33ec0cec80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009d90 tx=0x7f33e402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.970+0000 7f33f21b0640 1 -- 172.21.15.5:0/713987905 shutdown_connections 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.970+0000 7f33f21b0640 1 --2- 172.21.15.5:0/713987905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0ce7f0 0x7f33ec0cec80 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.970+0000 7f33f21b0640 1 -- 172.21.15.5:0/713987905 >> 172.21.15.5:0/713987905 conn(0x7f33ec06b000 msgr2=0x7f33ec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.970+0000 7f33f21b0640 1 -- 172.21.15.5:0/713987905 shutdown_connections 2024-04-25T09:03:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.970+0000 7f33f21b0640 1 -- 172.21.15.5:0/713987905 wait complete. 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.971+0000 7f33f21b0640 1 Processor -- start 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.971+0000 7f33f21b0640 1 -- start start 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33f21b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0b2cc0 0x7f33ec153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33f21b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f33ec0ce7f0 0x7f33ec0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33f21b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33ec15de70 0x7f33ec0b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33f21b0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0d2ea0 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33f21b0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0b7300 con 0x7f33ec15de70 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33f21b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0d3020 con 0x7f33ec0ce7f0 2024-04-25T09:03:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0b2cc0 0x7f33ec153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0b2cc0 0x7f33ec153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58532/0 (socket says 172.21.15.5:58532) 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33eb7fe640 1 -- 172.21.15.5:0/3054596347 learned_addr learned my addr 172.21.15.5:0/3054596347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.972+0000 7f33ebfff640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33ec15de70 0x7f33ec0b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33eb7fe640 1 -- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f33ec0ce7f0 msgr2=0x7f33ec0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33eb7fe640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f33ec0ce7f0 0x7f33ec0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33eb7fe640 1 -- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33ec15de70 msgr2=0x7f33ec0b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33eb7fe640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33ec15de70 0x7f33ec0b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33eb7fe640 1 -- 172.21.15.5:0/3054596347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec1f8550 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33ebfff640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33ec15de70 0x7f33ec0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33eb7fe640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0b2cc0 0x7f33ec153f70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b420 tx=0x7f33dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33d3fff640 1 -- 172.21.15.5:0/3054596347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc011830 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33d3fff640 1 -- 172.21.15.5:0/3054596347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc016070 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec1f8270 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33d3fff640 1 -- 172.21.15.5:0/3054596347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc011c10 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.973+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec0caf90 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.974+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec15e8f0 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.975+0000 7f33d3fff640 1 -- 172.21.15.5:0/3054596347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f33dc01b460 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.975+0000 7f33d3fff640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f33d806b4d0 0x7f33d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.975+0000 7f33d3fff640 1 -- 172.21.15.5:0/3054596347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33dc089cf0 con 0x7f33ec0b2cc0 2024-04-25T09:03:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.975+0000 7f33eaffd640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f33d806b4d0 0x7f33d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.976+0000 7f33eaffd640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f33d806b4d0 0x7f33d806d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f33e0000f60 tx=0x7f33e0007a80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:53.980+0000 7f33d3fff640 1 -- 172.21.15.5:0/3054596347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f33ec15e8f0 con 0x7f33ec0b2cc0 2024-04-25T09:03:54.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.196+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33ec04ef20 con 0x7f33ec0b2cc0 2024-04-25T09:03:54.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.196+0000 7f33d3fff640 1 -- 172.21.15.5:0/3054596347 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f33dc08e070 con 0x7f33ec0b2cc0 2024-04-25T09:03:54.185 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:54.185 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:54.186 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:54.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f33d806b4d0 msgr2=0x7f33d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f33d806b4d0 0x7f33d806d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f33e0000f60 tx=0x7f33e0007a80 comp rx=0 tx=0).stop 2024-04-25T09:03:54.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0b2cc0 msgr2=0x7f33ec153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0b2cc0 0x7f33ec153f70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b420 tx=0x7f33dc00b8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 shutdown_connections 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f33d806b4d0 0x7f33d806d990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33ec15de70 0x7f33ec0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f33ec0ce7f0 0x7f33ec0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 --2- 172.21.15.5:0/3054596347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec0b2cc0 0x7f33ec153f70 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 >> 172.21.15.5:0/3054596347 conn(0x7f33ec06b000 msgr2=0x7f33ec068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 shutdown_connections 2024-04-25T09:03:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.198+0000 7f33f21b0640 1 -- 172.21.15.5:0/3054596347 wait complete. 2024-04-25T09:03:54.198 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:03:54.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:03:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.309+0000 7ffb1c189640 1 Processor -- start 2024-04-25T09:03:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.309+0000 7ffb1c189640 1 -- start start 2024-04-25T09:03:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb1c189640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb140b2cc0 0x7ffb140b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb1c189640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb140b7130 0x7ffb140ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb1c189640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb140d20e0 con 0x7ffb1415de70 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb1c189640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140d2a10 con 0x7ffb140b2cc0 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb1c189640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140d23c0 con 0x7ffb140b7130 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb19724640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb140b2cc0 0x7ffb140b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb19724640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb140b2cc0 0x7ffb140b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58534/0 (socket says 172.21.15.5:58534) 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb19724640 1 -- 172.21.15.5:0/4163710442 learned_addr learned my addr 172.21.15.5:0/4163710442 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.310+0000 7ffb1a726640 1 --2- 172.21.15.5:0/4163710442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb140b7130 0x7ffb140ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb19724640 1 -- 172.21.15.5:0/4163710442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb140b7130 msgr2=0x7ffb140ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb19724640 1 --2- 172.21.15.5:0/4163710442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb140b7130 0x7ffb140ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb19724640 1 -- 172.21.15.5:0/4163710442 >> v1:172.21.15.80:6789/0 conn(0x7ffb1415de70 legacy=0x7ffb140b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb19724640 1 -- 172.21.15.5:0/4163710442 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb140d26a0 con 0x7ffb140b2cc0 2024-04-25T09:03:54.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb1a726640 1 --2- 172.21.15.5:0/4163710442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb140b7130 0x7ffb140ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb19724640 1 --2- 172.21.15.5:0/4163710442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb140b6bf0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009870 tx=0x7ffb0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a415b33288fb5999 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb18f23640 1 -- 172.21.15.5:0/4163710442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04037070 con 0x7ffb140b2cc0 2024-04-25T09:03:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb18f23640 1 -- 172.21.15.5:0/4163710442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04032440 con 0x7ffb140b2cc0 2024-04-25T09:03:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.311+0000 7ffb18f23640 1 -- 172.21.15.5:0/4163710442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04032810 con 0x7ffb140b2cc0 2024-04-25T09:03:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 -- 172.21.15.5:0/4163710442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 msgr2=0x7ffb140b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 --2- 172.21.15.5:0/4163710442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb140b6bf0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009870 tx=0x7ffb0402a270 comp rx=0 tx=0).stop 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 -- 172.21.15.5:0/4163710442 shutdown_connections 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 --2- 172.21.15.5:0/4163710442 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb140b7130 0x7ffb140ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 --2- 172.21.15.5:0/4163710442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb140b6bf0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 -- 172.21.15.5:0/4163710442 >> 172.21.15.5:0/4163710442 conn(0x7ffb1406b000 msgr2=0x7ffb1406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 -- 172.21.15.5:0/4163710442 shutdown_connections 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.312+0000 7ffb1c189640 1 -- 172.21.15.5:0/4163710442 wait complete. 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.313+0000 7ffb1c189640 1 Processor -- start 2024-04-25T09:03:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.313+0000 7ffb1c189640 1 -- start start 2024-04-25T09:03:54.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb1c189640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb14149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb1c189640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb140b7130 0x7ffb140b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb1c189640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb1415de70 0x7ffb140b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb1c189640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140cf100 con 0x7ffb140b2cc0 2024-04-25T09:03:54.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb1c189640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140cef80 con 0x7ffb140b7130 2024-04-25T09:03:54.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb1c189640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140d2ea0 con 0x7ffb1415de70 2024-04-25T09:03:54.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb14149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb14149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58536/0 (socket says 172.21.15.5:58536) 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 -- 172.21.15.5:0/2167652028 learned_addr learned my addr 172.21.15.5:0/2167652028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb1a726640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb1415de70 0x7ffb140b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19724640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb140b7130 0x7ffb140b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 -- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb1415de70 msgr2=0x7ffb140b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb1415de70 0x7ffb140b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 -- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb140b7130 msgr2=0x7ffb140b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb140b7130 0x7ffb140b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.314+0000 7ffb19f25640 1 -- 172.21.15.5:0/2167652028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1414c590 con 0x7ffb140b2cc0 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.315+0000 7ffb19f25640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb14149b10 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000c3c0 tx=0x7ffb1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.315+0000 7ffb0a7fc640 1 -- 172.21.15.5:0/2167652028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb100052d0 con 0x7ffb140b2cc0 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.315+0000 7ffb0a7fc640 1 -- 172.21.15.5:0/2167652028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10005490 con 0x7ffb140b2cc0 2024-04-25T09:03:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.315+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1414c870 con 0x7ffb140b2cc0 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.315+0000 7ffb0a7fc640 1 -- 172.21.15.5:0/2167652028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10007260 con 0x7ffb140b2cc0 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.315+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1414ce30 con 0x7ffb140b2cc0 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.316+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1404ef20 con 0x7ffb140b2cc0 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.316+0000 7ffb0a7fc640 1 -- 172.21.15.5:0/2167652028 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb10007400 con 0x7ffb140b2cc0 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.317+0000 7ffb0a7fc640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffaf806b4d0 0x7ffaf806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.317+0000 7ffb0a7fc640 1 -- 172.21.15.5:0/2167652028 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb10089740 con 0x7ffb140b2cc0 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.317+0000 7ffb19724640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffaf806b4d0 0x7ffaf806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.317+0000 7ffb19724640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffaf806b4d0 0x7ffaf806d990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffb04034000 tx=0x7ffb0402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.321+0000 7ffb0a7fc640 1 -- 172.21.15.5:0/2167652028 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb10058520 con 0x7ffb140b2cc0 2024-04-25T09:03:54.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.570+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ffb141610d0 con 0x7ffb140b2cc0 2024-04-25T09:03:54.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.571+0000 7ffb0a7fc640 1 -- 172.21.15.5:0/2167652028 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1187 (secure 0 0 0) 0x7ffb10057e20 con 0x7ffb140b2cc0 2024-04-25T09:03:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:54.559 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":454,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076144046,"bytes_used":2549727232,"bytes_avail":770544386048,"bytes_total":773094113280,"write_bytes_sec":89623206,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-04-25T09:01:58.457242+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:03:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffaf806b4d0 msgr2=0x7ffaf806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffaf806b4d0 0x7ffaf806d990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffb04034000 tx=0x7ffb0402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 msgr2=0x7ffb14149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb14149b10 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000c3c0 tx=0x7ffb1000c880 comp rx=0 tx=0).stop 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 shutdown_connections 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ffaf806b4d0 0x7ffaf806d990 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffb1415de70 0x7ffb140b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb140b7130 0x7ffb140b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 --2- 172.21.15.5:0/2167652028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb140b2cc0 0x7ffb14149b10 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 >> 172.21.15.5:0/2167652028 conn(0x7ffb1406b000 msgr2=0x7ffb1415e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.572+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 shutdown_connections 2024-04-25T09:03:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:54.573+0000 7ffb1c189640 1 -- 172.21.15.5:0/2167652028 wait complete. 2024-04-25T09:03:54.574 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:03:55.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.699+0000 7f1307fe2640 1 Processor -- start 2024-04-25T09:03:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.700+0000 7f1307fe2640 1 -- start start 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.700+0000 7f1307fe2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1300156250 0x7f13000b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f1307fe2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f130006dd20 0x7f13000ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f1307fe2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13000b3860 0x7f13000aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f1307fe2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000b2850 con 0x7f13000b3860 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f1307fe2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000b2aa0 con 0x7f1300156250 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f1307fe2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b2d80 con 0x7f130006dd20 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13000b3860 0x7f13000aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13000b3860 0x7f13000aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58548/0 (socket says 172.21.15.5:58548) 2024-04-25T09:03:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 -- 172.21.15.5:0/2249663644 learned_addr learned my addr 172.21.15.5:0/2249663644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f1305d7e640 1 --2- 172.21.15.5:0/2249663644 >> v2:172.21.15.80:3300/0 conn(0x7f1300156250 0x7f13000b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130557d640 1 --2- 172.21.15.5:0/2249663644 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f130006dd20 0x7f13000ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 -- 172.21.15.5:0/2249663644 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f130006dd20 msgr2=0x7f13000ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 --2- 172.21.15.5:0/2249663644 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f130006dd20 0x7f13000ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 -- 172.21.15.5:0/2249663644 >> v2:172.21.15.80:3300/0 conn(0x7f1300156250 msgr2=0x7f13000b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 --2- 172.21.15.5:0/2249663644 >> v2:172.21.15.80:3300/0 conn(0x7f1300156250 0x7f13000b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f130657f640 1 -- 172.21.15.5:0/2249663644 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000b3060 con 0x7f13000b3860 2024-04-25T09:03:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.701+0000 7f1305d7e640 1 --2- 172.21.15.5:0/2249663644 >> v2:172.21.15.80:3300/0 conn(0x7f1300156250 0x7f13000b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.702+0000 7f130657f640 1 --2- 172.21.15.5:0/2249663644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13000b3860 0x7f13000aebd0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f13000b2610 tx=0x7f12fc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781cf56e89f840e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.702+0000 7f1304d7c640 1 -- 172.21.15.5:0/2249663644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc036070 con 0x7f13000b3860 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.702+0000 7f1304d7c640 1 -- 172.21.15.5:0/2249663644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc031600 con 0x7f13000b3860 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.702+0000 7f1304d7c640 1 -- 172.21.15.5:0/2249663644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0319d0 con 0x7f13000b3860 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 -- 172.21.15.5:0/2249663644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13000b3860 msgr2=0x7f13000aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 --2- 172.21.15.5:0/2249663644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13000b3860 0x7f13000aebd0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f13000b2610 tx=0x7f12fc02a610 comp rx=0 tx=0).stop 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 -- 172.21.15.5:0/2249663644 shutdown_connections 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 --2- 172.21.15.5:0/2249663644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13000b3860 0x7f13000aebd0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 --2- 172.21.15.5:0/2249663644 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f130006dd20 0x7f13000ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 --2- 172.21.15.5:0/2249663644 >> v2:172.21.15.80:3300/0 conn(0x7f1300156250 0x7f13000b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 -- 172.21.15.5:0/2249663644 >> 172.21.15.5:0/2249663644 conn(0x7f13000668f0 msgr2=0x7f1300066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 -- 172.21.15.5:0/2249663644 shutdown_connections 2024-04-25T09:03:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.703+0000 7f1307fe2640 1 -- 172.21.15.5:0/2249663644 wait complete. 2024-04-25T09:03:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.704+0000 7f1307fe2640 1 Processor -- start 2024-04-25T09:03:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.704+0000 7f1307fe2640 1 -- start start 2024-04-25T09:03:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1307fe2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000b3860 0x7f13001480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1307fe2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1300156250 0x7f130015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1307fe2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300158fe0 0x7f13000ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1307fe2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b4b80 con 0x7f1300158fe0 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1307fe2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b4a00 con 0x7f13000b3860 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1307fe2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130006c420 con 0x7f1300156250 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300158fe0 0x7f13000ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300158fe0 0x7f13000ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58552/0 (socket says 172.21.15.5:58552) 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 -- 172.21.15.5:0/3037293564 learned_addr learned my addr 172.21.15.5:0/3037293564 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1305d7e640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000b3860 0x7f13001480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130557d640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1300156250 0x7f130015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 -- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1300156250 msgr2=0x7f130015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1300156250 0x7f130015e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 -- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000b3860 msgr2=0x7f13001480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000b3860 0x7f13001480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 -- 172.21.15.5:0/3037293564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130015f260 con 0x7f1300158fe0 2024-04-25T09:03:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f1305d7e640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000b3860 0x7f13001480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.705+0000 7f130657f640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300158fe0 0x7f13000ce000 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f12fc02ac00 tx=0x7f12fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.706+0000 7f12f67fc640 1 -- 172.21.15.5:0/3037293564 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc03f020 con 0x7f1300158fe0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.706+0000 7f12f67fc640 1 -- 172.21.15.5:0/3037293564 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc037040 con 0x7f1300158fe0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.706+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130015d4a0 con 0x7f1300158fe0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.706+0000 7f12f67fc640 1 -- 172.21.15.5:0/3037293564 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc036070 con 0x7f1300158fe0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.706+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130015ee50 con 0x7f1300158fe0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.707+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300154620 con 0x7f1300158fe0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.707+0000 7f12f67fc640 1 -- 172.21.15.5:0/3037293564 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f12fc042020 con 0x7f1300158fe0 2024-04-25T09:03:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.708+0000 7f12f67fc640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e406b4d0 0x7f12e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.708+0000 7f12f67fc640 1 -- 172.21.15.5:0/3037293564 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12fc0aa9a0 con 0x7f1300158fe0 2024-04-25T09:03:55.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.708+0000 7f1305d7e640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e406b4d0 0x7f12e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.709+0000 7f1305d7e640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e406b4d0 0x7f12e406d990 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.712+0000 7f12f67fc640 1 -- 172.21.15.5:0/3037293564 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1300154620 con 0x7f1300158fe0 2024-04-25T09:03:55.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.931+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f130004ef20 con 0x7f1300158fe0 2024-04-25T09:03:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.931+0000 7f12f67fc640 1 -- 172.21.15.5:0/3037293564 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f12fc049020 con 0x7f1300158fe0 2024-04-25T09:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e406b4d0 msgr2=0x7f12e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e406b4d0 0x7f12e406d990 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8008040 comp rx=0 tx=0).stop 2024-04-25T09:03:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300158fe0 msgr2=0x7f13000ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300158fe0 0x7f13000ce000 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f12fc02ac00 tx=0x7f12fc004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 shutdown_connections 2024-04-25T09:03:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f12e406b4d0 0x7f12e406d990 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1300158fe0 0x7f13000ce000 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1300156250 0x7f130015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 --2- 172.21.15.5:0/3037293564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13000b3860 0x7f13001480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 >> 172.21.15.5:0/3037293564 conn(0x7f13000668f0 msgr2=0x7f130006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 shutdown_connections 2024-04-25T09:03:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:55.933+0000 7f1307fe2640 1 -- 172.21.15.5:0/3037293564 wait complete. 2024-04-25T09:03:55.932 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:03:55.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:03:56.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.045+0000 7f9f50189640 1 Processor -- start 2024-04-25T09:03:56.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.046+0000 7f9f50189640 1 -- start start 2024-04-25T09:03:56.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.046+0000 7f9f50189640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f4815e0a0 0x7f9f480d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.046+0000 7f9f50189640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f480d3990 0x7f9f480d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.046+0000 7f9f50189640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480b7f60 con 0x7f9f480ce5e0 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.046+0000 7f9f50189640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f480d4330 con 0x7f9f480d3990 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.046+0000 7f9f50189640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f480b29c0 con 0x7f9f4815e0a0 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4d724640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f480d3990 0x7f9f480d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4e726640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f480ce5e0 0x7f9f480cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46324/0 (socket says 172.21.15.5:46324) 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4e726640 1 -- 172.21.15.5:0/3546352408 learned_addr learned my addr 172.21.15.5:0/3546352408 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4df25640 1 --2- 172.21.15.5:0/3546352408 >> v2:172.21.15.80:3300/0 conn(0x7f9f4815e0a0 0x7f9f480d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4d724640 1 -- 172.21.15.5:0/3546352408 >> v2:172.21.15.80:3300/0 conn(0x7f9f4815e0a0 msgr2=0x7f9f480d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4d724640 1 --2- 172.21.15.5:0/3546352408 >> v2:172.21.15.80:3300/0 conn(0x7f9f4815e0a0 0x7f9f480d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4d724640 1 -- 172.21.15.5:0/3546352408 >> v1:172.21.15.5:6789/0 conn(0x7f9f480ce5e0 legacy=0x7f9f480cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4d724640 1 -- 172.21.15.5:0/3546352408 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480d2080 con 0x7f9f480d3990 2024-04-25T09:03:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.047+0000 7f9f4cf23640 1 -- 172.21.15.5:0/3546352408 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936125351 0 0) 0x7f9f480b7f60 con 0x7f9f480ce5e0 2024-04-25T09:03:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f4d724640 1 --2- 172.21.15.5:0/3546352408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480d3990 0x7f9f480d3df0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f9f480b6680 tx=0x7f9f3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63127f411a78b9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f4cf23640 1 -- 172.21.15.5:0/3546352408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c037070 con 0x7f9f480d3990 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f4cf23640 1 -- 172.21.15.5:0/3546352408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c032440 con 0x7f9f480d3990 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f4cf23640 1 -- 172.21.15.5:0/3546352408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c032810 con 0x7f9f480d3990 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 -- 172.21.15.5:0/3546352408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480d3990 msgr2=0x7f9f480d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 --2- 172.21.15.5:0/3546352408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480d3990 0x7f9f480d3df0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f9f480b6680 tx=0x7f9f3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 -- 172.21.15.5:0/3546352408 shutdown_connections 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 --2- 172.21.15.5:0/3546352408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480d3990 0x7f9f480d3df0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 --2- 172.21.15.5:0/3546352408 >> v2:172.21.15.80:3300/0 conn(0x7f9f4815e0a0 0x7f9f480d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 -- 172.21.15.5:0/3546352408 >> 172.21.15.5:0/3546352408 conn(0x7f9f480668f0 msgr2=0x7f9f48066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 -- 172.21.15.5:0/3546352408 shutdown_connections 2024-04-25T09:03:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.048+0000 7f9f50189640 1 -- 172.21.15.5:0/3546352408 wait complete. 2024-04-25T09:03:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 Processor -- start 2024-04-25T09:03:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 -- start start 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480ce5e0 0x7f9f4814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f4815e0a0 0x7f9f480ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f480b0110 0x7f9f480cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480d2920 con 0x7f9f480ce5e0 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480d2640 con 0x7f9f480b0110 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.050+0000 7f9f50189640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480d2c00 con 0x7f9f4815e0a0 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480ce5e0 0x7f9f4814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480ce5e0 0x7f9f4814cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58566/0 (socket says 172.21.15.5:58566) 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 -- 172.21.15.5:0/3285418276 learned_addr learned my addr 172.21.15.5:0/3285418276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4e726640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f480b0110 0x7f9f480cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4d724640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f4815e0a0 0x7f9f480ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 -- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f4815e0a0 msgr2=0x7f9f480ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f4815e0a0 0x7f9f480ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 -- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f480b0110 msgr2=0x7f9f480cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f480b0110 0x7f9f480cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 -- 172.21.15.5:0/3285418276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4814d440 con 0x7f9f480ce5e0 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.051+0000 7f9f4df25640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480ce5e0 0x7f9f4814cf00 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f9f38007e90 tx=0x7f9f3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.052+0000 7f9f467fc640 1 -- 172.21.15.5:0/3285418276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38014620 con 0x7f9f480ce5e0 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.052+0000 7f9f467fc640 1 -- 172.21.15.5:0/3285418276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38019070 con 0x7f9f480ce5e0 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.052+0000 7f9f467fc640 1 -- 172.21.15.5:0/3285418276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38014a20 con 0x7f9f480ce5e0 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.052+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4814d8e0 con 0x7f9f480ce5e0 2024-04-25T09:03:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.052+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4814dea0 con 0x7f9f480ce5e0 2024-04-25T09:03:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.053+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4804ef20 con 0x7f9f480ce5e0 2024-04-25T09:03:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.053+0000 7f9f467fc640 1 -- 172.21.15.5:0/3285418276 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f38014bc0 con 0x7f9f480ce5e0 2024-04-25T09:03:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.054+0000 7f9f467fc640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3406b4d0 0x7f9f3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.054+0000 7f9f467fc640 1 -- 172.21.15.5:0/3285418276 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f3808aa10 con 0x7f9f480ce5e0 2024-04-25T09:03:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.054+0000 7f9f4d724640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3406b4d0 0x7f9f3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.054+0000 7f9f4d724640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3406b4d0 0x7f9f3406d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c034000 tx=0x7f9f3c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.058+0000 7f9f467fc640 1 -- 172.21.15.5:0/3285418276 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f380591a0 con 0x7f9f480ce5e0 2024-04-25T09:03:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.308+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9f480b9370 con 0x7f9f480ce5e0 2024-04-25T09:03:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.308+0000 7f9f467fc640 1 -- 172.21.15.5:0/3285418276 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1187 (secure 0 0 0) 0x7f9f3805d240 con 0x7f9f480ce5e0 2024-04-25T09:03:56.297 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":456,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076144046,"bytes_used":2549727232,"bytes_avail":770544386048,"bytes_total":773094113280,"write_bytes_sec":75117287,"read_op_per_sec":0,"write_op_per_sec":73},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-04-25T09:01:58.457242+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:03:56.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.310+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3406b4d0 msgr2=0x7f9f3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3406b4d0 0x7f9f3406d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c034000 tx=0x7f9f3c02e000 comp rx=0 tx=0).stop 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480ce5e0 msgr2=0x7f9f4814cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480ce5e0 0x7f9f4814cf00 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f9f38007e90 tx=0x7f9f3800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 shutdown_connections 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9f3406b4d0 0x7f9f3406d990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f480b0110 0x7f9f480cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9f4815e0a0 0x7f9f480ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 --2- 172.21.15.5:0/3285418276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480ce5e0 0x7f9f4814cf00 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 >> 172.21.15.5:0/3285418276 conn(0x7f9f480668f0 msgr2=0x7f9f480b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 shutdown_connections 2024-04-25T09:03:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:56.311+0000 7f9f50189640 1 -- 172.21.15.5:0/3285418276 wait complete. 2024-04-25T09:03:56.310 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:03:57.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:57.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.436+0000 7f6b2cb6a640 1 Processor -- start 2024-04-25T09:03:57.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.436+0000 7f6b2cb6a640 1 -- start start 2024-04-25T09:03:57.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.436+0000 7f6b2cb6a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 0x7f6b280b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.436+0000 7f6b2cb6a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b280ce7f0 0x7f6b280cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.436+0000 7f6b2cb6a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280cf1c0 con 0x7f6b280b2cc0 2024-04-25T09:03:57.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.436+0000 7f6b2cb6a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b280d2a10 con 0x7f6b280ce7f0 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.436+0000 7f6b2cb6a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280d20e0 con 0x7f6b2815de70 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b1ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6b280b2cc0 0x7f6b280b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46338/0 (socket says 172.21.15.5:46338) 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b1ffff640 1 -- 172.21.15.5:0/1931304944 learned_addr learned my addr 172.21.15.5:0/1931304944 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b26d9d640 1 --2- 172.21.15.5:0/1931304944 >> v2:172.21.15.80:3300/0 conn(0x7f6b280ce7f0 0x7f6b280cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b2659c640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 0x7f6b280b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879502400 0 0) 0x7f6b280cf1c0 con 0x7f6b280b2cc0 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b14003520 con 0x7f6b280b2cc0 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2700058984 0 0) 0x7f6b14003520 con 0x7f6b280b2cc0 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 msgr2=0x7f6b280b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 0x7f6b280b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 >> v2:172.21.15.80:3300/0 conn(0x7f6b280ce7f0 msgr2=0x7f6b280cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 --2- 172.21.15.5:0/1931304944 >> v2:172.21.15.80:3300/0 conn(0x7f6b280ce7f0 0x7f6b280cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280d23c0 con 0x7f6b280b2cc0 2024-04-25T09:03:57.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f6b10001670 con 0x7f6b280b2cc0 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b2659c640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 0x7f6b280b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b26d9d640 1 --2- 172.21.15.5:0/1931304944 >> v2:172.21.15.80:3300/0 conn(0x7f6b280ce7f0 0x7f6b280cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 >> v1:172.21.15.5:6789/0 conn(0x7f6b280b2cc0 legacy=0x7f6b280b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140039b0 0x7f6b14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 0x7f6b14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b14004d40 0x7f6b140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280d2a10 con 0x7f6b14004d40 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280d20e0 con 0x7f6b140039b0 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1400b9c0 con 0x7f6b2815de70 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b26d9d640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b14004d40 0x7f6b140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.437+0000 7f6b2659c640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140039b0 0x7f6b14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.438+0000 7f6b1ffff640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 0x7f6b14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.438+0000 7f6b26d9d640 1 -- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 msgr2=0x7f6b14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.438+0000 7f6b26d9d640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b2815de70 0x7f6b14004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.438+0000 7f6b26d9d640 1 -- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140039b0 msgr2=0x7f6b14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.438+0000 7f6b26d9d640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140039b0 0x7f6b14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.438+0000 7f6b26d9d640 1 -- 172.21.15.5:0/1931304944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14003520 con 0x7f6b14004d40 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b26d9d640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b14004d40 0x7f6b140051c0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000e350 tx=0x7f6b14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ed2e884361ad29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20009de0 con 0x7f6b14004d40 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2002e660 con 0x7f6b14004d40 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b25d9b640 1 -- 172.21.15.5:0/1931304944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2002ea10 con 0x7f6b14004d40 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1931304944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b14004d40 msgr2=0x7f6b140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b2cb6a640 1 --2- 172.21.15.5:0/1931304944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b14004d40 0x7f6b140051c0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000e350 tx=0x7f6b14005830 comp rx=0 tx=0).stop 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b26d9d640 1 -- 172.21.15.5:0/1931304944 reap_dead start 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1931304944 shutdown_connections 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1931304944 >> 172.21.15.5:0/1931304944 conn(0x7f6b2806b000 msgr2=0x7f6b2806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1931304944 shutdown_connections 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.439+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1931304944 wait complete. 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 Processor -- start 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 -- start start 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b14004d40 0x7f6b281f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b280cbd80 0x7f6b280caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b281f6670 0x7f6b280b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280b93e0 con 0x7f6b280cbd80 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280b7300 con 0x7f6b14004d40 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.441+0000 7f6b2cb6a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280b9560 con 0x7f6b281f6670 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b280cbd80 0x7f6b280caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b280cbd80 0x7f6b280caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58574/0 (socket says 172.21.15.5:58574) 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 -- 172.21.15.5:0/1480411013 learned_addr learned my addr 172.21.15.5:0/1480411013 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b2659c640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b14004d40 0x7f6b281f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b26d9d640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b281f6670 0x7f6b280b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 -- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b281f6670 msgr2=0x7f6b280b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b281f6670 0x7f6b280b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 -- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b14004d40 msgr2=0x7f6b281f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b14004d40 0x7f6b281f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 -- 172.21.15.5:0/1480411013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280cb310 con 0x7f6b280cbd80 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1ffff640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b280cbd80 0x7f6b280caba0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f6b10007310 tx=0x7f6b100077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1effd640 1 -- 172.21.15.5:0/1480411013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000fa00 con 0x7f6b280cbd80 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1effd640 1 -- 172.21.15.5:0/1480411013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10018070 con 0x7f6b280cbd80 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b280cb5f0 con 0x7f6b280cbd80 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b1effd640 1 -- 172.21.15.5:0/1480411013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000fe20 con 0x7f6b280cbd80 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.442+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b281f6af0 con 0x7f6b280cbd80 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.443+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b280cbb10 con 0x7f6b280cbd80 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.444+0000 7f6b1effd640 1 -- 172.21.15.5:0/1480411013 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6b1001d460 con 0x7f6b280cbd80 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.444+0000 7f6b1effd640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b0806b500 0x7f6b0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.444+0000 7f6b1effd640 1 -- 172.21.15.5:0/1480411013 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b1008a240 con 0x7f6b280cbd80 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.445+0000 7f6b2659c640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b0806b500 0x7f6b0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.445+0000 7f6b2659c640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b0806b500 0x7f6b0806d9c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009b50 tx=0x7f6b18009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.449+0000 7f6b1effd640 1 -- 172.21.15.5:0/1480411013 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b280cbb10 con 0x7f6b280cbd80 2024-04-25T09:03:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.669+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b2804ef20 con 0x7f6b280cbd80 2024-04-25T09:03:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.670+0000 7f6b1effd640 1 -- 172.21.15.5:0/1480411013 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f6b10058b00 con 0x7f6b280cbd80 2024-04-25T09:03:57.659 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:57.659 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.671+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b0806b500 msgr2=0x7f6b0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.671+0000 7f6b2cb6a640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b0806b500 0x7f6b0806d9c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009b50 tx=0x7f6b18009190 comp rx=0 tx=0).stop 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.671+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b280cbd80 msgr2=0x7f6b280caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.671+0000 7f6b2cb6a640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b280cbd80 0x7f6b280caba0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f6b10007310 tx=0x7f6b100077d0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 shutdown_connections 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b0806b500 0x7f6b0806d9c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b281f6670 0x7f6b280b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b280cbd80 0x7f6b280caba0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 --2- 172.21.15.5:0/1480411013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b14004d40 0x7f6b281f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 >> 172.21.15.5:0/1480411013 conn(0x7f6b2806b000 msgr2=0x7f6b280b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 shutdown_connections 2024-04-25T09:03:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.672+0000 7f6b2cb6a640 1 -- 172.21.15.5:0/1480411013 wait complete. 2024-04-25T09:03:57.671 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:03:57.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:03:57.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.783+0000 7f7955970640 1 Processor -- start 2024-04-25T09:03:57.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.783+0000 7f7955970640 1 -- start start 2024-04-25T09:03:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f7955970640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f795015dc70 0x7f7950161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f7955970640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79500cef60 0x7f79500d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f7955970640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7950161fc0 con 0x7f79500b94a0 2024-04-25T09:03:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f7955970640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500d2180 con 0x7f79500cef60 2024-04-25T09:03:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f7955970640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7950161d90 con 0x7f795015dc70 2024-04-25T09:03:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f794effd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f795015dc70 0x7f7950161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f794f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79500cef60 0x7f79500d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f794e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f79500b94a0 0x7f79500ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41850/0 (socket says 172.21.15.5:41850) 2024-04-25T09:03:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f794effd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f795015dc70 0x7f7950161850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:57434/0 (socket says 172.21.15.5:57434) 2024-04-25T09:03:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f794f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79500cef60 0x7f79500d2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:43066/0 (socket says 172.21.15.5:43066) 2024-04-25T09:03:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.784+0000 7f794e7fc640 1 -- 172.21.15.5:0/688045109 learned_addr learned my addr 172.21.15.5:0/688045109 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:57.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794dffb640 1 -- 172.21.15.5:0/688045109 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990328770 0 0) 0x7f7950161fc0 con 0x7f79500b94a0 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794dffb640 1 -- 172.21.15.5:0/688045109 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c003520 con 0x7f79500b94a0 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794effd640 1 -- 172.21.15.5:0/688045109 >> v2:172.21.15.80:3300/0 conn(0x7f79500cef60 msgr2=0x7f79500d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794effd640 1 --2- 172.21.15.5:0/688045109 >> v2:172.21.15.80:3300/0 conn(0x7f79500cef60 0x7f79500d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794effd640 1 -- 172.21.15.5:0/688045109 >> v1:172.21.15.80:6789/0 conn(0x7f79500b94a0 legacy=0x7f79500ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794effd640 1 -- 172.21.15.5:0/688045109 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79501622a0 con 0x7f795015dc70 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794f7fe640 1 --2- 172.21.15.5:0/688045109 >> v2:172.21.15.80:3300/0 conn(0x7f79500cef60 0x7f79500d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.785+0000 7f794effd640 1 --2- 172.21.15.5:0/688045109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f795015dc70 0x7f7950161850 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79480097a0 tx=0x7f794802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb5584e18a1325 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f794dffb640 1 -- 172.21.15.5:0/688045109 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948037070 con 0x7f795015dc70 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f794dffb640 1 -- 172.21.15.5:0/688045109 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948032440 con 0x7f795015dc70 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f794dffb640 1 -- 172.21.15.5:0/688045109 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948032810 con 0x7f795015dc70 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 -- 172.21.15.5:0/688045109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f795015dc70 msgr2=0x7f7950161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 --2- 172.21.15.5:0/688045109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f795015dc70 0x7f7950161850 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79480097a0 tx=0x7f794802a180 comp rx=0 tx=0).stop 2024-04-25T09:03:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 -- 172.21.15.5:0/688045109 shutdown_connections 2024-04-25T09:03:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 --2- 172.21.15.5:0/688045109 >> v2:172.21.15.80:3300/0 conn(0x7f79500cef60 0x7f79500d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 --2- 172.21.15.5:0/688045109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f795015dc70 0x7f7950161850 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 -- 172.21.15.5:0/688045109 >> 172.21.15.5:0/688045109 conn(0x7f79500668f0 msgr2=0x7f7950066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 -- 172.21.15.5:0/688045109 shutdown_connections 2024-04-25T09:03:57.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.786+0000 7f7955970640 1 -- 172.21.15.5:0/688045109 wait complete. 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.787+0000 7f7955970640 1 Processor -- start 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f7955970640 1 -- start start 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f7955970640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79500b94a0 0x7f79501f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f7955970640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79500cef60 0x7f79500b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f7955970640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f795015dc70 0x7f79500b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f7955970640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015e050 con 0x7f79500b94a0 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f7955970640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500d11f0 con 0x7f795015dc70 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f7955970640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795015e1d0 con 0x7f79500cef60 2024-04-25T09:03:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f794effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79500b94a0 0x7f79501f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f794effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79500b94a0 0x7f79501f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58588/0 (socket says 172.21.15.5:58588) 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.788+0000 7f794effd640 1 -- 172.21.15.5:0/1106075272 learned_addr learned my addr 172.21.15.5:0/1106075272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794e7fc640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79500cef60 0x7f79500b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794f7fe640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f795015dc70 0x7f79500b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794effd640 1 -- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79500cef60 msgr2=0x7f79500b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794effd640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79500cef60 0x7f79500b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794effd640 1 -- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f795015dc70 msgr2=0x7f79500b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794effd640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f795015dc70 0x7f79500b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794effd640 1 -- 172.21.15.5:0/1106075272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500b49b0 con 0x7f79500b94a0 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794f7fe640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f795015dc70 0x7f79500b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f794effd640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79500b94a0 0x7f79501f4860 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f79480098c0 tx=0x7f79480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f7947fff640 1 -- 172.21.15.5:0/1106075272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948041020 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f7947fff640 1 -- 172.21.15.5:0/1106075272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794803d640 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f7947fff640 1 -- 172.21.15.5:0/1106075272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948037040 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500cbdb0 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.789+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500cc370 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.790+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795004ef20 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.791+0000 7f7947fff640 1 -- 172.21.15.5:0/1106075272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7948044020 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.791+0000 7f7947fff640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f793006b500 0x7f793006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.791+0000 7f7947fff640 1 -- 172.21.15.5:0/1106075272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79480aa890 con 0x7f79500b94a0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.791+0000 7f794e7fc640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f793006b500 0x7f793006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.792+0000 7f794e7fc640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f793006b500 0x7f793006d9c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f79500b5330 tx=0x7f7938009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:57.795+0000 7f7947fff640 1 -- 172.21.15.5:0/1106075272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f794804b030 con 0x7f79500b94a0 2024-04-25T09:03:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.043+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f79500d1820 con 0x7f79500b94a0 2024-04-25T09:03:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.044+0000 7f7947fff640 1 -- 172.21.15.5:0/1106075272 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1597 (secure 0 0 0) 0x7f7948079720 con 0x7f79500b94a0 2024-04-25T09:03:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:58.033 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":457,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2550562816,"bytes_avail":770543550464,"bytes_total":773094113280,"write_bytes_sec":75153211,"read_op_per_sec":0,"write_op_per_sec":73},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-04-25T09:03:56.485214+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f793006b500 msgr2=0x7f793006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f793006b500 0x7f793006d9c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f79500b5330 tx=0x7f7938009040 comp rx=0 tx=0).stop 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79500b94a0 msgr2=0x7f79501f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79500b94a0 0x7f79501f4860 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f79480098c0 tx=0x7f79480046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 shutdown_connections 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f793006b500 0x7f793006d9c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f795015dc70 0x7f79500b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79500cef60 0x7f79500b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 --2- 172.21.15.5:0/1106075272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79500b94a0 0x7f79501f4860 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 >> 172.21.15.5:0/1106075272 conn(0x7f79500668f0 msgr2=0x7f79500c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 shutdown_connections 2024-04-25T09:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.046+0000 7f7955970640 1 -- 172.21.15.5:0/1106075272 wait complete. 2024-04-25T09:03:58.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:03:58.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:58.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub resume 2024-04-25T09:03:58.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.160+0000 7ff72c790640 1 Processor -- start 2024-04-25T09:03:58.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.160+0000 7ff72c790640 1 -- start start 2024-04-25T09:03:58.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72c790640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 0x7ff7240b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72c790640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7240b2850 0x7ff7240aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72c790640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff724072690 con 0x7ff7240ce190 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72c790640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff724071ff0 con 0x7ff7240b2850 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72c790640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240b2cb0 con 0x7ff7240ae690 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72ad2d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7240ce190 0x7ff7240cefd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46342/0 (socket says 172.21.15.5:46342) 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72ad2d640 1 -- 172.21.15.5:0/3967929387 learned_addr learned my addr 172.21.15.5:0/3967929387 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72a52c640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 0x7ff7240b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff729d2b640 1 --2- 172.21.15.5:0/3967929387 >> v2:172.21.15.80:3300/0 conn(0x7ff7240b2850 0x7ff7240aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234167947 0 0) 0x7ff724072690 con 0x7ff7240ce190 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.161+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff710003520 con 0x7ff7240ce190 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238710289 0 0) 0x7ff710003520 con 0x7ff7240ce190 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 msgr2=0x7ff7240b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 0x7ff7240b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 >> v2:172.21.15.80:3300/0 conn(0x7ff7240b2850 msgr2=0x7ff7240aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 --2- 172.21.15.5:0/3967929387 >> v2:172.21.15.80:3300/0 conn(0x7ff7240b2850 0x7ff7240aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7240aefb0 con 0x7ff7240ce190 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7ff7200019f0 con 0x7ff7240ce190 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 >> v1:172.21.15.5:6789/0 conn(0x7ff7240ce190 legacy=0x7ff7240cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7100039b0 0x7ff710003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff710004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 0x7ff7100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240b2cb0 con 0x7ff710004800 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71000b9c0 con 0x7ff7100039b0 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71000bb40 con 0x7ff7240ae690 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff729d2b640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff710004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72a52c640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7100039b0 0x7ff710003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 0x7ff7100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff729d2b640 1 -- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 msgr2=0x7ff7100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff729d2b640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7240ae690 0x7ff7100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff729d2b640 1 -- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7100039b0 msgr2=0x7ff710003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff729d2b640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7100039b0 0x7ff710003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.162+0000 7ff729d2b640 1 -- 172.21.15.5:0/3967929387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710003520 con 0x7ff710004800 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.163+0000 7ff729d2b640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff710004c80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff714009af0 tx=0x7ff710005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140beca2e58a2655 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.163+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714036070 con 0x7ff710004800 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.163+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714031400 con 0x7ff710004800 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.163+0000 7ff72952a640 1 -- 172.21.15.5:0/3967929387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714009690 con 0x7ff710004800 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.164+0000 7ff72c790640 1 -- 172.21.15.5:0/3967929387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 msgr2=0x7ff710004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.164+0000 7ff72c790640 1 --2- 172.21.15.5:0/3967929387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff710004c80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff714009af0 tx=0x7ff710005830 comp rx=0 tx=0).stop 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.164+0000 7ff72ad2d640 1 -- 172.21.15.5:0/3967929387 reap_dead start 2024-04-25T09:03:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.164+0000 7ff72c790640 1 -- 172.21.15.5:0/3967929387 shutdown_connections 2024-04-25T09:03:58.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.164+0000 7ff72c790640 1 -- 172.21.15.5:0/3967929387 >> 172.21.15.5:0/3967929387 conn(0x7ff7240b1550 msgr2=0x7ff7240b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.164+0000 7ff72c790640 1 -- 172.21.15.5:0/3967929387 shutdown_connections 2024-04-25T09:03:58.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.164+0000 7ff72c790640 1 -- 172.21.15.5:0/3967929387 wait complete. 2024-04-25T09:03:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.165+0000 7ff72c790640 1 Processor -- start 2024-04-25T09:03:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.165+0000 7ff72c790640 1 -- start start 2024-04-25T09:03:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72c790640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff7241444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72c790640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7241f1500 0x7ff724153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72c790640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7241f1980 0x7ff7241539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72c790640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240cd6b0 con 0x7ff710004800 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72c790640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240cd3d0 con 0x7ff7241f1980 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72c790640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240cd990 con 0x7ff7241f1500 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff7241444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff7241444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58616/0 (socket says 172.21.15.5:58616) 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 -- 172.21.15.5:0/503104501 learned_addr learned my addr 172.21.15.5:0/503104501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7241f1980 0x7ff7241539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 -- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7241f1500 msgr2=0x7ff724153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7241f1500 0x7ff724153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 -- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7241f1980 msgr2=0x7ff7241539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7241f1980 0x7ff7241539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 -- 172.21.15.5:0/503104501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7241f1f10 con 0x7ff710004800 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7241f1980 0x7ff7241539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.166+0000 7ff72a52c640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff7241444e0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0118e0 tx=0x7ff71c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.167+0000 7ff71affd640 1 -- 172.21.15.5:0/503104501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00fa90 con 0x7ff710004800 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.167+0000 7ff71affd640 1 -- 172.21.15.5:0/503104501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00fc30 con 0x7ff710004800 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.167+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7241f21f0 con 0x7ff710004800 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.167+0000 7ff71affd640 1 -- 172.21.15.5:0/503104501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c014440 con 0x7ff710004800 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.167+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff724152c50 con 0x7ff710004800 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.168+0000 7ff71affd640 1 -- 172.21.15.5:0/503104501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff71c012040 con 0x7ff710004800 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.169+0000 7ff71affd640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff70806b4d0 0x7ff70806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.169+0000 7ff71affd640 1 -- 172.21.15.5:0/503104501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff71c08a7a0 con 0x7ff710004800 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.169+0000 7ff729d2b640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff70806b4d0 0x7ff70806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.169+0000 7ff729d2b640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff70806b4d0 0x7ff70806d990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff714033000 tx=0x7ff71402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.170+0000 7ff72f573740 1 Processor -- start 2024-04-25T09:03:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.170+0000 7ff72f573740 1 -- start start 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72f573740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b25770 0x564ec9b2b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72f573740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec9a8eda0 con 0x564ec9b55510 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec9a37b80 con 0x564ec9b25770 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ec9a8ae40 con 0x564ec9b71470 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58620/0 (socket says 172.21.15.5:58620) 2024-04-25T09:03:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 -- 172.21.15.5:0/1704486879 learned_addr learned my addr 172.21.15.5:0/1704486879 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff729d2b640 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b25770 0x564ec9b2b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 -- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 msgr2=0x564ec9b718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 -- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b25770 msgr2=0x564ec9b2b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b25770 0x564ec9b2b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 -- 172.21.15.5:0/1704486879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ec9a41f10 con 0x564ec9b55510 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff72a52c640 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b558f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0610f0 tx=0x7ff71c059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7fb1cd08e7a9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff707fff640 1 -- 172.21.15.5:0/1704486879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c070020 con 0x564ec9b55510 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff707fff640 1 -- 172.21.15.5:0/1704486879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c061620 con 0x564ec9b55510 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.171+0000 7ff707fff640 1 -- 172.21.15.5:0/1704486879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c055630 con 0x564ec9b55510 2024-04-25T09:03:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 -- 172.21.15.5:0/1704486879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 msgr2=0x564ec9b558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b558f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0610f0 tx=0x7ff71c059040 comp rx=0 tx=0).stop 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 -- 172.21.15.5:0/1704486879 shutdown_connections 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b25770 0x564ec9b2b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 --2- 172.21.15.5:0/1704486879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b558f0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 -- 172.21.15.5:0/1704486879 >> 172.21.15.5:0/1704486879 conn(0x564ec9b279e0 msgr2=0x564ec9b70320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 -- 172.21.15.5:0/1704486879 shutdown_connections 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.172+0000 7ff72f573740 1 -- 172.21.15.5:0/1704486879 wait complete. 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.173+0000 7ff72f573740 1 -- start start 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.173+0000 7ff72f573740 1 Processor -- start 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b55510 0x564ec9b3db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9b3e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b51990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec9b2bce0 con 0x564ec9b71470 2024-04-25T09:03:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec9a2d4b0 con 0x564ec9b51510 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ec9b2b310 con 0x564ec9b55510 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 10 client.0 _ll_register_callbacks cb 0x564ec9a6d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9b3e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9b3e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58630/0 (socket says 172.21.15.5:58630) 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 -- 172.21.15.5:0/4021787990 learned_addr learned my addr 172.21.15.5:0/4021787990 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b51990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72a52c640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b55510 0x564ec9b3db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 -- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b55510 msgr2=0x564ec9b3db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b55510 0x564ec9b3db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 -- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 msgr2=0x564ec9b51990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b51990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 -- 172.21.15.5:0/4021787990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ec986d7d0 con 0x564ec9b71470 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b51990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72a52c640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b55510 0x564ec9b3db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff729d2b640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9b3e050 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7ff71403b8b0 tx=0x7ff7140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836dbf27268f5ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff7057fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff7057fa640 1 -- 172.21.15.5:0/4021787990 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71404a070 con 0x564ec9b71470 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff7057fa640 1 -- 172.21.15.5:0/4021787990 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff714046600 con 0x564ec9b71470 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff71c061620 con 0x564ec9b71470 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff7057fa640 1 -- 172.21.15.5:0/4021787990 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff714055050 con 0x564ec9b71470 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.174+0000 7ff72f573740 10 client.8259 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x564ec97a33f0 con 0x564ec9b71470 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff7057fa640 1 -- 172.21.15.5:0/4021787990 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c061620 con 0x564ec9b71470 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff7057fa640 1 -- 172.21.15.5:0/4021787990 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff714058020 con 0x564ec9b71470 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72f573740 10 client.8259 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72f573740 10 client.8259 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72f573740 20 client.8259 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72f573740 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9b563f0 0x564ec9b567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72f573740 4 client.8259 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ec9a9c2e0 con 0x564ec9b563f0 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72a52c640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9b563f0 0x564ec9b567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff72a52c640 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9b563f0 0x564ec9b567d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d6d901472677972 server_cookie=3e6cb0baa9db8a63 in_seq=0 out_seq=0 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.175+0000 7ff7057fa640 10 client.8259 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff7057fa640 1 -- 172.21.15.5:0/4021787990 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564ec9a9c2e0 con 0x564ec9b563f0 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff7057fa640 10 client.8259 handle_command_reply: tid=0 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 client.8259 shutdown 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 msgr2=0x564ec9b3e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9b3e050 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7ff71403b8b0 tx=0x7ff7140046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 shutdown_connections 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b51990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9b3e050 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9b563f0 0x564ec9b567d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 --2- 172.21.15.5:0/4021787990 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b55510 0x564ec9b3db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff7057fa640 0 client.8259 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 >> 172.21.15.5:0/4021787990 conn(0x564ec9b25770 msgr2=0x564ec9b70bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 shutdown_connections 2024-04-25T09:03:58.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.176+0000 7ff72f573740 1 -- 172.21.15.5:0/4021787990 wait complete. 2024-04-25T09:03:58.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.177+0000 7ff72f573740 20 client.8259 trim_cache size 0 max 16384 2024-04-25T09:03:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.191+0000 7ff72f573740 1 Processor -- start 2024-04-25T09:03:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.191+0000 7ff72f573740 1 -- start start 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b67300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72f573740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b96c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72f573740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7241fc0e0 con 0x564ec9b55510 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff724156d60 con 0x564ec9b51510 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff724156160 con 0x564ec9b71470 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b682f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58636/0 (socket says 172.21.15.5:58636) 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 -- 172.21.15.5:0/4056119676 learned_addr learned my addr 172.21.15.5:0/4056119676 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72a52c640 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b67300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b96c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 -- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 msgr2=0x564ec9b96c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b96c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 -- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 msgr2=0x564ec9b67300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b67300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff729d2b640 1 -- 172.21.15.5:0/4056119676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ec97630f0 con 0x564ec9b55510 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.192+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b96c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff729d2b640 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b682f0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7ff714034040 tx=0x7ff714046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8497b1bdf40bae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff7077fe640 1 -- 172.21.15.5:0/4056119676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71405f020 con 0x564ec9b55510 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff7077fe640 1 -- 172.21.15.5:0/4056119676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714040040 con 0x564ec9b55510 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff7077fe640 1 -- 172.21.15.5:0/4056119676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71404a040 con 0x564ec9b55510 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 -- 172.21.15.5:0/4056119676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 msgr2=0x564ec9b682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b682f0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7ff714034040 tx=0x7ff714046000 comp rx=0 tx=0).stop 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 -- 172.21.15.5:0/4056119676 shutdown_connections 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b71470 0x564ec9b96c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b55510 0x564ec9b682f0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 --2- 172.21.15.5:0/4056119676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b51510 0x564ec9b67300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 -- 172.21.15.5:0/4056119676 >> 172.21.15.5:0/4056119676 conn(0x564ec9b25770 msgr2=0x564ec9b72c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 -- 172.21.15.5:0/4056119676 shutdown_connections 2024-04-25T09:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.193+0000 7ff72f573740 1 -- 172.21.15.5:0/4056119676 wait complete. 2024-04-25T09:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.194+0000 7ff72f573740 1 -- start start 2024-04-25T09:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.194+0000 7ff72f573740 1 Processor -- start 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b51510 0x564ec9b3d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72f573740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b55510 0x564ec9b664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72f573740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9bc7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72f573740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec9a45e20 con 0x564ec9b71470 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff724156760 con 0x564ec9b55510 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72f573740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ec9b67b00 con 0x564ec9b51510 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72f573740 10 client.0 _ll_register_callbacks cb 0x7ff71c006bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9bc7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9bc7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58648/0 (socket says 172.21.15.5:58648) 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 -- 172.21.15.5:0/765269815 learned_addr learned my addr 172.21.15.5:0/765269815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72a52c640 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b51510 0x564ec9b3d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff729d2b640 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b55510 0x564ec9b664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 -- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b51510 msgr2=0x564ec9b3d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b51510 0x564ec9b3d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 -- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b55510 msgr2=0x564ec9b664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b55510 0x564ec9b664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 -- 172.21.15.5:0/765269815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ec9b669e0 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff72ad2d640 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9bc7800 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff72406e430 tx=0x7ff720007490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d95f87babaa5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.195+0000 7ff7057fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff7057fa640 1 -- 172.21.15.5:0/765269815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72001c070 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff7057fa640 1 -- 172.21.15.5:0/765269815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff720018650 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff714040040 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff7057fa640 1 -- 172.21.15.5:0/765269815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff720027050 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 10 client.8265 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x564ec9b2a3c0 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff7057fa640 1 -- 172.21.15.5:0/765269815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714040040 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff7057fa640 1 -- 172.21.15.5:0/765269815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff72002a020 con 0x564ec9b71470 2024-04-25T09:03:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 10 client.8265 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 10 client.8265 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 20 client.8265 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9bc7d90 0x564ec9b24600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 4 client.8265 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x564ec9a96630 con 0x564ec9bc7d90 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.196+0000 7ff72a52c640 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9bc7d90 0x564ec9b24600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff7057fa640 10 client.8265 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72a52c640 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9bc7d90 0x564ec9b24600 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c6d78e23cabc97 server_cookie=f66f3792a599d6c3 in_seq=0 out_seq=0 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff7057fa640 1 -- 172.21.15.5:0/765269815 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x564ec9a96630 con 0x564ec9bc7d90 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff7057fa640 10 client.8265 handle_command_reply: tid=0 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 client.8265 shutdown 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 msgr2=0x564ec9bc7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9bc7800 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff72406e430 tx=0x7ff720007490 comp rx=0 tx=0).stop 2024-04-25T09:03:58.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 shutdown_connections 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ec9b71470 0x564ec9bc7800 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ec9b55510 0x564ec9b664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x564ec9bc7d90 0x564ec9b24600 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 --2- 172.21.15.5:0/765269815 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x564ec9b51510 0x564ec9b3d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff7057fa640 0 client.8265 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 >> 172.21.15.5:0/765269815 conn(0x564ec9b25770 msgr2=0x564ec9b3d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 shutdown_connections 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 1 -- 172.21.15.5:0/765269815 wait complete. 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.197+0000 7ff72f573740 20 client.8265 trim_cache size 0 max 16384 2024-04-25T09:03:58.192 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:58.193 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T09:03:58.193 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff70806b4d0 msgr2=0x7ff70806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff70806b4d0 0x7ff70806d990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff714033000 tx=0x7ff71402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 msgr2=0x7ff7241444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff7241444e0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0118e0 tx=0x7ff71c011da0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 shutdown_connections 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff70806b4d0 0x7ff70806d990 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7241f1980 0x7ff7241539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff7241f1500 0x7ff724153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 --2- 172.21.15.5:0/503104501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff710004800 0x7ff7241444e0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 >> 172.21.15.5:0/503104501 conn(0x7ff7240b1550 msgr2=0x7ff7240afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 shutdown_connections 2024-04-25T09:03:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.198+0000 7ff72c790640 1 -- 172.21.15.5:0/503104501 wait complete. 2024-04-25T09:03:58.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:58.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:03:58.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.311+0000 7f8fc724a640 1 Processor -- start 2024-04-25T09:03:58.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.311+0000 7f8fc724a640 1 -- start start 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.312+0000 7f8fc724a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fc00d0610 0x7f8fc00b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.312+0000 7f8fc724a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00cdef0 con 0x7f8fc00b24b0 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.312+0000 7f8fc724a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00cf7a0 con 0x7f8fc015c0f0 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.312+0000 7f8fc724a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00cd350 con 0x7f8fc00d0610 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.312+0000 7f8fbffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8fc00b24b0 0x7f8fc00cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46344/0 (socket says 172.21.15.5:46344) 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.312+0000 7f8fbffff640 1 -- 172.21.15.5:0/2077549843 learned_addr learned my addr 172.21.15.5:0/2077549843 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.313+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/2077549843 >> v2:172.21.15.80:3300/0 conn(0x7f8fc00d0610 0x7f8fc00b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.313+0000 7f8fbf7fe640 1 -- 172.21.15.5:0/2077549843 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706195839 0 0) 0x7f8fc00cdef0 con 0x7f8fc00b24b0 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.313+0000 7f8fbf7fe640 1 -- 172.21.15.5:0/2077549843 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fac003520 con 0x7f8fc00b24b0 2024-04-25T09:03:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.313+0000 7f8fc57e7640 1 -- 172.21.15.5:0/2077549843 >> v1:172.21.15.80:6789/0 conn(0x7f8fc015c0f0 legacy=0x7f8fc00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.313+0000 7f8fbf7fe640 1 -- 172.21.15.5:0/2077549843 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4035343749 0 0) 0x7f8fac003520 con 0x7f8fc00b24b0 2024-04-25T09:03:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.313+0000 7f8fc57e7640 1 -- 172.21.15.5:0/2077549843 >> v1:172.21.15.5:6789/0 conn(0x7f8fc00b24b0 legacy=0x7f8fc00cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.313+0000 7f8fc57e7640 1 -- 172.21.15.5:0/2077549843 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00d24e0 con 0x7f8fc00d0610 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.314+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/2077549843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00d0610 0x7f8fc00b2960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00cd4d0 tx=0x7f8fb002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90f6552df50949a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.314+0000 7f8fbf7fe640 1 -- 172.21.15.5:0/2077549843 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0037070 con 0x7f8fc00d0610 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.314+0000 7f8fbf7fe640 1 -- 172.21.15.5:0/2077549843 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb002ac30 con 0x7f8fc00d0610 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.314+0000 7f8fbf7fe640 1 -- 172.21.15.5:0/2077549843 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8001670 con 0x7f8fc00d0610 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.314+0000 7f8fc724a640 1 -- 172.21.15.5:0/2077549843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00d0610 msgr2=0x7f8fc00b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.314+0000 7f8fc724a640 1 --2- 172.21.15.5:0/2077549843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00d0610 0x7f8fc00b2960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00cd4d0 tx=0x7f8fb002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.315+0000 7f8fc724a640 1 -- 172.21.15.5:0/2077549843 shutdown_connections 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.315+0000 7f8fc724a640 1 --2- 172.21.15.5:0/2077549843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00d0610 0x7f8fc00b2960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.315+0000 7f8fc724a640 1 -- 172.21.15.5:0/2077549843 >> 172.21.15.5:0/2077549843 conn(0x7f8fc00d1920 msgr2=0x7f8fc00d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.315+0000 7f8fc724a640 1 -- 172.21.15.5:0/2077549843 shutdown_connections 2024-04-25T09:03:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.315+0000 7f8fc724a640 1 -- 172.21.15.5:0/2077549843 wait complete. 2024-04-25T09:03:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.316+0000 7f8fc724a640 1 Processor -- start 2024-04-25T09:03:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.316+0000 7f8fc724a640 1 -- start start 2024-04-25T09:03:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc724a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00b24b0 0x7f8fc0159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc724a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc00d0610 0x7f8fc014cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc724a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fc015c0f0 0x7f8fc00b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc724a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00cfa40 con 0x7f8fc00d0610 2024-04-25T09:03:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc724a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b3170 con 0x7f8fc00b24b0 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc724a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00c5470 con 0x7f8fc015c0f0 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc00d0610 0x7f8fc014cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc00d0610 0x7f8fc014cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58660/0 (socket says 172.21.15.5:58660) 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 -- 172.21.15.5:0/4214702453 learned_addr learned my addr 172.21.15.5:0/4214702453 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00b24b0 0x7f8fc0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fc015c0f0 0x7f8fc00b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 -- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fc015c0f0 msgr2=0x7f8fc00b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fc015c0f0 0x7f8fc00b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 -- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00b24b0 msgr2=0x7f8fc0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00b24b0 0x7f8fc0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 -- 172.21.15.5:0/4214702453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00ca9e0 con 0x7f8fc00d0610 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fc015c0f0 0x7f8fc00b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbffff640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc00d0610 0x7f8fc014cc20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c750 tx=0x7f8fa800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbd7fa640 1 -- 172.21.15.5:0/4214702453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8017070 con 0x7f8fc00d0610 2024-04-25T09:03:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbd7fa640 1 -- 172.21.15.5:0/4214702453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa8005ad0 con 0x7f8fc00d0610 2024-04-25T09:03:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc00b5c40 con 0x7f8fc00d0610 2024-04-25T09:03:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.317+0000 7f8fbd7fa640 1 -- 172.21.15.5:0/4214702453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8007070 con 0x7f8fc00d0610 2024-04-25T09:03:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.318+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc00b6200 con 0x7f8fc00d0610 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.319+0000 7f8fbd7fa640 1 -- 172.21.15.5:0/4214702453 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8fa801a070 con 0x7f8fc00d0610 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.319+0000 7f8fbd7fa640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.319+0000 7f8fbd7fa640 1 -- 172.21.15.5:0/4214702453 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fa8089860 con 0x7f8fc00d0610 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.320+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.320+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80012e0 tx=0x7f8fb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.320+0000 7f8fca028740 1 Processor -- start 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.320+0000 7f8fca028740 1 -- start start 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6dab10 0x55a94a6dd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fca028740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6dd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6ad770 0x55a94a6b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fca028740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94a616da0 con 0x55a94a6daef0 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94a5bfb80 con 0x55a94a6dab10 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a94a612e40 con 0x55a94a6ad770 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6dd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58672/0 (socket says 172.21.15.5:58672) 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 -- 172.21.15.5:0/2764209269 learned_addr learned my addr 172.21.15.5:0/2764209269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6dab10 0x55a94a6dd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6ad770 0x55a94a6b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 -- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6ad770 msgr2=0x55a94a6b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6ad770 0x55a94a6b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 -- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6dab10 msgr2=0x55a94a6dd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6dab10 0x55a94a6dd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 -- 172.21.15.5:0/2764209269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a94a5c9f10 con 0x55a94a6daef0 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.321+0000 7f8fbffff640 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6dd860 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800cfd0 tx=0x7f8fa8057b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e821eff8779f4794 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fb67fc640 1 -- 172.21.15.5:0/2764209269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80561b0 con 0x55a94a6daef0 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fb67fc640 1 -- 172.21.15.5:0/2764209269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa8087e00 con 0x55a94a6daef0 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fb67fc640 1 -- 172.21.15.5:0/2764209269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80601c0 con 0x55a94a6daef0 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 -- 172.21.15.5:0/2764209269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 msgr2=0x55a94a6dd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6dd860 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800cfd0 tx=0x7f8fa8057b20 comp rx=0 tx=0).stop 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 -- 172.21.15.5:0/2764209269 shutdown_connections 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6ad770 0x55a94a6b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6dd860 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 --2- 172.21.15.5:0/2764209269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6dab10 0x55a94a6dd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 -- 172.21.15.5:0/2764209269 >> 172.21.15.5:0/2764209269 conn(0x55a94a6af9e0 msgr2=0x55a94a6f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 -- 172.21.15.5:0/2764209269 shutdown_connections 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.322+0000 7f8fca028740 1 -- 172.21.15.5:0/2764209269 wait complete. 2024-04-25T09:03:58.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.323+0000 7f8fca028740 1 -- start start 2024-04-25T09:03:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.323+0000 7f8fca028740 1 Processor -- start 2024-04-25T09:03:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fca028740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fca028740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94a6b2b90 con 0x55a94a6daef0 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94a5b54b0 con 0x55a94a6b1f90 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a94a6b2e70 con 0x55a94a6dab10 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fca028740 10 client.0 _ll_register_callbacks cb 0x55a94a5f5180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58688/0 (socket says 172.21.15.5:58688) 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 -- 172.21.15.5:0/592576687 learned_addr learned my addr 172.21.15.5:0/592576687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 -- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 msgr2=0x55a94a6d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 -- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 msgr2=0x55a94a6b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 -- 172.21.15.5:0/592576687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a94a3f57d0 con 0x55a94a6daef0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8fbffff640 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f3360 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8060120 tx=0x7f8fa8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba9a54ace9f86b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8f9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.324+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/592576687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8074060 con 0x55a94a6daef0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/592576687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fa80603c0 con 0x55a94a6daef0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fa8087e00 con 0x55a94a6daef0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/592576687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fa8057300 con 0x55a94a6daef0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 10 client.8277 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55a94a32b3f0 con 0x55a94a6daef0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/592576687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa8087e00 con 0x55a94a6daef0 2024-04-25T09:03:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/592576687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8fa80574a0 con 0x55a94a6daef0 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 10 client.8277 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 10 client.8277 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 20 client.8277 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a70bab0 0x55a94a70bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 4 client.8277 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a94a6242e0 con 0x55a94a70bab0 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.325+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a70bab0 0x55a94a70bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a70bab0 0x55a94a70bec0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a94dfa07d77ed785 server_cookie=157d495352bd4455 in_seq=0 out_seq=0 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8f9f7fe640 10 client.8277 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/592576687 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a94a6242e0 con 0x55a94a70bab0 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8f9f7fe640 10 client.8277 handle_command_reply: tid=0 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 client.8277 shutdown 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 msgr2=0x55a94a6f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f3360 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8060120 tx=0x7f8fa8000bc0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 shutdown_connections 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f3360 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a70bab0 0x55a94a70bec0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 --2- 172.21.15.5:0/592576687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8f9f7fe640 0 client.8277 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 >> 172.21.15.5:0/592576687 conn(0x55a94a6ad770 msgr2=0x55a94a6ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 shutdown_connections 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.326+0000 7f8fca028740 1 -- 172.21.15.5:0/592576687 wait complete. 2024-04-25T09:03:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.327+0000 7f8fca028740 20 client.8277 trim_cache size 0 max 16384 2024-04-25T09:03:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 Processor -- start 2024-04-25T09:03:58.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 -- start start 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6f8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01fff40 con 0x55a94a6daef0 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc014fa50 con 0x55a94a6b1f90 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.342+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc014ee50 con 0x55a94a6dab10 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58690/0 (socket says 172.21.15.5:58690) 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 -- 172.21.15.5:0/1769546936 learned_addr learned my addr 172.21.15.5:0/1769546936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fbffff640 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 -- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 msgr2=0x55a94a6f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 -- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 msgr2=0x55a94a6f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 -- 172.21.15.5:0/1769546936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a94a2eb0f0 con 0x55a94a6daef0 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f8860 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f8fb002a790 tx=0x7f8fb002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773c799de9b8c439 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fb5ffb640 1 -- 172.21.15.5:0/1769546936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb004a070 con 0x55a94a6daef0 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fb5ffb640 1 -- 172.21.15.5:0/1769546936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0032440 con 0x55a94a6daef0 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.343+0000 7f8fb5ffb640 1 -- 172.21.15.5:0/1769546936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0037040 con 0x55a94a6daef0 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 -- 172.21.15.5:0/1769546936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 msgr2=0x55a94a6f8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f8860 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f8fb002a790 tx=0x7f8fb002c000 comp rx=0 tx=0).stop 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 -- 172.21.15.5:0/1769546936 shutdown_connections 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6daef0 0x55a94a6f8860 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6dab10 0x55a94a6f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 --2- 172.21.15.5:0/1769546936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6b1f90 0x55a94a6f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 -- 172.21.15.5:0/1769546936 >> 172.21.15.5:0/1769546936 conn(0x55a94a6ad770 msgr2=0x55a94a6d86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 -- 172.21.15.5:0/1769546936 shutdown_connections 2024-04-25T09:03:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 -- 172.21.15.5:0/1769546936 wait complete. 2024-04-25T09:03:58.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 -- start start 2024-04-25T09:03:58.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.344+0000 7f8fca028740 1 Processor -- start 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6b1f90 0x55a94a75c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fca028740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6dab10 0x55a94a6d8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fca028740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6daef0 0x55a94a6d9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fca028740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc014f450 con 0x55a94a6dab10 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94a5b7010 con 0x55a94a6daef0 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fca028740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a94a6ff7f0 con 0x55a94a6b1f90 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fca028740 10 client.0 _ll_register_callbacks cb 0x7f8fa8054150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6dab10 0x55a94a6d8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6dab10 0x55a94a6d8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58692/0 (socket says 172.21.15.5:58692) 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fbffff640 1 -- 172.21.15.5:0/963571354 learned_addr learned my addr 172.21.15.5:0/963571354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6b1f90 0x55a94a75c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.345+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6daef0 0x55a94a6d9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fbffff640 1 -- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6b1f90 msgr2=0x55a94a75c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fbffff640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6b1f90 0x55a94a75c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fbffff640 1 -- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6daef0 msgr2=0x55a94a6d9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fbffff640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6daef0 0x55a94a6d9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fbffff640 1 -- 172.21.15.5:0/963571354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a94a6ffa40 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fc57e7640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6daef0 0x55a94a6d9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fbffff640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6dab10 0x55a94a6d8e40 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8056160 tx=0x7f8fa8054200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1f055cf6b7ea6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8f9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/963571354 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8074070 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/963571354 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fa80603c0 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fb0032440 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/963571354 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fa8056d70 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 10 client.8283 fetch_fsmap learned FSMap version 63 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55a94a6ffa40 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/963571354 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0032440 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/963571354 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8fa807d020 con 0x55a94a6dab10 2024-04-25T09:03:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 10 client.8283 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 10 client.8283 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 20 client.8283 populate_metadata read hostname 'smithi005' 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a6f24d0 0x55a94a6e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 4 client.8283 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.346+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 --> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a94a6f4bc0 con 0x55a94a6f24d0 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a6f24d0 0x55a94a6e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fc4fe6640 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a6f24d0 0x55a94a6e05f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=356155a0bcf4dd98 server_cookie=dfc0654fa178af21 in_seq=0 out_seq=0 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8f9f7fe640 10 client.8283 ms_handle_connect on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8f9f7fe640 1 -- 172.21.15.5:0/963571354 <== mds.0 v2:172.21.15.80:6835/1087126648 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a94a6f4bc0 con 0x55a94a6f24d0 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8f9f7fe640 10 client.8283 handle_command_reply: tid=0 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 client.8283 shutdown 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6dab10 msgr2=0x55a94a6d8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6dab10 0x55a94a6d8e40 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8056160 tx=0x7f8fa8054200 comp rx=0 tx=0).stop 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 shutdown_connections 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a94a6daef0 0x55a94a6d9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a94a6dab10 0x55a94a6d8e40 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:6835/1087126648,v1:172.21.15.80:6837/1087126648] conn(0x55a94a6f24d0 0x55a94a6e05f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 --2- 172.21.15.5:0/963571354 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a94a6b1f90 0x55a94a75c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8f9f7fe640 0 client.8283 ms_handle_reset on v2:172.21.15.80:6835/1087126648 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 >> 172.21.15.5:0/963571354 conn(0x55a94a6ad770 msgr2=0x55a94a6dd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 shutdown_connections 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 1 -- 172.21.15.5:0/963571354 wait complete. 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.347+0000 7f8fca028740 20 client.8283 trim_cache size 0 max 16384 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:03:58.342 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-04-25T09:03:58.343 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T09:03:58.343 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:03:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 msgr2=0x7f8fa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80012e0 tx=0x7f8fb8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc00d0610 msgr2=0x7f8fc014cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc00d0610 0x7f8fc014cc20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c750 tx=0x7f8fa800cc10 comp rx=0 tx=0).stop 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 shutdown_connections 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8fa006b4d0 0x7f8fa006d990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8fc015c0f0 0x7f8fc00b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc00d0610 0x7f8fc014cc20 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 --2- 172.21.15.5:0/4214702453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc00b24b0 0x7f8fc0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 >> 172.21.15.5:0/4214702453 conn(0x7f8fc00d1920 msgr2=0x7f8fc00c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 shutdown_connections 2024-04-25T09:03:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.348+0000 7f8fc724a640 1 -- 172.21.15.5:0/4214702453 wait complete. 2024-04-25T09:03:58.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.460+0000 7f448570a640 1 Processor -- start 2024-04-25T09:03:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.460+0000 7f448570a640 1 -- start start 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f448570a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f44800ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f448570a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4480067000 0x7f4480161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f448570a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800ae5e0 con 0x7f448015ef00 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f448570a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44800ae300 con 0x7f4480067000 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f448570a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448015e420 con 0x7f44801581e0 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f447f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4480067000 0x7f4480161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f447e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f448015ef00 0x7f44800668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:41874/0 (socket says 172.21.15.5:41874) 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f447effd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f44800ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.461+0000 7f447e7fc640 1 -- 172.21.15.5:0/2468818881 learned_addr learned my addr 172.21.15.5:0/2468818881 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:03:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.462+0000 7f447dffb640 1 -- 172.21.15.5:0/2468818881 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192417300 0 0) 0x7f44800ae5e0 con 0x7f448015ef00 2024-04-25T09:03:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.462+0000 7f447dffb640 1 -- 172.21.15.5:0/2468818881 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c003520 con 0x7f448015ef00 2024-04-25T09:03:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.462+0000 7f447f7fe640 1 -- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 msgr2=0x7f44800ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.462+0000 7f447f7fe640 1 --2- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f44800ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.462+0000 7f447f7fe640 1 -- 172.21.15.5:0/2468818881 >> v1:172.21.15.80:6789/0 conn(0x7f448015ef00 legacy=0x7f44800668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.462+0000 7f447f7fe640 1 -- 172.21.15.5:0/2468818881 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448015e700 con 0x7f4480067000 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.462+0000 7f447effd640 1 --2- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f44800ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f447f7fe640 1 --2- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4480067000 0x7f4480161800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4470009d90 tx=0x7f447002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259296d05f8cb1f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f447dffb640 1 -- 172.21.15.5:0/2468818881 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470031600 con 0x7f4480067000 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f447dffb640 1 -- 172.21.15.5:0/2468818881 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44700317a0 con 0x7f4480067000 2024-04-25T09:03:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f447dffb640 1 -- 172.21.15.5:0/2468818881 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470031b50 con 0x7f4480067000 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 -- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4480067000 msgr2=0x7f4480161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 --2- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4480067000 0x7f4480161800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4470009d90 tx=0x7f447002a5d0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 -- 172.21.15.5:0/2468818881 shutdown_connections 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 --2- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4480067000 0x7f4480161800 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 --2- 172.21.15.5:0/2468818881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f44800ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 -- 172.21.15.5:0/2468818881 >> 172.21.15.5:0/2468818881 conn(0x7f44800d0870 msgr2=0x7f44800d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 -- 172.21.15.5:0/2468818881 shutdown_connections 2024-04-25T09:03:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.463+0000 7f448570a640 1 -- 172.21.15.5:0/2468818881 wait complete. 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 Processor -- start 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 -- start start 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4480067000 0x7f44801f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f4480149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f448015ef00 0x7f44800cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800afd50 con 0x7f4480067000 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44801585c0 con 0x7f448015ef00 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f448570a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800add80 con 0x7f44801581e0 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f447effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4480067000 0x7f44801f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f447effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4480067000 0x7f44801f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58696/0 (socket says 172.21.15.5:58696) 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f447effd640 1 -- 172.21.15.5:0/1519404504 learned_addr learned my addr 172.21.15.5:0/1519404504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.465+0000 7f447f7fe640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f448015ef00 0x7f44800cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f447e7fc640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f4480149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f447effd640 1 -- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 msgr2=0x7f4480149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f447effd640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f4480149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f447effd640 1 -- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f448015ef00 msgr2=0x7f44800cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f447effd640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f448015ef00 0x7f44800cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f447effd640 1 -- 172.21.15.5:0/1519404504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44801e4620 con 0x7f4480067000 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f447effd640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4480067000 0x7f44801f3f70 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f447800ebe0 tx=0x7f447800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f44777fe640 1 -- 172.21.15.5:0/1519404504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478017070 con 0x7f4480067000 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f44777fe640 1 -- 172.21.15.5:0/1519404504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447800cc30 con 0x7f4480067000 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44801f44b0 con 0x7f4480067000 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f44777fe640 1 -- 172.21.15.5:0/1519404504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478013470 con 0x7f4480067000 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.466+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4480159f30 con 0x7f4480067000 2024-04-25T09:03:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.467+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448004ef20 con 0x7f4480067000 2024-04-25T09:03:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.468+0000 7f44777fe640 1 -- 172.21.15.5:0/1519404504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f447801a070 con 0x7f4480067000 2024-04-25T09:03:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.468+0000 7f44777fe640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f446006b4d0 0x7f446006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.468+0000 7f44777fe640 1 -- 172.21.15.5:0/1519404504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f447808a090 con 0x7f4480067000 2024-04-25T09:03:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.468+0000 7f447e7fc640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f446006b4d0 0x7f446006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.469+0000 7f447e7fc640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f446006b4d0 0x7f446006d990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4480157ad0 tx=0x7f4468009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.472+0000 7f44777fe640 1 -- 172.21.15.5:0/1519404504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44801e4620 con 0x7f4480067000 2024-04-25T09:03:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.689+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44800b0720 con 0x7f4480067000 2024-04-25T09:03:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.689+0000 7f44777fe640 1 -- 172.21.15.5:0/1519404504 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f44780588c0 con 0x7f4480067000 2024-04-25T09:03:58.678 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:58.678 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:03:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f446006b4d0 msgr2=0x7f446006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f446006b4d0 0x7f446006d990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4480157ad0 tx=0x7f4468009040 comp rx=0 tx=0).stop 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4480067000 msgr2=0x7f44801f3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4480067000 0x7f44801f3f70 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f447800ebe0 tx=0x7f447800c520 comp rx=0 tx=0).stop 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 shutdown_connections 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f446006b4d0 0x7f446006d990 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f448015ef00 0x7f44800cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44801581e0 0x7f4480149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 --2- 172.21.15.5:0/1519404504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4480067000 0x7f44801f3f70 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 >> 172.21.15.5:0/1519404504 conn(0x7f44800d0870 msgr2=0x7f44800668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 shutdown_connections 2024-04-25T09:03:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.692+0000 7f448570a640 1 -- 172.21.15.5:0/1519404504 wait complete. 2024-04-25T09:03:58.691 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:03:58.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:03:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.802+0000 7f9cf1730640 1 Processor -- start 2024-04-25T09:03:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.802+0000 7f9cf1730640 1 -- start start 2024-04-25T09:03:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9cf1730640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9cec15e0a0 0x7f9cec0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9cf1730640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cec0d3df0 0x7f9cec0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9cf1730640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0b7f60 con 0x7f9cec0d3990 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9cf1730640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0b29c0 con 0x7f9cec0d3df0 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9cf1730640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0d2080 con 0x7f9cec15e0a0 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9ceb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cec0d3df0 0x7f9cec0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9ceb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cec0d3df0 0x7f9cec0cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58702/0 (socket says 172.21.15.5:58702) 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9ce3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9cec0d3990 0x7f9cec0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46356/0 (socket says 172.21.15.5:46356) 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.803+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/2630757730 learned_addr learned my addr 172.21.15.5:0/2630757730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9ceaffd640 1 --2- 172.21.15.5:0/2630757730 >> v2:172.21.15.80:3300/0 conn(0x7f9cec15e0a0 0x7f9cec0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/2630757730 >> v2:172.21.15.80:3300/0 conn(0x7f9cec15e0a0 msgr2=0x7f9cec0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9ceb7fe640 1 --2- 172.21.15.5:0/2630757730 >> v2:172.21.15.80:3300/0 conn(0x7f9cec15e0a0 0x7f9cec0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/2630757730 >> v1:172.21.15.5:6789/0 conn(0x7f9cec0d3990 legacy=0x7f9cec0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/2630757730 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0d2360 con 0x7f9cec0d3df0 2024-04-25T09:03:58.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9cea7fc640 1 -- 172.21.15.5:0/2630757730 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654085169 0 0) 0x7f9cec0b7f60 con 0x7f9cec0d3990 2024-04-25T09:03:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9ceb7fe640 1 --2- 172.21.15.5:0/2630757730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec0d3df0 0x7f9cec0cecf0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0b6680 tx=0x7f9ce402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732cbc55af4fef99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.804+0000 7f9cea7fc640 1 -- 172.21.15.5:0/2630757730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4036070 con 0x7f9cec0d3df0 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cea7fc640 1 -- 172.21.15.5:0/2630757730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4031600 con 0x7f9cec0d3df0 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cea7fc640 1 -- 172.21.15.5:0/2630757730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40319d0 con 0x7f9cec0d3df0 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 -- 172.21.15.5:0/2630757730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec0d3df0 msgr2=0x7f9cec0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 --2- 172.21.15.5:0/2630757730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec0d3df0 0x7f9cec0cecf0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0b6680 tx=0x7f9ce402a730 comp rx=0 tx=0).stop 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 -- 172.21.15.5:0/2630757730 shutdown_connections 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 --2- 172.21.15.5:0/2630757730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec0d3df0 0x7f9cec0cecf0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 --2- 172.21.15.5:0/2630757730 >> v2:172.21.15.80:3300/0 conn(0x7f9cec15e0a0 0x7f9cec0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 -- 172.21.15.5:0/2630757730 >> 172.21.15.5:0/2630757730 conn(0x7f9cec0668f0 msgr2=0x7f9cec066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 -- 172.21.15.5:0/2630757730 shutdown_connections 2024-04-25T09:03:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.805+0000 7f9cf1730640 1 -- 172.21.15.5:0/2630757730 wait complete. 2024-04-25T09:03:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.806+0000 7f9cf1730640 1 Processor -- start 2024-04-25T09:03:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.806+0000 7f9cf1730640 1 -- start start 2024-04-25T09:03:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9cf1730640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cec0d3990 0x7f9cec0ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9cf1730640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9cec0d3df0 0x7f9cec0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9cf1730640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec15e0a0 0x7f9cec1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9cf1730640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0d2c00 con 0x7f9cec15e0a0 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9cf1730640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0d2920 con 0x7f9cec0d3990 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9cf1730640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0d4280 con 0x7f9cec0d3df0 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec15e0a0 0x7f9cec1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec15e0a0 0x7f9cec1f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58718/0 (socket says 172.21.15.5:58718) 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/3993555943 learned_addr learned my addr 172.21.15.5:0/3993555943 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceaffd640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cec0d3990 0x7f9cec0ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ce3fff640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9cec0d3df0 0x7f9cec0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9cec0d3df0 msgr2=0x7f9cec0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9cec0d3df0 0x7f9cec0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cec0d3990 msgr2=0x7f9cec0ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cec0d3990 0x7f9cec0ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ceb7fe640 1 -- 172.21.15.5:0/3993555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0cdc00 con 0x7f9cec15e0a0 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.807+0000 7f9ce3fff640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9cec0d3df0 0x7f9cec0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.808+0000 7f9ceb7fe640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec15e0a0 0x7f9cec1f2bd0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009f40 tx=0x7f9ce4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.808+0000 7f9ce37fe640 1 -- 172.21.15.5:0/3993555943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4041020 con 0x7f9cec15e0a0 2024-04-25T09:03:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.808+0000 7f9ce37fe640 1 -- 172.21.15.5:0/3993555943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40077a0 con 0x7f9cec15e0a0 2024-04-25T09:03:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.808+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec0cdee0 con 0x7f9cec15e0a0 2024-04-25T09:03:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.808+0000 7f9ce37fe640 1 -- 172.21.15.5:0/3993555943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4036040 con 0x7f9cec15e0a0 2024-04-25T09:03:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.808+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec0ce780 con 0x7f9cec15e0a0 2024-04-25T09:03:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.809+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec04ef20 con 0x7f9cec15e0a0 2024-04-25T09:03:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.810+0000 7f9ce37fe640 1 -- 172.21.15.5:0/3993555943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ce4044020 con 0x7f9cec15e0a0 2024-04-25T09:03:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.810+0000 7f9ce37fe640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ccc06b4d0 0x7f9ccc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.810+0000 7f9ce37fe640 1 -- 172.21.15.5:0/3993555943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ce40aae70 con 0x7f9cec15e0a0 2024-04-25T09:03:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.810+0000 7f9ceaffd640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ccc06b4d0 0x7f9ccc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.811+0000 7f9ceaffd640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ccc06b4d0 0x7f9ccc06d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc006fd0 tx=0x7f9cdc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:58.814+0000 7f9ce37fe640 1 -- 172.21.15.5:0/3993555943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ce404b030 con 0x7f9cec15e0a0 2024-04-25T09:03:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.063+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9cec0ce270 con 0x7f9cec15e0a0 2024-04-25T09:03:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.063+0000 7f9ce37fe640 1 -- 172.21.15.5:0/3993555943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1597 (secure 0 0 0) 0x7f9ce4079db0 con 0x7f9cec15e0a0 2024-04-25T09:03:59.052 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:03:59.052 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":458,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2550562816,"bytes_avail":770543550464,"bytes_total":773094113280,"write_bytes_sec":30884197,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-04-25T09:03:56.485214+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ccc06b4d0 msgr2=0x7f9ccc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ccc06b4d0 0x7f9ccc06d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc006fd0 tx=0x7f9cdc008040 comp rx=0 tx=0).stop 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec15e0a0 msgr2=0x7f9cec1f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec15e0a0 0x7f9cec1f2bd0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009f40 tx=0x7f9ce4004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 shutdown_connections 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ccc06b4d0 0x7f9ccc06d990 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cec15e0a0 0x7f9cec1f2bd0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9cec0d3df0 0x7f9cec0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 --2- 172.21.15.5:0/3993555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cec0d3990 0x7f9cec0ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 >> 172.21.15.5:0/3993555943 conn(0x7f9cec0668f0 msgr2=0x7f9cec066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 shutdown_connections 2024-04-25T09:03:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:03:59.065+0000 7f9cf1730640 1 -- 172.21.15.5:0/3993555943 wait complete. 2024-04-25T09:03:59.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:04:00.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:00.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.190+0000 7fabc3317640 1 Processor -- start 2024-04-25T09:04:00.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.190+0000 7fabc3317640 1 -- start start 2024-04-25T09:04:00.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabc3317640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc15de70 0x7fabbc0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabc3317640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc0d20e0 con 0x7fabbc0ce7f0 2024-04-25T09:04:00.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabc3317640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc0d23c0 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabc3317640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0d2a10 con 0x7fabbc15de70 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabc18b4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fabbc0ce7f0 0x7fabbc0cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46370/0 (socket says 172.21.15.5:46370) 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabc18b4640 1 -- 172.21.15.5:0/1571788531 learned_addr learned my addr 172.21.15.5:0/1571788531 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabc10b3640 1 --2- 172.21.15.5:0/1571788531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc15de70 0x7fabbc0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938865169 0 0) 0x7fabbc0d20e0 con 0x7fabbc0ce7f0 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.191+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faba8003520 con 0x7fabbc0ce7f0 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.192+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284364857 0 0) 0x7fabbc0d23c0 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.192+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabbc0d20e0 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.192+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853071701 0 0) 0x7faba8003520 con 0x7fabbc0ce7f0 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.192+0000 7fabc10b3640 1 -- 172.21.15.5:0/1571788531 >> v1:172.21.15.80:6789/0 conn(0x7fabbc0b2cc0 legacy=0x7fabbc0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.192+0000 7fabc10b3640 1 -- 172.21.15.5:0/1571788531 >> v1:172.21.15.5:6789/0 conn(0x7fabbc0ce7f0 legacy=0x7fabbc0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.192+0000 7fabc10b3640 1 -- 172.21.15.5:0/1571788531 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0d26a0 con 0x7fabbc15de70 2024-04-25T09:04:00.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.192+0000 7fabc10b3640 1 --2- 172.21.15.5:0/1571788531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc15de70 0x7fabbc0b93e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabb80097d0 tx=0x7fabb802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef46f8247bbdae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8037070 con 0x7fabbc15de70 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb802ac30 con 0x7fabbc15de70 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabb3fff640 1 -- 172.21.15.5:0/1571788531 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40019f0 con 0x7fabbc15de70 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabc3317640 1 -- 172.21.15.5:0/1571788531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc15de70 msgr2=0x7fabbc0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabc3317640 1 --2- 172.21.15.5:0/1571788531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc15de70 0x7fabbc0b93e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabb80097d0 tx=0x7fabb802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabc3317640 1 -- 172.21.15.5:0/1571788531 shutdown_connections 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabc3317640 1 --2- 172.21.15.5:0/1571788531 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc15de70 0x7fabbc0b93e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabc3317640 1 -- 172.21.15.5:0/1571788531 >> 172.21.15.5:0/1571788531 conn(0x7fabbc06b000 msgr2=0x7fabbc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabc3317640 1 -- 172.21.15.5:0/1571788531 shutdown_connections 2024-04-25T09:04:00.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.193+0000 7fabc3317640 1 -- 172.21.15.5:0/1571788531 wait complete. 2024-04-25T09:04:00.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 Processor -- start 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 -- start start 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc0b2cc0 0x7fabbc154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc0ce7f0 0x7fabbc0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabbc15de70 0x7fabbc160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0d2ea0 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0b7300 con 0x7fabbc15de70 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc3317640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0d3020 con 0x7fabbc0ce7f0 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc10b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc0b2cc0 0x7fabbc154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc10b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc0b2cc0 0x7fabbc154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58734/0 (socket says 172.21.15.5:58734) 2024-04-25T09:04:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.195+0000 7fabc10b3640 1 -- 172.21.15.5:0/2706684698 learned_addr learned my addr 172.21.15.5:0/2706684698 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc08b2640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc0ce7f0 0x7fabbc0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc18b4640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabbc15de70 0x7fabbc160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc10b3640 1 -- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc0ce7f0 msgr2=0x7fabbc0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc10b3640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc0ce7f0 0x7fabbc0c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc10b3640 1 -- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabbc15de70 msgr2=0x7fabbc160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc10b3640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabbc15de70 0x7fabbc160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc10b3640 1 -- 172.21.15.5:0/2706684698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0c7d60 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc18b4640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabbc15de70 0x7fabbc160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc10b3640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc0b2cc0 0x7fabbc154ee0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fabb80097d0 tx=0x7fabb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabb1ffb640 1 -- 172.21.15.5:0/2706684698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8037050 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabb1ffb640 1 -- 172.21.15.5:0/2706684698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8043070 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabb1ffb640 1 -- 172.21.15.5:0/2706684698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb803ca50 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.196+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc0c8040 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.197+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0c8600 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.198+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc04ef20 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.198+0000 7fabb1ffb640 1 -- 172.21.15.5:0/2706684698 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fabb803cbf0 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.198+0000 7fabb1ffb640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faba006b4d0 0x7faba006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.199+0000 7fabb1ffb640 1 -- 172.21.15.5:0/2706684698 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabb80aac80 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.199+0000 7fabc08b2640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faba006b4d0 0x7faba006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.199+0000 7fabc08b2640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faba006b4d0 0x7faba006d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fabac007fd0 tx=0x7fabac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.203+0000 7fabb1ffb640 1 -- 172.21.15.5:0/2706684698 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fabb8079c20 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.423+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabbc0d4670 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.424+0000 7fabb1ffb640 1 -- 172.21.15.5:0/2706684698 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fabb8079520 con 0x7fabbc0b2cc0 2024-04-25T09:04:00.413 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:00.413 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:04:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:04:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faba006b4d0 msgr2=0x7faba006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faba006b4d0 0x7faba006d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fabac007fd0 tx=0x7fabac009040 comp rx=0 tx=0).stop 2024-04-25T09:04:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc0b2cc0 msgr2=0x7fabbc154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc0b2cc0 0x7fabbc154ee0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fabb80097d0 tx=0x7fabb80046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 shutdown_connections 2024-04-25T09:04:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faba006b4d0 0x7faba006d990 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabbc15de70 0x7fabbc160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fabbc0ce7f0 0x7fabbc0c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 --2- 172.21.15.5:0/2706684698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc0b2cc0 0x7fabbc154ee0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 >> 172.21.15.5:0/2706684698 conn(0x7fabbc06b000 msgr2=0x7fabbc0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 shutdown_connections 2024-04-25T09:04:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.426+0000 7fabc3317640 1 -- 172.21.15.5:0/2706684698 wait complete. 2024-04-25T09:04:00.426 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:00.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.537+0000 7f062d770640 1 Processor -- start 2024-04-25T09:04:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.537+0000 7f062d770640 1 -- start start 2024-04-25T09:04:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.538+0000 7f062d770640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 0x7f062815b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.538+0000 7f062d770640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0628070e50 con 0x7f0628151080 2024-04-25T09:04:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.538+0000 7f062d770640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0628071130 con 0x7f06280aed30 2024-04-25T09:04:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.538+0000 7f062d770640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0628070c00 con 0x7f0628151460 2024-04-25T09:04:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.538+0000 7f0626ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0628151080 0x7f0628071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46384/0 (socket says 172.21.15.5:46384) 2024-04-25T09:04:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.538+0000 7f0626ffd640 1 -- 172.21.15.5:0/4166889120 learned_addr learned my addr 172.21.15.5:0/4166889120 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.538+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519204084 0 0) 0x7f0628070e50 con 0x7f0628151080 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0614004630 con 0x7f0628151080 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f061ffff640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 0x7f062815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437059997 0 0) 0x7f0614004630 con 0x7f0628151080 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 msgr2=0x7f062815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 0x7f062815b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 >> v1:172.21.15.80:6789/0 conn(0x7f06280aed30 legacy=0x7f06280b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0628071410 con 0x7f0628151080 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f0618001670 con 0x7f0628151080 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 >> v1:172.21.15.5:6789/0 conn(0x7f0628151080 legacy=0x7f0628071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0614004af0 0x7f0614004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06140054c0 0x7f0614005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 0x7f0614006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0628070c00 con 0x7f06140054c0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061400cb80 con 0x7f0614004af0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061400cd80 con 0x7f0628151460 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f061ffff640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06140054c0 0x7f0614005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f0626ffd640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0614004af0 0x7f0614004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f06277fe640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 0x7f0614006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f061ffff640 1 -- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 msgr2=0x7f0614006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f061ffff640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0628151460 0x7f0614006290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f061ffff640 1 -- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0614004af0 msgr2=0x7f0614004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f061ffff640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0614004af0 0x7f0614004ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.539+0000 7f061ffff640 1 -- 172.21.15.5:0/4166889120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614004630 con 0x7f06140054c0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.540+0000 7f061ffff640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06140054c0 0x7f0614005990 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0610009ac0 tx=0x7f0614006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8525536c9a4755 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.540+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610036070 con 0x7f06140054c0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.540+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610031400 con 0x7f06140054c0 2024-04-25T09:04:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.540+0000 7f06267fc640 1 -- 172.21.15.5:0/4166889120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610009690 con 0x7f06140054c0 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.541+0000 7f062d770640 1 -- 172.21.15.5:0/4166889120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06140054c0 msgr2=0x7f0614005990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.541+0000 7f062d770640 1 --2- 172.21.15.5:0/4166889120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06140054c0 0x7f0614005990 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0610009ac0 tx=0x7f0614006940 comp rx=0 tx=0).stop 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.541+0000 7f06277fe640 1 -- 172.21.15.5:0/4166889120 reap_dead start 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.541+0000 7f062d770640 1 -- 172.21.15.5:0/4166889120 shutdown_connections 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.541+0000 7f062d770640 1 -- 172.21.15.5:0/4166889120 >> 172.21.15.5:0/4166889120 conn(0x7f06280668f0 msgr2=0x7f0628066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.541+0000 7f062d770640 1 -- 172.21.15.5:0/4166889120 shutdown_connections 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.541+0000 7f062d770640 1 -- 172.21.15.5:0/4166889120 wait complete. 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.542+0000 7f062d770640 1 Processor -- start 2024-04-25T09:04:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.542+0000 7f062d770640 1 -- start start 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f062d770640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06140054c0 0x7f0628153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f062d770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0628145db0 0x7f06280acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f062d770640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06280ad080 0x7f0628141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f062d770640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06280b3270 con 0x7f0628145db0 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f062d770640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0628071a60 con 0x7f06140054c0 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f062d770640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06280b33f0 con 0x7f06280ad080 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0628145db0 0x7f06280acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0628145db0 0x7f06280acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58748/0 (socket says 172.21.15.5:58748) 2024-04-25T09:04:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 -- 172.21.15.5:0/1625473174 learned_addr learned my addr 172.21.15.5:0/1625473174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f0626ffd640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06140054c0 0x7f0628153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f06277fe640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06280ad080 0x7f0628141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 -- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06280ad080 msgr2=0x7f0628141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06280ad080 0x7f0628141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 -- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06140054c0 msgr2=0x7f0628153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06140054c0 0x7f0628153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 -- 172.21.15.5:0/1625473174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06281508d0 con 0x7f0628145db0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f06277fe640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06280ad080 0x7f0628141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.543+0000 7f061ffff640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0628145db0 0x7f06280acb40 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f0610009ac0 tx=0x7f0610004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.544+0000 7f061f7fe640 1 -- 172.21.15.5:0/1625473174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610040020 con 0x7f0628145db0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.544+0000 7f061f7fe640 1 -- 172.21.15.5:0/1625473174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610003bc0 con 0x7f0628145db0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.544+0000 7f061f7fe640 1 -- 172.21.15.5:0/1625473174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610036040 con 0x7f0628145db0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.544+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0628142aa0 con 0x7f0628145db0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.544+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0628143060 con 0x7f0628145db0 2024-04-25T09:04:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.545+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06280ad490 con 0x7f0628145db0 2024-04-25T09:04:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.545+0000 7f061f7fe640 1 -- 172.21.15.5:0/1625473174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0610043020 con 0x7f0628145db0 2024-04-25T09:04:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.545+0000 7f061f7fe640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f060806b4d0 0x7f060806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.546+0000 7f061f7fe640 1 -- 172.21.15.5:0/1625473174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06100aa2d0 con 0x7f0628145db0 2024-04-25T09:04:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.546+0000 7f0626ffd640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f060806b4d0 0x7f060806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.546+0000 7f0626ffd640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f060806b4d0 0x7f060806d990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f06180010e0 tx=0x7f06180078f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.550+0000 7f061f7fe640 1 -- 172.21.15.5:0/1625473174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06280ad490 con 0x7f0628145db0 2024-04-25T09:04:00.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.799+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f06280705a0 con 0x7f0628145db0 2024-04-25T09:04:00.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.799+0000 7f061f7fe640 1 -- 172.21.15.5:0/1625473174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1597 (secure 0 0 0) 0x7f061004a070 con 0x7f0628145db0 2024-04-25T09:04:00.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:00.788 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":460,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2550562816,"bytes_avail":770543550464,"bytes_total":773094113280,"write_bytes_sec":30884197,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-04-25T09:03:56.485214+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:04:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f060806b4d0 msgr2=0x7f060806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f060806b4d0 0x7f060806d990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f06180010e0 tx=0x7f06180078f0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0628145db0 msgr2=0x7f06280acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0628145db0 0x7f06280acb40 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f0610009ac0 tx=0x7f0610004730 comp rx=0 tx=0).stop 2024-04-25T09:04:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 shutdown_connections 2024-04-25T09:04:00.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f060806b4d0 0x7f060806d990 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06280ad080 0x7f0628141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0628145db0 0x7f06280acb40 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 --2- 172.21.15.5:0/1625473174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06140054c0 0x7f0628153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 >> 172.21.15.5:0/1625473174 conn(0x7f06280668f0 msgr2=0x7f062806d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 shutdown_connections 2024-04-25T09:04:00.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:00.801+0000 7f062d770640 1 -- 172.21.15.5:0/1625473174 wait complete. 2024-04-25T09:04:00.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:04:01.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.927+0000 7f25edff4640 1 Processor -- start 2024-04-25T09:04:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.927+0000 7f25edff4640 1 -- start start 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25edff4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25e80668f0 0x7f25e8066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25edff4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25e8161fe0 0x7f25e80b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25edff4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e8067210 con 0x7f25e80b3e10 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25edff4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e80b5740 con 0x7f25e80668f0 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25edff4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e80b5a20 con 0x7f25e8161fe0 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25e77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25e80668f0 0x7f25e8066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25e77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25e80668f0 0x7f25e8066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42484/0 (socket says 172.21.15.5:42484) 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25e7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25e80b3e10 0x7f25e806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60412/0 (socket says 172.21.15.5:60412) 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25e77fe640 1 -- 172.21.15.5:0/4233709383 learned_addr learned my addr 172.21.15.5:0/4233709383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.928+0000 7f25e6ffd640 1 --2- 172.21.15.5:0/4233709383 >> v2:172.21.15.80:3300/0 conn(0x7f25e8161fe0 0x7f25e80b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.929+0000 7f25e67fc640 1 -- 172.21.15.5:0/4233709383 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373410894 0 0) 0x7f25e8067210 con 0x7f25e80b3e10 2024-04-25T09:04:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.929+0000 7f25e77fe640 1 -- 172.21.15.5:0/4233709383 >> v2:172.21.15.80:3300/0 conn(0x7f25e8161fe0 msgr2=0x7f25e80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.929+0000 7f25e77fe640 1 --2- 172.21.15.5:0/4233709383 >> v2:172.21.15.80:3300/0 conn(0x7f25e8161fe0 0x7f25e80b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.929+0000 7f25e77fe640 1 -- 172.21.15.5:0/4233709383 >> v1:172.21.15.5:6789/0 conn(0x7f25e80b3e10 legacy=0x7f25e806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.929+0000 7f25e77fe640 1 -- 172.21.15.5:0/4233709383 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80b5d00 con 0x7f25e80668f0 2024-04-25T09:04:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.929+0000 7f25e77fe640 1 --2- 172.21.15.5:0/4233709383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80668f0 0x7f25e8066cd0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f25e806d3a0 tx=0x7f25d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a415d3da9d33d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25e67fc640 1 -- 172.21.15.5:0/4233709383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8037070 con 0x7f25e80668f0 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25e67fc640 1 -- 172.21.15.5:0/4233709383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d8032440 con 0x7f25e80668f0 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25e67fc640 1 -- 172.21.15.5:0/4233709383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8032810 con 0x7f25e80668f0 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 -- 172.21.15.5:0/4233709383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80668f0 msgr2=0x7f25e8066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 --2- 172.21.15.5:0/4233709383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80668f0 0x7f25e8066cd0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f25e806d3a0 tx=0x7f25d802a270 comp rx=0 tx=0).stop 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 -- 172.21.15.5:0/4233709383 shutdown_connections 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 --2- 172.21.15.5:0/4233709383 >> v2:172.21.15.80:3300/0 conn(0x7f25e8161fe0 0x7f25e80b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 --2- 172.21.15.5:0/4233709383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e80668f0 0x7f25e8066cd0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 -- 172.21.15.5:0/4233709383 >> 172.21.15.5:0/4233709383 conn(0x7f25e80b25d0 msgr2=0x7f25e80b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 -- 172.21.15.5:0/4233709383 shutdown_connections 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.930+0000 7f25edff4640 1 -- 172.21.15.5:0/4233709383 wait complete. 2024-04-25T09:04:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.931+0000 7f25edff4640 1 Processor -- start 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.932+0000 7f25edff4640 1 -- start start 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.932+0000 7f25edff4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25e80668f0 0x7f25e81f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.932+0000 7f25edff4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25e80b3e10 0x7f25e8145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.932+0000 7f25edff4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e8161fe0 0x7f25e81461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.932+0000 7f25edff4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e806f030 con 0x7f25e8161fe0 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.932+0000 7f25edff4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8161ac0 con 0x7f25e80b3e10 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.932+0000 7f25edff4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e806f1b0 con 0x7f25e80668f0 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e8161fe0 0x7f25e81461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e8161fe0 0x7f25e81461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42492/0 (socket says 172.21.15.5:42492) 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 -- 172.21.15.5:0/1222805278 learned_addr learned my addr 172.21.15.5:0/1222805278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e6ffd640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25e80b3e10 0x7f25e8145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e77fe640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25e80668f0 0x7f25e81f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 -- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25e80668f0 msgr2=0x7f25e81f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25e80668f0 0x7f25e81f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 -- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25e80b3e10 msgr2=0x7f25e8145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25e80b3e10 0x7f25e8145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 -- 172.21.15.5:0/1222805278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e81467d0 con 0x7f25e8161fe0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25e7fff640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e8161fe0 0x7f25e81461c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c780 tx=0x7f25e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25cffff640 1 -- 172.21.15.5:0/1222805278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0018070 con 0x7f25e8161fe0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25cffff640 1 -- 172.21.15.5:0/1222805278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000a5e0 con 0x7f25e8161fe0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e8146ab0 con 0x7f25e8161fe0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25cffff640 1 -- 172.21.15.5:0/1222805278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000aa50 con 0x7f25e8161fe0 2024-04-25T09:04:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.933+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e8147070 con 0x7f25e8161fe0 2024-04-25T09:04:01.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.935+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e804ef20 con 0x7f25e8161fe0 2024-04-25T09:04:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.935+0000 7f25cffff640 1 -- 172.21.15.5:0/1222805278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f25e001b070 con 0x7f25e8161fe0 2024-04-25T09:04:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.936+0000 7f25cffff640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25d406b4d0 0x7f25d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.936+0000 7f25cffff640 1 -- 172.21.15.5:0/1222805278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25e0089740 con 0x7f25e8161fe0 2024-04-25T09:04:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.936+0000 7f25e77fe640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25d406b4d0 0x7f25d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.936+0000 7f25e77fe640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25d406b4d0 0x7f25d406d990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f25d8034000 tx=0x7f25d802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:01.940+0000 7f25cffff640 1 -- 172.21.15.5:0/1222805278 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25e0057f70 con 0x7f25e8161fe0 2024-04-25T09:04:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.158+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25e8071c30 con 0x7f25e8161fe0 2024-04-25T09:04:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.158+0000 7f25cffff640 1 -- 172.21.15.5:0/1222805278 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f25e005c010 con 0x7f25e8161fe0 2024-04-25T09:04:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:02.147 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:04:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25d406b4d0 msgr2=0x7f25d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25d406b4d0 0x7f25d406d990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f25d8034000 tx=0x7f25d802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e8161fe0 msgr2=0x7f25e81461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e8161fe0 0x7f25e81461c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c780 tx=0x7f25e000cc40 comp rx=0 tx=0).stop 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 shutdown_connections 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25d406b4d0 0x7f25d406d990 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e8161fe0 0x7f25e81461c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25e80b3e10 0x7f25e8145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 --2- 172.21.15.5:0/1222805278 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25e80668f0 0x7f25e81f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 >> 172.21.15.5:0/1222805278 conn(0x7f25e80b25d0 msgr2=0x7f25e80af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 shutdown_connections 2024-04-25T09:04:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.160+0000 7f25edff4640 1 -- 172.21.15.5:0/1222805278 wait complete. 2024-04-25T09:04:02.160 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:02.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.271+0000 7fc2c7d9e640 1 Processor -- start 2024-04-25T09:04:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.271+0000 7fc2c7d9e640 1 -- start start 2024-04-25T09:04:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c7d9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 0x7fc2c00d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c7d9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c00b29c0 con 0x7fc2c00b6f50 2024-04-25T09:04:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c7d9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c00d2080 con 0x7fc2c015e0a0 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c7d9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00d4330 con 0x7fc2c00d3990 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c633b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2c00b6f50 0x7fc2c00b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60422/0 (socket says 172.21.15.5:60422) 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c633b640 1 -- 172.21.15.5:0/2238146210 learned_addr learned my addr 172.21.15.5:0/2238146210 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c5339640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 0x7fc2c00d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313742734 0 0) 0x7fc2c00b29c0 con 0x7fc2c00b6f50 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ac003520 con 0x7fc2c00b6f50 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 711635794 0 0) 0x7fc2ac003520 con 0x7fc2c00b6f50 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 msgr2=0x7fc2c00d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 0x7fc2c00d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 >> v1:172.21.15.80:6789/0 conn(0x7fc2c015e0a0 legacy=0x7fc2c00d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c00d2360 con 0x7fc2c00b6f50 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fc2b80019f0 con 0x7fc2c00b6f50 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.272+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 >> v1:172.21.15.5:6789/0 conn(0x7fc2c00b6f50 legacy=0x7fc2c00b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c4b38640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 0x7fc2ac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c4b38640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c4b38640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac004d40 0x7fc2ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac00b9f0 con 0x7fc2ac003f20 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac00bba0 con 0x7fc2ac004d40 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac00bda0 con 0x7fc2c00d3990 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5339640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c633b640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac004d40 0x7fc2ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5b3a640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 0x7fc2ac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5339640 1 -- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 msgr2=0x7fc2ac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5339640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 0x7fc2ac0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5339640 1 -- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac004d40 msgr2=0x7fc2ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5339640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac004d40 0x7fc2ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5339640 1 -- 172.21.15.5:0/2238146210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac003520 con 0x7fc2ac003f20 2024-04-25T09:04:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c633b640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac004d40 0x7fc2ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.273+0000 7fc2c5b3a640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c00d3990 0x7fc2ac0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c5339640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2ac004800 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009ac0 tx=0x7fc2ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92107ec729a6dbe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0036070 con 0x7fc2ac003f20 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b0031400 con 0x7fc2ac003f20 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c4b38640 1 -- 172.21.15.5:0/2238146210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0009690 con 0x7fc2ac003f20 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/2238146210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 msgr2=0x7fc2ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c7d9e640 1 --2- 172.21.15.5:0/2238146210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2ac004800 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009ac0 tx=0x7fc2ac005830 comp rx=0 tx=0).stop 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c633b640 1 -- 172.21.15.5:0/2238146210 reap_dead start 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/2238146210 shutdown_connections 2024-04-25T09:04:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/2238146210 >> 172.21.15.5:0/2238146210 conn(0x7fc2c00668f0 msgr2=0x7fc2c0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/2238146210 shutdown_connections 2024-04-25T09:04:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.274+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/2238146210 wait complete. 2024-04-25T09:04:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 Processor -- start 2024-04-25T09:04:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 -- start start 2024-04-25T09:04:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2c01f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c01f6cd0 0x7fc2c01f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c015f590 0x7fc2c015fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00d2920 con 0x7fc2ac003f20 2024-04-25T09:04:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00d1460 con 0x7fc2c01f6cd0 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c7d9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00d2c00 con 0x7fc2c015f590 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c5b3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2c01f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c5b3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2c01f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42500/0 (socket says 172.21.15.5:42500) 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.276+0000 7fc2c5b3a640 1 -- 172.21.15.5:0/1798314074 learned_addr learned my addr 172.21.15.5:0/1798314074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5339640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c01f6cd0 0x7fc2c01f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c633b640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c015f590 0x7fc2c015fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5b3a640 1 -- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c015f590 msgr2=0x7fc2c015fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5b3a640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c015f590 0x7fc2c015fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5b3a640 1 -- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c01f6cd0 msgr2=0x7fc2c01f7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5b3a640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c01f6cd0 0x7fc2c01f7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5b3a640 1 -- 172.21.15.5:0/1798314074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c014dbe0 con 0x7fc2ac003f20 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5339640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c01f6cd0 0x7fc2c01f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c5b3a640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2c01f2f00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc007980 tx=0x7fc2bc00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2b67fc640 1 -- 172.21.15.5:0/1798314074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0050d0 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2b67fc640 1 -- 172.21.15.5:0/1798314074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc018070 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c0160330 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2b67fc640 1 -- 172.21.15.5:0/1798314074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc005470 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.277+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c014ac20 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.278+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c00b6b30 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.279+0000 7fc2b67fc640 1 -- 172.21.15.5:0/1798314074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc2bc00c6c0 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.279+0000 7fc2b67fc640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2a406b4d0 0x7fc2a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.279+0000 7fc2b67fc640 1 -- 172.21.15.5:0/1798314074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2bc089fa0 con 0x7fc2ac003f20 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.279+0000 7fc2c5339640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2a406b4d0 0x7fc2a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.280+0000 7fc2c5339640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2a406b4d0 0x7fc2a406d990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0033000 tx=0x7fc2b0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.283+0000 7fc2b67fc640 1 -- 172.21.15.5:0/1798314074 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2c00b6b30 con 0x7fc2ac003f20 2024-04-25T09:04:02.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.536+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc2c004ef20 con 0x7fc2ac003f20 2024-04-25T09:04:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.536+0000 7fc2b67fc640 1 -- 172.21.15.5:0/1798314074 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1574 (secure 0 0 0) 0x7fc2c014dbe0 con 0x7fc2ac003f20 2024-04-25T09:04:02.525 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:02.525 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":462,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2550562816,"bytes_avail":770543550464,"bytes_total":773094113280,"write_bytes_sec":30883994,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":63,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-04-25T09:04:00.486142+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:04:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2a406b4d0 msgr2=0x7fc2a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2a406b4d0 0x7fc2a406d990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0033000 tx=0x7fc2b0008030 comp rx=0 tx=0).stop 2024-04-25T09:04:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 msgr2=0x7fc2c01f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2c01f2f00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc007980 tx=0x7fc2bc00eba0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 shutdown_connections 2024-04-25T09:04:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc2a406b4d0 0x7fc2a406d990 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2c015f590 0x7fc2c015fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c01f6cd0 0x7fc2c01f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 --2- 172.21.15.5:0/1798314074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2ac003f20 0x7fc2c01f2f00 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 >> 172.21.15.5:0/1798314074 conn(0x7fc2c00668f0 msgr2=0x7fc2c00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 shutdown_connections 2024-04-25T09:04:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.538+0000 7fc2c7d9e640 1 -- 172.21.15.5:0/1798314074 wait complete. 2024-04-25T09:04:02.538 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:04:02.538 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:04:02.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:02.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:02.636 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:04:02.636 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:02.636 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:02.652 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:02.652 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:02.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.860+0000 7f9bb4d9e640 1 Processor -- start 2024-04-25T09:04:02.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.860+0000 7f9bb4d9e640 1 -- start start 2024-04-25T09:04:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.861+0000 7f9bb4d9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bb00cfc90 0x7f9bb0165860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.861+0000 7f9bb4d9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb00b3f30 con 0x7f9bb0154f10 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.861+0000 7f9bb4d9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb015b0f0 con 0x7f9bb015bbd0 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.861+0000 7f9bb4d9e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb015b3d0 con 0x7f9bb00cfc90 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.861+0000 7f9bae59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9bb0154f10 0x7f9bb00b3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60438/0 (socket says 172.21.15.5:60438) 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.861+0000 7f9bae59c640 1 -- 172.21.15.5:0/2092132690 learned_addr learned my addr 172.21.15.5:0/2092132690 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.861+0000 7f9baed9d640 1 --2- 172.21.15.5:0/2092132690 >> v2:172.21.15.5:3300/0 conn(0x7f9bb00cfc90 0x7f9bb0165860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.862+0000 7f9bad59a640 1 -- 172.21.15.5:0/2092132690 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246608677 0 0) 0x7f9bb00b3f30 con 0x7f9bb0154f10 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.862+0000 7f9bad59a640 1 -- 172.21.15.5:0/2092132690 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b98003520 con 0x7f9bb0154f10 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.862+0000 7f9baed9d640 1 -- 172.21.15.5:0/2092132690 >> v1:172.21.15.80:6789/0 conn(0x7f9bb015bbd0 legacy=0x7f9bb00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.862+0000 7f9baed9d640 1 -- 172.21.15.5:0/2092132690 >> v1:172.21.15.5:6789/0 conn(0x7f9bb0154f10 legacy=0x7f9bb00b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.862+0000 7f9baed9d640 1 -- 172.21.15.5:0/2092132690 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb01552f0 con 0x7f9bb00cfc90 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.862+0000 7f9baed9d640 1 --2- 172.21.15.5:0/2092132690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb00cfc90 0x7f9bb0165860 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009d90 tx=0x7f9ba002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9d4295aa8b7218 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.862+0000 7f9bad59a640 1 -- 172.21.15.5:0/2092132690 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0031600 con 0x7f9bb00cfc90 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bad59a640 1 -- 172.21.15.5:0/2092132690 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba00317a0 con 0x7f9bb00cfc90 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bad59a640 1 -- 172.21.15.5:0/2092132690 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0031b70 con 0x7f9bb00cfc90 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/2092132690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb00cfc90 msgr2=0x7f9bb0165860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/2092132690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb00cfc90 0x7f9bb0165860 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009d90 tx=0x7f9ba002a610 comp rx=0 tx=0).stop 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/2092132690 shutdown_connections 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/2092132690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb00cfc90 0x7f9bb0165860 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/2092132690 >> 172.21.15.5:0/2092132690 conn(0x7f9bb00668f0 msgr2=0x7f9bb0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:02.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/2092132690 shutdown_connections 2024-04-25T09:04:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.863+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/2092132690 wait complete. 2024-04-25T09:04:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.864+0000 7f9bb4d9e640 1 Processor -- start 2024-04-25T09:04:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bb4d9e640 1 -- start start 2024-04-25T09:04:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bb4d9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9bb00cfc90 0x7f9bb0169890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bb4d9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb0154f10 0x7f9bb0140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bb4d9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bb015bbd0 0x7f9bb0145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bb4d9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00b3b80 con 0x7f9bb0154f10 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bb4d9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb006c420 con 0x7f9bb015bbd0 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bb4d9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00ccd60 con 0x7f9bb00cfc90 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9badd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb0154f10 0x7f9bb0140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9badd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb0154f10 0x7f9bb0140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42524/0 (socket says 172.21.15.5:42524) 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9badd9b640 1 -- 172.21.15.5:0/1602362865 learned_addr learned my addr 172.21.15.5:0/1602362865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9baed9d640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bb015bbd0 0x7f9bb0145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.865+0000 7f9bae59c640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9bb00cfc90 0x7f9bb0169890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9badd9b640 1 -- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9bb00cfc90 msgr2=0x7f9bb0169890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9badd9b640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9bb00cfc90 0x7f9bb0169890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9badd9b640 1 -- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bb015bbd0 msgr2=0x7f9bb0145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9badd9b640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bb015bbd0 0x7f9bb0145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9badd9b640 1 -- 172.21.15.5:0/1602362865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0169dd0 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9bae59c640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9bb00cfc90 0x7f9bb0169890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9badd9b640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb0154f10 0x7f9bb0140a80 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009fd0 tx=0x7f9ba400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9b9effd640 1 -- 172.21.15.5:0/1602362865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4015020 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9b9effd640 1 -- 172.21.15.5:0/1602362865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4011830 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb0146390 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9b9effd640 1 -- 172.21.15.5:0/1602362865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4011c00 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.866+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb0146950 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.867+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb004ef20 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.868+0000 7f9b9effd640 1 -- 172.21.15.5:0/1602362865 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ba4018020 con 0x7f9bb0154f10 2024-04-25T09:04:02.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.868+0000 7f9b9effd640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b9006b4d0 0x7f9b9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.868+0000 7f9b9effd640 1 -- 172.21.15.5:0/1602362865 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba4089f90 con 0x7f9bb0154f10 2024-04-25T09:04:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.868+0000 7f9bae59c640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b9006b4d0 0x7f9b9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.869+0000 7f9bae59c640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b9006b4d0 0x7f9b9006d990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007fd0 tx=0x7f9ba8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:02.873+0000 7f9b9effd640 1 -- 172.21.15.5:0/1602362865 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ba401f020 con 0x7f9bb0154f10 2024-04-25T09:04:03.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.053+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bb0070d30 con 0x7f9bb0154f10 2024-04-25T09:04:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.054+0000 7f9b9effd640 1 -- 172.21.15.5:0/1602362865 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16524 (secure 0 0 0) 0x7f9bb0169dd0 con 0x7f9bb0154f10 2024-04-25T09:04:03.043 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:03.043 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:33.997354+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.627226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:31.329753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b9006b4d0 msgr2=0x7f9b9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b9006b4d0 0x7f9b9006d990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007fd0 tx=0x7f9ba8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb0154f10 msgr2=0x7f9bb0140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb0154f10 0x7f9bb0140a80 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009fd0 tx=0x7f9ba400b870 comp rx=0 tx=0).stop 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 shutdown_connections 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b9006b4d0 0x7f9b9006d990 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9bb015bbd0 0x7f9bb0145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb0154f10 0x7f9bb0140a80 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 --2- 172.21.15.5:0/1602362865 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9bb00cfc90 0x7f9bb0169890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 >> 172.21.15.5:0/1602362865 conn(0x7f9bb00668f0 msgr2=0x7f9bb00b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 shutdown_connections 2024-04-25T09:04:03.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.056+0000 7f9bb4d9e640 1 -- 172.21.15.5:0/1602362865 wait complete. 2024-04-25T09:04:03.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:30.627226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:31.329753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:03.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.171+0000 7f2559977640 1 Processor -- start 2024-04-25T09:04:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.171+0000 7f2559977640 1 -- start start 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f2559977640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25540b2340 0x7f25540b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f2559977640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255406ae90 con 0x7f25540b18c0 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f2559977640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25540cfdb0 con 0x7f255406bfb0 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f2559977640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540d03c0 con 0x7f25540b2340 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f254bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25540b18c0 0x7f25540b2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60446/0 (socket says 172.21.15.5:60446) 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f254bfff640 1 -- 172.21.15.5:0/2509291318 learned_addr learned my addr 172.21.15.5:0/2509291318 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2509291318 >> v2:172.21.15.80:3300/0 conn(0x7f25540b2340 0x7f25540b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904081667 0 0) 0x7f255406ae90 con 0x7f25540b18c0 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2540003520 con 0x7f25540b18c0 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4162276542 0 0) 0x7f2540003520 con 0x7f25540b18c0 2024-04-25T09:04:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 >> v2:172.21.15.80:3300/0 conn(0x7f25540b2340 msgr2=0x7f25540b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 --2- 172.21.15.5:0/2509291318 >> v2:172.21.15.80:3300/0 conn(0x7f25540b2340 0x7f25540b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 >> v1:172.21.15.80:6789/0 conn(0x7f255406bfb0 legacy=0x7f25540d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255406b130 con 0x7f25540b18c0 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f253c001670 con 0x7f25540b18c0 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 >> v1:172.21.15.5:6789/0 conn(0x7f25540b18c0 legacy=0x7f25540b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.172+0000 7f25527fc640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25400039b0 0x7f2540003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25527fc640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2540004800 0x7f2540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25527fc640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400051c0 0x7f254000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540d03c0 con 0x7f25400039b0 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254000c060 con 0x7f2540004800 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254000c260 con 0x7f25400051c0 2024-04-25T09:04:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25400039b0 0x7f2540003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f254bfff640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2540004800 0x7f2540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25537fe640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400051c0 0x7f254000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f2552ffd640 1 -- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400051c0 msgr2=0x7f254000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400051c0 0x7f254000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f2552ffd640 1 -- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2540004800 msgr2=0x7f2540004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2540004800 0x7f2540004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f2552ffd640 1 -- 172.21.15.5:0/2509291318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540003520 con 0x7f25400039b0 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25537fe640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400051c0 0x7f254000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.173+0000 7f25537fe640 1 -- 172.21.15.5:0/2509291318 reap_dead start 2024-04-25T09:04:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25400039b0 0x7f2540003dd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f2544009ac0 tx=0x7f2540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6f7f46665c8ec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544036070 con 0x7f25400039b0 2024-04-25T09:04:03.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544031400 con 0x7f25400039b0 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f25527fc640 1 -- 172.21.15.5:0/2509291318 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544009690 con 0x7f25400039b0 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2559977640 1 -- 172.21.15.5:0/2509291318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25400039b0 msgr2=0x7f2540003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2559977640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25400039b0 0x7f2540003dd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f2544009ac0 tx=0x7f2540005830 comp rx=0 tx=0).stop 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2559977640 1 -- 172.21.15.5:0/2509291318 shutdown_connections 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2559977640 1 --2- 172.21.15.5:0/2509291318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25400039b0 0x7f2540003dd0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2559977640 1 -- 172.21.15.5:0/2509291318 >> 172.21.15.5:0/2509291318 conn(0x7f25540d1a40 msgr2=0x7f25540d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2559977640 1 -- 172.21.15.5:0/2509291318 shutdown_connections 2024-04-25T09:04:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.174+0000 7f2559977640 1 -- 172.21.15.5:0/2509291318 wait complete. 2024-04-25T09:04:03.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 Processor -- start 2024-04-25T09:04:03.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 -- start start 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400039b0 0x7f25540ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2554153e00 0x7f25540b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25540b6b00 0x7f25540ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540d1830 con 0x7f25540b6b00 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540d16b0 con 0x7f2554153e00 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.176+0000 7f2559977640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540b1380 con 0x7f25400039b0 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25540b6b00 0x7f25540ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25540b6b00 0x7f25540ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42552/0 (socket says 172.21.15.5:42552) 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 -- 172.21.15.5:0/3712793994 learned_addr learned my addr 172.21.15.5:0/3712793994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f254bfff640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2554153e00 0x7f25540b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f2552ffd640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400039b0 0x7f25540ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 -- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400039b0 msgr2=0x7f25540ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400039b0 0x7f25540ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 -- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2554153e00 msgr2=0x7f25540b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2554153e00 0x7f25540b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 -- 172.21.15.5:0/3712793994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540b50c0 con 0x7f25540b6b00 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f25537fe640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25540b6b00 0x7f25540ce290 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f25540cc020 tx=0x7f254c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f2550ff9640 1 -- 172.21.15.5:0/3712793994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c006b50 con 0x7f25540b6b00 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f2550ff9640 1 -- 172.21.15.5:0/3712793994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c006cf0 con 0x7f25540b6b00 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f2550ff9640 1 -- 172.21.15.5:0/3712793994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c003970 con 0x7f25540b6b00 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25540caf40 con 0x7f25540b6b00 2024-04-25T09:04:03.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.177+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540cb500 con 0x7f25540b6b00 2024-04-25T09:04:03.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.178+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255404ef20 con 0x7f25540b6b00 2024-04-25T09:04:03.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.179+0000 7f2550ff9640 1 -- 172.21.15.5:0/3712793994 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f254c01a020 con 0x7f25540b6b00 2024-04-25T09:04:03.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.179+0000 7f2550ff9640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f253406b500 0x7f253406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.179+0000 7f2550ff9640 1 -- 172.21.15.5:0/3712793994 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f254c0896f0 con 0x7f25540b6b00 2024-04-25T09:04:03.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.179+0000 7f2552ffd640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f253406b500 0x7f253406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.180+0000 7f2552ffd640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f253406b500 0x7f253406d9c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2544033000 tx=0x7f2544008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.184+0000 7f2550ff9640 1 -- 172.21.15.5:0/3712793994 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f254c058570 con 0x7f25540b6b00 2024-04-25T09:04:03.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.368+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25540b79c0 con 0x7f25540b6b00 2024-04-25T09:04:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.368+0000 7f2550ff9640 1 -- 172.21.15.5:0/3712793994 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7f254c057e70 con 0x7f25540b6b00 2024-04-25T09:04:03.357 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:04:03.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f253406b500 msgr2=0x7f253406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f253406b500 0x7f253406d9c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2544033000 tx=0x7f2544008030 comp rx=0 tx=0).stop 2024-04-25T09:04:03.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25540b6b00 msgr2=0x7f25540ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25540b6b00 0x7f25540ce290 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f25540cc020 tx=0x7f254c00eb90 comp rx=0 tx=0).stop 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 shutdown_connections 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f253406b500 0x7f253406d9c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25540b6b00 0x7f25540ce290 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2554153e00 0x7f25540b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 --2- 172.21.15.5:0/3712793994 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f25400039b0 0x7f25540ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 >> 172.21.15.5:0/3712793994 conn(0x7f25540d1a40 msgr2=0x7f255415dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 shutdown_connections 2024-04-25T09:04:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.370+0000 7f2559977640 1 -- 172.21.15.5:0/3712793994 wait complete. 2024-04-25T09:04:03.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.485+0000 7fb6537c1640 1 Processor -- start 2024-04-25T09:04:03.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.485+0000 7fb6537c1640 1 -- start start 2024-04-25T09:04:03.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb6537c1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb64c15e0b0 0x7fb64c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb6537c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb64c0cc780 0x7fb64c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb6537c1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c0d27f0 con 0x7fb64c0d0c80 2024-04-25T09:04:03.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb6537c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c0cfee0 con 0x7fb64c0cc780 2024-04-25T09:04:03.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb6537c1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c0d01c0 con 0x7fb64c15e0b0 2024-04-25T09:04:03.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb651d5e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb64c0cc780 0x7fb64c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb651d5e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb64c0cc780 0x7fb64c0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42568/0 (socket says 172.21.15.5:42568) 2024-04-25T09:04:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb651d5e640 1 -- 172.21.15.5:0/3078727383 learned_addr learned my addr 172.21.15.5:0/3078727383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb65155d640 1 --2- 172.21.15.5:0/3078727383 >> v2:172.21.15.80:3300/0 conn(0x7fb64c15e0b0 0x7fb64c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb651d5e640 1 -- 172.21.15.5:0/3078727383 >> v2:172.21.15.80:3300/0 conn(0x7fb64c15e0b0 msgr2=0x7fb64c06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb651d5e640 1 --2- 172.21.15.5:0/3078727383 >> v2:172.21.15.80:3300/0 conn(0x7fb64c15e0b0 0x7fb64c06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb651d5e640 1 -- 172.21.15.5:0/3078727383 >> v1:172.21.15.80:6789/0 conn(0x7fb64c0d0c80 legacy=0x7fb64c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb651d5e640 1 -- 172.21.15.5:0/3078727383 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c0d04a0 con 0x7fb64c0cc780 2024-04-25T09:04:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.486+0000 7fb65155d640 1 --2- 172.21.15.5:0/3078727383 >> v2:172.21.15.80:3300/0 conn(0x7fb64c15e0b0 0x7fb64c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:03.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.487+0000 7fb651d5e640 1 --2- 172.21.15.5:0/3078727383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0cc780 0x7fb64c0ce3b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb644009e50 tx=0x7fb64402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2726d3b8322f5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.487+0000 7fb643fff640 1 -- 172.21.15.5:0/3078727383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644036070 con 0x7fb64c0cc780 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.487+0000 7fb643fff640 1 -- 172.21.15.5:0/3078727383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644031600 con 0x7fb64c0cc780 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.487+0000 7fb643fff640 1 -- 172.21.15.5:0/3078727383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440319d0 con 0x7fb64c0cc780 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 -- 172.21.15.5:0/3078727383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0cc780 msgr2=0x7fb64c0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3078727383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0cc780 0x7fb64c0ce3b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb644009e50 tx=0x7fb64402a710 comp rx=0 tx=0).stop 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 -- 172.21.15.5:0/3078727383 shutdown_connections 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3078727383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0cc780 0x7fb64c0ce3b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3078727383 >> v2:172.21.15.80:3300/0 conn(0x7fb64c15e0b0 0x7fb64c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 -- 172.21.15.5:0/3078727383 >> 172.21.15.5:0/3078727383 conn(0x7fb64c0d1a20 msgr2=0x7fb64c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 -- 172.21.15.5:0/3078727383 shutdown_connections 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.488+0000 7fb6537c1640 1 -- 172.21.15.5:0/3078727383 wait complete. 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.489+0000 7fb6537c1640 1 Processor -- start 2024-04-25T09:04:03.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.489+0000 7fb6537c1640 1 -- start start 2024-04-25T09:04:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb6537c1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64c0cc780 0x7fb64c160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb6537c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0d0c80 0x7fb64c0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb6537c1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb64c15e0b0 0x7fb64c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb6537c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0cfb90 con 0x7fb64c0d0c80 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb6537c1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c15e490 con 0x7fb64c15e0b0 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb6537c1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0ccc30 con 0x7fb64c0cc780 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0d0c80 0x7fb64c0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0d0c80 0x7fb64c0caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42584/0 (socket says 172.21.15.5:42584) 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 -- 172.21.15.5:0/3969208274 learned_addr learned my addr 172.21.15.5:0/3969208274 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 -- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64c0cc780 msgr2=0x7fb64c160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64c0cc780 0x7fb64c160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb651d5e640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb64c15e0b0 0x7fb64c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 -- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb64c15e0b0 msgr2=0x7fb64c156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb64c15e0b0 0x7fb64c156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 -- 172.21.15.5:0/3969208274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c15f320 con 0x7fb64c0d0c80 2024-04-25T09:04:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb651d5e640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb64c15e0b0 0x7fb64c156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb650d5c640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0d0c80 0x7fb64c0caf30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c430 tx=0x7fb63c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb641ffb640 1 -- 172.21.15.5:0/3969208274 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011790 con 0x7fb64c0d0c80 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb641ffb640 1 -- 172.21.15.5:0/3969208274 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c017070 con 0x7fb64c0d0c80 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c15f890 con 0x7fb64c0d0c80 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.490+0000 7fb641ffb640 1 -- 172.21.15.5:0/3969208274 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011bb0 con 0x7fb64c0d0c80 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.491+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c15fe50 con 0x7fb64c0d0c80 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.492+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c04ef20 con 0x7fb64c0d0c80 2024-04-25T09:04:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.492+0000 7fb641ffb640 1 -- 172.21.15.5:0/3969208274 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb63c01c460 con 0x7fb64c0d0c80 2024-04-25T09:04:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.492+0000 7fb641ffb640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb63006b4d0 0x7fb63006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.493+0000 7fb641ffb640 1 -- 172.21.15.5:0/3969208274 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb63c08a060 con 0x7fb64c0d0c80 2024-04-25T09:04:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.493+0000 7fb65155d640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb63006b4d0 0x7fb63006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.493+0000 7fb65155d640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb63006b4d0 0x7fb63006d990 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb648006fd0 tx=0x7fb648008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.497+0000 7fb641ffb640 1 -- 172.21.15.5:0/3969208274 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb63c058ee0 con 0x7fb64c0d0c80 2024-04-25T09:04:03.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.677+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb64c160020 con 0x7fb64c0d0c80 2024-04-25T09:04:03.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.678+0000 7fb641ffb640 1 -- 172.21.15.5:0/3969208274 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb63c0587e0 con 0x7fb64c0d0c80 2024-04-25T09:04:03.667 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb63006b4d0 msgr2=0x7fb63006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb63006b4d0 0x7fb63006d990 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb648006fd0 tx=0x7fb648008040 comp rx=0 tx=0).stop 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0d0c80 msgr2=0x7fb64c0caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0d0c80 0x7fb64c0caf30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c430 tx=0x7fb63c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 shutdown_connections 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb63006b4d0 0x7fb63006d990 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb64c15e0b0 0x7fb64c156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb64c0d0c80 0x7fb64c0caf30 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 --2- 172.21.15.5:0/3969208274 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64c0cc780 0x7fb64c160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 >> 172.21.15.5:0/3969208274 conn(0x7fb64c0d1a20 msgr2=0x7fb64c0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 shutdown_connections 2024-04-25T09:04:03.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.680+0000 7fb6537c1640 1 -- 172.21.15.5:0/3969208274 wait complete. 2024-04-25T09:04:03.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:03.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.794+0000 7f11544c4640 1 Processor -- start 2024-04-25T09:04:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.794+0000 7f11544c4640 1 -- start start 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f11544c4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f114c15bce0 0x7f114c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f11544c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0b3b90 0x7f114c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f11544c4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c15c0c0 con 0x7f114c0cf790 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f11544c4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114c070e90 con 0x7f114c15bce0 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f11544c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c071170 con 0x7f114c0b3b90 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f1152a61640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0b3b90 0x7f114c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f1152260640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f114c15bce0 0x7f114c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f1152a61640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0b3b90 0x7f114c0cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:42280/0 (socket says 172.21.15.5:42280) 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.795+0000 7f1152a61640 1 -- 172.21.15.5:0/3088535915 learned_addr learned my addr 172.21.15.5:0/3088535915 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.796+0000 7f1152a61640 1 -- 172.21.15.5:0/3088535915 >> v2:172.21.15.80:3300/0 conn(0x7f114c15bce0 msgr2=0x7f114c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.796+0000 7f1152a61640 1 --2- 172.21.15.5:0/3088535915 >> v2:172.21.15.80:3300/0 conn(0x7f114c15bce0 0x7f114c06c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.796+0000 7f1152a61640 1 -- 172.21.15.5:0/3088535915 >> v1:172.21.15.80:6789/0 conn(0x7f114c0cf790 legacy=0x7f114c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.796+0000 7f1152a61640 1 -- 172.21.15.5:0/3088535915 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c071450 con 0x7f114c0b3b90 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.796+0000 7f1152a61640 1 --2- 172.21.15.5:0/3088535915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0b3b90 0x7f114c0cfc20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1144009e50 tx=0x7f114402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cdbb8ad6704dbf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.796+0000 7f115125e640 1 -- 172.21.15.5:0/3088535915 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144036070 con 0x7f114c0b3b90 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f115125e640 1 -- 172.21.15.5:0/3088535915 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1144031600 con 0x7f114c0b3b90 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f115125e640 1 -- 172.21.15.5:0/3088535915 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11440319d0 con 0x7f114c0b3b90 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 -- 172.21.15.5:0/3088535915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0b3b90 msgr2=0x7f114c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 --2- 172.21.15.5:0/3088535915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0b3b90 0x7f114c0cfc20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1144009e50 tx=0x7f114402a710 comp rx=0 tx=0).stop 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 -- 172.21.15.5:0/3088535915 shutdown_connections 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 --2- 172.21.15.5:0/3088535915 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0b3b90 0x7f114c0cfc20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 --2- 172.21.15.5:0/3088535915 >> v2:172.21.15.80:3300/0 conn(0x7f114c15bce0 0x7f114c06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 -- 172.21.15.5:0/3088535915 >> 172.21.15.5:0/3088535915 conn(0x7f114c0b1550 msgr2=0x7f114c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 -- 172.21.15.5:0/3088535915 shutdown_connections 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.797+0000 7f11544c4640 1 -- 172.21.15.5:0/3088535915 wait complete. 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.798+0000 7f11544c4640 1 Processor -- start 2024-04-25T09:04:03.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.798+0000 7f11544c4640 1 -- start start 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f11544c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f114c0b3b90 0x7f114c15e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f11544c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0cf790 0x7f114c155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f11544c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f114c15bce0 0x7f114c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f11544c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c06c940 con 0x7f114c0b3b90 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f11544c4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0b4140 con 0x7f114c15bce0 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f11544c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c06cac0 con 0x7f114c0cf790 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152260640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f114c0b3b90 0x7f114c15e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152260640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f114c0b3b90 0x7f114c15e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42592/0 (socket says 172.21.15.5:42592) 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152260640 1 -- 172.21.15.5:0/1927776303 learned_addr learned my addr 172.21.15.5:0/1927776303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152a61640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f114c15bce0 0x7f114c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1151a5f640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0cf790 0x7f114c155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152260640 1 -- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0cf790 msgr2=0x7f114c155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152260640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0cf790 0x7f114c155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152260640 1 -- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f114c15bce0 msgr2=0x7f114c1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.799+0000 7f1152260640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f114c15bce0 0x7f114c1542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f1152260640 1 -- 172.21.15.5:0/1927776303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c1567a0 con 0x7f114c0b3b90 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f1152a61640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f114c15bce0 0x7f114c1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f1152260640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f114c0b3b90 0x7f114c15e970 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f114800e9e0 tx=0x7f114800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f1142ffd640 1 -- 172.21.15.5:0/1927776303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148017070 con 0x7f114c0b3b90 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c156a80 con 0x7f114c0b3b90 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f1142ffd640 1 -- 172.21.15.5:0/1927776303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114800c9d0 con 0x7f114c0b3b90 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f1142ffd640 1 -- 172.21.15.5:0/1927776303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800cdc0 con 0x7f114c0b3b90 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.800+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c1f3010 con 0x7f114c0b3b90 2024-04-25T09:04:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.801+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c04ef20 con 0x7f114c0b3b90 2024-04-25T09:04:03.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.801+0000 7f1142ffd640 1 -- 172.21.15.5:0/1927776303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f114801a070 con 0x7f114c0b3b90 2024-04-25T09:04:03.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.802+0000 7f1142ffd640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f113006b4d0 0x7f113006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.802+0000 7f1142ffd640 1 -- 172.21.15.5:0/1927776303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f114808a650 con 0x7f114c0b3b90 2024-04-25T09:04:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.802+0000 7f1151a5f640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f113006b4d0 0x7f113006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.803+0000 7f1151a5f640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f113006b4d0 0x7f113006d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f113c007fd0 tx=0x7f113c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.806+0000 7f1142ffd640 1 -- 172.21.15.5:0/1927776303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1148059450 con 0x7f114c0b3b90 2024-04-25T09:04:03.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.984+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f114c0cfd30 con 0x7f114c0b3b90 2024-04-25T09:04:03.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.984+0000 7f1142ffd640 1 -- 172.21.15.5:0/1927776303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1148058d50 con 0x7f114c0b3b90 2024-04-25T09:04:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:04:03.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.986+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f113006b4d0 msgr2=0x7f113006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.986+0000 7f11544c4640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f113006b4d0 0x7f113006d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f113c007fd0 tx=0x7f113c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:03.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.986+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f114c0b3b90 msgr2=0x7f114c15e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.986+0000 7f11544c4640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f114c0b3b90 0x7f114c15e970 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f114800e9e0 tx=0x7f114800eea0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 shutdown_connections 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f113006b4d0 0x7f113006d990 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f114c15bce0 0x7f114c1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f114c0cf790 0x7f114c155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 --2- 172.21.15.5:0/1927776303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f114c0b3b90 0x7f114c15e970 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 >> 172.21.15.5:0/1927776303 conn(0x7f114c0b1550 msgr2=0x7f114c160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 shutdown_connections 2024-04-25T09:04:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:03.987+0000 7f11544c4640 1 -- 172.21.15.5:0/1927776303 wait complete. 2024-04-25T09:04:03.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:04.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.104+0000 7fa921361640 1 Processor -- start 2024-04-25T09:04:04.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.104+0000 7fa921361640 1 -- start start 2024-04-25T09:04:04.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa921361640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa91c15bdc0 0x7fa91c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa921361640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa91c0cd6e0 0x7fa91c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa921361640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa921361640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c0cec40 con 0x7fa91c15bdc0 2024-04-25T09:04:04.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa921361640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c0cdcb0 con 0x7fa91c0cd6e0 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa921361640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0cdf90 con 0x7fa91c0ce7d0 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa91affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa91c15bdc0 0x7fa91c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa91affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa91c15bdc0 0x7fa91c0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42608/0 (socket says 172.21.15.5:42608) 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.105+0000 7fa91affd640 1 -- 172.21.15.5:0/3363015982 learned_addr learned my addr 172.21.15.5:0/3363015982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91b7fe640 1 --2- 172.21.15.5:0/3363015982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91a7fc640 1 --2- 172.21.15.5:0/3363015982 >> v2:172.21.15.80:3300/0 conn(0x7fa91c0cd6e0 0x7fa91c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91affd640 1 -- 172.21.15.5:0/3363015982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 msgr2=0x7fa91c0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91affd640 1 --2- 172.21.15.5:0/3363015982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c0cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91affd640 1 -- 172.21.15.5:0/3363015982 >> v2:172.21.15.80:3300/0 conn(0x7fa91c0cd6e0 msgr2=0x7fa91c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91affd640 1 --2- 172.21.15.5:0/3363015982 >> v2:172.21.15.80:3300/0 conn(0x7fa91c0cd6e0 0x7fa91c0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91affd640 1 -- 172.21.15.5:0/3363015982 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c0b47e0 con 0x7fa91c15bdc0 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.106+0000 7fa91affd640 1 --2- 172.21.15.5:0/3363015982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c0cd1a0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0b44e0 tx=0x7fa90c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baca0b65626437b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa919ffb640 1 -- 172.21.15.5:0/3363015982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c036070 con 0x7fa91c15bdc0 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa919ffb640 1 -- 172.21.15.5:0/3363015982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c031600 con 0x7fa91c15bdc0 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa919ffb640 1 -- 172.21.15.5:0/3363015982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0319d0 con 0x7fa91c15bdc0 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 -- 172.21.15.5:0/3363015982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 msgr2=0x7fa91c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 --2- 172.21.15.5:0/3363015982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c0cd1a0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0b44e0 tx=0x7fa90c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 -- 172.21.15.5:0/3363015982 shutdown_connections 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 --2- 172.21.15.5:0/3363015982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c0cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 --2- 172.21.15.5:0/3363015982 >> v2:172.21.15.80:3300/0 conn(0x7fa91c0cd6e0 0x7fa91c0ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 --2- 172.21.15.5:0/3363015982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c0cd1a0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 -- 172.21.15.5:0/3363015982 >> 172.21.15.5:0/3363015982 conn(0x7fa91c0d18f0 msgr2=0x7fa91c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 -- 172.21.15.5:0/3363015982 shutdown_connections 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.107+0000 7fa921361640 1 -- 172.21.15.5:0/3363015982 wait complete. 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.108+0000 7fa921361640 1 Processor -- start 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa921361640 1 -- start start 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa921361640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91c0cd6e0 0x7fa91c1f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa921361640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa921361640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa921361640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0d09a0 con 0x7fa91c15bdc0 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa921361640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b4da0 con 0x7fa91c0cd6e0 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa921361640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c15c1a0 con 0x7fa91c0ce7d0 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa91b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa91b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c1545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42622/0 (socket says 172.21.15.5:42622) 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa91b7fe640 1 -- 172.21.15.5:0/1084074881 learned_addr learned my addr 172.21.15.5:0/1084074881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa91a7fc640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.109+0000 7fa91affd640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91c0cd6e0 0x7fa91c1f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa91b7fe640 1 -- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 msgr2=0x7fa91c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa91b7fe640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa91b7fe640 1 -- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91c0cd6e0 msgr2=0x7fa91c1f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa91b7fe640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91c0cd6e0 0x7fa91c1f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa91b7fe640 1 -- 172.21.15.5:0/1084074881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c1f1f50 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa91b7fe640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c1545f0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa91400d800 tx=0x7fa91400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa9037fe640 1 -- 172.21.15.5:0/1084074881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400b6c0 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa9037fe640 1 -- 172.21.15.5:0/1084074881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914019070 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa9037fe640 1 -- 172.21.15.5:0/1084074881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400bac0 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c1f2230 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.110+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c1f27f0 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.111+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c04ef20 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.111+0000 7fa9037fe640 1 -- 172.21.15.5:0/1084074881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa91400bc60 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.112+0000 7fa9037fe640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa90806b500 0x7fa90806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.112+0000 7fa9037fe640 1 -- 172.21.15.5:0/1084074881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa91408a440 con 0x7fa91c15bdc0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.112+0000 7fa91affd640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa90806b500 0x7fa90806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.113+0000 7fa91affd640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa90806b500 0x7fa90806d9c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa90c033000 tx=0x7fa90c009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.116+0000 7fa9037fe640 1 -- 172.21.15.5:0/1084074881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa914058d00 con 0x7fa91c15bdc0 2024-04-25T09:04:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.310+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa91c0b6910 con 0x7fa91c15bdc0 2024-04-25T09:04:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.310+0000 7fa9037fe640 1 -- 172.21.15.5:0/1084074881 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v99) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa91405cda0 con 0x7fa91c15bdc0 2024-04-25T09:04:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T09:04:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa90806b500 msgr2=0x7fa90806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa90806b500 0x7fa90806d9c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa90c033000 tx=0x7fa90c009000 comp rx=0 tx=0).stop 2024-04-25T09:04:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 msgr2=0x7fa91c1545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c1545f0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa91400d800 tx=0x7fa91400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 shutdown_connections 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa90806b500 0x7fa90806d9c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c15bdc0 0x7fa91c1545f0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa91c0ce7d0 0x7fa91c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 --2- 172.21.15.5:0/1084074881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91c0cd6e0 0x7fa91c1f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 >> 172.21.15.5:0/1084074881 conn(0x7fa91c0d18f0 msgr2=0x7fa91c0b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 shutdown_connections 2024-04-25T09:04:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:04.312+0000 7fa921361640 1 -- 172.21.15.5:0/1084074881 wait complete. 2024-04-25T09:04:04.312 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:04:04.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:05.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:04:05.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:05.002 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:04:05.020 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:04:05.020 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:05.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:05.035 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:05.036 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:05.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:05.076 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:04:05.076 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:05.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:05.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.229+0000 7fc89a710640 1 Processor -- start 2024-04-25T09:04:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.230+0000 7fc89a710640 1 -- start start 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.230+0000 7fc89a710640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8940b0e30 0x7fc8940b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.230+0000 7fc89a710640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89406ba50 con 0x7fc8940b0a50 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.230+0000 7fc89a710640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89406bd30 con 0x7fc8940ce910 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.230+0000 7fc89a710640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89406b800 con 0x7fc8940b0e30 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.230+0000 7fc8937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8940b0e30 0x7fc8940b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.231+0000 7fc8937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8940b0e30 0x7fc8940b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42630/0 (socket says 172.21.15.5:42630) 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.231+0000 7fc893fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc8940b0a50 0x7fc8940ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60460/0 (socket says 172.21.15.5:60460) 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.231+0000 7fc8937fe640 1 -- 172.21.15.5:0/3761252689 learned_addr learned my addr 172.21.15.5:0/3761252689 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.231+0000 7fc8937fe640 1 -- 172.21.15.5:0/3761252689 >> v1:172.21.15.80:6789/0 conn(0x7fc8940ce910 legacy=0x7fc8940b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.231+0000 7fc8937fe640 1 -- 172.21.15.5:0/3761252689 >> v1:172.21.15.5:6789/0 conn(0x7fc8940b0a50 legacy=0x7fc8940ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.231+0000 7fc8937fe640 1 -- 172.21.15.5:0/3761252689 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89406c010 con 0x7fc8940b0e30 2024-04-25T09:04:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.231+0000 7fc892ffd640 1 -- 172.21.15.5:0/3761252689 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207701116 0 0) 0x7fc89406ba50 con 0x7fc8940b0a50 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc8937fe640 1 --2- 172.21.15.5:0/3761252689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0e30 0x7fc8940b1230 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc888009870 tx=0x7fc88802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206342efa7f28c40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc892ffd640 1 -- 172.21.15.5:0/3761252689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888037070 con 0x7fc8940b0e30 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc892ffd640 1 -- 172.21.15.5:0/3761252689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888032440 con 0x7fc8940b0e30 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc892ffd640 1 -- 172.21.15.5:0/3761252689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888032810 con 0x7fc8940b0e30 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc89a710640 1 -- 172.21.15.5:0/3761252689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0e30 msgr2=0x7fc8940b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc89a710640 1 --2- 172.21.15.5:0/3761252689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0e30 0x7fc8940b1230 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc888009870 tx=0x7fc88802a270 comp rx=0 tx=0).stop 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc89a710640 1 -- 172.21.15.5:0/3761252689 shutdown_connections 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc89a710640 1 --2- 172.21.15.5:0/3761252689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0e30 0x7fc8940b1230 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc89a710640 1 -- 172.21.15.5:0/3761252689 >> 172.21.15.5:0/3761252689 conn(0x7fc8940d18f0 msgr2=0x7fc8940d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc89a710640 1 -- 172.21.15.5:0/3761252689 shutdown_connections 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.232+0000 7fc89a710640 1 -- 172.21.15.5:0/3761252689 wait complete. 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.233+0000 7fc89a710640 1 Processor -- start 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.234+0000 7fc89a710640 1 -- start start 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.234+0000 7fc89a710640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0a50 0x7fc8941e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.234+0000 7fc89a710640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8940b0e30 0x7fc89415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.234+0000 7fc89a710640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8940ce910 0x7fc8940c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.234+0000 7fc89a710640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940b2bf0 con 0x7fc8940b0a50 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.234+0000 7fc89a710640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940cfd60 con 0x7fc8940ce910 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.234+0000 7fc89a710640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8941e6cd0 con 0x7fc8940b0e30 2024-04-25T09:04:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0a50 0x7fc8941e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0a50 0x7fc8941e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42634/0 (socket says 172.21.15.5:42634) 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 -- 172.21.15.5:0/1946390749 learned_addr learned my addr 172.21.15.5:0/1946390749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc898cad640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8940ce910 0x7fc8940c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc8937fe640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8940b0e30 0x7fc89415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 -- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8940b0e30 msgr2=0x7fc89415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8940b0e30 0x7fc89415b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 -- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8940ce910 msgr2=0x7fc8940c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8940ce910 0x7fc8940c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 -- 172.21.15.5:0/1946390749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89406fe80 con 0x7fc8940b0a50 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc898cad640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8940ce910 0x7fc8940c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc893fff640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0a50 0x7fc8941e7160 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c4a0 tx=0x7fc88400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc890ff9640 1 -- 172.21.15.5:0/1946390749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884018070 con 0x7fc8940b0a50 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc890ff9640 1 -- 172.21.15.5:0/1946390749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8840074e0 con 0x7fc8940b0a50 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc890ff9640 1 -- 172.21.15.5:0/1946390749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884004a20 con 0x7fc8940b0a50 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc894070160 con 0x7fc8940b0a50 2024-04-25T09:04:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.235+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89415bf00 con 0x7fc8940b0a50 2024-04-25T09:04:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.236+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89404ef20 con 0x7fc8940b0a50 2024-04-25T09:04:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.237+0000 7fc890ff9640 1 -- 172.21.15.5:0/1946390749 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc88401b070 con 0x7fc8940b0a50 2024-04-25T09:04:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.237+0000 7fc890ff9640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc88006b4d0 0x7fc88006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.237+0000 7fc890ff9640 1 -- 172.21.15.5:0/1946390749 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8840894e0 con 0x7fc8940b0a50 2024-04-25T09:04:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.237+0000 7fc8937fe640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc88006b4d0 0x7fc88006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.238+0000 7fc8937fe640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc88006b4d0 0x7fc88006d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc888034000 tx=0x7fc88802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.241+0000 7fc890ff9640 1 -- 172.21.15.5:0/1946390749 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8840583f0 con 0x7fc8940b0a50 2024-04-25T09:04:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.460+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8940cd840 con 0x7fc8940b0a50 2024-04-25T09:04:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.460+0000 7fc890ff9640 1 -- 172.21.15.5:0/1946390749 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fc884057cf0 con 0x7fc8940b0a50 2024-04-25T09:04:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:05.449 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:04:05.450 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:04:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc88006b4d0 msgr2=0x7fc88006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc88006b4d0 0x7fc88006d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc888034000 tx=0x7fc88802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0a50 msgr2=0x7fc8941e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0a50 0x7fc8941e7160 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c4a0 tx=0x7fc88400c960 comp rx=0 tx=0).stop 2024-04-25T09:04:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 shutdown_connections 2024-04-25T09:04:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc88006b4d0 0x7fc88006d990 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8940ce910 0x7fc8940c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8940b0e30 0x7fc89415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 --2- 172.21.15.5:0/1946390749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8940b0a50 0x7fc8941e7160 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 >> 172.21.15.5:0/1946390749 conn(0x7fc8940d18f0 msgr2=0x7fc89415c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 shutdown_connections 2024-04-25T09:04:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.462+0000 7fc89a710640 1 -- 172.21.15.5:0/1946390749 wait complete. 2024-04-25T09:04:05.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.575+0000 7f936963a640 1 Processor -- start 2024-04-25T09:04:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.575+0000 7f936963a640 1 -- start start 2024-04-25T09:04:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f936963a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f936963a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93640cd6e0 0x7f93640ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f936963a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93640ce7d0 0x7f93640cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f936963a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640cec40 con 0x7f93640ce7d0 2024-04-25T09:04:05.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f936963a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640cdcb0 con 0x7f93640cd6e0 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f936963a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93640cdf90 con 0x7f936415bdc0 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93640ce7d0 0x7f93640cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93640ce7d0 0x7f93640cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42648/0 (socket says 172.21.15.5:42648) 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 -- 172.21.15.5:0/3661476921 learned_addr learned my addr 172.21.15.5:0/3661476921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f9362ffd640 1 --2- 172.21.15.5:0/3661476921 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93627fc640 1 --2- 172.21.15.5:0/3661476921 >> v2:172.21.15.80:3300/0 conn(0x7f93640cd6e0 0x7f93640ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 -- 172.21.15.5:0/3661476921 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 msgr2=0x7f93640cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 --2- 172.21.15.5:0/3661476921 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 -- 172.21.15.5:0/3661476921 >> v2:172.21.15.80:3300/0 conn(0x7f93640cd6e0 msgr2=0x7f93640ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 --2- 172.21.15.5:0/3661476921 >> v2:172.21.15.80:3300/0 conn(0x7f93640cd6e0 0x7f93640ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.576+0000 7f93637fe640 1 -- 172.21.15.5:0/3661476921 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640b47e0 con 0x7f93640ce7d0 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.577+0000 7f93637fe640 1 --2- 172.21.15.5:0/3661476921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f93640cf760 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f9364070e60 tx=0x7f935c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57231c43a79e57a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.577+0000 7f9361ffb640 1 -- 172.21.15.5:0/3661476921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c036070 con 0x7f93640ce7d0 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.577+0000 7f9361ffb640 1 -- 172.21.15.5:0/3661476921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c031600 con 0x7f93640ce7d0 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.577+0000 7f9361ffb640 1 -- 172.21.15.5:0/3661476921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0319d0 con 0x7f93640ce7d0 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.577+0000 7f936963a640 1 -- 172.21.15.5:0/3661476921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 msgr2=0x7f93640cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.577+0000 7f936963a640 1 --2- 172.21.15.5:0/3661476921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f93640cf760 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f9364070e60 tx=0x7f935c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.578+0000 7f936963a640 1 -- 172.21.15.5:0/3661476921 shutdown_connections 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.578+0000 7f936963a640 1 --2- 172.21.15.5:0/3661476921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f93640cf760 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.578+0000 7f936963a640 1 --2- 172.21.15.5:0/3661476921 >> v2:172.21.15.80:3300/0 conn(0x7f93640cd6e0 0x7f93640ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.578+0000 7f936963a640 1 --2- 172.21.15.5:0/3661476921 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.578+0000 7f936963a640 1 -- 172.21.15.5:0/3661476921 >> 172.21.15.5:0/3661476921 conn(0x7f93640d18f0 msgr2=0x7f93640d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.578+0000 7f936963a640 1 -- 172.21.15.5:0/3661476921 shutdown_connections 2024-04-25T09:04:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.578+0000 7f936963a640 1 -- 172.21.15.5:0/3661476921 wait complete. 2024-04-25T09:04:05.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.579+0000 7f936963a640 1 Processor -- start 2024-04-25T09:04:05.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.579+0000 7f936963a640 1 -- start start 2024-04-25T09:04:05.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93640cd6e0 0x7f936415d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f9364150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640d09a0 con 0x7f93640ce7d0 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640b4da0 con 0x7f93640cd6e0 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936415c1a0 con 0x7f936415bdc0 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f9364150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f9364150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42664/0 (socket says 172.21.15.5:42664) 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 -- 172.21.15.5:0/2818885755 learned_addr learned my addr 172.21.15.5:0/2818885755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93637fe640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f9362ffd640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93640cd6e0 0x7f936415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 -- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 msgr2=0x7f93640ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 -- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93640cd6e0 msgr2=0x7f936415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93640cd6e0 0x7f936415d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 -- 172.21.15.5:0/2818885755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936415d850 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f9362ffd640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93640cd6e0 0x7f936415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f93627fc640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f9364150cf0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f935800e870 tx=0x7f935800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f934b7fe640 1 -- 172.21.15.5:0/2818885755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358017070 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f934b7fe640 1 -- 172.21.15.5:0/2818885755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935800ee60 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f934b7fe640 1 -- 172.21.15.5:0/2818885755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800cb80 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936415db30 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.580+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936415e0f0 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.582+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936404ef20 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.582+0000 7f934b7fe640 1 -- 172.21.15.5:0/2818885755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f935801a070 con 0x7f93640ce7d0 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.582+0000 7f934b7fe640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f935006b4d0 0x7f935006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.582+0000 7f934b7fe640 1 -- 172.21.15.5:0/2818885755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f935808a400 con 0x7f93640ce7d0 2024-04-25T09:04:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.583+0000 7f9362ffd640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f935006b4d0 0x7f935006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.583+0000 7f9362ffd640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f935006b4d0 0x7f935006d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9354009ac0 tx=0x7f9354008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.587+0000 7f934b7fe640 1 -- 172.21.15.5:0/2818885755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9358059280 con 0x7f93640ce7d0 2024-04-25T09:04:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.766+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93640b5360 con 0x7f93640ce7d0 2024-04-25T09:04:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.768+0000 7f934b7fe640 1 -- 172.21.15.5:0/2818885755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16524 (secure 0 0 0) 0x7f9358058b80 con 0x7f93640ce7d0 2024-04-25T09:04:05.757 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:05.757 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:33.997354+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.627226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:31.329753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:05.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f935006b4d0 msgr2=0x7f935006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f935006b4d0 0x7f935006d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9354009ac0 tx=0x7f9354008040 comp rx=0 tx=0).stop 2024-04-25T09:04:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 msgr2=0x7f9364150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f9364150cf0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f935800e870 tx=0x7f935800ed30 comp rx=0 tx=0).stop 2024-04-25T09:04:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 shutdown_connections 2024-04-25T09:04:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f935006b4d0 0x7f935006d990 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f936415bdc0 0x7f93640ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93640ce7d0 0x7f9364150cf0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 --2- 172.21.15.5:0/2818885755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93640cd6e0 0x7f936415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 >> 172.21.15.5:0/2818885755 conn(0x7f93640d18f0 msgr2=0x7f93640b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 shutdown_connections 2024-04-25T09:04:05.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.770+0000 7f936963a640 1 -- 172.21.15.5:0/2818885755 wait complete. 2024-04-25T09:04:05.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:30.627226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:31.329753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:05.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:05.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.887+0000 7f5893a9a640 1 Processor -- start 2024-04-25T09:04:05.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.887+0000 7f5893a9a640 1 -- start start 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5893a9a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f588c0d2f70 0x7f588c0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5893a9a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588c0d1ed0 con 0x7f588c0ced50 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5893a9a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588c0d21b0 con 0x7f588c15df70 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5893a9a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588c0d1c80 con 0x7f588c0d2f70 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5892037640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f588c0ced50 0x7f588c0b6c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60466/0 (socket says 172.21.15.5:60466) 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5892037640 1 -- 172.21.15.5:0/1337994850 learned_addr learned my addr 172.21.15.5:0/1337994850 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5891035640 1 --2- 172.21.15.5:0/1337994850 >> v2:172.21.15.80:3300/0 conn(0x7f588c0d2f70 0x7f588c0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5890834640 1 -- 172.21.15.5:0/1337994850 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744493036 0 0) 0x7f588c0d1ed0 con 0x7f588c0ced50 2024-04-25T09:04:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5890834640 1 -- 172.21.15.5:0/1337994850 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5878003520 con 0x7f588c0ced50 2024-04-25T09:04:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5890834640 1 -- 172.21.15.5:0/1337994850 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103809978 0 0) 0x7f588c0d21b0 con 0x7f588c15df70 2024-04-25T09:04:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5890834640 1 -- 172.21.15.5:0/1337994850 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f588c0d1ed0 con 0x7f588c15df70 2024-04-25T09:04:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5891035640 1 -- 172.21.15.5:0/1337994850 >> v1:172.21.15.80:6789/0 conn(0x7f588c15df70 legacy=0x7f588c0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5891035640 1 -- 172.21.15.5:0/1337994850 >> v1:172.21.15.5:6789/0 conn(0x7f588c0ced50 legacy=0x7f588c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.888+0000 7f5891035640 1 -- 172.21.15.5:0/1337994850 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0d2490 con 0x7f588c0d2f70 2024-04-25T09:04:05.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.889+0000 7f5891035640 1 --2- 172.21.15.5:0/1337994850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0d2f70 0x7f588c0ce810 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f587c0097a0 tx=0x7f587c02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf733733cc90629a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.889+0000 7f5890834640 1 -- 172.21.15.5:0/1337994850 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c037070 con 0x7f588c0d2f70 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.889+0000 7f5890834640 1 -- 172.21.15.5:0/1337994850 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c032640 con 0x7f588c0d2f70 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.889+0000 7f5890834640 1 -- 172.21.15.5:0/1337994850 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0329f0 con 0x7f588c0d2f70 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.890+0000 7f5893a9a640 1 -- 172.21.15.5:0/1337994850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0d2f70 msgr2=0x7f588c0ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.890+0000 7f5893a9a640 1 --2- 172.21.15.5:0/1337994850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0d2f70 0x7f588c0ce810 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f587c0097a0 tx=0x7f587c02a2c0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.890+0000 7f5893a9a640 1 -- 172.21.15.5:0/1337994850 shutdown_connections 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.890+0000 7f5893a9a640 1 --2- 172.21.15.5:0/1337994850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0d2f70 0x7f588c0ce810 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.890+0000 7f5893a9a640 1 -- 172.21.15.5:0/1337994850 >> 172.21.15.5:0/1337994850 conn(0x7f588c06b000 msgr2=0x7f588c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.890+0000 7f5893a9a640 1 -- 172.21.15.5:0/1337994850 shutdown_connections 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.890+0000 7f5893a9a640 1 -- 172.21.15.5:0/1337994850 wait complete. 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.891+0000 7f5893a9a640 1 Processor -- start 2024-04-25T09:04:05.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.891+0000 7f5893a9a640 1 -- start start 2024-04-25T09:04:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5893a9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588c0ced50 0x7f588c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5893a9a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f588c0d2f70 0x7f588c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5893a9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0c7a80 0x7f588c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5893a9a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0d3720 con 0x7f588c0ced50 2024-04-25T09:04:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5893a9a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0d2ae0 con 0x7f588c0c7a80 2024-04-25T09:04:05.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5893a9a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0d38a0 con 0x7f588c0d2f70 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588c0ced50 0x7f588c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588c0ced50 0x7f588c14f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42676/0 (socket says 172.21.15.5:42676) 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 -- 172.21.15.5:0/2808711125 learned_addr learned my addr 172.21.15.5:0/2808711125 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891035640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f588c0d2f70 0x7f588c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5892037640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0c7a80 0x7f588c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 -- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f588c0d2f70 msgr2=0x7f588c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f588c0d2f70 0x7f588c15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 -- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0c7a80 msgr2=0x7f588c15ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0c7a80 0x7f588c15ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 -- 172.21.15.5:0/2808711125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0c7f10 con 0x7f588c0ced50 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.892+0000 7f5891836640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588c0ced50 0x7f588c14f2c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f588800c430 tx=0x7f588800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.893+0000 7f58827fc640 1 -- 172.21.15.5:0/2808711125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888017070 con 0x7f588c0ced50 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.893+0000 7f58827fc640 1 -- 172.21.15.5:0/2808711125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58880052f0 con 0x7f588c0ced50 2024-04-25T09:04:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.893+0000 7f58827fc640 1 -- 172.21.15.5:0/2808711125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888003830 con 0x7f588c0ced50 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.893+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c0c81f0 con 0x7f588c0ced50 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.893+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588c0c87b0 con 0x7f588c0ced50 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.894+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588c04ef20 con 0x7f588c0ced50 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.894+0000 7f58827fc640 1 -- 172.21.15.5:0/2808711125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f588801a070 con 0x7f588c0ced50 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.895+0000 7f58827fc640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587006b4d0 0x7f587006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.895+0000 7f58827fc640 1 -- 172.21.15.5:0/2808711125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5888089520 con 0x7f588c0ced50 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.895+0000 7f5891035640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587006b4d0 0x7f587006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.895+0000 7f5891035640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587006b4d0 0x7f587006d990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f587c034000 tx=0x7f587c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:05.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:05.899+0000 7f58827fc640 1 -- 172.21.15.5:0/2808711125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5888057d50 con 0x7f588c0ced50 2024-04-25T09:04:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.083+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f588c06b7f0 con 0x7f588c0ced50 2024-04-25T09:04:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.083+0000 7f58827fc640 1 -- 172.21.15.5:0/2808711125 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7f588805bdf0 con 0x7f588c0ced50 2024-04-25T09:04:06.072 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:04:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587006b4d0 msgr2=0x7f587006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587006b4d0 0x7f587006d990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f587c034000 tx=0x7f587c02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588c0ced50 msgr2=0x7f588c14f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588c0ced50 0x7f588c14f2c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f588800c430 tx=0x7f588800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 shutdown_connections 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f587006b4d0 0x7f587006d990 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f588c0c7a80 0x7f588c15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f588c0d2f70 0x7f588c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 --2- 172.21.15.5:0/2808711125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588c0ced50 0x7f588c14f2c0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 >> 172.21.15.5:0/2808711125 conn(0x7f588c06b000 msgr2=0x7f588c067180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 shutdown_connections 2024-04-25T09:04:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.085+0000 7f5893a9a640 1 -- 172.21.15.5:0/2808711125 wait complete. 2024-04-25T09:04:06.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:06.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.200+0000 7f3b2cb70640 1 Processor -- start 2024-04-25T09:04:06.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.200+0000 7f3b2cb70640 1 -- start start 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.200+0000 7f3b2cb70640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b2806adf0 0x7f3b28168f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.200+0000 7f3b2cb70640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b280cce90 con 0x7f3b2815e0b0 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.200+0000 7f3b2cb70640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b280d27f0 con 0x7f3b280d0c80 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b2cb70640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b280cfee0 con 0x7f3b2806adf0 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b26d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b2806adf0 0x7f3b28168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b2659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b2815e0b0 0x7f3b280cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60474/0 (socket says 172.21.15.5:60474) 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b26d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b2806adf0 0x7f3b28168f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42692/0 (socket says 172.21.15.5:42692) 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b2659c640 1 -- 172.21.15.5:0/2885926631 learned_addr learned my addr 172.21.15.5:0/2885926631 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b26d9d640 1 -- 172.21.15.5:0/2885926631 >> v1:172.21.15.80:6789/0 conn(0x7f3b280d0c80 legacy=0x7f3b280cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b26d9d640 1 -- 172.21.15.5:0/2885926631 >> v1:172.21.15.5:6789/0 conn(0x7f3b2815e0b0 legacy=0x7f3b280cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.201+0000 7f3b26d9d640 1 -- 172.21.15.5:0/2885926631 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280d01c0 con 0x7f3b2806adf0 2024-04-25T09:04:06.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b26d9d640 1 --2- 172.21.15.5:0/2885926631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2806adf0 0x7f3b28168f40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009dc0 tx=0x7f3b2002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124b264ebe53d441 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b25d9b640 1 -- 172.21.15.5:0/2885926631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20007740 con 0x7f3b2806adf0 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b25d9b640 1 -- 172.21.15.5:0/2885926631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200078e0 con 0x7f3b2806adf0 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b25d9b640 1 -- 172.21.15.5:0/2885926631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20007cb0 con 0x7f3b2806adf0 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b2cb70640 1 -- 172.21.15.5:0/2885926631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2806adf0 msgr2=0x7f3b28168f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/2885926631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2806adf0 0x7f3b28168f40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009dc0 tx=0x7f3b2002a730 comp rx=0 tx=0).stop 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b2cb70640 1 -- 172.21.15.5:0/2885926631 shutdown_connections 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/2885926631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2806adf0 0x7f3b28168f40 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b2cb70640 1 -- 172.21.15.5:0/2885926631 >> 172.21.15.5:0/2885926631 conn(0x7f3b280d1a20 msgr2=0x7f3b280d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.202+0000 7f3b2cb70640 1 -- 172.21.15.5:0/2885926631 shutdown_connections 2024-04-25T09:04:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.203+0000 7f3b2cb70640 1 -- 172.21.15.5:0/2885926631 wait complete. 2024-04-25T09:04:06.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.204+0000 7f3b2cb70640 1 Processor -- start 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.204+0000 7f3b2cb70640 1 -- start start 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.204+0000 7f3b2cb70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b2806adf0 0x7f3b2815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.204+0000 7f3b2cb70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b280d0c80 0x7f3b28160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.204+0000 7f3b2cb70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2815e0b0 0x7f3b280b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.204+0000 7f3b2cb70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2815e490 con 0x7f3b2815e0b0 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.204+0000 7f3b2cb70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280d0780 con 0x7f3b280d0c80 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b2cb70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280cfb90 con 0x7f3b2806adf0 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2815e0b0 0x7f3b280b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2815e0b0 0x7f3b280b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42702/0 (socket says 172.21.15.5:42702) 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 -- 172.21.15.5:0/3094544840 learned_addr learned my addr 172.21.15.5:0/3094544840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b2659c640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b2806adf0 0x7f3b2815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b1ffff640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b280d0c80 0x7f3b28160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 -- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b2806adf0 msgr2=0x7f3b2815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b2806adf0 0x7f3b2815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 -- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b280d0c80 msgr2=0x7f3b28160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b280d0c80 0x7f3b28160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 -- 172.21.15.5:0/3094544840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280c9c70 con 0x7f3b2815e0b0 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b26d9d640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2815e0b0 0x7f3b280b0930 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009eb0 tx=0x7f3b20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b1effd640 1 -- 172.21.15.5:0/3094544840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2003f070 con 0x7f3b2815e0b0 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b1effd640 1 -- 172.21.15.5:0/3094544840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20031c70 con 0x7f3b2815e0b0 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b280c9f30 con 0x7f3b2815e0b0 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b1effd640 1 -- 172.21.15.5:0/3094544840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20044660 con 0x7f3b2815e0b0 2024-04-25T09:04:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.205+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b280ca4f0 con 0x7f3b2815e0b0 2024-04-25T09:04:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.207+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2804ef20 con 0x7f3b2815e0b0 2024-04-25T09:04:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.207+0000 7f3b1effd640 1 -- 172.21.15.5:0/3094544840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b20007790 con 0x7f3b2815e0b0 2024-04-25T09:04:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.207+0000 7f3b1effd640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b0806b4d0 0x7f3b0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.207+0000 7f3b1effd640 1 -- 172.21.15.5:0/3094544840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b200ab950 con 0x7f3b2815e0b0 2024-04-25T09:04:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.208+0000 7f3b2659c640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b0806b4d0 0x7f3b0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.208+0000 7f3b2659c640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b0806b4d0 0x7f3b0806d990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3b18005880 tx=0x7f3b18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.211+0000 7f3b1effd640 1 -- 172.21.15.5:0/3094544840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b20031e20 con 0x7f3b2815e0b0 2024-04-25T09:04:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.394+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b280b79a0 con 0x7f3b2815e0b0 2024-04-25T09:04:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.394+0000 7f3b1effd640 1 -- 172.21.15.5:0/3094544840 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b2007a210 con 0x7f3b2815e0b0 2024-04-25T09:04:06.383 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b0806b4d0 msgr2=0x7f3b0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b0806b4d0 0x7f3b0806d990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3b18005880 tx=0x7f3b18009040 comp rx=0 tx=0).stop 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2815e0b0 msgr2=0x7f3b280b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2815e0b0 0x7f3b280b0930 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009eb0 tx=0x7f3b20004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 shutdown_connections 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b0806b4d0 0x7f3b0806d990 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b2815e0b0 0x7f3b280b0930 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b280d0c80 0x7f3b28160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 --2- 172.21.15.5:0/3094544840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b2806adf0 0x7f3b2815ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 >> 172.21.15.5:0/3094544840 conn(0x7f3b280d1a20 msgr2=0x7f3b280b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 shutdown_connections 2024-04-25T09:04:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.396+0000 7f3b2cb70640 1 -- 172.21.15.5:0/3094544840 wait complete. 2024-04-25T09:04:06.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:06.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.512+0000 7f5d566dd640 1 Processor -- start 2024-04-25T09:04:06.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.512+0000 7f5d566dd640 1 -- start start 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d566dd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d566dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d500d1f60 0x7f5d500d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d566dd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d500d4060 0x7f5d500b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d566dd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d500d2740 con 0x7f5d500d1f60 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d566dd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d500d2a20 con 0x7f5d500d4060 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d566dd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500d2d00 con 0x7f5d501614b0 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d500d1f60 0x7f5d500d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d500d1f60 0x7f5d500d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42706/0 (socket says 172.21.15.5:42706) 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3376013181 learned_addr learned my addr 172.21.15.5:0/3376013181 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3376013181 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 msgr2=0x7f5d500b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 --2- 172.21.15.5:0/3376013181 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3376013181 >> v2:172.21.15.80:3300/0 conn(0x7f5d500d4060 msgr2=0x7f5d500b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 --2- 172.21.15.5:0/3376013181 >> v2:172.21.15.80:3300/0 conn(0x7f5d500d4060 0x7f5d500b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.513+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3376013181 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d500d2fe0 con 0x7f5d500d1f60 2024-04-25T09:04:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.514+0000 7f5d4f7fe640 1 --2- 172.21.15.5:0/3376013181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d1f60 0x7f5d500d3b20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f5d500d4820 tx=0x7f5d4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff77a4191192540e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.514+0000 7f5d4effd640 1 -- 172.21.15.5:0/3376013181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40037070 con 0x7f5d500d1f60 2024-04-25T09:04:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.514+0000 7f5d4effd640 1 -- 172.21.15.5:0/3376013181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40032440 con 0x7f5d500d1f60 2024-04-25T09:04:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.514+0000 7f5d4effd640 1 -- 172.21.15.5:0/3376013181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40032810 con 0x7f5d500d1f60 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.514+0000 7f5d566dd640 1 -- 172.21.15.5:0/3376013181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d1f60 msgr2=0x7f5d500d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.514+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3376013181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d1f60 0x7f5d500d3b20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f5d500d4820 tx=0x7f5d4002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.515+0000 7f5d566dd640 1 -- 172.21.15.5:0/3376013181 shutdown_connections 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.515+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3376013181 >> v2:172.21.15.80:3300/0 conn(0x7f5d500d4060 0x7f5d500b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.515+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3376013181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d1f60 0x7f5d500d3b20 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.515+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3376013181 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.515+0000 7f5d566dd640 1 -- 172.21.15.5:0/3376013181 >> 172.21.15.5:0/3376013181 conn(0x7f5d5006b000 msgr2=0x7f5d5006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.515+0000 7f5d566dd640 1 -- 172.21.15.5:0/3376013181 shutdown_connections 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.515+0000 7f5d566dd640 1 -- 172.21.15.5:0/3376013181 wait complete. 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.516+0000 7f5d566dd640 1 Processor -- start 2024-04-25T09:04:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.516+0000 7f5d566dd640 1 -- start start 2024-04-25T09:04:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d500d1f60 0x7f5d5015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d4060 0x7f5d500b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500d23a0 con 0x7f5d500d4060 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500d37e0 con 0x7f5d500d1f60 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500d2520 con 0x7f5d501614b0 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d4060 0x7f5d500b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d4060 0x7f5d500b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42720/0 (socket says 172.21.15.5:42720) 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3113203396 learned_addr learned my addr 172.21.15.5:0/3113203396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4ffff640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d500d1f60 0x7f5d5015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d54c7a640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 msgr2=0x7f5d500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d500d1f60 msgr2=0x7f5d5015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d500d1f60 0x7f5d5015bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 -- 172.21.15.5:0/3113203396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d500b4d10 con 0x7f5d500d4060 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d54c7a640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4ffff640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d500d1f60 0x7f5d5015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4f7fe640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d4060 0x7f5d500b3c80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5d40000c00 tx=0x7f5d400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4cff9640 1 -- 172.21.15.5:0/3113203396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40041070 con 0x7f5d500d4060 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4cff9640 1 -- 172.21.15.5:0/3113203396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4003c870 con 0x7f5d500d4060 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d500b4ff0 con 0x7f5d500d4060 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d4cff9640 1 -- 172.21.15.5:0/3113203396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40037040 con 0x7f5d500d4060 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.517+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d500b52d0 con 0x7f5d500d4060 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.518+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5004ef20 con 0x7f5d500d4060 2024-04-25T09:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.519+0000 7f5d4cff9640 1 -- 172.21.15.5:0/3113203396 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d40044070 con 0x7f5d500d4060 2024-04-25T09:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.519+0000 7f5d4cff9640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d3c06b4d0 0x7f5d3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.520+0000 7f5d4cff9640 1 -- 172.21.15.5:0/3113203396 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d400aadc0 con 0x7f5d500d4060 2024-04-25T09:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.520+0000 7f5d4ffff640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d3c06b4d0 0x7f5d3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.520+0000 7f5d4ffff640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d3c06b4d0 0x7f5d3c06d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5d5015c7b0 tx=0x7f5d44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.524+0000 7f5d4cff9640 1 -- 172.21.15.5:0/3113203396 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d40079cd0 con 0x7f5d500d4060 2024-04-25T09:04:06.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.705+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d500d0c40 con 0x7f5d500d4060 2024-04-25T09:04:06.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.705+0000 7f5d4cff9640 1 -- 172.21.15.5:0/3113203396 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d400795d0 con 0x7f5d500d4060 2024-04-25T09:04:06.694 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:04:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d3c06b4d0 msgr2=0x7f5d3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d3c06b4d0 0x7f5d3c06d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5d5015c7b0 tx=0x7f5d44008040 comp rx=0 tx=0).stop 2024-04-25T09:04:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d4060 msgr2=0x7f5d500b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d4060 0x7f5d500b3c80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5d40000c00 tx=0x7f5d400046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 shutdown_connections 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5d3c06b4d0 0x7f5d3c06d990 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d501614b0 0x7f5d500c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d500d4060 0x7f5d500b3c80 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 --2- 172.21.15.5:0/3113203396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d500d1f60 0x7f5d5015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 >> 172.21.15.5:0/3113203396 conn(0x7f5d5006b000 msgr2=0x7f5d500ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 shutdown_connections 2024-04-25T09:04:06.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.707+0000 7f5d566dd640 1 -- 172.21.15.5:0/3113203396 wait complete. 2024-04-25T09:04:06.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.820+0000 7f1e722fc640 1 Processor -- start 2024-04-25T09:04:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.820+0000 7f1e722fc640 1 -- start start 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.820+0000 7f1e722fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e6c15ef00 0x7f1e6c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.820+0000 7f1e722fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e6c066e30 0x7f1e6c161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.820+0000 7f1e722fc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c067240 con 0x7f1e6c1581e0 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.820+0000 7f1e722fc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0ae5e0 con 0x7f1e6c15ef00 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.820+0000 7f1e722fc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0ae300 con 0x7f1e6c066e30 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e6b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e6c15ef00 0x7f1e6c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e6b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e6c15ef00 0x7f1e6c0668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42736/0 (socket says 172.21.15.5:42736) 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/4195200373 learned_addr learned my addr 172.21.15.5:0/4195200373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e70899640 1 --2- 172.21.15.5:0/4195200373 >> v2:172.21.15.80:3300/0 conn(0x7f1e6c066e30 0x7f1e6c161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/4195200373 >> v2:172.21.15.80:3300/0 conn(0x7f1e6c066e30 msgr2=0x7f1e6c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e6b7fe640 1 --2- 172.21.15.5:0/4195200373 >> v2:172.21.15.80:3300/0 conn(0x7f1e6c066e30 0x7f1e6c161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/4195200373 >> v1:172.21.15.80:6789/0 conn(0x7f1e6c1581e0 legacy=0x7f1e6c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.821+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/4195200373 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c15e420 con 0x7f1e6c15ef00 2024-04-25T09:04:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e6b7fe640 1 --2- 172.21.15.5:0/4195200373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c15ef00 0x7f1e6c0668f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0af2e0 tx=0x7f1e6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769c0fb3a527264b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e6affd640 1 -- 172.21.15.5:0/4195200373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60037070 con 0x7f1e6c15ef00 2024-04-25T09:04:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e6affd640 1 -- 172.21.15.5:0/4195200373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e60032440 con 0x7f1e6c15ef00 2024-04-25T09:04:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e6affd640 1 -- 172.21.15.5:0/4195200373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60032810 con 0x7f1e6c15ef00 2024-04-25T09:04:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 -- 172.21.15.5:0/4195200373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c15ef00 msgr2=0x7f1e6c0668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 --2- 172.21.15.5:0/4195200373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c15ef00 0x7f1e6c0668f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0af2e0 tx=0x7f1e6002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 -- 172.21.15.5:0/4195200373 shutdown_connections 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 --2- 172.21.15.5:0/4195200373 >> v2:172.21.15.80:3300/0 conn(0x7f1e6c066e30 0x7f1e6c161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 --2- 172.21.15.5:0/4195200373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c15ef00 0x7f1e6c0668f0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 -- 172.21.15.5:0/4195200373 >> 172.21.15.5:0/4195200373 conn(0x7f1e6c0d0870 msgr2=0x7f1e6c0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 -- 172.21.15.5:0/4195200373 shutdown_connections 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.822+0000 7f1e722fc640 1 -- 172.21.15.5:0/4195200373 wait complete. 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 Processor -- start 2024-04-25T09:04:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 -- start start 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e6c066e30 0x7f1e6c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c1581e0 0x7f1e6c161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e6c15ef00 0x7f1e6c161b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1585c0 con 0x7f1e6c1581e0 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15e9e0 con 0x7f1e6c066e30 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.824+0000 7f1e722fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0afd50 con 0x7f1e6c15ef00 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c1581e0 0x7f1e6c161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c1581e0 0x7f1e6c161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42742/0 (socket says 172.21.15.5:42742) 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/2628844947 learned_addr learned my addr 172.21.15.5:0/2628844947 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6bfff640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e6c066e30 0x7f1e6c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e70899640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e6c15ef00 0x7f1e6c161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e6c15ef00 msgr2=0x7f1e6c161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e6c15ef00 0x7f1e6c161b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e6c066e30 msgr2=0x7f1e6c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e6c066e30 0x7f1e6c1563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 -- 172.21.15.5:0/2628844947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0ce320 con 0x7f1e6c1581e0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e6b7fe640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c1581e0 0x7f1e6c161630 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f1e60000c00 tx=0x7f1e600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e68ff9640 1 -- 172.21.15.5:0/2628844947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60041020 con 0x7f1e6c1581e0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e68ff9640 1 -- 172.21.15.5:0/2628844947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e600306c0 con 0x7f1e6c1581e0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c0ce600 con 0x7f1e6c1581e0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e68ff9640 1 -- 172.21.15.5:0/2628844947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60037040 con 0x7f1e6c1581e0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.825+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c0cebc0 con 0x7f1e6c1581e0 2024-04-25T09:04:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.826+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c04ef20 con 0x7f1e6c1581e0 2024-04-25T09:04:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.827+0000 7f1e68ff9640 1 -- 172.21.15.5:0/2628844947 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e60044020 con 0x7f1e6c1581e0 2024-04-25T09:04:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.827+0000 7f1e68ff9640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5806b4d0 0x7f1e5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.827+0000 7f1e68ff9640 1 -- 172.21.15.5:0/2628844947 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e600aaab0 con 0x7f1e6c1581e0 2024-04-25T09:04:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.827+0000 7f1e6bfff640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5806b4d0 0x7f1e5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.828+0000 7f1e6bfff640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5806b4d0 0x7f1e5806d990 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c007fd0 tx=0x7f1e5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:06.831+0000 7f1e68ff9640 1 -- 172.21.15.5:0/2628844947 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e6004b030 con 0x7f1e6c1581e0 2024-04-25T09:04:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.049+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e6c0d16a0 con 0x7f1e6c1581e0 2024-04-25T09:04:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.050+0000 7f1e68ff9640 1 -- 172.21.15.5:0/2628844947 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f1e60079890 con 0x7f1e6c1581e0 2024-04-25T09:04:07.039 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:07.039 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:04:07.039 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5806b4d0 msgr2=0x7f1e5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5806b4d0 0x7f1e5806d990 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c007fd0 tx=0x7f1e5c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c1581e0 msgr2=0x7f1e6c161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c1581e0 0x7f1e6c161630 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f1e60000c00 tx=0x7f1e600046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 shutdown_connections 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5806b4d0 0x7f1e5806d990 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e6c15ef00 0x7f1e6c161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e6c1581e0 0x7f1e6c161630 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 --2- 172.21.15.5:0/2628844947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e6c066e30 0x7f1e6c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 >> 172.21.15.5:0/2628844947 conn(0x7f1e6c0d0870 msgr2=0x7f1e6c1e9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 shutdown_connections 2024-04-25T09:04:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.052+0000 7f1e722fc640 1 -- 172.21.15.5:0/2628844947 wait complete. 2024-04-25T09:04:07.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.166+0000 7f3c2cd30640 1 Processor -- start 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.166+0000 7f3c2cd30640 1 -- start start 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c2cd30640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c2815de70 0x7f3c280b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c2cd30640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 0x7f3c280cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c2cd30640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c280cf1c0 con 0x7f3c280b2cc0 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c2cd30640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c280d2a10 con 0x7f3c2815de70 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c2cd30640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280d20e0 con 0x7f3c280ce7f0 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c1dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c280b2cc0 0x7f3c280b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60482/0 (socket says 172.21.15.5:60482) 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/240494364 learned_addr learned my addr 172.21.15.5:0/240494364 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c26d9d640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 0x7f3c280cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c2659c640 1 --2- 172.21.15.5:0/240494364 >> v2:172.21.15.80:3300/0 conn(0x7f3c2815de70 0x7f3c280b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522999070 0 0) 0x7f3c280cf1c0 con 0x7f3c280b2cc0 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c14003520 con 0x7f3c280b2cc0 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2657281631 0 0) 0x7f3c14003520 con 0x7f3c280b2cc0 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 msgr2=0x7f3c280cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 0x7f3c280cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 >> v2:172.21.15.80:3300/0 conn(0x7f3c2815de70 msgr2=0x7f3c280b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 --2- 172.21.15.5:0/240494364 >> v2:172.21.15.80:3300/0 conn(0x7f3c2815de70 0x7f3c280b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280d23c0 con 0x7f3c280b2cc0 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.167+0000 7f3c2659c640 1 --2- 172.21.15.5:0/240494364 >> v2:172.21.15.80:3300/0 conn(0x7f3c2815de70 0x7f3c280b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f3c10001670 con 0x7f3c280b2cc0 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 >> v1:172.21.15.5:6789/0 conn(0x7f3c280b2cc0 legacy=0x7f3c280b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 0x7f3c140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c14003f30 0x7f3c14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c14004d40 0x7f3c140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280d2a10 con 0x7f3c14003f30 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280d20e0 con 0x7f3c14004d40 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1400b9c0 con 0x7f3c280ce7f0 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c1dd9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c14003f30 0x7f3c14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c2659c640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 0x7f3c140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c26d9d640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c14004d40 0x7f3c140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 msgr2=0x7f3c140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c1dd9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280ce7f0 0x7f3c140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c14004d40 msgr2=0x7f3c140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c1dd9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c14004d40 0x7f3c140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/240494364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c14003520 con 0x7f3c14003f30 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.168+0000 7f3c26d9d640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c14004d40 0x7f3c140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.169+0000 7f3c1dd9b640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c14003f30 0x7f3c14004800 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c260 tx=0x7f3c14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e8024b043dc43f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.169+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10007ce0 con 0x7f3c14003f30 2024-04-25T09:04:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.169+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10005af0 con 0x7f3c14003f30 2024-04-25T09:04:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.169+0000 7f3c25d9b640 1 -- 172.21.15.5:0/240494364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10007070 con 0x7f3c14003f30 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.170+0000 7f3c2cd30640 1 -- 172.21.15.5:0/240494364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c14003f30 msgr2=0x7f3c14004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.170+0000 7f3c2cd30640 1 --2- 172.21.15.5:0/240494364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c14003f30 0x7f3c14004800 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c260 tx=0x7f3c14005830 comp rx=0 tx=0).stop 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.170+0000 7f3c26d9d640 1 -- 172.21.15.5:0/240494364 reap_dead start 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.170+0000 7f3c2cd30640 1 -- 172.21.15.5:0/240494364 shutdown_connections 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.170+0000 7f3c2cd30640 1 -- 172.21.15.5:0/240494364 >> 172.21.15.5:0/240494364 conn(0x7f3c2806b000 msgr2=0x7f3c2806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.170+0000 7f3c2cd30640 1 -- 172.21.15.5:0/240494364 shutdown_connections 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.170+0000 7f3c2cd30640 1 -- 172.21.15.5:0/240494364 wait complete. 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.171+0000 7f3c2cd30640 1 Processor -- start 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.171+0000 7f3c2cd30640 1 -- start start 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c2cd30640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c14003f30 0x7f3c280c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c2cd30640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c280c9420 0x7f3c281f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c2cd30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c281f76a0 0x7f3c28152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c2cd30640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280b7300 con 0x7f3c280c9420 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c2cd30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280b9920 con 0x7f3c281f76a0 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c2cd30640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280cec80 con 0x7f3c14003f30 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c1dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c280c9420 0x7f3c281f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c1dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c280c9420 0x7f3c281f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42768/0 (socket says 172.21.15.5:42768) 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/181786764 learned_addr learned my addr 172.21.15.5:0/181786764 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c26d9d640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c281f76a0 0x7f3c28152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.172+0000 7f3c2659c640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c14003f30 0x7f3c280c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c14003f30 msgr2=0x7f3c280c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1dd9b640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c14003f30 0x7f3c280c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c281f76a0 msgr2=0x7f3c28152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1dd9b640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c281f76a0 0x7f3c28152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1dd9b640 1 -- 172.21.15.5:0/181786764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280c9a50 con 0x7f3c280c9420 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1dd9b640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c280c9420 0x7f3c281f7160 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c380 tx=0x7f3c280d1970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1f7fe640 1 -- 172.21.15.5:0/181786764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10038040 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1f7fe640 1 -- 172.21.15.5:0/181786764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10042070 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c280c9d30 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c1f7fe640 1 -- 172.21.15.5:0/181786764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100047e0 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.173+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c280cad50 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.174+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2806b910 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.175+0000 7f3c1f7fe640 1 -- 172.21.15.5:0/181786764 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c10004980 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.175+0000 7f3c1f7fe640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c0806b4d0 0x7f3c0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.175+0000 7f3c1f7fe640 1 -- 172.21.15.5:0/181786764 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c100a9d60 con 0x7f3c280c9420 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.175+0000 7f3c2659c640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c0806b4d0 0x7f3c0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.176+0000 7f3c2659c640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c0806b4d0 0x7f3c0806d990 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3c280cdea0 tx=0x7f3c18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.179+0000 7f3c1f7fe640 1 -- 172.21.15.5:0/181786764 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c2806b910 con 0x7f3c280c9420 2024-04-25T09:04:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.358+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c2815d270 con 0x7f3c280c9420 2024-04-25T09:04:07.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.359+0000 7f3c1f7fe640 1 -- 172.21.15.5:0/181786764 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16524 (secure 0 0 0) 0x7f3c10078590 con 0x7f3c280c9420 2024-04-25T09:04:07.348 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:07.348 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:33.997354+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.627226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:31.329753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c0806b4d0 msgr2=0x7f3c0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c0806b4d0 0x7f3c0806d990 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3c280cdea0 tx=0x7f3c18008040 comp rx=0 tx=0).stop 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c280c9420 msgr2=0x7f3c281f7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c280c9420 0x7f3c281f7160 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c380 tx=0x7f3c280d1970 comp rx=0 tx=0).stop 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 shutdown_connections 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3c0806b4d0 0x7f3c0806d990 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c281f76a0 0x7f3c28152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c280c9420 0x7f3c281f7160 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 --2- 172.21.15.5:0/181786764 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c14003f30 0x7f3c280c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 >> 172.21.15.5:0/181786764 conn(0x7f3c2806b000 msgr2=0x7f3c280d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 shutdown_connections 2024-04-25T09:04:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.361+0000 7f3c2cd30640 1 -- 172.21.15.5:0/181786764 wait complete. 2024-04-25T09:04:07.361 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:04:07.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.473+0000 7fda93607640 1 Processor -- start 2024-04-25T09:04:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.474+0000 7fda93607640 1 -- start start 2024-04-25T09:04:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.474+0000 7fda93607640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda8c0d3990 0x7fda8c0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.474+0000 7fda93607640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c0b6f50 0x7fda8c0b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.474+0000 7fda93607640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c0b29c0 con 0x7fda8c15e0a0 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.474+0000 7fda93607640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c0d4330 con 0x7fda8c0d3990 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.474+0000 7fda93607640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0d1460 con 0x7fda8c0b6f50 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.474+0000 7fda90ba2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda8c0d3990 0x7fda8c0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda913a3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda8c15e0a0 0x7fda8c0d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60486/0 (socket says 172.21.15.5:60486) 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda913a3640 1 -- 172.21.15.5:0/1814971819 learned_addr learned my addr 172.21.15.5:0/1814971819 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda91ba4640 1 --2- 172.21.15.5:0/1814971819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c0b6f50 0x7fda8c0b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda90ba2640 1 -- 172.21.15.5:0/1814971819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c0b6f50 msgr2=0x7fda8c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda90ba2640 1 --2- 172.21.15.5:0/1814971819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c0b6f50 0x7fda8c0b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda90ba2640 1 -- 172.21.15.5:0/1814971819 >> v1:172.21.15.5:6789/0 conn(0x7fda8c15e0a0 legacy=0x7fda8c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda90ba2640 1 -- 172.21.15.5:0/1814971819 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0d2080 con 0x7fda8c0d3990 2024-04-25T09:04:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.475+0000 7fda83fff640 1 -- 172.21.15.5:0/1814971819 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799241114 0 0) 0x7fda8c0b29c0 con 0x7fda8c15e0a0 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda90ba2640 1 --2- 172.21.15.5:0/1814971819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0d3990 0x7fda8c0d3df0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0097a0 tx=0x7fda7c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c87bdd4d568ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda83fff640 1 -- 172.21.15.5:0/1814971819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c037070 con 0x7fda8c0d3990 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda83fff640 1 -- 172.21.15.5:0/1814971819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c032440 con 0x7fda8c0d3990 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda83fff640 1 -- 172.21.15.5:0/1814971819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c032810 con 0x7fda8c0d3990 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 -- 172.21.15.5:0/1814971819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0d3990 msgr2=0x7fda8c0d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 --2- 172.21.15.5:0/1814971819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0d3990 0x7fda8c0d3df0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0097a0 tx=0x7fda7c02a180 comp rx=0 tx=0).stop 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 -- 172.21.15.5:0/1814971819 shutdown_connections 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 --2- 172.21.15.5:0/1814971819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c0b6f50 0x7fda8c0b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 --2- 172.21.15.5:0/1814971819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0d3990 0x7fda8c0d3df0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 -- 172.21.15.5:0/1814971819 >> 172.21.15.5:0/1814971819 conn(0x7fda8c0668f0 msgr2=0x7fda8c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 -- 172.21.15.5:0/1814971819 shutdown_connections 2024-04-25T09:04:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.476+0000 7fda93607640 1 -- 172.21.15.5:0/1814971819 wait complete. 2024-04-25T09:04:07.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.477+0000 7fda93607640 1 Processor -- start 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda93607640 1 -- start start 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda93607640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0b6f50 0x7fda8c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda93607640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda8c0d3990 0x7fda8c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda93607640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c15e0a0 0x7fda8c15e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda93607640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0d2920 con 0x7fda8c0b6f50 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda93607640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0d2640 con 0x7fda8c0d3990 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda93607640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0d2c00 con 0x7fda8c15e0a0 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda913a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0b6f50 0x7fda8c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda913a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0b6f50 0x7fda8c156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42792/0 (socket says 172.21.15.5:42792) 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.478+0000 7fda913a3640 1 -- 172.21.15.5:0/3348334783 learned_addr learned my addr 172.21.15.5:0/3348334783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda90ba2640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda8c0d3990 0x7fda8c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda91ba4640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c15e0a0 0x7fda8c15e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda913a3640 1 -- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c15e0a0 msgr2=0x7fda8c15e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda913a3640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c15e0a0 0x7fda8c15e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda913a3640 1 -- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda8c0d3990 msgr2=0x7fda8c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda913a3640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda8c0d3990 0x7fda8c15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda913a3640 1 -- 172.21.15.5:0/3348334783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c158940 con 0x7fda8c0b6f50 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda913a3640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0b6f50 0x7fda8c156d00 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c500 tx=0x7fda8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda81ffb640 1 -- 172.21.15.5:0/3348334783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88018070 con 0x7fda8c0b6f50 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda81ffb640 1 -- 172.21.15.5:0/3348334783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda88007580 con 0x7fda8c0b6f50 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c158c20 con 0x7fda8c0b6f50 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda81ffb640 1 -- 172.21.15.5:0/3348334783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88004a20 con 0x7fda8c0b6f50 2024-04-25T09:04:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.479+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c1591e0 con 0x7fda8c0b6f50 2024-04-25T09:04:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.480+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c04ef20 con 0x7fda8c0b6f50 2024-04-25T09:04:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.480+0000 7fda81ffb640 1 -- 172.21.15.5:0/3348334783 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda8801b070 con 0x7fda8c0b6f50 2024-04-25T09:04:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.481+0000 7fda81ffb640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda7006b4d0 0x7fda7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.481+0000 7fda81ffb640 1 -- 172.21.15.5:0/3348334783 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda880894a0 con 0x7fda8c0b6f50 2024-04-25T09:04:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.481+0000 7fda90ba2640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda7006b4d0 0x7fda7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.482+0000 7fda90ba2640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda7006b4d0 0x7fda7006d990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fda7c034000 tx=0x7fda7c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.485+0000 7fda81ffb640 1 -- 172.21.15.5:0/3348334783 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda880583b0 con 0x7fda8c0b6f50 2024-04-25T09:04:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.701+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda8c0d0f60 con 0x7fda8c0b6f50 2024-04-25T09:04:07.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.701+0000 7fda81ffb640 1 -- 172.21.15.5:0/3348334783 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fda88057cb0 con 0x7fda8c0b6f50 2024-04-25T09:04:07.690 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:07.690 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:04:07.690 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda7006b4d0 msgr2=0x7fda7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda7006b4d0 0x7fda7006d990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fda7c034000 tx=0x7fda7c02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0b6f50 msgr2=0x7fda8c156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0b6f50 0x7fda8c156d00 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c500 tx=0x7fda8800c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 shutdown_connections 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda7006b4d0 0x7fda7006d990 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fda8c15e0a0 0x7fda8c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda8c0d3990 0x7fda8c15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 --2- 172.21.15.5:0/3348334783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda8c0b6f50 0x7fda8c156d00 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.703+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 >> 172.21.15.5:0/3348334783 conn(0x7fda8c0668f0 msgr2=0x7fda8c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.704+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 shutdown_connections 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.704+0000 7fda93607640 1 -- 172.21.15.5:0/3348334783 wait complete. 2024-04-25T09:04:07.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.816+0000 7f7f71df4640 1 Processor -- start 2024-04-25T09:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.816+0000 7f7f71df4640 1 -- start start 2024-04-25T09:04:07.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.816+0000 7f7f71df4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.816+0000 7f7f71df4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f6c0b6f50 0x7f7f6c0b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.816+0000 7f7f71df4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c0b29c0 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.816+0000 7f7f71df4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0d4330 con 0x7f7f6c0b6f50 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.816+0000 7f7f71df4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0d1460 con 0x7f7f6c0d3990 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f6c0b6f50 0x7f7f6c0b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f6c0b6f50 0x7f7f6c0b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42798/0 (socket says 172.21.15.5:42798) 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6bfff640 1 -- 172.21.15.5:0/2036050570 learned_addr learned my addr 172.21.15.5:0/2036050570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6bfff640 1 -- 172.21.15.5:0/2036050570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 msgr2=0x7f7f6c0d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6affd640 1 --2- 172.21.15.5:0/2036050570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/2036050570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c0d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6bfff640 1 -- 172.21.15.5:0/2036050570 >> v1:172.21.15.80:6789/0 conn(0x7f7f6c15e0a0 legacy=0x7f7f6c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.817+0000 7f7f6bfff640 1 -- 172.21.15.5:0/2036050570 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0d2080 con 0x7f7f6c0b6f50 2024-04-25T09:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/2036050570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0b73e0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e50 tx=0x7f7f6402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952400ba88ca09ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f6a7fc640 1 -- 172.21.15.5:0/2036050570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64036070 con 0x7f7f6c0b6f50 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f6a7fc640 1 -- 172.21.15.5:0/2036050570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64031600 con 0x7f7f6c0b6f50 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f6a7fc640 1 -- 172.21.15.5:0/2036050570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640319d0 con 0x7f7f6c0b6f50 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 -- 172.21.15.5:0/2036050570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c0b6f50 msgr2=0x7f7f6c0b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 --2- 172.21.15.5:0/2036050570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0b73e0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e50 tx=0x7f7f6402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 -- 172.21.15.5:0/2036050570 shutdown_connections 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 --2- 172.21.15.5:0/2036050570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0b73e0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 --2- 172.21.15.5:0/2036050570 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c0d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 -- 172.21.15.5:0/2036050570 >> 172.21.15.5:0/2036050570 conn(0x7f7f6c0668f0 msgr2=0x7f7f6c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 -- 172.21.15.5:0/2036050570 shutdown_connections 2024-04-25T09:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.818+0000 7f7f71df4640 1 -- 172.21.15.5:0/2036050570 wait complete. 2024-04-25T09:04:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.819+0000 7f7f71df4640 1 Processor -- start 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f71df4640 1 -- start start 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f71df4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f71df4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c1e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f71df4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c15e0a0 0x7f7f6c1e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f71df4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0d2920 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f71df4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0d2640 con 0x7f7f6c0b6f50 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f71df4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0d2c00 con 0x7f7f6c0d3990 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c15e0a0 0x7f7f6c1e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c15e0a0 0x7f7f6c1e7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42806/0 (socket says 172.21.15.5:42806) 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.820+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3566957023 learned_addr learned my addr 172.21.15.5:0/3566957023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6b7fe640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6affd640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c1e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 msgr2=0x7f7f6c1e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c1e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f6c0b6f50 msgr2=0x7f7f6c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3566957023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c1609d0 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6affd640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c1e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6b7fe640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c15e0a0 0x7f7f6c1e7010 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e50 tx=0x7f7f64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f53fff640 1 -- 172.21.15.5:0/3566957023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64036050 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f53fff640 1 -- 172.21.15.5:0/3566957023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64042070 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c160cb0 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f53fff640 1 -- 172.21.15.5:0/3566957023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64009510 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.821+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c161270 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.822+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c068550 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.823+0000 7f7f53fff640 1 -- 172.21.15.5:0/3566957023 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7f64007bd0 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.823+0000 7f7f53fff640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7f5806b4d0 0x7f7f5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.823+0000 7f7f53fff640 1 -- 172.21.15.5:0/3566957023 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f640ab170 con 0x7f7f6c15e0a0 2024-04-25T09:04:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.823+0000 7f7f6b7fe640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7f5806b4d0 0x7f7f5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.824+0000 7f7f6b7fe640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7f5806b4d0 0x7f7f5806d990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c006fd0 tx=0x7f7f5c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:07.827+0000 7f7f53fff640 1 -- 172.21.15.5:0/3566957023 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f6c068550 con 0x7f7f6c15e0a0 2024-04-25T09:04:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.045+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f6c04ef20 con 0x7f7f6c15e0a0 2024-04-25T09:04:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.045+0000 7f7f53fff640 1 -- 172.21.15.5:0/3566957023 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f7f640799a0 con 0x7f7f6c15e0a0 2024-04-25T09:04:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:08.035 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:32.347912+0000","modified":"2024-04-25T09:03:35.359491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/1087126648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1087126648},{"type":"v1","addr":"172.21.15.80:6837","nonce":1087126648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:04:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7f5806b4d0 msgr2=0x7f7f5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7f5806b4d0 0x7f7f5806d990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c006fd0 tx=0x7f7f5c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c15e0a0 msgr2=0x7f7f6c1e7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c15e0a0 0x7f7f6c1e7010 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e50 tx=0x7f7f64004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 shutdown_connections 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7f5806b4d0 0x7f7f5806d990 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6c15e0a0 0x7f7f6c1e7010 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7f6c0d3990 0x7f7f6c1e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 --2- 172.21.15.5:0/3566957023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f6c0b6f50 0x7f7f6c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 >> 172.21.15.5:0/3566957023 conn(0x7f7f6c0668f0 msgr2=0x7f7f6c066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 shutdown_connections 2024-04-25T09:04:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.048+0000 7f7f71df4640 1 -- 172.21.15.5:0/3566957023 wait complete. 2024-04-25T09:04:08.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.160+0000 7f0781ebc640 1 Processor -- start 2024-04-25T09:04:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.160+0000 7f0781ebc640 1 -- start start 2024-04-25T09:04:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f0781ebc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f077c0d05f0 0x7f077c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f0781ebc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0d0f10 con 0x7f077c0b9990 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f0781ebc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0d23c0 con 0x7f077c0d3710 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f0781ebc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0d2670 con 0x7f077c0d05f0 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f077b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f077c0d05f0 0x7f077c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f077affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f077c0b9990 0x7f077c0d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60488/0 (socket says 172.21.15.5:60488) 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f077affd640 1 -- 172.21.15.5:0/3781323628 learned_addr learned my addr 172.21.15.5:0/3781323628 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.161+0000 7f077b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f077c0d05f0 0x7f077c0d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42822/0 (socket says 172.21.15.5:42822) 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.162+0000 7f077b7fe640 1 -- 172.21.15.5:0/3781323628 >> v1:172.21.15.80:6789/0 conn(0x7f077c0d3710 legacy=0x7f077c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.162+0000 7f077b7fe640 1 -- 172.21.15.5:0/3781323628 >> v1:172.21.15.5:6789/0 conn(0x7f077c0b9990 legacy=0x7f077c0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.162+0000 7f077b7fe640 1 -- 172.21.15.5:0/3781323628 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0d2950 con 0x7f077c0d05f0 2024-04-25T09:04:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.162+0000 7f077b7fe640 1 --2- 172.21.15.5:0/3781323628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d05f0 0x7f077c0d09d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bbae22d05caa8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.162+0000 7f077a7fc640 1 -- 172.21.15.5:0/3781323628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c037070 con 0x7f077c0d05f0 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.162+0000 7f077a7fc640 1 -- 172.21.15.5:0/3781323628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c032440 con 0x7f077c0d05f0 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.162+0000 7f077a7fc640 1 -- 172.21.15.5:0/3781323628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c032810 con 0x7f077c0d05f0 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.163+0000 7f0781ebc640 1 -- 172.21.15.5:0/3781323628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d05f0 msgr2=0x7f077c0d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.163+0000 7f0781ebc640 1 --2- 172.21.15.5:0/3781323628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d05f0 0x7f077c0d09d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097a0 tx=0x7f076c02a270 comp rx=0 tx=0).stop 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.163+0000 7f0781ebc640 1 -- 172.21.15.5:0/3781323628 shutdown_connections 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.163+0000 7f0781ebc640 1 --2- 172.21.15.5:0/3781323628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d05f0 0x7f077c0d09d0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.163+0000 7f0781ebc640 1 -- 172.21.15.5:0/3781323628 >> 172.21.15.5:0/3781323628 conn(0x7f077c06b000 msgr2=0x7f077c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.163+0000 7f0781ebc640 1 -- 172.21.15.5:0/3781323628 shutdown_connections 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.163+0000 7f0781ebc640 1 -- 172.21.15.5:0/3781323628 wait complete. 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.164+0000 7f0781ebc640 1 Processor -- start 2024-04-25T09:04:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.164+0000 7f0781ebc640 1 -- start start 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f0781ebc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f077c0d05f0 0x7f077c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f0781ebc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d3710 0x7f077c160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f0781ebc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f077c0ccfd0 0x7f077c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f0781ebc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c15e090 con 0x7f077c0d3710 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f0781ebc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0d2f10 con 0x7f077c0ccfd0 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f0781ebc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c15e210 con 0x7f077c0d05f0 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f077affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d3710 0x7f077c160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f077affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d3710 0x7f077c160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42834/0 (socket says 172.21.15.5:42834) 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f077affd640 1 -- 172.21.15.5:0/2606592870 learned_addr learned my addr 172.21.15.5:0/2606592870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f077b7fe640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f077c0d05f0 0x7f077c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f077bfff640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f077c0ccfd0 0x7f077c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.165+0000 7f077affd640 1 -- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f077c0d05f0 msgr2=0x7f077c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f077affd640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f077c0d05f0 0x7f077c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f077affd640 1 -- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f077c0ccfd0 msgr2=0x7f077c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f077affd640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f077c0ccfd0 0x7f077c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f077affd640 1 -- 172.21.15.5:0/2606592870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0cacc0 con 0x7f077c0d3710 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f077b7fe640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f077c0d05f0 0x7f077c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f077affd640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d3710 0x7f077c160d00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f077000c400 tx=0x7f077000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f0763fff640 1 -- 172.21.15.5:0/2606592870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770017070 con 0x7f077c0d3710 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f0763fff640 1 -- 172.21.15.5:0/2606592870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0770005ce0 con 0x7f077c0d3710 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c161240 con 0x7f077c0d3710 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f0763fff640 1 -- 172.21.15.5:0/2606592870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07700072f0 con 0x7f077c0d3710 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.166+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c15f940 con 0x7f077c0d3710 2024-04-25T09:04:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.167+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c04ef20 con 0x7f077c0d3710 2024-04-25T09:04:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.168+0000 7f0763fff640 1 -- 172.21.15.5:0/2606592870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f077001a070 con 0x7f077c0d3710 2024-04-25T09:04:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.168+0000 7f0763fff640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f076806b4d0 0x7f076806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.168+0000 7f0763fff640 1 -- 172.21.15.5:0/2606592870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0770089610 con 0x7f077c0d3710 2024-04-25T09:04:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.168+0000 7f077b7fe640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f076806b4d0 0x7f076806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.169+0000 7f077b7fe640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f076806b4d0 0x7f076806d990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f076c034000 tx=0x7f076c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.172+0000 7f0763fff640 1 -- 172.21.15.5:0/2606592870 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0770058490 con 0x7f077c0d3710 2024-04-25T09:04:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.353+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f077c0b3320 con 0x7f077c0d3710 2024-04-25T09:04:08.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.354+0000 7f0763fff640 1 -- 172.21.15.5:0/2606592870 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16524 (secure 0 0 0) 0x7f0770057d90 con 0x7f077c0d3710 2024-04-25T09:04:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:08.343 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:03:33.997354+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.627226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:31.329753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f076806b4d0 msgr2=0x7f076806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f076806b4d0 0x7f076806d990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f076c034000 tx=0x7f076c02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d3710 msgr2=0x7f077c160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d3710 0x7f077c160d00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f077000c400 tx=0x7f077000c8c0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 shutdown_connections 2024-04-25T09:04:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f076806b4d0 0x7f076806d990 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f077c0ccfd0 0x7f077c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f077c0d3710 0x7f077c160d00 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 --2- 172.21.15.5:0/2606592870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f077c0d05f0 0x7f077c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 >> 172.21.15.5:0/2606592870 conn(0x7f077c06b000 msgr2=0x7f077c0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 shutdown_connections 2024-04-25T09:04:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.356+0000 7f0781ebc640 1 -- 172.21.15.5:0/2606592870 wait complete. 2024-04-25T09:04:08.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.470+0000 7f0485207640 1 Processor -- start 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.470+0000 7f0485207640 1 -- start start 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f0485207640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800cea80 0x7f048015f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f0485207640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f048015fd80 0x7f048006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f0485207640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f048006adf0 0x7f048006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f0485207640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04800cfd60 con 0x7f048006adf0 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f0485207640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048015f480 con 0x7f048015fd80 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f0485207640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048015ef10 con 0x7f04800cea80 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f048006adf0 0x7f048006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f048006adf0 0x7f048006bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42850/0 (socket says 172.21.15.5:42850) 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 -- 172.21.15.5:0/3002859712 learned_addr learned my addr 172.21.15.5:0/3002859712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047e59c640 1 --2- 172.21.15.5:0/3002859712 >> v2:172.21.15.80:3300/0 conn(0x7f048015fd80 0x7f048006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047ed9d640 1 --2- 172.21.15.5:0/3002859712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800cea80 0x7f048015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 -- 172.21.15.5:0/3002859712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800cea80 msgr2=0x7f048015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 --2- 172.21.15.5:0/3002859712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800cea80 0x7f048015f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 -- 172.21.15.5:0/3002859712 >> v2:172.21.15.80:3300/0 conn(0x7f048015fd80 msgr2=0x7f048006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 --2- 172.21.15.5:0/3002859712 >> v2:172.21.15.80:3300/0 conn(0x7f048015fd80 0x7f048006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047f59e640 1 -- 172.21.15.5:0/3002859712 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048015f1a0 con 0x7f048006adf0 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.471+0000 7f047ed9d640 1 --2- 172.21.15.5:0/3002859712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800cea80 0x7f048015f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.472+0000 7f047f59e640 1 --2- 172.21.15.5:0/3002859712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048006adf0 0x7f048006bb30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f048006df30 tx=0x7f047002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b7893f924c8627 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.472+0000 7f047dd9b640 1 -- 172.21.15.5:0/3002859712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470036070 con 0x7f048006adf0 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.472+0000 7f047dd9b640 1 -- 172.21.15.5:0/3002859712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470031600 con 0x7f048006adf0 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.472+0000 7f047dd9b640 1 -- 172.21.15.5:0/3002859712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04700319d0 con 0x7f048006adf0 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 -- 172.21.15.5:0/3002859712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048006adf0 msgr2=0x7f048006bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 --2- 172.21.15.5:0/3002859712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048006adf0 0x7f048006bb30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f048006df30 tx=0x7f047002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 -- 172.21.15.5:0/3002859712 shutdown_connections 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 --2- 172.21.15.5:0/3002859712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048006adf0 0x7f048006bb30 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 --2- 172.21.15.5:0/3002859712 >> v2:172.21.15.80:3300/0 conn(0x7f048015fd80 0x7f048006b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 --2- 172.21.15.5:0/3002859712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800cea80 0x7f048015f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 -- 172.21.15.5:0/3002859712 >> 172.21.15.5:0/3002859712 conn(0x7f04800d19f0 msgr2=0x7f04800d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 -- 172.21.15.5:0/3002859712 shutdown_connections 2024-04-25T09:04:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.473+0000 7f0485207640 1 -- 172.21.15.5:0/3002859712 wait complete. 2024-04-25T09:04:08.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.474+0000 7f0485207640 1 Processor -- start 2024-04-25T09:04:08.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.474+0000 7f0485207640 1 -- start start 2024-04-25T09:04:08.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f0485207640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f048006adf0 0x7f0480152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f0485207640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04800cea80 0x7f04800c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f0485207640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800c6420 0x7f04801f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f0485207640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04800d1660 con 0x7f04800cea80 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f0485207640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04800d0270 con 0x7f048006adf0 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f0485207640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04800d17e0 con 0x7f04800c6420 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f047e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04800cea80 0x7f04800c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f047e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04800cea80 0x7f04800c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42854/0 (socket says 172.21.15.5:42854) 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.475+0000 7f047e59c640 1 -- 172.21.15.5:0/4038527991 learned_addr learned my addr 172.21.15.5:0/4038527991 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047ed9d640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f048006adf0 0x7f0480152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047f59e640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800c6420 0x7f04801f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047e59c640 1 -- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800c6420 msgr2=0x7f04801f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047e59c640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800c6420 0x7f04801f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047e59c640 1 -- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f048006adf0 msgr2=0x7f0480152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047e59c640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f048006adf0 0x7f0480152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047e59c640 1 -- 172.21.15.5:0/4038527991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800c5cd0 con 0x7f04800cea80 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047ed9d640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f048006adf0 0x7f0480152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047f59e640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800c6420 0x7f04801f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f047e59c640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04800cea80 0x7f04800c5ee0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f047400d800 tx=0x7f047400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f04677fe640 1 -- 172.21.15.5:0/4038527991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400b6c0 con 0x7f04800cea80 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f04677fe640 1 -- 172.21.15.5:0/4038527991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0474019070 con 0x7f04800cea80 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04800c7d80 con 0x7f04800cea80 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f04677fe640 1 -- 172.21.15.5:0/4038527991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400ba80 con 0x7f04800cea80 2024-04-25T09:04:08.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.476+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04800c8040 con 0x7f04800cea80 2024-04-25T09:04:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.477+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0480068610 con 0x7f04800cea80 2024-04-25T09:04:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.477+0000 7f04677fe640 1 -- 172.21.15.5:0/4038527991 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f047400bc20 con 0x7f04800cea80 2024-04-25T09:04:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.478+0000 7f04677fe640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f046c06b4d0 0x7f046c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.478+0000 7f04677fe640 1 -- 172.21.15.5:0/4038527991 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f047408a6b0 con 0x7f04800cea80 2024-04-25T09:04:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.478+0000 7f047ed9d640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f046c06b4d0 0x7f046c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.479+0000 7f047ed9d640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f046c06b4d0 0x7f046c06d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f04780088b0 tx=0x7f0478008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.482+0000 7f04677fe640 1 -- 172.21.15.5:0/4038527991 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0480068610 con 0x7f04800cea80 2024-04-25T09:04:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.699+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f048004ef20 con 0x7f04800cea80 2024-04-25T09:04:08.688 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:04:08.700+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:04:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.701+0000 7f04677fe640 1 -- 172.21.15.5:0/4038527991 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0474059530 con 0x7f04800cea80 2024-04-25T09:04:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.704+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f046c06b4d0 msgr2=0x7f046c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.704+0000 7f0485207640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f046c06b4d0 0x7f046c06d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f04780088b0 tx=0x7f0478008040 comp rx=0 tx=0).stop 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.704+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04800cea80 msgr2=0x7f04800c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.704+0000 7f0485207640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04800cea80 0x7f04800c5ee0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f047400d800 tx=0x7f047400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 shutdown_connections 2024-04-25T09:04:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f046c06b4d0 0x7f046c06d990 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f04800c6420 0x7f04801f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04800cea80 0x7f04800c5ee0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 --2- 172.21.15.5:0/4038527991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f048006adf0 0x7f0480152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 >> 172.21.15.5:0/4038527991 conn(0x7f04800d19f0 msgr2=0x7f048006e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 shutdown_connections 2024-04-25T09:04:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.705+0000 7f0485207640 1 -- 172.21.15.5:0/4038527991 wait complete. 2024-04-25T09:04:08.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:04:08.733 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:04:08.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.819+0000 7f576dfbe640 1 Processor -- start 2024-04-25T09:04:08.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.819+0000 7f576dfbe640 1 -- start start 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f576dfbe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57680ce6a0 0x7f57680cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f576dfbe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680cea80 0x7f576815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f576dfbe640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680cd990 con 0x7f57680d25d0 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f576dfbe640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680d0b80 con 0x7f57680ce6a0 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f576dfbe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680cffe0 con 0x7f57680cea80 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f57677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57680ce6a0 0x7f57680cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f57677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57680ce6a0 0x7f57680cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42858/0 (socket says 172.21.15.5:42858) 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.820+0000 7f57677fe640 1 -- 172.21.15.5:0/784508359 learned_addr learned my addr 172.21.15.5:0/784508359 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.821+0000 7f57677fe640 1 -- 172.21.15.5:0/784508359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680cea80 msgr2=0x7f576815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.821+0000 7f57677fe640 1 --2- 172.21.15.5:0/784508359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680cea80 0x7f576815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.821+0000 7f57677fe640 1 -- 172.21.15.5:0/784508359 >> v1:172.21.15.80:6789/0 conn(0x7f57680d25d0 legacy=0x7f57680d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.821+0000 7f57677fe640 1 -- 172.21.15.5:0/784508359 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680cf6b0 con 0x7f57680ce6a0 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.821+0000 7f57677fe640 1 --2- 172.21.15.5:0/784508359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680ce6a0 0x7f57680cd160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f5758009870 tx=0x7f575802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3893c1e6f6efff1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.821+0000 7f57667fc640 1 -- 172.21.15.5:0/784508359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758037070 con 0x7f57680ce6a0 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f57667fc640 1 -- 172.21.15.5:0/784508359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5758032440 con 0x7f57680ce6a0 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f57667fc640 1 -- 172.21.15.5:0/784508359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758032810 con 0x7f57680ce6a0 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 -- 172.21.15.5:0/784508359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680ce6a0 msgr2=0x7f57680cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 --2- 172.21.15.5:0/784508359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680ce6a0 0x7f57680cd160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f5758009870 tx=0x7f575802a180 comp rx=0 tx=0).stop 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 -- 172.21.15.5:0/784508359 shutdown_connections 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 --2- 172.21.15.5:0/784508359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680cea80 0x7f576815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 --2- 172.21.15.5:0/784508359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680ce6a0 0x7f57680cd160 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 -- 172.21.15.5:0/784508359 >> 172.21.15.5:0/784508359 conn(0x7f57680d1a40 msgr2=0x7f57680d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 -- 172.21.15.5:0/784508359 shutdown_connections 2024-04-25T09:04:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.822+0000 7f576dfbe640 1 -- 172.21.15.5:0/784508359 wait complete. 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.823+0000 7f576dfbe640 1 Processor -- start 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f576dfbe640 1 -- start start 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f576dfbe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680ce6a0 0x7f5768152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f576dfbe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680cea80 0x7f576815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f576dfbe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680d25d0 0x7f57680c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f576dfbe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680cd6a0 con 0x7f57680cea80 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f576dfbe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680cfc70 con 0x7f57680ce6a0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f576dfbe640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576815f380 con 0x7f57680d25d0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680cea80 0x7f576815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680cea80 0x7f576815b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42864/0 (socket says 172.21.15.5:42864) 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f5766ffd640 1 -- 172.21.15.5:0/3363912652 learned_addr learned my addr 172.21.15.5:0/3363912652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f57677fe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680ce6a0 0x7f5768152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.824+0000 7f5767fff640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680d25d0 0x7f57680c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f5766ffd640 1 -- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680d25d0 msgr2=0x7f57680c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f5766ffd640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680d25d0 0x7f57680c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f5766ffd640 1 -- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680ce6a0 msgr2=0x7f5768152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f5766ffd640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680ce6a0 0x7f5768152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f5766ffd640 1 -- 172.21.15.5:0/3363912652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680ca090 con 0x7f57680cea80 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f5766ffd640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680cea80 0x7f576815b2b0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f575c00b410 tx=0x7f575c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f574ffff640 1 -- 172.21.15.5:0/3363912652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c015020 con 0x7f57680cea80 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f574ffff640 1 -- 172.21.15.5:0/3363912652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c011830 con 0x7f57680cea80 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57680ca370 con 0x7f57680cea80 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f574ffff640 1 -- 172.21.15.5:0/3363912652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c011c20 con 0x7f57680cea80 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.825+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57680ca930 con 0x7f57680cea80 2024-04-25T09:04:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.826+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576804ef20 con 0x7f57680cea80 2024-04-25T09:04:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.827+0000 7f574ffff640 1 -- 172.21.15.5:0/3363912652 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f575c018020 con 0x7f57680cea80 2024-04-25T09:04:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.827+0000 7f574ffff640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f575406b4d0 0x7f575406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.827+0000 7f574ffff640 1 -- 172.21.15.5:0/3363912652 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f575c08a090 con 0x7f57680cea80 2024-04-25T09:04:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.827+0000 7f57677fe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f575406b4d0 0x7f575406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.828+0000 7f57677fe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f575406b4d0 0x7f575406d990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5758034000 tx=0x7f575802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:08.831+0000 7f574ffff640 1 -- 172.21.15.5:0/3363912652 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f575c01f020 con 0x7f57680cea80 2024-04-25T09:04:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.050+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f576806f800 con 0x7f57680cea80 2024-04-25T09:04:09.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.703+0000 7f574ffff640 1 -- 172.21.15.5:0/3363912652 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7f575c058870 con 0x7f57680cea80 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f575406b4d0 msgr2=0x7f575406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f575406b4d0 0x7f575406d990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5758034000 tx=0x7f575802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680cea80 msgr2=0x7f576815b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680cea80 0x7f576815b2b0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f575c00b410 tx=0x7f575c00b8d0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 shutdown_connections 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f575406b4d0 0x7f575406d990 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f57680d25d0 0x7f57680c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57680cea80 0x7f576815b2b0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 --2- 172.21.15.5:0/3363912652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680ce6a0 0x7f5768152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 >> 172.21.15.5:0/3363912652 conn(0x7f57680d1a40 msgr2=0x7f57680b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 shutdown_connections 2024-04-25T09:04:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.705+0000 7f576dfbe640 1 -- 172.21.15.5:0/3363912652 wait complete. 2024-04-25T09:04:09.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:04:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.829+0000 7f05659f9640 1 Processor -- start 2024-04-25T09:04:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.829+0000 7f05659f9640 1 -- start start 2024-04-25T09:04:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f05659f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 0x7f05600ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f05659f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0560162070 con 0x7f05600cecf0 2024-04-25T09:04:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f05659f9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0560162350 con 0x7f056015dbd0 2024-04-25T09:04:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f05659f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05600cf160 con 0x7f05600b9470 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f055f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f05600cecf0 0x7f05600d2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60498/0 (socket says 172.21.15.5:60498) 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f055f7fe640 1 -- 172.21.15.5:0/2065175492 learned_addr learned my addr 172.21.15.5:0/2065175492 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f055e7fc640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 0x7f05600ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605045353 0 0) 0x7f0560162070 con 0x7f05600cecf0 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f054c003520 con 0x7f05600cecf0 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.830+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2412111833 0 0) 0x7f054c003520 con 0x7f05600cecf0 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 msgr2=0x7f05600ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 0x7f05600ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 >> v1:172.21.15.80:6789/0 conn(0x7f056015dbd0 legacy=0x7f05601617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600d1c50 con 0x7f05600cecf0 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f05500019f0 con 0x7f05600cecf0 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 >> v1:172.21.15.5:6789/0 conn(0x7f05600cecf0 legacy=0x7f05600d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f054c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c004800 0x7f054c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 0x7f054c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600cf160 con 0x7f054c0039e0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c00baa0 con 0x7f054c004800 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c00bca0 con 0x7f05600b9470 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055effd640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f054c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055e7fc640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c004800 0x7f054c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055f7fe640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 0x7f054c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055effd640 1 -- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 msgr2=0x7f054c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055effd640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600b9470 0x7f054c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055effd640 1 -- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c004800 msgr2=0x7f054c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055effd640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c004800 0x7f054c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.831+0000 7f055effd640 1 -- 172.21.15.5:0/2065175492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c003520 con 0x7f054c0039e0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f055effd640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f054c003e00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0558001720 tx=0x7f054c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9609ccafe295a052 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558001370 con 0x7f054c0039e0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05580052d0 con 0x7f054c0039e0 2024-04-25T09:04:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f055dffb640 1 -- 172.21.15.5:0/2065175492 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055802ab90 con 0x7f054c0039e0 2024-04-25T09:04:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f05659f9640 1 -- 172.21.15.5:0/2065175492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 msgr2=0x7f054c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f05659f9640 1 --2- 172.21.15.5:0/2065175492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f054c003e00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0558001720 tx=0x7f054c005830 comp rx=0 tx=0).stop 2024-04-25T09:04:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f055f7fe640 1 -- 172.21.15.5:0/2065175492 reap_dead start 2024-04-25T09:04:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f05659f9640 1 -- 172.21.15.5:0/2065175492 shutdown_connections 2024-04-25T09:04:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.832+0000 7f05659f9640 1 -- 172.21.15.5:0/2065175492 >> 172.21.15.5:0/2065175492 conn(0x7f0560066ad0 msgr2=0x7f0560066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.833+0000 7f05659f9640 1 -- 172.21.15.5:0/2065175492 shutdown_connections 2024-04-25T09:04:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.833+0000 7f05659f9640 1 -- 172.21.15.5:0/2065175492 wait complete. 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.834+0000 7f05659f9640 1 Processor -- start 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.834+0000 7f05659f9640 1 -- start start 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f05659f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f05600c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f05659f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600cd150 0x7f05600cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f05659f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05601e8280 0x7f05601e8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f05659f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056015dfb0 con 0x7f054c0039e0 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f05659f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0560162630 con 0x7f05601e8280 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f05659f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056015e130 con 0x7f05600cd150 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f05600c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f05600c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42892/0 (socket says 172.21.15.5:42892) 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 -- 172.21.15.5:0/952348345 learned_addr learned my addr 172.21.15.5:0/952348345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055e7fc640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600cd150 0x7f05600cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055f7fe640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05601e8280 0x7f05601e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 -- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600cd150 msgr2=0x7f05600cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600cd150 0x7f05600cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 -- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05601e8280 msgr2=0x7f05601e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05601e8280 0x7f05601e8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 -- 172.21.15.5:0/952348345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600cdef0 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f055effd640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f05600c96d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f0558001840 tx=0x7f0558001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f0557fff640 1 -- 172.21.15.5:0/952348345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558042070 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f0557fff640 1 -- 172.21.15.5:0/952348345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0558005480 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f0557fff640 1 -- 172.21.15.5:0/952348345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558037040 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.835+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05601e74c0 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.836+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05601e7a80 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.837+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056004ef20 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.837+0000 7f0557fff640 1 -- 172.21.15.5:0/952348345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0558045070 con 0x7f054c0039e0 2024-04-25T09:04:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.837+0000 7f0557fff640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f054006b4d0 0x7f054006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.838+0000 7f0557fff640 1 -- 172.21.15.5:0/952348345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f05580a9930 con 0x7f054c0039e0 2024-04-25T09:04:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.838+0000 7f055e7fc640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f054006b4d0 0x7f054006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.838+0000 7f055e7fc640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f054006b4d0 0x7f054006d990 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f05600b8c60 tx=0x7f0548009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:09.842+0000 7f0557fff640 1 -- 172.21.15.5:0/952348345 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0558078080 con 0x7f054c0039e0 2024-04-25T09:04:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.021+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0560067f60 con 0x7f054c0039e0 2024-04-25T09:04:10.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.704+0000 7f0557fff640 1 -- 172.21.15.5:0/952348345 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 181+0+0 (secure 0 0 0) 0x7f055807c120 con 0x7f054c0039e0 2024-04-25T09:04:10.693 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f054006b4d0 msgr2=0x7f054006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f054006b4d0 0x7f054006d990 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f05600b8c60 tx=0x7f0548009190 comp rx=0 tx=0).stop 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 msgr2=0x7f05600c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f05600c96d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f0558001840 tx=0x7f0558001120 comp rx=0 tx=0).stop 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 shutdown_connections 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f054006b4d0 0x7f054006d990 secure :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f05600b8c60 tx=0x7f0548009190 comp rx=0 tx=0).stop 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05601e8280 0x7f05601e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f05600cd150 0x7f05600cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 --2- 172.21.15.5:0/952348345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054c0039e0 0x7f05600c96d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.710+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 >> 172.21.15.5:0/952348345 conn(0x7f0560066ad0 msgr2=0x7f05600d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.711+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 shutdown_connections 2024-04-25T09:04:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.711+0000 7f05659f9640 1 -- 172.21.15.5:0/952348345 wait complete. 2024-04-25T09:04:10.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:04:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.837+0000 7efd86b1d640 1 Processor -- start 2024-04-25T09:04:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.837+0000 7efd86b1d640 1 -- start start 2024-04-25T09:04:10.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd86b1d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 0x7efd801617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd86b1d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd800b9470 0x7efd800ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd86b1d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd80162070 con 0x7efd800cecf0 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd86b1d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800cf160 con 0x7efd800b9470 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd86b1d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd80162350 con 0x7efd8015dbd0 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd850ba640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efd800cecf0 0x7efd800b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57148/0 (socket says 172.21.15.5:57148) 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd850ba640 1 -- 172.21.15.5:0/2083355486 learned_addr learned my addr 172.21.15.5:0/2083355486 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599928804 0 0) 0x7efd80162070 con 0x7efd800cecf0 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7ffff640 1 --2- 172.21.15.5:0/2083355486 >> v2:172.21.15.80:3300/0 conn(0x7efd800b9470 0x7efd800ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd848b9640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 0x7efd801617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd70003520 con 0x7efd800cecf0 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1904327940 0 0) 0x7efd70003520 con 0x7efd800cecf0 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 msgr2=0x7efd801617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7f7fe640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 0x7efd801617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 >> v2:172.21.15.80:3300/0 conn(0x7efd800b9470 msgr2=0x7efd800ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.838+0000 7efd7f7fe640 1 --2- 172.21.15.5:0/2083355486 >> v2:172.21.15.80:3300/0 conn(0x7efd800b9470 0x7efd800ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800d1c50 con 0x7efd800cecf0 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7efd780019f0 con 0x7efd800cecf0 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 >> v1:172.21.15.5:6789/0 conn(0x7efd800cecf0 legacy=0x7efd800b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd700039b0 0x7efd70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 0x7efd70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70004d40 0x7efd700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800cf160 con 0x7efd700039b0 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80162350 con 0x7efd70004d40 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7000b9c0 con 0x7efd8015dbd0 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd848b9640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd700039b0 0x7efd70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd850ba640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70004d40 0x7efd700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd7ffff640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 0x7efd70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd848b9640 1 -- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 msgr2=0x7efd70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd848b9640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd8015dbd0 0x7efd70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd848b9640 1 -- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70004d40 msgr2=0x7efd700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd848b9640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70004d40 0x7efd700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd848b9640 1 -- 172.21.15.5:0/2083355486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70003520 con 0x7efd700039b0 2024-04-25T09:04:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.839+0000 7efd850ba640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70004d40 0x7efd700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd848b9640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd700039b0 0x7efd70003dd0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7efd74009ac0 tx=0x7efd70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8072215a881142f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74036070 con 0x7efd700039b0 2024-04-25T09:04:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74031400 con 0x7efd700039b0 2024-04-25T09:04:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd7f7fe640 1 -- 172.21.15.5:0/2083355486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74009690 con 0x7efd700039b0 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd86b1d640 1 -- 172.21.15.5:0/2083355486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd700039b0 msgr2=0x7efd70003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd86b1d640 1 --2- 172.21.15.5:0/2083355486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd700039b0 0x7efd70003dd0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7efd74009ac0 tx=0x7efd70005830 comp rx=0 tx=0).stop 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd850ba640 1 -- 172.21.15.5:0/2083355486 reap_dead start 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd86b1d640 1 -- 172.21.15.5:0/2083355486 shutdown_connections 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.840+0000 7efd86b1d640 1 -- 172.21.15.5:0/2083355486 >> 172.21.15.5:0/2083355486 conn(0x7efd80066ad0 msgr2=0x7efd80066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.841+0000 7efd86b1d640 1 -- 172.21.15.5:0/2083355486 shutdown_connections 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.841+0000 7efd86b1d640 1 -- 172.21.15.5:0/2083355486 wait complete. 2024-04-25T09:04:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.842+0000 7efd86b1d640 1 Processor -- start 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.842+0000 7efd86b1d640 1 -- start start 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd700039b0 0x7efd801601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8014bf70 0x7efd800b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd800b3b80 0x7efd8015e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8015dfb0 con 0x7efd800b3b80 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80162630 con 0x7efd8014bf70 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8015e130 con 0x7efd700039b0 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd800b3b80 0x7efd8015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd800b3b80 0x7efd8015e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45202/0 (socket says 172.21.15.5:45202) 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 -- 172.21.15.5:0/3934616603 learned_addr learned my addr 172.21.15.5:0/3934616603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd848b9640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd700039b0 0x7efd801601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd7ffff640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8014bf70 0x7efd800b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 -- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd700039b0 msgr2=0x7efd801601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd700039b0 0x7efd801601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 -- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8014bf70 msgr2=0x7efd800b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8014bf70 0x7efd800b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 -- 172.21.15.5:0/3934616603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8015f150 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd7ffff640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8014bf70 0x7efd800b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd850ba640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd800b3b80 0x7efd8015e400 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7efd8008ca00 tx=0x7efd7800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd7d7fa640 1 -- 172.21.15.5:0/3934616603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800eda0 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd7d7fa640 1 -- 172.21.15.5:0/3934616603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78014480 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd7d7fa640 1 -- 172.21.15.5:0/3934616603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78014830 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8015f430 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.843+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8015f9f0 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.844+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8004ef20 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.845+0000 7efd7d7fa640 1 -- 172.21.15.5:0/3934616603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd780149d0 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.845+0000 7efd7d7fa640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efd6406b500 0x7efd6406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.845+0000 7efd7d7fa640 1 -- 172.21.15.5:0/3934616603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5357+0+0 (secure 0 0 0) 0x7efd78089ec0 con 0x7efd800b3b80 2024-04-25T09:04:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.846+0000 7efd848b9640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efd6406b500 0x7efd6406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.846+0000 7efd848b9640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efd6406b500 0x7efd6406d9c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efd74033000 tx=0x7efd74008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:10.850+0000 7efd7d7fa640 1 -- 172.21.15.5:0/3934616603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd780587b0 con 0x7efd800b3b80 2024-04-25T09:04:11.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.029+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd800d1760 con 0x7efd800b3b80 2024-04-25T09:04:11.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.706+0000 7efd7d7fa640 1 -- 172.21.15.5:0/3934616603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 169+0+0 (secure 0 0 0) 0x7efd7805c850 con 0x7efd800b3b80 2024-04-25T09:04:11.695 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T09:04:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.709+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efd6406b500 msgr2=0x7efd6406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efd6406b500 0x7efd6406d9c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efd74033000 tx=0x7efd74008030 comp rx=0 tx=0).stop 2024-04-25T09:04:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd800b3b80 msgr2=0x7efd8015e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd800b3b80 0x7efd8015e400 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7efd8008ca00 tx=0x7efd7800e530 comp rx=0 tx=0).stop 2024-04-25T09:04:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 shutdown_connections 2024-04-25T09:04:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efd6406b500 0x7efd6406d9c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd800b3b80 0x7efd8015e400 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8014bf70 0x7efd800b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 --2- 172.21.15.5:0/3934616603 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efd700039b0 0x7efd801601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 >> 172.21.15.5:0/3934616603 conn(0x7efd80066ad0 msgr2=0x7efd800d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 shutdown_connections 2024-04-25T09:04:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.710+0000 7efd86b1d640 1 -- 172.21.15.5:0/3934616603 wait complete. 2024-04-25T09:04:11.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:04:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.843+0000 7f8d9e33b640 1 Processor -- start 2024-04-25T09:04:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.843+0000 7f8d9e33b640 1 -- start start 2024-04-25T09:04:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d9e33b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d981614b0 0x7f8d980b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d9e33b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980d2740 con 0x7f8d980d1f60 2024-04-25T09:04:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d9e33b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980d2a20 con 0x7f8d980d4230 2024-04-25T09:04:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d9e33b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980d2d00 con 0x7f8d981614b0 2024-04-25T09:04:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d97fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d981614b0 0x7f8d980b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d977fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8d980d1f60 0x7f8d980d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57154/0 (socket says 172.21.15.5:57154) 2024-04-25T09:04:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d977fe640 1 -- 172.21.15.5:0/1428464614 learned_addr learned my addr 172.21.15.5:0/1428464614 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d97fff640 1 -- 172.21.15.5:0/1428464614 >> v1:172.21.15.80:6789/0 conn(0x7f8d980d4230 legacy=0x7f8d980b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d97fff640 1 -- 172.21.15.5:0/1428464614 >> v1:172.21.15.5:6789/0 conn(0x7f8d980d1f60 legacy=0x7f8d980d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.844+0000 7f8d97fff640 1 -- 172.21.15.5:0/1428464614 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980d2fe0 con 0x7f8d981614b0 2024-04-25T09:04:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.845+0000 7f8d97fff640 1 --2- 172.21.15.5:0/1428464614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d981614b0 0x7f8d980b96e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097a0 tx=0x7f8d8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4ec6c95e7fe79e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.845+0000 7f8d96ffd640 1 -- 172.21.15.5:0/1428464614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88037070 con 0x7f8d981614b0 2024-04-25T09:04:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.845+0000 7f8d96ffd640 1 -- 172.21.15.5:0/1428464614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d88032440 con 0x7f8d981614b0 2024-04-25T09:04:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.845+0000 7f8d96ffd640 1 -- 172.21.15.5:0/1428464614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88032810 con 0x7f8d981614b0 2024-04-25T09:04:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.846+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1428464614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d981614b0 msgr2=0x7f8d980b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.846+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1428464614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d981614b0 0x7f8d980b96e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097a0 tx=0x7f8d8802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.846+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1428464614 shutdown_connections 2024-04-25T09:04:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.846+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1428464614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d981614b0 0x7f8d980b96e0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.846+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1428464614 >> 172.21.15.5:0/1428464614 conn(0x7f8d9806b000 msgr2=0x7f8d9806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.846+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1428464614 shutdown_connections 2024-04-25T09:04:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.846+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1428464614 wait complete. 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.847+0000 7f8d9e33b640 1 Processor -- start 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.847+0000 7f8d9e33b640 1 -- start start 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d9e33b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d980d1f60 0x7f8d980c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d9e33b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d980d4230 0x7f8d981f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d9e33b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d981614b0 0x7f8d981f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d9e33b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980d23a0 con 0x7f8d980d1f60 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d9e33b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980d37e0 con 0x7f8d981614b0 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d9e33b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980d2520 con 0x7f8d980d4230 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d980d1f60 0x7f8d980c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d980d1f60 0x7f8d980c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45232/0 (socket says 172.21.15.5:45232) 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 -- 172.21.15.5:0/1275637997 learned_addr learned my addr 172.21.15.5:0/1275637997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d977fe640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d980d4230 0x7f8d981f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d9c8d8640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d981614b0 0x7f8d981f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 -- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d980d4230 msgr2=0x7f8d981f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d980d4230 0x7f8d981f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 -- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d981614b0 msgr2=0x7f8d981f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d981614b0 0x7f8d981f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.848+0000 7f8d97fff640 1 -- 172.21.15.5:0/1275637997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d981f4110 con 0x7f8d980d1f60 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.849+0000 7f8d97fff640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d980d1f60 0x7f8d980c8070 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8d88000c00 tx=0x7f8d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.849+0000 7f8d94ff9640 1 -- 172.21.15.5:0/1275637997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88041070 con 0x7f8d980d1f60 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.849+0000 7f8d94ff9640 1 -- 172.21.15.5:0/1275637997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8803c930 con 0x7f8d980d1f60 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.849+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d980c8730 con 0x7f8d980d1f60 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.849+0000 7f8d94ff9640 1 -- 172.21.15.5:0/1275637997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88037040 con 0x7f8d980d1f60 2024-04-25T09:04:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.849+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d980c8cf0 con 0x7f8d980d1f60 2024-04-25T09:04:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.850+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9804ef20 con 0x7f8d980d1f60 2024-04-25T09:04:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.850+0000 7f8d94ff9640 1 -- 172.21.15.5:0/1275637997 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d88044070 con 0x7f8d980d1f60 2024-04-25T09:04:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.851+0000 7f8d94ff9640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d7806b4d0 0x7f8d7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.851+0000 7f8d94ff9640 1 -- 172.21.15.5:0/1275637997 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d880aadb0 con 0x7f8d980d1f60 2024-04-25T09:04:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.851+0000 7f8d977fe640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d7806b4d0 0x7f8d7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.852+0000 7f8d977fe640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d7806b4d0 0x7f8d7806d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8d981f7780 tx=0x7f8d80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:11.855+0000 7f8d94ff9640 1 -- 172.21.15.5:0/1275637997 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d8807a0e0 con 0x7f8d980d1f60 2024-04-25T09:04:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.035+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8d980b9830 con 0x7f8d980d1f60 2024-04-25T09:04:12.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.038+0000 7f8d94ff9640 1 -- 172.21.15.5:0/1275637997 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8d880799e0 con 0x7f8d980d1f60 2024-04-25T09:04:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d7806b4d0 msgr2=0x7f8d7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d7806b4d0 0x7f8d7806d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8d981f7780 tx=0x7f8d80009040 comp rx=0 tx=0).stop 2024-04-25T09:04:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d980d1f60 msgr2=0x7f8d980c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d980d1f60 0x7f8d980c8070 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8d88000c00 tx=0x7f8d880046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 shutdown_connections 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8d7806b4d0 0x7f8d7806d990 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d981614b0 0x7f8d981f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8d980d4230 0x7f8d981f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 --2- 172.21.15.5:0/1275637997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d980d1f60 0x7f8d980c8070 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 >> 172.21.15.5:0/1275637997 conn(0x7f8d9806b000 msgr2=0x7f8d980b8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 shutdown_connections 2024-04-25T09:04:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.040+0000 7f8d9e33b640 1 -- 172.21.15.5:0/1275637997 wait complete. 2024-04-25T09:04:12.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-04-25T09:04:12.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.152+0000 7f75a65f5640 1 Processor -- start 2024-04-25T09:04:12.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.152+0000 7f75a65f5640 1 -- start start 2024-04-25T09:04:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f75a65f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75a015de70 0x7f75a00b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f75a65f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f75a65f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00cf1c0 con 0x7f75a00b2cc0 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f75a65f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a00d2a10 con 0x7f75a015de70 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f75a65f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00d20e0 con 0x7f75a00ce7f0 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f759ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75a015de70 0x7f75a00b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f759ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75a015de70 0x7f75a00b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45240/0 (socket says 172.21.15.5:45240) 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f759ffff640 1 -- 172.21.15.5:0/3295804635 learned_addr learned my addr 172.21.15.5:0/3295804635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f75a4b92640 1 --2- 172.21.15.5:0/3295804635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f759ffff640 1 -- 172.21.15.5:0/3295804635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 msgr2=0x7f75a00cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f759ffff640 1 --2- 172.21.15.5:0/3295804635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f759ffff640 1 -- 172.21.15.5:0/3295804635 >> v1:172.21.15.80:6789/0 conn(0x7f75a00b2cc0 legacy=0x7f75a00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.153+0000 7f759ffff640 1 -- 172.21.15.5:0/3295804635 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00d23c0 con 0x7f75a015de70 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.154+0000 7f759ffff640 1 --2- 172.21.15.5:0/3295804635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00b93e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7594009870 tx=0x7f759402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cf40e8a6205767 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.154+0000 7f759effd640 1 -- 172.21.15.5:0/3295804635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594037070 con 0x7f75a015de70 2024-04-25T09:04:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.154+0000 7f759effd640 1 -- 172.21.15.5:0/3295804635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594032440 con 0x7f75a015de70 2024-04-25T09:04:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.154+0000 7f759effd640 1 -- 172.21.15.5:0/3295804635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594032810 con 0x7f75a015de70 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.154+0000 7f75a65f5640 1 -- 172.21.15.5:0/3295804635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 msgr2=0x7f75a00b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.154+0000 7f75a65f5640 1 --2- 172.21.15.5:0/3295804635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00b93e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7594009870 tx=0x7f759402a270 comp rx=0 tx=0).stop 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.155+0000 7f75a65f5640 1 -- 172.21.15.5:0/3295804635 shutdown_connections 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.155+0000 7f75a65f5640 1 --2- 172.21.15.5:0/3295804635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.155+0000 7f75a65f5640 1 --2- 172.21.15.5:0/3295804635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00b93e0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.155+0000 7f75a65f5640 1 -- 172.21.15.5:0/3295804635 >> 172.21.15.5:0/3295804635 conn(0x7f75a006b000 msgr2=0x7f75a006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.155+0000 7f75a65f5640 1 -- 172.21.15.5:0/3295804635 shutdown_connections 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.155+0000 7f75a65f5640 1 -- 172.21.15.5:0/3295804635 wait complete. 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.156+0000 7f75a65f5640 1 Processor -- start 2024-04-25T09:04:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.156+0000 7f75a65f5640 1 -- start start 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a65f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a00b2cc0 0x7f75a00caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a65f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a65f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a65f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00b7300 con 0x7f75a015de70 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a65f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00b9920 con 0x7f75a00b2cc0 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a65f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00d2ea0 con 0x7f75a00ce7f0 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45254/0 (socket says 172.21.15.5:45254) 2024-04-25T09:04:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 -- 172.21.15.5:0/1524288324 learned_addr learned my addr 172.21.15.5:0/1524288324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f759ffff640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a00b2cc0 0x7f75a00caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f759f7fe640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 -- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 msgr2=0x7f75a00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 -- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a00b2cc0 msgr2=0x7f75a00caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a00b2cc0 0x7f75a00caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 -- 172.21.15.5:0/1524288324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00ca100 con 0x7f75a015de70 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f759ffff640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a00b2cc0 0x7f75a00caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.157+0000 7f75a4b92640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00c9bc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7598007e70 tx=0x7f759800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.158+0000 7f759cff9640 1 -- 172.21.15.5:0/1524288324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598014620 con 0x7f75a015de70 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.158+0000 7f759cff9640 1 -- 172.21.15.5:0/1524288324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598019070 con 0x7f75a015de70 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.158+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a00cb210 con 0x7f75a015de70 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.158+0000 7f759cff9640 1 -- 172.21.15.5:0/1524288324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598014a20 con 0x7f75a015de70 2024-04-25T09:04:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.158+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a00cb7d0 con 0x7f75a015de70 2024-04-25T09:04:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.159+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a004ef20 con 0x7f75a015de70 2024-04-25T09:04:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.159+0000 7f759cff9640 1 -- 172.21.15.5:0/1524288324 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7598014bc0 con 0x7f75a015de70 2024-04-25T09:04:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.159+0000 7f759cff9640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f758c06b4d0 0x7f758c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.159+0000 7f759cff9640 1 -- 172.21.15.5:0/1524288324 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f759808a790 con 0x7f75a015de70 2024-04-25T09:04:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.160+0000 7f759ffff640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f758c06b4d0 0x7f758c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.160+0000 7f759ffff640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f758c06b4d0 0x7f758c06d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7594034000 tx=0x7f759402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.164+0000 7f759cff9640 1 -- 172.21.15.5:0/1524288324 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75980599a0 con 0x7f75a015de70 2024-04-25T09:04:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.450+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f75a0071800 con 0x7f75a015de70 2024-04-25T09:04:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.713+0000 7f759cff9640 1 -- 172.21.15.5:0/1524288324 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v365) v1 ==== 155+0+0 (secure 0 0 0) 0x7f75980592a0 con 0x7f75a015de70 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f758c06b4d0 msgr2=0x7f758c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f758c06b4d0 0x7f758c06d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7594034000 tx=0x7f759402e000 comp rx=0 tx=0).stop 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 msgr2=0x7f75a00c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00c9bc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7598007e70 tx=0x7f759800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 shutdown_connections 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f758c06b4d0 0x7f758c06d990 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a015de70 0x7f75a00c9bc0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75a00ce7f0 0x7f75a00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 --2- 172.21.15.5:0/1524288324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75a00b2cc0 0x7f75a00caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 >> 172.21.15.5:0/1524288324 conn(0x7f75a006b000 msgr2=0x7f75a0068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 shutdown_connections 2024-04-25T09:04:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.715+0000 7f75a65f5640 1 -- 172.21.15.5:0/1524288324 wait complete. 2024-04-25T09:04:12.716 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:04:12.716 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:04:12.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.829+0000 7fd95465a640 1 Processor -- start 2024-04-25T09:04:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.829+0000 7fd95465a640 1 -- start start 2024-04-25T09:04:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.830+0000 7fd95465a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.830+0000 7fd95465a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd94c0d3990 0x7fd94c0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.830+0000 7fd95465a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd94c0ce5e0 0x7fd94c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.830+0000 7fd95465a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0d4330 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.830+0000 7fd95465a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0b29c0 con 0x7fd94c0d3990 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.830+0000 7fd95465a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0d2080 con 0x7fd94c15e0a0 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.830+0000 7fd952bf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd94c0ce5e0 0x7fd94c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd952bf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd94c0ce5e0 0x7fd94c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45268/0 (socket says 172.21.15.5:45268) 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd952bf7640 1 -- 172.21.15.5:0/2730682730 learned_addr learned my addr 172.21.15.5:0/2730682730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd9523f6640 1 --2- 172.21.15.5:0/2730682730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd951bf5640 1 --2- 172.21.15.5:0/2730682730 >> v2:172.21.15.80:3300/0 conn(0x7fd94c0d3990 0x7fd94c0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd952bf7640 1 -- 172.21.15.5:0/2730682730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 msgr2=0x7fd94c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd952bf7640 1 --2- 172.21.15.5:0/2730682730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd952bf7640 1 -- 172.21.15.5:0/2730682730 >> v2:172.21.15.80:3300/0 conn(0x7fd94c0d3990 msgr2=0x7fd94c0d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd952bf7640 1 --2- 172.21.15.5:0/2730682730 >> v2:172.21.15.80:3300/0 conn(0x7fd94c0d3990 0x7fd94c0d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd952bf7640 1 -- 172.21.15.5:0/2730682730 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0d2360 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.831+0000 7fd951bf5640 1 --2- 172.21.15.5:0/2730682730 >> v2:172.21.15.80:3300/0 conn(0x7fd94c0d3990 0x7fd94c0d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd952bf7640 1 --2- 172.21.15.5:0/2730682730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c0cea70 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0678d0 tx=0x7fd94402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2976cbcfc6de032 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd9513f4640 1 -- 172.21.15.5:0/2730682730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944036070 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd9513f4640 1 -- 172.21.15.5:0/2730682730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944031600 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd9513f4640 1 -- 172.21.15.5:0/2730682730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440319d0 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd95465a640 1 -- 172.21.15.5:0/2730682730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 msgr2=0x7fd94c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd95465a640 1 --2- 172.21.15.5:0/2730682730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c0cea70 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0678d0 tx=0x7fd94402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd95465a640 1 -- 172.21.15.5:0/2730682730 shutdown_connections 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd95465a640 1 --2- 172.21.15.5:0/2730682730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c0cea70 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd95465a640 1 --2- 172.21.15.5:0/2730682730 >> v2:172.21.15.80:3300/0 conn(0x7fd94c0d3990 0x7fd94c0d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd95465a640 1 --2- 172.21.15.5:0/2730682730 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.832+0000 7fd95465a640 1 -- 172.21.15.5:0/2730682730 >> 172.21.15.5:0/2730682730 conn(0x7fd94c0668f0 msgr2=0x7fd94c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.833+0000 7fd95465a640 1 -- 172.21.15.5:0/2730682730 shutdown_connections 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.833+0000 7fd95465a640 1 -- 172.21.15.5:0/2730682730 wait complete. 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 Processor -- start 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 -- start start 2024-04-25T09:04:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c15c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd94c0d3990 0x7fd94c0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c1f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0d2c00 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0d2920 con 0x7fd94c0d3990 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd95465a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c15e480 con 0x7fd94c15e0a0 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd9523f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c15c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd9523f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c15c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45280/0 (socket says 172.21.15.5:45280) 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.834+0000 7fd9523f6640 1 -- 172.21.15.5:0/2033235510 learned_addr learned my addr 172.21.15.5:0/2033235510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd952bf7640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c1f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd951bf5640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd94c0d3990 0x7fd94c0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd9523f6640 1 -- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 msgr2=0x7fd94c1f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd9523f6640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c1f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd9523f6640 1 -- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd94c0d3990 msgr2=0x7fd94c0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd9523f6640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd94c0d3990 0x7fd94c0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd9523f6640 1 -- 172.21.15.5:0/2033235510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0cb680 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd952bf7640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd9523f6640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c15c2e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fd94800d800 tx=0x7fd94800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd942ffd640 1 -- 172.21.15.5:0/2033235510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800b6c0 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd942ffd640 1 -- 172.21.15.5:0/2033235510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948019070 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c0cb960 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd942ffd640 1 -- 172.21.15.5:0/2033235510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800ba80 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.835+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c0cbf20 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.836+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c0b5930 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.837+0000 7fd942ffd640 1 -- 172.21.15.5:0/2033235510 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd94800bc20 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.837+0000 7fd942ffd640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd93006b4d0 0x7fd93006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.837+0000 7fd942ffd640 1 -- 172.21.15.5:0/2033235510 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd94808a320 con 0x7fd94c0ce5e0 2024-04-25T09:04:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.837+0000 7fd951bf5640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd93006b4d0 0x7fd93006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.838+0000 7fd951bf5640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd93006b4d0 0x7fd93006d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0d41a0 tx=0x7fd93c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:12.842+0000 7fd942ffd640 1 -- 172.21.15.5:0/2033235510 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd948059530 con 0x7fd94c0ce5e0 2024-04-25T09:04:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.020+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd94c04ef20 con 0x7fd94c0ce5e0 2024-04-25T09:04:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.021+0000 7fd942ffd640 1 -- 172.21.15.5:0/2033235510 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+12938 (secure 0 0 0) 0x7fd948058e30 con 0x7fd94c0ce5e0 2024-04-25T09:04:13.010 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:13.010 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":102,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:11.705800+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/1087126648":"2024-04-26T09:04:08.701150+0000","172.21.15.80:6835/1087126648":"2024-04-26T09:04:08.701150+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd93006b4d0 msgr2=0x7fd93006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd93006b4d0 0x7fd93006d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0d41a0 tx=0x7fd93c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 msgr2=0x7fd94c15c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c15c2e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fd94800d800 tx=0x7fd94800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 shutdown_connections 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd93006b4d0 0x7fd93006d990 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd94c15e0a0 0x7fd94c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd94c0d3990 0x7fd94c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 --2- 172.21.15.5:0/2033235510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd94c0ce5e0 0x7fd94c15c2e0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 >> 172.21.15.5:0/2033235510 conn(0x7fd94c0668f0 msgr2=0x7fd94c0b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 shutdown_connections 2024-04-25T09:04:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.023+0000 7fd95465a640 1 -- 172.21.15.5:0/2033235510 wait complete. 2024-04-25T09:04:13.023 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:13.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:13.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.138+0000 7f391117e640 1 Processor -- start 2024-04-25T09:04:13.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.138+0000 7f391117e640 1 -- start start 2024-04-25T09:04:13.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f391117e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 0x7f390c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f391117e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c15e460 con 0x7f390c066e30 2024-04-25T09:04:13.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f391117e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c15e740 con 0x7f390c0affc0 2024-04-25T09:04:13.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f391117e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c155160 con 0x7f390c154d80 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f390a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f390c066e30 0x7f390c0af8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57162/0 (socket says 172.21.15.5:57162) 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f390a59c640 1 -- 172.21.15.5:0/2498242042 learned_addr learned my addr 172.21.15.5:0/2498242042 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065376124 0 0) 0x7f390c15e460 con 0x7f390c066e30 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f390ad9d640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 0x7f390c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.139+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f4003520 con 0x7f390c066e30 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1750602563 0 0) 0x7f38f4003520 con 0x7f390c066e30 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 msgr2=0x7f390c0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 0x7f390c0668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 >> v1:172.21.15.80:6789/0 conn(0x7f390c0affc0 legacy=0x7f390c1619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c15ea20 con 0x7f390c066e30 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f3900001670 con 0x7f390c066e30 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 >> v1:172.21.15.5:6789/0 conn(0x7f390c066e30 legacy=0x7f390c0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38f40039e0 0x7f38f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38f4004390 0x7f38f4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 0x7f38f40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c155160 con 0x7f38f40039e0 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f400b9c0 con 0x7f38f4004390 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f400bbc0 con 0x7f390c154d80 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390ad9d640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38f40039e0 0x7f38f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390a59c640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38f4004390 0x7f38f4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390b59e640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 0x7f38f40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390ad9d640 1 -- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 msgr2=0x7f38f40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390ad9d640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 0x7f38f40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390ad9d640 1 -- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38f4004390 msgr2=0x7f38f4004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390ad9d640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38f4004390 0x7f38f4004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390ad9d640 1 -- 172.21.15.5:0/2498242042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4003520 con 0x7f38f40039e0 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.140+0000 7f390b59e640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f390c154d80 0x7f38f40050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f390ad9d640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38f40039e0 0x7f38f4003dc0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3904009ac0 tx=0x7f38f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af596ae1f18d4c62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904036070 con 0x7f38f40039e0 2024-04-25T09:04:13.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904031400 con 0x7f38f40039e0 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f3909d9b640 1 -- 172.21.15.5:0/2498242042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904009690 con 0x7f38f40039e0 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f391117e640 1 -- 172.21.15.5:0/2498242042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38f40039e0 msgr2=0x7f38f4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f391117e640 1 --2- 172.21.15.5:0/2498242042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38f40039e0 0x7f38f4003dc0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3904009ac0 tx=0x7f38f4005830 comp rx=0 tx=0).stop 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f390b59e640 1 -- 172.21.15.5:0/2498242042 reap_dead start 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.141+0000 7f391117e640 1 -- 172.21.15.5:0/2498242042 shutdown_connections 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.142+0000 7f391117e640 1 -- 172.21.15.5:0/2498242042 >> 172.21.15.5:0/2498242042 conn(0x7f390c0cd310 msgr2=0x7f390c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.142+0000 7f391117e640 1 -- 172.21.15.5:0/2498242042 shutdown_connections 2024-04-25T09:04:13.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.142+0000 7f391117e640 1 -- 172.21.15.5:0/2498242042 wait complete. 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.143+0000 7f391117e640 1 Processor -- start 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.143+0000 7f391117e640 1 -- start start 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f391117e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38f40039e0 0x7f390c1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f391117e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f390c1f4f50 0x7f390c1e8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f391117e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f390c1e85b0 0x7f390c1e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f391117e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0724a0 con 0x7f390c1e85b0 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f391117e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c072620 con 0x7f390c1f4f50 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f391117e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0b41a0 con 0x7f38f40039e0 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f390c1e85b0 0x7f390c1e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f390c1e85b0 0x7f390c1e92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45286/0 (socket says 172.21.15.5:45286) 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 -- 172.21.15.5:0/3768681740 learned_addr learned my addr 172.21.15.5:0/3768681740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390ad9d640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38f40039e0 0x7f390c1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390a59c640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f390c1f4f50 0x7f390c1e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 -- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38f40039e0 msgr2=0x7f390c1f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38f40039e0 0x7f390c1f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 -- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f390c1f4f50 msgr2=0x7f390c1e8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f390c1f4f50 0x7f390c1e8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 -- 172.21.15.5:0/3768681740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0b3590 con 0x7f390c1e85b0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390a59c640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f390c1f4f50 0x7f390c1e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.144+0000 7f390b59e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f390c1e85b0 0x7f390c1e92f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f390c06bdf0 tx=0x7f38fc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.145+0000 7f38f37fe640 1 -- 172.21.15.5:0/3768681740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00ee50 con 0x7f390c1e85b0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.145+0000 7f38f37fe640 1 -- 172.21.15.5:0/3768681740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc018070 con 0x7f390c1e85b0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.145+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c0b3870 con 0x7f390c1e85b0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.145+0000 7f38f37fe640 1 -- 172.21.15.5:0/3768681740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc003dc0 con 0x7f390c1e85b0 2024-04-25T09:04:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.145+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0b3e30 con 0x7f390c1e85b0 2024-04-25T09:04:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.146+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c04ef20 con 0x7f390c1e85b0 2024-04-25T09:04:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.146+0000 7f38f37fe640 1 -- 172.21.15.5:0/3768681740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f38fc0050d0 con 0x7f390c1e85b0 2024-04-25T09:04:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.147+0000 7f38f37fe640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f38f806b4d0 0x7f38f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.147+0000 7f38f37fe640 1 -- 172.21.15.5:0/3768681740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f38fc089d30 con 0x7f390c1e85b0 2024-04-25T09:04:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.147+0000 7f390ad9d640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f38f806b4d0 0x7f38f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.148+0000 7f390ad9d640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f38f806b4d0 0x7f38f806d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3904009ac0 tx=0x7f3904008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.151+0000 7f38f37fe640 1 -- 172.21.15.5:0/3768681740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38fc058eb0 con 0x7f390c1e85b0 2024-04-25T09:04:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.330+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f390c0b4320 con 0x7f390c1e85b0 2024-04-25T09:04:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.330+0000 7f38f37fe640 1 -- 172.21.15.5:0/3768681740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38fc01be40 con 0x7f390c1e85b0 2024-04-25T09:04:13.319 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:04:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f38f806b4d0 msgr2=0x7f38f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f38f806b4d0 0x7f38f806d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3904009ac0 tx=0x7f3904008030 comp rx=0 tx=0).stop 2024-04-25T09:04:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f390c1e85b0 msgr2=0x7f390c1e92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f390c1e85b0 0x7f390c1e92f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f390c06bdf0 tx=0x7f38fc00ec00 comp rx=0 tx=0).stop 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 shutdown_connections 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f38f806b4d0 0x7f38f806d990 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f390c1e85b0 0x7f390c1e92f0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f390c1f4f50 0x7f390c1e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 --2- 172.21.15.5:0/3768681740 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f38f40039e0 0x7f390c1f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 >> 172.21.15.5:0/3768681740 conn(0x7f390c0cd310 msgr2=0x7f390c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 shutdown_connections 2024-04-25T09:04:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.332+0000 7f391117e640 1 -- 172.21.15.5:0/3768681740 wait complete. 2024-04-25T09:04:13.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-04-25T09:04:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.446+0000 7f8756cbc640 1 Processor -- start 2024-04-25T09:04:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.446+0000 7f8756cbc640 1 -- start start 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.446+0000 7f8756cbc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 0x7f87500cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.446+0000 7f8756cbc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f87500ce9a0 0x7f87500b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.446+0000 7f8756cbc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87500cdcb0 con 0x7f87500cd6e0 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.446+0000 7f8756cbc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87500cdf90 con 0x7f87500ce9a0 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.446+0000 7f8756cbc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87500b47e0 con 0x7f875015bdc0 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f87500cd6e0 0x7f87500ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57176/0 (socket says 172.21.15.5:57176) 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874ffff640 1 -- 172.21.15.5:0/2972703713 learned_addr learned my addr 172.21.15.5:0/2972703713 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f8754a58640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 0x7f87500cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f8755259640 1 --2- 172.21.15.5:0/2972703713 >> v2:172.21.15.80:3300/0 conn(0x7f87500ce9a0 0x7f87500b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379936892 0 0) 0x7f87500cdcb0 con 0x7f87500cd6e0 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8740003520 con 0x7f87500cd6e0 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609068309 0 0) 0x7f8740003520 con 0x7f87500cd6e0 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 msgr2=0x7f87500cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 0x7f87500cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 >> v2:172.21.15.80:3300/0 conn(0x7f87500ce9a0 msgr2=0x7f87500b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 --2- 172.21.15.5:0/2972703713 >> v2:172.21.15.80:3300/0 conn(0x7f87500ce9a0 0x7f87500b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500b4ac0 con 0x7f87500cd6e0 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f873c001670 con 0x7f87500cd6e0 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 >> v1:172.21.15.5:6789/0 conn(0x7f87500cd6e0 legacy=0x7f87500ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87400039b0 0x7f8740003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8740004800 0x7f8740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 0x7f87400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87500cdf90 con 0x7f8740004800 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87500b47e0 con 0x7f87400039b0 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874000b9c0 con 0x7f875015bdc0 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f874ffff640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8740004800 0x7f8740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f8754a58640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87400039b0 0x7f8740003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.447+0000 7f8755259640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 0x7f87400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874ffff640 1 -- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 msgr2=0x7f87400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874ffff640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 0x7f87400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874ffff640 1 -- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87400039b0 msgr2=0x7f8740003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874ffff640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87400039b0 0x7f8740003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874ffff640 1 -- 172.21.15.5:0/2972703713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740003520 con 0x7f8740004800 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f8755259640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015bdc0 0x7f87400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874ffff640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8740004800 0x7f8740004c80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f873c007fd0 tx=0x7f8740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46911a3e26609ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c007d50 con 0x7f8740004800 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c005ad0 con 0x7f8740004800 2024-04-25T09:04:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.448+0000 7f874f7fe640 1 -- 172.21.15.5:0/2972703713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c007070 con 0x7f8740004800 2024-04-25T09:04:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.449+0000 7f8756cbc640 1 -- 172.21.15.5:0/2972703713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8740004800 msgr2=0x7f8740004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.449+0000 7f8756cbc640 1 --2- 172.21.15.5:0/2972703713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8740004800 0x7f8740004c80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f873c007fd0 tx=0x7f8740005830 comp rx=0 tx=0).stop 2024-04-25T09:04:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.449+0000 7f8755259640 1 -- 172.21.15.5:0/2972703713 reap_dead start 2024-04-25T09:04:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.449+0000 7f8756cbc640 1 -- 172.21.15.5:0/2972703713 shutdown_connections 2024-04-25T09:04:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.449+0000 7f8756cbc640 1 -- 172.21.15.5:0/2972703713 >> 172.21.15.5:0/2972703713 conn(0x7f87500d18f0 msgr2=0x7f87500d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.449+0000 7f8756cbc640 1 -- 172.21.15.5:0/2972703713 shutdown_connections 2024-04-25T09:04:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.449+0000 7f8756cbc640 1 -- 172.21.15.5:0/2972703713 wait complete. 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.450+0000 7f8756cbc640 1 Processor -- start 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.450+0000 7f8756cbc640 1 -- start start 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8756cbc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8740004800 0x7f875015c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8756cbc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015ece0 0x7f8750157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8756cbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8750158140 0x7f87500c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8756cbc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875015c1a0 con 0x7f8750158140 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8756cbc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87500d09a0 con 0x7f8740004800 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8756cbc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875015c320 con 0x7f875015ece0 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8755259640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8750158140 0x7f87500c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8755259640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8750158140 0x7f87500c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45302/0 (socket says 172.21.15.5:45302) 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8755259640 1 -- 172.21.15.5:0/586825840 learned_addr learned my addr 172.21.15.5:0/586825840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f874ffff640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015ece0 0x7f8750157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.451+0000 7f8754a58640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8740004800 0x7f875015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8755259640 1 -- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015ece0 msgr2=0x7f8750157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8755259640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015ece0 0x7f8750157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8755259640 1 -- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8740004800 msgr2=0x7f875015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8755259640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8740004800 0x7f875015c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8755259640 1 -- 172.21.15.5:0/586825840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750152d30 con 0x7f8750158140 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8754a58640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8740004800 0x7f875015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8755259640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8750158140 0x7f87500c7430 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f87500cef90 tx=0x7f87480115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f874d7fa640 1 -- 172.21.15.5:0/586825840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748016470 con 0x7f8750158140 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f874d7fa640 1 -- 172.21.15.5:0/586825840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874801c070 con 0x7f8750158140 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f874d7fa640 1 -- 172.21.15.5:0/586825840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748016850 con 0x7f8750158140 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8750153010 con 0x7f8750158140 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.452+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87501535d0 con 0x7f8750158140 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.453+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87501537d0 con 0x7f8750158140 2024-04-25T09:04:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.453+0000 7f874d7fa640 1 -- 172.21.15.5:0/586825840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8748005d10 con 0x7f8750158140 2024-04-25T09:04:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.454+0000 7f874d7fa640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f873406b500 0x7f873406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.454+0000 7f874d7fa640 1 -- 172.21.15.5:0/586825840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f874808a8b0 con 0x7f8750158140 2024-04-25T09:04:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.454+0000 7f8754a58640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f873406b500 0x7f873406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.455+0000 7f8754a58640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f873406b500 0x7f873406d9c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8744006d40 tx=0x7f8744008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.458+0000 7f874d7fa640 1 -- 172.21.15.5:0/586825840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87501537d0 con 0x7f8750158140 2024-04-25T09:04:13.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.705+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f875004ef20 con 0x7f8750158140 2024-04-25T09:04:13.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.714+0000 7f874d7fa640 1 -- 172.21.15.5:0/586825840 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v366) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8748026020 con 0x7f8750158140 2024-04-25T09:04:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f873406b500 msgr2=0x7f873406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f873406b500 0x7f873406d9c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8744006d40 tx=0x7f8744008040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8750158140 msgr2=0x7f87500c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8750158140 0x7f87500c7430 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f87500cef90 tx=0x7f87480115a0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 shutdown_connections 2024-04-25T09:04:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f873406b500 0x7f873406d9c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8750158140 0x7f87500c7430 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f875015ece0 0x7f8750157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 --2- 172.21.15.5:0/586825840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8740004800 0x7f875015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 >> 172.21.15.5:0/586825840 conn(0x7f87500d18f0 msgr2=0x7f87500b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 shutdown_connections 2024-04-25T09:04:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.716+0000 7f8756cbc640 1 -- 172.21.15.5:0/586825840 wait complete. 2024-04-25T09:04:13.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:04:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.831+0000 7f5c53cf7640 1 Processor -- start 2024-04-25T09:04:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c53cf7640 1 -- start start 2024-04-25T09:04:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c53cf7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c53cf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c4c0cee10 0x7f5c4c0d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c53cf7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c162150 con 0x7f5c4c15df10 2024-04-25T09:04:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c53cf7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0d20d0 con 0x7f5c4c0cee10 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c53cf7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c162430 con 0x7f5c4c0b6250 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c52294640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c4c0cee10 0x7f5c4c0d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c52294640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c4c0cee10 0x7f5c4c0d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45314/0 (socket says 172.21.15.5:45314) 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.832+0000 7f5c52294640 1 -- 172.21.15.5:0/2659234698 learned_addr learned my addr 172.21.15.5:0/2659234698 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.833+0000 7f5c51292640 1 --2- 172.21.15.5:0/2659234698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.833+0000 7f5c52294640 1 -- 172.21.15.5:0/2659234698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 msgr2=0x7f5c4c0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.833+0000 7f5c52294640 1 --2- 172.21.15.5:0/2659234698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c0ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.833+0000 7f5c52294640 1 -- 172.21.15.5:0/2659234698 >> v1:172.21.15.80:6789/0 conn(0x7f5c4c15df10 legacy=0x7f5c4c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.833+0000 7f5c52294640 1 -- 172.21.15.5:0/2659234698 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c162710 con 0x7f5c4c0cee10 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.833+0000 7f5c52294640 1 --2- 172.21.15.5:0/2659234698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cee10 0x7f5c4c0d2560 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009870 tx=0x7f5c3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21142e116368a924 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c50a91640 1 -- 172.21.15.5:0/2659234698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c037070 con 0x7f5c4c0cee10 2024-04-25T09:04:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c50a91640 1 -- 172.21.15.5:0/2659234698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c032440 con 0x7f5c4c0cee10 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c50a91640 1 -- 172.21.15.5:0/2659234698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c032810 con 0x7f5c4c0cee10 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 -- 172.21.15.5:0/2659234698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cee10 msgr2=0x7f5c4c0d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/2659234698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cee10 0x7f5c4c0d2560 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009870 tx=0x7f5c3c02a210 comp rx=0 tx=0).stop 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 -- 172.21.15.5:0/2659234698 shutdown_connections 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/2659234698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c0cee10 0x7f5c4c0d2560 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/2659234698 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 -- 172.21.15.5:0/2659234698 >> 172.21.15.5:0/2659234698 conn(0x7f5c4c0668f0 msgr2=0x7f5c4c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 -- 172.21.15.5:0/2659234698 shutdown_connections 2024-04-25T09:04:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.834+0000 7f5c53cf7640 1 -- 172.21.15.5:0/2659234698 wait complete. 2024-04-25T09:04:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.835+0000 7f5c53cf7640 1 Processor -- start 2024-04-25T09:04:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.835+0000 7f5c53cf7640 1 -- start start 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c53cf7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c53cf7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c4c0cee10 0x7f5c4c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c53cf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c15df10 0x7f5c4c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c53cf7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0d2c20 con 0x7f5c4c15df10 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c53cf7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0d2aa0 con 0x7f5c4c0cee10 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c53cf7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0d2da0 con 0x7f5c4c0b6250 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c52294640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c15df10 0x7f5c4c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c52294640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c15df10 0x7f5c4c154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45318/0 (socket says 172.21.15.5:45318) 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c52294640 1 -- 172.21.15.5:0/3618116378 learned_addr learned my addr 172.21.15.5:0/3618116378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c51292640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c4c0cee10 0x7f5c4c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.836+0000 7f5c51a93640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c52294640 1 -- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 msgr2=0x7f5c4c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c52294640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c52294640 1 -- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c4c0cee10 msgr2=0x7f5c4c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c52294640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c4c0cee10 0x7f5c4c153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c52294640 1 -- 172.21.15.5:0/3618116378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0ca050 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c52294640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c15df10 0x7f5c4c154140 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009870 tx=0x7f5c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c4a7fc640 1 -- 172.21.15.5:0/3618116378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c037040 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c4a7fc640 1 -- 172.21.15.5:0/3618116378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c042070 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c159d00 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c4a7fc640 1 -- 172.21.15.5:0/3618116378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c030920 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.837+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c15a280 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.838+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c1e7ef0 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.839+0000 7f5c4a7fc640 1 -- 172.21.15.5:0/3618116378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c3c030ac0 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.839+0000 7f5c4a7fc640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c3806b4d0 0x7f5c3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.839+0000 7f5c4a7fc640 1 -- 172.21.15.5:0/3618116378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c3c0aa810 con 0x7f5c4c15df10 2024-04-25T09:04:13.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.839+0000 7f5c51a93640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c3806b4d0 0x7f5c3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.840+0000 7f5c51a93640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c3806b4d0 0x7f5c3806d990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0c8fd0 tx=0x7f5c440094d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:13.843+0000 7f5c4a7fc640 1 -- 172.21.15.5:0/3618116378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c4c1e7ef0 con 0x7f5c4c15df10 2024-04-25T09:04:14.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.025+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5c4c0d1910 con 0x7f5c4c15df10 2024-04-25T09:04:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.028+0000 7f5c4a7fc640 1 -- 172.21.15.5:0/3618116378 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5c3c079990 con 0x7f5c4c15df10 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c3806b4d0 msgr2=0x7f5c3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c3806b4d0 0x7f5c3806d990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0c8fd0 tx=0x7f5c440094d0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c15df10 msgr2=0x7f5c4c154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c15df10 0x7f5c4c154140 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009870 tx=0x7f5c3c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 shutdown_connections 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c3806b4d0 0x7f5c3806d990 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c4c15df10 0x7f5c4c154140 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c4c0cee10 0x7f5c4c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 --2- 172.21.15.5:0/3618116378 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5c4c0b6250 0x7f5c4c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 >> 172.21.15.5:0/3618116378 conn(0x7f5c4c0668f0 msgr2=0x7f5c4c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 shutdown_connections 2024-04-25T09:04:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.031+0000 7f5c53cf7640 1 -- 172.21.15.5:0/3618116378 wait complete. 2024-04-25T09:04:14.031 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:04:14.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:14.066 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:14.105 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:04:14.105 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:14.105 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:14.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:14.121 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:04:14.122 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:14.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:14.162 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:14.162 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:14.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:14.177 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:04:14.178 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:14.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:14.219 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:04:14.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:14.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.330+0000 7f4a5c24d640 1 Processor -- start 2024-04-25T09:04:14.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.331+0000 7f4a5c24d640 1 -- start start 2024-04-25T09:04:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.331+0000 7f4a5c24d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a54151460 0x7f4a5415b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.331+0000 7f4a5c24d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a540aed30 0x7f4a540b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.331+0000 7f4a5c24d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a54070e50 con 0x7f4a54151080 2024-04-25T09:04:14.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.331+0000 7f4a5c24d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a54070c00 con 0x7f4a54151460 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.331+0000 7f4a5c24d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54071a60 con 0x7f4a540aed30 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a597e8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a54151460 0x7f4a5415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a5a7ea640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a540aed30 0x7f4a540b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a59fe9640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4a54151080 0x7f4a54071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:49220/0 (socket says 172.21.15.5:49220) 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a59fe9640 1 -- 172.21.15.5:0/3970275394 learned_addr learned my addr 172.21.15.5:0/3970275394 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a597e8640 1 --2- 172.21.15.5:0/3970275394 >> v2:172.21.15.80:3300/0 conn(0x7f4a54151460 0x7f4a5415b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:49436/0 (socket says 172.21.15.5:49436) 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a597e8640 1 -- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a540aed30 msgr2=0x7f4a540b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a597e8640 1 --2- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a540aed30 0x7f4a540b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a597e8640 1 -- 172.21.15.5:0/3970275394 >> v1:172.21.15.80:6789/0 conn(0x7f4a54151080 legacy=0x7f4a54071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a597e8640 1 -- 172.21.15.5:0/3970275394 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54071130 con 0x7f4a54151460 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.332+0000 7f4a5a7ea640 1 --2- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a540aed30 0x7f4a540b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:14.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.333+0000 7f4a597e8640 1 --2- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151460 0x7f4a5415b230 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097a0 tx=0x7f4a4402a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d39c92ba4a61ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.333+0000 7f4a58fe7640 1 -- 172.21.15.5:0/3970275394 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44037070 con 0x7f4a54151460 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.333+0000 7f4a58fe7640 1 -- 172.21.15.5:0/3970275394 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4402ac90 con 0x7f4a54151460 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.333+0000 7f4a58fe7640 1 -- 172.21.15.5:0/3970275394 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44032660 con 0x7f4a54151460 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 -- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151460 msgr2=0x7f4a5415b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151460 0x7f4a5415b230 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097a0 tx=0x7f4a4402a000 comp rx=0 tx=0).stop 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 -- 172.21.15.5:0/3970275394 shutdown_connections 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a540aed30 0x7f4a540b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/3970275394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151460 0x7f4a5415b230 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 -- 172.21.15.5:0/3970275394 >> 172.21.15.5:0/3970275394 conn(0x7f4a540668f0 msgr2=0x7f4a54066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 -- 172.21.15.5:0/3970275394 shutdown_connections 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.334+0000 7f4a5c24d640 1 -- 172.21.15.5:0/3970275394 wait complete. 2024-04-25T09:04:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.335+0000 7f4a5c24d640 1 Processor -- start 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.335+0000 7f4a5c24d640 1 -- start start 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5c24d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a540aed30 0x7f4a540aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5c24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151080 0x7f4a5415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5c24d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a54151460 0x7f4a54159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5c24d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540b30a0 con 0x7f4a540aed30 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5c24d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540716f0 con 0x7f4a54151080 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5c24d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540b3220 con 0x7f4a54151460 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a540aed30 0x7f4a540aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a540aed30 0x7f4a540aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45334/0 (socket says 172.21.15.5:45334) 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 -- 172.21.15.5:0/470553665 learned_addr learned my addr 172.21.15.5:0/470553665 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5a7ea640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a54151460 0x7f4a54159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a597e8640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151080 0x7f4a5415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 -- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a54151460 msgr2=0x7f4a54159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a54151460 0x7f4a54159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 -- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151080 msgr2=0x7f4a5415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151080 0x7f4a5415c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 -- 172.21.15.5:0/470553665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5414dfb0 con 0x7f4a540aed30 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a59fe9640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a540aed30 0x7f4a540aa850 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c570 tx=0x7f4a5000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a4a7fc640 1 -- 172.21.15.5:0/470553665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50018070 con 0x7f4a540aed30 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a4a7fc640 1 -- 172.21.15.5:0/470553665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500074e0 con 0x7f4a540aed30 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5414e290 con 0x7f4a540aed30 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.336+0000 7f4a4a7fc640 1 -- 172.21.15.5:0/470553665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50004a20 con 0x7f4a540aed30 2024-04-25T09:04:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.337+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5414e850 con 0x7f4a540aed30 2024-04-25T09:04:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.338+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5404ef20 con 0x7f4a540aed30 2024-04-25T09:04:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.338+0000 7f4a4a7fc640 1 -- 172.21.15.5:0/470553665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a5001b070 con 0x7f4a540aed30 2024-04-25T09:04:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.338+0000 7f4a4a7fc640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4a3806b4d0 0x7f4a3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.338+0000 7f4a4a7fc640 1 -- 172.21.15.5:0/470553665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4a50089270 con 0x7f4a540aed30 2024-04-25T09:04:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.338+0000 7f4a597e8640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4a3806b4d0 0x7f4a3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.339+0000 7f4a597e8640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4a3806b4d0 0x7f4a3806d990 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4a44034000 tx=0x7f4a4402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.343+0000 7f4a4a7fc640 1 -- 172.21.15.5:0/470553665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a50058480 con 0x7f4a540aed30 2024-04-25T09:04:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.560+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a54072270 con 0x7f4a540aed30 2024-04-25T09:04:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.561+0000 7f4a4a7fc640 1 -- 172.21.15.5:0/470553665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3690 (secure 0 0 0) 0x7f4a50057d80 con 0x7f4a540aed30 2024-04-25T09:04:14.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2302171430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2302171430},{"type":"v1","addr":"172.21.15.80:6836","nonce":2302171430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6695,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3997947423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3997947423},{"type":"v1","addr":"172.21.15.80:6837","nonce":3997947423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3955726290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3955726290},{"type":"v1","addr":"172.21.15.5:6833","nonce":3955726290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/945194699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":945194699},{"type":"v1","addr":"172.21.15.5:6835","nonce":945194699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[]} 2024-04-25T09:04:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4a3806b4d0 msgr2=0x7f4a3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4a3806b4d0 0x7f4a3806d990 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4a44034000 tx=0x7f4a4402e000 comp rx=0 tx=0).stop 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a540aed30 msgr2=0x7f4a540aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a540aed30 0x7f4a540aa850 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c570 tx=0x7f4a5000ca30 comp rx=0 tx=0).stop 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 shutdown_connections 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4a3806b4d0 0x7f4a3806d990 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4a54151460 0x7f4a54159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.562+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54151080 0x7f4a5415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.563+0000 7f4a5c24d640 1 --2- 172.21.15.5:0/470553665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a540aed30 0x7f4a540aa850 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.563+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 >> 172.21.15.5:0/470553665 conn(0x7f4a540668f0 msgr2=0x7f4a5406d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.563+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 shutdown_connections 2024-04-25T09:04:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.563+0000 7f4a5c24d640 1 -- 172.21.15.5:0/470553665 wait complete. 2024-04-25T09:04:14.563 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:04:14.563 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:04:14.563 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:04:14.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:14.563 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:04:14.563 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:04:14.564 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:04:14.564 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:14.564 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:04:14.564 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:04:14.564 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:04:14.564 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:14.564 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:04:14.564 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:04:14.565 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:04:14.565 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:14.572 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:04:14.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:04:14.573 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:04:14.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:04:14.576 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:04:14.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:04:14.577 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:04:14.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:04:14.615 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:04:14.615 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:14.616 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:04:14.616 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:14.618 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:04:14.619 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:14.619 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:04:14.619 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:14.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:04:14.691 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:04:14.691 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:04:14.698 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:04:14.698 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:04:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.737+0000 7fb8ead7e640 1 Processor -- start 2024-04-25T09:04:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.737+0000 7fb8ead7e640 1 -- start start 2024-04-25T09:04:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.738+0000 7fb8ead7e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8e40d3990 0x7fb8e40d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.738+0000 7fb8ead7e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e40b29c0 con 0x7fb8e40b6f50 2024-04-25T09:04:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.738+0000 7fb8e3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8e40d3990 0x7fb8e40d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.738+0000 7fb8ead7e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e40d2080 con 0x7fb8e415e0a0 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.738+0000 7fb8e931b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb8e40b6f50 0x7fb8e40b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57208/0 (socket says 172.21.15.5:57208) 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.738+0000 7fb8ead7e640 1 -- 172.21.15.5:0/2056697367 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e40d4330 con 0x7fb8e40d3990 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.738+0000 7fb8e931b640 1 -- 172.21.15.5:0/2056697367 learned_addr learned my addr 172.21.15.5:0/2056697367 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.739+0000 7fb8e3fff640 1 -- 172.21.15.5:0/2056697367 >> v1:172.21.15.80:6789/0 conn(0x7fb8e415e0a0 legacy=0x7fb8e40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.739+0000 7fb8e3fff640 1 -- 172.21.15.5:0/2056697367 >> v1:172.21.15.5:6789/0 conn(0x7fb8e40b6f50 legacy=0x7fb8e40b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.739+0000 7fb8e37fe640 1 -- 172.21.15.5:0/2056697367 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53528867 0 0) 0x7fb8e40b29c0 con 0x7fb8e40b6f50 2024-04-25T09:04:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.739+0000 7fb8e3fff640 1 -- 172.21.15.5:0/2056697367 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40d2360 con 0x7fb8e40d3990 2024-04-25T09:04:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.739+0000 7fb8e3fff640 1 --2- 172.21.15.5:0/2056697367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e40d3990 0x7fb8e40d3df0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40097a0 tx=0x7fb8d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31700ae41ff687ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8e37fe640 1 -- 172.21.15.5:0/2056697367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4037070 con 0x7fb8e40d3990 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8e37fe640 1 -- 172.21.15.5:0/2056697367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d4032440 con 0x7fb8e40d3990 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8e37fe640 1 -- 172.21.15.5:0/2056697367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4032810 con 0x7fb8e40d3990 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8ead7e640 1 -- 172.21.15.5:0/2056697367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e40d3990 msgr2=0x7fb8e40d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/2056697367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e40d3990 0x7fb8e40d3df0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40097a0 tx=0x7fb8d402a230 comp rx=0 tx=0).stop 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8ead7e640 1 -- 172.21.15.5:0/2056697367 shutdown_connections 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/2056697367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e40d3990 0x7fb8e40d3df0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8ead7e640 1 -- 172.21.15.5:0/2056697367 >> 172.21.15.5:0/2056697367 conn(0x7fb8e40668f0 msgr2=0x7fb8e4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8ead7e640 1 -- 172.21.15.5:0/2056697367 shutdown_connections 2024-04-25T09:04:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.740+0000 7fb8ead7e640 1 -- 172.21.15.5:0/2056697367 wait complete. 2024-04-25T09:04:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.742+0000 7fb8ead7e640 1 Processor -- start 2024-04-25T09:04:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.742+0000 7fb8ead7e640 1 -- start start 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8ead7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8e40b6f50 0x7fb8e414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8ead7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e40d3990 0x7fb8e414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8ead7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e415e0a0 0x7fb8e414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8e8b1a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8e40b6f50 0x7fb8e414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8e8b1a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8e40b6f50 0x7fb8e414e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:33924/0 (socket says 172.21.15.5:33924) 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8e8b1a640 1 -- 172.21.15.5:0/3889459299 learned_addr learned my addr 172.21.15.5:0/3889459299 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40d2920 con 0x7fb8e415e0a0 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40d1460 con 0x7fb8e40d3990 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.743+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40d2c00 con 0x7fb8e40b6f50 2024-04-25T09:04:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e931b640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e415e0a0 0x7fb8e414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e3fff640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e40d3990 0x7fb8e414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e8b1a640 1 -- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e40d3990 msgr2=0x7fb8e414eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e8b1a640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e40d3990 0x7fb8e414eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e8b1a640 1 -- 172.21.15.5:0/3889459299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e415e0a0 msgr2=0x7fb8e414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e8b1a640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e415e0a0 0x7fb8e414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e8b1a640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e414dba0 con 0x7fb8e40b6f50 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.744+0000 7fb8e8b1a640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8e40b6f50 0x7fb8e414e960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00c870 tx=0x7fb8dc00cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.746+0000 7fb8e17fa640 1 -- 172.21.15.5:0/3889459299 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc003b70 con 0x7fb8e40b6f50 2024-04-25T09:04:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.746+0000 7fb8e17fa640 1 -- 172.21.15.5:0/3889459299 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc003d30 con 0x7fb8e40b6f50 2024-04-25T09:04:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.746+0000 7fb8e17fa640 1 -- 172.21.15.5:0/3889459299 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00aa90 con 0x7fb8e40b6f50 2024-04-25T09:04:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.746+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e414de80 con 0x7fb8e40b6f50 2024-04-25T09:04:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.746+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e414e440 con 0x7fb8e40b6f50 2024-04-25T09:04:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.747+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e404ef20 con 0x7fb8e40b6f50 2024-04-25T09:04:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.747+0000 7fb8e17fa640 1 -- 172.21.15.5:0/3889459299 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8dc00ac30 con 0x7fb8e40b6f50 2024-04-25T09:04:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.748+0000 7fb8e17fa640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8c406b500 0x7fb8c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.748+0000 7fb8e17fa640 1 -- 172.21.15.5:0/3889459299 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8dc089d90 con 0x7fb8e40b6f50 2024-04-25T09:04:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.748+0000 7fb8e3fff640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8c406b500 0x7fb8c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.748+0000 7fb8e3fff640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8c406b500 0x7fb8c406d9c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4034000 tx=0x7fb8d402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.754+0000 7fb8e17fa640 1 -- 172.21.15.5:0/3889459299 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8dc0588b0 con 0x7fb8e40b6f50 2024-04-25T09:04:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:14.947+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb8e4066f70 con 0x7fb8e40b6f50 2024-04-25T09:04:15.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.751+0000 7fb8e17fa640 1 -- 172.21.15.5:0/3889459299 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v107) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb8dc05c950 con 0x7fb8e40b6f50 2024-04-25T09:04:15.740 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8c406b500 msgr2=0x7fb8c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8c406b500 0x7fb8c406d9c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4034000 tx=0x7fb8d402e000 comp rx=0 tx=0).stop 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8e40b6f50 msgr2=0x7fb8e414e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8e40b6f50 0x7fb8e414e960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00c870 tx=0x7fb8dc00cd30 comp rx=0 tx=0).stop 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 shutdown_connections 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb8c406b500 0x7fb8c406d9c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e415e0a0 0x7fb8e414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e40d3990 0x7fb8e414eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 --2- 172.21.15.5:0/3889459299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8e40b6f50 0x7fb8e414e960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 >> 172.21.15.5:0/3889459299 conn(0x7fb8e40668f0 msgr2=0x7fb8e415d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 shutdown_connections 2024-04-25T09:04:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.754+0000 7fb8ead7e640 1 -- 172.21.15.5:0/3889459299 wait complete. 2024-04-25T09:04:15.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:04:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.876+0000 7f301e37e640 1 Processor -- start 2024-04-25T09:04:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.876+0000 7f301e37e640 1 -- start start 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f301e37e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f301806dd20 0x7f30180ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f301e37e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f30180b3860 0x7f30180aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f301e37e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30180b4bd0 con 0x7f3018156250 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f301e37e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30180b2850 con 0x7f301806dd20 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f301e37e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30180b2aa0 con 0x7f30180b3860 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f30177fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f301806dd20 0x7f30180ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f30177fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f301806dd20 0x7f30180ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45400/0 (socket says 172.21.15.5:45400) 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f30177fe640 1 -- 172.21.15.5:0/1310818668 learned_addr learned my addr 172.21.15.5:0/1310818668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f301c91b640 1 --2- 172.21.15.5:0/1310818668 >> v2:172.21.15.80:3300/0 conn(0x7f30180b3860 0x7f30180aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f30177fe640 1 -- 172.21.15.5:0/1310818668 >> v2:172.21.15.80:3300/0 conn(0x7f30180b3860 msgr2=0x7f30180aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f30177fe640 1 --2- 172.21.15.5:0/1310818668 >> v2:172.21.15.80:3300/0 conn(0x7f30180b3860 0x7f30180aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f30177fe640 1 -- 172.21.15.5:0/1310818668 >> v1:172.21.15.80:6789/0 conn(0x7f3018156250 legacy=0x7f30180b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.877+0000 7f30177fe640 1 -- 172.21.15.5:0/1310818668 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30180b2d80 con 0x7f301806dd20 2024-04-25T09:04:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.878+0000 7f30177fe640 1 --2- 172.21.15.5:0/1310818668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301806dd20 0x7f30180ae690 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f301806d750 tx=0x7f300c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c2886202095e80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.878+0000 7f3016ffd640 1 -- 172.21.15.5:0/1310818668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c037070 con 0x7f301806dd20 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.878+0000 7f3016ffd640 1 -- 172.21.15.5:0/1310818668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c032440 con 0x7f301806dd20 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.878+0000 7f3016ffd640 1 -- 172.21.15.5:0/1310818668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c032810 con 0x7f301806dd20 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 -- 172.21.15.5:0/1310818668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301806dd20 msgr2=0x7f30180ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 --2- 172.21.15.5:0/1310818668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301806dd20 0x7f30180ae690 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f301806d750 tx=0x7f300c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 -- 172.21.15.5:0/1310818668 shutdown_connections 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 --2- 172.21.15.5:0/1310818668 >> v2:172.21.15.80:3300/0 conn(0x7f30180b3860 0x7f30180aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 --2- 172.21.15.5:0/1310818668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301806dd20 0x7f30180ae690 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 -- 172.21.15.5:0/1310818668 >> 172.21.15.5:0/1310818668 conn(0x7f30180668f0 msgr2=0x7f3018066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 -- 172.21.15.5:0/1310818668 shutdown_connections 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.879+0000 7f301e37e640 1 -- 172.21.15.5:0/1310818668 wait complete. 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.880+0000 7f301e37e640 1 Processor -- start 2024-04-25T09:04:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.880+0000 7f301e37e640 1 -- start start 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301e37e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30180b3860 0x7f301814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301e37e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3018156250 0x7f3018070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301e37e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30181523f0 0x7f30180cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301e37e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301815d270 con 0x7f30181523f0 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301e37e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30180b3340 con 0x7f3018156250 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301e37e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301815d3f0 con 0x7f30180b3860 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30181523f0 0x7f30180cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30181523f0 0x7f30180cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45410/0 (socket says 172.21.15.5:45410) 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 -- 172.21.15.5:0/467719738 learned_addr learned my addr 172.21.15.5:0/467719738 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f30177fe640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3018156250 0x7f3018070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f3017fff640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30180b3860 0x7f301814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 -- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30180b3860 msgr2=0x7f301814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30180b3860 0x7f301814c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 -- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3018156250 msgr2=0x7f3018070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3018156250 0x7f3018070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 -- 172.21.15.5:0/467719738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018071780 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.881+0000 7f301c91b640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30181523f0 0x7f30180cee80 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f301000efc0 tx=0x7f301000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.882+0000 7f3014ff9640 1 -- 172.21.15.5:0/467719738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010018020 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.882+0000 7f3014ff9640 1 -- 172.21.15.5:0/467719738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010014480 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.882+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3018071a60 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.882+0000 7f3014ff9640 1 -- 172.21.15.5:0/467719738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010014870 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.882+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3018072020 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.883+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301804ef20 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.883+0000 7f3014ff9640 1 -- 172.21.15.5:0/467719738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3010005d10 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.883+0000 7f3014ff9640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f300406b4d0 0x7f300406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.884+0000 7f3014ff9640 1 -- 172.21.15.5:0/467719738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f301008ab50 con 0x7f30181523f0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.884+0000 7f3017fff640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f300406b4d0 0x7f300406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.884+0000 7f3017fff640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f300406b4d0 0x7f300406d990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f30080016e0 tx=0x7f3008009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:15.888+0000 7f3014ff9640 1 -- 172.21.15.5:0/467719738 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3010022030 con 0x7f30181523f0 2024-04-25T09:04:16.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.139+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3018066f00 con 0x7f30181523f0 2024-04-25T09:04:16.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.139+0000 7f3014ff9640 1 -- 172.21.15.5:0/467719738 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3010010040 con 0x7f30181523f0 2024-04-25T09:04:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:16.128 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:04:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T09:04:16.141 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f300406b4d0 msgr2=0x7f300406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f300406b4d0 0x7f300406d990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f30080016e0 tx=0x7f3008009040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30181523f0 msgr2=0x7f30180cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30181523f0 0x7f30180cee80 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f301000efc0 tx=0x7f301000c490 comp rx=0 tx=0).stop 2024-04-25T09:04:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 shutdown_connections 2024-04-25T09:04:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f300406b4d0 0x7f300406d990 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30181523f0 0x7f30180cee80 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3018156250 0x7f3018070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 --2- 172.21.15.5:0/467719738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30180b3860 0x7f301814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 >> 172.21.15.5:0/467719738 conn(0x7f30180668f0 msgr2=0x7f3018153580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 shutdown_connections 2024-04-25T09:04:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.141+0000 7f301e37e640 1 -- 172.21.15.5:0/467719738 wait complete. 2024-04-25T09:04:16.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.256+0000 7fe269807640 1 Processor -- start 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.256+0000 7fe269807640 1 -- start start 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe269807640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe269807640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2640ce7f0 0x7fe2640cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe269807640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640cf1c0 con 0x7fe2640b2cc0 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe269807640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640d2a10 con 0x7fe2640ce7f0 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe269807640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640d20e0 con 0x7fe26415de70 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe2637fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2640ce7f0 0x7fe2640cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe262ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe2637fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2640ce7f0 0x7fe2640cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:49530/0 (socket says 172.21.15.5:49530) 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.257+0000 7fe2637fe640 1 -- 172.21.15.5:0/1757308174 learned_addr learned my addr 172.21.15.5:0/1757308174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe2637fe640 1 -- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 msgr2=0x7fe2640b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe2637fe640 1 --2- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe2637fe640 1 -- 172.21.15.5:0/1757308174 >> v1:172.21.15.80:6789/0 conn(0x7fe2640b2cc0 legacy=0x7fe2640b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe2637fe640 1 -- 172.21.15.5:0/1757308174 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640d23c0 con 0x7fe2640ce7f0 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe261ffb640 1 -- 172.21.15.5:0/1757308174 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857114167 0 0) 0x7fe2640cf1c0 con 0x7fe2640b2cc0 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe262ffd640 1 --2- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe2637fe640 1 --2- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cec80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009e50 tx=0x7fe25c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d2446c81cb57f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.258+0000 7fe261ffb640 1 -- 172.21.15.5:0/1757308174 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c036070 con 0x7fe2640ce7f0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe261ffb640 1 -- 172.21.15.5:0/1757308174 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c031600 con 0x7fe2640ce7f0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe261ffb640 1 -- 172.21.15.5:0/1757308174 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0319d0 con 0x7fe2640ce7f0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 -- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640ce7f0 msgr2=0x7fe2640cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 --2- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cec80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009e50 tx=0x7fe25c02a710 comp rx=0 tx=0).stop 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 -- 172.21.15.5:0/1757308174 shutdown_connections 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 --2- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cec80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 --2- 172.21.15.5:0/1757308174 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 -- 172.21.15.5:0/1757308174 >> 172.21.15.5:0/1757308174 conn(0x7fe26406b000 msgr2=0x7fe26406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 -- 172.21.15.5:0/1757308174 shutdown_connections 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.259+0000 7fe269807640 1 -- 172.21.15.5:0/1757308174 wait complete. 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.260+0000 7fe269807640 1 Processor -- start 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.260+0000 7fe269807640 1 -- start start 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe269807640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640b2cc0 0x7fe264149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe269807640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe269807640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe269807640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640b7300 con 0x7fe2640ce7f0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe269807640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640b9920 con 0x7fe2640b2cc0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe269807640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640d2ea0 con 0x7fe26415de70 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45416/0 (socket says 172.21.15.5:45416) 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 -- 172.21.15.5:0/929347179 learned_addr learned my addr 172.21.15.5:0/929347179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe262ffd640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640b2cc0 0x7fe264149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2637fe640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 -- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 msgr2=0x7fe2640cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 -- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640b2cc0 msgr2=0x7fe264149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640b2cc0 0x7fe264149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe2627fc640 1 -- 172.21.15.5:0/929347179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640cbc70 con 0x7fe2640ce7f0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.261+0000 7fe262ffd640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640b2cc0 0x7fe264149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.262+0000 7fe2627fc640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cb580 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c4e0 tx=0x7fe24c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.262+0000 7fe25bfff640 1 -- 172.21.15.5:0/929347179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c017070 con 0x7fe2640ce7f0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.262+0000 7fe25bfff640 1 -- 172.21.15.5:0/929347179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c0035f0 con 0x7fe2640ce7f0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.262+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2640cbf50 con 0x7fe2640ce7f0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.262+0000 7fe25bfff640 1 -- 172.21.15.5:0/929347179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0039e0 con 0x7fe2640ce7f0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.262+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2640cc510 con 0x7fe2640ce7f0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.263+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26404ef20 con 0x7fe2640ce7f0 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.263+0000 7fe25bfff640 1 -- 172.21.15.5:0/929347179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe24c01a070 con 0x7fe2640ce7f0 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.264+0000 7fe25bfff640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24406b500 0x7fe24406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.264+0000 7fe25bfff640 1 -- 172.21.15.5:0/929347179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe24c089160 con 0x7fe2640ce7f0 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.264+0000 7fe262ffd640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24406b500 0x7fe24406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.264+0000 7fe262ffd640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24406b500 0x7fe24406d9c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe254009af0 tx=0x7fe254008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.268+0000 7fe25bfff640 1 -- 172.21.15.5:0/929347179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe24c057ce0 con 0x7fe2640ce7f0 2024-04-25T09:04:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.448+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2640ced70 con 0x7fe2640ce7f0 2024-04-25T09:04:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.449+0000 7fe25bfff640 1 -- 172.21.15.5:0/929347179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+12809 (secure 0 0 0) 0x7fe24c05bd80 con 0x7fe2640ce7f0 2024-04-25T09:04:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:16.438 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":107,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:15.748214+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24406b500 msgr2=0x7fe24406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24406b500 0x7fe24406d9c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe254009af0 tx=0x7fe254008040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2640ce7f0 msgr2=0x7fe2640cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cb580 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c4e0 tx=0x7fe24c00c9a0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 shutdown_connections 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe24406b500 0x7fe24406d9c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe26415de70 0x7fe2640cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2640ce7f0 0x7fe2640cb580 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 --2- 172.21.15.5:0/929347179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2640b2cc0 0x7fe264149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 >> 172.21.15.5:0/929347179 conn(0x7fe26406b000 msgr2=0x7fe2640d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 shutdown_connections 2024-04-25T09:04:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.451+0000 7fe269807640 1 -- 172.21.15.5:0/929347179 wait complete. 2024-04-25T09:04:16.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:16.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.566+0000 7f0ccb7b0640 1 Processor -- start 2024-04-25T09:04:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0ccb7b0640 1 -- start start 2024-04-25T09:04:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0ccb7b0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0cc40ce1c0 0x7f0cc40d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0ccb7b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0ccb7b0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc415e260 con 0x7f0cc415de80 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0ccb7b0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc40d3770 con 0x7f0cc40ce1c0 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0ccb7b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40d1ef0 con 0x7f0cc40d2dc0 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0cc8d4b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0cc40ce1c0 0x7f0cc40d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.567+0000 7f0cc8d4b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0cc40ce1c0 0x7f0cc40d2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45430/0 (socket says 172.21.15.5:45430) 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.568+0000 7f0cc8d4b640 1 -- 172.21.15.5:0/1191561704 learned_addr learned my addr 172.21.15.5:0/1191561704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.568+0000 7f0cc9d4d640 1 --2- 172.21.15.5:0/1191561704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.568+0000 7f0cc8d4b640 1 -- 172.21.15.5:0/1191561704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 msgr2=0x7f0cc40d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.568+0000 7f0cc8d4b640 1 --2- 172.21.15.5:0/1191561704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.568+0000 7f0cc8d4b640 1 -- 172.21.15.5:0/1191561704 >> v1:172.21.15.80:6789/0 conn(0x7f0cc415de80 legacy=0x7f0cc40ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.568+0000 7f0cc8d4b640 1 -- 172.21.15.5:0/1191561704 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40d18c0 con 0x7f0cc40ce1c0 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.568+0000 7f0cc8d4b640 1 --2- 172.21.15.5:0/1191561704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ce1c0 0x7f0cc40d2380 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4009870 tx=0x7f0cb402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1e01b0af8a811f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0cbbfff640 1 -- 172.21.15.5:0/1191561704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4037070 con 0x7f0cc40ce1c0 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0cbbfff640 1 -- 172.21.15.5:0/1191561704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb4032440 con 0x7f0cc40ce1c0 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0cbbfff640 1 -- 172.21.15.5:0/1191561704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4032810 con 0x7f0cc40ce1c0 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/1191561704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ce1c0 msgr2=0x7f0cc40d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/1191561704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ce1c0 0x7f0cc40d2380 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4009870 tx=0x7f0cb402a1c0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/1191561704 shutdown_connections 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/1191561704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/1191561704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ce1c0 0x7f0cc40d2380 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/1191561704 >> 172.21.15.5:0/1191561704 conn(0x7f0cc406b000 msgr2=0x7f0cc406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/1191561704 shutdown_connections 2024-04-25T09:04:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.569+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/1191561704 wait complete. 2024-04-25T09:04:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.570+0000 7f0ccb7b0640 1 Processor -- start 2024-04-25T09:04:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0ccb7b0640 1 -- start start 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0ccb7b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cc40ce1c0 0x7f0cc4155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0ccb7b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0ccb7b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415de80 0x7f0cc40cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0ccb7b0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40d28c0 con 0x7f0cc415de80 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0ccb7b0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40d1b80 con 0x7f0cc40ce1c0 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0ccb7b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40b6cf0 con 0x7f0cc40d2dc0 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0cc9d4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415de80 0x7f0cc40cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0cc9d4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415de80 0x7f0cc40cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45444/0 (socket says 172.21.15.5:45444) 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.571+0000 7f0cc9d4d640 1 -- 172.21.15.5:0/952008773 learned_addr learned my addr 172.21.15.5:0/952008773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc8d4b640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc954c640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cc40ce1c0 0x7f0cc4155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc9d4d640 1 -- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 msgr2=0x7f0cc40b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc9d4d640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc9d4d640 1 -- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cc40ce1c0 msgr2=0x7f0cc4155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc9d4d640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cc40ce1c0 0x7f0cc4155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc9d4d640 1 -- 172.21.15.5:0/952008773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4155580 con 0x7f0cc415de80 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cc9d4d640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415de80 0x7f0cc40cac40 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007e40 tx=0x7f0cbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cb9ffb640 1 -- 172.21.15.5:0/952008773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc014620 con 0x7f0cc415de80 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cb9ffb640 1 -- 172.21.15.5:0/952008773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc019070 con 0x7f0cc415de80 2024-04-25T09:04:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc40b53b0 con 0x7f0cc415de80 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0cb9ffb640 1 -- 172.21.15.5:0/952008773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc014a20 con 0x7f0cc415de80 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.572+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc40b5970 con 0x7f0cc415de80 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.573+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc404ef20 con 0x7f0cc415de80 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.574+0000 7f0cb9ffb640 1 -- 172.21.15.5:0/952008773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cbc014bc0 con 0x7f0cc415de80 2024-04-25T09:04:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.574+0000 7f0cb9ffb640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ca806b4d0 0x7f0ca806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.574+0000 7f0cb9ffb640 1 -- 172.21.15.5:0/952008773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cbc08a5c0 con 0x7f0cc415de80 2024-04-25T09:04:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.574+0000 7f0cc954c640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ca806b4d0 0x7f0ca806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.575+0000 7f0cc954c640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ca806b4d0 0x7f0ca806d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40cd960 tx=0x7f0cc0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.578+0000 7f0cb9ffb640 1 -- 172.21.15.5:0/952008773 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0cbc0591d0 con 0x7f0cc415de80 2024-04-25T09:04:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.762+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cc40b8480 con 0x7f0cc415de80 2024-04-25T09:04:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.762+0000 7f0cb9ffb640 1 -- 172.21.15.5:0/952008773 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cbc05d270 con 0x7f0cc415de80 2024-04-25T09:04:16.751 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ca806b4d0 msgr2=0x7f0ca806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ca806b4d0 0x7f0ca806d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40cd960 tx=0x7f0cc0009040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415de80 msgr2=0x7f0cc40cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415de80 0x7f0cc40cac40 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007e40 tx=0x7f0cbc00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 shutdown_connections 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ca806b4d0 0x7f0ca806d990 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415de80 0x7f0cc40cac40 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cc40d2dc0 0x7f0cc40b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 --2- 172.21.15.5:0/952008773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cc40ce1c0 0x7f0cc4155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 >> 172.21.15.5:0/952008773 conn(0x7f0cc406b000 msgr2=0x7f0cc40cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 shutdown_connections 2024-04-25T09:04:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.765+0000 7f0ccb7b0640 1 -- 172.21.15.5:0/952008773 wait complete. 2024-04-25T09:04:16.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:04:16.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.877+0000 7f60f4d7e640 1 Processor -- start 2024-04-25T09:04:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.877+0000 7f60f4d7e640 1 -- start start 2024-04-25T09:04:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.877+0000 7f60f4d7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f00cea80 0x7f60f015f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60f4d7e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60f015fd80 0x7f60f006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60f4d7e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f015ef10 con 0x7f60f006adf0 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60f4d7e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f00cfd60 con 0x7f60f015fd80 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60f4d7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f015f480 con 0x7f60f00cea80 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60e7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60f015fd80 0x7f60f006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f00cea80 0x7f60f015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60eed9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f60f006adf0 0x7f60f00d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:49274/0 (socket says 172.21.15.5:49274) 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60eed9d640 1 -- 172.21.15.5:0/2204035322 learned_addr learned my addr 172.21.15.5:0/2204035322 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60e7fff640 1 -- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f00cea80 msgr2=0x7f60f015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60e7fff640 1 --2- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f00cea80 0x7f60f015f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60e7fff640 1 -- 172.21.15.5:0/2204035322 >> v1:172.21.15.80:6789/0 conn(0x7f60f006adf0 legacy=0x7f60f00d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60e7fff640 1 -- 172.21.15.5:0/2204035322 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f015f1a0 con 0x7f60f015fd80 2024-04-25T09:04:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.878+0000 7f60ee59c640 1 --2- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f00cea80 0x7f60f015f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.879+0000 7f60e7fff640 1 --2- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f015fd80 0x7f60f006b5f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f60d80097a0 tx=0x7f60d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c8ee1c67ed78e7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.879+0000 7f60edd9b640 1 -- 172.21.15.5:0/2204035322 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8037070 con 0x7f60f015fd80 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.879+0000 7f60edd9b640 1 -- 172.21.15.5:0/2204035322 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8032440 con 0x7f60f015fd80 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.879+0000 7f60edd9b640 1 -- 172.21.15.5:0/2204035322 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8032810 con 0x7f60f015fd80 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 -- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f015fd80 msgr2=0x7f60f006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f015fd80 0x7f60f006b5f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f60d80097a0 tx=0x7f60d802a180 comp rx=0 tx=0).stop 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 -- 172.21.15.5:0/2204035322 shutdown_connections 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f015fd80 0x7f60f006b5f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/2204035322 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f00cea80 0x7f60f015f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 -- 172.21.15.5:0/2204035322 >> 172.21.15.5:0/2204035322 conn(0x7f60f00d19f0 msgr2=0x7f60f00d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 -- 172.21.15.5:0/2204035322 shutdown_connections 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.880+0000 7f60f4d7e640 1 -- 172.21.15.5:0/2204035322 wait complete. 2024-04-25T09:04:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.881+0000 7f60f4d7e640 1 Processor -- start 2024-04-25T09:04:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.881+0000 7f60f4d7e640 1 -- start start 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60f4d7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f006adf0 0x7f60f00c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60f4d7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f00cea80 0x7f60f01f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60f4d7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60f01f4020 0x7f60f006ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60f4d7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f00d1660 con 0x7f60f01f4020 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60f4d7e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f00d0270 con 0x7f60f00cea80 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60f4d7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f00d17e0 con 0x7f60f006adf0 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60f01f4020 0x7f60f006ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60f01f4020 0x7f60f006ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45458/0 (socket says 172.21.15.5:45458) 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 -- 172.21.15.5:0/161945765 learned_addr learned my addr 172.21.15.5:0/161945765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60ee59c640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f006adf0 0x7f60f00c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60e7fff640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f00cea80 0x7f60f01f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 -- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f006adf0 msgr2=0x7f60f00c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f006adf0 0x7f60f00c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 -- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f00cea80 msgr2=0x7f60f01f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f00cea80 0x7f60f01f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60eed9d640 1 -- 172.21.15.5:0/161945765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00b5d80 con 0x7f60f01f4020 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60ee59c640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f006adf0 0x7f60f00c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.882+0000 7f60e7fff640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f00cea80 0x7f60f01f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.883+0000 7f60eed9d640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60f01f4020 0x7f60f006ebb0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f60e800cbc0 tx=0x7f60e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.883+0000 7f60e6ffd640 1 -- 172.21.15.5:0/161945765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8017070 con 0x7f60f01f4020 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.883+0000 7f60e6ffd640 1 -- 172.21.15.5:0/161945765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800ad40 con 0x7f60f01f4020 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.883+0000 7f60e6ffd640 1 -- 172.21.15.5:0/161945765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8012600 con 0x7f60f01f4020 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.883+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f00b6060 con 0x7f60f01f4020 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.883+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f00b6620 con 0x7f60f01f4020 2024-04-25T09:04:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.884+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f0075050 con 0x7f60f01f4020 2024-04-25T09:04:16.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.884+0000 7f60e6ffd640 1 -- 172.21.15.5:0/161945765 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f60e801a070 con 0x7f60f01f4020 2024-04-25T09:04:16.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.885+0000 7f60e6ffd640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f60d006b4d0 0x7f60d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.885+0000 7f60e6ffd640 1 -- 172.21.15.5:0/161945765 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60e8089b60 con 0x7f60f01f4020 2024-04-25T09:04:16.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.885+0000 7f60ee59c640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f60d006b4d0 0x7f60d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.885+0000 7f60ee59c640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f60d006b4d0 0x7f60d006d990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009ac0 tx=0x7f60e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:16.889+0000 7f60e6ffd640 1 -- 172.21.15.5:0/161945765 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60f0075050 con 0x7f60f01f4020 2024-04-25T09:04:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.070+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60f006c270 con 0x7f60f01f4020 2024-04-25T09:04:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.070+0000 7f60e6ffd640 1 -- 172.21.15.5:0/161945765 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v107) v1 ==== 84+0+65 (secure 0 0 0) 0x7f60f006c270 con 0x7f60f01f4020 2024-04-25T09:04:17.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:17.059 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T09:04:17.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:04:17.059 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T09:04:17.060 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T09:04:17.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:17.060 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f60d006b4d0 msgr2=0x7f60d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f60d006b4d0 0x7f60d006d990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009ac0 tx=0x7f60e0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60f01f4020 msgr2=0x7f60f006ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60f01f4020 0x7f60f006ebb0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f60e800cbc0 tx=0x7f60e800a430 comp rx=0 tx=0).stop 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 shutdown_connections 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f60d006b4d0 0x7f60d006d990 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60f01f4020 0x7f60f006ebb0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60f00cea80 0x7f60f01f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 --2- 172.21.15.5:0/161945765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f60f006adf0 0x7f60f00c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 >> 172.21.15.5:0/161945765 conn(0x7f60f00d19f0 msgr2=0x7f60f006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 shutdown_connections 2024-04-25T09:04:17.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.072+0000 7f60f4d7e640 1 -- 172.21.15.5:0/161945765 wait complete. 2024-04-25T09:04:17.072 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:04:17.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:04:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.189+0000 7fae7ee2a640 1 Processor -- start 2024-04-25T09:04:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.189+0000 7fae7ee2a640 1 -- start start 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae7ee2a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae780d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae7ee2a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae780d0920 0x7fae780d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae7ee2a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae780b6ed0 con 0x7fae780d2500 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae7ee2a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae781619f0 con 0x7fae780d0920 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae7ee2a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780b74c0 con 0x7fae78161610 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae77fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae780d0920 0x7fae780d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae7d3c7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fae780d2500 0x7fae780b54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57212/0 (socket says 172.21.15.5:57212) 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.190+0000 7fae7d3c7640 1 -- 172.21.15.5:0/166049145 learned_addr learned my addr 172.21.15.5:0/166049145 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.191+0000 7fae7cbc6640 1 --2- 172.21.15.5:0/166049145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae780d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.191+0000 7fae77fff640 1 -- 172.21.15.5:0/166049145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 msgr2=0x7fae780d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.191+0000 7fae77fff640 1 --2- 172.21.15.5:0/166049145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae780d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.191+0000 7fae77fff640 1 -- 172.21.15.5:0/166049145 >> v1:172.21.15.5:6789/0 conn(0x7fae780d2500 legacy=0x7fae780b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.191+0000 7fae777fe640 1 -- 172.21.15.5:0/166049145 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609439785 0 0) 0x7fae70001490 con 0x7fae780d2500 2024-04-25T09:04:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.191+0000 7fae77fff640 1 -- 172.21.15.5:0/166049145 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780d0d80 con 0x7fae780d0920 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.192+0000 7fae77fff640 1 --2- 172.21.15.5:0/166049145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d0920 0x7fae780d1fc0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fae640097a0 tx=0x7fae6402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5ef1a8891cdc06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.192+0000 7fae777fe640 1 -- 172.21.15.5:0/166049145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64037070 con 0x7fae780d0920 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.192+0000 7fae777fe640 1 -- 172.21.15.5:0/166049145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6402ae50 con 0x7fae780d0920 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.192+0000 7fae777fe640 1 -- 172.21.15.5:0/166049145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64032660 con 0x7fae780d0920 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 -- 172.21.15.5:0/166049145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d0920 msgr2=0x7fae780d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/166049145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d0920 0x7fae780d1fc0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fae640097a0 tx=0x7fae6402a100 comp rx=0 tx=0).stop 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 -- 172.21.15.5:0/166049145 shutdown_connections 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/166049145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d0920 0x7fae780d1fc0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/166049145 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae780d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 -- 172.21.15.5:0/166049145 >> 172.21.15.5:0/166049145 conn(0x7fae780668f0 msgr2=0x7fae78066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 -- 172.21.15.5:0/166049145 shutdown_connections 2024-04-25T09:04:17.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.193+0000 7fae7ee2a640 1 -- 172.21.15.5:0/166049145 wait complete. 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.194+0000 7fae7ee2a640 1 Processor -- start 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.194+0000 7fae7ee2a640 1 -- start start 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7ee2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae780d0920 0x7fae78150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7ee2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d2500 0x7fae781e6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7ee2a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae781f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7ee2a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780b7150 con 0x7fae780d2500 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7ee2a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780d3070 con 0x7fae780d0920 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7ee2a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780d2970 con 0x7fae78161610 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d2500 0x7fae781e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d2500 0x7fae781e6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45488/0 (socket says 172.21.15.5:45488) 2024-04-25T09:04:17.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 -- 172.21.15.5:0/1712750044 learned_addr learned my addr 172.21.15.5:0/1712750044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7cbc6640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae780d0920 0x7fae78150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae7d3c7640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae781f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 -- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 msgr2=0x7fae781f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae781f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 -- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae780d0920 msgr2=0x7fae78150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae780d0920 0x7fae78150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.195+0000 7fae77fff640 1 -- 172.21.15.5:0/1712750044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780c9110 con 0x7fae780d2500 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.196+0000 7fae77fff640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d2500 0x7fae781e6890 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fae64035040 tx=0x7fae640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.196+0000 7fae757fa640 1 -- 172.21.15.5:0/1712750044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64041070 con 0x7fae780d2500 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.196+0000 7fae757fa640 1 -- 172.21.15.5:0/1712750044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6403c460 con 0x7fae780d2500 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.196+0000 7fae757fa640 1 -- 172.21.15.5:0/1712750044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64037040 con 0x7fae780d2500 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.196+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae780c93f0 con 0x7fae780d2500 2024-04-25T09:04:17.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.196+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae780c99b0 con 0x7fae780d2500 2024-04-25T09:04:17.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.197+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae78068550 con 0x7fae780d2500 2024-04-25T09:04:17.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.198+0000 7fae757fa640 1 -- 172.21.15.5:0/1712750044 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae6403a070 con 0x7fae780d2500 2024-04-25T09:04:17.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.198+0000 7fae757fa640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fae5c06b4d0 0x7fae5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.198+0000 7fae757fa640 1 -- 172.21.15.5:0/1712750044 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae640aa6a0 con 0x7fae780d2500 2024-04-25T09:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.198+0000 7fae7cbc6640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fae5c06b4d0 0x7fae5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.199+0000 7fae7cbc6640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fae5c06b4d0 0x7fae5c06d990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009aa0 tx=0x7fae6c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.202+0000 7fae757fa640 1 -- 172.21.15.5:0/1712750044 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae78068550 con 0x7fae780d2500 2024-04-25T09:04:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.382+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fae7804ef20 con 0x7fae780d2500 2024-04-25T09:04:17.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:17.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:17.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.757+0000 7fae757fa640 1 -- 172.21.15.5:0/1712750044 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v108) v1 ==== 138+0+0 (secure 0 0 0) 0x7fae640794b0 con 0x7fae780d2500 2024-04-25T09:04:17.746 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T09:04:17.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fae5c06b4d0 msgr2=0x7fae5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fae5c06b4d0 0x7fae5c06d990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009aa0 tx=0x7fae6c009190 comp rx=0 tx=0).stop 2024-04-25T09:04:17.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d2500 msgr2=0x7fae781e6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d2500 0x7fae781e6890 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fae64035040 tx=0x7fae640046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 shutdown_connections 2024-04-25T09:04:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fae5c06b4d0 0x7fae5c06d990 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fae78161610 0x7fae781f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae780d2500 0x7fae781e6890 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 --2- 172.21.15.5:0/1712750044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae780d0920 0x7fae78150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.759+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 >> 172.21.15.5:0/1712750044 conn(0x7fae780668f0 msgr2=0x7fae780cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.760+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 shutdown_connections 2024-04-25T09:04:17.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.761+0000 7fae7ee2a640 1 -- 172.21.15.5:0/1712750044 wait complete. 2024-04-25T09:04:17.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:04:17.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.886+0000 7ff56d26f640 1 Processor -- start 2024-04-25T09:04:17.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.886+0000 7ff56d26f640 1 -- start start 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff56d26f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5680b43d0 0x7ff5680ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff56d26f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56815a720 con 0x7ff56815a340 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff56d26f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680aeef0 con 0x7ff56815e880 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff56d26f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680af1d0 con 0x7ff5680b43d0 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff5667fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5680b43d0 0x7ff5680ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff5667fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5680b43d0 0x7ff5680ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45494/0 (socket says 172.21.15.5:45494) 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff566ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff56815a340 0x7ff5680b3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57216/0 (socket says 172.21.15.5:57216) 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff5667fc640 1 -- 172.21.15.5:0/706276929 learned_addr learned my addr 172.21.15.5:0/706276929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff5667fc640 1 -- 172.21.15.5:0/706276929 >> v1:172.21.15.80:6789/0 conn(0x7ff56815e880 legacy=0x7ff5680ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:17.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff5667fc640 1 -- 172.21.15.5:0/706276929 >> v1:172.21.15.5:6789/0 conn(0x7ff56815a340 legacy=0x7ff5680b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff5667fc640 1 -- 172.21.15.5:0/706276929 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680d0090 con 0x7ff5680b43d0 2024-04-25T09:04:17.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.887+0000 7ff565ffb640 1 -- 172.21.15.5:0/706276929 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907192444 0 0) 0x7ff56815a720 con 0x7ff56815a340 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.888+0000 7ff5667fc640 1 --2- 172.21.15.5:0/706276929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5680b43d0 0x7ff5680ce5f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00aa10 tx=0x7ff55c02b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccfba5c4069a3db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.888+0000 7ff565ffb640 1 -- 172.21.15.5:0/706276929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00b040 con 0x7ff5680b43d0 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.888+0000 7ff565ffb640 1 -- 172.21.15.5:0/706276929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c02be50 con 0x7ff5680b43d0 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.888+0000 7ff565ffb640 1 -- 172.21.15.5:0/706276929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c030930 con 0x7ff5680b43d0 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.889+0000 7ff56d26f640 1 -- 172.21.15.5:0/706276929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5680b43d0 msgr2=0x7ff5680ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.889+0000 7ff56d26f640 1 --2- 172.21.15.5:0/706276929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5680b43d0 0x7ff5680ce5f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00aa10 tx=0x7ff55c02b670 comp rx=0 tx=0).stop 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.889+0000 7ff56d26f640 1 -- 172.21.15.5:0/706276929 shutdown_connections 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.889+0000 7ff56d26f640 1 --2- 172.21.15.5:0/706276929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5680b43d0 0x7ff5680ce5f0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.889+0000 7ff56d26f640 1 -- 172.21.15.5:0/706276929 >> 172.21.15.5:0/706276929 conn(0x7ff5680b1550 msgr2=0x7ff5680b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.889+0000 7ff56d26f640 1 -- 172.21.15.5:0/706276929 shutdown_connections 2024-04-25T09:04:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.889+0000 7ff56d26f640 1 -- 172.21.15.5:0/706276929 wait complete. 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.890+0000 7ff56d26f640 1 Processor -- start 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.890+0000 7ff56d26f640 1 -- start start 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff56d26f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5680b43d0 0x7ff568147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff56d26f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff56815a340 0x7ff56814a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff56d26f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff56815e880 0x7ff568148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff56d26f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680703a0 con 0x7ff56815a340 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff56d26f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680725b0 con 0x7ff5680b43d0 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff56d26f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff568071ed0 con 0x7ff56815e880 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff56815a340 0x7ff56814a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff56815a340 0x7ff56814a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45496/0 (socket says 172.21.15.5:45496) 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 -- 172.21.15.5:0/347642758 learned_addr learned my addr 172.21.15.5:0/347642758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff566ffd640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5680b43d0 0x7ff568147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 -- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff56815e880 msgr2=0x7ff568148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5677fe640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff56815e880 0x7ff568148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff56815e880 0x7ff568148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 -- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5680b43d0 msgr2=0x7ff568147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5680b43d0 0x7ff568147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff5667fc640 1 -- 172.21.15.5:0/347642758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff568147540 con 0x7ff56815a340 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.891+0000 7ff566ffd640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5680b43d0 0x7ff568147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.892+0000 7ff5667fc640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff56815a340 0x7ff56814a2a0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00aa10 tx=0x7ff55c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.892+0000 7ff54f7fe640 1 -- 172.21.15.5:0/347642758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c004230 con 0x7ff56815a340 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.892+0000 7ff54f7fe640 1 -- 172.21.15.5:0/347642758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c0043f0 con 0x7ff56815a340 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.892+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56814a7e0 con 0x7ff56815a340 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.892+0000 7ff54f7fe640 1 -- 172.21.15.5:0/347642758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03b940 con 0x7ff56815a340 2024-04-25T09:04:17.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.892+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff568148000 con 0x7ff56815a340 2024-04-25T09:04:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.893+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56804ef20 con 0x7ff56815a340 2024-04-25T09:04:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.894+0000 7ff54f7fe640 1 -- 172.21.15.5:0/347642758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff55c03bae0 con 0x7ff56815a340 2024-04-25T09:04:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.894+0000 7ff54f7fe640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff55406b4d0 0x7ff55406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.894+0000 7ff54f7fe640 1 -- 172.21.15.5:0/347642758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff55c0aaa60 con 0x7ff56815a340 2024-04-25T09:04:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.894+0000 7ff566ffd640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff55406b4d0 0x7ff55406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.895+0000 7ff566ffd640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff55406b4d0 0x7ff55406d990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff558000f60 tx=0x7ff558009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:17.899+0000 7ff54f7fe640 1 -- 172.21.15.5:0/347642758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff55c041020 con 0x7ff56815a340 2024-04-25T09:04:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.099+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff56806e120 con 0x7ff56815a340 2024-04-25T09:04:18.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.762+0000 7ff54f7fe640 1 -- 172.21.15.5:0/347642758 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v109) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff55c079be0 con 0x7ff56815a340 2024-04-25T09:04:18.751 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T09:04:18.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff55406b4d0 msgr2=0x7ff55406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff55406b4d0 0x7ff55406d990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff558000f60 tx=0x7ff558009040 comp rx=0 tx=0).stop 2024-04-25T09:04:18.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff56815a340 msgr2=0x7ff56814a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff56815a340 0x7ff56814a2a0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00aa10 tx=0x7ff55c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 shutdown_connections 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff55406b4d0 0x7ff55406d990 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff56815e880 0x7ff568148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff56815a340 0x7ff56814a2a0 secure :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00aa10 tx=0x7ff55c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 --2- 172.21.15.5:0/347642758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5680b43d0 0x7ff568147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.765+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 >> 172.21.15.5:0/347642758 conn(0x7ff5680b1550 msgr2=0x7ff568071670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.766+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 shutdown_connections 2024-04-25T09:04:18.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.766+0000 7ff56d26f640 1 -- 172.21.15.5:0/347642758 wait complete. 2024-04-25T09:04:18.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:04:18.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.893+0000 7f21e04f5640 1 Processor -- start 2024-04-25T09:04:18.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.893+0000 7f21e04f5640 1 -- start start 2024-04-25T09:04:18.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21e04f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 0x7f21d80b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21e04f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21d80b2850 0x7f21d80aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21e04f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d8072690 con 0x7f21d80ce190 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21e04f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d8071ff0 con 0x7f21d80b2850 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21e04f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80b2cb0 con 0x7f21d80ae690 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21dda90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21d80b2850 0x7f21d80aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21dda90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21d80b2850 0x7f21d80aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45508/0 (socket says 172.21.15.5:45508) 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21dda90640 1 -- 172.21.15.5:0/4131628458 learned_addr learned my addr 172.21.15.5:0/4131628458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.894+0000 7f21dea92640 1 --1- 172.21.15.5:0/4131628458 >> v1:172.21.15.5:6789/0 conn(0x7f21d80ce190 0x7f21d80cefd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57220/0 (socket says 172.21.15.5:57220) 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.895+0000 7f21dda90640 1 -- 172.21.15.5:0/4131628458 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 msgr2=0x7f21d80b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.895+0000 7f21dda90640 1 --2- 172.21.15.5:0/4131628458 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 0x7f21d80b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.895+0000 7f21dda90640 1 -- 172.21.15.5:0/4131628458 >> v1:172.21.15.5:6789/0 conn(0x7f21d80ce190 legacy=0x7f21d80cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.895+0000 7f21dda90640 1 -- 172.21.15.5:0/4131628458 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80aefb0 con 0x7f21d80b2850 2024-04-25T09:04:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.895+0000 7f21dd28f640 1 -- 172.21.15.5:0/4131628458 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706941348 0 0) 0x7f21d8072690 con 0x7f21d80ce190 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.895+0000 7f21dda90640 1 --2- 172.21.15.5:0/4131628458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80b2850 0x7f21d80aea70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009870 tx=0x7f21cc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36311626c8be7b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.895+0000 7f21dd28f640 1 -- 172.21.15.5:0/4131628458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc037070 con 0x7f21d80b2850 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21dd28f640 1 -- 172.21.15.5:0/4131628458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc032440 con 0x7f21d80b2850 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21dd28f640 1 -- 172.21.15.5:0/4131628458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc032810 con 0x7f21d80b2850 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 -- 172.21.15.5:0/4131628458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80b2850 msgr2=0x7f21d80aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4131628458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80b2850 0x7f21d80aea70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009870 tx=0x7f21cc02a1c0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 -- 172.21.15.5:0/4131628458 shutdown_connections 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4131628458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80b2850 0x7f21d80aea70 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4131628458 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 0x7f21d80b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 -- 172.21.15.5:0/4131628458 >> 172.21.15.5:0/4131628458 conn(0x7f21d80b1550 msgr2=0x7f21d80b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 -- 172.21.15.5:0/4131628458 shutdown_connections 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.896+0000 7f21e04f5640 1 -- 172.21.15.5:0/4131628458 wait complete. 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.897+0000 7f21e04f5640 1 Processor -- start 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.897+0000 7f21e04f5640 1 -- start start 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21e04f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 0x7f21d814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21e04f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d80b2850 0x7f21d8159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21e04f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80ce190 0x7f21d81596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21e04f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80cd6b0 con 0x7f21d80ce190 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21e04f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80cd3d0 con 0x7f21d80b2850 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21e04f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80cd990 con 0x7f21d80ae690 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21dea92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80ce190 0x7f21d81596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21dea92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80ce190 0x7f21d81596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45510/0 (socket says 172.21.15.5:45510) 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21dea92640 1 -- 172.21.15.5:0/4049294668 learned_addr learned my addr 172.21.15.5:0/4049294668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21de291640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 0x7f21d814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.898+0000 7f21dda90640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d80b2850 0x7f21d8159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21dea92640 1 -- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 msgr2=0x7f21d814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21dea92640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 0x7f21d814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21dea92640 1 -- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d80b2850 msgr2=0x7f21d8159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21dea92640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d80b2850 0x7f21d8159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21dea92640 1 -- 172.21.15.5:0/4049294668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8151690 con 0x7f21d80ce190 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21dea92640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80ce190 0x7f21d81596b0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c730 tx=0x7f21c800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21d6ffd640 1 -- 172.21.15.5:0/4049294668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8018070 con 0x7f21d80ce190 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21d6ffd640 1 -- 172.21.15.5:0/4049294668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8004d60 con 0x7f21d80ce190 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d815af00 con 0x7f21d80ce190 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21d6ffd640 1 -- 172.21.15.5:0/4049294668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800a880 con 0x7f21d80ce190 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.899+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d815b4c0 con 0x7f21d80ce190 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.900+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d80ce600 con 0x7f21d80ce190 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.901+0000 7f21d6ffd640 1 -- 172.21.15.5:0/4049294668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21c801b070 con 0x7f21d80ce190 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.901+0000 7f21d6ffd640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f21c406b4d0 0x7f21c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.901+0000 7f21d6ffd640 1 -- 172.21.15.5:0/4049294668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f21c8089500 con 0x7f21d80ce190 2024-04-25T09:04:18.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.901+0000 7f21de291640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f21c406b4d0 0x7f21c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.902+0000 7f21de291640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f21c406b4d0 0x7f21c406d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009990 tx=0x7f21d0009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:18.905+0000 7f21d6ffd640 1 -- 172.21.15.5:0/4049294668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f21d80ce600 con 0x7f21d80ce190 2024-04-25T09:04:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.122+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f21d8068730 con 0x7f21d80ce190 2024-04-25T09:04:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.763+0000 7f21d6ffd640 1 -- 172.21.15.5:0/4049294668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f21d8068730 con 0x7f21d80ce190 2024-04-25T09:04:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 16 and data pool 17 2024-04-25T09:04:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.767+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f21c406b4d0 msgr2=0x7f21c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.767+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f21c406b4d0 0x7f21c406d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009990 tx=0x7f21d0009110 comp rx=0 tx=0).stop 2024-04-25T09:04:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.767+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80ce190 msgr2=0x7f21d81596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.767+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80ce190 0x7f21d81596b0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c730 tx=0x7f21c800cb30 comp rx=0 tx=0).stop 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 shutdown_connections 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f21c406b4d0 0x7f21c406d990 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d80ce190 0x7f21d81596b0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d80b2850 0x7f21d8159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 --2- 172.21.15.5:0/4049294668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21d80ae690 0x7f21d814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 >> 172.21.15.5:0/4049294668 conn(0x7f21d80b1550 msgr2=0x7f21d80ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 shutdown_connections 2024-04-25T09:04:19.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.768+0000 7f21e04f5640 1 -- 172.21.15.5:0/4049294668 wait complete. 2024-04-25T09:04:19.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:19.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.904+0000 7fcfaf1b0640 1 Processor -- start 2024-04-25T09:04:19.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.904+0000 7fcfaf1b0640 1 -- start start 2024-04-25T09:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfaf1b0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcfa80cea80 0x7fcfa815f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfaf1b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa815fd80 0x7fcfa806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfaf1b0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfa806adf0 0x7fcfa806bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfaf1b0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80cfd60 con 0x7fcfa806adf0 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfaf1b0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa815f480 con 0x7fcfa80cea80 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfaf1b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa815ef10 con 0x7fcfa815fd80 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfa806adf0 0x7fcfa806bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfa806adf0 0x7fcfa806bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45526/0 (socket says 172.21.15.5:45526) 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 -- 172.21.15.5:0/1798139118 learned_addr learned my addr 172.21.15.5:0/1798139118 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfacf4c640 1 --2- 172.21.15.5:0/1798139118 >> v2:172.21.15.80:3300/0 conn(0x7fcfa80cea80 0x7fcfa815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfa7fff640 1 --2- 172.21.15.5:0/1798139118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa815fd80 0x7fcfa806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 -- 172.21.15.5:0/1798139118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa815fd80 msgr2=0x7fcfa806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 --2- 172.21.15.5:0/1798139118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa815fd80 0x7fcfa806b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 -- 172.21.15.5:0/1798139118 >> v2:172.21.15.80:3300/0 conn(0x7fcfa80cea80 msgr2=0x7fcfa815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 --2- 172.21.15.5:0/1798139118 >> v2:172.21.15.80:3300/0 conn(0x7fcfa80cea80 0x7fcfa815f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfad74d640 1 -- 172.21.15.5:0/1798139118 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa815f1a0 con 0x7fcfa806adf0 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.905+0000 7fcfacf4c640 1 --2- 172.21.15.5:0/1798139118 >> v2:172.21.15.80:3300/0 conn(0x7fcfa80cea80 0x7fcfa815f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.906+0000 7fcfad74d640 1 --2- 172.21.15.5:0/1798139118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa806adf0 0x7fcfa806bb30 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8075080 tx=0x7fcfa002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abdf682f00ea7f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.906+0000 7fcfa77fe640 1 -- 172.21.15.5:0/1798139118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0036070 con 0x7fcfa806adf0 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.906+0000 7fcfa77fe640 1 -- 172.21.15.5:0/1798139118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0031600 con 0x7fcfa806adf0 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.906+0000 7fcfa77fe640 1 -- 172.21.15.5:0/1798139118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00319d0 con 0x7fcfa806adf0 2024-04-25T09:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/1798139118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa806adf0 msgr2=0x7fcfa806bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/1798139118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa806adf0 0x7fcfa806bb30 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8075080 tx=0x7fcfa002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/1798139118 shutdown_connections 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/1798139118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa806adf0 0x7fcfa806bb30 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/1798139118 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa815fd80 0x7fcfa806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/1798139118 >> v2:172.21.15.80:3300/0 conn(0x7fcfa80cea80 0x7fcfa815f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/1798139118 >> 172.21.15.5:0/1798139118 conn(0x7fcfa80d19f0 msgr2=0x7fcfa80d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/1798139118 shutdown_connections 2024-04-25T09:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.907+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/1798139118 wait complete. 2024-04-25T09:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.908+0000 7fcfaf1b0640 1 Processor -- start 2024-04-25T09:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.908+0000 7fcfaf1b0640 1 -- start start 2024-04-25T09:04:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfaf1b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa806adf0 0x7fcfa809f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfaf1b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa80cea80 0x7fcfa80b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfaf1b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa80c6650 0x7fcfa80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfaf1b0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80d1660 con 0x7fcfa80c6650 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfaf1b0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80d0270 con 0x7fcfa80cea80 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfaf1b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80d17e0 con 0x7fcfa806adf0 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa80c6650 0x7fcfa80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa80c6650 0x7fcfa80b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45528/0 (socket says 172.21.15.5:45528) 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 -- 172.21.15.5:0/2735471197 learned_addr learned my addr 172.21.15.5:0/2735471197 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfa7fff640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa80cea80 0x7fcfa80b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfacf4c640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa806adf0 0x7fcfa809f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 -- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa806adf0 msgr2=0x7fcfa809f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa806adf0 0x7fcfa809f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 -- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa80cea80 msgr2=0x7fcfa80b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa80cea80 0x7fcfa80b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 -- 172.21.15.5:0/2735471197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80b5370 con 0x7fcfa80c6650 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.909+0000 7fcfad74d640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa80c6650 0x7fcfa80b6b00 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009f40 tx=0x7fcfa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.910+0000 7fcfa57fa640 1 -- 172.21.15.5:0/2735471197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa003f020 con 0x7fcfa80c6650 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.910+0000 7fcfa57fa640 1 -- 172.21.15.5:0/2735471197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0037040 con 0x7fcfa80c6650 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.910+0000 7fcfa57fa640 1 -- 172.21.15.5:0/2735471197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0036070 con 0x7fcfa80c6650 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.910+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa80b5650 con 0x7fcfa80c6650 2024-04-25T09:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.910+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80b5c10 con 0x7fcfa80c6650 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.911+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa804ef20 con 0x7fcfa80c6650 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.911+0000 7fcfa57fa640 1 -- 172.21.15.5:0/2735471197 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfa0042020 con 0x7fcfa80c6650 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.912+0000 7fcfa57fa640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b500 0x7fcf8c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.912+0000 7fcfa57fa640 1 -- 172.21.15.5:0/2735471197 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfa00aaac0 con 0x7fcfa80c6650 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.912+0000 7fcfacf4c640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b500 0x7fcf8c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.912+0000 7fcfacf4c640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b500 0x7fcf8c06d9c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c006fd0 tx=0x7fcf9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:19.916+0000 7fcfa57fa640 1 -- 172.21.15.5:0/2735471197 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfa0049020 con 0x7fcfa80c6650 2024-04-25T09:04:20.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.098+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa80cefa0 con 0x7fcfa80c6650 2024-04-25T09:04:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.099+0000 7fcfa57fa640 1 -- 172.21.15.5:0/2735471197 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16556 (secure 0 0 0) 0x7fcfa00798b0 con 0x7fcfa80c6650 2024-04-25T09:04:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:20.088 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":110,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:19.124106+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:17.415000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:18.131219+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b500 msgr2=0x7fcf8c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b500 0x7fcf8c06d9c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c006fd0 tx=0x7fcf9c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa80c6650 msgr2=0x7fcfa80b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa80c6650 0x7fcfa80b6b00 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009f40 tx=0x7fcfa0004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 shutdown_connections 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf8c06b500 0x7fcf8c06d9c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa80c6650 0x7fcfa80b6b00 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa80cea80 0x7fcfa80b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 --2- 172.21.15.5:0/2735471197 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfa806adf0 0x7fcfa809f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 >> 172.21.15.5:0/2735471197 conn(0x7fcfa80d19f0 msgr2=0x7fcfa80ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 shutdown_connections 2024-04-25T09:04:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.101+0000 7fcfaf1b0640 1 -- 172.21.15.5:0/2735471197 wait complete. 2024-04-25T09:04:20.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.213+0000 7efc1e61f640 1 Processor -- start 2024-04-25T09:04:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.213+0000 7efc1e61f640 1 -- start start 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1e61f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc180b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1e61f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc180aeda0 0x7efc1815d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1e61f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc180b2aa0 con 0x7efc1806dd20 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1e61f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180b2850 con 0x7efc180aeda0 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1e61f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b2d80 con 0x7efc18156250 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1cbbc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc180aeda0 0x7efc1815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1cbbc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc180aeda0 0x7efc1815d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45534/0 (socket says 172.21.15.5:45534) 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3074163738 learned_addr learned my addr 172.21.15.5:0/3074163738 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc17fff640 1 --2- 172.21.15.5:0/3074163738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc180b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3074163738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 msgr2=0x7efc180b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1cbbc640 1 --2- 172.21.15.5:0/3074163738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc180b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3074163738 >> v1:172.21.15.80:6789/0 conn(0x7efc1806dd20 legacy=0x7efc180ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.214+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3074163738 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180b3060 con 0x7efc180aeda0 2024-04-25T09:04:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.215+0000 7efc1cbbc640 1 --2- 172.21.15.5:0/3074163738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc180aeda0 0x7efc1815d270 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7efc10009e50 tx=0x7efc1002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbeb9527df81da4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.215+0000 7efc16ffd640 1 -- 172.21.15.5:0/3074163738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10036070 con 0x7efc180aeda0 2024-04-25T09:04:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.215+0000 7efc16ffd640 1 -- 172.21.15.5:0/3074163738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10031600 con 0x7efc180aeda0 2024-04-25T09:04:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.215+0000 7efc16ffd640 1 -- 172.21.15.5:0/3074163738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100319d0 con 0x7efc180aeda0 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 -- 172.21.15.5:0/3074163738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc180aeda0 msgr2=0x7efc1815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3074163738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc180aeda0 0x7efc1815d270 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7efc10009e50 tx=0x7efc1002a630 comp rx=0 tx=0).stop 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 -- 172.21.15.5:0/3074163738 shutdown_connections 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3074163738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc180aeda0 0x7efc1815d270 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3074163738 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc180b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 -- 172.21.15.5:0/3074163738 >> 172.21.15.5:0/3074163738 conn(0x7efc180668f0 msgr2=0x7efc18066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 -- 172.21.15.5:0/3074163738 shutdown_connections 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.216+0000 7efc1e61f640 1 -- 172.21.15.5:0/3074163738 wait complete. 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.217+0000 7efc1e61f640 1 Processor -- start 2024-04-25T09:04:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.217+0000 7efc1e61f640 1 -- start start 2024-04-25T09:04:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1e61f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180aeda0 0x7efc181f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1e61f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc1814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1e61f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc1814de50 0x7efc181f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1e61f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b4b80 con 0x7efc1814de50 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1e61f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b4a00 con 0x7efc180aeda0 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1e61f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b3860 con 0x7efc18156250 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc1814de50 0x7efc181f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc1814de50 0x7efc181f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45536/0 (socket says 172.21.15.5:45536) 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3622665618 learned_addr learned my addr 172.21.15.5:0/3622665618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc17fff640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180aeda0 0x7efc181f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc177fe640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc1814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 msgr2=0x7efc1814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc1814ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180aeda0 msgr2=0x7efc181f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180aeda0 0x7efc181f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc1cbbc640 1 -- 172.21.15.5:0/3622665618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1814f650 con 0x7efc1814de50 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.218+0000 7efc177fe640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc1814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.219+0000 7efc1cbbc640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc1814de50 0x7efc181f1b40 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7efc10009e50 tx=0x7efc10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.219+0000 7efc14ff9640 1 -- 172.21.15.5:0/3622665618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10036050 con 0x7efc1814de50 2024-04-25T09:04:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.219+0000 7efc14ff9640 1 -- 172.21.15.5:0/3622665618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10042070 con 0x7efc1814de50 2024-04-25T09:04:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.219+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1814f930 con 0x7efc1814de50 2024-04-25T09:04:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.219+0000 7efc14ff9640 1 -- 172.21.15.5:0/3622665618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10009510 con 0x7efc1814de50 2024-04-25T09:04:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.219+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1814fef0 con 0x7efc1814de50 2024-04-25T09:04:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.220+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1804ef20 con 0x7efc1814de50 2024-04-25T09:04:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.220+0000 7efc14ff9640 1 -- 172.21.15.5:0/3622665618 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc10007c50 con 0x7efc1814de50 2024-04-25T09:04:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.221+0000 7efc14ff9640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efbf806b500 0x7efbf806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.221+0000 7efc14ff9640 1 -- 172.21.15.5:0/3622665618 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc100ab230 con 0x7efc1814de50 2024-04-25T09:04:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.221+0000 7efc17fff640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efbf806b500 0x7efbf806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.221+0000 7efc17fff640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efbf806b500 0x7efbf806d9c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efc0000aa20 tx=0x7efc00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.225+0000 7efc14ff9640 1 -- 172.21.15.5:0/3622665618 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc1007a0c0 con 0x7efc1814de50 2024-04-25T09:04:20.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.407+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc1815f390 con 0x7efc1814de50 2024-04-25T09:04:20.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.408+0000 7efc14ff9640 1 -- 172.21.15.5:0/3622665618 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16556 (secure 0 0 0) 0x7efc100799c0 con 0x7efc1814de50 2024-04-25T09:04:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:20.397 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":110,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:19.124106+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:17.415000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:18.131219+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:20.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efbf806b500 msgr2=0x7efbf806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efbf806b500 0x7efbf806d9c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efc0000aa20 tx=0x7efc00008040 comp rx=0 tx=0).stop 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc1814de50 msgr2=0x7efc181f1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc1814de50 0x7efc181f1b40 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7efc10009e50 tx=0x7efc10004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 shutdown_connections 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efbf806b500 0x7efbf806d9c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc1814de50 0x7efc181f1b40 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.410+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc18156250 0x7efc1814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.411+0000 7efc1e61f640 1 --2- 172.21.15.5:0/3622665618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180aeda0 0x7efc181f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.411+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 >> 172.21.15.5:0/3622665618 conn(0x7efc180668f0 msgr2=0x7efc181550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.411+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 shutdown_connections 2024-04-25T09:04:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.411+0000 7efc1e61f640 1 -- 172.21.15.5:0/3622665618 wait complete. 2024-04-25T09:04:20.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.525+0000 7f1218ef5640 1 Processor -- start 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.525+0000 7f1218ef5640 1 -- start start 2024-04-25T09:04:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.526+0000 7f1218ef5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12140cefe0 0x7f1214168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.526+0000 7f1218ef5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1214162150 con 0x7f12140b6250 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.526+0000 7f1218ef5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1214162430 con 0x7f121415df10 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.526+0000 7f1218ef5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140d20d0 con 0x7f12140cefe0 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.526+0000 7f1211d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12140b6250 0x7f12140ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57232/0 (socket says 172.21.15.5:57232) 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.527+0000 7f1211d9b640 1 -- 172.21.15.5:0/2413852431 learned_addr learned my addr 172.21.15.5:0/2413852431 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.527+0000 7f1212d9d640 1 --2- 172.21.15.5:0/2413852431 >> v2:172.21.15.80:3300/0 conn(0x7f12140cefe0 0x7f1214168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.527+0000 7f121159a640 1 -- 172.21.15.5:0/2413852431 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129238337 0 0) 0x7f1214162150 con 0x7f12140b6250 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.527+0000 7f121159a640 1 -- 172.21.15.5:0/2413852431 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1200003520 con 0x7f12140b6250 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.527+0000 7f1212d9d640 1 -- 172.21.15.5:0/2413852431 >> v1:172.21.15.80:6789/0 conn(0x7f121415df10 legacy=0x7f12141618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.527+0000 7f1212d9d640 1 -- 172.21.15.5:0/2413852431 >> v1:172.21.15.5:6789/0 conn(0x7f12140b6250 legacy=0x7f12140ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.527+0000 7f1212d9d640 1 -- 172.21.15.5:0/2413852431 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214162710 con 0x7f12140cefe0 2024-04-25T09:04:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.528+0000 7f1212d9d640 1 --2- 172.21.15.5:0/2413852431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12140cefe0 0x7f1214168c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f120c009d90 tx=0x7f120c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c705fac51710a895 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.528+0000 7f121159a640 1 -- 172.21.15.5:0/2413852431 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c007740 con 0x7f12140cefe0 2024-04-25T09:04:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.528+0000 7f121159a640 1 -- 172.21.15.5:0/2413852431 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c0078e0 con 0x7f12140cefe0 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.528+0000 7f121159a640 1 -- 172.21.15.5:0/2413852431 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c007cb0 con 0x7f12140cefe0 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.528+0000 7f1218ef5640 1 -- 172.21.15.5:0/2413852431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12140cefe0 msgr2=0x7f1214168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.528+0000 7f1218ef5640 1 --2- 172.21.15.5:0/2413852431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12140cefe0 0x7f1214168c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f120c009d90 tx=0x7f120c02a6f0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.529+0000 7f1218ef5640 1 -- 172.21.15.5:0/2413852431 shutdown_connections 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.529+0000 7f1218ef5640 1 --2- 172.21.15.5:0/2413852431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12140cefe0 0x7f1214168c40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.529+0000 7f1218ef5640 1 -- 172.21.15.5:0/2413852431 >> 172.21.15.5:0/2413852431 conn(0x7f12140668f0 msgr2=0x7f1214066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.529+0000 7f1218ef5640 1 -- 172.21.15.5:0/2413852431 shutdown_connections 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.529+0000 7f1218ef5640 1 -- 172.21.15.5:0/2413852431 wait complete. 2024-04-25T09:04:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.530+0000 7f1218ef5640 1 Processor -- start 2024-04-25T09:04:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.530+0000 7f1218ef5640 1 -- start start 2024-04-25T09:04:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1218ef5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12140b6250 0x7f12140b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1218ef5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12140cefe0 0x7f121414c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1218ef5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121415df10 0x7f121414b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1218ef5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140d36f0 con 0x7f12140cefe0 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1218ef5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140d3570 con 0x7f121415df10 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1218ef5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140d3870 con 0x7f12140b6250 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12140cefe0 0x7f121414c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12140cefe0 0x7f121414c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45540/0 (socket says 172.21.15.5:45540) 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 -- 172.21.15.5:0/3270487417 learned_addr learned my addr 172.21.15.5:0/3270487417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1212d9d640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121415df10 0x7f121414b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f121259c640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12140b6250 0x7f12140b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 -- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12140b6250 msgr2=0x7f12140b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12140b6250 0x7f12140b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 -- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121415df10 msgr2=0x7f121414b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121415df10 0x7f121414b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 -- 172.21.15.5:0/3270487417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140b5930 con 0x7f12140cefe0 2024-04-25T09:04:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1211d9b640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12140cefe0 0x7f121414c0d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00c530 tx=0x7f11fc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f120affd640 1 -- 172.21.15.5:0/3270487417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc017070 con 0x7f12140cefe0 2024-04-25T09:04:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f120affd640 1 -- 172.21.15.5:0/3270487417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc005ce0 con 0x7f12140cefe0 2024-04-25T09:04:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.531+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12140b3c50 con 0x7f12140cefe0 2024-04-25T09:04:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.532+0000 7f120affd640 1 -- 172.21.15.5:0/3270487417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0072b0 con 0x7f12140cefe0 2024-04-25T09:04:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.532+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12140b3ef0 con 0x7f12140cefe0 2024-04-25T09:04:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.532+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121404ef20 con 0x7f12140cefe0 2024-04-25T09:04:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.533+0000 7f120affd640 1 -- 172.21.15.5:0/3270487417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f11fc01a070 con 0x7f12140cefe0 2024-04-25T09:04:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.533+0000 7f120affd640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f11f406b4d0 0x7f11f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.533+0000 7f120affd640 1 -- 172.21.15.5:0/3270487417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11fc0895b0 con 0x7f12140cefe0 2024-04-25T09:04:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.533+0000 7f121259c640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f11f406b4d0 0x7f11f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.534+0000 7f121259c640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f11f406b4d0 0x7f11f406d990 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1204007fd0 tx=0x7f1204009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.538+0000 7f120affd640 1 -- 172.21.15.5:0/3270487417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11fc058580 con 0x7f12140cefe0 2024-04-25T09:04:20.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:20.755+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12140b3340 con 0x7f12140cefe0 2024-04-25T09:04:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.138+0000 7f120affd640 1 -- 172.21.15.5:0/3270487417 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f11fc057e80 con 0x7f12140cefe0 2024-04-25T09:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f11f406b4d0 msgr2=0x7f11f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f11f406b4d0 0x7f11f406d990 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1204007fd0 tx=0x7f1204009040 comp rx=0 tx=0).stop 2024-04-25T09:04:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12140cefe0 msgr2=0x7f121414c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12140cefe0 0x7f121414c0d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00c530 tx=0x7f11fc00c9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 shutdown_connections 2024-04-25T09:04:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f11f406b4d0 0x7f11f406d990 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121415df10 0x7f121414b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12140cefe0 0x7f121414c0d0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 --2- 172.21.15.5:0/3270487417 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f12140b6250 0x7f12140b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 >> 172.21.15.5:0/3270487417 conn(0x7f12140668f0 msgr2=0x7f12141561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 shutdown_connections 2024-04-25T09:04:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.141+0000 7f1218ef5640 1 -- 172.21.15.5:0/3270487417 wait complete. 2024-04-25T09:04:21.141 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:04:21.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:04:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.260+0000 7fcfbdfb0640 1 Processor -- start 2024-04-25T09:04:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.260+0000 7fcfbdfb0640 1 -- start start 2024-04-25T09:04:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfbdfb0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfb815df70 0x7fcfb80b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfbdfb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfbdfb0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80d1ed0 con 0x7fcfb80d2f70 2024-04-25T09:04:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfbdfb0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80d1c80 con 0x7fcfb815df70 2024-04-25T09:04:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfbdfb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80d2ae0 con 0x7fcfb80cef20 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfb815df70 0x7fcfb80b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfb815df70 0x7fcfb80b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36106/0 (socket says 172.21.15.5:36106) 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb77fe640 1 -- 172.21.15.5:0/3370402598 learned_addr learned my addr 172.21.15.5:0/3370402598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb7fff640 1 --2- 172.21.15.5:0/3370402598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb77fe640 1 -- 172.21.15.5:0/3370402598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 msgr2=0x7fcfb80b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb77fe640 1 --2- 172.21.15.5:0/3370402598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb77fe640 1 -- 172.21.15.5:0/3370402598 >> v1:172.21.15.80:6789/0 conn(0x7fcfb80d2f70 legacy=0x7fcfb80ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.261+0000 7fcfb77fe640 1 -- 172.21.15.5:0/3370402598 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80d21b0 con 0x7fcfb815df70 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.262+0000 7fcfb77fe640 1 --2- 172.21.15.5:0/3370402598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb815df70 0x7fcfb80b94d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009870 tx=0x7fcfac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee566c9f1e9c7cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.262+0000 7fcfb67fc640 1 -- 172.21.15.5:0/3370402598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac037070 con 0x7fcfb815df70 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.262+0000 7fcfb67fc640 1 -- 172.21.15.5:0/3370402598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac02ae50 con 0x7fcfb815df70 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.262+0000 7fcfb67fc640 1 -- 172.21.15.5:0/3370402598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac032860 con 0x7fcfb815df70 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.262+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/3370402598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb815df70 msgr2=0x7fcfb80b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.262+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/3370402598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb815df70 0x7fcfb80b94d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009870 tx=0x7fcfac02a300 comp rx=0 tx=0).stop 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.263+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/3370402598 shutdown_connections 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.263+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/3370402598 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.263+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/3370402598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb815df70 0x7fcfb80b94d0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.263+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/3370402598 >> 172.21.15.5:0/3370402598 conn(0x7fcfb806b000 msgr2=0x7fcfb806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.263+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/3370402598 shutdown_connections 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.263+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/3370402598 wait complete. 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.264+0000 7fcfbdfb0640 1 Processor -- start 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.264+0000 7fcfbdfb0640 1 -- start start 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb80d2f70 0x7fcfb8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfb80ccc80 0x7fcfb8145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80b9a10 con 0x7fcfb80d2f70 2024-04-25T09:04:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80d2770 con 0x7fcfb80ccc80 2024-04-25T09:04:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80d3720 con 0x7fcfb80cef20 2024-04-25T09:04:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb80d2f70 0x7fcfb8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb80d2f70 0x7fcfb8152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36122/0 (socket says 172.21.15.5:36122) 2024-04-25T09:04:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 -- 172.21.15.5:0/2075211725 learned_addr learned my addr 172.21.15.5:0/2075211725 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb7fff640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfb80ccc80 0x7fcfb8145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb77fe640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 -- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 msgr2=0x7fcfb80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 -- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfb80ccc80 msgr2=0x7fcfb8145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfb80ccc80 0x7fcfb8145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 -- 172.21.15.5:0/2075211725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb81f4160 con 0x7fcfb80d2f70 2024-04-25T09:04:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb7fff640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfb80ccc80 0x7fcfb8145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb77fe640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfb6ffd640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb80d2f70 0x7fcfb8152b50 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c3f0 tx=0x7fcfa800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcf9ffff640 1 -- 172.21.15.5:0/2075211725 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80052d0 con 0x7fcfb80d2f70 2024-04-25T09:04:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcf9ffff640 1 -- 172.21.15.5:0/2075211725 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8005490 con 0x7fcfb80d2f70 2024-04-25T09:04:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb80cbbe0 con 0x7fcfb80d2f70 2024-04-25T09:04:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcf9ffff640 1 -- 172.21.15.5:0/2075211725 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8007260 con 0x7fcfb80d2f70 2024-04-25T09:04:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.265+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb80cc1a0 con 0x7fcfb80d2f70 2024-04-25T09:04:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.266+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb804ef20 con 0x7fcfb80d2f70 2024-04-25T09:04:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.267+0000 7fcf9ffff640 1 -- 172.21.15.5:0/2075211725 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfa8007400 con 0x7fcfb80d2f70 2024-04-25T09:04:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.267+0000 7fcf9ffff640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfa406b4d0 0x7fcfa406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.267+0000 7fcf9ffff640 1 -- 172.21.15.5:0/2075211725 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfa80896e0 con 0x7fcfb80d2f70 2024-04-25T09:04:21.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.267+0000 7fcfb77fe640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfa406b4d0 0x7fcfa406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.268+0000 7fcfb77fe640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfa406b4d0 0x7fcfa406d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcfac034000 tx=0x7fcfac02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.271+0000 7fcf9ffff640 1 -- 172.21.15.5:0/2075211725 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfa8058560 con 0x7fcfb80d2f70 2024-04-25T09:04:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:21.489+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcfb80cfae0 con 0x7fcfb80d2f70 2024-04-25T09:04:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.139+0000 7fcf9ffff640 1 -- 172.21.15.5:0/2075211725 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcfa8057e60 con 0x7fcfb80d2f70 2024-04-25T09:04:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfa406b4d0 msgr2=0x7fcfa406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfa406b4d0 0x7fcfa406d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcfac034000 tx=0x7fcfac02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb80d2f70 msgr2=0x7fcfb8152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb80d2f70 0x7fcfb8152b50 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c3f0 tx=0x7fcfa800c8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 shutdown_connections 2024-04-25T09:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcfa406b4d0 0x7fcfa406d990 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfb80ccc80 0x7fcfb8145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfb80d2f70 0x7fcfb8152b50 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 --2- 172.21.15.5:0/2075211725 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcfb80cef20 0x7fcfb80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 >> 172.21.15.5:0/2075211725 conn(0x7fcfb806b000 msgr2=0x7fcfb815ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 shutdown_connections 2024-04-25T09:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.142+0000 7fcfbdfb0640 1 -- 172.21.15.5:0/2075211725 wait complete. 2024-04-25T09:04:22.144 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:04:22.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.263+0000 7fb0740c4640 1 Processor -- start 2024-04-25T09:04:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.263+0000 7fb0740c4640 1 -- start start 2024-04-25T09:04:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb0740c4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb06c15b970 0x7fb06c0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb0740c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb0740c4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb06c071ca0 0x7fb06c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb0740c4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c072620 con 0x7fb06c15b970 2024-04-25T09:04:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb0740c4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c0cebf0 con 0x7fb06c071ca0 2024-04-25T09:04:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb0740c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b00f0 con 0x7fb06c0af6a0 2024-04-25T09:04:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb071e60640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb06c15b970 0x7fb06c0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb071e60640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb06c15b970 0x7fb06c0cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36126/0 (socket says 172.21.15.5:36126) 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.264+0000 7fb071e60640 1 -- 172.21.15.5:0/1022295943 learned_addr learned my addr 172.21.15.5:0/1022295943 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb072661640 1 --2- 172.21.15.5:0/1022295943 >> v2:172.21.15.80:3300/0 conn(0x7fb06c071ca0 0x7fb06c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb07165f640 1 --2- 172.21.15.5:0/1022295943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb071e60640 1 -- 172.21.15.5:0/1022295943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 msgr2=0x7fb06c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb071e60640 1 --2- 172.21.15.5:0/1022295943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c0afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb071e60640 1 -- 172.21.15.5:0/1022295943 >> v2:172.21.15.80:3300/0 conn(0x7fb06c071ca0 msgr2=0x7fb06c0720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb071e60640 1 --2- 172.21.15.5:0/1022295943 >> v2:172.21.15.80:3300/0 conn(0x7fb06c071ca0 0x7fb06c0720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb071e60640 1 -- 172.21.15.5:0/1022295943 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0cee90 con 0x7fb06c15b970 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb071e60640 1 --2- 172.21.15.5:0/1022295943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c15b970 0x7fb06c0cf970 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fb06c067620 tx=0x7fb06402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7cbd531cf1e877 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.265+0000 7fb070e5e640 1 -- 172.21.15.5:0/1022295943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064037070 con 0x7fb06c15b970 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb070e5e640 1 -- 172.21.15.5:0/1022295943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064032440 con 0x7fb06c15b970 2024-04-25T09:04:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb070e5e640 1 -- 172.21.15.5:0/1022295943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064032810 con 0x7fb06c15b970 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 -- 172.21.15.5:0/1022295943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c15b970 msgr2=0x7fb06c0cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 --2- 172.21.15.5:0/1022295943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c15b970 0x7fb06c0cf970 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fb06c067620 tx=0x7fb06402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 -- 172.21.15.5:0/1022295943 shutdown_connections 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 --2- 172.21.15.5:0/1022295943 >> v2:172.21.15.80:3300/0 conn(0x7fb06c071ca0 0x7fb06c0720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 --2- 172.21.15.5:0/1022295943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 --2- 172.21.15.5:0/1022295943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c15b970 0x7fb06c0cf970 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 -- 172.21.15.5:0/1022295943 >> 172.21.15.5:0/1022295943 conn(0x7fb06c0b25d0 msgr2=0x7fb06c0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 -- 172.21.15.5:0/1022295943 shutdown_connections 2024-04-25T09:04:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.266+0000 7fb0740c4640 1 -- 172.21.15.5:0/1022295943 wait complete. 2024-04-25T09:04:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.267+0000 7fb0740c4640 1 Processor -- start 2024-04-25T09:04:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.267+0000 7fb0740c4640 1 -- start start 2024-04-25T09:04:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb0740c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c071ca0 0x7fb06c14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb0740c4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb0740c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb06c15b970 0x7fb06c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb0740c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0cfeb0 con 0x7fb06c071ca0 2024-04-25T09:04:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb0740c4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0cf450 con 0x7fb06c15b970 2024-04-25T09:04:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb0740c4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c150c40 con 0x7fb06c0af6a0 2024-04-25T09:04:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c071ca0 0x7fb06c14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c071ca0 0x7fb06c14f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36132/0 (socket says 172.21.15.5:36132) 2024-04-25T09:04:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 -- 172.21.15.5:0/2237905688 learned_addr learned my addr 172.21.15.5:0/2237905688 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb072661640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb06c15b970 0x7fb06c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb07165f640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 -- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 msgr2=0x7fb06c144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 -- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb06c15b970 msgr2=0x7fb06c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb06c15b970 0x7fb06c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb071e60640 1 -- 172.21.15.5:0/2237905688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c15d6f0 con 0x7fb06c071ca0 2024-04-25T09:04:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.268+0000 7fb072661640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb06c15b970 0x7fb06c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.269+0000 7fb071e60640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c071ca0 0x7fb06c14f220 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb06402a220 tx=0x7fb0640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.269+0000 7fb06a7fc640 1 -- 172.21.15.5:0/2237905688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064041020 con 0x7fb06c071ca0 2024-04-25T09:04:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.269+0000 7fb06a7fc640 1 -- 172.21.15.5:0/2237905688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0640306c0 con 0x7fb06c071ca0 2024-04-25T09:04:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.269+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c15d9d0 con 0x7fb06c071ca0 2024-04-25T09:04:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.269+0000 7fb06a7fc640 1 -- 172.21.15.5:0/2237905688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064037040 con 0x7fb06c071ca0 2024-04-25T09:04:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.269+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c15df90 con 0x7fb06c071ca0 2024-04-25T09:04:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.270+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c04ef20 con 0x7fb06c071ca0 2024-04-25T09:04:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.271+0000 7fb06a7fc640 1 -- 172.21.15.5:0/2237905688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb064044020 con 0x7fb06c071ca0 2024-04-25T09:04:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.271+0000 7fb06a7fc640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb05806b4d0 0x7fb05806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.271+0000 7fb06a7fc640 1 -- 172.21.15.5:0/2237905688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0640aa970 con 0x7fb06c071ca0 2024-04-25T09:04:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.271+0000 7fb07165f640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb05806b4d0 0x7fb05806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.272+0000 7fb07165f640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb05806b4d0 0x7fb05806d990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0b3050 tx=0x7fb060008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.275+0000 7fb06a7fc640 1 -- 172.21.15.5:0/2237905688 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb06404b030 con 0x7fb06c071ca0 2024-04-25T09:04:22.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.491+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb06c0b2da0 con 0x7fb06c071ca0 2024-04-25T09:04:22.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.491+0000 7fb06a7fc640 1 -- 172.21.15.5:0/2237905688 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fb064079880 con 0x7fb06c071ca0 2024-04-25T09:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:22.481 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb05806b4d0 msgr2=0x7fb05806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb05806b4d0 0x7fb05806d990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0b3050 tx=0x7fb060008040 comp rx=0 tx=0).stop 2024-04-25T09:04:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c071ca0 msgr2=0x7fb06c14f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c071ca0 0x7fb06c14f220 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb06402a220 tx=0x7fb0640046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 shutdown_connections 2024-04-25T09:04:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb05806b4d0 0x7fb05806d990 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb06c15b970 0x7fb06c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb06c0af6a0 0x7fb06c144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 --2- 172.21.15.5:0/2237905688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb06c071ca0 0x7fb06c14f220 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 >> 172.21.15.5:0/2237905688 conn(0x7fb06c0b25d0 msgr2=0x7fb06c157880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 shutdown_connections 2024-04-25T09:04:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.493+0000 7fb0740c4640 1 -- 172.21.15.5:0/2237905688 wait complete. 2024-04-25T09:04:22.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.605+0000 7fb31c5d5640 1 Processor -- start 2024-04-25T09:04:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.605+0000 7fb31c5d5640 1 -- start start 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31c5d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb31415de70 0x7fb3140b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31c5d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31c5d5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3140d20e0 con 0x7fb3140b7130 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31c5d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3140d2a10 con 0x7fb31415de70 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31c5d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140d23c0 con 0x7fb3140b2cc0 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31ab72640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3140b7130 0x7fb3140ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54716/0 (socket says 172.21.15.5:54716) 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31ab72640 1 -- 172.21.15.5:0/2543552073 learned_addr learned my addr 172.21.15.5:0/2543552073 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31a371640 1 --2- 172.21.15.5:0/2543552073 >> v2:172.21.15.80:3300/0 conn(0x7fb31415de70 0x7fb3140b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb319b70640 1 --2- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.606+0000 7fb31936f640 1 -- 172.21.15.5:0/2543552073 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194380117 0 0) 0x7fb3140d20e0 con 0x7fb3140b7130 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.607+0000 7fb31936f640 1 -- 172.21.15.5:0/2543552073 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2fc003520 con 0x7fb3140b7130 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.607+0000 7fb31a371640 1 -- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 msgr2=0x7fb3140b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.607+0000 7fb31a371640 1 --2- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.607+0000 7fb31a371640 1 -- 172.21.15.5:0/2543552073 >> v1:172.21.15.5:6789/0 conn(0x7fb3140b7130 legacy=0x7fb3140ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.607+0000 7fb31a371640 1 -- 172.21.15.5:0/2543552073 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3140d26a0 con 0x7fb31415de70 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.607+0000 7fb31a371640 1 --2- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb31415de70 0x7fb3140b93e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0097a0 tx=0x7fb30c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79d9c703aa09a26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31936f640 1 -- 172.21.15.5:0/2543552073 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c037070 con 0x7fb31415de70 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31936f640 1 -- 172.21.15.5:0/2543552073 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c032440 con 0x7fb31415de70 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31936f640 1 -- 172.21.15.5:0/2543552073 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0327f0 con 0x7fb31415de70 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 -- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb31415de70 msgr2=0x7fb3140b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb31415de70 0x7fb3140b93e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0097a0 tx=0x7fb30c02a180 comp rx=0 tx=0).stop 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 -- 172.21.15.5:0/2543552073 shutdown_connections 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/2543552073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb31415de70 0x7fb3140b93e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 -- 172.21.15.5:0/2543552073 >> 172.21.15.5:0/2543552073 conn(0x7fb31406b000 msgr2=0x7fb31406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 -- 172.21.15.5:0/2543552073 shutdown_connections 2024-04-25T09:04:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.608+0000 7fb31c5d5640 1 -- 172.21.15.5:0/2543552073 wait complete. 2024-04-25T09:04:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.609+0000 7fb31c5d5640 1 Processor -- start 2024-04-25T09:04:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31c5d5640 1 -- start start 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31c5d5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31c5d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3140b7130 0x7fb3141f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31c5d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb31415de70 0x7fb31415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31c5d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140cf080 con 0x7fb31415de70 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31c5d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140cef00 con 0x7fb3140b7130 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31c5d5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140cf200 con 0x7fb3140b2cc0 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31ab72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb31415de70 0x7fb31415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb319b70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3140b7130 0x7fb3141f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31a371640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31ab72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb31415de70 0x7fb31415b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36134/0 (socket says 172.21.15.5:36134) 2024-04-25T09:04:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb31ab72640 1 -- 172.21.15.5:0/654831863 learned_addr learned my addr 172.21.15.5:0/654831863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.610+0000 7fb319b70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3140b7130 0x7fb3141f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:58562/0 (socket says 172.21.15.5:58562) 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31ab72640 1 -- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 msgr2=0x7fb3140cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31ab72640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31ab72640 1 -- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3140b7130 msgr2=0x7fb3141f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31ab72640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3140b7130 0x7fb3141f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31ab72640 1 -- 172.21.15.5:0/654831863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3140cbde0 con 0x7fb31415de70 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31a371640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb319b70640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3140b7130 0x7fb3141f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31ab72640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb31415de70 0x7fb31415b070 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fb30400cb70 tx=0x7fb30400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb312ffd640 1 -- 172.21.15.5:0/654831863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304017070 con 0x7fb31415de70 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb312ffd640 1 -- 172.21.15.5:0/654831863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400ace0 con 0x7fb31415de70 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3140cc0c0 con 0x7fb31415de70 2024-04-25T09:04:22.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb312ffd640 1 -- 172.21.15.5:0/654831863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304012620 con 0x7fb31415de70 2024-04-25T09:04:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.611+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3140cc680 con 0x7fb31415de70 2024-04-25T09:04:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.612+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31404ef20 con 0x7fb31415de70 2024-04-25T09:04:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.613+0000 7fb312ffd640 1 -- 172.21.15.5:0/654831863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb30401a070 con 0x7fb31415de70 2024-04-25T09:04:22.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.613+0000 7fb312ffd640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb30006b4d0 0x7fb30006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.613+0000 7fb312ffd640 1 -- 172.21.15.5:0/654831863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb304089fd0 con 0x7fb31415de70 2024-04-25T09:04:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.614+0000 7fb31a371640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb30006b4d0 0x7fb30006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.614+0000 7fb31a371640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb30006b4d0 0x7fb30006d990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb30c034000 tx=0x7fb30c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.618+0000 7fb312ffd640 1 -- 172.21.15.5:0/654831863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb304058800 con 0x7fb31415de70 2024-04-25T09:04:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.802+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3140d06b0 con 0x7fb31415de70 2024-04-25T09:04:22.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.803+0000 7fb312ffd640 1 -- 172.21.15.5:0/654831863 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16543 (secure 0 0 0) 0x7fb30405c8a0 con 0x7fb31415de70 2024-04-25T09:04:22.792 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:22.792 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":111,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:20.773080+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:17.415000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:18.131219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:22.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb30006b4d0 msgr2=0x7fb30006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb30006b4d0 0x7fb30006d990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb30c034000 tx=0x7fb30c02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:22.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb31415de70 msgr2=0x7fb31415b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb31415de70 0x7fb31415b070 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fb30400cb70 tx=0x7fb30400a430 comp rx=0 tx=0).stop 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 shutdown_connections 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb30006b4d0 0x7fb30006d990 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb31415de70 0x7fb31415b070 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3140b7130 0x7fb3141f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 --2- 172.21.15.5:0/654831863 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3140b2cc0 0x7fb3140cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 >> 172.21.15.5:0/654831863 conn(0x7fb31406b000 msgr2=0x7fb31415cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 shutdown_connections 2024-04-25T09:04:22.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.805+0000 7fb31c5d5640 1 -- 172.21.15.5:0/654831863 wait complete. 2024-04-25T09:04:22.805 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:04:22.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.918+0000 7f1839a6f640 1 Processor -- start 2024-04-25T09:04:22.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.918+0000 7f1839a6f640 1 -- start start 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.918+0000 7f1839a6f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.918+0000 7f1839a6f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18340ce910 0x7f18340b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.918+0000 7f1839a6f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183406ba50 con 0x7f18340b0a50 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.918+0000 7f1839a6f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183406b800 con 0x7f18340ce910 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.918+0000 7f1839a6f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183406bd30 con 0x7f18340b0e30 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1833fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18340ce910 0x7f18340b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f18337fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18340b0a50 0x7f18340ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54730/0 (socket says 172.21.15.5:54730) 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f18337fe640 1 -- 172.21.15.5:0/3588706084 learned_addr learned my addr 172.21.15.5:0/3588706084 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1833fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18340ce910 0x7f18340b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36144/0 (socket says 172.21.15.5:36144) 2024-04-25T09:04:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1833fff640 1 -- 172.21.15.5:0/3588706084 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 msgr2=0x7f18340b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1832ffd640 1 --2- 172.21.15.5:0/3588706084 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f18327fc640 1 -- 172.21.15.5:0/3588706084 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431604921 0 0) 0x7f183406ba50 con 0x7f18340b0a50 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1833fff640 1 --2- 172.21.15.5:0/3588706084 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1833fff640 1 -- 172.21.15.5:0/3588706084 >> v1:172.21.15.5:6789/0 conn(0x7f18340b0a50 legacy=0x7f18340ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1833fff640 1 -- 172.21.15.5:0/3588706084 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183406c010 con 0x7f18340ce910 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.919+0000 7f1832ffd640 1 --2- 172.21.15.5:0/3588706084 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1833fff640 1 --2- 172.21.15.5:0/3588706084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340ce910 0x7f18340b1770 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f182c009d90 tx=0x7f182c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b07fad7e5b6f20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f18327fc640 1 -- 172.21.15.5:0/3588706084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c031600 con 0x7f18340ce910 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f18327fc640 1 -- 172.21.15.5:0/3588706084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c0317a0 con 0x7f18340ce910 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f18327fc640 1 -- 172.21.15.5:0/3588706084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c031b70 con 0x7f18340ce910 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 -- 172.21.15.5:0/3588706084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340ce910 msgr2=0x7f18340b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 --2- 172.21.15.5:0/3588706084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340ce910 0x7f18340b1770 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f182c009d90 tx=0x7f182c02a5d0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 -- 172.21.15.5:0/3588706084 shutdown_connections 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 --2- 172.21.15.5:0/3588706084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340ce910 0x7f18340b1770 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 --2- 172.21.15.5:0/3588706084 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 -- 172.21.15.5:0/3588706084 >> 172.21.15.5:0/3588706084 conn(0x7f18340d18f0 msgr2=0x7f18340d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 -- 172.21.15.5:0/3588706084 shutdown_connections 2024-04-25T09:04:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.920+0000 7f1839a6f640 1 -- 172.21.15.5:0/3588706084 wait complete. 2024-04-25T09:04:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 Processor -- start 2024-04-25T09:04:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 -- start start 2024-04-25T09:04:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340b0a50 0x7f18341f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18340ce910 0x7f18340b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18340b2bf0 con 0x7f18340b0a50 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18340cfd60 con 0x7f18340ce910 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.922+0000 7f1839a6f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183415b760 con 0x7f18340b0e30 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340b0a50 0x7f18341f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340b0a50 0x7f18341f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36146/0 (socket says 172.21.15.5:36146) 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 -- 172.21.15.5:0/2998927609 learned_addr learned my addr 172.21.15.5:0/2998927609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f1833fff640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18340ce910 0x7f18340b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f1832ffd640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 -- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 msgr2=0x7f18340b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 -- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18340ce910 msgr2=0x7f18340b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18340ce910 0x7f18340b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 -- 172.21.15.5:0/2998927609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18341f41c0 con 0x7f18340b0a50 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f18337fe640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340b0a50 0x7f18341f4910 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f182400c4d0 tx=0x7f182400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f181bfff640 1 -- 172.21.15.5:0/2998927609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824018070 con 0x7f18340b0a50 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f181bfff640 1 -- 172.21.15.5:0/2998927609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824007500 con 0x7f18340b0a50 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18341f44a0 con 0x7f18340b0a50 2024-04-25T09:04:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f181bfff640 1 -- 172.21.15.5:0/2998927609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824004a20 con 0x7f18340b0a50 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.923+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18340c8e40 con 0x7f18340b0a50 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.924+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183406cd70 con 0x7f18340b0a50 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.925+0000 7f181bfff640 1 -- 172.21.15.5:0/2998927609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f182401b070 con 0x7f18340b0a50 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.925+0000 7f181bfff640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f182006b4d0 0x7f182006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.925+0000 7f181bfff640 1 -- 172.21.15.5:0/2998927609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18240894c0 con 0x7f18340b0a50 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.925+0000 7f1832ffd640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f182006b4d0 0x7f182006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.926+0000 7f1832ffd640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f182006b4d0 0x7f182006d990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f18340c71e0 tx=0x7f1828008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:22.929+0000 7f181bfff640 1 -- 172.21.15.5:0/2998927609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18240583d0 con 0x7f18340b0a50 2024-04-25T09:04:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.105+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f183404ef20 con 0x7f182006b4d0 2024-04-25T09:04:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.111+0000 7f181bfff640 1 -- 172.21.15.5:0/2998927609 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252480 (secure 0 0 0) 0x7f183404ef20 con 0x7f182006b4d0 2024-04-25T09:04:23.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f182006b4d0 msgr2=0x7f182006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f182006b4d0 0x7f182006d990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f18340c71e0 tx=0x7f1828008040 comp rx=0 tx=0).stop 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340b0a50 msgr2=0x7f18341f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340b0a50 0x7f18341f4910 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f182400c4d0 tx=0x7f182400c990 comp rx=0 tx=0).stop 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 shutdown_connections 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f182006b4d0 0x7f182006d990 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18340ce910 0x7f18340b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f18340b0e30 0x7f18340b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 --2- 172.21.15.5:0/2998927609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18340b0a50 0x7f18341f4910 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 >> 172.21.15.5:0/2998927609 conn(0x7f18340d18f0 msgr2=0x7f18340cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 shutdown_connections 2024-04-25T09:04:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.114+0000 7f1839a6f640 1 -- 172.21.15.5:0/2998927609 wait complete. 2024-04-25T09:04:23.114 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-04-25T09:04:22.490849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":398828,"kb_used_data":11960,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754575892,"statfs":{"total":773094113280,"available":772685713408,"internally_reserved":0,"allocated":12247040,"data_stored":5945108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":396021297},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.731546"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780280+0000","last_change":"2024-04-25T09:04:19.800041+0000","last_active":"2024-04-25T09:04:20.780280+0000","last_peered":"2024-04-25T09:04:20.780280+0000","last_clean":"2024-04-25T09:04:20.780280+0000","last_became_active":"2024-04-25T09:04:19.799333+0000","last_became_peered":"2024-04-25T09:04:19.799333+0000","last_unstale":"2024-04-25T09:04:20.780280+0000","last_undegraded":"2024-04-25T09:04:20.780280+0000","last_fullsized":"2024-04-25T09:04:20.780280+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:33.800119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780154+0000","last_change":"2024-04-25T09:04:19.779440+0000","last_active":"2024-04-25T09:04:20.780154+0000","last_peered":"2024-04-25T09:04:20.780154+0000","last_clean":"2024-04-25T09:04:20.780154+0000","last_became_active":"2024-04-25T09:04:19.779162+0000","last_became_peered":"2024-04-25T09:04:19.779162+0000","last_unstale":"2024-04-25T09:04:20.780154+0000","last_undegraded":"2024-04-25T09:04:20.780154+0000","last_fullsized":"2024-04-25T09:04:20.780154+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:17.601171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057781+0000","last_change":"2024-04-25T09:04:19.780734+0000","last_active":"2024-04-25T09:04:21.057781+0000","last_peered":"2024-04-25T09:04:21.057781+0000","last_clean":"2024-04-25T09:04:21.057781+0000","last_became_active":"2024-04-25T09:04:19.780397+0000","last_became_peered":"2024-04-25T09:04:19.780397+0000","last_unstale":"2024-04-25T09:04:21.057781+0000","last_undegraded":"2024-04-25T09:04:21.057781+0000","last_fullsized":"2024-04-25T09:04:21.057781+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:12.110578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780122+0000","last_change":"2024-04-25T09:04:19.795274+0000","last_active":"2024-04-25T09:04:20.780122+0000","last_peered":"2024-04-25T09:04:20.780122+0000","last_clean":"2024-04-25T09:04:20.780122+0000","last_became_active":"2024-04-25T09:04:19.794532+0000","last_became_peered":"2024-04-25T09:04:19.794532+0000","last_unstale":"2024-04-25T09:04:20.780122+0000","last_undegraded":"2024-04-25T09:04:20.780122+0000","last_fullsized":"2024-04-25T09:04:20.780122+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:59.671612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057348+0000","last_change":"2024-04-25T09:04:19.781147+0000","last_active":"2024-04-25T09:04:21.057348+0000","last_peered":"2024-04-25T09:04:21.057348+0000","last_clean":"2024-04-25T09:04:21.057348+0000","last_became_active":"2024-04-25T09:04:19.780886+0000","last_became_peered":"2024-04-25T09:04:19.780886+0000","last_unstale":"2024-04-25T09:04:21.057348+0000","last_undegraded":"2024-04-25T09:04:21.057348+0000","last_fullsized":"2024-04-25T09:04:21.057348+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:39.264100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057349+0000","last_change":"2024-04-25T09:04:19.790462+0000","last_active":"2024-04-25T09:04:21.057349+0000","last_peered":"2024-04-25T09:04:21.057349+0000","last_clean":"2024-04-25T09:04:21.057349+0000","last_became_active":"2024-04-25T09:04:19.790177+0000","last_became_peered":"2024-04-25T09:04:19.790177+0000","last_unstale":"2024-04-25T09:04:21.057349+0000","last_undegraded":"2024-04-25T09:04:21.057349+0000","last_fullsized":"2024-04-25T09:04:21.057349+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:11.322291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057747+0000","last_change":"2024-04-25T09:04:19.784451+0000","last_active":"2024-04-25T09:04:21.057747+0000","last_peered":"2024-04-25T09:04:21.057747+0000","last_clean":"2024-04-25T09:04:21.057747+0000","last_became_active":"2024-04-25T09:04:19.784186+0000","last_became_peered":"2024-04-25T09:04:19.784186+0000","last_unstale":"2024-04-25T09:04:21.057747+0000","last_undegraded":"2024-04-25T09:04:21.057747+0000","last_fullsized":"2024-04-25T09:04:21.057747+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:17.780131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058302+0000","last_change":"2024-04-25T09:04:19.781221+0000","last_active":"2024-04-25T09:04:21.058302+0000","last_peered":"2024-04-25T09:04:21.058302+0000","last_clean":"2024-04-25T09:04:21.058302+0000","last_became_active":"2024-04-25T09:04:19.780677+0000","last_became_peered":"2024-04-25T09:04:19.780677+0000","last_unstale":"2024-04-25T09:04:21.058302+0000","last_undegraded":"2024-04-25T09:04:21.058302+0000","last_fullsized":"2024-04-25T09:04:21.058302+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:49.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780319+0000","last_change":"2024-04-25T09:04:19.799911+0000","last_active":"2024-04-25T09:04:20.780319+0000","last_peered":"2024-04-25T09:04:20.780319+0000","last_clean":"2024-04-25T09:04:20.780319+0000","last_became_active":"2024-04-25T09:04:19.799364+0000","last_became_peered":"2024-04-25T09:04:19.799364+0000","last_unstale":"2024-04-25T09:04:20.780319+0000","last_undegraded":"2024-04-25T09:04:20.780319+0000","last_fullsized":"2024-04-25T09:04:20.780319+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:08.219708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780248+0000","last_change":"2024-04-25T09:04:19.798863+0000","last_active":"2024-04-25T09:04:20.780248+0000","last_peered":"2024-04-25T09:04:20.780248+0000","last_clean":"2024-04-25T09:04:20.780248+0000","last_became_active":"2024-04-25T09:04:19.798511+0000","last_became_peered":"2024-04-25T09:04:19.798511+0000","last_unstale":"2024-04-25T09:04:20.780248+0000","last_undegraded":"2024-04-25T09:04:20.780248+0000","last_fullsized":"2024-04-25T09:04:20.780248+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:40.822165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780101+0000","last_change":"2024-04-25T09:04:19.785145+0000","last_active":"2024-04-25T09:04:20.780101+0000","last_peered":"2024-04-25T09:04:20.780101+0000","last_clean":"2024-04-25T09:04:20.780101+0000","last_became_active":"2024-04-25T09:04:19.782841+0000","last_became_peered":"2024-04-25T09:04:19.782841+0000","last_unstale":"2024-04-25T09:04:20.780101+0000","last_undegraded":"2024-04-25T09:04:20.780101+0000","last_fullsized":"2024-04-25T09:04:20.780101+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:35.749412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780293+0000","last_change":"2024-04-25T09:04:19.798525+0000","last_active":"2024-04-25T09:04:20.780293+0000","last_peered":"2024-04-25T09:04:20.780293+0000","last_clean":"2024-04-25T09:04:20.780293+0000","last_became_active":"2024-04-25T09:04:19.796642+0000","last_became_peered":"2024-04-25T09:04:19.796642+0000","last_unstale":"2024-04-25T09:04:20.780293+0000","last_undegraded":"2024-04-25T09:04:20.780293+0000","last_fullsized":"2024-04-25T09:04:20.780293+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:14.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058308+0000","last_change":"2024-04-25T09:04:19.784843+0000","last_active":"2024-04-25T09:04:21.058308+0000","last_peered":"2024-04-25T09:04:21.058308+0000","last_clean":"2024-04-25T09:04:21.058308+0000","last_became_active":"2024-04-25T09:04:19.784576+0000","last_became_peered":"2024-04-25T09:04:19.784576+0000","last_unstale":"2024-04-25T09:04:21.058308+0000","last_undegraded":"2024-04-25T09:04:21.058308+0000","last_fullsized":"2024-04-25T09:04:21.058308+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.915579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057747+0000","last_change":"2024-04-25T09:04:19.782613+0000","last_active":"2024-04-25T09:04:21.057747+0000","last_peered":"2024-04-25T09:04:21.057747+0000","last_clean":"2024-04-25T09:04:21.057747+0000","last_became_active":"2024-04-25T09:04:19.782305+0000","last_became_peered":"2024-04-25T09:04:19.782305+0000","last_unstale":"2024-04-25T09:04:21.057747+0000","last_undegraded":"2024-04-25T09:04:21.057747+0000","last_fullsized":"2024-04-25T09:04:21.057747+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:32.075046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057796+0000","last_change":"2024-04-25T09:04:19.789821+0000","last_active":"2024-04-25T09:04:21.057796+0000","last_peered":"2024-04-25T09:04:21.057796+0000","last_clean":"2024-04-25T09:04:21.057796+0000","last_became_active":"2024-04-25T09:04:19.789531+0000","last_became_peered":"2024-04-25T09:04:19.789531+0000","last_unstale":"2024-04-25T09:04:21.057796+0000","last_undegraded":"2024-04-25T09:04:21.057796+0000","last_fullsized":"2024-04-25T09:04:21.057796+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:41.656140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779571+0000","last_change":"2024-04-25T09:04:19.797004+0000","last_active":"2024-04-25T09:04:20.779571+0000","last_peered":"2024-04-25T09:04:20.779571+0000","last_clean":"2024-04-25T09:04:20.779571+0000","last_became_active":"2024-04-25T09:04:19.796379+0000","last_became_peered":"2024-04-25T09:04:19.796379+0000","last_unstale":"2024-04-25T09:04:20.779571+0000","last_undegraded":"2024-04-25T09:04:20.779571+0000","last_fullsized":"2024-04-25T09:04:20.779571+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:57.117380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780452+0000","last_change":"2024-04-25T09:04:19.791244+0000","last_active":"2024-04-25T09:04:20.780452+0000","last_peered":"2024-04-25T09:04:20.780452+0000","last_clean":"2024-04-25T09:04:20.780452+0000","last_became_active":"2024-04-25T09:04:19.789743+0000","last_became_peered":"2024-04-25T09:04:19.789743+0000","last_unstale":"2024-04-25T09:04:20.780452+0000","last_undegraded":"2024-04-25T09:04:20.780452+0000","last_fullsized":"2024-04-25T09:04:20.780452+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:23.753084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058498+0000","last_change":"2024-04-25T09:04:19.789136+0000","last_active":"2024-04-25T09:04:21.058498+0000","last_peered":"2024-04-25T09:04:21.058498+0000","last_clean":"2024-04-25T09:04:21.058498+0000","last_became_active":"2024-04-25T09:04:19.788837+0000","last_became_peered":"2024-04-25T09:04:19.788837+0000","last_unstale":"2024-04-25T09:04:21.058498+0000","last_undegraded":"2024-04-25T09:04:21.058498+0000","last_fullsized":"2024-04-25T09:04:21.058498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:17.601171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057926+0000","last_change":"2024-04-25T09:04:19.785853+0000","last_active":"2024-04-25T09:04:21.057926+0000","last_peered":"2024-04-25T09:04:21.057926+0000","last_clean":"2024-04-25T09:04:21.057926+0000","last_became_active":"2024-04-25T09:04:19.785123+0000","last_became_peered":"2024-04-25T09:04:19.785123+0000","last_unstale":"2024-04-25T09:04:21.057926+0000","last_undegraded":"2024-04-25T09:04:21.057926+0000","last_fullsized":"2024-04-25T09:04:21.057926+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:33.399806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780391+0000","last_change":"2024-04-25T09:04:19.791007+0000","last_active":"2024-04-25T09:04:20.780391+0000","last_peered":"2024-04-25T09:04:20.780391+0000","last_clean":"2024-04-25T09:04:20.780391+0000","last_became_active":"2024-04-25T09:04:19.788484+0000","last_became_peered":"2024-04-25T09:04:19.788484+0000","last_unstale":"2024-04-25T09:04:20.780391+0000","last_undegraded":"2024-04-25T09:04:20.780391+0000","last_fullsized":"2024-04-25T09:04:20.780391+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:50.200669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780464+0000","last_change":"2024-04-25T09:04:19.784435+0000","last_active":"2024-04-25T09:04:20.780464+0000","last_peered":"2024-04-25T09:04:20.780464+0000","last_clean":"2024-04-25T09:04:20.780464+0000","last_became_active":"2024-04-25T09:04:19.783727+0000","last_became_peered":"2024-04-25T09:04:19.783727+0000","last_unstale":"2024-04-25T09:04:20.780464+0000","last_undegraded":"2024-04-25T09:04:20.780464+0000","last_fullsized":"2024-04-25T09:04:20.780464+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:58.823764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779354+0000","last_change":"2024-04-25T09:04:19.783388+0000","last_active":"2024-04-25T09:04:20.779354+0000","last_peered":"2024-04-25T09:04:20.779354+0000","last_clean":"2024-04-25T09:04:20.779354+0000","last_became_active":"2024-04-25T09:04:19.783112+0000","last_became_peered":"2024-04-25T09:04:19.783112+0000","last_unstale":"2024-04-25T09:04:20.779354+0000","last_undegraded":"2024-04-25T09:04:20.779354+0000","last_fullsized":"2024-04-25T09:04:20.779354+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:32.075046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779835+0000","last_change":"2024-04-25T09:04:19.785530+0000","last_active":"2024-04-25T09:04:20.779835+0000","last_peered":"2024-04-25T09:04:20.779835+0000","last_clean":"2024-04-25T09:04:20.779835+0000","last_became_active":"2024-04-25T09:04:19.785284+0000","last_became_peered":"2024-04-25T09:04:19.785284+0000","last_unstale":"2024-04-25T09:04:20.779835+0000","last_undegraded":"2024-04-25T09:04:20.779835+0000","last_fullsized":"2024-04-25T09:04:20.779835+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:33.646805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779012+0000","last_change":"2024-04-25T09:04:19.787579+0000","last_active":"2024-04-25T09:04:20.779012+0000","last_peered":"2024-04-25T09:04:20.779012+0000","last_clean":"2024-04-25T09:04:20.779012+0000","last_became_active":"2024-04-25T09:04:19.787307+0000","last_became_peered":"2024-04-25T09:04:19.787307+0000","last_unstale":"2024-04-25T09:04:20.779012+0000","last_undegraded":"2024-04-25T09:04:20.779012+0000","last_fullsized":"2024-04-25T09:04:20.779012+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:58.004882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780502+0000","last_change":"2024-04-25T09:04:19.789820+0000","last_active":"2024-04-25T09:04:20.780502+0000","last_peered":"2024-04-25T09:04:20.780502+0000","last_clean":"2024-04-25T09:04:20.780502+0000","last_became_active":"2024-04-25T09:04:19.788255+0000","last_became_peered":"2024-04-25T09:04:19.788255+0000","last_unstale":"2024-04-25T09:04:20.780502+0000","last_undegraded":"2024-04-25T09:04:20.780502+0000","last_fullsized":"2024-04-25T09:04:20.780502+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:44.039006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780304+0000","last_change":"2024-04-25T09:04:19.796975+0000","last_active":"2024-04-25T09:04:20.780304+0000","last_peered":"2024-04-25T09:04:20.780304+0000","last_clean":"2024-04-25T09:04:20.780304+0000","last_became_active":"2024-04-25T09:04:19.796685+0000","last_became_peered":"2024-04-25T09:04:19.796685+0000","last_unstale":"2024-04-25T09:04:20.780304+0000","last_undegraded":"2024-04-25T09:04:20.780304+0000","last_fullsized":"2024-04-25T09:04:20.780304+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:06.136765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057540+0000","last_change":"2024-04-25T09:04:19.798018+0000","last_active":"2024-04-25T09:04:21.057540+0000","last_peered":"2024-04-25T09:04:21.057540+0000","last_clean":"2024-04-25T09:04:21.057540+0000","last_became_active":"2024-04-25T09:04:19.797598+0000","last_became_peered":"2024-04-25T09:04:19.797598+0000","last_unstale":"2024-04-25T09:04:21.057540+0000","last_undegraded":"2024-04-25T09:04:21.057540+0000","last_fullsized":"2024-04-25T09:04:21.057540+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:32.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779485+0000","last_change":"2024-04-25T09:04:19.796317+0000","last_active":"2024-04-25T09:04:20.779485+0000","last_peered":"2024-04-25T09:04:20.779485+0000","last_clean":"2024-04-25T09:04:20.779485+0000","last_became_active":"2024-04-25T09:04:19.795842+0000","last_became_peered":"2024-04-25T09:04:19.795842+0000","last_unstale":"2024-04-25T09:04:20.779485+0000","last_undegraded":"2024-04-25T09:04:20.779485+0000","last_fullsized":"2024-04-25T09:04:20.779485+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:12.110578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780058+0000","last_change":"2024-04-25T09:04:19.786414+0000","last_active":"2024-04-25T09:04:20.780058+0000","last_peered":"2024-04-25T09:04:20.780058+0000","last_clean":"2024-04-25T09:04:20.780058+0000","last_became_active":"2024-04-25T09:04:19.786162+0000","last_became_peered":"2024-04-25T09:04:19.786162+0000","last_unstale":"2024-04-25T09:04:20.780058+0000","last_undegraded":"2024-04-25T09:04:20.780058+0000","last_fullsized":"2024-04-25T09:04:20.780058+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:53.178680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058572+0000","last_change":"2024-04-25T09:04:19.781325+0000","last_active":"2024-04-25T09:04:21.058572+0000","last_peered":"2024-04-25T09:04:21.058572+0000","last_clean":"2024-04-25T09:04:21.058572+0000","last_became_active":"2024-04-25T09:04:19.780912+0000","last_became_peered":"2024-04-25T09:04:19.780912+0000","last_unstale":"2024-04-25T09:04:21.058572+0000","last_undegraded":"2024-04-25T09:04:21.058572+0000","last_fullsized":"2024-04-25T09:04:21.058572+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:10.343310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779805+0000","last_change":"2024-04-25T09:04:19.786196+0000","last_active":"2024-04-25T09:04:20.779805+0000","last_peered":"2024-04-25T09:04:20.779805+0000","last_clean":"2024-04-25T09:04:20.779805+0000","last_became_active":"2024-04-25T09:04:19.785802+0000","last_became_peered":"2024-04-25T09:04:19.785802+0000","last_unstale":"2024-04-25T09:04:20.779805+0000","last_undegraded":"2024-04-25T09:04:20.779805+0000","last_fullsized":"2024-04-25T09:04:20.779805+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.915579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057713+0000","last_change":"2024-04-25T09:04:19.788915+0000","last_active":"2024-04-25T09:04:21.057713+0000","last_peered":"2024-04-25T09:04:21.057713+0000","last_clean":"2024-04-25T09:04:21.057713+0000","last_became_active":"2024-04-25T09:04:19.788668+0000","last_became_peered":"2024-04-25T09:04:19.788668+0000","last_unstale":"2024-04-25T09:04:21.057713+0000","last_undegraded":"2024-04-25T09:04:21.057713+0000","last_fullsized":"2024-04-25T09:04:21.057713+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:02.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057421+0000","last_change":"2024-04-25T09:04:19.791741+0000","last_active":"2024-04-25T09:04:21.057421+0000","last_peered":"2024-04-25T09:04:21.057421+0000","last_clean":"2024-04-25T09:04:21.057421+0000","last_became_active":"2024-04-25T09:04:19.790732+0000","last_became_peered":"2024-04-25T09:04:19.790732+0000","last_unstale":"2024-04-25T09:04:21.057421+0000","last_undegraded":"2024-04-25T09:04:21.057421+0000","last_fullsized":"2024-04-25T09:04:21.057421+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:19.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"110'4","reported_seq":18,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058427+0000","last_change":"2024-04-25T09:04:18.777472+0000","last_active":"2024-04-25T09:04:21.058427+0000","last_peered":"2024-04-25T09:04:21.058427+0000","last_clean":"2024-04-25T09:04:21.058427+0000","last_became_active":"2024-04-25T09:04:18.777132+0000","last_became_peered":"2024-04-25T09:04:18.777132+0000","last_unstale":"2024-04-25T09:04:21.058427+0000","last_undegraded":"2024-04-25T09:04:21.058427+0000","last_fullsized":"2024-04-25T09:04:21.058427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:23.983248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058862+0000","last_change":"2024-04-25T09:04:19.787097+0000","last_active":"2024-04-25T09:04:21.058862+0000","last_peered":"2024-04-25T09:04:21.058862+0000","last_clean":"2024-04-25T09:04:21.058862+0000","last_became_active":"2024-04-25T09:04:19.786779+0000","last_became_peered":"2024-04-25T09:04:19.786779+0000","last_unstale":"2024-04-25T09:04:21.058862+0000","last_undegraded":"2024-04-25T09:04:21.058862+0000","last_fullsized":"2024-04-25T09:04:21.058862+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.536995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057984+0000","last_change":"2024-04-25T09:04:18.779006+0000","last_active":"2024-04-25T09:04:21.057984+0000","last_peered":"2024-04-25T09:04:21.057984+0000","last_clean":"2024-04-25T09:04:21.057984+0000","last_became_active":"2024-04-25T09:04:18.778710+0000","last_became_peered":"2024-04-25T09:04:18.778710+0000","last_unstale":"2024-04-25T09:04:21.057984+0000","last_undegraded":"2024-04-25T09:04:21.057984+0000","last_fullsized":"2024-04-25T09:04:21.057984+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:49.532203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057575+0000","last_change":"2024-04-25T09:04:19.791817+0000","last_active":"2024-04-25T09:04:21.057575+0000","last_peered":"2024-04-25T09:04:21.057575+0000","last_clean":"2024-04-25T09:04:21.057575+0000","last_became_active":"2024-04-25T09:04:19.791513+0000","last_became_peered":"2024-04-25T09:04:19.791513+0000","last_unstale":"2024-04-25T09:04:21.057575+0000","last_undegraded":"2024-04-25T09:04:21.057575+0000","last_fullsized":"2024-04-25T09:04:21.057575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:24.475275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057219+0000","last_change":"2024-04-25T09:04:18.779137+0000","last_active":"2024-04-25T09:04:21.057219+0000","last_peered":"2024-04-25T09:04:21.057219+0000","last_clean":"2024-04-25T09:04:21.057219+0000","last_became_active":"2024-04-25T09:04:18.778854+0000","last_became_peered":"2024-04-25T09:04:18.778854+0000","last_unstale":"2024-04-25T09:04:21.057219+0000","last_undegraded":"2024-04-25T09:04:21.057219+0000","last_fullsized":"2024-04-25T09:04:21.057219+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:18.199090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058383+0000","last_change":"2024-04-25T09:04:19.785746+0000","last_active":"2024-04-25T09:04:21.058383+0000","last_peered":"2024-04-25T09:04:21.058383+0000","last_clean":"2024-04-25T09:04:21.058383+0000","last_became_active":"2024-04-25T09:04:19.784597+0000","last_became_peered":"2024-04-25T09:04:19.784597+0000","last_unstale":"2024-04-25T09:04:21.058383+0000","last_undegraded":"2024-04-25T09:04:21.058383+0000","last_fullsized":"2024-04-25T09:04:21.058383+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:28.172130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057126+0000","last_change":"2024-04-25T09:04:18.778771+0000","last_active":"2024-04-25T09:04:21.057126+0000","last_peered":"2024-04-25T09:04:21.057126+0000","last_clean":"2024-04-25T09:04:21.057126+0000","last_became_active":"2024-04-25T09:04:18.778411+0000","last_became_peered":"2024-04-25T09:04:18.778411+0000","last_unstale":"2024-04-25T09:04:21.057126+0000","last_undegraded":"2024-04-25T09:04:21.057126+0000","last_fullsized":"2024-04-25T09:04:21.057126+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.142510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779985+0000","last_change":"2024-04-25T09:04:19.792383+0000","last_active":"2024-04-25T09:04:20.779985+0000","last_peered":"2024-04-25T09:04:20.779985+0000","last_clean":"2024-04-25T09:04:20.779985+0000","last_became_active":"2024-04-25T09:04:19.792058+0000","last_became_peered":"2024-04-25T09:04:19.792058+0000","last_unstale":"2024-04-25T09:04:20.779985+0000","last_undegraded":"2024-04-25T09:04:20.779985+0000","last_fullsized":"2024-04-25T09:04:20.779985+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:36.499777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057753+0000","last_change":"2024-04-25T09:04:18.784090+0000","last_active":"2024-04-25T09:04:21.057753+0000","last_peered":"2024-04-25T09:04:21.057753+0000","last_clean":"2024-04-25T09:04:21.057753+0000","last_became_active":"2024-04-25T09:04:18.783811+0000","last_became_peered":"2024-04-25T09:04:18.783811+0000","last_unstale":"2024-04-25T09:04:21.057753+0000","last_undegraded":"2024-04-25T09:04:21.057753+0000","last_fullsized":"2024-04-25T09:04:21.057753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:58.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780155+0000","last_change":"2024-04-25T09:04:19.782339+0000","last_active":"2024-04-25T09:04:20.780155+0000","last_peered":"2024-04-25T09:04:20.780155+0000","last_clean":"2024-04-25T09:04:20.780155+0000","last_became_active":"2024-04-25T09:04:19.782068+0000","last_became_peered":"2024-04-25T09:04:19.782068+0000","last_unstale":"2024-04-25T09:04:20.780155+0000","last_undegraded":"2024-04-25T09:04:20.780155+0000","last_fullsized":"2024-04-25T09:04:20.780155+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:13.683649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779469+0000","last_change":"2024-04-25T09:04:18.780930+0000","last_active":"2024-04-25T09:04:20.779469+0000","last_peered":"2024-04-25T09:04:20.779469+0000","last_clean":"2024-04-25T09:04:20.779469+0000","last_became_active":"2024-04-25T09:04:18.780402+0000","last_became_peered":"2024-04-25T09:04:18.780402+0000","last_unstale":"2024-04-25T09:04:20.779469+0000","last_undegraded":"2024-04-25T09:04:20.779469+0000","last_fullsized":"2024-04-25T09:04:20.779469+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:32.642012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779737+0000","last_change":"2024-04-25T09:04:19.799125+0000","last_active":"2024-04-25T09:04:20.779737+0000","last_peered":"2024-04-25T09:04:20.779737+0000","last_clean":"2024-04-25T09:04:20.779737+0000","last_became_active":"2024-04-25T09:04:19.797111+0000","last_became_peered":"2024-04-25T09:04:19.797111+0000","last_unstale":"2024-04-25T09:04:20.779737+0000","last_undegraded":"2024-04-25T09:04:20.779737+0000","last_fullsized":"2024-04-25T09:04:20.779737+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:49.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779892+0000","last_change":"2024-04-25T09:04:18.783196+0000","last_active":"2024-04-25T09:04:20.779892+0000","last_peered":"2024-04-25T09:04:20.779892+0000","last_clean":"2024-04-25T09:04:20.779892+0000","last_became_active":"2024-04-25T09:04:18.782875+0000","last_became_peered":"2024-04-25T09:04:18.782875+0000","last_unstale":"2024-04-25T09:04:20.779892+0000","last_undegraded":"2024-04-25T09:04:20.779892+0000","last_fullsized":"2024-04-25T09:04:20.779892+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:48.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058180+0000","last_change":"2024-04-25T09:04:19.785197+0000","last_active":"2024-04-25T09:04:21.058180+0000","last_peered":"2024-04-25T09:04:21.058180+0000","last_clean":"2024-04-25T09:04:21.058180+0000","last_became_active":"2024-04-25T09:04:19.784919+0000","last_became_peered":"2024-04-25T09:04:19.784919+0000","last_unstale":"2024-04-25T09:04:21.058180+0000","last_undegraded":"2024-04-25T09:04:21.058180+0000","last_fullsized":"2024-04-25T09:04:21.058180+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:07.536679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779744+0000","last_change":"2024-04-25T09:04:18.788156+0000","last_active":"2024-04-25T09:04:20.779744+0000","last_peered":"2024-04-25T09:04:20.779744+0000","last_clean":"2024-04-25T09:04:20.779744+0000","last_became_active":"2024-04-25T09:04:18.787763+0000","last_became_peered":"2024-04-25T09:04:18.787763+0000","last_unstale":"2024-04-25T09:04:20.779744+0000","last_undegraded":"2024-04-25T09:04:20.779744+0000","last_fullsized":"2024-04-25T09:04:20.779744+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:12.678856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058176+0000","last_change":"2024-04-25T09:04:19.775224+0000","last_active":"2024-04-25T09:04:21.058176+0000","last_peered":"2024-04-25T09:04:21.058176+0000","last_clean":"2024-04-25T09:04:21.058176+0000","last_became_active":"2024-04-25T09:04:19.774703+0000","last_became_peered":"2024-04-25T09:04:19.774703+0000","last_unstale":"2024-04-25T09:04:21.058176+0000","last_undegraded":"2024-04-25T09:04:21.058176+0000","last_fullsized":"2024-04-25T09:04:21.058176+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:49.813862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057051+0000","last_change":"2024-04-25T09:04:18.784590+0000","last_active":"2024-04-25T09:04:21.057051+0000","last_peered":"2024-04-25T09:04:21.057051+0000","last_clean":"2024-04-25T09:04:21.057051+0000","last_became_active":"2024-04-25T09:04:18.784333+0000","last_became_peered":"2024-04-25T09:04:18.784333+0000","last_unstale":"2024-04-25T09:04:21.057051+0000","last_undegraded":"2024-04-25T09:04:21.057051+0000","last_fullsized":"2024-04-25T09:04:21.057051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:23.470482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058999+0000","last_change":"2024-04-25T09:04:19.801552+0000","last_active":"2024-04-25T09:04:21.058999+0000","last_peered":"2024-04-25T09:04:21.058999+0000","last_clean":"2024-04-25T09:04:21.058999+0000","last_became_active":"2024-04-25T09:04:19.801281+0000","last_became_peered":"2024-04-25T09:04:19.801281+0000","last_unstale":"2024-04-25T09:04:21.058999+0000","last_undegraded":"2024-04-25T09:04:21.058999+0000","last_fullsized":"2024-04-25T09:04:21.058999+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:50.200669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779432+0000","last_change":"2024-04-25T09:04:18.781766+0000","last_active":"2024-04-25T09:04:20.779432+0000","last_peered":"2024-04-25T09:04:20.779432+0000","last_clean":"2024-04-25T09:04:20.779432+0000","last_became_active":"2024-04-25T09:04:18.781465+0000","last_became_peered":"2024-04-25T09:04:18.781465+0000","last_unstale":"2024-04-25T09:04:20.779432+0000","last_undegraded":"2024-04-25T09:04:20.779432+0000","last_fullsized":"2024-04-25T09:04:20.779432+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:43.068918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779507+0000","last_change":"2024-04-25T09:04:19.793079+0000","last_active":"2024-04-25T09:04:20.779507+0000","last_peered":"2024-04-25T09:04:20.779507+0000","last_clean":"2024-04-25T09:04:20.779507+0000","last_became_active":"2024-04-25T09:04:19.792778+0000","last_became_peered":"2024-04-25T09:04:19.792778+0000","last_unstale":"2024-04-25T09:04:20.779507+0000","last_undegraded":"2024-04-25T09:04:20.779507+0000","last_fullsized":"2024-04-25T09:04:20.779507+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:45.894539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"110'3","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779984+0000","last_change":"2024-04-25T09:04:18.783777+0000","last_active":"2024-04-25T09:04:20.779984+0000","last_peered":"2024-04-25T09:04:20.779984+0000","last_clean":"2024-04-25T09:04:20.779984+0000","last_became_active":"2024-04-25T09:04:18.783508+0000","last_became_peered":"2024-04-25T09:04:18.783508+0000","last_unstale":"2024-04-25T09:04:20.779984+0000","last_undegraded":"2024-04-25T09:04:20.779984+0000","last_fullsized":"2024-04-25T09:04:20.779984+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:43.068918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058657+0000","last_change":"2024-04-25T09:04:19.782067+0000","last_active":"2024-04-25T09:04:21.058657+0000","last_peered":"2024-04-25T09:04:21.058657+0000","last_clean":"2024-04-25T09:04:21.058657+0000","last_became_active":"2024-04-25T09:04:19.781784+0000","last_became_peered":"2024-04-25T09:04:19.781784+0000","last_unstale":"2024-04-25T09:04:21.058657+0000","last_undegraded":"2024-04-25T09:04:21.058657+0000","last_fullsized":"2024-04-25T09:04:21.058657+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:50.258614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"110'6","reported_seq":20,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780478+0000","last_change":"2024-04-25T09:04:18.786810+0000","last_active":"2024-04-25T09:04:20.780478+0000","last_peered":"2024-04-25T09:04:20.780478+0000","last_clean":"2024-04-25T09:04:20.780478+0000","last_became_active":"2024-04-25T09:04:18.786525+0000","last_became_peered":"2024-04-25T09:04:18.786525+0000","last_unstale":"2024-04-25T09:04:20.780478+0000","last_undegraded":"2024-04-25T09:04:20.780478+0000","last_fullsized":"2024-04-25T09:04:20.780478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:32.642012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779493+0000","last_change":"2024-04-25T09:04:19.780085+0000","last_active":"2024-04-25T09:04:20.779493+0000","last_peered":"2024-04-25T09:04:20.779493+0000","last_clean":"2024-04-25T09:04:20.779493+0000","last_became_active":"2024-04-25T09:04:19.779796+0000","last_became_peered":"2024-04-25T09:04:19.779796+0000","last_unstale":"2024-04-25T09:04:20.779493+0000","last_undegraded":"2024-04-25T09:04:20.779493+0000","last_fullsized":"2024-04-25T09:04:20.779493+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:33.399806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057635+0000","last_change":"2024-04-25T09:04:18.781602+0000","last_active":"2024-04-25T09:04:21.057635+0000","last_peered":"2024-04-25T09:04:21.057635+0000","last_clean":"2024-04-25T09:04:21.057635+0000","last_became_active":"2024-04-25T09:04:18.781330+0000","last_became_peered":"2024-04-25T09:04:18.781330+0000","last_unstale":"2024-04-25T09:04:21.057635+0000","last_undegraded":"2024-04-25T09:04:21.057635+0000","last_fullsized":"2024-04-25T09:04:21.057635+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:12.592722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779320+0000","last_change":"2024-04-25T09:04:19.786855+0000","last_active":"2024-04-25T09:04:20.779320+0000","last_peered":"2024-04-25T09:04:20.779320+0000","last_clean":"2024-04-25T09:04:20.779320+0000","last_became_active":"2024-04-25T09:04:19.785415+0000","last_became_peered":"2024-04-25T09:04:19.785415+0000","last_unstale":"2024-04-25T09:04:20.779320+0000","last_undegraded":"2024-04-25T09:04:20.779320+0000","last_fullsized":"2024-04-25T09:04:20.779320+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:27.395452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057756+0000","last_change":"2024-04-25T09:04:18.779920+0000","last_active":"2024-04-25T09:04:21.057756+0000","last_peered":"2024-04-25T09:04:21.057756+0000","last_clean":"2024-04-25T09:04:21.057756+0000","last_became_active":"2024-04-25T09:04:18.779619+0000","last_became_peered":"2024-04-25T09:04:18.779619+0000","last_unstale":"2024-04-25T09:04:21.057756+0000","last_undegraded":"2024-04-25T09:04:21.057756+0000","last_fullsized":"2024-04-25T09:04:21.057756+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:49.253821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779054+0000","last_change":"2024-04-25T09:04:19.789265+0000","last_active":"2024-04-25T09:04:20.779054+0000","last_peered":"2024-04-25T09:04:20.779054+0000","last_clean":"2024-04-25T09:04:20.779054+0000","last_became_active":"2024-04-25T09:04:19.788982+0000","last_became_peered":"2024-04-25T09:04:19.788982+0000","last_unstale":"2024-04-25T09:04:20.779054+0000","last_undegraded":"2024-04-25T09:04:20.779054+0000","last_fullsized":"2024-04-25T09:04:20.779054+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:01.192279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"110'8","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057033+0000","last_change":"2024-04-25T09:04:18.780196+0000","last_active":"2024-04-25T09:04:21.057033+0000","last_peered":"2024-04-25T09:04:21.057033+0000","last_clean":"2024-04-25T09:04:21.057033+0000","last_became_active":"2024-04-25T09:04:18.779896+0000","last_became_peered":"2024-04-25T09:04:18.779896+0000","last_unstale":"2024-04-25T09:04:21.057033+0000","last_undegraded":"2024-04-25T09:04:21.057033+0000","last_fullsized":"2024-04-25T09:04:21.057033+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:10.317498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057549+0000","last_change":"2024-04-25T09:04:19.800596+0000","last_active":"2024-04-25T09:04:21.057549+0000","last_peered":"2024-04-25T09:04:21.057549+0000","last_clean":"2024-04-25T09:04:21.057549+0000","last_became_active":"2024-04-25T09:04:19.799962+0000","last_became_peered":"2024-04-25T09:04:19.799962+0000","last_unstale":"2024-04-25T09:04:21.057549+0000","last_undegraded":"2024-04-25T09:04:21.057549+0000","last_fullsized":"2024-04-25T09:04:21.057549+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:33.546695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780432+0000","last_change":"2024-04-25T09:04:18.782761+0000","last_active":"2024-04-25T09:04:20.780432+0000","last_peered":"2024-04-25T09:04:20.780432+0000","last_clean":"2024-04-25T09:04:20.780432+0000","last_became_active":"2024-04-25T09:04:18.781007+0000","last_became_peered":"2024-04-25T09:04:18.781007+0000","last_unstale":"2024-04-25T09:04:20.780432+0000","last_undegraded":"2024-04-25T09:04:20.780432+0000","last_fullsized":"2024-04-25T09:04:20.780432+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.596379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057895+0000","last_change":"2024-04-25T09:04:19.800702+0000","last_active":"2024-04-25T09:04:21.057895+0000","last_peered":"2024-04-25T09:04:21.057895+0000","last_clean":"2024-04-25T09:04:21.057895+0000","last_became_active":"2024-04-25T09:04:19.800147+0000","last_became_peered":"2024-04-25T09:04:19.800147+0000","last_unstale":"2024-04-25T09:04:21.057895+0000","last_undegraded":"2024-04-25T09:04:21.057895+0000","last_fullsized":"2024-04-25T09:04:21.057895+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:55.878338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057658+0000","last_change":"2024-04-25T09:04:18.782503+0000","last_active":"2024-04-25T09:04:21.057658+0000","last_peered":"2024-04-25T09:04:21.057658+0000","last_clean":"2024-04-25T09:04:21.057658+0000","last_became_active":"2024-04-25T09:04:18.782229+0000","last_became_peered":"2024-04-25T09:04:18.782229+0000","last_unstale":"2024-04-25T09:04:21.057658+0000","last_undegraded":"2024-04-25T09:04:21.057658+0000","last_fullsized":"2024-04-25T09:04:21.057658+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:54.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057936+0000","last_change":"2024-04-25T09:04:19.795694+0000","last_active":"2024-04-25T09:04:21.057936+0000","last_peered":"2024-04-25T09:04:21.057936+0000","last_clean":"2024-04-25T09:04:21.057936+0000","last_became_active":"2024-04-25T09:04:19.795279+0000","last_became_peered":"2024-04-25T09:04:19.795279+0000","last_unstale":"2024-04-25T09:04:21.057936+0000","last_undegraded":"2024-04-25T09:04:21.057936+0000","last_fullsized":"2024-04-25T09:04:21.057936+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:45.894539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058232+0000","last_change":"2024-04-25T09:04:18.780659+0000","last_active":"2024-04-25T09:04:21.058232+0000","last_peered":"2024-04-25T09:04:21.058232+0000","last_clean":"2024-04-25T09:04:21.058232+0000","last_became_active":"2024-04-25T09:04:18.780411+0000","last_became_peered":"2024-04-25T09:04:18.780411+0000","last_unstale":"2024-04-25T09:04:21.058232+0000","last_undegraded":"2024-04-25T09:04:21.058232+0000","last_fullsized":"2024-04-25T09:04:21.058232+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:09.338518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058413+0000","last_change":"2024-04-25T09:04:19.776710+0000","last_active":"2024-04-25T09:04:21.058413+0000","last_peered":"2024-04-25T09:04:21.058413+0000","last_clean":"2024-04-25T09:04:21.058413+0000","last_became_active":"2024-04-25T09:04:19.776446+0000","last_became_peered":"2024-04-25T09:04:19.776446+0000","last_unstale":"2024-04-25T09:04:21.058413+0000","last_undegraded":"2024-04-25T09:04:21.058413+0000","last_fullsized":"2024-04-25T09:04:21.058413+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:38.404575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057641+0000","last_change":"2024-04-25T09:04:18.785410+0000","last_active":"2024-04-25T09:04:21.057641+0000","last_peered":"2024-04-25T09:04:21.057641+0000","last_clean":"2024-04-25T09:04:21.057641+0000","last_became_active":"2024-04-25T09:04:18.785124+0000","last_became_peered":"2024-04-25T09:04:18.785124+0000","last_unstale":"2024-04-25T09:04:21.057641+0000","last_undegraded":"2024-04-25T09:04:21.057641+0000","last_fullsized":"2024-04-25T09:04:21.057641+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:16.868980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058048+0000","last_change":"2024-04-25T09:04:19.788903+0000","last_active":"2024-04-25T09:04:21.058048+0000","last_peered":"2024-04-25T09:04:21.058048+0000","last_clean":"2024-04-25T09:04:21.058048+0000","last_became_active":"2024-04-25T09:04:19.787700+0000","last_became_peered":"2024-04-25T09:04:19.787700+0000","last_unstale":"2024-04-25T09:04:21.058048+0000","last_undegraded":"2024-04-25T09:04:21.058048+0000","last_fullsized":"2024-04-25T09:04:21.058048+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:57.117380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057543+0000","last_change":"2024-04-25T09:04:18.778438+0000","last_active":"2024-04-25T09:04:21.057543+0000","last_peered":"2024-04-25T09:04:21.057543+0000","last_clean":"2024-04-25T09:04:21.057543+0000","last_became_active":"2024-04-25T09:04:18.778132+0000","last_became_peered":"2024-04-25T09:04:18.778132+0000","last_unstale":"2024-04-25T09:04:21.057543+0000","last_undegraded":"2024-04-25T09:04:21.057543+0000","last_fullsized":"2024-04-25T09:04:21.057543+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:19.402178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779894+0000","last_change":"2024-04-25T09:04:19.794540+0000","last_active":"2024-04-25T09:04:20.779894+0000","last_peered":"2024-04-25T09:04:20.779894+0000","last_clean":"2024-04-25T09:04:20.779894+0000","last_became_active":"2024-04-25T09:04:19.794225+0000","last_became_peered":"2024-04-25T09:04:19.794225+0000","last_unstale":"2024-04-25T09:04:20.779894+0000","last_undegraded":"2024-04-25T09:04:20.779894+0000","last_fullsized":"2024-04-25T09:04:20.779894+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:38.404575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057077+0000","last_change":"2024-04-25T09:04:18.776598+0000","last_active":"2024-04-25T09:04:21.057077+0000","last_peered":"2024-04-25T09:04:21.057077+0000","last_clean":"2024-04-25T09:04:21.057077+0000","last_became_active":"2024-04-25T09:04:18.776289+0000","last_became_peered":"2024-04-25T09:04:18.776289+0000","last_unstale":"2024-04-25T09:04:21.057077+0000","last_undegraded":"2024-04-25T09:04:21.057077+0000","last_fullsized":"2024-04-25T09:04:21.057077+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:31.394323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058465+0000","last_change":"2024-04-25T09:04:19.784806+0000","last_active":"2024-04-25T09:04:21.058465+0000","last_peered":"2024-04-25T09:04:21.058465+0000","last_clean":"2024-04-25T09:04:21.058465+0000","last_became_active":"2024-04-25T09:04:19.784531+0000","last_became_peered":"2024-04-25T09:04:19.784531+0000","last_unstale":"2024-04-25T09:04:21.058465+0000","last_undegraded":"2024-04-25T09:04:21.058465+0000","last_fullsized":"2024-04-25T09:04:21.058465+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:36.499777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057849+0000","last_change":"2024-04-25T09:04:18.780829+0000","last_active":"2024-04-25T09:04:21.057849+0000","last_peered":"2024-04-25T09:04:21.057849+0000","last_clean":"2024-04-25T09:04:21.057849+0000","last_became_active":"2024-04-25T09:04:18.780576+0000","last_became_peered":"2024-04-25T09:04:18.780576+0000","last_unstale":"2024-04-25T09:04:21.057849+0000","last_undegraded":"2024-04-25T09:04:21.057849+0000","last_fullsized":"2024-04-25T09:04:21.057849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:59.306282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779084+0000","last_change":"2024-04-25T09:04:19.785019+0000","last_active":"2024-04-25T09:04:20.779084+0000","last_peered":"2024-04-25T09:04:20.779084+0000","last_clean":"2024-04-25T09:04:20.779084+0000","last_became_active":"2024-04-25T09:04:19.784707+0000","last_became_peered":"2024-04-25T09:04:19.784707+0000","last_unstale":"2024-04-25T09:04:20.779084+0000","last_undegraded":"2024-04-25T09:04:20.779084+0000","last_fullsized":"2024-04-25T09:04:20.779084+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:04.233790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779856+0000","last_change":"2024-04-25T09:04:18.783672+0000","last_active":"2024-04-25T09:04:20.779856+0000","last_peered":"2024-04-25T09:04:20.779856+0000","last_clean":"2024-04-25T09:04:20.779856+0000","last_became_active":"2024-04-25T09:04:18.783386+0000","last_became_peered":"2024-04-25T09:04:18.783386+0000","last_unstale":"2024-04-25T09:04:20.779856+0000","last_undegraded":"2024-04-25T09:04:20.779856+0000","last_fullsized":"2024-04-25T09:04:20.779856+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:49.532203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058629+0000","last_change":"2024-04-25T09:04:19.802570+0000","last_active":"2024-04-25T09:04:21.058629+0000","last_peered":"2024-04-25T09:04:21.058629+0000","last_clean":"2024-04-25T09:04:21.058629+0000","last_became_active":"2024-04-25T09:04:19.802297+0000","last_became_peered":"2024-04-25T09:04:19.802297+0000","last_unstale":"2024-04-25T09:04:21.058629+0000","last_undegraded":"2024-04-25T09:04:21.058629+0000","last_fullsized":"2024-04-25T09:04:21.058629+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:13.683649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779614+0000","last_change":"2024-04-25T09:04:18.786584+0000","last_active":"2024-04-25T09:04:20.779614+0000","last_peered":"2024-04-25T09:04:20.779614+0000","last_clean":"2024-04-25T09:04:20.779614+0000","last_became_active":"2024-04-25T09:04:18.786328+0000","last_became_peered":"2024-04-25T09:04:18.786328+0000","last_unstale":"2024-04-25T09:04:20.779614+0000","last_undegraded":"2024-04-25T09:04:20.779614+0000","last_fullsized":"2024-04-25T09:04:20.779614+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:52.173887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780410+0000","last_change":"2024-04-25T09:04:19.798529+0000","last_active":"2024-04-25T09:04:20.780410+0000","last_peered":"2024-04-25T09:04:20.780410+0000","last_clean":"2024-04-25T09:04:20.780410+0000","last_became_active":"2024-04-25T09:04:19.796988+0000","last_became_peered":"2024-04-25T09:04:19.796988+0000","last_unstale":"2024-04-25T09:04:20.780410+0000","last_undegraded":"2024-04-25T09:04:20.780410+0000","last_fullsized":"2024-04-25T09:04:20.780410+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:31.549606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058600+0000","last_change":"2024-04-25T09:04:18.778426+0000","last_active":"2024-04-25T09:04:21.058600+0000","last_peered":"2024-04-25T09:04:21.058600+0000","last_clean":"2024-04-25T09:04:21.058600+0000","last_became_active":"2024-04-25T09:04:18.777966+0000","last_became_peered":"2024-04-25T09:04:18.777966+0000","last_unstale":"2024-04-25T09:04:21.058600+0000","last_undegraded":"2024-04-25T09:04:21.058600+0000","last_fullsized":"2024-04-25T09:04:21.058600+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:06.531886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780445+0000","last_change":"2024-04-25T09:04:19.795159+0000","last_active":"2024-04-25T09:04:20.780445+0000","last_peered":"2024-04-25T09:04:20.780445+0000","last_clean":"2024-04-25T09:04:20.780445+0000","last_became_active":"2024-04-25T09:04:19.794311+0000","last_became_peered":"2024-04-25T09:04:19.794311+0000","last_unstale":"2024-04-25T09:04:20.780445+0000","last_undegraded":"2024-04-25T09:04:20.780445+0000","last_fullsized":"2024-04-25T09:04:20.780445+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.978804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780119+0000","last_change":"2024-04-25T09:04:18.784336+0000","last_active":"2024-04-25T09:04:20.780119+0000","last_peered":"2024-04-25T09:04:20.780119+0000","last_clean":"2024-04-25T09:04:20.780119+0000","last_became_active":"2024-04-25T09:04:18.784076+0000","last_became_peered":"2024-04-25T09:04:18.784076+0000","last_unstale":"2024-04-25T09:04:20.780119+0000","last_undegraded":"2024-04-25T09:04:20.780119+0000","last_fullsized":"2024-04-25T09:04:20.780119+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:52.173887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058111+0000","last_change":"2024-04-25T09:04:19.799561+0000","last_active":"2024-04-25T09:04:21.058111+0000","last_peered":"2024-04-25T09:04:21.058111+0000","last_clean":"2024-04-25T09:04:21.058111+0000","last_became_active":"2024-04-25T09:04:19.799279+0000","last_became_peered":"2024-04-25T09:04:19.799279+0000","last_unstale":"2024-04-25T09:04:21.058111+0000","last_undegraded":"2024-04-25T09:04:21.058111+0000","last_fullsized":"2024-04-25T09:04:21.058111+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:35.749412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779583+0000","last_change":"2024-04-25T09:04:18.786013+0000","last_active":"2024-04-25T09:04:20.779583+0000","last_peered":"2024-04-25T09:04:20.779583+0000","last_clean":"2024-04-25T09:04:20.779583+0000","last_became_active":"2024-04-25T09:04:18.785730+0000","last_became_peered":"2024-04-25T09:04:18.785730+0000","last_unstale":"2024-04-25T09:04:20.779583+0000","last_undegraded":"2024-04-25T09:04:20.779583+0000","last_fullsized":"2024-04-25T09:04:20.779583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:34.744620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779933+0000","last_change":"2024-04-25T09:04:19.778858+0000","last_active":"2024-04-25T09:04:20.779933+0000","last_peered":"2024-04-25T09:04:20.779933+0000","last_clean":"2024-04-25T09:04:20.779933+0000","last_became_active":"2024-04-25T09:04:19.778596+0000","last_became_peered":"2024-04-25T09:04:19.778596+0000","last_unstale":"2024-04-25T09:04:20.779933+0000","last_undegraded":"2024-04-25T09:04:20.779933+0000","last_fullsized":"2024-04-25T09:04:20.779933+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.073711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057852+0000","last_change":"2024-04-25T09:04:18.776766+0000","last_active":"2024-04-25T09:04:21.057852+0000","last_peered":"2024-04-25T09:04:21.057852+0000","last_clean":"2024-04-25T09:04:21.057852+0000","last_became_active":"2024-04-25T09:04:18.776457+0000","last_became_peered":"2024-04-25T09:04:18.776457+0000","last_unstale":"2024-04-25T09:04:21.057852+0000","last_undegraded":"2024-04-25T09:04:21.057852+0000","last_fullsized":"2024-04-25T09:04:21.057852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:48.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780240+0000","last_change":"2024-04-25T09:04:19.787788+0000","last_active":"2024-04-25T09:04:20.780240+0000","last_peered":"2024-04-25T09:04:20.780240+0000","last_clean":"2024-04-25T09:04:20.780240+0000","last_became_active":"2024-04-25T09:04:19.787298+0000","last_became_peered":"2024-04-25T09:04:19.787298+0000","last_unstale":"2024-04-25T09:04:20.780240+0000","last_undegraded":"2024-04-25T09:04:20.780240+0000","last_fullsized":"2024-04-25T09:04:20.780240+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.536995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779950+0000","last_change":"2024-04-25T09:04:18.777801+0000","last_active":"2024-04-25T09:04:20.779950+0000","last_peered":"2024-04-25T09:04:20.779950+0000","last_clean":"2024-04-25T09:04:20.779950+0000","last_became_active":"2024-04-25T09:04:18.777476+0000","last_became_peered":"2024-04-25T09:04:18.777476+0000","last_unstale":"2024-04-25T09:04:20.779950+0000","last_undegraded":"2024-04-25T09:04:20.779950+0000","last_fullsized":"2024-04-25T09:04:20.779950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:25.631107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058628+0000","last_change":"2024-04-25T09:04:19.785153+0000","last_active":"2024-04-25T09:04:21.058628+0000","last_peered":"2024-04-25T09:04:21.058628+0000","last_clean":"2024-04-25T09:04:21.058628+0000","last_became_active":"2024-04-25T09:04:19.783850+0000","last_became_peered":"2024-04-25T09:04:19.783850+0000","last_unstale":"2024-04-25T09:04:21.058628+0000","last_undegraded":"2024-04-25T09:04:21.058628+0000","last_fullsized":"2024-04-25T09:04:21.058628+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:59.671612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.056958+0000","last_change":"2024-04-25T09:04:18.777812+0000","last_active":"2024-04-25T09:04:21.056958+0000","last_peered":"2024-04-25T09:04:21.056958+0000","last_clean":"2024-04-25T09:04:21.056958+0000","last_became_active":"2024-04-25T09:04:18.777530+0000","last_became_peered":"2024-04-25T09:04:18.777530+0000","last_unstale":"2024-04-25T09:04:21.056958+0000","last_undegraded":"2024-04-25T09:04:21.056958+0000","last_fullsized":"2024-04-25T09:04:21.056958+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:40.651348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779900+0000","last_change":"2024-04-25T09:04:19.791619+0000","last_active":"2024-04-25T09:04:20.779900+0000","last_peered":"2024-04-25T09:04:20.779900+0000","last_clean":"2024-04-25T09:04:20.779900+0000","last_became_active":"2024-04-25T09:04:19.791348+0000","last_became_peered":"2024-04-25T09:04:19.791348+0000","last_unstale":"2024-04-25T09:04:20.779900+0000","last_undegraded":"2024-04-25T09:04:20.779900+0000","last_fullsized":"2024-04-25T09:04:20.779900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:28.172130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779941+0000","last_change":"2024-04-25T09:04:18.784478+0000","last_active":"2024-04-25T09:04:20.779941+0000","last_peered":"2024-04-25T09:04:20.779941+0000","last_clean":"2024-04-25T09:04:20.779941+0000","last_became_active":"2024-04-25T09:04:18.784020+0000","last_became_peered":"2024-04-25T09:04:18.784020+0000","last_unstale":"2024-04-25T09:04:20.779941+0000","last_undegraded":"2024-04-25T09:04:20.779941+0000","last_fullsized":"2024-04-25T09:04:20.779941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:49.195876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779013+0000","last_change":"2024-04-25T09:04:19.784038+0000","last_active":"2024-04-25T09:04:20.779013+0000","last_peered":"2024-04-25T09:04:20.779013+0000","last_clean":"2024-04-25T09:04:20.779013+0000","last_became_active":"2024-04-25T09:04:19.783756+0000","last_became_peered":"2024-04-25T09:04:19.783756+0000","last_unstale":"2024-04-25T09:04:20.779013+0000","last_undegraded":"2024-04-25T09:04:20.779013+0000","last_fullsized":"2024-04-25T09:04:20.779013+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:46.728849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058753+0000","last_change":"2024-04-25T09:04:18.785178+0000","last_active":"2024-04-25T09:04:21.058753+0000","last_peered":"2024-04-25T09:04:21.058753+0000","last_clean":"2024-04-25T09:04:21.058753+0000","last_became_active":"2024-04-25T09:04:18.784877+0000","last_became_peered":"2024-04-25T09:04:18.784877+0000","last_unstale":"2024-04-25T09:04:21.058753+0000","last_undegraded":"2024-04-25T09:04:21.058753+0000","last_fullsized":"2024-04-25T09:04:21.058753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:53.798703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":340,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058626+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:04:21.058626+0000","last_peered":"2024-04-25T09:04:21.058626+0000","last_clean":"2024-04-25T09:04:21.058626+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:04:21.058626+0000","last_undegraded":"2024-04-25T09:04:21.058626+0000","last_fullsized":"2024-04-25T09:04:21.058626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47004,"kb_used_data":1936,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324836,"statfs":{"total":96636764160,"available":96588632064,"internally_reserved":0,"allocated":1982464,"data_stored":1189078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50568,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321272,"statfs":{"total":96636764160,"available":96584982528,"internally_reserved":0,"allocated":1372160,"data_stored":591864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45016,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326824,"statfs":{"total":96636764160,"available":96590667776,"internally_reserved":0,"allocated":1388544,"data_stored":598698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54724,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317116,"statfs":{"total":96636764160,"available":96580726784,"internally_reserved":0,"allocated":1368064,"data_stored":591794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54756,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317084,"statfs":{"total":96636764160,"available":96580694016,"internally_reserved":0,"allocated":1396736,"data_stored":599776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1368064,"data_stored":591794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58900,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312940,"statfs":{"total":96636764160,"available":96576450560,"internally_reserved":0,"allocated":1376256,"data_stored":591918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1994752,"data_stored":1190186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:23.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.266+0000 7f3b08658640 1 Processor -- start 2024-04-25T09:04:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.266+0000 7f3b08658640 1 -- start start 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.267+0000 7f3b08658640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3b0015def0 0x7f3b000d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.267+0000 7f3b08658640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b000d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.267+0000 7f3b08658640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000d2550 con 0x7f3b000d0400 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.267+0000 7f3b08658640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0015e2d0 con 0x7f3b0015def0 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.267+0000 7f3b08658640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000d2830 con 0x7f3b000b94c0 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.267+0000 7f3b06bf5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b000d0400 0x7f3b000b5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54740/0 (socket says 172.21.15.5:54740) 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.267+0000 7f3b06bf5640 1 -- 172.21.15.5:0/4095066717 learned_addr learned my addr 172.21.15.5:0/4095066717 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b063f4640 1 --2- 172.21.15.5:0/4095066717 >> v2:172.21.15.80:3300/0 conn(0x7f3b0015def0 0x7f3b000d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b05bf3640 1 --2- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b000d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b053f2640 1 -- 172.21.15.5:0/4095066717 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938297802 0 0) 0x7f3b000d2550 con 0x7f3b000d0400 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b053f2640 1 -- 172.21.15.5:0/4095066717 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec003520 con 0x7f3b000d0400 2024-04-25T09:04:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b053f2640 1 -- 172.21.15.5:0/4095066717 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595489598 0 0) 0x7f3aec003520 con 0x7f3b000d0400 2024-04-25T09:04:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b063f4640 1 -- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 msgr2=0x7f3b000d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b063f4640 1 --2- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b000d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b063f4640 1 -- 172.21.15.5:0/4095066717 >> v1:172.21.15.5:6789/0 conn(0x7f3b000d0400 legacy=0x7f3b000b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b063f4640 1 -- 172.21.15.5:0/4095066717 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000d2b10 con 0x7f3b0015def0 2024-04-25T09:04:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.268+0000 7f3b05bf3640 1 --2- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b000d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.269+0000 7f3b063f4640 1 --2- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 0x7f3b000d35f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009d90 tx=0x7f3afc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b8259a507aaa07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.269+0000 7f3b053f2640 1 -- 172.21.15.5:0/4095066717 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8001670 con 0x7f3b0015def0 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.269+0000 7f3b053f2640 1 -- 172.21.15.5:0/4095066717 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc007540 con 0x7f3b0015def0 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.269+0000 7f3b053f2640 1 -- 172.21.15.5:0/4095066717 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc007910 con 0x7f3b0015def0 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 -- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 msgr2=0x7f3b000d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 --2- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 0x7f3b000d35f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009d90 tx=0x7f3afc02a5f0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 -- 172.21.15.5:0/4095066717 shutdown_connections 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 --2- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b000d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 --2- 172.21.15.5:0/4095066717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 0x7f3b000d35f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 -- 172.21.15.5:0/4095066717 >> 172.21.15.5:0/4095066717 conn(0x7f3b0006b000 msgr2=0x7f3b0006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 -- 172.21.15.5:0/4095066717 shutdown_connections 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.270+0000 7f3b08658640 1 -- 172.21.15.5:0/4095066717 wait complete. 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.271+0000 7f3b08658640 1 Processor -- start 2024-04-25T09:04:23.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.271+0000 7f3b08658640 1 -- start start 2024-04-25T09:04:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b08658640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b00160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b08658640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b000d0400 0x7f3b001f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b08658640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 0x7f3b001f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b08658640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000d2260 con 0x7f3b000d0400 2024-04-25T09:04:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b08658640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000d30d0 con 0x7f3b0015def0 2024-04-25T09:04:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b08658640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000d0870 con 0x7f3b000b94c0 2024-04-25T09:04:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b000d0400 0x7f3b001f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b000d0400 0x7f3b001f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36152/0 (socket says 172.21.15.5:36152) 2024-04-25T09:04:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 -- 172.21.15.5:0/3955935440 learned_addr learned my addr 172.21.15.5:0/3955935440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b06bf5640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 0x7f3b001f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b063f4640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b00160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 -- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 msgr2=0x7f3b00160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b00160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 -- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 msgr2=0x7f3b001f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 0x7f3b001f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 -- 172.21.15.5:0/3955935440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000aaf60 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b063f4640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b00160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3b05bf3640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b000d0400 0x7f3b001f3cd0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f3af000ebe0 tx=0x7f3af000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3af6ffd640 1 -- 172.21.15.5:0/3955935440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0017070 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.272+0000 7f3af6ffd640 1 -- 172.21.15.5:0/3955935440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000cc30 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.273+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b000ab240 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.273+0000 7f3af6ffd640 1 -- 172.21.15.5:0/3955935440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0013470 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.273+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b00150670 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.274+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0004ef20 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.274+0000 7f3af6ffd640 1 -- 172.21.15.5:0/3955935440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3af001a070 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.275+0000 7f3af6ffd640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3ae406b4d0 0x7f3ae406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.275+0000 7f3af6ffd640 1 -- 172.21.15.5:0/3955935440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3af008a500 con 0x7f3b000d0400 2024-04-25T09:04:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.275+0000 7f3b063f4640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3ae406b4d0 0x7f3ae406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.275+0000 7f3b063f4640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3ae406b4d0 0x7f3ae406d990 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3afc034000 tx=0x7f3afc033040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.279+0000 7f3af6ffd640 1 -- 172.21.15.5:0/3955935440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3af0059380 con 0x7f3b000d0400 2024-04-25T09:04:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.457+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b000b2bb0 con 0x7f3ae406b4d0 2024-04-25T09:04:23.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.464+0000 7f3af6ffd640 1 -- 172.21.15.5:0/3955935440 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252480 (secure 0 0 0) 0x7f3b000b2bb0 con 0x7f3ae406b4d0 2024-04-25T09:04:23.455 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:23.456 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3ae406b4d0 msgr2=0x7f3ae406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3ae406b4d0 0x7f3ae406d990 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3afc034000 tx=0x7f3afc033040 comp rx=0 tx=0).stop 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b000d0400 msgr2=0x7f3b001f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b000d0400 0x7f3b001f3cd0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f3af000ebe0 tx=0x7f3af000c520 comp rx=0 tx=0).stop 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 shutdown_connections 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3ae406b4d0 0x7f3ae406d990 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b0015def0 0x7f3b001f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b000d0400 0x7f3b001f3cd0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.466+0000 7f3b08658640 1 --2- 172.21.15.5:0/3955935440 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b000b94c0 0x7f3b00160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.467+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 >> 172.21.15.5:0/3955935440 conn(0x7f3b0006b000 msgr2=0x7f3b000ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.467+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 shutdown_connections 2024-04-25T09:04:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.467+0000 7f3b08658640 1 -- 172.21.15.5:0/3955935440 wait complete. 2024-04-25T09:04:23.466 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-04-25T09:04:22.490849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":398828,"kb_used_data":11960,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754575892,"statfs":{"total":773094113280,"available":772685713408,"internally_reserved":0,"allocated":12247040,"data_stored":5945108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":396021297},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.731546"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780280+0000","last_change":"2024-04-25T09:04:19.800041+0000","last_active":"2024-04-25T09:04:20.780280+0000","last_peered":"2024-04-25T09:04:20.780280+0000","last_clean":"2024-04-25T09:04:20.780280+0000","last_became_active":"2024-04-25T09:04:19.799333+0000","last_became_peered":"2024-04-25T09:04:19.799333+0000","last_unstale":"2024-04-25T09:04:20.780280+0000","last_undegraded":"2024-04-25T09:04:20.780280+0000","last_fullsized":"2024-04-25T09:04:20.780280+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:33.800119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780154+0000","last_change":"2024-04-25T09:04:19.779440+0000","last_active":"2024-04-25T09:04:20.780154+0000","last_peered":"2024-04-25T09:04:20.780154+0000","last_clean":"2024-04-25T09:04:20.780154+0000","last_became_active":"2024-04-25T09:04:19.779162+0000","last_became_peered":"2024-04-25T09:04:19.779162+0000","last_unstale":"2024-04-25T09:04:20.780154+0000","last_undegraded":"2024-04-25T09:04:20.780154+0000","last_fullsized":"2024-04-25T09:04:20.780154+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:17.601171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057781+0000","last_change":"2024-04-25T09:04:19.780734+0000","last_active":"2024-04-25T09:04:21.057781+0000","last_peered":"2024-04-25T09:04:21.057781+0000","last_clean":"2024-04-25T09:04:21.057781+0000","last_became_active":"2024-04-25T09:04:19.780397+0000","last_became_peered":"2024-04-25T09:04:19.780397+0000","last_unstale":"2024-04-25T09:04:21.057781+0000","last_undegraded":"2024-04-25T09:04:21.057781+0000","last_fullsized":"2024-04-25T09:04:21.057781+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:12.110578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780122+0000","last_change":"2024-04-25T09:04:19.795274+0000","last_active":"2024-04-25T09:04:20.780122+0000","last_peered":"2024-04-25T09:04:20.780122+0000","last_clean":"2024-04-25T09:04:20.780122+0000","last_became_active":"2024-04-25T09:04:19.794532+0000","last_became_peered":"2024-04-25T09:04:19.794532+0000","last_unstale":"2024-04-25T09:04:20.780122+0000","last_undegraded":"2024-04-25T09:04:20.780122+0000","last_fullsized":"2024-04-25T09:04:20.780122+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:59.671612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057348+0000","last_change":"2024-04-25T09:04:19.781147+0000","last_active":"2024-04-25T09:04:21.057348+0000","last_peered":"2024-04-25T09:04:21.057348+0000","last_clean":"2024-04-25T09:04:21.057348+0000","last_became_active":"2024-04-25T09:04:19.780886+0000","last_became_peered":"2024-04-25T09:04:19.780886+0000","last_unstale":"2024-04-25T09:04:21.057348+0000","last_undegraded":"2024-04-25T09:04:21.057348+0000","last_fullsized":"2024-04-25T09:04:21.057348+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:39.264100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057349+0000","last_change":"2024-04-25T09:04:19.790462+0000","last_active":"2024-04-25T09:04:21.057349+0000","last_peered":"2024-04-25T09:04:21.057349+0000","last_clean":"2024-04-25T09:04:21.057349+0000","last_became_active":"2024-04-25T09:04:19.790177+0000","last_became_peered":"2024-04-25T09:04:19.790177+0000","last_unstale":"2024-04-25T09:04:21.057349+0000","last_undegraded":"2024-04-25T09:04:21.057349+0000","last_fullsized":"2024-04-25T09:04:21.057349+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:11.322291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057747+0000","last_change":"2024-04-25T09:04:19.784451+0000","last_active":"2024-04-25T09:04:21.057747+0000","last_peered":"2024-04-25T09:04:21.057747+0000","last_clean":"2024-04-25T09:04:21.057747+0000","last_became_active":"2024-04-25T09:04:19.784186+0000","last_became_peered":"2024-04-25T09:04:19.784186+0000","last_unstale":"2024-04-25T09:04:21.057747+0000","last_undegraded":"2024-04-25T09:04:21.057747+0000","last_fullsized":"2024-04-25T09:04:21.057747+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:17.780131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058302+0000","last_change":"2024-04-25T09:04:19.781221+0000","last_active":"2024-04-25T09:04:21.058302+0000","last_peered":"2024-04-25T09:04:21.058302+0000","last_clean":"2024-04-25T09:04:21.058302+0000","last_became_active":"2024-04-25T09:04:19.780677+0000","last_became_peered":"2024-04-25T09:04:19.780677+0000","last_unstale":"2024-04-25T09:04:21.058302+0000","last_undegraded":"2024-04-25T09:04:21.058302+0000","last_fullsized":"2024-04-25T09:04:21.058302+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:49.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780319+0000","last_change":"2024-04-25T09:04:19.799911+0000","last_active":"2024-04-25T09:04:20.780319+0000","last_peered":"2024-04-25T09:04:20.780319+0000","last_clean":"2024-04-25T09:04:20.780319+0000","last_became_active":"2024-04-25T09:04:19.799364+0000","last_became_peered":"2024-04-25T09:04:19.799364+0000","last_unstale":"2024-04-25T09:04:20.780319+0000","last_undegraded":"2024-04-25T09:04:20.780319+0000","last_fullsized":"2024-04-25T09:04:20.780319+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:08.219708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780248+0000","last_change":"2024-04-25T09:04:19.798863+0000","last_active":"2024-04-25T09:04:20.780248+0000","last_peered":"2024-04-25T09:04:20.780248+0000","last_clean":"2024-04-25T09:04:20.780248+0000","last_became_active":"2024-04-25T09:04:19.798511+0000","last_became_peered":"2024-04-25T09:04:19.798511+0000","last_unstale":"2024-04-25T09:04:20.780248+0000","last_undegraded":"2024-04-25T09:04:20.780248+0000","last_fullsized":"2024-04-25T09:04:20.780248+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:40.822165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780101+0000","last_change":"2024-04-25T09:04:19.785145+0000","last_active":"2024-04-25T09:04:20.780101+0000","last_peered":"2024-04-25T09:04:20.780101+0000","last_clean":"2024-04-25T09:04:20.780101+0000","last_became_active":"2024-04-25T09:04:19.782841+0000","last_became_peered":"2024-04-25T09:04:19.782841+0000","last_unstale":"2024-04-25T09:04:20.780101+0000","last_undegraded":"2024-04-25T09:04:20.780101+0000","last_fullsized":"2024-04-25T09:04:20.780101+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:35.749412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780293+0000","last_change":"2024-04-25T09:04:19.798525+0000","last_active":"2024-04-25T09:04:20.780293+0000","last_peered":"2024-04-25T09:04:20.780293+0000","last_clean":"2024-04-25T09:04:20.780293+0000","last_became_active":"2024-04-25T09:04:19.796642+0000","last_became_peered":"2024-04-25T09:04:19.796642+0000","last_unstale":"2024-04-25T09:04:20.780293+0000","last_undegraded":"2024-04-25T09:04:20.780293+0000","last_fullsized":"2024-04-25T09:04:20.780293+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:14.559305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058308+0000","last_change":"2024-04-25T09:04:19.784843+0000","last_active":"2024-04-25T09:04:21.058308+0000","last_peered":"2024-04-25T09:04:21.058308+0000","last_clean":"2024-04-25T09:04:21.058308+0000","last_became_active":"2024-04-25T09:04:19.784576+0000","last_became_peered":"2024-04-25T09:04:19.784576+0000","last_unstale":"2024-04-25T09:04:21.058308+0000","last_undegraded":"2024-04-25T09:04:21.058308+0000","last_fullsized":"2024-04-25T09:04:21.058308+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.915579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057747+0000","last_change":"2024-04-25T09:04:19.782613+0000","last_active":"2024-04-25T09:04:21.057747+0000","last_peered":"2024-04-25T09:04:21.057747+0000","last_clean":"2024-04-25T09:04:21.057747+0000","last_became_active":"2024-04-25T09:04:19.782305+0000","last_became_peered":"2024-04-25T09:04:19.782305+0000","last_unstale":"2024-04-25T09:04:21.057747+0000","last_undegraded":"2024-04-25T09:04:21.057747+0000","last_fullsized":"2024-04-25T09:04:21.057747+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:32.075046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057796+0000","last_change":"2024-04-25T09:04:19.789821+0000","last_active":"2024-04-25T09:04:21.057796+0000","last_peered":"2024-04-25T09:04:21.057796+0000","last_clean":"2024-04-25T09:04:21.057796+0000","last_became_active":"2024-04-25T09:04:19.789531+0000","last_became_peered":"2024-04-25T09:04:19.789531+0000","last_unstale":"2024-04-25T09:04:21.057796+0000","last_undegraded":"2024-04-25T09:04:21.057796+0000","last_fullsized":"2024-04-25T09:04:21.057796+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:41.656140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779571+0000","last_change":"2024-04-25T09:04:19.797004+0000","last_active":"2024-04-25T09:04:20.779571+0000","last_peered":"2024-04-25T09:04:20.779571+0000","last_clean":"2024-04-25T09:04:20.779571+0000","last_became_active":"2024-04-25T09:04:19.796379+0000","last_became_peered":"2024-04-25T09:04:19.796379+0000","last_unstale":"2024-04-25T09:04:20.779571+0000","last_undegraded":"2024-04-25T09:04:20.779571+0000","last_fullsized":"2024-04-25T09:04:20.779571+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:57.117380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780452+0000","last_change":"2024-04-25T09:04:19.791244+0000","last_active":"2024-04-25T09:04:20.780452+0000","last_peered":"2024-04-25T09:04:20.780452+0000","last_clean":"2024-04-25T09:04:20.780452+0000","last_became_active":"2024-04-25T09:04:19.789743+0000","last_became_peered":"2024-04-25T09:04:19.789743+0000","last_unstale":"2024-04-25T09:04:20.780452+0000","last_undegraded":"2024-04-25T09:04:20.780452+0000","last_fullsized":"2024-04-25T09:04:20.780452+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:23.753084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058498+0000","last_change":"2024-04-25T09:04:19.789136+0000","last_active":"2024-04-25T09:04:21.058498+0000","last_peered":"2024-04-25T09:04:21.058498+0000","last_clean":"2024-04-25T09:04:21.058498+0000","last_became_active":"2024-04-25T09:04:19.788837+0000","last_became_peered":"2024-04-25T09:04:19.788837+0000","last_unstale":"2024-04-25T09:04:21.058498+0000","last_undegraded":"2024-04-25T09:04:21.058498+0000","last_fullsized":"2024-04-25T09:04:21.058498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:17.601171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057926+0000","last_change":"2024-04-25T09:04:19.785853+0000","last_active":"2024-04-25T09:04:21.057926+0000","last_peered":"2024-04-25T09:04:21.057926+0000","last_clean":"2024-04-25T09:04:21.057926+0000","last_became_active":"2024-04-25T09:04:19.785123+0000","last_became_peered":"2024-04-25T09:04:19.785123+0000","last_unstale":"2024-04-25T09:04:21.057926+0000","last_undegraded":"2024-04-25T09:04:21.057926+0000","last_fullsized":"2024-04-25T09:04:21.057926+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:33.399806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780391+0000","last_change":"2024-04-25T09:04:19.791007+0000","last_active":"2024-04-25T09:04:20.780391+0000","last_peered":"2024-04-25T09:04:20.780391+0000","last_clean":"2024-04-25T09:04:20.780391+0000","last_became_active":"2024-04-25T09:04:19.788484+0000","last_became_peered":"2024-04-25T09:04:19.788484+0000","last_unstale":"2024-04-25T09:04:20.780391+0000","last_undegraded":"2024-04-25T09:04:20.780391+0000","last_fullsized":"2024-04-25T09:04:20.780391+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:50.200669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780464+0000","last_change":"2024-04-25T09:04:19.784435+0000","last_active":"2024-04-25T09:04:20.780464+0000","last_peered":"2024-04-25T09:04:20.780464+0000","last_clean":"2024-04-25T09:04:20.780464+0000","last_became_active":"2024-04-25T09:04:19.783727+0000","last_became_peered":"2024-04-25T09:04:19.783727+0000","last_unstale":"2024-04-25T09:04:20.780464+0000","last_undegraded":"2024-04-25T09:04:20.780464+0000","last_fullsized":"2024-04-25T09:04:20.780464+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:58.823764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779354+0000","last_change":"2024-04-25T09:04:19.783388+0000","last_active":"2024-04-25T09:04:20.779354+0000","last_peered":"2024-04-25T09:04:20.779354+0000","last_clean":"2024-04-25T09:04:20.779354+0000","last_became_active":"2024-04-25T09:04:19.783112+0000","last_became_peered":"2024-04-25T09:04:19.783112+0000","last_unstale":"2024-04-25T09:04:20.779354+0000","last_undegraded":"2024-04-25T09:04:20.779354+0000","last_fullsized":"2024-04-25T09:04:20.779354+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:32.075046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779835+0000","last_change":"2024-04-25T09:04:19.785530+0000","last_active":"2024-04-25T09:04:20.779835+0000","last_peered":"2024-04-25T09:04:20.779835+0000","last_clean":"2024-04-25T09:04:20.779835+0000","last_became_active":"2024-04-25T09:04:19.785284+0000","last_became_peered":"2024-04-25T09:04:19.785284+0000","last_unstale":"2024-04-25T09:04:20.779835+0000","last_undegraded":"2024-04-25T09:04:20.779835+0000","last_fullsized":"2024-04-25T09:04:20.779835+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:33.646805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779012+0000","last_change":"2024-04-25T09:04:19.787579+0000","last_active":"2024-04-25T09:04:20.779012+0000","last_peered":"2024-04-25T09:04:20.779012+0000","last_clean":"2024-04-25T09:04:20.779012+0000","last_became_active":"2024-04-25T09:04:19.787307+0000","last_became_peered":"2024-04-25T09:04:19.787307+0000","last_unstale":"2024-04-25T09:04:20.779012+0000","last_undegraded":"2024-04-25T09:04:20.779012+0000","last_fullsized":"2024-04-25T09:04:20.779012+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:58.004882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780502+0000","last_change":"2024-04-25T09:04:19.789820+0000","last_active":"2024-04-25T09:04:20.780502+0000","last_peered":"2024-04-25T09:04:20.780502+0000","last_clean":"2024-04-25T09:04:20.780502+0000","last_became_active":"2024-04-25T09:04:19.788255+0000","last_became_peered":"2024-04-25T09:04:19.788255+0000","last_unstale":"2024-04-25T09:04:20.780502+0000","last_undegraded":"2024-04-25T09:04:20.780502+0000","last_fullsized":"2024-04-25T09:04:20.780502+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:44.039006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780304+0000","last_change":"2024-04-25T09:04:19.796975+0000","last_active":"2024-04-25T09:04:20.780304+0000","last_peered":"2024-04-25T09:04:20.780304+0000","last_clean":"2024-04-25T09:04:20.780304+0000","last_became_active":"2024-04-25T09:04:19.796685+0000","last_became_peered":"2024-04-25T09:04:19.796685+0000","last_unstale":"2024-04-25T09:04:20.780304+0000","last_undegraded":"2024-04-25T09:04:20.780304+0000","last_fullsized":"2024-04-25T09:04:20.780304+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:06.136765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057540+0000","last_change":"2024-04-25T09:04:19.798018+0000","last_active":"2024-04-25T09:04:21.057540+0000","last_peered":"2024-04-25T09:04:21.057540+0000","last_clean":"2024-04-25T09:04:21.057540+0000","last_became_active":"2024-04-25T09:04:19.797598+0000","last_became_peered":"2024-04-25T09:04:19.797598+0000","last_unstale":"2024-04-25T09:04:21.057540+0000","last_undegraded":"2024-04-25T09:04:21.057540+0000","last_fullsized":"2024-04-25T09:04:21.057540+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:32.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779485+0000","last_change":"2024-04-25T09:04:19.796317+0000","last_active":"2024-04-25T09:04:20.779485+0000","last_peered":"2024-04-25T09:04:20.779485+0000","last_clean":"2024-04-25T09:04:20.779485+0000","last_became_active":"2024-04-25T09:04:19.795842+0000","last_became_peered":"2024-04-25T09:04:19.795842+0000","last_unstale":"2024-04-25T09:04:20.779485+0000","last_undegraded":"2024-04-25T09:04:20.779485+0000","last_fullsized":"2024-04-25T09:04:20.779485+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:12.110578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780058+0000","last_change":"2024-04-25T09:04:19.786414+0000","last_active":"2024-04-25T09:04:20.780058+0000","last_peered":"2024-04-25T09:04:20.780058+0000","last_clean":"2024-04-25T09:04:20.780058+0000","last_became_active":"2024-04-25T09:04:19.786162+0000","last_became_peered":"2024-04-25T09:04:19.786162+0000","last_unstale":"2024-04-25T09:04:20.780058+0000","last_undegraded":"2024-04-25T09:04:20.780058+0000","last_fullsized":"2024-04-25T09:04:20.780058+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:53.178680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058572+0000","last_change":"2024-04-25T09:04:19.781325+0000","last_active":"2024-04-25T09:04:21.058572+0000","last_peered":"2024-04-25T09:04:21.058572+0000","last_clean":"2024-04-25T09:04:21.058572+0000","last_became_active":"2024-04-25T09:04:19.780912+0000","last_became_peered":"2024-04-25T09:04:19.780912+0000","last_unstale":"2024-04-25T09:04:21.058572+0000","last_undegraded":"2024-04-25T09:04:21.058572+0000","last_fullsized":"2024-04-25T09:04:21.058572+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:10.343310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779805+0000","last_change":"2024-04-25T09:04:19.786196+0000","last_active":"2024-04-25T09:04:20.779805+0000","last_peered":"2024-04-25T09:04:20.779805+0000","last_clean":"2024-04-25T09:04:20.779805+0000","last_became_active":"2024-04-25T09:04:19.785802+0000","last_became_peered":"2024-04-25T09:04:19.785802+0000","last_unstale":"2024-04-25T09:04:20.779805+0000","last_undegraded":"2024-04-25T09:04:20.779805+0000","last_fullsized":"2024-04-25T09:04:20.779805+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.915579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057713+0000","last_change":"2024-04-25T09:04:19.788915+0000","last_active":"2024-04-25T09:04:21.057713+0000","last_peered":"2024-04-25T09:04:21.057713+0000","last_clean":"2024-04-25T09:04:21.057713+0000","last_became_active":"2024-04-25T09:04:19.788668+0000","last_became_peered":"2024-04-25T09:04:19.788668+0000","last_unstale":"2024-04-25T09:04:21.057713+0000","last_undegraded":"2024-04-25T09:04:21.057713+0000","last_fullsized":"2024-04-25T09:04:21.057713+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:02.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057421+0000","last_change":"2024-04-25T09:04:19.791741+0000","last_active":"2024-04-25T09:04:21.057421+0000","last_peered":"2024-04-25T09:04:21.057421+0000","last_clean":"2024-04-25T09:04:21.057421+0000","last_became_active":"2024-04-25T09:04:19.790732+0000","last_became_peered":"2024-04-25T09:04:19.790732+0000","last_unstale":"2024-04-25T09:04:21.057421+0000","last_undegraded":"2024-04-25T09:04:21.057421+0000","last_fullsized":"2024-04-25T09:04:21.057421+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:19.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"110'4","reported_seq":18,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058427+0000","last_change":"2024-04-25T09:04:18.777472+0000","last_active":"2024-04-25T09:04:21.058427+0000","last_peered":"2024-04-25T09:04:21.058427+0000","last_clean":"2024-04-25T09:04:21.058427+0000","last_became_active":"2024-04-25T09:04:18.777132+0000","last_became_peered":"2024-04-25T09:04:18.777132+0000","last_unstale":"2024-04-25T09:04:21.058427+0000","last_undegraded":"2024-04-25T09:04:21.058427+0000","last_fullsized":"2024-04-25T09:04:21.058427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:23.983248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058862+0000","last_change":"2024-04-25T09:04:19.787097+0000","last_active":"2024-04-25T09:04:21.058862+0000","last_peered":"2024-04-25T09:04:21.058862+0000","last_clean":"2024-04-25T09:04:21.058862+0000","last_became_active":"2024-04-25T09:04:19.786779+0000","last_became_peered":"2024-04-25T09:04:19.786779+0000","last_unstale":"2024-04-25T09:04:21.058862+0000","last_undegraded":"2024-04-25T09:04:21.058862+0000","last_fullsized":"2024-04-25T09:04:21.058862+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.536995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057984+0000","last_change":"2024-04-25T09:04:18.779006+0000","last_active":"2024-04-25T09:04:21.057984+0000","last_peered":"2024-04-25T09:04:21.057984+0000","last_clean":"2024-04-25T09:04:21.057984+0000","last_became_active":"2024-04-25T09:04:18.778710+0000","last_became_peered":"2024-04-25T09:04:18.778710+0000","last_unstale":"2024-04-25T09:04:21.057984+0000","last_undegraded":"2024-04-25T09:04:21.057984+0000","last_fullsized":"2024-04-25T09:04:21.057984+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:49.532203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057575+0000","last_change":"2024-04-25T09:04:19.791817+0000","last_active":"2024-04-25T09:04:21.057575+0000","last_peered":"2024-04-25T09:04:21.057575+0000","last_clean":"2024-04-25T09:04:21.057575+0000","last_became_active":"2024-04-25T09:04:19.791513+0000","last_became_peered":"2024-04-25T09:04:19.791513+0000","last_unstale":"2024-04-25T09:04:21.057575+0000","last_undegraded":"2024-04-25T09:04:21.057575+0000","last_fullsized":"2024-04-25T09:04:21.057575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:24.475275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057219+0000","last_change":"2024-04-25T09:04:18.779137+0000","last_active":"2024-04-25T09:04:21.057219+0000","last_peered":"2024-04-25T09:04:21.057219+0000","last_clean":"2024-04-25T09:04:21.057219+0000","last_became_active":"2024-04-25T09:04:18.778854+0000","last_became_peered":"2024-04-25T09:04:18.778854+0000","last_unstale":"2024-04-25T09:04:21.057219+0000","last_undegraded":"2024-04-25T09:04:21.057219+0000","last_fullsized":"2024-04-25T09:04:21.057219+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:18.199090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058383+0000","last_change":"2024-04-25T09:04:19.785746+0000","last_active":"2024-04-25T09:04:21.058383+0000","last_peered":"2024-04-25T09:04:21.058383+0000","last_clean":"2024-04-25T09:04:21.058383+0000","last_became_active":"2024-04-25T09:04:19.784597+0000","last_became_peered":"2024-04-25T09:04:19.784597+0000","last_unstale":"2024-04-25T09:04:21.058383+0000","last_undegraded":"2024-04-25T09:04:21.058383+0000","last_fullsized":"2024-04-25T09:04:21.058383+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:28.172130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057126+0000","last_change":"2024-04-25T09:04:18.778771+0000","last_active":"2024-04-25T09:04:21.057126+0000","last_peered":"2024-04-25T09:04:21.057126+0000","last_clean":"2024-04-25T09:04:21.057126+0000","last_became_active":"2024-04-25T09:04:18.778411+0000","last_became_peered":"2024-04-25T09:04:18.778411+0000","last_unstale":"2024-04-25T09:04:21.057126+0000","last_undegraded":"2024-04-25T09:04:21.057126+0000","last_fullsized":"2024-04-25T09:04:21.057126+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.142510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779985+0000","last_change":"2024-04-25T09:04:19.792383+0000","last_active":"2024-04-25T09:04:20.779985+0000","last_peered":"2024-04-25T09:04:20.779985+0000","last_clean":"2024-04-25T09:04:20.779985+0000","last_became_active":"2024-04-25T09:04:19.792058+0000","last_became_peered":"2024-04-25T09:04:19.792058+0000","last_unstale":"2024-04-25T09:04:20.779985+0000","last_undegraded":"2024-04-25T09:04:20.779985+0000","last_fullsized":"2024-04-25T09:04:20.779985+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:36.499777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057753+0000","last_change":"2024-04-25T09:04:18.784090+0000","last_active":"2024-04-25T09:04:21.057753+0000","last_peered":"2024-04-25T09:04:21.057753+0000","last_clean":"2024-04-25T09:04:21.057753+0000","last_became_active":"2024-04-25T09:04:18.783811+0000","last_became_peered":"2024-04-25T09:04:18.783811+0000","last_unstale":"2024-04-25T09:04:21.057753+0000","last_undegraded":"2024-04-25T09:04:21.057753+0000","last_fullsized":"2024-04-25T09:04:21.057753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:58.420923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780155+0000","last_change":"2024-04-25T09:04:19.782339+0000","last_active":"2024-04-25T09:04:20.780155+0000","last_peered":"2024-04-25T09:04:20.780155+0000","last_clean":"2024-04-25T09:04:20.780155+0000","last_became_active":"2024-04-25T09:04:19.782068+0000","last_became_peered":"2024-04-25T09:04:19.782068+0000","last_unstale":"2024-04-25T09:04:20.780155+0000","last_undegraded":"2024-04-25T09:04:20.780155+0000","last_fullsized":"2024-04-25T09:04:20.780155+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:13.683649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779469+0000","last_change":"2024-04-25T09:04:18.780930+0000","last_active":"2024-04-25T09:04:20.779469+0000","last_peered":"2024-04-25T09:04:20.779469+0000","last_clean":"2024-04-25T09:04:20.779469+0000","last_became_active":"2024-04-25T09:04:18.780402+0000","last_became_peered":"2024-04-25T09:04:18.780402+0000","last_unstale":"2024-04-25T09:04:20.779469+0000","last_undegraded":"2024-04-25T09:04:20.779469+0000","last_fullsized":"2024-04-25T09:04:20.779469+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:32.642012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779737+0000","last_change":"2024-04-25T09:04:19.799125+0000","last_active":"2024-04-25T09:04:20.779737+0000","last_peered":"2024-04-25T09:04:20.779737+0000","last_clean":"2024-04-25T09:04:20.779737+0000","last_became_active":"2024-04-25T09:04:19.797111+0000","last_became_peered":"2024-04-25T09:04:19.797111+0000","last_unstale":"2024-04-25T09:04:20.779737+0000","last_undegraded":"2024-04-25T09:04:20.779737+0000","last_fullsized":"2024-04-25T09:04:20.779737+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:49.627007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779892+0000","last_change":"2024-04-25T09:04:18.783196+0000","last_active":"2024-04-25T09:04:20.779892+0000","last_peered":"2024-04-25T09:04:20.779892+0000","last_clean":"2024-04-25T09:04:20.779892+0000","last_became_active":"2024-04-25T09:04:18.782875+0000","last_became_peered":"2024-04-25T09:04:18.782875+0000","last_unstale":"2024-04-25T09:04:20.779892+0000","last_undegraded":"2024-04-25T09:04:20.779892+0000","last_fullsized":"2024-04-25T09:04:20.779892+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:48.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058180+0000","last_change":"2024-04-25T09:04:19.785197+0000","last_active":"2024-04-25T09:04:21.058180+0000","last_peered":"2024-04-25T09:04:21.058180+0000","last_clean":"2024-04-25T09:04:21.058180+0000","last_became_active":"2024-04-25T09:04:19.784919+0000","last_became_peered":"2024-04-25T09:04:19.784919+0000","last_unstale":"2024-04-25T09:04:21.058180+0000","last_undegraded":"2024-04-25T09:04:21.058180+0000","last_fullsized":"2024-04-25T09:04:21.058180+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:07.536679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779744+0000","last_change":"2024-04-25T09:04:18.788156+0000","last_active":"2024-04-25T09:04:20.779744+0000","last_peered":"2024-04-25T09:04:20.779744+0000","last_clean":"2024-04-25T09:04:20.779744+0000","last_became_active":"2024-04-25T09:04:18.787763+0000","last_became_peered":"2024-04-25T09:04:18.787763+0000","last_unstale":"2024-04-25T09:04:20.779744+0000","last_undegraded":"2024-04-25T09:04:20.779744+0000","last_fullsized":"2024-04-25T09:04:20.779744+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:12.678856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058176+0000","last_change":"2024-04-25T09:04:19.775224+0000","last_active":"2024-04-25T09:04:21.058176+0000","last_peered":"2024-04-25T09:04:21.058176+0000","last_clean":"2024-04-25T09:04:21.058176+0000","last_became_active":"2024-04-25T09:04:19.774703+0000","last_became_peered":"2024-04-25T09:04:19.774703+0000","last_unstale":"2024-04-25T09:04:21.058176+0000","last_undegraded":"2024-04-25T09:04:21.058176+0000","last_fullsized":"2024-04-25T09:04:21.058176+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:49.813862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057051+0000","last_change":"2024-04-25T09:04:18.784590+0000","last_active":"2024-04-25T09:04:21.057051+0000","last_peered":"2024-04-25T09:04:21.057051+0000","last_clean":"2024-04-25T09:04:21.057051+0000","last_became_active":"2024-04-25T09:04:18.784333+0000","last_became_peered":"2024-04-25T09:04:18.784333+0000","last_unstale":"2024-04-25T09:04:21.057051+0000","last_undegraded":"2024-04-25T09:04:21.057051+0000","last_fullsized":"2024-04-25T09:04:21.057051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:23.470482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058999+0000","last_change":"2024-04-25T09:04:19.801552+0000","last_active":"2024-04-25T09:04:21.058999+0000","last_peered":"2024-04-25T09:04:21.058999+0000","last_clean":"2024-04-25T09:04:21.058999+0000","last_became_active":"2024-04-25T09:04:19.801281+0000","last_became_peered":"2024-04-25T09:04:19.801281+0000","last_unstale":"2024-04-25T09:04:21.058999+0000","last_undegraded":"2024-04-25T09:04:21.058999+0000","last_fullsized":"2024-04-25T09:04:21.058999+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:50.200669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779432+0000","last_change":"2024-04-25T09:04:18.781766+0000","last_active":"2024-04-25T09:04:20.779432+0000","last_peered":"2024-04-25T09:04:20.779432+0000","last_clean":"2024-04-25T09:04:20.779432+0000","last_became_active":"2024-04-25T09:04:18.781465+0000","last_became_peered":"2024-04-25T09:04:18.781465+0000","last_unstale":"2024-04-25T09:04:20.779432+0000","last_undegraded":"2024-04-25T09:04:20.779432+0000","last_fullsized":"2024-04-25T09:04:20.779432+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:43.068918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779507+0000","last_change":"2024-04-25T09:04:19.793079+0000","last_active":"2024-04-25T09:04:20.779507+0000","last_peered":"2024-04-25T09:04:20.779507+0000","last_clean":"2024-04-25T09:04:20.779507+0000","last_became_active":"2024-04-25T09:04:19.792778+0000","last_became_peered":"2024-04-25T09:04:19.792778+0000","last_unstale":"2024-04-25T09:04:20.779507+0000","last_undegraded":"2024-04-25T09:04:20.779507+0000","last_fullsized":"2024-04-25T09:04:20.779507+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:45.894539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"110'3","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779984+0000","last_change":"2024-04-25T09:04:18.783777+0000","last_active":"2024-04-25T09:04:20.779984+0000","last_peered":"2024-04-25T09:04:20.779984+0000","last_clean":"2024-04-25T09:04:20.779984+0000","last_became_active":"2024-04-25T09:04:18.783508+0000","last_became_peered":"2024-04-25T09:04:18.783508+0000","last_unstale":"2024-04-25T09:04:20.779984+0000","last_undegraded":"2024-04-25T09:04:20.779984+0000","last_fullsized":"2024-04-25T09:04:20.779984+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:43.068918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058657+0000","last_change":"2024-04-25T09:04:19.782067+0000","last_active":"2024-04-25T09:04:21.058657+0000","last_peered":"2024-04-25T09:04:21.058657+0000","last_clean":"2024-04-25T09:04:21.058657+0000","last_became_active":"2024-04-25T09:04:19.781784+0000","last_became_peered":"2024-04-25T09:04:19.781784+0000","last_unstale":"2024-04-25T09:04:21.058657+0000","last_undegraded":"2024-04-25T09:04:21.058657+0000","last_fullsized":"2024-04-25T09:04:21.058657+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:50.258614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"110'6","reported_seq":20,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780478+0000","last_change":"2024-04-25T09:04:18.786810+0000","last_active":"2024-04-25T09:04:20.780478+0000","last_peered":"2024-04-25T09:04:20.780478+0000","last_clean":"2024-04-25T09:04:20.780478+0000","last_became_active":"2024-04-25T09:04:18.786525+0000","last_became_peered":"2024-04-25T09:04:18.786525+0000","last_unstale":"2024-04-25T09:04:20.780478+0000","last_undegraded":"2024-04-25T09:04:20.780478+0000","last_fullsized":"2024-04-25T09:04:20.780478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:32.642012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779493+0000","last_change":"2024-04-25T09:04:19.780085+0000","last_active":"2024-04-25T09:04:20.779493+0000","last_peered":"2024-04-25T09:04:20.779493+0000","last_clean":"2024-04-25T09:04:20.779493+0000","last_became_active":"2024-04-25T09:04:19.779796+0000","last_became_peered":"2024-04-25T09:04:19.779796+0000","last_unstale":"2024-04-25T09:04:20.779493+0000","last_undegraded":"2024-04-25T09:04:20.779493+0000","last_fullsized":"2024-04-25T09:04:20.779493+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:33.399806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057635+0000","last_change":"2024-04-25T09:04:18.781602+0000","last_active":"2024-04-25T09:04:21.057635+0000","last_peered":"2024-04-25T09:04:21.057635+0000","last_clean":"2024-04-25T09:04:21.057635+0000","last_became_active":"2024-04-25T09:04:18.781330+0000","last_became_peered":"2024-04-25T09:04:18.781330+0000","last_unstale":"2024-04-25T09:04:21.057635+0000","last_undegraded":"2024-04-25T09:04:21.057635+0000","last_fullsized":"2024-04-25T09:04:21.057635+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:12.592722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779320+0000","last_change":"2024-04-25T09:04:19.786855+0000","last_active":"2024-04-25T09:04:20.779320+0000","last_peered":"2024-04-25T09:04:20.779320+0000","last_clean":"2024-04-25T09:04:20.779320+0000","last_became_active":"2024-04-25T09:04:19.785415+0000","last_became_peered":"2024-04-25T09:04:19.785415+0000","last_unstale":"2024-04-25T09:04:20.779320+0000","last_undegraded":"2024-04-25T09:04:20.779320+0000","last_fullsized":"2024-04-25T09:04:20.779320+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:27.395452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057756+0000","last_change":"2024-04-25T09:04:18.779920+0000","last_active":"2024-04-25T09:04:21.057756+0000","last_peered":"2024-04-25T09:04:21.057756+0000","last_clean":"2024-04-25T09:04:21.057756+0000","last_became_active":"2024-04-25T09:04:18.779619+0000","last_became_peered":"2024-04-25T09:04:18.779619+0000","last_unstale":"2024-04-25T09:04:21.057756+0000","last_undegraded":"2024-04-25T09:04:21.057756+0000","last_fullsized":"2024-04-25T09:04:21.057756+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:49.253821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779054+0000","last_change":"2024-04-25T09:04:19.789265+0000","last_active":"2024-04-25T09:04:20.779054+0000","last_peered":"2024-04-25T09:04:20.779054+0000","last_clean":"2024-04-25T09:04:20.779054+0000","last_became_active":"2024-04-25T09:04:19.788982+0000","last_became_peered":"2024-04-25T09:04:19.788982+0000","last_unstale":"2024-04-25T09:04:20.779054+0000","last_undegraded":"2024-04-25T09:04:20.779054+0000","last_fullsized":"2024-04-25T09:04:20.779054+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:01.192279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"110'8","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057033+0000","last_change":"2024-04-25T09:04:18.780196+0000","last_active":"2024-04-25T09:04:21.057033+0000","last_peered":"2024-04-25T09:04:21.057033+0000","last_clean":"2024-04-25T09:04:21.057033+0000","last_became_active":"2024-04-25T09:04:18.779896+0000","last_became_peered":"2024-04-25T09:04:18.779896+0000","last_unstale":"2024-04-25T09:04:21.057033+0000","last_undegraded":"2024-04-25T09:04:21.057033+0000","last_fullsized":"2024-04-25T09:04:21.057033+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:10.317498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057549+0000","last_change":"2024-04-25T09:04:19.800596+0000","last_active":"2024-04-25T09:04:21.057549+0000","last_peered":"2024-04-25T09:04:21.057549+0000","last_clean":"2024-04-25T09:04:21.057549+0000","last_became_active":"2024-04-25T09:04:19.799962+0000","last_became_peered":"2024-04-25T09:04:19.799962+0000","last_unstale":"2024-04-25T09:04:21.057549+0000","last_undegraded":"2024-04-25T09:04:21.057549+0000","last_fullsized":"2024-04-25T09:04:21.057549+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:33.546695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780432+0000","last_change":"2024-04-25T09:04:18.782761+0000","last_active":"2024-04-25T09:04:20.780432+0000","last_peered":"2024-04-25T09:04:20.780432+0000","last_clean":"2024-04-25T09:04:20.780432+0000","last_became_active":"2024-04-25T09:04:18.781007+0000","last_became_peered":"2024-04-25T09:04:18.781007+0000","last_unstale":"2024-04-25T09:04:20.780432+0000","last_undegraded":"2024-04-25T09:04:20.780432+0000","last_fullsized":"2024-04-25T09:04:20.780432+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.596379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057895+0000","last_change":"2024-04-25T09:04:19.800702+0000","last_active":"2024-04-25T09:04:21.057895+0000","last_peered":"2024-04-25T09:04:21.057895+0000","last_clean":"2024-04-25T09:04:21.057895+0000","last_became_active":"2024-04-25T09:04:19.800147+0000","last_became_peered":"2024-04-25T09:04:19.800147+0000","last_unstale":"2024-04-25T09:04:21.057895+0000","last_undegraded":"2024-04-25T09:04:21.057895+0000","last_fullsized":"2024-04-25T09:04:21.057895+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:55.878338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057658+0000","last_change":"2024-04-25T09:04:18.782503+0000","last_active":"2024-04-25T09:04:21.057658+0000","last_peered":"2024-04-25T09:04:21.057658+0000","last_clean":"2024-04-25T09:04:21.057658+0000","last_became_active":"2024-04-25T09:04:18.782229+0000","last_became_peered":"2024-04-25T09:04:18.782229+0000","last_unstale":"2024-04-25T09:04:21.057658+0000","last_undegraded":"2024-04-25T09:04:21.057658+0000","last_fullsized":"2024-04-25T09:04:21.057658+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:54.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057936+0000","last_change":"2024-04-25T09:04:19.795694+0000","last_active":"2024-04-25T09:04:21.057936+0000","last_peered":"2024-04-25T09:04:21.057936+0000","last_clean":"2024-04-25T09:04:21.057936+0000","last_became_active":"2024-04-25T09:04:19.795279+0000","last_became_peered":"2024-04-25T09:04:19.795279+0000","last_unstale":"2024-04-25T09:04:21.057936+0000","last_undegraded":"2024-04-25T09:04:21.057936+0000","last_fullsized":"2024-04-25T09:04:21.057936+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:45.894539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058232+0000","last_change":"2024-04-25T09:04:18.780659+0000","last_active":"2024-04-25T09:04:21.058232+0000","last_peered":"2024-04-25T09:04:21.058232+0000","last_clean":"2024-04-25T09:04:21.058232+0000","last_became_active":"2024-04-25T09:04:18.780411+0000","last_became_peered":"2024-04-25T09:04:18.780411+0000","last_unstale":"2024-04-25T09:04:21.058232+0000","last_undegraded":"2024-04-25T09:04:21.058232+0000","last_fullsized":"2024-04-25T09:04:21.058232+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:09.338518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058413+0000","last_change":"2024-04-25T09:04:19.776710+0000","last_active":"2024-04-25T09:04:21.058413+0000","last_peered":"2024-04-25T09:04:21.058413+0000","last_clean":"2024-04-25T09:04:21.058413+0000","last_became_active":"2024-04-25T09:04:19.776446+0000","last_became_peered":"2024-04-25T09:04:19.776446+0000","last_unstale":"2024-04-25T09:04:21.058413+0000","last_undegraded":"2024-04-25T09:04:21.058413+0000","last_fullsized":"2024-04-25T09:04:21.058413+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:38.404575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057641+0000","last_change":"2024-04-25T09:04:18.785410+0000","last_active":"2024-04-25T09:04:21.057641+0000","last_peered":"2024-04-25T09:04:21.057641+0000","last_clean":"2024-04-25T09:04:21.057641+0000","last_became_active":"2024-04-25T09:04:18.785124+0000","last_became_peered":"2024-04-25T09:04:18.785124+0000","last_unstale":"2024-04-25T09:04:21.057641+0000","last_undegraded":"2024-04-25T09:04:21.057641+0000","last_fullsized":"2024-04-25T09:04:21.057641+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:16.868980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058048+0000","last_change":"2024-04-25T09:04:19.788903+0000","last_active":"2024-04-25T09:04:21.058048+0000","last_peered":"2024-04-25T09:04:21.058048+0000","last_clean":"2024-04-25T09:04:21.058048+0000","last_became_active":"2024-04-25T09:04:19.787700+0000","last_became_peered":"2024-04-25T09:04:19.787700+0000","last_unstale":"2024-04-25T09:04:21.058048+0000","last_undegraded":"2024-04-25T09:04:21.058048+0000","last_fullsized":"2024-04-25T09:04:21.058048+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:57.117380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057543+0000","last_change":"2024-04-25T09:04:18.778438+0000","last_active":"2024-04-25T09:04:21.057543+0000","last_peered":"2024-04-25T09:04:21.057543+0000","last_clean":"2024-04-25T09:04:21.057543+0000","last_became_active":"2024-04-25T09:04:18.778132+0000","last_became_peered":"2024-04-25T09:04:18.778132+0000","last_unstale":"2024-04-25T09:04:21.057543+0000","last_undegraded":"2024-04-25T09:04:21.057543+0000","last_fullsized":"2024-04-25T09:04:21.057543+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:19.402178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779894+0000","last_change":"2024-04-25T09:04:19.794540+0000","last_active":"2024-04-25T09:04:20.779894+0000","last_peered":"2024-04-25T09:04:20.779894+0000","last_clean":"2024-04-25T09:04:20.779894+0000","last_became_active":"2024-04-25T09:04:19.794225+0000","last_became_peered":"2024-04-25T09:04:19.794225+0000","last_unstale":"2024-04-25T09:04:20.779894+0000","last_undegraded":"2024-04-25T09:04:20.779894+0000","last_fullsized":"2024-04-25T09:04:20.779894+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:38.404575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057077+0000","last_change":"2024-04-25T09:04:18.776598+0000","last_active":"2024-04-25T09:04:21.057077+0000","last_peered":"2024-04-25T09:04:21.057077+0000","last_clean":"2024-04-25T09:04:21.057077+0000","last_became_active":"2024-04-25T09:04:18.776289+0000","last_became_peered":"2024-04-25T09:04:18.776289+0000","last_unstale":"2024-04-25T09:04:21.057077+0000","last_undegraded":"2024-04-25T09:04:21.057077+0000","last_fullsized":"2024-04-25T09:04:21.057077+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:31.394323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058465+0000","last_change":"2024-04-25T09:04:19.784806+0000","last_active":"2024-04-25T09:04:21.058465+0000","last_peered":"2024-04-25T09:04:21.058465+0000","last_clean":"2024-04-25T09:04:21.058465+0000","last_became_active":"2024-04-25T09:04:19.784531+0000","last_became_peered":"2024-04-25T09:04:19.784531+0000","last_unstale":"2024-04-25T09:04:21.058465+0000","last_undegraded":"2024-04-25T09:04:21.058465+0000","last_fullsized":"2024-04-25T09:04:21.058465+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:36.499777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057849+0000","last_change":"2024-04-25T09:04:18.780829+0000","last_active":"2024-04-25T09:04:21.057849+0000","last_peered":"2024-04-25T09:04:21.057849+0000","last_clean":"2024-04-25T09:04:21.057849+0000","last_became_active":"2024-04-25T09:04:18.780576+0000","last_became_peered":"2024-04-25T09:04:18.780576+0000","last_unstale":"2024-04-25T09:04:21.057849+0000","last_undegraded":"2024-04-25T09:04:21.057849+0000","last_fullsized":"2024-04-25T09:04:21.057849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:59.306282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779084+0000","last_change":"2024-04-25T09:04:19.785019+0000","last_active":"2024-04-25T09:04:20.779084+0000","last_peered":"2024-04-25T09:04:20.779084+0000","last_clean":"2024-04-25T09:04:20.779084+0000","last_became_active":"2024-04-25T09:04:19.784707+0000","last_became_peered":"2024-04-25T09:04:19.784707+0000","last_unstale":"2024-04-25T09:04:20.779084+0000","last_undegraded":"2024-04-25T09:04:20.779084+0000","last_fullsized":"2024-04-25T09:04:20.779084+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:04.233790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779856+0000","last_change":"2024-04-25T09:04:18.783672+0000","last_active":"2024-04-25T09:04:20.779856+0000","last_peered":"2024-04-25T09:04:20.779856+0000","last_clean":"2024-04-25T09:04:20.779856+0000","last_became_active":"2024-04-25T09:04:18.783386+0000","last_became_peered":"2024-04-25T09:04:18.783386+0000","last_unstale":"2024-04-25T09:04:20.779856+0000","last_undegraded":"2024-04-25T09:04:20.779856+0000","last_fullsized":"2024-04-25T09:04:20.779856+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:49.532203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058629+0000","last_change":"2024-04-25T09:04:19.802570+0000","last_active":"2024-04-25T09:04:21.058629+0000","last_peered":"2024-04-25T09:04:21.058629+0000","last_clean":"2024-04-25T09:04:21.058629+0000","last_became_active":"2024-04-25T09:04:19.802297+0000","last_became_peered":"2024-04-25T09:04:19.802297+0000","last_unstale":"2024-04-25T09:04:21.058629+0000","last_undegraded":"2024-04-25T09:04:21.058629+0000","last_fullsized":"2024-04-25T09:04:21.058629+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:13.683649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"110'2","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779614+0000","last_change":"2024-04-25T09:04:18.786584+0000","last_active":"2024-04-25T09:04:20.779614+0000","last_peered":"2024-04-25T09:04:20.779614+0000","last_clean":"2024-04-25T09:04:20.779614+0000","last_became_active":"2024-04-25T09:04:18.786328+0000","last_became_peered":"2024-04-25T09:04:18.786328+0000","last_unstale":"2024-04-25T09:04:20.779614+0000","last_undegraded":"2024-04-25T09:04:20.779614+0000","last_fullsized":"2024-04-25T09:04:20.779614+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:52.173887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780410+0000","last_change":"2024-04-25T09:04:19.798529+0000","last_active":"2024-04-25T09:04:20.780410+0000","last_peered":"2024-04-25T09:04:20.780410+0000","last_clean":"2024-04-25T09:04:20.780410+0000","last_became_active":"2024-04-25T09:04:19.796988+0000","last_became_peered":"2024-04-25T09:04:19.796988+0000","last_unstale":"2024-04-25T09:04:20.780410+0000","last_undegraded":"2024-04-25T09:04:20.780410+0000","last_fullsized":"2024-04-25T09:04:20.780410+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:31.549606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"110'1","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058600+0000","last_change":"2024-04-25T09:04:18.778426+0000","last_active":"2024-04-25T09:04:21.058600+0000","last_peered":"2024-04-25T09:04:21.058600+0000","last_clean":"2024-04-25T09:04:21.058600+0000","last_became_active":"2024-04-25T09:04:18.777966+0000","last_became_peered":"2024-04-25T09:04:18.777966+0000","last_unstale":"2024-04-25T09:04:21.058600+0000","last_undegraded":"2024-04-25T09:04:21.058600+0000","last_fullsized":"2024-04-25T09:04:21.058600+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:06.531886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780445+0000","last_change":"2024-04-25T09:04:19.795159+0000","last_active":"2024-04-25T09:04:20.780445+0000","last_peered":"2024-04-25T09:04:20.780445+0000","last_clean":"2024-04-25T09:04:20.780445+0000","last_became_active":"2024-04-25T09:04:19.794311+0000","last_became_peered":"2024-04-25T09:04:19.794311+0000","last_unstale":"2024-04-25T09:04:20.780445+0000","last_undegraded":"2024-04-25T09:04:20.780445+0000","last_fullsized":"2024-04-25T09:04:20.780445+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:04.978804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780119+0000","last_change":"2024-04-25T09:04:18.784336+0000","last_active":"2024-04-25T09:04:20.780119+0000","last_peered":"2024-04-25T09:04:20.780119+0000","last_clean":"2024-04-25T09:04:20.780119+0000","last_became_active":"2024-04-25T09:04:18.784076+0000","last_became_peered":"2024-04-25T09:04:18.784076+0000","last_unstale":"2024-04-25T09:04:20.780119+0000","last_undegraded":"2024-04-25T09:04:20.780119+0000","last_fullsized":"2024-04-25T09:04:20.780119+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:52.173887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058111+0000","last_change":"2024-04-25T09:04:19.799561+0000","last_active":"2024-04-25T09:04:21.058111+0000","last_peered":"2024-04-25T09:04:21.058111+0000","last_clean":"2024-04-25T09:04:21.058111+0000","last_became_active":"2024-04-25T09:04:19.799279+0000","last_became_peered":"2024-04-25T09:04:19.799279+0000","last_unstale":"2024-04-25T09:04:21.058111+0000","last_undegraded":"2024-04-25T09:04:21.058111+0000","last_fullsized":"2024-04-25T09:04:21.058111+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:35.749412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779583+0000","last_change":"2024-04-25T09:04:18.786013+0000","last_active":"2024-04-25T09:04:20.779583+0000","last_peered":"2024-04-25T09:04:20.779583+0000","last_clean":"2024-04-25T09:04:20.779583+0000","last_became_active":"2024-04-25T09:04:18.785730+0000","last_became_peered":"2024-04-25T09:04:18.785730+0000","last_unstale":"2024-04-25T09:04:20.779583+0000","last_undegraded":"2024-04-25T09:04:20.779583+0000","last_fullsized":"2024-04-25T09:04:20.779583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:34.744620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779933+0000","last_change":"2024-04-25T09:04:19.778858+0000","last_active":"2024-04-25T09:04:20.779933+0000","last_peered":"2024-04-25T09:04:20.779933+0000","last_clean":"2024-04-25T09:04:20.779933+0000","last_became_active":"2024-04-25T09:04:19.778596+0000","last_became_peered":"2024-04-25T09:04:19.778596+0000","last_unstale":"2024-04-25T09:04:20.779933+0000","last_undegraded":"2024-04-25T09:04:20.779933+0000","last_fullsized":"2024-04-25T09:04:20.779933+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.073711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.057852+0000","last_change":"2024-04-25T09:04:18.776766+0000","last_active":"2024-04-25T09:04:21.057852+0000","last_peered":"2024-04-25T09:04:21.057852+0000","last_clean":"2024-04-25T09:04:21.057852+0000","last_became_active":"2024-04-25T09:04:18.776457+0000","last_became_peered":"2024-04-25T09:04:18.776457+0000","last_unstale":"2024-04-25T09:04:21.057852+0000","last_undegraded":"2024-04-25T09:04:21.057852+0000","last_fullsized":"2024-04-25T09:04:21.057852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:48.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.780240+0000","last_change":"2024-04-25T09:04:19.787788+0000","last_active":"2024-04-25T09:04:20.780240+0000","last_peered":"2024-04-25T09:04:20.780240+0000","last_clean":"2024-04-25T09:04:20.780240+0000","last_became_active":"2024-04-25T09:04:19.787298+0000","last_became_peered":"2024-04-25T09:04:19.787298+0000","last_unstale":"2024-04-25T09:04:20.780240+0000","last_undegraded":"2024-04-25T09:04:20.780240+0000","last_fullsized":"2024-04-25T09:04:20.780240+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.536995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779950+0000","last_change":"2024-04-25T09:04:18.777801+0000","last_active":"2024-04-25T09:04:20.779950+0000","last_peered":"2024-04-25T09:04:20.779950+0000","last_clean":"2024-04-25T09:04:20.779950+0000","last_became_active":"2024-04-25T09:04:18.777476+0000","last_became_peered":"2024-04-25T09:04:18.777476+0000","last_unstale":"2024-04-25T09:04:20.779950+0000","last_undegraded":"2024-04-25T09:04:20.779950+0000","last_fullsized":"2024-04-25T09:04:20.779950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:25.631107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058628+0000","last_change":"2024-04-25T09:04:19.785153+0000","last_active":"2024-04-25T09:04:21.058628+0000","last_peered":"2024-04-25T09:04:21.058628+0000","last_clean":"2024-04-25T09:04:21.058628+0000","last_became_active":"2024-04-25T09:04:19.783850+0000","last_became_peered":"2024-04-25T09:04:19.783850+0000","last_unstale":"2024-04-25T09:04:21.058628+0000","last_undegraded":"2024-04-25T09:04:21.058628+0000","last_fullsized":"2024-04-25T09:04:21.058628+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:59.671612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.056958+0000","last_change":"2024-04-25T09:04:18.777812+0000","last_active":"2024-04-25T09:04:21.056958+0000","last_peered":"2024-04-25T09:04:21.056958+0000","last_clean":"2024-04-25T09:04:21.056958+0000","last_became_active":"2024-04-25T09:04:18.777530+0000","last_became_peered":"2024-04-25T09:04:18.777530+0000","last_unstale":"2024-04-25T09:04:21.056958+0000","last_undegraded":"2024-04-25T09:04:21.056958+0000","last_fullsized":"2024-04-25T09:04:21.056958+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:40.651348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779900+0000","last_change":"2024-04-25T09:04:19.791619+0000","last_active":"2024-04-25T09:04:20.779900+0000","last_peered":"2024-04-25T09:04:20.779900+0000","last_clean":"2024-04-25T09:04:20.779900+0000","last_became_active":"2024-04-25T09:04:19.791348+0000","last_became_peered":"2024-04-25T09:04:19.791348+0000","last_unstale":"2024-04-25T09:04:20.779900+0000","last_undegraded":"2024-04-25T09:04:20.779900+0000","last_fullsized":"2024-04-25T09:04:20.779900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:28.172130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779941+0000","last_change":"2024-04-25T09:04:18.784478+0000","last_active":"2024-04-25T09:04:20.779941+0000","last_peered":"2024-04-25T09:04:20.779941+0000","last_clean":"2024-04-25T09:04:20.779941+0000","last_became_active":"2024-04-25T09:04:18.784020+0000","last_became_peered":"2024-04-25T09:04:18.784020+0000","last_unstale":"2024-04-25T09:04:20.779941+0000","last_undegraded":"2024-04-25T09:04:20.779941+0000","last_fullsized":"2024-04-25T09:04:20.779941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:49.195876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:20.779013+0000","last_change":"2024-04-25T09:04:19.784038+0000","last_active":"2024-04-25T09:04:20.779013+0000","last_peered":"2024-04-25T09:04:20.779013+0000","last_clean":"2024-04-25T09:04:20.779013+0000","last_became_active":"2024-04-25T09:04:19.783756+0000","last_became_peered":"2024-04-25T09:04:19.783756+0000","last_unstale":"2024-04-25T09:04:20.779013+0000","last_undegraded":"2024-04-25T09:04:20.779013+0000","last_fullsized":"2024-04-25T09:04:20.779013+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:18.759112+0000","last_clean_scrub_stamp":"2024-04-25T09:04:18.759112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:46.728849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058753+0000","last_change":"2024-04-25T09:04:18.785178+0000","last_active":"2024-04-25T09:04:21.058753+0000","last_peered":"2024-04-25T09:04:21.058753+0000","last_clean":"2024-04-25T09:04:21.058753+0000","last_became_active":"2024-04-25T09:04:18.784877+0000","last_became_peered":"2024-04-25T09:04:18.784877+0000","last_unstale":"2024-04-25T09:04:21.058753+0000","last_undegraded":"2024-04-25T09:04:21.058753+0000","last_fullsized":"2024-04-25T09:04:21.058753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:17.754319+0000","last_clean_scrub_stamp":"2024-04-25T09:04:17.754319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:53.798703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":340,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T09:04:21.058626+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:04:21.058626+0000","last_peered":"2024-04-25T09:04:21.058626+0000","last_clean":"2024-04-25T09:04:21.058626+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:04:21.058626+0000","last_undegraded":"2024-04-25T09:04:21.058626+0000","last_fullsized":"2024-04-25T09:04:21.058626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47004,"kb_used_data":1936,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324836,"statfs":{"total":96636764160,"available":96588632064,"internally_reserved":0,"allocated":1982464,"data_stored":1189078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50568,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321272,"statfs":{"total":96636764160,"available":96584982528,"internally_reserved":0,"allocated":1372160,"data_stored":591864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45016,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326824,"statfs":{"total":96636764160,"available":96590667776,"internally_reserved":0,"allocated":1388544,"data_stored":598698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54724,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317116,"statfs":{"total":96636764160,"available":96580726784,"internally_reserved":0,"allocated":1368064,"data_stored":591794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54756,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317084,"statfs":{"total":96636764160,"available":96580694016,"internally_reserved":0,"allocated":1396736,"data_stored":599776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1368064,"data_stored":591794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58900,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312940,"statfs":{"total":96636764160,"available":96576450560,"internally_reserved":0,"allocated":1376256,"data_stored":591918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33128,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338712,"statfs":{"total":96636764160,"available":96602841088,"internally_reserved":0,"allocated":1994752,"data_stored":1190186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:23.470 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:04:23.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:04:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.625+0000 7f4be7b89640 1 Processor -- start 2024-04-25T09:04:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be7b89640 1 -- start start 2024-04-25T09:04:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be7b89640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4be015df90 0x7f4be00b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be7b89640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4be00d2f90 0x7f4be00ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be7b89640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be7b89640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be00d1ca0 con 0x7f4be015df90 2024-04-25T09:04:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be7b89640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be00d2b00 con 0x7f4be00d2f90 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be7b89640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00d1ef0 con 0x7f4be00ced70 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be5925640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4be015df90 0x7f4be00b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be5925640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4be015df90 0x7f4be00b94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36160/0 (socket says 172.21.15.5:36160) 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.626+0000 7f4be5925640 1 -- 172.21.15.5:0/3372169825 learned_addr learned my addr 172.21.15.5:0/3372169825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5124640 1 --2- 172.21.15.5:0/3372169825 >> v2:172.21.15.80:3300/0 conn(0x7f4be00d2f90 0x7f4be00ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be6126640 1 --2- 172.21.15.5:0/3372169825 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5925640 1 -- 172.21.15.5:0/3372169825 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 msgr2=0x7f4be00b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5925640 1 --2- 172.21.15.5:0/3372169825 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5925640 1 -- 172.21.15.5:0/3372169825 >> v2:172.21.15.80:3300/0 conn(0x7f4be00d2f90 msgr2=0x7f4be00ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5925640 1 --2- 172.21.15.5:0/3372169825 >> v2:172.21.15.80:3300/0 conn(0x7f4be00d2f90 0x7f4be00ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5925640 1 -- 172.21.15.5:0/3372169825 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be00d21d0 con 0x7f4be015df90 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5124640 1 --2- 172.21.15.5:0/3372169825 >> v2:172.21.15.80:3300/0 conn(0x7f4be00d2f90 0x7f4be00ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be6126640 1 --2- 172.21.15.5:0/3372169825 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.627+0000 7f4be5925640 1 --2- 172.21.15.5:0/3372169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be015df90 0x7f4be00b94f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f4be00ce310 tx=0x7f4bd002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f095a45c1f2dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be4923640 1 -- 172.21.15.5:0/3372169825 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0036070 con 0x7f4be015df90 2024-04-25T09:04:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be4923640 1 -- 172.21.15.5:0/3372169825 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0031600 con 0x7f4be015df90 2024-04-25T09:04:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be4923640 1 -- 172.21.15.5:0/3372169825 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00319d0 con 0x7f4be015df90 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 -- 172.21.15.5:0/3372169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be015df90 msgr2=0x7f4be00b94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 --2- 172.21.15.5:0/3372169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be015df90 0x7f4be00b94f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f4be00ce310 tx=0x7f4bd002a730 comp rx=0 tx=0).stop 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 -- 172.21.15.5:0/3372169825 shutdown_connections 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 --2- 172.21.15.5:0/3372169825 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 --2- 172.21.15.5:0/3372169825 >> v2:172.21.15.80:3300/0 conn(0x7f4be00d2f90 0x7f4be00ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 --2- 172.21.15.5:0/3372169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be015df90 0x7f4be00b94f0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 -- 172.21.15.5:0/3372169825 >> 172.21.15.5:0/3372169825 conn(0x7f4be006b000 msgr2=0x7f4be006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 -- 172.21.15.5:0/3372169825 shutdown_connections 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.628+0000 7f4be7b89640 1 -- 172.21.15.5:0/3372169825 wait complete. 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.629+0000 7f4be7b89640 1 Processor -- start 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be7b89640 1 -- start start 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be7b89640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be7b89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4be00d2f90 0x7f4be01f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be7b89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be01f77c0 0x7f4be0156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be7b89640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00b9a30 con 0x7f4be01f77c0 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be7b89640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00d2790 con 0x7f4be00d2f90 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be7b89640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00d3740 con 0x7f4be00ced70 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be6126640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be01f77c0 0x7f4be0156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be6126640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be01f77c0 0x7f4be0156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36162/0 (socket says 172.21.15.5:36162) 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be6126640 1 -- 172.21.15.5:0/1678073747 learned_addr learned my addr 172.21.15.5:0/1678073747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be5124640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4be00d2f90 0x7f4be01f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.630+0000 7f4be5925640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be6126640 1 -- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 msgr2=0x7f4be00c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be6126640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be6126640 1 -- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4be00d2f90 msgr2=0x7f4be01f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be6126640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4be00d2f90 0x7f4be01f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be6126640 1 -- 172.21.15.5:0/1678073747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0155e40 con 0x7f4be01f77c0 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be6126640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be01f77c0 0x7f4be0156c00 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800afd0 tx=0x7f4bd800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4bde7fc640 1 -- 172.21.15.5:0/1678073747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8015020 con 0x7f4be01f77c0 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4bde7fc640 1 -- 172.21.15.5:0/1678073747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd8004440 con 0x7f4be01f77c0 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4bde7fc640 1 -- 172.21.15.5:0/1678073747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8003850 con 0x7f4be01f77c0 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be0156120 con 0x7f4be01f77c0 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.631+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be01566e0 con 0x7f4be01f77c0 2024-04-25T09:04:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.632+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be004ef20 con 0x7f4be01f77c0 2024-04-25T09:04:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.633+0000 7f4bde7fc640 1 -- 172.21.15.5:0/1678073747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4bd8018020 con 0x7f4be01f77c0 2024-04-25T09:04:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.633+0000 7f4bde7fc640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bcc06b500 0x7f4bcc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.633+0000 7f4bde7fc640 1 -- 172.21.15.5:0/1678073747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bd808a010 con 0x7f4be01f77c0 2024-04-25T09:04:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.633+0000 7f4be5925640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bcc06b500 0x7f4bcc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.634+0000 7f4be5925640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bcc06b500 0x7f4bcc06d9c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0033000 tx=0x7f4bd0009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.637+0000 7f4bde7fc640 1 -- 172.21.15.5:0/1678073747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4bd801f020 con 0x7f4be01f77c0 2024-04-25T09:04:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.884+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4be01568b0 con 0x7f4be01f77c0 2024-04-25T09:04:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.886+0000 7f4bde7fc640 1 -- 172.21.15.5:0/1678073747 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4bd8058850 con 0x7f4be01f77c0 2024-04-25T09:04:23.875 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T09:04:23.875 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T09:04:23.875 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T09:04:23.875 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T09:04:23.875 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:04:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T09:04:23.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bcc06b500 msgr2=0x7f4bcc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bcc06b500 0x7f4bcc06d9c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0033000 tx=0x7f4bd0009000 comp rx=0 tx=0).stop 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be01f77c0 msgr2=0x7f4be0156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be01f77c0 0x7f4be0156c00 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800afd0 tx=0x7f4bd800ca20 comp rx=0 tx=0).stop 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 shutdown_connections 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bcc06b500 0x7f4bcc06d9c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4be01f77c0 0x7f4be0156c00 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4be00d2f90 0x7f4be01f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 --2- 172.21.15.5:0/1678073747 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4be00ced70 0x7f4be00c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 >> 172.21.15.5:0/1678073747 conn(0x7f4be006b000 msgr2=0x7f4be015f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 shutdown_connections 2024-04-25T09:04:23.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:23.888+0000 7f4be7b89640 1 -- 172.21.15.5:0/1678073747 wait complete. 2024-04-25T09:04:23.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.000+0000 7f293b24a640 1 Processor -- start 2024-04-25T09:04:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.000+0000 7f293b24a640 1 -- start start 2024-04-25T09:04:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f293b24a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f293415f100 0x7f29340cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f293b24a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29340cfec0 0x7f29340d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f293b24a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340cfc00 con 0x7f29340cc460 2024-04-25T09:04:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f293b24a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340d0870 con 0x7f293415f100 2024-04-25T09:04:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f293b24a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340cf250 con 0x7f29340cfec0 2024-04-25T09:04:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2938fe6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f293415f100 0x7f29340cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2938fe6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f293415f100 0x7f29340cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36170/0 (socket says 172.21.15.5:36170) 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2938fe6640 1 -- 172.21.15.5:0/1501766023 learned_addr learned my addr 172.21.15.5:0/1501766023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2933fff640 1 --2- 172.21.15.5:0/1501766023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29340cfec0 0x7f29340d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2938fe6640 1 -- 172.21.15.5:0/1501766023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29340cfec0 msgr2=0x7f29340d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2938fe6640 1 --2- 172.21.15.5:0/1501766023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29340cfec0 0x7f29340d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2938fe6640 1 -- 172.21.15.5:0/1501766023 >> v1:172.21.15.5:6789/0 conn(0x7f29340cc460 legacy=0x7f29340cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2938fe6640 1 -- 172.21.15.5:0/1501766023 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340cec90 con 0x7f293415f100 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f29337fe640 1 -- 172.21.15.5:0/1501766023 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588047672 0 0) 0x7f29340cfc00 con 0x7f29340cc460 2024-04-25T09:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.001+0000 7f2933fff640 1 --2- 172.21.15.5:0/1501766023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29340cfec0 0x7f29340d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.002+0000 7f2938fe6640 1 --2- 172.21.15.5:0/1501766023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f293415f100 0x7f29340cf6c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f29240098a0 tx=0x7f292402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcef41930bfb20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.002+0000 7f29337fe640 1 -- 172.21.15.5:0/1501766023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924037070 con 0x7f293415f100 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.002+0000 7f29337fe640 1 -- 172.21.15.5:0/1501766023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924032440 con 0x7f293415f100 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.002+0000 7f29337fe640 1 -- 172.21.15.5:0/1501766023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924032810 con 0x7f293415f100 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 -- 172.21.15.5:0/1501766023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f293415f100 msgr2=0x7f29340cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 --2- 172.21.15.5:0/1501766023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f293415f100 0x7f29340cf6c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f29240098a0 tx=0x7f292402a290 comp rx=0 tx=0).stop 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 -- 172.21.15.5:0/1501766023 shutdown_connections 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 --2- 172.21.15.5:0/1501766023 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29340cfec0 0x7f29340d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 --2- 172.21.15.5:0/1501766023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f293415f100 0x7f29340cf6c0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 -- 172.21.15.5:0/1501766023 >> 172.21.15.5:0/1501766023 conn(0x7f29340d18e0 msgr2=0x7f29340d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 -- 172.21.15.5:0/1501766023 shutdown_connections 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.003+0000 7f293b24a640 1 -- 172.21.15.5:0/1501766023 wait complete. 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.004+0000 7f293b24a640 1 Processor -- start 2024-04-25T09:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.004+0000 7f293b24a640 1 -- start start 2024-04-25T09:04:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f293b24a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29340cc460 0x7f293414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f293b24a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29340cfec0 0x7f293406f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f293b24a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f293415f100 0x7f293406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f293b24a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340d2600 con 0x7f29340cc460 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f293b24a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340c5560 con 0x7f29340cfec0 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f293b24a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340ce920 con 0x7f293415f100 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29340cc460 0x7f293414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29340cc460 0x7f293414c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36178/0 (socket says 172.21.15.5:36178) 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 -- 172.21.15.5:0/342004037 learned_addr learned my addr 172.21.15.5:0/342004037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2933fff640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29340cfec0 0x7f293406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 -- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f293415f100 msgr2=0x7f293406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f29397e7640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f293415f100 0x7f293406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f293415f100 0x7f293406fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 -- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29340cfec0 msgr2=0x7f293406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29340cfec0 0x7f293406f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2938fe6640 1 -- 172.21.15.5:0/342004037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293406cbc0 con 0x7f29340cc460 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.005+0000 7f2933fff640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29340cfec0 0x7f293406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.006+0000 7f2938fe6640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29340cc460 0x7f293414c040 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f29240098a0 tx=0x7f29240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.006+0000 7f29317fa640 1 -- 172.21.15.5:0/342004037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924037040 con 0x7f29340cc460 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.006+0000 7f29317fa640 1 -- 172.21.15.5:0/342004037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924004250 con 0x7f29340cc460 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.006+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293406be00 con 0x7f29340cc460 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.006+0000 7f29317fa640 1 -- 172.21.15.5:0/342004037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924003610 con 0x7f29340cc460 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.006+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293406c3c0 con 0x7f29340cc460 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.007+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293404ef20 con 0x7f29340cc460 2024-04-25T09:04:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.007+0000 7f29317fa640 1 -- 172.21.15.5:0/342004037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29240037b0 con 0x7f29340cc460 2024-04-25T09:04:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.008+0000 7f29317fa640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f292006b4d0 0x7f292006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.008+0000 7f29317fa640 1 -- 172.21.15.5:0/342004037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29240ab0a0 con 0x7f29340cc460 2024-04-25T09:04:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.008+0000 7f2933fff640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f292006b4d0 0x7f292006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.009+0000 7f2933fff640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f292006b4d0 0x7f292006d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2928006fd0 tx=0x7f2928008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.012+0000 7f29317fa640 1 -- 172.21.15.5:0/342004037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f292407a040 con 0x7f29340cc460 2024-04-25T09:04:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.229+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29340cdfc0 con 0x7f29340cc460 2024-04-25T09:04:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.230+0000 7f29317fa640 1 -- 172.21.15.5:0/342004037 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f2924079940 con 0x7f29340cc460 2024-04-25T09:04:24.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:24.219 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:24.219 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f292006b4d0 msgr2=0x7f292006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f292006b4d0 0x7f292006d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2928006fd0 tx=0x7f2928008040 comp rx=0 tx=0).stop 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29340cc460 msgr2=0x7f293414c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29340cc460 0x7f293414c040 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f29240098a0 tx=0x7f29240046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 shutdown_connections 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f292006b4d0 0x7f292006d990 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f293415f100 0x7f293406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29340cfec0 0x7f293406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 --2- 172.21.15.5:0/342004037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29340cc460 0x7f293414c040 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.231+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 >> 172.21.15.5:0/342004037 conn(0x7f29340d18e0 msgr2=0x7f29340c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.232+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 shutdown_connections 2024-04-25T09:04:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.232+0000 7f293b24a640 1 -- 172.21.15.5:0/342004037 wait complete. 2024-04-25T09:04:24.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:04:19.124411+0000', 'modified': '2024-04-25T09:04:21.491091+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8526': {'gid': 8526, 'name': 'd', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/4045189382', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6835', 'nonce': 4045189382}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 4045189382}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:04:24.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:04:24.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:04:24.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.749+0000 7f934cd89640 1 Processor -- start 2024-04-25T09:04:24.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.749+0000 7f934cd89640 1 -- start start 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f934cd89640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93480d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f934cd89640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93480b6f50 0x7f93480b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f934cd89640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93480b29c0 con 0x7f934815e0a0 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f934cd89640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93480d4330 con 0x7f93480b6f50 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f934cd89640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93480d1460 con 0x7f93480d3990 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f9346d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93480b6f50 0x7f93480b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f9346d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93480b6f50 0x7f93480b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36190/0 (socket says 172.21.15.5:36190) 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f9346d9d640 1 -- 172.21.15.5:0/1757742904 learned_addr learned my addr 172.21.15.5:0/1757742904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f9345d9b640 1 --2- 172.21.15.5:0/1757742904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93480d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f9346d9d640 1 -- 172.21.15.5:0/1757742904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 msgr2=0x7f93480d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f9346d9d640 1 --2- 172.21.15.5:0/1757742904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93480d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.750+0000 7f9346d9d640 1 -- 172.21.15.5:0/1757742904 >> v1:172.21.15.80:6789/0 conn(0x7f934815e0a0 legacy=0x7f93480d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.751+0000 7f9346d9d640 1 -- 172.21.15.5:0/1757742904 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480d2080 con 0x7f93480b6f50 2024-04-25T09:04:24.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.751+0000 7f9346d9d640 1 --2- 172.21.15.5:0/1757742904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93480b6f50 0x7f93480b73e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9338009e50 tx=0x7f933802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c82038645643dde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.751+0000 7f934559a640 1 -- 172.21.15.5:0/1757742904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338036070 con 0x7f93480b6f50 2024-04-25T09:04:24.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.751+0000 7f934559a640 1 -- 172.21.15.5:0/1757742904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338031600 con 0x7f93480b6f50 2024-04-25T09:04:24.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.751+0000 7f934559a640 1 -- 172.21.15.5:0/1757742904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93380319d0 con 0x7f93480b6f50 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 -- 172.21.15.5:0/1757742904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93480b6f50 msgr2=0x7f93480b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 --2- 172.21.15.5:0/1757742904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93480b6f50 0x7f93480b73e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9338009e50 tx=0x7f933802a710 comp rx=0 tx=0).stop 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 -- 172.21.15.5:0/1757742904 shutdown_connections 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 --2- 172.21.15.5:0/1757742904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93480b6f50 0x7f93480b73e0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 --2- 172.21.15.5:0/1757742904 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93480d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 -- 172.21.15.5:0/1757742904 >> 172.21.15.5:0/1757742904 conn(0x7f93480668f0 msgr2=0x7f9348066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 -- 172.21.15.5:0/1757742904 shutdown_connections 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.752+0000 7f934cd89640 1 -- 172.21.15.5:0/1757742904 wait complete. 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.753+0000 7f934cd89640 1 Processor -- start 2024-04-25T09:04:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.753+0000 7f934cd89640 1 -- start start 2024-04-25T09:04:24.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f934cd89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93480b6f50 0x7f93481f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f934cd89640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93481e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f934cd89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934815e0a0 0x7f93481e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f934cd89640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93480d2920 con 0x7f934815e0a0 2024-04-25T09:04:24.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f934cd89640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93480d2640 con 0x7f93480b6f50 2024-04-25T09:04:24.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f934cd89640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93480d2c00 con 0x7f93480d3990 2024-04-25T09:04:24.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9346d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934815e0a0 0x7f93481e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9346d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934815e0a0 0x7f93481e84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36198/0 (socket says 172.21.15.5:36198) 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9346d9d640 1 -- 172.21.15.5:0/1577281318 learned_addr learned my addr 172.21.15.5:0/1577281318 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9345d9b640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93481e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f934659c640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93480b6f50 0x7f93481f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9346d9d640 1 -- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 msgr2=0x7f93481e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9346d9d640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93481e7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9346d9d640 1 -- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93480b6f50 msgr2=0x7f93481f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.754+0000 7f9346d9d640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93480b6f50 0x7f93481f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.755+0000 7f9346d9d640 1 -- 172.21.15.5:0/1577281318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480cbf00 con 0x7f934815e0a0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.755+0000 7f9346d9d640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934815e0a0 0x7f93481e84e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9338034040 tx=0x7f9338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.755+0000 7f933effd640 1 -- 172.21.15.5:0/1577281318 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933803f020 con 0x7f934815e0a0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.755+0000 7f933effd640 1 -- 172.21.15.5:0/1577281318 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338037040 con 0x7f934815e0a0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.755+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93481e6f00 con 0x7f934815e0a0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.755+0000 7f933effd640 1 -- 172.21.15.5:0/1577281318 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338036070 con 0x7f934815e0a0 2024-04-25T09:04:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.755+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93481e74c0 con 0x7f934815e0a0 2024-04-25T09:04:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.757+0000 7f933effd640 1 -- 172.21.15.5:0/1577281318 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9338042020 con 0x7f934815e0a0 2024-04-25T09:04:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.757+0000 7f933effd640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932806b4d0 0x7f932806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.757+0000 7f933effd640 1 -- 172.21.15.5:0/1577281318 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93380aa760 con 0x7f934815e0a0 2024-04-25T09:04:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.757+0000 7f934659c640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932806b4d0 0x7f932806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.758+0000 7f934659c640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932806b4d0 0x7f932806d990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9340001500 tx=0x7f9340009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.758+0000 7f934fb6b740 1 Processor -- start 2024-04-25T09:04:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.758+0000 7f934fb6b740 1 -- start start 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d837020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d7eef10 0x55fd3d835190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934fb6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d751a10 con 0x55fd3d7eef10 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d6fab30 con 0x55fd3d836ad0 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d74dc50 con 0x55fd3d819230 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d7eef10 0x55fd3d835190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d7eef10 0x55fd3d835190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36200/0 (socket says 172.21.15.5:36200) 2024-04-25T09:04:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 -- 172.21.15.5:0/493513832 learned_addr learned my addr 172.21.15.5:0/493513832 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934659c640 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9345d9b640 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d837020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 -- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 msgr2=0x55fd3d819610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 -- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 msgr2=0x55fd3d837020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d837020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 -- 172.21.15.5:0/493513832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd3d70fe10 con 0x55fd3d7eef10 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f934659c640 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.759+0000 7f9346d9d640 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d7eef10 0x55fd3d835190 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f933802ad00 tx=0x7f9338078960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891597902cced7c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f9327fff640 1 -- 172.21.15.5:0/493513832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93380a7070 con 0x55fd3d7eef10 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f9327fff640 1 -- 172.21.15.5:0/493513832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933807cf90 con 0x55fd3d7eef10 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f9327fff640 1 -- 172.21.15.5:0/493513832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933807b070 con 0x55fd3d7eef10 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 -- 172.21.15.5:0/493513832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d7eef10 msgr2=0x55fd3d835190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d7eef10 0x55fd3d835190 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f933802ad00 tx=0x7f9338078960 comp rx=0 tx=0).stop 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 -- 172.21.15.5:0/493513832 shutdown_connections 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d7eef10 0x55fd3d835190 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d837020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 --2- 172.21.15.5:0/493513832 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 -- 172.21.15.5:0/493513832 >> 172.21.15.5:0/493513832 conn(0x55fd3d7eb840 msgr2=0x55fd3d834040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 -- 172.21.15.5:0/493513832 shutdown_connections 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.760+0000 7f934fb6b740 1 -- 172.21.15.5:0/493513832 wait complete. 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.761+0000 7f934fb6b740 1 -- start start 2024-04-25T09:04:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.761+0000 7f934fb6b740 1 Processor -- start 2024-04-25T09:04:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d819230 0x55fd3d80ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d82d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d8082b0 0x55fd3d82da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934fb6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d751a10 con 0x55fd3d819230 2024-04-25T09:04:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d70e0c0 con 0x55fd3d836ad0 2024-04-25T09:04:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d7efcb0 con 0x55fd3d8082b0 2024-04-25T09:04:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934fb6b740 10 client.0 _ll_register_callbacks cb 0x55fd3d701ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d819230 0x55fd3d80ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d819230 0x55fd3d80ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36208/0 (socket says 172.21.15.5:36208) 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 -- 172.21.15.5:0/982669167 learned_addr learned my addr 172.21.15.5:0/982669167 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f9345d9b640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d82d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f9346d9d640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d8082b0 0x55fd3d82da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 -- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d8082b0 msgr2=0x55fd3d82da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d8082b0 0x55fd3d82da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 -- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 msgr2=0x55fd3d82d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d82d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f934659c640 1 -- 172.21.15.5:0/982669167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd3d4662d0 con 0x55fd3d819230 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.762+0000 7f9345d9b640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d82d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934659c640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d819230 0x55fd3d80ac00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f9340014c00 tx=0x7f9340000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ead049c8777325 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f93257fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f93257fa640 1 -- 172.21.15.5:0/982669167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340012ce0 con 0x55fd3d819230 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f93257fa640 1 -- 172.21.15.5:0/982669167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9340020420 con 0x55fd3d819230 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f933807cf90 con 0x55fd3d819230 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f93257fa640 1 -- 172.21.15.5:0/982669167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f934002d050 con 0x55fd3d819230 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 10 client.8658 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55fd3d5306b0 con 0x55fd3d819230 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f93257fa640 1 -- 172.21.15.5:0/982669167 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933807cf90 con 0x55fd3d819230 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f93257fa640 1 -- 172.21.15.5:0/982669167 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9340030020 con 0x55fd3d819230 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 10 client.8658 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 10 client.8658 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 20 client.8658 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d82c940 0x55fd3d852160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 4 client.8658 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd3d7b0920 con 0x55fd3d82c940 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.763+0000 7f9345d9b640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d82c940 0x55fd3d852160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.764+0000 7f93257fa640 10 client.8658 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.764+0000 7f9345d9b640 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d82c940 0x55fd3d852160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b65b80ff897c261 server_cookie=86764acd667b1d5f in_seq=0 out_seq=0 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.764+0000 7f93257fa640 1 -- 172.21.15.5:0/982669167 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fd3d7b0920 con 0x55fd3d82c940 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.764+0000 7f93257fa640 10 client.8658 handle_command_reply: tid=0 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.764+0000 7f934fb6b740 1 client.8658 shutdown 2024-04-25T09:04:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d819230 msgr2=0x55fd3d80ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d819230 0x55fd3d80ac00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f9340014c00 tx=0x7f9340000bc0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 shutdown_connections 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d82c940 0x55fd3d852160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d8082b0 0x55fd3d82da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d82d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f93257fa640 0 client.8658 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 --2- 172.21.15.5:0/982669167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d819230 0x55fd3d80ac00 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 >> 172.21.15.5:0/982669167 conn(0x55fd3d7eef10 msgr2=0x55fd3d8182b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 shutdown_connections 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 1 -- 172.21.15.5:0/982669167 wait complete. 2024-04-25T09:04:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.765+0000 7f934fb6b740 20 client.8658 trim_cache size 0 max 16384 2024-04-25T09:04:24.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.781+0000 7f934fb6b740 1 Processor -- start 2024-04-25T09:04:24.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.781+0000 7f934fb6b740 1 -- start start 2024-04-25T09:04:24.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d82d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d818460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934fb6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481fefe0 con 0x55fd3d8082b0 2024-04-25T09:04:24.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481e9fe0 con 0x55fd3d836ad0 2024-04-25T09:04:24.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93481fe9e0 con 0x55fd3d819230 2024-04-25T09:04:24.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d82d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d82d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36222/0 (socket says 172.21.15.5:36222) 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 -- 172.21.15.5:0/2850082513 learned_addr learned my addr 172.21.15.5:0/2850082513 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f9346d9d640 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d818460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f9345d9b640 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 -- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 msgr2=0x55fd3d819610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 -- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 msgr2=0x55fd3d818460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d818460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 -- 172.21.15.5:0/2850082513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd3d786460 con 0x55fd3d8082b0 2024-04-25T09:04:24.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f9346d9d640 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d818460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f9345d9b640 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f934659c640 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d82d090 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f9340012f80 tx=0x7f934001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cf84469eae008e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f93277fe640 1 -- 172.21.15.5:0/2850082513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340012860 con 0x55fd3d8082b0 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f93277fe640 1 -- 172.21.15.5:0/2850082513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340025070 con 0x55fd3d8082b0 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.782+0000 7f93277fe640 1 -- 172.21.15.5:0/2850082513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340020420 con 0x55fd3d8082b0 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 -- 172.21.15.5:0/2850082513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 msgr2=0x55fd3d82d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d82d090 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f9340012f80 tx=0x7f934001e000 comp rx=0 tx=0).stop 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 -- 172.21.15.5:0/2850082513 shutdown_connections 2024-04-25T09:04:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d836ad0 0x55fd3d818460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d819230 0x55fd3d819610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 --2- 172.21.15.5:0/2850082513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d82d090 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 -- 172.21.15.5:0/2850082513 >> 172.21.15.5:0/2850082513 conn(0x55fd3d7eef10 msgr2=0x55fd3d81cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 -- 172.21.15.5:0/2850082513 shutdown_connections 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 -- 172.21.15.5:0/2850082513 wait complete. 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.783+0000 7f934fb6b740 1 -- start start 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 1 Processor -- start 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d815880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d819230 0x55fd3d819ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d836ad0 0x55fd3d89e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d82c7c0 con 0x55fd3d8082b0 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d80b140 con 0x55fd3d819230 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd3d82cdc0 con 0x55fd3d836ad0 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.784+0000 7f934fb6b740 10 client.0 _ll_register_callbacks cb 0x55fd3d7e9c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d815880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d815880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36238/0 (socket says 172.21.15.5:36238) 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 -- 172.21.15.5:0/3163141195 learned_addr learned my addr 172.21.15.5:0/3163141195 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f9345d9b640 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d819230 0x55fd3d819ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f9346d9d640 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d836ad0 0x55fd3d89e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 -- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d836ad0 msgr2=0x55fd3d89e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d836ad0 0x55fd3d89e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 -- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d819230 msgr2=0x55fd3d819ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d819230 0x55fd3d819ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 -- 172.21.15.5:0/3163141195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd3d815dc0 con 0x55fd3d8082b0 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934659c640 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d815880 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f9340014c00 tx=0x7f9340014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff66b8176401306 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f93257fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f93257fa640 1 -- 172.21.15.5:0/3163141195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340040060 con 0x55fd3d8082b0 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f93257fa640 1 -- 172.21.15.5:0/3163141195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9340020830 con 0x55fd3d8082b0 2024-04-25T09:04:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9340025070 con 0x55fd3d8082b0 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f93257fa640 1 -- 172.21.15.5:0/3163141195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9340046050 con 0x55fd3d8082b0 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934fb6b740 10 client.8664 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.785+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55fd3d8463c0 con 0x55fd3d8082b0 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f93257fa640 1 -- 172.21.15.5:0/3163141195 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340025070 con 0x55fd3d8082b0 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f93257fa640 1 -- 172.21.15.5:0/3163141195 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9340030040 con 0x55fd3d8082b0 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f934fb6b740 10 client.8664 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f934fb6b740 10 client.8664 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:04:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f934fb6b740 20 client.8664 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f934fb6b740 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d81ada0 0x55fd3d89e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f934fb6b740 4 client.8664 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fd3d75ef50 con 0x55fd3d81ada0 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f9345d9b640 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d81ada0 0x55fd3d89e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f93257fa640 10 client.8664 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f9345d9b640 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d81ada0 0x55fd3d89e8b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c112a8c05be6c9 server_cookie=758a81f4da8bb0a2 in_seq=0 out_seq=0 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.786+0000 7f93257fa640 1 -- 172.21.15.5:0/3163141195 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55fd3d75ef50 con 0x55fd3d81ada0 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f93257fa640 10 client.8664 handle_command_reply: tid=0 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 client.8664 shutdown 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 msgr2=0x55fd3d815880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d815880 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f9340014c00 tx=0x7f9340014000 comp rx=0 tx=0).stop 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 shutdown_connections 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55fd3d81ada0 0x55fd3d89e8b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55fd3d836ad0 0x55fd3d89e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fd3d819230 0x55fd3d819ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f93257fa640 0 client.8664 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 --2- 172.21.15.5:0/3163141195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd3d8082b0 0x55fd3d815880 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 >> 172.21.15.5:0/3163141195 conn(0x55fd3d7eef10 msgr2=0x55fd3d818460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 shutdown_connections 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 1 -- 172.21.15.5:0/3163141195 wait complete. 2024-04-25T09:04:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934fb6b740 20 client.8664 trim_cache size 0 max 16384 2024-04-25T09:04:24.791 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:24.791 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8526, 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.0223111940000003, 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 70, 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 111, 2024-04-25T09:04:24.792 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 111, 2024-04-25T09:04:24.793 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.075966806 2024-04-25T09:04:24.793 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932806b4d0 msgr2=0x7f932806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932806b4d0 0x7f932806d990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9340001500 tx=0x7f9340009040 comp rx=0 tx=0).stop 2024-04-25T09:04:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934815e0a0 msgr2=0x7f93481e84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934815e0a0 0x7f93481e84e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9338034040 tx=0x7f9338004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 shutdown_connections 2024-04-25T09:04:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f932806b4d0 0x7f932806d990 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934815e0a0 0x7f93481e84e0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93480d3990 0x7f93481e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 --2- 172.21.15.5:0/1577281318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93480b6f50 0x7f93481f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.787+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 >> 172.21.15.5:0/1577281318 conn(0x7f93480668f0 msgr2=0x7f93480cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.788+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 shutdown_connections 2024-04-25T09:04:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.788+0000 7f934cd89640 1 -- 172.21.15.5:0/1577281318 wait complete. 2024-04-25T09:04:24.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.909+0000 7f08df8a3640 1 Processor -- start 2024-04-25T09:04:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.910+0000 7f08df8a3640 1 -- start start 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.910+0000 7f08df8a3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08d815de70 0x7f08d80b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.910+0000 7f08df8a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08d80b2cc0 0x7f08d80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08df8a3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d80d20e0 con 0x7f08d80b7130 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08df8a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d80d2a10 con 0x7f08d80b2cc0 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08df8a3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d80d23c0 con 0x7f08d815de70 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dce3e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08d80b2cc0 0x7f08d80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dce3e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08d80b2cc0 0x7f08d80b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36248/0 (socket says 172.21.15.5:36248) 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dce3e640 1 -- 172.21.15.5:0/908938130 learned_addr learned my addr 172.21.15.5:0/908938130 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dd63f640 1 --2- 172.21.15.5:0/908938130 >> v2:172.21.15.80:3300/0 conn(0x7f08d815de70 0x7f08d80b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dce3e640 1 -- 172.21.15.5:0/908938130 >> v2:172.21.15.80:3300/0 conn(0x7f08d815de70 msgr2=0x7f08d80b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dce3e640 1 --2- 172.21.15.5:0/908938130 >> v2:172.21.15.80:3300/0 conn(0x7f08d815de70 0x7f08d80b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dce3e640 1 -- 172.21.15.5:0/908938130 >> v1:172.21.15.80:6789/0 conn(0x7f08d80b7130 legacy=0x7f08d80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.911+0000 7f08dce3e640 1 -- 172.21.15.5:0/908938130 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80d26a0 con 0x7f08d80b2cc0 2024-04-25T09:04:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.912+0000 7f08dce3e640 1 --2- 172.21.15.5:0/908938130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b2cc0 0x7f08d80b6bf0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009870 tx=0x7f08cc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a664cf19af387b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.912+0000 7f08d7fff640 1 -- 172.21.15.5:0/908938130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc037070 con 0x7f08d80b2cc0 2024-04-25T09:04:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.912+0000 7f08d7fff640 1 -- 172.21.15.5:0/908938130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc032440 con 0x7f08d80b2cc0 2024-04-25T09:04:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.912+0000 7f08d7fff640 1 -- 172.21.15.5:0/908938130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc032810 con 0x7f08d80b2cc0 2024-04-25T09:04:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.912+0000 7f08df8a3640 1 -- 172.21.15.5:0/908938130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b2cc0 msgr2=0x7f08d80b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.912+0000 7f08df8a3640 1 --2- 172.21.15.5:0/908938130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b2cc0 0x7f08d80b6bf0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009870 tx=0x7f08cc02a2a0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.913+0000 7f08df8a3640 1 -- 172.21.15.5:0/908938130 shutdown_connections 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.913+0000 7f08df8a3640 1 --2- 172.21.15.5:0/908938130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b2cc0 0x7f08d80b6bf0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.913+0000 7f08df8a3640 1 --2- 172.21.15.5:0/908938130 >> v2:172.21.15.80:3300/0 conn(0x7f08d815de70 0x7f08d80b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.913+0000 7f08df8a3640 1 -- 172.21.15.5:0/908938130 >> 172.21.15.5:0/908938130 conn(0x7f08d806b000 msgr2=0x7f08d806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.913+0000 7f08df8a3640 1 -- 172.21.15.5:0/908938130 shutdown_connections 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.913+0000 7f08df8a3640 1 -- 172.21.15.5:0/908938130 wait complete. 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 Processor -- start 2024-04-25T09:04:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 -- start start 2024-04-25T09:04:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d80b2cc0 0x7f08d8155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b7130 0x7f08d80caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d815de70 0x7f08d80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80cf080 con 0x7f08d80b7130 2024-04-25T09:04:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80cef00 con 0x7f08d80b2cc0 2024-04-25T09:04:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.914+0000 7f08df8a3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80cf200 con 0x7f08d815de70 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b7130 0x7f08d80caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b7130 0x7f08d80caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36260/0 (socket says 172.21.15.5:36260) 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 -- 172.21.15.5:0/3856825640 learned_addr learned my addr 172.21.15.5:0/3856825640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dd63f640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d80b2cc0 0x7f08d8155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dde40640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d815de70 0x7f08d80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 -- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d815de70 msgr2=0x7f08d80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d815de70 0x7f08d80ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 -- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d80b2cc0 msgr2=0x7f08d8155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d80b2cc0 0x7f08d8155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 -- 172.21.15.5:0/3856825640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80cb5f0 con 0x7f08d80b7130 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dd63f640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d80b2cc0 0x7f08d8155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dde40640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d815de70 0x7f08d80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08dce3e640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b7130 0x7f08d80caba0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08d5ffb640 1 -- 172.21.15.5:0/3856825640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc037040 con 0x7f08d80b7130 2024-04-25T09:04:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08d5ffb640 1 -- 172.21.15.5:0/3856825640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc042070 con 0x7f08d80b7130 2024-04-25T09:04:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d80cb8d0 con 0x7f08d80b7130 2024-04-25T09:04:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.915+0000 7f08d5ffb640 1 -- 172.21.15.5:0/3856825640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc030880 con 0x7f08d80b7130 2024-04-25T09:04:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.916+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d80cbe90 con 0x7f08d80b7130 2024-04-25T09:04:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.916+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d804ef20 con 0x7f08d80b7130 2024-04-25T09:04:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.917+0000 7f08d5ffb640 1 -- 172.21.15.5:0/3856825640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08cc030a20 con 0x7f08d80b7130 2024-04-25T09:04:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.917+0000 7f08d5ffb640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08c406b4d0 0x7f08c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.918+0000 7f08d5ffb640 1 -- 172.21.15.5:0/3856825640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08cc0aaaa0 con 0x7f08d80b7130 2024-04-25T09:04:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.918+0000 7f08dd63f640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08c406b4d0 0x7f08c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.918+0000 7f08dd63f640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08c406b4d0 0x7f08c406d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009a20 tx=0x7f08d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:24.922+0000 7f08d5ffb640 1 -- 172.21.15.5:0/3856825640 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08cc079910 con 0x7f08d80b7130 2024-04-25T09:04:25.028 INFO:tasks.ceph.mds.d.smithi080.stderr:2024-04-25T09:04:25.040+0000 7fa6f137d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.140+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08d80ce980 con 0x7f08d80b7130 2024-04-25T09:04:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.140+0000 7f08d5ffb640 1 -- 172.21.15.5:0/3856825640 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08cc079210 con 0x7f08d80b7130 2024-04-25T09:04:25.129 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08c406b4d0 msgr2=0x7f08c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08c406b4d0 0x7f08c406d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009a20 tx=0x7f08d0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b7130 msgr2=0x7f08d80caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b7130 0x7f08d80caba0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 shutdown_connections 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f08c406b4d0 0x7f08c406d990 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08d815de70 0x7f08d80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08d80b7130 0x7f08d80caba0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 --2- 172.21.15.5:0/3856825640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d80b2cc0 0x7f08d8155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 >> 172.21.15.5:0/3856825640 conn(0x7f08d806b000 msgr2=0x7f08d815e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:25.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 shutdown_connections 2024-04-25T09:04:25.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:25.142+0000 7f08df8a3640 1 -- 172.21.15.5:0/3856825640 wait complete. 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:25.144 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:25.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.145 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:04:25.160 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:25.160 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:25.160 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:04:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42295sec preferred_lft 42295sec 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.162 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.163 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:25.223 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:04:25.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.225 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:04:25.282 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:04:25.285 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:25.286 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:04:25.286 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:04:25.286 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:25.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.287 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:04:25.287 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:25.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:04:25.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:04:25.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:04:25.288 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:25.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.368 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:04:25.383 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:04:25.383 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:04:25.383 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:25.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:04:25.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:25.448 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:25.503 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:25.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:25.504 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:25.558 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:04:25.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:04:25.642 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:04:25.642 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:04:25.650 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:04:25.650 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:04:25.650 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:04:25.650 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:04:25.650 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:04:25.651 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:04:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:04:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:04:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:04:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:04:25.653 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:25.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:25.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.719 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:25.784 INFO:teuthology.orchestra.run.smithi005.stdout:client8673 2024-04-25T09:04:25.785 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:25.785 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:25.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.841 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:25.841 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:25.841 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:04:25.841 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:25.841 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:25.841 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:25.841 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101216 s, 104 MB/s 2024-04-25T09:04:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825454 s, 127 MB/s 2024-04-25T09:04:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852828 s, 123 MB/s 2024-04-25T09:04:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668004 s, 157 MB/s 2024-04-25T09:04:25.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713184 s, 147 MB/s 2024-04-25T09:04:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077622 s, 135 MB/s 2024-04-25T09:04:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800456 s, 131 MB/s 2024-04-25T09:04:25.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721123 s, 145 MB/s 2024-04-25T09:04:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087703 s, 120 MB/s 2024-04-25T09:04:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080664 s, 130 MB/s 2024-04-25T09:04:26.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737909 s, 142 MB/s 2024-04-25T09:04:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771651 s, 136 MB/s 2024-04-25T09:04:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687427 s, 153 MB/s 2024-04-25T09:04:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778754 s, 135 MB/s 2024-04-25T09:04:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682617 s, 154 MB/s 2024-04-25T09:04:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712592 s, 147 MB/s 2024-04-25T09:04:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708741 s, 148 MB/s 2024-04-25T09:04:26.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.063 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735386 s, 143 MB/s 2024-04-25T09:04:26.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752026 s, 139 MB/s 2024-04-25T09:04:26.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074272 s, 141 MB/s 2024-04-25T09:04:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744831 s, 141 MB/s 2024-04-25T09:04:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658484 s, 159 MB/s 2024-04-25T09:04:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703872 s, 149 MB/s 2024-04-25T09:04:26.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787781 s, 133 MB/s 2024-04-25T09:04:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733797 s, 143 MB/s 2024-04-25T09:04:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726561 s, 144 MB/s 2024-04-25T09:04:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777223 s, 135 MB/s 2024-04-25T09:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073176 s, 143 MB/s 2024-04-25T09:04:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692282 s, 151 MB/s 2024-04-25T09:04:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689177 s, 152 MB/s 2024-04-25T09:04:26.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717061 s, 146 MB/s 2024-04-25T09:04:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770294 s, 136 MB/s 2024-04-25T09:04:26.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:26.179 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:26.179 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:26.179 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:04:26.180 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:26.180 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:26.180 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:26.180 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:26.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645593 s, 162 MB/s 2024-04-25T09:04:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744148 s, 141 MB/s 2024-04-25T09:04:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776239 s, 135 MB/s 2024-04-25T09:04:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633992 s, 165 MB/s 2024-04-25T09:04:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743774 s, 141 MB/s 2024-04-25T09:04:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644023 s, 163 MB/s 2024-04-25T09:04:26.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.292 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647031 s, 162 MB/s 2024-04-25T09:04:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755527 s, 139 MB/s 2024-04-25T09:04:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690811 s, 152 MB/s 2024-04-25T09:04:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756962 s, 139 MB/s 2024-04-25T09:04:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741708 s, 141 MB/s 2024-04-25T09:04:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685773 s, 153 MB/s 2024-04-25T09:04:26.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781224 s, 134 MB/s 2024-04-25T09:04:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712761 s, 147 MB/s 2024-04-25T09:04:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644856 s, 163 MB/s 2024-04-25T09:04:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781655 s, 134 MB/s 2024-04-25T09:04:26.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.374 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746329 s, 140 MB/s 2024-04-25T09:04:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676598 s, 155 MB/s 2024-04-25T09:04:26.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714456 s, 147 MB/s 2024-04-25T09:04:26.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725942 s, 144 MB/s 2024-04-25T09:04:26.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720164 s, 146 MB/s 2024-04-25T09:04:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750533 s, 140 MB/s 2024-04-25T09:04:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785617 s, 133 MB/s 2024-04-25T09:04:26.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749852 s, 140 MB/s 2024-04-25T09:04:26.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075848 s, 138 MB/s 2024-04-25T09:04:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692707 s, 151 MB/s 2024-04-25T09:04:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741038 s, 142 MB/s 2024-04-25T09:04:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714684 s, 147 MB/s 2024-04-25T09:04:26.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782517 s, 134 MB/s 2024-04-25T09:04:26.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664935 s, 158 MB/s 2024-04-25T09:04:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066367 s, 158 MB/s 2024-04-25T09:04:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642597 s, 163 MB/s 2024-04-25T09:04:26.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:26.496 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:26.496 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:26.496 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:04:26.496 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:26.496 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:26.496 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:26.496 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758049 s, 138 MB/s 2024-04-25T09:04:26.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748235 s, 140 MB/s 2024-04-25T09:04:26.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748178 s, 140 MB/s 2024-04-25T09:04:26.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073594 s, 142 MB/s 2024-04-25T09:04:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707506 s, 148 MB/s 2024-04-25T09:04:26.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696296 s, 151 MB/s 2024-04-25T09:04:26.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748603 s, 140 MB/s 2024-04-25T09:04:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716055 s, 146 MB/s 2024-04-25T09:04:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702348 s, 149 MB/s 2024-04-25T09:04:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729161 s, 144 MB/s 2024-04-25T09:04:26.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646978 s, 162 MB/s 2024-04-25T09:04:26.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653297 s, 161 MB/s 2024-04-25T09:04:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717278 s, 146 MB/s 2024-04-25T09:04:26.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696688 s, 151 MB/s 2024-04-25T09:04:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640139 s, 164 MB/s 2024-04-25T09:04:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766401 s, 137 MB/s 2024-04-25T09:04:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721109 s, 145 MB/s 2024-04-25T09:04:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670671 s, 156 MB/s 2024-04-25T09:04:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733605 s, 143 MB/s 2024-04-25T09:04:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715438 s, 147 MB/s 2024-04-25T09:04:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688008 s, 152 MB/s 2024-04-25T09:04:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638143 s, 164 MB/s 2024-04-25T09:04:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754011 s, 139 MB/s 2024-04-25T09:04:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668597 s, 157 MB/s 2024-04-25T09:04:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726908 s, 144 MB/s 2024-04-25T09:04:26.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733151 s, 143 MB/s 2024-04-25T09:04:26.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738332 s, 142 MB/s 2024-04-25T09:04:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676076 s, 155 MB/s 2024-04-25T09:04:26.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743619 s, 141 MB/s 2024-04-25T09:04:26.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711028 s, 147 MB/s 2024-04-25T09:04:26.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754386 s, 139 MB/s 2024-04-25T09:04:26.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659486 s, 159 MB/s 2024-04-25T09:04:26.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:26.812 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:26.812 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:26.812 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:04:26.812 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:26.812 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:26.813 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:26.813 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:26.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746995 s, 140 MB/s 2024-04-25T09:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718031 s, 146 MB/s 2024-04-25T09:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006541 s, 160 MB/s 2024-04-25T09:04:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722805 s, 145 MB/s 2024-04-25T09:04:26.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742874 s, 141 MB/s 2024-04-25T09:04:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687641 s, 152 MB/s 2024-04-25T09:04:26.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681838 s, 154 MB/s 2024-04-25T09:04:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073332 s, 143 MB/s 2024-04-25T09:04:26.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.942 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685103 s, 153 MB/s 2024-04-25T09:04:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700541 s, 150 MB/s 2024-04-25T09:04:26.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.958 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707589 s, 148 MB/s 2024-04-25T09:04:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725929 s, 144 MB/s 2024-04-25T09:04:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.974 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718707 s, 146 MB/s 2024-04-25T09:04:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763159 s, 137 MB/s 2024-04-25T09:04:26.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702235 s, 149 MB/s 2024-04-25T09:04:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746051 s, 141 MB/s 2024-04-25T09:04:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774567 s, 135 MB/s 2024-04-25T09:04:27.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.015 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756124 s, 139 MB/s 2024-04-25T09:04:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751465 s, 140 MB/s 2024-04-25T09:04:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630016 s, 166 MB/s 2024-04-25T09:04:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641461 s, 163 MB/s 2024-04-25T09:04:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740977 s, 142 MB/s 2024-04-25T09:04:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699318 s, 150 MB/s 2024-04-25T09:04:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758436 s, 138 MB/s 2024-04-25T09:04:27.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.071 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718695 s, 146 MB/s 2024-04-25T09:04:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734119 s, 143 MB/s 2024-04-25T09:04:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696362 s, 151 MB/s 2024-04-25T09:04:27.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657906 s, 159 MB/s 2024-04-25T09:04:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647788 s, 162 MB/s 2024-04-25T09:04:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071575 s, 147 MB/s 2024-04-25T09:04:27.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684972 s, 153 MB/s 2024-04-25T09:04:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066717 s, 157 MB/s 2024-04-25T09:04:27.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.126 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:27.126 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:27.126 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:04:27.127 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:27.127 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:27.127 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:27.127 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:27.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749604 s, 140 MB/s 2024-04-25T09:04:27.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805847 s, 130 MB/s 2024-04-25T09:04:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733374 s, 143 MB/s 2024-04-25T09:04:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734678 s, 143 MB/s 2024-04-25T09:04:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687209 s, 153 MB/s 2024-04-25T09:04:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731156 s, 143 MB/s 2024-04-25T09:04:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685834 s, 153 MB/s 2024-04-25T09:04:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766457 s, 137 MB/s 2024-04-25T09:04:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652366 s, 161 MB/s 2024-04-25T09:04:27.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735746 s, 143 MB/s 2024-04-25T09:04:27.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:27.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:27.273 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651943 s, 161 MB/s 2024-04-25T09:04:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.880826 s, 1.2 MB/s 2024-04-25T09:04:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858395 s, 122 MB/s 2024-04-25T09:04:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778886 s, 135 MB/s 2024-04-25T09:04:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726475 s, 144 MB/s 2024-04-25T09:04:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767963 s, 137 MB/s 2024-04-25T09:04:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682038 s, 154 MB/s 2024-04-25T09:04:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802114 s, 131 MB/s 2024-04-25T09:04:28.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698226 s, 150 MB/s 2024-04-25T09:04:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718875 s, 146 MB/s 2024-04-25T09:04:28.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767677 s, 137 MB/s 2024-04-25T09:04:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732362 s, 143 MB/s 2024-04-25T09:04:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765711 s, 137 MB/s 2024-04-25T09:04:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916283 s, 114 MB/s 2024-04-25T09:04:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729813 s, 144 MB/s 2024-04-25T09:04:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788746 s, 133 MB/s 2024-04-25T09:04:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682268 s, 154 MB/s 2024-04-25T09:04:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708882 s, 148 MB/s 2024-04-25T09:04:28.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639054 s, 164 MB/s 2024-04-25T09:04:28.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703679 s, 149 MB/s 2024-04-25T09:04:28.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702242 s, 149 MB/s 2024-04-25T09:04:28.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705461 s, 149 MB/s 2024-04-25T09:04:28.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.324 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:28.324 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:28.324 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:04:28.325 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:28.325 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:28.325 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:28.325 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685829 s, 153 MB/s 2024-04-25T09:04:28.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756244 s, 139 MB/s 2024-04-25T09:04:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810945 s, 129 MB/s 2024-04-25T09:04:28.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762033 s, 138 MB/s 2024-04-25T09:04:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722436 s, 145 MB/s 2024-04-25T09:04:28.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762328 s, 138 MB/s 2024-04-25T09:04:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759476 s, 138 MB/s 2024-04-25T09:04:28.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745329 s, 141 MB/s 2024-04-25T09:04:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626298 s, 167 MB/s 2024-04-25T09:04:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078143 s, 134 MB/s 2024-04-25T09:04:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074255 s, 141 MB/s 2024-04-25T09:04:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718885 s, 146 MB/s 2024-04-25T09:04:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746745 s, 140 MB/s 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756171 s, 139 MB/s 2024-04-25T09:04:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774692 s, 135 MB/s 2024-04-25T09:04:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751407 s, 140 MB/s 2024-04-25T09:04:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730353 s, 144 MB/s 2024-04-25T09:04:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744231 s, 141 MB/s 2024-04-25T09:04:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719849 s, 146 MB/s 2024-04-25T09:04:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680078 s, 154 MB/s 2024-04-25T09:04:28.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066727 s, 157 MB/s 2024-04-25T09:04:28.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681498 s, 154 MB/s 2024-04-25T09:04:28.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740402 s, 142 MB/s 2024-04-25T09:04:28.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856554 s, 122 MB/s 2024-04-25T09:04:28.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653382 s, 160 MB/s 2024-04-25T09:04:28.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773631 s, 136 MB/s 2024-04-25T09:04:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732424 s, 143 MB/s 2024-04-25T09:04:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670645 s, 156 MB/s 2024-04-25T09:04:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851679 s, 123 MB/s 2024-04-25T09:04:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749169 s, 140 MB/s 2024-04-25T09:04:28.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683872 s, 153 MB/s 2024-04-25T09:04:28.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.647 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761259 s, 138 MB/s 2024-04-25T09:04:28.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.649 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:28.649 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:28.649 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:04:28.649 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:28.649 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:28.649 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:28.649 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751985 s, 139 MB/s 2024-04-25T09:04:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666294 s, 157 MB/s 2024-04-25T09:04:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709086 s, 148 MB/s 2024-04-25T09:04:28.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063158 s, 166 MB/s 2024-04-25T09:04:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641522 s, 163 MB/s 2024-04-25T09:04:28.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685443 s, 153 MB/s 2024-04-25T09:04:28.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698192 s, 150 MB/s 2024-04-25T09:04:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656496 s, 160 MB/s 2024-04-25T09:04:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647953 s, 162 MB/s 2024-04-25T09:04:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078094 s, 134 MB/s 2024-04-25T09:04:28.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763901 s, 137 MB/s 2024-04-25T09:04:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705855 s, 149 MB/s 2024-04-25T09:04:28.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657019 s, 160 MB/s 2024-04-25T09:04:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073596 s, 142 MB/s 2024-04-25T09:04:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069843 s, 150 MB/s 2024-04-25T09:04:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069196 s, 152 MB/s 2024-04-25T09:04:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737316 s, 142 MB/s 2024-04-25T09:04:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736571 s, 142 MB/s 2024-04-25T09:04:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751592 s, 140 MB/s 2024-04-25T09:04:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643839 s, 163 MB/s 2024-04-25T09:04:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720248 s, 146 MB/s 2024-04-25T09:04:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740727 s, 142 MB/s 2024-04-25T09:04:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073401 s, 143 MB/s 2024-04-25T09:04:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748727 s, 140 MB/s 2024-04-25T09:04:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747124 s, 140 MB/s 2024-04-25T09:04:28.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619814 s, 169 MB/s 2024-04-25T09:04:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068471 s, 153 MB/s 2024-04-25T09:04:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670079 s, 156 MB/s 2024-04-25T09:04:28.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688762 s, 152 MB/s 2024-04-25T09:04:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856737 s, 122 MB/s 2024-04-25T09:04:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710618 s, 148 MB/s 2024-04-25T09:04:28.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:28.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:28.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635146 s, 165 MB/s 2024-04-25T09:04:28.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.961 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:28.961 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:28.961 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:04:28.961 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:28.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:28.962 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:28.962 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:29.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749349 s, 140 MB/s 2024-04-25T09:04:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854058 s, 123 MB/s 2024-04-25T09:04:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763635 s, 137 MB/s 2024-04-25T09:04:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817184 s, 128 MB/s 2024-04-25T09:04:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662263 s, 158 MB/s 2024-04-25T09:04:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073836 s, 142 MB/s 2024-04-25T09:04:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726145 s, 144 MB/s 2024-04-25T09:04:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.087 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751073 s, 140 MB/s 2024-04-25T09:04:29.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628616 s, 167 MB/s 2024-04-25T09:04:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651088 s, 161 MB/s 2024-04-25T09:04:29.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084861 s, 124 MB/s 2024-04-25T09:04:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641548 s, 163 MB/s 2024-04-25T09:04:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808107 s, 130 MB/s 2024-04-25T09:04:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733459 s, 143 MB/s 2024-04-25T09:04:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712116 s, 147 MB/s 2024-04-25T09:04:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751869 s, 139 MB/s 2024-04-25T09:04:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748216 s, 140 MB/s 2024-04-25T09:04:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678761 s, 154 MB/s 2024-04-25T09:04:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714373 s, 147 MB/s 2024-04-25T09:04:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069071 s, 152 MB/s 2024-04-25T09:04:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716174 s, 146 MB/s 2024-04-25T09:04:29.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691538 s, 152 MB/s 2024-04-25T09:04:29.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736168 s, 142 MB/s 2024-04-25T09:04:29.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726541 s, 144 MB/s 2024-04-25T09:04:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684953 s, 153 MB/s 2024-04-25T09:04:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718056 s, 146 MB/s 2024-04-25T09:04:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741391 s, 141 MB/s 2024-04-25T09:04:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717119 s, 146 MB/s 2024-04-25T09:04:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763934 s, 137 MB/s 2024-04-25T09:04:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629503 s, 167 MB/s 2024-04-25T09:04:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715746 s, 147 MB/s 2024-04-25T09:04:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647315 s, 162 MB/s 2024-04-25T09:04:29.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.281 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:29.281 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:29.281 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:04:29.281 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:29.281 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:29.281 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:29.281 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650634 s, 161 MB/s 2024-04-25T09:04:29.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629634 s, 167 MB/s 2024-04-25T09:04:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716311 s, 146 MB/s 2024-04-25T09:04:29.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720877 s, 145 MB/s 2024-04-25T09:04:29.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067792 s, 155 MB/s 2024-04-25T09:04:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723926 s, 145 MB/s 2024-04-25T09:04:29.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766216 s, 137 MB/s 2024-04-25T09:04:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715094 s, 147 MB/s 2024-04-25T09:04:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724321 s, 145 MB/s 2024-04-25T09:04:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069341 s, 151 MB/s 2024-04-25T09:04:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734327 s, 143 MB/s 2024-04-25T09:04:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719497 s, 146 MB/s 2024-04-25T09:04:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741708 s, 141 MB/s 2024-04-25T09:04:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757384 s, 138 MB/s 2024-04-25T09:04:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716644 s, 146 MB/s 2024-04-25T09:04:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714945 s, 147 MB/s 2024-04-25T09:04:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718341 s, 146 MB/s 2024-04-25T09:04:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728281 s, 144 MB/s 2024-04-25T09:04:29.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670318 s, 156 MB/s 2024-04-25T09:04:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754188 s, 139 MB/s 2024-04-25T09:04:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716559 s, 146 MB/s 2024-04-25T09:04:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843343 s, 124 MB/s 2024-04-25T09:04:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732188 s, 143 MB/s 2024-04-25T09:04:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742786 s, 141 MB/s 2024-04-25T09:04:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643943 s, 163 MB/s 2024-04-25T09:04:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621399 s, 169 MB/s 2024-04-25T09:04:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629496 s, 167 MB/s 2024-04-25T09:04:29.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074083 s, 142 MB/s 2024-04-25T09:04:29.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741554 s, 141 MB/s 2024-04-25T09:04:29.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.578 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649273 s, 161 MB/s 2024-04-25T09:04:29.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.586 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746585 s, 140 MB/s 2024-04-25T09:04:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749266 s, 140 MB/s 2024-04-25T09:04:29.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.596 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:29.596 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:29.596 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:04:29.596 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:29.596 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:29.596 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:29.596 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753798 s, 139 MB/s 2024-04-25T09:04:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725942 s, 144 MB/s 2024-04-25T09:04:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718478 s, 146 MB/s 2024-04-25T09:04:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073423 s, 143 MB/s 2024-04-25T09:04:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666088 s, 157 MB/s 2024-04-25T09:04:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713992 s, 147 MB/s 2024-04-25T09:04:29.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.710 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763571 s, 137 MB/s 2024-04-25T09:04:29.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650484 s, 161 MB/s 2024-04-25T09:04:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737859 s, 142 MB/s 2024-04-25T09:04:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731685 s, 143 MB/s 2024-04-25T09:04:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830351 s, 126 MB/s 2024-04-25T09:04:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720057 s, 146 MB/s 2024-04-25T09:04:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069804 s, 150 MB/s 2024-04-25T09:04:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751379 s, 140 MB/s 2024-04-25T09:04:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656037 s, 160 MB/s 2024-04-25T09:04:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670943 s, 156 MB/s 2024-04-25T09:04:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074178 s, 141 MB/s 2024-04-25T09:04:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747167 s, 140 MB/s 2024-04-25T09:04:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677368 s, 155 MB/s 2024-04-25T09:04:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.816 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735922 s, 142 MB/s 2024-04-25T09:04:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680142 s, 154 MB/s 2024-04-25T09:04:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670769 s, 156 MB/s 2024-04-25T09:04:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718231 s, 146 MB/s 2024-04-25T09:04:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.846 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646417 s, 162 MB/s 2024-04-25T09:04:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646871 s, 162 MB/s 2024-04-25T09:04:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738084 s, 142 MB/s 2024-04-25T09:04:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645371 s, 162 MB/s 2024-04-25T09:04:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685954 s, 153 MB/s 2024-04-25T09:04:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823907 s, 127 MB/s 2024-04-25T09:04:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700584 s, 150 MB/s 2024-04-25T09:04:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.901 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715625 s, 147 MB/s 2024-04-25T09:04:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733454 s, 143 MB/s 2024-04-25T09:04:29.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.911 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:29.911 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:29.911 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:04:29.911 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:29.911 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:29.911 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:29.911 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762086 s, 138 MB/s 2024-04-25T09:04:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712413 s, 147 MB/s 2024-04-25T09:04:29.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:29.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:29.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710583 s, 148 MB/s 2024-04-25T09:04:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680107 s, 154 MB/s 2024-04-25T09:04:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690124 s, 152 MB/s 2024-04-25T09:04:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726475 s, 144 MB/s 2024-04-25T09:04:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629254 s, 167 MB/s 2024-04-25T09:04:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719841 s, 146 MB/s 2024-04-25T09:04:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666037 s, 157 MB/s 2024-04-25T09:04:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650616 s, 161 MB/s 2024-04-25T09:04:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071798 s, 146 MB/s 2024-04-25T09:04:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066215 s, 158 MB/s 2024-04-25T09:04:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654583 s, 160 MB/s 2024-04-25T09:04:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068776 s, 152 MB/s 2024-04-25T09:04:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712659 s, 147 MB/s 2024-04-25T09:04:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013278 s, 79.0 MB/s 2024-04-25T09:04:30.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.107 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666076 s, 157 MB/s 2024-04-25T09:04:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743447 s, 141 MB/s 2024-04-25T09:04:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733405 s, 143 MB/s 2024-04-25T09:04:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735066 s, 143 MB/s 2024-04-25T09:04:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721256 s, 145 MB/s 2024-04-25T09:04:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770158 s, 136 MB/s 2024-04-25T09:04:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648676 s, 162 MB/s 2024-04-25T09:04:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635005 s, 165 MB/s 2024-04-25T09:04:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745309 s, 141 MB/s 2024-04-25T09:04:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699053 s, 150 MB/s 2024-04-25T09:04:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861518 s, 122 MB/s 2024-04-25T09:04:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064094 s, 164 MB/s 2024-04-25T09:04:30.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00814583 s, 129 MB/s 2024-04-25T09:04:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700835 s, 150 MB/s 2024-04-25T09:04:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063344 s, 166 MB/s 2024-04-25T09:04:30.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.229 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805586 s, 130 MB/s 2024-04-25T09:04:30.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.230 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:30.230 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:30.230 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:04:30.230 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:30.230 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:30.230 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:30.231 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:30.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643063 s, 163 MB/s 2024-04-25T09:04:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072114 s, 145 MB/s 2024-04-25T09:04:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635065 s, 165 MB/s 2024-04-25T09:04:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696961 s, 150 MB/s 2024-04-25T09:04:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664248 s, 158 MB/s 2024-04-25T09:04:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684563 s, 153 MB/s 2024-04-25T09:04:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645566 s, 162 MB/s 2024-04-25T09:04:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753933 s, 139 MB/s 2024-04-25T09:04:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.357 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693375 s, 151 MB/s 2024-04-25T09:04:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688175 s, 152 MB/s 2024-04-25T09:04:30.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720521 s, 146 MB/s 2024-04-25T09:04:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683407 s, 153 MB/s 2024-04-25T09:04:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651742 s, 161 MB/s 2024-04-25T09:04:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739242 s, 142 MB/s 2024-04-25T09:04:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641191 s, 164 MB/s 2024-04-25T09:04:30.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644276 s, 163 MB/s 2024-04-25T09:04:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720133 s, 146 MB/s 2024-04-25T09:04:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749822 s, 140 MB/s 2024-04-25T09:04:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690673 s, 152 MB/s 2024-04-25T09:04:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069428 s, 151 MB/s 2024-04-25T09:04:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715422 s, 147 MB/s 2024-04-25T09:04:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719775 s, 146 MB/s 2024-04-25T09:04:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677502 s, 155 MB/s 2024-04-25T09:04:30.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703191 s, 149 MB/s 2024-04-25T09:04:30.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663159 s, 158 MB/s 2024-04-25T09:04:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725336 s, 145 MB/s 2024-04-25T09:04:30.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751728 s, 139 MB/s 2024-04-25T09:04:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709941 s, 148 MB/s 2024-04-25T09:04:30.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656877 s, 160 MB/s 2024-04-25T09:04:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711393 s, 147 MB/s 2024-04-25T09:04:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625577 s, 168 MB/s 2024-04-25T09:04:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075496 s, 139 MB/s 2024-04-25T09:04:30.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.539 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:30.539 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:30.539 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:04:30.539 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:30.539 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:30.539 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:30.539 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729411 s, 144 MB/s 2024-04-25T09:04:30.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734111 s, 143 MB/s 2024-04-25T09:04:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725261 s, 145 MB/s 2024-04-25T09:04:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633797 s, 165 MB/s 2024-04-25T09:04:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697431 s, 150 MB/s 2024-04-25T09:04:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637719 s, 164 MB/s 2024-04-25T09:04:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648154 s, 162 MB/s 2024-04-25T09:04:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749709 s, 140 MB/s 2024-04-25T09:04:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651048 s, 161 MB/s 2024-04-25T09:04:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066184 s, 158 MB/s 2024-04-25T09:04:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763458 s, 137 MB/s 2024-04-25T09:04:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664217 s, 158 MB/s 2024-04-25T09:04:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712479 s, 147 MB/s 2024-04-25T09:04:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721525 s, 145 MB/s 2024-04-25T09:04:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700562 s, 150 MB/s 2024-04-25T09:04:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733625 s, 143 MB/s 2024-04-25T09:04:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741594 s, 141 MB/s 2024-04-25T09:04:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640879 s, 164 MB/s 2024-04-25T09:04:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.745 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635569 s, 165 MB/s 2024-04-25T09:04:30.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673347 s, 156 MB/s 2024-04-25T09:04:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674257 s, 156 MB/s 2024-04-25T09:04:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692526 s, 151 MB/s 2024-04-25T09:04:30.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718452 s, 146 MB/s 2024-04-25T09:04:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797424 s, 131 MB/s 2024-04-25T09:04:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675865 s, 155 MB/s 2024-04-25T09:04:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718734 s, 146 MB/s 2024-04-25T09:04:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713203 s, 147 MB/s 2024-04-25T09:04:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686184 s, 153 MB/s 2024-04-25T09:04:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.824 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679398 s, 154 MB/s 2024-04-25T09:04:30.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719654 s, 146 MB/s 2024-04-25T09:04:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769996 s, 136 MB/s 2024-04-25T09:04:30.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757035 s, 139 MB/s 2024-04-25T09:04:30.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.850 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:30.850 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:30.850 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:04:30.850 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:30.850 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:30.850 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:30.851 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726081 s, 144 MB/s 2024-04-25T09:04:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687086 s, 153 MB/s 2024-04-25T09:04:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758983 s, 138 MB/s 2024-04-25T09:04:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724346 s, 145 MB/s 2024-04-25T09:04:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074063 s, 142 MB/s 2024-04-25T09:04:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694234 s, 151 MB/s 2024-04-25T09:04:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714388 s, 147 MB/s 2024-04-25T09:04:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723867 s, 145 MB/s 2024-04-25T09:04:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725081 s, 145 MB/s 2024-04-25T09:04:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699701 s, 150 MB/s 2024-04-25T09:04:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:30.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728621 s, 144 MB/s 2024-04-25T09:04:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.004 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617553 s, 170 MB/s 2024-04-25T09:04:31.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.012 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698978 s, 150 MB/s 2024-04-25T09:04:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720429 s, 146 MB/s 2024-04-25T09:04:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692966 s, 151 MB/s 2024-04-25T09:04:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684477 s, 153 MB/s 2024-04-25T09:04:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728579 s, 144 MB/s 2024-04-25T09:04:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642812 s, 163 MB/s 2024-04-25T09:04:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062823 s, 167 MB/s 2024-04-25T09:04:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645282 s, 162 MB/s 2024-04-25T09:04:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066089 s, 159 MB/s 2024-04-25T09:04:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715658 s, 147 MB/s 2024-04-25T09:04:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655551 s, 160 MB/s 2024-04-25T09:04:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744725 s, 141 MB/s 2024-04-25T09:04:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835328 s, 126 MB/s 2024-04-25T09:04:31.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704355 s, 149 MB/s 2024-04-25T09:04:31.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862305 s, 122 MB/s 2024-04-25T09:04:31.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664086 s, 158 MB/s 2024-04-25T09:04:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702939 s, 149 MB/s 2024-04-25T09:04:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658151 s, 159 MB/s 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742988 s, 141 MB/s 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754434 s, 139 MB/s 2024-04-25T09:04:31.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.164 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:31.164 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:31.164 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:04:31.164 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:31.164 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:31.164 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:31.164 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628288 s, 167 MB/s 2024-04-25T09:04:31.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743288 s, 141 MB/s 2024-04-25T09:04:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757669 s, 138 MB/s 2024-04-25T09:04:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615236 s, 170 MB/s 2024-04-25T09:04:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647952 s, 162 MB/s 2024-04-25T09:04:31.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737524 s, 142 MB/s 2024-04-25T09:04:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674853 s, 155 MB/s 2024-04-25T09:04:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080571 s, 130 MB/s 2024-04-25T09:04:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651148 s, 161 MB/s 2024-04-25T09:04:31.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703726 s, 149 MB/s 2024-04-25T09:04:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733528 s, 143 MB/s 2024-04-25T09:04:31.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.317 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653669 s, 160 MB/s 2024-04-25T09:04:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645804 s, 162 MB/s 2024-04-25T09:04:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733394 s, 143 MB/s 2024-04-25T09:04:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654873 s, 160 MB/s 2024-04-25T09:04:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623884 s, 168 MB/s 2024-04-25T09:04:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868914 s, 121 MB/s 2024-04-25T09:04:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757129 s, 138 MB/s 2024-04-25T09:04:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666797 s, 157 MB/s 2024-04-25T09:04:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757495 s, 138 MB/s 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686885 s, 153 MB/s 2024-04-25T09:04:31.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730897 s, 143 MB/s 2024-04-25T09:04:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734228 s, 143 MB/s 2024-04-25T09:04:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643887 s, 163 MB/s 2024-04-25T09:04:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737082 s, 142 MB/s 2024-04-25T09:04:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710391 s, 148 MB/s 2024-04-25T09:04:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777805 s, 135 MB/s 2024-04-25T09:04:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700074 s, 150 MB/s 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727194 s, 144 MB/s 2024-04-25T09:04:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636645 s, 165 MB/s 2024-04-25T09:04:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737469 s, 142 MB/s 2024-04-25T09:04:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723415 s, 145 MB/s 2024-04-25T09:04:31.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.478 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:31.478 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:31.478 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:04:31.478 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:31.478 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:31.478 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:31.478 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663303 s, 158 MB/s 2024-04-25T09:04:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749009 s, 140 MB/s 2024-04-25T09:04:31.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714112 s, 147 MB/s 2024-04-25T09:04:31.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702919 s, 149 MB/s 2024-04-25T09:04:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682788 s, 154 MB/s 2024-04-25T09:04:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724932 s, 145 MB/s 2024-04-25T09:04:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733323 s, 143 MB/s 2024-04-25T09:04:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793239 s, 132 MB/s 2024-04-25T09:04:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721909 s, 145 MB/s 2024-04-25T09:04:31.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714627 s, 147 MB/s 2024-04-25T09:04:31.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690707 s, 152 MB/s 2024-04-25T09:04:31.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066585 s, 157 MB/s 2024-04-25T09:04:31.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754454 s, 139 MB/s 2024-04-25T09:04:31.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683659 s, 153 MB/s 2024-04-25T09:04:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640332 s, 164 MB/s 2024-04-25T09:04:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687338 s, 153 MB/s 2024-04-25T09:04:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769061 s, 136 MB/s 2024-04-25T09:04:31.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726909 s, 144 MB/s 2024-04-25T09:04:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712639 s, 147 MB/s 2024-04-25T09:04:31.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742877 s, 141 MB/s 2024-04-25T09:04:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685101 s, 153 MB/s 2024-04-25T09:04:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666752 s, 157 MB/s 2024-04-25T09:04:31.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731462 s, 143 MB/s 2024-04-25T09:04:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721223 s, 145 MB/s 2024-04-25T09:04:31.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720978 s, 145 MB/s 2024-04-25T09:04:31.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612321 s, 171 MB/s 2024-04-25T09:04:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764449 s, 137 MB/s 2024-04-25T09:04:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674558 s, 155 MB/s 2024-04-25T09:04:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711223 s, 147 MB/s 2024-04-25T09:04:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720843 s, 145 MB/s 2024-04-25T09:04:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719797 s, 146 MB/s 2024-04-25T09:04:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071078 s, 148 MB/s 2024-04-25T09:04:31.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.793 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:31.793 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:31.793 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:04:31.793 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:31.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:31.794 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:31.794 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073053 s, 144 MB/s 2024-04-25T09:04:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884275 s, 119 MB/s 2024-04-25T09:04:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745206 s, 141 MB/s 2024-04-25T09:04:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645767 s, 162 MB/s 2024-04-25T09:04:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076593 s, 137 MB/s 2024-04-25T09:04:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731358 s, 143 MB/s 2024-04-25T09:04:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614769 s, 171 MB/s 2024-04-25T09:04:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065677 s, 160 MB/s 2024-04-25T09:04:31.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735986 s, 142 MB/s 2024-04-25T09:04:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693257 s, 151 MB/s 2024-04-25T09:04:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070851 s, 148 MB/s 2024-04-25T09:04:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655669 s, 160 MB/s 2024-04-25T09:04:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770355 s, 136 MB/s 2024-04-25T09:04:31.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725954 s, 144 MB/s 2024-04-25T09:04:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671423 s, 156 MB/s 2024-04-25T09:04:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877785 s, 119 MB/s 2024-04-25T09:04:31.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713208 s, 147 MB/s 2024-04-25T09:04:31.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:31.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:31.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727368 s, 144 MB/s 2024-04-25T09:04:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648683 s, 162 MB/s 2024-04-25T09:04:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746964 s, 140 MB/s 2024-04-25T09:04:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067936 s, 154 MB/s 2024-04-25T09:04:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752774 s, 139 MB/s 2024-04-25T09:04:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072468 s, 145 MB/s 2024-04-25T09:04:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664536 s, 158 MB/s 2024-04-25T09:04:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632836 s, 166 MB/s 2024-04-25T09:04:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657563 s, 159 MB/s 2024-04-25T09:04:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656506 s, 160 MB/s 2024-04-25T09:04:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749119 s, 140 MB/s 2024-04-25T09:04:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608963 s, 172 MB/s 2024-04-25T09:04:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771973 s, 136 MB/s 2024-04-25T09:04:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067993 s, 154 MB/s 2024-04-25T09:04:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.107 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709345 s, 148 MB/s 2024-04-25T09:04:32.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.108 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:32.108 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:32.109 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:04:32.109 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:32.109 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:32.109 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:32.109 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729954 s, 144 MB/s 2024-04-25T09:04:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664376 s, 158 MB/s 2024-04-25T09:04:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641749 s, 163 MB/s 2024-04-25T09:04:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764758 s, 137 MB/s 2024-04-25T09:04:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736138 s, 142 MB/s 2024-04-25T09:04:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686989 s, 153 MB/s 2024-04-25T09:04:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732758 s, 143 MB/s 2024-04-25T09:04:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714187 s, 147 MB/s 2024-04-25T09:04:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716911 s, 146 MB/s 2024-04-25T09:04:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851177 s, 123 MB/s 2024-04-25T09:04:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708656 s, 148 MB/s 2024-04-25T09:04:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673729 s, 156 MB/s 2024-04-25T09:04:32.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723766 s, 145 MB/s 2024-04-25T09:04:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679494 s, 154 MB/s 2024-04-25T09:04:32.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623998 s, 168 MB/s 2024-04-25T09:04:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703898 s, 149 MB/s 2024-04-25T09:04:32.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817453 s, 128 MB/s 2024-04-25T09:04:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749083 s, 140 MB/s 2024-04-25T09:04:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736425 s, 142 MB/s 2024-04-25T09:04:32.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708089 s, 148 MB/s 2024-04-25T09:04:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075223 s, 139 MB/s 2024-04-25T09:04:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715067 s, 147 MB/s 2024-04-25T09:04:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691868 s, 152 MB/s 2024-04-25T09:04:32.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655965 s, 160 MB/s 2024-04-25T09:04:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739651 s, 142 MB/s 2024-04-25T09:04:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693115 s, 151 MB/s 2024-04-25T09:04:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670197 s, 156 MB/s 2024-04-25T09:04:32.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071844 s, 146 MB/s 2024-04-25T09:04:32.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725907 s, 144 MB/s 2024-04-25T09:04:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760146 s, 138 MB/s 2024-04-25T09:04:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.415 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625949 s, 168 MB/s 2024-04-25T09:04:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756672 s, 139 MB/s 2024-04-25T09:04:32.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:32.425 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:32.425 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:04:32.425 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:32.425 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:32.425 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:32.425 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767859 s, 137 MB/s 2024-04-25T09:04:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723423 s, 145 MB/s 2024-04-25T09:04:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661008 s, 159 MB/s 2024-04-25T09:04:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679182 s, 154 MB/s 2024-04-25T09:04:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745798 s, 141 MB/s 2024-04-25T09:04:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737929 s, 142 MB/s 2024-04-25T09:04:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730198 s, 144 MB/s 2024-04-25T09:04:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638774 s, 164 MB/s 2024-04-25T09:04:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074155 s, 141 MB/s 2024-04-25T09:04:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729073 s, 144 MB/s 2024-04-25T09:04:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620774 s, 169 MB/s 2024-04-25T09:04:32.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072041 s, 146 MB/s 2024-04-25T09:04:32.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.585 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729872 s, 144 MB/s 2024-04-25T09:04:32.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721978 s, 145 MB/s 2024-04-25T09:04:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697255 s, 150 MB/s 2024-04-25T09:04:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659884 s, 159 MB/s 2024-04-25T09:04:32.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721333 s, 145 MB/s 2024-04-25T09:04:32.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704107 s, 149 MB/s 2024-04-25T09:04:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633804 s, 165 MB/s 2024-04-25T09:04:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741924 s, 141 MB/s 2024-04-25T09:04:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725995 s, 144 MB/s 2024-04-25T09:04:32.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689511 s, 152 MB/s 2024-04-25T09:04:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.664 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638134 s, 164 MB/s 2024-04-25T09:04:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695546 s, 151 MB/s 2024-04-25T09:04:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726277 s, 144 MB/s 2024-04-25T09:04:32.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074845 s, 140 MB/s 2024-04-25T09:04:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711512 s, 147 MB/s 2024-04-25T09:04:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645655 s, 162 MB/s 2024-04-25T09:04:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768167 s, 137 MB/s 2024-04-25T09:04:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668296 s, 157 MB/s 2024-04-25T09:04:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840285 s, 125 MB/s 2024-04-25T09:04:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767455 s, 137 MB/s 2024-04-25T09:04:32.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.739 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:32.739 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:32.739 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:04:32.739 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:32.739 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:32.739 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:32.739 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779525 s, 135 MB/s 2024-04-25T09:04:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798456 s, 131 MB/s 2024-04-25T09:04:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722208 s, 145 MB/s 2024-04-25T09:04:32.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637677 s, 164 MB/s 2024-04-25T09:04:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777772 s, 135 MB/s 2024-04-25T09:04:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705618 s, 149 MB/s 2024-04-25T09:04:32.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656392 s, 160 MB/s 2024-04-25T09:04:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699611 s, 150 MB/s 2024-04-25T09:04:32.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674213 s, 156 MB/s 2024-04-25T09:04:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692666 s, 151 MB/s 2024-04-25T09:04:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725123 s, 145 MB/s 2024-04-25T09:04:32.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765079 s, 137 MB/s 2024-04-25T09:04:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664374 s, 158 MB/s 2024-04-25T09:04:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609579 s, 172 MB/s 2024-04-25T09:04:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.918 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713295 s, 147 MB/s 2024-04-25T09:04:32.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072023 s, 146 MB/s 2024-04-25T09:04:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715439 s, 147 MB/s 2024-04-25T09:04:32.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728541 s, 144 MB/s 2024-04-25T09:04:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729434 s, 144 MB/s 2024-04-25T09:04:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671603 s, 156 MB/s 2024-04-25T09:04:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739836 s, 142 MB/s 2024-04-25T09:04:32.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.975 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736474 s, 142 MB/s 2024-04-25T09:04:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672574 s, 156 MB/s 2024-04-25T09:04:32.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663772 s, 158 MB/s 2024-04-25T09:04:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741717 s, 141 MB/s 2024-04-25T09:04:33.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650151 s, 161 MB/s 2024-04-25T09:04:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069043 s, 152 MB/s 2024-04-25T09:04:33.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643836 s, 163 MB/s 2024-04-25T09:04:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705358 s, 149 MB/s 2024-04-25T09:04:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699164 s, 150 MB/s 2024-04-25T09:04:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743751 s, 141 MB/s 2024-04-25T09:04:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728398 s, 144 MB/s 2024-04-25T09:04:33.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:33.054 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:33.054 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:33.055 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:04:33.055 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:33.055 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:33.055 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:33.055 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693832 s, 151 MB/s 2024-04-25T09:04:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696121 s, 151 MB/s 2024-04-25T09:04:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666494 s, 157 MB/s 2024-04-25T09:04:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685323 s, 153 MB/s 2024-04-25T09:04:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689 s, 152 MB/s 2024-04-25T09:04:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688011 s, 152 MB/s 2024-04-25T09:04:33.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.167 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770562 s, 136 MB/s 2024-04-25T09:04:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613291 s, 171 MB/s 2024-04-25T09:04:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626852 s, 167 MB/s 2024-04-25T09:04:33.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.191 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00806176 s, 130 MB/s 2024-04-25T09:04:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849497 s, 123 MB/s 2024-04-25T09:04:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685201 s, 153 MB/s 2024-04-25T09:04:33.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738308 s, 142 MB/s 2024-04-25T09:04:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625773 s, 168 MB/s 2024-04-25T09:04:33.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073011 s, 144 MB/s 2024-04-25T09:04:33.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751325 s, 140 MB/s 2024-04-25T09:04:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747782 s, 140 MB/s 2024-04-25T09:04:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654877 s, 160 MB/s 2024-04-25T09:04:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717205 s, 146 MB/s 2024-04-25T09:04:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702672 s, 149 MB/s 2024-04-25T09:04:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626516 s, 167 MB/s 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733822 s, 143 MB/s 2024-04-25T09:04:33.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718268 s, 146 MB/s 2024-04-25T09:04:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718308 s, 146 MB/s 2024-04-25T09:04:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074276 s, 141 MB/s 2024-04-25T09:04:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764804 s, 137 MB/s 2024-04-25T09:04:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734295 s, 143 MB/s 2024-04-25T09:04:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635049 s, 165 MB/s 2024-04-25T09:04:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072385 s, 145 MB/s 2024-04-25T09:04:33.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726967 s, 144 MB/s 2024-04-25T09:04:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071615 s, 146 MB/s 2024-04-25T09:04:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706546 s, 148 MB/s 2024-04-25T09:04:33.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:33.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:33.369 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:33.369 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:04:33.369 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:33.369 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:33.369 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:33.369 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692296 s, 151 MB/s 2024-04-25T09:04:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667708 s, 157 MB/s 2024-04-25T09:04:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740239 s, 142 MB/s 2024-04-25T09:04:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731378 s, 143 MB/s 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663321 s, 158 MB/s 2024-04-25T09:04:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744952 s, 141 MB/s 2024-04-25T09:04:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738128 s, 142 MB/s 2024-04-25T09:04:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722541 s, 145 MB/s 2024-04-25T09:04:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746143 s, 141 MB/s 2024-04-25T09:04:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690378 s, 152 MB/s 2024-04-25T09:04:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697671 s, 150 MB/s 2024-04-25T09:04:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062625 s, 167 MB/s 2024-04-25T09:04:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689822 s, 152 MB/s 2024-04-25T09:04:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641717 s, 163 MB/s 2024-04-25T09:04:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676769 s, 155 MB/s 2024-04-25T09:04:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639461 s, 164 MB/s 2024-04-25T09:04:33.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698206 s, 150 MB/s 2024-04-25T09:04:33.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735088 s, 143 MB/s 2024-04-25T09:04:33.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661929 s, 158 MB/s 2024-04-25T09:04:33.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707536 s, 148 MB/s 2024-04-25T09:04:33.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658538 s, 159 MB/s 2024-04-25T09:04:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774586 s, 135 MB/s 2024-04-25T09:04:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729783 s, 144 MB/s 2024-04-25T09:04:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714356 s, 147 MB/s 2024-04-25T09:04:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067745 s, 155 MB/s 2024-04-25T09:04:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653562 s, 160 MB/s 2024-04-25T09:04:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678444 s, 155 MB/s 2024-04-25T09:04:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720948 s, 145 MB/s 2024-04-25T09:04:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734292 s, 143 MB/s 2024-04-25T09:04:33.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073769 s, 142 MB/s 2024-04-25T09:04:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731232 s, 143 MB/s 2024-04-25T09:04:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650102 s, 161 MB/s 2024-04-25T09:04:33.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:33.680 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:33.680 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:33.680 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:04:33.680 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:33.680 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:33.680 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:33.680 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755412 s, 139 MB/s 2024-04-25T09:04:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719078 s, 146 MB/s 2024-04-25T09:04:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074207 s, 141 MB/s 2024-04-25T09:04:33.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073475 s, 143 MB/s 2024-04-25T09:04:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744294 s, 141 MB/s 2024-04-25T09:04:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630701 s, 166 MB/s 2024-04-25T09:04:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717514 s, 146 MB/s 2024-04-25T09:04:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707802 s, 148 MB/s 2024-04-25T09:04:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741156 s, 141 MB/s 2024-04-25T09:04:33.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752458 s, 139 MB/s 2024-04-25T09:04:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777961 s, 135 MB/s 2024-04-25T09:04:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667299 s, 157 MB/s 2024-04-25T09:04:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719573 s, 146 MB/s 2024-04-25T09:04:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645306 s, 162 MB/s 2024-04-25T09:04:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702854 s, 149 MB/s 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754714 s, 139 MB/s 2024-04-25T09:04:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658943 s, 159 MB/s 2024-04-25T09:04:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673265 s, 156 MB/s 2024-04-25T09:04:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064566 s, 162 MB/s 2024-04-25T09:04:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722098 s, 145 MB/s 2024-04-25T09:04:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640492 s, 164 MB/s 2024-04-25T09:04:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754165 s, 139 MB/s 2024-04-25T09:04:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706511 s, 148 MB/s 2024-04-25T09:04:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065019 s, 161 MB/s 2024-04-25T09:04:33.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731333 s, 143 MB/s 2024-04-25T09:04:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665487 s, 158 MB/s 2024-04-25T09:04:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622166 s, 169 MB/s 2024-04-25T09:04:33.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767272 s, 137 MB/s 2024-04-25T09:04:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742214 s, 141 MB/s 2024-04-25T09:04:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681789 s, 154 MB/s 2024-04-25T09:04:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739581 s, 142 MB/s 2024-04-25T09:04:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:33.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066035 s, 159 MB/s 2024-04-25T09:04:33.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:33.992 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:33.992 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:33.992 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:04:33.992 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:33.992 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:33.992 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:33.992 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740682 s, 142 MB/s 2024-04-25T09:04:34.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.067 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849395 s, 123 MB/s 2024-04-25T09:04:34.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748193 s, 140 MB/s 2024-04-25T09:04:34.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730005 s, 144 MB/s 2024-04-25T09:04:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739805 s, 142 MB/s 2024-04-25T09:04:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073096 s, 143 MB/s 2024-04-25T09:04:34.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744088 s, 141 MB/s 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744021 s, 141 MB/s 2024-04-25T09:04:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646115 s, 162 MB/s 2024-04-25T09:04:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733687 s, 143 MB/s 2024-04-25T09:04:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680975 s, 154 MB/s 2024-04-25T09:04:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064728 s, 162 MB/s 2024-04-25T09:04:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818893 s, 128 MB/s 2024-04-25T09:04:34.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666585 s, 157 MB/s 2024-04-25T09:04:34.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678427 s, 155 MB/s 2024-04-25T09:04:34.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711544 s, 147 MB/s 2024-04-25T09:04:34.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638762 s, 164 MB/s 2024-04-25T09:04:34.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729901 s, 144 MB/s 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677609 s, 155 MB/s 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696489 s, 151 MB/s 2024-04-25T09:04:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067994 s, 154 MB/s 2024-04-25T09:04:34.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673769 s, 156 MB/s 2024-04-25T09:04:34.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722473 s, 145 MB/s 2024-04-25T09:04:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715365 s, 147 MB/s 2024-04-25T09:04:34.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007199 s, 146 MB/s 2024-04-25T09:04:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783836 s, 134 MB/s 2024-04-25T09:04:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663739 s, 158 MB/s 2024-04-25T09:04:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738397 s, 142 MB/s 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717317 s, 146 MB/s 2024-04-25T09:04:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.290 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653706 s, 160 MB/s 2024-04-25T09:04:34.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756639 s, 139 MB/s 2024-04-25T09:04:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727429 s, 144 MB/s 2024-04-25T09:04:34.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:34.308 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:34.308 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:34.308 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:04:34.308 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:34.308 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:34.309 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:34.309 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:34.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.374 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723984 s, 145 MB/s 2024-04-25T09:04:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695161 s, 151 MB/s 2024-04-25T09:04:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669002 s, 157 MB/s 2024-04-25T09:04:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720551 s, 146 MB/s 2024-04-25T09:04:34.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739043 s, 142 MB/s 2024-04-25T09:04:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708343 s, 148 MB/s 2024-04-25T09:04:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782186 s, 134 MB/s 2024-04-25T09:04:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745739 s, 141 MB/s 2024-04-25T09:04:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798801 s, 131 MB/s 2024-04-25T09:04:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711386 s, 147 MB/s 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591596 s, 177 MB/s 2024-04-25T09:04:34.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809127 s, 130 MB/s 2024-04-25T09:04:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673275 s, 156 MB/s 2024-04-25T09:04:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863161 s, 121 MB/s 2024-04-25T09:04:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719802 s, 146 MB/s 2024-04-25T09:04:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635285 s, 165 MB/s 2024-04-25T09:04:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634168 s, 165 MB/s 2024-04-25T09:04:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068186 s, 154 MB/s 2024-04-25T09:04:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755027 s, 139 MB/s 2024-04-25T09:04:34.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073705 s, 142 MB/s 2024-04-25T09:04:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727944 s, 144 MB/s 2024-04-25T09:04:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734477 s, 143 MB/s 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619622 s, 169 MB/s 2024-04-25T09:04:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681599 s, 154 MB/s 2024-04-25T09:04:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.567 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674841 s, 155 MB/s 2024-04-25T09:04:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763682 s, 137 MB/s 2024-04-25T09:04:34.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650059 s, 161 MB/s 2024-04-25T09:04:34.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006633 s, 158 MB/s 2024-04-25T09:04:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667151 s, 157 MB/s 2024-04-25T09:04:34.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071605 s, 146 MB/s 2024-04-25T09:04:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715184 s, 147 MB/s 2024-04-25T09:04:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756216 s, 139 MB/s 2024-04-25T09:04:34.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:34.623 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:34.623 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:34.623 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:04:34.624 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:34.624 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:34.624 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:34.624 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:34.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753295 s, 139 MB/s 2024-04-25T09:04:34.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798706 s, 131 MB/s 2024-04-25T09:04:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685711 s, 153 MB/s 2024-04-25T09:04:34.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774421 s, 135 MB/s 2024-04-25T09:04:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740161 s, 142 MB/s 2024-04-25T09:04:34.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727886 s, 144 MB/s 2024-04-25T09:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671353 s, 156 MB/s 2024-04-25T09:04:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679605 s, 154 MB/s 2024-04-25T09:04:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838184 s, 125 MB/s 2024-04-25T09:04:34.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068283 s, 154 MB/s 2024-04-25T09:04:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839418 s, 125 MB/s 2024-04-25T09:04:34.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705234 s, 149 MB/s 2024-04-25T09:04:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737936 s, 142 MB/s 2024-04-25T09:04:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735891 s, 142 MB/s 2024-04-25T09:04:34.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.806 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068093 s, 154 MB/s 2024-04-25T09:04:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781083 s, 134 MB/s 2024-04-25T09:04:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742711 s, 141 MB/s 2024-04-25T09:04:34.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699521 s, 150 MB/s 2024-04-25T09:04:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741523 s, 141 MB/s 2024-04-25T09:04:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628564 s, 167 MB/s 2024-04-25T09:04:34.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710189 s, 148 MB/s 2024-04-25T09:04:34.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649683 s, 161 MB/s 2024-04-25T09:04:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727267 s, 144 MB/s 2024-04-25T09:04:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641997 s, 163 MB/s 2024-04-25T09:04:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680223 s, 154 MB/s 2024-04-25T09:04:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071599 s, 146 MB/s 2024-04-25T09:04:34.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624836 s, 168 MB/s 2024-04-25T09:04:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692101 s, 152 MB/s 2024-04-25T09:04:34.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687304 s, 153 MB/s 2024-04-25T09:04:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754485 s, 139 MB/s 2024-04-25T09:04:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721116 s, 145 MB/s 2024-04-25T09:04:34.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:34.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:34.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731303 s, 143 MB/s 2024-04-25T09:04:34.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:34.942 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:34.942 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:34.942 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:04:34.942 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:34.942 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:34.942 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:34.942 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716065 s, 146 MB/s 2024-04-25T09:04:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688428 s, 152 MB/s 2024-04-25T09:04:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724452 s, 145 MB/s 2024-04-25T09:04:35.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641561 s, 163 MB/s 2024-04-25T09:04:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007558 s, 139 MB/s 2024-04-25T09:04:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729819 s, 144 MB/s 2024-04-25T09:04:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717093 s, 146 MB/s 2024-04-25T09:04:35.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763554 s, 137 MB/s 2024-04-25T09:04:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714784 s, 147 MB/s 2024-04-25T09:04:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677747 s, 155 MB/s 2024-04-25T09:04:35.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.087 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691077 s, 152 MB/s 2024-04-25T09:04:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070088 s, 150 MB/s 2024-04-25T09:04:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722765 s, 145 MB/s 2024-04-25T09:04:35.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673448 s, 156 MB/s 2024-04-25T09:04:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714285 s, 147 MB/s 2024-04-25T09:04:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709997 s, 148 MB/s 2024-04-25T09:04:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065633 s, 160 MB/s 2024-04-25T09:04:35.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782778 s, 134 MB/s 2024-04-25T09:04:35.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679521 s, 154 MB/s 2024-04-25T09:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715092 s, 147 MB/s 2024-04-25T09:04:35.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.167 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746987 s, 140 MB/s 2024-04-25T09:04:35.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687296 s, 153 MB/s 2024-04-25T09:04:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741393 s, 141 MB/s 2024-04-25T09:04:35.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749194 s, 140 MB/s 2024-04-25T09:04:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711127 s, 147 MB/s 2024-04-25T09:04:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669848 s, 157 MB/s 2024-04-25T09:04:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737797 s, 142 MB/s 2024-04-25T09:04:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796675 s, 132 MB/s 2024-04-25T09:04:35.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725542 s, 145 MB/s 2024-04-25T09:04:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062026 s, 169 MB/s 2024-04-25T09:04:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639023 s, 164 MB/s 2024-04-25T09:04:35.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680668 s, 154 MB/s 2024-04-25T09:04:35.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:35.256 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:35.256 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:35.256 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:04:35.256 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:35.256 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:35.256 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:35.256 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799693 s, 131 MB/s 2024-04-25T09:04:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657094 s, 160 MB/s 2024-04-25T09:04:35.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651906 s, 161 MB/s 2024-04-25T09:04:35.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632728 s, 166 MB/s 2024-04-25T09:04:35.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718922 s, 146 MB/s 2024-04-25T09:04:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714686 s, 147 MB/s 2024-04-25T09:04:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732696 s, 143 MB/s 2024-04-25T09:04:35.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698193 s, 150 MB/s 2024-04-25T09:04:35.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656765 s, 160 MB/s 2024-04-25T09:04:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666158 s, 157 MB/s 2024-04-25T09:04:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062034 s, 169 MB/s 2024-04-25T09:04:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631651 s, 166 MB/s 2024-04-25T09:04:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728839 s, 144 MB/s 2024-04-25T09:04:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686221 s, 153 MB/s 2024-04-25T09:04:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605637 s, 173 MB/s 2024-04-25T09:04:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629092 s, 167 MB/s 2024-04-25T09:04:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070021 s, 150 MB/s 2024-04-25T09:04:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639934 s, 164 MB/s 2024-04-25T09:04:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758499 s, 138 MB/s 2024-04-25T09:04:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687463 s, 153 MB/s 2024-04-25T09:04:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643538 s, 163 MB/s 2024-04-25T09:04:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646189 s, 162 MB/s 2024-04-25T09:04:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624261 s, 168 MB/s 2024-04-25T09:04:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071686 s, 146 MB/s 2024-04-25T09:04:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856262 s, 122 MB/s 2024-04-25T09:04:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718027 s, 146 MB/s 2024-04-25T09:04:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733144 s, 143 MB/s 2024-04-25T09:04:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701927 s, 149 MB/s 2024-04-25T09:04:35.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748854 s, 140 MB/s 2024-04-25T09:04:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071975 s, 146 MB/s 2024-04-25T09:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740131 s, 142 MB/s 2024-04-25T09:04:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074583 s, 141 MB/s 2024-04-25T09:04:35.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:35.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:35.565 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:35.565 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:04:35.565 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:35.565 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:35.565 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:35.565 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630821 s, 166 MB/s 2024-04-25T09:04:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624804 s, 168 MB/s 2024-04-25T09:04:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736002 s, 142 MB/s 2024-04-25T09:04:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702455 s, 149 MB/s 2024-04-25T09:04:35.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086338 s, 121 MB/s 2024-04-25T09:04:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739378 s, 142 MB/s 2024-04-25T09:04:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651112 s, 161 MB/s 2024-04-25T09:04:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650273 s, 161 MB/s 2024-04-25T09:04:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746252 s, 141 MB/s 2024-04-25T09:04:35.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709396 s, 148 MB/s 2024-04-25T09:04:35.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622343 s, 168 MB/s 2024-04-25T09:04:35.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643132 s, 163 MB/s 2024-04-25T09:04:35.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688504 s, 152 MB/s 2024-04-25T09:04:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644748 s, 163 MB/s 2024-04-25T09:04:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072726 s, 144 MB/s 2024-04-25T09:04:35.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075153 s, 140 MB/s 2024-04-25T09:04:35.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721219 s, 145 MB/s 2024-04-25T09:04:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793134 s, 132 MB/s 2024-04-25T09:04:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067233 s, 156 MB/s 2024-04-25T09:04:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675231 s, 155 MB/s 2024-04-25T09:04:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789695 s, 133 MB/s 2024-04-25T09:04:35.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719581 s, 146 MB/s 2024-04-25T09:04:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064151 s, 163 MB/s 2024-04-25T09:04:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713732 s, 147 MB/s 2024-04-25T09:04:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714514 s, 147 MB/s 2024-04-25T09:04:35.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739805 s, 142 MB/s 2024-04-25T09:04:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066882 s, 157 MB/s 2024-04-25T09:04:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724211 s, 145 MB/s 2024-04-25T09:04:35.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667822 s, 157 MB/s 2024-04-25T09:04:35.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677847 s, 155 MB/s 2024-04-25T09:04:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068466 s, 153 MB/s 2024-04-25T09:04:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687557 s, 153 MB/s 2024-04-25T09:04:35.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:35.876 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:35.876 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:35.876 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:04:35.876 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:35.876 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:35.876 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:35.876 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632741 s, 166 MB/s 2024-04-25T09:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746665 s, 140 MB/s 2024-04-25T09:04:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683966 s, 153 MB/s 2024-04-25T09:04:35.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730379 s, 144 MB/s 2024-04-25T09:04:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696883 s, 150 MB/s 2024-04-25T09:04:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691753 s, 152 MB/s 2024-04-25T09:04:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644961 s, 163 MB/s 2024-04-25T09:04:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744696 s, 141 MB/s 2024-04-25T09:04:36.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725822 s, 144 MB/s 2024-04-25T09:04:36.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072794 s, 144 MB/s 2024-04-25T09:04:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679547 s, 154 MB/s 2024-04-25T09:04:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635635 s, 165 MB/s 2024-04-25T09:04:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636197 s, 165 MB/s 2024-04-25T09:04:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656381 s, 160 MB/s 2024-04-25T09:04:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732472 s, 143 MB/s 2024-04-25T09:04:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736967 s, 142 MB/s 2024-04-25T09:04:36.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.067 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716409 s, 146 MB/s 2024-04-25T09:04:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063913 s, 164 MB/s 2024-04-25T09:04:36.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630936 s, 166 MB/s 2024-04-25T09:04:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719472 s, 146 MB/s 2024-04-25T09:04:36.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.097 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063822 s, 164 MB/s 2024-04-25T09:04:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632884 s, 166 MB/s 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064231 s, 163 MB/s 2024-04-25T09:04:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632746 s, 166 MB/s 2024-04-25T09:04:36.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.126 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718143 s, 146 MB/s 2024-04-25T09:04:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705697 s, 149 MB/s 2024-04-25T09:04:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671603 s, 156 MB/s 2024-04-25T09:04:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877094 s, 120 MB/s 2024-04-25T09:04:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803705 s, 130 MB/s 2024-04-25T09:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824446 s, 127 MB/s 2024-04-25T09:04:36.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.178 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724327 s, 145 MB/s 2024-04-25T09:04:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708975 s, 148 MB/s 2024-04-25T09:04:36.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:36.187 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:36.187 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:36.187 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:04:36.187 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:36.187 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:36.187 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:36.187 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740563 s, 142 MB/s 2024-04-25T09:04:36.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652483 s, 161 MB/s 2024-04-25T09:04:36.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737653 s, 142 MB/s 2024-04-25T09:04:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627298 s, 167 MB/s 2024-04-25T09:04:36.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735952 s, 142 MB/s 2024-04-25T09:04:36.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648677 s, 162 MB/s 2024-04-25T09:04:36.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.298 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688632 s, 152 MB/s 2024-04-25T09:04:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008031 s, 131 MB/s 2024-04-25T09:04:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071575 s, 147 MB/s 2024-04-25T09:04:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663318 s, 158 MB/s 2024-04-25T09:04:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740116 s, 142 MB/s 2024-04-25T09:04:36.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682339 s, 154 MB/s 2024-04-25T09:04:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062568 s, 168 MB/s 2024-04-25T09:04:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765711 s, 137 MB/s 2024-04-25T09:04:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777627 s, 135 MB/s 2024-04-25T09:04:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620479 s, 169 MB/s 2024-04-25T09:04:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662028 s, 158 MB/s 2024-04-25T09:04:36.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072737 s, 144 MB/s 2024-04-25T09:04:36.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.394 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751775 s, 139 MB/s 2024-04-25T09:04:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747252 s, 140 MB/s 2024-04-25T09:04:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715005 s, 147 MB/s 2024-04-25T09:04:36.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689214 s, 152 MB/s 2024-04-25T09:04:36.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748637 s, 140 MB/s 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641925 s, 163 MB/s 2024-04-25T09:04:36.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642824 s, 163 MB/s 2024-04-25T09:04:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659422 s, 159 MB/s 2024-04-25T09:04:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073685 s, 142 MB/s 2024-04-25T09:04:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700962 s, 150 MB/s 2024-04-25T09:04:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737784 s, 142 MB/s 2024-04-25T09:04:36.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606708 s, 173 MB/s 2024-04-25T09:04:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072538 s, 145 MB/s 2024-04-25T09:04:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744637 s, 141 MB/s 2024-04-25T09:04:36.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:36.498 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:04:36.498 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:04:36.498 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:04:36.498 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:04:36.498 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:04:36.498 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:04:36.498 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:04:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674034 s, 156 MB/s 2024-04-25T09:04:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662641 s, 158 MB/s 2024-04-25T09:04:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708918 s, 148 MB/s 2024-04-25T09:04:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610392 s, 172 MB/s 2024-04-25T09:04:36.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652498 s, 161 MB/s 2024-04-25T09:04:36.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731771 s, 143 MB/s 2024-04-25T09:04:36.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695807 s, 151 MB/s 2024-04-25T09:04:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820699 s, 128 MB/s 2024-04-25T09:04:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689837 s, 152 MB/s 2024-04-25T09:04:36.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675482 s, 155 MB/s 2024-04-25T09:04:36.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613545 s, 171 MB/s 2024-04-25T09:04:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728086 s, 144 MB/s 2024-04-25T09:04:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700209 s, 150 MB/s 2024-04-25T09:04:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725997 s, 144 MB/s 2024-04-25T09:04:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681748 s, 154 MB/s 2024-04-25T09:04:36.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738304 s, 142 MB/s 2024-04-25T09:04:36.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072276 s, 145 MB/s 2024-04-25T09:04:36.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644978 s, 163 MB/s 2024-04-25T09:04:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728223 s, 144 MB/s 2024-04-25T09:04:36.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702053 s, 149 MB/s 2024-04-25T09:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730858 s, 143 MB/s 2024-04-25T09:04:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702614 s, 149 MB/s 2024-04-25T09:04:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752565 s, 139 MB/s 2024-04-25T09:04:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696186 s, 151 MB/s 2024-04-25T09:04:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717705 s, 146 MB/s 2024-04-25T09:04:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638927 s, 164 MB/s 2024-04-25T09:04:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694201 s, 151 MB/s 2024-04-25T09:04:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739429 s, 142 MB/s 2024-04-25T09:04:36.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724827 s, 145 MB/s 2024-04-25T09:04:36.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670118 s, 156 MB/s 2024-04-25T09:04:36.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659806 s, 159 MB/s 2024-04-25T09:04:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:04:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:04:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691607 s, 152 MB/s 2024-04-25T09:04:36.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:36.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:04:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.966+0000 7f879f65d640 1 Processor -- start 2024-04-25T09:04:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.966+0000 7f879f65d640 1 -- start start 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879f65d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f879806d320 0x7f879815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879f65d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8798071040 0x7f87980ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879f65d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879815c040 con 0x7f8798154e20 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879f65d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879815be70 con 0x7f8798071040 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879f65d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87980717b0 con 0x7f879806d320 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879dbfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8798071040 0x7f87980ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879d3f9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8798154e20 0x7f879806cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57926/0 (socket says 172.21.15.5:57926) 2024-04-25T09:04:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879dbfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8798071040 0x7f87980ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42052/0 (socket says 172.21.15.5:42052) 2024-04-25T09:04:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879d3f9640 1 -- 172.21.15.5:0/2039352522 learned_addr learned my addr 172.21.15.5:0/2039352522 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879cbf8640 1 --2- 172.21.15.5:0/2039352522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f879806d320 0x7f879815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879dbfa640 1 -- 172.21.15.5:0/2039352522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f879806d320 msgr2=0x7f879815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879dbfa640 1 --2- 172.21.15.5:0/2039352522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f879806d320 0x7f879815ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879dbfa640 1 -- 172.21.15.5:0/2039352522 >> v1:172.21.15.5:6789/0 conn(0x7f8798154e20 legacy=0x7f879806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f878ffff640 1 -- 172.21.15.5:0/2039352522 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033928761 0 0) 0x7f879815c040 con 0x7f8798154e20 2024-04-25T09:04:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.967+0000 7f879dbfa640 1 -- 172.21.15.5:0/2039352522 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8798071a90 con 0x7f8798071040 2024-04-25T09:04:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.968+0000 7f879dbfa640 1 --2- 172.21.15.5:0/2039352522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f87980ae480 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f879815bff0 tx=0x7f879002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00511e899a47c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.968+0000 7f878ffff640 1 -- 172.21.15.5:0/2039352522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879002ae60 con 0x7f8798071040 2024-04-25T09:04:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.968+0000 7f878ffff640 1 -- 172.21.15.5:0/2039352522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790007740 con 0x7f8798071040 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.968+0000 7f878ffff640 1 -- 172.21.15.5:0/2039352522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790007b10 con 0x7f8798071040 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 -- 172.21.15.5:0/2039352522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 msgr2=0x7f87980ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 --2- 172.21.15.5:0/2039352522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f87980ae480 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f879815bff0 tx=0x7f879002a640 comp rx=0 tx=0).stop 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 -- 172.21.15.5:0/2039352522 shutdown_connections 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 --2- 172.21.15.5:0/2039352522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f87980ae480 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 --2- 172.21.15.5:0/2039352522 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f879806d320 0x7f879815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 -- 172.21.15.5:0/2039352522 >> 172.21.15.5:0/2039352522 conn(0x7f87980668f0 msgr2=0x7f8798066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 -- 172.21.15.5:0/2039352522 shutdown_connections 2024-04-25T09:04:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.969+0000 7f879f65d640 1 -- 172.21.15.5:0/2039352522 wait complete. 2024-04-25T09:04:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.970+0000 7f879f65d640 1 Processor -- start 2024-04-25T09:04:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.970+0000 7f879f65d640 1 -- start start 2024-04-25T09:04:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879f65d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f879806d320 0x7f8798143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879f65d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f8798140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879f65d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8798154e20 0x7f8798142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879f65d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980714d0 con 0x7f8798071040 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879f65d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798072050 con 0x7f879806d320 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879f65d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8798155200 con 0x7f8798154e20 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f8798140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f8798140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42062/0 (socket says 172.21.15.5:42062) 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879cbf8640 1 -- 172.21.15.5:0/2995826547 learned_addr learned my addr 172.21.15.5:0/2995826547 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879d3f9640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f879806d320 0x7f8798143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879dbfa640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8798154e20 0x7f8798142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879cbf8640 1 -- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8798154e20 msgr2=0x7f8798142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879cbf8640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8798154e20 0x7f8798142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879cbf8640 1 -- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f879806d320 msgr2=0x7f8798143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.971+0000 7f879cbf8640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f879806d320 0x7f8798143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.972+0000 7f879cbf8640 1 -- 172.21.15.5:0/2995826547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87981440e0 con 0x7f8798071040 2024-04-25T09:04:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.972+0000 7f879cbf8640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f8798140840 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f878800e9e0 tx=0x7f878800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.972+0000 7f878dffb640 1 -- 172.21.15.5:0/2995826547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788017070 con 0x7f8798071040 2024-04-25T09:04:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.972+0000 7f878dffb640 1 -- 172.21.15.5:0/2995826547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800c9d0 con 0x7f8798071040 2024-04-25T09:04:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.972+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8798141680 con 0x7f8798071040 2024-04-25T09:04:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.972+0000 7f878dffb640 1 -- 172.21.15.5:0/2995826547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800cdc0 con 0x7f8798071040 2024-04-25T09:04:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.972+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8798141c40 con 0x7f8798071040 2024-04-25T09:04:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.974+0000 7f878dffb640 1 -- 172.21.15.5:0/2995826547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f878801a070 con 0x7f8798071040 2024-04-25T09:04:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.974+0000 7f878dffb640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f877c06b4d0 0x7f877c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.974+0000 7f878dffb640 1 -- 172.21.15.5:0/2995826547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f878808a1b0 con 0x7f8798071040 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.974+0000 7f879d3f9640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f877c06b4d0 0x7f877c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 Processor -- start 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f879d3f9640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f877c06b4d0 0x7f877c06d990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8794007fd0 tx=0x7f8794007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 -- start start 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385faa53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385fa7f3a0 0x56385fac3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fac4350 0x56385fa7c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385f9e1000 con 0x56385fa7f3a0 2024-04-25T09:04:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385f989f20 con 0x56385fac4350 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.975+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56385f9dd0a0 con 0x56385faa4ff0 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385faa53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385fa7f3a0 0x56385fac3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385faa53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:38452/0 (socket says 172.21.15.5:38452) 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 -- 172.21.15.5:0/1901977303 learned_addr learned my addr 172.21.15.5:0/1901977303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385fa7f3a0 0x56385fac3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42068/0 (socket says 172.21.15.5:42068) 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879dbfa640 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fac4350 0x56385fa7c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 -- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fac4350 msgr2=0x56385fa7c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fac4350 0x56385fa7c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 -- 172.21.15.5:0/1901977303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385fa7f3a0 msgr2=0x56385fac3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385fa7f3a0 0x56385fac3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 -- 172.21.15.5:0/1901977303 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56385f7c1ba0 con 0x56385faa4ff0 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879cbf8640 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385fa7f3a0 0x56385fac3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f879d3f9640 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385faa53d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f87940077e0 tx=0x7f8794013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f4cb90b4edfc82d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f8782ffd640 1 -- 172.21.15.5:0/1901977303 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794026070 con 0x56385faa4ff0 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f8782ffd640 1 -- 172.21.15.5:0/1901977303 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794001cf0 con 0x56385faa4ff0 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.976+0000 7f8782ffd640 1 -- 172.21.15.5:0/1901977303 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794013d70 con 0x56385faa4ff0 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 -- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 msgr2=0x56385faa53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385faa53d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f87940077e0 tx=0x7f8794013000 comp rx=0 tx=0).stop 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 -- 172.21.15.5:0/1901977303 shutdown_connections 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fac4350 0x56385fa7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385fa7f3a0 0x56385fac3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 --2- 172.21.15.5:0/1901977303 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385faa53d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 -- 172.21.15.5:0/1901977303 >> 172.21.15.5:0/1901977303 conn(0x56385fa45050 msgr2=0x56385fac2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 -- 172.21.15.5:0/1901977303 shutdown_connections 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.977+0000 7f87a2366740 1 -- 172.21.15.5:0/1901977303 wait complete. 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.978+0000 7f87a2366740 1 -- start start 2024-04-25T09:04:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.978+0000 7f87a2366740 1 Processor -- start 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.978+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385fa7f3a0 0x56385fad7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.978+0000 7f87a2366740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa4ff0 0x56385fab14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.978+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385faa18b0 0x56385fab1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.978+0000 7f87a2366740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385fa79800 con 0x56385faa4ff0 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.978+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385f97f610 con 0x56385faa18b0 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56385fa7e330 con 0x56385fa7f3a0 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f87a2366740 10 client.0 _ll_register_callbacks cb 0x56385f997f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa4ff0 0x56385fab14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa4ff0 0x56385fab14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42076/0 (socket says 172.21.15.5:42076) 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 -- 172.21.15.5:0/1232954924 learned_addr learned my addr 172.21.15.5:0/1232954924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879d3f9640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385fa7f3a0 0x56385fad7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879dbfa640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385faa18b0 0x56385fab1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 -- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385fa7f3a0 msgr2=0x56385fad7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385fa7f3a0 0x56385fad7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 -- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385faa18b0 msgr2=0x56385fab1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385faa18b0 0x56385fab1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 -- 172.21.15.5:0/1232954924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56385f6b5490 con 0x56385faa4ff0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879dbfa640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385faa18b0 0x56385fab1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879d3f9640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385fa7f3a0 0x56385fad7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f879cbf8640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa4ff0 0x56385fab14f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f8788054df0 tx=0x7f878805ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71bd1b22a5cc4b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f8777fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f8777fff640 1 -- 172.21.15.5:0/1232954924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788021030 con 0x56385faa4ff0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f8777fff640 1 -- 172.21.15.5:0/1232954924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8788070180 con 0x56385faa4ff0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8794001cf0 con 0x56385faa4ff0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f8777fff640 1 -- 172.21.15.5:0/1232954924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8788056d50 con 0x56385faa4ff0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f87a2366740 10 client.8688 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.979+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x56385f822330 con 0x56385faa4ff0 2024-04-25T09:04:36.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f8777fff640 1 -- 172.21.15.5:0/1232954924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794001cf0 con 0x56385faa4ff0 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f8777fff640 1 -- 172.21.15.5:0/1232954924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8788024060 con 0x56385faa4ff0 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f87a2366740 10 client.8688 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f87a2366740 10 client.8688 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f87a2366740 20 client.8688 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f87a2366740 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fadab70 0x56385fadafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f87a2366740 4 client.8688 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56385f9ee540 con 0x56385fadab70 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f879d3f9640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fadab70 0x56385fadafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f879d3f9640 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fadab70 0x56385fadafe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f506b995c4ed34d5 server_cookie=f97eb02af2c8bf7c in_seq=0 out_seq=0 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.980+0000 7f8777fff640 10 client.8688 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f8777fff640 1 -- 172.21.15.5:0/1232954924 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56385f9ee540 con 0x56385fadab70 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f8777fff640 10 client.8688 handle_command_reply: tid=0 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 client.8688 shutdown 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa4ff0 msgr2=0x56385fab14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa4ff0 0x56385fab14f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f8788054df0 tx=0x7f878805ca30 comp rx=0 tx=0).stop 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 shutdown_connections 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fadab70 0x56385fadafe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385faa18b0 0x56385fab1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa4ff0 0x56385fab14f0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 --2- 172.21.15.5:0/1232954924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385fa7f3a0 0x56385fad7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f8777fff640 0 client.8688 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 >> 172.21.15.5:0/1232954924 conn(0x56385fa45050 msgr2=0x56385fa7db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 shutdown_connections 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 1 -- 172.21.15.5:0/1232954924 wait complete. 2024-04-25T09:04:36.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.981+0000 7f87a2366740 20 client.8688 trim_cache size 0 max 16384 2024-04-25T09:04:36.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.996+0000 7f87a2366740 1 Processor -- start 2024-04-25T09:04:36.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f87a2366740 1 -- start start 2024-04-25T09:04:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385faa3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f87a2366740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fa7db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385fae9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f87a2366740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980ceff0 con 0x56385faa18b0 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980ce1d0 con 0x56385fa7f3a0 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87981570a0 con 0x56385faa4ff0 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fa7db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fa7db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42078/0 (socket says 172.21.15.5:42078) 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.997+0000 7f879cbf8640 1 -- 172.21.15.5:0/2195798159 learned_addr learned my addr 172.21.15.5:0/2195798159 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f879cbf8640 1 -- 172.21.15.5:0/2195798159 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 msgr2=0x56385fae9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f879d3f9640 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385faa3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f879cbf8640 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385fae9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f879cbf8640 1 -- 172.21.15.5:0/2195798159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 msgr2=0x56385faa3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f879cbf8640 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385faa3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f879cbf8640 1 -- 172.21.15.5:0/2195798159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56385faa5740 con 0x56385faa18b0 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f879cbf8640 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fa7db80 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f878808a120 tx=0x7f878805a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febdd9444912b2bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87827fc640 1 -- 172.21.15.5:0/2195798159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788021070 con 0x56385faa18b0 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87827fc640 1 -- 172.21.15.5:0/2195798159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788070180 con 0x56385faa18b0 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87827fc640 1 -- 172.21.15.5:0/2195798159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788086030 con 0x56385faa18b0 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 -- 172.21.15.5:0/2195798159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 msgr2=0x56385fa7db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fa7db80 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f878808a120 tx=0x7f878805a000 comp rx=0 tx=0).stop 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 -- 172.21.15.5:0/2195798159 shutdown_connections 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385fae9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fa7db80 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 --2- 172.21.15.5:0/2195798159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385faa3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 -- 172.21.15.5:0/2195798159 >> 172.21.15.5:0/2195798159 conn(0x56385fa45050 msgr2=0x56385fab2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 -- 172.21.15.5:0/2195798159 shutdown_connections 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.998+0000 7f87a2366740 1 -- 172.21.15.5:0/2195798159 wait complete. 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.999+0000 7f87a2366740 1 -- start start 2024-04-25T09:04:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:36.999+0000 7f87a2366740 1 Processor -- start 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385fae9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f87a2366740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fb1abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f87a2366740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385fa7da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f87a2366740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385faa44b0 con 0x56385faa18b0 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980cdbd0 con 0x56385fa7f3a0 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f87a2366740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56385faea400 con 0x56385faa4ff0 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f87a2366740 10 client.0 _ll_register_callbacks cb 0x7f8794007060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fb1abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fb1abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42080/0 (socket says 172.21.15.5:42080) 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 -- 172.21.15.5:0/4021858629 learned_addr learned my addr 172.21.15.5:0/4021858629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879dbfa640 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385fa7da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879d3f9640 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385fae9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 -- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 msgr2=0x56385fa7da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385fa7da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 -- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 msgr2=0x56385fae9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385fae9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.000+0000 7f879cbf8640 1 -- 172.21.15.5:0/4021858629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56385faa1090 con 0x56385faa18b0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f879cbf8640 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fb1abb0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8788054df0 tx=0x7f8788088560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152292f3cd31addd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f8777fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f8777fff640 1 -- 172.21.15.5:0/4021858629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788086050 con 0x56385faa18b0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f8777fff640 1 -- 172.21.15.5:0/4021858629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f87880882d0 con 0x56385faa18b0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8788070180 con 0x56385faa18b0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f8777fff640 1 -- 172.21.15.5:0/4021858629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8788021040 con 0x56385faa18b0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 10 client.8694 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x56385f68e610 con 0x56385faa18b0 2024-04-25T09:04:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f8777fff640 1 -- 172.21.15.5:0/4021858629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788070180 con 0x56385faa18b0 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f8777fff640 1 -- 172.21.15.5:0/4021858629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f87880546e0 con 0x56385faa18b0 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 10 client.8694 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 10 client.8694 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 20 client.8694 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fac54c0 0x56385fa7dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 4 client.8694 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x56385fab31f0 con 0x56385fac54c0 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.001+0000 7f879d3f9640 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fac54c0 0x56385fa7dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.002+0000 7f8777fff640 10 client.8694 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.002+0000 7f879d3f9640 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fac54c0 0x56385fa7dfc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789b0431aff69069 server_cookie=39f47749d9b61823 in_seq=0 out_seq=0 2024-04-25T09:04:36.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f8777fff640 1 -- 172.21.15.5:0/4021858629 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56385fab31f0 con 0x56385fac54c0 2024-04-25T09:04:36.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f8777fff640 10 client.8694 handle_command_reply: tid=0 2024-04-25T09:04:36.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 client.8694 shutdown 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 msgr2=0x56385fb1abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fb1abb0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8788054df0 tx=0x7f8788088560 comp rx=0 tx=0).stop 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 shutdown_connections 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x56385fac54c0 0x56385fa7dfc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56385faa4ff0 0x56385fa7da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56385faa18b0 0x56385fb1abb0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f8777fff640 0 client.8694 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 --2- 172.21.15.5:0/4021858629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56385fa7f3a0 0x56385fae9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 >> 172.21.15.5:0/4021858629 conn(0x56385fa45050 msgr2=0x56385fab20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 shutdown_connections 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 1 -- 172.21.15.5:0/4021858629 wait complete. 2024-04-25T09:04:36.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.004+0000 7f87a2366740 20 client.8694 trim_cache size 0 max 16384 2024-04-25T09:04:36.996 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:36.996 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T09:04:36.996 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "b090e395-80ac-44e4-a1e5-ce1f6a62d642", 2024-04-25T09:04:36.996 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T09:04:36.996 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f877c06b4d0 msgr2=0x7f877c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f877c06b4d0 0x7f877c06d990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8794007fd0 tx=0x7f8794007de0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 msgr2=0x7f8798140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f8798140840 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f878800e9e0 tx=0x7f878800eea0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 shutdown_connections 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f877c06b4d0 0x7f877c06d990 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8798154e20 0x7f8798142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8798071040 0x7f8798140840 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 --2- 172.21.15.5:0/2995826547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f879806d320 0x7f8798143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 >> 172.21.15.5:0/2995826547 conn(0x7f87980668f0 msgr2=0x7f8798154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 shutdown_connections 2024-04-25T09:04:36.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.005+0000 7f879f65d640 1 -- 172.21.15.5:0/2995826547 wait complete. 2024-04-25T09:04:37.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:37.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub pause 2024-04-25T09:04:37.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.129+0000 7f826402a640 1 Processor -- start 2024-04-25T09:04:37.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.129+0000 7f826402a640 1 -- start start 2024-04-25T09:04:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f826402a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f825c0d4230 0x7f825c168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f826402a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c0b9b20 con 0x7f825c1614b0 2024-04-25T09:04:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f826402a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c0d2740 con 0x7f825c0b96e0 2024-04-25T09:04:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f826402a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0d2a20 con 0x7f825c0d4230 2024-04-25T09:04:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f8261dc6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f825c1614b0 0x7f825c0d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57932/0 (socket says 172.21.15.5:57932) 2024-04-25T09:04:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f8261dc6640 1 -- 172.21.15.5:0/4024573848 learned_addr learned my addr 172.21.15.5:0/4024573848 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f82625c7640 1 --2- 172.21.15.5:0/4024573848 >> v2:172.21.15.80:3300/0 conn(0x7f825c0d4230 0x7f825c168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f8260dc4640 1 -- 172.21.15.5:0/4024573848 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221172455 0 0) 0x7f825c0b9b20 con 0x7f825c1614b0 2024-04-25T09:04:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f8260dc4640 1 -- 172.21.15.5:0/4024573848 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8248003520 con 0x7f825c1614b0 2024-04-25T09:04:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f8260dc4640 1 -- 172.21.15.5:0/4024573848 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614226632 0 0) 0x7f825c0d2740 con 0x7f825c0b96e0 2024-04-25T09:04:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f8260dc4640 1 -- 172.21.15.5:0/4024573848 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f825c0b9b20 con 0x7f825c0b96e0 2024-04-25T09:04:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f82625c7640 1 -- 172.21.15.5:0/4024573848 >> v1:172.21.15.80:6789/0 conn(0x7f825c0b96e0 legacy=0x7f825c0d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f82625c7640 1 -- 172.21.15.5:0/4024573848 >> v1:172.21.15.5:6789/0 conn(0x7f825c1614b0 legacy=0x7f825c0d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.130+0000 7f82625c7640 1 -- 172.21.15.5:0/4024573848 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0d2d00 con 0x7f825c0d4230 2024-04-25T09:04:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.131+0000 7f82625c7640 1 --2- 172.21.15.5:0/4024573848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0d4230 0x7f825c168960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8254009d90 tx=0x7f825402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8748481b1804219 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.131+0000 7f8260dc4640 1 -- 172.21.15.5:0/4024573848 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254007740 con 0x7f825c0d4230 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.131+0000 7f8260dc4640 1 -- 172.21.15.5:0/4024573848 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82540078e0 con 0x7f825c0d4230 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.131+0000 7f8260dc4640 1 -- 172.21.15.5:0/4024573848 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254007cb0 con 0x7f825c0d4230 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.132+0000 7f826402a640 1 -- 172.21.15.5:0/4024573848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0d4230 msgr2=0x7f825c168960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.132+0000 7f826402a640 1 --2- 172.21.15.5:0/4024573848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0d4230 0x7f825c168960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8254009d90 tx=0x7f825402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.132+0000 7f826402a640 1 -- 172.21.15.5:0/4024573848 shutdown_connections 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.132+0000 7f826402a640 1 --2- 172.21.15.5:0/4024573848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0d4230 0x7f825c168960 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.132+0000 7f826402a640 1 -- 172.21.15.5:0/4024573848 >> 172.21.15.5:0/4024573848 conn(0x7f825c06b000 msgr2=0x7f825c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.132+0000 7f826402a640 1 -- 172.21.15.5:0/4024573848 shutdown_connections 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.132+0000 7f826402a640 1 -- 172.21.15.5:0/4024573848 wait complete. 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.133+0000 7f826402a640 1 Processor -- start 2024-04-25T09:04:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.133+0000 7f826402a640 1 -- start start 2024-04-25T09:04:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f826402a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0b96e0 0x7f825c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f826402a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f825c0d4230 0x7f825c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f826402a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f825c1614b0 0x7f825c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f826402a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0d37e0 con 0x7f825c0d4230 2024-04-25T09:04:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f826402a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0d32c0 con 0x7f825c0b96e0 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f826402a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0b7cd0 con 0x7f825c1614b0 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f825c0d4230 0x7f825c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f825c0d4230 0x7f825c15c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42088/0 (socket says 172.21.15.5:42088) 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 -- 172.21.15.5:0/1932271069 learned_addr learned my addr 172.21.15.5:0/1932271069 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f8261dc6640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0b96e0 0x7f825c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82625c7640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f825c1614b0 0x7f825c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 -- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f825c1614b0 msgr2=0x7f825c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f825c1614b0 0x7f825c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 -- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0b96e0 msgr2=0x7f825c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0b96e0 0x7f825c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 -- 172.21.15.5:0/1932271069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0b4290 con 0x7f825c0d4230 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f8261dc6640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0b96e0 0x7f825c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.134+0000 7f82615c5640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f825c0d4230 0x7f825c15c930 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c500 tx=0x7f824c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.135+0000 7f82527fc640 1 -- 172.21.15.5:0/1932271069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c0052d0 con 0x7f825c0d4230 2024-04-25T09:04:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.135+0000 7f82527fc640 1 -- 172.21.15.5:0/1932271069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c005490 con 0x7f825c0d4230 2024-04-25T09:04:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.135+0000 7f82527fc640 1 -- 172.21.15.5:0/1932271069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c012870 con 0x7f825c0d4230 2024-04-25T09:04:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.135+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c0b34d0 con 0x7f825c0d4230 2024-04-25T09:04:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.135+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c0b3a90 con 0x7f825c0d4230 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.136+0000 7f82527fc640 1 -- 172.21.15.5:0/1932271069 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f824c012a10 con 0x7f825c0d4230 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.137+0000 7f82527fc640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f824006b4d0 0x7f824006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.137+0000 7f82527fc640 1 -- 172.21.15.5:0/1932271069 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f824c089e80 con 0x7f825c0d4230 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.137+0000 7f8261dc6640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f824006b4d0 0x7f824006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.137+0000 7f8261dc6640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f824006b4d0 0x7f824006d990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f82580011e0 tx=0x7f8258007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 Processor -- start 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 -- start start 2024-04-25T09:04:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637be6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637be5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637c0fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562637b47b90 con 0x562637be4ca0 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562637af0e40 con 0x562637c0f760 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.138+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x562637b43c30 con 0x562637c21370 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637be6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637be6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42104/0 (socket says 172.21.15.5:42104) 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 -- 172.21.15.5:0/3340334523 learned_addr learned my addr 172.21.15.5:0/3340334523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f82625c7640 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637c0fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f82615c5640 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637be5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 -- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 msgr2=0x562637be5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637be5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 -- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 msgr2=0x562637c0fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637c0fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 -- 172.21.15.5:0/3340334523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626379267d0 con 0x562637be4ca0 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f82625c7640 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637c0fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f82615c5640 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637be5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637be6e00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8258001be0 tx=0x7f8258012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777bdc1a6b70f1f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f823f7fe640 1 -- 172.21.15.5:0/3340334523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258026070 con 0x562637be4ca0 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f823f7fe640 1 -- 172.21.15.5:0/3340334523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825801b070 con 0x562637be4ca0 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.139+0000 7f823f7fe640 1 -- 172.21.15.5:0/3340334523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258014e60 con 0x562637be4ca0 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 -- 172.21.15.5:0/3340334523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 msgr2=0x562637be6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637be6e00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8258001be0 tx=0x7f8258012000 comp rx=0 tx=0).stop 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 -- 172.21.15.5:0/3340334523 shutdown_connections 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637c0fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637be5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 --2- 172.21.15.5:0/3340334523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637be6e00 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 -- 172.21.15.5:0/3340334523 >> 172.21.15.5:0/3340334523 conn(0x562637bac870 msgr2=0x562637c2a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 -- 172.21.15.5:0/3340334523 shutdown_connections 2024-04-25T09:04:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 -- 172.21.15.5:0/3340334523 wait complete. 2024-04-25T09:04:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.140+0000 7f8266e06740 1 -- start start 2024-04-25T09:04:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.141+0000 7f8266e06740 1 Processor -- start 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637be4ca0 0x562637c127b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637bfe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562637b043e0 con 0x562637c0f760 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562637c0d2b0 con 0x562637be4ca0 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x562637bfc8c0 con 0x562637c21370 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 10 client.0 _ll_register_callbacks cb 0x562637b03db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637bfe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637bfe500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42118/0 (socket says 172.21.15.5:42118) 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 -- 172.21.15.5:0/3104756810 learned_addr learned my addr 172.21.15.5:0/3104756810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82625c7640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637be4ca0 0x562637c127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 -- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 msgr2=0x562637bfbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 -- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637be4ca0 msgr2=0x562637c127b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637be4ca0 0x562637c127b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 -- 172.21.15.5:0/3104756810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56263781c0f0 con 0x562637c0f760 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82625c7640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f82615c5640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637bfe500 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f824c058520 tx=0x7f824c05c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec985856595409 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f823cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f823cff9640 1 -- 172.21.15.5:0/3104756810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c0771a0 con 0x562637c0f760 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f823cff9640 1 -- 172.21.15.5:0/3104756810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f824c05c170 con 0x562637c0f760 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f825801b070 con 0x562637c0f760 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f823cff9640 1 -- 172.21.15.5:0/3104756810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f824c05c370 con 0x562637c0f760 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 10 client.8706 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.142+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x562637986f60 con 0x562637c0f760 2024-04-25T09:04:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f823cff9640 1 -- 172.21.15.5:0/3104756810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825801b070 con 0x562637c0f760 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f823cff9640 1 -- 172.21.15.5:0/3104756810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f824c057a30 con 0x562637c0f760 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8266e06740 10 client.8706 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8266e06740 10 client.8706 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8266e06740 20 client.8706 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8266e06740 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c2a790 0x562637c24b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8266e06740 4 client.8706 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562637b550d0 con 0x562637c2a790 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c2a790 0x562637c24b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c2a790 0x562637c24b80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10c26d60562fe96 server_cookie=905da5ed26fc9d22 in_seq=0 out_seq=0 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.143+0000 7f823cff9640 10 client.8706 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f823cff9640 1 -- 172.21.15.5:0/3104756810 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562637b550d0 con 0x562637c2a790 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f823cff9640 10 client.8706 handle_command_reply: tid=0 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 client.8706 shutdown 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 msgr2=0x562637bfe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637bfe500 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f824c058520 tx=0x7f824c05c7c0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 shutdown_connections 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c2a790 0x562637c24b80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637bfe500 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f823cff9640 0 client.8706 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 --2- 172.21.15.5:0/3104756810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637be4ca0 0x562637c127b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 >> 172.21.15.5:0/3104756810 conn(0x562637bac870 msgr2=0x562637c2dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 shutdown_connections 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 1 -- 172.21.15.5:0/3104756810 wait complete. 2024-04-25T09:04:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.144+0000 7f8266e06740 20 client.8706 trim_cache size 0 max 16384 2024-04-25T09:04:37.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.159+0000 7f8266e06740 1 Processor -- start 2024-04-25T09:04:37.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.159+0000 7f8266e06740 1 -- start start 2024-04-25T09:04:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8266e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637c26170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637bfda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8266e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1ffee0 con 0x562637be4ca0 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0b5a50 con 0x562637c0f760 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1f7ac0 con 0x562637c21370 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637c26170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637c26170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42122/0 (socket says 172.21.15.5:42122) 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 -- 172.21.15.5:0/3152583961 learned_addr learned my addr 172.21.15.5:0/3152583961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f82615c5640 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637bfda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 -- 172.21.15.5:0/3152583961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 msgr2=0x562637bfdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 -- 172.21.15.5:0/3152583961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 msgr2=0x562637bfda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637bfda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 -- 172.21.15.5:0/3152583961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626377f51b0 con 0x562637be4ca0 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f8261dc6640 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637c26170 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f8258001bb0 tx=0x7f8258014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d2b76aaac6dd33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f823effd640 1 -- 172.21.15.5:0/3152583961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258026040 con 0x562637be4ca0 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f823effd640 1 -- 172.21.15.5:0/3152583961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825801b040 con 0x562637be4ca0 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.160+0000 7f823effd640 1 -- 172.21.15.5:0/3152583961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580049e0 con 0x562637be4ca0 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 -- 172.21.15.5:0/3152583961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 msgr2=0x562637c26170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637c26170 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f8258001bb0 tx=0x7f8258014000 comp rx=0 tx=0).stop 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 -- 172.21.15.5:0/3152583961 shutdown_connections 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637c21370 0x562637bfdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c0f760 0x562637bfda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 --2- 172.21.15.5:0/3152583961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637be4ca0 0x562637c26170 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 -- 172.21.15.5:0/3152583961 >> 172.21.15.5:0/3152583961 conn(0x562637bac870 msgr2=0x562637c4d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 -- 172.21.15.5:0/3152583961 shutdown_connections 2024-04-25T09:04:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.161+0000 7f8266e06740 1 -- 172.21.15.5:0/3152583961 wait complete. 2024-04-25T09:04:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 -- start start 2024-04-25T09:04:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 Processor -- start 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637be4ca0 0x562637c29ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637c0bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c21370 0x562637c0c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562637bfb640 con 0x562637c0f760 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0b5450 con 0x562637c21370 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x562637c217e0 con 0x562637be4ca0 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.162+0000 7f8266e06740 10 client.0 _ll_register_callbacks cb 0x7f824c0581a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637c0bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637c0bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42138/0 (socket says 172.21.15.5:42138) 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 -- 172.21.15.5:0/2176651033 learned_addr learned my addr 172.21.15.5:0/2176651033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82625c7640 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c21370 0x562637c0c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f8261dc6640 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637be4ca0 0x562637c29ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 -- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637be4ca0 msgr2=0x562637c29ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637be4ca0 0x562637c29ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 -- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c21370 msgr2=0x562637c0c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c21370 0x562637c0c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 -- 172.21.15.5:0/2176651033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562637c0fe90 con 0x562637c0f760 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f82615c5640 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637c0bf60 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f824c0580b0 tx=0x7f824c088230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d930215669c5a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f823cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f823cff9640 1 -- 172.21.15.5:0/2176651033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c0771a0 con 0x562637c0f760 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f823cff9640 1 -- 172.21.15.5:0/2176651033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f824c054540 con 0x562637c0f760 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f825801b040 con 0x562637c0f760 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f823cff9640 1 -- 172.21.15.5:0/2176651033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f824c05c680 con 0x562637c0f760 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f8266e06740 10 client.8712 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x562637c0fe90 con 0x562637c0f760 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.163+0000 7f823cff9640 1 -- 172.21.15.5:0/2176651033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825801b040 con 0x562637c0f760 2024-04-25T09:04:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f823cff9640 1 -- 172.21.15.5:0/2176651033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f824c0574a0 con 0x562637c0f760 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 10 client.8712 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 10 client.8712 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 20 client.8712 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c263b0 0x562637c20610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 4 client.8712 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x562637b4f420 con 0x562637c263b0 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8261dc6640 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c263b0 0x562637c20610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f823cff9640 10 client.8712 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8261dc6640 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c263b0 0x562637c20610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e7b0e1ca7cd076e server_cookie=c6e024212f4ab106 in_seq=0 out_seq=0 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f823cff9640 1 -- 172.21.15.5:0/2176651033 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x562637b4f420 con 0x562637c263b0 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f823cff9640 10 client.8712 handle_command_reply: tid=0 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 client.8712 shutdown 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 msgr2=0x562637c0bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637c0bf60 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f824c0580b0 tx=0x7f824c088230 comp rx=0 tx=0).stop 2024-04-25T09:04:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 shutdown_connections 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x562637c263b0 0x562637c20610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562637c21370 0x562637c0c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562637c0f760 0x562637c0bf60 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 --2- 172.21.15.5:0/2176651033 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x562637be4ca0 0x562637c29ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f823cff9640 0 client.8712 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.164+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 >> 172.21.15.5:0/2176651033 conn(0x562637bac870 msgr2=0x562637c11160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 shutdown_connections 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f8266e06740 1 -- 172.21.15.5:0/2176651033 wait complete. 2024-04-25T09:04:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f8266e06740 20 client.8712 trim_cache size 0 max 16384 2024-04-25T09:04:37.159 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:37.159 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T09:04:37.159 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f824006b4d0 msgr2=0x7f824006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f824006b4d0 0x7f824006d990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f82580011e0 tx=0x7f8258007d30 comp rx=0 tx=0).stop 2024-04-25T09:04:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f825c0d4230 msgr2=0x7f825c15c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f825c0d4230 0x7f825c15c930 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c500 tx=0x7f824c00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 shutdown_connections 2024-04-25T09:04:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f824006b4d0 0x7f824006d990 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f825c1614b0 0x7f825c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f825c0d4230 0x7f825c15c930 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 --2- 172.21.15.5:0/1932271069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f825c0b96e0 0x7f825c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 >> 172.21.15.5:0/1932271069 conn(0x7f825c06b000 msgr2=0x7f825c067040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 shutdown_connections 2024-04-25T09:04:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.165+0000 7f826402a640 1 -- 172.21.15.5:0/1932271069 wait complete. 2024-04-25T09:04:37.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:37.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T09:04:37.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.278+0000 7f8eddd9e640 1 Processor -- start 2024-04-25T09:04:37.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.278+0000 7f8eddd9e640 1 -- start start 2024-04-25T09:04:37.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.279+0000 7f8eddd9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ed815e070 0x7f8ed80b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.279+0000 7f8eddd9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed80668f0 0x7f8ed8066d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.279+0000 7f8eddd9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed815e700 con 0x7f8ed8158100 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.279+0000 7f8eddd9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80672a0 con 0x7f8ed815e070 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.279+0000 7f8eddd9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b3d30 con 0x7f8ed80668f0 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ed815e070 0x7f8ed80b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8edd59d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed80668f0 0x7f8ed8066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ed815e070 0x7f8ed80b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:39446/0 (socket says 172.21.15.5:39446) 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8edcd9c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8ed8158100 0x7f8ed806d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:48848/0 (socket says 172.21.15.5:48848) 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed7fff640 1 -- 172.21.15.5:0/2798064276 learned_addr learned my addr 172.21.15.5:0/2798064276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed7fff640 1 -- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed80668f0 msgr2=0x7f8ed8066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed80668f0 0x7f8ed8066d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed7fff640 1 -- 172.21.15.5:0/2798064276 >> v1:172.21.15.80:6789/0 conn(0x7f8ed8158100 legacy=0x7f8ed806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed77fe640 1 -- 172.21.15.5:0/2798064276 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944317446 0 0) 0x7f8ed815e700 con 0x7f8ed8158100 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8ed7fff640 1 -- 172.21.15.5:0/2798064276 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed815e9e0 con 0x7f8ed815e070 2024-04-25T09:04:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.280+0000 7f8edd59d640 1 --2- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed80668f0 0x7f8ed8066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed815e070 0x7f8ed80b37f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009870 tx=0x7f8ecc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c59263fd05933d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8ed77fe640 1 -- 172.21.15.5:0/2798064276 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc037070 con 0x7f8ed815e070 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8ed77fe640 1 -- 172.21.15.5:0/2798064276 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc032440 con 0x7f8ed815e070 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8ed77fe640 1 -- 172.21.15.5:0/2798064276 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc032810 con 0x7f8ed815e070 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 -- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed815e070 msgr2=0x7f8ed80b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed815e070 0x7f8ed80b37f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009870 tx=0x7f8ecc02a270 comp rx=0 tx=0).stop 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 -- 172.21.15.5:0/2798064276 shutdown_connections 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed80668f0 0x7f8ed8066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/2798064276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed815e070 0x7f8ed80b37f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 -- 172.21.15.5:0/2798064276 >> 172.21.15.5:0/2798064276 conn(0x7f8ed8073fb0 msgr2=0x7f8ed806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 -- 172.21.15.5:0/2798064276 shutdown_connections 2024-04-25T09:04:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.281+0000 7f8eddd9e640 1 -- 172.21.15.5:0/2798064276 wait complete. 2024-04-25T09:04:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.283+0000 7f8eddd9e640 1 Processor -- start 2024-04-25T09:04:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.283+0000 7f8eddd9e640 1 -- start start 2024-04-25T09:04:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.283+0000 7f8eddd9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed80668f0 0x7f8ed8146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.283+0000 7f8eddd9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed8158100 0x7f8ed80ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8eddd9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed815e070 0x7f8ed815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8eddd9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80d0440 con 0x7f8ed80668f0 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8eddd9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed815efa0 con 0x7f8ed8158100 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8eddd9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81584e0 con 0x7f8ed815e070 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed80668f0 0x7f8ed8146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed80668f0 0x7f8ed8146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42154/0 (socket says 172.21.15.5:42154) 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3794541521 learned_addr learned my addr 172.21.15.5:0/3794541521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed8158100 0x7f8ed80ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8edd59d640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed815e070 0x7f8ed815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed7fff640 1 -- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed815e070 msgr2=0x7f8ed815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed815e070 0x7f8ed815b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed7fff640 1 -- 172.21.15.5:0/3794541521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed80668f0 msgr2=0x7f8ed8146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed80668f0 0x7f8ed8146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed7fff640 1 -- 172.21.15.5:0/3794541521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80cea40 con 0x7f8ed8158100 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed80668f0 0x7f8ed8146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed8158100 0x7f8ed80ce140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc031000 tx=0x7f8ecc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed57fa640 1 -- 172.21.15.5:0/3794541521 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc037040 con 0x7f8ed8158100 2024-04-25T09:04:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8ed57fa640 1 -- 172.21.15.5:0/3794541521 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc004020 con 0x7f8ed8158100 2024-04-25T09:04:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.284+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80ced20 con 0x7f8ed8158100 2024-04-25T09:04:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.285+0000 7f8ed57fa640 1 -- 172.21.15.5:0/3794541521 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc004410 con 0x7f8ed8158100 2024-04-25T09:04:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.285+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed80cf2e0 con 0x7f8ed8158100 2024-04-25T09:04:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.286+0000 7f8ed57fa640 1 -- 172.21.15.5:0/3794541521 <== mon.1 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ecc03a070 con 0x7f8ed8158100 2024-04-25T09:04:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.287+0000 7f8ed57fa640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ec406b4d0 0x7f8ec406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.287+0000 7f8ed57fa640 1 -- 172.21.15.5:0/3794541521 <== mon.1 v2:172.21.15.80:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8ecc0aa610 con 0x7f8ed8158100 2024-04-25T09:04:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.287+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ec406b4d0 0x7f8ec406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.287+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ec406b4d0 0x7f8ec406d990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000f60 tx=0x7f8ec8007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 Processor -- start 2024-04-25T09:04:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 -- start start 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26be530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26bea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe268e980 0x55bbe2692190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe25f7da0 con 0x55bbe26bbd20 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe25a0b80 con 0x55bbe26bc100 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbe25f3e40 con 0x55bbe268e980 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26be530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42166/0 (socket says 172.21.15.5:42166) 2024-04-25T09:04:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8edcd9c640 1 -- 172.21.15.5:0/184460519 learned_addr learned my addr 172.21.15.5:0/184460519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.288+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8edd59d640 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe268e980 0x55bbe2692190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8edcd9c640 1 -- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe268e980 msgr2=0x55bbe2692190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe268e980 0x55bbe2692190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8edcd9c640 1 -- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 msgr2=0x55bbe26bea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26bea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8edcd9c640 1 -- 172.21.15.5:0/184460519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbe25aaf10 con 0x55bbe26bbd20 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26bea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26be530 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8004eb0 tx=0x7f8ec8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57d91c8d7e91885 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8ebe7fc640 1 -- 172.21.15.5:0/184460519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8026070 con 0x55bbe26bbd20 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8ebe7fc640 1 -- 172.21.15.5:0/184460519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8012350 con 0x55bbe26bbd20 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.289+0000 7f8ebe7fc640 1 -- 172.21.15.5:0/184460519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8012740 con 0x55bbe26bbd20 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/184460519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 msgr2=0x55bbe26be530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26be530 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8004eb0 tx=0x7f8ec8013000 comp rx=0 tx=0).stop 2024-04-25T09:04:37.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/184460519 shutdown_connections 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe268e980 0x55bbe2692190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26bea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/184460519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26be530 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/184460519 >> 172.21.15.5:0/184460519 conn(0x55bbe2690bf0 msgr2=0x55bbe26d9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/184460519 shutdown_connections 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/184460519 wait complete. 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 -- start start 2024-04-25T09:04:37.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.290+0000 7f8ee1ddd740 1 Processor -- start 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 0x55bbe26c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26b9c70 0x55bbe26dce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe2693da0 con 0x55bbe26bbd20 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe25964b0 con 0x55bbe26b9c70 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbe2694080 con 0x55bbe26bc100 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ee1ddd740 10 client.0 _ll_register_callbacks cb 0x55bbe25d6180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42174/0 (socket says 172.21.15.5:42174) 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3847372819 learned_addr learned my addr 172.21.15.5:0/3847372819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8edd59d640 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26b9c70 0x55bbe26dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.291+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 0x55bbe26c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 msgr2=0x55bbe26c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 0x55bbe26c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26b9c70 msgr2=0x55bbe26dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26b9c70 0x55bbe26dce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3847372819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbe23d67d0 con 0x55bbe26bbd20 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26aae50 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x55bbe2696280 tx=0x7f8ec8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c9dddd64e59233 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8eb77fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3847372819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8026040 con 0x55bbe26bbd20 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3847372819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8ec8012c60 con 0x55bbe26bbd20 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ec8012350 con 0x55bbe26bbd20 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3847372819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec8038050 con 0x55bbe26bbd20 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8ee1ddd740 10 client.8721 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55bbe230c3f0 con 0x55bbe26bbd20 2024-04-25T09:04:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3847372819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8012350 con 0x55bbe26bbd20 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3847372819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ec803b020 con 0x55bbe26bbd20 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8ee1ddd740 10 client.8721 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8ee1ddd740 10 client.8721 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.292+0000 7f8ee1ddd740 20 client.8721 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.293+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe26b9080 0x55bbe26b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.293+0000 7f8ee1ddd740 4 client.8721 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.293+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbe26052e0 con 0x55bbe26b9080 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.293+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe26b9080 0x55bbe26b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.293+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe26b9080 0x55bbe26b9490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a80c585ee4dfdc1 server_cookie=d9b7a84eea3a83a6 in_seq=0 out_seq=0 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.293+0000 7f8eb77fe640 10 client.8721 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3847372819 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bbe26052e0 con 0x55bbe26b9080 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8eb77fe640 10 client.8721 handle_command_reply: tid=0 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 client.8721 shutdown 2024-04-25T09:04:37.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 msgr2=0x55bbe26aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26aae50 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x55bbe2696280 tx=0x7f8ec8000ed0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 shutdown_connections 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe26b9080 0x55bbe26b9490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26b9c70 0x55bbe26dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 0x55bbe26c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8eb77fe640 0 client.8721 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3847372819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26bbd20 0x55bbe26aae50 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 >> 172.21.15.5:0/3847372819 conn(0x55bbe268e980 msgr2=0x55bbe26be4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 shutdown_connections 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3847372819 wait complete. 2024-04-25T09:04:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.294+0000 7f8ee1ddd740 20 client.8721 trim_cache size 0 max 16384 2024-04-25T09:04:37.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.309+0000 7f8ee1ddd740 1 Processor -- start 2024-04-25T09:04:37.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.309+0000 7f8ee1ddd740 1 -- start start 2024-04-25T09:04:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe268f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bbd20 0x55bbe268ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 0x55bbe26d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81ffb60 con 0x55bbe26b9c70 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81fed70 con 0x55bbe26bbd20 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8160060 con 0x55bbe26bc100 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe268f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe268f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42176/0 (socket says 172.21.15.5:42176) 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 -- 172.21.15.5:0/463149958 learned_addr learned my addr 172.21.15.5:0/463149958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 -- 172.21.15.5:0/463149958 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 msgr2=0x55bbe26d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/463149958 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 0x55bbe26d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 -- 172.21.15.5:0/463149958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bbd20 msgr2=0x55bbe268ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/463149958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bbd20 0x55bbe268ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 -- 172.21.15.5:0/463149958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbe22cc0f0 con 0x55bbe26b9c70 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/463149958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe268f610 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80077e0 tx=0x7f8ec802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d2713060c34e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ebdffb640 1 -- 172.21.15.5:0/463149958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8041030 con 0x55bbe26b9c70 2024-04-25T09:04:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ebdffb640 1 -- 172.21.15.5:0/463149958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8030070 con 0x55bbe26b9c70 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.310+0000 7f8ebdffb640 1 -- 172.21.15.5:0/463149958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8026040 con 0x55bbe26b9c70 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/463149958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 msgr2=0x55bbe268f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/463149958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe268f610 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80077e0 tx=0x7f8ec802a000 comp rx=0 tx=0).stop 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/463149958 shutdown_connections 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/463149958 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bc100 0x55bbe26d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/463149958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bbd20 0x55bbe268ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/463149958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe268f610 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/463149958 >> 172.21.15.5:0/463149958 conn(0x55bbe268e980 msgr2=0x55bbe26b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/463149958 shutdown_connections 2024-04-25T09:04:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/463149958 wait complete. 2024-04-25T09:04:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.311+0000 7f8ee1ddd740 1 -- start start 2024-04-25T09:04:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 1 Processor -- start 2024-04-25T09:04:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe26d4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bbd20 0x55bbe26d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26d6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbe26bf8c0 con 0x55bbe26b9c70 2024-04-25T09:04:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8160660 con 0x55bbe26bc100 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbe26aa830 con 0x55bbe26bbd20 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8ee1ddd740 10 client.0 _ll_register_callbacks cb 0x7f8ec80019e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.312+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe26d4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe26d4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42190/0 (socket says 172.21.15.5:42190) 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3661992448 learned_addr learned my addr 172.21.15.5:0/3661992448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bbd20 0x55bbe26d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edd59d640 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bbd20 msgr2=0x55bbe26d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bbd20 0x55bbe26d5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 msgr2=0x55bbe26d6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26d6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 -- 172.21.15.5:0/3661992448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbe26d4c50 con 0x55bbe26b9c70 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8edcd9c640 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe26d4710 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80077e0 tx=0x7f8ec8009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73230917b5c9a749 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8eb77fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3661992448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8026040 con 0x55bbe26b9c70 2024-04-25T09:04:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3661992448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8ec8021970 con 0x55bbe26b9c70 2024-04-25T09:04:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ec8030070 con 0x55bbe26b9c70 2024-04-25T09:04:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3661992448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec8052050 con 0x55bbe26b9c70 2024-04-25T09:04:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8ee1ddd740 10 client.8727 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55bbe2692ca0 con 0x55bbe26b9c70 2024-04-25T09:04:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.313+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3661992448 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8030070 con 0x55bbe26b9c70 2024-04-25T09:04:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3661992448 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ec8055020 con 0x55bbe26b9c70 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 10 client.8727 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 10 client.8727 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 20 client.8727 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe272cda0 0x55bbe26c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 4 client.8727 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bbe25ff630 con 0x55bbe272cda0 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe272cda0 0x55bbe26c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ed7fff640 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe272cda0 0x55bbe26c09c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47f199d76d910f30 server_cookie=aa5448015d3850d7 in_seq=0 out_seq=0 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8eb77fe640 10 client.8727 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8eb77fe640 1 -- 172.21.15.5:0/3661992448 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55bbe25ff630 con 0x55bbe272cda0 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8eb77fe640 10 client.8727 handle_command_reply: tid=0 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 client.8727 shutdown 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 msgr2=0x55bbe26d4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe26d4710 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80077e0 tx=0x7f8ec8009030 comp rx=0 tx=0).stop 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 shutdown_connections 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x55bbe272cda0 0x55bbe26c09c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bbe26bc100 0x55bbe26d6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8eb77fe640 0 client.8727 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55bbe26bbd20 0x55bbe26d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 --2- 172.21.15.5:0/3661992448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbe26b9c70 0x55bbe26d4710 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.314+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 >> 172.21.15.5:0/3661992448 conn(0x55bbe268e980 msgr2=0x55bbe2693fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 shutdown_connections 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8ee1ddd740 1 -- 172.21.15.5:0/3661992448 wait complete. 2024-04-25T09:04:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8ee1ddd740 20 client.8727 trim_cache size 0 max 16384 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: "b090e395-80ac-44e4-a1e5-ce1f6a62d642": { 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "b090e395-80ac-44e4-a1e5-ce1f6a62d642", 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ec406b4d0 msgr2=0x7f8ec406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ec406b4d0 0x7f8ec406d990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000f60 tx=0x7f8ec8007e10 comp rx=0 tx=0).stop 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed8158100 msgr2=0x7f8ed80ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed8158100 0x7f8ed80ce140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc031000 tx=0x7f8ecc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 shutdown_connections 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8ec406b4d0 0x7f8ec406d990 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ed815e070 0x7f8ed815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ed8158100 0x7f8ed80ce140 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 --2- 172.21.15.5:0/3794541521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ed80668f0 0x7f8ed8146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 >> 172.21.15.5:0/3794541521 conn(0x7f8ed8073fb0 msgr2=0x7f8ed806db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 shutdown_connections 2024-04-25T09:04:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.315+0000 7f8eddd9e640 1 -- 172.21.15.5:0/3794541521 wait complete. 2024-04-25T09:04:37.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.426+0000 7f2613ec4640 1 Processor -- start 2024-04-25T09:04:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.427+0000 7f2613ec4640 1 -- start start 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.427+0000 7f2613ec4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f260c154f10 0x7f260c0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.427+0000 7f2613ec4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f260c0cfc90 0x7f260c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.427+0000 7f2613ec4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0b3f30 con 0x7f260c15bbd0 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.427+0000 7f2613ec4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c15b0f0 con 0x7f260c0cfc90 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.427+0000 7f2613ec4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c15b3d0 con 0x7f260c154f10 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2612461640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f260c0cfc90 0x7f260c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f261145f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f260c15bbd0 0x7f260c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57944/0 (socket says 172.21.15.5:57944) 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f261145f640 1 -- 172.21.15.5:0/564084491 learned_addr learned my addr 172.21.15.5:0/564084491 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2611c60640 1 --2- 172.21.15.5:0/564084491 >> v2:172.21.15.80:3300/0 conn(0x7f260c154f10 0x7f260c0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2612461640 1 -- 172.21.15.5:0/564084491 >> v2:172.21.15.80:3300/0 conn(0x7f260c154f10 msgr2=0x7f260c0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2612461640 1 --2- 172.21.15.5:0/564084491 >> v2:172.21.15.80:3300/0 conn(0x7f260c154f10 0x7f260c0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2612461640 1 -- 172.21.15.5:0/564084491 >> v1:172.21.15.5:6789/0 conn(0x7f260c15bbd0 legacy=0x7f260c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2612461640 1 -- 172.21.15.5:0/564084491 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c1552f0 con 0x7f260c0cfc90 2024-04-25T09:04:37.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2610c5e640 1 -- 172.21.15.5:0/564084491 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020450675 0 0) 0x7f260c0b3f30 con 0x7f260c15bbd0 2024-04-25T09:04:37.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.428+0000 7f2611c60640 1 --2- 172.21.15.5:0/564084491 >> v2:172.21.15.80:3300/0 conn(0x7f260c154f10 0x7f260c0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2612461640 1 --2- 172.21.15.5:0/564084491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c0cfc90 0x7f260c070f50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f260c0b2610 tx=0x7f260402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55ba5a8324697f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2610c5e640 1 -- 172.21.15.5:0/564084491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604007740 con 0x7f260c0cfc90 2024-04-25T09:04:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2610c5e640 1 -- 172.21.15.5:0/564084491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26040078e0 con 0x7f260c0cfc90 2024-04-25T09:04:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2610c5e640 1 -- 172.21.15.5:0/564084491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604007cb0 con 0x7f260c0cfc90 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2613ec4640 1 -- 172.21.15.5:0/564084491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c0cfc90 msgr2=0x7f260c070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2613ec4640 1 --2- 172.21.15.5:0/564084491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c0cfc90 0x7f260c070f50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f260c0b2610 tx=0x7f260402a5f0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2613ec4640 1 -- 172.21.15.5:0/564084491 shutdown_connections 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2613ec4640 1 --2- 172.21.15.5:0/564084491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c0cfc90 0x7f260c070f50 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2613ec4640 1 --2- 172.21.15.5:0/564084491 >> v2:172.21.15.80:3300/0 conn(0x7f260c154f10 0x7f260c0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.429+0000 7f2613ec4640 1 -- 172.21.15.5:0/564084491 >> 172.21.15.5:0/564084491 conn(0x7f260c0668f0 msgr2=0x7f260c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.430+0000 7f2613ec4640 1 -- 172.21.15.5:0/564084491 shutdown_connections 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.430+0000 7f2613ec4640 1 -- 172.21.15.5:0/564084491 wait complete. 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 Processor -- start 2024-04-25T09:04:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 -- start start 2024-04-25T09:04:37.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f260c0cfc90 0x7f260c1f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c154f10 0x7f260c1398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f260c15bbd0 0x7f260c13c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0b3b30 con 0x7f260c154f10 2024-04-25T09:04:37.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0b39b0 con 0x7f260c0cfc90 2024-04-25T09:04:37.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.431+0000 7f2613ec4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0b3cb0 con 0x7f260c15bbd0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c154f10 0x7f260c1398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c154f10 0x7f260c1398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42210/0 (socket says 172.21.15.5:42210) 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 -- 172.21.15.5:0/2267883784 learned_addr learned my addr 172.21.15.5:0/2267883784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f2611c60640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f260c0cfc90 0x7f260c1f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f2612461640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f260c15bbd0 0x7f260c13c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 -- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f260c15bbd0 msgr2=0x7f260c13c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f260c15bbd0 0x7f260c13c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 -- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f260c0cfc90 msgr2=0x7f260c1f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f260c0cfc90 0x7f260c1f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 -- 172.21.15.5:0/2267883784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c1f3cc0 con 0x7f260c154f10 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f261145f640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c154f10 0x7f260c1398c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e690 tx=0x7f25fc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f26027fc640 1 -- 172.21.15.5:0/2267883784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0070d0 con 0x7f260c154f10 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f26027fc640 1 -- 172.21.15.5:0/2267883784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc016020 con 0x7f260c154f10 2024-04-25T09:04:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c14aa30 con 0x7f260c154f10 2024-04-25T09:04:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f26027fc640 1 -- 172.21.15.5:0/2267883784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0074d0 con 0x7f260c154f10 2024-04-25T09:04:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.432+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c13d020 con 0x7f260c154f10 2024-04-25T09:04:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.433+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c04ef20 con 0x7f260c154f10 2024-04-25T09:04:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.434+0000 7f26027fc640 1 -- 172.21.15.5:0/2267883784 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f25fc0016d0 con 0x7f260c154f10 2024-04-25T09:04:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.434+0000 7f26027fc640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25f006b4d0 0x7f25f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.434+0000 7f26027fc640 1 -- 172.21.15.5:0/2267883784 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f25fc08c250 con 0x7f260c154f10 2024-04-25T09:04:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.434+0000 7f2611c60640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25f006b4d0 0x7f25f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.435+0000 7f2611c60640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25f006b4d0 0x7f25f006d990 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2608009560 tx=0x7f2608009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.438+0000 7f26027fc640 1 -- 172.21.15.5:0/2267883784 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25fc020030 con 0x7f260c154f10 2024-04-25T09:04:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.654+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f260c072270 con 0x7f260c154f10 2024-04-25T09:04:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.654+0000 7f26027fc640 1 -- 172.21.15.5:0/2267883784 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f25fc05ab90 con 0x7f260c154f10 2024-04-25T09:04:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:37.642 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25f006b4d0 msgr2=0x7f25f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25f006b4d0 0x7f25f006d990 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2608009560 tx=0x7f2608009190 comp rx=0 tx=0).stop 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c154f10 msgr2=0x7f260c1398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c154f10 0x7f260c1398c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e690 tx=0x7f25fc00eb50 comp rx=0 tx=0).stop 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 shutdown_connections 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25f006b4d0 0x7f25f006d990 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f260c15bbd0 0x7f260c13c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f260c154f10 0x7f260c1398c0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 --2- 172.21.15.5:0/2267883784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f260c0cfc90 0x7f260c1f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 >> 172.21.15.5:0/2267883784 conn(0x7f260c0668f0 msgr2=0x7f260c0717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 shutdown_connections 2024-04-25T09:04:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.656+0000 7f2613ec4640 1 -- 172.21.15.5:0/2267883784 wait complete. 2024-04-25T09:04:37.654 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:37.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:37.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.767+0000 7fd90937e640 1 Processor -- start 2024-04-25T09:04:37.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.767+0000 7fd90937e640 1 -- start start 2024-04-25T09:04:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd90937e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd90415e0a0 0x7fd9040d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd90937e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040d3990 0x7fd9040d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd90937e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9040ce5e0 0x7fd9040cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd90937e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9040d4330 con 0x7fd9040ce5e0 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd90937e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9040b29c0 con 0x7fd90415e0a0 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd90937e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9040d2080 con 0x7fd9040d3990 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9040ce5e0 0x7fd9040cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9040ce5e0 0x7fd9040cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42226/0 (socket says 172.21.15.5:42226) 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 -- 172.21.15.5:0/3314293647 learned_addr learned my addr 172.21.15.5:0/3314293647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd902ffd640 1 --2- 172.21.15.5:0/3314293647 >> v2:172.21.15.80:3300/0 conn(0x7fd90415e0a0 0x7fd9040d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9027fc640 1 --2- 172.21.15.5:0/3314293647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040d3990 0x7fd9040d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 -- 172.21.15.5:0/3314293647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040d3990 msgr2=0x7fd9040d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 --2- 172.21.15.5:0/3314293647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040d3990 0x7fd9040d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 -- 172.21.15.5:0/3314293647 >> v2:172.21.15.80:3300/0 conn(0x7fd90415e0a0 msgr2=0x7fd9040d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 --2- 172.21.15.5:0/3314293647 >> v2:172.21.15.80:3300/0 conn(0x7fd90415e0a0 0x7fd9040d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.768+0000 7fd9037fe640 1 -- 172.21.15.5:0/3314293647 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9040d2360 con 0x7fd9040ce5e0 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.769+0000 7fd9037fe640 1 --2- 172.21.15.5:0/3314293647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040ce5e0 0x7fd9040cea70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd9040b6680 tx=0x7fd8fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb3f261370c632a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.769+0000 7fd901ffb640 1 -- 172.21.15.5:0/3314293647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc036070 con 0x7fd9040ce5e0 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.769+0000 7fd901ffb640 1 -- 172.21.15.5:0/3314293647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc031600 con 0x7fd9040ce5e0 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.769+0000 7fd901ffb640 1 -- 172.21.15.5:0/3314293647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0319d0 con 0x7fd9040ce5e0 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 -- 172.21.15.5:0/3314293647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040ce5e0 msgr2=0x7fd9040cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 --2- 172.21.15.5:0/3314293647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040ce5e0 0x7fd9040cea70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd9040b6680 tx=0x7fd8fc02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 -- 172.21.15.5:0/3314293647 shutdown_connections 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 --2- 172.21.15.5:0/3314293647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040ce5e0 0x7fd9040cea70 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 --2- 172.21.15.5:0/3314293647 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040d3990 0x7fd9040d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 --2- 172.21.15.5:0/3314293647 >> v2:172.21.15.80:3300/0 conn(0x7fd90415e0a0 0x7fd9040d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 -- 172.21.15.5:0/3314293647 >> 172.21.15.5:0/3314293647 conn(0x7fd9040668f0 msgr2=0x7fd904066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 -- 172.21.15.5:0/3314293647 shutdown_connections 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.770+0000 7fd90937e640 1 -- 172.21.15.5:0/3314293647 wait complete. 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.771+0000 7fd90937e640 1 Processor -- start 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.771+0000 7fd90937e640 1 -- start start 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040ce5e0 0x7fd9041540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040d3990 0x7fd9040ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90415e0a0 0x7fd9040cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9040d2c00 con 0x7fd9040d3990 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9040d2920 con 0x7fd90415e0a0 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90415e480 con 0x7fd9040ce5e0 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040d3990 0x7fd9040ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040d3990 0x7fd9040ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42240/0 (socket says 172.21.15.5:42240) 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 -- 172.21.15.5:0/1457557660 learned_addr learned my addr 172.21.15.5:0/1457557660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd902ffd640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040ce5e0 0x7fd9041540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9037fe640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90415e0a0 0x7fd9040cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 -- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040ce5e0 msgr2=0x7fd9041540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040ce5e0 0x7fd9041540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 -- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90415e0a0 msgr2=0x7fd9040cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90415e0a0 0x7fd9040cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 -- 172.21.15.5:0/1457557660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904157da0 con 0x7fd9040d3990 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9037fe640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90415e0a0 0x7fd9040cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd9027fc640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040d3990 0x7fd9040ccbb0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e8c0 tx=0x7fd8f800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd8eb7fe640 1 -- 172.21.15.5:0/1457557660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8017070 con 0x7fd9040d3990 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd8eb7fe640 1 -- 172.21.15.5:0/1457557660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f800c940 con 0x7fd9040d3990 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9041545e0 con 0x7fd9040d3990 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd8eb7fe640 1 -- 172.21.15.5:0/1457557660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800cd10 con 0x7fd9040d3990 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.772+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9041f3de0 con 0x7fd9040d3990 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.773+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9040cfaa0 con 0x7fd9040d3990 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.774+0000 7fd8eb7fe640 1 -- 172.21.15.5:0/1457557660 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8f801a070 con 0x7fd9040d3990 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.774+0000 7fd8eb7fe640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f006b4d0 0x7fd8f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.774+0000 7fd8eb7fe640 1 -- 172.21.15.5:0/1457557660 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd8f808a100 con 0x7fd9040d3990 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.774+0000 7fd902ffd640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f006b4d0 0x7fd8f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.775+0000 7fd902ffd640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f006b4d0 0x7fd8f006d990 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009b40 tx=0x7fd8f4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:37.778+0000 7fd8eb7fe640 1 -- 172.21.15.5:0/1457557660 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9040cfaa0 con 0x7fd9040d3990 2024-04-25T09:04:38.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.026+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd9040d0990 con 0x7fd9040d3990 2024-04-25T09:04:38.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.027+0000 7fd8eb7fe640 1 -- 172.21.15.5:0/1457557660 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1749 (secure 0 0 0) 0x7fd8f80588f0 con 0x7fd9040d3990 2024-04-25T09:04:38.014 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":497,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1008,"data_bytes":1034173267,"bytes_used":2353987584,"bytes_avail":770740125696,"bytes_total":773094113280,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":224714,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":2097152,"num_keys_recovered":0,"write_bytes_sec":104470225,"read_op_per_sec":0,"write_op_per_sec":102},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-04-25T09:04:00.486142+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:04:38.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f006b4d0 msgr2=0x7fd8f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f006b4d0 0x7fd8f006d990 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009b40 tx=0x7fd8f4009190 comp rx=0 tx=0).stop 2024-04-25T09:04:38.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040d3990 msgr2=0x7fd9040ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040d3990 0x7fd9040ccbb0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e8c0 tx=0x7fd8f800ed80 comp rx=0 tx=0).stop 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 shutdown_connections 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd8f006b4d0 0x7fd8f006d990 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90415e0a0 0x7fd9040cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.028+0000 7fd90937e640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9040d3990 0x7fd9040ccbb0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.029+0000 7fd90937e640 1 --2- 172.21.15.5:0/1457557660 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9040ce5e0 0x7fd9041540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.029+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 >> 172.21.15.5:0/1457557660 conn(0x7fd9040668f0 msgr2=0x7fd90415f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.029+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 shutdown_connections 2024-04-25T09:04:38.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:38.029+0000 7fd90937e640 1 -- 172.21.15.5:0/1457557660 wait complete. 2024-04-25T09:04:38.027 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:04:39.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:39.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.152+0000 7f1ed445d640 1 Processor -- start 2024-04-25T09:04:39.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.152+0000 7f1ed445d640 1 -- start start 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.153+0000 7f1ed445d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.153+0000 7f1ed445d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc0b7f60 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.153+0000 7f1ed445d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc0cf400 con 0x7f1ecc0d3990 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.153+0000 7f1ed445d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0b29c0 con 0x7f1ecc15e0a0 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed29fa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ecc0d3df0 0x7f1ecc0cecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57954/0 (socket says 172.21.15.5:57954) 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed29fa640 1 -- 172.21.15.5:0/3013860985 learned_addr learned my addr 172.21.15.5:0/3013860985 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed21f9640 1 --2- 172.21.15.5:0/3013860985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed11f7640 1 -- 172.21.15.5:0/3013860985 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506292959 0 0) 0x7f1ecc0b7f60 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed11f7640 1 -- 172.21.15.5:0/3013860985 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb8003520 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed11f7640 1 -- 172.21.15.5:0/3013860985 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25175397 0 0) 0x7f1ecc0cf400 con 0x7f1ecc0d3990 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed11f7640 1 -- 172.21.15.5:0/3013860985 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ecc0b7f60 con 0x7f1ecc0d3990 2024-04-25T09:04:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed21f9640 1 -- 172.21.15.5:0/3013860985 >> v1:172.21.15.80:6789/0 conn(0x7f1ecc0d3990 legacy=0x7f1ecc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed21f9640 1 -- 172.21.15.5:0/3013860985 >> v1:172.21.15.5:6789/0 conn(0x7f1ecc0d3df0 legacy=0x7f1ecc0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.154+0000 7f1ed21f9640 1 -- 172.21.15.5:0/3013860985 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0d2080 con 0x7f1ecc15e0a0 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.155+0000 7f1ed21f9640 1 --2- 172.21.15.5:0/3013860985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc0d0d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80097d0 tx=0x7f1ec802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d235f0725dbc537 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.155+0000 7f1ed11f7640 1 -- 172.21.15.5:0/3013860985 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8037070 con 0x7f1ecc15e0a0 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.155+0000 7f1ed11f7640 1 -- 172.21.15.5:0/3013860985 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec8032440 con 0x7f1ecc15e0a0 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.155+0000 7f1ed11f7640 1 -- 172.21.15.5:0/3013860985 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80327f0 con 0x7f1ecc15e0a0 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.156+0000 7f1ed445d640 1 -- 172.21.15.5:0/3013860985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 msgr2=0x7f1ecc0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.156+0000 7f1ed445d640 1 --2- 172.21.15.5:0/3013860985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc0d0d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80097d0 tx=0x7f1ec802a210 comp rx=0 tx=0).stop 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.156+0000 7f1ed445d640 1 -- 172.21.15.5:0/3013860985 shutdown_connections 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.156+0000 7f1ed445d640 1 --2- 172.21.15.5:0/3013860985 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc0d0d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.156+0000 7f1ed445d640 1 -- 172.21.15.5:0/3013860985 >> 172.21.15.5:0/3013860985 conn(0x7f1ecc0668f0 msgr2=0x7f1ecc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.156+0000 7f1ed445d640 1 -- 172.21.15.5:0/3013860985 shutdown_connections 2024-04-25T09:04:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.156+0000 7f1ed445d640 1 -- 172.21.15.5:0/3013860985 wait complete. 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.157+0000 7f1ed445d640 1 Processor -- start 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.157+0000 7f1ed445d640 1 -- start start 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed445d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ecc0d3990 0x7f1ecc149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed445d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc0d3df0 0x7f1ecc1f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed445d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed445d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0d2920 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed445d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0d2640 con 0x7f1ecc0d3990 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed445d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0d2c00 con 0x7f1ecc15e0a0 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc0d3df0 0x7f1ecc1f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc0d3df0 0x7f1ecc1f3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42254/0 (socket says 172.21.15.5:42254) 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 -- 172.21.15.5:0/618229140 learned_addr learned my addr 172.21.15.5:0/618229140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed21f9640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ecc0d3990 0x7f1ecc149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed29fa640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 -- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 msgr2=0x7f1ecc15aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc15aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 -- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ecc0d3990 msgr2=0x7f1ecc149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ecc0d3990 0x7f1ecc149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.158+0000 7f1ed19f8640 1 -- 172.21.15.5:0/618229140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc14a310 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.159+0000 7f1ed19f8640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc0d3df0 0x7f1ecc1f3e40 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c430 tx=0x7f1ebc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.159+0000 7f1ec2ffd640 1 -- 172.21.15.5:0/618229140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc017070 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.159+0000 7f1ec2ffd640 1 -- 172.21.15.5:0/618229140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc0052f0 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.159+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc15fe70 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.159+0000 7f1ec2ffd640 1 -- 172.21.15.5:0/618229140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003830 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.159+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc160430 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.160+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc04ef20 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.160+0000 7f1ec2ffd640 1 -- 172.21.15.5:0/618229140 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ebc01a070 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.161+0000 7f1ec2ffd640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1eb006b4d0 0x7f1eb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.161+0000 7f1ec2ffd640 1 -- 172.21.15.5:0/618229140 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1ebc089620 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.161+0000 7f1ed21f9640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1eb006b4d0 0x7f1eb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.162+0000 7f1ed21f9640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1eb006b4d0 0x7f1eb006d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8034000 tx=0x7f1ec802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.165+0000 7f1ec2ffd640 1 -- 172.21.15.5:0/618229140 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ebc058460 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.381+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ecc0b38d0 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.382+0000 7f1ec2ffd640 1 -- 172.21.15.5:0/618229140 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f1ebc057d60 con 0x7f1ecc0d3df0 2024-04-25T09:04:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:39.371 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:39.371 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:39.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1eb006b4d0 msgr2=0x7f1eb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1eb006b4d0 0x7f1eb006d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8034000 tx=0x7f1ec802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc0d3df0 msgr2=0x7f1ecc1f3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc0d3df0 0x7f1ecc1f3e40 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c430 tx=0x7f1ebc00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 shutdown_connections 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1eb006b4d0 0x7f1eb006d990 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1ecc15e0a0 0x7f1ecc15aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc0d3df0 0x7f1ecc1f3e40 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 --2- 172.21.15.5:0/618229140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ecc0d3990 0x7f1ecc149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 >> 172.21.15.5:0/618229140 conn(0x7f1ecc0668f0 msgr2=0x7f1ecc066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 shutdown_connections 2024-04-25T09:04:39.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.384+0000 7f1ed445d640 1 -- 172.21.15.5:0/618229140 wait complete. 2024-04-25T09:04:39.383 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:39.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:39.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.494+0000 7fac61148640 1 Processor -- start 2024-04-25T09:04:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.494+0000 7fac61148640 1 -- start start 2024-04-25T09:04:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac61148640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fac5c15de70 0x7fac5c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac61148640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b2cc0 0x7fac5c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac61148640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5c0b7130 0x7fac5c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac61148640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0d2a10 con 0x7fac5c0b7130 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac61148640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0d20e0 con 0x7fac5c15de70 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac61148640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0d23c0 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5c0b7130 0x7fac5c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5c0b7130 0x7fac5c0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42268/0 (socket says 172.21.15.5:42268) 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 -- 172.21.15.5:0/910986180 learned_addr learned my addr 172.21.15.5:0/910986180 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5ad9d640 1 --2- 172.21.15.5:0/910986180 >> v2:172.21.15.80:3300/0 conn(0x7fac5c15de70 0x7fac5c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5a59c640 1 --2- 172.21.15.5:0/910986180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b2cc0 0x7fac5c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 -- 172.21.15.5:0/910986180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b2cc0 msgr2=0x7fac5c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 --2- 172.21.15.5:0/910986180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b2cc0 0x7fac5c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 -- 172.21.15.5:0/910986180 >> v2:172.21.15.80:3300/0 conn(0x7fac5c15de70 msgr2=0x7fac5c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 --2- 172.21.15.5:0/910986180 >> v2:172.21.15.80:3300/0 conn(0x7fac5c15de70 0x7fac5c0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5b59e640 1 -- 172.21.15.5:0/910986180 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0d26a0 con 0x7fac5c0b7130 2024-04-25T09:04:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.495+0000 7fac5a59c640 1 --2- 172.21.15.5:0/910986180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b2cc0 0x7fac5c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.496+0000 7fac5b59e640 1 --2- 172.21.15.5:0/910986180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b7130 0x7fac5c0ce7f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0d1650 tx=0x7fac5402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9014271a75d83c7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.496+0000 7fac59d9b640 1 -- 172.21.15.5:0/910986180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54036070 con 0x7fac5c0b7130 2024-04-25T09:04:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.496+0000 7fac59d9b640 1 -- 172.21.15.5:0/910986180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54031600 con 0x7fac5c0b7130 2024-04-25T09:04:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.496+0000 7fac59d9b640 1 -- 172.21.15.5:0/910986180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540319d0 con 0x7fac5c0b7130 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.496+0000 7fac61148640 1 -- 172.21.15.5:0/910986180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b7130 msgr2=0x7fac5c0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.496+0000 7fac61148640 1 --2- 172.21.15.5:0/910986180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b7130 0x7fac5c0ce7f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0d1650 tx=0x7fac5402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.497+0000 7fac61148640 1 -- 172.21.15.5:0/910986180 shutdown_connections 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.497+0000 7fac61148640 1 --2- 172.21.15.5:0/910986180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b7130 0x7fac5c0ce7f0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.497+0000 7fac61148640 1 --2- 172.21.15.5:0/910986180 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b2cc0 0x7fac5c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.497+0000 7fac61148640 1 --2- 172.21.15.5:0/910986180 >> v2:172.21.15.80:3300/0 conn(0x7fac5c15de70 0x7fac5c0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.497+0000 7fac61148640 1 -- 172.21.15.5:0/910986180 >> 172.21.15.5:0/910986180 conn(0x7fac5c06b000 msgr2=0x7fac5c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.497+0000 7fac61148640 1 -- 172.21.15.5:0/910986180 shutdown_connections 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.497+0000 7fac61148640 1 -- 172.21.15.5:0/910986180 wait complete. 2024-04-25T09:04:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.498+0000 7fac61148640 1 Processor -- start 2024-04-25T09:04:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.498+0000 7fac61148640 1 -- start start 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac61148640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2cc0 0x7fac5c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac61148640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b7130 0x7fac5c160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac61148640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac5c15de70 0x7fac5c160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac61148640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ceeb0 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac61148640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ced30 con 0x7fac5c15de70 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac61148640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0cf030 con 0x7fac5c0b7130 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2cc0 0x7fac5c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2cc0 0x7fac5c156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42272/0 (socket says 172.21.15.5:42272) 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 -- 172.21.15.5:0/1021446367 learned_addr learned my addr 172.21.15.5:0/1021446367 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5a59c640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b7130 0x7fac5c160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5b59e640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac5c15de70 0x7fac5c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 -- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b7130 msgr2=0x7fac5c160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b7130 0x7fac5c160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 -- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac5c15de70 msgr2=0x7fac5c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac5c15de70 0x7fac5c160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.499+0000 7fac5ad9d640 1 -- 172.21.15.5:0/1021446367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0cd8e0 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.500+0000 7fac5ad9d640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2cc0 0x7fac5c156d30 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00d5f0 tx=0x7fac4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.500+0000 7fac437fe640 1 -- 172.21.15.5:0/1021446367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0125f0 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.500+0000 7fac437fe640 1 -- 172.21.15.5:0/1021446367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c019070 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.500+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c0c7e80 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.500+0000 7fac437fe640 1 -- 172.21.15.5:0/1021446367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0129d0 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.500+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c157610 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.501+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c04ef20 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.501+0000 7fac437fe640 1 -- 172.21.15.5:0/1021446367 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac4c012b70 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.502+0000 7fac437fe640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac4806b4d0 0x7fac4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.502+0000 7fac437fe640 1 -- 172.21.15.5:0/1021446367 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fac4c08a670 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.502+0000 7fac5a59c640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac4806b4d0 0x7fac4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.502+0000 7fac5a59c640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac4806b4d0 0x7fac4806d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fac5c157c50 tx=0x7fac50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.506+0000 7fac437fe640 1 -- 172.21.15.5:0/1021446367 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac4c058d40 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.758+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fac5c0b6c90 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.759+0000 7fac437fe640 1 -- 172.21.15.5:0/1021446367 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1747 (secure 0 0 0) 0x7fac4c05cde0 con 0x7fac5c0b2cc0 2024-04-25T09:04:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:39.748 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":499,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1008,"data_bytes":1034173267,"bytes_used":2353987584,"bytes_avail":770740125696,"bytes_total":773094113280,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":202905,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":2097152,"num_keys_recovered":0,"write_bytes_sec":94331116,"read_op_per_sec":0,"write_op_per_sec":92},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-04-25T09:04:00.486142+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac4806b4d0 msgr2=0x7fac4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac4806b4d0 0x7fac4806d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fac5c157c50 tx=0x7fac50008040 comp rx=0 tx=0).stop 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2cc0 msgr2=0x7fac5c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2cc0 0x7fac5c156d30 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00d5f0 tx=0x7fac4c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 shutdown_connections 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac4806b4d0 0x7fac4806d990 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac5c15de70 0x7fac5c160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac5c0b7130 0x7fac5c160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 --2- 172.21.15.5:0/1021446367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2cc0 0x7fac5c156d30 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 >> 172.21.15.5:0/1021446367 conn(0x7fac5c06b000 msgr2=0x7fac5c15e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 shutdown_connections 2024-04-25T09:04:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:39.761+0000 7fac61148640 1 -- 172.21.15.5:0/1021446367 wait complete. 2024-04-25T09:04:39.760 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:04:40.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:40.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.886+0000 7f202dd6a640 1 Processor -- start 2024-04-25T09:04:40.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.886+0000 7f202dd6a640 1 -- start start 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f202dd6a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20280b2cc0 0x7f20280b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f202dd6a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20280d20e0 con 0x7f20280b7130 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f202dd6a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20280d23c0 con 0x7f202815de70 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f202dd6a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20280d2a10 con 0x7f20280b2cc0 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f2027fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20280b7130 0x7f20280ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37724/0 (socket says 172.21.15.5:37724) 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f2027fff640 1 -- 172.21.15.5:0/2604285299 learned_addr learned my addr 172.21.15.5:0/2604285299 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928122748 0 0) 0x7f20280d20e0 con 0x7f20280b7130 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.887+0000 7f2026ffd640 1 --2- 172.21.15.5:0/2604285299 >> v2:172.21.15.80:3300/0 conn(0x7f20280b2cc0 0x7f20280b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2010003520 con 0x7f20280b7130 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485001924 0 0) 0x7f2010003520 con 0x7f20280b7130 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 >> v2:172.21.15.80:3300/0 conn(0x7f20280b2cc0 msgr2=0x7f20280b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 --2- 172.21.15.5:0/2604285299 >> v2:172.21.15.80:3300/0 conn(0x7f20280b2cc0 0x7f20280b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 >> v1:172.21.15.80:6789/0 conn(0x7f202815de70 legacy=0x7f20280b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20280d26a0 con 0x7f20280b7130 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f20200019f0 con 0x7f20280b7130 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 >> v1:172.21.15.5:6789/0 conn(0x7f20280b7130 legacy=0x7f20280ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20100039b0 0x7f2010003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2010004800 0x7f2010004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20100051c0 0x7f201000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280d2a10 con 0x7f20100039b0 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201000c060 con 0x7f20100051c0 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201000c260 con 0x7f2010004800 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20277fe640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20100039b0 0x7f2010003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f2027fff640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20100051c0 0x7f201000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f2026ffd640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2010004800 0x7f2010004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20277fe640 1 -- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2010004800 msgr2=0x7f2010004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20277fe640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2010004800 0x7f2010004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20277fe640 1 -- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20100051c0 msgr2=0x7f201000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20277fe640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20100051c0 0x7f201000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f20277fe640 1 -- 172.21.15.5:0/2604285299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2010003520 con 0x7f20100039b0 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f2027fff640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20100051c0 0x7f201000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.888+0000 7f2027fff640 1 -- 172.21.15.5:0/2604285299 reap_dead start 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.889+0000 7f20277fe640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20100039b0 0x7f2010003dd0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f2018001750 tx=0x7f2010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9aa89a7cff40fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.889+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018001370 con 0x7f20100039b0 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.889+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20180052d0 con 0x7f20100039b0 2024-04-25T09:04:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.889+0000 7f20267fc640 1 -- 172.21.15.5:0/2604285299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201802abc0 con 0x7f20100039b0 2024-04-25T09:04:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.890+0000 7f202dd6a640 1 -- 172.21.15.5:0/2604285299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20100039b0 msgr2=0x7f2010003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.890+0000 7f202dd6a640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20100039b0 0x7f2010003dd0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f2018001750 tx=0x7f2010005830 comp rx=0 tx=0).stop 2024-04-25T09:04:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.890+0000 7f202dd6a640 1 -- 172.21.15.5:0/2604285299 shutdown_connections 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.890+0000 7f202dd6a640 1 --2- 172.21.15.5:0/2604285299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20100039b0 0x7f2010003dd0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.890+0000 7f202dd6a640 1 -- 172.21.15.5:0/2604285299 >> 172.21.15.5:0/2604285299 conn(0x7f202806b000 msgr2=0x7f202806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.890+0000 7f202dd6a640 1 -- 172.21.15.5:0/2604285299 shutdown_connections 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.890+0000 7f202dd6a640 1 -- 172.21.15.5:0/2604285299 wait complete. 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.891+0000 7f202dd6a640 1 Processor -- start 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.891+0000 7f202dd6a640 1 -- start start 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f202dd6a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20100039b0 0x7f2028152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f202dd6a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20281531a0 0x7f2028156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f202dd6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cb540 0x7f20280cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f202dd6a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280b6f80 con 0x7f20280cb540 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f202dd6a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280b6e00 con 0x7f20281531a0 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f202dd6a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20280b93e0 con 0x7f20100039b0 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cb540 0x7f20280cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cb540 0x7f20280cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60274/0 (socket says 172.21.15.5:60274) 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 -- 172.21.15.5:0/1991732682 learned_addr learned my addr 172.21.15.5:0/1991732682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2026ffd640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20281531a0 0x7f2028156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 -- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20100039b0 msgr2=0x7f2028152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f20277fe640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20100039b0 0x7f2028152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20100039b0 0x7f2028152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 -- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20281531a0 msgr2=0x7f2028156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20281531a0 0x7f2028156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2027fff640 1 -- 172.21.15.5:0/1991732682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20280b6290 con 0x7f20280cb540 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.892+0000 7f2026ffd640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20281531a0 0x7f2028156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.893+0000 7f2027fff640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cb540 0x7f20280cb9c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f2020001f00 tx=0x7f2020007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.893+0000 7f200ffff640 1 -- 172.21.15.5:0/1991732682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000ea80 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.893+0000 7f200ffff640 1 -- 172.21.15.5:0/1991732682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020018070 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.893+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2028157080 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.893+0000 7f200ffff640 1 -- 172.21.15.5:0/1991732682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000ee60 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.893+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20280cd830 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.894+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202804ef20 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.894+0000 7f200ffff640 1 -- 172.21.15.5:0/1991732682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f202001d460 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.895+0000 7f200ffff640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201406b4d0 0x7f201406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.895+0000 7f200ffff640 1 -- 172.21.15.5:0/1991732682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f202008a570 con 0x7f20280cb540 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.895+0000 7f20277fe640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201406b4d0 0x7f201406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.896+0000 7f20277fe640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201406b4d0 0x7f201406d990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2018032000 tx=0x7f201802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:40.899+0000 7f200ffff640 1 -- 172.21.15.5:0/1991732682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2020059310 con 0x7f20280cb540 2024-04-25T09:04:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.119+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20280cf270 con 0x7f20280cb540 2024-04-25T09:04:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.120+0000 7f200ffff640 1 -- 172.21.15.5:0/1991732682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f2020058c10 con 0x7f20280cb540 2024-04-25T09:04:41.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:41.108 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201406b4d0 msgr2=0x7f201406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201406b4d0 0x7f201406d990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2018032000 tx=0x7f201802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cb540 msgr2=0x7f20280cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cb540 0x7f20280cb9c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f2020001f00 tx=0x7f2020007bc0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 shutdown_connections 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201406b4d0 0x7f201406d990 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cb540 0x7f20280cb9c0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20281531a0 0x7f2028156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 --2- 172.21.15.5:0/1991732682 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20100039b0 0x7f2028152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 >> 172.21.15.5:0/1991732682 conn(0x7f202806b000 msgr2=0x7f20280ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 shutdown_connections 2024-04-25T09:04:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.122+0000 7f202dd6a640 1 -- 172.21.15.5:0/1991732682 wait complete. 2024-04-25T09:04:41.121 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:41.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.234+0000 7fe097dcf640 1 Processor -- start 2024-04-25T09:04:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.234+0000 7fe097dcf640 1 -- start start 2024-04-25T09:04:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe097dcf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe09015e0a0 0x7fe0900d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe097dcf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0900d3990 0x7fe0900d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe097dcf640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900b7f60 con 0x7fe0900ce5e0 2024-04-25T09:04:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe097dcf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900d4330 con 0x7fe0900d3990 2024-04-25T09:04:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe097dcf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900b29c0 con 0x7fe09015e0a0 2024-04-25T09:04:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe09536a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0900d3990 0x7fe0900d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe09536a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0900d3990 0x7fe0900d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60278/0 (socket says 172.21.15.5:60278) 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.235+0000 7fe09536a640 1 -- 172.21.15.5:0/576313119 learned_addr learned my addr 172.21.15.5:0/576313119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.236+0000 7fe095b6b640 1 --2- 172.21.15.5:0/576313119 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe09015e0a0 0x7fe0900d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.236+0000 7fe09536a640 1 -- 172.21.15.5:0/576313119 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe09015e0a0 msgr2=0x7fe0900d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.236+0000 7fe09536a640 1 --2- 172.21.15.5:0/576313119 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe09015e0a0 0x7fe0900d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.236+0000 7fe09536a640 1 -- 172.21.15.5:0/576313119 >> v1:172.21.15.80:6789/0 conn(0x7fe0900ce5e0 legacy=0x7fe0900cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.236+0000 7fe09536a640 1 -- 172.21.15.5:0/576313119 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900d2080 con 0x7fe0900d3990 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.236+0000 7fe09536a640 1 --2- 172.21.15.5:0/576313119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900d3990 0x7fe0900d3df0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fe080009870 tx=0x7fe08002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c508de737e68c27c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe094b69640 1 -- 172.21.15.5:0/576313119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080037070 con 0x7fe0900d3990 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe094b69640 1 -- 172.21.15.5:0/576313119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe080032440 con 0x7fe0900d3990 2024-04-25T09:04:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe094b69640 1 -- 172.21.15.5:0/576313119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080032810 con 0x7fe0900d3990 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 -- 172.21.15.5:0/576313119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900d3990 msgr2=0x7fe0900d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 --2- 172.21.15.5:0/576313119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900d3990 0x7fe0900d3df0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fe080009870 tx=0x7fe08002a270 comp rx=0 tx=0).stop 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 -- 172.21.15.5:0/576313119 shutdown_connections 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 --2- 172.21.15.5:0/576313119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900d3990 0x7fe0900d3df0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 --2- 172.21.15.5:0/576313119 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe09015e0a0 0x7fe0900d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 -- 172.21.15.5:0/576313119 >> 172.21.15.5:0/576313119 conn(0x7fe0900668f0 msgr2=0x7fe090066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 -- 172.21.15.5:0/576313119 shutdown_connections 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.237+0000 7fe097dcf640 1 -- 172.21.15.5:0/576313119 wait complete. 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.238+0000 7fe097dcf640 1 Processor -- start 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.238+0000 7fe097dcf640 1 -- start start 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe097dcf640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0900ce5e0 0x7fe0900c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe097dcf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0900d3990 0x7fe0900b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe097dcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09015e0a0 0x7fe0900b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe097dcf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900d2920 con 0x7fe09015e0a0 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe097dcf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900d2640 con 0x7fe0900d3990 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe097dcf640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900d2c00 con 0x7fe0900ce5e0 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe09636c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09015e0a0 0x7fe0900b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe09636c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09015e0a0 0x7fe0900b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60282/0 (socket says 172.21.15.5:60282) 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe09636c640 1 -- 172.21.15.5:0/3603439497 learned_addr learned my addr 172.21.15.5:0/3603439497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe09536a640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0900d3990 0x7fe0900b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.239+0000 7fe095b6b640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0900ce5e0 0x7fe0900c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe09636c640 1 -- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0900ce5e0 msgr2=0x7fe0900c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe09636c640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0900ce5e0 0x7fe0900c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe09636c640 1 -- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0900d3990 msgr2=0x7fe0900b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe09636c640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0900d3990 0x7fe0900b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe09636c640 1 -- 172.21.15.5:0/3603439497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09015f600 con 0x7fe09015e0a0 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe095b6b640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0900ce5e0 0x7fe0900c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe09636c640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09015e0a0 0x7fe0900b4540 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fe08800c6b0 tx=0x7fe08800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe0867fc640 1 -- 172.21.15.5:0/3603439497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088003b70 con 0x7fe09015e0a0 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe0867fc640 1 -- 172.21.15.5:0/3603439497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe088003d30 con 0x7fe09015e0a0 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09015f8e0 con 0x7fe09015e0a0 2024-04-25T09:04:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe0867fc640 1 -- 172.21.15.5:0/3603439497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088005310 con 0x7fe09015e0a0 2024-04-25T09:04:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.240+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09015fea0 con 0x7fe09015e0a0 2024-04-25T09:04:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.241+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09004ef20 con 0x7fe09015e0a0 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.241+0000 7fe0867fc640 1 -- 172.21.15.5:0/3603439497 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe0880054b0 con 0x7fe09015e0a0 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.242+0000 7fe0867fc640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe07406b4d0 0x7fe07406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.242+0000 7fe0867fc640 1 -- 172.21.15.5:0/3603439497 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe088089f80 con 0x7fe09015e0a0 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.242+0000 7fe095b6b640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe07406b4d0 0x7fe07406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.242+0000 7fe095b6b640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe07406b4d0 0x7fe07406d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe08c006fd0 tx=0x7fe08c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.246+0000 7fe0867fc640 1 -- 172.21.15.5:0/3603439497 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe088058e50 con 0x7fe09015e0a0 2024-04-25T09:04:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.497+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0900d10a0 con 0x7fe09015e0a0 2024-04-25T09:04:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.498+0000 7fe0867fc640 1 -- 172.21.15.5:0/3603439497 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1770 (secure 0 0 0) 0x7fe088058750 con 0x7fe09015e0a0 2024-04-25T09:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":501,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1008,"data_bytes":1034173267,"bytes_used":2353987584,"bytes_avail":770740125696,"bytes_total":773094113280,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":174723,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":2097152,"num_keys_recovered":0,"write_bytes_sec":81229407,"read_op_per_sec":0,"write_op_per_sec":79},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-04-25T09:04:40.495120+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe07406b4d0 msgr2=0x7fe07406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe07406b4d0 0x7fe07406d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe08c006fd0 tx=0x7fe08c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09015e0a0 msgr2=0x7fe0900b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09015e0a0 0x7fe0900b4540 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fe08800c6b0 tx=0x7fe08800cb70 comp rx=0 tx=0).stop 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 shutdown_connections 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe07406b4d0 0x7fe07406d990 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09015e0a0 0x7fe0900b4540 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0900d3990 0x7fe0900b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 --2- 172.21.15.5:0/3603439497 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0900ce5e0 0x7fe0900c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 >> 172.21.15.5:0/3603439497 conn(0x7fe0900668f0 msgr2=0x7fe0900b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 shutdown_connections 2024-04-25T09:04:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.500+0000 7fe097dcf640 1 -- 172.21.15.5:0/3603439497 wait complete. 2024-04-25T09:04:41.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:04:41.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:41.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-04-25T09:04:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.613+0000 7f0fd06fc640 1 Processor -- start 2024-04-25T09:04:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.613+0000 7f0fd06fc640 1 -- start start 2024-04-25T09:04:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.614+0000 7f0fd06fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0fc815df10 0x7f0fc81618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.614+0000 7f0fd06fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc80d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.614+0000 7f0fd06fc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc8162150 con 0x7f0fc80b6250 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.614+0000 7f0fd06fc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc80d20d0 con 0x7f0fc815df10 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.614+0000 7f0fd06fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8162430 con 0x7f0fc80cefe0 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.614+0000 7f0fcdc97640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0fc80b6250 0x7f0fc80ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37734/0 (socket says 172.21.15.5:37734) 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.614+0000 7f0fcdc97640 1 -- 172.21.15.5:0/1373124428 learned_addr learned my addr 172.21.15.5:0/1373124428 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fce498640 1 --2- 172.21.15.5:0/1373124428 >> v2:172.21.15.80:3300/0 conn(0x7f0fc815df10 0x7f0fc81618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fcec99640 1 --2- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc80d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fcd496640 1 -- 172.21.15.5:0/1373124428 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548712894 0 0) 0x7f0fc8162150 con 0x7f0fc80b6250 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fcd496640 1 -- 172.21.15.5:0/1373124428 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb4003520 con 0x7f0fc80b6250 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fce498640 1 -- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 msgr2=0x7f0fc80d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fce498640 1 --2- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc80d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fce498640 1 -- 172.21.15.5:0/1373124428 >> v1:172.21.15.5:6789/0 conn(0x7f0fc80b6250 legacy=0x7f0fc80ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fcd496640 1 -- 172.21.15.5:0/1373124428 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309392513 0 0) 0x7f0fb4003520 con 0x7f0fc80b6250 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fce498640 1 -- 172.21.15.5:0/1373124428 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8162710 con 0x7f0fc815df10 2024-04-25T09:04:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.615+0000 7f0fcec99640 1 --2- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc80d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.616+0000 7f0fce498640 1 --2- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 0x7f0fc81618d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40097a0 tx=0x7f0fc402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9342dd09c8c7cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.616+0000 7f0fcd496640 1 -- 172.21.15.5:0/1373124428 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4037070 con 0x7f0fc815df10 2024-04-25T09:04:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.616+0000 7f0fcd496640 1 -- 172.21.15.5:0/1373124428 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc402aba0 con 0x7f0fc815df10 2024-04-25T09:04:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.616+0000 7f0fcd496640 1 -- 172.21.15.5:0/1373124428 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8001670 con 0x7f0fc815df10 2024-04-25T09:04:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 msgr2=0x7f0fc81618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 0x7f0fc81618d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40097a0 tx=0x7f0fc402a110 comp rx=0 tx=0).stop 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1373124428 shutdown_connections 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc80d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1373124428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 0x7f0fc81618d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1373124428 >> 172.21.15.5:0/1373124428 conn(0x7f0fc80668f0 msgr2=0x7f0fc8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1373124428 shutdown_connections 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.617+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1373124428 wait complete. 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.618+0000 7f0fd06fc640 1 Processor -- start 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.618+0000 7f0fd06fc640 1 -- start start 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fc80b6250 0x7f0fc81f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 0x7f0fc815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80d2aa0 con 0x7f0fc80b6250 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8161e10 con 0x7f0fc815df10 2024-04-25T09:04:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80d2c20 con 0x7f0fc80cefe0 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fc80b6250 0x7f0fc81f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fc80b6250 0x7f0fc81f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60296/0 (socket says 172.21.15.5:60296) 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 -- 172.21.15.5:0/1119165745 learned_addr learned my addr 172.21.15.5:0/1119165745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fcec99640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 0x7f0fc815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 -- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 msgr2=0x7f0fc815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 -- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 msgr2=0x7f0fc815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 0x7f0fc815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 -- 172.21.15.5:0/1119165745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc815f780 con 0x7f0fc80b6250 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fce498640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fc80b6250 0x7f0fc81f3680 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0fc402a700 tx=0x7f0fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fbeffd640 1 -- 172.21.15.5:0/1119165745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4042020 con 0x7f0fc80b6250 2024-04-25T09:04:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fbeffd640 1 -- 172.21.15.5:0/1119165745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4003a40 con 0x7f0fc80b6250 2024-04-25T09:04:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc815fa60 con 0x7f0fc80b6250 2024-04-25T09:04:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fbeffd640 1 -- 172.21.15.5:0/1119165745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4037040 con 0x7f0fc80b6250 2024-04-25T09:04:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.619+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc8160020 con 0x7f0fc80b6250 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.621+0000 7f0fbeffd640 1 -- 172.21.15.5:0/1119165745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0fc4045020 con 0x7f0fc80b6250 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.621+0000 7f0fbeffd640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0fac06b4d0 0x7f0fac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.621+0000 7f0fbeffd640 1 -- 172.21.15.5:0/1119165745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0fc40aaa40 con 0x7f0fc80b6250 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.622+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0fac06b4d0 0x7f0fac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.622+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0fac06b4d0 0x7f0fac06d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8066f80 tx=0x7f0fb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.622+0000 7f0fd3404740 1 Processor -- start 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.622+0000 7f0fd3404740 1 -- start start 2024-04-25T09:04:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce180ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce180b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce1835be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fd3404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ce176db90 con 0x556ce1835760 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ce1716e40 con 0x556ce1847370 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ce1769c30 con 0x556ce180aca0 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce1835be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce1835be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60304/0 (socket says 172.21.15.5:60304) 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 -- 172.21.15.5:0/798529030 learned_addr learned my addr 172.21.15.5:0/798529030 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce180b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fce498640 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce180ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 -- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 msgr2=0x556ce180ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce180ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 -- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 msgr2=0x556ce180b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce180b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.623+0000 7f0fcec99640 1 -- 172.21.15.5:0/798529030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ce154c7d0 con 0x556ce1835760 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.624+0000 7f0fcec99640 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce1835be0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007680 tx=0x7f0fc0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96383637b000b9d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.624+0000 7f0fabfff640 1 -- 172.21.15.5:0/798529030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0019020 con 0x556ce1835760 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.624+0000 7f0fabfff640 1 -- 172.21.15.5:0/798529030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc0015850 con 0x556ce1835760 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.624+0000 7f0fabfff640 1 -- 172.21.15.5:0/798529030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0015c00 con 0x556ce1835760 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.624+0000 7f0fd3404740 1 -- 172.21.15.5:0/798529030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 msgr2=0x556ce1835be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.624+0000 7f0fd3404740 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce1835be0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007680 tx=0x7f0fc0009750 comp rx=0 tx=0).stop 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 -- 172.21.15.5:0/798529030 shutdown_connections 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce1835be0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce180b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 --2- 172.21.15.5:0/798529030 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce180ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 -- 172.21.15.5:0/798529030 >> 172.21.15.5:0/798529030 conn(0x556ce17d2870 msgr2=0x556ce1850760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 -- 172.21.15.5:0/798529030 shutdown_connections 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 -- 172.21.15.5:0/798529030 wait complete. 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 -- start start 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.625+0000 7f0fd3404740 1 Processor -- start 2024-04-25T09:04:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce18388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce184ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce184b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fd3404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ce172a3e0 con 0x556ce1835760 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ce18332b0 con 0x556ce1847370 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ce1861dc0 con 0x556ce180aca0 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fd3404740 10 client.0 _ll_register_callbacks cb 0x556ce1729db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fcdc97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce184ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fcdc97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce184ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60312/0 (socket says 172.21.15.5:60312) 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fcdc97640 1 -- 172.21.15.5:0/2613940176 learned_addr learned my addr 172.21.15.5:0/2613940176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fcec99640 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce184b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.626+0000 7f0fce498640 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce18388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fcdc97640 1 -- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 msgr2=0x556ce18388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce18388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fcdc97640 1 -- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 msgr2=0x556ce184b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce184b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fcdc97640 1 -- 172.21.15.5:0/2613940176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ce14420f0 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce184ad70 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8161360 tx=0x7f0fb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71b3cbdbdf73fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fa97fa640 1 -- 172.21.15.5:0/2613940176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8027060 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fa97fa640 1 -- 172.21.15.5:0/2613940176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0fb8022b40 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fc0015850 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fa97fa640 1 -- 172.21.15.5:0/2613940176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb8022d40 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 10 client.8778 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x556ce15acf60 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fa97fa640 1 -- 172.21.15.5:0/2613940176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc0015850 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fa97fa640 1 -- 172.21.15.5:0/2613940176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0fb8012620 con 0x556ce1835760 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 10 client.8778 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 10 client.8778 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 20 client.8778 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce1832e20 0x556ce1837940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 4 client.8778 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.627+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ce177b0d0 con 0x556ce1832e20 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.628+0000 7f0fce498640 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce1832e20 0x556ce1837940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.628+0000 7f0fa97fa640 10 client.8778 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.628+0000 7f0fce498640 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce1832e20 0x556ce1837940 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9428523cf5bf6026 server_cookie=4e76df2d0291e117 in_seq=0 out_seq=0 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fa97fa640 1 -- 172.21.15.5:0/2613940176 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556ce177b0d0 con 0x556ce1832e20 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fa97fa640 10 client.8778 handle_command_reply: tid=0 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 client.8778 shutdown 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 msgr2=0x556ce184ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce184ad70 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8161360 tx=0x7f0fb80057f0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 shutdown_connections 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce1832e20 0x556ce1837940 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1847370 0x556ce184b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce184ad70 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fa97fa640 0 client.8778 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 --2- 172.21.15.5:0/2613940176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce180aca0 0x556ce18388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 >> 172.21.15.5:0/2613940176 conn(0x556ce17d2870 msgr2=0x556ce1833490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 shutdown_connections 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 1 -- 172.21.15.5:0/2613940176 wait complete. 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.629+0000 7f0fd3404740 20 client.8778 trim_cache size 0 max 16384 2024-04-25T09:04:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 Processor -- start 2024-04-25T09:04:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 -- start start 2024-04-25T09:04:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce180aca0 0x556ce18611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1835760 0x556ce184be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce1848200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81fff00 con 0x556ce180aca0 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81ff100 con 0x556ce1835760 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.644+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81fe530 con 0x556ce1847370 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce180aca0 0x556ce18611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce180aca0 0x556ce18611b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60316/0 (socket says 172.21.15.5:60316) 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 -- 172.21.15.5:0/3378772003 learned_addr learned my addr 172.21.15.5:0/3378772003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 -- 172.21.15.5:0/3378772003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 msgr2=0x556ce1848200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 --2- 172.21.15.5:0/3378772003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce1848200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 -- 172.21.15.5:0/3378772003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1835760 msgr2=0x556ce184be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 --2- 172.21.15.5:0/3378772003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1835760 0x556ce184be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 -- 172.21.15.5:0/3378772003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ce1809000 con 0x556ce180aca0 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fce498640 1 --2- 172.21.15.5:0/3378772003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce180aca0 0x556ce18611b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4079140 tx=0x7f0fc407c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b7147ff46b20a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fab7fe640 1 -- 172.21.15.5:0/3378772003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4079900 con 0x556ce180aca0 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fab7fe640 1 -- 172.21.15.5:0/3378772003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40a6070 con 0x556ce180aca0 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.645+0000 7f0fab7fe640 1 -- 172.21.15.5:0/3378772003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4079200 con 0x556ce180aca0 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 -- 172.21.15.5:0/3378772003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce180aca0 msgr2=0x556ce18611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3378772003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce180aca0 0x556ce18611b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4079140 tx=0x7f0fc407c040 comp rx=0 tx=0).stop 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 -- 172.21.15.5:0/3378772003 shutdown_connections 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3378772003 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce1848200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3378772003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce1835760 0x556ce184be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3378772003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce180aca0 0x556ce18611b0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 -- 172.21.15.5:0/3378772003 >> 172.21.15.5:0/3378772003 conn(0x556ce17d2870 msgr2=0x556ce1800f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 -- 172.21.15.5:0/3378772003 shutdown_connections 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 -- 172.21.15.5:0/3378772003 wait complete. 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 -- start start 2024-04-25T09:04:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.646+0000 7f0fd3404740 1 Processor -- start 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce180aca0 0x556ce18538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce18ba720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fd3404740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce184c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fd3404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81feb30 con 0x556ce1835760 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ce1808a60 con 0x556ce180aca0 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fd3404740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ce18540f0 con 0x556ce1847370 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fd3404740 10 client.0 _ll_register_callbacks cb 0x7f0fb80058d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fcdc97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce18ba720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fcdc97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce18ba720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60326/0 (socket says 172.21.15.5:60326) 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.647+0000 7f0fcdc97640 1 -- 172.21.15.5:0/3519112021 learned_addr learned my addr 172.21.15.5:0/3519112021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fce498640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce180aca0 0x556ce18538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcdc97640 1 -- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 msgr2=0x556ce184c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcec99640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce184c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce184c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcdc97640 1 -- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce180aca0 msgr2=0x556ce18538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce180aca0 0x556ce18538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcdc97640 1 -- 172.21.15.5:0/3519112021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ce141b1b0 con 0x556ce1835760 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fce498640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce180aca0 0x556ce18538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcec99640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce184c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fcdc97640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce18ba720 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009010 tx=0x7f0fb8007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db1e6117e29d272 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fa97fa640 1 -- 172.21.15.5:0/3519112021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8027070 con 0x556ce1835760 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fa97fa640 1 -- 172.21.15.5:0/3519112021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0fb80047e0 con 0x556ce1835760 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fc40a6070 con 0x556ce1835760 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fa97fa640 1 -- 172.21.15.5:0/3519112021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb803a050 con 0x556ce1835760 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 10 client.8784 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x556ce1869d80 con 0x556ce1835760 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fa97fa640 1 -- 172.21.15.5:0/3519112021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40a6070 con 0x556ce1835760 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fa97fa640 1 -- 172.21.15.5:0/3519112021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0fb803d020 con 0x556ce1835760 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 10 client.8784 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 10 client.8784 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 20 client.8784 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce18364c0 0x556ce18368a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 4 client.8784 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-04-25T09:04:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.648+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x556ce1775420 con 0x556ce18364c0 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fce498640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce18364c0 0x556ce18368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fce498640 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce18364c0 0x556ce18368a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed61232053118e86 server_cookie=4699821ff5f74c44 in_seq=0 out_seq=0 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fa97fa640 10 client.8784 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fa97fa640 1 -- 172.21.15.5:0/3519112021 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x556ce1775420 con 0x556ce18364c0 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fa97fa640 10 client.8784 handle_command_reply: tid=0 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 client.8784 shutdown 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 msgr2=0x556ce18ba720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce18ba720 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009010 tx=0x7f0fb8007000 comp rx=0 tx=0).stop 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 shutdown_connections 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x556ce18364c0 0x556ce18368a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x556ce1847370 0x556ce184c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ce1835760 0x556ce18ba720 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fa97fa640 0 client.8784 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 --2- 172.21.15.5:0/3519112021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ce180aca0 0x556ce18538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 >> 172.21.15.5:0/3519112021 conn(0x556ce17d2870 msgr2=0x556ce1804ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 shutdown_connections 2024-04-25T09:04:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.649+0000 7f0fd3404740 1 -- 172.21.15.5:0/3519112021 wait complete. 2024-04-25T09:04:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd3404740 20 client.8784 trim_cache size 0 max 16384 2024-04-25T09:04:41.644 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:41.644 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T09:04:41.644 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0fac06b4d0 msgr2=0x7f0fac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0fac06b4d0 0x7f0fac06d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8066f80 tx=0x7f0fb8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fc80b6250 msgr2=0x7f0fc81f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fc80b6250 0x7f0fc81f3680 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0fc402a700 tx=0x7f0fc40046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 shutdown_connections 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0fac06b4d0 0x7f0fac06d990 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fc815df10 0x7f0fc815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fc80cefe0 0x7f0fc815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 --2- 172.21.15.5:0/1119165745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fc80b6250 0x7f0fc81f3680 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 >> 172.21.15.5:0/1119165745 conn(0x7f0fc80668f0 msgr2=0x7f0fc815bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 shutdown_connections 2024-04-25T09:04:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.650+0000 7f0fd06fc640 1 -- 172.21.15.5:0/1119165745 wait complete. 2024-04-25T09:04:41.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:41.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T09:04:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.763+0000 7f1030d28640 1 Processor -- start 2024-04-25T09:04:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.763+0000 7f1030d28640 1 -- start start 2024-04-25T09:04:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.764+0000 7f1030d28640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f102c0d4230 0x7f102c168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.764+0000 7f1030d28640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102c0b9b20 con 0x7f102c0b96e0 2024-04-25T09:04:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.764+0000 7f1030d28640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102c0d2740 con 0x7f102c1614b0 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.764+0000 7f1030d28640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c0d2a20 con 0x7f102c0d4230 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.764+0000 7f102ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f102c0d4230 0x7f102c168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.764+0000 7f1029d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f102c0b96e0 0x7f102c0d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37736/0 (socket says 172.21.15.5:37736) 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.764+0000 7f1029d9b640 1 -- 172.21.15.5:0/3725402582 learned_addr learned my addr 172.21.15.5:0/3725402582 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.765+0000 7f102959a640 1 -- 172.21.15.5:0/3725402582 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158592971 0 0) 0x7f102c0b9b20 con 0x7f102c0b96e0 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.765+0000 7f102959a640 1 -- 172.21.15.5:0/3725402582 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1018003520 con 0x7f102c0b96e0 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.765+0000 7f102ad9d640 1 -- 172.21.15.5:0/3725402582 >> v1:172.21.15.80:6789/0 conn(0x7f102c1614b0 legacy=0x7f102c0d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.765+0000 7f102ad9d640 1 -- 172.21.15.5:0/3725402582 >> v1:172.21.15.5:6789/0 conn(0x7f102c0b96e0 legacy=0x7f102c0d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.765+0000 7f102ad9d640 1 -- 172.21.15.5:0/3725402582 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0d2d00 con 0x7f102c0d4230 2024-04-25T09:04:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.765+0000 7f102ad9d640 1 --2- 172.21.15.5:0/3725402582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c168960 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f101c009d90 tx=0x7f101c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72ecd54c69d5732 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f102959a640 1 -- 172.21.15.5:0/3725402582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c007740 con 0x7f102c0d4230 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f102959a640 1 -- 172.21.15.5:0/3725402582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0078e0 con 0x7f102c0d4230 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f102959a640 1 -- 172.21.15.5:0/3725402582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c007cb0 con 0x7f102c0d4230 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f1030d28640 1 -- 172.21.15.5:0/3725402582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 msgr2=0x7f102c168960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f1030d28640 1 --2- 172.21.15.5:0/3725402582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c168960 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f101c009d90 tx=0x7f101c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f1030d28640 1 -- 172.21.15.5:0/3725402582 shutdown_connections 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f1030d28640 1 --2- 172.21.15.5:0/3725402582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c168960 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f1030d28640 1 -- 172.21.15.5:0/3725402582 >> 172.21.15.5:0/3725402582 conn(0x7f102c06b000 msgr2=0x7f102c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f1030d28640 1 -- 172.21.15.5:0/3725402582 shutdown_connections 2024-04-25T09:04:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.766+0000 7f1030d28640 1 -- 172.21.15.5:0/3725402582 wait complete. 2024-04-25T09:04:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 Processor -- start 2024-04-25T09:04:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 -- start start 2024-04-25T09:04:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f102c0b96e0 0x7f102c1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c1f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f102c1614b0 0x7f102c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0d37e0 con 0x7f102c0d4230 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0d32c0 con 0x7f102c0b96e0 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1030d28640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0b7cd0 con 0x7f102c1614b0 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1029d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c1f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1029d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c1f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60336/0 (socket says 172.21.15.5:60336) 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.768+0000 7f1029d9b640 1 -- 172.21.15.5:0/453236793 learned_addr learned my addr 172.21.15.5:0/453236793 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f102a59c640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f102c0b96e0 0x7f102c1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f102ad9d640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f102c1614b0 0x7f102c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1029d9b640 1 -- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f102c1614b0 msgr2=0x7f102c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1029d9b640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f102c1614b0 0x7f102c15eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1029d9b640 1 -- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f102c0b96e0 msgr2=0x7f102c1f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1029d9b640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f102c0b96e0 0x7f102c1f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1029d9b640 1 -- 172.21.15.5:0/453236793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0cbd50 con 0x7f102c0d4230 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f102a59c640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f102c0b96e0 0x7f102c1f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1029d9b640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c1f40d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f101400c500 tx=0x7f101400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1022ffd640 1 -- 172.21.15.5:0/453236793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014017070 con 0x7f102c0d4230 2024-04-25T09:04:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1022ffd640 1 -- 172.21.15.5:0/453236793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1014005ce0 con 0x7f102c0d4230 2024-04-25T09:04:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c0cc030 con 0x7f102c0d4230 2024-04-25T09:04:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1022ffd640 1 -- 172.21.15.5:0/453236793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014007330 con 0x7f102c0d4230 2024-04-25T09:04:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.769+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c0cc5f0 con 0x7f102c0d4230 2024-04-25T09:04:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.770+0000 7f1022ffd640 1 -- 172.21.15.5:0/453236793 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f101401a070 con 0x7f102c0d4230 2024-04-25T09:04:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.771+0000 7f1022ffd640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f100c06b4d0 0x7f100c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.771+0000 7f1022ffd640 1 -- 172.21.15.5:0/453236793 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1014089640 con 0x7f102c0d4230 2024-04-25T09:04:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.771+0000 7f102a59c640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f100c06b4d0 0x7f100c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.772+0000 7f102a59c640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f100c06b4d0 0x7f100c06d990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f102c0cd0b0 tx=0x7f1024009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.772+0000 7f1033a20740 1 Processor -- start 2024-04-25T09:04:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.772+0000 7f1033a20740 1 -- start start 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f1033a20740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x5582322f2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x5582322f2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322c2770 0x5582322c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f1033a20740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823222bda0 con 0x5582322efb10 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582321d4b80 con 0x5582322efef0 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x558232227e40 con 0x5582322c2770 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x5582322f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x5582322f2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60338/0 (socket says 172.21.15.5:60338) 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 -- 172.21.15.5:0/3695912422 learned_addr learned my addr 172.21.15.5:0/3695912422 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f1029d9b640 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x5582322f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102ad9d640 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322c2770 0x5582322c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 -- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322c2770 msgr2=0x5582322c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322c2770 0x5582322c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 -- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 msgr2=0x5582322f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x5582322f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102a59c640 1 -- 172.21.15.5:0/3695912422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582321def10 con 0x5582322efb10 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.773+0000 7f102ad9d640 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322c2770 0x5582322c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f102a59c640 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x5582322f2320 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f102400d8c0 tx=0x7f1024010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d88b66a7ef1179 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f100bfff640 1 -- 172.21.15.5:0/3695912422 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024024070 con 0x5582322efb10 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f100bfff640 1 -- 172.21.15.5:0/3695912422 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024014bb0 con 0x5582322efb10 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f100bfff640 1 -- 172.21.15.5:0/3695912422 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102401f400 con 0x5582322efb10 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 -- 172.21.15.5:0/3695912422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 msgr2=0x5582322f2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x5582322f2320 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f102400d8c0 tx=0x7f1024010000 comp rx=0 tx=0).stop 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 -- 172.21.15.5:0/3695912422 shutdown_connections 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322c2770 0x5582322c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x5582322f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 --2- 172.21.15.5:0/3695912422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x5582322f2320 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 -- 172.21.15.5:0/3695912422 >> 172.21.15.5:0/3695912422 conn(0x5582322c49e0 msgr2=0x55823230d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 -- 172.21.15.5:0/3695912422 shutdown_connections 2024-04-25T09:04:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.774+0000 7f1033a20740 1 -- 172.21.15.5:0/3695912422 wait complete. 2024-04-25T09:04:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.775+0000 7f1033a20740 1 -- start start 2024-04-25T09:04:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.775+0000 7f1033a20740 1 Processor -- start 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1033a20740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x55823230e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efef0 0x5582322f1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322e6e10 0x5582322f1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1033a20740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582322c7b90 con 0x5582322efb10 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582321ca4b0 con 0x5582322e6e10 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582322c7e70 con 0x5582322efef0 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1033a20740 10 client.0 _ll_register_callbacks cb 0x55823220a180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x55823230e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x55823230e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60340/0 (socket says 172.21.15.5:60340) 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 -- 172.21.15.5:0/2449631072 learned_addr learned my addr 172.21.15.5:0/2449631072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f1029d9b640 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efef0 0x5582322f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102ad9d640 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322e6e10 0x5582322f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 -- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efef0 msgr2=0x5582322f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efef0 0x5582322f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 -- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322e6e10 msgr2=0x5582322f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322e6e10 0x5582322f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.776+0000 7f102a59c640 1 -- 172.21.15.5:0/2449631072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55823200a7d0 con 0x5582322efb10 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f102a59c640 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x55823230e450 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f10240147f0 tx=0x7f1024000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a82397ccd11ff2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f10097fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f10097fa640 1 -- 172.21.15.5:0/2449631072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102402d060 con 0x5582322efb10 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f10097fa640 1 -- 172.21.15.5:0/2449631072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f10240053d0 con 0x5582322efb10 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1024014bb0 con 0x5582322efb10 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f10097fa640 1 -- 172.21.15.5:0/2449631072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1024033050 con 0x5582322efb10 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 10 client.8799 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x558231f403f0 con 0x5582322efb10 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f10097fa640 1 -- 172.21.15.5:0/2449631072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024014bb0 con 0x5582322efb10 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f10097fa640 1 -- 172.21.15.5:0/2449631072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1024036020 con 0x5582322efb10 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 10 client.8799 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 10 client.8799 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 20 client.8799 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232320900 0x558232320d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 4 client.8799 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582322392e0 con 0x558232320900 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.777+0000 7f1029d9b640 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232320900 0x558232320d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.778+0000 7f10097fa640 10 client.8799 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.778+0000 7f1029d9b640 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232320900 0x558232320d10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8c22f00063abce server_cookie=f73497325e965bce in_seq=0 out_seq=0 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.778+0000 7f10097fa640 1 -- 172.21.15.5:0/2449631072 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5582322392e0 con 0x558232320900 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.778+0000 7f10097fa640 10 client.8799 handle_command_reply: tid=0 2024-04-25T09:04:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.778+0000 7f1033a20740 1 client.8799 shutdown 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 msgr2=0x55823230e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x55823230e450 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f10240147f0 tx=0x7f1024000ed0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 shutdown_connections 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232320900 0x558232320d10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322e6e10 0x5582322f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efef0 0x5582322f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f10097fa640 0 client.8799 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 --2- 172.21.15.5:0/2449631072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efb10 0x55823230e450 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 >> 172.21.15.5:0/2449631072 conn(0x5582322c2770 msgr2=0x5582322c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 shutdown_connections 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 1 -- 172.21.15.5:0/2449631072 wait complete. 2024-04-25T09:04:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.779+0000 7f1033a20740 20 client.8799 trim_cache size 0 max 16384 2024-04-25T09:04:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.794+0000 7f1033a20740 1 Processor -- start 2024-04-25T09:04:41.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.794+0000 7f1033a20740 1 -- start start 2024-04-25T09:04:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322e6e10 0x5582322c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efb10 0x558232371ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f1033a20740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efef0 0x5582322c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f1033a20740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c1ffe90 con 0x5582322efef0 2024-04-25T09:04:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c1ff0d0 con 0x5582322efb10 2024-04-25T09:04:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0b5570 con 0x5582322e6e10 2024-04-25T09:04:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efef0 0x5582322c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efef0 0x5582322c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60354/0 (socket says 172.21.15.5:60354) 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 -- 172.21.15.5:0/2422978709 learned_addr learned my addr 172.21.15.5:0/2422978709 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f1029d9b640 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efb10 0x558232371ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102a59c640 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322e6e10 0x5582322c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 -- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322e6e10 msgr2=0x5582322c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322e6e10 0x5582322c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 -- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efb10 msgr2=0x558232371ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efb10 0x558232371ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 -- 172.21.15.5:0/2422978709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558231f000f0 con 0x5582322efef0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f102ad9d640 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efef0 0x5582322c9690 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f101c02ac90 tx=0x7f101c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6beeba865e1a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.795+0000 7f100b7fe640 1 -- 172.21.15.5:0/2422978709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c007680 con 0x5582322efef0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f100b7fe640 1 -- 172.21.15.5:0/2422978709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c007820 con 0x5582322efef0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f100b7fe640 1 -- 172.21.15.5:0/2422978709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c007c10 con 0x5582322efef0 2024-04-25T09:04:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 -- 172.21.15.5:0/2422978709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efef0 msgr2=0x5582322c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efef0 0x5582322c9690 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f101c02ac90 tx=0x7f101c02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 -- 172.21.15.5:0/2422978709 shutdown_connections 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322efef0 0x5582322c9690 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efb10 0x558232371ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 --2- 172.21.15.5:0/2422978709 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322e6e10 0x5582322c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 -- 172.21.15.5:0/2422978709 >> 172.21.15.5:0/2422978709 conn(0x5582322c2770 msgr2=0x5582322e61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 -- 172.21.15.5:0/2422978709 shutdown_connections 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.796+0000 7f1033a20740 1 -- 172.21.15.5:0/2422978709 wait complete. 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.797+0000 7f1033a20740 1 -- start start 2024-04-25T09:04:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.797+0000 7f1033a20740 1 Processor -- start 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322e6e10 0x55823236e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efb10 0x55823230d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x558232307300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582322e6c90 con 0x5582322e6e10 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0b5b70 con 0x5582322efef0 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55823232fa30 con 0x5582322efb10 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 10 client.0 _ll_register_callbacks cb 0x7f1024001390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322e6e10 0x55823236e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322e6e10 0x55823236e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60358/0 (socket says 172.21.15.5:60358) 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 -- 172.21.15.5:0/3857768406 learned_addr learned my addr 172.21.15.5:0/3857768406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1029d9b640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efb10 0x55823230d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102ad9d640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x558232307300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 -- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efb10 msgr2=0x55823230d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efb10 0x55823230d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 -- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 msgr2=0x558232307300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x558232307300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 -- 172.21.15.5:0/3857768406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55823230dd50 con 0x5582322e6e10 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102ad9d640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x558232307300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f102a59c640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322e6e10 0x55823236e110 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f10240147f0 tx=0x7f1024013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238c1c28f8e9c69d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f10097fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f10097fa640 1 -- 172.21.15.5:0/3857768406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024024040 con 0x5582322e6e10 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f10097fa640 1 -- 172.21.15.5:0/3857768406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f102400de40 con 0x5582322e6e10 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f101c007820 con 0x5582322e6e10 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f10097fa640 1 -- 172.21.15.5:0/3857768406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1024042050 con 0x5582322e6e10 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.798+0000 7f1033a20740 10 client.8805 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5582322f14b0 con 0x5582322e6e10 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f10097fa640 1 -- 172.21.15.5:0/3857768406 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c007820 con 0x5582322e6e10 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f10097fa640 1 -- 172.21.15.5:0/3857768406 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1024045020 con 0x5582322e6e10 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1033a20740 10 client.8805 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1033a20740 10 client.8805 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1033a20740 20 client.8805 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1033a20740 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232307840 0x5582322f0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1033a20740 4 client.8805 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55823230f330 con 0x558232307840 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1029d9b640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232307840 0x5582322f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f10097fa640 10 client.8805 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.799+0000 7f1029d9b640 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232307840 0x5582322f0570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=430f5fd2407b7416 server_cookie=f4fffaddcf61eb9e in_seq=0 out_seq=0 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f10097fa640 1 -- 172.21.15.5:0/3857768406 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x55823230f330 con 0x558232307840 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f10097fa640 10 client.8805 handle_command_reply: tid=0 2024-04-25T09:04:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 client.8805 shutdown 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322e6e10 msgr2=0x55823236e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322e6e10 0x55823236e110 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f10240147f0 tx=0x7f1024013000 comp rx=0 tx=0).stop 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 shutdown_connections 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x558232307840 0x5582322f0570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582322efef0 0x558232307300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5582322efb10 0x55823230d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 --2- 172.21.15.5:0/3857768406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582322e6e10 0x55823236e110 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f10097fa640 0 client.8805 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 >> 172.21.15.5:0/3857768406 conn(0x5582322c2770 msgr2=0x5582322c2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 shutdown_connections 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 1 -- 172.21.15.5:0/3857768406 wait complete. 2024-04-25T09:04:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1033a20740 20 client.8805 trim_cache size 0 max 16384 2024-04-25T09:04:41.795 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:41.795 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:04:41.795 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T09:04:41.795 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f100c06b4d0 msgr2=0x7f100c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f100c06b4d0 0x7f100c06d990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f102c0cd0b0 tx=0x7f1024009040 comp rx=0 tx=0).stop 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 msgr2=0x7f102c1f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c1f40d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f101400c500 tx=0x7f101400c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 shutdown_connections 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f100c06b4d0 0x7f100c06d990 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f102c1614b0 0x7f102c15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f102c0d4230 0x7f102c1f40d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 --2- 172.21.15.5:0/453236793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f102c0b96e0 0x7f102c1f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 >> 172.21.15.5:0/453236793 conn(0x7f102c06b000 msgr2=0x7f102c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.800+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 shutdown_connections 2024-04-25T09:04:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.801+0000 7f1030d28640 1 -- 172.21.15.5:0/453236793 wait complete. 2024-04-25T09:04:41.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.911+0000 7f1d8df6a640 1 Processor -- start 2024-04-25T09:04:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.911+0000 7f1d8df6a640 1 -- start start 2024-04-25T09:04:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d8df6a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d880b2cc0 0x7f1d880b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d8df6a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d880b7130 0x7f1d880ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d8df6a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880d20e0 con 0x7f1d8815de70 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d8df6a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880d2a10 con 0x7f1d880b7130 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d8df6a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880d23c0 con 0x7f1d880b2cc0 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d880b7130 0x7f1d880ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d880b7130 0x7f1d880ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60368/0 (socket says 172.21.15.5:60368) 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.912+0000 7f1d87fff640 1 -- 172.21.15.5:0/1535849805 learned_addr learned my addr 172.21.15.5:0/1535849805 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d86ffd640 1 --2- 172.21.15.5:0/1535849805 >> v2:172.21.15.80:3300/0 conn(0x7f1d880b2cc0 0x7f1d880b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d87fff640 1 -- 172.21.15.5:0/1535849805 >> v2:172.21.15.80:3300/0 conn(0x7f1d880b2cc0 msgr2=0x7f1d880b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d87fff640 1 --2- 172.21.15.5:0/1535849805 >> v2:172.21.15.80:3300/0 conn(0x7f1d880b2cc0 0x7f1d880b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d87fff640 1 -- 172.21.15.5:0/1535849805 >> v1:172.21.15.80:6789/0 conn(0x7f1d8815de70 legacy=0x7f1d880b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d87fff640 1 -- 172.21.15.5:0/1535849805 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880d26a0 con 0x7f1d880b7130 2024-04-25T09:04:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d86ffd640 1 --2- 172.21.15.5:0/1535849805 >> v2:172.21.15.80:3300/0 conn(0x7f1d880b2cc0 0x7f1d880b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d87fff640 1 --2- 172.21.15.5:0/1535849805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880ce7f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009e50 tx=0x7f1d8002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6292050eb6cd8f0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.913+0000 7f1d867fc640 1 -- 172.21.15.5:0/1535849805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80036070 con 0x7f1d880b7130 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d867fc640 1 -- 172.21.15.5:0/1535849805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80031600 con 0x7f1d880b7130 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d867fc640 1 -- 172.21.15.5:0/1535849805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800319d0 con 0x7f1d880b7130 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 -- 172.21.15.5:0/1535849805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 msgr2=0x7f1d880ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/1535849805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880ce7f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009e50 tx=0x7f1d8002a710 comp rx=0 tx=0).stop 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 -- 172.21.15.5:0/1535849805 shutdown_connections 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/1535849805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880ce7f0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/1535849805 >> v2:172.21.15.80:3300/0 conn(0x7f1d880b2cc0 0x7f1d880b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 -- 172.21.15.5:0/1535849805 >> 172.21.15.5:0/1535849805 conn(0x7f1d8806b000 msgr2=0x7f1d8806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 -- 172.21.15.5:0/1535849805 shutdown_connections 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.914+0000 7f1d8df6a640 1 -- 172.21.15.5:0/1535849805 wait complete. 2024-04-25T09:04:41.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.915+0000 7f1d8df6a640 1 Processor -- start 2024-04-25T09:04:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.915+0000 7f1d8df6a640 1 -- start start 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d8df6a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d880b2cc0 0x7f1d88152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d8df6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d8df6a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8815de70 0x7f1d880c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d8df6a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880cf0c0 con 0x7f1d880b7130 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d8df6a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880cef40 con 0x7f1d880b2cc0 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d8df6a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d881440f0 con 0x7f1d8815de70 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d86ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d86ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60370/0 (socket says 172.21.15.5:60370) 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d86ffd640 1 -- 172.21.15.5:0/2925294563 learned_addr learned my addr 172.21.15.5:0/2925294563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d86ffd640 1 -- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8815de70 msgr2=0x7f1d880c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d87fff640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8815de70 0x7f1d880c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d86ffd640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8815de70 0x7f1d880c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.916+0000 7f1d877fe640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d880b2cc0 0x7f1d88152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d86ffd640 1 -- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d880b2cc0 msgr2=0x7f1d88152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d86ffd640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d880b2cc0 0x7f1d88152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d86ffd640 1 -- 172.21.15.5:0/2925294563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88153530 con 0x7f1d880b7130 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d877fe640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d880b2cc0 0x7f1d88152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d86ffd640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880c7530 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c7f0 tx=0x7f1d7c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d6ffff640 1 -- 172.21.15.5:0/2925294563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c015070 con 0x7f1d880b7130 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d6ffff640 1 -- 172.21.15.5:0/2925294563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c007a30 con 0x7f1d880b7130 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d880b5540 con 0x7f1d880b7130 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d6ffff640 1 -- 172.21.15.5:0/2925294563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c007e00 con 0x7f1d880b7130 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.917+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d880b5b00 con 0x7f1d880b7130 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.918+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8804ef20 con 0x7f1d880b7130 2024-04-25T09:04:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.918+0000 7f1d6ffff640 1 -- 172.21.15.5:0/2925294563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d7c018070 con 0x7f1d880b7130 2024-04-25T09:04:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.919+0000 7f1d6ffff640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d7406b500 0x7f1d7406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.919+0000 7f1d6ffff640 1 -- 172.21.15.5:0/2925294563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d7c08a100 con 0x7f1d880b7130 2024-04-25T09:04:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.919+0000 7f1d877fe640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d7406b500 0x7f1d7406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.919+0000 7f1d877fe640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d7406b500 0x7f1d7406d9c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1d880b2720 tx=0x7f1d78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:41.923+0000 7f1d6ffff640 1 -- 172.21.15.5:0/2925294563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d7c058fd0 con 0x7f1d880b7130 2024-04-25T09:04:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.139+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d880b8520 con 0x7f1d880b7130 2024-04-25T09:04:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.140+0000 7f1d6ffff640 1 -- 172.21.15.5:0/2925294563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f1d7c0588d0 con 0x7f1d880b7130 2024-04-25T09:04:42.129 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:42.129 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d7406b500 msgr2=0x7f1d7406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d7406b500 0x7f1d7406d9c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1d880b2720 tx=0x7f1d78008040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 msgr2=0x7f1d880c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880c7530 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c7f0 tx=0x7f1d7c00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 shutdown_connections 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d7406b500 0x7f1d7406d9c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1d8815de70 0x7f1d880c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d880b7130 0x7f1d880c7530 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 --2- 172.21.15.5:0/2925294563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d880b2cc0 0x7f1d88152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 >> 172.21.15.5:0/2925294563 conn(0x7f1d8806b000 msgr2=0x7f1d8815e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 shutdown_connections 2024-04-25T09:04:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.142+0000 7f1d8df6a640 1 -- 172.21.15.5:0/2925294563 wait complete. 2024-04-25T09:04:42.142 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:42.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.253+0000 7f97c9c6b640 1 Processor -- start 2024-04-25T09:04:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.253+0000 7f97c9c6b640 1 -- start start 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c9c6b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f97c415de70 0x7f97c40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c9c6b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97c40b2cc0 0x7f97c40b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c9c6b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c40d20e0 con 0x7f97c40b7130 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c9c6b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40d2a10 con 0x7f97c40b2cc0 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c9c6b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40d23c0 con 0x7f97c415de70 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97c40b2cc0 0x7f97c40b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97c40b2cc0 0x7f97c40b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60376/0 (socket says 172.21.15.5:60376) 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c2ffd640 1 -- 172.21.15.5:0/3304029253 learned_addr learned my addr 172.21.15.5:0/3304029253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c37fe640 1 --2- 172.21.15.5:0/3304029253 >> v2:172.21.15.80:3300/0 conn(0x7f97c415de70 0x7f97c40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c2ffd640 1 -- 172.21.15.5:0/3304029253 >> v2:172.21.15.80:3300/0 conn(0x7f97c415de70 msgr2=0x7f97c40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c2ffd640 1 --2- 172.21.15.5:0/3304029253 >> v2:172.21.15.80:3300/0 conn(0x7f97c415de70 0x7f97c40b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c2ffd640 1 -- 172.21.15.5:0/3304029253 >> v1:172.21.15.80:6789/0 conn(0x7f97c40b7130 legacy=0x7f97c40ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c2ffd640 1 -- 172.21.15.5:0/3304029253 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40d26a0 con 0x7f97c40b2cc0 2024-04-25T09:04:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.254+0000 7f97c37fe640 1 --2- 172.21.15.5:0/3304029253 >> v2:172.21.15.80:3300/0 conn(0x7f97c415de70 0x7f97c40b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.255+0000 7f97c2ffd640 1 --2- 172.21.15.5:0/3304029253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c40b2cc0 0x7f97c40b6bf0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009870 tx=0x7f97b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f816e3416e1709 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.255+0000 7f97c27fc640 1 -- 172.21.15.5:0/3304029253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037070 con 0x7f97c40b2cc0 2024-04-25T09:04:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.255+0000 7f97c27fc640 1 -- 172.21.15.5:0/3304029253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b8032440 con 0x7f97c40b2cc0 2024-04-25T09:04:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.255+0000 7f97c27fc640 1 -- 172.21.15.5:0/3304029253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8032810 con 0x7f97c40b2cc0 2024-04-25T09:04:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 -- 172.21.15.5:0/3304029253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c40b2cc0 msgr2=0x7f97c40b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/3304029253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c40b2cc0 0x7f97c40b6bf0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009870 tx=0x7f97b802a270 comp rx=0 tx=0).stop 2024-04-25T09:04:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 -- 172.21.15.5:0/3304029253 shutdown_connections 2024-04-25T09:04:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/3304029253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c40b2cc0 0x7f97c40b6bf0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/3304029253 >> v2:172.21.15.80:3300/0 conn(0x7f97c415de70 0x7f97c40b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 -- 172.21.15.5:0/3304029253 >> 172.21.15.5:0/3304029253 conn(0x7f97c406b000 msgr2=0x7f97c406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 -- 172.21.15.5:0/3304029253 shutdown_connections 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.256+0000 7f97c9c6b640 1 -- 172.21.15.5:0/3304029253 wait complete. 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.257+0000 7f97c9c6b640 1 Processor -- start 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.257+0000 7f97c9c6b640 1 -- start start 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c9c6b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97c40b2cc0 0x7f97c4149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c9c6b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f97c40b7130 0x7f97c40cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c9c6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c415de70 0x7f97c41e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c9c6b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40cf080 con 0x7f97c415de70 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c9c6b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40cef00 con 0x7f97c40b2cc0 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c9c6b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40cf200 con 0x7f97c40b7130 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c415de70 0x7f97c41e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c415de70 0x7f97c41e63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60388/0 (socket says 172.21.15.5:60388) 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 -- 172.21.15.5:0/4124886864 learned_addr learned my addr 172.21.15.5:0/4124886864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 -- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f97c40b7130 msgr2=0x7f97c40cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f97c40b7130 0x7f97c40cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 -- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97c40b2cc0 msgr2=0x7f97c4149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97c40b2cc0 0x7f97c4149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 -- 172.21.15.5:0/4124886864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40cc4f0 con 0x7f97c415de70 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97c3fff640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c415de70 0x7f97c41e63a0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00c730 tx=0x7f97bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97abfff640 1 -- 172.21.15.5:0/4124886864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc016020 con 0x7f97c415de70 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.258+0000 7f97abfff640 1 -- 172.21.15.5:0/4124886864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc00aa50 con 0x7f97c415de70 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.259+0000 7f97abfff640 1 -- 172.21.15.5:0/4124886864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00ce40 con 0x7f97c415de70 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.259+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c40cc7d0 con 0x7f97c415de70 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.259+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c40ccd90 con 0x7f97c415de70 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.259+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c404ef20 con 0x7f97c415de70 2024-04-25T09:04:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.260+0000 7f97abfff640 1 -- 172.21.15.5:0/4124886864 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f97bc019020 con 0x7f97c415de70 2024-04-25T09:04:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.260+0000 7f97abfff640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f97b006b4d0 0x7f97b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.260+0000 7f97abfff640 1 -- 172.21.15.5:0/4124886864 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f97bc08a220 con 0x7f97c415de70 2024-04-25T09:04:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.260+0000 7f97c37fe640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f97b006b4d0 0x7f97b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.261+0000 7f97c37fe640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f97b006b4d0 0x7f97b006d990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f97b4006fd0 tx=0x7f97b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.264+0000 7f97abfff640 1 -- 172.21.15.5:0/4124886864 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f97bc020030 con 0x7f97c415de70 2024-04-25T09:04:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.514+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f97c40cf9b0 con 0x7f97c415de70 2024-04-25T09:04:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.515+0000 7f97abfff640 1 -- 172.21.15.5:0/4124886864 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1770 (secure 0 0 0) 0x7f97bc0212b0 con 0x7f97c415de70 2024-04-25T09:04:42.503 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:42.504 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":502,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1008,"data_bytes":1034173267,"bytes_used":2353987584,"bytes_avail":770740125696,"bytes_total":773094113280,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":174723,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":2097152,"num_keys_recovered":0,"write_bytes_sec":81229407,"read_op_per_sec":0,"write_op_per_sec":79},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-04-25T09:04:40.495120+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:04:42.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f97b006b4d0 msgr2=0x7f97b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f97b006b4d0 0x7f97b006d990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f97b4006fd0 tx=0x7f97b4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c415de70 msgr2=0x7f97c41e63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c415de70 0x7f97c41e63a0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00c730 tx=0x7f97bc00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 shutdown_connections 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f97b006b4d0 0x7f97b006d990 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c415de70 0x7f97c41e63a0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f97c40b7130 0x7f97c40cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 --2- 172.21.15.5:0/4124886864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97c40b2cc0 0x7f97c4149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 >> 172.21.15.5:0/4124886864 conn(0x7f97c406b000 msgr2=0x7f97c40d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 shutdown_connections 2024-04-25T09:04:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.517+0000 7f97c9c6b640 1 -- 172.21.15.5:0/4124886864 wait complete. 2024-04-25T09:04:42.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:04:42.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:42.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub resume 2024-04-25T09:04:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35c301f640 1 Processor -- start 2024-04-25T09:04:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35c301f640 1 -- start start 2024-04-25T09:04:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35c301f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35bc0cefe0 0x7f35bc168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35c301f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc162150 con 0x7f35bc0b6250 2024-04-25T09:04:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35c301f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc162430 con 0x7f35bc15df10 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35c301f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc0d20d0 con 0x7f35bc0cefe0 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35c15bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35bc0cefe0 0x7f35bc168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35bbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f35bc0b6250 0x7f35bc0ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37738/0 (socket says 172.21.15.5:37738) 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.631+0000 7f35bbfff640 1 -- 172.21.15.5:0/3859821048 learned_addr learned my addr 172.21.15.5:0/3859821048 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.632+0000 7f35c15bc640 1 -- 172.21.15.5:0/3859821048 >> v1:172.21.15.80:6789/0 conn(0x7f35bc15df10 legacy=0x7f35bc1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.632+0000 7f35c15bc640 1 -- 172.21.15.5:0/3859821048 >> v1:172.21.15.5:6789/0 conn(0x7f35bc0b6250 legacy=0x7f35bc0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.632+0000 7f35c15bc640 1 -- 172.21.15.5:0/3859821048 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc162710 con 0x7f35bc0cefe0 2024-04-25T09:04:42.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.632+0000 7f35bb7fe640 1 -- 172.21.15.5:0/3859821048 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090444370 0 0) 0x7f35bc162150 con 0x7f35bc0b6250 2024-04-25T09:04:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c15bc640 1 --2- 172.21.15.5:0/3859821048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc168c40 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0097a0 tx=0x7f35ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b84430d22b90c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35bb7fe640 1 -- 172.21.15.5:0/3859821048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac037070 con 0x7f35bc0cefe0 2024-04-25T09:04:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35bb7fe640 1 -- 172.21.15.5:0/3859821048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac032440 con 0x7f35bc0cefe0 2024-04-25T09:04:42.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35bb7fe640 1 -- 172.21.15.5:0/3859821048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac032810 con 0x7f35bc0cefe0 2024-04-25T09:04:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c301f640 1 -- 172.21.15.5:0/3859821048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 msgr2=0x7f35bc168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c301f640 1 --2- 172.21.15.5:0/3859821048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc168c40 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0097a0 tx=0x7f35ac02a230 comp rx=0 tx=0).stop 2024-04-25T09:04:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c301f640 1 -- 172.21.15.5:0/3859821048 shutdown_connections 2024-04-25T09:04:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c301f640 1 --2- 172.21.15.5:0/3859821048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc168c40 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c301f640 1 -- 172.21.15.5:0/3859821048 >> 172.21.15.5:0/3859821048 conn(0x7f35bc0668f0 msgr2=0x7f35bc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c301f640 1 -- 172.21.15.5:0/3859821048 shutdown_connections 2024-04-25T09:04:42.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.633+0000 7f35c301f640 1 -- 172.21.15.5:0/3859821048 wait complete. 2024-04-25T09:04:42.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.634+0000 7f35c301f640 1 Processor -- start 2024-04-25T09:04:42.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.634+0000 7f35c301f640 1 -- start start 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35c301f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0b6250 0x7f35bc152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35c301f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35c301f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35bc15df10 0x7f35bc0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35c301f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0d36f0 con 0x7f35bc0cefe0 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35c301f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0d3570 con 0x7f35bc0b6250 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35c301f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0d3870 con 0x7f35bc15df10 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc0b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60404/0 (socket says 172.21.15.5:60404) 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.635+0000 7f35bbfff640 1 -- 172.21.15.5:0/3220206828 learned_addr learned my addr 172.21.15.5:0/3220206828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0b6250 0x7f35bc152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35c15bc640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35bc15df10 0x7f35bc0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35bbfff640 1 -- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35bc15df10 msgr2=0x7f35bc0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35bbfff640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35bc15df10 0x7f35bc0b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35bbfff640 1 -- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0b6250 msgr2=0x7f35bc152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35bbfff640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0b6250 0x7f35bc152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35bbfff640 1 -- 172.21.15.5:0/3220206828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc1605f0 con 0x7f35bc0cefe0 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35c15bc640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35bc15df10 0x7f35bc0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35bbfff640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc0b5100 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f35a400c4a0 tx=0x7f35a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35b97fa640 1 -- 172.21.15.5:0/3220206828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4018070 con 0x7f35bc0cefe0 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35b97fa640 1 -- 172.21.15.5:0/3220206828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a40074e0 con 0x7f35bc0cefe0 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc0c9710 con 0x7f35bc0cefe0 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35b97fa640 1 -- 172.21.15.5:0/3220206828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4004a20 con 0x7f35bc0cefe0 2024-04-25T09:04:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.636+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc15fc50 con 0x7f35bc0cefe0 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.638+0000 7f35b97fa640 1 -- 172.21.15.5:0/3220206828 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35a401b070 con 0x7f35bc0cefe0 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.638+0000 7f35b97fa640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f359c06b4d0 0x7f359c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.638+0000 7f35b97fa640 1 -- 172.21.15.5:0/3220206828 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f35a4089550 con 0x7f35bc0cefe0 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.639+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f359c06b4d0 0x7f359c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.639+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f359c06b4d0 0x7f359c06d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f35bc15d820 tx=0x7f35b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.639+0000 7f35c5df4740 1 Processor -- start 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.639+0000 7f35c5df4740 1 -- start start 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33ab10 0x560ebc33d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33aef0 0x560ebc33d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc30d770 0x560ebc310f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c5df4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ebc276da0 con 0x560ebc33ab10 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ebc21fb80 con 0x560ebc33aef0 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ebc272e40 con 0x560ebc30d770 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33ab10 0x560ebc33d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33ab10 0x560ebc33d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60406/0 (socket says 172.21.15.5:60406) 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 -- 172.21.15.5:0/2439492257 learned_addr learned my addr 172.21.15.5:0/2439492257 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35bbfff640 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33aef0 0x560ebc33d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c15bc640 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc30d770 0x560ebc310f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 -- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc30d770 msgr2=0x560ebc310f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc30d770 0x560ebc310f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 -- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33aef0 msgr2=0x560ebc33d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33aef0 0x560ebc33d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.640+0000 7f35c0dbb640 1 -- 172.21.15.5:0/2439492257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ebc229f10 con 0x560ebc33ab10 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33ab10 0x560ebc33d320 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f35b4003af0 tx=0x7f35b4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528066158d5bddf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35b27fc640 1 -- 172.21.15.5:0/2439492257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40052e0 con 0x560ebc33ab10 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35b27fc640 1 -- 172.21.15.5:0/2439492257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4005480 con 0x560ebc33ab10 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35b27fc640 1 -- 172.21.15.5:0/2439492257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4021450 con 0x560ebc33ab10 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 -- 172.21.15.5:0/2439492257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33ab10 msgr2=0x560ebc33d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33ab10 0x560ebc33d320 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f35b4003af0 tx=0x7f35b4011000 comp rx=0 tx=0).stop 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 -- 172.21.15.5:0/2439492257 shutdown_connections 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc30d770 0x560ebc310f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33aef0 0x560ebc33d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 --2- 172.21.15.5:0/2439492257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33ab10 0x560ebc33d320 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 -- 172.21.15.5:0/2439492257 >> 172.21.15.5:0/2439492257 conn(0x560ebc30f9e0 msgr2=0x560ebc358320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 -- 172.21.15.5:0/2439492257 shutdown_connections 2024-04-25T09:04:42.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.641+0000 7f35c5df4740 1 -- 172.21.15.5:0/2439492257 wait complete. 2024-04-25T09:04:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.642+0000 7f35c5df4740 1 -- start start 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.642+0000 7f35c5df4740 1 Processor -- start 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc331cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc354f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc34fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c5df4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ebc312b90 con 0x560ebc359e60 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ebc2154b0 con 0x560ebc33ab10 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ebc312e70 con 0x560ebc33aef0 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c5df4740 10 client.0 _ll_register_callbacks cb 0x560ebc255180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc34fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc34fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60422/0 (socket says 172.21.15.5:60422) 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 -- 172.21.15.5:0/663877113 learned_addr learned my addr 172.21.15.5:0/663877113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc331cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35bbfff640 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc354f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 -- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 msgr2=0x560ebc354f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc354f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 -- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 msgr2=0x560ebc331cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc331cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.643+0000 7f35c15bc640 1 -- 172.21.15.5:0/663877113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ebc0557d0 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c15bc640 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc34fda0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0098c0 tx=0x7f35ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152695e25bda9252 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f359b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f359b7fe640 1 -- 172.21.15.5:0/663877113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac037040 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f359b7fe640 1 -- 172.21.15.5:0/663877113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f35ac046630 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35b4005480 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f359b7fe640 1 -- 172.21.15.5:0/663877113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35ac04e050 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 10 client.8832 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x560ebbf8b3f0 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f359b7fe640 1 -- 172.21.15.5:0/663877113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4005480 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f359b7fe640 1 -- 172.21.15.5:0/663877113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f35ac051020 con 0x560ebc359e60 2024-04-25T09:04:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 10 client.8832 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 10 client.8832 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 20 client.8832 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc339aa0 0x560ebc339eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 4 client.8832 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.644+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ebc2842e0 con 0x560ebc339aa0 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.645+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc339aa0 0x560ebc339eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.645+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc339aa0 0x560ebc339eb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93dd46b4f9277289 server_cookie=5c68ae8ac794fa91 in_seq=0 out_seq=0 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.645+0000 7f359b7fe640 10 client.8832 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f359b7fe640 1 -- 172.21.15.5:0/663877113 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560ebc2842e0 con 0x560ebc339aa0 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f359b7fe640 10 client.8832 handle_command_reply: tid=0 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 client.8832 shutdown 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 msgr2=0x560ebc34fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc34fda0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0098c0 tx=0x7f35ac004730 comp rx=0 tx=0).stop 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 shutdown_connections 2024-04-25T09:04:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc339aa0 0x560ebc339eb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc34fda0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc354f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f359b7fe640 0 client.8832 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 --2- 172.21.15.5:0/663877113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc331cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 >> 172.21.15.5:0/663877113 conn(0x560ebc30d770 msgr2=0x560ebc33d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 shutdown_connections 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 1 -- 172.21.15.5:0/663877113 wait complete. 2024-04-25T09:04:42.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.646+0000 7f35c5df4740 20 client.8832 trim_cache size 0 max 16384 2024-04-25T09:04:42.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.661+0000 7f35c5df4740 1 Processor -- start 2024-04-25T09:04:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.661+0000 7f35c5df4740 1 -- start start 2024-04-25T09:04:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc3595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33aef0 0x560ebc352270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc359e60 0x560ebc34f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c5df4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc200030 con 0x560ebc33aef0 2024-04-25T09:04:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1ff230 con 0x560ebc33ab10 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0c8070 con 0x560ebc359e60 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33aef0 0x560ebc352270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33aef0 0x560ebc352270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60434/0 (socket says 172.21.15.5:60434) 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 -- 172.21.15.5:0/714342287 learned_addr learned my addr 172.21.15.5:0/714342287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c15bc640 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc359e60 0x560ebc34f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc3595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 -- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc359e60 msgr2=0x560ebc34f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc359e60 0x560ebc34f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 -- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 msgr2=0x560ebc3595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc3595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 -- 172.21.15.5:0/714342287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ebbf4b0f0 con 0x560ebc33aef0 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc3595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35c15bc640 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc359e60 0x560ebc34f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35bbfff640 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33aef0 0x560ebc352270 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f35a405fe60 tx=0x7f35a4089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bea293164eff1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35b1ffb640 1 -- 172.21.15.5:0/714342287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4055f80 con 0x560ebc33aef0 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35b1ffb640 1 -- 172.21.15.5:0/714342287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a40542f0 con 0x560ebc33aef0 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.662+0000 7f35b1ffb640 1 -- 172.21.15.5:0/714342287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4004dc0 con 0x560ebc33aef0 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 -- 172.21.15.5:0/714342287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33aef0 msgr2=0x560ebc352270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33aef0 0x560ebc352270 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f35a405fe60 tx=0x7f35a4089040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 -- 172.21.15.5:0/714342287 shutdown_connections 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc359e60 0x560ebc34f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc33aef0 0x560ebc352270 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 --2- 172.21.15.5:0/714342287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc3595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 -- 172.21.15.5:0/714342287 >> 172.21.15.5:0/714342287 conn(0x560ebc30d770 msgr2=0x560ebc33d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 -- 172.21.15.5:0/714342287 shutdown_connections 2024-04-25T09:04:42.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.663+0000 7f35c5df4740 1 -- 172.21.15.5:0/714342287 wait complete. 2024-04-25T09:04:42.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 -- start start 2024-04-25T09:04:42.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 Processor -- start 2024-04-25T09:04:42.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc34dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc34e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc35a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1fec60 con 0x560ebc359e60 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ebc341480 con 0x560ebc33ab10 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ebc358b10 con 0x560ebc33aef0 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.664+0000 7f35c5df4740 10 client.0 _ll_register_callbacks cb 0x7f35b40019c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc35a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc35a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60442/0 (socket says 172.21.15.5:60442) 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 -- 172.21.15.5:0/366288936 learned_addr learned my addr 172.21.15.5:0/366288936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc34dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35bbfff640 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc34e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 -- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 msgr2=0x560ebc34e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc34e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 -- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 msgr2=0x560ebc34dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc34dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 -- 172.21.15.5:0/366288936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ebc3400c0 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c15bc640 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc35a240 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009890 tx=0x7f35ac009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbbfa1189504f04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f359b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f359b7fe640 1 -- 172.21.15.5:0/366288936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0469d0 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f359b7fe640 1 -- 172.21.15.5:0/366288936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f35ac046b70 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35a40542f0 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f359b7fe640 1 -- 172.21.15.5:0/366288936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35ac05e050 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c5df4740 10 client.8838 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x560ebc34e790 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.665+0000 7f359b7fe640 1 -- 172.21.15.5:0/366288936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a40542f0 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f359b7fe640 1 -- 172.21.15.5:0/366288936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f35ac061020 con 0x560ebc359e60 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c5df4740 10 client.8838 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c5df4740 10 client.8838 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c5df4740 20 client.8838 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c5df4740 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc308f20 0x560ebc35a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c5df4740 4 client.8838 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x560ebc27e630 con 0x560ebc308f20 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc308f20 0x560ebc35a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c0dbb640 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc308f20 0x560ebc35a780 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9cbafb2cfcbdc74 server_cookie=5027efe11b4cd2db in_seq=0 out_seq=0 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f359b7fe640 10 client.8838 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f359b7fe640 1 -- 172.21.15.5:0/366288936 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x560ebc27e630 con 0x560ebc308f20 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f359b7fe640 10 client.8838 handle_command_reply: tid=0 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.666+0000 7f35c5df4740 1 client.8838 shutdown 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 msgr2=0x560ebc35a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc35a240 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009890 tx=0x7f35ac009190 comp rx=0 tx=0).stop 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 shutdown_connections 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x560ebc308f20 0x560ebc35a780 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ebc359e60 0x560ebc35a240 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x560ebc33aef0 0x560ebc34e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f359b7fe640 0 client.8838 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 --2- 172.21.15.5:0/366288936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ebc33ab10 0x560ebc34dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 >> 172.21.15.5:0/366288936 conn(0x560ebc30d770 msgr2=0x560ebc3595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 shutdown_connections 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 1 -- 172.21.15.5:0/366288936 wait complete. 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c5df4740 20 client.8838 trim_cache size 0 max 16384 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T09:04:42.662 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f359c06b4d0 msgr2=0x7f359c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f359c06b4d0 0x7f359c06d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f35bc15d820 tx=0x7f35b4009040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 msgr2=0x7f35bc0b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc0b5100 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f35a400c4a0 tx=0x7f35a400c960 comp rx=0 tx=0).stop 2024-04-25T09:04:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 shutdown_connections 2024-04-25T09:04:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f359c06b4d0 0x7f359c06d990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35bc15df10 0x7f35bc0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35bc0cefe0 0x7f35bc0b5100 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 --2- 172.21.15.5:0/3220206828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0b6250 0x7f35bc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.667+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 >> 172.21.15.5:0/3220206828 conn(0x7f35bc0668f0 msgr2=0x7f35bc159280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.668+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 shutdown_connections 2024-04-25T09:04:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.668+0000 7f35c301f640 1 -- 172.21.15.5:0/3220206828 wait complete. 2024-04-25T09:04:42.667 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:04:42.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.782+0000 7fc277bd5640 1 Processor -- start 2024-04-25T09:04:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.782+0000 7fc277bd5640 1 -- start start 2024-04-25T09:04:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc277bd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700b6250 0x7fc2700ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc277bd5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc270162150 con 0x7fc27015df10 2024-04-25T09:04:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc277bd5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc270162430 con 0x7fc2700cee10 2024-04-25T09:04:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc277bd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700d20d0 con 0x7fc2700b6250 2024-04-25T09:04:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc275971640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc27015df10 0x7fc2701618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37754/0 (socket says 172.21.15.5:37754) 2024-04-25T09:04:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc275971640 1 -- 172.21.15.5:0/503008411 learned_addr learned my addr 172.21.15.5:0/503008411 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc275170640 1 --2- 172.21.15.5:0/503008411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700b6250 0x7fc2700ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc27496f640 1 -- 172.21.15.5:0/503008411 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072347192 0 0) 0x7fc270162150 con 0x7fc27015df10 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc27496f640 1 -- 172.21.15.5:0/503008411 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c003520 con 0x7fc27015df10 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc27496f640 1 -- 172.21.15.5:0/503008411 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060045827 0 0) 0x7fc270162430 con 0x7fc2700cee10 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.783+0000 7fc27496f640 1 -- 172.21.15.5:0/503008411 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc270162150 con 0x7fc2700cee10 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.784+0000 7fc275170640 1 -- 172.21.15.5:0/503008411 >> v1:172.21.15.80:6789/0 conn(0x7fc2700cee10 legacy=0x7fc2700d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.784+0000 7fc275170640 1 -- 172.21.15.5:0/503008411 >> v1:172.21.15.5:6789/0 conn(0x7fc27015df10 legacy=0x7fc2701618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.784+0000 7fc275170640 1 -- 172.21.15.5:0/503008411 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc270162710 con 0x7fc2700b6250 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.784+0000 7fc275170640 1 --2- 172.21.15.5:0/503008411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700b6250 0x7fc2700ce8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2600097d0 tx=0x7fc26002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89310537bdd940cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc27496f640 1 -- 172.21.15.5:0/503008411 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260037070 con 0x7fc2700b6250 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc27496f640 1 -- 172.21.15.5:0/503008411 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260032440 con 0x7fc2700b6250 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc27496f640 1 -- 172.21.15.5:0/503008411 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600327f0 con 0x7fc2700b6250 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc277bd5640 1 -- 172.21.15.5:0/503008411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700b6250 msgr2=0x7fc2700ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc277bd5640 1 --2- 172.21.15.5:0/503008411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700b6250 0x7fc2700ce8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2600097d0 tx=0x7fc26002a210 comp rx=0 tx=0).stop 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc277bd5640 1 -- 172.21.15.5:0/503008411 shutdown_connections 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc277bd5640 1 --2- 172.21.15.5:0/503008411 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700b6250 0x7fc2700ce8d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc277bd5640 1 -- 172.21.15.5:0/503008411 >> 172.21.15.5:0/503008411 conn(0x7fc2700668f0 msgr2=0x7fc270066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc277bd5640 1 -- 172.21.15.5:0/503008411 shutdown_connections 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.785+0000 7fc277bd5640 1 -- 172.21.15.5:0/503008411 wait complete. 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.786+0000 7fc277bd5640 1 Processor -- start 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.786+0000 7fc277bd5640 1 -- start start 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc277bd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2700b6250 0x7fc2700cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc277bd5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700cee10 0x7fc2700c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc277bd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc27015df10 0x7fc270151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc277bd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700d2df0 con 0x7fc2700b6250 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc277bd5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700d2c70 con 0x7fc27015df10 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc277bd5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700d2f70 con 0x7fc2700cee10 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc275971640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2700b6250 0x7fc2700cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc275971640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2700b6250 0x7fc2700cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60454/0 (socket says 172.21.15.5:60454) 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc275971640 1 -- 172.21.15.5:0/4185995501 learned_addr learned my addr 172.21.15.5:0/4185995501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc275170640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700cee10 0x7fc2700c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.787+0000 7fc276172640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc27015df10 0x7fc270151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc275971640 1 -- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700cee10 msgr2=0x7fc2700c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc275971640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700cee10 0x7fc2700c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc275971640 1 -- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc27015df10 msgr2=0x7fc270151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc275971640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc27015df10 0x7fc270151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc275971640 1 -- 172.21.15.5:0/4185995501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2700cdb70 con 0x7fc2700b6250 2024-04-25T09:04:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc275971640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2700b6250 0x7fc2700cd630 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c410 tx=0x7fc26c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc2667fc640 1 -- 172.21.15.5:0/4185995501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c017070 con 0x7fc2700b6250 2024-04-25T09:04:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc2667fc640 1 -- 172.21.15.5:0/4185995501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c005ce0 con 0x7fc2700b6250 2024-04-25T09:04:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2701e8720 con 0x7fc2700b6250 2024-04-25T09:04:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc2667fc640 1 -- 172.21.15.5:0/4185995501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0072d0 con 0x7fc2700b6250 2024-04-25T09:04:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.788+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2700cce30 con 0x7fc2700b6250 2024-04-25T09:04:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.789+0000 7fc2667fc640 1 -- 172.21.15.5:0/4185995501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc26c01a070 con 0x7fc2700b6250 2024-04-25T09:04:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.790+0000 7fc2667fc640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc25406b4d0 0x7fc25406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.790+0000 7fc2667fc640 1 -- 172.21.15.5:0/4185995501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc26c089560 con 0x7fc2700b6250 2024-04-25T09:04:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.790+0000 7fc275170640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc25406b4d0 0x7fc25406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.791+0000 7fc275170640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc25406b4d0 0x7fc25406d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc260034000 tx=0x7fc26002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.791+0000 7fc27a9b9740 1 Processor -- start 2024-04-25T09:04:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.791+0000 7fc27a9b9740 1 -- start start 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1b10 0x557e7a7d4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7a4770 0x557e7a7a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7a70dda0 con 0x557e7a7d1ef0 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7a6b6b80 con 0x557e7a7d1b10 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e7a709e40 con 0x557e7a7a4770 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7d4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60468/0 (socket says 172.21.15.5:60468) 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 -- 172.21.15.5:0/1836977561 learned_addr learned my addr 172.21.15.5:0/1836977561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275971640 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1b10 0x557e7a7d4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc276172640 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7a4770 0x557e7a7a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 -- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7a4770 msgr2=0x557e7a7a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7a4770 0x557e7a7a7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 -- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1b10 msgr2=0x557e7a7d4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1b10 0x557e7a7d4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275170640 1 -- 172.21.15.5:0/1836977561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e7a6c0f10 con 0x557e7a7d1ef0 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc276172640 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7a4770 0x557e7a7a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.792+0000 7fc275971640 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1b10 0x557e7a7d4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc275170640 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7d4860 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc260035040 tx=0x7fc26002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e51f00951982dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc2537fe640 1 -- 172.21.15.5:0/1836977561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260037040 con 0x557e7a7d1ef0 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc2537fe640 1 -- 172.21.15.5:0/1836977561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26004d070 con 0x557e7a7d1ef0 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc2537fe640 1 -- 172.21.15.5:0/1836977561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260032dd0 con 0x557e7a7d1ef0 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 -- 172.21.15.5:0/1836977561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 msgr2=0x557e7a7d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7d4860 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc260035040 tx=0x7fc26002c000 comp rx=0 tx=0).stop 2024-04-25T09:04:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 -- 172.21.15.5:0/1836977561 shutdown_connections 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7a4770 0x557e7a7a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7d4860 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/1836977561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1b10 0x557e7a7d4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 -- 172.21.15.5:0/1836977561 >> 172.21.15.5:0/1836977561 conn(0x557e7a7a69e0 msgr2=0x557e7a7ef320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 -- 172.21.15.5:0/1836977561 shutdown_connections 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.793+0000 7fc27a9b9740 1 -- 172.21.15.5:0/1836977561 wait complete. 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.794+0000 7fc27a9b9740 1 -- start start 2024-04-25T09:04:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.794+0000 7fc27a9b9740 1 Processor -- start 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7d1b10 0x557e7a7cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7c6f30 0x557e7a7eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7a7a9b90 con 0x557e7a7d1ef0 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7a6ac4b0 con 0x557e7a7c6f30 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e7a7a9e70 con 0x557e7a7d1b10 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc27a9b9740 10 client.0 _ll_register_callbacks cb 0x557e7a6ec180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60480/0 (socket says 172.21.15.5:60480) 2024-04-25T09:04:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 -- 172.21.15.5:0/46347253 learned_addr learned my addr 172.21.15.5:0/46347253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275971640 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7d1b10 0x557e7a7cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc276172640 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7c6f30 0x557e7a7eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 -- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7d1b10 msgr2=0x557e7a7cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7d1b10 0x557e7a7cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 -- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7c6f30 msgr2=0x557e7a7eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7c6f30 0x557e7a7eaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.795+0000 7fc275170640 1 -- 172.21.15.5:0/46347253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e7a4ec7d0 con 0x557e7a7d1ef0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc275170640 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f0450 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc260035040 tx=0x7fc260004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390718629d88736a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc250ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc250ff9640 1 -- 172.21.15.5:0/46347253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260037070 con 0x557e7a7d1ef0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc250ff9640 1 -- 172.21.15.5:0/46347253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc260004440 con 0x557e7a7d1ef0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc26004d070 con 0x557e7a7d1ef0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc250ff9640 1 -- 172.21.15.5:0/46347253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc26005e050 con 0x557e7a7d1ef0 2024-04-25T09:04:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 10 client.8850 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x557e7a4223f0 con 0x557e7a7d1ef0 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc250ff9640 1 -- 172.21.15.5:0/46347253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26004d070 con 0x557e7a7d1ef0 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc250ff9640 1 -- 172.21.15.5:0/46347253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc260061020 con 0x557e7a7d1ef0 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 10 client.8850 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 10 client.8850 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 20 client.8850 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7cb010 0x557e7a7c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 4 client.8850 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.796+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e7a71b2e0 con 0x557e7a7cb010 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.797+0000 7fc275971640 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7cb010 0x557e7a7c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.797+0000 7fc275971640 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7cb010 0x557e7a7c75c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=314424539c49f078 server_cookie=1edcd4ab6ca99d62 in_seq=0 out_seq=0 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.797+0000 7fc250ff9640 10 client.8850 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.797+0000 7fc250ff9640 1 -- 172.21.15.5:0/46347253 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557e7a71b2e0 con 0x557e7a7cb010 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.797+0000 7fc250ff9640 10 client.8850 handle_command_reply: tid=0 2024-04-25T09:04:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.797+0000 7fc27a9b9740 1 client.8850 shutdown 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 msgr2=0x557e7a7f0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f0450 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc260035040 tx=0x7fc260004730 comp rx=0 tx=0).stop 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 shutdown_connections 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7cb010 0x557e7a7c75c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7c6f30 0x557e7a7eaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f0450 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc250ff9640 0 client.8850 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/46347253 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7d1b10 0x557e7a7cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 >> 172.21.15.5:0/46347253 conn(0x557e7a7a4770 msgr2=0x557e7a7d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 shutdown_connections 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 1 -- 172.21.15.5:0/46347253 wait complete. 2024-04-25T09:04:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.798+0000 7fc27a9b9740 20 client.8850 trim_cache size 0 max 16384 2024-04-25T09:04:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.813+0000 7fc27a9b9740 1 Processor -- start 2024-04-25T09:04:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.813+0000 7fc27a9b9740 1 -- start start 2024-04-25T09:04:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 0x557e7a7f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a7f7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 0x557e7a7e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701ffd20 con 0x557e7a7d1b10 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700cb860 con 0x557e7a7d1ef0 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700cac60 con 0x557e7a7c6f30 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a7f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a7f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60488/0 (socket says 172.21.15.5:60488) 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 -- 172.21.15.5:0/2605006183 learned_addr learned my addr 172.21.15.5:0/2605006183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 -- 172.21.15.5:0/2605006183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 msgr2=0x557e7a7f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 --2- 172.21.15.5:0/2605006183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 0x557e7a7f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 -- 172.21.15.5:0/2605006183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 msgr2=0x557e7a7e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 --2- 172.21.15.5:0/2605006183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 0x557e7a7e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 -- 172.21.15.5:0/2605006183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e7a3e20f0 con 0x557e7a7d1b10 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc275170640 1 --2- 172.21.15.5:0/2605006183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a7f7450 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc260009720 tx=0x7fc26000b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51086bbabbb9b34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.814+0000 7fc252ffd640 1 -- 172.21.15.5:0/2605006183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260004440 con 0x557e7a7d1b10 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc252ffd640 1 -- 172.21.15.5:0/2605006183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26004d040 con 0x557e7a7d1b10 2024-04-25T09:04:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc252ffd640 1 -- 172.21.15.5:0/2605006183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260003e10 con 0x557e7a7d1b10 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 -- 172.21.15.5:0/2605006183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 msgr2=0x557e7a7f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/2605006183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a7f7450 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc260009720 tx=0x7fc26000b050 comp rx=0 tx=0).stop 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 -- 172.21.15.5:0/2605006183 shutdown_connections 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/2605006183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 0x557e7a7e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/2605006183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a7f7450 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/2605006183 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 0x557e7a7f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 -- 172.21.15.5:0/2605006183 >> 172.21.15.5:0/2605006183 conn(0x557e7a7a4770 msgr2=0x557e7a7d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 -- 172.21.15.5:0/2605006183 shutdown_connections 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.815+0000 7fc27a9b9740 1 -- 172.21.15.5:0/2605006183 wait complete. 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 -- start start 2024-04-25T09:04:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 Processor -- start 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 0x557e7a7a5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a84f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7a7c8b20 con 0x557e7a7d1b10 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700cb260 con 0x557e7a7d1ef0 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.816+0000 7fc27a9b9740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e7a7eb520 con 0x557e7a7c6f30 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc27a9b9740 10 client.0 _ll_register_callbacks cb 0x7fc25c0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a84f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a84f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60500/0 (socket says 172.21.15.5:60500) 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 -- 172.21.15.5:0/4206818952 learned_addr learned my addr 172.21.15.5:0/4206818952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc276172640 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275971640 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 0x557e7a7a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 -- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 msgr2=0x557e7a7a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 0x557e7a7a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 -- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 msgr2=0x557e7a7f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 -- 172.21.15.5:0/4206818952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e7a859b10 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc275170640 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a84f680 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc26002a800 tx=0x7fc260008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8649ccfa153b838e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc250ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc250ff9640 1 -- 172.21.15.5:0/4206818952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26006f060 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc250ff9640 1 -- 172.21.15.5:0/4206818952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc260051860 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc26004d040 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc250ff9640 1 -- 172.21.15.5:0/4206818952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc260075050 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc27a9b9740 10 client.8856 fetch_fsmap learned FSMap version 70 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.817+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x557e7a7ce150 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc250ff9640 1 -- 172.21.15.5:0/4206818952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26004d040 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc250ff9640 1 -- 172.21.15.5:0/4206818952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc260078020 con 0x557e7a7d1b10 2024-04-25T09:04:42.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 10 client.8856 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 10 client.8856 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 20 client.8856 populate_metadata read hostname 'smithi005' 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7a96e0 0x557e7a7f7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 4 client.8856 mds_command: new command op to 8526 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 --> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557e7a715630 con 0x557e7a7a96e0 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc275971640 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7a96e0 0x557e7a7f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc275971640 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7a96e0 0x557e7a7f7450 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fafeb065e1e70314 server_cookie=a659bead02865cd5 in_seq=0 out_seq=0 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc250ff9640 10 client.8856 ms_handle_connect on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc250ff9640 1 -- 172.21.15.5:0/4206818952 <== mds.0 v2:172.21.15.80:6835/4045189382 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557e7a715630 con 0x557e7a7a96e0 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc250ff9640 10 client.8856 handle_command_reply: tid=0 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 1 client.8856 shutdown 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 msgr2=0x557e7a84f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.818+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a84f680 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc26002a800 tx=0x7fc260008030 comp rx=0 tx=0).stop 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 shutdown_connections 2024-04-25T09:04:42.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:6835/4045189382,v1:172.21.15.80:6837/4045189382] conn(0x557e7a7a96e0 0x557e7a7f7450 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557e7a7d1ef0 0x557e7a7f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e7a7d1b10 0x557e7a84f680 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc250ff9640 0 client.8856 ms_handle_reset on v2:172.21.15.80:6835/4045189382 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 --2- 172.21.15.5:0/4206818952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x557e7a7c6f30 0x557e7a7a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 >> 172.21.15.5:0/4206818952 conn(0x557e7a7a4770 msgr2=0x557e7a7c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 shutdown_connections 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 1 -- 172.21.15.5:0/4206818952 wait complete. 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc27a9b9740 20 client.8856 trim_cache size 0 max 16384 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:04:42.813 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-04-25T09:04:42.814 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-04-25T09:04:42.814 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:04:42.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc25406b4d0 msgr2=0x7fc25406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc25406b4d0 0x7fc25406d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc260034000 tx=0x7fc26002e000 comp rx=0 tx=0).stop 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2700b6250 msgr2=0x7fc2700cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2700b6250 0x7fc2700cd630 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c410 tx=0x7fc26c00c8d0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 shutdown_connections 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc25406b4d0 0x7fc25406d990 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc27015df10 0x7fc270151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc2700cee10 0x7fc2700c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 --2- 172.21.15.5:0/4185995501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2700b6250 0x7fc2700cd630 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 >> 172.21.15.5:0/4185995501 conn(0x7fc2700668f0 msgr2=0x7fc2700b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 shutdown_connections 2024-04-25T09:04:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.819+0000 7fc277bd5640 1 -- 172.21.15.5:0/4185995501 wait complete. 2024-04-25T09:04:42.818 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:04:42.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:42.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.931+0000 7fd2a995c640 1 Processor -- start 2024-04-25T09:04:42.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.931+0000 7fd2a995c640 1 -- start start 2024-04-25T09:04:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a995c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a415de70 0x7fd2a40b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a995c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2a40ce7f0 0x7fd2a40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a995c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a40cf1c0 con 0x7fd2a40b2cc0 2024-04-25T09:04:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a995c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a40d2a10 con 0x7fd2a40ce7f0 2024-04-25T09:04:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a995c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40d20e0 con 0x7fd2a415de70 2024-04-25T09:04:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2a40ce7f0 0x7fd2a40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2a40ce7f0 0x7fd2a40cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60514/0 (socket says 172.21.15.5:60514) 2024-04-25T09:04:42.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4012746169 learned_addr learned my addr 172.21.15.5:0/4012746169 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a2ffd640 1 --2- 172.21.15.5:0/4012746169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a415de70 0x7fd2a40b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4012746169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a415de70 msgr2=0x7fd2a40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/4012746169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a415de70 0x7fd2a40b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4012746169 >> v1:172.21.15.80:6789/0 conn(0x7fd2a40b2cc0 legacy=0x7fd2a40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.932+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4012746169 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40d23c0 con 0x7fd2a40ce7f0 2024-04-25T09:04:42.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.933+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/4012746169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a40ce7f0 0x7fd2a40cec80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009e50 tx=0x7fd29c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2612dfb429ee7062 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.933+0000 7fd2a27fc640 1 -- 172.21.15.5:0/4012746169 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c036070 con 0x7fd2a40ce7f0 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.933+0000 7fd2a27fc640 1 -- 172.21.15.5:0/4012746169 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c031600 con 0x7fd2a40ce7f0 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.933+0000 7fd2a27fc640 1 -- 172.21.15.5:0/4012746169 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0319d0 con 0x7fd2a40ce7f0 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 -- 172.21.15.5:0/4012746169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a40ce7f0 msgr2=0x7fd2a40cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4012746169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a40ce7f0 0x7fd2a40cec80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009e50 tx=0x7fd29c02a710 comp rx=0 tx=0).stop 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 -- 172.21.15.5:0/4012746169 shutdown_connections 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4012746169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a40ce7f0 0x7fd2a40cec80 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4012746169 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a415de70 0x7fd2a40b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 -- 172.21.15.5:0/4012746169 >> 172.21.15.5:0/4012746169 conn(0x7fd2a406b000 msgr2=0x7fd2a406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 -- 172.21.15.5:0/4012746169 shutdown_connections 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.934+0000 7fd2a995c640 1 -- 172.21.15.5:0/4012746169 wait complete. 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.935+0000 7fd2a995c640 1 Processor -- start 2024-04-25T09:04:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.935+0000 7fd2a995c640 1 -- start start 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a995c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2a40b2cc0 0x7fd2a414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a995c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a40ce7f0 0x7fd2a40cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a995c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a415de70 0x7fd2a40c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a995c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b7300 con 0x7fd2a415de70 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a995c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b9920 con 0x7fd2a40b2cc0 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a995c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40d2ea0 con 0x7fd2a40ce7f0 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a415de70 0x7fd2a40c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a415de70 0x7fd2a40c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60526/0 (socket says 172.21.15.5:60526) 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4062414081 learned_addr learned my addr 172.21.15.5:0/4062414081 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a2ffd640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2a40b2cc0 0x7fd2a414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd29bfff640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a40ce7f0 0x7fd2a40cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a40ce7f0 msgr2=0x7fd2a40cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a40ce7f0 0x7fd2a40cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2a40b2cc0 msgr2=0x7fd2a414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2a40b2cc0 0x7fd2a414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 -- 172.21.15.5:0/4062414081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40cac40 con 0x7fd2a415de70 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a2ffd640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2a40b2cc0 0x7fd2a414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd29bfff640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a40ce7f0 0x7fd2a40cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a415de70 0x7fd2a40c9880 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009f70 tx=0x7fd29c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.936+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/4062414081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c03f020 con 0x7fd2a415de70 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.937+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/4062414081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c037040 con 0x7fd2a415de70 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.937+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a40caf20 con 0x7fd2a415de70 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.937+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/4062414081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c036070 con 0x7fd2a415de70 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.937+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a40cb4e0 con 0x7fd2a415de70 2024-04-25T09:04:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.937+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a404ef20 con 0x7fd2a415de70 2024-04-25T09:04:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.938+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/4062414081 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd29c042020 con 0x7fd2a415de70 2024-04-25T09:04:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.938+0000 7fd2a0ff9640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd28406b500 0x7fd28406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.939+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/4062414081 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd29c0aa600 con 0x7fd2a415de70 2024-04-25T09:04:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.939+0000 7fd2a2ffd640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd28406b500 0x7fd28406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.939+0000 7fd2a2ffd640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd28406b500 0x7fd28406d9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd294006fd0 tx=0x7fd294008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:42.943+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/4062414081 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd29c049030 con 0x7fd2a415de70 2024-04-25T09:04:43.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.161+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2a40cf6c0 con 0x7fd2a415de70 2024-04-25T09:04:43.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.162+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/4062414081 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fd29c0794d0 con 0x7fd2a415de70 2024-04-25T09:04:43.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:43.151 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:43.151 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:43.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.163+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd28406b500 msgr2=0x7fd28406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.163+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd28406b500 0x7fd28406d9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd294006fd0 tx=0x7fd294008040 comp rx=0 tx=0).stop 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a415de70 msgr2=0x7fd2a40c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a415de70 0x7fd2a40c9880 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009f70 tx=0x7fd29c004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 shutdown_connections 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd28406b500 0x7fd28406d9c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a415de70 0x7fd2a40c9880 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2a40ce7f0 0x7fd2a40cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 --2- 172.21.15.5:0/4062414081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2a40b2cc0 0x7fd2a414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 >> 172.21.15.5:0/4062414081 conn(0x7fd2a406b000 msgr2=0x7fd2a4158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 shutdown_connections 2024-04-25T09:04:43.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.164+0000 7fd2a995c640 1 -- 172.21.15.5:0/4062414081 wait complete. 2024-04-25T09:04:43.164 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:43.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.276+0000 7f545f007640 1 Processor -- start 2024-04-25T09:04:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.276+0000 7f545f007640 1 -- start start 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.276+0000 7f545f007640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54580668f0 0x7f5458066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.276+0000 7f545f007640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f545806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.276+0000 7f545f007640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5458067210 con 0x7f5458161fe0 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.276+0000 7f545f007640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54580b5740 con 0x7f54580668f0 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.276+0000 7f545f007640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580b5a20 con 0x7f5458162460 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f545cda3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54580668f0 0x7f5458066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f5457fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5458161fe0 0x7f54580b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37766/0 (socket says 172.21.15.5:37766) 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f5457fff640 1 -- 172.21.15.5:0/3098020781 learned_addr learned my addr 172.21.15.5:0/3098020781 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f545d5a4640 1 --2- 172.21.15.5:0/3098020781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f545806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f545cda3640 1 -- 172.21.15.5:0/3098020781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 msgr2=0x7f545806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f545cda3640 1 --2- 172.21.15.5:0/3098020781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f545806d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f545cda3640 1 -- 172.21.15.5:0/3098020781 >> v1:172.21.15.5:6789/0 conn(0x7f5458161fe0 legacy=0x7f54580b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f54577fe640 1 -- 172.21.15.5:0/3098020781 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135185139 0 0) 0x7f5458067210 con 0x7f5458161fe0 2024-04-25T09:04:43.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.277+0000 7f545cda3640 1 -- 172.21.15.5:0/3098020781 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580b5d00 con 0x7f54580668f0 2024-04-25T09:04:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545cda3640 1 --2- 172.21.15.5:0/3098020781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f5458066cd0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f544c0097a0 tx=0x7f544c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cf0aa97e51b35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f54577fe640 1 -- 172.21.15.5:0/3098020781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c037070 con 0x7f54580668f0 2024-04-25T09:04:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f54577fe640 1 -- 172.21.15.5:0/3098020781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c032440 con 0x7f54580668f0 2024-04-25T09:04:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f54577fe640 1 -- 172.21.15.5:0/3098020781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c032810 con 0x7f54580668f0 2024-04-25T09:04:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 -- 172.21.15.5:0/3098020781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 msgr2=0x7f5458066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 --2- 172.21.15.5:0/3098020781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f5458066cd0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f544c0097a0 tx=0x7f544c02a180 comp rx=0 tx=0).stop 2024-04-25T09:04:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 -- 172.21.15.5:0/3098020781 shutdown_connections 2024-04-25T09:04:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 --2- 172.21.15.5:0/3098020781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f545806d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 --2- 172.21.15.5:0/3098020781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f5458066cd0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 -- 172.21.15.5:0/3098020781 >> 172.21.15.5:0/3098020781 conn(0x7f54580b25d0 msgr2=0x7f54580b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 -- 172.21.15.5:0/3098020781 shutdown_connections 2024-04-25T09:04:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.278+0000 7f545f007640 1 -- 172.21.15.5:0/3098020781 wait complete. 2024-04-25T09:04:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 Processor -- start 2024-04-25T09:04:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 -- start start 2024-04-25T09:04:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f545815e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5458161fe0 0x7f54580cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f5458143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580b3fe0 con 0x7f54580668f0 2024-04-25T09:04:43.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458161ac0 con 0x7f5458161fe0 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.280+0000 7f545f007640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545806f030 con 0x7f5458162460 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f545815e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f545815e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60538/0 (socket says 172.21.15.5:60538) 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 -- 172.21.15.5:0/702548432 learned_addr learned my addr 172.21.15.5:0/702548432 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f5457fff640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5458161fe0 0x7f54580cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545d5a4640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f5458143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 -- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 msgr2=0x7f5458143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f5458143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 -- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5458161fe0 msgr2=0x7f54580cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5458161fe0 0x7f54580cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 -- 172.21.15.5:0/702548432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580cde10 con 0x7f54580668f0 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545cda3640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f545815e230 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f544c035040 tx=0x7f544c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f54557fa640 1 -- 172.21.15.5:0/702548432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c037040 con 0x7f54580668f0 2024-04-25T09:04:43.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f54557fa640 1 -- 172.21.15.5:0/702548432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c030770 con 0x7f54580668f0 2024-04-25T09:04:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545815e8a0 con 0x7f54580668f0 2024-04-25T09:04:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f54557fa640 1 -- 172.21.15.5:0/702548432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c030b80 con 0x7f54580668f0 2024-04-25T09:04:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.281+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545815ee60 con 0x7f54580668f0 2024-04-25T09:04:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.282+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54580b2380 con 0x7f54580668f0 2024-04-25T09:04:43.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.283+0000 7f54557fa640 1 -- 172.21.15.5:0/702548432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f544c044020 con 0x7f54580668f0 2024-04-25T09:04:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.283+0000 7f54557fa640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543c06b4d0 0x7f543c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.283+0000 7f54557fa640 1 -- 172.21.15.5:0/702548432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f544c0aa780 con 0x7f54580668f0 2024-04-25T09:04:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.284+0000 7f5457fff640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543c06b4d0 0x7f543c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.284+0000 7f5457fff640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543c06b4d0 0x7f543c06d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f54581f7730 tx=0x7f5444007b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.287+0000 7f54557fa640 1 -- 172.21.15.5:0/702548432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54580b2380 con 0x7f54580668f0 2024-04-25T09:04:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.538+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5458067f90 con 0x7f54580668f0 2024-04-25T09:04:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.539+0000 7f54557fa640 1 -- 172.21.15.5:0/702548432 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1770 (secure 0 0 0) 0x7f5458067f90 con 0x7f54580668f0 2024-04-25T09:04:43.528 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:43.528 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":503,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076563295,"bytes_used":2556272640,"bytes_avail":770537840640,"bytes_total":773094113280,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":174720,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":2097152,"num_keys_recovered":0,"write_bytes_sec":84761597,"read_op_per_sec":0,"write_op_per_sec":83},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-04-25T09:04:40.495120+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:04:43.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543c06b4d0 msgr2=0x7f543c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543c06b4d0 0x7f543c06d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f54581f7730 tx=0x7f5444007b50 comp rx=0 tx=0).stop 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 msgr2=0x7f545815e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f545815e230 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f544c035040 tx=0x7f544c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 shutdown_connections 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543c06b4d0 0x7f543c06d990 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5458162460 0x7f5458143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5458161fe0 0x7f54580cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 --2- 172.21.15.5:0/702548432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54580668f0 0x7f545815e230 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 >> 172.21.15.5:0/702548432 conn(0x7f54580b25d0 msgr2=0x7f54580b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 shutdown_connections 2024-04-25T09:04:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:43.541+0000 7f545f007640 1 -- 172.21.15.5:0/702548432 wait complete. 2024-04-25T09:04:43.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:04:44.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.666+0000 7f080c2b6640 1 Processor -- start 2024-04-25T09:04:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.666+0000 7f080c2b6640 1 -- start start 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f080c2b6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08040d3990 0x7f08040d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f080c2b6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08040b6f50 0x7f08040b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f080c2b6640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040b29c0 con 0x7f080415e0a0 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f080c2b6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040d4330 con 0x7f08040d3990 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f080c2b6640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040d1460 con 0x7f08040b6f50 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f0809851640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08040d3990 0x7f08040d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f0809851640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08040d3990 0x7f08040d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60546/0 (socket says 172.21.15.5:60546) 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f0809851640 1 -- 172.21.15.5:0/746447706 learned_addr learned my addr 172.21.15.5:0/746447706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.667+0000 7f080a853640 1 --2- 172.21.15.5:0/746447706 >> v2:172.21.15.80:3300/0 conn(0x7f08040b6f50 0x7f08040b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809851640 1 -- 172.21.15.5:0/746447706 >> v2:172.21.15.80:3300/0 conn(0x7f08040b6f50 msgr2=0x7f08040b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809851640 1 --2- 172.21.15.5:0/746447706 >> v2:172.21.15.80:3300/0 conn(0x7f08040b6f50 0x7f08040b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809851640 1 -- 172.21.15.5:0/746447706 >> v1:172.21.15.80:6789/0 conn(0x7f080415e0a0 legacy=0x7f08040d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809851640 1 -- 172.21.15.5:0/746447706 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040d2080 con 0x7f08040d3990 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f080a853640 1 --2- 172.21.15.5:0/746447706 >> v2:172.21.15.80:3300/0 conn(0x7f08040b6f50 0x7f08040b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809851640 1 --2- 172.21.15.5:0/746447706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040d3990 0x7f08040d3df0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f08040b34f0 tx=0x7f07f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca920568c6fd69fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809050640 1 -- 172.21.15.5:0/746447706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4037070 con 0x7f08040d3990 2024-04-25T09:04:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809050640 1 -- 172.21.15.5:0/746447706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4032440 con 0x7f08040d3990 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.668+0000 7f0809050640 1 -- 172.21.15.5:0/746447706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4032810 con 0x7f08040d3990 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 -- 172.21.15.5:0/746447706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040d3990 msgr2=0x7f08040d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 --2- 172.21.15.5:0/746447706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040d3990 0x7f08040d3df0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f08040b34f0 tx=0x7f07f402a230 comp rx=0 tx=0).stop 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 -- 172.21.15.5:0/746447706 shutdown_connections 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 --2- 172.21.15.5:0/746447706 >> v2:172.21.15.80:3300/0 conn(0x7f08040b6f50 0x7f08040b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 --2- 172.21.15.5:0/746447706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040d3990 0x7f08040d3df0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 -- 172.21.15.5:0/746447706 >> 172.21.15.5:0/746447706 conn(0x7f08040668f0 msgr2=0x7f0804066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 -- 172.21.15.5:0/746447706 shutdown_connections 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.669+0000 7f080c2b6640 1 -- 172.21.15.5:0/746447706 wait complete. 2024-04-25T09:04:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.670+0000 7f080c2b6640 1 Processor -- start 2024-04-25T09:04:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.670+0000 7f080c2b6640 1 -- start start 2024-04-25T09:04:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080c2b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040b6f50 0x7f08041591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080c2b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08040d3990 0x7f08040c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080c2b6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f080415e0a0 0x7f08040c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080c2b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040d2920 con 0x7f08040b6f50 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080c2b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040d2640 con 0x7f08040d3990 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080c2b6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08040d2c00 con 0x7f080415e0a0 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080a052640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040b6f50 0x7f08041591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080a052640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040b6f50 0x7f08041591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60558/0 (socket says 172.21.15.5:60558) 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080a052640 1 -- 172.21.15.5:0/1847354572 learned_addr learned my addr 172.21.15.5:0/1847354572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f0809851640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08040d3990 0x7f08040c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080a052640 1 -- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f080415e0a0 msgr2=0x7f08040c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080a853640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f080415e0a0 0x7f08040c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080a052640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f080415e0a0 0x7f08040c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.671+0000 7f080a052640 1 -- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08040d3990 msgr2=0x7f08040c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f080a052640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08040d3990 0x7f08040c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f080a052640 1 -- 172.21.15.5:0/1847354572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804159850 con 0x7f08040b6f50 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f080a853640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f080415e0a0 0x7f08040c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f0809851640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08040d3990 0x7f08040c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f080a052640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040b6f50 0x7f08041591c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f080000b3f0 tx=0x7f080000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f07faffd640 1 -- 172.21.15.5:0/1847354572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800015020 con 0x7f08040b6f50 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f07faffd640 1 -- 172.21.15.5:0/1847354572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800011830 con 0x7f08040b6f50 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f07faffd640 1 -- 172.21.15.5:0/1847354572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011c20 con 0x7f08040b6f50 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0804159b30 con 0x7f08040b6f50 2024-04-25T09:04:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.672+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080415a0f0 con 0x7f08040b6f50 2024-04-25T09:04:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.673+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08040ca000 con 0x7f08040b6f50 2024-04-25T09:04:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.674+0000 7f07faffd640 1 -- 172.21.15.5:0/1847354572 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0800018020 con 0x7f08040b6f50 2024-04-25T09:04:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.674+0000 7f07faffd640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07e806b4d0 0x7f07e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.674+0000 7f07faffd640 1 -- 172.21.15.5:0/1847354572 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0800089dd0 con 0x7f08040b6f50 2024-04-25T09:04:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.674+0000 7f0809851640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07e806b4d0 0x7f07e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.675+0000 7f0809851640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07e806b4d0 0x7f07e806d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f07f4034000 tx=0x7f07f402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.679+0000 7f07faffd640 1 -- 172.21.15.5:0/1847354572 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f080001f030 con 0x7f08040b6f50 2024-04-25T09:04:44.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.898+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f080404ef20 con 0x7f08040b6f50 2024-04-25T09:04:44.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.898+0000 7f07faffd640 1 -- 172.21.15.5:0/1847354572 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f080008b090 con 0x7f08040b6f50 2024-04-25T09:04:44.887 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:44.887 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:44.887 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07e806b4d0 msgr2=0x7f07e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07e806b4d0 0x7f07e806d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f07f4034000 tx=0x7f07f402e000 comp rx=0 tx=0).stop 2024-04-25T09:04:44.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040b6f50 msgr2=0x7f08041591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040b6f50 0x7f08041591c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f080000b3f0 tx=0x7f080000b8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 shutdown_connections 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f07e806b4d0 0x7f07e806d990 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f080415e0a0 0x7f08040c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08040d3990 0x7f08040c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 --2- 172.21.15.5:0/1847354572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08040b6f50 0x7f08041591c0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 >> 172.21.15.5:0/1847354572 conn(0x7f08040668f0 msgr2=0x7f08040b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 shutdown_connections 2024-04-25T09:04:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:44.900+0000 7f080c2b6640 1 -- 172.21.15.5:0/1847354572 wait complete. 2024-04-25T09:04:44.900 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:44.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:45.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.011+0000 7f4c7d0b6640 1 Processor -- start 2024-04-25T09:04:45.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.011+0000 7f4c7d0b6640 1 -- start start 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c7d0b6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 0x7f4c780b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c7d0b6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c780d20e0 con 0x7f4c780b7130 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c7d0b6640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c780d23c0 con 0x7f4c7815de70 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c7d0b6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780d2a10 con 0x7f4c780b2cc0 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c7759e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4c780b7130 0x7f4c780ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37770/0 (socket says 172.21.15.5:37770) 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c7759e640 1 -- 172.21.15.5:0/1293806689 learned_addr learned my addr 172.21.15.5:0/1293806689 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068752117 0 0) 0x7f4c780d20e0 con 0x7f4c780b7130 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c64003520 con 0x7f4c780b7130 2024-04-25T09:04:45.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c7659c640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 0x7f4c780b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2799806980 0 0) 0x7f4c64003520 con 0x7f4c780b7130 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 msgr2=0x7f4c780b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 0x7f4c780b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 >> v1:172.21.15.80:6789/0 conn(0x7f4c7815de70 legacy=0x7f4c780b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c780d26a0 con 0x7f4c780b7130 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.012+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f4c680019f0 con 0x7f4c780b7130 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 >> v1:172.21.15.5:6789/0 conn(0x7f4c780b7130 legacy=0x7f4c780ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c75d9b640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 0x7f4c640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c75d9b640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c64003f60 0x7f4c64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c75d9b640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c64004d40 0x7f4c640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780d2a10 con 0x7f4c64004d40 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6400baa0 con 0x7f4c64003f60 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6400bca0 con 0x7f4c780b2cc0 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c7759e640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c64004d40 0x7f4c640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c76d9d640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 0x7f4c640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c7659c640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c64003f60 0x7f4c64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c7759e640 1 -- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 msgr2=0x7f4c640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c7759e640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c780b2cc0 0x7f4c640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c7759e640 1 -- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c64003f60 msgr2=0x7f4c64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c7759e640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c64003f60 0x7f4c64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.013+0000 7f4c7759e640 1 -- 172.21.15.5:0/1293806689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c64003520 con 0x7f4c64004d40 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7759e640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c64004d40 0x7f4c640051c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800a860 tx=0x7f4c64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bce3263eda25b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800a480 con 0x7f4c64004d40 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6802f070 con 0x7f4c64004d40 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c75d9b640 1 -- 172.21.15.5:0/1293806689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6802bd40 con 0x7f4c64004d40 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/1293806689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c64004d40 msgr2=0x7f4c640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7d0b6640 1 --2- 172.21.15.5:0/1293806689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c64004d40 0x7f4c640051c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800a860 tx=0x7f4c64005830 comp rx=0 tx=0).stop 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7759e640 1 -- 172.21.15.5:0/1293806689 reap_dead start 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/1293806689 shutdown_connections 2024-04-25T09:04:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/1293806689 >> 172.21.15.5:0/1293806689 conn(0x7f4c7806b000 msgr2=0x7f4c7806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/1293806689 shutdown_connections 2024-04-25T09:04:45.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.014+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/1293806689 wait complete. 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.016+0000 7f4c7d0b6640 1 Processor -- start 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.016+0000 7f4c7d0b6640 1 -- start start 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7d0b6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c64004d40 0x7f4c780aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7d0b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c780b1f10 0x7f4c780b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7d0b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c780b4a50 0x7f4c780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7d0b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780b6bf0 con 0x7f4c780b1f10 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7d0b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780cf110 con 0x7f4c780b4a50 2024-04-25T09:04:45.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7d0b6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780b6d70 con 0x7f4c64004d40 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c780b1f10 0x7f4c780b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c780b1f10 0x7f4c780b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60578/0 (socket says 172.21.15.5:60578) 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 -- 172.21.15.5:0/3840292628 learned_addr learned my addr 172.21.15.5:0/3840292628 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7759e640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c780b4a50 0x7f4c780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c76d9d640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c64004d40 0x7f4c780aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 -- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c64004d40 msgr2=0x7f4c780aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c64004d40 0x7f4c780aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 -- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c780b4a50 msgr2=0x7f4c780b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c780b4a50 0x7f4c780b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 -- 172.21.15.5:0/3840292628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7815ace0 con 0x7f4c780b1f10 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7759e640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c780b4a50 0x7f4c780b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7659c640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c780b1f10 0x7f4c780b4510 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4c600119a0 tx=0x7f4c60011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/3840292628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000faf0 con 0x7f4c780b1f10 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/3840292628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000fc90 con 0x7f4c780b1f10 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7815afc0 con 0x7f4c780b1f10 2024-04-25T09:04:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.017+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/3840292628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60014440 con 0x7f4c780b1f10 2024-04-25T09:04:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.018+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7815b580 con 0x7f4c780b1f10 2024-04-25T09:04:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.018+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7804ef20 con 0x7f4c780b1f10 2024-04-25T09:04:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.019+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/3840292628 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c60012040 con 0x7f4c780b1f10 2024-04-25T09:04:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.019+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4c5806b4d0 0x7f4c5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.019+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/3840292628 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4c6008a800 con 0x7f4c780b1f10 2024-04-25T09:04:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.020+0000 7f4c76d9d640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4c5806b4d0 0x7f4c5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.020+0000 7f4c76d9d640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4c5806b4d0 0x7f4c5806d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4c700017e0 tx=0x7f4c70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.024+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/3840292628 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c60019030 con 0x7f4c780b1f10 2024-04-25T09:04:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.277+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4c780cf7c0 con 0x7f4c780b1f10 2024-04-25T09:04:45.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.278+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/3840292628 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f4c600596d0 con 0x7f4c780b1f10 2024-04-25T09:04:45.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:45.267 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":504,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076563295,"bytes_used":2556272640,"bytes_avail":770537840640,"bytes_total":773094113280,"write_bytes_sec":48187297,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-04-25T09:04:40.495120+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4c5806b4d0 msgr2=0x7f4c5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4c5806b4d0 0x7f4c5806d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4c700017e0 tx=0x7f4c70009040 comp rx=0 tx=0).stop 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c780b1f10 msgr2=0x7f4c780b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c780b1f10 0x7f4c780b4510 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4c600119a0 tx=0x7f4c60011e60 comp rx=0 tx=0).stop 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 shutdown_connections 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4c5806b4d0 0x7f4c5806d990 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c780b4a50 0x7f4c780b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c780b1f10 0x7f4c780b4510 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 --2- 172.21.15.5:0/3840292628 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c64004d40 0x7f4c780aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 >> 172.21.15.5:0/3840292628 conn(0x7f4c7806b000 msgr2=0x7f4c780c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 shutdown_connections 2024-04-25T09:04:45.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:45.280+0000 7f4c7d0b6640 1 -- 172.21.15.5:0/3840292628 wait complete. 2024-04-25T09:04:45.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:04:46.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.405+0000 7fcba6768640 1 Processor -- start 2024-04-25T09:04:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.405+0000 7fcba6768640 1 -- start start 2024-04-25T09:04:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcba6768640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcba00d3990 0x7fcba00d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcba6768640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcba00b6f50 0x7fcba00b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcba6768640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba00b29c0 con 0x7fcba015e0a0 2024-04-25T09:04:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcba6768640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba00d4330 con 0x7fcba00d3990 2024-04-25T09:04:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcba6768640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba00d1460 con 0x7fcba00b6f50 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcb9f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcba00d3990 0x7fcba00d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcb9f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcba00d3990 0x7fcba00d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60592/0 (socket says 172.21.15.5:60592) 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcb9f7fe640 1 -- 172.21.15.5:0/2022709229 learned_addr learned my addr 172.21.15.5:0/2022709229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcba4d05640 1 --2- 172.21.15.5:0/2022709229 >> v2:172.21.15.80:3300/0 conn(0x7fcba00b6f50 0x7fcba00b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcb9f7fe640 1 -- 172.21.15.5:0/2022709229 >> v2:172.21.15.80:3300/0 conn(0x7fcba00b6f50 msgr2=0x7fcba00b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcb9f7fe640 1 --2- 172.21.15.5:0/2022709229 >> v2:172.21.15.80:3300/0 conn(0x7fcba00b6f50 0x7fcba00b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcb9f7fe640 1 -- 172.21.15.5:0/2022709229 >> v1:172.21.15.80:6789/0 conn(0x7fcba015e0a0 legacy=0x7fcba00d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.406+0000 7fcb9f7fe640 1 -- 172.21.15.5:0/2022709229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00d2080 con 0x7fcba00d3990 2024-04-25T09:04:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.407+0000 7fcb9f7fe640 1 --2- 172.21.15.5:0/2022709229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00d3990 0x7fcba00d3df0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fcba00b34f0 tx=0x7fcb8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deddda6572e686ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.407+0000 7fcb9effd640 1 -- 172.21.15.5:0/2022709229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88037070 con 0x7fcba00d3990 2024-04-25T09:04:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.407+0000 7fcb9effd640 1 -- 172.21.15.5:0/2022709229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88032440 con 0x7fcba00d3990 2024-04-25T09:04:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.407+0000 7fcb9effd640 1 -- 172.21.15.5:0/2022709229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88032810 con 0x7fcba00d3990 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 -- 172.21.15.5:0/2022709229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00d3990 msgr2=0x7fcba00d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 --2- 172.21.15.5:0/2022709229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00d3990 0x7fcba00d3df0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fcba00b34f0 tx=0x7fcb8802a270 comp rx=0 tx=0).stop 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 -- 172.21.15.5:0/2022709229 shutdown_connections 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 --2- 172.21.15.5:0/2022709229 >> v2:172.21.15.80:3300/0 conn(0x7fcba00b6f50 0x7fcba00b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 --2- 172.21.15.5:0/2022709229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00d3990 0x7fcba00d3df0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 -- 172.21.15.5:0/2022709229 >> 172.21.15.5:0/2022709229 conn(0x7fcba00668f0 msgr2=0x7fcba0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 -- 172.21.15.5:0/2022709229 shutdown_connections 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.408+0000 7fcba6768640 1 -- 172.21.15.5:0/2022709229 wait complete. 2024-04-25T09:04:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.409+0000 7fcba6768640 1 Processor -- start 2024-04-25T09:04:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.409+0000 7fcba6768640 1 -- start start 2024-04-25T09:04:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba6768640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00b6f50 0x7fcba00b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba6768640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcba00d3990 0x7fcba015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba6768640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba015e0a0 0x7fcba00ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba6768640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00d2920 con 0x7fcba00b6f50 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba6768640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00d2640 con 0x7fcba015e0a0 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba6768640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00d2c00 con 0x7fcba00d3990 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00b6f50 0x7fcba00b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00b6f50 0x7fcba00b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60596/0 (socket says 172.21.15.5:60596) 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 -- 172.21.15.5:0/850779329 learned_addr learned my addr 172.21.15.5:0/850779329 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba4d05640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba015e0a0 0x7fcba00ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9f7fe640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcba00d3990 0x7fcba015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 -- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcba00d3990 msgr2=0x7fcba015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcba00d3990 0x7fcba015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 -- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba015e0a0 msgr2=0x7fcba00ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba015e0a0 0x7fcba00ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcb9ffff640 1 -- 172.21.15.5:0/850779329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00b43a0 con 0x7fcba00b6f50 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.410+0000 7fcba4d05640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba015e0a0 0x7fcba00ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.411+0000 7fcb9ffff640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00b6f50 0x7fcba00b5440 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c3c0 tx=0x7fcb9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.411+0000 7fcb9cff9640 1 -- 172.21.15.5:0/850779329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900052d0 con 0x7fcba00b6f50 2024-04-25T09:04:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.411+0000 7fcb9cff9640 1 -- 172.21.15.5:0/850779329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb90005490 con 0x7fcba00b6f50 2024-04-25T09:04:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.411+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba00b4680 con 0x7fcba00b6f50 2024-04-25T09:04:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.411+0000 7fcb9cff9640 1 -- 172.21.15.5:0/850779329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90007260 con 0x7fcba00b6f50 2024-04-25T09:04:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.411+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba00b4c40 con 0x7fcba00b6f50 2024-04-25T09:04:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.412+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba004ef20 con 0x7fcba00b6f50 2024-04-25T09:04:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.412+0000 7fcb9cff9640 1 -- 172.21.15.5:0/850779329 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb90007400 con 0x7fcba00b6f50 2024-04-25T09:04:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.413+0000 7fcb9cff9640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb8006b4d0 0x7fcb8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.413+0000 7fcb9cff9640 1 -- 172.21.15.5:0/850779329 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcb90089720 con 0x7fcba00b6f50 2024-04-25T09:04:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.413+0000 7fcb9f7fe640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb8006b4d0 0x7fcb8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.414+0000 7fcb9f7fe640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb8006b4d0 0x7fcb8006d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcb88034000 tx=0x7fcb8802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.417+0000 7fcb9cff9640 1 -- 172.21.15.5:0/850779329 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb90058560 con 0x7fcba00b6f50 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.634+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcba015ffb0 con 0x7fcba00b6f50 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.634+0000 7fcb9cff9640 1 -- 172.21.15.5:0/850779329 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fcb90057e60 con 0x7fcba00b6f50 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb8006b4d0 msgr2=0x7fcb8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb8006b4d0 0x7fcb8006d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcb88034000 tx=0x7fcb8802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00b6f50 msgr2=0x7fcba00b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00b6f50 0x7fcba00b5440 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c3c0 tx=0x7fcb9000c880 comp rx=0 tx=0).stop 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 shutdown_connections 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcb8006b4d0 0x7fcb8006d990 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba015e0a0 0x7fcba00ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcba00d3990 0x7fcba015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 --2- 172.21.15.5:0/850779329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba00b6f50 0x7fcba00b5440 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 >> 172.21.15.5:0/850779329 conn(0x7fcba00668f0 msgr2=0x7fcba00b8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 shutdown_connections 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.636+0000 7fcba6768640 1 -- 172.21.15.5:0/850779329 wait complete. 2024-04-25T09:04:46.635 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:46.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.747+0000 7f35f143f640 1 Processor -- start 2024-04-25T09:04:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.747+0000 7f35f143f640 1 -- start start 2024-04-25T09:04:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35f143f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec15de70 0x7f35ec0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35f143f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35ec0b2cc0 0x7f35ec0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35f143f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec0d20e0 con 0x7f35ec0b7130 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35f143f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0d2a10 con 0x7f35ec0b2cc0 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35f143f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0d23c0 con 0x7f35ec15de70 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35ea7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35ec0b2cc0 0x7f35ec0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35ea7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35ec0b2cc0 0x7f35ec0b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60612/0 (socket says 172.21.15.5:60612) 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35ea7fc640 1 -- 172.21.15.5:0/3394454024 learned_addr learned my addr 172.21.15.5:0/3394454024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35ea7fc640 1 -- 172.21.15.5:0/3394454024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec15de70 msgr2=0x7f35ec0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35eaffd640 1 --2- 172.21.15.5:0/3394454024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec15de70 0x7f35ec0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35ea7fc640 1 --2- 172.21.15.5:0/3394454024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec15de70 0x7f35ec0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35ea7fc640 1 -- 172.21.15.5:0/3394454024 >> v1:172.21.15.80:6789/0 conn(0x7f35ec0b7130 legacy=0x7f35ec0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.748+0000 7f35ea7fc640 1 -- 172.21.15.5:0/3394454024 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0d26a0 con 0x7f35ec0b2cc0 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.749+0000 7f35ea7fc640 1 --2- 172.21.15.5:0/3394454024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0b6bf0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009870 tx=0x7f35e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e4f755ccc44a18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.749+0000 7f35e9ffb640 1 -- 172.21.15.5:0/3394454024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0037070 con 0x7f35ec0b2cc0 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.749+0000 7f35e9ffb640 1 -- 172.21.15.5:0/3394454024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e0032440 con 0x7f35ec0b2cc0 2024-04-25T09:04:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.749+0000 7f35e9ffb640 1 -- 172.21.15.5:0/3394454024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0032810 con 0x7f35ec0b2cc0 2024-04-25T09:04:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 -- 172.21.15.5:0/3394454024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b2cc0 msgr2=0x7f35ec0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 --2- 172.21.15.5:0/3394454024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0b6bf0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009870 tx=0x7f35e002a210 comp rx=0 tx=0).stop 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 -- 172.21.15.5:0/3394454024 shutdown_connections 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 --2- 172.21.15.5:0/3394454024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0b6bf0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 --2- 172.21.15.5:0/3394454024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec15de70 0x7f35ec0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 -- 172.21.15.5:0/3394454024 >> 172.21.15.5:0/3394454024 conn(0x7f35ec06b000 msgr2=0x7f35ec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 -- 172.21.15.5:0/3394454024 shutdown_connections 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.750+0000 7f35f143f640 1 -- 172.21.15.5:0/3394454024 wait complete. 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.751+0000 7f35f143f640 1 Processor -- start 2024-04-25T09:04:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.751+0000 7f35f143f640 1 -- start start 2024-04-25T09:04:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35f143f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35f143f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec0b7130 0x7f35ec149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35f143f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec15de70 0x7f35ec0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35f143f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0cf080 con 0x7f35ec15de70 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35f143f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0cef00 con 0x7f35ec0b2cc0 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35f143f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0cf200 con 0x7f35ec0b7130 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec15de70 0x7f35ec0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec15de70 0x7f35ec0c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60618/0 (socket says 172.21.15.5:60618) 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 -- 172.21.15.5:0/984247092 learned_addr learned my addr 172.21.15.5:0/984247092 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35ea7fc640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec0b7130 0x7f35ec149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eaffd640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 -- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec0b7130 msgr2=0x7f35ec149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec0b7130 0x7f35ec149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 -- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ec0b2cc0 msgr2=0x7f35ec0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eb7fe640 1 -- 172.21.15.5:0/984247092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec14d850 con 0x7f35ec15de70 2024-04-25T09:04:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35ea7fc640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec0b7130 0x7f35ec149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.752+0000 7f35eaffd640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.753+0000 7f35eb7fe640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec15de70 0x7f35ec0c9c90 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c780 tx=0x7f35e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.753+0000 7f35d37fe640 1 -- 172.21.15.5:0/984247092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4004b60 con 0x7f35ec15de70 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.753+0000 7f35d37fe640 1 -- 172.21.15.5:0/984247092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e4004d00 con 0x7f35ec15de70 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.753+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec0c7ca0 con 0x7f35ec15de70 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.753+0000 7f35d37fe640 1 -- 172.21.15.5:0/984247092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400aa90 con 0x7f35ec15de70 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.753+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec14ada0 con 0x7f35ec15de70 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.754+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec04ef20 con 0x7f35ec15de70 2024-04-25T09:04:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.754+0000 7f35d37fe640 1 -- 172.21.15.5:0/984247092 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35e400ac30 con 0x7f35ec15de70 2024-04-25T09:04:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.755+0000 7f35d37fe640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f35d806b4d0 0x7f35d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.755+0000 7f35d37fe640 1 -- 172.21.15.5:0/984247092 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f35e408a4a0 con 0x7f35ec15de70 2024-04-25T09:04:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.755+0000 7f35eaffd640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f35d806b4d0 0x7f35d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.755+0000 7f35eaffd640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f35d806b4d0 0x7f35d806d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006fd0 tx=0x7f35dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:46.759+0000 7f35d37fe640 1 -- 172.21.15.5:0/984247092 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35e4020070 con 0x7f35ec15de70 2024-04-25T09:04:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.012+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f35ec0ce480 con 0x7f35ec15de70 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.012+0000 7f35d37fe640 1 -- 172.21.15.5:0/984247092 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f35e40592e0 con 0x7f35ec15de70 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":506,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076563295,"bytes_used":2556272640,"bytes_avail":770537840640,"bytes_total":773094113280,"write_bytes_sec":48187297,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-04-25T09:04:40.495120+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T09:04:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f35d806b4d0 msgr2=0x7f35d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f35d806b4d0 0x7f35d806d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006fd0 tx=0x7f35dc008040 comp rx=0 tx=0).stop 2024-04-25T09:04:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec15de70 msgr2=0x7f35ec0c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec15de70 0x7f35ec0c9c90 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c780 tx=0x7f35e400cc40 comp rx=0 tx=0).stop 2024-04-25T09:04:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 shutdown_connections 2024-04-25T09:04:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f35d806b4d0 0x7f35d806d990 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec15de70 0x7f35ec0c9c90 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f35ec0b7130 0x7f35ec149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 --2- 172.21.15.5:0/984247092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ec0b2cc0 0x7f35ec0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 >> 172.21.15.5:0/984247092 conn(0x7f35ec06b000 msgr2=0x7f35ec0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 shutdown_connections 2024-04-25T09:04:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:47.014+0000 7f35f143f640 1 -- 172.21.15.5:0/984247092 wait complete. 2024-04-25T09:04:47.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T09:04:47.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:47.516 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:48.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:48.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.135+0000 7f37bd26f640 1 Processor -- start 2024-04-25T09:04:48.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.135+0000 7f37bd26f640 1 -- start start 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37bd26f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 0x7f37b8161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37bd26f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b8161fc0 con 0x7f37b80cef60 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37bd26f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b81622a0 con 0x7f37b815dc70 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37bd26f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80d2180 con 0x7f37b80b94a0 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37affff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f37b80cef60 0x7f37b80d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37780/0 (socket says 172.21.15.5:37780) 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37affff640 1 -- 172.21.15.5:0/888783243 learned_addr learned my addr 172.21.15.5:0/888783243 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104890105 0 0) 0x7f37b8161fc0 con 0x7f37b80cef60 2024-04-25T09:04:48.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b77fe640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 0x7f37b8161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a4003520 con 0x7f37b80cef60 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2329191757 0 0) 0x7f37a4003520 con 0x7f37b80cef60 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 msgr2=0x7f37b8161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 0x7f37b8161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 >> v1:172.21.15.80:6789/0 conn(0x7f37b815dc70 legacy=0x7f37b80ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8162580 con 0x7f37b80cef60 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f37a0001670 con 0x7f37b80cef60 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 >> v1:172.21.15.5:6789/0 conn(0x7f37b80cef60 legacy=0x7f37b80d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 0x7f37a40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37a4003f20 0x7f37a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a4004d40 0x7f37a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a400b9f0 con 0x7f37a4004d40 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a400bba0 con 0x7f37a4003f20 2024-04-25T09:04:48.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.136+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a400bda0 con 0x7f37b80b94a0 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37b77fe640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a4004d40 0x7f37a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37affff640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37a4003f20 0x7f37a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37b6ffd640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 0x7f37a40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37b77fe640 1 -- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 msgr2=0x7f37a40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37b77fe640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b80b94a0 0x7f37a40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37b77fe640 1 -- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37a4003f20 msgr2=0x7f37a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37b77fe640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37a4003f20 0x7f37a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.137+0000 7f37b77fe640 1 -- 172.21.15.5:0/888783243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a4003520 con 0x7f37a4004d40 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37b77fe640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a4004d40 0x7f37a40051c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009fc0 tx=0x7f37a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b3ff32ed9f4404 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0009c10 con 0x7f37a4004d40 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0036070 con 0x7f37a4004d40 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37b67fc640 1 -- 172.21.15.5:0/888783243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0031880 con 0x7f37a4004d40 2024-04-25T09:04:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37bd26f640 1 -- 172.21.15.5:0/888783243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a4004d40 msgr2=0x7f37a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37bd26f640 1 --2- 172.21.15.5:0/888783243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a4004d40 0x7f37a40051c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009fc0 tx=0x7f37a4005830 comp rx=0 tx=0).stop 2024-04-25T09:04:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37b77fe640 1 -- 172.21.15.5:0/888783243 reap_dead start 2024-04-25T09:04:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37bd26f640 1 -- 172.21.15.5:0/888783243 shutdown_connections 2024-04-25T09:04:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37bd26f640 1 -- 172.21.15.5:0/888783243 >> 172.21.15.5:0/888783243 conn(0x7f37b80668f0 msgr2=0x7f37b8066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37bd26f640 1 -- 172.21.15.5:0/888783243 shutdown_connections 2024-04-25T09:04:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.138+0000 7f37bd26f640 1 -- 172.21.15.5:0/888783243 wait complete. 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 Processor -- start 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 -- start start 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37b81f3b10 0x7f37b81f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b81f3ef0 0x7f37b81f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37b814cba0 0x7f37b814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8161850 con 0x7f37b814cba0 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80d11f0 con 0x7f37b81f3b10 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37bd26f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81619d0 con 0x7f37b81f3ef0 2024-04-25T09:04:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37b814cba0 0x7f37b814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37b814cba0 0x7f37b814d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60626/0 (socket says 172.21.15.5:60626) 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.140+0000 7f37b77fe640 1 -- 172.21.15.5:0/332708742 learned_addr learned my addr 172.21.15.5:0/332708742 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37affff640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b81f3ef0 0x7f37b81f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b6ffd640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37b81f3b10 0x7f37b81f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b77fe640 1 -- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b81f3ef0 msgr2=0x7f37b81f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b77fe640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b81f3ef0 0x7f37b81f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b77fe640 1 -- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37b81f3b10 msgr2=0x7f37b81f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b77fe640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37b81f3b10 0x7f37b81f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b77fe640 1 -- 172.21.15.5:0/332708742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b814edb0 con 0x7f37b814cba0 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b6ffd640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37b81f3b10 0x7f37b81f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37affff640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b81f3ef0 0x7f37b81f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37b77fe640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37b814cba0 0x7f37b814d020 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f37b0033040 tx=0x7f37b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37af7fe640 1 -- 172.21.15.5:0/332708742 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0009c10 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37af7fe640 1 -- 172.21.15.5:0/332708742 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0031dd0 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b81f7490 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37af7fe640 1 -- 172.21.15.5:0/332708742 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0003bd0 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.141+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b81f7a50 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.142+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b804ef20 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.143+0000 7f37af7fe640 1 -- 172.21.15.5:0/332708742 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f37b0005d10 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.143+0000 7f37af7fe640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f379806b500 0x7f379806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.143+0000 7f37af7fe640 1 -- 172.21.15.5:0/332708742 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f37b00ab440 con 0x7f37b814cba0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.143+0000 7f37b6ffd640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f379806b500 0x7f379806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.144+0000 7f37b6ffd640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f379806b500 0x7f379806d9c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f37b80c7a10 tx=0x7f37a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.147+0000 7f37af7fe640 1 -- 172.21.15.5:0/332708742 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37b004a060 con 0x7f37b814cba0 2024-04-25T09:04:48.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.365+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37b80d1820 con 0x7f37b814cba0 2024-04-25T09:04:48.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.365+0000 7f37af7fe640 1 -- 172.21.15.5:0/332708742 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f37b007a280 con 0x7f37b814cba0 2024-04-25T09:04:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:48.354 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:48.354 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f379806b500 msgr2=0x7f379806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f379806b500 0x7f379806d9c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f37b80c7a10 tx=0x7f37a8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37b814cba0 msgr2=0x7f37b814d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37b814cba0 0x7f37b814d020 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f37b0033040 tx=0x7f37b0009750 comp rx=0 tx=0).stop 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 shutdown_connections 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f379806b500 0x7f379806d9c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37b814cba0 0x7f37b814d020 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37b81f3ef0 0x7f37b81f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 --2- 172.21.15.5:0/332708742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37b81f3b10 0x7f37b81f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 >> 172.21.15.5:0/332708742 conn(0x7f37b80668f0 msgr2=0x7f37b80b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 shutdown_connections 2024-04-25T09:04:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.367+0000 7f37bd26f640 1 -- 172.21.15.5:0/332708742 wait complete. 2024-04-25T09:04:48.366 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T09:04:48.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.477+0000 7f4d2b812640 1 Processor -- start 2024-04-25T09:04:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.477+0000 7f4d2b812640 1 -- start start 2024-04-25T09:04:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d2b812640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d240b2cc0 0x7f4d240b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d2b812640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d2b812640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d240d20e0 con 0x7f4d2415de70 2024-04-25T09:04:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d2b812640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240d2a10 con 0x7f4d240b2cc0 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d2b812640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240d23c0 con 0x7f4d240b7130 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d28dad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d240b2cc0 0x7f4d240b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d28dad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d240b2cc0 0x7f4d240b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60640/0 (socket says 172.21.15.5:60640) 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d28dad640 1 -- 172.21.15.5:0/3241925637 learned_addr learned my addr 172.21.15.5:0/3241925637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d29daf640 1 --2- 172.21.15.5:0/3241925637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d28dad640 1 -- 172.21.15.5:0/3241925637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 msgr2=0x7f4d240ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d28dad640 1 --2- 172.21.15.5:0/3241925637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d28dad640 1 -- 172.21.15.5:0/3241925637 >> v1:172.21.15.80:6789/0 conn(0x7f4d2415de70 legacy=0x7f4d240b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d28dad640 1 -- 172.21.15.5:0/3241925637 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240d26a0 con 0x7f4d240b2cc0 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.478+0000 7f4d29daf640 1 --2- 172.21.15.5:0/3241925637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.479+0000 7f4d28dad640 1 --2- 172.21.15.5:0/3241925637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b6bf0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009870 tx=0x7f4d1402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2722861ffd9b8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.479+0000 7f4d1bfff640 1 -- 172.21.15.5:0/3241925637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14037070 con 0x7f4d240b2cc0 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.479+0000 7f4d1bfff640 1 -- 172.21.15.5:0/3241925637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d14032440 con 0x7f4d240b2cc0 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.479+0000 7f4d1bfff640 1 -- 172.21.15.5:0/3241925637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14032810 con 0x7f4d240b2cc0 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 -- 172.21.15.5:0/3241925637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 msgr2=0x7f4d240b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 --2- 172.21.15.5:0/3241925637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b6bf0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009870 tx=0x7f4d1402a210 comp rx=0 tx=0).stop 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 -- 172.21.15.5:0/3241925637 shutdown_connections 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 --2- 172.21.15.5:0/3241925637 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 --2- 172.21.15.5:0/3241925637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b6bf0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 -- 172.21.15.5:0/3241925637 >> 172.21.15.5:0/3241925637 conn(0x7f4d2406b000 msgr2=0x7f4d2406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 -- 172.21.15.5:0/3241925637 shutdown_connections 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.480+0000 7f4d2b812640 1 -- 172.21.15.5:0/3241925637 wait complete. 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.481+0000 7f4d2b812640 1 Processor -- start 2024-04-25T09:04:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.481+0000 7f4d2b812640 1 -- start start 2024-04-25T09:04:48.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d2b812640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d2b812640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d2b812640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2415de70 0x7f4d241f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d2b812640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240cf100 con 0x7f4d240b2cc0 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d2b812640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240cef80 con 0x7f4d2415de70 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d2b812640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240d2ea0 con 0x7f4d240b7130 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60650/0 (socket says 172.21.15.5:60650) 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 -- 172.21.15.5:0/977753701 learned_addr learned my addr 172.21.15.5:0/977753701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d28dad640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d29daf640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2415de70 0x7f4d241f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 -- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 msgr2=0x7f4d240b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 -- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2415de70 msgr2=0x7f4d241f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2415de70 0x7f4d241f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 -- 172.21.15.5:0/977753701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240cd670 con 0x7f4d240b2cc0 2024-04-25T09:04:48.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.482+0000 7f4d295ae640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b56a0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b3f0 tx=0x7f4d2000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.483+0000 7f4d19ffb640 1 -- 172.21.15.5:0/977753701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20015020 con 0x7f4d240b2cc0 2024-04-25T09:04:48.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.483+0000 7f4d19ffb640 1 -- 172.21.15.5:0/977753701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20011830 con 0x7f4d240b2cc0 2024-04-25T09:04:48.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.483+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d240b3b10 con 0x7f4d240b2cc0 2024-04-25T09:04:48.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.483+0000 7f4d19ffb640 1 -- 172.21.15.5:0/977753701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011c20 con 0x7f4d240b2cc0 2024-04-25T09:04:48.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.483+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d240b40d0 con 0x7f4d240b2cc0 2024-04-25T09:04:48.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.484+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2404ef20 con 0x7f4d240b2cc0 2024-04-25T09:04:48.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.484+0000 7f4d19ffb640 1 -- 172.21.15.5:0/977753701 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d20018020 con 0x7f4d240b2cc0 2024-04-25T09:04:48.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.485+0000 7f4d19ffb640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d0806b4d0 0x7f4d0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.485+0000 7f4d19ffb640 1 -- 172.21.15.5:0/977753701 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4d20089ec0 con 0x7f4d240b2cc0 2024-04-25T09:04:48.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.485+0000 7f4d28dad640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d0806b4d0 0x7f4d0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.486+0000 7f4d28dad640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d0806b4d0 0x7f4d0806d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4d14034000 tx=0x7f4d1402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.489+0000 7f4d19ffb640 1 -- 172.21.15.5:0/977753701 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d2001f030 con 0x7f4d240b2cc0 2024-04-25T09:04:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.737+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4d240b5480 con 0x7f4d240b2cc0 2024-04-25T09:04:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.737+0000 7f4d19ffb640 1 -- 172.21.15.5:0/977753701 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1575 (secure 0 0 0) 0x7f4d240cd670 con 0x7f4d240b2cc0 2024-04-25T09:04:48.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:48.726 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":508,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076567642,"bytes_used":2556280832,"bytes_avail":770537832448,"bytes_total":773094113280,"write_bytes_sec":48188094,"read_op_per_sec":0,"write_op_per_sec":48},"fsmap":{"epoch":70,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8526}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-04-25T09:04:46.496936+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d0806b4d0 msgr2=0x7f4d0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d0806b4d0 0x7f4d0806d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4d14034000 tx=0x7f4d1402e000 comp rx=0 tx=0).stop 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 msgr2=0x7f4d240b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b56a0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b3f0 tx=0x7f4d2000b8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 shutdown_connections 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4d0806b4d0 0x7f4d0806d990 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2415de70 0x7f4d241f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4d240b7130 0x7f4d240b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 --2- 172.21.15.5:0/977753701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240b2cc0 0x7f4d240b56a0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 >> 172.21.15.5:0/977753701 conn(0x7f4d2406b000 msgr2=0x7f4d2415e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 shutdown_connections 2024-04-25T09:04:48.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:48.739+0000 7f4d2b812640 1 -- 172.21.15.5:0/977753701 wait complete. 2024-04-25T09:04:48.738 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:04:48.739 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:04:48.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:48.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:48.835 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:04:48.835 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:48.835 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:48.852 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:48.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:48.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.060+0000 7ff3e36f5640 1 Processor -- start 2024-04-25T09:04:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.061+0000 7ff3e36f5640 1 -- start start 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.061+0000 7ff3e36f5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3dc15e0a0 0x7ff3dc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.061+0000 7ff3e36f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3dc0d3df0 0x7ff3dc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.061+0000 7ff3e36f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc0b7f60 con 0x7ff3dc0d3990 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.061+0000 7ff3e36f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc0b29c0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.061+0000 7ff3e36f5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc0d2080 con 0x7ff3dc15e0a0 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.061+0000 7ff3e1c92640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3dc0d3df0 0x7ff3dc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3e0c90640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff3dc0d3990 0x7ff3dc0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37796/0 (socket says 172.21.15.5:37796) 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3e0c90640 1 -- 172.21.15.5:0/1642327286 learned_addr learned my addr 172.21.15.5:0/1642327286 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3e1491640 1 --2- 172.21.15.5:0/1642327286 >> v2:172.21.15.80:3300/0 conn(0x7ff3dc15e0a0 0x7ff3dc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3e1c92640 1 -- 172.21.15.5:0/1642327286 >> v2:172.21.15.80:3300/0 conn(0x7ff3dc15e0a0 msgr2=0x7ff3dc0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3e1c92640 1 --2- 172.21.15.5:0/1642327286 >> v2:172.21.15.80:3300/0 conn(0x7ff3dc15e0a0 0x7ff3dc0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3e1c92640 1 -- 172.21.15.5:0/1642327286 >> v1:172.21.15.5:6789/0 conn(0x7ff3dc0d3990 legacy=0x7ff3dc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3d3fff640 1 -- 172.21.15.5:0/1642327286 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567601708 0 0) 0x7ff3dc0b7f60 con 0x7ff3dc0d3990 2024-04-25T09:04:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.062+0000 7ff3e1c92640 1 -- 172.21.15.5:0/1642327286 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc0d2360 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e1c92640 1 --2- 172.21.15.5:0/1642327286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0cecf0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0b6680 tx=0x7ff3d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e280fa637ce7e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3d3fff640 1 -- 172.21.15.5:0/1642327286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4007740 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3d3fff640 1 -- 172.21.15.5:0/1642327286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d40078e0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3d3fff640 1 -- 172.21.15.5:0/1642327286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4007cb0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1642327286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 msgr2=0x7ff3dc0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1642327286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0cecf0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0b6680 tx=0x7ff3d402a680 comp rx=0 tx=0).stop 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1642327286 shutdown_connections 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1642327286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0cecf0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1642327286 >> v2:172.21.15.80:3300/0 conn(0x7ff3dc15e0a0 0x7ff3dc0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1642327286 >> 172.21.15.5:0/1642327286 conn(0x7ff3dc0668f0 msgr2=0x7ff3dc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1642327286 shutdown_connections 2024-04-25T09:04:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.063+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1642327286 wait complete. 2024-04-25T09:04:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 Processor -- start 2024-04-25T09:04:49.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 -- start start 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3dc0d3990 0x7ff3dc154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc15e0a0 0x7ff3dc1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc0d2c00 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc0d2920 con 0x7ff3dc15e0a0 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e36f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc0d4280 con 0x7ff3dc0d3990 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e0c90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e0c90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60668/0 (socket says 172.21.15.5:60668) 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.065+0000 7ff3e0c90640 1 -- 172.21.15.5:0/1189904695 learned_addr learned my addr 172.21.15.5:0/1189904695 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e1c92640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc15e0a0 0x7ff3dc1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e1491640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3dc0d3990 0x7ff3dc154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e0c90640 1 -- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3dc0d3990 msgr2=0x7ff3dc154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e0c90640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3dc0d3990 0x7ff3dc154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e0c90640 1 -- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc15e0a0 msgr2=0x7ff3dc1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e0c90640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc15e0a0 0x7ff3dc1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e0c90640 1 -- 172.21.15.5:0/1189904695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc0cde00 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e1c92640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc15e0a0 0x7ff3dc1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e0c90640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0caba0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c430 tx=0x7ff3cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3d1ffb640 1 -- 172.21.15.5:0/1189904695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0074e0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3d1ffb640 1 -- 172.21.15.5:0/1189904695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc0047e0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc0ce0e0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3d1ffb640 1 -- 172.21.15.5:0/1189904695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc004bd0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.066+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc0ce6a0 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.067+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc04ef20 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.068+0000 7ff3d1ffb640 1 -- 172.21.15.5:0/1189904695 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff3cc011070 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.068+0000 7ff3d1ffb640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.068+0000 7ff3d1ffb640 1 -- 172.21.15.5:0/1189904695 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff3cc089f00 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.068+0000 7ff3e1491640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.069+0000 7ff3e1491640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff3c006b4d0 0x7ff3c006d990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc1556e0 tx=0x7ff3d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.072+0000 7ff3d1ffb640 1 -- 172.21.15.5:0/1189904695 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff3cc058d40 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.253+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3dc0b8d60 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.254+0000 7ff3d1ffb640 1 -- 172.21.15.5:0/1189904695 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16636 (secure 0 0 0) 0x7ff3cc058640 con 0x7ff3dc0d3df0 2024-04-25T09:04:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:49.243 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:28.155947+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:17.415000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:18.131219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.256+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff3c006b4d0 msgr2=0x7ff3c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.256+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff3c006b4d0 0x7ff3c006d990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc1556e0 tx=0x7ff3d8008040 comp rx=0 tx=0).stop 2024-04-25T09:04:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.256+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 msgr2=0x7ff3dc0caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.256+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0caba0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c430 tx=0x7ff3cc00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 shutdown_connections 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc15e0a0 0x7ff3dc1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc0d3df0 0x7ff3dc0caba0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 --2- 172.21.15.5:0/1189904695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff3dc0d3990 0x7ff3dc154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 >> 172.21.15.5:0/1189904695 conn(0x7ff3dc0668f0 msgr2=0x7ff3dc15d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 shutdown_connections 2024-04-25T09:04:49.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.257+0000 7ff3e36f5640 1 -- 172.21.15.5:0/1189904695 wait complete. 2024-04-25T09:04:49.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:17.415000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:18.131219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:49.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:49.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.371+0000 7fb8b40dd640 1 Processor -- start 2024-04-25T09:04:49.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.371+0000 7fb8b40dd640 1 -- start start 2024-04-25T09:04:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.372+0000 7fb8b40dd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.372+0000 7fb8b40dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8ac066d50 0x7fb8ac06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.372+0000 7fb8b40dd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac0b3a00 con 0x7fb8ac0668f0 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.372+0000 7fb8b40dd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac072410 con 0x7fb8ac066d50 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.372+0000 7fb8b40dd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0af260 con 0x7fb8ac15dc00 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.372+0000 7fb8b267a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8ac066d50 0x7fb8ac06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b267a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8ac066d50 0x7fb8ac06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60680/0 (socket says 172.21.15.5:60680) 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b267a640 1 -- 172.21.15.5:0/1014223817 learned_addr learned my addr 172.21.15.5:0/1014223817 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b1e79640 1 --2- 172.21.15.5:0/1014223817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b267a640 1 -- 172.21.15.5:0/1014223817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 msgr2=0x7fb8ac0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b267a640 1 --2- 172.21.15.5:0/1014223817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b267a640 1 -- 172.21.15.5:0/1014223817 >> v1:172.21.15.80:6789/0 conn(0x7fb8ac0668f0 legacy=0x7fb8ac06abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b267a640 1 -- 172.21.15.5:0/1014223817 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0b3ce0 con 0x7fb8ac066d50 2024-04-25T09:04:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.373+0000 7fb8b267a640 1 --2- 172.21.15.5:0/1014223817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac066d50 0x7fb8ac06b2f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009e50 tx=0x7fb8a402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0df7f5eded4df5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b0e77640 1 -- 172.21.15.5:0/1014223817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4036070 con 0x7fb8ac066d50 2024-04-25T09:04:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b0e77640 1 -- 172.21.15.5:0/1014223817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4031600 con 0x7fb8ac066d50 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b0e77640 1 -- 172.21.15.5:0/1014223817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40319d0 con 0x7fb8ac066d50 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 -- 172.21.15.5:0/1014223817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac066d50 msgr2=0x7fb8ac06b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/1014223817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac066d50 0x7fb8ac06b2f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009e50 tx=0x7fb8a402a710 comp rx=0 tx=0).stop 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 -- 172.21.15.5:0/1014223817 shutdown_connections 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/1014223817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac066d50 0x7fb8ac06b2f0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/1014223817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 -- 172.21.15.5:0/1014223817 >> 172.21.15.5:0/1014223817 conn(0x7fb8ac0b2560 msgr2=0x7fb8ac0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 -- 172.21.15.5:0/1014223817 shutdown_connections 2024-04-25T09:04:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.374+0000 7fb8b40dd640 1 -- 172.21.15.5:0/1014223817 wait complete. 2024-04-25T09:04:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.375+0000 7fb8b40dd640 1 Processor -- start 2024-04-25T09:04:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b40dd640 1 -- start start 2024-04-25T09:04:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b40dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac0668f0 0x7fb8ac14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b40dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8ac066d50 0x7fb8ac148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b40dd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b40dd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac06d450 con 0x7fb8ac0668f0 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b40dd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0671e0 con 0x7fb8ac066d50 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b40dd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac15dfe0 con 0x7fb8ac15dc00 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b1e79640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac0668f0 0x7fb8ac14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b1e79640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac0668f0 0x7fb8ac14ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60696/0 (socket says 172.21.15.5:60696) 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.376+0000 7fb8b1e79640 1 -- 172.21.15.5:0/2623609817 learned_addr learned my addr 172.21.15.5:0/2623609817 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b267a640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1678640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8ac066d50 0x7fb8ac148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1e79640 1 -- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 msgr2=0x7fb8ac149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1e79640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1e79640 1 -- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8ac066d50 msgr2=0x7fb8ac148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1e79640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8ac066d50 0x7fb8ac148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1e79640 1 -- 172.21.15.5:0/2623609817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac160160 con 0x7fb8ac0668f0 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b267a640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1678640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8ac066d50 0x7fb8ac148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b1e79640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac0668f0 0x7fb8ac14ca60 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e870 tx=0x7fb8a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8a27fc640 1 -- 172.21.15.5:0/2623609817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8017070 con 0x7fb8ac0668f0 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8a27fc640 1 -- 172.21.15.5:0/2623609817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800c940 con 0x7fb8ac0668f0 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac146c90 con 0x7fb8ac0668f0 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8a27fc640 1 -- 172.21.15.5:0/2623609817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800cd30 con 0x7fb8ac0668f0 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.377+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac147250 con 0x7fb8ac0668f0 2024-04-25T09:04:49.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.378+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac04ef20 con 0x7fb8ac0668f0 2024-04-25T09:04:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.379+0000 7fb8a27fc640 1 -- 172.21.15.5:0/2623609817 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8a801a070 con 0x7fb8ac0668f0 2024-04-25T09:04:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.379+0000 7fb8a27fc640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb89006b4d0 0x7fb89006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.379+0000 7fb8a27fc640 1 -- 172.21.15.5:0/2623609817 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb8a808a3d0 con 0x7fb8ac0668f0 2024-04-25T09:04:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.379+0000 7fb8b1678640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb89006b4d0 0x7fb89006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.380+0000 7fb8b1678640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb89006b4d0 0x7fb89006d990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb89c007fd0 tx=0x7fb89c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.383+0000 7fb8a27fc640 1 -- 172.21.15.5:0/2623609817 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8a80592a0 con 0x7fb8ac0668f0 2024-04-25T09:04:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.563+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8ac0ae4c0 con 0x7fb8ac0668f0 2024-04-25T09:04:49.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.563+0000 7fb8a27fc640 1 -- 172.21.15.5:0/2623609817 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8a8058ba0 con 0x7fb8ac0668f0 2024-04-25T09:04:49.552 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb89006b4d0 msgr2=0x7fb89006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb89006b4d0 0x7fb89006d990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb89c007fd0 tx=0x7fb89c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac0668f0 msgr2=0x7fb8ac14ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac0668f0 0x7fb8ac14ca60 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e870 tx=0x7fb8a800ed30 comp rx=0 tx=0).stop 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 shutdown_connections 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb89006b4d0 0x7fb89006d990 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb8ac15dc00 0x7fb8ac149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8ac066d50 0x7fb8ac148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 --2- 172.21.15.5:0/2623609817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac0668f0 0x7fb8ac14ca60 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 >> 172.21.15.5:0/2623609817 conn(0x7fb8ac0b2560 msgr2=0x7fb8ac06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 shutdown_connections 2024-04-25T09:04:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.565+0000 7fb8b40dd640 1 -- 172.21.15.5:0/2623609817 wait complete. 2024-04-25T09:04:49.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:49.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.680+0000 7fb812fb0640 1 Processor -- start 2024-04-25T09:04:49.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.680+0000 7fb812fb0640 1 -- start start 2024-04-25T09:04:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb812fb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 0x7fb80c168f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb812fb0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c0cce90 con 0x7fb80c15e0b0 2024-04-25T09:04:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb812fb0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c0d27f0 con 0x7fb80c0d0c80 2024-04-25T09:04:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb812fb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0cfee0 con 0x7fb80c06adf0 2024-04-25T09:04:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb810d4c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb80c15e0b0 0x7fb80c0cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37806/0 (socket says 172.21.15.5:37806) 2024-04-25T09:04:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb810d4c640 1 -- 172.21.15.5:0/2591335721 learned_addr learned my addr 172.21.15.5:0/2591335721 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332170568 0 0) 0x7fb80c0cce90 con 0x7fb80c15e0b0 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb81154d640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 0x7fb80c168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7fc003520 con 0x7fb80c15e0b0 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2634442427 0 0) 0x7fb7fc003520 con 0x7fb80c15e0b0 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 msgr2=0x7fb80c168f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 0x7fb80c168f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 >> v1:172.21.15.80:6789/0 conn(0x7fb80c0d0c80 legacy=0x7fb80c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0d01c0 con 0x7fb80c15e0b0 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb800001670 con 0x7fb80c15e0b0 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 >> v1:172.21.15.5:6789/0 conn(0x7fb80c15e0b0 legacy=0x7fb80c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 0x7fb7fc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc003f20 0x7fb7fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7fc004d40 0x7fb7fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0cfee0 con 0x7fb7fc004d40 2024-04-25T09:04:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc00ba20 con 0x7fb7fc003f20 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.681+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc00bc20 con 0x7fb80c06adf0 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb81154d640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7fc004d40 0x7fb7fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb810d4c640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 0x7fb7fc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb80bfff640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc003f20 0x7fb7fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb81154d640 1 -- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 msgr2=0x7fb7fc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb81154d640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb80c06adf0 0x7fb7fc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb81154d640 1 -- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc003f20 msgr2=0x7fb7fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb81154d640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc003f20 0x7fb7fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.682+0000 7fb81154d640 1 -- 172.21.15.5:0/2591335721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc003520 con 0x7fb7fc004d40 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb81154d640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7fc004d40 0x7fb7fc0051c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fb804009fc0 tx=0x7fb7fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f7738541a521ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804009c10 con 0x7fb7fc004d40 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb804036070 con 0x7fb7fc004d40 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb80b7fe640 1 -- 172.21.15.5:0/2591335721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804031880 con 0x7fb7fc004d40 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb812fb0640 1 -- 172.21.15.5:0/2591335721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7fc004d40 msgr2=0x7fb7fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb812fb0640 1 --2- 172.21.15.5:0/2591335721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7fc004d40 0x7fb7fc0051c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fb804009fc0 tx=0x7fb7fc005830 comp rx=0 tx=0).stop 2024-04-25T09:04:49.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb81154d640 1 -- 172.21.15.5:0/2591335721 reap_dead start 2024-04-25T09:04:49.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb812fb0640 1 -- 172.21.15.5:0/2591335721 shutdown_connections 2024-04-25T09:04:49.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb812fb0640 1 -- 172.21.15.5:0/2591335721 >> 172.21.15.5:0/2591335721 conn(0x7fb80c0d1a20 msgr2=0x7fb80c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb812fb0640 1 -- 172.21.15.5:0/2591335721 shutdown_connections 2024-04-25T09:04:49.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.683+0000 7fb812fb0640 1 -- 172.21.15.5:0/2591335721 wait complete. 2024-04-25T09:04:49.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.684+0000 7fb812fb0640 1 Processor -- start 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.684+0000 7fb812fb0640 1 -- start start 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb812fb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7fc004d40 0x7fb80c09f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb812fb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb80c1f4130 0x7fb80c09bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb812fb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb80c157db0 0x7fb80c158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb812fb0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c15e490 con 0x7fb80c1f4130 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb812fb0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0d0780 con 0x7fb80c157db0 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb812fb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0cfb90 con 0x7fb7fc004d40 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb80bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb80c1f4130 0x7fb80c09bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb80bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb80c1f4130 0x7fb80c09bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60718/0 (socket says 172.21.15.5:60718) 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.685+0000 7fb80bfff640 1 -- 172.21.15.5:0/102271555 learned_addr learned my addr 172.21.15.5:0/102271555 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb81154d640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb80c157db0 0x7fb80c158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb810d4c640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7fc004d40 0x7fb80c09f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb80bfff640 1 -- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7fc004d40 msgr2=0x7fb80c09f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb80bfff640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7fc004d40 0x7fb80c09f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb80bfff640 1 -- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb80c157db0 msgr2=0x7fb80c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb80bfff640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb80c157db0 0x7fb80c158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb80bfff640 1 -- 172.21.15.5:0/102271555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c158750 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb81154d640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb80c157db0 0x7fb80c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb810d4c640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7fc004d40 0x7fb80c09f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb80bfff640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb80c1f4130 0x7fb80c09bfa0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800f7f0 tx=0x7fb7f800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb8097fa640 1 -- 172.21.15.5:0/102271555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80052e0 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb8097fa640 1 -- 172.21.15.5:0/102271555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f8018070 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c1f48d0 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb8097fa640 1 -- 172.21.15.5:0/102271555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800d970 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.686+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c1f4e90 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.687+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c04ef20 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.688+0000 7fb8097fa640 1 -- 172.21.15.5:0/102271555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb7f800db10 con 0x7fb80c1f4130 2024-04-25T09:04:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.688+0000 7fb8097fa640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7f006b4d0 0x7fb7f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.688+0000 7fb8097fa640 1 -- 172.21.15.5:0/102271555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb7f808a1f0 con 0x7fb80c1f4130 2024-04-25T09:04:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.688+0000 7fb810d4c640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7f006b4d0 0x7fb7f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.689+0000 7fb810d4c640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7f006b4d0 0x7fb7f006d990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb800007cd0 tx=0x7fb800009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.692+0000 7fb8097fa640 1 -- 172.21.15.5:0/102271555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7f801a310 con 0x7fb80c1f4130 2024-04-25T09:04:49.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.869+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb80c0b79a0 con 0x7fb80c1f4130 2024-04-25T09:04:49.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.869+0000 7fb8097fa640 1 -- 172.21.15.5:0/102271555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7f8059030 con 0x7fb80c1f4130 2024-04-25T09:04:49.858 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:04:49.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7f006b4d0 msgr2=0x7fb7f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7f006b4d0 0x7fb7f006d990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb800007cd0 tx=0x7fb800009040 comp rx=0 tx=0).stop 2024-04-25T09:04:49.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb80c1f4130 msgr2=0x7fb80c09bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb80c1f4130 0x7fb80c09bfa0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800f7f0 tx=0x7fb7f800fcb0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 shutdown_connections 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7f006b4d0 0x7fb7f006d990 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb80c157db0 0x7fb80c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb80c1f4130 0x7fb80c09bfa0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 --2- 172.21.15.5:0/102271555 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7fc004d40 0x7fb80c09f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 >> 172.21.15.5:0/102271555 conn(0x7fb80c0d1a20 msgr2=0x7fb80c0b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 shutdown_connections 2024-04-25T09:04:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.872+0000 7fb812fb0640 1 -- 172.21.15.5:0/102271555 wait complete. 2024-04-25T09:04:49.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.986+0000 7f3b3ee93640 1 Processor -- start 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.986+0000 7f3b3ee93640 1 -- start start 2024-04-25T09:04:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.986+0000 7f3b3ee93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380cefe0 0x7f3b38168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.986+0000 7f3b3ee93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b38162150 con 0x7f3b3815df10 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.986+0000 7f3b3ee93640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b38162430 con 0x7f3b380b6250 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.986+0000 7f3b3ee93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380d20d0 con 0x7f3b380cefe0 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b3cc2f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b3815df10 0x7f3b381618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37812/0 (socket says 172.21.15.5:37812) 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b3cc2f640 1 -- 172.21.15.5:0/2062491857 learned_addr learned my addr 172.21.15.5:0/2062491857 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b3d430640 1 --2- 172.21.15.5:0/2062491857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380cefe0 0x7f3b38168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675662953 0 0) 0x7f3b38162150 con 0x7f3b3815df10 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b28003520 con 0x7f3b3815df10 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494452268 0 0) 0x7f3b38162430 con 0x7f3b380b6250 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b38162150 con 0x7f3b380b6250 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007683760 0 0) 0x7f3b28003520 con 0x7f3b3815df10 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b3d430640 1 -- 172.21.15.5:0/2062491857 >> v1:172.21.15.80:6789/0 conn(0x7f3b380b6250 legacy=0x7f3b380ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b3d430640 1 -- 172.21.15.5:0/2062491857 >> v1:172.21.15.5:6789/0 conn(0x7f3b3815df10 legacy=0x7f3b381618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.987+0000 7f3b3d430640 1 -- 172.21.15.5:0/2062491857 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38162710 con 0x7f3b380cefe0 2024-04-25T09:04:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.988+0000 7f3b3d430640 1 --2- 172.21.15.5:0/2062491857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380cefe0 0x7f3b38168c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009dc0 tx=0x7f3b3002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dffad5e199f7ef91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.988+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c001670 con 0x7f3b380cefe0 2024-04-25T09:04:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.988+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b30007540 con 0x7f3b380cefe0 2024-04-25T09:04:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.988+0000 7f3b377fe640 1 -- 172.21.15.5:0/2062491857 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300078f0 con 0x7f3b380cefe0 2024-04-25T09:04:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.989+0000 7f3b3ee93640 1 -- 172.21.15.5:0/2062491857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380cefe0 msgr2=0x7f3b38168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.989+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/2062491857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380cefe0 0x7f3b38168c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009dc0 tx=0x7f3b3002a660 comp rx=0 tx=0).stop 2024-04-25T09:04:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.989+0000 7f3b3ee93640 1 -- 172.21.15.5:0/2062491857 shutdown_connections 2024-04-25T09:04:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.989+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/2062491857 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380cefe0 0x7f3b38168c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.989+0000 7f3b3ee93640 1 -- 172.21.15.5:0/2062491857 >> 172.21.15.5:0/2062491857 conn(0x7f3b380668f0 msgr2=0x7f3b38066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.989+0000 7f3b3ee93640 1 -- 172.21.15.5:0/2062491857 shutdown_connections 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.989+0000 7f3b3ee93640 1 -- 172.21.15.5:0/2062491857 wait complete. 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.990+0000 7f3b3ee93640 1 Processor -- start 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.990+0000 7f3b3ee93640 1 -- start start 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380b6250 0x7f3b380c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b380cefe0 0x7f3b381560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3815df10 0x7f3b380cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380d36f0 con 0x7f3b3815df10 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380d3570 con 0x7f3b380cefe0 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380d3870 con 0x7f3b380b6250 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3815df10 0x7f3b380cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3815df10 0x7f3b380cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60722/0 (socket says 172.21.15.5:60722) 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 -- 172.21.15.5:0/1287385244 learned_addr learned my addr 172.21.15.5:0/1287385244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b37fff640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b380cefe0 0x7f3b381560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 -- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380b6250 msgr2=0x7f3b380c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380b6250 0x7f3b380c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 -- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b380cefe0 msgr2=0x7f3b381560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b380cefe0 0x7f3b381560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 -- 172.21.15.5:0/1287385244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b381f7860 con 0x7f3b3815df10 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b37fff640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b380cefe0 0x7f3b381560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3d430640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3815df10 0x7f3b380cccb0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009ee0 tx=0x7f3b30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b357fa640 1 -- 172.21.15.5:0/1287385244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30009450 con 0x7f3b3815df10 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b357fa640 1 -- 172.21.15.5:0/1287385244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b30004240 con 0x7f3b3815df10 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b381f7b00 con 0x7f3b3815df10 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b357fa640 1 -- 172.21.15.5:0/1287385244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300045f0 con 0x7f3b3815df10 2024-04-25T09:04:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.991+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b381f80c0 con 0x7f3b3815df10 2024-04-25T09:04:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.992+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3804ef20 con 0x7f3b3815df10 2024-04-25T09:04:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.993+0000 7f3b357fa640 1 -- 172.21.15.5:0/1287385244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b30039040 con 0x7f3b3815df10 2024-04-25T09:04:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.993+0000 7f3b357fa640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b1c06b4d0 0x7f3b1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.993+0000 7f3b357fa640 1 -- 172.21.15.5:0/1287385244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3b300ab770 con 0x7f3b3815df10 2024-04-25T09:04:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.994+0000 7f3b3cc2f640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b1c06b4d0 0x7f3b1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.994+0000 7f3b3cc2f640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b1c06b4d0 0x7f3b1c06d990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c001d70 tx=0x7f3b2c000f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:49.997+0000 7f3b357fa640 1 -- 172.21.15.5:0/1287385244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b30040030 con 0x7f3b3815df10 2024-04-25T09:04:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.180+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b380b6030 con 0x7f3b3815df10 2024-04-25T09:04:50.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.181+0000 7f3b357fa640 1 -- 172.21.15.5:0/1287385244 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b3007a5b0 con 0x7f3b3815df10 2024-04-25T09:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b1c06b4d0 msgr2=0x7f3b1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b1c06b4d0 0x7f3b1c06d990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c001d70 tx=0x7f3b2c000f90 comp rx=0 tx=0).stop 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3815df10 msgr2=0x7f3b380cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3815df10 0x7f3b380cccb0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009ee0 tx=0x7f3b30004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 shutdown_connections 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b1c06b4d0 0x7f3b1c06d990 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3815df10 0x7f3b380cccb0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3b380cefe0 0x7f3b381560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 --2- 172.21.15.5:0/1287385244 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3b380b6250 0x7f3b380c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 >> 172.21.15.5:0/1287385244 conn(0x7f3b380668f0 msgr2=0x7f3b380b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 shutdown_connections 2024-04-25T09:04:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.183+0000 7f3b3ee93640 1 -- 172.21.15.5:0/1287385244 wait complete. 2024-04-25T09:04:50.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:50.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.296+0000 7f8959734640 1 Processor -- start 2024-04-25T09:04:50.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.296+0000 7f8959734640 1 -- start start 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f8959734640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8954161fe0 0x7f89540b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f8959734640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89540b5740 con 0x7f89540668f0 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f8959734640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89540b5a20 con 0x7f89540b3e10 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f8959734640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89540b5d00 con 0x7f8954161fe0 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f8952ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89540668f0 0x7f8954066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37822/0 (socket says 172.21.15.5:37822) 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f8952ffd640 1 -- 172.21.15.5:0/2359378153 learned_addr learned my addr 172.21.15.5:0/2359378153 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f894bfff640 1 --2- 172.21.15.5:0/2359378153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8954161fe0 0x7f89540b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f89527fc640 1 -- 172.21.15.5:0/2359378153 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263976038 0 0) 0x7f89540b5740 con 0x7f89540668f0 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f89527fc640 1 -- 172.21.15.5:0/2359378153 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8940003520 con 0x7f89540668f0 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f89527fc640 1 -- 172.21.15.5:0/2359378153 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052118461 0 0) 0x7f89540b5a20 con 0x7f89540b3e10 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f89527fc640 1 -- 172.21.15.5:0/2359378153 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89540b5740 con 0x7f89540b3e10 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f894bfff640 1 -- 172.21.15.5:0/2359378153 >> v1:172.21.15.80:6789/0 conn(0x7f89540b3e10 legacy=0x7f895406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f894bfff640 1 -- 172.21.15.5:0/2359378153 >> v1:172.21.15.5:6789/0 conn(0x7f89540668f0 legacy=0x7f8954066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.297+0000 7f894bfff640 1 -- 172.21.15.5:0/2359378153 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89541617e0 con 0x7f8954161fe0 2024-04-25T09:04:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.298+0000 7f894bfff640 1 --2- 172.21.15.5:0/2359378153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8954161fe0 0x7f89540b38d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f893c009800 tx=0x7f893c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c1f23f7d07d50f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.298+0000 7f89527fc640 1 -- 172.21.15.5:0/2359378153 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c037070 con 0x7f8954161fe0 2024-04-25T09:04:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.298+0000 7f89527fc640 1 -- 172.21.15.5:0/2359378153 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c032440 con 0x7f8954161fe0 2024-04-25T09:04:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.298+0000 7f89527fc640 1 -- 172.21.15.5:0/2359378153 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c032810 con 0x7f8954161fe0 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.299+0000 7f8959734640 1 -- 172.21.15.5:0/2359378153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8954161fe0 msgr2=0x7f89540b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.299+0000 7f8959734640 1 --2- 172.21.15.5:0/2359378153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8954161fe0 0x7f89540b38d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f893c009800 tx=0x7f893c02a230 comp rx=0 tx=0).stop 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.299+0000 7f8959734640 1 -- 172.21.15.5:0/2359378153 shutdown_connections 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.299+0000 7f8959734640 1 --2- 172.21.15.5:0/2359378153 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8954161fe0 0x7f89540b38d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.299+0000 7f8959734640 1 -- 172.21.15.5:0/2359378153 >> 172.21.15.5:0/2359378153 conn(0x7f89540b25d0 msgr2=0x7f89540b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.299+0000 7f8959734640 1 -- 172.21.15.5:0/2359378153 shutdown_connections 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.299+0000 7f8959734640 1 -- 172.21.15.5:0/2359378153 wait complete. 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.300+0000 7f8959734640 1 Processor -- start 2024-04-25T09:04:50.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.300+0000 7f8959734640 1 -- start start 2024-04-25T09:04:50.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f8959734640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89540668f0 0x7f89541597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f8959734640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89540b3e10 0x7f89540aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f8959734640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8954161fe0 0x7f895415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f8959734640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895406f1b0 con 0x7f89540b3e10 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f8959734640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895406f030 con 0x7f8954161fe0 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f8959734640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895406dbb0 con 0x7f89540668f0 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89540b3e10 0x7f89540aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89540b3e10 0x7f89540aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60726/0 (socket says 172.21.15.5:60726) 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 -- 172.21.15.5:0/2551747768 learned_addr learned my addr 172.21.15.5:0/2551747768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f8952ffd640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89540668f0 0x7f89541597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f89537fe640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8954161fe0 0x7f895415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 -- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89540668f0 msgr2=0x7f89541597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89540668f0 0x7f89541597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 -- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8954161fe0 msgr2=0x7f895415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8954161fe0 0x7f895415e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f894bfff640 1 -- 172.21.15.5:0/2551747768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89541457d0 con 0x7f89540b3e10 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.301+0000 7f89537fe640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8954161fe0 0x7f895415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.302+0000 7f894bfff640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89540b3e10 0x7f89540aec30 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f893c02a820 tx=0x7f893c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.302+0000 7f894b7fe640 1 -- 172.21.15.5:0/2551747768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c041020 con 0x7f89540b3e10 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.302+0000 7f894b7fe640 1 -- 172.21.15.5:0/2551747768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c03d700 con 0x7f89540b3e10 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.302+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8954145ab0 con 0x7f89540b3e10 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.302+0000 7f894b7fe640 1 -- 172.21.15.5:0/2551747768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c037040 con 0x7f89540b3e10 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.302+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8954146070 con 0x7f89540b3e10 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.303+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895404ef20 con 0x7f89540b3e10 2024-04-25T09:04:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.303+0000 7f894b7fe640 1 -- 172.21.15.5:0/2551747768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f893c044020 con 0x7f89540b3e10 2024-04-25T09:04:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.304+0000 7f894b7fe640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f893406b4d0 0x7f893406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.304+0000 7f894b7fe640 1 -- 172.21.15.5:0/2551747768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f893c0aa860 con 0x7f89540b3e10 2024-04-25T09:04:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.304+0000 7f8952ffd640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f893406b4d0 0x7f893406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.304+0000 7f8952ffd640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f893406b4d0 0x7f893406d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8944000f60 tx=0x7f8944007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.308+0000 7f894b7fe640 1 -- 172.21.15.5:0/2551747768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f893c04b030 con 0x7f89540b3e10 2024-04-25T09:04:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.500+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8954071c30 con 0x7f89540b3e10 2024-04-25T09:04:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.500+0000 7f894b7fe640 1 -- 172.21.15.5:0/2551747768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) v1 ==== 80+0+0 (secure 0 0 0) 0x7f893c0796b0 con 0x7f89540b3e10 2024-04-25T09:04:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T09:04:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f893406b4d0 msgr2=0x7f893406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f893406b4d0 0x7f893406d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8944000f60 tx=0x7f8944007d70 comp rx=0 tx=0).stop 2024-04-25T09:04:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89540b3e10 msgr2=0x7f89540aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89540b3e10 0x7f89540aec30 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f893c02a820 tx=0x7f893c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 shutdown_connections 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f893406b4d0 0x7f893406d990 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8954161fe0 0x7f895415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89540b3e10 0x7f89540aec30 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 --2- 172.21.15.5:0/2551747768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f89540668f0 0x7f89541597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 >> 172.21.15.5:0/2551747768 conn(0x7f89540b25d0 msgr2=0x7f895406d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 shutdown_connections 2024-04-25T09:04:50.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:50.502+0000 7f8959734640 1 -- 172.21.15.5:0/2551747768 wait complete. 2024-04-25T09:04:50.502 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:04:50.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:50.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:51.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:04:51.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:51.175 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:04:51.190 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:04:51.190 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:51.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:51.206 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:04:51.206 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:51.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:51.246 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:04:51.247 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:51.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:51.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:51.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.399+0000 7f3641cd8640 1 Processor -- start 2024-04-25T09:04:51.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.399+0000 7f3641cd8640 1 -- start start 2024-04-25T09:04:51.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.399+0000 7f3641cd8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f363c0b2cc0 0x7f363c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.399+0000 7f3641cd8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f363c0b7130 0x7f363c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.399+0000 7f3641cd8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c0d20e0 con 0x7f363c15de70 2024-04-25T09:04:51.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.399+0000 7f3641cd8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c0d2a10 con 0x7f363c0b2cc0 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.399+0000 7f3641cd8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c0d23c0 con 0x7f363c0b7130 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f363c0b2cc0 0x7f363c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f363c0b2cc0 0x7f363c0b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46658/0 (socket says 172.21.15.5:46658) 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363affd640 1 -- 172.21.15.5:0/622287695 learned_addr learned my addr 172.21.15.5:0/622287695 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363bfff640 1 --2- 172.21.15.5:0/622287695 >> v2:172.21.15.80:3300/0 conn(0x7f363c0b7130 0x7f363c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363affd640 1 -- 172.21.15.5:0/622287695 >> v2:172.21.15.80:3300/0 conn(0x7f363c0b7130 msgr2=0x7f363c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363affd640 1 --2- 172.21.15.5:0/622287695 >> v2:172.21.15.80:3300/0 conn(0x7f363c0b7130 0x7f363c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363affd640 1 -- 172.21.15.5:0/622287695 >> v1:172.21.15.80:6789/0 conn(0x7f363c15de70 legacy=0x7f363c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363affd640 1 -- 172.21.15.5:0/622287695 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0d26a0 con 0x7f363c0b2cc0 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.400+0000 7f363bfff640 1 --2- 172.21.15.5:0/622287695 >> v2:172.21.15.80:3300/0 conn(0x7f363c0b7130 0x7f363c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f363affd640 1 --2- 172.21.15.5:0/622287695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c0b6bf0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f362c009870 tx=0x7f362c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22db9fcaf641b8bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f363a7fc640 1 -- 172.21.15.5:0/622287695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c037070 con 0x7f363c0b2cc0 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f363a7fc640 1 -- 172.21.15.5:0/622287695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c032440 con 0x7f363c0b2cc0 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f363a7fc640 1 -- 172.21.15.5:0/622287695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c032810 con 0x7f363c0b2cc0 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 -- 172.21.15.5:0/622287695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 msgr2=0x7f363c0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 --2- 172.21.15.5:0/622287695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c0b6bf0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f362c009870 tx=0x7f362c02a270 comp rx=0 tx=0).stop 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 -- 172.21.15.5:0/622287695 shutdown_connections 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 --2- 172.21.15.5:0/622287695 >> v2:172.21.15.80:3300/0 conn(0x7f363c0b7130 0x7f363c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 --2- 172.21.15.5:0/622287695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c0b6bf0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 -- 172.21.15.5:0/622287695 >> 172.21.15.5:0/622287695 conn(0x7f363c06b000 msgr2=0x7f363c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 -- 172.21.15.5:0/622287695 shutdown_connections 2024-04-25T09:04:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.401+0000 7f3641cd8640 1 -- 172.21.15.5:0/622287695 wait complete. 2024-04-25T09:04:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.403+0000 7f3641cd8640 1 Processor -- start 2024-04-25T09:04:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.403+0000 7f3641cd8640 1 -- start start 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.403+0000 7f3641cd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3641cd8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f363c0b7130 0x7f363c0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3641cd8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f363c15de70 0x7f363c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3641cd8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0cf0c0 con 0x7f363c0b2cc0 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3641cd8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0cef40 con 0x7f363c0b7130 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3641cd8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0b4080 con 0x7f363c15de70 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c1f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46662/0 (socket says 172.21.15.5:46662) 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 -- 172.21.15.5:0/4271865343 learned_addr learned my addr 172.21.15.5:0/4271865343 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363affd640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f363c0b7130 0x7f363c0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363bfff640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f363c15de70 0x7f363c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 -- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f363c15de70 msgr2=0x7f363c0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f363c15de70 0x7f363c0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 -- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f363c0b7130 msgr2=0x7f363c0c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f363c0b7130 0x7f363c0c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 -- 172.21.15.5:0/4271865343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0c9610 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f363b7fe640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c1f36e0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f363000b3f0 tx=0x7f363000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3623fff640 1 -- 172.21.15.5:0/4271865343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630015020 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3623fff640 1 -- 172.21.15.5:0/4271865343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630011830 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c0c98f0 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3623fff640 1 -- 172.21.15.5:0/4271865343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011c20 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.404+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c0cce00 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.405+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c0c9e10 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.406+0000 7f3623fff640 1 -- 172.21.15.5:0/4271865343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3630018020 con 0x7f363c0b2cc0 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.406+0000 7f3623fff640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f362806b4d0 0x7f362806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.406+0000 7f3623fff640 1 -- 172.21.15.5:0/4271865343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3630089d30 con 0x7f363c0b2cc0 2024-04-25T09:04:51.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.407+0000 7f363affd640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f362806b4d0 0x7f362806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.407+0000 7f363affd640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f362806b4d0 0x7f362806d990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f362c034000 tx=0x7f362c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.411+0000 7f3623fff640 1 -- 172.21.15.5:0/4271865343 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f363001f030 con 0x7f363c0b2cc0 2024-04-25T09:04:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.630+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f363c04ef20 con 0x7f363c0b2cc0 2024-04-25T09:04:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.630+0000 7f3623fff640 1 -- 172.21.15.5:0/4271865343 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f3630058520 con 0x7f363c0b2cc0 2024-04-25T09:04:51.619 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:51.619 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f362806b4d0 msgr2=0x7f362806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f362806b4d0 0x7f362806d990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f362c034000 tx=0x7f362c02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 msgr2=0x7f363c1f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c1f36e0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f363000b3f0 tx=0x7f363000b8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 shutdown_connections 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f362806b4d0 0x7f362806d990 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f363c15de70 0x7f363c0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f363c0b7130 0x7f363c0c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 --2- 172.21.15.5:0/4271865343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c0b2cc0 0x7f363c1f36e0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.632+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 >> 172.21.15.5:0/4271865343 conn(0x7f363c06b000 msgr2=0x7f363c0b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.633+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 shutdown_connections 2024-04-25T09:04:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.633+0000 7f3641cd8640 1 -- 172.21.15.5:0/4271865343 wait complete. 2024-04-25T09:04:51.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:51.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.744+0000 7f0d45a1c640 1 Processor -- start 2024-04-25T09:04:51.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d45a1c640 1 -- start start 2024-04-25T09:04:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d45a1c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d4015de70 0x7f0d400b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d45a1c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b2cc0 0x7f0d400b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d45a1c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d400b7130 0x7f0d400ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d45a1c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400d2a10 con 0x7f0d400b7130 2024-04-25T09:04:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d45a1c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400d20e0 con 0x7f0d4015de70 2024-04-25T09:04:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d45a1c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400d23c0 con 0x7f0d400b2cc0 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.745+0000 7f0d3f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d400b7130 0x7f0d400ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d400b7130 0x7f0d400ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46664/0 (socket says 172.21.15.5:46664) 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 -- 172.21.15.5:0/3247292716 learned_addr learned my addr 172.21.15.5:0/3247292716 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3effd640 1 --2- 172.21.15.5:0/3247292716 >> v2:172.21.15.80:3300/0 conn(0x7f0d4015de70 0x7f0d400b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3e7fc640 1 --2- 172.21.15.5:0/3247292716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b2cc0 0x7f0d400b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 -- 172.21.15.5:0/3247292716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b2cc0 msgr2=0x7f0d400b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 --2- 172.21.15.5:0/3247292716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b2cc0 0x7f0d400b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 -- 172.21.15.5:0/3247292716 >> v2:172.21.15.80:3300/0 conn(0x7f0d4015de70 msgr2=0x7f0d400b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 --2- 172.21.15.5:0/3247292716 >> v2:172.21.15.80:3300/0 conn(0x7f0d4015de70 0x7f0d400b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 -- 172.21.15.5:0/3247292716 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400d26a0 con 0x7f0d400b7130 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3e7fc640 1 --2- 172.21.15.5:0/3247292716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b2cc0 0x7f0d400b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3effd640 1 --2- 172.21.15.5:0/3247292716 >> v2:172.21.15.80:3300/0 conn(0x7f0d4015de70 0x7f0d400b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.746+0000 7f0d3f7fe640 1 --2- 172.21.15.5:0/3247292716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b7130 0x7f0d400ce7f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f0d400d1650 tx=0x7f0d3002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793449e9caf1e036 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d3dffb640 1 -- 172.21.15.5:0/3247292716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30036070 con 0x7f0d400b7130 2024-04-25T09:04:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d3dffb640 1 -- 172.21.15.5:0/3247292716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30031600 con 0x7f0d400b7130 2024-04-25T09:04:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d3dffb640 1 -- 172.21.15.5:0/3247292716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300319d0 con 0x7f0d400b7130 2024-04-25T09:04:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3247292716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b7130 msgr2=0x7f0d400ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3247292716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b7130 0x7f0d400ce7f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f0d400d1650 tx=0x7f0d3002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3247292716 shutdown_connections 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3247292716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b7130 0x7f0d400ce7f0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3247292716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b2cc0 0x7f0d400b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3247292716 >> v2:172.21.15.80:3300/0 conn(0x7f0d4015de70 0x7f0d400b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3247292716 >> 172.21.15.5:0/3247292716 conn(0x7f0d4006b000 msgr2=0x7f0d4006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3247292716 shutdown_connections 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.747+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3247292716 wait complete. 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.748+0000 7f0d45a1c640 1 Processor -- start 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d45a1c640 1 -- start start 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d45a1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b2cc0 0x7f0d40156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d45a1c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b7130 0x7f0d40160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d45a1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4015de70 0x7f0d40160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d45a1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400ceeb0 con 0x7f0d400b2cc0 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d45a1c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400ced30 con 0x7f0d4015de70 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d45a1c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400cf030 con 0x7f0d400b7130 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d3effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b2cc0 0x7f0d40156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d3effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b2cc0 0x7f0d40156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46666/0 (socket says 172.21.15.5:46666) 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.749+0000 7f0d3effd640 1 -- 172.21.15.5:0/3808944691 learned_addr learned my addr 172.21.15.5:0/3808944691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3f7fe640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4015de70 0x7f0d40160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3e7fc640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b7130 0x7f0d40160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3effd640 1 -- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b7130 msgr2=0x7f0d40160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3effd640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b7130 0x7f0d40160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3effd640 1 -- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4015de70 msgr2=0x7f0d40160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3effd640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4015de70 0x7f0d40160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3effd640 1 -- 172.21.15.5:0/3808944691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400cd8e0 con 0x7f0d400b2cc0 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d3effd640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b2cc0 0x7f0d40156ca0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c7f0 tx=0x7f0d3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d37fff640 1 -- 172.21.15.5:0/3808944691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38015070 con 0x7f0d400b2cc0 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d37fff640 1 -- 172.21.15.5:0/3808944691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d38007820 con 0x7f0d400b2cc0 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d400c7e80 con 0x7f0d400b2cc0 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d37fff640 1 -- 172.21.15.5:0/3808944691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38007bd0 con 0x7f0d400b2cc0 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.750+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d40157610 con 0x7f0d400b2cc0 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.751+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4004ef20 con 0x7f0d400b2cc0 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.751+0000 7f0d37fff640 1 -- 172.21.15.5:0/3808944691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d38018070 con 0x7f0d400b2cc0 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.752+0000 7f0d37fff640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0d2006b4d0 0x7f0d2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.752+0000 7f0d37fff640 1 -- 172.21.15.5:0/3808944691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0d3808a0b0 con 0x7f0d400b2cc0 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.752+0000 7f0d3e7fc640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0d2006b4d0 0x7f0d2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.753+0000 7f0d3e7fc640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0d2006b4d0 0x7f0d2006d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0d40157c50 tx=0x7f0d28008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.756+0000 7f0d37fff640 1 -- 172.21.15.5:0/3808944691 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d380588a0 con 0x7f0d400b2cc0 2024-04-25T09:04:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.940+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d400b6c90 con 0x7f0d400b2cc0 2024-04-25T09:04:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.941+0000 7f0d37fff640 1 -- 172.21.15.5:0/3808944691 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f0d3805c940 con 0x7f0d400b2cc0 2024-04-25T09:04:51.930 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:51.930 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:28.155947+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:17.415000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:18.131219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0d2006b4d0 msgr2=0x7f0d2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0d2006b4d0 0x7f0d2006d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0d40157c50 tx=0x7f0d28008040 comp rx=0 tx=0).stop 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b2cc0 msgr2=0x7f0d40156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b2cc0 0x7f0d40156ca0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c7f0 tx=0x7f0d3800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 shutdown_connections 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0d2006b4d0 0x7f0d2006d990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4015de70 0x7f0d40160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0d400b7130 0x7f0d40160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 --2- 172.21.15.5:0/3808944691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d400b2cc0 0x7f0d40156ca0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 >> 172.21.15.5:0/3808944691 conn(0x7f0d4006b000 msgr2=0x7f0d4015e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 shutdown_connections 2024-04-25T09:04:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:51.943+0000 7f0d45a1c640 1 -- 172.21.15.5:0/3808944691 wait complete. 2024-04-25T09:04:51.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:17.415000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:18.131219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:51.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.058+0000 7f4c06f10640 1 Processor -- start 2024-04-25T09:04:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.058+0000 7f4c06f10640 1 -- start start 2024-04-25T09:04:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.059+0000 7f4c06f10640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c0015df10 0x7f4c001618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.059+0000 7f4c06f10640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c00162150 con 0x7f4c000cefe0 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.059+0000 7f4c06f10640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c00162430 con 0x7f4c000b6250 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.059+0000 7f4c06f10640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000d20d0 con 0x7f4c0015df10 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.059+0000 7f4c04cac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c0015df10 0x7f4c001618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.059+0000 7f4c054ad640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4c000cefe0 0x7f4c000d2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53258/0 (socket says 172.21.15.5:53258) 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.059+0000 7f4c054ad640 1 -- 172.21.15.5:0/3684760437 learned_addr learned my addr 172.21.15.5:0/3684760437 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.060+0000 7f4c04cac640 1 -- 172.21.15.5:0/3684760437 >> v1:172.21.15.80:6789/0 conn(0x7f4c000b6250 legacy=0x7f4c000ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.060+0000 7f4c04cac640 1 -- 172.21.15.5:0/3684760437 >> v1:172.21.15.5:6789/0 conn(0x7f4c000cefe0 legacy=0x7f4c000d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.060+0000 7f4bff7fe640 1 -- 172.21.15.5:0/3684760437 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365373314 0 0) 0x7f4c00162150 con 0x7f4c000cefe0 2024-04-25T09:04:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.060+0000 7f4c04cac640 1 -- 172.21.15.5:0/3684760437 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00162710 con 0x7f4c0015df10 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.060+0000 7f4c04cac640 1 --2- 172.21.15.5:0/3684760437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c001618d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009d90 tx=0x7f4bf802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3311556121b408b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4bff7fe640 1 -- 172.21.15.5:0/3684760437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8007740 con 0x7f4c0015df10 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4bff7fe640 1 -- 172.21.15.5:0/3684760437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf80078e0 con 0x7f4c0015df10 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4bff7fe640 1 -- 172.21.15.5:0/3684760437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8007cb0 con 0x7f4c0015df10 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4c06f10640 1 -- 172.21.15.5:0/3684760437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 msgr2=0x7f4c001618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4c06f10640 1 --2- 172.21.15.5:0/3684760437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c001618d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009d90 tx=0x7f4bf802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4c06f10640 1 -- 172.21.15.5:0/3684760437 shutdown_connections 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4c06f10640 1 --2- 172.21.15.5:0/3684760437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c001618d0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4c06f10640 1 -- 172.21.15.5:0/3684760437 >> 172.21.15.5:0/3684760437 conn(0x7f4c000668f0 msgr2=0x7f4c00066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4c06f10640 1 -- 172.21.15.5:0/3684760437 shutdown_connections 2024-04-25T09:04:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.061+0000 7f4c06f10640 1 -- 172.21.15.5:0/3684760437 wait complete. 2024-04-25T09:04:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.062+0000 7f4c06f10640 1 Processor -- start 2024-04-25T09:04:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.062+0000 7f4c06f10640 1 -- start start 2024-04-25T09:04:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c06f10640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c000b6250 0x7f4c0014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c06f10640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c000cefe0 0x7f4c000cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c06f10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c000b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c06f10640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000d2c70 con 0x7f4c0015df10 2024-04-25T09:04:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c06f10640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00161e10 con 0x7f4c000cefe0 2024-04-25T09:04:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c06f10640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000d2df0 con 0x7f4c000b6250 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c054ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c000b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c054ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c000b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46692/0 (socket says 172.21.15.5:46692) 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4c054ad640 1 -- 172.21.15.5:0/2504081593 learned_addr learned my addr 172.21.15.5:0/2504081593 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.063+0000 7f4bfffff640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c000cefe0 0x7f4c000cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c04cac640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c000b6250 0x7f4c0014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c054ad640 1 -- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c000b6250 msgr2=0x7f4c0014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c054ad640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c000b6250 0x7f4c0014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c054ad640 1 -- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c000cefe0 msgr2=0x7f4c000cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c054ad640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c000cefe0 0x7f4c000cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c054ad640 1 -- 172.21.15.5:0/2504081593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000c8de0 con 0x7f4c0015df10 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c054ad640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c000b4ea0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000c480 tx=0x7f4bf000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4bfd7fa640 1 -- 172.21.15.5:0/2504081593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0018070 con 0x7f4c0015df10 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4bfd7fa640 1 -- 172.21.15.5:0/2504081593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf00074e0 con 0x7f4c0015df10 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4bfd7fa640 1 -- 172.21.15.5:0/2504081593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0004a20 con 0x7f4c0015df10 2024-04-25T09:04:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c000cde70 con 0x7f4c0015df10 2024-04-25T09:04:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.064+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c000c7330 con 0x7f4c0015df10 2024-04-25T09:04:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.065+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0004ef20 con 0x7f4c0015df10 2024-04-25T09:04:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.066+0000 7f4bfd7fa640 1 -- 172.21.15.5:0/2504081593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4bf0004bc0 con 0x7f4c0015df10 2024-04-25T09:04:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.066+0000 7f4bfd7fa640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bec06b4d0 0x7f4bec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.066+0000 7f4bfd7fa640 1 -- 172.21.15.5:0/2504081593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4bf00894c0 con 0x7f4c0015df10 2024-04-25T09:04:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.066+0000 7f4c04cac640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bec06b4d0 0x7f4bec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.067+0000 7f4c04cac640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bec06b4d0 0x7f4bec06d990 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8034000 tx=0x7f4bf802f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.070+0000 7f4bfd7fa640 1 -- 172.21.15.5:0/2504081593 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4bf0057cc0 con 0x7f4c0015df10 2024-04-25T09:04:52.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.253+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c000b3340 con 0x7f4c0015df10 2024-04-25T09:04:52.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.253+0000 7f4bfd7fa640 1 -- 172.21.15.5:0/2504081593 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bf005bd60 con 0x7f4c0015df10 2024-04-25T09:04:52.242 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:04:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bec06b4d0 msgr2=0x7f4bec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bec06b4d0 0x7f4bec06d990 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8034000 tx=0x7f4bf802f000 comp rx=0 tx=0).stop 2024-04-25T09:04:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 msgr2=0x7f4c000b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c000b4ea0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000c480 tx=0x7f4bf000c940 comp rx=0 tx=0).stop 2024-04-25T09:04:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 shutdown_connections 2024-04-25T09:04:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4bec06b4d0 0x7f4bec06d990 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c0015df10 0x7f4c000b4ea0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c000cefe0 0x7f4c000cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 --2- 172.21.15.5:0/2504081593 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4c000b6250 0x7f4c0014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.255+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 >> 172.21.15.5:0/2504081593 conn(0x7f4c000668f0 msgr2=0x7f4c000b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.256+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 shutdown_connections 2024-04-25T09:04:52.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.256+0000 7f4c06f10640 1 -- 172.21.15.5:0/2504081593 wait complete. 2024-04-25T09:04:52.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.370+0000 7f7e48770640 1 Processor -- start 2024-04-25T09:04:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.370+0000 7f7e48770640 1 -- start start 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.371+0000 7f7e48770640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.371+0000 7f7e48770640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e400d2dc0 0x7f7e400d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.371+0000 7f7e48770640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4015e260 con 0x7f7e400ce1c0 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.371+0000 7f7e48770640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400d3770 con 0x7f7e400d2dc0 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.371+0000 7f7e48770640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400d1ef0 con 0x7f7e4015de80 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e45d0b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e400ce1c0 0x7f7e400d2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53264/0 (socket says 172.21.15.5:53264) 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e45d0b640 1 -- 172.21.15.5:0/4134488345 learned_addr learned my addr 172.21.15.5:0/4134488345 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e46d0d640 1 --2- 172.21.15.5:0/4134488345 >> v2:172.21.15.80:3300/0 conn(0x7f7e400d2dc0 0x7f7e400d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e4650c640 1 --2- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e4550a640 1 -- 172.21.15.5:0/4134488345 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738833066 0 0) 0x7f7e4015e260 con 0x7f7e400ce1c0 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e4550a640 1 -- 172.21.15.5:0/4134488345 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c003520 con 0x7f7e400ce1c0 2024-04-25T09:04:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e46d0d640 1 -- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 msgr2=0x7f7e400ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e46d0d640 1 --2- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e46d0d640 1 -- 172.21.15.5:0/4134488345 >> v1:172.21.15.5:6789/0 conn(0x7f7e400ce1c0 legacy=0x7f7e400d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e46d0d640 1 -- 172.21.15.5:0/4134488345 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400cf2e0 con 0x7f7e400d2dc0 2024-04-25T09:04:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.372+0000 7f7e4650c640 1 --2- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.373+0000 7f7e46d0d640 1 --2- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e400d3230 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009d90 tx=0x7f7e3802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1cc9a55d822068d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.373+0000 7f7e4550a640 1 -- 172.21.15.5:0/4134488345 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38007740 con 0x7f7e400d2dc0 2024-04-25T09:04:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.373+0000 7f7e4550a640 1 -- 172.21.15.5:0/4134488345 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e380078e0 con 0x7f7e400d2dc0 2024-04-25T09:04:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.373+0000 7f7e4550a640 1 -- 172.21.15.5:0/4134488345 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38007cb0 con 0x7f7e400d2dc0 2024-04-25T09:04:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.373+0000 7f7e48770640 1 -- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 msgr2=0x7f7e400d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.373+0000 7f7e48770640 1 --2- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e400d3230 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009d90 tx=0x7f7e3802a660 comp rx=0 tx=0).stop 2024-04-25T09:04:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.374+0000 7f7e48770640 1 -- 172.21.15.5:0/4134488345 shutdown_connections 2024-04-25T09:04:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.374+0000 7f7e48770640 1 --2- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e400d3230 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.374+0000 7f7e48770640 1 --2- 172.21.15.5:0/4134488345 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.374+0000 7f7e48770640 1 -- 172.21.15.5:0/4134488345 >> 172.21.15.5:0/4134488345 conn(0x7f7e4006b000 msgr2=0x7f7e4006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.374+0000 7f7e48770640 1 -- 172.21.15.5:0/4134488345 shutdown_connections 2024-04-25T09:04:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.374+0000 7f7e48770640 1 -- 172.21.15.5:0/4134488345 wait complete. 2024-04-25T09:04:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.375+0000 7f7e48770640 1 Processor -- start 2024-04-25T09:04:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.375+0000 7f7e48770640 1 -- start start 2024-04-25T09:04:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.375+0000 7f7e48770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e400ce1c0 0x7f7e40161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.375+0000 7f7e48770640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e4015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.375+0000 7f7e48770640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e48770640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400d1b80 con 0x7f7e400ce1c0 2024-04-25T09:04:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e48770640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400ce780 con 0x7f7e400d2dc0 2024-04-25T09:04:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e48770640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400b6cf0 con 0x7f7e4015de80 2024-04-25T09:04:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e400ce1c0 0x7f7e40161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e400ce1c0 0x7f7e40161010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46694/0 (socket says 172.21.15.5:46694) 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 -- 172.21.15.5:0/2127065626 learned_addr learned my addr 172.21.15.5:0/2127065626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e45d0b640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e4015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e46d0d640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 -- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 msgr2=0x7f7e400c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 -- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 msgr2=0x7f7e4015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e4015b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 -- 172.21.15.5:0/2127065626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40158c50 con 0x7f7e400ce1c0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e46d0d640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e45d0b640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e4015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e4650c640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e400ce1c0 0x7f7e40161010 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e960 tx=0x7f7e3c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e36ffd640 1 -- 172.21.15.5:0/2127065626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c017070 con 0x7f7e400ce1c0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e36ffd640 1 -- 172.21.15.5:0/2127065626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00ca00 con 0x7f7e400ce1c0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e36ffd640 1 -- 172.21.15.5:0/2127065626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00cdd0 con 0x7f7e400ce1c0 2024-04-25T09:04:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e40158f30 con 0x7f7e400ce1c0 2024-04-25T09:04:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.376+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e400c9ed0 con 0x7f7e400ce1c0 2024-04-25T09:04:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.377+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4004ef20 con 0x7f7e400ce1c0 2024-04-25T09:04:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.378+0000 7f7e36ffd640 1 -- 172.21.15.5:0/2127065626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e3c01a070 con 0x7f7e400ce1c0 2024-04-25T09:04:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.378+0000 7f7e36ffd640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e2406b500 0x7f7e2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.378+0000 7f7e36ffd640 1 -- 172.21.15.5:0/2127065626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7e3c08a0a0 con 0x7f7e400ce1c0 2024-04-25T09:04:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.378+0000 7f7e45d0b640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e2406b500 0x7f7e2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.379+0000 7f7e45d0b640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e2406b500 0x7f7e2406d9c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.382+0000 7f7e36ffd640 1 -- 172.21.15.5:0/2127065626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e3c058f70 con 0x7f7e400ce1c0 2024-04-25T09:04:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.561+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e400c6c00 con 0x7f7e400ce1c0 2024-04-25T09:04:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.561+0000 7f7e36ffd640 1 -- 172.21.15.5:0/2127065626 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e3c058870 con 0x7f7e400ce1c0 2024-04-25T09:04:52.550 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:04:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e2406b500 msgr2=0x7f7e2406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e2406b500 0x7f7e2406d9c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e400ce1c0 msgr2=0x7f7e40161010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e400ce1c0 0x7f7e40161010 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e960 tx=0x7f7e3c00ee20 comp rx=0 tx=0).stop 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 shutdown_connections 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e2406b500 0x7f7e2406d9c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e4015de80 0x7f7e400c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e400d2dc0 0x7f7e4015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 --2- 172.21.15.5:0/2127065626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e400ce1c0 0x7f7e40161010 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 >> 172.21.15.5:0/2127065626 conn(0x7f7e4006b000 msgr2=0x7f7e400d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 shutdown_connections 2024-04-25T09:04:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.563+0000 7f7e48770640 1 -- 172.21.15.5:0/2127065626 wait complete. 2024-04-25T09:04:52.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.677+0000 7efc73058640 1 Processor -- start 2024-04-25T09:04:52.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.677+0000 7efc73058640 1 -- start start 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc73058640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc6c15a340 0x7efc6c0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc73058640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc6c15e880 0x7efc6c0b4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc73058640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c0cf600 con 0x7efc6c071ed0 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc73058640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0b4740 con 0x7efc6c15e880 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc73058640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c15a720 con 0x7efc6c15a340 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc6c15e880 0x7efc6c0b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc6c15e880 0x7efc6c0b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46700/0 (socket says 172.21.15.5:46700) 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc6bfff640 1 -- 172.21.15.5:0/1727501312 learned_addr learned my addr 172.21.15.5:0/1727501312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc70df4640 1 --2- 172.21.15.5:0/1727501312 >> v2:172.21.15.80:3300/0 conn(0x7efc6c15a340 0x7efc6c0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc6bfff640 1 -- 172.21.15.5:0/1727501312 >> v2:172.21.15.80:3300/0 conn(0x7efc6c15a340 msgr2=0x7efc6c0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc6bfff640 1 --2- 172.21.15.5:0/1727501312 >> v2:172.21.15.80:3300/0 conn(0x7efc6c15a340 0x7efc6c0b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc6bfff640 1 -- 172.21.15.5:0/1727501312 >> v1:172.21.15.80:6789/0 conn(0x7efc6c071ed0 legacy=0x7efc6c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.678+0000 7efc6bfff640 1 -- 172.21.15.5:0/1727501312 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0aeef0 con 0x7efc6c15e880 2024-04-25T09:04:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.679+0000 7efc6bfff640 1 --2- 172.21.15.5:0/1727501312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c0b4200 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06c320 tx=0x7efc5802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb64e7f8adf46b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.679+0000 7efc6b7fe640 1 -- 172.21.15.5:0/1727501312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58037070 con 0x7efc6c15e880 2024-04-25T09:04:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.679+0000 7efc6b7fe640 1 -- 172.21.15.5:0/1727501312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58032440 con 0x7efc6c15e880 2024-04-25T09:04:52.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.679+0000 7efc6b7fe640 1 -- 172.21.15.5:0/1727501312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58032810 con 0x7efc6c15e880 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 -- 172.21.15.5:0/1727501312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 msgr2=0x7efc6c0b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 --2- 172.21.15.5:0/1727501312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c0b4200 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06c320 tx=0x7efc5802a230 comp rx=0 tx=0).stop 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 -- 172.21.15.5:0/1727501312 shutdown_connections 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 --2- 172.21.15.5:0/1727501312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c0b4200 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 --2- 172.21.15.5:0/1727501312 >> v2:172.21.15.80:3300/0 conn(0x7efc6c15a340 0x7efc6c0b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 -- 172.21.15.5:0/1727501312 >> 172.21.15.5:0/1727501312 conn(0x7efc6c0b1550 msgr2=0x7efc6c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 -- 172.21.15.5:0/1727501312 shutdown_connections 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.680+0000 7efc73058640 1 -- 172.21.15.5:0/1727501312 wait complete. 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.681+0000 7efc73058640 1 Processor -- start 2024-04-25T09:04:52.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.681+0000 7efc73058640 1 -- start start 2024-04-25T09:04:52.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc73058640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc6c071ed0 0x7efc6c15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc73058640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c15a340 0x7efc6c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc73058640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc73058640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0d0370 con 0x7efc6c15e880 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc73058640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0d0090 con 0x7efc6c15a340 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc73058640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0725b0 con 0x7efc6c071ed0 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c15aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46710/0 (socket says 172.21.15.5:46710) 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 -- 172.21.15.5:0/628064754 learned_addr learned my addr 172.21.15.5:0/628064754 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc6bfff640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c15a340 0x7efc6c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc70df4640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc6c071ed0 0x7efc6c15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 -- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc6c071ed0 msgr2=0x7efc6c15c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc6c071ed0 0x7efc6c15c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 -- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c15a340 msgr2=0x7efc6c14e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c15a340 0x7efc6c14e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc715f5640 1 -- 172.21.15.5:0/628064754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c15b430 con 0x7efc6c15e880 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.682+0000 7efc70df4640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc6c071ed0 0x7efc6c15c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.683+0000 7efc715f5640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c15aa50 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c7b0 tx=0x7efc6400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.683+0000 7efc697fa640 1 -- 172.21.15.5:0/628064754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64004b60 con 0x7efc6c15e880 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.683+0000 7efc697fa640 1 -- 172.21.15.5:0/628064754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64004d00 con 0x7efc6c15e880 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.683+0000 7efc697fa640 1 -- 172.21.15.5:0/628064754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400aa90 con 0x7efc6c15e880 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.683+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c15b710 con 0x7efc6c15e880 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.683+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c15bcd0 con 0x7efc6c15e880 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.684+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c068730 con 0x7efc6c15e880 2024-04-25T09:04:52.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.684+0000 7efc697fa640 1 -- 172.21.15.5:0/628064754 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc6400ac30 con 0x7efc6c15e880 2024-04-25T09:04:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.685+0000 7efc697fa640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc5006b4d0 0x7efc5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.685+0000 7efc697fa640 1 -- 172.21.15.5:0/628064754 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efc6408a430 con 0x7efc6c15e880 2024-04-25T09:04:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.685+0000 7efc70df4640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc5006b4d0 0x7efc5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.685+0000 7efc70df4640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc5006b4d0 0x7efc5006d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efc60006fd0 tx=0x7efc60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.689+0000 7efc697fa640 1 -- 172.21.15.5:0/628064754 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc6c068730 con 0x7efc6c15e880 2024-04-25T09:04:52.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.867+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc6c06e120 con 0x7efc6c15e880 2024-04-25T09:04:52.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.867+0000 7efc697fa640 1 -- 172.21.15.5:0/628064754 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc64020070 con 0x7efc6c15e880 2024-04-25T09:04:52.856 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc5006b4d0 msgr2=0x7efc5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc5006b4d0 0x7efc5006d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efc60006fd0 tx=0x7efc60008040 comp rx=0 tx=0).stop 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 msgr2=0x7efc6c15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c15aa50 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c7b0 tx=0x7efc6400cc70 comp rx=0 tx=0).stop 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 shutdown_connections 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efc5006b4d0 0x7efc5006d990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc6c15e880 0x7efc6c15aa50 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c15a340 0x7efc6c14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 --2- 172.21.15.5:0/628064754 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc6c071ed0 0x7efc6c15c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 >> 172.21.15.5:0/628064754 conn(0x7efc6c0b1550 msgr2=0x7efc6c1594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 shutdown_connections 2024-04-25T09:04:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.869+0000 7efc73058640 1 -- 172.21.15.5:0/628064754 wait complete. 2024-04-25T09:04:52.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:52.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.981+0000 7f81cbaab640 1 Processor -- start 2024-04-25T09:04:52.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.981+0000 7f81cbaab640 1 -- start start 2024-04-25T09:04:52.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81cbaab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81c40cea80 0x7f81c415f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81cbaab640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c415ef10 con 0x7f81c415fd80 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81cbaab640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c415f1a0 con 0x7f81c406bd00 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81cbaab640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c40cfd60 con 0x7f81c40cea80 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81c9046640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f81c415fd80 0x7f81c406b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53278/0 (socket says 172.21.15.5:53278) 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81c9046640 1 -- 172.21.15.5:0/1353968097 learned_addr learned my addr 172.21.15.5:0/1353968097 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81c9847640 1 --2- 172.21.15.5:0/1353968097 >> v2:172.21.15.80:3300/0 conn(0x7f81c40cea80 0x7f81c415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977781761 0 0) 0x7f81c415ef10 con 0x7f81c415fd80 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.982+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b0003520 con 0x7f81c415fd80 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2683511264 0 0) 0x7f81b0003520 con 0x7f81c415fd80 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 >> v2:172.21.15.80:3300/0 conn(0x7f81c40cea80 msgr2=0x7f81c415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 --2- 172.21.15.5:0/1353968097 >> v2:172.21.15.80:3300/0 conn(0x7f81c40cea80 0x7f81c415f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 >> v1:172.21.15.80:6789/0 conn(0x7f81c406bd00 legacy=0x7f81c40d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40cff90 con 0x7f81c415fd80 2024-04-25T09:04:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f81b4001670 con 0x7f81c415fd80 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 >> v1:172.21.15.5:6789/0 conn(0x7f81c415fd80 legacy=0x7f81c406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b00039b0 0x7f81b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b0004800 0x7f81b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00051c0 0x7f81b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b000c030 con 0x7f81b00039b0 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b000c1e0 con 0x7f81b0004800 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b000c3e0 con 0x7f81b00051c0 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c9847640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b00039b0 0x7f81b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c9046640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b0004800 0x7f81b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81ca048640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00051c0 0x7f81b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c9847640 1 -- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00051c0 msgr2=0x7f81b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c9847640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00051c0 0x7f81b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c9847640 1 -- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b0004800 msgr2=0x7f81b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c9847640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b0004800 0x7f81b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81c9847640 1 -- 172.21.15.5:0/1353968097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0003520 con 0x7f81b00039b0 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.983+0000 7f81ca048640 1 -- 172.21.15.5:0/1353968097 reap_dead start 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.984+0000 7f81c9847640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b00039b0 0x7f81b0003dd0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009ac0 tx=0x7f81b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b3b0f657821567 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.984+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0036070 con 0x7f81b00039b0 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.984+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0031400 con 0x7f81b00039b0 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.984+0000 7f81c8845640 1 -- 172.21.15.5:0/1353968097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0009690 con 0x7f81b00039b0 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.985+0000 7f81cbaab640 1 -- 172.21.15.5:0/1353968097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b00039b0 msgr2=0x7f81b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.985+0000 7f81cbaab640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b00039b0 0x7f81b0003dd0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009ac0 tx=0x7f81b0005830 comp rx=0 tx=0).stop 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.985+0000 7f81cbaab640 1 -- 172.21.15.5:0/1353968097 shutdown_connections 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.985+0000 7f81cbaab640 1 --2- 172.21.15.5:0/1353968097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b00039b0 0x7f81b0003dd0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.985+0000 7f81cbaab640 1 -- 172.21.15.5:0/1353968097 >> 172.21.15.5:0/1353968097 conn(0x7f81c40d19f0 msgr2=0x7f81c40d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.985+0000 7f81cbaab640 1 -- 172.21.15.5:0/1353968097 shutdown_connections 2024-04-25T09:04:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.985+0000 7f81cbaab640 1 -- 172.21.15.5:0/1353968097 wait complete. 2024-04-25T09:04:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.986+0000 7f81cbaab640 1 Processor -- start 2024-04-25T09:04:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.986+0000 7f81cbaab640 1 -- start start 2024-04-25T09:04:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00039b0 0x7f81c41f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c40c63f0 0x7f81c40c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c40c78c0 0x7f81c40b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40d1660 con 0x7f81c40c78c0 2024-04-25T09:04:52.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c415f480 con 0x7f81c40c63f0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40d17e0 con 0x7f81b00039b0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c40c78c0 0x7f81c40b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c40c78c0 0x7f81c40b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46728/0 (socket says 172.21.15.5:46728) 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 -- 172.21.15.5:0/4002528251 learned_addr learned my addr 172.21.15.5:0/4002528251 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81c9046640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c40c63f0 0x7f81c40c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81c9847640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00039b0 0x7f81c41f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 -- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00039b0 msgr2=0x7f81c41f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00039b0 0x7f81c41f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 -- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c40c63f0 msgr2=0x7f81c40c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c40c63f0 0x7f81c40c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 -- 172.21.15.5:0/4002528251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40c6b90 con 0x7f81c40c78c0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ca048640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c40c78c0 0x7f81c40b2390 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f81bc007fd0 tx=0x7f81bc00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ba7fc640 1 -- 172.21.15.5:0/4002528251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc019070 con 0x7f81c40c78c0 2024-04-25T09:04:52.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ba7fc640 1 -- 172.21.15.5:0/4002528251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc003b80 con 0x7f81c40c78c0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81ba7fc640 1 -- 172.21.15.5:0/4002528251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0050d0 con 0x7f81c40c78c0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c40c5630 con 0x7f81c40c78c0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.987+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c40c5bf0 con 0x7f81c40c78c0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.989+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c404ef20 con 0x7f81c40c78c0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.989+0000 7f81ba7fc640 1 -- 172.21.15.5:0/4002528251 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81bc01c070 con 0x7f81c40c78c0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.989+0000 7f81ba7fc640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f81a806b4d0 0x7f81a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.989+0000 7f81ba7fc640 1 -- 172.21.15.5:0/4002528251 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f81bc089740 con 0x7f81c40c78c0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.990+0000 7f81c9847640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f81a806b4d0 0x7f81a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.990+0000 7f81c9847640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f81a806b4d0 0x7f81a806d990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f81c0033000 tx=0x7f81c0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:52.994+0000 7f81ba7fc640 1 -- 172.21.15.5:0/4002528251 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81bc057f30 con 0x7f81c40c78c0 2024-04-25T09:04:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.210+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81c40cefa0 con 0x7f81c40c78c0 2024-04-25T09:04:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.211+0000 7f81ba7fc640 1 -- 172.21.15.5:0/4002528251 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f81bc05bfd0 con 0x7f81c40c78c0 2024-04-25T09:04:53.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.212+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f81a806b4d0 msgr2=0x7f81a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.212+0000 7f81cbaab640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f81a806b4d0 0x7f81a806d990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f81c0033000 tx=0x7f81c0008030 comp rx=0 tx=0).stop 2024-04-25T09:04:53.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.212+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c40c78c0 msgr2=0x7f81c40b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.212+0000 7f81cbaab640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c40c78c0 0x7f81c40b2390 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f81bc007fd0 tx=0x7f81bc00ead0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 shutdown_connections 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f81a806b4d0 0x7f81a806d990 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c40c78c0 0x7f81c40b2390 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c40c63f0 0x7f81c40c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 --2- 172.21.15.5:0/4002528251 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b00039b0 0x7f81c41f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 >> 172.21.15.5:0/4002528251 conn(0x7f81c40d19f0 msgr2=0x7f81c406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 shutdown_connections 2024-04-25T09:04:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.213+0000 7f81cbaab640 1 -- 172.21.15.5:0/4002528251 wait complete. 2024-04-25T09:04:53.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.326+0000 7f8386ccb640 1 Processor -- start 2024-04-25T09:04:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.326+0000 7f8386ccb640 1 -- start start 2024-04-25T09:04:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f8386ccb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f838015e120 0x7f838006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f8386ccb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800b4730 con 0x7f838006b7d0 2024-04-25T09:04:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f8386ccb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800d0da0 con 0x7f838006bbb0 2024-04-25T09:04:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f8386ccb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83800cbf30 con 0x7f838015e120 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f8384a67640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f838006b7d0 0x7f838015da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53294/0 (socket says 172.21.15.5:53294) 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f8384a67640 1 -- 172.21.15.5:0/3593949063 learned_addr learned my addr 172.21.15.5:0/3593949063 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837ffff640 1 --2- 172.21.15.5:0/3593949063 >> v2:172.21.15.80:3300/0 conn(0x7f838015e120 0x7f838006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865380436 0 0) 0x7f8374001110 con 0x7f838006b7d0 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8370003520 con 0x7f838006b7d0 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1807759121 0 0) 0x7f8370003520 con 0x7f838006b7d0 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 >> v2:172.21.15.80:3300/0 conn(0x7f838015e120 msgr2=0x7f838006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 --2- 172.21.15.5:0/3593949063 >> v2:172.21.15.80:3300/0 conn(0x7f838015e120 0x7f838006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 >> v1:172.21.15.80:6789/0 conn(0x7f838006bbb0 legacy=0x7f83800ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800cc180 con 0x7f838006b7d0 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f8374001840 con 0x7f838006b7d0 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 >> v1:172.21.15.5:6789/0 conn(0x7f838006b7d0 legacy=0x7f838015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83700039b0 0x7f8370003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004800 0x7f8370004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.327+0000 7f837f7fe640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83700051c0 0x7f837000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83800cbf30 con 0x7f8370004800 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837000c070 con 0x7f83700051c0 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837000c270 con 0x7f83700039b0 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837ffff640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004800 0x7f8370004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f8384a67640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83700039b0 0x7f8370003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f8385268640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83700051c0 0x7f837000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837ffff640 1 -- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83700039b0 msgr2=0x7f8370003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837ffff640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83700039b0 0x7f8370003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837ffff640 1 -- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83700051c0 msgr2=0x7f837000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837ffff640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83700051c0 0x7f837000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f837ffff640 1 -- 172.21.15.5:0/3593949063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370003520 con 0x7f8370004800 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f8385268640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83700051c0 0x7f837000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.328+0000 7f8385268640 1 -- 172.21.15.5:0/3593949063 reap_dead start 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f837ffff640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004800 0x7f8370004c80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f836c009ac0 tx=0x7f8370005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b50bea8d6e94e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c036070 con 0x7f8370004800 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c031400 con 0x7f8370004800 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f837f7fe640 1 -- 172.21.15.5:0/3593949063 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c009690 con 0x7f8370004800 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f8386ccb640 1 -- 172.21.15.5:0/3593949063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004800 msgr2=0x7f8370004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f8386ccb640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004800 0x7f8370004c80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f836c009ac0 tx=0x7f8370005830 comp rx=0 tx=0).stop 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f8386ccb640 1 -- 172.21.15.5:0/3593949063 shutdown_connections 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f8386ccb640 1 --2- 172.21.15.5:0/3593949063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004800 0x7f8370004c80 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f8386ccb640 1 -- 172.21.15.5:0/3593949063 >> 172.21.15.5:0/3593949063 conn(0x7f83800d18e0 msgr2=0x7f83800d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f8386ccb640 1 -- 172.21.15.5:0/3593949063 shutdown_connections 2024-04-25T09:04:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.329+0000 7f8386ccb640 1 -- 172.21.15.5:0/3593949063 wait complete. 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.330+0000 7f8386ccb640 1 Processor -- start 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.331+0000 7f8386ccb640 1 -- start start 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.331+0000 7f8386ccb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8370004800 0x7f8380160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.331+0000 7f8386ccb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800c93c0 0x7f83800c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.331+0000 7f8386ccb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b4910 0x7f83800b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.331+0000 7f8386ccb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838006aef0 con 0x7f83800c93c0 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.331+0000 7f8386ccb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83800cc7d0 con 0x7f8370004800 2024-04-25T09:04:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.331+0000 7f8386ccb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838006b070 con 0x7f83800b4910 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800c93c0 0x7f83800c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800c93c0 0x7f83800c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46752/0 (socket says 172.21.15.5:46752) 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 -- 172.21.15.5:0/2409859464 learned_addr learned my addr 172.21.15.5:0/2409859464 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f8384a67640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8370004800 0x7f8380160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f8385268640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b4910 0x7f83800b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 -- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b4910 msgr2=0x7f83800b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b4910 0x7f83800b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 -- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8370004800 msgr2=0x7f8380160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8370004800 0x7f8380160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 -- 172.21.15.5:0/2409859464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838015fd70 con 0x7f83800c93c0 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837ffff640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800c93c0 0x7f83800c9840 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f836c034040 tx=0x7f836c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837d7fa640 1 -- 172.21.15.5:0/2409859464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c03f020 con 0x7f83800c93c0 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837d7fa640 1 -- 172.21.15.5:0/2409859464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c037040 con 0x7f83800c93c0 2024-04-25T09:04:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8380160010 con 0x7f83800c93c0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f837d7fa640 1 -- 172.21.15.5:0/2409859464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c036070 con 0x7f83800c93c0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.332+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83801605d0 con 0x7f83800c93c0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.333+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838004ef20 con 0x7f83800c93c0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.334+0000 7f837d7fa640 1 -- 172.21.15.5:0/2409859464 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f836c042020 con 0x7f83800c93c0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.334+0000 7f837d7fa640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836406b4d0 0x7f836406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.334+0000 7f837d7fa640 1 -- 172.21.15.5:0/2409859464 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f836c0aa2d0 con 0x7f83800c93c0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.334+0000 7f8384a67640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836406b4d0 0x7f836406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.335+0000 7f8384a67640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836406b4d0 0x7f836406d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f83740017e0 tx=0x7f8374009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.338+0000 7f837d7fa640 1 -- 172.21.15.5:0/2409859464 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f836c049030 con 0x7f83800c93c0 2024-04-25T09:04:53.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.524+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83800c9d80 con 0x7f83800c93c0 2024-04-25T09:04:53.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.525+0000 7f837d7fa640 1 -- 172.21.15.5:0/2409859464 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f836c0791d0 con 0x7f83800c93c0 2024-04-25T09:04:53.514 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:53.514 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:28.155947+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:17.415000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:18.131219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836406b4d0 msgr2=0x7f836406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836406b4d0 0x7f836406d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f83740017e0 tx=0x7f8374009040 comp rx=0 tx=0).stop 2024-04-25T09:04:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800c93c0 msgr2=0x7f83800c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800c93c0 0x7f83800c9840 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f836c034040 tx=0x7f836c004730 comp rx=0 tx=0).stop 2024-04-25T09:04:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 shutdown_connections 2024-04-25T09:04:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f836406b4d0 0x7f836406d990 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f83800b4910 0x7f83800b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800c93c0 0x7f83800c9840 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 --2- 172.21.15.5:0/2409859464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8370004800 0x7f8380160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 >> 172.21.15.5:0/2409859464 conn(0x7f83800d18e0 msgr2=0x7f838015cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 shutdown_connections 2024-04-25T09:04:53.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.527+0000 7f8386ccb640 1 -- 172.21.15.5:0/2409859464 wait complete. 2024-04-25T09:04:53.527 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:04:53.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.640+0000 7f411c4bd640 1 Processor -- start 2024-04-25T09:04:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.640+0000 7f411c4bd640 1 -- start start 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.640+0000 7f411c4bd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f411415de70 0x7f41140b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f411c4bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41140d20e0 con 0x7f41140b2cc0 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f411c4bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41140d23c0 con 0x7f41140ce7f0 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f411c4bd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41140d2a10 con 0x7f411415de70 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f411a259640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f411415de70 0x7f41140b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f4119a58640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f41140b2cc0 0x7f41140b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53306/0 (socket says 172.21.15.5:53306) 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f4119a58640 1 -- 172.21.15.5:0/2354932128 learned_addr learned my addr 172.21.15.5:0/2354932128 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f411a259640 1 -- 172.21.15.5:0/2354932128 >> v1:172.21.15.80:6789/0 conn(0x7f41140ce7f0 legacy=0x7f41140cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f411a259640 1 -- 172.21.15.5:0/2354932128 >> v1:172.21.15.5:6789/0 conn(0x7f41140b2cc0 legacy=0x7f41140b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f411a259640 1 -- 172.21.15.5:0/2354932128 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140d26a0 con 0x7f411415de70 2024-04-25T09:04:53.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.641+0000 7f4119257640 1 -- 172.21.15.5:0/2354932128 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418271452 0 0) 0x7f41140d20e0 con 0x7f41140b2cc0 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.642+0000 7f411a259640 1 --2- 172.21.15.5:0/2354932128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41140b93e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f41100097a0 tx=0x7f411002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7e7a59692ed06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.642+0000 7f4119257640 1 -- 172.21.15.5:0/2354932128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110037070 con 0x7f411415de70 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.642+0000 7f4119257640 1 -- 172.21.15.5:0/2354932128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110032440 con 0x7f411415de70 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.642+0000 7f4119257640 1 -- 172.21.15.5:0/2354932128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110032810 con 0x7f411415de70 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.642+0000 7f411c4bd640 1 -- 172.21.15.5:0/2354932128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 msgr2=0x7f41140b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.642+0000 7f411c4bd640 1 --2- 172.21.15.5:0/2354932128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41140b93e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f41100097a0 tx=0x7f411002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.643+0000 7f411c4bd640 1 -- 172.21.15.5:0/2354932128 shutdown_connections 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.643+0000 7f411c4bd640 1 --2- 172.21.15.5:0/2354932128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41140b93e0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.643+0000 7f411c4bd640 1 -- 172.21.15.5:0/2354932128 >> 172.21.15.5:0/2354932128 conn(0x7f411406b000 msgr2=0x7f411406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.643+0000 7f411c4bd640 1 -- 172.21.15.5:0/2354932128 shutdown_connections 2024-04-25T09:04:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.643+0000 7f411c4bd640 1 -- 172.21.15.5:0/2354932128 wait complete. 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.644+0000 7f411c4bd640 1 Processor -- start 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.644+0000 7f411c4bd640 1 -- start start 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41140b2cc0 0x7f411414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41140ce7f0 0x7f41141f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41141f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140d2ea0 con 0x7f411415de70 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140b7300 con 0x7f41140b2cc0 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41140d3020 con 0x7f41140ce7f0 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41141f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41141f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46764/0 (socket says 172.21.15.5:46764) 2024-04-25T09:04:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 -- 172.21.15.5:0/3846665689 learned_addr learned my addr 172.21.15.5:0/3846665689 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411a259640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41140b2cc0 0x7f411414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f4119a58640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41140ce7f0 0x7f41141f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 -- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41140ce7f0 msgr2=0x7f41141f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41140ce7f0 0x7f41141f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 -- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41140b2cc0 msgr2=0x7f411414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41140b2cc0 0x7f411414f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 -- 172.21.15.5:0/3846665689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140c92c0 con 0x7f411415de70 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f4119a58640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41140ce7f0 0x7f41141f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411aa5a640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41141f3150 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f410c00c780 tx=0x7f410c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f410affd640 1 -- 172.21.15.5:0/3846665689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c004b60 con 0x7f411415de70 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f410affd640 1 -- 172.21.15.5:0/3846665689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c004d00 con 0x7f411415de70 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41140c95a0 con 0x7f411415de70 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f410affd640 1 -- 172.21.15.5:0/3846665689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c00aa90 con 0x7f411415de70 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.645+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41140c9b60 con 0x7f411415de70 2024-04-25T09:04:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.646+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411404ef20 con 0x7f411415de70 2024-04-25T09:04:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.647+0000 7f410affd640 1 -- 172.21.15.5:0/3846665689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f410c00ac30 con 0x7f411415de70 2024-04-25T09:04:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.647+0000 7f410affd640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f40f806b500 0x7f40f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.647+0000 7f410affd640 1 -- 172.21.15.5:0/3846665689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f410c08a4a0 con 0x7f411415de70 2024-04-25T09:04:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.648+0000 7f411a259640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f40f806b500 0x7f40f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.648+0000 7f411a259640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f40f806b500 0x7f40f806d9c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4110034000 tx=0x7f411002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.652+0000 7f410affd640 1 -- 172.21.15.5:0/3846665689 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f410c020070 con 0x7f411415de70 2024-04-25T09:04:53.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.868+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41140cf8d0 con 0x7f411415de70 2024-04-25T09:04:53.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.868+0000 7f410affd640 1 -- 172.21.15.5:0/3846665689 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f410c0592d0 con 0x7f411415de70 2024-04-25T09:04:53.857 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:53.857 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:53.858 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:53.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f40f806b500 msgr2=0x7f40f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f40f806b500 0x7f40f806d9c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4110034000 tx=0x7f411002e000 comp rx=0 tx=0).stop 2024-04-25T09:04:53.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 msgr2=0x7f41141f3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41141f3150 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f410c00c780 tx=0x7f410c00cc40 comp rx=0 tx=0).stop 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 shutdown_connections 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f40f806b500 0x7f40f806d9c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f411415de70 0x7f41141f3150 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41140ce7f0 0x7f41141f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 --2- 172.21.15.5:0/3846665689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41140b2cc0 0x7f411414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 >> 172.21.15.5:0/3846665689 conn(0x7f411406b000 msgr2=0x7f41140b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 shutdown_connections 2024-04-25T09:04:53.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.870+0000 7f411c4bd640 1 -- 172.21.15.5:0/3846665689 wait complete. 2024-04-25T09:04:53.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:53.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.982+0000 7f0bd02f5640 1 Processor -- start 2024-04-25T09:04:53.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.982+0000 7f0bd02f5640 1 -- start start 2024-04-25T09:04:53.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bd02f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 0x7f0bc80b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bd02f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc80b3f30 con 0x7f0bc80cfc90 2024-04-25T09:04:53.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bd02f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc815b0f0 con 0x7f0bc815bbd0 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bd02f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc815b3d0 con 0x7f0bc8154f10 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bce892640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0bc80cfc90 0x7f0bc8070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53310/0 (socket says 172.21.15.5:53310) 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bce892640 1 -- 172.21.15.5:0/1119375695 learned_addr learned my addr 172.21.15.5:0/1119375695 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bce091640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 0x7f0bc80b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811760681 0 0) 0x7f0bc80b3f30 con 0x7f0bc80cfc90 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb4003520 con 0x7f0bc80cfc90 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644531721 0 0) 0x7f0bc815b0f0 con 0x7f0bc815bbd0 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc80b3f30 con 0x7f0bc815bbd0 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155585403 0 0) 0x7f0bb4003520 con 0x7f0bc80cfc90 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 msgr2=0x7f0bc80b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 0x7f0bc80b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 >> v1:172.21.15.80:6789/0 conn(0x7f0bc815bbd0 legacy=0x7f0bc80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.983+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc81552f0 con 0x7f0bc80cfc90 2024-04-25T09:04:53.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f0bc0001670 con 0x7f0bc80cfc90 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce091640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 0x7f0bc80b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 >> v1:172.21.15.5:6789/0 conn(0x7f0bc80cfc90 legacy=0x7f0bc8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bb4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bb4004800 0x7f0bb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 0x7f0bb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc815b3d0 con 0x7f0bb4003b70 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb400baa0 con 0x7f0bb4004800 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb400bca0 con 0x7f0bc8154f10 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce091640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bb4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd890640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bb4004800 0x7f0bb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce892640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 0x7f0bb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce091640 1 -- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 msgr2=0x7f0bb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce091640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8154f10 0x7f0bb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce091640 1 -- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bb4004800 msgr2=0x7f0bb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce091640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bb4004800 0x7f0bb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bce091640 1 -- 172.21.15.5:0/1119375695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4003520 con 0x7f0bb4003b70 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.984+0000 7f0bcd890640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bb4004800 0x7f0bb4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bce091640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bb4003f70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e320 tx=0x7f0bb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c3dd08cebcec63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4033070 con 0x7f0bb4003b70 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc402f660 con 0x7f0bb4003b70 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bcd08f640 1 -- 172.21.15.5:0/1119375695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4009de0 con 0x7f0bb4003b70 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1119375695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 msgr2=0x7f0bb4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bd02f5640 1 --2- 172.21.15.5:0/1119375695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bb4003f70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e320 tx=0x7f0bb4005830 comp rx=0 tx=0).stop 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bce892640 1 -- 172.21.15.5:0/1119375695 reap_dead start 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1119375695 shutdown_connections 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1119375695 >> 172.21.15.5:0/1119375695 conn(0x7f0bc80668f0 msgr2=0x7f0bc8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1119375695 shutdown_connections 2024-04-25T09:04:53.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.985+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1119375695 wait complete. 2024-04-25T09:04:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 Processor -- start 2024-04-25T09:04:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 -- start start 2024-04-25T09:04:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bc806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc81373b0 0x7f0bc806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8137930 0x7f0bc8137de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80717e0 con 0x7f0bb4003b70 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc8071660 con 0x7f0bc81373b0 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bd02f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc8071960 con 0x7f0bc8137930 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bce091640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bc806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.987+0000 7f0bce091640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bc806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46784/0 (socket says 172.21.15.5:46784) 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce091640 1 -- 172.21.15.5:0/1932171869 learned_addr learned my addr 172.21.15.5:0/1932171869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bcd890640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc81373b0 0x7f0bc806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce892640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8137930 0x7f0bc8137de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce091640 1 -- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8137930 msgr2=0x7f0bc8137de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce091640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8137930 0x7f0bc8137de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce091640 1 -- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc81373b0 msgr2=0x7f0bc806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce091640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc81373b0 0x7f0bc806cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce091640 1 -- 172.21.15.5:0/1932171869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8138660 con 0x7f0bb4003b70 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce892640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8137930 0x7f0bc8137de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bce091640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bc806c6c0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e410 tx=0x7f0bc4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bbeffd640 1 -- 172.21.15.5:0/1932171869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4033040 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bbeffd640 1 -- 172.21.15.5:0/1932171869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4009a50 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc8138940 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bbeffd640 1 -- 172.21.15.5:0/1932171869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4009de0 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.988+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc8138f00 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.989+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc804ef20 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.990+0000 7f0bbeffd640 1 -- 172.21.15.5:0/1932171869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0bc4048020 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.990+0000 7f0bbeffd640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0bac06b4d0 0x7f0bac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.990+0000 7f0bbeffd640 1 -- 172.21.15.5:0/1932171869 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0bc40aaf90 con 0x7f0bb4003b70 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.990+0000 7f0bcd890640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0bac06b4d0 0x7f0bac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.991+0000 7f0bcd890640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0bac06b4d0 0x7f0bac06d990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8153c30 tx=0x7f0bb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:53.994+0000 7f0bbeffd640 1 -- 172.21.15.5:0/1932171869 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0bc4079dd0 con 0x7f0bb4003b70 2024-04-25T09:04:54.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.217+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bc8070d30 con 0x7f0bb4003b70 2024-04-25T09:04:54.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.218+0000 7f0bbeffd640 1 -- 172.21.15.5:0/1932171869 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f0bc40796d0 con 0x7f0bb4003b70 2024-04-25T09:04:54.207 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:54.207 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:19.124411+0000","modified":"2024-04-25T09:04:21.491091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4045189382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4045189382},{"type":"v1","addr":"172.21.15.80:6837","nonce":4045189382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:54.207 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 70 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0bac06b4d0 msgr2=0x7f0bac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0bac06b4d0 0x7f0bac06d990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8153c30 tx=0x7f0bb8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 msgr2=0x7f0bc806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bc806c6c0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e410 tx=0x7f0bc4009750 comp rx=0 tx=0).stop 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 shutdown_connections 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0bac06b4d0 0x7f0bac06d990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0bc8137930 0x7f0bc8137de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc81373b0 0x7f0bc806cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 --2- 172.21.15.5:0/1932171869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0bb4003b70 0x7f0bc806c6c0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 >> 172.21.15.5:0/1932171869 conn(0x7f0bc80668f0 msgr2=0x7f0bc80b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 shutdown_connections 2024-04-25T09:04:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.220+0000 7f0bd02f5640 1 -- 172.21.15.5:0/1932171869 wait complete. 2024-04-25T09:04:54.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.333+0000 7f54a9d70640 1 Processor -- start 2024-04-25T09:04:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.333+0000 7f54a9d70640 1 -- start start 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a9d70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a4154f10 0x7f54a40b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a9d70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54a40cfc90 0x7f54a4070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a9d70640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a40b3f30 con 0x7f54a415bbd0 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a9d70640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a415b0f0 con 0x7f54a40cfc90 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a9d70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a415b3d0 con 0x7f54a4154f10 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54a40cfc90 0x7f54a4070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a4154f10 0x7f54a40b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a2ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f54a415bbd0 0x7f54a40cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:59018/0 (socket says 172.21.15.5:59018) 2024-04-25T09:04:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a2ffd640 1 -- 172.21.15.5:0/2913219399 learned_addr learned my addr 172.21.15.5:0/2913219399 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a3fff640 1 -- 172.21.15.5:0/2913219399 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a4154f10 msgr2=0x7f54a40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a3fff640 1 --2- 172.21.15.5:0/2913219399 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a4154f10 0x7f54a40b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a3fff640 1 -- 172.21.15.5:0/2913219399 >> v1:172.21.15.80:6789/0 conn(0x7f54a415bbd0 legacy=0x7f54a40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a27fc640 1 -- 172.21.15.5:0/2913219399 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889329343 0 0) 0x7f54a40b3f30 con 0x7f54a415bbd0 2024-04-25T09:04:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.334+0000 7f54a3fff640 1 -- 172.21.15.5:0/2913219399 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a41552f0 con 0x7f54a40cfc90 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.335+0000 7f54a3fff640 1 --2- 172.21.15.5:0/2913219399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a40cfc90 0x7f54a4070f50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f549c009d90 tx=0x7f549c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af3d0cc1e52fb705 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.335+0000 7f54a27fc640 1 -- 172.21.15.5:0/2913219399 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c031600 con 0x7f54a40cfc90 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.335+0000 7f54a27fc640 1 -- 172.21.15.5:0/2913219399 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0317a0 con 0x7f54a40cfc90 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.335+0000 7f54a27fc640 1 -- 172.21.15.5:0/2913219399 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c031b70 con 0x7f54a40cfc90 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 -- 172.21.15.5:0/2913219399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a40cfc90 msgr2=0x7f54a4070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 --2- 172.21.15.5:0/2913219399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a40cfc90 0x7f54a4070f50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f549c009d90 tx=0x7f549c02a5d0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 -- 172.21.15.5:0/2913219399 shutdown_connections 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 --2- 172.21.15.5:0/2913219399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a40cfc90 0x7f54a4070f50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 --2- 172.21.15.5:0/2913219399 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a4154f10 0x7f54a40b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 -- 172.21.15.5:0/2913219399 >> 172.21.15.5:0/2913219399 conn(0x7f54a40668f0 msgr2=0x7f54a4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 -- 172.21.15.5:0/2913219399 shutdown_connections 2024-04-25T09:04:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.336+0000 7f54a9d70640 1 -- 172.21.15.5:0/2913219399 wait complete. 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.337+0000 7f54a9d70640 1 Processor -- start 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.337+0000 7f54a9d70640 1 -- start start 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a9d70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54a40cfc90 0x7f54a413c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a9d70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a4154f10 0x7f54a41e4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a9d70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a415bbd0 0x7f54a413c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a9d70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40b3b30 con 0x7f54a40cfc90 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a9d70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40b39b0 con 0x7f54a4154f10 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a9d70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40b3cb0 con 0x7f54a415bbd0 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54a40cfc90 0x7f54a413c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54a40cfc90 0x7f54a413c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46788/0 (socket says 172.21.15.5:46788) 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a37fe640 1 -- 172.21.15.5:0/969372553 learned_addr learned my addr 172.21.15.5:0/969372553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a3fff640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a415bbd0 0x7f54a413c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a2ffd640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a4154f10 0x7f54a41e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.338+0000 7f54a37fe640 1 -- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a415bbd0 msgr2=0x7f54a413c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a37fe640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a415bbd0 0x7f54a413c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a37fe640 1 -- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a4154f10 msgr2=0x7f54a41e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a37fe640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a4154f10 0x7f54a41e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a37fe640 1 -- 172.21.15.5:0/969372553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a414fc80 con 0x7f54a40cfc90 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a3fff640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a415bbd0 0x7f54a413c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a2ffd640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a4154f10 0x7f54a41e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a37fe640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54a40cfc90 0x7f54a413c360 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f549400e9b0 tx=0x7f549400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f548bfff640 1 -- 172.21.15.5:0/969372553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494017070 con 0x7f54a40cfc90 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f548bfff640 1 -- 172.21.15.5:0/969372553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549400c9a0 con 0x7f54a40cfc90 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f548bfff640 1 -- 172.21.15.5:0/969372553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400cd90 con 0x7f54a40cfc90 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a414ff60 con 0x7f54a40cfc90 2024-04-25T09:04:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.339+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a4150520 con 0x7f54a40cfc90 2024-04-25T09:04:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.340+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a404ef20 con 0x7f54a40cfc90 2024-04-25T09:04:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.340+0000 7f548bfff640 1 -- 172.21.15.5:0/969372553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f549401a070 con 0x7f54a40cfc90 2024-04-25T09:04:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.341+0000 7f548bfff640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f549006b4d0 0x7f549006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.341+0000 7f548bfff640 1 -- 172.21.15.5:0/969372553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f549408a720 con 0x7f54a40cfc90 2024-04-25T09:04:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.341+0000 7f54a2ffd640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f549006b4d0 0x7f549006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.342+0000 7f54a2ffd640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f549006b4d0 0x7f549006d990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f54a40cba00 tx=0x7f5498007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.345+0000 7f548bfff640 1 -- 172.21.15.5:0/969372553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5494059440 con 0x7f54a40cfc90 2024-04-25T09:04:54.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.528+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54a40714f0 con 0x7f54a40cfc90 2024-04-25T09:04:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.529+0000 7f548bfff640 1 -- 172.21.15.5:0/969372553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f5494058d40 con 0x7f54a40cfc90 2024-04-25T09:04:54.518 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:54.518 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:28.155947+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:17.415000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:18.131219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f549006b4d0 msgr2=0x7f549006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f549006b4d0 0x7f549006d990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f54a40cba00 tx=0x7f5498007ca0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54a40cfc90 msgr2=0x7f54a413c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54a40cfc90 0x7f54a413c360 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f549400e9b0 tx=0x7f549400ee70 comp rx=0 tx=0).stop 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 shutdown_connections 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f549006b4d0 0x7f549006d990 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54a415bbd0 0x7f54a413c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54a4154f10 0x7f54a41e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 --2- 172.21.15.5:0/969372553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54a40cfc90 0x7f54a413c360 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 >> 172.21.15.5:0/969372553 conn(0x7f54a40668f0 msgr2=0x7f54a40cbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 shutdown_connections 2024-04-25T09:04:54.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.531+0000 7f54a9d70640 1 -- 172.21.15.5:0/969372553 wait complete. 2024-04-25T09:04:54.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:04:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.644+0000 7f95ae79e640 1 Processor -- start 2024-04-25T09:04:54.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.645+0000 7f95ae79e640 1 -- start start 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.645+0000 7f95ae79e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95a80b0e30 0x7f95a80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.645+0000 7f95ae79e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a806ba50 con 0x7f95a80ce910 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.645+0000 7f95ae79e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a806bd30 con 0x7f95a80b0a50 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.645+0000 7f95ae79e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a806b800 con 0x7f95a80b0e30 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.645+0000 7f95acd3b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f95a80ce910 0x7f95a80b1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53320/0 (socket says 172.21.15.5:53320) 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.645+0000 7f95acd3b640 1 -- 172.21.15.5:0/3659302572 learned_addr learned my addr 172.21.15.5:0/3659302572 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a77fe640 1 --2- 172.21.15.5:0/3659302572 >> v2:172.21.15.80:3300/0 conn(0x7f95a80b0e30 0x7f95a80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630804832 0 0) 0x7f95a806ba50 con 0x7f95a80ce910 2024-04-25T09:04:54.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9594003520 con 0x7f95a80ce910 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335636812 0 0) 0x7f9594003520 con 0x7f95a80ce910 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 >> v2:172.21.15.80:3300/0 conn(0x7f95a80b0e30 msgr2=0x7f95a80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 --2- 172.21.15.5:0/3659302572 >> v2:172.21.15.80:3300/0 conn(0x7f95a80b0e30 0x7f95a80b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 >> v1:172.21.15.80:6789/0 conn(0x7f95a80b0a50 legacy=0x7f95a80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a806c010 con 0x7f95a80ce910 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f95a00019f0 con 0x7f95a80ce910 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 >> v1:172.21.15.5:6789/0 conn(0x7f95a80ce910 legacy=0x7f95a80b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95940039b0 0x7f9594003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95940043b0 0x7f9594004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9594005120 0x7f959400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a806b800 con 0x7f95940043b0 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959400c060 con 0x7f9594005120 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959400c260 con 0x7f95940039b0 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a77fe640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95940043b0 0x7f9594004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.646+0000 7f95a7fff640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95940039b0 0x7f9594003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95acd3b640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9594005120 0x7f959400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95a77fe640 1 -- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95940039b0 msgr2=0x7f9594003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95a77fe640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95940039b0 0x7f9594003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95a77fe640 1 -- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9594005120 msgr2=0x7f959400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95a77fe640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9594005120 0x7f959400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95a77fe640 1 -- 172.21.15.5:0/3659302572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594003520 con 0x7f95940043b0 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95acd3b640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9594005120 0x7f959400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95acd3b640 1 -- 172.21.15.5:0/3659302572 reap_dead start 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95a77fe640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95940043b0 0x7f9594004880 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f95a8161ab0 tx=0x7f9594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb126a787fd24401 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.647+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598036070 con 0x7f95940043b0 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598031400 con 0x7f95940043b0 2024-04-25T09:04:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95a6ffd640 1 -- 172.21.15.5:0/3659302572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598009690 con 0x7f95940043b0 2024-04-25T09:04:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95ae79e640 1 -- 172.21.15.5:0/3659302572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95940043b0 msgr2=0x7f9594004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95940043b0 0x7f9594004880 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f95a8161ab0 tx=0x7f9594005830 comp rx=0 tx=0).stop 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95ae79e640 1 -- 172.21.15.5:0/3659302572 shutdown_connections 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3659302572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95940043b0 0x7f9594004880 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95ae79e640 1 -- 172.21.15.5:0/3659302572 >> 172.21.15.5:0/3659302572 conn(0x7f95a80d18f0 msgr2=0x7f95a80d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95ae79e640 1 -- 172.21.15.5:0/3659302572 shutdown_connections 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.648+0000 7f95ae79e640 1 -- 172.21.15.5:0/3659302572 wait complete. 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.649+0000 7f95ae79e640 1 Processor -- start 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.649+0000 7f95ae79e640 1 -- start start 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95ae79e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95940043b0 0x7f95a806f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95ae79e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95a815cee0 0x7f95a80c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95ae79e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a8154c00 0x7f95a80b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95ae79e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80b2bf0 con 0x7f95a8154c00 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95ae79e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80cfd60 con 0x7f95940043b0 2024-04-25T09:04:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95ae79e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a806f9b0 con 0x7f95a815cee0 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95acd3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a8154c00 0x7f95a80b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95acd3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a8154c00 0x7f95a80b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46800/0 (socket says 172.21.15.5:46800) 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.650+0000 7f95acd3b640 1 -- 172.21.15.5:0/3941681797 learned_addr learned my addr 172.21.15.5:0/3941681797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95a7fff640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95940043b0 0x7f95a806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95a77fe640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95a815cee0 0x7f95a80c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95acd3b640 1 -- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95a815cee0 msgr2=0x7f95a80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95acd3b640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95a815cee0 0x7f95a80c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95acd3b640 1 -- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95940043b0 msgr2=0x7f95a806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95acd3b640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95940043b0 0x7f95a806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95acd3b640 1 -- 172.21.15.5:0/3941681797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80c94c0 con 0x7f95a8154c00 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95acd3b640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a8154c00 0x7f95a80b1790 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f95a806c680 tx=0x7f95a0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95a4ff9640 1 -- 172.21.15.5:0/3941681797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000ea20 con 0x7f95a8154c00 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95a4ff9640 1 -- 172.21.15.5:0/3941681797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a000ec00 con 0x7f95a8154c00 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a806fbe0 con 0x7f95a8154c00 2024-04-25T09:04:54.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95a4ff9640 1 -- 172.21.15.5:0/3941681797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0014480 con 0x7f95a8154c00 2024-04-25T09:04:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.651+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80b4640 con 0x7f95a8154c00 2024-04-25T09:04:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.652+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a804ef20 con 0x7f95a8154c00 2024-04-25T09:04:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.652+0000 7f95a4ff9640 1 -- 172.21.15.5:0/3941681797 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f95a0014620 con 0x7f95a8154c00 2024-04-25T09:04:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.653+0000 7f95a4ff9640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f958806b4d0 0x7f958806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.653+0000 7f95a4ff9640 1 -- 172.21.15.5:0/3941681797 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f95a0089e70 con 0x7f95a8154c00 2024-04-25T09:04:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.653+0000 7f95a7fff640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f958806b4d0 0x7f958806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.654+0000 7f95a7fff640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f958806b4d0 0x7f958806d990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9590003700 tx=0x7f9590009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.657+0000 7f95a4ff9640 1 -- 172.21.15.5:0/3941681797 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f95a0058d40 con 0x7f95a8154c00 2024-04-25T09:04:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.875+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f95a80b77b0 con 0x7f95a8154c00 2024-04-25T09:04:54.864 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:04:54.876+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:04:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.877+0000 7f95a4ff9640 1 -- 172.21.15.5:0/3941681797 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f95a0058640 con 0x7f95a8154c00 2024-04-25T09:04:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f958806b4d0 msgr2=0x7f958806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f958806b4d0 0x7f958806d990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9590003700 tx=0x7f9590009040 comp rx=0 tx=0).stop 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a8154c00 msgr2=0x7f95a80b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a8154c00 0x7f95a80b1790 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f95a806c680 tx=0x7f95a0007bc0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 shutdown_connections 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f958806b4d0 0x7f958806d990 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a8154c00 0x7f95a80b1790 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95a815cee0 0x7f95a80c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 --2- 172.21.15.5:0/3941681797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95940043b0 0x7f95a806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 >> 172.21.15.5:0/3941681797 conn(0x7f95a80d18f0 msgr2=0x7f95a815de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 shutdown_connections 2024-04-25T09:04:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.880+0000 7f95ae79e640 1 -- 172.21.15.5:0/3941681797 wait complete. 2024-04-25T09:04:54.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:04:54.909 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:04:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.994+0000 7f101ce5d640 1 Processor -- start 2024-04-25T09:04:54.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.994+0000 7f101ce5d640 1 -- start start 2024-04-25T09:04:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f101ce5d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f101815df10 0x7f10181618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f101ce5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10180b6250 0x7f10180ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f101ce5d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10180cee10 0x7f10180d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f101ce5d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180d20d0 con 0x7f10180cee10 2024-04-25T09:04:54.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f101ce5d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1018162150 con 0x7f101815df10 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f101ce5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1018162430 con 0x7f10180b6250 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f1016d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10180cee10 0x7f10180d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f1016d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10180cee10 0x7f10180d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46814/0 (socket says 172.21.15.5:46814) 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.995+0000 7f1016d9d640 1 -- 172.21.15.5:0/2038326168 learned_addr learned my addr 172.21.15.5:0/2038326168 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f100dd9b640 1 --2- 172.21.15.5:0/2038326168 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10180b6250 0x7f10180ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f101659c640 1 --2- 172.21.15.5:0/2038326168 >> v2:172.21.15.80:3300/0 conn(0x7f101815df10 0x7f10181618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f1016d9d640 1 -- 172.21.15.5:0/2038326168 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10180b6250 msgr2=0x7f10180ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f1016d9d640 1 --2- 172.21.15.5:0/2038326168 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10180b6250 0x7f10180ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f1016d9d640 1 -- 172.21.15.5:0/2038326168 >> v2:172.21.15.80:3300/0 conn(0x7f101815df10 msgr2=0x7f10181618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f1016d9d640 1 --2- 172.21.15.5:0/2038326168 >> v2:172.21.15.80:3300/0 conn(0x7f101815df10 0x7f10181618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f1016d9d640 1 -- 172.21.15.5:0/2038326168 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1018162710 con 0x7f10180cee10 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f100dd9b640 1 --2- 172.21.15.5:0/2038326168 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10180b6250 0x7f10180ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f101659c640 1 --2- 172.21.15.5:0/2038326168 >> v2:172.21.15.80:3300/0 conn(0x7f101815df10 0x7f10181618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.996+0000 7f1016d9d640 1 --2- 172.21.15.5:0/2038326168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180d0440 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f1018075080 tx=0x7f101002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10a83186e22e5e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f1015d9b640 1 -- 172.21.15.5:0/2038326168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010036070 con 0x7f10180cee10 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f1015d9b640 1 -- 172.21.15.5:0/2038326168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1010031600 con 0x7f10180cee10 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f1015d9b640 1 -- 172.21.15.5:0/2038326168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100319d0 con 0x7f10180cee10 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 -- 172.21.15.5:0/2038326168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 msgr2=0x7f10180d0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 --2- 172.21.15.5:0/2038326168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180d0440 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f1018075080 tx=0x7f101002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 -- 172.21.15.5:0/2038326168 shutdown_connections 2024-04-25T09:04:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 --2- 172.21.15.5:0/2038326168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180d0440 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 --2- 172.21.15.5:0/2038326168 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f10180b6250 0x7f10180ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 --2- 172.21.15.5:0/2038326168 >> v2:172.21.15.80:3300/0 conn(0x7f101815df10 0x7f10181618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 -- 172.21.15.5:0/2038326168 >> 172.21.15.5:0/2038326168 conn(0x7f10180668f0 msgr2=0x7f1018066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 -- 172.21.15.5:0/2038326168 shutdown_connections 2024-04-25T09:04:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.997+0000 7f101ce5d640 1 -- 172.21.15.5:0/2038326168 wait complete. 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 Processor -- start 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 -- start start 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10180b6250 0x7f10180b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f101815df10 0x7f10180cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10180d0980 con 0x7f10180cee10 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018161e10 con 0x7f10180b6250 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:54.999+0000 7f101ce5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10180d0b00 con 0x7f101815df10 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46822/0 (socket says 172.21.15.5:46822) 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 -- 172.21.15.5:0/760540372 learned_addr learned my addr 172.21.15.5:0/760540372 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:54.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f101659c640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10180b6250 0x7f10180b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f1016d9d640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f101815df10 0x7f10180cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 -- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f101815df10 msgr2=0x7f10180cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f101815df10 0x7f10180cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 -- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10180b6250 msgr2=0x7f10180b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10180b6250 0x7f10180b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 -- 172.21.15.5:0/760540372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10181e85b0 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100dd9b640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180cc510 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f100000c7c0 tx=0x7f100000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100f7fe640 1 -- 172.21.15.5:0/760540372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000015070 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100f7fe640 1 -- 172.21.15.5:0/760540372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000007a30 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f100f7fe640 1 -- 172.21.15.5:0/760540372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000007e00 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10181e8890 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.000+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10181e8e50 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.001+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101804ef20 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.002+0000 7f100f7fe640 1 -- 172.21.15.5:0/760540372 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1000018070 con 0x7f10180cee10 2024-04-25T09:04:54.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.002+0000 7f100f7fe640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ff806b4d0 0x7f0ff806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.002+0000 7f100f7fe640 1 -- 172.21.15.5:0/760540372 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f100008a040 con 0x7f10180cee10 2024-04-25T09:04:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.002+0000 7f101659c640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ff806b4d0 0x7f0ff806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:54.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.003+0000 7f101659c640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ff806b4d0 0x7f0ff806d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f100800aac0 tx=0x7f1008008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:54.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.006+0000 7f100f7fe640 1 -- 172.21.15.5:0/760540372 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1000058870 con 0x7f10180cee10 2024-04-25T09:04:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.226+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f10180c6e60 con 0x7f10180cee10 2024-04-25T09:04:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.879+0000 7f100f7fe640 1 -- 172.21.15.5:0/760540372 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f100005c910 con 0x7f10180cee10 2024-04-25T09:04:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ff806b4d0 msgr2=0x7f0ff806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ff806b4d0 0x7f0ff806d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f100800aac0 tx=0x7f1008008040 comp rx=0 tx=0).stop 2024-04-25T09:04:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 msgr2=0x7f10180cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180cc510 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f100000c7c0 tx=0x7f100000cc80 comp rx=0 tx=0).stop 2024-04-25T09:04:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 shutdown_connections 2024-04-25T09:04:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0ff806b4d0 0x7f0ff806d990 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f101815df10 0x7f10180cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10180cee10 0x7f10180cc510 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 --2- 172.21.15.5:0/760540372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10180b6250 0x7f10180b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 >> 172.21.15.5:0/760540372 conn(0x7f10180668f0 msgr2=0x7f10180c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 shutdown_connections 2024-04-25T09:04:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:55.882+0000 7f101ce5d640 1 -- 172.21.15.5:0/760540372 wait complete. 2024-04-25T09:04:55.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:04:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.010+0000 7fdab03e7640 1 Processor -- start 2024-04-25T09:04:55.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.010+0000 7fdab03e7640 1 -- start start 2024-04-25T09:04:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdab03e7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdaa815dbd0 0x7fdaa81617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdab03e7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdaa80ceec0 0x7fdaa80d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdab03e7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa8162070 con 0x7fdaa80b9470 2024-04-25T09:04:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdab03e7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa8162350 con 0x7fdaa80ceec0 2024-04-25T09:04:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdab03e7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa80d1c50 con 0x7fdaa815dbd0 2024-04-25T09:04:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae984640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdaa80ceec0 0x7fdaa80d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaad982640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdaa80b9470 0x7fdaa80ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53322/0 (socket says 172.21.15.5:53322) 2024-04-25T09:04:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae984640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdaa80ceec0 0x7fdaa80d2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46838/0 (socket says 172.21.15.5:46838) 2024-04-25T09:04:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaad982640 1 -- 172.21.15.5:0/1004080773 learned_addr learned my addr 172.21.15.5:0/1004080773 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae183640 1 --2- 172.21.15.5:0/1004080773 >> v2:172.21.15.80:3300/0 conn(0x7fdaa815dbd0 0x7fdaa81617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae984640 1 -- 172.21.15.5:0/1004080773 >> v2:172.21.15.80:3300/0 conn(0x7fdaa815dbd0 msgr2=0x7fdaa81617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae984640 1 --2- 172.21.15.5:0/1004080773 >> v2:172.21.15.80:3300/0 conn(0x7fdaa815dbd0 0x7fdaa81617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae984640 1 -- 172.21.15.5:0/1004080773 >> v1:172.21.15.5:6789/0 conn(0x7fdaa80b9470 legacy=0x7fdaa80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae984640 1 -- 172.21.15.5:0/1004080773 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80d1f30 con 0x7fdaa80ceec0 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaad181640 1 -- 172.21.15.5:0/1004080773 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700764156 0 0) 0x7fdaa8162070 con 0x7fdaa80b9470 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.011+0000 7fdaae183640 1 --2- 172.21.15.5:0/1004080773 >> v2:172.21.15.80:3300/0 conn(0x7fdaa815dbd0 0x7fdaa81617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.012+0000 7fdaae984640 1 --2- 172.21.15.5:0/1004080773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa80d2450 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fdaa806bad0 tx=0x7fdaa002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e329307dbdc5b69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.012+0000 7fdaad181640 1 -- 172.21.15.5:0/1004080773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0007740 con 0x7fdaa80ceec0 2024-04-25T09:04:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.012+0000 7fdaad181640 1 -- 172.21.15.5:0/1004080773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa00078e0 con 0x7fdaa80ceec0 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.012+0000 7fdaad181640 1 -- 172.21.15.5:0/1004080773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0007cb0 con 0x7fdaa80ceec0 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 -- 172.21.15.5:0/1004080773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 msgr2=0x7fdaa80d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 --2- 172.21.15.5:0/1004080773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa80d2450 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fdaa806bad0 tx=0x7fdaa002a680 comp rx=0 tx=0).stop 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 -- 172.21.15.5:0/1004080773 shutdown_connections 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 --2- 172.21.15.5:0/1004080773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa80d2450 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 --2- 172.21.15.5:0/1004080773 >> v2:172.21.15.80:3300/0 conn(0x7fdaa815dbd0 0x7fdaa81617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 -- 172.21.15.5:0/1004080773 >> 172.21.15.5:0/1004080773 conn(0x7fdaa8066ad0 msgr2=0x7fdaa8066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 -- 172.21.15.5:0/1004080773 shutdown_connections 2024-04-25T09:04:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.013+0000 7fdab03e7640 1 -- 172.21.15.5:0/1004080773 wait complete. 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.014+0000 7fdab03e7640 1 Processor -- start 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.014+0000 7fdab03e7640 1 -- start start 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdab03e7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdaa80b9470 0x7fdaa814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdab03e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdab03e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdaa815dbd0 0x7fdaa80c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdab03e7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa815dfb0 con 0x7fdaa80ceec0 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdab03e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8161cf0 con 0x7fdaa815dbd0 2024-04-25T09:04:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdab03e7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa815e130 con 0x7fdaa80b9470 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46850/0 (socket says 172.21.15.5:46850) 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 -- 172.21.15.5:0/3230569006 learned_addr learned my addr 172.21.15.5:0/3230569006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaae984640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdaa815dbd0 0x7fdaa80c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaae183640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdaa80b9470 0x7fdaa814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 -- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdaa80b9470 msgr2=0x7fdaa814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdaa80b9470 0x7fdaa814aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 -- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdaa815dbd0 msgr2=0x7fdaa80c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdaa815dbd0 0x7fdaa80c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaad982640 1 -- 172.21.15.5:0/3230569006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa815ed70 con 0x7fdaa80ceec0 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.015+0000 7fdaae984640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdaa815dbd0 0x7fdaa80c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.016+0000 7fdaad982640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa815e2b0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c4d0 tx=0x7fda9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.016+0000 7fda9effd640 1 -- 172.21.15.5:0/3230569006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98018070 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.016+0000 7fda9effd640 1 -- 172.21.15.5:0/3230569006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98007500 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.016+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa815f050 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.016+0000 7fda9effd640 1 -- 172.21.15.5:0/3230569006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98004a20 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.016+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa815f610 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.017+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa804ef20 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.017+0000 7fda9effd640 1 -- 172.21.15.5:0/3230569006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda9801b070 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.018+0000 7fda9effd640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda8c06b4d0 0x7fda8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.018+0000 7fda9effd640 1 -- 172.21.15.5:0/3230569006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fda98089590 con 0x7fdaa80ceec0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.018+0000 7fdaae183640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda8c06b4d0 0x7fda8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.018+0000 7fdaae183640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda8c06b4d0 0x7fda8c06d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4006fd0 tx=0x7fdaa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.022+0000 7fda9effd640 1 -- 172.21.15.5:0/3230569006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda98058380 con 0x7fdaa80ceec0 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.201+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdaa80cfc80 con 0x7fdaa80ceec0 2024-04-25T09:04:56.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.880+0000 7fda9effd640 1 -- 172.21.15.5:0/3230569006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 181+0+0 (secure 0 0 0) 0x7fda98057c80 con 0x7fdaa80ceec0 2024-04-25T09:04:56.869 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:04:56.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda8c06b4d0 msgr2=0x7fda8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda8c06b4d0 0x7fda8c06d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4006fd0 tx=0x7fdaa4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 msgr2=0x7fdaa815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa815e2b0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c4d0 tx=0x7fda9800c990 comp rx=0 tx=0).stop 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 shutdown_connections 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fda8c06b4d0 0x7fda8c06d990 secure :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4006fd0 tx=0x7fdaa4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdaa815dbd0 0x7fdaa80c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa80ceec0 0x7fdaa815e2b0 secure :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c4d0 tx=0x7fda9800c990 comp rx=0 tx=0).stop 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 --2- 172.21.15.5:0/3230569006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdaa80b9470 0x7fdaa814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 >> 172.21.15.5:0/3230569006 conn(0x7fdaa8066ad0 msgr2=0x7fdaa80d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.884+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 shutdown_connections 2024-04-25T09:04:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:56.885+0000 7fdab03e7640 1 -- 172.21.15.5:0/3230569006 wait complete. 2024-04-25T09:04:56.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:04:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.013+0000 7f56f9f61640 1 Processor -- start 2024-04-25T09:04:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.013+0000 7f56f9f61640 1 -- start start 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f9f61640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f56f415dbd0 0x7f56f41617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f9f61640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56f40b9470 0x7f56f40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f9f61640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f4162070 con 0x7f56f40cecf0 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f9f61640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f40cf120 con 0x7f56f40b9470 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f9f61640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f4162350 con 0x7f56f415dbd0 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56f40b9470 0x7f56f40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f56f40cecf0 0x7f56f40b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53324/0 (socket says 172.21.15.5:53324) 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f3fff640 1 -- 172.21.15.5:0/4198757301 learned_addr learned my addr 172.21.15.5:0/4198757301 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56f40b9470 0x7f56f40ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46852/0 (socket says 172.21.15.5:46852) 2024-04-25T09:04:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f37fe640 1 --2- 172.21.15.5:0/4198757301 >> v2:172.21.15.80:3300/0 conn(0x7f56f415dbd0 0x7f56f41617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f2ffd640 1 -- 172.21.15.5:0/4198757301 >> v2:172.21.15.80:3300/0 conn(0x7f56f415dbd0 msgr2=0x7f56f41617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f2ffd640 1 --2- 172.21.15.5:0/4198757301 >> v2:172.21.15.80:3300/0 conn(0x7f56f415dbd0 0x7f56f41617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f2ffd640 1 -- 172.21.15.5:0/4198757301 >> v1:172.21.15.5:6789/0 conn(0x7f56f40cecf0 legacy=0x7f56f40b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f27fc640 1 -- 172.21.15.5:0/4198757301 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178252784 0 0) 0x7f56f4162070 con 0x7f56f40cecf0 2024-04-25T09:04:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.014+0000 7f56f2ffd640 1 -- 172.21.15.5:0/4198757301 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40d1c50 con 0x7f56f40b9470 2024-04-25T09:04:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.015+0000 7f56f2ffd640 1 --2- 172.21.15.5:0/4198757301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40b9470 0x7f56f40ce7b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f56f406bad0 tx=0x7f56e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aa20231ba29fcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.015+0000 7f56f27fc640 1 -- 172.21.15.5:0/4198757301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8037070 con 0x7f56f40b9470 2024-04-25T09:04:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.015+0000 7f56f27fc640 1 -- 172.21.15.5:0/4198757301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8032440 con 0x7f56f40b9470 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.015+0000 7f56f27fc640 1 -- 172.21.15.5:0/4198757301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8032810 con 0x7f56f40b9470 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 -- 172.21.15.5:0/4198757301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40b9470 msgr2=0x7f56f40ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 --2- 172.21.15.5:0/4198757301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40b9470 0x7f56f40ce7b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f56f406bad0 tx=0x7f56e802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 -- 172.21.15.5:0/4198757301 shutdown_connections 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 --2- 172.21.15.5:0/4198757301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40b9470 0x7f56f40ce7b0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 --2- 172.21.15.5:0/4198757301 >> v2:172.21.15.80:3300/0 conn(0x7f56f415dbd0 0x7f56f41617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 -- 172.21.15.5:0/4198757301 >> 172.21.15.5:0/4198757301 conn(0x7f56f4066ad0 msgr2=0x7f56f4066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 -- 172.21.15.5:0/4198757301 shutdown_connections 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.016+0000 7f56f9f61640 1 -- 172.21.15.5:0/4198757301 wait complete. 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.017+0000 7f56f9f61640 1 Processor -- start 2024-04-25T09:04:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.017+0000 7f56f9f61640 1 -- start start 2024-04-25T09:04:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f9f61640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f40b9470 0x7f56f414ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f9f61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40cecf0 0x7f56f415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f9f61640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56f415dbd0 0x7f56f4157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f9f61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4161cf0 con 0x7f56f40cecf0 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f9f61640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4162630 con 0x7f56f40b9470 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f9f61640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f415dfb0 con 0x7f56f415dbd0 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40cecf0 0x7f56f415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40cecf0 0x7f56f415a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46858/0 (socket says 172.21.15.5:46858) 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 -- 172.21.15.5:0/1947280796 learned_addr learned my addr 172.21.15.5:0/1947280796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f37fe640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f40b9470 0x7f56f414ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f3fff640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56f415dbd0 0x7f56f4157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 -- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56f415dbd0 msgr2=0x7f56f4157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56f415dbd0 0x7f56f4157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 -- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f40b9470 msgr2=0x7f56f414ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f40b9470 0x7f56f414ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 -- 172.21.15.5:0/1947280796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40cd0c0 con 0x7f56f40cecf0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f37fe640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f40b9470 0x7f56f414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.018+0000 7f56f2ffd640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40cecf0 0x7f56f415a500 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.019+0000 7f56dbfff640 1 -- 172.21.15.5:0/1947280796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8037040 con 0x7f56f40cecf0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.019+0000 7f56dbfff640 1 -- 172.21.15.5:0/1947280796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8042070 con 0x7f56f40cecf0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.019+0000 7f56dbfff640 1 -- 172.21.15.5:0/1947280796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8030bd0 con 0x7f56f40cecf0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.019+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f414d3c0 con 0x7f56f40cecf0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.019+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f40cd610 con 0x7f56f40cecf0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.020+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f404ef20 con 0x7f56f40cecf0 2024-04-25T09:04:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.020+0000 7f56dbfff640 1 -- 172.21.15.5:0/1947280796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56e8047460 con 0x7f56f40cecf0 2024-04-25T09:04:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.021+0000 7f56dbfff640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f56e006b4d0 0x7f56e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.021+0000 7f56dbfff640 1 -- 172.21.15.5:0/1947280796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f56e80aac50 con 0x7f56f40cecf0 2024-04-25T09:04:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.021+0000 7f56f37fe640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f56e006b4d0 0x7f56e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.021+0000 7f56f37fe640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f56e006b4d0 0x7f56e006d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f56e4006fd0 tx=0x7f56e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.025+0000 7f56dbfff640 1 -- 172.21.15.5:0/1947280796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56e8032e20 con 0x7f56f40cecf0 2024-04-25T09:04:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.204+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56f40b6080 con 0x7f56f40cecf0 2024-04-25T09:04:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.885+0000 7f56dbfff640 1 -- 172.21.15.5:0/1947280796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 169+0+0 (secure 0 0 0) 0x7f56e8045360 con 0x7f56f40cecf0 2024-04-25T09:04:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T09:04:57.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.890+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f56e006b4d0 msgr2=0x7f56e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.890+0000 7f56f9f61640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f56e006b4d0 0x7f56e006d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f56e4006fd0 tx=0x7f56e4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:57.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.890+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40cecf0 msgr2=0x7f56f415a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.890+0000 7f56f9f61640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40cecf0 0x7f56f415a500 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e80046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.892+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 shutdown_connections 2024-04-25T09:04:57.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.892+0000 7f56f9f61640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f56e006b4d0 0x7f56e006d990 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.892+0000 7f56f9f61640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56f415dbd0 0x7f56f4157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.892+0000 7f56f9f61640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56f40cecf0 0x7f56f415a500 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.892+0000 7f56f9f61640 1 --2- 172.21.15.5:0/1947280796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56f40b9470 0x7f56f414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.892+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 >> 172.21.15.5:0/1947280796 conn(0x7f56f4066ad0 msgr2=0x7f56f40b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:57.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.893+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 shutdown_connections 2024-04-25T09:04:57.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:57.893+0000 7f56f9f61640 1 -- 172.21.15.5:0/1947280796 wait complete. 2024-04-25T09:04:57.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:04:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.027+0000 7fce24590640 1 Processor -- start 2024-04-25T09:04:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.027+0000 7fce24590640 1 -- start start 2024-04-25T09:04:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce24590640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0cfd70 0x7fce1c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce24590640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce1c0ce6e0 0x7fce1c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce24590640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c0cc010 con 0x7fce1c0b72b0 2024-04-25T09:04:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce24590640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c0d01d0 con 0x7fce1c0ce6e0 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce24590640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0cc2f0 con 0x7fce1c0cfd70 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce22b2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce1c0ce6e0 0x7fce1c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce22b2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce1c0ce6e0 0x7fce1c0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46874/0 (socket says 172.21.15.5:46874) 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.028+0000 7fce22b2d640 1 -- 172.21.15.5:0/2527781770 learned_addr learned my addr 172.21.15.5:0/2527781770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.029+0000 7fce21b2b640 1 --2- 172.21.15.5:0/2527781770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0cfd70 0x7fce1c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.029+0000 7fce22b2d640 1 -- 172.21.15.5:0/2527781770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0cfd70 msgr2=0x7fce1c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.029+0000 7fce22b2d640 1 --2- 172.21.15.5:0/2527781770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0cfd70 0x7fce1c0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.029+0000 7fce22b2d640 1 -- 172.21.15.5:0/2527781770 >> v1:172.21.15.80:6789/0 conn(0x7fce1c0b72b0 legacy=0x7fce1c0d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.029+0000 7fce22b2d640 1 -- 172.21.15.5:0/2527781770 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c0cc5d0 con 0x7fce1c0ce6e0 2024-04-25T09:04:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.029+0000 7fce21b2b640 1 --2- 172.21.15.5:0/2527781770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0cfd70 0x7fce1c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.029+0000 7fce22b2d640 1 --2- 172.21.15.5:0/2527781770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0ce6e0 0x7fce1c0ccdd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009e50 tx=0x7fce0c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0679091fcf369f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce2132a640 1 -- 172.21.15.5:0/2527781770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c036070 con 0x7fce1c0ce6e0 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce2132a640 1 -- 172.21.15.5:0/2527781770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c031600 con 0x7fce1c0ce6e0 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce2132a640 1 -- 172.21.15.5:0/2527781770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0319d0 con 0x7fce1c0ce6e0 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 -- 172.21.15.5:0/2527781770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0ce6e0 msgr2=0x7fce1c0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 --2- 172.21.15.5:0/2527781770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0ce6e0 0x7fce1c0ccdd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009e50 tx=0x7fce0c02a710 comp rx=0 tx=0).stop 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 -- 172.21.15.5:0/2527781770 shutdown_connections 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 --2- 172.21.15.5:0/2527781770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0ce6e0 0x7fce1c0ccdd0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 --2- 172.21.15.5:0/2527781770 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0cfd70 0x7fce1c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 -- 172.21.15.5:0/2527781770 >> 172.21.15.5:0/2527781770 conn(0x7fce1c0d1920 msgr2=0x7fce1c0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 -- 172.21.15.5:0/2527781770 shutdown_connections 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.030+0000 7fce24590640 1 -- 172.21.15.5:0/2527781770 wait complete. 2024-04-25T09:04:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.031+0000 7fce24590640 1 Processor -- start 2024-04-25T09:04:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.031+0000 7fce24590640 1 -- start start 2024-04-25T09:04:58.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce24590640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0b72b0 0x7fce1c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce24590640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce1c0ce6e0 0x7fce1c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce24590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0cfd70 0x7fce1c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce24590640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0d1550 con 0x7fce1c0cfd70 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce24590640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0b4770 con 0x7fce1c0ce6e0 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce24590640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0b7690 con 0x7fce1c0b72b0 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce22b2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0cfd70 0x7fce1c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce22b2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0cfd70 0x7fce1c0caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46882/0 (socket says 172.21.15.5:46882) 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce22b2d640 1 -- 172.21.15.5:0/961906962 learned_addr learned my addr 172.21.15.5:0/961906962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce2232c640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0b72b0 0x7fce1c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.032+0000 7fce21b2b640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce1c0ce6e0 0x7fce1c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce22b2d640 1 -- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0b72b0 msgr2=0x7fce1c0c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce22b2d640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0b72b0 0x7fce1c0c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce22b2d640 1 -- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce1c0ce6e0 msgr2=0x7fce1c15d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce22b2d640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce1c0ce6e0 0x7fce1c15d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce22b2d640 1 -- 172.21.15.5:0/961906962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c15dd20 con 0x7fce1c0cfd70 2024-04-25T09:04:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce22b2d640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0cfd70 0x7fce1c0caad0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fce0c034040 tx=0x7fce0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce1affd640 1 -- 172.21.15.5:0/961906962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c036050 con 0x7fce1c0cfd70 2024-04-25T09:04:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce1affd640 1 -- 172.21.15.5:0/961906962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c042070 con 0x7fce1c0cfd70 2024-04-25T09:04:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c0c8b70 con 0x7fce1c0cfd70 2024-04-25T09:04:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce1affd640 1 -- 172.21.15.5:0/961906962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c009510 con 0x7fce1c0cfd70 2024-04-25T09:04:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.033+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c0c67e0 con 0x7fce1c0cfd70 2024-04-25T09:04:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.034+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c04ef20 con 0x7fce1c0cfd70 2024-04-25T09:04:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.035+0000 7fce1affd640 1 -- 172.21.15.5:0/961906962 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce0c007bd0 con 0x7fce1c0cfd70 2024-04-25T09:04:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.035+0000 7fce1affd640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce0806b500 0x7fce0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.035+0000 7fce1affd640 1 -- 172.21.15.5:0/961906962 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fce0c0aaba0 con 0x7fce1c0cfd70 2024-04-25T09:04:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.035+0000 7fce2232c640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce0806b500 0x7fce0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.036+0000 7fce2232c640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce0806b500 0x7fce0806d9c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fce140016e0 tx=0x7fce14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.039+0000 7fce1affd640 1 -- 172.21.15.5:0/961906962 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce0c079760 con 0x7fce1c0cfd70 2024-04-25T09:04:58.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.219+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fce1c0c8d40 con 0x7fce1c0cfd70 2024-04-25T09:04:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.222+0000 7fce1affd640 1 -- 172.21.15.5:0/961906962 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fce0c07d800 con 0x7fce1c0cfd70 2024-04-25T09:04:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce0806b500 msgr2=0x7fce0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce0806b500 0x7fce0806d9c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fce140016e0 tx=0x7fce14009040 comp rx=0 tx=0).stop 2024-04-25T09:04:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0cfd70 msgr2=0x7fce1c0caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0cfd70 0x7fce1c0caad0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fce0c034040 tx=0x7fce0c004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 shutdown_connections 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fce0806b500 0x7fce0806d9c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce1c0cfd70 0x7fce1c0caad0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce1c0ce6e0 0x7fce1c15d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 --2- 172.21.15.5:0/961906962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fce1c0b72b0 0x7fce1c0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 >> 172.21.15.5:0/961906962 conn(0x7fce1c0d1920 msgr2=0x7fce1c160ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 shutdown_connections 2024-04-25T09:04:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.224+0000 7fce24590640 1 -- 172.21.15.5:0/961906962 wait complete. 2024-04-25T09:04:58.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-04-25T09:04:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.336+0000 7f665c4b5640 1 Processor -- start 2024-04-25T09:04:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.336+0000 7f665c4b5640 1 -- start start 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665c4b5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66540ce720 0x7f66540b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665c4b5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540cdcb0 con 0x7f665415bdc0 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665c4b5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540cdf90 con 0x7f66540ce290 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665c4b5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66540b47e0 con 0x7f66540ce720 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665aa52640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66540ce720 0x7f66540b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665a251640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f665415bdc0 0x7f66540cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53334/0 (socket says 172.21.15.5:53334) 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665aa52640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66540ce720 0x7f66540b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46888/0 (socket says 172.21.15.5:46888) 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665a251640 1 -- 172.21.15.5:0/548157741 learned_addr learned my addr 172.21.15.5:0/548157741 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665aa52640 1 -- 172.21.15.5:0/548157741 >> v1:172.21.15.80:6789/0 conn(0x7f66540ce290 legacy=0x7f66540b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665aa52640 1 -- 172.21.15.5:0/548157741 >> v1:172.21.15.5:6789/0 conn(0x7f665415bdc0 legacy=0x7f66540cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665aa52640 1 -- 172.21.15.5:0/548157741 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66540b4ac0 con 0x7f66540ce720 2024-04-25T09:04:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.337+0000 7f665924f640 1 -- 172.21.15.5:0/548157741 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245755541 0 0) 0x7f66540cdcb0 con 0x7f665415bdc0 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.338+0000 7f665aa52640 1 --2- 172.21.15.5:0/548157741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66540b59d0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f664c009d90 tx=0x7f664c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fead9e8476548b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.338+0000 7f665924f640 1 -- 172.21.15.5:0/548157741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c007740 con 0x7f66540ce720 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.338+0000 7f665924f640 1 -- 172.21.15.5:0/548157741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c0078e0 con 0x7f66540ce720 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.338+0000 7f665924f640 1 -- 172.21.15.5:0/548157741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c007cb0 con 0x7f66540ce720 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.339+0000 7f665c4b5640 1 -- 172.21.15.5:0/548157741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 msgr2=0x7f66540b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.339+0000 7f665c4b5640 1 --2- 172.21.15.5:0/548157741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66540b59d0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f664c009d90 tx=0x7f664c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.339+0000 7f665c4b5640 1 -- 172.21.15.5:0/548157741 shutdown_connections 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.339+0000 7f665c4b5640 1 --2- 172.21.15.5:0/548157741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66540b59d0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.339+0000 7f665c4b5640 1 -- 172.21.15.5:0/548157741 >> 172.21.15.5:0/548157741 conn(0x7f66540d18f0 msgr2=0x7f66540d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.339+0000 7f665c4b5640 1 -- 172.21.15.5:0/548157741 shutdown_connections 2024-04-25T09:04:58.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.339+0000 7f665c4b5640 1 -- 172.21.15.5:0/548157741 wait complete. 2024-04-25T09:04:58.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.340+0000 7f665c4b5640 1 Processor -- start 2024-04-25T09:04:58.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.340+0000 7f665c4b5640 1 -- start start 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665c4b5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66540ce290 0x7f66540c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665c4b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66541511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665c4b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665415bdc0 0x7f66540c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665c4b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66540d09a0 con 0x7f66540ce720 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665c4b5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66540ceb50 con 0x7f665415bdc0 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665c4b5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66540cd8b0 con 0x7f66540ce290 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66541511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66541511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46898/0 (socket says 172.21.15.5:46898) 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 -- 172.21.15.5:0/1167716209 learned_addr learned my addr 172.21.15.5:0/1167716209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665a251640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66540ce290 0x7f66540c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f665aa52640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665415bdc0 0x7f66540c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 -- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66540ce290 msgr2=0x7f66540c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66540ce290 0x7f66540c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 -- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665415bdc0 msgr2=0x7f66540c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665415bdc0 0x7f66540c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.341+0000 7f6659a50640 1 -- 172.21.15.5:0/1167716209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66540c6830 con 0x7f66540ce720 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.342+0000 7f6659a50640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66541511a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f664400c430 tx=0x7f664400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.342+0000 7f664affd640 1 -- 172.21.15.5:0/1167716209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011790 con 0x7f66540ce720 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.342+0000 7f664affd640 1 -- 172.21.15.5:0/1167716209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644017070 con 0x7f66540ce720 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.342+0000 7f664affd640 1 -- 172.21.15.5:0/1167716209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011bb0 con 0x7f66540ce720 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.342+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6654152210 con 0x7f66540ce720 2024-04-25T09:04:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.342+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66541524b0 con 0x7f66540ce720 2024-04-25T09:04:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.343+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665404ef20 con 0x7f66540ce720 2024-04-25T09:04:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.343+0000 7f664affd640 1 -- 172.21.15.5:0/1167716209 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f664401c460 con 0x7f66540ce720 2024-04-25T09:04:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.344+0000 7f664affd640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.344+0000 7f664affd640 1 -- 172.21.15.5:0/1167716209 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6644089c50 con 0x7f66540ce720 2024-04-25T09:04:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.344+0000 7f665a251640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.344+0000 7f665a251640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6650007fd0 tx=0x7f6650007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.348+0000 7f664affd640 1 -- 172.21.15.5:0/1167716209 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6644058770 con 0x7f66540ce720 2024-04-25T09:04:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.599+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f66540b73d0 con 0x7f66540ce720 2024-04-25T09:04:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.886+0000 7f664affd640 1 -- 172.21.15.5:0/1167716209 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v405) v1 ==== 166+0+0 (secure 0 0 0) 0x7f664405c810 con 0x7f66540ce720 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 msgr2=0x7f663806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6650007fd0 tx=0x7f6650007de0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 msgr2=0x7f66541511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66541511a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f664400c430 tx=0x7f664400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 shutdown_connections 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665415bdc0 0x7f66540c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66540ce720 0x7f66541511a0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 --2- 172.21.15.5:0/1167716209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66540ce290 0x7f66540c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 >> 172.21.15.5:0/1167716209 conn(0x7f66540d18f0 msgr2=0x7f66540b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 shutdown_connections 2024-04-25T09:04:58.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:58.889+0000 7f665c4b5640 1 -- 172.21.15.5:0/1167716209 wait complete. 2024-04-25T09:04:58.889 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:04:58.889 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:04:58.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:58.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.003+0000 7ff8a4c07640 1 Processor -- start 2024-04-25T09:04:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.003+0000 7ff8a4c07640 1 -- start start 2024-04-25T09:04:58.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff8a4c07640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 0x7ff8a00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff8a4c07640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8a00b7130 0x7ff8a00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff8a4c07640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00d20e0 con 0x7ff8a015de70 2024-04-25T09:04:58.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff8a4c07640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a00d2a10 con 0x7ff8a00b7130 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff8a4c07640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00d23c0 con 0x7ff8a00b2cc0 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff8a015de70 0x7ff8a00b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53340/0 (socket says 172.21.15.5:53340) 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89e59c640 1 -- 172.21.15.5:0/525110140 learned_addr learned my addr 172.21.15.5:0/525110140 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752453951 0 0) 0x7ff8a00d20e0 con 0x7ff8a015de70 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff88c003520 con 0x7ff8a015de70 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89ed9d640 1 --2- 172.21.15.5:0/525110140 >> v2:172.21.15.80:3300/0 conn(0x7ff8a00b7130 0x7ff8a00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff897fff640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 0x7ff8a00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194304890 0 0) 0x7ff88c003520 con 0x7ff8a015de70 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 msgr2=0x7ff8a00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 0x7ff8a00b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 >> v2:172.21.15.80:3300/0 conn(0x7ff8a00b7130 msgr2=0x7ff8a00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 --2- 172.21.15.5:0/525110140 >> v2:172.21.15.80:3300/0 conn(0x7ff8a00b7130 0x7ff8a00ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00d26a0 con 0x7ff8a015de70 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7ff890001670 con 0x7ff8a015de70 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 >> v1:172.21.15.5:6789/0 conn(0x7ff8a015de70 legacy=0x7ff8a00b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff88c0039b0 0x7ff88c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.004+0000 7ff89dd9b640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 0x7ff88c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89dd9b640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c004d40 0x7ff88c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00d2a10 con 0x7ff88c004d40 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00d23c0 con 0x7ff88c0039b0 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c00b9c0 con 0x7ff8a00b2cc0 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89ed9d640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c004d40 0x7ff88c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89e59c640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff88c0039b0 0x7ff88c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff897fff640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 0x7ff88c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89ed9d640 1 -- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 msgr2=0x7ff88c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89ed9d640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff8a00b2cc0 0x7ff88c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89ed9d640 1 -- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff88c0039b0 msgr2=0x7ff88c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89ed9d640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff88c0039b0 0x7ff88c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.005+0000 7ff89ed9d640 1 -- 172.21.15.5:0/525110140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c003520 con 0x7ff88c004d40 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff89ed9d640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c004d40 0x7ff88c0051c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ff898009fc0 tx=0x7ff88c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed1001f5b7c960e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898009c10 con 0x7ff88c004d40 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff898036070 con 0x7ff88c004d40 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff89dd9b640 1 -- 172.21.15.5:0/525110140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89802d070 con 0x7ff88c004d40 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff8a4c07640 1 -- 172.21.15.5:0/525110140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c004d40 msgr2=0x7ff88c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff8a4c07640 1 --2- 172.21.15.5:0/525110140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c004d40 0x7ff88c0051c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ff898009fc0 tx=0x7ff88c005830 comp rx=0 tx=0).stop 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff89ed9d640 1 -- 172.21.15.5:0/525110140 reap_dead start 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff8a4c07640 1 -- 172.21.15.5:0/525110140 shutdown_connections 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff8a4c07640 1 -- 172.21.15.5:0/525110140 >> 172.21.15.5:0/525110140 conn(0x7ff8a006b000 msgr2=0x7ff8a006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff8a4c07640 1 -- 172.21.15.5:0/525110140 shutdown_connections 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.006+0000 7ff8a4c07640 1 -- 172.21.15.5:0/525110140 wait complete. 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 Processor -- start 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 -- start start 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff88c004d40 0x7ff8a00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a01f7db0 0x7ff8a015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8a01f7130 0x7ff8a01f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b6f80 con 0x7ff8a01f7db0 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b6e00 con 0x7ff8a01f7130 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.008+0000 7ff8a4c07640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00ced30 con 0x7ff88c004d40 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a01f7db0 0x7ff8a015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a01f7db0 0x7ff8a015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46910/0 (socket says 172.21.15.5:46910) 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 -- 172.21.15.5:0/4271231324 learned_addr learned my addr 172.21.15.5:0/4271231324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff89e59c640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff88c004d40 0x7ff8a00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff89ed9d640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8a01f7130 0x7ff8a01f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 -- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff88c004d40 msgr2=0x7ff8a00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff88c004d40 0x7ff8a00b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 -- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8a01f7130 msgr2=0x7ff8a01f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8a01f7130 0x7ff8a01f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 -- 172.21.15.5:0/4271231324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00b3a00 con 0x7ff8a01f7db0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff897fff640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a01f7db0 0x7ff8a015b200 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff8880119d0 tx=0x7ff888011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff896ffd640 1 -- 172.21.15.5:0/4271231324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88800faf0 con 0x7ff8a01f7db0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff896ffd640 1 -- 172.21.15.5:0/4271231324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88800fc90 con 0x7ff8a01f7db0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a015b740 con 0x7ff8a01f7db0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff896ffd640 1 -- 172.21.15.5:0/4271231324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888014440 con 0x7ff8a01f7db0 2024-04-25T09:04:59.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.009+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a00b4b50 con 0x7ff8a01f7db0 2024-04-25T09:04:59.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.010+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a004ef20 con 0x7ff8a01f7db0 2024-04-25T09:04:59.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.011+0000 7ff896ffd640 1 -- 172.21.15.5:0/4271231324 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff888012040 con 0x7ff8a01f7db0 2024-04-25T09:04:59.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.011+0000 7ff896ffd640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff88006b500 0x7ff88006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.011+0000 7ff896ffd640 1 -- 172.21.15.5:0/4271231324 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff88808a4b0 con 0x7ff8a01f7db0 2024-04-25T09:04:59.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.011+0000 7ff89e59c640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff88006b500 0x7ff88006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.012+0000 7ff89e59c640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff88006b500 0x7ff88006d9c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff890000fb0 tx=0x7ff890007970 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.015+0000 7ff896ffd640 1 -- 172.21.15.5:0/4271231324 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff888019030 con 0x7ff8a01f7db0 2024-04-25T09:04:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.218+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8a015c710 con 0x7ff8a01f7db0 2024-04-25T09:04:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.219+0000 7ff896ffd640 1 -- 172.21.15.5:0/4271231324 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+12946 (secure 0 0 0) 0x7ff888059590 con 0x7ff8a01f7db0 2024-04-25T09:04:59.208 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:04:59.208 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":116,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:04:57.882282+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/4045189382":"2024-04-26T09:04:54.877421+0000","172.21.15.80:6835/4045189382":"2024-04-26T09:04:54.877421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff88006b500 msgr2=0x7ff88006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff88006b500 0x7ff88006d9c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff890000fb0 tx=0x7ff890007970 comp rx=0 tx=0).stop 2024-04-25T09:04:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a01f7db0 msgr2=0x7ff8a015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a01f7db0 0x7ff8a015b200 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff8880119d0 tx=0x7ff888011dd0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 shutdown_connections 2024-04-25T09:04:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff88006b500 0x7ff88006d9c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8a01f7130 0x7ff8a01f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a01f7db0 0x7ff8a015b200 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 --2- 172.21.15.5:0/4271231324 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff88c004d40 0x7ff8a00b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 >> 172.21.15.5:0/4271231324 conn(0x7ff8a006b000 msgr2=0x7ff8a00b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 shutdown_connections 2024-04-25T09:04:59.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.222+0000 7ff8a4c07640 1 -- 172.21.15.5:0/4271231324 wait complete. 2024-04-25T09:04:59.223 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:59.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.338+0000 7fa04f79e640 1 Processor -- start 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.338+0000 7fa04f79e640 1 -- start start 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04f79e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa04815df10 0x7fa0481618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04f79e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0480b6250 0x7fa0480ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04f79e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 0x7fa0480d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04f79e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480d20d0 con 0x7fa04815df10 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04f79e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa048162150 con 0x7fa0480b6250 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04f79e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa048162430 con 0x7fa0480cee10 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa04815df10 0x7fa0481618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa04815df10 0x7fa0481618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46914/0 (socket says 172.21.15.5:46914) 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 -- 172.21.15.5:0/171138408 learned_addr learned my addr 172.21.15.5:0/171138408 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04dd3b640 1 --2- 172.21.15.5:0/171138408 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 0x7fa0480d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04cd39640 1 --2- 172.21.15.5:0/171138408 >> v2:172.21.15.80:3300/0 conn(0x7fa0480b6250 0x7fa0480ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 -- 172.21.15.5:0/171138408 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 msgr2=0x7fa0480d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 --2- 172.21.15.5:0/171138408 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 0x7fa0480d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 -- 172.21.15.5:0/171138408 >> v2:172.21.15.80:3300/0 conn(0x7fa0480b6250 msgr2=0x7fa0480ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 --2- 172.21.15.5:0/171138408 >> v2:172.21.15.80:3300/0 conn(0x7fa0480b6250 0x7fa0480ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04d53a640 1 -- 172.21.15.5:0/171138408 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048162710 con 0x7fa04815df10 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.339+0000 7fa04cd39640 1 --2- 172.21.15.5:0/171138408 >> v2:172.21.15.80:3300/0 conn(0x7fa0480b6250 0x7fa0480ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.340+0000 7fa04d53a640 1 --2- 172.21.15.5:0/171138408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04815df10 0x7fa0481618d0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa0480b9d70 tx=0x7fa04402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6601aaae56ffeb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.340+0000 7fa03ffff640 1 -- 172.21.15.5:0/171138408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044037070 con 0x7fa04815df10 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.340+0000 7fa03ffff640 1 -- 172.21.15.5:0/171138408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044032440 con 0x7fa04815df10 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.340+0000 7fa03ffff640 1 -- 172.21.15.5:0/171138408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044032810 con 0x7fa04815df10 2024-04-25T09:04:59.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 -- 172.21.15.5:0/171138408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04815df10 msgr2=0x7fa0481618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 --2- 172.21.15.5:0/171138408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04815df10 0x7fa0481618d0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa0480b9d70 tx=0x7fa04402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 -- 172.21.15.5:0/171138408 shutdown_connections 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 --2- 172.21.15.5:0/171138408 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 0x7fa0480d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 --2- 172.21.15.5:0/171138408 >> v2:172.21.15.80:3300/0 conn(0x7fa0480b6250 0x7fa0480ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 --2- 172.21.15.5:0/171138408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04815df10 0x7fa0481618d0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 -- 172.21.15.5:0/171138408 >> 172.21.15.5:0/171138408 conn(0x7fa0480668f0 msgr2=0x7fa048066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 -- 172.21.15.5:0/171138408 shutdown_connections 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.341+0000 7fa04f79e640 1 -- 172.21.15.5:0/171138408 wait complete. 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.342+0000 7fa04f79e640 1 Processor -- start 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.342+0000 7fa04f79e640 1 -- start start 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04f79e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0480b6250 0x7fa0480c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04f79e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 0x7fa04815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04f79e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa04815df10 0x7fa04815e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04f79e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480d0980 con 0x7fa0480b6250 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04f79e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa048161e10 con 0x7fa04815df10 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04f79e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480d0b00 con 0x7fa0480cee10 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0480b6250 0x7fa0480c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0480b6250 0x7fa0480c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46922/0 (socket says 172.21.15.5:46922) 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 -- 172.21.15.5:0/1674483650 learned_addr learned my addr 172.21.15.5:0/1674483650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 -- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 msgr2=0x7fa04815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 0x7fa04815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 -- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa04815df10 msgr2=0x7fa04815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa04815df10 0x7fa04815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 -- 172.21.15.5:0/1674483650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048145e70 con 0x7fa0480b6250 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04d53a640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0480b6250 0x7fa0480c7d90 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fa044000c00 tx=0x7fa0440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa03dffb640 1 -- 172.21.15.5:0/1674483650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044037040 con 0x7fa0480b6250 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa03dffb640 1 -- 172.21.15.5:0/1674483650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044042070 con 0x7fa0480b6250 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0480c83c0 con 0x7fa0480b6250 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.343+0000 7fa03dffb640 1 -- 172.21.15.5:0/1674483650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044030bb0 con 0x7fa0480b6250 2024-04-25T09:04:59.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.344+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0481466f0 con 0x7fa0480b6250 2024-04-25T09:04:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.344+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04804ef20 con 0x7fa0480b6250 2024-04-25T09:04:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.345+0000 7fa03dffb640 1 -- 172.21.15.5:0/1674483650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa044047460 con 0x7fa0480b6250 2024-04-25T09:04:59.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.345+0000 7fa03dffb640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa02c06b4d0 0x7fa02c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.346+0000 7fa03dffb640 1 -- 172.21.15.5:0/1674483650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa0440aab70 con 0x7fa0480b6250 2024-04-25T09:04:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.346+0000 7fa04cd39640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa02c06b4d0 0x7fa02c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.346+0000 7fa04cd39640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa02c06b4d0 0x7fa02c06d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa0481f6fb0 tx=0x7fa038008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.350+0000 7fa03dffb640 1 -- 172.21.15.5:0/1674483650 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa044045360 con 0x7fa0480b6250 2024-04-25T09:04:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.532+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0480d1910 con 0x7fa0480b6250 2024-04-25T09:04:59.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.533+0000 7fa03dffb640 1 -- 172.21.15.5:0/1674483650 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa044079cf0 con 0x7fa0480b6250 2024-04-25T09:04:59.522 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa02c06b4d0 msgr2=0x7fa02c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa02c06b4d0 0x7fa02c06d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa0481f6fb0 tx=0x7fa038008040 comp rx=0 tx=0).stop 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0480b6250 msgr2=0x7fa0480c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0480b6250 0x7fa0480c7d90 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fa044000c00 tx=0x7fa0440046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 shutdown_connections 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa02c06b4d0 0x7fa02c06d990 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa04815df10 0x7fa04815e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0480cee10 0x7fa04815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 --2- 172.21.15.5:0/1674483650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0480b6250 0x7fa0480c7d90 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 >> 172.21.15.5:0/1674483650 conn(0x7fa0480668f0 msgr2=0x7fa0480b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 shutdown_connections 2024-04-25T09:04:59.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.535+0000 7fa04f79e640 1 -- 172.21.15.5:0/1674483650 wait complete. 2024-04-25T09:04:59.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-04-25T09:04:59.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.646+0000 7f8620038640 1 Processor -- start 2024-04-25T09:04:59.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.647+0000 7f8620038640 1 -- start start 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.647+0000 7f8620038640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86180b2cc0 0x7f86180b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.647+0000 7f8620038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86180b7130 0x7f86180ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.647+0000 7f8620038640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86180d20e0 con 0x7f861815de70 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.647+0000 7f8620038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86180d2a10 con 0x7f86180b7130 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.647+0000 7f8620038640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86180d23c0 con 0x7f86180b2cc0 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861e5d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86180b7130 0x7f86180ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861ddd4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f861815de70 0x7f86180b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53342/0 (socket says 172.21.15.5:53342) 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861ddd4640 1 -- 172.21.15.5:0/2311762581 learned_addr learned my addr 172.21.15.5:0/2311762581 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861d5d3640 1 --2- 172.21.15.5:0/2311762581 >> v2:172.21.15.80:3300/0 conn(0x7f86180b2cc0 0x7f86180b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861e5d5640 1 -- 172.21.15.5:0/2311762581 >> v2:172.21.15.80:3300/0 conn(0x7f86180b2cc0 msgr2=0x7f86180b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861e5d5640 1 --2- 172.21.15.5:0/2311762581 >> v2:172.21.15.80:3300/0 conn(0x7f86180b2cc0 0x7f86180b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861e5d5640 1 -- 172.21.15.5:0/2311762581 >> v1:172.21.15.5:6789/0 conn(0x7f861815de70 legacy=0x7f86180b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861e5d5640 1 -- 172.21.15.5:0/2311762581 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86180d26a0 con 0x7f86180b7130 2024-04-25T09:04:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861cdd2640 1 -- 172.21.15.5:0/2311762581 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726137030 0 0) 0x7f86180d20e0 con 0x7f861815de70 2024-04-25T09:04:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.648+0000 7f861d5d3640 1 --2- 172.21.15.5:0/2311762581 >> v2:172.21.15.80:3300/0 conn(0x7f86180b2cc0 0x7f86180b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f861e5d5640 1 --2- 172.21.15.5:0/2311762581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86180ce7f0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f8610009d90 tx=0x7f861002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb6ed00722a936f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f861cdd2640 1 -- 172.21.15.5:0/2311762581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610007740 con 0x7f86180b7130 2024-04-25T09:04:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f861cdd2640 1 -- 172.21.15.5:0/2311762581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86100078e0 con 0x7f86180b7130 2024-04-25T09:04:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f861cdd2640 1 -- 172.21.15.5:0/2311762581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610007cb0 con 0x7f86180b7130 2024-04-25T09:04:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f8620038640 1 -- 172.21.15.5:0/2311762581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 msgr2=0x7f86180ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f8620038640 1 --2- 172.21.15.5:0/2311762581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86180ce7f0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f8610009d90 tx=0x7f861002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f8620038640 1 -- 172.21.15.5:0/2311762581 shutdown_connections 2024-04-25T09:04:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f8620038640 1 --2- 172.21.15.5:0/2311762581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86180ce7f0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f8620038640 1 --2- 172.21.15.5:0/2311762581 >> v2:172.21.15.80:3300/0 conn(0x7f86180b2cc0 0x7f86180b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.649+0000 7f8620038640 1 -- 172.21.15.5:0/2311762581 >> 172.21.15.5:0/2311762581 conn(0x7f861806b000 msgr2=0x7f861806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.650+0000 7f8620038640 1 -- 172.21.15.5:0/2311762581 shutdown_connections 2024-04-25T09:04:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.650+0000 7f8620038640 1 -- 172.21.15.5:0/2311762581 wait complete. 2024-04-25T09:04:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 Processor -- start 2024-04-25T09:04:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 -- start start 2024-04-25T09:04:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86180b2cc0 0x7f8618157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86181f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f861815de70 0x7f86181f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180cf0c0 con 0x7f86180b7130 2024-04-25T09:04:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180cef40 con 0x7f861815de70 2024-04-25T09:04:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.651+0000 7f8620038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86180caba0 con 0x7f86180b2cc0 2024-04-25T09:04:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86181f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86181f33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46952/0 (socket says 172.21.15.5:46952) 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 -- 172.21.15.5:0/3314142913 learned_addr learned my addr 172.21.15.5:0/3314142913 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861e5d5640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f861815de70 0x7f86181f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861ddd4640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86180b2cc0 0x7f8618157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 -- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86180b2cc0 msgr2=0x7f8618157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86180b2cc0 0x7f8618157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 -- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f861815de70 msgr2=0x7f86181f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f861815de70 0x7f86181f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 -- 172.21.15.5:0/3314142913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86181f3f10 con 0x7f86180b7130 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f861d5d3640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86181f33d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f860800e7e0 tx=0x7f860800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f860e7fc640 1 -- 172.21.15.5:0/3314142913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860800f040 con 0x7f86180b7130 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f860e7fc640 1 -- 172.21.15.5:0/3314142913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608004030 con 0x7f86180b7130 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86181f41f0 con 0x7f86180b7130 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f860e7fc640 1 -- 172.21.15.5:0/3314142913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608004400 con 0x7f86180b7130 2024-04-25T09:04:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.652+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86180ca2c0 con 0x7f86180b7130 2024-04-25T09:04:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.653+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861804ef20 con 0x7f86180b7130 2024-04-25T09:04:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.654+0000 7f860e7fc640 1 -- 172.21.15.5:0/3314142913 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f860800c670 con 0x7f86180b7130 2024-04-25T09:04:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.654+0000 7f860e7fc640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85fc06b500 0x7f85fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.654+0000 7f860e7fc640 1 -- 172.21.15.5:0/3314142913 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8608089ac0 con 0x7f86180b7130 2024-04-25T09:04:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.654+0000 7f861ddd4640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85fc06b500 0x7f85fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.655+0000 7f861ddd4640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85fc06b500 0x7f85fc06d9c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8614007fd0 tx=0x7f8614007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.658+0000 7f860e7fc640 1 -- 172.21.15.5:0/3314142913 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8608017020 con 0x7f86180b7130 2024-04-25T09:04:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:04:59.908+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f8618071800 con 0x7f86180b7130 2024-04-25T09:05:00.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.889+0000 7f860e7fc640 1 -- 172.21.15.5:0/3314142913 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v407) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8608058680 con 0x7f86180b7130 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85fc06b500 msgr2=0x7f85fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85fc06b500 0x7f85fc06d9c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8614007fd0 tx=0x7f8614007de0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 msgr2=0x7f86181f33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86181f33d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f860800e7e0 tx=0x7f860800eca0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 shutdown_connections 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85fc06b500 0x7f85fc06d9c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f861815de70 0x7f86181f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86180b7130 0x7f86181f33d0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 --2- 172.21.15.5:0/3314142913 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86180b2cc0 0x7f8618157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 >> 172.21.15.5:0/3314142913 conn(0x7f861806b000 msgr2=0x7f86180b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 shutdown_connections 2024-04-25T09:05:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:00.892+0000 7f8620038640 1 -- 172.21.15.5:0/3314142913 wait complete. 2024-04-25T09:05:00.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:05:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.016+0000 7f46998b3640 1 Processor -- start 2024-04-25T09:05:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.016+0000 7f46998b3640 1 -- start start 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46998b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2340 0x7f46940b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46998b3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46940b18c0 0x7f46940b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46998b3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46940b2c60 0x7f46940d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46998b3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940d03c0 con 0x7f46940b2c60 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46998b3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469406ae90 con 0x7f46940b18c0 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46998b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940cfdb0 con 0x7f46940b2340 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46940b2c60 0x7f46940d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46940b2c60 0x7f46940d0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54546/0 (socket says 172.21.15.5:54546) 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 -- 172.21.15.5:0/3066812155 learned_addr learned my addr 172.21.15.5:0/3066812155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46927fc640 1 --2- 172.21.15.5:0/3066812155 >> v2:172.21.15.80:3300/0 conn(0x7f46940b18c0 0x7f46940b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f4692ffd640 1 --2- 172.21.15.5:0/3066812155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2340 0x7f46940b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 -- 172.21.15.5:0/3066812155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2340 msgr2=0x7f46940b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 --2- 172.21.15.5:0/3066812155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2340 0x7f46940b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 -- 172.21.15.5:0/3066812155 >> v2:172.21.15.80:3300/0 conn(0x7f46940b18c0 msgr2=0x7f46940b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 --2- 172.21.15.5:0/3066812155 >> v2:172.21.15.80:3300/0 conn(0x7f46940b18c0 0x7f46940b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46937fe640 1 -- 172.21.15.5:0/3066812155 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469406b130 con 0x7f46940b2c60 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f46927fc640 1 --2- 172.21.15.5:0/3066812155 >> v2:172.21.15.80:3300/0 conn(0x7f46940b18c0 0x7f46940b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.017+0000 7f4692ffd640 1 --2- 172.21.15.5:0/3066812155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2340 0x7f46940b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.018+0000 7f46937fe640 1 --2- 172.21.15.5:0/3066812155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b2c60 0x7f46940d0850 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f469406dfd0 tx=0x7f468c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c8d9f5bf99a21f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.018+0000 7f4691ffb640 1 -- 172.21.15.5:0/3066812155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c036070 con 0x7f46940b2c60 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.018+0000 7f4691ffb640 1 -- 172.21.15.5:0/3066812155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c031600 con 0x7f46940b2c60 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.018+0000 7f4691ffb640 1 -- 172.21.15.5:0/3066812155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0319d0 con 0x7f46940b2c60 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 -- 172.21.15.5:0/3066812155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b2c60 msgr2=0x7f46940d0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 --2- 172.21.15.5:0/3066812155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b2c60 0x7f46940d0850 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f469406dfd0 tx=0x7f468c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 -- 172.21.15.5:0/3066812155 shutdown_connections 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 --2- 172.21.15.5:0/3066812155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b2c60 0x7f46940d0850 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 --2- 172.21.15.5:0/3066812155 >> v2:172.21.15.80:3300/0 conn(0x7f46940b18c0 0x7f46940b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 --2- 172.21.15.5:0/3066812155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2340 0x7f46940b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 -- 172.21.15.5:0/3066812155 >> 172.21.15.5:0/3066812155 conn(0x7f46940d1a40 msgr2=0x7f46940d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 -- 172.21.15.5:0/3066812155 shutdown_connections 2024-04-25T09:05:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.019+0000 7f46998b3640 1 -- 172.21.15.5:0/3066812155 wait complete. 2024-04-25T09:05:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.020+0000 7f46998b3640 1 Processor -- start 2024-04-25T09:05:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.020+0000 7f46998b3640 1 -- start start 2024-04-25T09:05:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f46998b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b18c0 0x7f469414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f46998b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46940b2340 0x7f46940b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f46998b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2c60 0x7f469415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f46998b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940d1830 con 0x7f46940b18c0 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f46998b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940d16b0 con 0x7f46940b2340 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f46998b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469406bfb0 con 0x7f46940b2c60 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b18c0 0x7f469414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b18c0 0x7f469414eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54562/0 (socket says 172.21.15.5:54562) 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 -- 172.21.15.5:0/1958386282 learned_addr learned my addr 172.21.15.5:0/1958386282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f46927fc640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46940b2340 0x7f46940b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 -- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2c60 msgr2=0x7f469415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2c60 0x7f469415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 -- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46940b2340 msgr2=0x7f46940b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46940b2340 0x7f46940b71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.021+0000 7f4692ffd640 1 -- 172.21.15.5:0/1958386282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469414f3f0 con 0x7f46940b18c0 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.022+0000 7f4692ffd640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b18c0 0x7f469414eeb0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f468400c7f0 tx=0x7f468400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.022+0000 7f467bfff640 1 -- 172.21.15.5:0/1958386282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684015070 con 0x7f46940b18c0 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.022+0000 7f467bfff640 1 -- 172.21.15.5:0/1958386282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684007a30 con 0x7f46940b18c0 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.022+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4694159f70 con 0x7f46940b18c0 2024-04-25T09:05:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.022+0000 7f467bfff640 1 -- 172.21.15.5:0/1958386282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684007e00 con 0x7f46940b18c0 2024-04-25T09:05:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.022+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46940b54f0 con 0x7f46940b18c0 2024-04-25T09:05:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.023+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469404ef20 con 0x7f46940b18c0 2024-04-25T09:05:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.023+0000 7f467bfff640 1 -- 172.21.15.5:0/1958386282 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4684018070 con 0x7f46940b18c0 2024-04-25T09:05:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.024+0000 7f467bfff640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f468006b500 0x7f468006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.024+0000 7f467bfff640 1 -- 172.21.15.5:0/1958386282 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4684089e20 con 0x7f46940b18c0 2024-04-25T09:05:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.024+0000 7f46927fc640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f468006b500 0x7f468006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.025+0000 7f46927fc640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f468006b500 0x7f468006d9c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4688006fd0 tx=0x7f4688008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.028+0000 7f467bfff640 1 -- 172.21.15.5:0/1958386282 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f469414f3f0 con 0x7f46940b18c0 2024-04-25T09:05:01.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.212+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f46940c8860 con 0x7f46940b18c0 2024-04-25T09:05:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.215+0000 7f467bfff640 1 -- 172.21.15.5:0/1958386282 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4684058f90 con 0x7f46940b18c0 2024-04-25T09:05:01.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f468006b500 msgr2=0x7f468006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f468006b500 0x7f468006d9c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4688006fd0 tx=0x7f4688008040 comp rx=0 tx=0).stop 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b18c0 msgr2=0x7f469414eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b18c0 0x7f469414eeb0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f468400c7f0 tx=0x7f468400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 shutdown_connections 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f468006b500 0x7f468006d9c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46940b2c60 0x7f469415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46940b2340 0x7f46940b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 --2- 172.21.15.5:0/1958386282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46940b18c0 0x7f469414eeb0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 >> 172.21.15.5:0/1958386282 conn(0x7f46940d1a40 msgr2=0x7f46940af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 shutdown_connections 2024-04-25T09:05:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.217+0000 7f46998b3640 1 -- 172.21.15.5:0/1958386282 wait complete. 2024-04-25T09:05:01.217 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:05:01.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:01.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:01.336 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:05:01.336 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:05:01.336 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:01.352 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:01.352 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:05:01.352 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:01.370 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:01.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:05:01.370 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:01.407 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:01.408 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:05:01.408 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:01.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:01.428 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:05:01.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:01.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.561+0000 7fdcea8b3640 1 Processor -- start 2024-04-25T09:05:01.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.561+0000 7fdcea8b3640 1 -- start start 2024-04-25T09:05:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdcea8b3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdce415f100 0x7fdce40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdcea8b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce40c6d70 0x7fdce40d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdcea8b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce40cfc00 con 0x7fdce40cfec0 2024-04-25T09:05:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdcea8b3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40d0870 con 0x7fdce415f100 2024-04-25T09:05:01.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdcea8b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40cf250 con 0x7fdce40c6d70 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdce3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdce415f100 0x7fdce40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdce8e50640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce40c6d70 0x7fdce40d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdce3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdce415f100 0x7fdce40cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:50814/0 (socket says 172.21.15.5:50814) 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.562+0000 7fdce3fff640 1 -- 172.21.15.5:0/922415330 learned_addr learned my addr 172.21.15.5:0/922415330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.563+0000 7fdce3fff640 1 -- 172.21.15.5:0/922415330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce40c6d70 msgr2=0x7fdce40d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.563+0000 7fdce3fff640 1 --2- 172.21.15.5:0/922415330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce40c6d70 0x7fdce40d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.563+0000 7fdce3fff640 1 -- 172.21.15.5:0/922415330 >> v1:172.21.15.80:6789/0 conn(0x7fdce40cfec0 legacy=0x7fdce40cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.563+0000 7fdce3fff640 1 -- 172.21.15.5:0/922415330 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40cec90 con 0x7fdce415f100 2024-04-25T09:05:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.563+0000 7fdce2ffd640 1 -- 172.21.15.5:0/922415330 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740962940 0 0) 0x7fdce40cfc00 con 0x7fdce40cfec0 2024-04-25T09:05:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.563+0000 7fdce3fff640 1 --2- 172.21.15.5:0/922415330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce415f100 0x7fdce40cf6c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098a0 tx=0x7fdcd802a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e7f0b0d338e8d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.563+0000 7fdce2ffd640 1 -- 172.21.15.5:0/922415330 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8037070 con 0x7fdce415f100 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdce2ffd640 1 -- 172.21.15.5:0/922415330 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8032440 con 0x7fdce415f100 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdce2ffd640 1 -- 172.21.15.5:0/922415330 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8032810 con 0x7fdce415f100 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 -- 172.21.15.5:0/922415330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce415f100 msgr2=0x7fdce40cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/922415330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce415f100 0x7fdce40cf6c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098a0 tx=0x7fdcd802a290 comp rx=0 tx=0).stop 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 -- 172.21.15.5:0/922415330 shutdown_connections 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/922415330 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce40c6d70 0x7fdce40d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/922415330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce415f100 0x7fdce40cf6c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 -- 172.21.15.5:0/922415330 >> 172.21.15.5:0/922415330 conn(0x7fdce40d18e0 msgr2=0x7fdce40d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 -- 172.21.15.5:0/922415330 shutdown_connections 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.564+0000 7fdcea8b3640 1 -- 172.21.15.5:0/922415330 wait complete. 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.565+0000 7fdcea8b3640 1 Processor -- start 2024-04-25T09:05:01.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.565+0000 7fdcea8b3640 1 -- start start 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdcea8b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce40c6d70 0x7fdce4153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdcea8b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce40cfec0 0x7fdce406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdcea8b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce415f100 0x7fdce406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdcea8b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40d2600 con 0x7fdce40cfec0 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdcea8b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40c5560 con 0x7fdce40c6d70 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdcea8b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40ce920 con 0x7fdce415f100 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdce37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce40cfec0 0x7fdce406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdce37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce40cfec0 0x7fdce406eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54570/0 (socket says 172.21.15.5:54570) 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdce37fe640 1 -- 172.21.15.5:0/1764887960 learned_addr learned my addr 172.21.15.5:0/1764887960 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdce3fff640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce40c6d70 0x7fdce4153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.566+0000 7fdce8e50640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce415f100 0x7fdce406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce37fe640 1 -- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce415f100 msgr2=0x7fdce406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce37fe640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce415f100 0x7fdce406f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce37fe640 1 -- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce40c6d70 msgr2=0x7fdce4153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce37fe640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce40c6d70 0x7fdce4153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce37fe640 1 -- 172.21.15.5:0/1764887960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce41f71d0 con 0x7fdce40cfec0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce37fe640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce40cfec0 0x7fdce406eb70 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400c520 tx=0x7fdcd400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce0ff9640 1 -- 172.21.15.5:0/1764887960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4017070 con 0x7fdce40cfec0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce0ff9640 1 -- 172.21.15.5:0/1764887960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd40052d0 con 0x7fdce40cfec0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdce0ff9640 1 -- 172.21.15.5:0/1764887960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4012870 con 0x7fdce40cfec0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce41f74b0 con 0x7fdce40cfec0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.567+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce41f7a70 con 0x7fdce40cfec0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.568+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce40cfba0 con 0x7fdce40cfec0 2024-04-25T09:05:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.568+0000 7fdce0ff9640 1 -- 172.21.15.5:0/1764887960 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcd401a070 con 0x7fdce40cfec0 2024-04-25T09:05:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.569+0000 7fdce0ff9640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdcd006b4d0 0x7fdcd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.569+0000 7fdce0ff9640 1 -- 172.21.15.5:0/1764887960 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcd4089260 con 0x7fdce40cfec0 2024-04-25T09:05:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.569+0000 7fdce3fff640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdcd006b4d0 0x7fdcd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.570+0000 7fdce3fff640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdcd006b4d0 0x7fdcd006d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8034000 tx=0x7fdcd802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:01.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.573+0000 7fdce0ff9640 1 -- 172.21.15.5:0/1764887960 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdce40cfba0 con 0x7fdce40cfec0 2024-04-25T09:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.794+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdce404ef20 con 0x7fdce40cfec0 2024-04-25T09:05:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.794+0000 7fdce0ff9640 1 -- 172.21.15.5:0/1764887960 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3687 (secure 0 0 0) 0x7fdcd4057d00 con 0x7fdce40cfec0 2024-04-25T09:05:01.783 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:01.783 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3285790977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3285790977},{"type":"v1","addr":"172.21.15.5:6835","nonce":3285790977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1966222204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1966222204},{"type":"v1","addr":"172.21.15.80:6837","nonce":1966222204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72},{"gid":8511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/86406625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":86406625},{"type":"v1","addr":"172.21.15.5:6834","nonce":86406625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66},{"gid":8523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3902188326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3902188326},{"type":"v1","addr":"172.21.15.80:6836","nonce":3902188326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[]} 2024-04-25T09:05:01.783 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 72 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdcd006b4d0 msgr2=0x7fdcd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdcd006b4d0 0x7fdcd006d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8034000 tx=0x7fdcd802e000 comp rx=0 tx=0).stop 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce40cfec0 msgr2=0x7fdce406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce40cfec0 0x7fdce406eb70 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400c520 tx=0x7fdcd400c9e0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 shutdown_connections 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdcd006b4d0 0x7fdcd006d990 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdce415f100 0x7fdce406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdce40cfec0 0x7fdce406eb70 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 --2- 172.21.15.5:0/1764887960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce40c6d70 0x7fdce4153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 >> 172.21.15.5:0/1764887960 conn(0x7fdce40d18e0 msgr2=0x7fdce40cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 shutdown_connections 2024-04-25T09:05:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:01.796+0000 7fdcea8b3640 1 -- 172.21.15.5:0/1764887960 wait complete. 2024-04-25T09:05:01.796 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:05:01.797 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:05:01.797 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:05:01.797 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:01.797 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:05:01.797 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:05:01.797 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:05:01.797 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:01.798 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:05:01.798 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:05:01.798 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:05:01.798 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:01.798 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:05:01.798 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:05:01.799 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:05:01.799 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:01.807 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:05:01.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:05:01.811 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:05:01.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:05:01.811 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:05:01.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:05:01.849 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:05:01.850 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:01.853 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:05:01.854 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:01.854 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:05:01.854 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:01.922 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:05:01.938 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:05:01.938 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:05:06.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T09:05:07.807 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:05:07.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:05:07.810 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:05:07.811 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:07.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:05:07.897 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:05:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.937+0000 7f44ecc4c640 1 Processor -- start 2024-04-25T09:05:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.937+0000 7f44ecc4c640 1 -- start start 2024-04-25T09:05:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.938+0000 7f44ecc4c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0e30 0x7f44e80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.938+0000 7f44ecc4c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44e80ce910 0x7f44e80b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.938+0000 7f44ecc4c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e806ba50 con 0x7f44e80b0a50 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.938+0000 7f44ecc4c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e806b800 con 0x7f44e80ce910 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.938+0000 7f44ecc4c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e806bd30 con 0x7f44e80b0e30 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.938+0000 7f44e659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f44e80b0a50 0x7f44e80ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42374/0 (socket says 172.21.15.5:42374) 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.938+0000 7f44e659c640 1 -- 172.21.15.5:0/3392549831 learned_addr learned my addr 172.21.15.5:0/3392549831 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e5d9b640 1 --2- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0e30 0x7f44e80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e6d9d640 1 --2- 172.21.15.5:0/3392549831 >> v2:172.21.15.80:3300/0 conn(0x7f44e80ce910 0x7f44e80b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e559a640 1 -- 172.21.15.5:0/3392549831 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221602631 0 0) 0x7f44e806ba50 con 0x7f44e80b0a50 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e559a640 1 -- 172.21.15.5:0/3392549831 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d0003520 con 0x7f44e80b0a50 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e559a640 1 -- 172.21.15.5:0/3392549831 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3732038789 0 0) 0x7f44d0003520 con 0x7f44e80b0a50 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e6d9d640 1 -- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0e30 msgr2=0x7f44e80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e6d9d640 1 --2- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0e30 0x7f44e80b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e6d9d640 1 -- 172.21.15.5:0/3392549831 >> v1:172.21.15.5:6789/0 conn(0x7f44e80b0a50 legacy=0x7f44e80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e6d9d640 1 -- 172.21.15.5:0/3392549831 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e806c010 con 0x7f44e80ce910 2024-04-25T09:05:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.939+0000 7f44e5d9b640 1 --2- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0e30 0x7f44e80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.940+0000 7f44e6d9d640 1 --2- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 0x7f44e80b1770 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009d90 tx=0x7f44e002a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4455549beaf75423 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.940+0000 7f44e559a640 1 -- 172.21.15.5:0/3392549831 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8001670 con 0x7f44e80ce910 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.940+0000 7f44e559a640 1 -- 172.21.15.5:0/3392549831 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0007540 con 0x7f44e80ce910 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.940+0000 7f44e559a640 1 -- 172.21.15.5:0/3392549831 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0007910 con 0x7f44e80ce910 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.940+0000 7f44ecc4c640 1 -- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 msgr2=0x7f44e80b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.940+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 0x7f44e80b1770 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009d90 tx=0x7f44e002a560 comp rx=0 tx=0).stop 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.941+0000 7f44ecc4c640 1 -- 172.21.15.5:0/3392549831 shutdown_connections 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.941+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 0x7f44e80b1770 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.941+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/3392549831 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0e30 0x7f44e80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.941+0000 7f44ecc4c640 1 -- 172.21.15.5:0/3392549831 >> 172.21.15.5:0/3392549831 conn(0x7f44e80d18f0 msgr2=0x7f44e80d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.941+0000 7f44ecc4c640 1 -- 172.21.15.5:0/3392549831 shutdown_connections 2024-04-25T09:05:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.941+0000 7f44ecc4c640 1 -- 172.21.15.5:0/3392549831 wait complete. 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.942+0000 7f44ecc4c640 1 Processor -- start 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.942+0000 7f44ecc4c640 1 -- start start 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44ecc4c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0a50 0x7f44e80ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44ecc4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e80b0e30 0x7f44e815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44ecc4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 0x7f44e8161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44ecc4c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b2bf0 con 0x7f44e80b0e30 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44ecc4c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80cfd60 con 0x7f44e80ce910 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44ecc4c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e81f35e0 con 0x7f44e80b0a50 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e80b0e30 0x7f44e815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e80b0e30 0x7f44e815ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54630/0 (socket says 172.21.15.5:54630) 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 -- 172.21.15.5:0/827929683 learned_addr learned my addr 172.21.15.5:0/827929683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e659c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0a50 0x7f44e80ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e6d9d640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 0x7f44e8161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 -- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0a50 msgr2=0x7f44e80ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0a50 0x7f44e80ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 -- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 msgr2=0x7f44e8161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 0x7f44e8161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.943+0000 7f44e5d9b640 1 -- 172.21.15.5:0/827929683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e81608d0 con 0x7f44e80b0e30 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.944+0000 7f44e5d9b640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e80b0e30 0x7f44e815ce40 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00ec10 tx=0x7f44dc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.944+0000 7f44d6ffd640 1 -- 172.21.15.5:0/827929683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc017070 con 0x7f44e80b0e30 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.944+0000 7f44d6ffd640 1 -- 172.21.15.5:0/827929683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00cc30 con 0x7f44e80b0e30 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.944+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e80cd260 con 0x7f44e80b0e30 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.944+0000 7f44d6ffd640 1 -- 172.21.15.5:0/827929683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc013470 con 0x7f44e80b0e30 2024-04-25T09:05:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.944+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e81f3b10 con 0x7f44e80b0e30 2024-04-25T09:05:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.945+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e806cd70 con 0x7f44e80b0e30 2024-04-25T09:05:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.945+0000 7f44d6ffd640 1 -- 172.21.15.5:0/827929683 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44dc01a070 con 0x7f44e80b0e30 2024-04-25T09:05:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.946+0000 7f44d6ffd640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f44c806b4d0 0x7f44c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.946+0000 7f44d6ffd640 1 -- 172.21.15.5:0/827929683 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f44dc089d90 con 0x7f44e80b0e30 2024-04-25T09:05:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.946+0000 7f44e659c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f44c806b4d0 0x7f44c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.947+0000 7f44e659c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f44c806b4d0 0x7f44c806d990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005880 tx=0x7f44d80057f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:07.950+0000 7f44d6ffd640 1 -- 172.21.15.5:0/827929683 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44dc0588f0 con 0x7f44e80b0e30 2024-04-25T09:05:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:08.142+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f44e8160cd0 con 0x7f44e80b0e30 2024-04-25T09:05:09.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.908+0000 7f44d6ffd640 1 -- 172.21.15.5:0/827929683 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) v1 ==== 97+0+0 (secure 0 0 0) 0x7f44dc05c990 con 0x7f44e80b0e30 2024-04-25T09:05:09.897 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T09:05:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f44c806b4d0 msgr2=0x7f44c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f44c806b4d0 0x7f44c806d990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005880 tx=0x7f44d80057f0 comp rx=0 tx=0).stop 2024-04-25T09:05:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e80b0e30 msgr2=0x7f44e815ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e80b0e30 0x7f44e815ce40 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00ec10 tx=0x7f44dc00c520 comp rx=0 tx=0).stop 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 shutdown_connections 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f44c806b4d0 0x7f44c806d990 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44e80ce910 0x7f44e8161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e80b0e30 0x7f44e815ce40 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 --2- 172.21.15.5:0/827929683 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f44e80b0a50 0x7f44e80ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 >> 172.21.15.5:0/827929683 conn(0x7f44e80d18f0 msgr2=0x7f44e80ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 shutdown_connections 2024-04-25T09:05:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:09.911+0000 7f44ecc4c640 1 -- 172.21.15.5:0/827929683 wait complete. 2024-04-25T09:05:09.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:05:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.033+0000 7f0b07a9e640 1 Processor -- start 2024-04-25T09:05:10.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.033+0000 7f0b07a9e640 1 -- start start 2024-04-25T09:05:10.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.034+0000 7f0b07a9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b0015e0a0 0x7f0b000d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.034+0000 7f0b07a9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b000d3df0 0x7f0b000cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.034+0000 7f0b07a9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000b7f60 con 0x7f0b000d3990 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.034+0000 7f0b07a9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b000b29c0 con 0x7f0b000d3df0 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.034+0000 7f0b07a9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000d2080 con 0x7f0b0015e0a0 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b0603b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b000d3df0 0x7f0b000cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b05039640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b000d3990 0x7f0b000ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:33022/0 (socket says 172.21.15.5:33022) 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b05039640 1 -- 172.21.15.5:0/2121445925 learned_addr learned my addr 172.21.15.5:0/2121445925 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b0583a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b0015e0a0 0x7f0b000d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b04838640 1 -- 172.21.15.5:0/2121445925 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885746966 0 0) 0x7f0b000b7f60 con 0x7f0b000d3990 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b04838640 1 -- 172.21.15.5:0/2121445925 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae8003520 con 0x7f0b000d3990 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b0583a640 1 -- 172.21.15.5:0/2121445925 >> v2:172.21.15.80:3300/0 conn(0x7f0b000d3df0 msgr2=0x7f0b000cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b0583a640 1 --2- 172.21.15.5:0/2121445925 >> v2:172.21.15.80:3300/0 conn(0x7f0b000d3df0 0x7f0b000cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b0583a640 1 -- 172.21.15.5:0/2121445925 >> v1:172.21.15.80:6789/0 conn(0x7f0b000d3990 legacy=0x7f0b000ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b0583a640 1 -- 172.21.15.5:0/2121445925 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b000d2360 con 0x7f0b0015e0a0 2024-04-25T09:05:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.035+0000 7f0b0603b640 1 --2- 172.21.15.5:0/2121445925 >> v2:172.21.15.80:3300/0 conn(0x7f0b000d3df0 0x7f0b000cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.036+0000 7f0b0583a640 1 --2- 172.21.15.5:0/2121445925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b0015e0a0 0x7f0b000d0d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0af80097a0 tx=0x7f0af802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba0c8ff8357a601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.036+0000 7f0b04838640 1 -- 172.21.15.5:0/2121445925 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8037070 con 0x7f0b0015e0a0 2024-04-25T09:05:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.036+0000 7f0b04838640 1 -- 172.21.15.5:0/2121445925 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8032440 con 0x7f0b0015e0a0 2024-04-25T09:05:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.036+0000 7f0b04838640 1 -- 172.21.15.5:0/2121445925 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af80327f0 con 0x7f0b0015e0a0 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 -- 172.21.15.5:0/2121445925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b0015e0a0 msgr2=0x7f0b000d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/2121445925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b0015e0a0 0x7f0b000d0d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0af80097a0 tx=0x7f0af802a180 comp rx=0 tx=0).stop 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 -- 172.21.15.5:0/2121445925 shutdown_connections 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/2121445925 >> v2:172.21.15.80:3300/0 conn(0x7f0b000d3df0 0x7f0b000cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/2121445925 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b0015e0a0 0x7f0b000d0d50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 -- 172.21.15.5:0/2121445925 >> 172.21.15.5:0/2121445925 conn(0x7f0b000668f0 msgr2=0x7f0b00066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 -- 172.21.15.5:0/2121445925 shutdown_connections 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.037+0000 7f0b07a9e640 1 -- 172.21.15.5:0/2121445925 wait complete. 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.038+0000 7f0b07a9e640 1 Processor -- start 2024-04-25T09:05:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.038+0000 7f0b07a9e640 1 -- start start 2024-04-25T09:05:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b07a9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b000d3990 0x7f0b000b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b07a9e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b000d3df0 0x7f0b000b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b07a9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b0015e0a0 0x7f0b000b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b07a9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000d2c00 con 0x7f0b0015e0a0 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b07a9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000d2920 con 0x7f0b000d3990 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b07a9e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000d4280 con 0x7f0b000d3df0 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b0015e0a0 0x7f0b000b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b0015e0a0 0x7f0b000b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54634/0 (socket says 172.21.15.5:54634) 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 -- 172.21.15.5:0/393531165 learned_addr learned my addr 172.21.15.5:0/393531165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b05039640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b000d3df0 0x7f0b000b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0583a640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b000d3990 0x7f0b000b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 -- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b000d3df0 msgr2=0x7f0b000b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b000d3df0 0x7f0b000b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 -- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b000d3990 msgr2=0x7f0b000b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b000d3990 0x7f0b000b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 -- 172.21.15.5:0/393531165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0015f3e0 con 0x7f0b0015e0a0 2024-04-25T09:05:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.039+0000 7f0b0603b640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b0015e0a0 0x7f0b000b5e00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f0af000efc0 tx=0x7f0af000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.040+0000 7f0afe7fc640 1 -- 172.21.15.5:0/393531165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0018030 con 0x7f0b0015e0a0 2024-04-25T09:05:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.040+0000 7f0afe7fc640 1 -- 172.21.15.5:0/393531165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000cdf0 con 0x7f0b0015e0a0 2024-04-25T09:05:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.040+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0015f6c0 con 0x7f0b0015e0a0 2024-04-25T09:05:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.040+0000 7f0afe7fc640 1 -- 172.21.15.5:0/393531165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0003bb0 con 0x7f0b0015e0a0 2024-04-25T09:05:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.040+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0015fc80 con 0x7f0b0015e0a0 2024-04-25T09:05:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.041+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0004ef20 con 0x7f0b0015e0a0 2024-04-25T09:05:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.041+0000 7f0afe7fc640 1 -- 172.21.15.5:0/393531165 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0af001b070 con 0x7f0b0015e0a0 2024-04-25T09:05:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.041+0000 7f0afe7fc640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0aec06b500 0x7f0aec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.042+0000 7f0afe7fc640 1 -- 172.21.15.5:0/393531165 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0af008a660 con 0x7f0b0015e0a0 2024-04-25T09:05:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.042+0000 7f0b0583a640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0aec06b500 0x7f0aec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.042+0000 7f0b0583a640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0aec06b500 0x7f0aec06d9c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0af8034000 tx=0x7f0af802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.046+0000 7f0afe7fc640 1 -- 172.21.15.5:0/393531165 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0af0010040 con 0x7f0b0015e0a0 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.295+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0b000b67e0 con 0x7f0b0015e0a0 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.295+0000 7f0afe7fc640 1 -- 172.21.15.5:0/393531165 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0af0059270 con 0x7f0b0015e0a0 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T09:05:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:05:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T09:05:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T09:05:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.290 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T09:05:10.291 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T09:05:10.293 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:05:10.294 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T09:05:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T09:05:10.297 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:05:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0aec06b500 msgr2=0x7f0aec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0aec06b500 0x7f0aec06d9c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0af8034000 tx=0x7f0af802e000 comp rx=0 tx=0).stop 2024-04-25T09:05:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b0015e0a0 msgr2=0x7f0b000b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b0015e0a0 0x7f0b000b5e00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f0af000efc0 tx=0x7f0af000c490 comp rx=0 tx=0).stop 2024-04-25T09:05:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 shutdown_connections 2024-04-25T09:05:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0aec06b500 0x7f0aec06d9c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b0015e0a0 0x7f0b000b5e00 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0b000d3df0 0x7f0b000b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 --2- 172.21.15.5:0/393531165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b000d3990 0x7f0b000b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 >> 172.21.15.5:0/393531165 conn(0x7f0b000668f0 msgr2=0x7f0b000b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 shutdown_connections 2024-04-25T09:05:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.297+0000 7f0b07a9e640 1 -- 172.21.15.5:0/393531165 wait complete. 2024-04-25T09:05:10.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:10.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.413+0000 7faf9a0fc640 1 Processor -- start 2024-04-25T09:05:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.413+0000 7faf9a0fc640 1 -- start start 2024-04-25T09:05:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf9a0fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf940d05f0 0x7faf940d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf9a0fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf940d3710 0x7faf940b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf9a0fc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf940d0f10 con 0x7faf940b9990 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf9a0fc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940d23c0 con 0x7faf940d05f0 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf9a0fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf940d2670 con 0x7faf940d3710 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf92ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf940b9990 0x7faf940d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42384/0 (socket says 172.21.15.5:42384) 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf92ffd640 1 -- 172.21.15.5:0/220087849 learned_addr learned my addr 172.21.15.5:0/220087849 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf93fff640 1 --2- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf940d3710 0x7faf940b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf937fe640 1 --2- 172.21.15.5:0/220087849 >> v2:172.21.15.80:3300/0 conn(0x7faf940d05f0 0x7faf940d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf927fc640 1 -- 172.21.15.5:0/220087849 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388773767 0 0) 0x7faf940d0f10 con 0x7faf940b9990 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf927fc640 1 -- 172.21.15.5:0/220087849 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf7c003520 con 0x7faf940b9990 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf937fe640 1 -- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf940d3710 msgr2=0x7faf940b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf937fe640 1 --2- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf940d3710 0x7faf940b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf937fe640 1 -- 172.21.15.5:0/220087849 >> v1:172.21.15.5:6789/0 conn(0x7faf940b9990 legacy=0x7faf940d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf927fc640 1 -- 172.21.15.5:0/220087849 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3747982022 0 0) 0x7faf7c003520 con 0x7faf940b9990 2024-04-25T09:05:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.414+0000 7faf937fe640 1 -- 172.21.15.5:0/220087849 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf940d2950 con 0x7faf940d05f0 2024-04-25T09:05:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.415+0000 7faf937fe640 1 --2- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d05f0 0x7faf940d09d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faf880097a0 tx=0x7faf8802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f19b99ba76adca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.415+0000 7faf927fc640 1 -- 172.21.15.5:0/220087849 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88037070 con 0x7faf940d05f0 2024-04-25T09:05:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.415+0000 7faf927fc640 1 -- 172.21.15.5:0/220087849 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8802ac30 con 0x7faf940d05f0 2024-04-25T09:05:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.415+0000 7faf927fc640 1 -- 172.21.15.5:0/220087849 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84001670 con 0x7faf940d05f0 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 -- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d05f0 msgr2=0x7faf940d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d05f0 0x7faf940d09d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faf880097a0 tx=0x7faf8802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 -- 172.21.15.5:0/220087849 shutdown_connections 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf940d3710 0x7faf940b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/220087849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d05f0 0x7faf940d09d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 -- 172.21.15.5:0/220087849 >> 172.21.15.5:0/220087849 conn(0x7faf9406b000 msgr2=0x7faf9406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 -- 172.21.15.5:0/220087849 shutdown_connections 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.416+0000 7faf9a0fc640 1 -- 172.21.15.5:0/220087849 wait complete. 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.417+0000 7faf9a0fc640 1 Processor -- start 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.417+0000 7faf9a0fc640 1 -- start start 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf9a0fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf940d05f0 0x7faf9415e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf9a0fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d3710 0x7faf941577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf9a0fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf94157d10 0x7faf941f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf9a0fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9415e090 con 0x7faf940d05f0 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf9a0fc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940d2f10 con 0x7faf940d3710 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf9a0fc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9415e210 con 0x7faf94157d10 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf940d05f0 0x7faf9415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf940d05f0 0x7faf9415e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54646/0 (socket says 172.21.15.5:54646) 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 -- 172.21.15.5:0/3794494976 learned_addr learned my addr 172.21.15.5:0/3794494976 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf93fff640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf94157d10 0x7faf941f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf92ffd640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d3710 0x7faf941577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 -- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf94157d10 msgr2=0x7faf941f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf94157d10 0x7faf941f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 -- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d3710 msgr2=0x7faf941577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d3710 0x7faf941577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.418+0000 7faf937fe640 1 -- 172.21.15.5:0/3794494976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9415eaa0 con 0x7faf940d05f0 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.419+0000 7faf937fe640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf940d05f0 0x7faf9415e390 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7faf88035040 tx=0x7faf880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.419+0000 7faf7bfff640 1 -- 172.21.15.5:0/3794494976 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88042020 con 0x7faf940d05f0 2024-04-25T09:05:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.419+0000 7faf7bfff640 1 -- 172.21.15.5:0/3794494976 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf88003c40 con 0x7faf940d05f0 2024-04-25T09:05:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.419+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9415ed80 con 0x7faf940d05f0 2024-04-25T09:05:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.419+0000 7faf7bfff640 1 -- 172.21.15.5:0/3794494976 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88037040 con 0x7faf940d05f0 2024-04-25T09:05:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.419+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf940cbd10 con 0x7faf940d05f0 2024-04-25T09:05:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.420+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9404ef20 con 0x7faf940d05f0 2024-04-25T09:05:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.420+0000 7faf7bfff640 1 -- 172.21.15.5:0/3794494976 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf88045020 con 0x7faf940d05f0 2024-04-25T09:05:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.421+0000 7faf7bfff640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf8006b4d0 0x7faf8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.421+0000 7faf7bfff640 1 -- 172.21.15.5:0/3794494976 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faf880aa400 con 0x7faf940d05f0 2024-04-25T09:05:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.421+0000 7faf92ffd640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf8006b4d0 0x7faf8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.422+0000 7faf92ffd640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf8006b4d0 0x7faf8006d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faf9406ba20 tx=0x7faf840057f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.425+0000 7faf7bfff640 1 -- 172.21.15.5:0/3794494976 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf8804c030 con 0x7faf940d05f0 2024-04-25T09:05:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.605+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf940b3320 con 0x7faf940d05f0 2024-04-25T09:05:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.606+0000 7faf7bfff640 1 -- 172.21.15.5:0/3794494976 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+12817 (secure 0 0 0) 0x7faf88078f80 con 0x7faf940d05f0 2024-04-25T09:05:10.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:10.595 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":121,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:09.908299+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf8006b4d0 msgr2=0x7faf8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf8006b4d0 0x7faf8006d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faf9406ba20 tx=0x7faf840057f0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf940d05f0 msgr2=0x7faf9415e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf940d05f0 0x7faf9415e390 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7faf88035040 tx=0x7faf880046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 shutdown_connections 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf8006b4d0 0x7faf8006d990 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf94157d10 0x7faf941f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf940d3710 0x7faf941577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 --2- 172.21.15.5:0/3794494976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf940d05f0 0x7faf9415e390 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 >> 172.21.15.5:0/3794494976 conn(0x7faf9406b000 msgr2=0x7faf940c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 shutdown_connections 2024-04-25T09:05:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.608+0000 7faf9a0fc640 1 -- 172.21.15.5:0/3794494976 wait complete. 2024-04-25T09:05:10.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:10.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.723+0000 7f028bbc1640 1 Processor -- start 2024-04-25T09:05:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.723+0000 7f028bbc1640 1 -- start start 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028bbc1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02841614b0 0x7f02840b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028bbc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d1f60 0x7f02840d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028bbc1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02840d2740 con 0x7f02840d4060 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028bbc1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02840d2a20 con 0x7f02841614b0 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028bbc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02840d2d00 con 0x7f02840d1f60 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028995d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02841614b0 0x7f02840b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028a15e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02840d4060 0x7f02840b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47568/0 (socket says 172.21.15.5:47568) 2024-04-25T09:05:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028a15e640 1 -- 172.21.15.5:0/2661636769 learned_addr learned my addr 172.21.15.5:0/2661636769 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028995d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02841614b0 0x7f02840b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40932/0 (socket says 172.21.15.5:40932) 2024-04-25T09:05:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028915c640 1 --2- 172.21.15.5:0/2661636769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d1f60 0x7f02840d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028995d640 1 -- 172.21.15.5:0/2661636769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d1f60 msgr2=0x7f02840d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028995d640 1 --2- 172.21.15.5:0/2661636769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d1f60 0x7f02840d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028995d640 1 -- 172.21.15.5:0/2661636769 >> v1:172.21.15.5:6789/0 conn(0x7f02840d4060 legacy=0x7f02840b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.724+0000 7f028995d640 1 -- 172.21.15.5:0/2661636769 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840d2fe0 con 0x7f02841614b0 2024-04-25T09:05:10.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.725+0000 7f028995d640 1 --2- 172.21.15.5:0/2661636769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b96e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f027c0097a0 tx=0x7f027c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69b8cc4620206cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.725+0000 7f028895b640 1 -- 172.21.15.5:0/2661636769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c037070 con 0x7f02841614b0 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.725+0000 7f028895b640 1 -- 172.21.15.5:0/2661636769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c032440 con 0x7f02841614b0 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.725+0000 7f028895b640 1 -- 172.21.15.5:0/2661636769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c032810 con 0x7f02841614b0 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 -- 172.21.15.5:0/2661636769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 msgr2=0x7f02840b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 --2- 172.21.15.5:0/2661636769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b96e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f027c0097a0 tx=0x7f027c02a180 comp rx=0 tx=0).stop 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 -- 172.21.15.5:0/2661636769 shutdown_connections 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 --2- 172.21.15.5:0/2661636769 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d1f60 0x7f02840d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 --2- 172.21.15.5:0/2661636769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b96e0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 -- 172.21.15.5:0/2661636769 >> 172.21.15.5:0/2661636769 conn(0x7f028406b000 msgr2=0x7f028406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 -- 172.21.15.5:0/2661636769 shutdown_connections 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.726+0000 7f028bbc1640 1 -- 172.21.15.5:0/2661636769 wait complete. 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.727+0000 7f028bbc1640 1 Processor -- start 2024-04-25T09:05:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.727+0000 7f028bbc1640 1 -- start start 2024-04-25T09:05:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028bbc1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02840d1f60 0x7f0284155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028bbc1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d4060 0x7f0284153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028bbc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028bbc1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02840d23a0 con 0x7f02841614b0 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028bbc1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02840d37e0 con 0x7f02840d1f60 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028bbc1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02840d2520 con 0x7f02840d4060 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40934/0 (socket says 172.21.15.5:40934) 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 -- 172.21.15.5:0/4069871464 learned_addr learned my addr 172.21.15.5:0/4069871464 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028915c640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d4060 0x7f0284153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028995d640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02840d1f60 0x7f0284155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 -- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d4060 msgr2=0x7f0284153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d4060 0x7f0284153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 -- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02840d1f60 msgr2=0x7f0284155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02840d1f60 0x7f0284155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028a15e640 1 -- 172.21.15.5:0/4069871464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840c7860 con 0x7f02841614b0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.728+0000 7f028995d640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02840d1f60 0x7f0284155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.729+0000 7f028a15e640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b3810 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f028000cbc0 tx=0x7f028000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.729+0000 7f027a7fc640 1 -- 172.21.15.5:0/4069871464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280017070 con 0x7f02841614b0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.729+0000 7f027a7fc640 1 -- 172.21.15.5:0/4069871464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028000ad40 con 0x7f02841614b0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.729+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02840c7b40 con 0x7f02841614b0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.729+0000 7f027a7fc640 1 -- 172.21.15.5:0/4069871464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280012600 con 0x7f02841614b0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.729+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0284155780 con 0x7f02841614b0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.730+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028404ef20 con 0x7f02841614b0 2024-04-25T09:05:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.730+0000 7f027a7fc640 1 -- 172.21.15.5:0/4069871464 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f028001a070 con 0x7f02841614b0 2024-04-25T09:05:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.731+0000 7f027a7fc640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f026806b4d0 0x7f026806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.731+0000 7f027a7fc640 1 -- 172.21.15.5:0/4069871464 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0280089ad0 con 0x7f02841614b0 2024-04-25T09:05:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.731+0000 7f028995d640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f026806b4d0 0x7f026806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.731+0000 7f028995d640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f026806b4d0 0x7f026806d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f027c034000 tx=0x7f027c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.735+0000 7f027a7fc640 1 -- 172.21.15.5:0/4069871464 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0280058650 con 0x7f02841614b0 2024-04-25T09:05:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.918+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f028406b580 con 0x7f02841614b0 2024-04-25T09:05:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.919+0000 7f027a7fc640 1 -- 172.21.15.5:0/4069871464 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7f028005c6f0 con 0x7f02841614b0 2024-04-25T09:05:10.907 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:05:10.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.920+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f026806b4d0 msgr2=0x7f026806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.920+0000 7f028bbc1640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f026806b4d0 0x7f026806d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f027c034000 tx=0x7f027c02e000 comp rx=0 tx=0).stop 2024-04-25T09:05:10.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.920+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 msgr2=0x7f02840b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.920+0000 7f028bbc1640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b3810 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f028000cbc0 tx=0x7f028000a430 comp rx=0 tx=0).stop 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.920+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 shutdown_connections 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.920+0000 7f028bbc1640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f026806b4d0 0x7f026806d990 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.921+0000 7f028bbc1640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02841614b0 0x7f02840b3810 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.921+0000 7f028bbc1640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02840d4060 0x7f0284153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.921+0000 7f028bbc1640 1 --2- 172.21.15.5:0/4069871464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02840d1f60 0x7f0284155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.921+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 >> 172.21.15.5:0/4069871464 conn(0x7f028406b000 msgr2=0x7f0284160130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.921+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 shutdown_connections 2024-04-25T09:05:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:10.921+0000 7f028bbc1640 1 -- 172.21.15.5:0/4069871464 wait complete. 2024-04-25T09:05:10.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:05:11.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.033+0000 7fc8fa99e640 1 Processor -- start 2024-04-25T09:05:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.033+0000 7fc8fa99e640 1 -- start start 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8fa99e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f4161270 0x7fc8f40d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8fa99e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40d2620 con 0x7fc8f40d0a50 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8fa99e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40d2900 con 0x7fc8f40d1fa0 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8fa99e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f40b9650 con 0x7fc8f4161270 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8f999c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f4161270 0x7fc8f40d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8fa19d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc8f40d0a50 0x7fc8f40b6a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47572/0 (socket says 172.21.15.5:47572) 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8fa19d640 1 -- 172.21.15.5:0/4082835002 learned_addr learned my addr 172.21.15.5:0/4082835002 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8f999c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f4161270 0x7fc8f40d1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40944/0 (socket says 172.21.15.5:40944) 2024-04-25T09:05:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8f999c640 1 -- 172.21.15.5:0/4082835002 >> v1:172.21.15.80:6789/0 conn(0x7fc8f40d1fa0 legacy=0x7fc8f40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8f899a640 1 -- 172.21.15.5:0/4082835002 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282835717 0 0) 0x7fc8f40d2620 con 0x7fc8f40d0a50 2024-04-25T09:05:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8f999c640 1 -- 172.21.15.5:0/4082835002 >> v1:172.21.15.5:6789/0 conn(0x7fc8f40d0a50 legacy=0x7fc8f40b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.034+0000 7fc8f999c640 1 -- 172.21.15.5:0/4082835002 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40d2be0 con 0x7fc8f4161270 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.035+0000 7fc8f999c640 1 --2- 172.21.15.5:0/4082835002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40d1a60 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097a0 tx=0x7fc8f002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e65e3e98d2f7ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.035+0000 7fc8f899a640 1 -- 172.21.15.5:0/4082835002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0037070 con 0x7fc8f4161270 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.035+0000 7fc8f899a640 1 -- 172.21.15.5:0/4082835002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f0032640 con 0x7fc8f4161270 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.035+0000 7fc8f899a640 1 -- 172.21.15.5:0/4082835002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0032a10 con 0x7fc8f4161270 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.036+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4082835002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 msgr2=0x7fc8f40d1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.036+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4082835002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40d1a60 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097a0 tx=0x7fc8f002a2c0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.036+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4082835002 shutdown_connections 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.036+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4082835002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40d1a60 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.036+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4082835002 >> 172.21.15.5:0/4082835002 conn(0x7fc8f40668f0 msgr2=0x7fc8f4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:11.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.036+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4082835002 shutdown_connections 2024-04-25T09:05:11.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.036+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4082835002 wait complete. 2024-04-25T09:05:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.037+0000 7fc8fa99e640 1 Processor -- start 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.037+0000 7fc8fa99e640 1 -- start start 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa99e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8f40d0a50 0x7fc8f4149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa99e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8f40d1fa0 0x7fc8f40c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa99e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa99e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40d23e0 con 0x7fc8f4161270 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa99e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40d36c0 con 0x7fc8f40d0a50 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa99e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40d3230 con 0x7fc8f40d1fa0 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40948/0 (socket says 172.21.15.5:40948) 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 -- 172.21.15.5:0/4055637051 learned_addr learned my addr 172.21.15.5:0/4055637051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8f919b640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8f40d1fa0 0x7fc8f40c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 -- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8f40d1fa0 msgr2=0x7fc8f40c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8f999c640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8f40d0a50 0x7fc8f4149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8f40d1fa0 0x7fc8f40c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 -- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8f40d0a50 msgr2=0x7fc8f4149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8f40d0a50 0x7fc8f4149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.038+0000 7fc8fa19d640 1 -- 172.21.15.5:0/4055637051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f41e7320 con 0x7fc8f4161270 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.039+0000 7fc8fa19d640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40c9d90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c780 tx=0x7fc8ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.039+0000 7fc8ea7fc640 1 -- 172.21.15.5:0/4055637051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec018070 con 0x7fc8f4161270 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.039+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f41e7600 con 0x7fc8f4161270 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.039+0000 7fc8ea7fc640 1 -- 172.21.15.5:0/4055637051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec00a640 con 0x7fc8f4161270 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.039+0000 7fc8ea7fc640 1 -- 172.21.15.5:0/4055637051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00aab0 con 0x7fc8f4161270 2024-04-25T09:05:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.039+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f41e7bc0 con 0x7fc8f4161270 2024-04-25T09:05:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.040+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f4074f70 con 0x7fc8f4161270 2024-04-25T09:05:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.040+0000 7fc8ea7fc640 1 -- 172.21.15.5:0/4055637051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc8ec00ac50 con 0x7fc8f4161270 2024-04-25T09:05:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.041+0000 7fc8ea7fc640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc8d806b4d0 0x7fc8d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.041+0000 7fc8ea7fc640 1 -- 172.21.15.5:0/4055637051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8ec0895c0 con 0x7fc8f4161270 2024-04-25T09:05:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.041+0000 7fc8f999c640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc8d806b4d0 0x7fc8d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.041+0000 7fc8f999c640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc8d806b4d0 0x7fc8d806d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0034000 tx=0x7fc8f002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.045+0000 7fc8ea7fc640 1 -- 172.21.15.5:0/4055637051 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8ec058710 con 0x7fc8f4161270 2024-04-25T09:05:11.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.226+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc8f40b8fc0 con 0x7fc8f4161270 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.226+0000 7fc8ea7fc640 1 -- 172.21.15.5:0/4055637051 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v121) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc8ec058010 con 0x7fc8f4161270 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:11.215 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T09:05:11.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc8d806b4d0 msgr2=0x7fc8d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc8d806b4d0 0x7fc8d806d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0034000 tx=0x7fc8f002e000 comp rx=0 tx=0).stop 2024-04-25T09:05:11.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 msgr2=0x7fc8f40c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40c9d90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c780 tx=0x7fc8ec00cc40 comp rx=0 tx=0).stop 2024-04-25T09:05:11.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 shutdown_connections 2024-04-25T09:05:11.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc8d806b4d0 0x7fc8d806d990 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4161270 0x7fc8f40c9d90 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc8f40d1fa0 0x7fc8f40c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 --2- 172.21.15.5:0/4055637051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8f40d0a50 0x7fc8f4149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 >> 172.21.15.5:0/4055637051 conn(0x7fc8f40668f0 msgr2=0x7fc8f415e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:11.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 shutdown_connections 2024-04-25T09:05:11.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.228+0000 7fc8fa99e640 1 -- 172.21.15.5:0/4055637051 wait complete. 2024-04-25T09:05:11.228 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:05:11.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:05:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.345+0000 7f1e7f542640 1 Processor -- start 2024-04-25T09:05:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.345+0000 7f1e7f542640 1 -- start start 2024-04-25T09:05:11.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e7f542640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e780ceec0 0x7f1e78168b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e7f542640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e78162070 con 0x7f1e7815dbd0 2024-04-25T09:05:11.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e7f542640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e78162350 con 0x7f1e780b9470 2024-04-25T09:05:11.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e7f542640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780d1c50 con 0x7f1e780ceec0 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e7d2de640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e7815dbd0 0x7f1e781617b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47578/0 (socket says 172.21.15.5:47578) 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e7d2de640 1 -- 172.21.15.5:0/3179038643 learned_addr learned my addr 172.21.15.5:0/3179038643 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595765828 0 0) 0x7f1e78162070 con 0x7f1e7815dbd0 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e7dadf640 1 --2- 172.21.15.5:0/3179038643 >> v2:172.21.15.80:3300/0 conn(0x7f1e780ceec0 0x7f1e78168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e64003520 con 0x7f1e7815dbd0 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 928743673 0 0) 0x7f1e64003520 con 0x7f1e7815dbd0 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 >> v2:172.21.15.80:3300/0 conn(0x7f1e780ceec0 msgr2=0x7f1e78168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 --2- 172.21.15.5:0/3179038643 >> v2:172.21.15.80:3300/0 conn(0x7f1e780ceec0 0x7f1e78168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 >> v1:172.21.15.80:6789/0 conn(0x7f1e780b9470 legacy=0x7f1e780ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780d1f30 con 0x7f1e7815dbd0 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.346+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1e74001670 con 0x7f1e7815dbd0 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 >> v1:172.21.15.5:6789/0 conn(0x7f1e7815dbd0 legacy=0x7f1e781617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e6ffff640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64003a00 0x7f1e64003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e6ffff640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e64004800 0x7f1e64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e6ffff640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e640051c0 0x7f1e6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780d1c50 con 0x7f1e640051c0 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6400c0c0 con 0x7f1e64003a00 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6400c2c0 con 0x7f1e64004800 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7dadf640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e640051c0 0x7f1e6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7d2de640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64003a00 0x7f1e64003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7cadd640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e64004800 0x7f1e64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7dadf640 1 -- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e64004800 msgr2=0x7f1e64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7dadf640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e64004800 0x7f1e64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7dadf640 1 -- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64003a00 msgr2=0x7f1e64003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7dadf640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64003a00 0x7f1e64003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.347+0000 7f1e7dadf640 1 -- 172.21.15.5:0/3179038643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64003520 con 0x7f1e640051c0 2024-04-25T09:05:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e7dadf640 1 -- 172.21.15.5:0/3179038643 reap_dead start 2024-04-25T09:05:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e7dadf640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e640051c0 0x7f1e6400b9c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009fc0 tx=0x7f1e64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7657b8e398f99de5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70035020 con 0x7f1e640051c0 2024-04-25T09:05:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70003bd0 con 0x7f1e640051c0 2024-04-25T09:05:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e6ffff640 1 -- 172.21.15.5:0/3179038643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70009c10 con 0x7f1e640051c0 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e7f542640 1 -- 172.21.15.5:0/3179038643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e640051c0 msgr2=0x7f1e6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e7f542640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e640051c0 0x7f1e6400b9c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009fc0 tx=0x7f1e64005830 comp rx=0 tx=0).stop 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e7f542640 1 -- 172.21.15.5:0/3179038643 shutdown_connections 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e7f542640 1 --2- 172.21.15.5:0/3179038643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e640051c0 0x7f1e6400b9c0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.348+0000 7f1e7f542640 1 -- 172.21.15.5:0/3179038643 >> 172.21.15.5:0/3179038643 conn(0x7f1e78066ad0 msgr2=0x7f1e78066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.349+0000 7f1e7f542640 1 -- 172.21.15.5:0/3179038643 shutdown_connections 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.349+0000 7f1e7f542640 1 -- 172.21.15.5:0/3179038643 wait complete. 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 Processor -- start 2024-04-25T09:05:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 -- start start 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640051c0 0x7f1e7815f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7814bf50 0x7f1e781e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e780b8340 0x7f1e780b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7815e130 con 0x7f1e7814bf50 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7815dfb0 con 0x7f1e640051c0 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7f542640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780ce7b0 con 0x7f1e780b8340 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.350+0000 7f1e7cadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7814bf50 0x7f1e781e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7814bf50 0x7f1e781e9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40968/0 (socket says 172.21.15.5:40968) 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 -- 172.21.15.5:0/2248871397 learned_addr learned my addr 172.21.15.5:0/2248871397 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7d2de640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640051c0 0x7f1e7815f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7dadf640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e780b8340 0x7f1e780b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 -- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e780b8340 msgr2=0x7f1e780b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e780b8340 0x7f1e780b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 -- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640051c0 msgr2=0x7f1e7815f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640051c0 0x7f1e7815f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 -- 172.21.15.5:0/2248871397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7815e430 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7cadd640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7814bf50 0x7f1e781e9e50 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800f650 tx=0x7f1e6800fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e6dffb640 1 -- 172.21.15.5:0/2248871397 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e680050d0 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e6dffb640 1 -- 172.21.15.5:0/2248871397 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e68018070 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7815e710 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e6dffb640 1 -- 172.21.15.5:0/2248871397 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68005490 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.351+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7815ecd0 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.352+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7804ef20 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.353+0000 7f1e6dffb640 1 -- 172.21.15.5:0/2248871397 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e6800d6d0 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.353+0000 7f1e6dffb640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5c06b4d0 0x7f1e5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.354+0000 7f1e6dffb640 1 -- 172.21.15.5:0/2248871397 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e680899e0 con 0x7f1e7814bf50 2024-04-25T09:05:11.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.354+0000 7f1e7d2de640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5c06b4d0 0x7f1e5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.354+0000 7f1e7d2de640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5c06b4d0 0x7f1e5c06d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1e74000c00 tx=0x7f1e74001db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.358+0000 7f1e6dffb640 1 -- 172.21.15.5:0/2248871397 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e680585f0 con 0x7f1e7814bf50 2024-04-25T09:05:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.540+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1e780b7e20 con 0x7f1e7814bf50 2024-04-25T09:05:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.921+0000 7f1e6dffb640 1 -- 172.21.15.5:0/2248871397 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v122) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1e6805c690 con 0x7f1e7814bf50 2024-04-25T09:05:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5c06b4d0 msgr2=0x7f1e5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5c06b4d0 0x7f1e5c06d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1e74000c00 tx=0x7f1e74001db0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7814bf50 msgr2=0x7f1e781e9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7814bf50 0x7f1e781e9e50 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800f650 tx=0x7f1e6800fb10 comp rx=0 tx=0).stop 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 shutdown_connections 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1e5c06b4d0 0x7f1e5c06d990 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e780b8340 0x7f1e780b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e7814bf50 0x7f1e781e9e50 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 --2- 172.21.15.5:0/2248871397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640051c0 0x7f1e7815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 >> 172.21.15.5:0/2248871397 conn(0x7f1e78066ad0 msgr2=0x7f1e780d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:11.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 shutdown_connections 2024-04-25T09:05:11.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:11.924+0000 7f1e7f542640 1 -- 172.21.15.5:0/2248871397 wait complete. 2024-04-25T09:05:11.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:05:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.049+0000 7fef2abb7640 1 Processor -- start 2024-04-25T09:05:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.049+0000 7fef2abb7640 1 -- start start 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.050+0000 7fef2abb7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef2415e0b0 0x7fef2406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.050+0000 7fef2abb7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240d27f0 con 0x7fef240cc780 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.050+0000 7fef2abb7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240cfee0 con 0x7fef240d0c80 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.050+0000 7fef2abb7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240d01c0 con 0x7fef2415e0b0 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.050+0000 7fef29154640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef240cc780 0x7fef240ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47592/0 (socket says 172.21.15.5:47592) 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.050+0000 7fef29154640 1 -- 172.21.15.5:0/252831712 learned_addr learned my addr 172.21.15.5:0/252831712 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef28953640 1 --2- 172.21.15.5:0/252831712 >> v2:172.21.15.80:3300/0 conn(0x7fef2415e0b0 0x7fef2406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437613682 0 0) 0x7fef240d27f0 con 0x7fef240cc780 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef10003520 con 0x7fef240cc780 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275902224 0 0) 0x7fef240cfee0 con 0x7fef240d0c80 2024-04-25T09:05:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef240d27f0 con 0x7fef240d0c80 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 48924206 0 0) 0x7fef10003520 con 0x7fef240cc780 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 >> v2:172.21.15.80:3300/0 conn(0x7fef2415e0b0 msgr2=0x7fef2406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 --2- 172.21.15.5:0/252831712 >> v2:172.21.15.80:3300/0 conn(0x7fef2415e0b0 0x7fef2406adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 >> v1:172.21.15.80:6789/0 conn(0x7fef240d0c80 legacy=0x7fef240cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240d04a0 con 0x7fef240cc780 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fef0c001670 con 0x7fef240cc780 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 >> v1:172.21.15.5:6789/0 conn(0x7fef240cc780 legacy=0x7fef240ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef10003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef10004800 0x7fef10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef100051c0 0x7fef1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef28953640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef10003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240d01c0 con 0x7fef10003b40 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1000c060 con 0x7fef10004800 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1000c260 con 0x7fef100051c0 2024-04-25T09:05:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef23fff640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef10004800 0x7fef10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef29154640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef100051c0 0x7fef1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef28953640 1 -- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef100051c0 msgr2=0x7fef1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef28953640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef100051c0 0x7fef1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef28953640 1 -- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef10004800 msgr2=0x7fef10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef28953640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef10004800 0x7fef10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef29154640 1 -- 172.21.15.5:0/252831712 reap_dead start 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.051+0000 7fef28953640 1 -- 172.21.15.5:0/252831712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10003520 con 0x7fef10003b40 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.052+0000 7fef28953640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef10003f40 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009fc0 tx=0x7fef10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af3ab75fb2d4f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.052+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c034020 con 0x7fef10003b40 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.052+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c0305f0 con 0x7fef10003b40 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.052+0000 7fef237fe640 1 -- 172.21.15.5:0/252831712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c009c10 con 0x7fef10003b40 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.053+0000 7fef2abb7640 1 -- 172.21.15.5:0/252831712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 msgr2=0x7fef10003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.053+0000 7fef2abb7640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef10003f40 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009fc0 tx=0x7fef10005830 comp rx=0 tx=0).stop 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.053+0000 7fef2abb7640 1 -- 172.21.15.5:0/252831712 shutdown_connections 2024-04-25T09:05:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.053+0000 7fef2abb7640 1 --2- 172.21.15.5:0/252831712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef10003f40 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.053+0000 7fef2abb7640 1 -- 172.21.15.5:0/252831712 >> 172.21.15.5:0/252831712 conn(0x7fef240d1a20 msgr2=0x7fef240d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.053+0000 7fef2abb7640 1 -- 172.21.15.5:0/252831712 shutdown_connections 2024-04-25T09:05:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.053+0000 7fef2abb7640 1 -- 172.21.15.5:0/252831712 wait complete. 2024-04-25T09:05:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.054+0000 7fef2abb7640 1 Processor -- start 2024-04-25T09:05:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.054+0000 7fef2abb7640 1 -- start start 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef2abb7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef241f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef2abb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef24152ed0 0x7fef240cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef2abb7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef240cb2a0 0x7fef240c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef2abb7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240cfb90 con 0x7fef10003b40 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef2abb7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2415e490 con 0x7fef24152ed0 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef2abb7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240ccc30 con 0x7fef240cb2a0 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef241f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef241f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40986/0 (socket says 172.21.15.5:40986) 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 -- 172.21.15.5:0/872810268 learned_addr learned my addr 172.21.15.5:0/872810268 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 -- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef240cb2a0 msgr2=0x7fef240c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef240cb2a0 0x7fef240c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 -- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef24152ed0 msgr2=0x7fef240cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef23fff640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef24152ed0 0x7fef240cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef24152ed0 0x7fef240cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.055+0000 7fef28953640 1 -- 172.21.15.5:0/872810268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240c6d00 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.056+0000 7fef28953640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef241f3a90 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fef1c033040 tx=0x7fef1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.056+0000 7fef217fa640 1 -- 172.21.15.5:0/872810268 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c040070 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.056+0000 7fef217fa640 1 -- 172.21.15.5:0/872810268 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c003990 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.056+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240c8c70 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.056+0000 7fef217fa640 1 -- 172.21.15.5:0/872810268 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c034040 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.056+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef24153350 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.057+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2404ef20 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.057+0000 7fef217fa640 1 -- 172.21.15.5:0/872810268 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef1c037020 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.058+0000 7fef217fa640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef0406b500 0x7fef0406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.058+0000 7fef217fa640 1 -- 172.21.15.5:0/872810268 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fef1c0aaa70 con 0x7fef10003b40 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.058+0000 7fef23fff640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef0406b500 0x7fef0406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.058+0000 7fef23fff640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef0406b500 0x7fef0406d9c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fef14000c00 tx=0x7fef14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.062+0000 7fef217fa640 1 -- 172.21.15.5:0/872810268 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef1c079b60 con 0x7fef10003b40 2024-04-25T09:05:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.242+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fef240b79a0 con 0x7fef10003b40 2024-04-25T09:05:12.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.927+0000 7fef217fa640 1 -- 172.21.15.5:0/872810268 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v123) v1 ==== 170+0+0 (secure 0 0 0) 0x7fef1c079460 con 0x7fef10003b40 2024-04-25T09:05:12.916 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T09:05:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef0406b500 msgr2=0x7fef0406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef0406b500 0x7fef0406d9c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fef14000c00 tx=0x7fef14009040 comp rx=0 tx=0).stop 2024-04-25T09:05:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 msgr2=0x7fef241f3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef241f3a90 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fef1c033040 tx=0x7fef1c009750 comp rx=0 tx=0).stop 2024-04-25T09:05:12.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 shutdown_connections 2024-04-25T09:05:12.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fef0406b500 0x7fef0406d9c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fef240cb2a0 0x7fef240c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef24152ed0 0x7fef240cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 --2- 172.21.15.5:0/872810268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef10003b40 0x7fef241f3a90 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.933+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 >> 172.21.15.5:0/872810268 conn(0x7fef240d1a20 msgr2=0x7fef240b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.935+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 shutdown_connections 2024-04-25T09:05:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:12.937+0000 7fef2abb7640 1 -- 172.21.15.5:0/872810268 wait complete. 2024-04-25T09:05:12.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:05:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.070+0000 7fd7f42b3640 1 Processor -- start 2024-04-25T09:05:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.070+0000 7fd7f42b3640 1 -- start start 2024-04-25T09:05:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f42b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b72b0 0x7fd7ec0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f42b3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7ec0d0d20 0x7fd7ec0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f42b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec0cc010 con 0x7fd7ec0ce6e0 2024-04-25T09:05:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f42b3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0cdde0 con 0x7fd7ec0d0d20 2024-04-25T09:05:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f42b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0cc2f0 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f184e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7ec0d0d20 0x7fd7ec0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f184e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd7ec0d0d20 0x7fd7ec0ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40992/0 (socket says 172.21.15.5:40992) 2024-04-25T09:05:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f184e640 1 -- 172.21.15.5:0/1770735912 learned_addr learned my addr 172.21.15.5:0/1770735912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.071+0000 7fd7f204f640 1 --2- 172.21.15.5:0/1770735912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b72b0 0x7fd7ec0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.072+0000 7fd7f184e640 1 -- 172.21.15.5:0/1770735912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b72b0 msgr2=0x7fd7ec0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.072+0000 7fd7f184e640 1 --2- 172.21.15.5:0/1770735912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b72b0 0x7fd7ec0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.072+0000 7fd7f184e640 1 -- 172.21.15.5:0/1770735912 >> v1:172.21.15.80:6789/0 conn(0x7fd7ec0ce6e0 legacy=0x7fd7ec06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.072+0000 7fd7f184e640 1 -- 172.21.15.5:0/1770735912 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0cc5d0 con 0x7fd7ec0d0d20 2024-04-25T09:05:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.072+0000 7fd7f184e640 1 --2- 172.21.15.5:0/1770735912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec0ce1a0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009870 tx=0x7fd7e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d074167ca9139bcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f104d640 1 -- 172.21.15.5:0/1770735912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0037070 con 0x7fd7ec0d0d20 2024-04-25T09:05:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f104d640 1 -- 172.21.15.5:0/1770735912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0032440 con 0x7fd7ec0d0d20 2024-04-25T09:05:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f104d640 1 -- 172.21.15.5:0/1770735912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0032810 con 0x7fd7ec0d0d20 2024-04-25T09:05:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 -- 172.21.15.5:0/1770735912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0d0d20 msgr2=0x7fd7ec0ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/1770735912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec0ce1a0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009870 tx=0x7fd7e002a270 comp rx=0 tx=0).stop 2024-04-25T09:05:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 -- 172.21.15.5:0/1770735912 shutdown_connections 2024-04-25T09:05:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/1770735912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec0ce1a0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/1770735912 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0b72b0 0x7fd7ec0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 -- 172.21.15.5:0/1770735912 >> 172.21.15.5:0/1770735912 conn(0x7fd7ec0d1920 msgr2=0x7fd7ec0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 -- 172.21.15.5:0/1770735912 shutdown_connections 2024-04-25T09:05:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.073+0000 7fd7f42b3640 1 -- 172.21.15.5:0/1770735912 wait complete. 2024-04-25T09:05:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.074+0000 7fd7f42b3640 1 Processor -- start 2024-04-25T09:05:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f42b3640 1 -- start start 2024-04-25T09:05:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f42b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0b72b0 0x7fd7ec157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f42b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0ce6e0 0x7fd7ec1f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f42b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f42b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0d1550 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f42b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b4770 con 0x7fd7ec0d0d20 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f42b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0d1180 con 0x7fd7ec0ce6e0 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f204f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0b72b0 0x7fd7ec157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f204f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0b72b0 0x7fd7ec157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40998/0 (socket says 172.21.15.5:40998) 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f204f640 1 -- 172.21.15.5:0/2141937694 learned_addr learned my addr 172.21.15.5:0/2141937694 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f184e640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0ce6e0 0x7fd7ec1f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.075+0000 7fd7f2850640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f204f640 1 -- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0ce6e0 msgr2=0x7fd7ec1f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f204f640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0ce6e0 0x7fd7ec1f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f204f640 1 -- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0d0d20 msgr2=0x7fd7ec15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f204f640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec15dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f204f640 1 -- 172.21.15.5:0/2141937694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec1f7f30 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f2850640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f204f640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0b72b0 0x7fd7ec157c60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400e870 tx=0x7fd7e400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7eaffd640 1 -- 172.21.15.5:0/2141937694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4017070 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7eaffd640 1 -- 172.21.15.5:0/2141937694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400c940 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec1f3b30 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7eaffd640 1 -- 172.21.15.5:0/2141937694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400cd30 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.076+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec1f40f0 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.077+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec04ef20 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.078+0000 7fd7eaffd640 1 -- 172.21.15.5:0/2141937694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd7e401a070 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.078+0000 7fd7eaffd640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d806b500 0x7fd7d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.078+0000 7fd7eaffd640 1 -- 172.21.15.5:0/2141937694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd7e4089f60 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.078+0000 7fd7f184e640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d806b500 0x7fd7d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.079+0000 7fd7f184e640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d806b500 0x7fd7d806d9c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0034000 tx=0x7fd7e002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.082+0000 7fd7eaffd640 1 -- 172.21.15.5:0/2141937694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7e40587f0 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T09:05:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.299+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd7ec06c140 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.929+0000 7fd7eaffd640 1 -- 172.21.15.5:0/2141937694 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v76) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd7e405c890 con 0x7fd7ec0b72b0 2024-04-25T09:05:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 18 and data pool 19 2024-04-25T09:05:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d806b500 msgr2=0x7fd7d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d806b500 0x7fd7d806d9c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0034000 tx=0x7fd7e002e000 comp rx=0 tx=0).stop 2024-04-25T09:05:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0b72b0 msgr2=0x7fd7ec157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0b72b0 0x7fd7ec157c60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400e870 tx=0x7fd7e400ed30 comp rx=0 tx=0).stop 2024-04-25T09:05:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 shutdown_connections 2024-04-25T09:05:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd7d806b500 0x7fd7d806d9c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7ec0d0d20 0x7fd7ec15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd7ec0ce6e0 0x7fd7ec1f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 --2- 172.21.15.5:0/2141937694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7ec0b72b0 0x7fd7ec157c60 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.935+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 >> 172.21.15.5:0/2141937694 conn(0x7fd7ec0d1920 msgr2=0x7fd7ec06fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.945+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 shutdown_connections 2024-04-25T09:05:13.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:13.945+0000 7fd7f42b3640 1 -- 172.21.15.5:0/2141937694 wait complete. 2024-04-25T09:05:13.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.078+0000 7f6b948ac640 1 Processor -- start 2024-04-25T09:05:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.078+0000 7f6b948ac640 1 -- start start 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b948ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b9006bbb0 0x7f6b9006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b948ac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900b4730 con 0x7f6b9006b7d0 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b948ac640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900d0da0 con 0x7f6b9015e120 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b948ac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b900cbf30 con 0x7f6b9006bbb0 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b8ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b9006bbb0 0x7f6b9006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b8e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6b9006b7d0 0x7f6b9015da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47608/0 (socket says 172.21.15.5:47608) 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b8e59c640 1 -- 172.21.15.5:0/4093217996 learned_addr learned my addr 172.21.15.5:0/4093217996 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b8ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b9006bbb0 0x7f6b9006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41006/0 (socket says 172.21.15.5:41006) 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b8ed9d640 1 -- 172.21.15.5:0/4093217996 >> v1:172.21.15.80:6789/0 conn(0x7f6b9015e120 legacy=0x7f6b900ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b8ed9d640 1 -- 172.21.15.5:0/4093217996 >> v1:172.21.15.5:6789/0 conn(0x7f6b9006b7d0 legacy=0x7f6b9015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.079+0000 7f6b8ed9d640 1 -- 172.21.15.5:0/4093217996 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900cc180 con 0x7f6b9006bbb0 2024-04-25T09:05:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.080+0000 7f6b8ed9d640 1 --2- 172.21.15.5:0/4093217996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006bbb0 0x7f6b9006aef0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009d90 tx=0x7f6b8802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7549ce3fabe21f0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.080+0000 7f6b8d59a640 1 -- 172.21.15.5:0/4093217996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88007740 con 0x7f6b9006bbb0 2024-04-25T09:05:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.080+0000 7f6b8d59a640 1 -- 172.21.15.5:0/4093217996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b880078e0 con 0x7f6b9006bbb0 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.080+0000 7f6b8d59a640 1 -- 172.21.15.5:0/4093217996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88007cb0 con 0x7f6b9006bbb0 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.081+0000 7f6b948ac640 1 -- 172.21.15.5:0/4093217996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006bbb0 msgr2=0x7f6b9006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.081+0000 7f6b948ac640 1 --2- 172.21.15.5:0/4093217996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006bbb0 0x7f6b9006aef0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009d90 tx=0x7f6b8802a730 comp rx=0 tx=0).stop 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.081+0000 7f6b948ac640 1 -- 172.21.15.5:0/4093217996 shutdown_connections 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.081+0000 7f6b948ac640 1 --2- 172.21.15.5:0/4093217996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006bbb0 0x7f6b9006aef0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.081+0000 7f6b948ac640 1 -- 172.21.15.5:0/4093217996 >> 172.21.15.5:0/4093217996 conn(0x7f6b900d18e0 msgr2=0x7f6b900d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.081+0000 7f6b948ac640 1 -- 172.21.15.5:0/4093217996 shutdown_connections 2024-04-25T09:05:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.081+0000 7f6b948ac640 1 -- 172.21.15.5:0/4093217996 wait complete. 2024-04-25T09:05:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.082+0000 7f6b948ac640 1 Processor -- start 2024-04-25T09:05:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.082+0000 7f6b948ac640 1 -- start start 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b948ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006b7d0 0x7f6b9014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b948ac640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b9006bbb0 0x7f6b901602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b948ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b9015e120 0x7f6b90160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b948ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900d0630 con 0x7f6b9006b7d0 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b948ac640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900cc7d0 con 0x7f6b9015e120 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b948ac640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900d07b0 con 0x7f6b9006bbb0 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006b7d0 0x7f6b9014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006b7d0 0x7f6b9014ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41016/0 (socket says 172.21.15.5:41016) 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 -- 172.21.15.5:0/891790395 learned_addr learned my addr 172.21.15.5:0/891790395 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8dd9b640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b9006bbb0 0x7f6b901602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8ed9d640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b9015e120 0x7f6b90160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 -- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b9006bbb0 msgr2=0x7f6b901602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b9006bbb0 0x7f6b901602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 -- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b9015e120 msgr2=0x7f6b90160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b9015e120 0x7f6b90160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8e59c640 1 -- 172.21.15.5:0/891790395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900cb320 con 0x7f6b9006b7d0 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8ed9d640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b9015e120 0x7f6b90160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.083+0000 7f6b8dd9b640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b9006bbb0 0x7f6b901602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.084+0000 7f6b8e59c640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006b7d0 0x7f6b9014ad80 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c400 tx=0x7f6b7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.084+0000 7f6b86ffd640 1 -- 172.21.15.5:0/891790395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78017070 con 0x7f6b9006b7d0 2024-04-25T09:05:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.084+0000 7f6b86ffd640 1 -- 172.21.15.5:0/891790395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78005ce0 con 0x7f6b9006b7d0 2024-04-25T09:05:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.084+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b900c8a50 con 0x7f6b9006b7d0 2024-04-25T09:05:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.084+0000 7f6b86ffd640 1 -- 172.21.15.5:0/891790395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780072f0 con 0x7f6b9006b7d0 2024-04-25T09:05:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.084+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b900c9010 con 0x7f6b9006b7d0 2024-04-25T09:05:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.085+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9004ef20 con 0x7f6b9006b7d0 2024-04-25T09:05:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.085+0000 7f6b86ffd640 1 -- 172.21.15.5:0/891790395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6b7801a070 con 0x7f6b9006b7d0 2024-04-25T09:05:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.086+0000 7f6b86ffd640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b7006b4d0 0x7f6b7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.086+0000 7f6b86ffd640 1 -- 172.21.15.5:0/891790395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b78089650 con 0x7f6b9006b7d0 2024-04-25T09:05:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.086+0000 7f6b8dd9b640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b7006b4d0 0x7f6b7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.087+0000 7f6b8dd9b640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b7006b4d0 0x7f6b7006d990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6b80006fd0 tx=0x7f6b80008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.090+0000 7f6b86ffd640 1 -- 172.21.15.5:0/891790395 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b900b4730 con 0x7f6b9006b7d0 2024-04-25T09:05:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.272+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b9015d060 con 0x7f6b9006b7d0 2024-04-25T09:05:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.273+0000 7f6b86ffd640 1 -- 172.21.15.5:0/891790395 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f6b780584c0 con 0x7f6b9006b7d0 2024-04-25T09:05:14.262 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:14.262 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":124,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:13.300745+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:11.572493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:12.274797+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b7006b4d0 msgr2=0x7f6b7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b7006b4d0 0x7f6b7006d990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6b80006fd0 tx=0x7f6b80008040 comp rx=0 tx=0).stop 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006b7d0 msgr2=0x7f6b9014ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006b7d0 0x7f6b9014ad80 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c400 tx=0x7f6b7800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 shutdown_connections 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6b7006b4d0 0x7f6b7006d990 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b9015e120 0x7f6b90160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6b9006bbb0 0x7f6b901602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 --2- 172.21.15.5:0/891790395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9006b7d0 0x7f6b9014ad80 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 >> 172.21.15.5:0/891790395 conn(0x7f6b900d18e0 msgr2=0x7f6b900d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 shutdown_connections 2024-04-25T09:05:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.275+0000 7f6b948ac640 1 -- 172.21.15.5:0/891790395 wait complete. 2024-04-25T09:05:14.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.387+0000 7fb646b1b640 1 Processor -- start 2024-04-25T09:05:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.388+0000 7fb646b1b640 1 -- start start 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.388+0000 7fb646b1b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb64015bdc0 0x7fb6400cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.388+0000 7fb646b1b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6400cd6e0 0x7fb6400ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.388+0000 7fb646b1b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6400cdcb0 con 0x7fb6400ce7d0 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.388+0000 7fb646b1b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400cec00 con 0x7fb6400cd6e0 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.388+0000 7fb646b1b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400cdf90 con 0x7fb64015bdc0 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb63ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6400cd6e0 0x7fb6400ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb63ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6400cd6e0 0x7fb6400ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41022/0 (socket says 172.21.15.5:41022) 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb63ffff640 1 -- 172.21.15.5:0/1704141238 learned_addr learned my addr 172.21.15.5:0/1704141238 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb6448b7640 1 --2- 172.21.15.5:0/1704141238 >> v2:172.21.15.80:3300/0 conn(0x7fb64015bdc0 0x7fb6400cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb63ffff640 1 -- 172.21.15.5:0/1704141238 >> v2:172.21.15.80:3300/0 conn(0x7fb64015bdc0 msgr2=0x7fb6400cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb63ffff640 1 --2- 172.21.15.5:0/1704141238 >> v2:172.21.15.80:3300/0 conn(0x7fb64015bdc0 0x7fb6400cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb63ffff640 1 -- 172.21.15.5:0/1704141238 >> v1:172.21.15.80:6789/0 conn(0x7fb6400ce7d0 legacy=0x7fb6400cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.389+0000 7fb63ffff640 1 -- 172.21.15.5:0/1704141238 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400b47e0 con 0x7fb6400cd6e0 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb63ffff640 1 --2- 172.21.15.5:0/1704141238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400cd6e0 0x7fb6400ce290 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fb640067710 tx=0x7fb62c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7ae6d795a802c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb63f7fe640 1 -- 172.21.15.5:0/1704141238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c037070 con 0x7fb6400cd6e0 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb63f7fe640 1 -- 172.21.15.5:0/1704141238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c032440 con 0x7fb6400cd6e0 2024-04-25T09:05:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb63f7fe640 1 -- 172.21.15.5:0/1704141238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c032810 con 0x7fb6400cd6e0 2024-04-25T09:05:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 -- 172.21.15.5:0/1704141238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400cd6e0 msgr2=0x7fb6400ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 --2- 172.21.15.5:0/1704141238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400cd6e0 0x7fb6400ce290 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fb640067710 tx=0x7fb62c02a270 comp rx=0 tx=0).stop 2024-04-25T09:05:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 -- 172.21.15.5:0/1704141238 shutdown_connections 2024-04-25T09:05:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 --2- 172.21.15.5:0/1704141238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400cd6e0 0x7fb6400ce290 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 --2- 172.21.15.5:0/1704141238 >> v2:172.21.15.80:3300/0 conn(0x7fb64015bdc0 0x7fb6400cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 -- 172.21.15.5:0/1704141238 >> 172.21.15.5:0/1704141238 conn(0x7fb6400d18f0 msgr2=0x7fb6400d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 -- 172.21.15.5:0/1704141238 shutdown_connections 2024-04-25T09:05:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.390+0000 7fb646b1b640 1 -- 172.21.15.5:0/1704141238 wait complete. 2024-04-25T09:05:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.391+0000 7fb646b1b640 1 Processor -- start 2024-04-25T09:05:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb646b1b640 1 -- start start 2024-04-25T09:05:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb646b1b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6400cd6e0 0x7fb6400c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb646b1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400ce7d0 0x7fb640150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb646b1b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64015bdc0 0x7fb6400ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb646b1b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400d09a0 con 0x7fb6400ce7d0 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb646b1b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400b4da0 con 0x7fb6400cd6e0 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb646b1b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64015c1a0 con 0x7fb64015bdc0 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.392+0000 7fb63ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400ce7d0 0x7fb640150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400ce7d0 0x7fb640150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41032/0 (socket says 172.21.15.5:41032) 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 -- 172.21.15.5:0/4161859475 learned_addr learned my addr 172.21.15.5:0/4161859475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb6450b8640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64015bdc0 0x7fb6400ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb6448b7640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6400cd6e0 0x7fb6400c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 -- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64015bdc0 msgr2=0x7fb6400ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64015bdc0 0x7fb6400ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 -- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6400cd6e0 msgr2=0x7fb6400c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6400cd6e0 0x7fb6400c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 -- 172.21.15.5:0/4161859475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6401512c0 con 0x7fb6400ce7d0 2024-04-25T09:05:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb6450b8640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64015bdc0 0x7fb6400ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb6448b7640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6400cd6e0 0x7fb6400c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63ffff640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400ce7d0 0x7fb640150d80 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02a2b0 tx=0x7fb62c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63d7fa640 1 -- 172.21.15.5:0/4161859475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c037040 con 0x7fb6400ce7d0 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63d7fa640 1 -- 172.21.15.5:0/4161859475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c042070 con 0x7fb6400ce7d0 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb63d7fa640 1 -- 172.21.15.5:0/4161859475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c030880 con 0x7fb6400ce7d0 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400cad40 con 0x7fb6400ce7d0 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.393+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400cb300 con 0x7fb6400ce7d0 2024-04-25T09:05:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.394+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64004ef20 con 0x7fb6400ce7d0 2024-04-25T09:05:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.395+0000 7fb63d7fa640 1 -- 172.21.15.5:0/4161859475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb62c030a20 con 0x7fb6400ce7d0 2024-04-25T09:05:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.395+0000 7fb63d7fa640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb62406b4d0 0x7fb62406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.395+0000 7fb63d7fa640 1 -- 172.21.15.5:0/4161859475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb62c0aab20 con 0x7fb6400ce7d0 2024-04-25T09:05:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.395+0000 7fb6448b7640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb62406b4d0 0x7fb62406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.396+0000 7fb6448b7640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb62406b4d0 0x7fb62406d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb634009b90 tx=0x7fb634008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.399+0000 7fb63d7fa640 1 -- 172.21.15.5:0/4161859475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6401512c0 con 0x7fb6400ce7d0 2024-04-25T09:05:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.580+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6400b7410 con 0x7fb6400ce7d0 2024-04-25T09:05:14.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.581+0000 7fb63d7fa640 1 -- 172.21.15.5:0/4161859475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16608 (secure 0 0 0) 0x7fb62c079940 con 0x7fb6400ce7d0 2024-04-25T09:05:14.570 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":124,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:13.300745+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:11.572493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:12.274797+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb62406b4d0 msgr2=0x7fb62406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb62406b4d0 0x7fb62406d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb634009b90 tx=0x7fb634008040 comp rx=0 tx=0).stop 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400ce7d0 msgr2=0x7fb640150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400ce7d0 0x7fb640150d80 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02a2b0 tx=0x7fb62c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 shutdown_connections 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb62406b4d0 0x7fb62406d990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb64015bdc0 0x7fb6400ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6400ce7d0 0x7fb640150d80 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 --2- 172.21.15.5:0/4161859475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6400cd6e0 0x7fb6400c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 >> 172.21.15.5:0/4161859475 conn(0x7fb6400d18f0 msgr2=0x7fb6400b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 shutdown_connections 2024-04-25T09:05:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.584+0000 7fb646b1b640 1 -- 172.21.15.5:0/4161859475 wait complete. 2024-04-25T09:05:14.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:05:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.701+0000 7f7e68b70640 1 Processor -- start 2024-04-25T09:05:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.701+0000 7f7e68b70640 1 -- start start 2024-04-25T09:05:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e68b70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e640b6250 0x7f7e640ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e68b70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 0x7f7e640d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e68b70640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e64162150 con 0x7f7e6415df10 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e68b70640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e640d20d0 con 0x7f7e640b6250 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e68b70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64162430 con 0x7f7e640cee10 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e6259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e6415df10 0x7f7e641618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47616/0 (socket says 172.21.15.5:47616) 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e6259c640 1 -- 172.21.15.5:0/3226310091 learned_addr learned my addr 172.21.15.5:0/3226310091 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e5bfff640 1 --2- 172.21.15.5:0/3226310091 >> v2:172.21.15.80:3300/0 conn(0x7f7e640b6250 0x7f7e640ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 0x7f7e640d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362366907 0 0) 0x7f7e64162150 con 0x7f7e6415df10 2024-04-25T09:05:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e50003520 con 0x7f7e6415df10 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976656236 0 0) 0x7f7e50003520 con 0x7f7e6415df10 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 msgr2=0x7f7e640d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 0x7f7e640d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 >> v2:172.21.15.80:3300/0 conn(0x7f7e640b6250 msgr2=0x7f7e640ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 --2- 172.21.15.5:0/3226310091 >> v2:172.21.15.80:3300/0 conn(0x7f7e640b6250 0x7f7e640ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64162710 con 0x7f7e6415df10 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f7e54001670 con 0x7f7e6415df10 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 >> v1:172.21.15.5:6789/0 conn(0x7f7e6415df10 legacy=0x7f7e641618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e500039b0 0x7f7e50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 0x7f7e50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e50004d40 0x7f7e500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640d20d0 con 0x7f7e50004d40 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64162430 con 0x7f7e500039b0 2024-04-25T09:05:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.702+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5000b9c0 con 0x7f7e640cee10 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e6259c640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e500039b0 0x7f7e50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e50004d40 0x7f7e500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e5bfff640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 0x7f7e50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e62d9d640 1 -- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 msgr2=0x7f7e50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e640cee10 0x7f7e50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e62d9d640 1 -- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e500039b0 msgr2=0x7f7e50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e500039b0 0x7f7e50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.703+0000 7f7e62d9d640 1 -- 172.21.15.5:0/3226310091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50003520 con 0x7f7e50004d40 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e50004d40 0x7f7e500051c0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009fc0 tx=0x7f7e50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2920379adfc5114a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c009c10 con 0x7f7e50004d40 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c036070 con 0x7f7e50004d40 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e61d9b640 1 -- 172.21.15.5:0/3226310091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c031880 con 0x7f7e50004d40 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e68b70640 1 -- 172.21.15.5:0/3226310091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e50004d40 msgr2=0x7f7e500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e68b70640 1 --2- 172.21.15.5:0/3226310091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e50004d40 0x7f7e500051c0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009fc0 tx=0x7f7e50005830 comp rx=0 tx=0).stop 2024-04-25T09:05:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e62d9d640 1 -- 172.21.15.5:0/3226310091 reap_dead start 2024-04-25T09:05:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e68b70640 1 -- 172.21.15.5:0/3226310091 shutdown_connections 2024-04-25T09:05:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e68b70640 1 -- 172.21.15.5:0/3226310091 >> 172.21.15.5:0/3226310091 conn(0x7f7e640668f0 msgr2=0x7f7e64066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e68b70640 1 -- 172.21.15.5:0/3226310091 shutdown_connections 2024-04-25T09:05:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.704+0000 7f7e68b70640 1 -- 172.21.15.5:0/3226310091 wait complete. 2024-04-25T09:05:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 Processor -- start 2024-04-25T09:05:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 -- start start 2024-04-25T09:05:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e50004d40 0x7f7e6414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e6414ba60 0x7f7e640c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415e2f0 0x7f7e6415e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640d26e0 con 0x7f7e6415e2f0 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640d2560 con 0x7f7e6414ba60 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e68b70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640d2860 con 0x7f7e50004d40 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.706+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415e2f0 0x7f7e6415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415e2f0 0x7f7e6415e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41046/0 (socket says 172.21.15.5:41046) 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 -- 172.21.15.5:0/484398704 learned_addr learned my addr 172.21.15.5:0/484398704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e6259c640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e50004d40 0x7f7e6414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e5bfff640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e6414ba60 0x7f7e640c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 -- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e50004d40 msgr2=0x7f7e6414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e50004d40 0x7f7e6414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 -- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e6414ba60 msgr2=0x7f7e640c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e6414ba60 0x7f7e640c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 -- 172.21.15.5:0/484398704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6414bfd0 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e62d9d640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415e2f0 0x7f7e6415e770 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c033040 tx=0x7f7e5c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e5affd640 1 -- 172.21.15.5:0/484398704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c009c10 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e5affd640 1 -- 172.21.15.5:0/484398704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c031dd0 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e5affd640 1 -- 172.21.15.5:0/484398704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c003bd0 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6414c2b0 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.707+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6414c870 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.708+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6404ef20 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.709+0000 7f7e5affd640 1 -- 172.21.15.5:0/484398704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e5c005d10 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.709+0000 7f7e5affd640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e4406b4d0 0x7f7e4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.709+0000 7f7e5affd640 1 -- 172.21.15.5:0/484398704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e5c0ab9d0 con 0x7f7e6415e2f0 2024-04-25T09:05:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.709+0000 7f7e6259c640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e4406b4d0 0x7f7e4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.710+0000 7f7e6259c640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e4406b4d0 0x7f7e4406d990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000fb0 tx=0x7f7e54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.714+0000 7f7e5affd640 1 -- 172.21.15.5:0/484398704 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e5c04a060 con 0x7f7e6415e2f0 2024-04-25T09:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.933+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7e640b3340 con 0x7f7e6415e2f0 2024-04-25T09:05:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.946+0000 7f7e5affd640 1 -- 172.21.15.5:0/484398704 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7e5c07a7c0 con 0x7f7e6415e2f0 2024-04-25T09:05:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e4406b4d0 msgr2=0x7f7e4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e4406b4d0 0x7f7e4406d990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000fb0 tx=0x7f7e54009040 comp rx=0 tx=0).stop 2024-04-25T09:05:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415e2f0 msgr2=0x7f7e6415e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415e2f0 0x7f7e6415e770 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c033040 tx=0x7f7e5c009750 comp rx=0 tx=0).stop 2024-04-25T09:05:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 shutdown_connections 2024-04-25T09:05:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7e4406b4d0 0x7f7e4406d990 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6415e2f0 0x7f7e6415e770 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e6414ba60 0x7f7e640c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.947+0000 7f7e68b70640 1 --2- 172.21.15.5:0/484398704 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e50004d40 0x7f7e6414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.948+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 >> 172.21.15.5:0/484398704 conn(0x7f7e640668f0 msgr2=0x7f7e640b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.948+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 shutdown_connections 2024-04-25T09:05:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:14.948+0000 7f7e68b70640 1 -- 172.21.15.5:0/484398704 wait complete. 2024-04-25T09:05:14.947 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:05:14.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:05:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.063+0000 7fea5d928640 1 Processor -- start 2024-04-25T09:05:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.063+0000 7fea5d928640 1 -- start start 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.064+0000 7fea5d928640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 0x7fea580d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.064+0000 7fea5d928640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5815e260 con 0x7fea580ce1c0 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.064+0000 7fea5d928640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea580d18c0 con 0x7fea5815de80 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.064+0000 7fea5d928640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d3770 con 0x7fea580d2dc0 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.064+0000 7fea567fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea580ce1c0 0x7fea580d2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47626/0 (socket says 172.21.15.5:47626) 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.064+0000 7fea567fc640 1 -- 172.21.15.5:0/728068155 learned_addr learned my addr 172.21.15.5:0/728068155 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea577fe640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 0x7fea580d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747210873 0 0) 0x7fea5815e260 con 0x7fea580ce1c0 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea44003520 con 0x7fea580ce1c0 2024-04-25T09:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 813293972 0 0) 0x7fea44003520 con 0x7fea580ce1c0 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 msgr2=0x7fea580d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 0x7fea580d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 >> v1:172.21.15.80:6789/0 conn(0x7fea5815de80 legacy=0x7fea580ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580ce780 con 0x7fea580ce1c0 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fea40001690 con 0x7fea580ce1c0 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 >> v1:172.21.15.5:6789/0 conn(0x7fea580ce1c0 legacy=0x7fea580d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea44004390 0x7fea44004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 0x7fea44005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d3770 con 0x7fea440039e0 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4400ba70 con 0x7fea44004390 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4400bc70 con 0x7fea580d2dc0 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea56ffd640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea567fc640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea44004390 0x7fea44004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.065+0000 7fea577fe640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 0x7fea44005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea56ffd640 1 -- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 msgr2=0x7fea44005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea56ffd640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea580d2dc0 0x7fea44005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea56ffd640 1 -- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea44004390 msgr2=0x7fea44004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea56ffd640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea44004390 0x7fea44004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea56ffd640 1 -- 172.21.15.5:0/728068155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44003520 con 0x7fea440039e0 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea56ffd640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea44003dc0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fea50001860 tx=0x7fea44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9f02e11072622f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50037070 con 0x7fea440039e0 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5002ac30 con 0x7fea440039e0 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.066+0000 7fea55ffb640 1 -- 172.21.15.5:0/728068155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50001430 con 0x7fea440039e0 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.067+0000 7fea5d928640 1 -- 172.21.15.5:0/728068155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 msgr2=0x7fea44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.067+0000 7fea5d928640 1 --2- 172.21.15.5:0/728068155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea44003dc0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fea50001860 tx=0x7fea44005830 comp rx=0 tx=0).stop 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.067+0000 7fea577fe640 1 -- 172.21.15.5:0/728068155 reap_dead start 2024-04-25T09:05:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.067+0000 7fea5d928640 1 -- 172.21.15.5:0/728068155 shutdown_connections 2024-04-25T09:05:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.067+0000 7fea5d928640 1 -- 172.21.15.5:0/728068155 >> 172.21.15.5:0/728068155 conn(0x7fea5806b000 msgr2=0x7fea5806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.067+0000 7fea5d928640 1 -- 172.21.15.5:0/728068155 shutdown_connections 2024-04-25T09:05:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.067+0000 7fea5d928640 1 -- 172.21.15.5:0/728068155 wait complete. 2024-04-25T09:05:15.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.068+0000 7fea5d928640 1 Processor -- start 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.068+0000 7fea5d928640 1 -- start start 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea5d928640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea581468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea5d928640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea580b5f90 0x7fea580cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea5d928640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea581f3050 0x7fea581f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea5d928640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d3230 con 0x7fea440039e0 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea5d928640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d1ef0 con 0x7fea580b5f90 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea5d928640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d33b0 con 0x7fea581f3050 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea581468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea581468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41062/0 (socket says 172.21.15.5:41062) 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 -- 172.21.15.5:0/3375634768 learned_addr learned my addr 172.21.15.5:0/3375634768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea577fe640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea581f3050 0x7fea581f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea567fc640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea580b5f90 0x7fea580cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 -- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea581f3050 msgr2=0x7fea581f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea581f3050 0x7fea581f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 -- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea580b5f90 msgr2=0x7fea580cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea580b5f90 0x7fea580cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.069+0000 7fea56ffd640 1 -- 172.21.15.5:0/3375634768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58146e30 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.070+0000 7fea56ffd640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea581468f0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fea5002a6c0 tx=0x7fea50001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.070+0000 7fea4ffff640 1 -- 172.21.15.5:0/3375634768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50040020 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.070+0000 7fea4ffff640 1 -- 172.21.15.5:0/3375634768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50005070 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.070+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea581531f0 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.070+0000 7fea4ffff640 1 -- 172.21.15.5:0/3375634768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50037040 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.070+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea580b3920 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.071+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5804ef20 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.071+0000 7fea4ffff640 1 -- 172.21.15.5:0/3375634768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fea50043020 con 0x7fea440039e0 2024-04-25T09:05:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.072+0000 7fea4ffff640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3806b4d0 0x7fea3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.072+0000 7fea4ffff640 1 -- 172.21.15.5:0/3375634768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea500aa1a0 con 0x7fea440039e0 2024-04-25T09:05:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.072+0000 7fea567fc640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3806b4d0 0x7fea3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.073+0000 7fea567fc640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3806b4d0 0x7fea3806d990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fea58155910 tx=0x7fea40000fe0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.076+0000 7fea4ffff640 1 -- 172.21.15.5:0/3375634768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fea5004a030 con 0x7fea440039e0 2024-04-25T09:05:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.296+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fea580cd860 con 0x7fea440039e0 2024-04-25T09:05:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.952+0000 7fea4ffff640 1 -- 172.21.15.5:0/3375634768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7fea58146e30 con 0x7fea440039e0 2024-04-25T09:05:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3806b4d0 msgr2=0x7fea3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3806b4d0 0x7fea3806d990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fea58155910 tx=0x7fea40000fe0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 msgr2=0x7fea581468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea581468f0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fea5002a6c0 tx=0x7fea50001230 comp rx=0 tx=0).stop 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 shutdown_connections 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fea3806b4d0 0x7fea3806d990 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fea581f3050 0x7fea581f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea580b5f90 0x7fea580cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 --2- 172.21.15.5:0/3375634768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea440039e0 0x7fea581468f0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 >> 172.21.15.5:0/3375634768 conn(0x7fea5806b000 msgr2=0x7fea580cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 shutdown_connections 2024-04-25T09:05:15.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:15.955+0000 7fea5d928640 1 -- 172.21.15.5:0/3375634768 wait complete. 2024-04-25T09:05:15.956 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:05:15.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:16.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.077+0000 7f8ceb6ee640 1 Processor -- start 2024-04-25T09:05:16.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.077+0000 7f8ceb6ee640 1 -- start start 2024-04-25T09:05:16.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ceb6ee640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce40ce7f0 0x7f8ce40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ceb6ee640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40cf1c0 con 0x7f8ce415de70 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ceb6ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40d20e0 con 0x7f8ce40b2cc0 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ceb6ee640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce40d2a10 con 0x7f8ce40ce7f0 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ce9c8b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce40ce7f0 0x7f8ce40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ce9c8b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce40ce7f0 0x7f8ce40cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41076/0 (socket says 172.21.15.5:41076) 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ce948a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8ce415de70 0x7f8ce40b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47638/0 (socket says 172.21.15.5:47638) 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/2980667796 learned_addr learned my addr 172.21.15.5:0/2980667796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/2980667796 >> v1:172.21.15.80:6789/0 conn(0x7f8ce40b2cc0 legacy=0x7f8ce40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/2980667796 >> v1:172.21.15.5:6789/0 conn(0x7f8ce415de70 legacy=0x7f8ce40b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8cdbfff640 1 -- 172.21.15.5:0/2980667796 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567452349 0 0) 0x7f8ce40cf1c0 con 0x7f8ce415de70 2024-04-25T09:05:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.078+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/2980667796 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40d23c0 con 0x7f8ce40ce7f0 2024-04-25T09:05:16.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.079+0000 7f8ce9c8b640 1 --2- 172.21.15.5:0/2980667796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40ce7f0 0x7f8ce40cec80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5a88fbc445e4d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.079+0000 7f8cdbfff640 1 -- 172.21.15.5:0/2980667796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc036070 con 0x7f8ce40ce7f0 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.079+0000 7f8cdbfff640 1 -- 172.21.15.5:0/2980667796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc031600 con 0x7f8ce40ce7f0 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.079+0000 7f8cdbfff640 1 -- 172.21.15.5:0/2980667796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0319d0 con 0x7f8ce40ce7f0 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.080+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/2980667796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40ce7f0 msgr2=0x7f8ce40cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.080+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/2980667796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40ce7f0 0x7f8ce40cec80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc02a760 comp rx=0 tx=0).stop 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.080+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/2980667796 shutdown_connections 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.080+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/2980667796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40ce7f0 0x7f8ce40cec80 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.080+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/2980667796 >> 172.21.15.5:0/2980667796 conn(0x7f8ce406b000 msgr2=0x7f8ce406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.080+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/2980667796 shutdown_connections 2024-04-25T09:05:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.080+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/2980667796 wait complete. 2024-04-25T09:05:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.081+0000 7f8ceb6ee640 1 Processor -- start 2024-04-25T09:05:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.081+0000 7f8ceb6ee640 1 -- start start 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ceb6ee640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ce40b2cc0 0x7f8ce40cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ceb6ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce40ce7f0 0x7f8ce41608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ceb6ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415de70 0x7f8ce414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ceb6ee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40d2ea0 con 0x7f8ce415de70 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ceb6ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40b7300 con 0x7f8ce40ce7f0 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ceb6ee640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40d3020 con 0x7f8ce40b2cc0 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415de70 0x7f8ce414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415de70 0x7f8ce414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41090/0 (socket says 172.21.15.5:41090) 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/3810634703 learned_addr learned my addr 172.21.15.5:0/3810634703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce8c89640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce40ce7f0 0x7f8ce41608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce948a640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ce40b2cc0 0x7f8ce40cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ce40b2cc0 msgr2=0x7f8ce40cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ce40b2cc0 0x7f8ce40cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce40ce7f0 msgr2=0x7f8ce41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce40ce7f0 0x7f8ce41608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 -- 172.21.15.5:0/3810634703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40cbe70 con 0x7f8ce415de70 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce948a640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ce40b2cc0 0x7f8ce40cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ce9c8b640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415de70 0x7f8ce414db50 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8cd9ffb640 1 -- 172.21.15.5:0/3810634703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc041070 con 0x7f8ce415de70 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8cd9ffb640 1 -- 172.21.15.5:0/3810634703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc003990 con 0x7f8ce415de70 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce40cc110 con 0x7f8ce415de70 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.082+0000 7f8cd9ffb640 1 -- 172.21.15.5:0/3810634703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc036040 con 0x7f8ce415de70 2024-04-25T09:05:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.083+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce40cc9b0 con 0x7f8ce415de70 2024-04-25T09:05:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.084+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce40cc2e0 con 0x7f8ce415de70 2024-04-25T09:05:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.084+0000 7f8cd9ffb640 1 -- 172.21.15.5:0/3810634703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8cdc007800 con 0x7f8ce415de70 2024-04-25T09:05:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.085+0000 7f8cd9ffb640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cc806b4d0 0x7f8cc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.085+0000 7f8cd9ffb640 1 -- 172.21.15.5:0/3810634703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cdc0aacf0 con 0x7f8ce415de70 2024-04-25T09:05:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.085+0000 7f8ce948a640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cc806b4d0 0x7f8cc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.085+0000 7f8ce948a640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cc806b4d0 0x7f8cc806d990 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0000f60 tx=0x7f8ce0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.089+0000 7f8cd9ffb640 1 -- 172.21.15.5:0/3810634703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8cdc0af070 con 0x7f8ce415de70 2024-04-25T09:05:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.309+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce404ef20 con 0x7f8ce415de70 2024-04-25T09:05:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.310+0000 7f8cd9ffb640 1 -- 172.21.15.5:0/3810634703 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f8cdc04b020 con 0x7f8ce415de70 2024-04-25T09:05:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:16.297 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:16.298 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cc806b4d0 msgr2=0x7f8cc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cc806b4d0 0x7f8cc806d990 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0000f60 tx=0x7f8ce0009040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415de70 msgr2=0x7f8ce414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415de70 0x7f8ce414db50 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc004a40 comp rx=0 tx=0).stop 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 shutdown_connections 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cc806b4d0 0x7f8cc806d990 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415de70 0x7f8ce414db50 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce40ce7f0 0x7f8ce41608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 --2- 172.21.15.5:0/3810634703 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ce40b2cc0 0x7f8ce40cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 >> 172.21.15.5:0/3810634703 conn(0x7f8ce406b000 msgr2=0x7f8ce415b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 shutdown_connections 2024-04-25T09:05:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.312+0000 7f8ceb6ee640 1 -- 172.21.15.5:0/3810634703 wait complete. 2024-04-25T09:05:16.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:16.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.424+0000 7f0caac3f640 1 Processor -- start 2024-04-25T09:05:16.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.424+0000 7f0caac3f640 1 -- start start 2024-04-25T09:05:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.424+0000 7f0caac3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ca4156250 0x7f0ca40b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.424+0000 7f0caac3f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0ca40aeda0 0x7f0ca415d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.424+0000 7f0caac3f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca40b2aa0 con 0x7f0ca406dd20 2024-04-25T09:05:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.424+0000 7f0caac3f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca40b2850 con 0x7f0ca4156250 2024-04-25T09:05:16.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.424+0000 7f0caac3f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca40b2d80 con 0x7f0ca40aeda0 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca89db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ca4156250 0x7f0ca40b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca89db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ca4156250 0x7f0ca40b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41094/0 (socket says 172.21.15.5:41094) 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca89db640 1 -- 172.21.15.5:0/842344088 learned_addr learned my addr 172.21.15.5:0/842344088 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca91dc640 1 --2- 172.21.15.5:0/842344088 >> v2:172.21.15.80:3300/0 conn(0x7f0ca40aeda0 0x7f0ca415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca89db640 1 -- 172.21.15.5:0/842344088 >> v2:172.21.15.80:3300/0 conn(0x7f0ca40aeda0 msgr2=0x7f0ca415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca89db640 1 --2- 172.21.15.5:0/842344088 >> v2:172.21.15.80:3300/0 conn(0x7f0ca40aeda0 0x7f0ca415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca89db640 1 -- 172.21.15.5:0/842344088 >> v1:172.21.15.80:6789/0 conn(0x7f0ca406dd20 legacy=0x7f0ca40ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca89db640 1 -- 172.21.15.5:0/842344088 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40b3060 con 0x7f0ca4156250 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.425+0000 7f0ca91dc640 1 --2- 172.21.15.5:0/842344088 >> v2:172.21.15.80:3300/0 conn(0x7f0ca40aeda0 0x7f0ca415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0ca89db640 1 --2- 172.21.15.5:0/842344088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca4156250 0x7f0ca40b44c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f0ca406d750 tx=0x7f0c9802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98232ef5fb6a6eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0ca37fe640 1 -- 172.21.15.5:0/842344088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98037070 con 0x7f0ca4156250 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0ca37fe640 1 -- 172.21.15.5:0/842344088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98032440 con 0x7f0ca4156250 2024-04-25T09:05:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0ca37fe640 1 -- 172.21.15.5:0/842344088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98032810 con 0x7f0ca4156250 2024-04-25T09:05:16.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 -- 172.21.15.5:0/842344088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca4156250 msgr2=0x7f0ca40b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 --2- 172.21.15.5:0/842344088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca4156250 0x7f0ca40b44c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f0ca406d750 tx=0x7f0c9802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 -- 172.21.15.5:0/842344088 shutdown_connections 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 --2- 172.21.15.5:0/842344088 >> v2:172.21.15.80:3300/0 conn(0x7f0ca40aeda0 0x7f0ca415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 --2- 172.21.15.5:0/842344088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca4156250 0x7f0ca40b44c0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 -- 172.21.15.5:0/842344088 >> 172.21.15.5:0/842344088 conn(0x7f0ca40668f0 msgr2=0x7f0ca4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 -- 172.21.15.5:0/842344088 shutdown_connections 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.426+0000 7f0caac3f640 1 -- 172.21.15.5:0/842344088 wait complete. 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.428+0000 7f0caac3f640 1 Processor -- start 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.428+0000 7f0caac3f640 1 -- start start 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.428+0000 7f0caac3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca40aeda0 0x7f0ca40cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.428+0000 7f0caac3f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ca4156250 0x7f0ca4140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0caac3f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ca4155060 0x7f0ca4152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0caac3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40b4b80 con 0x7f0ca40aeda0 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0caac3f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40b4a00 con 0x7f0ca4156250 2024-04-25T09:05:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0caac3f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40b3860 con 0x7f0ca4155060 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca40aeda0 0x7f0ca40cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca40aeda0 0x7f0ca40cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41108/0 (socket says 172.21.15.5:41108) 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 -- 172.21.15.5:0/3175461512 learned_addr learned my addr 172.21.15.5:0/3175461512 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca91dc640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ca4155060 0x7f0ca4152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca3fff640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ca4156250 0x7f0ca4140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 -- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ca4155060 msgr2=0x7f0ca4152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ca4155060 0x7f0ca4152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 -- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ca4156250 msgr2=0x7f0ca4140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ca4156250 0x7f0ca4140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 -- 172.21.15.5:0/3175461512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4155520 con 0x7f0ca40aeda0 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca3fff640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ca4156250 0x7f0ca4140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca89db640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca40aeda0 0x7f0ca40cf470 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f0c98000c00 tx=0x7f0c980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca17fa640 1 -- 172.21.15.5:0/3175461512 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98037040 con 0x7f0ca40aeda0 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca17fa640 1 -- 172.21.15.5:0/3175461512 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98042070 con 0x7f0ca40aeda0 2024-04-25T09:05:16.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0ca17fa640 1 -- 172.21.15.5:0/3175461512 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98030bb0 con 0x7f0ca40aeda0 2024-04-25T09:05:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca4155800 con 0x7f0ca40aeda0 2024-04-25T09:05:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.429+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca414a7a0 con 0x7f0ca40aeda0 2024-04-25T09:05:16.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.431+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca404ef20 con 0x7f0ca40aeda0 2024-04-25T09:05:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.431+0000 7f0ca17fa640 1 -- 172.21.15.5:0/3175461512 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0c98047460 con 0x7f0ca40aeda0 2024-04-25T09:05:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.431+0000 7f0ca17fa640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0c8806b4d0 0x7f0c8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.432+0000 7f0ca17fa640 1 -- 172.21.15.5:0/3175461512 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c980aad40 con 0x7f0ca40aeda0 2024-04-25T09:05:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.432+0000 7f0ca3fff640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0c8806b4d0 0x7f0c8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.432+0000 7f0ca3fff640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0c8806b4d0 0x7f0c8806d990 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0ca414ae60 tx=0x7f0c90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.436+0000 7f0ca17fa640 1 -- 172.21.15.5:0/3175461512 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c98079c50 con 0x7f0ca40aeda0 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.618+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca4066cd0 con 0x7f0ca40aeda0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.619+0000 7f0ca17fa640 1 -- 172.21.15.5:0/3175461512 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16595 (secure 0 0 0) 0x7f0c98079550 con 0x7f0ca40aeda0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:14.930532+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:11.572493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:12.274797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0c8806b4d0 msgr2=0x7f0c8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0c8806b4d0 0x7f0c8806d990 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0ca414ae60 tx=0x7f0c90009040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca40aeda0 msgr2=0x7f0ca40cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca40aeda0 0x7f0ca40cf470 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f0c98000c00 tx=0x7f0c980046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 shutdown_connections 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0c8806b4d0 0x7f0c8806d990 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ca4155060 0x7f0ca4152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ca4156250 0x7f0ca4140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 --2- 172.21.15.5:0/3175461512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ca40aeda0 0x7f0ca40cf470 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.621+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 >> 172.21.15.5:0/3175461512 conn(0x7f0ca40668f0 msgr2=0x7f0ca40b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.622+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 shutdown_connections 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.622+0000 7f0caac3f640 1 -- 172.21.15.5:0/3175461512 wait complete. 2024-04-25T09:05:16.620 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:05:16.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:16.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.734+0000 7fa6e62bc640 1 Processor -- start 2024-04-25T09:05:16.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.734+0000 7fa6e62bc640 1 -- start start 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6e62bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6e00b2cc0 0x7fa6e00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6e62bc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6e00b7130 0x7fa6e00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6e62bc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00d20e0 con 0x7fa6e015de70 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6e62bc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e00d2a10 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6e62bc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e00d23c0 con 0x7fa6e00b7130 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6df7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6e00b2cc0 0x7fa6e00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6df7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6e00b2cc0 0x7fa6e00b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41114/0 (socket says 172.21.15.5:41114) 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6df7fe640 1 -- 172.21.15.5:0/473810178 learned_addr learned my addr 172.21.15.5:0/473810178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6e4859640 1 --2- 172.21.15.5:0/473810178 >> v2:172.21.15.80:3300/0 conn(0x7fa6e00b7130 0x7fa6e00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6df7fe640 1 -- 172.21.15.5:0/473810178 >> v2:172.21.15.80:3300/0 conn(0x7fa6e00b7130 msgr2=0x7fa6e00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6df7fe640 1 --2- 172.21.15.5:0/473810178 >> v2:172.21.15.80:3300/0 conn(0x7fa6e00b7130 0x7fa6e00ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6df7fe640 1 -- 172.21.15.5:0/473810178 >> v1:172.21.15.80:6789/0 conn(0x7fa6e015de70 legacy=0x7fa6e00b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6df7fe640 1 -- 172.21.15.5:0/473810178 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00d26a0 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.735+0000 7fa6e4859640 1 --2- 172.21.15.5:0/473810178 >> v2:172.21.15.80:3300/0 conn(0x7fa6e00b7130 0x7fa6e00ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.736+0000 7fa6df7fe640 1 --2- 172.21.15.5:0/473810178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00b6bf0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009870 tx=0x7fa6d002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7e531e0b0db6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.736+0000 7fa6deffd640 1 -- 172.21.15.5:0/473810178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0037070 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.736+0000 7fa6deffd640 1 -- 172.21.15.5:0/473810178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0032440 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.736+0000 7fa6deffd640 1 -- 172.21.15.5:0/473810178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0032810 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 -- 172.21.15.5:0/473810178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 msgr2=0x7fa6e00b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/473810178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00b6bf0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009870 tx=0x7fa6d002a2a0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 -- 172.21.15.5:0/473810178 shutdown_connections 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/473810178 >> v2:172.21.15.80:3300/0 conn(0x7fa6e00b7130 0x7fa6e00ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/473810178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00b6bf0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 -- 172.21.15.5:0/473810178 >> 172.21.15.5:0/473810178 conn(0x7fa6e006b000 msgr2=0x7fa6e006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 -- 172.21.15.5:0/473810178 shutdown_connections 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.737+0000 7fa6e62bc640 1 -- 172.21.15.5:0/473810178 wait complete. 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.738+0000 7fa6e62bc640 1 Processor -- start 2024-04-25T09:05:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.738+0000 7fa6e62bc640 1 -- start start 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6e62bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6e62bc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6e00b7130 0x7fa6e00c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6e62bc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa6e015de70 0x7fa6e00c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6e62bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00cf0c0 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6e62bc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00cef40 con 0x7fa6e00b7130 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6e62bc640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00c7ff0 con 0x7fa6e015de70 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41118/0 (socket says 172.21.15.5:41118) 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 -- 172.21.15.5:0/3545329779 learned_addr learned my addr 172.21.15.5:0/3545329779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6e4859640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa6e015de70 0x7fa6e00c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6df7fe640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6e00b7130 0x7fa6e00c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 -- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa6e015de70 msgr2=0x7fa6e00c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa6e015de70 0x7fa6e00c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 -- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6e00b7130 msgr2=0x7fa6e00c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6e00b7130 0x7fa6e00c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.739+0000 7fa6dffff640 1 -- 172.21.15.5:0/3545329779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00c82d0 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.740+0000 7fa6df7fe640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6e00b7130 0x7fa6e00c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.740+0000 7fa6dffff640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00c9090 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c3c0 tx=0x7fa6c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.740+0000 7fa6dcff9640 1 -- 172.21.15.5:0/3545329779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80052d0 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.740+0000 7fa6dcff9640 1 -- 172.21.15.5:0/3545329779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8005490 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.740+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e00c85b0 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.740+0000 7fa6dcff9640 1 -- 172.21.15.5:0/3545329779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8007260 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.740+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e00c8b70 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.741+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e004ef20 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.741+0000 7fa6dcff9640 1 -- 172.21.15.5:0/3545329779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa6c8007400 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.742+0000 7fa6dcff9640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa6c006b4d0 0x7fa6c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.742+0000 7fa6dcff9640 1 -- 172.21.15.5:0/3545329779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6c80896d0 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.742+0000 7fa6df7fe640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa6c006b4d0 0x7fa6c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.742+0000 7fa6df7fe640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa6c006b4d0 0x7fa6c006d990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0034000 tx=0x7fa6d002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.746+0000 7fa6dcff9640 1 -- 172.21.15.5:0/3545329779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa6c8058550 con 0x7fa6e00b2cc0 2024-04-25T09:05:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.921+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6e00c8db0 con 0x7fa6c006b4d0 2024-04-25T09:05:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.927+0000 7fa6dcff9640 1 -- 172.21.15.5:0/3545329779 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252482 (secure 0 0 0) 0x7fa6d0032770 con 0x7fa6c006b4d0 2024-04-25T09:05:16.918 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:16.920 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa6c006b4d0 msgr2=0x7fa6c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa6c006b4d0 0x7fa6c006d990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0034000 tx=0x7fa6d002e000 comp rx=0 tx=0).stop 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 msgr2=0x7fa6e00c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00c9090 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c3c0 tx=0x7fa6c800c880 comp rx=0 tx=0).stop 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 shutdown_connections 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa6c006b4d0 0x7fa6c006d990 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa6e015de70 0x7fa6e00c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6e00b7130 0x7fa6e00c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 --2- 172.21.15.5:0/3545329779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6e00b2cc0 0x7fa6e00c9090 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.930+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 >> 172.21.15.5:0/3545329779 conn(0x7fa6e006b000 msgr2=0x7fa6e015e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.931+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 shutdown_connections 2024-04-25T09:05:16.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:16.931+0000 7fa6e62bc640 1 -- 172.21.15.5:0/3545329779 wait complete. 2024-04-25T09:05:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2024-04-25T09:05:16.503636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397528,"kb_used_data":13404,"kb_used_omap":12,"kb_used_meta":383987,"kb_avail":754577192,"statfs":{"total":773094113280,"available":772687044608,"internally_reserved":0,"allocated":13725696,"data_stored":6609328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":393203249},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.578456"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933680+0000","last_change":"2024-04-25T09:05:13.945563+0000","last_active":"2024-04-25T09:05:14.933680+0000","last_peered":"2024-04-25T09:05:14.933680+0000","last_clean":"2024-04-25T09:05:14.933680+0000","last_became_active":"2024-04-25T09:05:13.945277+0000","last_became_peered":"2024-04-25T09:05:13.945277+0000","last_unstale":"2024-04-25T09:05:14.933680+0000","last_undegraded":"2024-04-25T09:05:14.933680+0000","last_fullsized":"2024-04-25T09:05:14.933680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:40.893080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986729+0000","last_change":"2024-04-25T09:05:13.946559+0000","last_active":"2024-04-25T09:05:15.986729+0000","last_peered":"2024-04-25T09:05:15.986729+0000","last_clean":"2024-04-25T09:05:15.986729+0000","last_became_active":"2024-04-25T09:05:13.946293+0000","last_became_peered":"2024-04-25T09:05:13.946293+0000","last_unstale":"2024-04-25T09:05:15.986729+0000","last_undegraded":"2024-04-25T09:05:15.986729+0000","last_fullsized":"2024-04-25T09:05:15.986729+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:06.274809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052615+0000","last_change":"2024-04-25T09:05:13.952318+0000","last_active":"2024-04-25T09:05:15.052615+0000","last_peered":"2024-04-25T09:05:15.052615+0000","last_clean":"2024-04-25T09:05:15.052615+0000","last_became_active":"2024-04-25T09:05:13.951817+0000","last_became_peered":"2024-04-25T09:05:13.951817+0000","last_unstale":"2024-04-25T09:05:15.052615+0000","last_undegraded":"2024-04-25T09:05:15.052615+0000","last_fullsized":"2024-04-25T09:05:15.052615+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:37.556392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933394+0000","last_change":"2024-04-25T09:05:13.937984+0000","last_active":"2024-04-25T09:05:14.933394+0000","last_peered":"2024-04-25T09:05:14.933394+0000","last_clean":"2024-04-25T09:05:14.933394+0000","last_became_active":"2024-04-25T09:05:13.937658+0000","last_became_peered":"2024-04-25T09:05:13.937658+0000","last_unstale":"2024-04-25T09:05:14.933394+0000","last_undegraded":"2024-04-25T09:05:14.933394+0000","last_fullsized":"2024-04-25T09:05:14.933394+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:38.203237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346922+0000","last_change":"2024-04-25T09:05:13.945297+0000","last_active":"2024-04-25T09:05:15.346922+0000","last_peered":"2024-04-25T09:05:15.346922+0000","last_clean":"2024-04-25T09:05:15.346922+0000","last_became_active":"2024-04-25T09:05:13.943909+0000","last_became_peered":"2024-04-25T09:05:13.943909+0000","last_unstale":"2024-04-25T09:05:15.346922+0000","last_undegraded":"2024-04-25T09:05:15.346922+0000","last_fullsized":"2024-04-25T09:05:15.346922+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:00.412262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934199+0000","last_change":"2024-04-25T09:05:13.941652+0000","last_active":"2024-04-25T09:05:14.934199+0000","last_peered":"2024-04-25T09:05:14.934199+0000","last_clean":"2024-04-25T09:05:14.934199+0000","last_became_active":"2024-04-25T09:05:13.941368+0000","last_became_peered":"2024-04-25T09:05:13.941368+0000","last_unstale":"2024-04-25T09:05:14.934199+0000","last_undegraded":"2024-04-25T09:05:14.934199+0000","last_fullsized":"2024-04-25T09:05:14.934199+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:37.556392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933941+0000","last_change":"2024-04-25T09:05:13.953264+0000","last_active":"2024-04-25T09:05:14.933941+0000","last_peered":"2024-04-25T09:05:14.933941+0000","last_clean":"2024-04-25T09:05:14.933941+0000","last_became_active":"2024-04-25T09:05:13.952966+0000","last_became_peered":"2024-04-25T09:05:13.952966+0000","last_unstale":"2024-04-25T09:05:14.933941+0000","last_undegraded":"2024-04-25T09:05:14.933941+0000","last_fullsized":"2024-04-25T09:05:14.933941+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:02.302447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052463+0000","last_change":"2024-04-25T09:05:13.956163+0000","last_active":"2024-04-25T09:05:15.052463+0000","last_peered":"2024-04-25T09:05:15.052463+0000","last_clean":"2024-04-25T09:05:15.052463+0000","last_became_active":"2024-04-25T09:05:13.954251+0000","last_became_peered":"2024-04-25T09:05:13.954251+0000","last_unstale":"2024-04-25T09:05:15.052463+0000","last_undegraded":"2024-04-25T09:05:15.052463+0000","last_fullsized":"2024-04-25T09:05:15.052463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:57.308475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052840+0000","last_change":"2024-04-25T09:05:13.952289+0000","last_active":"2024-04-25T09:05:15.052840+0000","last_peered":"2024-04-25T09:05:15.052840+0000","last_clean":"2024-04-25T09:05:15.052840+0000","last_became_active":"2024-04-25T09:05:13.952015+0000","last_became_peered":"2024-04-25T09:05:13.952015+0000","last_unstale":"2024-04-25T09:05:15.052840+0000","last_undegraded":"2024-04-25T09:05:15.052840+0000","last_fullsized":"2024-04-25T09:05:15.052840+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:43.945176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986835+0000","last_change":"2024-04-25T09:05:13.943432+0000","last_active":"2024-04-25T09:05:15.986835+0000","last_peered":"2024-04-25T09:05:15.986835+0000","last_clean":"2024-04-25T09:05:15.986835+0000","last_became_active":"2024-04-25T09:05:13.943136+0000","last_became_peered":"2024-04-25T09:05:13.943136+0000","last_unstale":"2024-04-25T09:05:15.986835+0000","last_undegraded":"2024-04-25T09:05:15.986835+0000","last_fullsized":"2024-04-25T09:05:15.986835+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:27.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985951+0000","last_change":"2024-04-25T09:05:13.951574+0000","last_active":"2024-04-25T09:05:15.985951+0000","last_peered":"2024-04-25T09:05:15.985951+0000","last_clean":"2024-04-25T09:05:15.985951+0000","last_became_active":"2024-04-25T09:05:13.951307+0000","last_became_peered":"2024-04-25T09:05:13.951307+0000","last_unstale":"2024-04-25T09:05:15.985951+0000","last_undegraded":"2024-04-25T09:05:15.985951+0000","last_fullsized":"2024-04-25T09:05:15.985951+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:08.578032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052507+0000","last_change":"2024-04-25T09:05:13.948487+0000","last_active":"2024-04-25T09:05:15.052507+0000","last_peered":"2024-04-25T09:05:15.052507+0000","last_clean":"2024-04-25T09:05:15.052507+0000","last_became_active":"2024-04-25T09:05:13.947565+0000","last_became_peered":"2024-04-25T09:05:13.947565+0000","last_unstale":"2024-04-25T09:05:15.052507+0000","last_undegraded":"2024-04-25T09:05:15.052507+0000","last_fullsized":"2024-04-25T09:05:15.052507+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:57.491740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933554+0000","last_change":"2024-04-25T09:05:13.946162+0000","last_active":"2024-04-25T09:05:14.933554+0000","last_peered":"2024-04-25T09:05:14.933554+0000","last_clean":"2024-04-25T09:05:14.933554+0000","last_became_active":"2024-04-25T09:05:13.945899+0000","last_became_peered":"2024-04-25T09:05:13.945899+0000","last_unstale":"2024-04-25T09:05:14.933554+0000","last_undegraded":"2024-04-25T09:05:14.933554+0000","last_fullsized":"2024-04-25T09:05:14.933554+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:19.312127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986156+0000","last_change":"2024-04-25T09:05:13.949151+0000","last_active":"2024-04-25T09:05:15.986156+0000","last_peered":"2024-04-25T09:05:15.986156+0000","last_clean":"2024-04-25T09:05:15.986156+0000","last_became_active":"2024-04-25T09:05:13.948867+0000","last_became_peered":"2024-04-25T09:05:13.948867+0000","last_unstale":"2024-04-25T09:05:15.986156+0000","last_undegraded":"2024-04-25T09:05:15.986156+0000","last_fullsized":"2024-04-25T09:05:15.986156+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:40.893080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933198+0000","last_change":"2024-04-25T09:05:13.953687+0000","last_active":"2024-04-25T09:05:14.933198+0000","last_peered":"2024-04-25T09:05:14.933198+0000","last_clean":"2024-04-25T09:05:14.933198+0000","last_became_active":"2024-04-25T09:05:13.953381+0000","last_became_peered":"2024-04-25T09:05:13.953381+0000","last_unstale":"2024-04-25T09:05:14.933198+0000","last_undegraded":"2024-04-25T09:05:14.933198+0000","last_fullsized":"2024-04-25T09:05:14.933198+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.364900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708585+0000","last_change":"2024-04-25T09:05:13.953727+0000","last_active":"2024-04-25T09:05:15.708585+0000","last_peered":"2024-04-25T09:05:15.708585+0000","last_clean":"2024-04-25T09:05:15.708585+0000","last_became_active":"2024-04-25T09:05:13.953432+0000","last_became_peered":"2024-04-25T09:05:13.953432+0000","last_unstale":"2024-04-25T09:05:15.708585+0000","last_undegraded":"2024-04-25T09:05:15.708585+0000","last_fullsized":"2024-04-25T09:05:15.708585+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:50.726798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934685+0000","last_change":"2024-04-25T09:05:13.950199+0000","last_active":"2024-04-25T09:05:14.934685+0000","last_peered":"2024-04-25T09:05:14.934685+0000","last_clean":"2024-04-25T09:05:14.934685+0000","last_became_active":"2024-04-25T09:05:13.949908+0000","last_became_peered":"2024-04-25T09:05:13.949908+0000","last_unstale":"2024-04-25T09:05:14.934685+0000","last_undegraded":"2024-04-25T09:05:14.934685+0000","last_fullsized":"2024-04-25T09:05:14.934685+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:59.127240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708829+0000","last_change":"2024-04-25T09:05:13.955301+0000","last_active":"2024-04-25T09:05:15.708829+0000","last_peered":"2024-04-25T09:05:15.708829+0000","last_clean":"2024-04-25T09:05:15.708829+0000","last_became_active":"2024-04-25T09:05:13.954671+0000","last_became_peered":"2024-04-25T09:05:13.954671+0000","last_unstale":"2024-04-25T09:05:15.708829+0000","last_undegraded":"2024-04-25T09:05:15.708829+0000","last_fullsized":"2024-04-25T09:05:15.708829+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:38.420341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986104+0000","last_change":"2024-04-25T09:05:13.946561+0000","last_active":"2024-04-25T09:05:15.986104+0000","last_peered":"2024-04-25T09:05:15.986104+0000","last_clean":"2024-04-25T09:05:15.986104+0000","last_became_active":"2024-04-25T09:05:13.946246+0000","last_became_peered":"2024-04-25T09:05:13.946246+0000","last_unstale":"2024-04-25T09:05:15.986104+0000","last_undegraded":"2024-04-25T09:05:15.986104+0000","last_fullsized":"2024-04-25T09:05:15.986104+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:35.779212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708811+0000","last_change":"2024-04-25T09:05:13.952953+0000","last_active":"2024-04-25T09:05:15.708811+0000","last_peered":"2024-04-25T09:05:15.708811+0000","last_clean":"2024-04-25T09:05:15.708811+0000","last_became_active":"2024-04-25T09:05:13.952610+0000","last_became_peered":"2024-04-25T09:05:13.952610+0000","last_unstale":"2024-04-25T09:05:15.708811+0000","last_undegraded":"2024-04-25T09:05:15.708811+0000","last_fullsized":"2024-04-25T09:05:15.708811+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:05.767806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346738+0000","last_change":"2024-04-25T09:05:13.944435+0000","last_active":"2024-04-25T09:05:15.346738+0000","last_peered":"2024-04-25T09:05:15.346738+0000","last_clean":"2024-04-25T09:05:15.346738+0000","last_became_active":"2024-04-25T09:05:13.942353+0000","last_became_peered":"2024-04-25T09:05:13.942353+0000","last_unstale":"2024-04-25T09:05:15.346738+0000","last_undegraded":"2024-04-25T09:05:15.346738+0000","last_fullsized":"2024-04-25T09:05:15.346738+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:26.239262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986074+0000","last_change":"2024-04-25T09:05:13.949012+0000","last_active":"2024-04-25T09:05:15.986074+0000","last_peered":"2024-04-25T09:05:15.986074+0000","last_clean":"2024-04-25T09:05:15.986074+0000","last_became_active":"2024-04-25T09:05:13.948742+0000","last_became_peered":"2024-04-25T09:05:13.948742+0000","last_unstale":"2024-04-25T09:05:15.986074+0000","last_undegraded":"2024-04-25T09:05:15.986074+0000","last_fullsized":"2024-04-25T09:05:15.986074+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:39.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052596+0000","last_change":"2024-04-25T09:05:13.950817+0000","last_active":"2024-04-25T09:05:15.052596+0000","last_peered":"2024-04-25T09:05:15.052596+0000","last_clean":"2024-04-25T09:05:15.052596+0000","last_became_active":"2024-04-25T09:05:13.949832+0000","last_became_peered":"2024-04-25T09:05:13.949832+0000","last_unstale":"2024-04-25T09:05:15.052596+0000","last_undegraded":"2024-04-25T09:05:15.052596+0000","last_fullsized":"2024-04-25T09:05:15.052596+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:02.302447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986446+0000","last_change":"2024-04-25T09:05:13.950901+0000","last_active":"2024-04-25T09:05:15.986446+0000","last_peered":"2024-04-25T09:05:15.986446+0000","last_clean":"2024-04-25T09:05:15.986446+0000","last_became_active":"2024-04-25T09:05:13.950232+0000","last_became_peered":"2024-04-25T09:05:13.950232+0000","last_unstale":"2024-04-25T09:05:15.986446+0000","last_undegraded":"2024-04-25T09:05:15.986446+0000","last_fullsized":"2024-04-25T09:05:15.986446+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:26.239262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986546+0000","last_change":"2024-04-25T09:05:13.943398+0000","last_active":"2024-04-25T09:05:15.986546+0000","last_peered":"2024-04-25T09:05:15.986546+0000","last_clean":"2024-04-25T09:05:15.986546+0000","last_became_active":"2024-04-25T09:05:13.943076+0000","last_became_peered":"2024-04-25T09:05:13.943076+0000","last_unstale":"2024-04-25T09:05:15.986546+0000","last_undegraded":"2024-04-25T09:05:15.986546+0000","last_fullsized":"2024-04-25T09:05:15.986546+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:21.559683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708882+0000","last_change":"2024-04-25T09:05:13.954983+0000","last_active":"2024-04-25T09:05:15.708882+0000","last_peered":"2024-04-25T09:05:15.708882+0000","last_clean":"2024-04-25T09:05:15.708882+0000","last_became_active":"2024-04-25T09:05:13.954410+0000","last_became_peered":"2024-04-25T09:05:13.954410+0000","last_unstale":"2024-04-25T09:05:15.708882+0000","last_undegraded":"2024-04-25T09:05:15.708882+0000","last_fullsized":"2024-04-25T09:05:15.708882+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:22.358320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933383+0000","last_change":"2024-04-25T09:05:13.944561+0000","last_active":"2024-04-25T09:05:14.933383+0000","last_peered":"2024-04-25T09:05:14.933383+0000","last_clean":"2024-04-25T09:05:14.933383+0000","last_became_active":"2024-04-25T09:05:13.944272+0000","last_became_peered":"2024-04-25T09:05:13.944272+0000","last_unstale":"2024-04-25T09:05:14.933383+0000","last_undegraded":"2024-04-25T09:05:14.933383+0000","last_fullsized":"2024-04-25T09:05:14.933383+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:52.987995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934818+0000","last_change":"2024-04-25T09:05:13.954883+0000","last_active":"2024-04-25T09:05:14.934818+0000","last_peered":"2024-04-25T09:05:14.934818+0000","last_clean":"2024-04-25T09:05:14.934818+0000","last_became_active":"2024-04-25T09:05:13.954608+0000","last_became_peered":"2024-04-25T09:05:13.954608+0000","last_unstale":"2024-04-25T09:05:14.934818+0000","last_undegraded":"2024-04-25T09:05:14.934818+0000","last_fullsized":"2024-04-25T09:05:14.934818+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:02.383939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933744+0000","last_change":"2024-04-25T09:05:13.952280+0000","last_active":"2024-04-25T09:05:14.933744+0000","last_peered":"2024-04-25T09:05:14.933744+0000","last_clean":"2024-04-25T09:05:14.933744+0000","last_became_active":"2024-04-25T09:05:13.951985+0000","last_became_peered":"2024-04-25T09:05:13.951985+0000","last_unstale":"2024-04-25T09:05:14.933744+0000","last_undegraded":"2024-04-25T09:05:14.933744+0000","last_fullsized":"2024-04-25T09:05:14.933744+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:55.356511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933537+0000","last_change":"2024-04-25T09:05:13.954111+0000","last_active":"2024-04-25T09:05:14.933537+0000","last_peered":"2024-04-25T09:05:14.933537+0000","last_clean":"2024-04-25T09:05:14.933537+0000","last_became_active":"2024-04-25T09:05:13.953841+0000","last_became_peered":"2024-04-25T09:05:13.953841+0000","last_unstale":"2024-04-25T09:05:14.933537+0000","last_undegraded":"2024-04-25T09:05:14.933537+0000","last_fullsized":"2024-04-25T09:05:14.933537+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:41.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346609+0000","last_change":"2024-04-25T09:05:13.939619+0000","last_active":"2024-04-25T09:05:15.346609+0000","last_peered":"2024-04-25T09:05:15.346609+0000","last_clean":"2024-04-25T09:05:15.346609+0000","last_became_active":"2024-04-25T09:05:13.938918+0000","last_became_peered":"2024-04-25T09:05:13.938918+0000","last_unstale":"2024-04-25T09:05:15.346609+0000","last_undegraded":"2024-04-25T09:05:15.346609+0000","last_fullsized":"2024-04-25T09:05:15.346609+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:35.779212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933939+0000","last_change":"2024-04-25T09:05:13.953940+0000","last_active":"2024-04-25T09:05:14.933939+0000","last_peered":"2024-04-25T09:05:14.933939+0000","last_clean":"2024-04-25T09:05:14.933939+0000","last_became_active":"2024-04-25T09:05:13.953683+0000","last_became_peered":"2024-04-25T09:05:13.953683+0000","last_unstale":"2024-04-25T09:05:14.933939+0000","last_undegraded":"2024-04-25T09:05:14.933939+0000","last_fullsized":"2024-04-25T09:05:14.933939+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:30.584572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.709007+0000","last_change":"2024-04-25T09:05:13.954703+0000","last_active":"2024-04-25T09:05:15.709007+0000","last_peered":"2024-04-25T09:05:15.709007+0000","last_clean":"2024-04-25T09:05:15.709007+0000","last_became_active":"2024-04-25T09:05:13.954063+0000","last_became_peered":"2024-04-25T09:05:13.954063+0000","last_unstale":"2024-04-25T09:05:15.709007+0000","last_undegraded":"2024-04-25T09:05:15.709007+0000","last_fullsized":"2024-04-25T09:05:15.709007+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:51.210835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"124'4","reported_seq":18,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346922+0000","last_change":"2024-04-25T09:05:12.948723+0000","last_active":"2024-04-25T09:05:15.346922+0000","last_peered":"2024-04-25T09:05:15.346922+0000","last_clean":"2024-04-25T09:05:15.346922+0000","last_became_active":"2024-04-25T09:05:12.948452+0000","last_became_peered":"2024-04-25T09:05:12.948452+0000","last_unstale":"2024-04-25T09:05:15.346922+0000","last_undegraded":"2024-04-25T09:05:15.346922+0000","last_fullsized":"2024-04-25T09:05:15.346922+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:05.824728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052840+0000","last_change":"2024-04-25T09:05:13.950877+0000","last_active":"2024-04-25T09:05:15.052840+0000","last_peered":"2024-04-25T09:05:15.052840+0000","last_clean":"2024-04-25T09:05:15.052840+0000","last_became_active":"2024-04-25T09:05:13.948813+0000","last_became_peered":"2024-04-25T09:05:13.948813+0000","last_unstale":"2024-04-25T09:05:15.052840+0000","last_undegraded":"2024-04-25T09:05:15.052840+0000","last_fullsized":"2024-04-25T09:05:15.052840+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:35.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935061+0000","last_change":"2024-04-25T09:05:12.947409+0000","last_active":"2024-04-25T09:05:14.935061+0000","last_peered":"2024-04-25T09:05:14.935061+0000","last_clean":"2024-04-25T09:05:14.935061+0000","last_became_active":"2024-04-25T09:05:12.947163+0000","last_became_peered":"2024-04-25T09:05:12.947163+0000","last_unstale":"2024-04-25T09:05:14.935061+0000","last_undegraded":"2024-04-25T09:05:14.935061+0000","last_fullsized":"2024-04-25T09:05:14.935061+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:38.074852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.347032+0000","last_change":"2024-04-25T09:05:13.943698+0000","last_active":"2024-04-25T09:05:15.347032+0000","last_peered":"2024-04-25T09:05:15.347032+0000","last_clean":"2024-04-25T09:05:15.347032+0000","last_became_active":"2024-04-25T09:05:13.943418+0000","last_became_peered":"2024-04-25T09:05:13.943418+0000","last_unstale":"2024-04-25T09:05:15.347032+0000","last_undegraded":"2024-04-25T09:05:15.347032+0000","last_fullsized":"2024-04-25T09:05:15.347032+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:47.226819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986211+0000","last_change":"2024-04-25T09:05:12.945846+0000","last_active":"2024-04-25T09:05:15.986211+0000","last_peered":"2024-04-25T09:05:15.986211+0000","last_clean":"2024-04-25T09:05:15.986211+0000","last_became_active":"2024-04-25T09:05:12.945567+0000","last_became_peered":"2024-04-25T09:05:12.945567+0000","last_unstale":"2024-04-25T09:05:15.986211+0000","last_undegraded":"2024-04-25T09:05:15.986211+0000","last_fullsized":"2024-04-25T09:05:15.986211+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:49.721840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346869+0000","last_change":"2024-04-25T09:05:13.942892+0000","last_active":"2024-04-25T09:05:15.346869+0000","last_peered":"2024-04-25T09:05:15.346869+0000","last_clean":"2024-04-25T09:05:15.346869+0000","last_became_active":"2024-04-25T09:05:13.942633+0000","last_became_peered":"2024-04-25T09:05:13.942633+0000","last_unstale":"2024-04-25T09:05:15.346869+0000","last_undegraded":"2024-04-25T09:05:15.346869+0000","last_fullsized":"2024-04-25T09:05:15.346869+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:28.992638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986481+0000","last_change":"2024-04-25T09:05:12.949931+0000","last_active":"2024-04-25T09:05:15.986481+0000","last_peered":"2024-04-25T09:05:15.986481+0000","last_clean":"2024-04-25T09:05:15.986481+0000","last_became_active":"2024-04-25T09:05:12.949637+0000","last_became_peered":"2024-04-25T09:05:12.949637+0000","last_unstale":"2024-04-25T09:05:15.986481+0000","last_undegraded":"2024-04-25T09:05:15.986481+0000","last_fullsized":"2024-04-25T09:05:15.986481+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:03.502584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708710+0000","last_change":"2024-04-25T09:05:13.955207+0000","last_active":"2024-04-25T09:05:15.708710+0000","last_peered":"2024-04-25T09:05:15.708710+0000","last_clean":"2024-04-25T09:05:15.708710+0000","last_became_active":"2024-04-25T09:05:13.954887+0000","last_became_peered":"2024-04-25T09:05:13.954887+0000","last_unstale":"2024-04-25T09:05:15.708710+0000","last_undegraded":"2024-04-25T09:05:15.708710+0000","last_fullsized":"2024-04-25T09:05:15.708710+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:42.620148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986912+0000","last_change":"2024-04-25T09:05:12.940545+0000","last_active":"2024-04-25T09:05:15.986912+0000","last_peered":"2024-04-25T09:05:15.986912+0000","last_clean":"2024-04-25T09:05:15.986912+0000","last_became_active":"2024-04-25T09:05:12.940215+0000","last_became_peered":"2024-04-25T09:05:12.940215+0000","last_unstale":"2024-04-25T09:05:15.986912+0000","last_undegraded":"2024-04-25T09:05:15.986912+0000","last_fullsized":"2024-04-25T09:05:15.986912+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:42.973136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934456+0000","last_change":"2024-04-25T09:05:13.944968+0000","last_active":"2024-04-25T09:05:14.934456+0000","last_peered":"2024-04-25T09:05:14.934456+0000","last_clean":"2024-04-25T09:05:14.934456+0000","last_became_active":"2024-04-25T09:05:13.944695+0000","last_became_peered":"2024-04-25T09:05:13.944695+0000","last_unstale":"2024-04-25T09:05:14.934456+0000","last_undegraded":"2024-04-25T09:05:14.934456+0000","last_fullsized":"2024-04-25T09:05:14.934456+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:43.945176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708573+0000","last_change":"2024-04-25T09:05:12.949159+0000","last_active":"2024-04-25T09:05:15.708573+0000","last_peered":"2024-04-25T09:05:15.708573+0000","last_clean":"2024-04-25T09:05:15.708573+0000","last_became_active":"2024-04-25T09:05:12.948748+0000","last_became_peered":"2024-04-25T09:05:12.948748+0000","last_unstale":"2024-04-25T09:05:15.708573+0000","last_undegraded":"2024-04-25T09:05:15.708573+0000","last_fullsized":"2024-04-25T09:05:15.708573+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:25.373366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052649+0000","last_change":"2024-04-25T09:05:13.956593+0000","last_active":"2024-04-25T09:05:15.052649+0000","last_peered":"2024-04-25T09:05:15.052649+0000","last_clean":"2024-04-25T09:05:15.052649+0000","last_became_active":"2024-04-25T09:05:13.955699+0000","last_became_peered":"2024-04-25T09:05:13.955699+0000","last_unstale":"2024-04-25T09:05:15.052649+0000","last_undegraded":"2024-04-25T09:05:15.052649+0000","last_fullsized":"2024-04-25T09:05:15.052649+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:55.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934492+0000","last_change":"2024-04-25T09:05:12.942928+0000","last_active":"2024-04-25T09:05:14.934492+0000","last_peered":"2024-04-25T09:05:14.934492+0000","last_clean":"2024-04-25T09:05:14.934492+0000","last_became_active":"2024-04-25T09:05:12.942615+0000","last_became_peered":"2024-04-25T09:05:12.942615+0000","last_unstale":"2024-04-25T09:05:14.934492+0000","last_undegraded":"2024-04-25T09:05:14.934492+0000","last_fullsized":"2024-04-25T09:05:14.934492+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:52.830885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986482+0000","last_change":"2024-04-25T09:05:13.956048+0000","last_active":"2024-04-25T09:05:15.986482+0000","last_peered":"2024-04-25T09:05:15.986482+0000","last_clean":"2024-04-25T09:05:15.986482+0000","last_became_active":"2024-04-25T09:05:13.955628+0000","last_became_peered":"2024-04-25T09:05:13.955628+0000","last_unstale":"2024-04-25T09:05:15.986482+0000","last_undegraded":"2024-04-25T09:05:15.986482+0000","last_fullsized":"2024-04-25T09:05:15.986482+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:58.398021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985846+0000","last_change":"2024-04-25T09:05:12.945505+0000","last_active":"2024-04-25T09:05:15.985846+0000","last_peered":"2024-04-25T09:05:15.985846+0000","last_clean":"2024-04-25T09:05:15.985846+0000","last_became_active":"2024-04-25T09:05:12.945215+0000","last_became_peered":"2024-04-25T09:05:12.945215+0000","last_unstale":"2024-04-25T09:05:15.985846+0000","last_undegraded":"2024-04-25T09:05:15.985846+0000","last_fullsized":"2024-04-25T09:05:15.985846+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:14.335976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933625+0000","last_change":"2024-04-25T09:05:13.948442+0000","last_active":"2024-04-25T09:05:14.933625+0000","last_peered":"2024-04-25T09:05:14.933625+0000","last_clean":"2024-04-25T09:05:14.933625+0000","last_became_active":"2024-04-25T09:05:13.947754+0000","last_became_peered":"2024-04-25T09:05:13.947754+0000","last_unstale":"2024-04-25T09:05:14.933625+0000","last_undegraded":"2024-04-25T09:05:14.933625+0000","last_fullsized":"2024-04-25T09:05:14.933625+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:52.169113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935564+0000","last_change":"2024-04-25T09:05:12.945461+0000","last_active":"2024-04-25T09:05:14.935564+0000","last_peered":"2024-04-25T09:05:14.935564+0000","last_clean":"2024-04-25T09:05:14.935564+0000","last_became_active":"2024-04-25T09:05:12.945082+0000","last_became_peered":"2024-04-25T09:05:12.945082+0000","last_unstale":"2024-04-25T09:05:14.935564+0000","last_undegraded":"2024-04-25T09:05:14.935564+0000","last_fullsized":"2024-04-25T09:05:14.935564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:29.659051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935365+0000","last_change":"2024-04-25T09:05:13.954901+0000","last_active":"2024-04-25T09:05:14.935365+0000","last_peered":"2024-04-25T09:05:14.935365+0000","last_clean":"2024-04-25T09:05:14.935365+0000","last_became_active":"2024-04-25T09:05:13.954629+0000","last_became_peered":"2024-04-25T09:05:13.954629+0000","last_unstale":"2024-04-25T09:05:14.935365+0000","last_undegraded":"2024-04-25T09:05:14.935365+0000","last_fullsized":"2024-04-25T09:05:14.935365+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:59.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708981+0000","last_change":"2024-04-25T09:05:12.944791+0000","last_active":"2024-04-25T09:05:15.708981+0000","last_peered":"2024-04-25T09:05:15.708981+0000","last_clean":"2024-04-25T09:05:15.708981+0000","last_became_active":"2024-04-25T09:05:12.944514+0000","last_became_peered":"2024-04-25T09:05:12.944514+0000","last_unstale":"2024-04-25T09:05:15.708981+0000","last_undegraded":"2024-04-25T09:05:15.708981+0000","last_fullsized":"2024-04-25T09:05:15.708981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:06.758623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.347049+0000","last_change":"2024-04-25T09:05:13.956984+0000","last_active":"2024-04-25T09:05:15.347049+0000","last_peered":"2024-04-25T09:05:15.347049+0000","last_clean":"2024-04-25T09:05:15.347049+0000","last_became_active":"2024-04-25T09:05:13.956705+0000","last_became_peered":"2024-04-25T09:05:13.956705+0000","last_unstale":"2024-04-25T09:05:15.347049+0000","last_undegraded":"2024-04-25T09:05:15.347049+0000","last_fullsized":"2024-04-25T09:05:15.347049+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:31.434095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"124'3","reported_seq":17,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935162+0000","last_change":"2024-04-25T09:05:12.949152+0000","last_active":"2024-04-25T09:05:14.935162+0000","last_peered":"2024-04-25T09:05:14.935162+0000","last_clean":"2024-04-25T09:05:14.935162+0000","last_became_active":"2024-04-25T09:05:12.948791+0000","last_became_peered":"2024-04-25T09:05:12.948791+0000","last_unstale":"2024-04-25T09:05:14.935162+0000","last_undegraded":"2024-04-25T09:05:14.935162+0000","last_fullsized":"2024-04-25T09:05:14.935162+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:42.786281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346990+0000","last_change":"2024-04-25T09:05:13.954021+0000","last_active":"2024-04-25T09:05:15.346990+0000","last_peered":"2024-04-25T09:05:15.346990+0000","last_clean":"2024-04-25T09:05:15.346990+0000","last_became_active":"2024-04-25T09:05:13.953156+0000","last_became_peered":"2024-04-25T09:05:13.953156+0000","last_unstale":"2024-04-25T09:05:15.346990+0000","last_undegraded":"2024-04-25T09:05:15.346990+0000","last_fullsized":"2024-04-25T09:05:15.346990+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:09.180406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"124'6","reported_seq":20,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052506+0000","last_change":"2024-04-25T09:05:12.945110+0000","last_active":"2024-04-25T09:05:15.052506+0000","last_peered":"2024-04-25T09:05:15.052506+0000","last_clean":"2024-04-25T09:05:15.052506+0000","last_became_active":"2024-04-25T09:05:12.944122+0000","last_became_peered":"2024-04-25T09:05:12.944122+0000","last_unstale":"2024-04-25T09:05:15.052506+0000","last_undegraded":"2024-04-25T09:05:15.052506+0000","last_fullsized":"2024-04-25T09:05:15.052506+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:38.074852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933784+0000","last_change":"2024-04-25T09:05:13.949744+0000","last_active":"2024-04-25T09:05:14.933784+0000","last_peered":"2024-04-25T09:05:14.933784+0000","last_clean":"2024-04-25T09:05:14.933784+0000","last_became_active":"2024-04-25T09:05:13.949384+0000","last_became_peered":"2024-04-25T09:05:13.949384+0000","last_unstale":"2024-04-25T09:05:14.933784+0000","last_undegraded":"2024-04-25T09:05:14.933784+0000","last_fullsized":"2024-04-25T09:05:14.933784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:58.398021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933483+0000","last_change":"2024-04-25T09:05:12.941506+0000","last_active":"2024-04-25T09:05:14.933483+0000","last_peered":"2024-04-25T09:05:14.933483+0000","last_clean":"2024-04-25T09:05:14.933483+0000","last_became_active":"2024-04-25T09:05:12.941188+0000","last_became_peered":"2024-04-25T09:05:12.941188+0000","last_unstale":"2024-04-25T09:05:14.933483+0000","last_undegraded":"2024-04-25T09:05:14.933483+0000","last_fullsized":"2024-04-25T09:05:14.933483+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:42.973136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985701+0000","last_change":"2024-04-25T09:05:13.952656+0000","last_active":"2024-04-25T09:05:15.985701+0000","last_peered":"2024-04-25T09:05:15.985701+0000","last_clean":"2024-04-25T09:05:15.985701+0000","last_became_active":"2024-04-25T09:05:13.952357+0000","last_became_peered":"2024-04-25T09:05:13.952357+0000","last_unstale":"2024-04-25T09:05:15.985701+0000","last_undegraded":"2024-04-25T09:05:15.985701+0000","last_fullsized":"2024-04-25T09:05:15.985701+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:41.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986137+0000","last_change":"2024-04-25T09:05:12.948905+0000","last_active":"2024-04-25T09:05:15.986137+0000","last_peered":"2024-04-25T09:05:15.986137+0000","last_clean":"2024-04-25T09:05:15.986137+0000","last_became_active":"2024-04-25T09:05:12.948630+0000","last_became_peered":"2024-04-25T09:05:12.948630+0000","last_unstale":"2024-04-25T09:05:15.986137+0000","last_undegraded":"2024-04-25T09:05:15.986137+0000","last_fullsized":"2024-04-25T09:05:15.986137+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:43.417887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052508+0000","last_change":"2024-04-25T09:05:13.952250+0000","last_active":"2024-04-25T09:05:15.052508+0000","last_peered":"2024-04-25T09:05:15.052508+0000","last_clean":"2024-04-25T09:05:15.052508+0000","last_became_active":"2024-04-25T09:05:13.951890+0000","last_became_peered":"2024-04-25T09:05:13.951890+0000","last_unstale":"2024-04-25T09:05:15.052508+0000","last_undegraded":"2024-04-25T09:05:15.052508+0000","last_fullsized":"2024-04-25T09:05:15.052508+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:30.584572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"124'8","reported_seq":22,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052755+0000","last_change":"2024-04-25T09:05:12.943134+0000","last_active":"2024-04-25T09:05:15.052755+0000","last_peered":"2024-04-25T09:05:15.052755+0000","last_clean":"2024-04-25T09:05:15.052755+0000","last_became_active":"2024-04-25T09:05:12.942838+0000","last_became_peered":"2024-04-25T09:05:12.942838+0000","last_unstale":"2024-04-25T09:05:15.052755+0000","last_undegraded":"2024-04-25T09:05:15.052755+0000","last_fullsized":"2024-04-25T09:05:15.052755+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:21.331404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052835+0000","last_change":"2024-04-25T09:05:13.955241+0000","last_active":"2024-04-25T09:05:15.052835+0000","last_peered":"2024-04-25T09:05:15.052835+0000","last_clean":"2024-04-25T09:05:15.052835+0000","last_became_active":"2024-04-25T09:05:13.954931+0000","last_became_peered":"2024-04-25T09:05:13.954931+0000","last_unstale":"2024-04-25T09:05:15.052835+0000","last_undegraded":"2024-04-25T09:05:15.052835+0000","last_fullsized":"2024-04-25T09:05:15.052835+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:31.157523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935556+0000","last_change":"2024-04-25T09:05:12.944361+0000","last_active":"2024-04-25T09:05:14.935556+0000","last_peered":"2024-04-25T09:05:14.935556+0000","last_clean":"2024-04-25T09:05:14.935556+0000","last_became_active":"2024-04-25T09:05:12.944071+0000","last_became_peered":"2024-04-25T09:05:12.944071+0000","last_unstale":"2024-04-25T09:05:14.935556+0000","last_undegraded":"2024-04-25T09:05:14.935556+0000","last_fullsized":"2024-04-25T09:05:14.935556+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:52.830885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935440+0000","last_change":"2024-04-25T09:05:13.949987+0000","last_active":"2024-04-25T09:05:14.935440+0000","last_peered":"2024-04-25T09:05:14.935440+0000","last_clean":"2024-04-25T09:05:14.935440+0000","last_became_active":"2024-04-25T09:05:13.949684+0000","last_became_peered":"2024-04-25T09:05:13.949684+0000","last_unstale":"2024-04-25T09:05:14.935440+0000","last_undegraded":"2024-04-25T09:05:14.935440+0000","last_fullsized":"2024-04-25T09:05:14.935440+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:57.308475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986414+0000","last_change":"2024-04-25T09:05:12.945488+0000","last_active":"2024-04-25T09:05:15.986414+0000","last_peered":"2024-04-25T09:05:15.986414+0000","last_clean":"2024-04-25T09:05:15.986414+0000","last_became_active":"2024-04-25T09:05:12.945110+0000","last_became_peered":"2024-04-25T09:05:12.945110+0000","last_unstale":"2024-04-25T09:05:15.986414+0000","last_undegraded":"2024-04-25T09:05:15.986414+0000","last_fullsized":"2024-04-25T09:05:15.986414+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:41.615190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708937+0000","last_change":"2024-04-25T09:05:13.952899+0000","last_active":"2024-04-25T09:05:15.708937+0000","last_peered":"2024-04-25T09:05:15.708937+0000","last_clean":"2024-04-25T09:05:15.708937+0000","last_became_active":"2024-04-25T09:05:13.952549+0000","last_became_peered":"2024-04-25T09:05:13.952549+0000","last_unstale":"2024-04-25T09:05:15.708937+0000","last_undegraded":"2024-04-25T09:05:15.708937+0000","last_fullsized":"2024-04-25T09:05:15.708937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:55.228401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934400+0000","last_change":"2024-04-25T09:05:12.940973+0000","last_active":"2024-04-25T09:05:14.934400+0000","last_peered":"2024-04-25T09:05:14.934400+0000","last_clean":"2024-04-25T09:05:14.934400+0000","last_became_active":"2024-04-25T09:05:12.940676+0000","last_became_peered":"2024-04-25T09:05:12.940676+0000","last_unstale":"2024-04-25T09:05:14.934400+0000","last_undegraded":"2024-04-25T09:05:14.934400+0000","last_fullsized":"2024-04-25T09:05:14.934400+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:33.981439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986639+0000","last_change":"2024-04-25T09:05:13.955672+0000","last_active":"2024-04-25T09:05:15.986639+0000","last_peered":"2024-04-25T09:05:15.986639+0000","last_clean":"2024-04-25T09:05:15.986639+0000","last_became_active":"2024-04-25T09:05:13.955354+0000","last_became_peered":"2024-04-25T09:05:13.955354+0000","last_unstale":"2024-04-25T09:05:15.986639+0000","last_undegraded":"2024-04-25T09:05:15.986639+0000","last_fullsized":"2024-04-25T09:05:15.986639+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:26.239277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934930+0000","last_change":"2024-04-25T09:05:12.942489+0000","last_active":"2024-04-25T09:05:14.934930+0000","last_peered":"2024-04-25T09:05:14.934930+0000","last_clean":"2024-04-25T09:05:14.934930+0000","last_became_active":"2024-04-25T09:05:12.942196+0000","last_became_peered":"2024-04-25T09:05:12.942196+0000","last_unstale":"2024-04-25T09:05:14.934930+0000","last_undegraded":"2024-04-25T09:05:14.934930+0000","last_fullsized":"2024-04-25T09:05:14.934930+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:21.331404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933364+0000","last_change":"2024-04-25T09:05:13.943739+0000","last_active":"2024-04-25T09:05:14.933364+0000","last_peered":"2024-04-25T09:05:14.933364+0000","last_clean":"2024-04-25T09:05:14.933364+0000","last_became_active":"2024-04-25T09:05:13.943446+0000","last_became_peered":"2024-04-25T09:05:13.943446+0000","last_unstale":"2024-04-25T09:05:14.933364+0000","last_undegraded":"2024-04-25T09:05:14.933364+0000","last_fullsized":"2024-04-25T09:05:14.933364+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:17.917315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934868+0000","last_change":"2024-04-25T09:05:12.948507+0000","last_active":"2024-04-25T09:05:14.934868+0000","last_peered":"2024-04-25T09:05:14.934868+0000","last_clean":"2024-04-25T09:05:14.934868+0000","last_became_active":"2024-04-25T09:05:12.948204+0000","last_became_peered":"2024-04-25T09:05:12.948204+0000","last_unstale":"2024-04-25T09:05:14.934868+0000","last_undegraded":"2024-04-25T09:05:14.934868+0000","last_fullsized":"2024-04-25T09:05:14.934868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:31.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934357+0000","last_change":"2024-04-25T09:05:13.953471+0000","last_active":"2024-04-25T09:05:14.934357+0000","last_peered":"2024-04-25T09:05:14.934357+0000","last_clean":"2024-04-25T09:05:14.934357+0000","last_became_active":"2024-04-25T09:05:13.952970+0000","last_became_peered":"2024-04-25T09:05:13.952970+0000","last_unstale":"2024-04-25T09:05:14.934357+0000","last_undegraded":"2024-04-25T09:05:14.934357+0000","last_fullsized":"2024-04-25T09:05:14.934357+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:55.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708927+0000","last_change":"2024-04-25T09:05:12.948486+0000","last_active":"2024-04-25T09:05:15.708927+0000","last_peered":"2024-04-25T09:05:15.708927+0000","last_clean":"2024-04-25T09:05:15.708927+0000","last_became_active":"2024-04-25T09:05:12.948165+0000","last_became_peered":"2024-04-25T09:05:12.948165+0000","last_unstale":"2024-04-25T09:05:15.708927+0000","last_undegraded":"2024-04-25T09:05:15.708927+0000","last_fullsized":"2024-04-25T09:05:15.708927+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:19.579938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985738+0000","last_change":"2024-04-25T09:05:13.949132+0000","last_active":"2024-04-25T09:05:15.985738+0000","last_peered":"2024-04-25T09:05:15.985738+0000","last_clean":"2024-04-25T09:05:15.985738+0000","last_became_active":"2024-04-25T09:05:13.948826+0000","last_became_peered":"2024-04-25T09:05:13.948826+0000","last_unstale":"2024-04-25T09:05:15.985738+0000","last_undegraded":"2024-04-25T09:05:15.985738+0000","last_fullsized":"2024-04-25T09:05:15.985738+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:19.312127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708496+0000","last_change":"2024-04-25T09:05:12.943912+0000","last_active":"2024-04-25T09:05:15.708496+0000","last_peered":"2024-04-25T09:05:15.708496+0000","last_clean":"2024-04-25T09:05:15.708496+0000","last_became_active":"2024-04-25T09:05:12.943550+0000","last_became_peered":"2024-04-25T09:05:12.943550+0000","last_unstale":"2024-04-25T09:05:15.708496+0000","last_undegraded":"2024-04-25T09:05:15.708496+0000","last_fullsized":"2024-04-25T09:05:15.708496+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:34.105259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346604+0000","last_change":"2024-04-25T09:05:13.940015+0000","last_active":"2024-04-25T09:05:15.346604+0000","last_peered":"2024-04-25T09:05:15.346604+0000","last_clean":"2024-04-25T09:05:15.346604+0000","last_became_active":"2024-04-25T09:05:13.939356+0000","last_became_peered":"2024-04-25T09:05:13.939356+0000","last_unstale":"2024-04-25T09:05:15.346604+0000","last_undegraded":"2024-04-25T09:05:15.346604+0000","last_fullsized":"2024-04-25T09:05:15.346604+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:39.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986433+0000","last_change":"2024-04-25T09:05:12.945313+0000","last_active":"2024-04-25T09:05:15.986433+0000","last_peered":"2024-04-25T09:05:15.986433+0000","last_clean":"2024-04-25T09:05:15.986433+0000","last_became_active":"2024-04-25T09:05:12.945002+0000","last_became_peered":"2024-04-25T09:05:12.945002+0000","last_unstale":"2024-04-25T09:05:15.986433+0000","last_undegraded":"2024-04-25T09:05:15.986433+0000","last_fullsized":"2024-04-25T09:05:15.986433+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:33.975710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934603+0000","last_change":"2024-04-25T09:05:13.942578+0000","last_active":"2024-04-25T09:05:14.934603+0000","last_peered":"2024-04-25T09:05:14.934603+0000","last_clean":"2024-04-25T09:05:14.934603+0000","last_became_active":"2024-04-25T09:05:13.942282+0000","last_became_peered":"2024-04-25T09:05:13.942282+0000","last_unstale":"2024-04-25T09:05:14.934603+0000","last_undegraded":"2024-04-25T09:05:14.934603+0000","last_fullsized":"2024-04-25T09:05:14.934603+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:35.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933765+0000","last_change":"2024-04-25T09:05:12.943115+0000","last_active":"2024-04-25T09:05:14.933765+0000","last_peered":"2024-04-25T09:05:14.933765+0000","last_clean":"2024-04-25T09:05:14.933765+0000","last_became_active":"2024-04-25T09:05:12.942795+0000","last_became_peered":"2024-04-25T09:05:12.942795+0000","last_unstale":"2024-04-25T09:05:14.933765+0000","last_undegraded":"2024-04-25T09:05:14.933765+0000","last_fullsized":"2024-04-25T09:05:14.933765+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:00.695952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933793+0000","last_change":"2024-04-25T09:05:13.952978+0000","last_active":"2024-04-25T09:05:14.933793+0000","last_peered":"2024-04-25T09:05:14.933793+0000","last_clean":"2024-04-25T09:05:14.933793+0000","last_became_active":"2024-04-25T09:05:13.952717+0000","last_became_peered":"2024-04-25T09:05:13.952717+0000","last_unstale":"2024-04-25T09:05:14.933793+0000","last_undegraded":"2024-04-25T09:05:14.933793+0000","last_fullsized":"2024-04-25T09:05:14.933793+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:21.559683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"125'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.938089+0000","last_change":"2024-04-25T09:05:12.946181+0000","last_active":"2024-04-25T09:05:15.938089+0000","last_peered":"2024-04-25T09:05:15.938089+0000","last_clean":"2024-04-25T09:05:15.938089+0000","last_became_active":"2024-04-25T09:05:12.945727+0000","last_became_peered":"2024-04-25T09:05:12.945727+0000","last_unstale":"2024-04-25T09:05:15.938089+0000","last_undegraded":"2024-04-25T09:05:15.938089+0000","last_fullsized":"2024-04-25T09:05:15.938089+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:21.399297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986362+0000","last_change":"2024-04-25T09:05:13.944167+0000","last_active":"2024-04-25T09:05:15.986362+0000","last_peered":"2024-04-25T09:05:15.986362+0000","last_clean":"2024-04-25T09:05:15.986362+0000","last_became_active":"2024-04-25T09:05:13.943890+0000","last_became_peered":"2024-04-25T09:05:13.943890+0000","last_unstale":"2024-04-25T09:05:15.986362+0000","last_undegraded":"2024-04-25T09:05:15.986362+0000","last_fullsized":"2024-04-25T09:05:15.986362+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:55.356511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986682+0000","last_change":"2024-04-25T09:05:12.944455+0000","last_active":"2024-04-25T09:05:15.986682+0000","last_peered":"2024-04-25T09:05:15.986682+0000","last_clean":"2024-04-25T09:05:15.986682+0000","last_became_active":"2024-04-25T09:05:12.944150+0000","last_became_peered":"2024-04-25T09:05:12.944150+0000","last_unstale":"2024-04-25T09:05:15.986682+0000","last_undegraded":"2024-04-25T09:05:15.986682+0000","last_fullsized":"2024-04-25T09:05:15.986682+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:09.218747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934446+0000","last_change":"2024-04-25T09:05:13.942616+0000","last_active":"2024-04-25T09:05:14.934446+0000","last_peered":"2024-04-25T09:05:14.934446+0000","last_clean":"2024-04-25T09:05:14.934446+0000","last_became_active":"2024-04-25T09:05:13.942329+0000","last_became_peered":"2024-04-25T09:05:13.942329+0000","last_unstale":"2024-04-25T09:05:14.934446+0000","last_undegraded":"2024-04-25T09:05:14.934446+0000","last_fullsized":"2024-04-25T09:05:14.934446+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:31.157523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985968+0000","last_change":"2024-04-25T09:05:12.946819+0000","last_active":"2024-04-25T09:05:15.985968+0000","last_peered":"2024-04-25T09:05:15.985968+0000","last_clean":"2024-04-25T09:05:15.985968+0000","last_became_active":"2024-04-25T09:05:12.946530+0000","last_became_peered":"2024-04-25T09:05:12.946530+0000","last_unstale":"2024-04-25T09:05:15.985968+0000","last_undegraded":"2024-04-25T09:05:15.985968+0000","last_fullsized":"2024-04-25T09:05:15.985968+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:11.912676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346590+0000","last_change":"2024-04-25T09:05:13.943648+0000","last_active":"2024-04-25T09:05:15.346590+0000","last_peered":"2024-04-25T09:05:15.346590+0000","last_clean":"2024-04-25T09:05:15.346590+0000","last_became_active":"2024-04-25T09:05:13.943373+0000","last_became_peered":"2024-04-25T09:05:13.943373+0000","last_unstale":"2024-04-25T09:05:15.346590+0000","last_undegraded":"2024-04-25T09:05:15.346590+0000","last_fullsized":"2024-04-25T09:05:15.346590+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:08.578032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986889+0000","last_change":"2024-04-25T09:05:12.949016+0000","last_active":"2024-04-25T09:05:15.986889+0000","last_peered":"2024-04-25T09:05:15.986889+0000","last_clean":"2024-04-25T09:05:15.986889+0000","last_became_active":"2024-04-25T09:05:12.948732+0000","last_became_peered":"2024-04-25T09:05:12.948732+0000","last_unstale":"2024-04-25T09:05:15.986889+0000","last_undegraded":"2024-04-25T09:05:15.986889+0000","last_fullsized":"2024-04-25T09:05:15.986889+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:00.695952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934923+0000","last_change":"2024-04-25T09:05:13.938556+0000","last_active":"2024-04-25T09:05:14.934923+0000","last_peered":"2024-04-25T09:05:14.934923+0000","last_clean":"2024-04-25T09:05:14.934923+0000","last_became_active":"2024-04-25T09:05:13.938265+0000","last_became_peered":"2024-04-25T09:05:13.938265+0000","last_unstale":"2024-04-25T09:05:14.934923+0000","last_undegraded":"2024-04-25T09:05:14.934923+0000","last_fullsized":"2024-04-25T09:05:14.934923+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:25.713837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346761+0000","last_change":"2024-04-25T09:05:12.950194+0000","last_active":"2024-04-25T09:05:15.346761+0000","last_peered":"2024-04-25T09:05:15.346761+0000","last_clean":"2024-04-25T09:05:15.346761+0000","last_became_active":"2024-04-25T09:05:12.949893+0000","last_became_peered":"2024-04-25T09:05:12.949893+0000","last_unstale":"2024-04-25T09:05:15.346761+0000","last_undegraded":"2024-04-25T09:05:15.346761+0000","last_fullsized":"2024-04-25T09:05:15.346761+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:12.931384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708762+0000","last_change":"2024-04-25T09:05:13.954372+0000","last_active":"2024-04-25T09:05:15.708762+0000","last_peered":"2024-04-25T09:05:15.708762+0000","last_clean":"2024-04-25T09:05:15.708762+0000","last_became_active":"2024-04-25T09:05:13.954079+0000","last_became_peered":"2024-04-25T09:05:13.954079+0000","last_unstale":"2024-04-25T09:05:15.708762+0000","last_undegraded":"2024-04-25T09:05:15.708762+0000","last_fullsized":"2024-04-25T09:05:15.708762+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:34.980667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708574+0000","last_change":"2024-04-25T09:05:12.947672+0000","last_active":"2024-04-25T09:05:15.708574+0000","last_peered":"2024-04-25T09:05:15.708574+0000","last_clean":"2024-04-25T09:05:15.708574+0000","last_became_active":"2024-04-25T09:05:12.947279+0000","last_became_peered":"2024-04-25T09:05:12.947279+0000","last_unstale":"2024-04-25T09:05:15.708574+0000","last_undegraded":"2024-04-25T09:05:15.708574+0000","last_fullsized":"2024-04-25T09:05:15.708574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:58.122283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986019+0000","last_change":"2024-04-25T09:05:13.945486+0000","last_active":"2024-04-25T09:05:15.986019+0000","last_peered":"2024-04-25T09:05:15.986019+0000","last_clean":"2024-04-25T09:05:15.986019+0000","last_became_active":"2024-04-25T09:05:13.945134+0000","last_became_peered":"2024-04-25T09:05:13.945134+0000","last_unstale":"2024-04-25T09:05:15.986019+0000","last_undegraded":"2024-04-25T09:05:15.986019+0000","last_fullsized":"2024-04-25T09:05:15.986019+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:52.169113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986542+0000","last_change":"2024-04-25T09:05:12.941940+0000","last_active":"2024-04-25T09:05:15.986542+0000","last_peered":"2024-04-25T09:05:15.986542+0000","last_clean":"2024-04-25T09:05:15.986542+0000","last_became_active":"2024-04-25T09:05:12.941649+0000","last_became_peered":"2024-04-25T09:05:12.941649+0000","last_unstale":"2024-04-25T09:05:15.986542+0000","last_undegraded":"2024-04-25T09:05:15.986542+0000","last_fullsized":"2024-04-25T09:05:15.986542+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:37.415384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346586+0000","last_change":"2024-04-25T09:05:13.938616+0000","last_active":"2024-04-25T09:05:15.346586+0000","last_peered":"2024-04-25T09:05:15.346586+0000","last_clean":"2024-04-25T09:05:15.346586+0000","last_became_active":"2024-04-25T09:05:13.938319+0000","last_became_peered":"2024-04-25T09:05:13.938319+0000","last_unstale":"2024-04-25T09:05:15.346586+0000","last_undegraded":"2024-04-25T09:05:15.346586+0000","last_fullsized":"2024-04-25T09:05:15.346586+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:51.210835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346953+0000","last_change":"2024-04-25T09:05:12.949516+0000","last_active":"2024-04-25T09:05:15.346953+0000","last_peered":"2024-04-25T09:05:15.346953+0000","last_clean":"2024-04-25T09:05:15.346953+0000","last_became_active":"2024-04-25T09:05:12.949258+0000","last_became_peered":"2024-04-25T09:05:12.949258+0000","last_unstale":"2024-04-25T09:05:15.346953+0000","last_undegraded":"2024-04-25T09:05:15.346953+0000","last_fullsized":"2024-04-25T09:05:15.346953+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:51.289672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":366,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346337+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:05:15.346337+0000","last_peered":"2024-04-25T09:05:15.346337+0000","last_clean":"2024-04-25T09:05:15.346337+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:05:15.346337+0000","last_undegraded":"2024-04-25T09:05:15.346337+0000","last_fullsized":"2024-04-25T09:05:15.346337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51356,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320484,"statfs":{"total":96636764160,"available":96584175616,"internally_reserved":0,"allocated":2179072,"data_stored":1271377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54928,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316912,"statfs":{"total":96636764160,"available":96580517888,"internally_reserved":0,"allocated":1572864,"data_stored":680371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46604,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325236,"statfs":{"total":96636764160,"available":96589041664,"internally_reserved":0,"allocated":1568768,"data_stored":678871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54924,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316916,"statfs":{"total":96636764160,"available":96580521984,"internally_reserved":0,"allocated":1564672,"data_stored":678829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54924,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316916,"statfs":{"total":96636764160,"available":96580521984,"internally_reserved":0,"allocated":1568768,"data_stored":678919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574956,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54920,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316920,"statfs":{"total":96636764160,"available":96580526080,"internally_reserved":0,"allocated":1568768,"data_stored":679375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46588,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325252,"statfs":{"total":96636764160,"available":96589058048,"internally_reserved":0,"allocated":1548288,"data_stored":672459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33284,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338556,"statfs":{"total":96636764160,"available":96602681344,"internally_reserved":0,"allocated":2154496,"data_stored":1269127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:16.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.084+0000 7f0dcb7f4640 1 Processor -- start 2024-04-25T09:05:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.084+0000 7f0dcb7f4640 1 -- start start 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dcb7f4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0dc406cbf0 0x7f0dc40cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dcb7f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0dc40ce190 0x7f0dc40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dcb7f4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc4072150 con 0x7f0dc415df80 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dcb7f4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40cbd50 con 0x7f0dc40ce190 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dcb7f4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40cc030 con 0x7f0dc406cbf0 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc8d8f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0dc40ce190 0x7f0dc40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc8d8f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0dc40ce190 0x7f0dc40ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41128/0 (socket says 172.21.15.5:41128) 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc8d8f640 1 -- 172.21.15.5:0/1547328145 learned_addr learned my addr 172.21.15.5:0/1547328145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc9590640 1 --2- 172.21.15.5:0/1547328145 >> v2:172.21.15.80:3300/0 conn(0x7f0dc406cbf0 0x7f0dc40cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc8d8f640 1 -- 172.21.15.5:0/1547328145 >> v2:172.21.15.80:3300/0 conn(0x7f0dc406cbf0 msgr2=0x7f0dc40cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc8d8f640 1 --2- 172.21.15.5:0/1547328145 >> v2:172.21.15.80:3300/0 conn(0x7f0dc406cbf0 0x7f0dc40cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc8d8f640 1 -- 172.21.15.5:0/1547328145 >> v1:172.21.15.80:6789/0 conn(0x7f0dc415df80 legacy=0x7f0dc406cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.085+0000 7f0dc8d8f640 1 -- 172.21.15.5:0/1547328145 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc40cc310 con 0x7f0dc40ce190 2024-04-25T09:05:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.086+0000 7f0dc8d8f640 1 --2- 172.21.15.5:0/1547328145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc40ce190 0x7f0dc40ccb10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f0dc406c890 tx=0x7f0db402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f03a38093ba10d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.086+0000 7f0dbbfff640 1 -- 172.21.15.5:0/1547328145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4037070 con 0x7f0dc40ce190 2024-04-25T09:05:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.086+0000 7f0dbbfff640 1 -- 172.21.15.5:0/1547328145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db402ae50 con 0x7f0dc40ce190 2024-04-25T09:05:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.086+0000 7f0dbbfff640 1 -- 172.21.15.5:0/1547328145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4032860 con 0x7f0dc40ce190 2024-04-25T09:05:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/1547328145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc40ce190 msgr2=0x7f0dc40ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/1547328145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc40ce190 0x7f0dc40ccb10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f0dc406c890 tx=0x7f0db402a300 comp rx=0 tx=0).stop 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/1547328145 shutdown_connections 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/1547328145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc40ce190 0x7f0dc40ccb10 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/1547328145 >> v2:172.21.15.80:3300/0 conn(0x7f0dc406cbf0 0x7f0dc40cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/1547328145 >> 172.21.15.5:0/1547328145 conn(0x7f0dc40b1c50 msgr2=0x7f0dc40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/1547328145 shutdown_connections 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.087+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/1547328145 wait complete. 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.088+0000 7f0dcb7f4640 1 Processor -- start 2024-04-25T09:05:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.088+0000 7f0dcb7f4640 1 -- start start 2024-04-25T09:05:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dcb7f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc406cbf0 0x7f0dc41524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dcb7f4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0dc40ce190 0x7f0dc40b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dcb7f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc415df80 0x7f0dc40c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dcb7f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4071d50 con 0x7f0dc406cbf0 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dcb7f4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4071bd0 con 0x7f0dc415df80 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dcb7f4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4071ed0 con 0x7f0dc40ce190 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc406cbf0 0x7f0dc41524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc406cbf0 0x7f0dc41524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41142/0 (socket says 172.21.15.5:41142) 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 -- 172.21.15.5:0/2218259241 learned_addr learned my addr 172.21.15.5:0/2218259241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9d91640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc415df80 0x7f0dc40c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 -- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0dc40ce190 msgr2=0x7f0dc40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc8d8f640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0dc40ce190 0x7f0dc40b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0dc40ce190 0x7f0dc40b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 -- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc415df80 msgr2=0x7f0dc40c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc415df80 0x7f0dc40c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 -- 172.21.15.5:0/2218259241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc415f780 con 0x7f0dc406cbf0 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9d91640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc415df80 0x7f0dc40c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc8d8f640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0dc40ce190 0x7f0dc40b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.089+0000 7f0dc9590640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc406cbf0 0x7f0dc41524d0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000d800 tx=0x7f0dc000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.090+0000 7f0db9ffb640 1 -- 172.21.15.5:0/2218259241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000b6c0 con 0x7f0dc406cbf0 2024-04-25T09:05:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.090+0000 7f0db9ffb640 1 -- 172.21.15.5:0/2218259241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc0019070 con 0x7f0dc406cbf0 2024-04-25T09:05:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.090+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc415fa20 con 0x7f0dc406cbf0 2024-04-25T09:05:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.090+0000 7f0db9ffb640 1 -- 172.21.15.5:0/2218259241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000bac0 con 0x7f0dc406cbf0 2024-04-25T09:05:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.090+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc41602c0 con 0x7f0dc406cbf0 2024-04-25T09:05:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.091+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc404ef20 con 0x7f0dc406cbf0 2024-04-25T09:05:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.091+0000 7f0db9ffb640 1 -- 172.21.15.5:0/2218259241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0dc000bc60 con 0x7f0dc406cbf0 2024-04-25T09:05:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.091+0000 7f0db9ffb640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0da806b4d0 0x7f0da806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.092+0000 7f0db9ffb640 1 -- 172.21.15.5:0/2218259241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc008a770 con 0x7f0dc406cbf0 2024-04-25T09:05:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.092+0000 7f0dc8d8f640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0da806b4d0 0x7f0da806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.092+0000 7f0dc8d8f640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0da806b4d0 0x7f0da806d990 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0db4034000 tx=0x7f0db402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.096+0000 7f0db9ffb640 1 -- 172.21.15.5:0/2218259241 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0dc0059560 con 0x7f0dc406cbf0 2024-04-25T09:05:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.273+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dc4072e80 con 0x7f0da806b4d0 2024-04-25T09:05:17.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.279+0000 7f0db9ffb640 1 -- 172.21.15.5:0/2218259241 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252482 (secure 0 0 0) 0x7f0dc4072e80 con 0x7f0da806b4d0 2024-04-25T09:05:17.269 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:17.270 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0da806b4d0 msgr2=0x7f0da806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0da806b4d0 0x7f0da806d990 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0db4034000 tx=0x7f0db402e000 comp rx=0 tx=0).stop 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc406cbf0 msgr2=0x7f0dc41524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc406cbf0 0x7f0dc41524d0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000d800 tx=0x7f0dc000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 shutdown_connections 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0da806b4d0 0x7f0da806d990 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc415df80 0x7f0dc40c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0dc40ce190 0x7f0dc40b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 --2- 172.21.15.5:0/2218259241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dc406cbf0 0x7f0dc41524d0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 >> 172.21.15.5:0/2218259241 conn(0x7f0dc40b1c50 msgr2=0x7f0dc406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 shutdown_connections 2024-04-25T09:05:17.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.282+0000 7f0dcb7f4640 1 -- 172.21.15.5:0/2218259241 wait complete. 2024-04-25T09:05:17.281 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2024-04-25T09:05:16.503636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397528,"kb_used_data":13404,"kb_used_omap":12,"kb_used_meta":383987,"kb_avail":754577192,"statfs":{"total":773094113280,"available":772687044608,"internally_reserved":0,"allocated":13725696,"data_stored":6609328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":393203249},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.578456"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933680+0000","last_change":"2024-04-25T09:05:13.945563+0000","last_active":"2024-04-25T09:05:14.933680+0000","last_peered":"2024-04-25T09:05:14.933680+0000","last_clean":"2024-04-25T09:05:14.933680+0000","last_became_active":"2024-04-25T09:05:13.945277+0000","last_became_peered":"2024-04-25T09:05:13.945277+0000","last_unstale":"2024-04-25T09:05:14.933680+0000","last_undegraded":"2024-04-25T09:05:14.933680+0000","last_fullsized":"2024-04-25T09:05:14.933680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:40.893080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986729+0000","last_change":"2024-04-25T09:05:13.946559+0000","last_active":"2024-04-25T09:05:15.986729+0000","last_peered":"2024-04-25T09:05:15.986729+0000","last_clean":"2024-04-25T09:05:15.986729+0000","last_became_active":"2024-04-25T09:05:13.946293+0000","last_became_peered":"2024-04-25T09:05:13.946293+0000","last_unstale":"2024-04-25T09:05:15.986729+0000","last_undegraded":"2024-04-25T09:05:15.986729+0000","last_fullsized":"2024-04-25T09:05:15.986729+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:06.274809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052615+0000","last_change":"2024-04-25T09:05:13.952318+0000","last_active":"2024-04-25T09:05:15.052615+0000","last_peered":"2024-04-25T09:05:15.052615+0000","last_clean":"2024-04-25T09:05:15.052615+0000","last_became_active":"2024-04-25T09:05:13.951817+0000","last_became_peered":"2024-04-25T09:05:13.951817+0000","last_unstale":"2024-04-25T09:05:15.052615+0000","last_undegraded":"2024-04-25T09:05:15.052615+0000","last_fullsized":"2024-04-25T09:05:15.052615+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:37.556392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933394+0000","last_change":"2024-04-25T09:05:13.937984+0000","last_active":"2024-04-25T09:05:14.933394+0000","last_peered":"2024-04-25T09:05:14.933394+0000","last_clean":"2024-04-25T09:05:14.933394+0000","last_became_active":"2024-04-25T09:05:13.937658+0000","last_became_peered":"2024-04-25T09:05:13.937658+0000","last_unstale":"2024-04-25T09:05:14.933394+0000","last_undegraded":"2024-04-25T09:05:14.933394+0000","last_fullsized":"2024-04-25T09:05:14.933394+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:38.203237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346922+0000","last_change":"2024-04-25T09:05:13.945297+0000","last_active":"2024-04-25T09:05:15.346922+0000","last_peered":"2024-04-25T09:05:15.346922+0000","last_clean":"2024-04-25T09:05:15.346922+0000","last_became_active":"2024-04-25T09:05:13.943909+0000","last_became_peered":"2024-04-25T09:05:13.943909+0000","last_unstale":"2024-04-25T09:05:15.346922+0000","last_undegraded":"2024-04-25T09:05:15.346922+0000","last_fullsized":"2024-04-25T09:05:15.346922+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:00.412262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934199+0000","last_change":"2024-04-25T09:05:13.941652+0000","last_active":"2024-04-25T09:05:14.934199+0000","last_peered":"2024-04-25T09:05:14.934199+0000","last_clean":"2024-04-25T09:05:14.934199+0000","last_became_active":"2024-04-25T09:05:13.941368+0000","last_became_peered":"2024-04-25T09:05:13.941368+0000","last_unstale":"2024-04-25T09:05:14.934199+0000","last_undegraded":"2024-04-25T09:05:14.934199+0000","last_fullsized":"2024-04-25T09:05:14.934199+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:37.556392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933941+0000","last_change":"2024-04-25T09:05:13.953264+0000","last_active":"2024-04-25T09:05:14.933941+0000","last_peered":"2024-04-25T09:05:14.933941+0000","last_clean":"2024-04-25T09:05:14.933941+0000","last_became_active":"2024-04-25T09:05:13.952966+0000","last_became_peered":"2024-04-25T09:05:13.952966+0000","last_unstale":"2024-04-25T09:05:14.933941+0000","last_undegraded":"2024-04-25T09:05:14.933941+0000","last_fullsized":"2024-04-25T09:05:14.933941+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:02.302447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052463+0000","last_change":"2024-04-25T09:05:13.956163+0000","last_active":"2024-04-25T09:05:15.052463+0000","last_peered":"2024-04-25T09:05:15.052463+0000","last_clean":"2024-04-25T09:05:15.052463+0000","last_became_active":"2024-04-25T09:05:13.954251+0000","last_became_peered":"2024-04-25T09:05:13.954251+0000","last_unstale":"2024-04-25T09:05:15.052463+0000","last_undegraded":"2024-04-25T09:05:15.052463+0000","last_fullsized":"2024-04-25T09:05:15.052463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:57.308475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052840+0000","last_change":"2024-04-25T09:05:13.952289+0000","last_active":"2024-04-25T09:05:15.052840+0000","last_peered":"2024-04-25T09:05:15.052840+0000","last_clean":"2024-04-25T09:05:15.052840+0000","last_became_active":"2024-04-25T09:05:13.952015+0000","last_became_peered":"2024-04-25T09:05:13.952015+0000","last_unstale":"2024-04-25T09:05:15.052840+0000","last_undegraded":"2024-04-25T09:05:15.052840+0000","last_fullsized":"2024-04-25T09:05:15.052840+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:43.945176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986835+0000","last_change":"2024-04-25T09:05:13.943432+0000","last_active":"2024-04-25T09:05:15.986835+0000","last_peered":"2024-04-25T09:05:15.986835+0000","last_clean":"2024-04-25T09:05:15.986835+0000","last_became_active":"2024-04-25T09:05:13.943136+0000","last_became_peered":"2024-04-25T09:05:13.943136+0000","last_unstale":"2024-04-25T09:05:15.986835+0000","last_undegraded":"2024-04-25T09:05:15.986835+0000","last_fullsized":"2024-04-25T09:05:15.986835+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:27.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985951+0000","last_change":"2024-04-25T09:05:13.951574+0000","last_active":"2024-04-25T09:05:15.985951+0000","last_peered":"2024-04-25T09:05:15.985951+0000","last_clean":"2024-04-25T09:05:15.985951+0000","last_became_active":"2024-04-25T09:05:13.951307+0000","last_became_peered":"2024-04-25T09:05:13.951307+0000","last_unstale":"2024-04-25T09:05:15.985951+0000","last_undegraded":"2024-04-25T09:05:15.985951+0000","last_fullsized":"2024-04-25T09:05:15.985951+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:08.578032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052507+0000","last_change":"2024-04-25T09:05:13.948487+0000","last_active":"2024-04-25T09:05:15.052507+0000","last_peered":"2024-04-25T09:05:15.052507+0000","last_clean":"2024-04-25T09:05:15.052507+0000","last_became_active":"2024-04-25T09:05:13.947565+0000","last_became_peered":"2024-04-25T09:05:13.947565+0000","last_unstale":"2024-04-25T09:05:15.052507+0000","last_undegraded":"2024-04-25T09:05:15.052507+0000","last_fullsized":"2024-04-25T09:05:15.052507+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:57.491740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933554+0000","last_change":"2024-04-25T09:05:13.946162+0000","last_active":"2024-04-25T09:05:14.933554+0000","last_peered":"2024-04-25T09:05:14.933554+0000","last_clean":"2024-04-25T09:05:14.933554+0000","last_became_active":"2024-04-25T09:05:13.945899+0000","last_became_peered":"2024-04-25T09:05:13.945899+0000","last_unstale":"2024-04-25T09:05:14.933554+0000","last_undegraded":"2024-04-25T09:05:14.933554+0000","last_fullsized":"2024-04-25T09:05:14.933554+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:19.312127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986156+0000","last_change":"2024-04-25T09:05:13.949151+0000","last_active":"2024-04-25T09:05:15.986156+0000","last_peered":"2024-04-25T09:05:15.986156+0000","last_clean":"2024-04-25T09:05:15.986156+0000","last_became_active":"2024-04-25T09:05:13.948867+0000","last_became_peered":"2024-04-25T09:05:13.948867+0000","last_unstale":"2024-04-25T09:05:15.986156+0000","last_undegraded":"2024-04-25T09:05:15.986156+0000","last_fullsized":"2024-04-25T09:05:15.986156+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:40.893080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933198+0000","last_change":"2024-04-25T09:05:13.953687+0000","last_active":"2024-04-25T09:05:14.933198+0000","last_peered":"2024-04-25T09:05:14.933198+0000","last_clean":"2024-04-25T09:05:14.933198+0000","last_became_active":"2024-04-25T09:05:13.953381+0000","last_became_peered":"2024-04-25T09:05:13.953381+0000","last_unstale":"2024-04-25T09:05:14.933198+0000","last_undegraded":"2024-04-25T09:05:14.933198+0000","last_fullsized":"2024-04-25T09:05:14.933198+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.364900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708585+0000","last_change":"2024-04-25T09:05:13.953727+0000","last_active":"2024-04-25T09:05:15.708585+0000","last_peered":"2024-04-25T09:05:15.708585+0000","last_clean":"2024-04-25T09:05:15.708585+0000","last_became_active":"2024-04-25T09:05:13.953432+0000","last_became_peered":"2024-04-25T09:05:13.953432+0000","last_unstale":"2024-04-25T09:05:15.708585+0000","last_undegraded":"2024-04-25T09:05:15.708585+0000","last_fullsized":"2024-04-25T09:05:15.708585+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:50.726798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934685+0000","last_change":"2024-04-25T09:05:13.950199+0000","last_active":"2024-04-25T09:05:14.934685+0000","last_peered":"2024-04-25T09:05:14.934685+0000","last_clean":"2024-04-25T09:05:14.934685+0000","last_became_active":"2024-04-25T09:05:13.949908+0000","last_became_peered":"2024-04-25T09:05:13.949908+0000","last_unstale":"2024-04-25T09:05:14.934685+0000","last_undegraded":"2024-04-25T09:05:14.934685+0000","last_fullsized":"2024-04-25T09:05:14.934685+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:59.127240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708829+0000","last_change":"2024-04-25T09:05:13.955301+0000","last_active":"2024-04-25T09:05:15.708829+0000","last_peered":"2024-04-25T09:05:15.708829+0000","last_clean":"2024-04-25T09:05:15.708829+0000","last_became_active":"2024-04-25T09:05:13.954671+0000","last_became_peered":"2024-04-25T09:05:13.954671+0000","last_unstale":"2024-04-25T09:05:15.708829+0000","last_undegraded":"2024-04-25T09:05:15.708829+0000","last_fullsized":"2024-04-25T09:05:15.708829+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:38.420341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986104+0000","last_change":"2024-04-25T09:05:13.946561+0000","last_active":"2024-04-25T09:05:15.986104+0000","last_peered":"2024-04-25T09:05:15.986104+0000","last_clean":"2024-04-25T09:05:15.986104+0000","last_became_active":"2024-04-25T09:05:13.946246+0000","last_became_peered":"2024-04-25T09:05:13.946246+0000","last_unstale":"2024-04-25T09:05:15.986104+0000","last_undegraded":"2024-04-25T09:05:15.986104+0000","last_fullsized":"2024-04-25T09:05:15.986104+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:35.779212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708811+0000","last_change":"2024-04-25T09:05:13.952953+0000","last_active":"2024-04-25T09:05:15.708811+0000","last_peered":"2024-04-25T09:05:15.708811+0000","last_clean":"2024-04-25T09:05:15.708811+0000","last_became_active":"2024-04-25T09:05:13.952610+0000","last_became_peered":"2024-04-25T09:05:13.952610+0000","last_unstale":"2024-04-25T09:05:15.708811+0000","last_undegraded":"2024-04-25T09:05:15.708811+0000","last_fullsized":"2024-04-25T09:05:15.708811+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:05.767806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346738+0000","last_change":"2024-04-25T09:05:13.944435+0000","last_active":"2024-04-25T09:05:15.346738+0000","last_peered":"2024-04-25T09:05:15.346738+0000","last_clean":"2024-04-25T09:05:15.346738+0000","last_became_active":"2024-04-25T09:05:13.942353+0000","last_became_peered":"2024-04-25T09:05:13.942353+0000","last_unstale":"2024-04-25T09:05:15.346738+0000","last_undegraded":"2024-04-25T09:05:15.346738+0000","last_fullsized":"2024-04-25T09:05:15.346738+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:26.239262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986074+0000","last_change":"2024-04-25T09:05:13.949012+0000","last_active":"2024-04-25T09:05:15.986074+0000","last_peered":"2024-04-25T09:05:15.986074+0000","last_clean":"2024-04-25T09:05:15.986074+0000","last_became_active":"2024-04-25T09:05:13.948742+0000","last_became_peered":"2024-04-25T09:05:13.948742+0000","last_unstale":"2024-04-25T09:05:15.986074+0000","last_undegraded":"2024-04-25T09:05:15.986074+0000","last_fullsized":"2024-04-25T09:05:15.986074+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:39.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052596+0000","last_change":"2024-04-25T09:05:13.950817+0000","last_active":"2024-04-25T09:05:15.052596+0000","last_peered":"2024-04-25T09:05:15.052596+0000","last_clean":"2024-04-25T09:05:15.052596+0000","last_became_active":"2024-04-25T09:05:13.949832+0000","last_became_peered":"2024-04-25T09:05:13.949832+0000","last_unstale":"2024-04-25T09:05:15.052596+0000","last_undegraded":"2024-04-25T09:05:15.052596+0000","last_fullsized":"2024-04-25T09:05:15.052596+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:02.302447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986446+0000","last_change":"2024-04-25T09:05:13.950901+0000","last_active":"2024-04-25T09:05:15.986446+0000","last_peered":"2024-04-25T09:05:15.986446+0000","last_clean":"2024-04-25T09:05:15.986446+0000","last_became_active":"2024-04-25T09:05:13.950232+0000","last_became_peered":"2024-04-25T09:05:13.950232+0000","last_unstale":"2024-04-25T09:05:15.986446+0000","last_undegraded":"2024-04-25T09:05:15.986446+0000","last_fullsized":"2024-04-25T09:05:15.986446+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:26.239262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986546+0000","last_change":"2024-04-25T09:05:13.943398+0000","last_active":"2024-04-25T09:05:15.986546+0000","last_peered":"2024-04-25T09:05:15.986546+0000","last_clean":"2024-04-25T09:05:15.986546+0000","last_became_active":"2024-04-25T09:05:13.943076+0000","last_became_peered":"2024-04-25T09:05:13.943076+0000","last_unstale":"2024-04-25T09:05:15.986546+0000","last_undegraded":"2024-04-25T09:05:15.986546+0000","last_fullsized":"2024-04-25T09:05:15.986546+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:21.559683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708882+0000","last_change":"2024-04-25T09:05:13.954983+0000","last_active":"2024-04-25T09:05:15.708882+0000","last_peered":"2024-04-25T09:05:15.708882+0000","last_clean":"2024-04-25T09:05:15.708882+0000","last_became_active":"2024-04-25T09:05:13.954410+0000","last_became_peered":"2024-04-25T09:05:13.954410+0000","last_unstale":"2024-04-25T09:05:15.708882+0000","last_undegraded":"2024-04-25T09:05:15.708882+0000","last_fullsized":"2024-04-25T09:05:15.708882+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:22.358320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933383+0000","last_change":"2024-04-25T09:05:13.944561+0000","last_active":"2024-04-25T09:05:14.933383+0000","last_peered":"2024-04-25T09:05:14.933383+0000","last_clean":"2024-04-25T09:05:14.933383+0000","last_became_active":"2024-04-25T09:05:13.944272+0000","last_became_peered":"2024-04-25T09:05:13.944272+0000","last_unstale":"2024-04-25T09:05:14.933383+0000","last_undegraded":"2024-04-25T09:05:14.933383+0000","last_fullsized":"2024-04-25T09:05:14.933383+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:52.987995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934818+0000","last_change":"2024-04-25T09:05:13.954883+0000","last_active":"2024-04-25T09:05:14.934818+0000","last_peered":"2024-04-25T09:05:14.934818+0000","last_clean":"2024-04-25T09:05:14.934818+0000","last_became_active":"2024-04-25T09:05:13.954608+0000","last_became_peered":"2024-04-25T09:05:13.954608+0000","last_unstale":"2024-04-25T09:05:14.934818+0000","last_undegraded":"2024-04-25T09:05:14.934818+0000","last_fullsized":"2024-04-25T09:05:14.934818+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:02.383939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933744+0000","last_change":"2024-04-25T09:05:13.952280+0000","last_active":"2024-04-25T09:05:14.933744+0000","last_peered":"2024-04-25T09:05:14.933744+0000","last_clean":"2024-04-25T09:05:14.933744+0000","last_became_active":"2024-04-25T09:05:13.951985+0000","last_became_peered":"2024-04-25T09:05:13.951985+0000","last_unstale":"2024-04-25T09:05:14.933744+0000","last_undegraded":"2024-04-25T09:05:14.933744+0000","last_fullsized":"2024-04-25T09:05:14.933744+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:55.356511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933537+0000","last_change":"2024-04-25T09:05:13.954111+0000","last_active":"2024-04-25T09:05:14.933537+0000","last_peered":"2024-04-25T09:05:14.933537+0000","last_clean":"2024-04-25T09:05:14.933537+0000","last_became_active":"2024-04-25T09:05:13.953841+0000","last_became_peered":"2024-04-25T09:05:13.953841+0000","last_unstale":"2024-04-25T09:05:14.933537+0000","last_undegraded":"2024-04-25T09:05:14.933537+0000","last_fullsized":"2024-04-25T09:05:14.933537+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:41.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346609+0000","last_change":"2024-04-25T09:05:13.939619+0000","last_active":"2024-04-25T09:05:15.346609+0000","last_peered":"2024-04-25T09:05:15.346609+0000","last_clean":"2024-04-25T09:05:15.346609+0000","last_became_active":"2024-04-25T09:05:13.938918+0000","last_became_peered":"2024-04-25T09:05:13.938918+0000","last_unstale":"2024-04-25T09:05:15.346609+0000","last_undegraded":"2024-04-25T09:05:15.346609+0000","last_fullsized":"2024-04-25T09:05:15.346609+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:35.779212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933939+0000","last_change":"2024-04-25T09:05:13.953940+0000","last_active":"2024-04-25T09:05:14.933939+0000","last_peered":"2024-04-25T09:05:14.933939+0000","last_clean":"2024-04-25T09:05:14.933939+0000","last_became_active":"2024-04-25T09:05:13.953683+0000","last_became_peered":"2024-04-25T09:05:13.953683+0000","last_unstale":"2024-04-25T09:05:14.933939+0000","last_undegraded":"2024-04-25T09:05:14.933939+0000","last_fullsized":"2024-04-25T09:05:14.933939+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:30.584572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.709007+0000","last_change":"2024-04-25T09:05:13.954703+0000","last_active":"2024-04-25T09:05:15.709007+0000","last_peered":"2024-04-25T09:05:15.709007+0000","last_clean":"2024-04-25T09:05:15.709007+0000","last_became_active":"2024-04-25T09:05:13.954063+0000","last_became_peered":"2024-04-25T09:05:13.954063+0000","last_unstale":"2024-04-25T09:05:15.709007+0000","last_undegraded":"2024-04-25T09:05:15.709007+0000","last_fullsized":"2024-04-25T09:05:15.709007+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:51.210835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"124'4","reported_seq":18,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346922+0000","last_change":"2024-04-25T09:05:12.948723+0000","last_active":"2024-04-25T09:05:15.346922+0000","last_peered":"2024-04-25T09:05:15.346922+0000","last_clean":"2024-04-25T09:05:15.346922+0000","last_became_active":"2024-04-25T09:05:12.948452+0000","last_became_peered":"2024-04-25T09:05:12.948452+0000","last_unstale":"2024-04-25T09:05:15.346922+0000","last_undegraded":"2024-04-25T09:05:15.346922+0000","last_fullsized":"2024-04-25T09:05:15.346922+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:05.824728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052840+0000","last_change":"2024-04-25T09:05:13.950877+0000","last_active":"2024-04-25T09:05:15.052840+0000","last_peered":"2024-04-25T09:05:15.052840+0000","last_clean":"2024-04-25T09:05:15.052840+0000","last_became_active":"2024-04-25T09:05:13.948813+0000","last_became_peered":"2024-04-25T09:05:13.948813+0000","last_unstale":"2024-04-25T09:05:15.052840+0000","last_undegraded":"2024-04-25T09:05:15.052840+0000","last_fullsized":"2024-04-25T09:05:15.052840+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:35.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935061+0000","last_change":"2024-04-25T09:05:12.947409+0000","last_active":"2024-04-25T09:05:14.935061+0000","last_peered":"2024-04-25T09:05:14.935061+0000","last_clean":"2024-04-25T09:05:14.935061+0000","last_became_active":"2024-04-25T09:05:12.947163+0000","last_became_peered":"2024-04-25T09:05:12.947163+0000","last_unstale":"2024-04-25T09:05:14.935061+0000","last_undegraded":"2024-04-25T09:05:14.935061+0000","last_fullsized":"2024-04-25T09:05:14.935061+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:38.074852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.347032+0000","last_change":"2024-04-25T09:05:13.943698+0000","last_active":"2024-04-25T09:05:15.347032+0000","last_peered":"2024-04-25T09:05:15.347032+0000","last_clean":"2024-04-25T09:05:15.347032+0000","last_became_active":"2024-04-25T09:05:13.943418+0000","last_became_peered":"2024-04-25T09:05:13.943418+0000","last_unstale":"2024-04-25T09:05:15.347032+0000","last_undegraded":"2024-04-25T09:05:15.347032+0000","last_fullsized":"2024-04-25T09:05:15.347032+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:47.226819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986211+0000","last_change":"2024-04-25T09:05:12.945846+0000","last_active":"2024-04-25T09:05:15.986211+0000","last_peered":"2024-04-25T09:05:15.986211+0000","last_clean":"2024-04-25T09:05:15.986211+0000","last_became_active":"2024-04-25T09:05:12.945567+0000","last_became_peered":"2024-04-25T09:05:12.945567+0000","last_unstale":"2024-04-25T09:05:15.986211+0000","last_undegraded":"2024-04-25T09:05:15.986211+0000","last_fullsized":"2024-04-25T09:05:15.986211+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:49.721840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346869+0000","last_change":"2024-04-25T09:05:13.942892+0000","last_active":"2024-04-25T09:05:15.346869+0000","last_peered":"2024-04-25T09:05:15.346869+0000","last_clean":"2024-04-25T09:05:15.346869+0000","last_became_active":"2024-04-25T09:05:13.942633+0000","last_became_peered":"2024-04-25T09:05:13.942633+0000","last_unstale":"2024-04-25T09:05:15.346869+0000","last_undegraded":"2024-04-25T09:05:15.346869+0000","last_fullsized":"2024-04-25T09:05:15.346869+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:28.992638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986481+0000","last_change":"2024-04-25T09:05:12.949931+0000","last_active":"2024-04-25T09:05:15.986481+0000","last_peered":"2024-04-25T09:05:15.986481+0000","last_clean":"2024-04-25T09:05:15.986481+0000","last_became_active":"2024-04-25T09:05:12.949637+0000","last_became_peered":"2024-04-25T09:05:12.949637+0000","last_unstale":"2024-04-25T09:05:15.986481+0000","last_undegraded":"2024-04-25T09:05:15.986481+0000","last_fullsized":"2024-04-25T09:05:15.986481+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:03.502584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708710+0000","last_change":"2024-04-25T09:05:13.955207+0000","last_active":"2024-04-25T09:05:15.708710+0000","last_peered":"2024-04-25T09:05:15.708710+0000","last_clean":"2024-04-25T09:05:15.708710+0000","last_became_active":"2024-04-25T09:05:13.954887+0000","last_became_peered":"2024-04-25T09:05:13.954887+0000","last_unstale":"2024-04-25T09:05:15.708710+0000","last_undegraded":"2024-04-25T09:05:15.708710+0000","last_fullsized":"2024-04-25T09:05:15.708710+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:42.620148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986912+0000","last_change":"2024-04-25T09:05:12.940545+0000","last_active":"2024-04-25T09:05:15.986912+0000","last_peered":"2024-04-25T09:05:15.986912+0000","last_clean":"2024-04-25T09:05:15.986912+0000","last_became_active":"2024-04-25T09:05:12.940215+0000","last_became_peered":"2024-04-25T09:05:12.940215+0000","last_unstale":"2024-04-25T09:05:15.986912+0000","last_undegraded":"2024-04-25T09:05:15.986912+0000","last_fullsized":"2024-04-25T09:05:15.986912+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:42.973136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934456+0000","last_change":"2024-04-25T09:05:13.944968+0000","last_active":"2024-04-25T09:05:14.934456+0000","last_peered":"2024-04-25T09:05:14.934456+0000","last_clean":"2024-04-25T09:05:14.934456+0000","last_became_active":"2024-04-25T09:05:13.944695+0000","last_became_peered":"2024-04-25T09:05:13.944695+0000","last_unstale":"2024-04-25T09:05:14.934456+0000","last_undegraded":"2024-04-25T09:05:14.934456+0000","last_fullsized":"2024-04-25T09:05:14.934456+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:43.945176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708573+0000","last_change":"2024-04-25T09:05:12.949159+0000","last_active":"2024-04-25T09:05:15.708573+0000","last_peered":"2024-04-25T09:05:15.708573+0000","last_clean":"2024-04-25T09:05:15.708573+0000","last_became_active":"2024-04-25T09:05:12.948748+0000","last_became_peered":"2024-04-25T09:05:12.948748+0000","last_unstale":"2024-04-25T09:05:15.708573+0000","last_undegraded":"2024-04-25T09:05:15.708573+0000","last_fullsized":"2024-04-25T09:05:15.708573+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:25.373366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052649+0000","last_change":"2024-04-25T09:05:13.956593+0000","last_active":"2024-04-25T09:05:15.052649+0000","last_peered":"2024-04-25T09:05:15.052649+0000","last_clean":"2024-04-25T09:05:15.052649+0000","last_became_active":"2024-04-25T09:05:13.955699+0000","last_became_peered":"2024-04-25T09:05:13.955699+0000","last_unstale":"2024-04-25T09:05:15.052649+0000","last_undegraded":"2024-04-25T09:05:15.052649+0000","last_fullsized":"2024-04-25T09:05:15.052649+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:55.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934492+0000","last_change":"2024-04-25T09:05:12.942928+0000","last_active":"2024-04-25T09:05:14.934492+0000","last_peered":"2024-04-25T09:05:14.934492+0000","last_clean":"2024-04-25T09:05:14.934492+0000","last_became_active":"2024-04-25T09:05:12.942615+0000","last_became_peered":"2024-04-25T09:05:12.942615+0000","last_unstale":"2024-04-25T09:05:14.934492+0000","last_undegraded":"2024-04-25T09:05:14.934492+0000","last_fullsized":"2024-04-25T09:05:14.934492+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:52.830885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986482+0000","last_change":"2024-04-25T09:05:13.956048+0000","last_active":"2024-04-25T09:05:15.986482+0000","last_peered":"2024-04-25T09:05:15.986482+0000","last_clean":"2024-04-25T09:05:15.986482+0000","last_became_active":"2024-04-25T09:05:13.955628+0000","last_became_peered":"2024-04-25T09:05:13.955628+0000","last_unstale":"2024-04-25T09:05:15.986482+0000","last_undegraded":"2024-04-25T09:05:15.986482+0000","last_fullsized":"2024-04-25T09:05:15.986482+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:58.398021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985846+0000","last_change":"2024-04-25T09:05:12.945505+0000","last_active":"2024-04-25T09:05:15.985846+0000","last_peered":"2024-04-25T09:05:15.985846+0000","last_clean":"2024-04-25T09:05:15.985846+0000","last_became_active":"2024-04-25T09:05:12.945215+0000","last_became_peered":"2024-04-25T09:05:12.945215+0000","last_unstale":"2024-04-25T09:05:15.985846+0000","last_undegraded":"2024-04-25T09:05:15.985846+0000","last_fullsized":"2024-04-25T09:05:15.985846+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:14.335976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933625+0000","last_change":"2024-04-25T09:05:13.948442+0000","last_active":"2024-04-25T09:05:14.933625+0000","last_peered":"2024-04-25T09:05:14.933625+0000","last_clean":"2024-04-25T09:05:14.933625+0000","last_became_active":"2024-04-25T09:05:13.947754+0000","last_became_peered":"2024-04-25T09:05:13.947754+0000","last_unstale":"2024-04-25T09:05:14.933625+0000","last_undegraded":"2024-04-25T09:05:14.933625+0000","last_fullsized":"2024-04-25T09:05:14.933625+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:52.169113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935564+0000","last_change":"2024-04-25T09:05:12.945461+0000","last_active":"2024-04-25T09:05:14.935564+0000","last_peered":"2024-04-25T09:05:14.935564+0000","last_clean":"2024-04-25T09:05:14.935564+0000","last_became_active":"2024-04-25T09:05:12.945082+0000","last_became_peered":"2024-04-25T09:05:12.945082+0000","last_unstale":"2024-04-25T09:05:14.935564+0000","last_undegraded":"2024-04-25T09:05:14.935564+0000","last_fullsized":"2024-04-25T09:05:14.935564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:29.659051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935365+0000","last_change":"2024-04-25T09:05:13.954901+0000","last_active":"2024-04-25T09:05:14.935365+0000","last_peered":"2024-04-25T09:05:14.935365+0000","last_clean":"2024-04-25T09:05:14.935365+0000","last_became_active":"2024-04-25T09:05:13.954629+0000","last_became_peered":"2024-04-25T09:05:13.954629+0000","last_unstale":"2024-04-25T09:05:14.935365+0000","last_undegraded":"2024-04-25T09:05:14.935365+0000","last_fullsized":"2024-04-25T09:05:14.935365+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:59.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708981+0000","last_change":"2024-04-25T09:05:12.944791+0000","last_active":"2024-04-25T09:05:15.708981+0000","last_peered":"2024-04-25T09:05:15.708981+0000","last_clean":"2024-04-25T09:05:15.708981+0000","last_became_active":"2024-04-25T09:05:12.944514+0000","last_became_peered":"2024-04-25T09:05:12.944514+0000","last_unstale":"2024-04-25T09:05:15.708981+0000","last_undegraded":"2024-04-25T09:05:15.708981+0000","last_fullsized":"2024-04-25T09:05:15.708981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:06.758623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.347049+0000","last_change":"2024-04-25T09:05:13.956984+0000","last_active":"2024-04-25T09:05:15.347049+0000","last_peered":"2024-04-25T09:05:15.347049+0000","last_clean":"2024-04-25T09:05:15.347049+0000","last_became_active":"2024-04-25T09:05:13.956705+0000","last_became_peered":"2024-04-25T09:05:13.956705+0000","last_unstale":"2024-04-25T09:05:15.347049+0000","last_undegraded":"2024-04-25T09:05:15.347049+0000","last_fullsized":"2024-04-25T09:05:15.347049+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:31.434095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"124'3","reported_seq":17,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935162+0000","last_change":"2024-04-25T09:05:12.949152+0000","last_active":"2024-04-25T09:05:14.935162+0000","last_peered":"2024-04-25T09:05:14.935162+0000","last_clean":"2024-04-25T09:05:14.935162+0000","last_became_active":"2024-04-25T09:05:12.948791+0000","last_became_peered":"2024-04-25T09:05:12.948791+0000","last_unstale":"2024-04-25T09:05:14.935162+0000","last_undegraded":"2024-04-25T09:05:14.935162+0000","last_fullsized":"2024-04-25T09:05:14.935162+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:42.786281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346990+0000","last_change":"2024-04-25T09:05:13.954021+0000","last_active":"2024-04-25T09:05:15.346990+0000","last_peered":"2024-04-25T09:05:15.346990+0000","last_clean":"2024-04-25T09:05:15.346990+0000","last_became_active":"2024-04-25T09:05:13.953156+0000","last_became_peered":"2024-04-25T09:05:13.953156+0000","last_unstale":"2024-04-25T09:05:15.346990+0000","last_undegraded":"2024-04-25T09:05:15.346990+0000","last_fullsized":"2024-04-25T09:05:15.346990+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:09.180406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"124'6","reported_seq":20,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052506+0000","last_change":"2024-04-25T09:05:12.945110+0000","last_active":"2024-04-25T09:05:15.052506+0000","last_peered":"2024-04-25T09:05:15.052506+0000","last_clean":"2024-04-25T09:05:15.052506+0000","last_became_active":"2024-04-25T09:05:12.944122+0000","last_became_peered":"2024-04-25T09:05:12.944122+0000","last_unstale":"2024-04-25T09:05:15.052506+0000","last_undegraded":"2024-04-25T09:05:15.052506+0000","last_fullsized":"2024-04-25T09:05:15.052506+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:38.074852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933784+0000","last_change":"2024-04-25T09:05:13.949744+0000","last_active":"2024-04-25T09:05:14.933784+0000","last_peered":"2024-04-25T09:05:14.933784+0000","last_clean":"2024-04-25T09:05:14.933784+0000","last_became_active":"2024-04-25T09:05:13.949384+0000","last_became_peered":"2024-04-25T09:05:13.949384+0000","last_unstale":"2024-04-25T09:05:14.933784+0000","last_undegraded":"2024-04-25T09:05:14.933784+0000","last_fullsized":"2024-04-25T09:05:14.933784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:58.398021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933483+0000","last_change":"2024-04-25T09:05:12.941506+0000","last_active":"2024-04-25T09:05:14.933483+0000","last_peered":"2024-04-25T09:05:14.933483+0000","last_clean":"2024-04-25T09:05:14.933483+0000","last_became_active":"2024-04-25T09:05:12.941188+0000","last_became_peered":"2024-04-25T09:05:12.941188+0000","last_unstale":"2024-04-25T09:05:14.933483+0000","last_undegraded":"2024-04-25T09:05:14.933483+0000","last_fullsized":"2024-04-25T09:05:14.933483+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:42.973136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985701+0000","last_change":"2024-04-25T09:05:13.952656+0000","last_active":"2024-04-25T09:05:15.985701+0000","last_peered":"2024-04-25T09:05:15.985701+0000","last_clean":"2024-04-25T09:05:15.985701+0000","last_became_active":"2024-04-25T09:05:13.952357+0000","last_became_peered":"2024-04-25T09:05:13.952357+0000","last_unstale":"2024-04-25T09:05:15.985701+0000","last_undegraded":"2024-04-25T09:05:15.985701+0000","last_fullsized":"2024-04-25T09:05:15.985701+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:41.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986137+0000","last_change":"2024-04-25T09:05:12.948905+0000","last_active":"2024-04-25T09:05:15.986137+0000","last_peered":"2024-04-25T09:05:15.986137+0000","last_clean":"2024-04-25T09:05:15.986137+0000","last_became_active":"2024-04-25T09:05:12.948630+0000","last_became_peered":"2024-04-25T09:05:12.948630+0000","last_unstale":"2024-04-25T09:05:15.986137+0000","last_undegraded":"2024-04-25T09:05:15.986137+0000","last_fullsized":"2024-04-25T09:05:15.986137+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:43.417887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052508+0000","last_change":"2024-04-25T09:05:13.952250+0000","last_active":"2024-04-25T09:05:15.052508+0000","last_peered":"2024-04-25T09:05:15.052508+0000","last_clean":"2024-04-25T09:05:15.052508+0000","last_became_active":"2024-04-25T09:05:13.951890+0000","last_became_peered":"2024-04-25T09:05:13.951890+0000","last_unstale":"2024-04-25T09:05:15.052508+0000","last_undegraded":"2024-04-25T09:05:15.052508+0000","last_fullsized":"2024-04-25T09:05:15.052508+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:30.584572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"124'8","reported_seq":22,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052755+0000","last_change":"2024-04-25T09:05:12.943134+0000","last_active":"2024-04-25T09:05:15.052755+0000","last_peered":"2024-04-25T09:05:15.052755+0000","last_clean":"2024-04-25T09:05:15.052755+0000","last_became_active":"2024-04-25T09:05:12.942838+0000","last_became_peered":"2024-04-25T09:05:12.942838+0000","last_unstale":"2024-04-25T09:05:15.052755+0000","last_undegraded":"2024-04-25T09:05:15.052755+0000","last_fullsized":"2024-04-25T09:05:15.052755+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:21.331404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.052835+0000","last_change":"2024-04-25T09:05:13.955241+0000","last_active":"2024-04-25T09:05:15.052835+0000","last_peered":"2024-04-25T09:05:15.052835+0000","last_clean":"2024-04-25T09:05:15.052835+0000","last_became_active":"2024-04-25T09:05:13.954931+0000","last_became_peered":"2024-04-25T09:05:13.954931+0000","last_unstale":"2024-04-25T09:05:15.052835+0000","last_undegraded":"2024-04-25T09:05:15.052835+0000","last_fullsized":"2024-04-25T09:05:15.052835+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:31.157523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935556+0000","last_change":"2024-04-25T09:05:12.944361+0000","last_active":"2024-04-25T09:05:14.935556+0000","last_peered":"2024-04-25T09:05:14.935556+0000","last_clean":"2024-04-25T09:05:14.935556+0000","last_became_active":"2024-04-25T09:05:12.944071+0000","last_became_peered":"2024-04-25T09:05:12.944071+0000","last_unstale":"2024-04-25T09:05:14.935556+0000","last_undegraded":"2024-04-25T09:05:14.935556+0000","last_fullsized":"2024-04-25T09:05:14.935556+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:52.830885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.935440+0000","last_change":"2024-04-25T09:05:13.949987+0000","last_active":"2024-04-25T09:05:14.935440+0000","last_peered":"2024-04-25T09:05:14.935440+0000","last_clean":"2024-04-25T09:05:14.935440+0000","last_became_active":"2024-04-25T09:05:13.949684+0000","last_became_peered":"2024-04-25T09:05:13.949684+0000","last_unstale":"2024-04-25T09:05:14.935440+0000","last_undegraded":"2024-04-25T09:05:14.935440+0000","last_fullsized":"2024-04-25T09:05:14.935440+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:57.308475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986414+0000","last_change":"2024-04-25T09:05:12.945488+0000","last_active":"2024-04-25T09:05:15.986414+0000","last_peered":"2024-04-25T09:05:15.986414+0000","last_clean":"2024-04-25T09:05:15.986414+0000","last_became_active":"2024-04-25T09:05:12.945110+0000","last_became_peered":"2024-04-25T09:05:12.945110+0000","last_unstale":"2024-04-25T09:05:15.986414+0000","last_undegraded":"2024-04-25T09:05:15.986414+0000","last_fullsized":"2024-04-25T09:05:15.986414+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:41.615190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708937+0000","last_change":"2024-04-25T09:05:13.952899+0000","last_active":"2024-04-25T09:05:15.708937+0000","last_peered":"2024-04-25T09:05:15.708937+0000","last_clean":"2024-04-25T09:05:15.708937+0000","last_became_active":"2024-04-25T09:05:13.952549+0000","last_became_peered":"2024-04-25T09:05:13.952549+0000","last_unstale":"2024-04-25T09:05:15.708937+0000","last_undegraded":"2024-04-25T09:05:15.708937+0000","last_fullsized":"2024-04-25T09:05:15.708937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:55.228401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934400+0000","last_change":"2024-04-25T09:05:12.940973+0000","last_active":"2024-04-25T09:05:14.934400+0000","last_peered":"2024-04-25T09:05:14.934400+0000","last_clean":"2024-04-25T09:05:14.934400+0000","last_became_active":"2024-04-25T09:05:12.940676+0000","last_became_peered":"2024-04-25T09:05:12.940676+0000","last_unstale":"2024-04-25T09:05:14.934400+0000","last_undegraded":"2024-04-25T09:05:14.934400+0000","last_fullsized":"2024-04-25T09:05:14.934400+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:33.981439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986639+0000","last_change":"2024-04-25T09:05:13.955672+0000","last_active":"2024-04-25T09:05:15.986639+0000","last_peered":"2024-04-25T09:05:15.986639+0000","last_clean":"2024-04-25T09:05:15.986639+0000","last_became_active":"2024-04-25T09:05:13.955354+0000","last_became_peered":"2024-04-25T09:05:13.955354+0000","last_unstale":"2024-04-25T09:05:15.986639+0000","last_undegraded":"2024-04-25T09:05:15.986639+0000","last_fullsized":"2024-04-25T09:05:15.986639+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:26.239277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934930+0000","last_change":"2024-04-25T09:05:12.942489+0000","last_active":"2024-04-25T09:05:14.934930+0000","last_peered":"2024-04-25T09:05:14.934930+0000","last_clean":"2024-04-25T09:05:14.934930+0000","last_became_active":"2024-04-25T09:05:12.942196+0000","last_became_peered":"2024-04-25T09:05:12.942196+0000","last_unstale":"2024-04-25T09:05:14.934930+0000","last_undegraded":"2024-04-25T09:05:14.934930+0000","last_fullsized":"2024-04-25T09:05:14.934930+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:21.331404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933364+0000","last_change":"2024-04-25T09:05:13.943739+0000","last_active":"2024-04-25T09:05:14.933364+0000","last_peered":"2024-04-25T09:05:14.933364+0000","last_clean":"2024-04-25T09:05:14.933364+0000","last_became_active":"2024-04-25T09:05:13.943446+0000","last_became_peered":"2024-04-25T09:05:13.943446+0000","last_unstale":"2024-04-25T09:05:14.933364+0000","last_undegraded":"2024-04-25T09:05:14.933364+0000","last_fullsized":"2024-04-25T09:05:14.933364+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:17.917315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934868+0000","last_change":"2024-04-25T09:05:12.948507+0000","last_active":"2024-04-25T09:05:14.934868+0000","last_peered":"2024-04-25T09:05:14.934868+0000","last_clean":"2024-04-25T09:05:14.934868+0000","last_became_active":"2024-04-25T09:05:12.948204+0000","last_became_peered":"2024-04-25T09:05:12.948204+0000","last_unstale":"2024-04-25T09:05:14.934868+0000","last_undegraded":"2024-04-25T09:05:14.934868+0000","last_fullsized":"2024-04-25T09:05:14.934868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:31.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934357+0000","last_change":"2024-04-25T09:05:13.953471+0000","last_active":"2024-04-25T09:05:14.934357+0000","last_peered":"2024-04-25T09:05:14.934357+0000","last_clean":"2024-04-25T09:05:14.934357+0000","last_became_active":"2024-04-25T09:05:13.952970+0000","last_became_peered":"2024-04-25T09:05:13.952970+0000","last_unstale":"2024-04-25T09:05:14.934357+0000","last_undegraded":"2024-04-25T09:05:14.934357+0000","last_fullsized":"2024-04-25T09:05:14.934357+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:55.864467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708927+0000","last_change":"2024-04-25T09:05:12.948486+0000","last_active":"2024-04-25T09:05:15.708927+0000","last_peered":"2024-04-25T09:05:15.708927+0000","last_clean":"2024-04-25T09:05:15.708927+0000","last_became_active":"2024-04-25T09:05:12.948165+0000","last_became_peered":"2024-04-25T09:05:12.948165+0000","last_unstale":"2024-04-25T09:05:15.708927+0000","last_undegraded":"2024-04-25T09:05:15.708927+0000","last_fullsized":"2024-04-25T09:05:15.708927+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:19.579938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985738+0000","last_change":"2024-04-25T09:05:13.949132+0000","last_active":"2024-04-25T09:05:15.985738+0000","last_peered":"2024-04-25T09:05:15.985738+0000","last_clean":"2024-04-25T09:05:15.985738+0000","last_became_active":"2024-04-25T09:05:13.948826+0000","last_became_peered":"2024-04-25T09:05:13.948826+0000","last_unstale":"2024-04-25T09:05:15.985738+0000","last_undegraded":"2024-04-25T09:05:15.985738+0000","last_fullsized":"2024-04-25T09:05:15.985738+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:19.312127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708496+0000","last_change":"2024-04-25T09:05:12.943912+0000","last_active":"2024-04-25T09:05:15.708496+0000","last_peered":"2024-04-25T09:05:15.708496+0000","last_clean":"2024-04-25T09:05:15.708496+0000","last_became_active":"2024-04-25T09:05:12.943550+0000","last_became_peered":"2024-04-25T09:05:12.943550+0000","last_unstale":"2024-04-25T09:05:15.708496+0000","last_undegraded":"2024-04-25T09:05:15.708496+0000","last_fullsized":"2024-04-25T09:05:15.708496+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:34.105259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346604+0000","last_change":"2024-04-25T09:05:13.940015+0000","last_active":"2024-04-25T09:05:15.346604+0000","last_peered":"2024-04-25T09:05:15.346604+0000","last_clean":"2024-04-25T09:05:15.346604+0000","last_became_active":"2024-04-25T09:05:13.939356+0000","last_became_peered":"2024-04-25T09:05:13.939356+0000","last_unstale":"2024-04-25T09:05:15.346604+0000","last_undegraded":"2024-04-25T09:05:15.346604+0000","last_fullsized":"2024-04-25T09:05:15.346604+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:39.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986433+0000","last_change":"2024-04-25T09:05:12.945313+0000","last_active":"2024-04-25T09:05:15.986433+0000","last_peered":"2024-04-25T09:05:15.986433+0000","last_clean":"2024-04-25T09:05:15.986433+0000","last_became_active":"2024-04-25T09:05:12.945002+0000","last_became_peered":"2024-04-25T09:05:12.945002+0000","last_unstale":"2024-04-25T09:05:15.986433+0000","last_undegraded":"2024-04-25T09:05:15.986433+0000","last_fullsized":"2024-04-25T09:05:15.986433+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:33.975710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934603+0000","last_change":"2024-04-25T09:05:13.942578+0000","last_active":"2024-04-25T09:05:14.934603+0000","last_peered":"2024-04-25T09:05:14.934603+0000","last_clean":"2024-04-25T09:05:14.934603+0000","last_became_active":"2024-04-25T09:05:13.942282+0000","last_became_peered":"2024-04-25T09:05:13.942282+0000","last_unstale":"2024-04-25T09:05:14.934603+0000","last_undegraded":"2024-04-25T09:05:14.934603+0000","last_fullsized":"2024-04-25T09:05:14.934603+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:35.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933765+0000","last_change":"2024-04-25T09:05:12.943115+0000","last_active":"2024-04-25T09:05:14.933765+0000","last_peered":"2024-04-25T09:05:14.933765+0000","last_clean":"2024-04-25T09:05:14.933765+0000","last_became_active":"2024-04-25T09:05:12.942795+0000","last_became_peered":"2024-04-25T09:05:12.942795+0000","last_unstale":"2024-04-25T09:05:14.933765+0000","last_undegraded":"2024-04-25T09:05:14.933765+0000","last_fullsized":"2024-04-25T09:05:14.933765+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:00.695952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.933793+0000","last_change":"2024-04-25T09:05:13.952978+0000","last_active":"2024-04-25T09:05:14.933793+0000","last_peered":"2024-04-25T09:05:14.933793+0000","last_clean":"2024-04-25T09:05:14.933793+0000","last_became_active":"2024-04-25T09:05:13.952717+0000","last_became_peered":"2024-04-25T09:05:13.952717+0000","last_unstale":"2024-04-25T09:05:14.933793+0000","last_undegraded":"2024-04-25T09:05:14.933793+0000","last_fullsized":"2024-04-25T09:05:14.933793+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:21.559683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"125'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.938089+0000","last_change":"2024-04-25T09:05:12.946181+0000","last_active":"2024-04-25T09:05:15.938089+0000","last_peered":"2024-04-25T09:05:15.938089+0000","last_clean":"2024-04-25T09:05:15.938089+0000","last_became_active":"2024-04-25T09:05:12.945727+0000","last_became_peered":"2024-04-25T09:05:12.945727+0000","last_unstale":"2024-04-25T09:05:15.938089+0000","last_undegraded":"2024-04-25T09:05:15.938089+0000","last_fullsized":"2024-04-25T09:05:15.938089+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:21.399297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986362+0000","last_change":"2024-04-25T09:05:13.944167+0000","last_active":"2024-04-25T09:05:15.986362+0000","last_peered":"2024-04-25T09:05:15.986362+0000","last_clean":"2024-04-25T09:05:15.986362+0000","last_became_active":"2024-04-25T09:05:13.943890+0000","last_became_peered":"2024-04-25T09:05:13.943890+0000","last_unstale":"2024-04-25T09:05:15.986362+0000","last_undegraded":"2024-04-25T09:05:15.986362+0000","last_fullsized":"2024-04-25T09:05:15.986362+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:55.356511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986682+0000","last_change":"2024-04-25T09:05:12.944455+0000","last_active":"2024-04-25T09:05:15.986682+0000","last_peered":"2024-04-25T09:05:15.986682+0000","last_clean":"2024-04-25T09:05:15.986682+0000","last_became_active":"2024-04-25T09:05:12.944150+0000","last_became_peered":"2024-04-25T09:05:12.944150+0000","last_unstale":"2024-04-25T09:05:15.986682+0000","last_undegraded":"2024-04-25T09:05:15.986682+0000","last_fullsized":"2024-04-25T09:05:15.986682+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:09.218747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934446+0000","last_change":"2024-04-25T09:05:13.942616+0000","last_active":"2024-04-25T09:05:14.934446+0000","last_peered":"2024-04-25T09:05:14.934446+0000","last_clean":"2024-04-25T09:05:14.934446+0000","last_became_active":"2024-04-25T09:05:13.942329+0000","last_became_peered":"2024-04-25T09:05:13.942329+0000","last_unstale":"2024-04-25T09:05:14.934446+0000","last_undegraded":"2024-04-25T09:05:14.934446+0000","last_fullsized":"2024-04-25T09:05:14.934446+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:31.157523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.985968+0000","last_change":"2024-04-25T09:05:12.946819+0000","last_active":"2024-04-25T09:05:15.985968+0000","last_peered":"2024-04-25T09:05:15.985968+0000","last_clean":"2024-04-25T09:05:15.985968+0000","last_became_active":"2024-04-25T09:05:12.946530+0000","last_became_peered":"2024-04-25T09:05:12.946530+0000","last_unstale":"2024-04-25T09:05:15.985968+0000","last_undegraded":"2024-04-25T09:05:15.985968+0000","last_fullsized":"2024-04-25T09:05:15.985968+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:11.912676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346590+0000","last_change":"2024-04-25T09:05:13.943648+0000","last_active":"2024-04-25T09:05:15.346590+0000","last_peered":"2024-04-25T09:05:15.346590+0000","last_clean":"2024-04-25T09:05:15.346590+0000","last_became_active":"2024-04-25T09:05:13.943373+0000","last_became_peered":"2024-04-25T09:05:13.943373+0000","last_unstale":"2024-04-25T09:05:15.346590+0000","last_undegraded":"2024-04-25T09:05:15.346590+0000","last_fullsized":"2024-04-25T09:05:15.346590+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:08.578032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986889+0000","last_change":"2024-04-25T09:05:12.949016+0000","last_active":"2024-04-25T09:05:15.986889+0000","last_peered":"2024-04-25T09:05:15.986889+0000","last_clean":"2024-04-25T09:05:15.986889+0000","last_became_active":"2024-04-25T09:05:12.948732+0000","last_became_peered":"2024-04-25T09:05:12.948732+0000","last_unstale":"2024-04-25T09:05:15.986889+0000","last_undegraded":"2024-04-25T09:05:15.986889+0000","last_fullsized":"2024-04-25T09:05:15.986889+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:00.695952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:14.934923+0000","last_change":"2024-04-25T09:05:13.938556+0000","last_active":"2024-04-25T09:05:14.934923+0000","last_peered":"2024-04-25T09:05:14.934923+0000","last_clean":"2024-04-25T09:05:14.934923+0000","last_became_active":"2024-04-25T09:05:13.938265+0000","last_became_peered":"2024-04-25T09:05:13.938265+0000","last_unstale":"2024-04-25T09:05:14.934923+0000","last_undegraded":"2024-04-25T09:05:14.934923+0000","last_fullsized":"2024-04-25T09:05:14.934923+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:25.713837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346761+0000","last_change":"2024-04-25T09:05:12.950194+0000","last_active":"2024-04-25T09:05:15.346761+0000","last_peered":"2024-04-25T09:05:15.346761+0000","last_clean":"2024-04-25T09:05:15.346761+0000","last_became_active":"2024-04-25T09:05:12.949893+0000","last_became_peered":"2024-04-25T09:05:12.949893+0000","last_unstale":"2024-04-25T09:05:15.346761+0000","last_undegraded":"2024-04-25T09:05:15.346761+0000","last_fullsized":"2024-04-25T09:05:15.346761+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:12.931384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708762+0000","last_change":"2024-04-25T09:05:13.954372+0000","last_active":"2024-04-25T09:05:15.708762+0000","last_peered":"2024-04-25T09:05:15.708762+0000","last_clean":"2024-04-25T09:05:15.708762+0000","last_became_active":"2024-04-25T09:05:13.954079+0000","last_became_peered":"2024-04-25T09:05:13.954079+0000","last_unstale":"2024-04-25T09:05:15.708762+0000","last_undegraded":"2024-04-25T09:05:15.708762+0000","last_fullsized":"2024-04-25T09:05:15.708762+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:34.980667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.708574+0000","last_change":"2024-04-25T09:05:12.947672+0000","last_active":"2024-04-25T09:05:15.708574+0000","last_peered":"2024-04-25T09:05:15.708574+0000","last_clean":"2024-04-25T09:05:15.708574+0000","last_became_active":"2024-04-25T09:05:12.947279+0000","last_became_peered":"2024-04-25T09:05:12.947279+0000","last_unstale":"2024-04-25T09:05:15.708574+0000","last_undegraded":"2024-04-25T09:05:15.708574+0000","last_fullsized":"2024-04-25T09:05:15.708574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:58.122283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986019+0000","last_change":"2024-04-25T09:05:13.945486+0000","last_active":"2024-04-25T09:05:15.986019+0000","last_peered":"2024-04-25T09:05:15.986019+0000","last_clean":"2024-04-25T09:05:15.986019+0000","last_became_active":"2024-04-25T09:05:13.945134+0000","last_became_peered":"2024-04-25T09:05:13.945134+0000","last_unstale":"2024-04-25T09:05:15.986019+0000","last_undegraded":"2024-04-25T09:05:15.986019+0000","last_fullsized":"2024-04-25T09:05:15.986019+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:52.169113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.986542+0000","last_change":"2024-04-25T09:05:12.941940+0000","last_active":"2024-04-25T09:05:15.986542+0000","last_peered":"2024-04-25T09:05:15.986542+0000","last_clean":"2024-04-25T09:05:15.986542+0000","last_became_active":"2024-04-25T09:05:12.941649+0000","last_became_peered":"2024-04-25T09:05:12.941649+0000","last_unstale":"2024-04-25T09:05:15.986542+0000","last_undegraded":"2024-04-25T09:05:15.986542+0000","last_fullsized":"2024-04-25T09:05:15.986542+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:37.415384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346586+0000","last_change":"2024-04-25T09:05:13.938616+0000","last_active":"2024-04-25T09:05:15.346586+0000","last_peered":"2024-04-25T09:05:15.346586+0000","last_clean":"2024-04-25T09:05:15.346586+0000","last_became_active":"2024-04-25T09:05:13.938319+0000","last_became_peered":"2024-04-25T09:05:13.938319+0000","last_unstale":"2024-04-25T09:05:15.346586+0000","last_undegraded":"2024-04-25T09:05:15.346586+0000","last_fullsized":"2024-04-25T09:05:15.346586+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:12.923343+0000","last_clean_scrub_stamp":"2024-04-25T09:05:12.923343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:51.210835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346953+0000","last_change":"2024-04-25T09:05:12.949516+0000","last_active":"2024-04-25T09:05:15.346953+0000","last_peered":"2024-04-25T09:05:15.346953+0000","last_clean":"2024-04-25T09:05:15.346953+0000","last_became_active":"2024-04-25T09:05:12.949258+0000","last_became_peered":"2024-04-25T09:05:12.949258+0000","last_unstale":"2024-04-25T09:05:15.346953+0000","last_undegraded":"2024-04-25T09:05:15.346953+0000","last_fullsized":"2024-04-25T09:05:15.346953+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:11.918385+0000","last_clean_scrub_stamp":"2024-04-25T09:05:11.918385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:51.289672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":366,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-25T09:05:15.346337+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:05:15.346337+0000","last_peered":"2024-04-25T09:05:15.346337+0000","last_clean":"2024-04-25T09:05:15.346337+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:05:15.346337+0000","last_undegraded":"2024-04-25T09:05:15.346337+0000","last_fullsized":"2024-04-25T09:05:15.346337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51356,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320484,"statfs":{"total":96636764160,"available":96584175616,"internally_reserved":0,"allocated":2179072,"data_stored":1271377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54928,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316912,"statfs":{"total":96636764160,"available":96580517888,"internally_reserved":0,"allocated":1572864,"data_stored":680371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46604,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325236,"statfs":{"total":96636764160,"available":96589041664,"internally_reserved":0,"allocated":1568768,"data_stored":678871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54924,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316916,"statfs":{"total":96636764160,"available":96580521984,"internally_reserved":0,"allocated":1564672,"data_stored":678829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54924,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316916,"statfs":{"total":96636764160,"available":96580521984,"internally_reserved":0,"allocated":1568768,"data_stored":678919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574956,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54920,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316920,"statfs":{"total":96636764160,"available":96580526080,"internally_reserved":0,"allocated":1568768,"data_stored":679375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46588,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325252,"statfs":{"total":96636764160,"available":96589058048,"internally_reserved":0,"allocated":1548288,"data_stored":672459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33284,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338556,"statfs":{"total":96636764160,"available":96602681344,"internally_reserved":0,"allocated":2154496,"data_stored":1269127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:05:17.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:05:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.442+0000 7f86c507c640 1 Processor -- start 2024-04-25T09:05:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.442+0000 7f86c507c640 1 -- start start 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86c507c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c015df90 0x7f86c00b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86c507c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c00b5600 0x7f86c00b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86c507c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86c00b6cb0 0x7f86c00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86c507c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c00b5fa0 con 0x7f86c00b5600 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86c507c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c00b8180 con 0x7f86c00b6cb0 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86c507c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00b8460 con 0x7f86c015df90 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c00b5600 0x7f86c00b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c00b5600 0x7f86c00b5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41144/0 (socket says 172.21.15.5:41144) 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 -- 172.21.15.5:0/2856858018 learned_addr learned my addr 172.21.15.5:0/2856858018 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86bed9d640 1 --2- 172.21.15.5:0/2856858018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c015df90 0x7f86c00b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86bf59e640 1 --2- 172.21.15.5:0/2856858018 >> v2:172.21.15.80:3300/0 conn(0x7f86c00b6cb0 0x7f86c00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 -- 172.21.15.5:0/2856858018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c015df90 msgr2=0x7f86c00b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 --2- 172.21.15.5:0/2856858018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c015df90 0x7f86c00b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 -- 172.21.15.5:0/2856858018 >> v2:172.21.15.80:3300/0 conn(0x7f86c00b6cb0 msgr2=0x7f86c00b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 --2- 172.21.15.5:0/2856858018 >> v2:172.21.15.80:3300/0 conn(0x7f86c00b6cb0 0x7f86c00b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.443+0000 7f86be59c640 1 -- 172.21.15.5:0/2856858018 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00b8740 con 0x7f86c00b5600 2024-04-25T09:05:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.444+0000 7f86be59c640 1 --2- 172.21.15.5:0/2856858018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b5600 0x7f86c00b5a60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f86c00d16e0 tx=0x7f86a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e987e9dc0df82a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.444+0000 7f86bdd9b640 1 -- 172.21.15.5:0/2856858018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8037070 con 0x7f86c00b5600 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.444+0000 7f86bdd9b640 1 -- 172.21.15.5:0/2856858018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a8032440 con 0x7f86c00b5600 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.444+0000 7f86bdd9b640 1 -- 172.21.15.5:0/2856858018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8032810 con 0x7f86c00b5600 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 -- 172.21.15.5:0/2856858018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b5600 msgr2=0x7f86c00b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 --2- 172.21.15.5:0/2856858018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b5600 0x7f86c00b5a60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f86c00d16e0 tx=0x7f86a802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 -- 172.21.15.5:0/2856858018 shutdown_connections 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 --2- 172.21.15.5:0/2856858018 >> v2:172.21.15.80:3300/0 conn(0x7f86c00b6cb0 0x7f86c00b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 --2- 172.21.15.5:0/2856858018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b5600 0x7f86c00b5a60 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 --2- 172.21.15.5:0/2856858018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c015df90 0x7f86c00b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 -- 172.21.15.5:0/2856858018 >> 172.21.15.5:0/2856858018 conn(0x7f86c006b000 msgr2=0x7f86c006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 -- 172.21.15.5:0/2856858018 shutdown_connections 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.445+0000 7f86c507c640 1 -- 172.21.15.5:0/2856858018 wait complete. 2024-04-25T09:05:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.446+0000 7f86c507c640 1 Processor -- start 2024-04-25T09:05:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.446+0000 7f86c507c640 1 -- start start 2024-04-25T09:05:17.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86c507c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c00b5600 0x7f86c00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86c507c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b6cb0 0x7f86c015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86c507c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86c015df90 0x7f86c0160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86c507c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00b99e0 con 0x7f86c00b6cb0 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86c507c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00b8d00 con 0x7f86c015df90 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86c507c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00b9b60 con 0x7f86c00b5600 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86be59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b6cb0 0x7f86c015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86be59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b6cb0 0x7f86c015ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41154/0 (socket says 172.21.15.5:41154) 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86be59c640 1 -- 172.21.15.5:0/1289136186 learned_addr learned my addr 172.21.15.5:0/1289136186 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86bf59e640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86c015df90 0x7f86c0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86bed9d640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c00b5600 0x7f86c00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86be59c640 1 -- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c00b5600 msgr2=0x7f86c00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86be59c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c00b5600 0x7f86c00cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86be59c640 1 -- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86c015df90 msgr2=0x7f86c0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.447+0000 7f86be59c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86c015df90 0x7f86c0160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.448+0000 7f86be59c640 1 -- 172.21.15.5:0/1289136186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00cd5d0 con 0x7f86c00b6cb0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.448+0000 7f86be59c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b6cb0 0x7f86c015ebf0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f86a802a220 tx=0x7f86a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.448+0000 7f86b77fe640 1 -- 172.21.15.5:0/1289136186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8041020 con 0x7f86c00b6cb0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.448+0000 7f86b77fe640 1 -- 172.21.15.5:0/1289136186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a80306c0 con 0x7f86c00b6cb0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.448+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c00cbff0 con 0x7f86c00b6cb0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.448+0000 7f86b77fe640 1 -- 172.21.15.5:0/1289136186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8037040 con 0x7f86c00b6cb0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.448+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c00cc5b0 con 0x7f86c00b6cb0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.449+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c004ef20 con 0x7f86c00b6cb0 2024-04-25T09:05:17.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.449+0000 7f86b77fe640 1 -- 172.21.15.5:0/1289136186 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f86a8044020 con 0x7f86c00b6cb0 2024-04-25T09:05:17.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.450+0000 7f86b77fe640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86a006b4d0 0x7f86a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.450+0000 7f86b77fe640 1 -- 172.21.15.5:0/1289136186 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86a80aa980 con 0x7f86c00b6cb0 2024-04-25T09:05:17.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.450+0000 7f86bed9d640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86a006b4d0 0x7f86a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.451+0000 7f86bed9d640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86a006b4d0 0x7f86a006d990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f86b8006fd0 tx=0x7f86b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.454+0000 7f86b77fe640 1 -- 172.21.15.5:0/1289136186 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f86a804b030 con 0x7f86c00b6cb0 2024-04-25T09:05:17.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:17.575 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.705+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f86c00b7ec0 con 0x7f86c00b6cb0 2024-04-25T09:05:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.707+0000 7f86b77fe640 1 -- 172.21.15.5:0/1289136186 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f86a8079800 con 0x7f86c00b6cb0 2024-04-25T09:05:17.695 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T09:05:17.695 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T09:05:17.695 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T09:05:17.695 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T09:05:17.695 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:05:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T09:05:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86a006b4d0 msgr2=0x7f86a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86a006b4d0 0x7f86a006d990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f86b8006fd0 tx=0x7f86b8008040 comp rx=0 tx=0).stop 2024-04-25T09:05:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b6cb0 msgr2=0x7f86c015ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b6cb0 0x7f86c015ebf0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f86a802a220 tx=0x7f86a80046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 shutdown_connections 2024-04-25T09:05:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f86a006b4d0 0x7f86a006d990 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86c015df90 0x7f86c0160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c00b6cb0 0x7f86c015ebf0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 --2- 172.21.15.5:0/1289136186 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f86c00b5600 0x7f86c00cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.709+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 >> 172.21.15.5:0/1289136186 conn(0x7f86c006b000 msgr2=0x7f86c00d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.710+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 shutdown_connections 2024-04-25T09:05:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.710+0000 7f86c507c640 1 -- 172.21.15.5:0/1289136186 wait complete. 2024-04-25T09:05:17.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.822+0000 7f665c9f4640 1 Processor -- start 2024-04-25T09:05:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.822+0000 7f665c9f4640 1 -- start start 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.822+0000 7f665c9f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f665815bea0 0x7f66580cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665c9f4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d2510 0x7f66580cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665c9f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66580cfca0 con 0x7f66580d04f0 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665c9f4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66580cedb0 con 0x7f665815bea0 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665c9f4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665815c640 con 0x7f66580d2510 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f665815bea0 0x7f66580cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f6656d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f66580d04f0 0x7f665815f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47652/0 (socket says 172.21.15.5:47652) 2024-04-25T09:05:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f6656d9d640 1 -- 172.21.15.5:0/2830927092 learned_addr learned my addr 172.21.15.5:0/2830927092 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f6655d9b640 1 --2- 172.21.15.5:0/2830927092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d2510 0x7f66580cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665659c640 1 -- 172.21.15.5:0/2830927092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d2510 msgr2=0x7f66580cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665659c640 1 --2- 172.21.15.5:0/2830927092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d2510 0x7f66580cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665659c640 1 -- 172.21.15.5:0/2830927092 >> v1:172.21.15.5:6789/0 conn(0x7f66580d04f0 legacy=0x7f665815f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665659c640 1 -- 172.21.15.5:0/2830927092 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665815c920 con 0x7f665815bea0 2024-04-25T09:05:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.823+0000 7f665559a640 1 -- 172.21.15.5:0/2830927092 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232388795 0 0) 0x7f66580cfca0 con 0x7f66580d04f0 2024-04-25T09:05:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.824+0000 7f665659c640 1 --2- 172.21.15.5:0/2830927092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f665815bea0 0x7f66580cf5c0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f66480097a0 tx=0x7f664802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bfdbf6d5086938 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.824+0000 7f665559a640 1 -- 172.21.15.5:0/2830927092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648037070 con 0x7f665815bea0 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.824+0000 7f665559a640 1 -- 172.21.15.5:0/2830927092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648032440 con 0x7f665815bea0 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.824+0000 7f665559a640 1 -- 172.21.15.5:0/2830927092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648032810 con 0x7f665815bea0 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.824+0000 7f665c9f4640 1 -- 172.21.15.5:0/2830927092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f665815bea0 msgr2=0x7f66580cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.824+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2830927092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f665815bea0 0x7f66580cf5c0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f66480097a0 tx=0x7f664802a180 comp rx=0 tx=0).stop 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.825+0000 7f665c9f4640 1 -- 172.21.15.5:0/2830927092 shutdown_connections 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.825+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2830927092 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d2510 0x7f66580cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.825+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2830927092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f665815bea0 0x7f66580cf5c0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.825+0000 7f665c9f4640 1 -- 172.21.15.5:0/2830927092 >> 172.21.15.5:0/2830927092 conn(0x7f66580d19f0 msgr2=0x7f66580d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.825+0000 7f665c9f4640 1 -- 172.21.15.5:0/2830927092 shutdown_connections 2024-04-25T09:05:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.825+0000 7f665c9f4640 1 -- 172.21.15.5:0/2830927092 wait complete. 2024-04-25T09:05:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.826+0000 7f665c9f4640 1 Processor -- start 2024-04-25T09:05:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.826+0000 7f665c9f4640 1 -- start start 2024-04-25T09:05:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d04f0 0x7f66581f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66580d2510 0x7f665815f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665815bea0 0x7f665814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665815c280 con 0x7f66580d2510 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66580cd580 con 0x7f665815bea0 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665815c400 con 0x7f66580d04f0 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66580d2510 0x7f665815f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66580d2510 0x7f665815f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41180/0 (socket says 172.21.15.5:41180) 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 -- 172.21.15.5:0/2468854423 learned_addr learned my addr 172.21.15.5:0/2468854423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665659c640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d04f0 0x7f66581f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 -- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d04f0 msgr2=0x7f66581f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6656d9d640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665815bea0 0x7f665814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d04f0 0x7f66581f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 -- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665815bea0 msgr2=0x7f665814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665815bea0 0x7f665814d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 -- 172.21.15.5:0/2468854423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66580b5c00 con 0x7f66580d2510 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6655d9b640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66580d2510 0x7f665815f0e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c7f0 tx=0x7f664c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6646ffd640 1 -- 172.21.15.5:0/2468854423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c015070 con 0x7f66580d2510 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6646ffd640 1 -- 172.21.15.5:0/2468854423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c004240 con 0x7f66580d2510 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f6646ffd640 1 -- 172.21.15.5:0/2468854423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c007620 con 0x7f66580d2510 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66580b5ee0 con 0x7f66580d2510 2024-04-25T09:05:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.827+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66580b64a0 con 0x7f66580d2510 2024-04-25T09:05:17.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.829+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665804ef20 con 0x7f66580d2510 2024-04-25T09:05:17.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.829+0000 7f6646ffd640 1 -- 172.21.15.5:0/2468854423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f664c0079d0 con 0x7f66580d2510 2024-04-25T09:05:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.829+0000 7f6646ffd640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.829+0000 7f6646ffd640 1 -- 172.21.15.5:0/2468854423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f664c08a5f0 con 0x7f66580d2510 2024-04-25T09:05:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.830+0000 7f665659c640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.830+0000 7f665659c640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6648034000 tx=0x7f664802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:17.834+0000 7f6646ffd640 1 -- 172.21.15.5:0/2468854423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f664c059500 con 0x7f66580d2510 2024-04-25T09:05:18.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.055+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66580b7460 con 0x7f66580d2510 2024-04-25T09:05:18.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.056+0000 7f6646ffd640 1 -- 172.21.15.5:0/2468854423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f664c058e00 con 0x7f66580d2510 2024-04-25T09:05:18.043 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:18.043 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:18.044 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:18.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 msgr2=0x7f663806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6648034000 tx=0x7f664802e000 comp rx=0 tx=0).stop 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66580d2510 msgr2=0x7f665815f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66580d2510 0x7f665815f0e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c7f0 tx=0x7f664c00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 shutdown_connections 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f663806b4d0 0x7f663806d990 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f665815bea0 0x7f665814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66580d2510 0x7f665815f0e0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 --2- 172.21.15.5:0/2468854423 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f66580d04f0 0x7f66581f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 >> 172.21.15.5:0/2468854423 conn(0x7f66580d19f0 msgr2=0x7f665806e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 shutdown_connections 2024-04-25T09:05:18.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.058+0000 7f665c9f4640 1 -- 172.21.15.5:0/2468854423 wait complete. 2024-04-25T09:05:18.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:05:13.301049+0000', 'modified': '2024-04-25T09:05:15.297700+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9102}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9102': {'gid': 9102, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/778491752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 778491752}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 778491752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:05:18.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:05:18.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:05:18.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.579+0000 7f94e63e2640 1 Processor -- start 2024-04-25T09:05:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.579+0000 7f94e63e2640 1 -- start start 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e63e2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94e00b94a0 0x7f94e0161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e63e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e0161fc0 con 0x7f94e00cef60 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e63e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e01622a0 con 0x7f94e015dc70 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e63e2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00d2180 con 0x7f94e00b94a0 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94df7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f94e00cef60 0x7f94e00d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47654/0 (socket says 172.21.15.5:47654) 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94df7fe640 1 -- 172.21.15.5:0/1657477171 learned_addr learned my addr 172.21.15.5:0/1657477171 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e497f640 1 --2- 172.21.15.5:0/1657477171 >> v2:172.21.15.80:3300/0 conn(0x7f94e00b94a0 0x7f94e0161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94deffd640 1 -- 172.21.15.5:0/1657477171 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667893952 0 0) 0x7f94e0161fc0 con 0x7f94e00cef60 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94deffd640 1 -- 172.21.15.5:0/1657477171 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94cc003520 con 0x7f94e00cef60 2024-04-25T09:05:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94deffd640 1 -- 172.21.15.5:0/1657477171 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685089091 0 0) 0x7f94e01622a0 con 0x7f94e015dc70 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94deffd640 1 -- 172.21.15.5:0/1657477171 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e0161fc0 con 0x7f94e015dc70 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e497f640 1 -- 172.21.15.5:0/1657477171 >> v1:172.21.15.80:6789/0 conn(0x7f94e015dc70 legacy=0x7f94e00ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e497f640 1 -- 172.21.15.5:0/1657477171 >> v1:172.21.15.5:6789/0 conn(0x7f94e00cef60 legacy=0x7f94e00d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.580+0000 7f94e497f640 1 -- 172.21.15.5:0/1657477171 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0162580 con 0x7f94e00b94a0 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.581+0000 7f94e497f640 1 --2- 172.21.15.5:0/1657477171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 0x7f94e0161850 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009d90 tx=0x7f94d802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8420003d11619bb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.581+0000 7f94deffd640 1 -- 172.21.15.5:0/1657477171 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8007740 con 0x7f94e00b94a0 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.581+0000 7f94deffd640 1 -- 172.21.15.5:0/1657477171 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d80078e0 con 0x7f94e00b94a0 2024-04-25T09:05:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.581+0000 7f94deffd640 1 -- 172.21.15.5:0/1657477171 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8007cb0 con 0x7f94e00b94a0 2024-04-25T09:05:18.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.582+0000 7f94e63e2640 1 -- 172.21.15.5:0/1657477171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 msgr2=0x7f94e0161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.582+0000 7f94e63e2640 1 --2- 172.21.15.5:0/1657477171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 0x7f94e0161850 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009d90 tx=0x7f94d802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.582+0000 7f94e63e2640 1 -- 172.21.15.5:0/1657477171 shutdown_connections 2024-04-25T09:05:18.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.582+0000 7f94e63e2640 1 --2- 172.21.15.5:0/1657477171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 0x7f94e0161850 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.582+0000 7f94e63e2640 1 -- 172.21.15.5:0/1657477171 >> 172.21.15.5:0/1657477171 conn(0x7f94e00668f0 msgr2=0x7f94e0066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.582+0000 7f94e63e2640 1 -- 172.21.15.5:0/1657477171 shutdown_connections 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.582+0000 7f94e63e2640 1 -- 172.21.15.5:0/1657477171 wait complete. 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.583+0000 7f94e63e2640 1 Processor -- start 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.583+0000 7f94e63e2640 1 -- start start 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e63e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 0x7f94e00cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e63e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94e00cef60 0x7f94e015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e63e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015dc70 0x7f94e00c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e63e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00d11f0 con 0x7f94e015dc70 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e63e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00d2d20 con 0x7f94e00b94a0 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e63e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00d2ea0 con 0x7f94e00cef60 2024-04-25T09:05:18.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015dc70 0x7f94e00c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015dc70 0x7f94e00c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41182/0 (socket says 172.21.15.5:41182) 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 -- 172.21.15.5:0/576199850 learned_addr learned my addr 172.21.15.5:0/576199850 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94dffff640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 0x7f94e00cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94df7fe640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94e00cef60 0x7f94e015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 -- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94e00cef60 msgr2=0x7f94e015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94e00cef60 0x7f94e015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 -- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 msgr2=0x7f94e00cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 0x7f94e00cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.584+0000 7f94e497f640 1 -- 172.21.15.5:0/576199850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e015e260 con 0x7f94e015dc70 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.585+0000 7f94e497f640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015dc70 0x7f94e00c98e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009eb0 tx=0x7f94d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.585+0000 7f94dcff9640 1 -- 172.21.15.5:0/576199850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8040070 con 0x7f94e015dc70 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.585+0000 7f94dcff9640 1 -- 172.21.15.5:0/576199850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8031bc0 con 0x7f94e015dc70 2024-04-25T09:05:18.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.585+0000 7f94dcff9640 1 -- 172.21.15.5:0/576199850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8009450 con 0x7f94e015dc70 2024-04-25T09:05:18.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.585+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e015e500 con 0x7f94e015dc70 2024-04-25T09:05:18.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.585+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e015eac0 con 0x7f94e015dc70 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.586+0000 7f94dcff9640 1 -- 172.21.15.5:0/576199850 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f94d8039040 con 0x7f94e015dc70 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.587+0000 7f94dcff9640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94c006b4d0 0x7f94c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.587+0000 7f94dcff9640 1 -- 172.21.15.5:0/576199850 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d80ab770 con 0x7f94e015dc70 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.587+0000 7f94dffff640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94c006b4d0 0x7f94c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.587+0000 7f94dffff640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94c006b4d0 0x7f94c006d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f94c8007fd0 tx=0x7f94c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 Processor -- start 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 -- start start 2024-04-25T09:05:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557ad8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557af6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557aadf10 0x55e557af4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e557a10a10 con 0x55e557ad8230 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5579b9b30 con 0x55e557af5ad0 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e557a0cc50 con 0x55e557aadf10 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557ad8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557ad8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41194/0 (socket says 172.21.15.5:41194) 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94dffff640 1 -- 172.21.15.5:0/2359265687 learned_addr learned my addr 172.21.15.5:0/2359265687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557af6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.588+0000 7f94e497f640 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557aadf10 0x55e557af4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94dffff640 1 -- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557aadf10 msgr2=0x55e557af4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94dffff640 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557aadf10 0x55e557af4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94dffff640 1 -- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 msgr2=0x55e557af6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94dffff640 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557af6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94dffff640 1 -- 172.21.15.5:0/2359265687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5579cee10 con 0x55e557ad8230 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94dffff640 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557ad8610 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f94c800f9e0 tx=0x7f94c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc3bc8e3a143b82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94d5ffb640 1 -- 172.21.15.5:0/2359265687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8025070 con 0x55e557ad8230 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94d5ffb640 1 -- 172.21.15.5:0/2359265687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c801b050 con 0x55e557ad8230 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94d5ffb640 1 -- 172.21.15.5:0/2359265687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8014de0 con 0x55e557ad8230 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94e91b7740 1 -- 172.21.15.5:0/2359265687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 msgr2=0x55e557ad8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.589+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557ad8610 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f94c800f9e0 tx=0x7f94c8012000 comp rx=0 tx=0).stop 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 -- 172.21.15.5:0/2359265687 shutdown_connections 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557aadf10 0x55e557af4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557af6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2359265687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557ad8610 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 -- 172.21.15.5:0/2359265687 >> 172.21.15.5:0/2359265687 conn(0x55e557aaa840 msgr2=0x55e557af3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 -- 172.21.15.5:0/2359265687 shutdown_connections 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 -- 172.21.15.5:0/2359265687 wait complete. 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 -- start start 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.590+0000 7f94e91b7740 1 Processor -- start 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad8230 0x55e557ada950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557af5ad0 0x55e557af4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e91b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e557aaecb0 con 0x55e557af5ad0 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5579cd0c0 con 0x55e557ad8230 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e557aa8770 con 0x55e557ad4030 2024-04-25T09:05:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e91b7740 10 client.0 _ll_register_callbacks cb 0x55e5579c0ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557af5ad0 0x55e557af4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557af5ad0 0x55e557af4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41204/0 (socket says 172.21.15.5:41204) 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94df7fe640 1 -- 172.21.15.5:0/2700810452 learned_addr learned my addr 172.21.15.5:0/2700810452 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94dffff640 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad8230 0x55e557ada950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.591+0000 7f94e497f640 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94df7fe640 1 -- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 msgr2=0x55e557af4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94df7fe640 1 -- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad8230 msgr2=0x55e557ada950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad8230 0x55e557ada950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94df7fe640 1 -- 172.21.15.5:0/2700810452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5577252d0 con 0x55e557af5ad0 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557af5ad0 0x55e557af4520 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f94d0007760 tx=0x7f94d00016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b2adda6a9f74bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94beffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:05:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94beffd640 1 -- 172.21.15.5:0/2700810452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0019020 con 0x55e557af5ad0 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94c801b050 con 0x55e557af5ad0 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94beffd640 1 -- 172.21.15.5:0/2700810452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d0015650 con 0x55e557af5ad0 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94beffd640 1 -- 172.21.15.5:0/2700810452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d0023050 con 0x55e557af5ad0 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 10 client.9234 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e5577ef6b0 con 0x55e557af5ad0 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94beffd640 1 -- 172.21.15.5:0/2700810452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c801b050 con 0x55e557af5ad0 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94beffd640 1 -- 172.21.15.5:0/2700810452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f94d0026020 con 0x55e557af5ad0 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 10 client.9234 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 10 client.9234 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 20 client.9234 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad9540 0x55e557af7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 4 client.9234 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.592+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e557a6f920 con 0x55e557ad9540 2024-04-25T09:05:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.593+0000 7f94dffff640 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad9540 0x55e557af7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.593+0000 7f94dffff640 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad9540 0x55e557af7d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c244007f73ec7977 server_cookie=75e26fd4f2b013bc in_seq=0 out_seq=0 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.593+0000 7f94beffd640 10 client.9234 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.593+0000 7f94beffd640 1 -- 172.21.15.5:0/2700810452 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e557a6f920 con 0x55e557ad9540 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.593+0000 7f94beffd640 10 client.9234 handle_command_reply: tid=0 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.593+0000 7f94e91b7740 1 client.9234 shutdown 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557af5ad0 msgr2=0x55e557af4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557af5ad0 0x55e557af4520 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f94d0007760 tx=0x7f94d00016a0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 shutdown_connections 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad9540 0x55e557af7d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557af5ad0 0x55e557af4520 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2700810452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad8230 0x55e557ada950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94beffd640 0 client.9234 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 >> 172.21.15.5:0/2700810452 conn(0x55e557aadf10 msgr2=0x55e557af65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 shutdown_connections 2024-04-25T09:05:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 1 -- 172.21.15.5:0/2700810452 wait complete. 2024-04-25T09:05:18.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.594+0000 7f94e91b7740 20 client.9234 trim_cache size 0 max 16384 2024-04-25T09:05:18.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 Processor -- start 2024-04-25T09:05:18.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 -- start start 2024-04-25T09:05:18.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557aae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557aae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01f4880 con 0x55e557ad8230 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01f3c80 con 0x55e557af5ad0 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01f4280 con 0x55e557ad4030 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557aae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557aae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41210/0 (socket says 172.21.15.5:41210) 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94df7fe640 1 -- 172.21.15.5:0/2480092602 learned_addr learned my addr 172.21.15.5:0/2480092602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94e497f640 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557aae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.610+0000 7f94dffff640 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94df7fe640 1 -- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 msgr2=0x55e557af6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94df7fe640 1 -- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 msgr2=0x55e557aae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557aae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94df7fe640 1 -- 172.21.15.5:0/2480092602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e557af3d90 con 0x55e557ad8230 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557aae2f0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f94d00073d0 tx=0x7f94d000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69ee012969a0c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94d57fa640 1 -- 172.21.15.5:0/2480092602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0019030 con 0x55e557ad8230 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94d57fa640 1 -- 172.21.15.5:0/2480092602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0007de0 con 0x55e557ad8230 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94d57fa640 1 -- 172.21.15.5:0/2480092602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00273f0 con 0x55e557ad8230 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94e91b7740 1 -- 172.21.15.5:0/2480092602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 msgr2=0x55e557aae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557aae2f0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f94d00073d0 tx=0x7f94d000f000 comp rx=0 tx=0).stop 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94e91b7740 1 -- 172.21.15.5:0/2480092602 shutdown_connections 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557af5ad0 0x55e557aae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557aae2f0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2480092602 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557ad4030 0x55e557af6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.611+0000 7f94e91b7740 1 -- 172.21.15.5:0/2480092602 >> 172.21.15.5:0/2480092602 conn(0x55e557aadf10 msgr2=0x55e557af7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.612+0000 7f94e91b7740 1 -- 172.21.15.5:0/2480092602 shutdown_connections 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.612+0000 7f94e91b7740 1 -- 172.21.15.5:0/2480092602 wait complete. 2024-04-25T09:05:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.612+0000 7f94e91b7740 1 -- start start 2024-04-25T09:05:18.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.612+0000 7f94e91b7740 1 Processor -- start 2024-04-25T09:05:18.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad4030 0x55e557b5dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557af64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e91b7740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557af5ad0 0x55e557aae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e91b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e557ad93c0 con 0x55e557ad8230 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e557b04210 con 0x55e557ad4030 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e91b7740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e557ad9990 con 0x55e557af5ad0 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e91b7740 10 client.0 _ll_register_callbacks cb 0x55e557aa8c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557af64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557af64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41220/0 (socket says 172.21.15.5:41220) 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 -- 172.21.15.5:0/2354753765 learned_addr learned my addr 172.21.15.5:0/2354753765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94e497f640 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557af5ad0 0x55e557aae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94dffff640 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad4030 0x55e557b5dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 -- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557af5ad0 msgr2=0x55e557aae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557af5ad0 0x55e557aae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 -- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad4030 msgr2=0x55e557b5dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad4030 0x55e557b5dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.613+0000 7f94df7fe640 1 -- 172.21.15.5:0/2354753765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e557aa76f0 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94df7fe640 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557af64b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f94d00070c0 tx=0x7f94d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8378be2ecb357 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94beffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94beffd640 1 -- 172.21.15.5:0/2354753765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0019050 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94d0007de0 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94beffd640 1 -- 172.21.15.5:0/2354753765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d0005d00 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94beffd640 1 -- 172.21.15.5:0/2354753765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d0040050 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 10 client.9240 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e557afa070 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94beffd640 1 -- 172.21.15.5:0/2354753765 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0007de0 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94beffd640 1 -- 172.21.15.5:0/2354753765 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f94d0043020 con 0x55e557ad8230 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 10 client.9240 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 10 client.9240 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 20 client.9240 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad2dd0 0x55e557af8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 4 client.9240 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e557a1df50 con 0x55e557ad2dd0 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.614+0000 7f94dffff640 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad2dd0 0x55e557af8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94beffd640 10 client.9240 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94dffff640 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad2dd0 0x55e557af8ff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928701d5f0f96bb4 server_cookie=6c35147670d244fe in_seq=0 out_seq=0 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94beffd640 1 -- 172.21.15.5:0/2354753765 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e557a1df50 con 0x55e557ad2dd0 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94beffd640 10 client.9240 handle_command_reply: tid=0 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 client.9240 shutdown 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 msgr2=0x55e557af64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557af64b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f94d00070c0 tx=0x7f94d0015000 comp rx=0 tx=0).stop 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 shutdown_connections 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e557ad2dd0 0x55e557af8ff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e557af5ad0 0x55e557aae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e557ad8230 0x55e557af64b0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94beffd640 0 client.9240 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 --2- 172.21.15.5:0/2354753765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e557ad4030 0x55e557b5dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 >> 172.21.15.5:0/2354753765 conn(0x55e557aadf10 msgr2=0x55e557af7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 shutdown_connections 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 1 -- 172.21.15.5:0/2354753765 wait complete. 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.615+0000 7f94e91b7740 20 client.9240 trim_cache size 0 max 16384 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9102, 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:05:18.609 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:05:18.610 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:05:18.610 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 4.6841907650000003, 2024-04-25T09:05:18.610 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 78, 2024-04-25T09:05:18.610 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 125, 2024-04-25T09:05:18.610 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 125, 2024-04-25T09:05:18.610 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.703592464 2024-04-25T09:05:18.610 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94c006b4d0 msgr2=0x7f94c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94c006b4d0 0x7f94c006d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f94c8007fd0 tx=0x7f94c8009040 comp rx=0 tx=0).stop 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015dc70 msgr2=0x7f94e00c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015dc70 0x7f94e00c98e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009eb0 tx=0x7f94d8004a40 comp rx=0 tx=0).stop 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 shutdown_connections 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f94c006b4d0 0x7f94c006d990 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015dc70 0x7f94e00c98e0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94e00cef60 0x7f94e015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 --2- 172.21.15.5:0/576199850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94e00b94a0 0x7f94e00cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 >> 172.21.15.5:0/576199850 conn(0x7f94e00668f0 msgr2=0x7f94e00c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 shutdown_connections 2024-04-25T09:05:18.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.616+0000 7f94e63e2640 1 -- 172.21.15.5:0/576199850 wait complete. 2024-04-25T09:05:18.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:05:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.728+0000 7fc5ef37e640 1 Processor -- start 2024-04-25T09:05:18.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.728+0000 7fc5ef37e640 1 -- start start 2024-04-25T09:05:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ef37e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80b0a50 0x7fc5e80ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ef37e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5e80b0e30 0x7fc5e80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ef37e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5e80cbf40 0x7fc5e80d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ef37e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e806b800 con 0x7fc5e80b0e30 2024-04-25T09:05:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ef37e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e806ba50 con 0x7fc5e80cbf40 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ef37e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e806bd30 con 0x7fc5e80b0a50 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ec919640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5e80b0e30 0x7fc5e80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ec919640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5e80b0e30 0x7fc5e80ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41226/0 (socket says 172.21.15.5:41226) 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.729+0000 7fc5ec919640 1 -- 172.21.15.5:0/3379748154 learned_addr learned my addr 172.21.15.5:0/3379748154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ed11a640 1 --2- 172.21.15.5:0/3379748154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80b0a50 0x7fc5e80ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ed91b640 1 --2- 172.21.15.5:0/3379748154 >> v2:172.21.15.80:3300/0 conn(0x7fc5e80cbf40 0x7fc5e80d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ec919640 1 -- 172.21.15.5:0/3379748154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80b0a50 msgr2=0x7fc5e80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ec919640 1 --2- 172.21.15.5:0/3379748154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80b0a50 0x7fc5e80ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ec919640 1 -- 172.21.15.5:0/3379748154 >> v2:172.21.15.80:3300/0 conn(0x7fc5e80cbf40 msgr2=0x7fc5e80d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ec919640 1 --2- 172.21.15.5:0/3379748154 >> v2:172.21.15.80:3300/0 conn(0x7fc5e80cbf40 0x7fc5e80d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ec919640 1 -- 172.21.15.5:0/3379748154 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e806c010 con 0x7fc5e80b0e30 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.730+0000 7fc5ec919640 1 --2- 172.21.15.5:0/3379748154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e80ce740 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8067890 tx=0x7fc5dc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de653ab516514d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5e7fff640 1 -- 172.21.15.5:0/3379748154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc037070 con 0x7fc5e80b0e30 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5e7fff640 1 -- 172.21.15.5:0/3379748154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc032440 con 0x7fc5e80b0e30 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5e7fff640 1 -- 172.21.15.5:0/3379748154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc032810 con 0x7fc5e80b0e30 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 -- 172.21.15.5:0/3379748154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 msgr2=0x7fc5e80ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/3379748154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e80ce740 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8067890 tx=0x7fc5dc02a140 comp rx=0 tx=0).stop 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 -- 172.21.15.5:0/3379748154 shutdown_connections 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/3379748154 >> v2:172.21.15.80:3300/0 conn(0x7fc5e80cbf40 0x7fc5e80d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/3379748154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e80ce740 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/3379748154 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80b0a50 0x7fc5e80ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 -- 172.21.15.5:0/3379748154 >> 172.21.15.5:0/3379748154 conn(0x7fc5e80d18f0 msgr2=0x7fc5e80d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 -- 172.21.15.5:0/3379748154 shutdown_connections 2024-04-25T09:05:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.731+0000 7fc5ef37e640 1 -- 172.21.15.5:0/3379748154 wait complete. 2024-04-25T09:05:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.732+0000 7fc5ef37e640 1 Processor -- start 2024-04-25T09:05:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ef37e640 1 -- start start 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ef37e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80b0a50 0x7fc5e814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ef37e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e81606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ef37e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80cbf40 0x7fc5e8160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ef37e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80b2bf0 con 0x7fc5e80b0e30 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ef37e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80cfd60 con 0x7fc5e80b0a50 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ef37e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e815f360 con 0x7fc5e80cbf40 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ec919640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e81606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ec919640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e81606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41238/0 (socket says 172.21.15.5:41238) 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ec919640 1 -- 172.21.15.5:0/1710247819 learned_addr learned my addr 172.21.15.5:0/1710247819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ed11a640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80b0a50 0x7fc5e814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.733+0000 7fc5ed91b640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80cbf40 0x7fc5e8160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ec919640 1 -- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80cbf40 msgr2=0x7fc5e8160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ec919640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80cbf40 0x7fc5e8160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ec919640 1 -- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80b0a50 msgr2=0x7fc5e814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ec919640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80b0a50 0x7fc5e814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ec919640 1 -- 172.21.15.5:0/1710247819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e815f640 con 0x7fc5e80b0e30 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ec919640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e81606d0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc02a180 tx=0x7fc5dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5e5ffb640 1 -- 172.21.15.5:0/1710247819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc041020 con 0x7fc5e80b0e30 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5e5ffb640 1 -- 172.21.15.5:0/1710247819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc03d620 con 0x7fc5e80b0e30 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e815f920 con 0x7fc5e80b0e30 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5e5ffb640 1 -- 172.21.15.5:0/1710247819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc037040 con 0x7fc5e80b0e30 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.734+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e814f230 con 0x7fc5e80b0e30 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.735+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e806cd70 con 0x7fc5e80b0e30 2024-04-25T09:05:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.736+0000 7fc5e5ffb640 1 -- 172.21.15.5:0/1710247819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc5dc044020 con 0x7fc5e80b0e30 2024-04-25T09:05:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.736+0000 7fc5e5ffb640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc5d406b4d0 0x7fc5d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.736+0000 7fc5e5ffb640 1 -- 172.21.15.5:0/1710247819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5dc0aa770 con 0x7fc5e80b0e30 2024-04-25T09:05:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.736+0000 7fc5ed11a640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc5d406b4d0 0x7fc5d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.737+0000 7fc5ed11a640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc5d406b4d0 0x7fc5d406d990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009b40 tx=0x7fc5e0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.740+0000 7fc5e5ffb640 1 -- 172.21.15.5:0/1710247819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5dc04b030 con 0x7fc5e80b0e30 2024-04-25T09:05:18.910 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-04-25T09:05:18.923+0000 7f4ad8aac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:05:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.958+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc5e804ef20 con 0x7fc5e80b0e30 2024-04-25T09:05:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.958+0000 7fc5e5ffb640 1 -- 172.21.15.5:0/1710247819 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc5dc0790c0 con 0x7fc5e80b0e30 2024-04-25T09:05:18.946 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:05:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc5d406b4d0 msgr2=0x7fc5d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc5d406b4d0 0x7fc5d406d990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009b40 tx=0x7fc5e0009190 comp rx=0 tx=0).stop 2024-04-25T09:05:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 msgr2=0x7fc5e81606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e81606d0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc02a180 tx=0x7fc5dc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 shutdown_connections 2024-04-25T09:05:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc5d406b4d0 0x7fc5d406d990 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc5e80cbf40 0x7fc5e8160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5e80b0e30 0x7fc5e81606d0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 --2- 172.21.15.5:0/1710247819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80b0a50 0x7fc5e814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 >> 172.21.15.5:0/1710247819 conn(0x7fc5e80d18f0 msgr2=0x7fc5e8068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 shutdown_connections 2024-04-25T09:05:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:18.960+0000 7fc5ef37e640 1 -- 172.21.15.5:0/1710247819 wait complete. 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:05:18.960 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:18.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:18.960 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:05:18.976 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:05:18.976 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42241sec preferred_lft 42241sec 2024-04-25T09:05:18.977 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:05:18.978 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:18.978 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:05:18.980 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:18.980 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:05:18.980 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:05:18.980 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:18.980 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:18.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:18.982 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:05:19.040 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:05:19.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:19.042 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:05:19.099 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:05:19.099 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:05:19.099 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:05:19.099 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:05:19.100 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:05:19.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:19.100 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:05:19.100 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:19.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:05:19.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:05:19.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:05:19.100 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:19.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:19.185 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:05:19.201 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:05:19.201 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:05:19.201 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:19.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:19.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:05:19.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:05:19.266 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:19.322 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:19.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:05:19.322 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:19.377 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:05:19.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:19.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:05:19.459 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:05:19.459 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:05:19.471 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:05:19.471 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:05:19.471 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:05:19.471 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:05:19.471 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:05:19.471 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:05:19.472 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:05:19.472 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:05:19.472 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:05:19.472 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:05:19.477 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:05:19.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:19.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:19.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:19.543 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:05:19.602 INFO:teuthology.orchestra.run.smithi005.stdout:client8158 2024-04-25T09:05:19.603 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:05:19.603 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:19.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.811+0000 7f53744cb640 1 Processor -- start 2024-04-25T09:05:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.811+0000 7f53744cb640 1 -- start start 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.812+0000 7f53744cb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f536c0ce910 0x7f536c168b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.812+0000 7f53744cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c06ba50 con 0x7f536c0b0a50 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.812+0000 7f53744cb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c06bd30 con 0x7f536c0b0e30 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.812+0000 7f53744cb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536c06b800 con 0x7f536c0ce910 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5372267640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f536c0b0a50 0x7f536c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47658/0 (socket says 172.21.15.5:47658) 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5372267640 1 -- 172.21.15.5:0/3150369327 learned_addr learned my addr 172.21.15.5:0/3150369327 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5372a68640 1 --2- 172.21.15.5:0/3150369327 >> v2:172.21.15.80:3300/0 conn(0x7f536c0ce910 0x7f536c168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5371265640 1 -- 172.21.15.5:0/3150369327 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803195310 0 0) 0x7f536c06ba50 con 0x7f536c0b0a50 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5371265640 1 -- 172.21.15.5:0/3150369327 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5358003520 con 0x7f536c0b0a50 2024-04-25T09:05:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5372a68640 1 -- 172.21.15.5:0/3150369327 >> v1:172.21.15.80:6789/0 conn(0x7f536c0b0e30 legacy=0x7f536c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5371265640 1 -- 172.21.15.5:0/3150369327 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360358797 0 0) 0x7f536c06bd30 con 0x7f536c0b0e30 2024-04-25T09:05:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5372a68640 1 -- 172.21.15.5:0/3150369327 >> v1:172.21.15.5:6789/0 conn(0x7f536c0b0a50 legacy=0x7f536c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.813+0000 7f5372a68640 1 -- 172.21.15.5:0/3150369327 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c06c010 con 0x7f536c0ce910 2024-04-25T09:05:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.814+0000 7f5372a68640 1 --2- 172.21.15.5:0/3150369327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 0x7f536c168b90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5364009d90 tx=0x7f536402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c04972d92b0ac1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.814+0000 7f5371265640 1 -- 172.21.15.5:0/3150369327 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364007740 con 0x7f536c0ce910 2024-04-25T09:05:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.814+0000 7f5371265640 1 -- 172.21.15.5:0/3150369327 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640078e0 con 0x7f536c0ce910 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.814+0000 7f5371265640 1 -- 172.21.15.5:0/3150369327 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364007cb0 con 0x7f536c0ce910 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.814+0000 7f53744cb640 1 -- 172.21.15.5:0/3150369327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 msgr2=0x7f536c168b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.814+0000 7f53744cb640 1 --2- 172.21.15.5:0/3150369327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 0x7f536c168b90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5364009d90 tx=0x7f536402a660 comp rx=0 tx=0).stop 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.815+0000 7f53744cb640 1 -- 172.21.15.5:0/3150369327 shutdown_connections 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.815+0000 7f53744cb640 1 --2- 172.21.15.5:0/3150369327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 0x7f536c168b90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.815+0000 7f53744cb640 1 -- 172.21.15.5:0/3150369327 >> 172.21.15.5:0/3150369327 conn(0x7f536c0d18f0 msgr2=0x7f536c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.815+0000 7f53744cb640 1 -- 172.21.15.5:0/3150369327 shutdown_connections 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.815+0000 7f53744cb640 1 -- 172.21.15.5:0/3150369327 wait complete. 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.816+0000 7f53744cb640 1 Processor -- start 2024-04-25T09:05:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.816+0000 7f53744cb640 1 -- start start 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.816+0000 7f53744cb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536c0b0a50 0x7f536c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.816+0000 7f53744cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f536c0b0e30 0x7f536c1f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f53744cb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 0x7f536c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f53744cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c0b2bf0 con 0x7f536c0b0e30 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f53744cb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c0cfd60 con 0x7f536c0ce910 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f53744cb640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c15d6a0 con 0x7f536c0b0a50 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f536c0b0e30 0x7f536c1f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f536c0b0e30 0x7f536c1f4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41252/0 (socket says 172.21.15.5:41252) 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 -- 172.21.15.5:0/2826823816 learned_addr learned my addr 172.21.15.5:0/2826823816 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5372267640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536c0b0a50 0x7f536c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5372a68640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 0x7f536c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 -- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536c0b0a50 msgr2=0x7f536c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536c0b0a50 0x7f536c15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 -- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 msgr2=0x7f536c0c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 0x7f536c0c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 -- 172.21.15.5:0/2826823816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c0c5820 con 0x7f536c0b0e30 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5371a66640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f536c0b0e30 0x7f536c1f4730 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c480 tx=0x7f535c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5362ffd640 1 -- 172.21.15.5:0/2826823816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c017070 con 0x7f536c0b0e30 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5362ffd640 1 -- 172.21.15.5:0/2826823816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c005480 con 0x7f536c0b0e30 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c0c5ae0 con 0x7f536c0b0e30 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f5362ffd640 1 -- 172.21.15.5:0/2826823816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c003830 con 0x7f536c0b0e30 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.817+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c0c60a0 con 0x7f536c0b0e30 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.818+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c04ef20 con 0x7f536c0b0e30 2024-04-25T09:05:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.819+0000 7f5362ffd640 1 -- 172.21.15.5:0/2826823816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f535c01a070 con 0x7f536c0b0e30 2024-04-25T09:05:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.819+0000 7f5362ffd640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535006b4d0 0x7f535006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.819+0000 7f5362ffd640 1 -- 172.21.15.5:0/2826823816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f535c089480 con 0x7f536c0b0e30 2024-04-25T09:05:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.819+0000 7f5372267640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535006b4d0 0x7f535006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.820+0000 7f5372267640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535006b4d0 0x7f535006d990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5368005880 tx=0x7f5368009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:19.823+0000 7f5362ffd640 1 -- 172.21.15.5:0/2826823816 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f535c057d40 con 0x7f536c0b0e30 2024-04-25T09:05:20.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.040+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f536c0c5600 con 0x7f536c0b0e30 2024-04-25T09:05:20.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.041+0000 7f5362ffd640 1 -- 172.21.15.5:0/2826823816 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f535c05bde0 con 0x7f536c0b0e30 2024-04-25T09:05:20.029 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:20.029 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535006b4d0 msgr2=0x7f535006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535006b4d0 0x7f535006d990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5368005880 tx=0x7f5368009040 comp rx=0 tx=0).stop 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f536c0b0e30 msgr2=0x7f536c1f4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f536c0b0e30 0x7f536c1f4730 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c480 tx=0x7f535c00c940 comp rx=0 tx=0).stop 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 shutdown_connections 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f535006b4d0 0x7f535006d990 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f536c0ce910 0x7f536c0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f536c0b0e30 0x7f536c1f4730 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 --2- 172.21.15.5:0/2826823816 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f536c0b0a50 0x7f536c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 >> 172.21.15.5:0/2826823816 conn(0x7f536c0d18f0 msgr2=0x7f536c161350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 shutdown_connections 2024-04-25T09:05:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.043+0000 7f53744cb640 1 -- 172.21.15.5:0/2826823816 wait complete. 2024-04-25T09:05:20.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.155+0000 7fd271b28640 1 Processor -- start 2024-04-25T09:05:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.155+0000 7fd271b28640 1 -- start start 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.156+0000 7fd271b28640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd26c15e0a0 0x7fd26c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.156+0000 7fd271b28640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c0b7f60 con 0x7fd26c0d3df0 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.156+0000 7fd271b28640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c0cf400 con 0x7fd26c0d3990 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.156+0000 7fd271b28640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26c0b29c0 con 0x7fd26c15e0a0 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.156+0000 7fd26bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd26c0d3df0 0x7fd26c0cecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47672/0 (socket says 172.21.15.5:47672) 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.156+0000 7fd26bfff640 1 -- 172.21.15.5:0/3732602135 learned_addr learned my addr 172.21.15.5:0/3732602135 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573845646 0 0) 0x7fd26c0b7f60 con 0x7fd26c0d3df0 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26b7fe640 1 --2- 172.21.15.5:0/3732602135 >> v2:172.21.15.80:3300/0 conn(0x7fd26c15e0a0 0x7fd26c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd254003520 con 0x7fd26c0d3df0 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712607000 0 0) 0x7fd254003520 con 0x7fd26c0d3df0 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 >> v2:172.21.15.80:3300/0 conn(0x7fd26c15e0a0 msgr2=0x7fd26c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 --2- 172.21.15.5:0/3732602135 >> v2:172.21.15.80:3300/0 conn(0x7fd26c15e0a0 0x7fd26c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 >> v1:172.21.15.80:6789/0 conn(0x7fd26c0d3990 legacy=0x7fd26c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c0d2080 con 0x7fd26c0d3df0 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fd2640019f0 con 0x7fd26c0d3df0 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 >> v1:172.21.15.5:6789/0 conn(0x7fd26c0d3df0 legacy=0x7fd26c0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2540039b0 0x7fd254003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd254004800 0x7fd254004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd25400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0b29c0 con 0x7fd2540051c0 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25400c060 con 0x7fd254004800 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25400c260 con 0x7fd2540039b0 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26bfff640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd25400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26b7fe640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2540039b0 0x7fd254003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26affd640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd254004800 0x7fd254004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26bfff640 1 -- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2540039b0 msgr2=0x7fd254003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26bfff640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd2540039b0 0x7fd254003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26bfff640 1 -- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd254004800 msgr2=0x7fd254004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26bfff640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd254004800 0x7fd254004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.157+0000 7fd26bfff640 1 -- 172.21.15.5:0/3732602135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254003520 con 0x7fd2540051c0 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.158+0000 7fd26bfff640 1 -- 172.21.15.5:0/3732602135 reap_dead start 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.158+0000 7fd26bfff640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd25400b9c0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd26400a860 tx=0x7fd254005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b52ea9ab4073a9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.158+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400a480 con 0x7fd2540051c0 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.158+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26402f070 con 0x7fd2540051c0 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.158+0000 7fd26a7fc640 1 -- 172.21.15.5:0/3732602135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26402bcc0 con 0x7fd2540051c0 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.159+0000 7fd271b28640 1 -- 172.21.15.5:0/3732602135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 msgr2=0x7fd25400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.159+0000 7fd271b28640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd25400b9c0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd26400a860 tx=0x7fd254005830 comp rx=0 tx=0).stop 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.159+0000 7fd271b28640 1 -- 172.21.15.5:0/3732602135 shutdown_connections 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.159+0000 7fd271b28640 1 --2- 172.21.15.5:0/3732602135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd25400b9c0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.159+0000 7fd271b28640 1 -- 172.21.15.5:0/3732602135 >> 172.21.15.5:0/3732602135 conn(0x7fd26c0668f0 msgr2=0x7fd26c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.159+0000 7fd271b28640 1 -- 172.21.15.5:0/3732602135 shutdown_connections 2024-04-25T09:05:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.159+0000 7fd271b28640 1 -- 172.21.15.5:0/3732602135 wait complete. 2024-04-25T09:05:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.160+0000 7fd271b28640 1 Processor -- start 2024-04-25T09:05:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.160+0000 7fd271b28640 1 -- start start 2024-04-25T09:05:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd271b28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd26c149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd271b28640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd26c14ac00 0x7fd26c147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd271b28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c14a1f0 0x7fd26c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd271b28640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0d2920 con 0x7fd2540051c0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd271b28640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0d2640 con 0x7fd26c14a1f0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd271b28640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0d2c00 con 0x7fd26c14ac00 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd26c149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd26c149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41270/0 (socket says 172.21.15.5:41270) 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 -- 172.21.15.5:0/2762717723 learned_addr learned my addr 172.21.15.5:0/2762717723 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26bfff640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c14a1f0 0x7fd26c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26affd640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd26c14ac00 0x7fd26c147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 -- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd26c14ac00 msgr2=0x7fd26c147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd26c14ac00 0x7fd26c147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 -- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c14a1f0 msgr2=0x7fd26c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c14a1f0 0x7fd26c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 -- 172.21.15.5:0/2762717723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c148790 con 0x7fd2540051c0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.161+0000 7fd26b7fe640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd26c149830 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0118e0 tx=0x7fd25c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.162+0000 7fd253fff640 1 -- 172.21.15.5:0/2762717723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00faf0 con 0x7fd2540051c0 2024-04-25T09:05:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.162+0000 7fd253fff640 1 -- 172.21.15.5:0/2762717723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c00fc90 con 0x7fd2540051c0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.162+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c148a70 con 0x7fd2540051c0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.162+0000 7fd253fff640 1 -- 172.21.15.5:0/2762717723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c014440 con 0x7fd2540051c0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.162+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c149030 con 0x7fd2540051c0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.163+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26c04ef20 con 0x7fd2540051c0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.163+0000 7fd253fff640 1 -- 172.21.15.5:0/2762717723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd25c012040 con 0x7fd2540051c0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.163+0000 7fd253fff640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd25806b500 0x7fd25806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.164+0000 7fd253fff640 1 -- 172.21.15.5:0/2762717723 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd25c08a9d0 con 0x7fd2540051c0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.164+0000 7fd26affd640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd25806b500 0x7fd25806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.164+0000 7fd26affd640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd25806b500 0x7fd25806d9c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd260000c00 tx=0x7fd260009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.168+0000 7fd253fff640 1 -- 172.21.15.5:0/2762717723 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd25c019030 con 0x7fd2540051c0 2024-04-25T09:05:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.383+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd26c15f210 con 0x7fd2540051c0 2024-04-25T09:05:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.383+0000 7fd253fff640 1 -- 172.21.15.5:0/2762717723 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fd25c059170 con 0x7fd2540051c0 2024-04-25T09:05:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:20.371 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd25806b500 msgr2=0x7fd25806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd25806b500 0x7fd25806d9c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd260000c00 tx=0x7fd260009040 comp rx=0 tx=0).stop 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 msgr2=0x7fd26c149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd26c149830 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0118e0 tx=0x7fd25c011da0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 shutdown_connections 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd25806b500 0x7fd25806d9c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c14a1f0 0x7fd26c0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd26c14ac00 0x7fd26c147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 --2- 172.21.15.5:0/2762717723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540051c0 0x7fd26c149830 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 >> 172.21.15.5:0/2762717723 conn(0x7fd26c0668f0 msgr2=0x7fd26c15e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 shutdown_connections 2024-04-25T09:05:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:20.385+0000 7fd271b28640 1 -- 172.21.15.5:0/2762717723 wait complete. 2024-04-25T09:05:20.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:20.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:20.385 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:20.385 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:05:20.385 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:20.385 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:20.385 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:20.385 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.420 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988675 s, 106 MB/s 2024-04-25T09:05:20.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719952 s, 146 MB/s 2024-04-25T09:05:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847383 s, 124 MB/s 2024-04-25T09:05:20.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777067 s, 135 MB/s 2024-04-25T09:05:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845236 s, 124 MB/s 2024-04-25T09:05:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773894 s, 135 MB/s 2024-04-25T09:05:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617307 s, 170 MB/s 2024-04-25T09:05:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843432 s, 124 MB/s 2024-04-25T09:05:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779 s, 135 MB/s 2024-04-25T09:05:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748585 s, 140 MB/s 2024-04-25T09:05:20.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763802 s, 137 MB/s 2024-04-25T09:05:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866954 s, 121 MB/s 2024-04-25T09:05:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691134 s, 152 MB/s 2024-04-25T09:05:20.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751874 s, 139 MB/s 2024-04-25T09:05:20.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700043 s, 150 MB/s 2024-04-25T09:05:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071878 s, 146 MB/s 2024-04-25T09:05:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649138 s, 162 MB/s 2024-04-25T09:05:20.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076984 s, 136 MB/s 2024-04-25T09:05:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783165 s, 134 MB/s 2024-04-25T09:05:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077717 s, 135 MB/s 2024-04-25T09:05:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795614 s, 132 MB/s 2024-04-25T09:05:20.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787921 s, 133 MB/s 2024-04-25T09:05:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766492 s, 137 MB/s 2024-04-25T09:05:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742645 s, 141 MB/s 2024-04-25T09:05:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777914 s, 135 MB/s 2024-04-25T09:05:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689274 s, 152 MB/s 2024-04-25T09:05:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712743 s, 147 MB/s 2024-04-25T09:05:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747704 s, 140 MB/s 2024-04-25T09:05:20.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723657 s, 145 MB/s 2024-04-25T09:05:20.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723683 s, 145 MB/s 2024-04-25T09:05:20.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.674 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780957 s, 134 MB/s 2024-04-25T09:05:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707322 s, 148 MB/s 2024-04-25T09:05:20.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:20.682 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:20.683 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:20.683 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:05:20.683 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:20.683 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:20.683 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:20.683 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:20.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720996 s, 145 MB/s 2024-04-25T09:05:20.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071484 s, 147 MB/s 2024-04-25T09:05:20.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767157 s, 137 MB/s 2024-04-25T09:05:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078713 s, 133 MB/s 2024-04-25T09:05:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762541 s, 138 MB/s 2024-04-25T09:05:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798987 s, 131 MB/s 2024-04-25T09:05:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070602 s, 149 MB/s 2024-04-25T09:05:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079694 s, 132 MB/s 2024-04-25T09:05:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729081 s, 144 MB/s 2024-04-25T09:05:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789032 s, 133 MB/s 2024-04-25T09:05:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632261 s, 166 MB/s 2024-04-25T09:05:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762241 s, 138 MB/s 2024-04-25T09:05:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692029 s, 152 MB/s 2024-04-25T09:05:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747756 s, 140 MB/s 2024-04-25T09:05:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749718 s, 140 MB/s 2024-04-25T09:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766667 s, 137 MB/s 2024-04-25T09:05:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763807 s, 137 MB/s 2024-04-25T09:05:20.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.890 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743259 s, 141 MB/s 2024-04-25T09:05:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714133 s, 147 MB/s 2024-04-25T09:05:20.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812853 s, 129 MB/s 2024-04-25T09:05:20.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739434 s, 142 MB/s 2024-04-25T09:05:20.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712037 s, 147 MB/s 2024-04-25T09:05:20.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699772 s, 150 MB/s 2024-04-25T09:05:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742543 s, 141 MB/s 2024-04-25T09:05:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746513 s, 140 MB/s 2024-04-25T09:05:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766242 s, 137 MB/s 2024-04-25T09:05:20.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754261 s, 139 MB/s 2024-04-25T09:05:20.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071624 s, 146 MB/s 2024-04-25T09:05:20.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693627 s, 151 MB/s 2024-04-25T09:05:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685072 s, 153 MB/s 2024-04-25T09:05:20.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:20.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:20.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707571 s, 148 MB/s 2024-04-25T09:05:21.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779566 s, 135 MB/s 2024-04-25T09:05:21.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:21.007 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:21.007 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:21.007 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:05:21.007 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:21.007 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:21.007 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:21.007 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737457 s, 142 MB/s 2024-04-25T09:05:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065659 s, 160 MB/s 2024-04-25T09:05:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664869 s, 158 MB/s 2024-04-25T09:05:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691571 s, 152 MB/s 2024-04-25T09:05:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758587 s, 138 MB/s 2024-04-25T09:05:21.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.113 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745865 s, 141 MB/s 2024-04-25T09:05:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689674 s, 152 MB/s 2024-04-25T09:05:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709009 s, 148 MB/s 2024-04-25T09:05:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758456 s, 138 MB/s 2024-04-25T09:05:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.145 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749688 s, 140 MB/s 2024-04-25T09:05:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750556 s, 140 MB/s 2024-04-25T09:05:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756062 s, 139 MB/s 2024-04-25T09:05:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764693 s, 137 MB/s 2024-04-25T09:05:21.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767376 s, 137 MB/s 2024-04-25T09:05:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679196 s, 154 MB/s 2024-04-25T09:05:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772076 s, 136 MB/s 2024-04-25T09:05:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066466 s, 158 MB/s 2024-04-25T09:05:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670872 s, 156 MB/s 2024-04-25T09:05:21.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726121 s, 144 MB/s 2024-04-25T09:05:21.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070268 s, 149 MB/s 2024-04-25T09:05:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793556 s, 132 MB/s 2024-04-25T09:05:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824211 s, 127 MB/s 2024-04-25T09:05:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771284 s, 136 MB/s 2024-04-25T09:05:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747481 s, 140 MB/s 2024-04-25T09:05:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765662 s, 137 MB/s 2024-04-25T09:05:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769686 s, 136 MB/s 2024-04-25T09:05:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733442 s, 143 MB/s 2024-04-25T09:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653793 s, 160 MB/s 2024-04-25T09:05:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666482 s, 157 MB/s 2024-04-25T09:05:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728839 s, 144 MB/s 2024-04-25T09:05:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736338 s, 142 MB/s 2024-04-25T09:05:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690814 s, 152 MB/s 2024-04-25T09:05:21.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:21.329 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:21.329 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:21.329 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:05:21.329 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:21.329 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:21.329 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:21.329 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725749 s, 144 MB/s 2024-04-25T09:05:21.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00831845 s, 126 MB/s 2024-04-25T09:05:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079356 s, 132 MB/s 2024-04-25T09:05:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698119 s, 150 MB/s 2024-04-25T09:05:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709621 s, 148 MB/s 2024-04-25T09:05:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767288 s, 137 MB/s 2024-04-25T09:05:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744978 s, 141 MB/s 2024-04-25T09:05:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783925 s, 134 MB/s 2024-04-25T09:05:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066345 s, 158 MB/s 2024-04-25T09:05:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695614 s, 151 MB/s 2024-04-25T09:05:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739562 s, 142 MB/s 2024-04-25T09:05:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707648 s, 148 MB/s 2024-04-25T09:05:21.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746468 s, 140 MB/s 2024-04-25T09:05:21.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655782 s, 160 MB/s 2024-04-25T09:05:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668577 s, 157 MB/s 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641948 s, 163 MB/s 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748344 s, 140 MB/s 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717735 s, 146 MB/s 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077681 s, 135 MB/s 2024-04-25T09:05:21.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774161 s, 135 MB/s 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075848 s, 138 MB/s 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00897272 s, 117 MB/s 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083485 s, 126 MB/s 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727332 s, 144 MB/s 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724305 s, 145 MB/s 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737231 s, 142 MB/s 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688698 s, 152 MB/s 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721941 s, 145 MB/s 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074937 s, 140 MB/s 2024-04-25T09:05:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724551 s, 145 MB/s 2024-04-25T09:05:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732861 s, 143 MB/s 2024-04-25T09:05:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736216 s, 142 MB/s 2024-04-25T09:05:21.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:21.652 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:21.652 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:21.652 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:05:21.652 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:21.652 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:21.652 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:21.652 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664017 s, 158 MB/s 2024-04-25T09:05:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.725 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692241 s, 151 MB/s 2024-04-25T09:05:21.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718632 s, 146 MB/s 2024-04-25T09:05:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718916 s, 146 MB/s 2024-04-25T09:05:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683846 s, 153 MB/s 2024-04-25T09:05:21.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731606 s, 143 MB/s 2024-04-25T09:05:21.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750605 s, 140 MB/s 2024-04-25T09:05:21.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.773 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730683 s, 144 MB/s 2024-04-25T09:05:21.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.782 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.782 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074181 s, 141 MB/s 2024-04-25T09:05:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695667 s, 151 MB/s 2024-04-25T09:05:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749609 s, 140 MB/s 2024-04-25T09:05:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.806 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657903 s, 159 MB/s 2024-04-25T09:05:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835268 s, 126 MB/s 2024-04-25T09:05:21.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629934 s, 166 MB/s 2024-04-25T09:05:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745784 s, 141 MB/s 2024-04-25T09:05:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687834 s, 152 MB/s 2024-04-25T09:05:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747539 s, 140 MB/s 2024-04-25T09:05:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732065 s, 143 MB/s 2024-04-25T09:05:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759401 s, 138 MB/s 2024-04-25T09:05:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074858 s, 140 MB/s 2024-04-25T09:05:21.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688976 s, 152 MB/s 2024-04-25T09:05:21.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072601 s, 144 MB/s 2024-04-25T09:05:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714269 s, 147 MB/s 2024-04-25T09:05:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738073 s, 142 MB/s 2024-04-25T09:05:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785677 s, 133 MB/s 2024-04-25T09:05:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736731 s, 142 MB/s 2024-04-25T09:05:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751982 s, 139 MB/s 2024-04-25T09:05:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742707 s, 141 MB/s 2024-04-25T09:05:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809164 s, 130 MB/s 2024-04-25T09:05:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069635 s, 151 MB/s 2024-04-25T09:05:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784772 s, 134 MB/s 2024-04-25T09:05:21.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:21.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:21.972 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720815 s, 145 MB/s 2024-04-25T09:05:21.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:21.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:21.973 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:21.973 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:05:21.973 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:21.974 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:21.974 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:21.974 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698937 s, 150 MB/s 2024-04-25T09:05:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072554 s, 145 MB/s 2024-04-25T09:05:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852619 s, 123 MB/s 2024-04-25T09:05:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643958 s, 163 MB/s 2024-04-25T09:05:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746734 s, 140 MB/s 2024-04-25T09:05:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677228 s, 155 MB/s 2024-04-25T09:05:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768032 s, 137 MB/s 2024-04-25T09:05:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715273 s, 147 MB/s 2024-04-25T09:05:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686882 s, 153 MB/s 2024-04-25T09:05:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748168 s, 140 MB/s 2024-04-25T09:05:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708087 s, 148 MB/s 2024-04-25T09:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715075 s, 147 MB/s 2024-04-25T09:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724398 s, 145 MB/s 2024-04-25T09:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645717 s, 162 MB/s 2024-04-25T09:05:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710484 s, 148 MB/s 2024-04-25T09:05:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680982 s, 154 MB/s 2024-04-25T09:05:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746469 s, 140 MB/s 2024-04-25T09:05:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665025 s, 158 MB/s 2024-04-25T09:05:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702767 s, 149 MB/s 2024-04-25T09:05:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728946 s, 144 MB/s 2024-04-25T09:05:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737509 s, 142 MB/s 2024-04-25T09:05:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724439 s, 145 MB/s 2024-04-25T09:05:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750533 s, 140 MB/s 2024-04-25T09:05:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867449 s, 121 MB/s 2024-04-25T09:05:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660468 s, 159 MB/s 2024-04-25T09:05:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076351 s, 137 MB/s 2024-04-25T09:05:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706206 s, 148 MB/s 2024-04-25T09:05:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743974 s, 141 MB/s 2024-04-25T09:05:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700659 s, 150 MB/s 2024-04-25T09:05:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733059 s, 143 MB/s 2024-04-25T09:05:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754833 s, 139 MB/s 2024-04-25T09:05:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764363 s, 137 MB/s 2024-04-25T09:05:22.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:22.293 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:22.293 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:22.293 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:05:22.293 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:22.293 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:22.293 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:22.293 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729715 s, 144 MB/s 2024-04-25T09:05:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621753 s, 169 MB/s 2024-04-25T09:05:22.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.374 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733773 s, 143 MB/s 2024-04-25T09:05:22.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.382 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733708 s, 143 MB/s 2024-04-25T09:05:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606668 s, 173 MB/s 2024-04-25T09:05:22.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750334 s, 140 MB/s 2024-04-25T09:05:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725261 s, 145 MB/s 2024-04-25T09:05:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070309 s, 149 MB/s 2024-04-25T09:05:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654965 s, 160 MB/s 2024-04-25T09:05:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687142 s, 153 MB/s 2024-04-25T09:05:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743915 s, 141 MB/s 2024-04-25T09:05:22.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787654 s, 133 MB/s 2024-04-25T09:05:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737883 s, 142 MB/s 2024-04-25T09:05:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653572 s, 160 MB/s 2024-04-25T09:05:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648515 s, 162 MB/s 2024-04-25T09:05:22.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721416 s, 145 MB/s 2024-04-25T09:05:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723285 s, 145 MB/s 2024-04-25T09:05:22.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757942 s, 138 MB/s 2024-04-25T09:05:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634906 s, 165 MB/s 2024-04-25T09:05:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695099 s, 151 MB/s 2024-04-25T09:05:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743874 s, 141 MB/s 2024-04-25T09:05:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721007 s, 145 MB/s 2024-04-25T09:05:22.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.533 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710719 s, 148 MB/s 2024-04-25T09:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707976 s, 148 MB/s 2024-04-25T09:05:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613571 s, 171 MB/s 2024-04-25T09:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662978 s, 158 MB/s 2024-04-25T09:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634796 s, 165 MB/s 2024-04-25T09:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706873 s, 148 MB/s 2024-04-25T09:05:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766776 s, 137 MB/s 2024-04-25T09:05:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761519 s, 138 MB/s 2024-04-25T09:05:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739748 s, 142 MB/s 2024-04-25T09:05:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637886 s, 164 MB/s 2024-04-25T09:05:22.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:22.605 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:22.605 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:22.605 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:05:22.605 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:22.605 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:22.605 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:22.605 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719212 s, 146 MB/s 2024-04-25T09:05:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716512 s, 146 MB/s 2024-04-25T09:05:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808803 s, 130 MB/s 2024-04-25T09:05:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745861 s, 141 MB/s 2024-04-25T09:05:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728868 s, 144 MB/s 2024-04-25T09:05:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738846 s, 142 MB/s 2024-04-25T09:05:22.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713712 s, 147 MB/s 2024-04-25T09:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.729 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745372 s, 141 MB/s 2024-04-25T09:05:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765688 s, 137 MB/s 2024-04-25T09:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065574 s, 160 MB/s 2024-04-25T09:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746375 s, 140 MB/s 2024-04-25T09:05:22.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067725 s, 155 MB/s 2024-04-25T09:05:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726949 s, 144 MB/s 2024-04-25T09:05:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735087 s, 143 MB/s 2024-04-25T09:05:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734293 s, 143 MB/s 2024-04-25T09:05:22.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071931 s, 146 MB/s 2024-04-25T09:05:22.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724461 s, 145 MB/s 2024-04-25T09:05:22.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700727 s, 150 MB/s 2024-04-25T09:05:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723809 s, 145 MB/s 2024-04-25T09:05:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676461 s, 155 MB/s 2024-04-25T09:05:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667861 s, 157 MB/s 2024-04-25T09:05:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674512 s, 155 MB/s 2024-04-25T09:05:22.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008573 s, 122 MB/s 2024-04-25T09:05:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733964 s, 143 MB/s 2024-04-25T09:05:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689238 s, 152 MB/s 2024-04-25T09:05:22.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695509 s, 151 MB/s 2024-04-25T09:05:22.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656209 s, 160 MB/s 2024-04-25T09:05:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663616 s, 158 MB/s 2024-04-25T09:05:22.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728638 s, 144 MB/s 2024-04-25T09:05:22.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.906 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782155 s, 134 MB/s 2024-04-25T09:05:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724033 s, 145 MB/s 2024-04-25T09:05:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705932 s, 149 MB/s 2024-04-25T09:05:22.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:22.923 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:22.924 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:22.924 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:05:22.924 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:22.924 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:22.924 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:22.924 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:22.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075657 s, 139 MB/s 2024-04-25T09:05:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756185 s, 139 MB/s 2024-04-25T09:05:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782793 s, 134 MB/s 2024-04-25T09:05:23.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070748 s, 148 MB/s 2024-04-25T09:05:23.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764876 s, 137 MB/s 2024-04-25T09:05:23.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681975 s, 154 MB/s 2024-04-25T09:05:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705844 s, 149 MB/s 2024-04-25T09:05:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752937 s, 139 MB/s 2024-04-25T09:05:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074561 s, 141 MB/s 2024-04-25T09:05:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752961 s, 139 MB/s 2024-04-25T09:05:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796167 s, 132 MB/s 2024-04-25T09:05:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861165 s, 122 MB/s 2024-04-25T09:05:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790548 s, 133 MB/s 2024-04-25T09:05:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753485 s, 139 MB/s 2024-04-25T09:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721475 s, 145 MB/s 2024-04-25T09:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721515 s, 145 MB/s 2024-04-25T09:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729466 s, 144 MB/s 2024-04-25T09:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770371 s, 136 MB/s 2024-04-25T09:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706937 s, 148 MB/s 2024-04-25T09:05:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721641 s, 145 MB/s 2024-04-25T09:05:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711647 s, 147 MB/s 2024-04-25T09:05:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704193 s, 149 MB/s 2024-04-25T09:05:23.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.173 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699994 s, 150 MB/s 2024-04-25T09:05:23.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714161 s, 147 MB/s 2024-04-25T09:05:23.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765946 s, 137 MB/s 2024-04-25T09:05:23.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704991 s, 149 MB/s 2024-04-25T09:05:23.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748644 s, 140 MB/s 2024-04-25T09:05:23.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699619 s, 150 MB/s 2024-04-25T09:05:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073443 s, 143 MB/s 2024-04-25T09:05:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728413 s, 144 MB/s 2024-04-25T09:05:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783182 s, 134 MB/s 2024-04-25T09:05:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741109 s, 141 MB/s 2024-04-25T09:05:23.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:23.249 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:23.249 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:23.249 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:05:23.249 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:23.249 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:23.249 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:23.249 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706624 s, 148 MB/s 2024-04-25T09:05:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695924 s, 151 MB/s 2024-04-25T09:05:23.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754296 s, 139 MB/s 2024-04-25T09:05:23.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627424 s, 167 MB/s 2024-04-25T09:05:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741979 s, 141 MB/s 2024-04-25T09:05:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735953 s, 142 MB/s 2024-04-25T09:05:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687171 s, 153 MB/s 2024-04-25T09:05:23.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014236 s, 73.7 MB/s 2024-04-25T09:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745367 s, 141 MB/s 2024-04-25T09:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725022 s, 145 MB/s 2024-04-25T09:05:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733711 s, 143 MB/s 2024-04-25T09:05:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743178 s, 141 MB/s 2024-04-25T09:05:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720704 s, 145 MB/s 2024-04-25T09:05:23.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649093 s, 162 MB/s 2024-04-25T09:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.438 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733641 s, 143 MB/s 2024-04-25T09:05:23.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636806 s, 165 MB/s 2024-04-25T09:05:23.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716108 s, 146 MB/s 2024-04-25T09:05:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719637 s, 146 MB/s 2024-04-25T09:05:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720493 s, 146 MB/s 2024-04-25T09:05:23.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725492 s, 145 MB/s 2024-04-25T09:05:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634907 s, 165 MB/s 2024-04-25T09:05:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665389 s, 158 MB/s 2024-04-25T09:05:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750326 s, 140 MB/s 2024-04-25T09:05:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620322 s, 169 MB/s 2024-04-25T09:05:23.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.512 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685216 s, 153 MB/s 2024-04-25T09:05:23.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849762 s, 123 MB/s 2024-04-25T09:05:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737173 s, 142 MB/s 2024-04-25T09:05:23.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638713 s, 164 MB/s 2024-04-25T09:05:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712602 s, 147 MB/s 2024-04-25T09:05:23.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769854 s, 136 MB/s 2024-04-25T09:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756578 s, 139 MB/s 2024-04-25T09:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635151 s, 165 MB/s 2024-04-25T09:05:23.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:23.570 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:23.570 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:23.570 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:05:23.571 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:23.571 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:23.571 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:23.571 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:23.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768765 s, 136 MB/s 2024-04-25T09:05:23.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718012 s, 146 MB/s 2024-04-25T09:05:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767289 s, 137 MB/s 2024-04-25T09:05:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651638 s, 161 MB/s 2024-04-25T09:05:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761928 s, 138 MB/s 2024-04-25T09:05:23.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.677 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736804 s, 142 MB/s 2024-04-25T09:05:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698754 s, 150 MB/s 2024-04-25T09:05:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639388 s, 164 MB/s 2024-04-25T09:05:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641923 s, 163 MB/s 2024-04-25T09:05:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073627 s, 142 MB/s 2024-04-25T09:05:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738016 s, 142 MB/s 2024-04-25T09:05:23.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.725 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759636 s, 138 MB/s 2024-04-25T09:05:23.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695285 s, 151 MB/s 2024-04-25T09:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072385 s, 145 MB/s 2024-04-25T09:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746027 s, 141 MB/s 2024-04-25T09:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698345 s, 150 MB/s 2024-04-25T09:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006847 s, 153 MB/s 2024-04-25T09:05:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.773 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673911 s, 156 MB/s 2024-04-25T09:05:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740035 s, 142 MB/s 2024-04-25T09:05:23.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730467 s, 144 MB/s 2024-04-25T09:05:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627577 s, 167 MB/s 2024-04-25T09:05:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071944 s, 146 MB/s 2024-04-25T09:05:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655557 s, 160 MB/s 2024-04-25T09:05:23.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641306 s, 164 MB/s 2024-04-25T09:05:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655051 s, 160 MB/s 2024-04-25T09:05:23.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722477 s, 145 MB/s 2024-04-25T09:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661018 s, 159 MB/s 2024-04-25T09:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.851 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737753 s, 142 MB/s 2024-04-25T09:05:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753398 s, 139 MB/s 2024-04-25T09:05:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741861 s, 141 MB/s 2024-04-25T09:05:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634303 s, 165 MB/s 2024-04-25T09:05:23.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777449 s, 135 MB/s 2024-04-25T09:05:23.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:23.884 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:23.884 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:23.884 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:05:23.884 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:23.884 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:23.884 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:23.884 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700897 s, 150 MB/s 2024-04-25T09:05:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845533 s, 124 MB/s 2024-04-25T09:05:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706402 s, 148 MB/s 2024-04-25T09:05:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708324 s, 148 MB/s 2024-04-25T09:05:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900052 s, 117 MB/s 2024-04-25T09:05:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794228 s, 132 MB/s 2024-04-25T09:05:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678554 s, 155 MB/s 2024-04-25T09:05:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710938 s, 147 MB/s 2024-04-25T09:05:24.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758291 s, 138 MB/s 2024-04-25T09:05:24.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723141 s, 145 MB/s 2024-04-25T09:05:24.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762233 s, 138 MB/s 2024-04-25T09:05:24.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729611 s, 144 MB/s 2024-04-25T09:05:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742069 s, 141 MB/s 2024-04-25T09:05:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742079 s, 141 MB/s 2024-04-25T09:05:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728584 s, 144 MB/s 2024-04-25T09:05:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768827 s, 136 MB/s 2024-04-25T09:05:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865178 s, 121 MB/s 2024-04-25T09:05:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745756 s, 141 MB/s 2024-04-25T09:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738714 s, 142 MB/s 2024-04-25T09:05:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710763 s, 148 MB/s 2024-04-25T09:05:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776864 s, 135 MB/s 2024-04-25T09:05:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065667 s, 160 MB/s 2024-04-25T09:05:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777106 s, 135 MB/s 2024-04-25T09:05:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734813 s, 143 MB/s 2024-04-25T09:05:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659275 s, 159 MB/s 2024-04-25T09:05:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752202 s, 139 MB/s 2024-04-25T09:05:24.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.168 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710272 s, 148 MB/s 2024-04-25T09:05:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715343 s, 147 MB/s 2024-04-25T09:05:24.184 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.184 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.184 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708469 s, 148 MB/s 2024-04-25T09:05:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728837 s, 144 MB/s 2024-04-25T09:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687058 s, 153 MB/s 2024-04-25T09:05:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721237 s, 145 MB/s 2024-04-25T09:05:24.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:24.209 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:24.209 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:24.209 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:05:24.209 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:24.209 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:24.209 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:24.209 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:24.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.274 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696411 s, 151 MB/s 2024-04-25T09:05:24.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719671 s, 146 MB/s 2024-04-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766903 s, 137 MB/s 2024-04-25T09:05:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730207 s, 144 MB/s 2024-04-25T09:05:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630218 s, 166 MB/s 2024-04-25T09:05:24.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745009 s, 141 MB/s 2024-04-25T09:05:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675295 s, 155 MB/s 2024-04-25T09:05:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777984 s, 135 MB/s 2024-04-25T09:05:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064104 s, 164 MB/s 2024-04-25T09:05:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713407 s, 147 MB/s 2024-04-25T09:05:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673825 s, 156 MB/s 2024-04-25T09:05:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691097 s, 152 MB/s 2024-04-25T09:05:24.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733184 s, 143 MB/s 2024-04-25T09:05:24.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.377 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640918 s, 164 MB/s 2024-04-25T09:05:24.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646537 s, 162 MB/s 2024-04-25T09:05:24.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666666 s, 157 MB/s 2024-04-25T09:05:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752828 s, 139 MB/s 2024-04-25T09:05:24.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708457 s, 148 MB/s 2024-04-25T09:05:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688928 s, 152 MB/s 2024-04-25T09:05:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746512 s, 140 MB/s 2024-04-25T09:05:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074415 s, 141 MB/s 2024-04-25T09:05:24.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769072 s, 136 MB/s 2024-04-25T09:05:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730103 s, 144 MB/s 2024-04-25T09:05:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738165 s, 142 MB/s 2024-04-25T09:05:24.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684815 s, 153 MB/s 2024-04-25T09:05:24.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769927 s, 136 MB/s 2024-04-25T09:05:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737234 s, 142 MB/s 2024-04-25T09:05:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695394 s, 151 MB/s 2024-04-25T09:05:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762676 s, 137 MB/s 2024-04-25T09:05:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075467 s, 139 MB/s 2024-04-25T09:05:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684601 s, 153 MB/s 2024-04-25T09:05:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746458 s, 140 MB/s 2024-04-25T09:05:24.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:24.525 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:24.525 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:24.526 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:05:24.526 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:24.526 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:24.526 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:24.526 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:24.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629123 s, 167 MB/s 2024-04-25T09:05:24.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767528 s, 137 MB/s 2024-04-25T09:05:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708116 s, 148 MB/s 2024-04-25T09:05:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706233 s, 148 MB/s 2024-04-25T09:05:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726699 s, 144 MB/s 2024-04-25T09:05:24.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076698 s, 137 MB/s 2024-04-25T09:05:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709622 s, 148 MB/s 2024-04-25T09:05:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757196 s, 138 MB/s 2024-04-25T09:05:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733835 s, 143 MB/s 2024-04-25T09:05:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747373 s, 140 MB/s 2024-04-25T09:05:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727291 s, 144 MB/s 2024-04-25T09:05:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784842 s, 134 MB/s 2024-04-25T09:05:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742778 s, 141 MB/s 2024-04-25T09:05:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708142 s, 148 MB/s 2024-04-25T09:05:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615196 s, 170 MB/s 2024-04-25T09:05:24.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.711 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605313 s, 173 MB/s 2024-04-25T09:05:24.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676266 s, 155 MB/s 2024-04-25T09:05:24.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753988 s, 139 MB/s 2024-04-25T09:05:24.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636797 s, 165 MB/s 2024-04-25T09:05:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714867 s, 147 MB/s 2024-04-25T09:05:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716549 s, 146 MB/s 2024-04-25T09:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711444 s, 147 MB/s 2024-04-25T09:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683396 s, 153 MB/s 2024-04-25T09:05:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734345 s, 143 MB/s 2024-04-25T09:05:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805097 s, 130 MB/s 2024-04-25T09:05:24.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721962 s, 145 MB/s 2024-04-25T09:05:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646913 s, 162 MB/s 2024-04-25T09:05:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802779 s, 131 MB/s 2024-04-25T09:05:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805607 s, 130 MB/s 2024-04-25T09:05:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080152 s, 131 MB/s 2024-04-25T09:05:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683741 s, 153 MB/s 2024-04-25T09:05:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709799 s, 148 MB/s 2024-04-25T09:05:24.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:24.843 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:24.843 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:24.843 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:05:24.843 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:24.843 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:24.844 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:24.844 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781457 s, 134 MB/s 2024-04-25T09:05:24.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.918 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739577 s, 142 MB/s 2024-04-25T09:05:24.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652667 s, 161 MB/s 2024-04-25T09:05:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620685 s, 169 MB/s 2024-04-25T09:05:24.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729232 s, 144 MB/s 2024-04-25T09:05:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743325 s, 141 MB/s 2024-04-25T09:05:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739616 s, 142 MB/s 2024-04-25T09:05:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759445 s, 138 MB/s 2024-04-25T09:05:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672335 s, 156 MB/s 2024-04-25T09:05:24.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690153 s, 152 MB/s 2024-04-25T09:05:24.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728826 s, 144 MB/s 2024-04-25T09:05:24.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727143 s, 144 MB/s 2024-04-25T09:05:25.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069732 s, 150 MB/s 2024-04-25T09:05:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727134 s, 144 MB/s 2024-04-25T09:05:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007209 s, 145 MB/s 2024-04-25T09:05:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739946 s, 142 MB/s 2024-04-25T09:05:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763772 s, 137 MB/s 2024-04-25T09:05:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720837 s, 145 MB/s 2024-04-25T09:05:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739217 s, 142 MB/s 2024-04-25T09:05:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712161 s, 147 MB/s 2024-04-25T09:05:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637458 s, 164 MB/s 2024-04-25T09:05:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696233 s, 151 MB/s 2024-04-25T09:05:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702707 s, 149 MB/s 2024-04-25T09:05:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721412 s, 145 MB/s 2024-04-25T09:05:25.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072828 s, 144 MB/s 2024-04-25T09:05:25.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745351 s, 141 MB/s 2024-04-25T09:05:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784676 s, 134 MB/s 2024-04-25T09:05:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713726 s, 147 MB/s 2024-04-25T09:05:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078401 s, 134 MB/s 2024-04-25T09:05:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864771 s, 121 MB/s 2024-04-25T09:05:25.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066962 s, 157 MB/s 2024-04-25T09:05:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725577 s, 145 MB/s 2024-04-25T09:05:25.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:25.163 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:25.163 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:25.163 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:05:25.163 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:25.163 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:25.163 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:25.163 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727948 s, 144 MB/s 2024-04-25T09:05:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670576 s, 156 MB/s 2024-04-25T09:05:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726717 s, 144 MB/s 2024-04-25T09:05:25.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698236 s, 150 MB/s 2024-04-25T09:05:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860161 s, 122 MB/s 2024-04-25T09:05:25.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723928 s, 145 MB/s 2024-04-25T09:05:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672516 s, 156 MB/s 2024-04-25T09:05:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648061 s, 162 MB/s 2024-04-25T09:05:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742663 s, 141 MB/s 2024-04-25T09:05:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729039 s, 144 MB/s 2024-04-25T09:05:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644737 s, 163 MB/s 2024-04-25T09:05:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735003 s, 143 MB/s 2024-04-25T09:05:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614398 s, 171 MB/s 2024-04-25T09:05:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632438 s, 166 MB/s 2024-04-25T09:05:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682734 s, 154 MB/s 2024-04-25T09:05:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786319 s, 133 MB/s 2024-04-25T09:05:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760825 s, 138 MB/s 2024-04-25T09:05:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672496 s, 156 MB/s 2024-04-25T09:05:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747791 s, 140 MB/s 2024-04-25T09:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751157 s, 140 MB/s 2024-04-25T09:05:25.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721826 s, 145 MB/s 2024-04-25T09:05:25.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.396 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664332 s, 158 MB/s 2024-04-25T09:05:25.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693714 s, 151 MB/s 2024-04-25T09:05:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639817 s, 164 MB/s 2024-04-25T09:05:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746841 s, 140 MB/s 2024-04-25T09:05:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740329 s, 142 MB/s 2024-04-25T09:05:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739964 s, 142 MB/s 2024-04-25T09:05:25.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070218 s, 149 MB/s 2024-04-25T09:05:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718775 s, 146 MB/s 2024-04-25T09:05:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680481 s, 154 MB/s 2024-04-25T09:05:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737012 s, 142 MB/s 2024-04-25T09:05:25.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.475 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649519 s, 161 MB/s 2024-04-25T09:05:25.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:25.476 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:25.477 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:25.477 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:05:25.477 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:25.477 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:25.477 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:25.477 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732687 s, 143 MB/s 2024-04-25T09:05:25.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730875 s, 143 MB/s 2024-04-25T09:05:25.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726925 s, 144 MB/s 2024-04-25T09:05:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683713 s, 153 MB/s 2024-04-25T09:05:25.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681399 s, 154 MB/s 2024-04-25T09:05:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738255 s, 142 MB/s 2024-04-25T09:05:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728136 s, 144 MB/s 2024-04-25T09:05:25.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713636 s, 147 MB/s 2024-04-25T09:05:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690872 s, 152 MB/s 2024-04-25T09:05:25.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734455 s, 143 MB/s 2024-04-25T09:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732993 s, 143 MB/s 2024-04-25T09:05:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675693 s, 155 MB/s 2024-04-25T09:05:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076206 s, 138 MB/s 2024-04-25T09:05:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627601 s, 167 MB/s 2024-04-25T09:05:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833998 s, 126 MB/s 2024-04-25T09:05:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756478 s, 139 MB/s 2024-04-25T09:05:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708654 s, 148 MB/s 2024-04-25T09:05:25.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701036 s, 150 MB/s 2024-04-25T09:05:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726466 s, 144 MB/s 2024-04-25T09:05:25.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732249 s, 143 MB/s 2024-04-25T09:05:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728473 s, 144 MB/s 2024-04-25T09:05:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630914 s, 166 MB/s 2024-04-25T09:05:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746292 s, 141 MB/s 2024-04-25T09:05:25.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764818 s, 137 MB/s 2024-04-25T09:05:25.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797773 s, 131 MB/s 2024-04-25T09:05:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.745 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708688 s, 148 MB/s 2024-04-25T09:05:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774165 s, 135 MB/s 2024-04-25T09:05:25.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669173 s, 157 MB/s 2024-04-25T09:05:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702672 s, 149 MB/s 2024-04-25T09:05:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747744 s, 140 MB/s 2024-04-25T09:05:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741732 s, 141 MB/s 2024-04-25T09:05:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753599 s, 139 MB/s 2024-04-25T09:05:25.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:25.796 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:25.796 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:25.796 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:05:25.796 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:25.796 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:25.796 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:25.796 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:25.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069489 s, 151 MB/s 2024-04-25T09:05:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659947 s, 159 MB/s 2024-04-25T09:05:25.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696229 s, 151 MB/s 2024-04-25T09:05:25.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701913 s, 149 MB/s 2024-04-25T09:05:25.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638608 s, 164 MB/s 2024-04-25T09:05:25.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746782 s, 140 MB/s 2024-04-25T09:05:25.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721813 s, 145 MB/s 2024-04-25T09:05:25.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658642 s, 159 MB/s 2024-04-25T09:05:25.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751102 s, 140 MB/s 2024-04-25T09:05:25.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808981 s, 130 MB/s 2024-04-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.942 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727453 s, 144 MB/s 2024-04-25T09:05:25.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725149 s, 145 MB/s 2024-04-25T09:05:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071815 s, 146 MB/s 2024-04-25T09:05:25.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736972 s, 142 MB/s 2024-04-25T09:05:25.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.974 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741015 s, 142 MB/s 2024-04-25T09:05:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073326 s, 143 MB/s 2024-04-25T09:05:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753004 s, 139 MB/s 2024-04-25T09:05:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068051 s, 154 MB/s 2024-04-25T09:05:26.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762401 s, 138 MB/s 2024-04-25T09:05:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736851 s, 142 MB/s 2024-04-25T09:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852521 s, 123 MB/s 2024-04-25T09:05:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705604 s, 149 MB/s 2024-04-25T09:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728325 s, 144 MB/s 2024-04-25T09:05:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714409 s, 147 MB/s 2024-04-25T09:05:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708841 s, 148 MB/s 2024-04-25T09:05:26.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072002 s, 146 MB/s 2024-04-25T09:05:26.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074337 s, 141 MB/s 2024-04-25T09:05:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712525 s, 147 MB/s 2024-04-25T09:05:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723113 s, 145 MB/s 2024-04-25T09:05:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757532 s, 138 MB/s 2024-04-25T09:05:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007188 s, 146 MB/s 2024-04-25T09:05:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728789 s, 144 MB/s 2024-04-25T09:05:26.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:26.115 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:26.116 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:26.116 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:05:26.116 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:26.116 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:26.116 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:26.116 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744393 s, 141 MB/s 2024-04-25T09:05:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706234 s, 148 MB/s 2024-04-25T09:05:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734435 s, 143 MB/s 2024-04-25T09:05:26.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744755 s, 141 MB/s 2024-04-25T09:05:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702962 s, 149 MB/s 2024-04-25T09:05:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071615 s, 146 MB/s 2024-04-25T09:05:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762042 s, 138 MB/s 2024-04-25T09:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068506 s, 153 MB/s 2024-04-25T09:05:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742214 s, 141 MB/s 2024-04-25T09:05:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647911 s, 162 MB/s 2024-04-25T09:05:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627856 s, 167 MB/s 2024-04-25T09:05:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614983 s, 171 MB/s 2024-04-25T09:05:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714637 s, 147 MB/s 2024-04-25T09:05:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718779 s, 146 MB/s 2024-04-25T09:05:26.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727967 s, 144 MB/s 2024-04-25T09:05:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733272 s, 143 MB/s 2024-04-25T09:05:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072599 s, 144 MB/s 2024-04-25T09:05:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720627 s, 146 MB/s 2024-04-25T09:05:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706828 s, 148 MB/s 2024-04-25T09:05:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725706 s, 144 MB/s 2024-04-25T09:05:26.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718518 s, 146 MB/s 2024-04-25T09:05:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076595 s, 137 MB/s 2024-04-25T09:05:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646961 s, 162 MB/s 2024-04-25T09:05:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734452 s, 143 MB/s 2024-04-25T09:05:26.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692837 s, 151 MB/s 2024-04-25T09:05:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657056 s, 160 MB/s 2024-04-25T09:05:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732388 s, 143 MB/s 2024-04-25T09:05:26.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752496 s, 139 MB/s 2024-04-25T09:05:26.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623387 s, 168 MB/s 2024-04-25T09:05:26.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070917 s, 148 MB/s 2024-04-25T09:05:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695068 s, 151 MB/s 2024-04-25T09:05:26.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701822 s, 149 MB/s 2024-04-25T09:05:26.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:26.428 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:26.429 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:26.429 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:05:26.429 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:26.429 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:26.429 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:26.429 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667967 s, 157 MB/s 2024-04-25T09:05:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748647 s, 140 MB/s 2024-04-25T09:05:26.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725073 s, 145 MB/s 2024-04-25T09:05:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075909 s, 138 MB/s 2024-04-25T09:05:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714039 s, 147 MB/s 2024-04-25T09:05:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738982 s, 142 MB/s 2024-04-25T09:05:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692958 s, 151 MB/s 2024-04-25T09:05:26.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713791 s, 147 MB/s 2024-04-25T09:05:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069579 s, 151 MB/s 2024-04-25T09:05:26.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.567 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766072 s, 137 MB/s 2024-04-25T09:05:26.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649366 s, 161 MB/s 2024-04-25T09:05:26.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768264 s, 136 MB/s 2024-04-25T09:05:26.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722492 s, 145 MB/s 2024-04-25T09:05:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734278 s, 143 MB/s 2024-04-25T09:05:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638455 s, 164 MB/s 2024-04-25T09:05:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690398 s, 152 MB/s 2024-04-25T09:05:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085639 s, 122 MB/s 2024-04-25T09:05:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745936 s, 141 MB/s 2024-04-25T09:05:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743452 s, 141 MB/s 2024-04-25T09:05:26.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735154 s, 143 MB/s 2024-04-25T09:05:26.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722745 s, 145 MB/s 2024-04-25T09:05:26.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737263 s, 142 MB/s 2024-04-25T09:05:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749659 s, 140 MB/s 2024-04-25T09:05:26.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651154 s, 161 MB/s 2024-04-25T09:05:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751237 s, 140 MB/s 2024-04-25T09:05:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720042 s, 146 MB/s 2024-04-25T09:05:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756553 s, 139 MB/s 2024-04-25T09:05:26.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787448 s, 133 MB/s 2024-04-25T09:05:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634577 s, 165 MB/s 2024-04-25T09:05:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737442 s, 142 MB/s 2024-04-25T09:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709931 s, 148 MB/s 2024-04-25T09:05:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749077 s, 140 MB/s 2024-04-25T09:05:26.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:26.747 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:26.747 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:26.748 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:05:26.748 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:26.748 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:26.748 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:26.748 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:26.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646712 s, 162 MB/s 2024-04-25T09:05:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636449 s, 165 MB/s 2024-04-25T09:05:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071535 s, 147 MB/s 2024-04-25T09:05:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650971 s, 161 MB/s 2024-04-25T09:05:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075294 s, 139 MB/s 2024-04-25T09:05:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690267 s, 152 MB/s 2024-04-25T09:05:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760325 s, 138 MB/s 2024-04-25T09:05:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669446 s, 157 MB/s 2024-04-25T09:05:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743737 s, 141 MB/s 2024-04-25T09:05:26.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714704 s, 147 MB/s 2024-04-25T09:05:26.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671366 s, 156 MB/s 2024-04-25T09:05:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760716 s, 138 MB/s 2024-04-25T09:05:26.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812977 s, 129 MB/s 2024-04-25T09:05:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068939 s, 152 MB/s 2024-04-25T09:05:26.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726033 s, 144 MB/s 2024-04-25T09:05:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641289 s, 164 MB/s 2024-04-25T09:05:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730447 s, 144 MB/s 2024-04-25T09:05:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727153 s, 144 MB/s 2024-04-25T09:05:26.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855251 s, 123 MB/s 2024-04-25T09:05:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747074 s, 140 MB/s 2024-04-25T09:05:26.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743308 s, 141 MB/s 2024-04-25T09:05:26.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.984 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720114 s, 146 MB/s 2024-04-25T09:05:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766257 s, 137 MB/s 2024-04-25T09:05:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737507 s, 142 MB/s 2024-04-25T09:05:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703396 s, 149 MB/s 2024-04-25T09:05:27.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0082316 s, 127 MB/s 2024-04-25T09:05:27.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067292 s, 156 MB/s 2024-04-25T09:05:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708371 s, 148 MB/s 2024-04-25T09:05:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639709 s, 164 MB/s 2024-04-25T09:05:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730449 s, 144 MB/s 2024-04-25T09:05:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740025 s, 142 MB/s 2024-04-25T09:05:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643162 s, 163 MB/s 2024-04-25T09:05:27.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:27.065 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:27.066 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:27.066 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:05:27.066 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:27.066 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:27.066 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:27.066 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:27.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007203 s, 146 MB/s 2024-04-25T09:05:27.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762497 s, 138 MB/s 2024-04-25T09:05:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686486 s, 153 MB/s 2024-04-25T09:05:27.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726717 s, 144 MB/s 2024-04-25T09:05:27.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732969 s, 143 MB/s 2024-04-25T09:05:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767388 s, 137 MB/s 2024-04-25T09:05:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760854 s, 138 MB/s 2024-04-25T09:05:27.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741275 s, 141 MB/s 2024-04-25T09:05:27.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760998 s, 138 MB/s 2024-04-25T09:05:27.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725798 s, 144 MB/s 2024-04-25T09:05:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704322 s, 149 MB/s 2024-04-25T09:05:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735137 s, 143 MB/s 2024-04-25T09:05:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763199 s, 137 MB/s 2024-04-25T09:05:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718298 s, 146 MB/s 2024-04-25T09:05:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066963 s, 157 MB/s 2024-04-25T09:05:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670853 s, 156 MB/s 2024-04-25T09:05:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715903 s, 146 MB/s 2024-04-25T09:05:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713479 s, 147 MB/s 2024-04-25T09:05:27.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747756 s, 140 MB/s 2024-04-25T09:05:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746961 s, 140 MB/s 2024-04-25T09:05:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772344 s, 136 MB/s 2024-04-25T09:05:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727257 s, 144 MB/s 2024-04-25T09:05:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652268 s, 161 MB/s 2024-04-25T09:05:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742588 s, 141 MB/s 2024-04-25T09:05:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688104 s, 152 MB/s 2024-04-25T09:05:27.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.334 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692477 s, 151 MB/s 2024-04-25T09:05:27.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739549 s, 142 MB/s 2024-04-25T09:05:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748585 s, 140 MB/s 2024-04-25T09:05:27.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717064 s, 146 MB/s 2024-04-25T09:05:27.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.367 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664414 s, 158 MB/s 2024-04-25T09:05:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700207 s, 150 MB/s 2024-04-25T09:05:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721834 s, 145 MB/s 2024-04-25T09:05:27.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:27.384 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:27.384 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:27.384 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:05:27.384 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:27.384 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:27.384 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:27.384 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715502 s, 147 MB/s 2024-04-25T09:05:27.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759278 s, 138 MB/s 2024-04-25T09:05:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066384 s, 158 MB/s 2024-04-25T09:05:27.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736946 s, 142 MB/s 2024-04-25T09:05:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698346 s, 150 MB/s 2024-04-25T09:05:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753453 s, 139 MB/s 2024-04-25T09:05:27.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722653 s, 145 MB/s 2024-04-25T09:05:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704087 s, 149 MB/s 2024-04-25T09:05:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716288 s, 146 MB/s 2024-04-25T09:05:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084167 s, 125 MB/s 2024-04-25T09:05:27.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065194 s, 161 MB/s 2024-04-25T09:05:27.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681752 s, 154 MB/s 2024-04-25T09:05:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716046 s, 146 MB/s 2024-04-25T09:05:27.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650645 s, 161 MB/s 2024-04-25T09:05:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731601 s, 143 MB/s 2024-04-25T09:05:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731931 s, 143 MB/s 2024-04-25T09:05:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.579 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685455 s, 153 MB/s 2024-04-25T09:05:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743467 s, 141 MB/s 2024-04-25T09:05:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692281 s, 151 MB/s 2024-04-25T09:05:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748831 s, 140 MB/s 2024-04-25T09:05:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660209 s, 159 MB/s 2024-04-25T09:05:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641816 s, 163 MB/s 2024-04-25T09:05:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080327 s, 131 MB/s 2024-04-25T09:05:27.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695486 s, 151 MB/s 2024-04-25T09:05:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651588 s, 161 MB/s 2024-04-25T09:05:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756712 s, 139 MB/s 2024-04-25T09:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620203 s, 169 MB/s 2024-04-25T09:05:27.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728578 s, 144 MB/s 2024-04-25T09:05:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621039 s, 169 MB/s 2024-04-25T09:05:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713963 s, 147 MB/s 2024-04-25T09:05:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704641 s, 149 MB/s 2024-04-25T09:05:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786694 s, 133 MB/s 2024-04-25T09:05:27.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:27.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:27.698 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:27.698 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:05:27.699 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:27.699 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:27.699 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:27.699 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751403 s, 140 MB/s 2024-04-25T09:05:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674178 s, 156 MB/s 2024-04-25T09:05:27.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075943 s, 138 MB/s 2024-04-25T09:05:27.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703115 s, 149 MB/s 2024-04-25T09:05:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647575 s, 162 MB/s 2024-04-25T09:05:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696034 s, 151 MB/s 2024-04-25T09:05:27.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767446 s, 137 MB/s 2024-04-25T09:05:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713515 s, 147 MB/s 2024-04-25T09:05:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678491 s, 155 MB/s 2024-04-25T09:05:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756596 s, 139 MB/s 2024-04-25T09:05:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683417 s, 153 MB/s 2024-04-25T09:05:27.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892906 s, 117 MB/s 2024-04-25T09:05:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670164 s, 156 MB/s 2024-04-25T09:05:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795568 s, 132 MB/s 2024-04-25T09:05:27.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722104 s, 145 MB/s 2024-04-25T09:05:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718203 s, 146 MB/s 2024-04-25T09:05:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629266 s, 167 MB/s 2024-04-25T09:05:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754357 s, 139 MB/s 2024-04-25T09:05:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872066 s, 120 MB/s 2024-04-25T09:05:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737753 s, 142 MB/s 2024-04-25T09:05:27.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799845 s, 131 MB/s 2024-04-25T09:05:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854829 s, 123 MB/s 2024-04-25T09:05:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.948 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079032 s, 133 MB/s 2024-04-25T09:05:27.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720787 s, 145 MB/s 2024-04-25T09:05:27.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103123 s, 102 MB/s 2024-04-25T09:05:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820239 s, 128 MB/s 2024-04-25T09:05:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767409 s, 137 MB/s 2024-04-25T09:05:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671876 s, 156 MB/s 2024-04-25T09:05:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754058 s, 139 MB/s 2024-04-25T09:05:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761366 s, 138 MB/s 2024-04-25T09:05:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672832 s, 156 MB/s 2024-04-25T09:05:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765656 s, 137 MB/s 2024-04-25T09:05:28.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:28.028 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:28.028 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:28.028 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:05:28.028 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:28.028 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:28.028 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:28.028 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742631 s, 141 MB/s 2024-04-25T09:05:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725338 s, 145 MB/s 2024-04-25T09:05:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746131 s, 141 MB/s 2024-04-25T09:05:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724306 s, 145 MB/s 2024-04-25T09:05:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741897 s, 141 MB/s 2024-04-25T09:05:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074289 s, 141 MB/s 2024-04-25T09:05:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688213 s, 152 MB/s 2024-04-25T09:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.838239 s, 1.3 MB/s 2024-04-25T09:05:28.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:28.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:28.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989767 s, 106 MB/s 2024-04-25T09:05:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839623 s, 125 MB/s 2024-04-25T09:05:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100286 s, 105 MB/s 2024-04-25T09:05:29.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870337 s, 120 MB/s 2024-04-25T09:05:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795948 s, 132 MB/s 2024-04-25T09:05:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876174 s, 120 MB/s 2024-04-25T09:05:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937454 s, 112 MB/s 2024-04-25T09:05:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930079 s, 113 MB/s 2024-04-25T09:05:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767743 s, 137 MB/s 2024-04-25T09:05:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764666 s, 137 MB/s 2024-04-25T09:05:29.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726512 s, 144 MB/s 2024-04-25T09:05:29.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.097 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694192 s, 151 MB/s 2024-04-25T09:05:29.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796668 s, 132 MB/s 2024-04-25T09:05:29.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713395 s, 147 MB/s 2024-04-25T09:05:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820963 s, 128 MB/s 2024-04-25T09:05:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077303 s, 136 MB/s 2024-04-25T09:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868379 s, 121 MB/s 2024-04-25T09:05:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743774 s, 141 MB/s 2024-04-25T09:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661883 s, 158 MB/s 2024-04-25T09:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735655 s, 143 MB/s 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726972 s, 144 MB/s 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725105 s, 145 MB/s 2024-04-25T09:05:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724831 s, 145 MB/s 2024-04-25T09:05:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073657 s, 142 MB/s 2024-04-25T09:05:29.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:29.200 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:29.200 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:29.200 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:05:29.200 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:29.200 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:29.200 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:29.200 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762916 s, 137 MB/s 2024-04-25T09:05:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723806 s, 145 MB/s 2024-04-25T09:05:29.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.281 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674733 s, 155 MB/s 2024-04-25T09:05:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736849 s, 142 MB/s 2024-04-25T09:05:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.297 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719257 s, 146 MB/s 2024-04-25T09:05:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681332 s, 154 MB/s 2024-04-25T09:05:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703166 s, 149 MB/s 2024-04-25T09:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715365 s, 147 MB/s 2024-04-25T09:05:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734509 s, 143 MB/s 2024-04-25T09:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634499 s, 165 MB/s 2024-04-25T09:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785591 s, 133 MB/s 2024-04-25T09:05:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733375 s, 143 MB/s 2024-04-25T09:05:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668066 s, 157 MB/s 2024-04-25T09:05:29.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796774 s, 132 MB/s 2024-04-25T09:05:29.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722021 s, 145 MB/s 2024-04-25T09:05:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641835 s, 163 MB/s 2024-04-25T09:05:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848219 s, 124 MB/s 2024-04-25T09:05:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007055 s, 149 MB/s 2024-04-25T09:05:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668443 s, 157 MB/s 2024-04-25T09:05:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707559 s, 148 MB/s 2024-04-25T09:05:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743096 s, 141 MB/s 2024-04-25T09:05:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704342 s, 149 MB/s 2024-04-25T09:05:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724503 s, 145 MB/s 2024-04-25T09:05:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660294 s, 159 MB/s 2024-04-25T09:05:29.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760023 s, 138 MB/s 2024-04-25T09:05:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740322 s, 142 MB/s 2024-04-25T09:05:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764312 s, 137 MB/s 2024-04-25T09:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712785 s, 147 MB/s 2024-04-25T09:05:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720885 s, 145 MB/s 2024-04-25T09:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770798 s, 136 MB/s 2024-04-25T09:05:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680424 s, 154 MB/s 2024-04-25T09:05:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657076 s, 160 MB/s 2024-04-25T09:05:29.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:29.517 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:29.517 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:29.517 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:05:29.517 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:29.517 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:29.517 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:29.517 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:29.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735095 s, 143 MB/s 2024-04-25T09:05:29.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695266 s, 151 MB/s 2024-04-25T09:05:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778779 s, 135 MB/s 2024-04-25T09:05:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832339 s, 126 MB/s 2024-04-25T09:05:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748887 s, 140 MB/s 2024-04-25T09:05:29.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645537 s, 162 MB/s 2024-04-25T09:05:29.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748993 s, 140 MB/s 2024-04-25T09:05:29.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678632 s, 155 MB/s 2024-04-25T09:05:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732328 s, 143 MB/s 2024-04-25T09:05:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717682 s, 146 MB/s 2024-04-25T09:05:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833007 s, 126 MB/s 2024-04-25T09:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075445 s, 139 MB/s 2024-04-25T09:05:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738395 s, 142 MB/s 2024-04-25T09:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664498 s, 158 MB/s 2024-04-25T09:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775016 s, 135 MB/s 2024-04-25T09:05:29.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073087 s, 143 MB/s 2024-04-25T09:05:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691446 s, 152 MB/s 2024-04-25T09:05:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739436 s, 142 MB/s 2024-04-25T09:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751288 s, 140 MB/s 2024-04-25T09:05:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751763 s, 139 MB/s 2024-04-25T09:05:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758072 s, 138 MB/s 2024-04-25T09:05:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655073 s, 160 MB/s 2024-04-25T09:05:29.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706702 s, 148 MB/s 2024-04-25T09:05:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718256 s, 146 MB/s 2024-04-25T09:05:29.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698407 s, 150 MB/s 2024-04-25T09:05:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072193 s, 145 MB/s 2024-04-25T09:05:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786653 s, 133 MB/s 2024-04-25T09:05:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765841 s, 137 MB/s 2024-04-25T09:05:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691632 s, 152 MB/s 2024-04-25T09:05:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700059 s, 150 MB/s 2024-04-25T09:05:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753799 s, 139 MB/s 2024-04-25T09:05:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072633 s, 144 MB/s 2024-04-25T09:05:29.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:29.839 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:29.839 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:29.839 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:05:29.839 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:29.839 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:29.839 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:29.839 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642303 s, 163 MB/s 2024-04-25T09:05:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073512 s, 143 MB/s 2024-04-25T09:05:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772469 s, 136 MB/s 2024-04-25T09:05:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707153 s, 148 MB/s 2024-04-25T09:05:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753854 s, 139 MB/s 2024-04-25T09:05:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713032 s, 147 MB/s 2024-04-25T09:05:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679625 s, 154 MB/s 2024-04-25T09:05:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746675 s, 140 MB/s 2024-04-25T09:05:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710072 s, 148 MB/s 2024-04-25T09:05:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738137 s, 142 MB/s 2024-04-25T09:05:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719316 s, 146 MB/s 2024-04-25T09:05:29.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:29.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:29.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735649 s, 143 MB/s 2024-04-25T09:05:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765767 s, 137 MB/s 2024-04-25T09:05:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725949 s, 144 MB/s 2024-04-25T09:05:30.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717985 s, 146 MB/s 2024-04-25T09:05:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854777 s, 123 MB/s 2024-04-25T09:05:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718828 s, 146 MB/s 2024-04-25T09:05:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746173 s, 141 MB/s 2024-04-25T09:05:30.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731401 s, 143 MB/s 2024-04-25T09:05:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733841 s, 143 MB/s 2024-04-25T09:05:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714909 s, 147 MB/s 2024-04-25T09:05:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069855 s, 150 MB/s 2024-04-25T09:05:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067861 s, 155 MB/s 2024-04-25T09:05:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731007 s, 143 MB/s 2024-04-25T09:05:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845862 s, 124 MB/s 2024-04-25T09:05:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681189 s, 154 MB/s 2024-04-25T09:05:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690515 s, 152 MB/s 2024-04-25T09:05:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675383 s, 155 MB/s 2024-04-25T09:05:30.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737084 s, 142 MB/s 2024-04-25T09:05:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737209 s, 142 MB/s 2024-04-25T09:05:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698724 s, 150 MB/s 2024-04-25T09:05:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649367 s, 161 MB/s 2024-04-25T09:05:30.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:30.158 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:30.158 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:30.159 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:05:30.159 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:30.159 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:30.159 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:30.159 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725919 s, 144 MB/s 2024-04-25T09:05:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701499 s, 149 MB/s 2024-04-25T09:05:30.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071471 s, 147 MB/s 2024-04-25T09:05:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718621 s, 146 MB/s 2024-04-25T09:05:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701693 s, 149 MB/s 2024-04-25T09:05:30.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650286 s, 161 MB/s 2024-04-25T09:05:30.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675102 s, 155 MB/s 2024-04-25T09:05:30.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623238 s, 168 MB/s 2024-04-25T09:05:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772048 s, 136 MB/s 2024-04-25T09:05:30.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747982 s, 140 MB/s 2024-04-25T09:05:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075958 s, 138 MB/s 2024-04-25T09:05:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702565 s, 149 MB/s 2024-04-25T09:05:30.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718404 s, 146 MB/s 2024-04-25T09:05:30.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073295 s, 143 MB/s 2024-04-25T09:05:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716429 s, 146 MB/s 2024-04-25T09:05:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695027 s, 151 MB/s 2024-04-25T09:05:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717929 s, 146 MB/s 2024-04-25T09:05:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744161 s, 141 MB/s 2024-04-25T09:05:30.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661173 s, 159 MB/s 2024-04-25T09:05:30.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685218 s, 153 MB/s 2024-04-25T09:05:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672558 s, 156 MB/s 2024-04-25T09:05:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076832 s, 136 MB/s 2024-04-25T09:05:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073573 s, 143 MB/s 2024-04-25T09:05:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759614 s, 138 MB/s 2024-04-25T09:05:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716326 s, 146 MB/s 2024-04-25T09:05:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646985 s, 162 MB/s 2024-04-25T09:05:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757416 s, 138 MB/s 2024-04-25T09:05:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723434 s, 145 MB/s 2024-04-25T09:05:30.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073224 s, 143 MB/s 2024-04-25T09:05:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655875 s, 160 MB/s 2024-04-25T09:05:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731881 s, 143 MB/s 2024-04-25T09:05:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738593 s, 142 MB/s 2024-04-25T09:05:30.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:30.474 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:30.474 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:30.474 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:05:30.474 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:30.474 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:30.474 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:30.474 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741193 s, 141 MB/s 2024-04-25T09:05:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660577 s, 159 MB/s 2024-04-25T09:05:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674168 s, 156 MB/s 2024-04-25T09:05:30.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721807 s, 145 MB/s 2024-04-25T09:05:30.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084516 s, 124 MB/s 2024-04-25T09:05:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738578 s, 142 MB/s 2024-04-25T09:05:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720375 s, 146 MB/s 2024-04-25T09:05:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769135 s, 136 MB/s 2024-04-25T09:05:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714655 s, 147 MB/s 2024-04-25T09:05:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726106 s, 144 MB/s 2024-04-25T09:05:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758803 s, 138 MB/s 2024-04-25T09:05:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700387 s, 150 MB/s 2024-04-25T09:05:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755509 s, 139 MB/s 2024-04-25T09:05:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642805 s, 163 MB/s 2024-04-25T09:05:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779882 s, 134 MB/s 2024-04-25T09:05:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680328 s, 154 MB/s 2024-04-25T09:05:30.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731982 s, 143 MB/s 2024-04-25T09:05:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710405 s, 148 MB/s 2024-04-25T09:05:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817723 s, 128 MB/s 2024-04-25T09:05:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715589 s, 147 MB/s 2024-04-25T09:05:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713168 s, 147 MB/s 2024-04-25T09:05:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727806 s, 144 MB/s 2024-04-25T09:05:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692965 s, 151 MB/s 2024-04-25T09:05:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738548 s, 142 MB/s 2024-04-25T09:05:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713668 s, 147 MB/s 2024-04-25T09:05:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624449 s, 168 MB/s 2024-04-25T09:05:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635839 s, 165 MB/s 2024-04-25T09:05:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733853 s, 143 MB/s 2024-04-25T09:05:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074241 s, 141 MB/s 2024-04-25T09:05:30.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722337 s, 145 MB/s 2024-04-25T09:05:30.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720208 s, 146 MB/s 2024-04-25T09:05:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729419 s, 144 MB/s 2024-04-25T09:05:30.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:30.793 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:30.793 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:30.793 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:05:30.793 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:30.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:30.793 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:30.793 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663336 s, 158 MB/s 2024-04-25T09:05:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676627 s, 155 MB/s 2024-04-25T09:05:30.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620505 s, 169 MB/s 2024-04-25T09:05:30.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064974 s, 161 MB/s 2024-04-25T09:05:30.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726089 s, 144 MB/s 2024-04-25T09:05:30.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656768 s, 160 MB/s 2024-04-25T09:05:30.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.904 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736266 s, 142 MB/s 2024-04-25T09:05:30.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753592 s, 139 MB/s 2024-04-25T09:05:30.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727043 s, 144 MB/s 2024-04-25T09:05:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726013 s, 144 MB/s 2024-04-25T09:05:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708867 s, 148 MB/s 2024-04-25T09:05:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723404 s, 145 MB/s 2024-04-25T09:05:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767258 s, 137 MB/s 2024-04-25T09:05:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632069 s, 166 MB/s 2024-04-25T09:05:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659114 s, 159 MB/s 2024-04-25T09:05:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749162 s, 140 MB/s 2024-04-25T09:05:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809193 s, 130 MB/s 2024-04-25T09:05:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006323 s, 166 MB/s 2024-04-25T09:05:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701384 s, 150 MB/s 2024-04-25T09:05:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676229 s, 155 MB/s 2024-04-25T09:05:31.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658377 s, 159 MB/s 2024-04-25T09:05:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653138 s, 161 MB/s 2024-04-25T09:05:31.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064172 s, 163 MB/s 2024-04-25T09:05:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672018 s, 156 MB/s 2024-04-25T09:05:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704871 s, 149 MB/s 2024-04-25T09:05:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714905 s, 147 MB/s 2024-04-25T09:05:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723103 s, 145 MB/s 2024-04-25T09:05:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074705 s, 140 MB/s 2024-04-25T09:05:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739402 s, 142 MB/s 2024-04-25T09:05:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759304 s, 138 MB/s 2024-04-25T09:05:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690619 s, 152 MB/s 2024-04-25T09:05:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743022 s, 141 MB/s 2024-04-25T09:05:31.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:31.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:05:31.104 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:05:31.105 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:05:31.105 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:05:31.105 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:05:31.105 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:05:31.105 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:05:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752275 s, 139 MB/s 2024-04-25T09:05:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871669 s, 120 MB/s 2024-04-25T09:05:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750434 s, 140 MB/s 2024-04-25T09:05:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740293 s, 142 MB/s 2024-04-25T09:05:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768063 s, 137 MB/s 2024-04-25T09:05:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070767 s, 148 MB/s 2024-04-25T09:05:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724874 s, 145 MB/s 2024-04-25T09:05:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724936 s, 145 MB/s 2024-04-25T09:05:31.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744172 s, 141 MB/s 2024-04-25T09:05:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713553 s, 147 MB/s 2024-04-25T09:05:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072962 s, 144 MB/s 2024-04-25T09:05:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670906 s, 156 MB/s 2024-04-25T09:05:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749844 s, 140 MB/s 2024-04-25T09:05:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658024 s, 159 MB/s 2024-04-25T09:05:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692403 s, 151 MB/s 2024-04-25T09:05:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761305 s, 138 MB/s 2024-04-25T09:05:31.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.302 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729174 s, 144 MB/s 2024-04-25T09:05:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624428 s, 168 MB/s 2024-04-25T09:05:31.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.317 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737469 s, 142 MB/s 2024-04-25T09:05:31.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717128 s, 146 MB/s 2024-04-25T09:05:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658466 s, 159 MB/s 2024-04-25T09:05:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662102 s, 158 MB/s 2024-04-25T09:05:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113254 s, 92.6 MB/s 2024-04-25T09:05:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071706 s, 146 MB/s 2024-04-25T09:05:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074142 s, 141 MB/s 2024-04-25T09:05:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648298 s, 162 MB/s 2024-04-25T09:05:31.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742275 s, 141 MB/s 2024-04-25T09:05:31.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713408 s, 147 MB/s 2024-04-25T09:05:31.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722611 s, 145 MB/s 2024-04-25T09:05:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767824 s, 137 MB/s 2024-04-25T09:05:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683417 s, 153 MB/s 2024-04-25T09:05:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:05:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:05:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079104 s, 133 MB/s 2024-04-25T09:05:31.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:31.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:05:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.583+0000 7fcc91ff5640 1 Processor -- start 2024-04-25T09:05:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.583+0000 7fcc91ff5640 1 -- start start 2024-04-25T09:05:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.584+0000 7fcc91ff5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc8c0b8960 0x7fcc8c0d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.584+0000 7fcc91ff5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0b6ed0 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.584+0000 7fcc91ff5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0d2d90 con 0x7fcc8c161610 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.584+0000 7fcc91ff5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8c1619f0 con 0x7fcc8c0b8960 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.584+0000 7fcc8affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc8c0d0af0 0x7fcc8c0d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58910/0 (socket says 172.21.15.5:58910) 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.584+0000 7fcc8affd640 1 -- 172.21.15.5:0/3969037799 learned_addr learned my addr 172.21.15.5:0/3969037799 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.584+0000 7fcc8bfff640 1 --2- 172.21.15.5:0/3969037799 >> v2:172.21.15.5:3300/0 conn(0x7fcc8c0b8960 0x7fcc8c0d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.585+0000 7fcc8a7fc640 1 -- 172.21.15.5:0/3969037799 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044280843 0 0) 0x7fcc80001110 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.585+0000 7fcc8a7fc640 1 -- 172.21.15.5:0/3969037799 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc74003520 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.585+0000 7fcc8bfff640 1 -- 172.21.15.5:0/3969037799 >> v1:172.21.15.80:6789/0 conn(0x7fcc8c161610 legacy=0x7fcc8c0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.585+0000 7fcc8bfff640 1 -- 172.21.15.5:0/3969037799 >> v1:172.21.15.5:6789/0 conn(0x7fcc8c0d0af0 legacy=0x7fcc8c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.585+0000 7fcc8bfff640 1 -- 172.21.15.5:0/3969037799 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0d3070 con 0x7fcc8c0b8960 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.585+0000 7fcc8bfff640 1 --2- 172.21.15.5:0/3969037799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c0d26d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009d90 tx=0x7fcc8402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b6fbe417cd2e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc8a7fc640 1 -- 172.21.15.5:0/3969037799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84007740 con 0x7fcc8c0b8960 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc8a7fc640 1 -- 172.21.15.5:0/3969037799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc840078e0 con 0x7fcc8c0b8960 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc8a7fc640 1 -- 172.21.15.5:0/3969037799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84007cb0 con 0x7fcc8c0b8960 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc91ff5640 1 -- 172.21.15.5:0/3969037799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0b8960 msgr2=0x7fcc8c0d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/3969037799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c0d26d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009d90 tx=0x7fcc8402a660 comp rx=0 tx=0).stop 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc91ff5640 1 -- 172.21.15.5:0/3969037799 shutdown_connections 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/3969037799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c0d26d0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc91ff5640 1 -- 172.21.15.5:0/3969037799 >> 172.21.15.5:0/3969037799 conn(0x7fcc8c0668f0 msgr2=0x7fcc8c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc91ff5640 1 -- 172.21.15.5:0/3969037799 shutdown_connections 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.586+0000 7fcc91ff5640 1 -- 172.21.15.5:0/3969037799 wait complete. 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.587+0000 7fcc91ff5640 1 Processor -- start 2024-04-25T09:05:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc91ff5640 1 -- start start 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc91ff5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc91ff5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0d0af0 0x7fcc8c150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc91ff5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc8c161610 0x7fcc8c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc91ff5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c168c30 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc91ff5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0b74c0 con 0x7fcc8c0b8960 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc91ff5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c168db0 con 0x7fcc8c161610 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc8affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0d0af0 0x7fcc8c150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc8affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0d0af0 0x7fcc8c150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48888/0 (socket says 172.21.15.5:48888) 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.588+0000 7fcc8affd640 1 -- 172.21.15.5:0/2774918466 learned_addr learned my addr 172.21.15.5:0/2774918466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8bfff640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc8c161610 0x7fcc8c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8affd640 1 -- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc8c161610 msgr2=0x7fcc8c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8affd640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc8c161610 0x7fcc8c151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8affd640 1 -- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8c0b8960 msgr2=0x7fcc8c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8affd640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8affd640 1 -- 172.21.15.5:0/2774918466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0ccea0 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc8affd640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0d0af0 0x7fcc8c150690 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000c760 tx=0x7fcc8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc73fff640 1 -- 172.21.15.5:0/2774918466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80017070 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc73fff640 1 -- 172.21.15.5:0/2774918466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc80005ab0 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c157da0 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc73fff640 1 -- 172.21.15.5:0/2774918466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80007070 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.589+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c151840 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.591+0000 7fcc73fff640 1 -- 172.21.15.5:0/2774918466 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc8001a070 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.591+0000 7fcc73fff640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc7806b500 0x7fcc7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.591+0000 7fcc73fff640 1 -- 172.21.15.5:0/2774918466 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcc80089600 con 0x7fcc8c0d0af0 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.592+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc7806b500 0x7fcc7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.592+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc7806b500 0x7fcc7806d9c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c001660 tx=0x7fcc7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.592+0000 7fcc94dd5740 1 Processor -- start 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.592+0000 7fcc94dd5740 1 -- start start 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b502360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b53c8d0 0x55e90b5005e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b52b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b464000 con 0x55e90b500200 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b40cf20 con 0x55e90b53c8d0 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e90b4600a0 con 0x55e90b52acc0 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b502360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b502360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48894/0 (socket says 172.21.15.5:48894) 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc8bfff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b52b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/718258097 learned_addr learned my addr 172.21.15.5:0/718258097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.593+0000 7fcc8affd640 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b53c8d0 0x55e90b5005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/718258097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 msgr2=0x55e90b52b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b52b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/718258097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b53c8d0 msgr2=0x55e90b5005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b53c8d0 0x55e90b5005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/718258097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90b244ba0 con 0x55e90b500200 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b502360 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c001e80 tx=0x7fcc7c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c946c47b6518a60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc717fa640 1 -- 172.21.15.5:0/718258097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0035f0 con 0x55e90b500200 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc717fa640 1 -- 172.21.15.5:0/718258097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c003790 con 0x55e90b500200 2024-04-25T09:05:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.594+0000 7fcc717fa640 1 -- 172.21.15.5:0/718258097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c003b80 con 0x55e90b500200 2024-04-25T09:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 -- 172.21.15.5:0/718258097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 msgr2=0x55e90b502360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b502360 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c001e80 tx=0x7fcc7c011000 comp rx=0 tx=0).stop 2024-04-25T09:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 -- 172.21.15.5:0/718258097 shutdown_connections 2024-04-25T09:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b52b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b53c8d0 0x55e90b5005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/718258097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b502360 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 -- 172.21.15.5:0/718258097 >> 172.21.15.5:0/718258097 conn(0x55e90b4c8050 msgr2=0x55e90b545cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 -- 172.21.15.5:0/718258097 shutdown_connections 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 -- 172.21.15.5:0/718258097 wait complete. 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 -- start start 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.595+0000 7fcc94dd5740 1 Processor -- start 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b519900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b548de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b53c8d0 0x55e90b5402f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b402610 con 0x55e90b53c8d0 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b528810 con 0x55e90b500200 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e90b52df40 con 0x55e90b52acc0 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc94dd5740 10 client.0 _ll_register_callbacks cb 0x55e90b41af20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b53c8d0 0x55e90b5402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b53c8d0 0x55e90b5402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48900/0 (socket says 172.21.15.5:48900) 2024-04-25T09:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc8bfff640 1 -- 172.21.15.5:0/530048814 learned_addr learned my addr 172.21.15.5:0/530048814 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc8affd640 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b548de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.596+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b519900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc8bfff640 1 -- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 msgr2=0x55e90b548de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc8bfff640 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b548de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc8bfff640 1 -- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 msgr2=0x55e90b519900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc8bfff640 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b519900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc8bfff640 1 -- 172.21.15.5:0/530048814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e90b138490 con 0x55e90b53c8d0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc8bfff640 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b53c8d0 0x55e90b5402f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009d90 tx=0x7fcc84004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52287cd877983af4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/530048814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84009450 con 0x55e90b53c8d0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/530048814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcc84047b00 con 0x55e90b53c8d0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc7c003790 con 0x55e90b53c8d0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/530048814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc84047d00 con 0x55e90b53c8d0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 10 client.9273 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e90b2a5330 con 0x55e90b53c8d0 2024-04-25T09:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/530048814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c003790 con 0x55e90b53c8d0 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/530048814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcc84047020 con 0x55e90b53c8d0 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 10 client.9273 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 10 client.9273 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 20 client.9273 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b558e10 0x55e90b5591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 4 client.9273 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.597+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e90b471540 con 0x55e90b558e10 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b558e10 0x55e90b5591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b558e10 0x55e90b5591f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1d6cef8f416067 server_cookie=e70d9be940bb0b7d in_seq=0 out_seq=0 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc6a7fc640 10 client.9273 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/530048814 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e90b471540 con 0x55e90b558e10 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc6a7fc640 10 client.9273 handle_command_reply: tid=0 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 client.9273 shutdown 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b53c8d0 msgr2=0x55e90b5402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b53c8d0 0x55e90b5402f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009d90 tx=0x7fcc84004ab0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 shutdown_connections 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b558e10 0x55e90b5591f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b53c8d0 0x55e90b5402f0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc6a7fc640 0 client.9273 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b52acc0 0x55e90b548de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/530048814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b519900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.598+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 >> 172.21.15.5:0/530048814 conn(0x55e90b4c8050 msgr2=0x55e90b4feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.599+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 shutdown_connections 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.599+0000 7fcc94dd5740 1 -- 172.21.15.5:0/530048814 wait complete. 2024-04-25T09:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.599+0000 7fcc94dd5740 20 client.9273 trim_cache size 0 max 16384 2024-04-25T09:05:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.614+0000 7fcc94dd5740 1 Processor -- start 2024-04-25T09:05:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.614+0000 7fcc94dd5740 1 -- start start 2024-04-25T09:05:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b52b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b52acc0 0x55e90b52cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 0x55e90b52d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b527890 con 0x55e90b500200 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c200170 con 0x55e90b52acc0 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c1ff4d0 con 0x55e90b53c8d0 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b52b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b52b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48916/0 (socket says 172.21.15.5:48916) 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/2798366040 learned_addr learned my addr 172.21.15.5:0/2798366040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/2798366040 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 msgr2=0x55e90b52d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2798366040 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 0x55e90b52d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/2798366040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b52acc0 msgr2=0x55e90b52cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2798366040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b52acc0 0x55e90b52cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 -- 172.21.15.5:0/2798366040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90b111610 con 0x55e90b500200 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2798366040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b52b5b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c001490 tx=0x7fcc7c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1646f878c30407 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc70ff9640 1 -- 172.21.15.5:0/2798366040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c032070 con 0x55e90b500200 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc70ff9640 1 -- 172.21.15.5:0/2798366040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c003b40 con 0x55e90b500200 2024-04-25T09:05:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.615+0000 7fcc70ff9640 1 -- 172.21.15.5:0/2798366040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c02e070 con 0x55e90b500200 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2798366040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 msgr2=0x55e90b52b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2798366040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b52b5b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c001490 tx=0x7fcc7c005000 comp rx=0 tx=0).stop 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2798366040 shutdown_connections 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2798366040 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 0x55e90b52d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2798366040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b52acc0 0x55e90b52cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2798366040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b500200 0x55e90b52b5b0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2798366040 >> 172.21.15.5:0/2798366040 conn(0x55e90b4c8050 msgr2=0x55e90b519710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2798366040 shutdown_connections 2024-04-25T09:05:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.616+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2798366040 wait complete. 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 -- start start 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 Processor -- start 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b5623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b52acc0 0x55e90b53b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 0x55e90b53bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0cb430 con 0x55e90b52acc0 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0c8c90 con 0x55e90b500200 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e90b52ef40 con 0x55e90b53c8d0 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc94dd5740 10 client.0 _ll_register_callbacks cb 0x7fcc7c0013a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:31.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc8affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b52acc0 0x55e90b53b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc8affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b52acc0 0x55e90b53b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48926/0 (socket says 172.21.15.5:48926) 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.617+0000 7fcc8affd640 1 -- 172.21.15.5:0/2066267323 learned_addr learned my addr 172.21.15.5:0/2066267323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8bfff640 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 0x55e90b53bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b5623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8affd640 1 -- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 msgr2=0x55e90b53bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8affd640 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 0x55e90b53bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8affd640 1 -- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 msgr2=0x55e90b5623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8affd640 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b5623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8affd640 1 -- 172.21.15.5:0/2066267323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e90b501c80 con 0x55e90b52acc0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc8affd640 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b52acc0 0x55e90b53b650 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fcc80087af0 tx=0x7fcc8000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82f2f6222e68837 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/2066267323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80086060 con 0x55e90b52acc0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/2066267323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcc8005ffc0 con 0x55e90b52acc0 2024-04-25T09:05:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc7c003b40 con 0x55e90b52acc0 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/2066267323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc80074050 con 0x55e90b52acc0 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 10 client.9279 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e90b5b18e0 con 0x55e90b52acc0 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/2066267323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c003b40 con 0x55e90b52acc0 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/2066267323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcc80057190 con 0x55e90b52acc0 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 10 client.9279 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 10 client.9279 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 20 client.9279 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b541310 0x55e90b557900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 4 client.9279 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.618+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x55e90b46b890 con 0x55e90b541310 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.619+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b541310 0x55e90b557900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.619+0000 7fcc6a7fc640 10 client.9279 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.619+0000 7fcc8b7fe640 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b541310 0x55e90b557900 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad0d2b91c344078 server_cookie=2d8107eb2e5a3ce7 in_seq=0 out_seq=0 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc6a7fc640 1 -- 172.21.15.5:0/2066267323 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e90b46b890 con 0x55e90b541310 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc6a7fc640 10 client.9279 handle_command_reply: tid=0 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 client.9279 shutdown 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b52acc0 msgr2=0x55e90b53b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b52acc0 0x55e90b53b650 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fcc80087af0 tx=0x7fcc8000f000 comp rx=0 tx=0).stop 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 shutdown_connections 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55e90b541310 0x55e90b557900 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55e90b53c8d0 0x55e90b53bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e90b52acc0 0x55e90b53b650 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 --2- 172.21.15.5:0/2066267323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b500200 0x55e90b5623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 >> 172.21.15.5:0/2066267323 conn(0x55e90b4c8050 msgr2=0x55e90b53ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc6a7fc640 0 client.9279 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 shutdown_connections 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 1 -- 172.21.15.5:0/2066267323 wait complete. 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.623+0000 7fcc94dd5740 20 client.9279 trim_cache size 0 max 16384 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "49a79272-a7a7-44e6-9da2-1a91681bdcb2", 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-04-25T09:05:31.614 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:05:31.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc7806b500 msgr2=0x7fcc7806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc7806b500 0x7fcc7806d9c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c001660 tx=0x7fcc7c009040 comp rx=0 tx=0).stop 2024-04-25T09:05:31.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0d0af0 msgr2=0x7fcc8c150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0d0af0 0x7fcc8c150690 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000c760 tx=0x7fcc8000cc20 comp rx=0 tx=0).stop 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 shutdown_connections 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcc7806b500 0x7fcc7806d9c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcc8c161610 0x7fcc8c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8c0d0af0 0x7fcc8c150690 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 --2- 172.21.15.5:0/2774918466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc8c0b8960 0x7fcc8c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 >> 172.21.15.5:0/2774918466 conn(0x7fcc8c0668f0 msgr2=0x7fcc8c160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 shutdown_connections 2024-04-25T09:05:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.624+0000 7fcc91ff5640 1 -- 172.21.15.5:0/2774918466 wait complete. 2024-04-25T09:05:31.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:31.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-04-25T09:05:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.760+0000 7f1da8c6b640 1 Processor -- start 2024-04-25T09:05:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.760+0000 7f1da8c6b640 1 -- start start 2024-04-25T09:05:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.761+0000 7f1da8c6b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1da415c0f0 0x7f1da40cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.761+0000 7f1da8c6b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40cf7a0 con 0x7f1da40b24b0 2024-04-25T09:05:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.761+0000 7f1da8c6b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40d24e0 con 0x7f1da40d0610 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.761+0000 7f1da8c6b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da40cd350 con 0x7f1da415c0f0 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.761+0000 7f1da1d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1da40b24b0 0x7f1da40cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58916/0 (socket says 172.21.15.5:58916) 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.761+0000 7f1da1d9b640 1 -- 172.21.15.5:0/1526360896 learned_addr learned my addr 172.21.15.5:0/1526360896 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.762+0000 7f1da259c640 1 --2- 172.21.15.5:0/1526360896 >> v2:172.21.15.80:3300/0 conn(0x7f1da415c0f0 0x7f1da40cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.762+0000 7f1da159a640 1 -- 172.21.15.5:0/1526360896 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999367072 0 0) 0x7f1da40cf7a0 con 0x7f1da40b24b0 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.762+0000 7f1da159a640 1 -- 172.21.15.5:0/1526360896 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d90003520 con 0x7f1da40b24b0 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.762+0000 7f1da259c640 1 -- 172.21.15.5:0/1526360896 >> v1:172.21.15.80:6789/0 conn(0x7f1da40d0610 legacy=0x7f1da40c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.762+0000 7f1da159a640 1 -- 172.21.15.5:0/1526360896 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708064689 0 0) 0x7f1da40d24e0 con 0x7f1da40d0610 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.762+0000 7f1da259c640 1 -- 172.21.15.5:0/1526360896 >> v1:172.21.15.5:6789/0 conn(0x7f1da40b24b0 legacy=0x7f1da40cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.762+0000 7f1da259c640 1 -- 172.21.15.5:0/1526360896 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40d27c0 con 0x7f1da415c0f0 2024-04-25T09:05:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da259c640 1 --2- 172.21.15.5:0/1526360896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da415c0f0 0x7f1da40cd7e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009d90 tx=0x7f1d9402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9adaf9aed11323f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da159a640 1 -- 172.21.15.5:0/1526360896 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94007740 con 0x7f1da415c0f0 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da159a640 1 -- 172.21.15.5:0/1526360896 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d940078e0 con 0x7f1da415c0f0 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da159a640 1 -- 172.21.15.5:0/1526360896 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94007c90 con 0x7f1da415c0f0 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da8c6b640 1 -- 172.21.15.5:0/1526360896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da415c0f0 msgr2=0x7f1da40cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/1526360896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da415c0f0 0x7f1da40cd7e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009d90 tx=0x7f1d9402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da8c6b640 1 -- 172.21.15.5:0/1526360896 shutdown_connections 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/1526360896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da415c0f0 0x7f1da40cd7e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da8c6b640 1 -- 172.21.15.5:0/1526360896 >> 172.21.15.5:0/1526360896 conn(0x7f1da40d1920 msgr2=0x7f1da40d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.763+0000 7f1da8c6b640 1 -- 172.21.15.5:0/1526360896 shutdown_connections 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.764+0000 7f1da8c6b640 1 -- 172.21.15.5:0/1526360896 wait complete. 2024-04-25T09:05:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.765+0000 7f1da8c6b640 1 Processor -- start 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.765+0000 7f1da8c6b640 1 -- start start 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.765+0000 7f1da8c6b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da40b24b0 0x7f1da41f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da8c6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da40d0610 0x7f1da40af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da8c6b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1da415c0f0 0x7f1da40c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da8c6b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40cdd20 con 0x7f1da40d0610 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da8c6b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40cfa40 con 0x7f1da40b24b0 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da8c6b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40cdea0 con 0x7f1da415c0f0 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da40d0610 0x7f1da40af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da40d0610 0x7f1da40af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48936/0 (socket says 172.21.15.5:48936) 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 -- 172.21.15.5:0/271683906 learned_addr learned my addr 172.21.15.5:0/271683906 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da259c640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da40b24b0 0x7f1da41f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1da415c0f0 0x7f1da40c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 -- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1da415c0f0 msgr2=0x7f1da40c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1da415c0f0 0x7f1da40c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 -- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da40b24b0 msgr2=0x7f1da41f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da40b24b0 0x7f1da41f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 -- 172.21.15.5:0/271683906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40afbe0 con 0x7f1da40d0610 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da40d0610 0x7f1da40af6a0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c430 tx=0x7f1d8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1d9affd640 1 -- 172.21.15.5:0/271683906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c017070 con 0x7f1da40d0610 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1d9affd640 1 -- 172.21.15.5:0/271683906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c005ce0 con 0x7f1da40d0610 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da40ae950 con 0x7f1da40d0610 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1d9affd640 1 -- 172.21.15.5:0/271683906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0072f0 con 0x7f1da40d0610 2024-04-25T09:05:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.766+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da40aef10 con 0x7f1da40d0610 2024-04-25T09:05:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.768+0000 7f1d9affd640 1 -- 172.21.15.5:0/271683906 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d8c01a070 con 0x7f1da40d0610 2024-04-25T09:05:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.768+0000 7f1d9affd640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d8406b4d0 0x7f1d8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.768+0000 7f1d9affd640 1 -- 172.21.15.5:0/271683906 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d8c089650 con 0x7f1da40d0610 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.768+0000 7f1da259c640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d8406b4d0 0x7f1d8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.769+0000 7f1da259c640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d8406b4d0 0x7f1d8406d990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1d94034000 tx=0x7f1d9402f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.769+0000 7f1dab969740 1 Processor -- start 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.769+0000 7f1dab969740 1 -- start start 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x561717665e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1dab969740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x5617176848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717684df0 0x56171763cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1dab969740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617175a0b90 con 0x56171763fe40 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561717549e40 con 0x561717665a90 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56171759cc30 con 0x561717684df0 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1da1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x5617176848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1da1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x5617176848b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48948/0 (socket says 172.21.15.5:48948) 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717684df0 0x56171763cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1da1d9b640 1 -- 172.21.15.5:0/1449961498 learned_addr learned my addr 172.21.15.5:0/1449961498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1da259c640 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x561717665e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.770+0000 7f1da1d9b640 1 -- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717684df0 msgr2=0x56171763cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717684df0 0x56171763cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1da1d9b640 1 -- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 msgr2=0x561717665e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x561717665e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1da1d9b640 1 -- 172.21.15.5:0/1449961498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56171737f7d0 con 0x56171763fe40 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717684df0 0x56171763cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x5617176848b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c000f30 tx=0x7f1d8c05bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca03df6260719b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1d83fff640 1 -- 172.21.15.5:0/1449961498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c05e0f0 con 0x56171763fe40 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1d83fff640 1 -- 172.21.15.5:0/1449961498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c056130 con 0x56171763fe40 2024-04-25T09:05:31.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1d83fff640 1 -- 172.21.15.5:0/1449961498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c007490 con 0x56171763fe40 2024-04-25T09:05:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1dab969740 1 -- 172.21.15.5:0/1449961498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 msgr2=0x5617176848b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.771+0000 7f1dab969740 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x5617176848b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c000f30 tx=0x7f1d8c05bed0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 -- 172.21.15.5:0/1449961498 shutdown_connections 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717684df0 0x56171763cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x5617176848b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 --2- 172.21.15.5:0/1449961498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x561717665e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 -- 172.21.15.5:0/1449961498 >> 172.21.15.5:0/1449961498 conn(0x561717605870 msgr2=0x561717683760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 -- 172.21.15.5:0/1449961498 shutdown_connections 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 -- 172.21.15.5:0/1449961498 wait complete. 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 -- start start 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.772+0000 7f1dab969740 1 Processor -- start 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1dab969740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x56171765eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171769b150 0x56171769b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1dab969740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617175a0b90 con 0x56171763fe40 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171755d3e0 con 0x56171769b150 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56171763a2a0 con 0x561717665a90 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1dab969740 10 client.0 _ll_register_callbacks cb 0x56171755cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1da259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x56171765eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1da259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x56171765eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48954/0 (socket says 172.21.15.5:48954) 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1da259c640 1 -- 172.21.15.5:0/3339389661 learned_addr learned my addr 172.21.15.5:0/3339389661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.773+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171769b150 0x56171769b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1da1d9b640 1 -- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171769b150 msgr2=0x56171769b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171769b150 0x56171769b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1da1d9b640 1 -- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 msgr2=0x56171765eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x56171765eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1da1d9b640 1 -- 172.21.15.5:0/3339389661 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5617172750f0 con 0x561717665a90 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1da259c640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x56171765eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766b6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c400 tx=0x7f1d8c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7f0c3593faf39c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3301/0 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1d817fa640 1 -- 172.21.15.5:0/3339389661 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c007690 con 0x561717665a90 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d8c056130 con 0x561717665a90 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1d817fa640 1 -- 172.21.15.5:0/3339389661 <== mon.2 v2:172.21.15.80:3301/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d8c057280 con 0x561717665a90 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1d817fa640 1 -- 172.21.15.5:0/3339389661 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8c0574a0 con 0x561717665a90 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1dab969740 10 client.7214 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x5617173dff60 con 0x561717665a90 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.774+0000 7f1d817fa640 1 -- 172.21.15.5:0/3339389661 <== mon.2 v2:172.21.15.80:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c056130 con 0x561717665a90 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1d817fa640 1 -- 172.21.15.5:0/3339389661 <== mon.2 v2:172.21.15.80:3301/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d8c06fb10 con 0x561717665a90 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1dab969740 10 client.7214 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1dab969740 10 client.7214 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1dab969740 20 client.7214 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1dab969740 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717668dd0 0x5617176691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1dab969740 4 client.7214 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617175ae0d0 con 0x561717668dd0 2024-04-25T09:05:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1da259c640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717668dd0 0x5617176691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1d817fa640 10 client.7214 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.775+0000 7f1da259c640 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717668dd0 0x5617176691e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd7fe47d38f197f server_cookie=e499f2a85bafd92f in_seq=0 out_seq=0 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1d817fa640 1 -- 172.21.15.5:0/3339389661 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5617175ae0d0 con 0x561717668dd0 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1d817fa640 10 client.7214 handle_command_reply: tid=0 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 client.7214 shutdown 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 msgr2=0x56171766b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766b6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c400 tx=0x7f1d8c000bc0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 shutdown_connections 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717668dd0 0x5617176691e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171769b150 0x56171769b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766b6d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1d817fa640 0 client.7214 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 --2- 172.21.15.5:0/3339389661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171763fe40 0x56171765eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 >> 172.21.15.5:0/3339389661 conn(0x561717605870 msgr2=0x5617176851e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 shutdown_connections 2024-04-25T09:05:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 1 -- 172.21.15.5:0/3339389661 wait complete. 2024-04-25T09:05:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.776+0000 7f1dab969740 20 client.7214 trim_cache size 0 max 16384 2024-04-25T09:05:31.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.791+0000 7f1dab969740 1 Processor -- start 2024-04-25T09:05:31.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.791+0000 7f1dab969740 1 -- start start 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171763fe40 0x56171765f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1dab969740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1dab969740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da406baf0 con 0x56171769b150 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da406acb0 con 0x56171763fe40 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da41f5aa0 con 0x561717665a90 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48970/0 (socket says 172.21.15.5:48970) 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 -- 172.21.15.5:0/860256078 learned_addr learned my addr 172.21.15.5:0/860256078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da259c640 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171763fe40 0x56171765f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 -- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 msgr2=0x56171766a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 -- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171763fe40 msgr2=0x56171765f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171763fe40 0x56171765f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 -- 172.21.15.5:0/860256078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56171724e1b0 con 0x56171769b150 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da259c640 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171763fe40 0x56171765f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001880 tx=0x7f1d9c001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818d5d68c9add76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1d837fe640 1 -- 172.21.15.5:0/860256078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c015ca0 con 0x56171769b150 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1d837fe640 1 -- 172.21.15.5:0/860256078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c015e40 con 0x56171769b150 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.792+0000 7f1d837fe640 1 -- 172.21.15.5:0/860256078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0052d0 con 0x56171769b150 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 -- 172.21.15.5:0/860256078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 msgr2=0x56171766a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001880 tx=0x7f1d9c001d40 comp rx=0 tx=0).stop 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 -- 172.21.15.5:0/860256078 shutdown_connections 2024-04-25T09:05:31.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 --2- 172.21.15.5:0/860256078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56171763fe40 0x56171765f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 -- 172.21.15.5:0/860256078 >> 172.21.15.5:0/860256078 conn(0x561717605870 msgr2=0x561717633f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 -- 172.21.15.5:0/860256078 shutdown_connections 2024-04-25T09:05:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.793+0000 7f1dab969740 1 -- 172.21.15.5:0/860256078 wait complete. 2024-04-25T09:05:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.794+0000 7f1dab969740 1 -- start start 2024-04-25T09:05:31.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.794+0000 7f1dab969740 1 Processor -- start 2024-04-25T09:05:31.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56171763fe40 0x5617176f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40cecc0 con 0x56171769b150 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617176f25e0 con 0x561717665a90 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x56171766ba80 con 0x56171763fe40 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 10 client.0 _ll_register_callbacks cb 0x7f1d8c06e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48982/0 (socket says 172.21.15.5:48982) 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 -- 172.21.15.5:0/3317402368 learned_addr learned my addr 172.21.15.5:0/3317402368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da259c640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56171763fe40 0x5617176f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 -- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56171763fe40 msgr2=0x5617176f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56171763fe40 0x5617176f0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 -- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 msgr2=0x56171766a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 -- 172.21.15.5:0/3317402368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56171769ab50 con 0x56171769b150 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da259c640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56171763fe40 0x5617176f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da1d9b640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1da2d9d640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001820 tx=0x7f1d9c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25003b99d0c57ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1d817fa640 1 -- 172.21.15.5:0/3317402368 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c007440 con 0x56171769b150 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1d817fa640 1 -- 172.21.15.5:0/3317402368 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d9c0075e0 con 0x56171769b150 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d9c015e40 con 0x56171769b150 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1d817fa640 1 -- 172.21.15.5:0/3317402368 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d9c0067b0 con 0x56171769b150 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 10 client.9297 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.795+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x561717669ad0 con 0x56171769b150 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1d817fa640 1 -- 172.21.15.5:0/3317402368 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c015e40 con 0x56171769b150 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1d817fa640 1 -- 172.21.15.5:0/3317402368 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d9c006950 con 0x56171769b150 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 10 client.9297 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 10 client.9297 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 20 client.9297 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717685510 0x561717662e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 4 client.9297 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x5617175a8420 con 0x561717685510 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1da259c640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717685510 0x561717662e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1da259c640 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717685510 0x561717662e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec56762e0f7b77db server_cookie=ec4d45d8d9180040 in_seq=0 out_seq=0 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1d817fa640 10 client.9297 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1d817fa640 1 -- 172.21.15.5:0/3317402368 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5617175a8420 con 0x561717685510 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1d817fa640 10 client.9297 handle_command_reply: tid=0 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 1 client.9297 shutdown 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 msgr2=0x56171766a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001820 tx=0x7f1d9c007c80 comp rx=0 tx=0).stop 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 shutdown_connections 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.796+0000 7f1dab969740 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x561717685510 0x561717662e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1dab969740 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56171769b150 0x56171766a7c0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1dab969740 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561717665a90 0x56171766a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1d817fa640 0 client.9297 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1dab969740 1 --2- 172.21.15.5:0/3317402368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x56171763fe40 0x5617176f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 >> 172.21.15.5:0/3317402368 conn(0x561717605870 msgr2=0x561717633f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 shutdown_connections 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1dab969740 1 -- 172.21.15.5:0/3317402368 wait complete. 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1dab969740 20 client.9297 trim_cache size 0 max 16384 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-04-25T09:05:31.791 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:05:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d8406b4d0 msgr2=0x7f1d8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d8406b4d0 0x7f1d8406d990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1d94034000 tx=0x7f1d9402f000 comp rx=0 tx=0).stop 2024-04-25T09:05:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da40d0610 msgr2=0x7f1da40af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da40d0610 0x7f1da40af6a0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c430 tx=0x7f1d8c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 shutdown_connections 2024-04-25T09:05:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1d8406b4d0 0x7f1d8406d990 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1da415c0f0 0x7f1da40c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da40d0610 0x7f1da40af6a0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 --2- 172.21.15.5:0/271683906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da40b24b0 0x7f1da41f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 >> 172.21.15.5:0/271683906 conn(0x7f1da40d1920 msgr2=0x7f1da4159650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 shutdown_connections 2024-04-25T09:05:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.797+0000 7f1da8c6b640 1 -- 172.21.15.5:0/271683906 wait complete. 2024-04-25T09:05:31.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:31.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-04-25T09:05:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.910+0000 7efe7f088640 1 Processor -- start 2024-04-25T09:05:31.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.910+0000 7efe7f088640 1 -- start start 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7f088640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe7815e0b0 0x7efe7806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7f088640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780d27f0 con 0x7efe780d0c80 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7f088640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780cfee0 con 0x7efe780cc780 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7f088640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe780d01c0 con 0x7efe7815e0b0 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe77fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efe780d0c80 0x7efe780cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58920/0 (socket says 172.21.15.5:58920) 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe77fff640 1 -- 172.21.15.5:0/6271890 learned_addr learned my addr 172.21.15.5:0/6271890 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7ce24640 1 --2- 172.21.15.5:0/6271890 >> v2:172.21.15.80:3300/0 conn(0x7efe7815e0b0 0x7efe7806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe777fe640 1 -- 172.21.15.5:0/6271890 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299858194 0 0) 0x7efe780d27f0 con 0x7efe780d0c80 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe777fe640 1 -- 172.21.15.5:0/6271890 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe68003520 con 0x7efe780d0c80 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7ce24640 1 -- 172.21.15.5:0/6271890 >> v1:172.21.15.80:6789/0 conn(0x7efe780cc780 legacy=0x7efe780ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7ce24640 1 -- 172.21.15.5:0/6271890 >> v1:172.21.15.5:6789/0 conn(0x7efe780d0c80 legacy=0x7efe780cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe777fe640 1 -- 172.21.15.5:0/6271890 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210336138 0 0) 0x7efe780cfee0 con 0x7efe780cc780 2024-04-25T09:05:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.911+0000 7efe7ce24640 1 -- 172.21.15.5:0/6271890 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780d04a0 con 0x7efe7815e0b0 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.912+0000 7efe7ce24640 1 --2- 172.21.15.5:0/6271890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 0x7efe7806adf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0097d0 tx=0x7efe6c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=135d7d277011b96f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.912+0000 7efe777fe640 1 -- 172.21.15.5:0/6271890 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c037070 con 0x7efe7815e0b0 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.912+0000 7efe777fe640 1 -- 172.21.15.5:0/6271890 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c032440 con 0x7efe7815e0b0 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.912+0000 7efe777fe640 1 -- 172.21.15.5:0/6271890 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c032810 con 0x7efe7815e0b0 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.913+0000 7efe7f088640 1 -- 172.21.15.5:0/6271890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 msgr2=0x7efe7806adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.913+0000 7efe7f088640 1 --2- 172.21.15.5:0/6271890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 0x7efe7806adf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0097d0 tx=0x7efe6c02a270 comp rx=0 tx=0).stop 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.913+0000 7efe7f088640 1 -- 172.21.15.5:0/6271890 shutdown_connections 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.913+0000 7efe7f088640 1 --2- 172.21.15.5:0/6271890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 0x7efe7806adf0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.913+0000 7efe7f088640 1 -- 172.21.15.5:0/6271890 >> 172.21.15.5:0/6271890 conn(0x7efe780d1a20 msgr2=0x7efe780d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.913+0000 7efe7f088640 1 -- 172.21.15.5:0/6271890 shutdown_connections 2024-04-25T09:05:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.913+0000 7efe7f088640 1 -- 172.21.15.5:0/6271890 wait complete. 2024-04-25T09:05:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.914+0000 7efe7f088640 1 Processor -- start 2024-04-25T09:05:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.914+0000 7efe7f088640 1 -- start start 2024-04-25T09:05:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7f088640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe780cc780 0x7efe780cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7f088640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe780d0c80 0x7efe7814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7f088640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 0x7efe7814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7f088640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780cfb90 con 0x7efe780cc780 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7f088640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7815e490 con 0x7efe7815e0b0 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7f088640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe780ccc30 con 0x7efe780d0c80 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe780cc780 0x7efe780cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe780cc780 0x7efe780cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48992/0 (socket says 172.21.15.5:48992) 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 -- 172.21.15.5:0/503773744 learned_addr learned my addr 172.21.15.5:0/503773744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe77fff640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe780d0c80 0x7efe7814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7d625640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 0x7efe7814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 -- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe780d0c80 msgr2=0x7efe7814ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe780d0c80 0x7efe7814ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 -- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 msgr2=0x7efe7814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 0x7efe7814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.915+0000 7efe7ce24640 1 -- 172.21.15.5:0/503773744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780c9ce0 con 0x7efe780cc780 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.916+0000 7efe7ce24640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe780cc780 0x7efe780cad80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7efe6c035040 tx=0x7efe6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.916+0000 7efe757fa640 1 -- 172.21.15.5:0/503773744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c041020 con 0x7efe780cc780 2024-04-25T09:05:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.916+0000 7efe757fa640 1 -- 172.21.15.5:0/503773744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c03d6e0 con 0x7efe780cc780 2024-04-25T09:05:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.916+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe780c9fc0 con 0x7efe780cc780 2024-04-25T09:05:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.916+0000 7efe757fa640 1 -- 172.21.15.5:0/503773744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c037040 con 0x7efe780cc780 2024-04-25T09:05:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.916+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe780ca580 con 0x7efe780cc780 2024-04-25T09:05:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.918+0000 7efe757fa640 1 -- 172.21.15.5:0/503773744 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe6c044020 con 0x7efe780cc780 2024-04-25T09:05:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.918+0000 7efe757fa640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe5c06b4d0 0x7efe5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.918+0000 7efe757fa640 1 -- 172.21.15.5:0/503773744 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efe6c0aa8b0 con 0x7efe780cc780 2024-04-25T09:05:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.918+0000 7efe77fff640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe5c06b4d0 0x7efe5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.919+0000 7efe77fff640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe5c06b4d0 0x7efe5c06d990 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7efe7806ee50 tx=0x7efe64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.919+0000 7efe81d86740 1 Processor -- start 2024-04-25T09:05:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.919+0000 7efe81d86740 1 -- start start 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e188320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e188860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe81d86740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e158770 0x55617e15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe81d86740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55617e0c1da0 con 0x55617e158770 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55617e06ab80 con 0x55617e185ef0 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55617e0bde40 con 0x55617e185b10 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e158770 0x55617e15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e158770 0x55617e15bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48996/0 (socket says 172.21.15.5:48996) 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7ce24640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e188320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 -- 172.21.15.5:0/2830287407 learned_addr learned my addr 172.21.15.5:0/2830287407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe77fff640 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e188860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 -- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 msgr2=0x55617e188320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e188320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 -- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 msgr2=0x55617e188860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e188860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 -- 172.21.15.5:0/2830287407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55617e074f10 con 0x55617e158770 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7ce24640 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e188320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe7d625640 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e158770 0x55617e15bf80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7efe70001ee0 tx=0x7efe7000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2834f34cba0186 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.920+0000 7efe627fc640 1 -- 172.21.15.5:0/2830287407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000fe60 con 0x55617e158770 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe627fc640 1 -- 172.21.15.5:0/2830287407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70018070 con 0x55617e158770 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe627fc640 1 -- 172.21.15.5:0/2830287407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70003b90 con 0x55617e158770 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 -- 172.21.15.5:0/2830287407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e158770 msgr2=0x55617e15bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e158770 0x55617e15bf80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7efe70001ee0 tx=0x7efe7000f5a0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 -- 172.21.15.5:0/2830287407 shutdown_connections 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e158770 0x55617e15bf80 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e188860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 --2- 172.21.15.5:0/2830287407 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e188320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 -- 172.21.15.5:0/2830287407 >> 172.21.15.5:0/2830287407 conn(0x55617e15a9e0 msgr2=0x55617e1a3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 -- 172.21.15.5:0/2830287407 shutdown_connections 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.921+0000 7efe81d86740 1 -- 172.21.15.5:0/2830287407 wait complete. 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.922+0000 7efe81d86740 1 -- start start 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.922+0000 7efe81d86740 1 Processor -- start 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185b10 0x55617e159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe81d86740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e17c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe81d86740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55617e15db90 con 0x55617e1a6270 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55617e0604b0 con 0x55617e185b10 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55617e15de70 con 0x55617e185ef0 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe81d86740 10 client.0 _ll_register_callbacks cb 0x55617e0a0180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e17c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e17c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49000/0 (socket says 172.21.15.5:49000) 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 -- 172.21.15.5:0/7551144 learned_addr learned my addr 172.21.15.5:0/7551144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7ce24640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185b10 0x55617e159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe77fff640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 -- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 msgr2=0x55617e1a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 -- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185b10 msgr2=0x55617e159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185b10 0x55617e159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 -- 172.21.15.5:0/7551144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55617dea07d0 con 0x55617e1a6270 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7ce24640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185b10 0x55617e159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe7d625640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e17c770 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7efe7000faa0 tx=0x7efe70001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c288e400498d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.923+0000 7efe577fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe577fe640 1 -- 172.21.15.5:0/7551144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000fe60 con 0x55617e1a6270 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe577fe640 1 -- 172.21.15.5:0/7551144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efe700052d0 con 0x55617e1a6270 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe70018070 con 0x55617e1a6270 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe577fe640 1 -- 172.21.15.5:0/7551144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe7002f050 con 0x55617e1a6270 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 10 client.9309 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55617ddd63f0 con 0x55617e1a6270 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe577fe640 1 -- 172.21.15.5:0/7551144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70018070 con 0x55617e1a6270 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe577fe640 1 -- 172.21.15.5:0/7551144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe70032020 con 0x55617e1a6270 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 10 client.9309 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 10 client.9309 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 20 client.9309 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e1a4920 0x55617e1a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 4 client.9309 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55617e0cf2e0 con 0x55617e1a4920 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe7ce24640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e1a4920 0x55617e1a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe7ce24640 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e1a4920 0x55617e1a4d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c591b42aab532eee server_cookie=8d0c41908b1a417e in_seq=0 out_seq=0 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.924+0000 7efe577fe640 10 client.9309 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe577fe640 1 -- 172.21.15.5:0/7551144 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55617e0cf2e0 con 0x55617e1a4920 2024-04-25T09:05:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe577fe640 10 client.9309 handle_command_reply: tid=0 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 client.9309 shutdown 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 msgr2=0x55617e17c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e17c770 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7efe7000faa0 tx=0x7efe70001630 comp rx=0 tx=0).stop 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 shutdown_connections 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e1a4920 0x55617e1a4d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e17c770 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe577fe640 0 client.9309 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 --2- 172.21.15.5:0/7551144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185b10 0x55617e159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 >> 172.21.15.5:0/7551144 conn(0x55617e158770 msgr2=0x55617e184d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 shutdown_connections 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 1 -- 172.21.15.5:0/7551144 wait complete. 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.925+0000 7efe81d86740 20 client.9309 trim_cache size 0 max 16384 2024-04-25T09:05:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.940+0000 7efe81d86740 1 Processor -- start 2024-04-25T09:05:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.940+0000 7efe81d86740 1 -- start start 2024-04-25T09:05:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e184780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e1a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe81d86740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe81d86740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe781f3580 con 0x55617e1a6270 2024-04-25T09:05:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe781f7da0 con 0x55617e185ef0 2024-04-25T09:05:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe781f71a0 con 0x55617e185b10 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe7d625640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe7d625640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e1577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49004/0 (socket says 172.21.15.5:49004) 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe7d625640 1 -- 172.21.15.5:0/180067470 learned_addr learned my addr 172.21.15.5:0/180067470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe7ce24640 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e184780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe77fff640 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e1a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe7d625640 1 -- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 msgr2=0x55617e184780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.941+0000 7efe7d625640 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e184780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe7d625640 1 -- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 msgr2=0x55617e1a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe7d625640 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e1a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe7d625640 1 -- 172.21.15.5:0/180067470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55617dd960f0 con 0x55617e1a6270 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe77fff640 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e1a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe7d625640 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e1577f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7efe70007cb0 tx=0x7efe70020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7127abea05ef5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe61ffb640 1 -- 172.21.15.5:0/180067470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70038070 con 0x55617e1a6270 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe61ffb640 1 -- 172.21.15.5:0/180067470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70018040 con 0x55617e1a6270 2024-04-25T09:05:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe61ffb640 1 -- 172.21.15.5:0/180067470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000fe60 con 0x55617e1a6270 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe81d86740 1 -- 172.21.15.5:0/180067470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 msgr2=0x55617e1577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe81d86740 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e1577f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7efe70007cb0 tx=0x7efe70020070 comp rx=0 tx=0).stop 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe81d86740 1 -- 172.21.15.5:0/180067470 shutdown_connections 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe81d86740 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e1a6270 0x55617e1577f0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe81d86740 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e185ef0 0x55617e1a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe81d86740 1 --2- 172.21.15.5:0/180067470 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185b10 0x55617e184780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.942+0000 7efe81d86740 1 -- 172.21.15.5:0/180067470 >> 172.21.15.5:0/180067470 conn(0x55617e158770 msgr2=0x55617e17c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.943+0000 7efe81d86740 1 -- 172.21.15.5:0/180067470 shutdown_connections 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.943+0000 7efe81d86740 1 -- 172.21.15.5:0/180067470 wait complete. 2024-04-25T09:05:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.943+0000 7efe81d86740 1 -- start start 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.943+0000 7efe81d86740 1 Processor -- start 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe81d86740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e185b10 0x55617e20d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe81d86740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e1a6270 0x55617e1a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe81d86740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55617e188a80 con 0x55617e185b10 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe781f77a0 con 0x55617e1a6270 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe81d86740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55617e1b5f30 con 0x55617e185ef0 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe81d86740 10 client.0 _ll_register_callbacks cb 0x7efe70001980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e185b10 0x55617e20d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e185b10 0x55617e20d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49014/0 (socket says 172.21.15.5:49014) 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 -- 172.21.15.5:0/1950275654 learned_addr learned my addr 172.21.15.5:0/1950275654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7d625640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e1a6270 0x55617e1a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe77fff640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 -- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 msgr2=0x55617e1a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 -- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e1a6270 msgr2=0x55617e1a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e1a6270 0x55617e1a6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 -- 172.21.15.5:0/1950275654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55617e1a3670 con 0x55617e185b10 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7d625640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e1a6270 0x55617e1a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe77fff640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe7ce24640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e185b10 0x55617e20d500 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7efe6c078e30 tx=0x7efe6c048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7982a18af86e9810 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.944+0000 7efe577fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe577fe640 1 -- 172.21.15.5:0/1950275654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c03da90 con 0x55617e185b10 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe577fe640 1 -- 172.21.15.5:0/1950275654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efe6c03dc30 con 0x55617e185b10 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe70018040 con 0x55617e185b10 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe577fe640 1 -- 172.21.15.5:0/1950275654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe6c09e050 con 0x55617e185b10 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 10 client.9315 fetch_fsmap learned FSMap version 78 2024-04-25T09:05:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55617e20da60 con 0x55617e185b10 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe577fe640 1 -- 172.21.15.5:0/1950275654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70018040 con 0x55617e185b10 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe577fe640 1 -- 172.21.15.5:0/1950275654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe6c0a1020 con 0x55617e185b10 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 10 client.9315 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 10 client.9315 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 20 client.9315 populate_metadata read hostname 'smithi005' 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e18a410 0x55617e1bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 4 client.9315 mds_command: new command op to 9102 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 --> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55617e0c9630 con 0x55617e18a410 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe77fff640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e18a410 0x55617e1bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe77fff640 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e18a410 0x55617e1bc8b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdb64d00a01c9514 server_cookie=8b9364e2c53d6baf in_seq=0 out_seq=0 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.945+0000 7efe577fe640 10 client.9315 ms_handle_connect on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe577fe640 1 -- 172.21.15.5:0/1950275654 <== mds.0 v2:172.21.15.5:6834/778491752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55617e0c9630 con 0x55617e18a410 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe577fe640 10 client.9315 handle_command_reply: tid=0 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 client.9315 shutdown 2024-04-25T09:05:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e185b10 msgr2=0x55617e20d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e185b10 0x55617e20d500 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7efe6c078e30 tx=0x7efe6c048040 comp rx=0 tx=0).stop 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 shutdown_connections 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:6834/778491752,v1:172.21.15.5:6835/778491752] conn(0x55617e18a410 0x55617e1bc8b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55617e1a6270 0x55617e1a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55617e185ef0 0x55617e1a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 --2- 172.21.15.5:0/1950275654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55617e185b10 0x55617e20d500 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe577fe640 0 client.9315 ms_handle_reset on v2:172.21.15.5:6834/778491752 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 >> 172.21.15.5:0/1950275654 conn(0x55617e158770 msgr2=0x55617e1a0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 shutdown_connections 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 1 -- 172.21.15.5:0/1950275654 wait complete. 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.946+0000 7efe81d86740 20 client.9315 trim_cache size 0 max 16384 2024-04-25T09:05:31.940 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: "49a79272-a7a7-44e6-9da2-1a91681bdcb2": { 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "49a79272-a7a7-44e6-9da2-1a91681bdcb2", 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:05:31.941 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe5c06b4d0 msgr2=0x7efe5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe5c06b4d0 0x7efe5c06d990 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7efe7806ee50 tx=0x7efe64009040 comp rx=0 tx=0).stop 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe780cc780 msgr2=0x7efe780cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe780cc780 0x7efe780cad80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7efe6c035040 tx=0x7efe6c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 shutdown_connections 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efe5c06b4d0 0x7efe5c06d990 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe7815e0b0 0x7efe7814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efe780d0c80 0x7efe7814ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 --2- 172.21.15.5:0/503773744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe780cc780 0x7efe780cad80 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 >> 172.21.15.5:0/503773744 conn(0x7efe780d1a20 msgr2=0x7efe7806fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 shutdown_connections 2024-04-25T09:05:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:31.947+0000 7efe7f088640 1 -- 172.21.15.5:0/503773744 wait complete. 2024-04-25T09:05:31.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.058+0000 7f01afd90640 1 Processor -- start 2024-04-25T09:05:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.058+0000 7f01afd90640 1 -- start start 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01afd90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01a80cea80 0x7f01a815f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01afd90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a815fd80 0x7f01a806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01afd90640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a815ef10 con 0x7f01a806adf0 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01afd90640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80cfd60 con 0x7f01a80cea80 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01afd90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a815f480 con 0x7f01a815fd80 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01adb2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01a80cea80 0x7f01a815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01ae32d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01a806adf0 0x7f01a80d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58928/0 (socket says 172.21.15.5:58928) 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01adb2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01a80cea80 0x7f01a815f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49022/0 (socket says 172.21.15.5:49022) 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01ae32d640 1 -- 172.21.15.5:0/1411948951 learned_addr learned my addr 172.21.15.5:0/1411948951 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01ad32b640 1 --2- 172.21.15.5:0/1411948951 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a815fd80 0x7f01a806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01adb2c640 1 -- 172.21.15.5:0/1411948951 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a815fd80 msgr2=0x7f01a806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:32.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01adb2c640 1 --2- 172.21.15.5:0/1411948951 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a815fd80 0x7f01a806b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01adb2c640 1 -- 172.21.15.5:0/1411948951 >> v1:172.21.15.5:6789/0 conn(0x7f01a806adf0 legacy=0x7f01a80d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.059+0000 7f01adb2c640 1 -- 172.21.15.5:0/1411948951 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a815f1a0 con 0x7f01a80cea80 2024-04-25T09:05:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.060+0000 7f01adb2c640 1 --2- 172.21.15.5:0/1411948951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a815f840 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f01a40097a0 tx=0x7f01a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2efccccef20defe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.060+0000 7f01acb2a640 1 -- 172.21.15.5:0/1411948951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4037070 con 0x7f01a80cea80 2024-04-25T09:05:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.060+0000 7f01acb2a640 1 -- 172.21.15.5:0/1411948951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a4032440 con 0x7f01a80cea80 2024-04-25T09:05:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.060+0000 7f01acb2a640 1 -- 172.21.15.5:0/1411948951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4032810 con 0x7f01a80cea80 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 -- 172.21.15.5:0/1411948951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 msgr2=0x7f01a815f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 --2- 172.21.15.5:0/1411948951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a815f840 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f01a40097a0 tx=0x7f01a402a180 comp rx=0 tx=0).stop 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 -- 172.21.15.5:0/1411948951 shutdown_connections 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 --2- 172.21.15.5:0/1411948951 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a815fd80 0x7f01a806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 --2- 172.21.15.5:0/1411948951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a815f840 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 -- 172.21.15.5:0/1411948951 >> 172.21.15.5:0/1411948951 conn(0x7f01a80d19f0 msgr2=0x7f01a80d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 -- 172.21.15.5:0/1411948951 shutdown_connections 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.061+0000 7f01afd90640 1 -- 172.21.15.5:0/1411948951 wait complete. 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.062+0000 7f01afd90640 1 Processor -- start 2024-04-25T09:05:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.062+0000 7f01afd90640 1 -- start start 2024-04-25T09:05:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01afd90640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a806adf0 0x7f01a80c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01afd90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a80c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01afd90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a8150590 0x7f01a8150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01afd90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80d1660 con 0x7f01a80cea80 2024-04-25T09:05:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01afd90640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80d0270 con 0x7f01a806adf0 2024-04-25T09:05:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01afd90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80d17e0 con 0x7f01a8150590 2024-04-25T09:05:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a80c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a80c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49032/0 (socket says 172.21.15.5:49032) 2024-04-25T09:05:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 -- 172.21.15.5:0/3854039226 learned_addr learned my addr 172.21.15.5:0/3854039226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ae32d640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a8150590 0x7f01a8150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01adb2c640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a806adf0 0x7f01a80c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 -- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a8150590 msgr2=0x7f01a8150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a8150590 0x7f01a8150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 -- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a806adf0 msgr2=0x7f01a80c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a806adf0 0x7f01a80c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 -- 172.21.15.5:0/3854039226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a81e9d60 con 0x7f01a80cea80 2024-04-25T09:05:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ae32d640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a8150590 0x7f01a8150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01adb2c640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a806adf0 0x7f01a80c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01ad32b640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a80c5c20 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f019800e870 tx=0x7f019800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f019e7fc640 1 -- 172.21.15.5:0/3854039226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198017070 con 0x7f01a80cea80 2024-04-25T09:05:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f019e7fc640 1 -- 172.21.15.5:0/3854039226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800c940 con 0x7f01a80cea80 2024-04-25T09:05:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a81ea040 con 0x7f01a80cea80 2024-04-25T09:05:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.063+0000 7f019e7fc640 1 -- 172.21.15.5:0/3854039226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800cd30 con 0x7f01a80cea80 2024-04-25T09:05:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.064+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a815df60 con 0x7f01a80cea80 2024-04-25T09:05:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.064+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a80b5070 con 0x7f01a80cea80 2024-04-25T09:05:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.065+0000 7f019e7fc640 1 -- 172.21.15.5:0/3854039226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f019801a070 con 0x7f01a80cea80 2024-04-25T09:05:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.065+0000 7f019e7fc640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f018c06b500 0x7f018c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.066+0000 7f019e7fc640 1 -- 172.21.15.5:0/3854039226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f019808a3d0 con 0x7f01a80cea80 2024-04-25T09:05:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.066+0000 7f01adb2c640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f018c06b500 0x7f018c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.066+0000 7f01adb2c640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f018c06b500 0x7f018c06d9c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f01a4034000 tx=0x7f01a402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.070+0000 7f019e7fc640 1 -- 172.21.15.5:0/3854039226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f01980592a0 con 0x7f01a80cea80 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.290+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01a804ef20 con 0x7f01a80cea80 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.291+0000 7f019e7fc640 1 -- 172.21.15.5:0/3854039226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f0198058ba0 con 0x7f01a80cea80 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:32.281 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:32.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.292+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f018c06b500 msgr2=0x7f018c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.292+0000 7f01afd90640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f018c06b500 0x7f018c06d9c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f01a4034000 tx=0x7f01a402e000 comp rx=0 tx=0).stop 2024-04-25T09:05:32.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.292+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 msgr2=0x7f01a80c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.292+0000 7f01afd90640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a80c5c20 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f019800e870 tx=0x7f019800ed30 comp rx=0 tx=0).stop 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 shutdown_connections 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f018c06b500 0x7f018c06d9c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01a8150590 0x7f01a8150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a80cea80 0x7f01a80c5c20 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 --2- 172.21.15.5:0/3854039226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a806adf0 0x7f01a80c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 >> 172.21.15.5:0/3854039226 conn(0x7f01a80d19f0 msgr2=0x7f01a80aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 shutdown_connections 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.293+0000 7f01afd90640 1 -- 172.21.15.5:0/3854039226 wait complete. 2024-04-25T09:05:32.292 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:05:32.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:05:32.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.403+0000 7f0e4ffb0640 1 Processor -- start 2024-04-25T09:05:32.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.403+0000 7f0e4ffb0640 1 -- start start 2024-04-25T09:05:32.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.404+0000 7f0e4ffb0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e480ce290 0x7f0e480ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.404+0000 7f0e4ffb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480b52c0 0x7f0e480b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.404+0000 7f0e4ffb0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e480cdcb0 con 0x7f0e4815bdc0 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.404+0000 7f0e4ffb0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e480cdf90 con 0x7f0e480ce290 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.404+0000 7f0e4ffb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480b47e0 con 0x7f0e480b52c0 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4d54b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e480ce290 0x7f0e480ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4e54d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480b52c0 0x7f0e480b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4dd4c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0e4815bdc0 0x7f0e480cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:54246/0 (socket says 172.21.15.5:54246) 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4dd4c640 1 -- 172.21.15.5:0/2300439359 learned_addr learned my addr 172.21.15.5:0/2300439359 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4d54b640 1 -- 172.21.15.5:0/2300439359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480b52c0 msgr2=0x7f0e480b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4d54b640 1 --2- 172.21.15.5:0/2300439359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480b52c0 0x7f0e480b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4d54b640 1 -- 172.21.15.5:0/2300439359 >> v1:172.21.15.80:6789/0 conn(0x7f0e4815bdc0 legacy=0x7f0e480cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4d54b640 1 -- 172.21.15.5:0/2300439359 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480b4ac0 con 0x7f0e480ce290 2024-04-25T09:05:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.405+0000 7f0e4cd4a640 1 -- 172.21.15.5:0/2300439359 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406494060 0 0) 0x7f0e480cdcb0 con 0x7f0e4815bdc0 2024-04-25T09:05:32.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4d54b640 1 --2- 172.21.15.5:0/2300439359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480ce290 0x7f0e480ce720 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097a0 tx=0x7f0e3c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ae03024ddaa562 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4cd4a640 1 -- 172.21.15.5:0/2300439359 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c037070 con 0x7f0e480ce290 2024-04-25T09:05:32.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4cd4a640 1 -- 172.21.15.5:0/2300439359 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c032440 con 0x7f0e480ce290 2024-04-25T09:05:32.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4cd4a640 1 -- 172.21.15.5:0/2300439359 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c032810 con 0x7f0e480ce290 2024-04-25T09:05:32.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/2300439359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480ce290 msgr2=0x7f0e480ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/2300439359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480ce290 0x7f0e480ce720 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097a0 tx=0x7f0e3c02a180 comp rx=0 tx=0).stop 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/2300439359 shutdown_connections 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/2300439359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480b52c0 0x7f0e480b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/2300439359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480ce290 0x7f0e480ce720 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/2300439359 >> 172.21.15.5:0/2300439359 conn(0x7f0e480d18f0 msgr2=0x7f0e480d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/2300439359 shutdown_connections 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.406+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/2300439359 wait complete. 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 Processor -- start 2024-04-25T09:05:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 -- start start 2024-04-25T09:05:32.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480b52c0 0x7f0e480c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480ce290 0x7f0e480c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e4815bdc0 0x7f0e480b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480cd8b0 con 0x7f0e4815bdc0 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480d09a0 con 0x7f0e480b52c0 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.408+0000 7f0e4ffb0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480cda30 con 0x7f0e480ce290 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e4815bdc0 0x7f0e480b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e4815bdc0 0x7f0e480b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49042/0 (socket says 172.21.15.5:49042) 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 -- 172.21.15.5:0/1055010373 learned_addr learned my addr 172.21.15.5:0/1055010373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4dd4c640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480b52c0 0x7f0e480c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4d54b640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480ce290 0x7f0e480c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 -- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480ce290 msgr2=0x7f0e480c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480ce290 0x7f0e480c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 -- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480b52c0 msgr2=0x7f0e480c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480b52c0 0x7f0e480c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 -- 172.21.15.5:0/1055010373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480c7000 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4e54d640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e4815bdc0 0x7f0e480b6590 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800efc0 tx=0x7f0e3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e467fc640 1 -- 172.21.15.5:0/1055010373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38018020 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e467fc640 1 -- 172.21.15.5:0/1055010373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38014480 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e480c72e0 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e467fc640 1 -- 172.21.15.5:0/1055010373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38014870 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.409+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e480c78a0 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.410+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4804ef20 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.411+0000 7f0e467fc640 1 -- 172.21.15.5:0/1055010373 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e38005d10 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.411+0000 7f0e467fc640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e3406b500 0x7f0e3406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.411+0000 7f0e467fc640 1 -- 172.21.15.5:0/1055010373 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0e3808abf0 con 0x7f0e4815bdc0 2024-04-25T09:05:32.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.411+0000 7f0e4dd4c640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e3406b500 0x7f0e3406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.412+0000 7f0e4dd4c640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e3406b500 0x7f0e3406d9c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0e40007fd0 tx=0x7f0e40007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.415+0000 7f0e467fc640 1 -- 172.21.15.5:0/1055010373 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e38022070 con 0x7f0e4815bdc0 2024-04-25T09:05:32.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.667+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0e4815af60 con 0x7f0e4815bdc0 2024-04-25T09:05:32.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.668+0000 7f0e467fc640 1 -- 172.21.15.5:0/1055010373 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1573 (secure 0 0 0) 0x7f0e38010040 con 0x7f0e4815bdc0 2024-04-25T09:05:32.656 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:32.657 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":552,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":127,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":632,"data_bytes":638679886,"bytes_used":1624473600,"bytes_avail":771469639680,"bytes_total":773094113280,"write_bytes_sec":66381383,"read_op_per_sec":0,"write_op_per_sec":64},"fsmap":{"epoch":78,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9102}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-04-25T09:04:46.496936+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:05:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e3406b500 msgr2=0x7f0e3406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e3406b500 0x7f0e3406d9c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0e40007fd0 tx=0x7f0e40007de0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e4815bdc0 msgr2=0x7f0e480b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e4815bdc0 0x7f0e480b6590 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800efc0 tx=0x7f0e3800c490 comp rx=0 tx=0).stop 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 shutdown_connections 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0e3406b500 0x7f0e3406d9c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e4815bdc0 0x7f0e480b6590 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0e480ce290 0x7f0e480c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 --2- 172.21.15.5:0/1055010373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e480b52c0 0x7f0e480c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 >> 172.21.15.5:0/1055010373 conn(0x7f0e480d18f0 msgr2=0x7f0e480d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 shutdown_connections 2024-04-25T09:05:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:32.670+0000 7f0e4ffb0640 1 -- 172.21.15.5:0/1055010373 wait complete. 2024-04-25T09:05:32.669 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:05:33.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.796+0000 7f4882f70640 1 Processor -- start 2024-04-25T09:05:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.796+0000 7f4882f70640 1 -- start start 2024-04-25T09:05:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.796+0000 7f4882f70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f487c15e0a0 0x7f487c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.796+0000 7f4882f70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.796+0000 7f4882f70640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0b7f60 con 0x7f487c0d3990 2024-04-25T09:05:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.796+0000 7f4882f70640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0b29c0 con 0x7f487c15e0a0 2024-04-25T09:05:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.796+0000 7f4882f70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0d2080 con 0x7f487c0d3df0 2024-04-25T09:05:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f488150d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f4880d0c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f487c15e0a0 0x7f487c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f488150d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c0cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:51488/0 (socket says 172.21.15.5:51488) 2024-04-25T09:05:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f4880d0c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f487c15e0a0 0x7f487c0d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:37416/0 (socket says 172.21.15.5:37416) 2024-04-25T09:05:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f488150d640 1 -- 172.21.15.5:0/424649601 learned_addr learned my addr 172.21.15.5:0/424649601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f4873fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f487c0d3990 0x7f487c0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:54256/0 (socket says 172.21.15.5:54256) 2024-04-25T09:05:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f4880d0c640 1 -- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 msgr2=0x7f487c0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f4880d0c640 1 --2- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c0cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f4880d0c640 1 -- 172.21.15.5:0/424649601 >> v1:172.21.15.80:6789/0 conn(0x7f487c0d3990 legacy=0x7f487c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f48737fe640 1 -- 172.21.15.5:0/424649601 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490691884 0 0) 0x7f487c0b7f60 con 0x7f487c0d3990 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f4880d0c640 1 -- 172.21.15.5:0/424649601 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0d2360 con 0x7f487c15e0a0 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.797+0000 7f488150d640 1 --2- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.798+0000 7f4880d0c640 1 --2- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 0x7f487c0d0d50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f48780097a0 tx=0x7f487802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a9d0462aab5136 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.798+0000 7f48737fe640 1 -- 172.21.15.5:0/424649601 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878037070 con 0x7f487c15e0a0 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.798+0000 7f48737fe640 1 -- 172.21.15.5:0/424649601 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878032440 con 0x7f487c15e0a0 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.798+0000 7f48737fe640 1 -- 172.21.15.5:0/424649601 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878032810 con 0x7f487c15e0a0 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 -- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 msgr2=0x7f487c0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 --2- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 0x7f487c0d0d50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f48780097a0 tx=0x7f487802a180 comp rx=0 tx=0).stop 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 -- 172.21.15.5:0/424649601 shutdown_connections 2024-04-25T09:05:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 --2- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 --2- 172.21.15.5:0/424649601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 0x7f487c0d0d50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 -- 172.21.15.5:0/424649601 >> 172.21.15.5:0/424649601 conn(0x7f487c0668f0 msgr2=0x7f487c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 -- 172.21.15.5:0/424649601 shutdown_connections 2024-04-25T09:05:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.799+0000 7f4882f70640 1 -- 172.21.15.5:0/424649601 wait complete. 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.800+0000 7f4882f70640 1 Processor -- start 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.800+0000 7f4882f70640 1 -- start start 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4882f70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f487c0d3990 0x7f487c0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4882f70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4882f70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 0x7f487c0c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4882f70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0d2c00 con 0x7f487c0d3990 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4882f70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0d2920 con 0x7f487c15e0a0 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4882f70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0d4280 con 0x7f487c0d3df0 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4880d0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f487c0d3990 0x7f487c0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4880d0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f487c0d3990 0x7f487c0b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49046/0 (socket says 172.21.15.5:49046) 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4880d0c640 1 -- 172.21.15.5:0/11001124 learned_addr learned my addr 172.21.15.5:0/11001124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f4873fff640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.801+0000 7f488150d640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 0x7f487c0c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4880d0c640 1 -- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 msgr2=0x7f487c15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4880d0c640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c15ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4880d0c640 1 -- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 msgr2=0x7f487c0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4880d0c640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 0x7f487c0c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4880d0c640 1 -- 172.21.15.5:0/11001124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0c8ec0 con 0x7f487c0d3990 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4880d0c640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f487c0d3990 0x7f487c0b1f10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f48780098c0 tx=0x7f48780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f48717fa640 1 -- 172.21.15.5:0/11001124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878037040 con 0x7f487c0d3990 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f48717fa640 1 -- 172.21.15.5:0/11001124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878030500 con 0x7f487c0d3990 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c0c91a0 con 0x7f487c0d3990 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f48717fa640 1 -- 172.21.15.5:0/11001124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780308d0 con 0x7f487c0d3990 2024-04-25T09:05:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.802+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c0c9760 con 0x7f487c0d3990 2024-04-25T09:05:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.803+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c067f90 con 0x7f487c0d3990 2024-04-25T09:05:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.804+0000 7f48717fa640 1 -- 172.21.15.5:0/11001124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4878044020 con 0x7f487c0d3990 2024-04-25T09:05:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.804+0000 7f48717fa640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486806b500 0x7f486806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.804+0000 7f48717fa640 1 -- 172.21.15.5:0/11001124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f48780aa370 con 0x7f487c0d3990 2024-04-25T09:05:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.804+0000 7f4873fff640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486806b500 0x7f486806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.805+0000 7f4873fff640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486806b500 0x7f486806d9c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f487c0cf4a0 tx=0x7f486c007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:33.809+0000 7f48717fa640 1 -- 172.21.15.5:0/11001124 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f487c067f90 con 0x7f487c0d3990 2024-04-25T09:05:34.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.028+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f487c068550 con 0x7f487c0d3990 2024-04-25T09:05:34.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.029+0000 7f48717fa640 1 -- 172.21.15.5:0/11001124 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f487c068550 con 0x7f487c0d3990 2024-04-25T09:05:34.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:34.018 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:34.018 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:34.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486806b500 msgr2=0x7f486806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486806b500 0x7f486806d9c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f487c0cf4a0 tx=0x7f486c007de0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f487c0d3990 msgr2=0x7f487c0b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f487c0d3990 0x7f487c0b1f10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f48780098c0 tx=0x7f48780046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 shutdown_connections 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f486806b500 0x7f486806d9c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f487c15e0a0 0x7f487c0c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f487c0d3df0 0x7f487c15ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 --2- 172.21.15.5:0/11001124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f487c0d3990 0x7f487c0b1f10 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 >> 172.21.15.5:0/11001124 conn(0x7f487c0668f0 msgr2=0x7f487c0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 shutdown_connections 2024-04-25T09:05:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.031+0000 7f4882f70640 1 -- 172.21.15.5:0/11001124 wait complete. 2024-04-25T09:05:34.030 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:05:34.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.141+0000 7f8c7784c640 1 Processor -- start 2024-04-25T09:05:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.141+0000 7f8c7784c640 1 -- start start 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c7784c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700b94c0 0x7f8c700d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c7784c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c700d0400 0x7f8c700d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c7784c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c700d2550 con 0x7f8c7015def0 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c7784c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7015e2d0 con 0x7f8c700d0400 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c7784c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700d0db0 con 0x7f8c700b94c0 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c75de9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c700d0400 0x7f8c700d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c75de9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c700d0400 0x7f8c700d0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49050/0 (socket says 172.21.15.5:49050) 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c75de9640 1 -- 172.21.15.5:0/3886174289 learned_addr learned my addr 172.21.15.5:0/3886174289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c74de7640 1 --2- 172.21.15.5:0/3886174289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700b94c0 0x7f8c700d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c75de9640 1 -- 172.21.15.5:0/3886174289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700b94c0 msgr2=0x7f8c700d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c75de9640 1 --2- 172.21.15.5:0/3886174289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700b94c0 0x7f8c700d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c75de9640 1 -- 172.21.15.5:0/3886174289 >> v1:172.21.15.80:6789/0 conn(0x7f8c7015def0 legacy=0x7f8c700d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.142+0000 7f8c75de9640 1 -- 172.21.15.5:0/3886174289 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700d2830 con 0x7f8c700d0400 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.143+0000 7f8c75de9640 1 --2- 172.21.15.5:0/3886174289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c700d0400 0x7f8c700d0870 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009e80 tx=0x7f8c6802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac880c48fd9fa644 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.143+0000 7f8c67fff640 1 -- 172.21.15.5:0/3886174289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68036070 con 0x7f8c700d0400 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.143+0000 7f8c67fff640 1 -- 172.21.15.5:0/3886174289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68031600 con 0x7f8c700d0400 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.143+0000 7f8c67fff640 1 -- 172.21.15.5:0/3886174289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680319d0 con 0x7f8c700d0400 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 -- 172.21.15.5:0/3886174289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c700d0400 msgr2=0x7f8c700d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3886174289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c700d0400 0x7f8c700d0870 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009e80 tx=0x7f8c6802a750 comp rx=0 tx=0).stop 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 -- 172.21.15.5:0/3886174289 shutdown_connections 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3886174289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c700d0400 0x7f8c700d0870 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3886174289 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700b94c0 0x7f8c700d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 -- 172.21.15.5:0/3886174289 >> 172.21.15.5:0/3886174289 conn(0x7f8c7006b000 msgr2=0x7f8c7006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 -- 172.21.15.5:0/3886174289 shutdown_connections 2024-04-25T09:05:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.144+0000 7f8c7784c640 1 -- 172.21.15.5:0/3886174289 wait complete. 2024-04-25T09:05:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.145+0000 7f8c7784c640 1 Processor -- start 2024-04-25T09:05:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.145+0000 7f8c7784c640 1 -- start start 2024-04-25T09:05:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c7784c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c700b94c0 0x7f8c700b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c7784c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700d0400 0x7f8c700b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c7784c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7015def0 0x7f8c7015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c7784c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700d30d0 con 0x7f8c7015def0 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c7784c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700d2df0 con 0x7f8c700b94c0 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c7784c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700b6c60 con 0x7f8c700d0400 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7015def0 0x7f8c7015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7015def0 0x7f8c7015fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49052/0 (socket says 172.21.15.5:49052) 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 -- 172.21.15.5:0/3176307006 learned_addr learned my addr 172.21.15.5:0/3176307006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c755e8640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c700b94c0 0x7f8c700b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c74de7640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700d0400 0x7f8c700b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 -- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700d0400 msgr2=0x7f8c700b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700d0400 0x7f8c700b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 -- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c700b94c0 msgr2=0x7f8c700b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c700b94c0 0x7f8c700b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 -- 172.21.15.5:0/3176307006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c701f43c0 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.146+0000 7f8c75de9640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7015def0 0x7f8c7015fd80 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8c68034040 tx=0x7f8c68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.147+0000 7f8c65ffb640 1 -- 172.21.15.5:0/3176307006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68036050 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.147+0000 7f8c65ffb640 1 -- 172.21.15.5:0/3176307006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68042070 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.147+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c700b36c0 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.147+0000 7f8c65ffb640 1 -- 172.21.15.5:0/3176307006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68009510 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.147+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c700b3c80 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.148+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7004ef20 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.148+0000 7f8c65ffb640 1 -- 172.21.15.5:0/3176307006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c68007bf0 con 0x7f8c7015def0 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.149+0000 7f8c65ffb640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c5406b4d0 0x7f8c5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.149+0000 7f8c65ffb640 1 -- 172.21.15.5:0/3176307006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8c680ab000 con 0x7f8c7015def0 2024-04-25T09:05:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.149+0000 7f8c755e8640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c5406b4d0 0x7f8c5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.149+0000 7f8c755e8640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c5406b4d0 0x7f8c5406d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007fd0 tx=0x7f8c6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.153+0000 7f8c65ffb640 1 -- 172.21.15.5:0/3176307006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c68079e40 con 0x7f8c7015def0 2024-04-25T09:05:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.403+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8c700b2720 con 0x7f8c7015def0 2024-04-25T09:05:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.404+0000 7f8c65ffb640 1 -- 172.21.15.5:0/3176307006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1752 (secure 0 0 0) 0x7f8c68079740 con 0x7f8c7015def0 2024-04-25T09:05:34.392 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:34.392 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":554,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":127,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076007165,"bytes_used":2505625600,"bytes_avail":770588487680,"bytes_total":773094113280,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":3145038,"recovering_keys_per_sec":0,"num_objects_recovered":24,"num_bytes_recovered":25165824,"num_keys_recovered":0,"write_bytes_sec":121044293,"read_op_per_sec":0,"write_op_per_sec":118},"fsmap":{"epoch":78,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9102}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-04-25T09:04:46.496936+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:05:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c5406b4d0 msgr2=0x7f8c5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c5406b4d0 0x7f8c5406d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007fd0 tx=0x7f8c6c009040 comp rx=0 tx=0).stop 2024-04-25T09:05:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7015def0 msgr2=0x7f8c7015fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7015def0 0x7f8c7015fd80 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8c68034040 tx=0x7f8c68004a40 comp rx=0 tx=0).stop 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 shutdown_connections 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8c5406b4d0 0x7f8c5406d990 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7015def0 0x7f8c7015fd80 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8c700d0400 0x7f8c700b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 --2- 172.21.15.5:0/3176307006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c700b94c0 0x7f8c700b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.405+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 >> 172.21.15.5:0/3176307006 conn(0x7f8c7006b000 msgr2=0x7f8c7015e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.406+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 shutdown_connections 2024-04-25T09:05:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:34.406+0000 7f8c7784c640 1 -- 172.21.15.5:0/3176307006 wait complete. 2024-04-25T09:05:34.404 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:05:35.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.530+0000 7fcf5e930640 1 Processor -- start 2024-04-25T09:05:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.530+0000 7fcf5e930640 1 -- start start 2024-04-25T09:05:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf5e930640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 0x7fcf580b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf5e930640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf580aeda0 0x7fcf5815d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf5e930640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580b2aa0 con 0x7fcf5806dd20 2024-04-25T09:05:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf5e930640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580b2850 con 0x7fcf580aeda0 2024-04-25T09:05:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf5e930640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b2d80 con 0x7fcf58156250 2024-04-25T09:05:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf577fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf5806dd20 0x7fcf580ae690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58942/0 (socket says 172.21.15.5:58942) 2024-04-25T09:05:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf577fe640 1 -- 172.21.15.5:0/2094125420 learned_addr learned my addr 172.21.15.5:0/2094125420 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 0x7fcf580b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889930847 0 0) 0x7fcf580b2aa0 con 0x7fcf5806dd20 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf40003520 con 0x7fcf5806dd20 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf5cecd640 1 --2- 172.21.15.5:0/2094125420 >> v2:172.21.15.80:3300/0 conn(0x7fcf580aeda0 0x7fcf5815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 287166109 0 0) 0x7fcf40003520 con 0x7fcf5806dd20 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 msgr2=0x7fcf580b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 0x7fcf580b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 >> v2:172.21.15.80:3300/0 conn(0x7fcf580aeda0 msgr2=0x7fcf5815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 --2- 172.21.15.5:0/2094125420 >> v2:172.21.15.80:3300/0 conn(0x7fcf580aeda0 0x7fcf5815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580b3060 con 0x7fcf5806dd20 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fcf4c001670 con 0x7fcf5806dd20 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf5cecd640 1 --2- 172.21.15.5:0/2094125420 >> v2:172.21.15.80:3300/0 conn(0x7fcf580aeda0 0x7fcf5815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 >> v1:172.21.15.5:6789/0 conn(0x7fcf5806dd20 legacy=0x7fcf580ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.531+0000 7fcf56ffd640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400039b0 0x7fcf40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf56ffd640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf40004800 0x7fcf40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf56ffd640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 0x7fcf400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b2850 con 0x7fcf400039b0 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b2d80 con 0x7fcf40004800 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4000ba70 con 0x7fcf58156250 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400039b0 0x7fcf40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf577fe640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf40004800 0x7fcf40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf5cecd640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 0x7fcf400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf57fff640 1 -- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 msgr2=0x7fcf400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 0x7fcf400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf57fff640 1 -- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf40004800 msgr2=0x7fcf40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf40004800 0x7fcf40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf57fff640 1 -- 172.21.15.5:0/2094125420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40003520 con 0x7fcf400039b0 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.532+0000 7fcf5cecd640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf58156250 0x7fcf400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400039b0 0x7fcf40003dd0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009a90 tx=0x7fcf40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09acce8439cf70d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48036070 con 0x7fcf400039b0 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48031400 con 0x7fcf400039b0 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf56ffd640 1 -- 172.21.15.5:0/2094125420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48009690 con 0x7fcf400039b0 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf5e930640 1 -- 172.21.15.5:0/2094125420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400039b0 msgr2=0x7fcf40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf5e930640 1 --2- 172.21.15.5:0/2094125420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400039b0 0x7fcf40003dd0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009a90 tx=0x7fcf40005830 comp rx=0 tx=0).stop 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf5cecd640 1 -- 172.21.15.5:0/2094125420 reap_dead start 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf5e930640 1 -- 172.21.15.5:0/2094125420 shutdown_connections 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf5e930640 1 -- 172.21.15.5:0/2094125420 >> 172.21.15.5:0/2094125420 conn(0x7fcf580668f0 msgr2=0x7fcf58066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.533+0000 7fcf5e930640 1 -- 172.21.15.5:0/2094125420 shutdown_connections 2024-04-25T09:05:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.534+0000 7fcf5e930640 1 -- 172.21.15.5:0/2094125420 wait complete. 2024-04-25T09:05:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.535+0000 7fcf5e930640 1 Processor -- start 2024-04-25T09:05:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.535+0000 7fcf5e930640 1 -- start start 2024-04-25T09:05:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf5e930640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf400039b0 0x7fcf580ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf5e930640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58142090 0x7fcf5814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf5e930640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5815e2a0 0x7fcf5815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf5e930640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b39e0 con 0x7fcf58142090 2024-04-25T09:05:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf5e930640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b3860 con 0x7fcf5815e2a0 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf5e930640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b44c0 con 0x7fcf400039b0 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58142090 0x7fcf5814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58142090 0x7fcf5814cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49076/0 (socket says 172.21.15.5:49076) 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 -- 172.21.15.5:0/2544120950 learned_addr learned my addr 172.21.15.5:0/2544120950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf5cecd640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5815e2a0 0x7fcf5815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf400039b0 0x7fcf580ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 -- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf400039b0 msgr2=0x7fcf580ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf400039b0 0x7fcf580ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 -- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5815e2a0 msgr2=0x7fcf5815e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5815e2a0 0x7fcf5815e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 -- 172.21.15.5:0/2544120950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5814d8d0 con 0x7fcf58142090 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf577fe640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58142090 0x7fcf5814cce0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c007340 tx=0x7fcf4c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.536+0000 7fcf54ff9640 1 -- 172.21.15.5:0/2544120950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00f940 con 0x7fcf58142090 2024-04-25T09:05:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.537+0000 7fcf54ff9640 1 -- 172.21.15.5:0/2544120950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c018070 con 0x7fcf58142090 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.537+0000 7fcf54ff9640 1 -- 172.21.15.5:0/2544120950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00fd40 con 0x7fcf58142090 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.537+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf58142590 con 0x7fcf58142090 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.537+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58142b50 con 0x7fcf58142090 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.538+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf580cd0a0 con 0x7fcf58142090 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.538+0000 7fcf54ff9640 1 -- 172.21.15.5:0/2544120950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf4c01d460 con 0x7fcf58142090 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.538+0000 7fcf54ff9640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf4406b500 0x7fcf4406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.539+0000 7fcf54ff9640 1 -- 172.21.15.5:0/2544120950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcf4c08a280 con 0x7fcf58142090 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.539+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf4406b500 0x7fcf4406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.539+0000 7fcf57fff640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf4406b500 0x7fcf4406d9c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fcf48033000 tx=0x7fcf48008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.543+0000 7fcf54ff9640 1 -- 172.21.15.5:0/2544120950 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf580cd0a0 con 0x7fcf58142090 2024-04-25T09:05:35.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.758+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf5804ef20 con 0x7fcf58142090 2024-04-25T09:05:35.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.759+0000 7fcf54ff9640 1 -- 172.21.15.5:0/2544120950 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fcf4c0589e0 con 0x7fcf58142090 2024-04-25T09:05:35.748 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:35.748 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:35.748 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:35.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.760+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf4406b500 msgr2=0x7fcf4406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.760+0000 7fcf5e930640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf4406b500 0x7fcf4406d9c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fcf48033000 tx=0x7fcf48008030 comp rx=0 tx=0).stop 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.760+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58142090 msgr2=0x7fcf5814cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.760+0000 7fcf5e930640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58142090 0x7fcf5814cce0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c007340 tx=0x7fcf4c007800 comp rx=0 tx=0).stop 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 shutdown_connections 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fcf4406b500 0x7fcf4406d9c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf5815e2a0 0x7fcf5815e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58142090 0x7fcf5814cce0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 --2- 172.21.15.5:0/2544120950 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcf400039b0 0x7fcf580ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 >> 172.21.15.5:0/2544120950 conn(0x7fcf580668f0 msgr2=0x7fcf580b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 shutdown_connections 2024-04-25T09:05:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.761+0000 7fcf5e930640 1 -- 172.21.15.5:0/2544120950 wait complete. 2024-04-25T09:05:35.760 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:05:35.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:05:35.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.872+0000 7fd9f8b29640 1 Processor -- start 2024-04-25T09:05:35.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.872+0000 7fd9f8b29640 1 -- start start 2024-04-25T09:05:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.872+0000 7fd9f8b29640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9f40cfec0 0x7fd9f40d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.872+0000 7fd9f8b29640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f40cec90 con 0x7fd9f40c5d60 2024-04-25T09:05:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.872+0000 7fd9f8b29640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f40cef70 con 0x7fd9f415f100 2024-04-25T09:05:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.872+0000 7fd9f8b29640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40d0870 con 0x7fd9f40cfec0 2024-04-25T09:05:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f2d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9f40c5d60 0x7fd9f40c6180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58958/0 (socket says 172.21.15.5:58958) 2024-04-25T09:05:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f2d9d640 1 -- 172.21.15.5:0/231865207 learned_addr learned my addr 172.21.15.5:0/231865207 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9ebfff640 1 --2- 172.21.15.5:0/231865207 >> v2:172.21.15.80:3300/0 conn(0x7fd9f40cfec0 0x7fd9f40d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860257519 0 0) 0x7fd9f40cec90 con 0x7fd9f40c5d60 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e0003520 con 0x7fd9f40c5d60 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 990217395 0 0) 0x7fd9e0003520 con 0x7fd9f40c5d60 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 >> v2:172.21.15.80:3300/0 conn(0x7fd9f40cfec0 msgr2=0x7fd9f40d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 --2- 172.21.15.5:0/231865207 >> v2:172.21.15.80:3300/0 conn(0x7fd9f40cfec0 0x7fd9f40d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 >> v1:172.21.15.80:6789/0 conn(0x7fd9f415f100 legacy=0x7fd9f40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40c5560 con 0x7fd9f40c5d60 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fd9ec0019f0 con 0x7fd9f40c5d60 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9ebfff640 1 --2- 172.21.15.5:0/231865207 >> v2:172.21.15.80:3300/0 conn(0x7fd9f40cfec0 0x7fd9f40d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 >> v1:172.21.15.5:6789/0 conn(0x7fd9f40c5d60 legacy=0x7fd9f40c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9e00039b0 0x7fd9e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e0004800 0x7fd9e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e00051c0 0x7fd9e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40d0870 con 0x7fd9e00051c0 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e000c160 con 0x7fd9e0004800 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e000c360 con 0x7fd9e00039b0 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f2d9d640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e00051c0 0x7fd9e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9ebfff640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e0004800 0x7fd9e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.873+0000 7fd9f259c640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9e00039b0 0x7fd9e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.874+0000 7fd9f2d9d640 1 -- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9e00039b0 msgr2=0x7fd9e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.874+0000 7fd9f2d9d640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9e00039b0 0x7fd9e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.874+0000 7fd9f2d9d640 1 -- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e0004800 msgr2=0x7fd9e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.874+0000 7fd9f2d9d640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e0004800 0x7fd9e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.874+0000 7fd9f2d9d640 1 -- 172.21.15.5:0/231865207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0003520 con 0x7fd9e00051c0 2024-04-25T09:05:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.874+0000 7fd9f2d9d640 1 -- 172.21.15.5:0/231865207 reap_dead start 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.874+0000 7fd9f2d9d640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e00051c0 0x7fd9e000b9c0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00a860 tx=0x7fd9e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7826dbe41dc2ff65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00a480 con 0x7fd9e00051c0 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec02f070 con 0x7fd9e00051c0 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f1d9b640 1 -- 172.21.15.5:0/231865207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec02bcc0 con 0x7fd9e00051c0 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f8b29640 1 -- 172.21.15.5:0/231865207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e00051c0 msgr2=0x7fd9e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e00051c0 0x7fd9e000b9c0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00a860 tx=0x7fd9e0005830 comp rx=0 tx=0).stop 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f8b29640 1 -- 172.21.15.5:0/231865207 shutdown_connections 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/231865207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9e00051c0 0x7fd9e000b9c0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f8b29640 1 -- 172.21.15.5:0/231865207 >> 172.21.15.5:0/231865207 conn(0x7fd9f40d18e0 msgr2=0x7fd9f40d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f8b29640 1 -- 172.21.15.5:0/231865207 shutdown_connections 2024-04-25T09:05:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.875+0000 7fd9f8b29640 1 -- 172.21.15.5:0/231865207 wait complete. 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.876+0000 7fd9f8b29640 1 Processor -- start 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f8b29640 1 -- start start 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f8b29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e00051c0 0x7fd9f406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f8b29640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f406c2f0 0x7fd9f41f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f8b29640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9f41f5050 0x7fd9f415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f8b29640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40ce920 con 0x7fd9f406c2f0 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f8b29640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cf250 con 0x7fd9e00051c0 2024-04-25T09:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f8b29640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f415f4e0 con 0x7fd9f41f5050 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f406c2f0 0x7fd9f41f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f406c2f0 0x7fd9f41f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49102/0 (socket says 172.21.15.5:49102) 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9ebfff640 1 -- 172.21.15.5:0/1996821418 learned_addr learned my addr 172.21.15.5:0/1996821418 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f259c640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e00051c0 0x7fd9f406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.877+0000 7fd9f2d9d640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9f41f5050 0x7fd9f415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9ebfff640 1 -- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9f41f5050 msgr2=0x7fd9f415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9ebfff640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9f41f5050 0x7fd9f415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9ebfff640 1 -- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e00051c0 msgr2=0x7fd9f406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9ebfff640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e00051c0 0x7fd9f406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9ebfff640 1 -- 172.21.15.5:0/1996821418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f406ad10 con 0x7fd9f406c2f0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9ebfff640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f406c2f0 0x7fd9f41f4b10 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc011ac0 tx=0x7fd9dc011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9eaffd640 1 -- 172.21.15.5:0/1996821418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00fc10 con 0x7fd9f406c2f0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9eaffd640 1 -- 172.21.15.5:0/1996821418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00fdb0 con 0x7fd9f406c2f0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f406aff0 con 0x7fd9f406c2f0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9eaffd640 1 -- 172.21.15.5:0/1996821418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc004260 con 0x7fd9f406c2f0 2024-04-25T09:05:35.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.878+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f406b5b0 con 0x7fd9f406c2f0 2024-04-25T09:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.879+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f404ef20 con 0x7fd9f406c2f0 2024-04-25T09:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.879+0000 7fd9eaffd640 1 -- 172.21.15.5:0/1996821418 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9dc012040 con 0x7fd9f406c2f0 2024-04-25T09:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.880+0000 7fd9eaffd640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9d406b4d0 0x7fd9d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.880+0000 7fd9eaffd640 1 -- 172.21.15.5:0/1996821418 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd9dc08a660 con 0x7fd9f406c2f0 2024-04-25T09:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.880+0000 7fd9f259c640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9d406b4d0 0x7fd9d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.881+0000 7fd9f259c640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9d406b4d0 0x7fd9d406d990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4001760 tx=0x7fd9e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:35.884+0000 7fd9eaffd640 1 -- 172.21.15.5:0/1996821418 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9dc019030 con 0x7fd9f406c2f0 2024-04-25T09:05:36.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.142+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd9f40c6f20 con 0x7fd9f406c2f0 2024-04-25T09:05:36.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.143+0000 7fd9eaffd640 1 -- 172.21.15.5:0/1996821418 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1806 (secure 0 0 0) 0x7fd9dc058ee0 con 0x7fd9f406c2f0 2024-04-25T09:05:36.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:36.131 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":555,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":127,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076007165,"bytes_used":2505625600,"bytes_avail":770588487680,"bytes_total":773094113280,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":3144836,"recovering_keys_per_sec":0,"num_objects_recovered":24,"num_bytes_recovered":25165824,"num_keys_recovered":0,"write_bytes_sec":54658303,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":78,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9102}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-04-25T09:05:34.508342+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9d406b4d0 msgr2=0x7fd9d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9d406b4d0 0x7fd9d406d990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4001760 tx=0x7fd9e4009040 comp rx=0 tx=0).stop 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f406c2f0 msgr2=0x7fd9f41f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f406c2f0 0x7fd9f41f4b10 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc011ac0 tx=0x7fd9dc011f80 comp rx=0 tx=0).stop 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 shutdown_connections 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd9d406b4d0 0x7fd9d406d990 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9f41f5050 0x7fd9f415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f406c2f0 0x7fd9f41f4b10 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 --2- 172.21.15.5:0/1996821418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9e00051c0 0x7fd9f406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 >> 172.21.15.5:0/1996821418 conn(0x7fd9f40d18e0 msgr2=0x7fd9f406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.144+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 shutdown_connections 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.145+0000 7fd9f8b29640 1 -- 172.21.15.5:0/1996821418 wait complete. 2024-04-25T09:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/scrub_control_test_path]'} 2024-04-25T09:05:36.144 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:36.155 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:05:36.155 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'b', 'd', 'c'} 2024-04-25T09:05:36.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-04-25T09:05:36.302 INFO:teuthology.orchestra.run.smithi005.stdout:{"mds_beacon_grace":"15.000000"} 2024-04-25T09:05:36.302 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-04-25T09:05:36.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.415+0000 7f297dcc4640 1 Processor -- start 2024-04-25T09:05:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.415+0000 7f297dcc4640 1 -- start start 2024-04-25T09:05:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f297dcc4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29780ce7f0 0x7f29780cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f297dcc4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29780cf1c0 con 0x7f29780b2cc0 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f297dcc4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29780d20e0 con 0x7f297815de70 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f297dcc4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780d2a10 con 0x7f29780ce7f0 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f2976ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29780b2cc0 0x7f29780b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58964/0 (socket says 172.21.15.5:58964) 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f2976ffd640 1 -- 172.21.15.5:0/2241663063 learned_addr learned my addr 172.21.15.5:0/2241663063 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f2977fff640 1 --2- 172.21.15.5:0/2241663063 >> v2:172.21.15.5:3300/0 conn(0x7f29780ce7f0 0x7f29780cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f29767fc640 1 -- 172.21.15.5:0/2241663063 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782747108 0 0) 0x7f29780cf1c0 con 0x7f29780b2cc0 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f29767fc640 1 -- 172.21.15.5:0/2241663063 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2960003520 con 0x7f29780b2cc0 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f2977fff640 1 -- 172.21.15.5:0/2241663063 >> v1:172.21.15.80:6789/0 conn(0x7f297815de70 legacy=0x7f29780b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f2977fff640 1 -- 172.21.15.5:0/2241663063 >> v1:172.21.15.5:6789/0 conn(0x7f29780b2cc0 legacy=0x7f29780b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.416+0000 7f2977fff640 1 -- 172.21.15.5:0/2241663063 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780d23c0 con 0x7f29780ce7f0 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.417+0000 7f2977fff640 1 --2- 172.21.15.5:0/2241663063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780ce7f0 0x7f29780cec80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f2970009d90 tx=0x7f297002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75a0b3773c863fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.417+0000 7f29767fc640 1 -- 172.21.15.5:0/2241663063 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970007740 con 0x7f29780ce7f0 2024-04-25T09:05:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.417+0000 7f29767fc640 1 -- 172.21.15.5:0/2241663063 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29700078e0 con 0x7f29780ce7f0 2024-04-25T09:05:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.417+0000 7f29767fc640 1 -- 172.21.15.5:0/2241663063 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970007c90 con 0x7f29780ce7f0 2024-04-25T09:05:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.418+0000 7f297dcc4640 1 -- 172.21.15.5:0/2241663063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780ce7f0 msgr2=0x7f29780cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.418+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2241663063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780ce7f0 0x7f29780cec80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f2970009d90 tx=0x7f297002a6f0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.418+0000 7f297dcc4640 1 -- 172.21.15.5:0/2241663063 shutdown_connections 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.418+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2241663063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780ce7f0 0x7f29780cec80 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.418+0000 7f297dcc4640 1 -- 172.21.15.5:0/2241663063 >> 172.21.15.5:0/2241663063 conn(0x7f297806b000 msgr2=0x7f297806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.418+0000 7f297dcc4640 1 -- 172.21.15.5:0/2241663063 shutdown_connections 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.418+0000 7f297dcc4640 1 -- 172.21.15.5:0/2241663063 wait complete. 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.419+0000 7f297dcc4640 1 Processor -- start 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.419+0000 7f297dcc4640 1 -- start start 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f297dcc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780b2cc0 0x7f29780c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f297dcc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29780ce7f0 0x7f2978153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f297dcc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297815de70 0x7f29780c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f297dcc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29780d2ea0 con 0x7f29780b2cc0 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f297dcc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29780b7300 con 0x7f297815de70 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f297dcc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780d3020 con 0x7f29780ce7f0 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780b2cc0 0x7f29780c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780b2cc0 0x7f29780c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49124/0 (socket says 172.21.15.5:49124) 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 -- 172.21.15.5:0/2052434047 learned_addr learned my addr 172.21.15.5:0/2052434047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f2976ffd640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29780ce7f0 0x7f2978153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f2977fff640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297815de70 0x7f29780c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 -- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29780ce7f0 msgr2=0x7f2978153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29780ce7f0 0x7f2978153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 -- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297815de70 msgr2=0x7f29780c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297815de70 0x7f29780c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 -- 172.21.15.5:0/2052434047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780b5ee0 con 0x7f29780b2cc0 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f29777fe640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780b2cc0 0x7f29780c7720 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f296800c430 tx=0x7f296800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f295ffff640 1 -- 172.21.15.5:0/2052434047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968017070 con 0x7f29780b2cc0 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f295ffff640 1 -- 172.21.15.5:0/2052434047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29680052d0 con 0x7f29780b2cc0 2024-04-25T09:05:36.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.420+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29780caf10 con 0x7f29780b2cc0 2024-04-25T09:05:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.421+0000 7f295ffff640 1 -- 172.21.15.5:0/2052434047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968003830 con 0x7f29780b2cc0 2024-04-25T09:05:36.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.421+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29780cb4d0 con 0x7f29780b2cc0 2024-04-25T09:05:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.422+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297804ef20 con 0x7f29780b2cc0 2024-04-25T09:05:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.422+0000 7f295ffff640 1 -- 172.21.15.5:0/2052434047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f296801a070 con 0x7f29780b2cc0 2024-04-25T09:05:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.422+0000 7f295ffff640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f296406b4d0 0x7f296406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.422+0000 7f295ffff640 1 -- 172.21.15.5:0/2052434047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f29680895f0 con 0x7f29780b2cc0 2024-04-25T09:05:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.423+0000 7f2976ffd640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f296406b4d0 0x7f296406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.423+0000 7f2976ffd640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f296406b4d0 0x7f296406d990 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f29780cf510 tx=0x7f296c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.427+0000 7f295ffff640 1 -- 172.21.15.5:0/2052434047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29680583b0 con 0x7f29780b2cc0 2024-04-25T09:05:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.646+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29780cb840 con 0x7f29780b2cc0 2024-04-25T09:05:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.646+0000 7f295ffff640 1 -- 172.21.15.5:0/2052434047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f2968057cb0 con 0x7f29780b2cc0 2024-04-25T09:05:36.635 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:36.635 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:36.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.648+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f296406b4d0 msgr2=0x7f296406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f296406b4d0 0x7f296406d990 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f29780cf510 tx=0x7f296c009040 comp rx=0 tx=0).stop 2024-04-25T09:05:36.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780b2cc0 msgr2=0x7f29780c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780b2cc0 0x7f29780c7720 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f296800c430 tx=0x7f296800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 shutdown_connections 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f296406b4d0 0x7f296406d990 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297815de70 0x7f29780c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29780ce7f0 0x7f2978153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 --2- 172.21.15.5:0/2052434047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29780b2cc0 0x7f29780c7720 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 >> 172.21.15.5:0/2052434047 conn(0x7f297806b000 msgr2=0x7f297815aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 shutdown_connections 2024-04-25T09:05:36.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:36.649+0000 7f297dcc4640 1 -- 172.21.15.5:0/2052434047 wait complete. 2024-04-25T09:05:36.648 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:05:41.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.774+0000 7f3d6021b640 1 Processor -- start 2024-04-25T09:05:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.774+0000 7f3d6021b640 1 -- start start 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d6021b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 0x7f3d580b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d6021b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d580b7130 0x7f3d580ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d6021b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d580d20e0 con 0x7f3d5815de70 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d6021b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d580d2a10 con 0x7f3d580b7130 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d6021b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580d23c0 con 0x7f3d580b2cc0 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d5dfb7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3d5815de70 0x7f3d580b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36490/0 (socket says 172.21.15.5:36490) 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d5dfb7640 1 -- 172.21.15.5:0/1093636438 learned_addr learned my addr 172.21.15.5:0/1093636438 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/1093636438 >> v2:172.21.15.80:3300/0 conn(0x7f3d580b7130 0x7f3d580ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d5d7b6640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 0x7f3d580b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336611876 0 0) 0x7f3d580d20e0 con 0x7f3d5815de70 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.775+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d40003520 con 0x7f3d5815de70 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196060106 0 0) 0x7f3d40003520 con 0x7f3d5815de70 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 msgr2=0x7f3d580b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 0x7f3d580b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 >> v2:172.21.15.80:3300/0 conn(0x7f3d580b7130 msgr2=0x7f3d580ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 --2- 172.21.15.5:0/1093636438 >> v2:172.21.15.80:3300/0 conn(0x7f3d580b7130 0x7f3d580ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580d26a0 con 0x7f3d5815de70 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f3d50001670 con 0x7f3d5815de70 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5d7b6640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 0x7f3d580b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 >> v1:172.21.15.5:6789/0 conn(0x7f3d5815de70 legacy=0x7f3d580b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 0x7f3d400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d40003ef0 0x7f3d40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580d2a10 con 0x7f3d40004d40 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580d23c0 con 0x7f3d40003ef0 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4000b9c0 con 0x7f3d580b2cc0 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/1093636438 >> v2:172.21.15.80:3300/0 conn(0x7f3d580b7130 0x7f3d580ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5dfb7640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 0x7f3d400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5d7b6640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d40003ef0 0x7f3d40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5e7b8640 1 -- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 msgr2=0x7f3d400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d580b2cc0 0x7f3d400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5e7b8640 1 -- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d40003ef0 msgr2=0x7f3d40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d40003ef0 0x7f3d40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.776+0000 7f3d5e7b8640 1 -- 172.21.15.5:0/1093636438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40003520 con 0x7f3d40004d40 2024-04-25T09:05:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.777+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d400051c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800e350 tx=0x7f3d40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c0700378f5963b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.777+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48009dc0 con 0x7f3d40004d40 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.777+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48003b90 con 0x7f3d40004d40 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.777+0000 7f3d5cfb5640 1 -- 172.21.15.5:0/1093636438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48004020 con 0x7f3d40004d40 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.778+0000 7f3d6021b640 1 -- 172.21.15.5:0/1093636438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 msgr2=0x7f3d400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.778+0000 7f3d6021b640 1 --2- 172.21.15.5:0/1093636438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d400051c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800e350 tx=0x7f3d40005830 comp rx=0 tx=0).stop 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.778+0000 7f3d5e7b8640 1 -- 172.21.15.5:0/1093636438 reap_dead start 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.778+0000 7f3d6021b640 1 -- 172.21.15.5:0/1093636438 shutdown_connections 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.778+0000 7f3d6021b640 1 -- 172.21.15.5:0/1093636438 >> 172.21.15.5:0/1093636438 conn(0x7f3d5806b000 msgr2=0x7f3d5806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.778+0000 7f3d6021b640 1 -- 172.21.15.5:0/1093636438 shutdown_connections 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.778+0000 7f3d6021b640 1 -- 172.21.15.5:0/1093636438 wait complete. 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.779+0000 7f3d6021b640 1 Processor -- start 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.779+0000 7f3d6021b640 1 -- start start 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d6021b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d580c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d6021b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d58152420 0x7f3d581f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d6021b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d580c8ec0 0x7f3d580c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d6021b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580b6f80 con 0x7f3d40004d40 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d6021b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580b6e00 con 0x7f3d580c8ec0 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d6021b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580ced30 con 0x7f3d58152420 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d580c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d580c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40952/0 (socket says 172.21.15.5:40952) 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 -- 172.21.15.5:0/3410220873 learned_addr learned my addr 172.21.15.5:0/3410220873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d580c8ec0 0x7f3d580c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5d7b6640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d58152420 0x7f3d581f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 -- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d58152420 msgr2=0x7f3d581f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d58152420 0x7f3d581f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 -- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d580c8ec0 msgr2=0x7f3d580c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d580c8ec0 0x7f3d580c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 -- 172.21.15.5:0/3410220873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d581528a0 con 0x7f3d40004d40 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5e7b8640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d580c8ec0 0x7f3d580c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5d7b6640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d58152420 0x7f3d581f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.780+0000 7f3d5dfb7640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d580c7480 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f3d50007310 tx=0x7f3d500077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.781+0000 7f3d567fc640 1 -- 172.21.15.5:0/3410220873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000f9a0 con 0x7f3d40004d40 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.781+0000 7f3d567fc640 1 -- 172.21.15.5:0/3410220873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50018070 con 0x7f3d40004d40 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.781+0000 7f3d567fc640 1 -- 172.21.15.5:0/3410220873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000fda0 con 0x7f3d40004d40 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.781+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d580c7a60 con 0x7f3d40004d40 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.781+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d580c8020 con 0x7f3d40004d40 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.782+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5804ef20 con 0x7f3d40004d40 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.782+0000 7f3d567fc640 1 -- 172.21.15.5:0/3410220873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d5001d460 con 0x7f3d40004d40 2024-04-25T09:05:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.783+0000 7f3d567fc640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d4406b500 0x7f3d4406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.783+0000 7f3d567fc640 1 -- 172.21.15.5:0/3410220873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3d5008a3a0 con 0x7f3d40004d40 2024-04-25T09:05:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.783+0000 7f3d5d7b6640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d4406b500 0x7f3d4406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.784+0000 7f3d5d7b6640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d4406b500 0x7f3d4406d9c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3d5815eaa0 tx=0x7f3d4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:41.787+0000 7f3d567fc640 1 -- 172.21.15.5:0/3410220873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d500591e0 con 0x7f3d40004d40 2024-04-25T09:05:41.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.004+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d58071800 con 0x7f3d40004d40 2024-04-25T09:05:41.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.005+0000 7f3d567fc640 1 -- 172.21.15.5:0/3410220873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f3d50058ae0 con 0x7f3d40004d40 2024-04-25T09:05:41.993 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:41.993 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:41.994 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d4406b500 msgr2=0x7f3d4406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d4406b500 0x7f3d4406d9c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3d5815eaa0 tx=0x7f3d4c008040 comp rx=0 tx=0).stop 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 msgr2=0x7f3d580c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d580c7480 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f3d50007310 tx=0x7f3d500077d0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 shutdown_connections 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3d4406b500 0x7f3d4406d9c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d580c8ec0 0x7f3d580c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d58152420 0x7f3d581f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 --2- 172.21.15.5:0/3410220873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d40004d40 0x7f3d580c7480 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 >> 172.21.15.5:0/3410220873 conn(0x7f3d5806b000 msgr2=0x7f3d5815cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 shutdown_connections 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:42.007+0000 7f3d6021b640 1 -- 172.21.15.5:0/3410220873 wait complete. 2024-04-25T09:05:42.007 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:05:47.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.132+0000 7f7dddc41640 1 Processor -- start 2024-04-25T09:05:47.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.132+0000 7f7dddc41640 1 -- start start 2024-04-25T09:05:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dddc41640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd80b2cc0 0x7f7dd80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dddc41640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7dd80b7130 0x7f7dd80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dddc41640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd80d20e0 con 0x7f7dd815de70 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dddc41640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80d2a10 con 0x7f7dd80b2cc0 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dddc41640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80d23c0 con 0x7f7dd80b7130 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dd6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd80b2cc0 0x7f7dd80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dd77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7dd815de70 0x7f7dd80b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36502/0 (socket says 172.21.15.5:36502) 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.133+0000 7f7dd77fe640 1 -- 172.21.15.5:0/5451153 learned_addr learned my addr 172.21.15.5:0/5451153 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.134+0000 7f7dd7fff640 1 --2- 172.21.15.5:0/5451153 >> v2:172.21.15.80:3300/0 conn(0x7f7dd80b7130 0x7f7dd80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.134+0000 7f7dd6ffd640 1 -- 172.21.15.5:0/5451153 >> v2:172.21.15.80:3300/0 conn(0x7f7dd80b7130 msgr2=0x7f7dd80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.134+0000 7f7dd6ffd640 1 --2- 172.21.15.5:0/5451153 >> v2:172.21.15.80:3300/0 conn(0x7f7dd80b7130 0x7f7dd80ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.134+0000 7f7dd6ffd640 1 -- 172.21.15.5:0/5451153 >> v1:172.21.15.5:6789/0 conn(0x7f7dd815de70 legacy=0x7f7dd80b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.134+0000 7f7dd67fc640 1 -- 172.21.15.5:0/5451153 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282801503 0 0) 0x7f7dd80d20e0 con 0x7f7dd815de70 2024-04-25T09:05:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.134+0000 7f7dd6ffd640 1 -- 172.21.15.5:0/5451153 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80d26a0 con 0x7f7dd80b2cc0 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dd6ffd640 1 --2- 172.21.15.5:0/5451153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd80b6bf0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0097a0 tx=0x7f7dcc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f83ef5b5fcdf02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dd67fc640 1 -- 172.21.15.5:0/5451153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc037070 con 0x7f7dd80b2cc0 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dd67fc640 1 -- 172.21.15.5:0/5451153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc032440 con 0x7f7dd80b2cc0 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dd67fc640 1 -- 172.21.15.5:0/5451153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc032810 con 0x7f7dd80b2cc0 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 -- 172.21.15.5:0/5451153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 msgr2=0x7f7dd80b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 --2- 172.21.15.5:0/5451153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd80b6bf0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0097a0 tx=0x7f7dcc02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 -- 172.21.15.5:0/5451153 shutdown_connections 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 --2- 172.21.15.5:0/5451153 >> v2:172.21.15.80:3300/0 conn(0x7f7dd80b7130 0x7f7dd80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 --2- 172.21.15.5:0/5451153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b2cc0 0x7f7dd80b6bf0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 -- 172.21.15.5:0/5451153 >> 172.21.15.5:0/5451153 conn(0x7f7dd806b000 msgr2=0x7f7dd806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 -- 172.21.15.5:0/5451153 shutdown_connections 2024-04-25T09:05:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.135+0000 7f7dddc41640 1 -- 172.21.15.5:0/5451153 wait complete. 2024-04-25T09:05:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.137+0000 7f7dddc41640 1 Processor -- start 2024-04-25T09:05:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.137+0000 7f7dddc41640 1 -- start start 2024-04-25T09:05:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.137+0000 7f7dddc41640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80b2cc0 0x7f7dd80cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.137+0000 7f7dddc41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b7130 0x7f7dd80b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dddc41640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd815de70 0x7f7dd80c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dddc41640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80cf0c0 con 0x7f7dd80b7130 2024-04-25T09:05:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dddc41640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80cef40 con 0x7f7dd815de70 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dddc41640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80ca470 con 0x7f7dd80b2cc0 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b7130 0x7f7dd80b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b7130 0x7f7dd80b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40974/0 (socket says 172.21.15.5:40974) 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 -- 172.21.15.5:0/3862350222 learned_addr learned my addr 172.21.15.5:0/3862350222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd7fff640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd815de70 0x7f7dd80c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd77fe640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80b2cc0 0x7f7dd80cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 -- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80b2cc0 msgr2=0x7f7dd80cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80b2cc0 0x7f7dd80cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 -- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd815de70 msgr2=0x7f7dd80c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd815de70 0x7f7dd80c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 -- 172.21.15.5:0/3862350222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80b4530 con 0x7f7dd80b7130 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd77fe640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80b2cc0 0x7f7dd80cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dd6ffd640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b7130 0x7f7dd80b3e50 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c00 tx=0x7f7dcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dbffff640 1 -- 172.21.15.5:0/3862350222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc037040 con 0x7f7dd80b7130 2024-04-25T09:05:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dbffff640 1 -- 172.21.15.5:0/3862350222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc042070 con 0x7f7dd80b7130 2024-04-25T09:05:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dbffff640 1 -- 172.21.15.5:0/3862350222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc030bb0 con 0x7f7dd80b7130 2024-04-25T09:05:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd80b4810 con 0x7f7dd80b7130 2024-04-25T09:05:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.138+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80b4dd0 con 0x7f7dd80b7130 2024-04-25T09:05:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.139+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd814a7f0 con 0x7f7dd80b7130 2024-04-25T09:05:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.140+0000 7f7dbffff640 1 -- 172.21.15.5:0/3862350222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7dcc047460 con 0x7f7dd80b7130 2024-04-25T09:05:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.140+0000 7f7dbffff640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7dc406b4d0 0x7f7dc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.140+0000 7f7dbffff640 1 -- 172.21.15.5:0/3862350222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7dcc0aae60 con 0x7f7dd80b7130 2024-04-25T09:05:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.141+0000 7f7dd77fe640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7dc406b4d0 0x7f7dc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.141+0000 7f7dd77fe640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7dc406b4d0 0x7f7dc406d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000f60 tx=0x7f7dc8007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.145+0000 7f7dbffff640 1 -- 172.21.15.5:0/3862350222 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7dd814a7f0 con 0x7f7dd80b7130 2024-04-25T09:05:47.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.362+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dd804ef20 con 0x7f7dd80b7130 2024-04-25T09:05:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.362+0000 7f7dbffff640 1 -- 172.21.15.5:0/3862350222 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f7dcc032e20 con 0x7f7dd80b7130 2024-04-25T09:05:47.351 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:15.297700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9102":{"gid":9102,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/778491752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":778491752},{"type":"v1","addr":"172.21.15.5:6835","nonce":778491752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-04-25T09:05:47.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.364+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7dc406b4d0 msgr2=0x7f7dc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.364+0000 7f7dddc41640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7dc406b4d0 0x7f7dc406d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000f60 tx=0x7f7dc8007ca0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.364+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b7130 msgr2=0x7f7dd80b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.364+0000 7f7dddc41640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b7130 0x7f7dd80b3e50 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c00 tx=0x7f7dcc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 shutdown_connections 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7dc406b4d0 0x7f7dc406d990 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd815de70 0x7f7dd80c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd80b7130 0x7f7dd80b3e50 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 --2- 172.21.15.5:0/3862350222 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7dd80b2cc0 0x7f7dd80cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 >> 172.21.15.5:0/3862350222 conn(0x7f7dd806b000 msgr2=0x7f7dd815e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 shutdown_connections 2024-04-25T09:05:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:47.365+0000 7f7dddc41640 1 -- 172.21.15.5:0/3862350222 wait complete. 2024-04-25T09:05:47.365 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:05:47.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:47.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:52.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.491+0000 7f5300b70640 1 Processor -- start 2024-04-25T09:05:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.491+0000 7f5300b70640 1 -- start start 2024-04-25T09:05:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f5300b70640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52fc0cea80 0x7f52fc15f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f5300b70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc15fd80 0x7f52fc06b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f5300b70640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc15ef10 con 0x7f52fc06adf0 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f5300b70640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0cfd60 con 0x7f52fc0cea80 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f5300b70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc15f480 con 0x7f52fc15fd80 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52fa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52fc0cea80 0x7f52fc15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52fa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52fc0cea80 0x7f52fc15f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46416/0 (socket says 172.21.15.5:46416) 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52fa59c640 1 -- 172.21.15.5:0/3998599890 learned_addr learned my addr 172.21.15.5:0/3998599890 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52f9d9b640 1 --2- 172.21.15.5:0/3998599890 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc15fd80 0x7f52fc06b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52fa59c640 1 -- 172.21.15.5:0/3998599890 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc15fd80 msgr2=0x7f52fc06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52fa59c640 1 --2- 172.21.15.5:0/3998599890 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc15fd80 0x7f52fc06b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52fa59c640 1 -- 172.21.15.5:0/3998599890 >> v1:172.21.15.80:6789/0 conn(0x7f52fc06adf0 legacy=0x7f52fc0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.492+0000 7f52fa59c640 1 -- 172.21.15.5:0/3998599890 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc15f1a0 con 0x7f52fc0cea80 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.493+0000 7f52fa59c640 1 --2- 172.21.15.5:0/3998599890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc0cea80 0x7f52fc15f840 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009870 tx=0x7f52ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5e412664974f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.493+0000 7f52f959a640 1 -- 172.21.15.5:0/3998599890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec037070 con 0x7f52fc0cea80 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.493+0000 7f52f959a640 1 -- 172.21.15.5:0/3998599890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec032440 con 0x7f52fc0cea80 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.493+0000 7f52f959a640 1 -- 172.21.15.5:0/3998599890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec032810 con 0x7f52fc0cea80 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 -- 172.21.15.5:0/3998599890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc0cea80 msgr2=0x7f52fc15f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 --2- 172.21.15.5:0/3998599890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc0cea80 0x7f52fc15f840 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009870 tx=0x7f52ec02a270 comp rx=0 tx=0).stop 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 -- 172.21.15.5:0/3998599890 shutdown_connections 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 --2- 172.21.15.5:0/3998599890 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc15fd80 0x7f52fc06b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 --2- 172.21.15.5:0/3998599890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc0cea80 0x7f52fc15f840 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 -- 172.21.15.5:0/3998599890 >> 172.21.15.5:0/3998599890 conn(0x7f52fc0d19f0 msgr2=0x7f52fc0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 -- 172.21.15.5:0/3998599890 shutdown_connections 2024-04-25T09:05:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.494+0000 7f5300b70640 1 -- 172.21.15.5:0/3998599890 wait complete. 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.495+0000 7f5300b70640 1 Processor -- start 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.495+0000 7f5300b70640 1 -- start start 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f5300b70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc06adf0 0x7f52fc0c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f5300b70640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc0cea80 0x7f52fc0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f5300b70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52fc150590 0x7f52fc150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f5300b70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0d1660 con 0x7f52fc06adf0 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f5300b70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0d0270 con 0x7f52fc150590 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f5300b70640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0d17e0 con 0x7f52fc0cea80 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc06adf0 0x7f52fc0c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc06adf0 0x7f52fc0c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46430/0 (socket says 172.21.15.5:46430) 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 -- 172.21.15.5:0/4033821668 learned_addr learned my addr 172.21.15.5:0/4033821668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fad9d640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52fc150590 0x7f52fc150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52f9d9b640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc0cea80 0x7f52fc0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 -- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc0cea80 msgr2=0x7f52fc0c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc0cea80 0x7f52fc0c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 -- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52fc150590 msgr2=0x7f52fc150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52fc150590 0x7f52fc150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fa59c640 1 -- 172.21.15.5:0/4033821668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc1e9d60 con 0x7f52fc06adf0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52f9d9b640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc0cea80 0x7f52fc0c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.496+0000 7f52fad9d640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52fc150590 0x7f52fc150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.497+0000 7f52fa59c640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc06adf0 0x7f52fc0c56e0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f52ec000c00 tx=0x7f52ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.497+0000 7f52eaffd640 1 -- 172.21.15.5:0/4033821668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec037040 con 0x7f52fc06adf0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.497+0000 7f52eaffd640 1 -- 172.21.15.5:0/4033821668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec042070 con 0x7f52fc06adf0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.497+0000 7f52eaffd640 1 -- 172.21.15.5:0/4033821668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec030880 con 0x7f52fc06adf0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.497+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc1ea040 con 0x7f52fc06adf0 2024-04-25T09:05:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.497+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc15df60 con 0x7f52fc06adf0 2024-04-25T09:05:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.498+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc0b5070 con 0x7f52fc06adf0 2024-04-25T09:05:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.498+0000 7f52eaffd640 1 -- 172.21.15.5:0/4033821668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52ec030a20 con 0x7f52fc06adf0 2024-04-25T09:05:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.499+0000 7f52eaffd640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52dc06b500 0x7f52dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.499+0000 7f52eaffd640 1 -- 172.21.15.5:0/4033821668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f52ec0aaa10 con 0x7f52fc06adf0 2024-04-25T09:05:52.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.499+0000 7f52f9d9b640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52dc06b500 0x7f52dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.500+0000 7f52f9d9b640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52dc06b500 0x7f52dc06d9c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b4930 tx=0x7f52f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.503+0000 7f52eaffd640 1 -- 172.21.15.5:0/4033821668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52ec079890 con 0x7f52fc06adf0 2024-04-25T09:05:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.723+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52fc04ef20 con 0x7f52fc06adf0 2024-04-25T09:05:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.723+0000 7f52eaffd640 1 -- 172.21.15.5:0/4033821668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f52ec079190 con 0x7f52fc06adf0 2024-04-25T09:05:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:52.712 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:51.162797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"c","rank":0,"incarnation":79,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-04-25T09:05:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52dc06b500 msgr2=0x7f52dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52dc06b500 0x7f52dc06d9c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b4930 tx=0x7f52f0008040 comp rx=0 tx=0).stop 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc06adf0 msgr2=0x7f52fc0c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc06adf0 0x7f52fc0c56e0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f52ec000c00 tx=0x7f52ec0046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 shutdown_connections 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f52dc06b500 0x7f52dc06d9c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52fc150590 0x7f52fc150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f52fc0cea80 0x7f52fc0c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 --2- 172.21.15.5:0/4033821668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52fc06adf0 0x7f52fc0c56e0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 >> 172.21.15.5:0/4033821668 conn(0x7f52fc0d19f0 msgr2=0x7f52fc0aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 shutdown_connections 2024-04-25T09:05:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:52.726+0000 7f5300b70640 1 -- 172.21.15.5:0/4033821668 wait complete. 2024-04-25T09:05:52.725 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:05:57.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:57.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.851+0000 7f8cd15a9640 1 Processor -- start 2024-04-25T09:05:57.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.851+0000 7f8cd15a9640 1 -- start start 2024-04-25T09:05:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.852+0000 7f8cd15a9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc070630 0x7f8ccc0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.852+0000 7f8cd15a9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0b4b30 con 0x7f8ccc0cfec0 2024-04-25T09:05:57.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.852+0000 7f8cd15a9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0b2aa0 con 0x7f8ccc0cfa80 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.852+0000 7f8cd15a9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc162500 con 0x7f8ccc070630 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.852+0000 7f8ccb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8ccc0cfec0 0x7f8ccc16bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58652/0 (socket says 172.21.15.5:58652) 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.852+0000 7f8ccb7fe640 1 -- 172.21.15.5:0/624990072 learned_addr learned my addr 172.21.15.5:0/624990072 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.852+0000 7f8ccaffd640 1 --2- 172.21.15.5:0/624990072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc070630 0x7f8ccc0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.853+0000 7f8cc9ffb640 1 -- 172.21.15.5:0/624990072 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112246631 0 0) 0x7f8ccc0b4b30 con 0x7f8ccc0cfec0 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.853+0000 7f8cc9ffb640 1 -- 172.21.15.5:0/624990072 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb8003520 con 0x7f8ccc0cfec0 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.853+0000 7f8cc9ffb640 1 -- 172.21.15.5:0/624990072 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916771177 0 0) 0x7f8ccc0b2aa0 con 0x7f8ccc0cfa80 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.853+0000 7f8cc9ffb640 1 -- 172.21.15.5:0/624990072 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ccc0b4b30 con 0x7f8ccc0cfa80 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.853+0000 7f8ccaffd640 1 -- 172.21.15.5:0/624990072 >> v1:172.21.15.80:6789/0 conn(0x7f8ccc0cfa80 legacy=0x7f8ccc070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.853+0000 7f8ccaffd640 1 -- 172.21.15.5:0/624990072 >> v1:172.21.15.5:6789/0 conn(0x7f8ccc0cfec0 legacy=0x7f8ccc16bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.853+0000 7f8ccaffd640 1 -- 172.21.15.5:0/624990072 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0b2d80 con 0x7f8ccc070630 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8ccaffd640 1 --2- 172.21.15.5:0/624990072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc070630 0x7f8ccc0b4530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc162680 tx=0x7f8cc402a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21dd54c58c5c37a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cc9ffb640 1 -- 172.21.15.5:0/624990072 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4037070 con 0x7f8ccc070630 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cc9ffb640 1 -- 172.21.15.5:0/624990072 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc402ae20 con 0x7f8ccc070630 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cc9ffb640 1 -- 172.21.15.5:0/624990072 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4032640 con 0x7f8ccc070630 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cd15a9640 1 -- 172.21.15.5:0/624990072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc070630 msgr2=0x7f8ccc0b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/624990072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc070630 0x7f8ccc0b4530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc162680 tx=0x7f8cc402a0d0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cd15a9640 1 -- 172.21.15.5:0/624990072 shutdown_connections 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/624990072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc070630 0x7f8ccc0b4530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cd15a9640 1 -- 172.21.15.5:0/624990072 >> 172.21.15.5:0/624990072 conn(0x7f8ccc0668f0 msgr2=0x7f8ccc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cd15a9640 1 -- 172.21.15.5:0/624990072 shutdown_connections 2024-04-25T09:05:57.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.854+0000 7f8cd15a9640 1 -- 172.21.15.5:0/624990072 wait complete. 2024-04-25T09:05:57.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 Processor -- start 2024-04-25T09:05:57.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 -- start start 2024-04-25T09:05:57.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ccc070630 0x7f8ccc15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc0cfa80 0x7f8ccc15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ccc0cfec0 0x7f8ccc15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b30f0 con 0x7f8ccc070630 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b2850 con 0x7f8ccc0cfec0 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.856+0000 7f8cd15a9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc06d7a0 con 0x7f8ccc0cfa80 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ccc070630 0x7f8ccc15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ccc070630 0x7f8ccc15b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46436/0 (socket says 172.21.15.5:46436) 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 -- 172.21.15.5:0/2504403585 learned_addr learned my addr 172.21.15.5:0/2504403585 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccb7fe640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ccc0cfec0 0x7f8ccc15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8cca7fc640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc0cfa80 0x7f8ccc15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 -- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc0cfa80 msgr2=0x7f8ccc15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc0cfa80 0x7f8ccc15cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 -- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ccc0cfec0 msgr2=0x7f8ccc15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ccc0cfec0 0x7f8ccc15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 -- 172.21.15.5:0/2504403585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc15bc70 con 0x7f8ccc070630 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8ccaffd640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ccc070630 0x7f8ccc15b5e0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f8cc402a110 tx=0x7f8cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8cc37fe640 1 -- 172.21.15.5:0/2504403585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4041030 con 0x7f8ccc070630 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8cc37fe640 1 -- 172.21.15.5:0/2504403585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40044c0 con 0x7f8ccc070630 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc15bf50 con 0x7f8ccc070630 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8cc37fe640 1 -- 172.21.15.5:0/2504403585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4037040 con 0x7f8ccc070630 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.857+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc15c510 con 0x7f8ccc070630 2024-04-25T09:05:57.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.858+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc0b4530 con 0x7f8ccc070630 2024-04-25T09:05:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.859+0000 7f8cc37fe640 1 -- 172.21.15.5:0/2504403585 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8cc4044070 con 0x7f8ccc070630 2024-04-25T09:05:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.859+0000 7f8cc37fe640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cac06b4d0 0x7f8cac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.860+0000 7f8cc37fe640 1 -- 172.21.15.5:0/2504403585 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8cc40aa630 con 0x7f8ccc070630 2024-04-25T09:05:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.860+0000 7f8cca7fc640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cac06b4d0 0x7f8cac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.860+0000 7f8cca7fc640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cac06b4d0 0x7f8cac06d990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc14e6b0 tx=0x7f8cb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:57.864+0000 7f8cc37fe640 1 -- 172.21.15.5:0/2504403585 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ccc0b4530 con 0x7f8ccc070630 2024-04-25T09:05:57.892 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-04-25T09:05:57.904+0000 7ff99ccdd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:05:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.087+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ccc04ef20 con 0x7f8ccc070630 2024-04-25T09:05:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.088+0000 7f8cc37fe640 1 -- 172.21.15.5:0/2504403585 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f8cc402ae20 con 0x7f8ccc070630 2024-04-25T09:05:58.076 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:58.077 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:52.172731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":16,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:58.077 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 82 2024-04-25T09:05:58.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.089+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cac06b4d0 msgr2=0x7f8cac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.089+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cac06b4d0 0x7f8cac06d990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc14e6b0 tx=0x7f8cb4009040 comp rx=0 tx=0).stop 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.089+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ccc070630 msgr2=0x7f8ccc15b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.089+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ccc070630 0x7f8ccc15b5e0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f8cc402a110 tx=0x7f8cc40046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.089+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 shutdown_connections 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.090+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f8cac06b4d0 0x7f8cac06d990 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.090+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ccc0cfec0 0x7f8ccc15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.090+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8ccc0cfa80 0x7f8ccc15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.090+0000 7f8cd15a9640 1 --2- 172.21.15.5:0/2504403585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ccc070630 0x7f8ccc15b5e0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.090+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 >> 172.21.15.5:0/2504403585 conn(0x7f8ccc0668f0 msgr2=0x7f8ccc0cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.090+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 shutdown_connections 2024-04-25T09:05:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.090+0000 7f8cd15a9640 1 -- 172.21.15.5:0/2504403585 wait complete. 2024-04-25T09:05:58.089 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-04-25T09:05:58.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.202+0000 7f126382a640 1 Processor -- start 2024-04-25T09:05:58.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.202+0000 7f126382a640 1 -- start start 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f126382a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f125c15dc70 0x7f125c161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f126382a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c161fc0 con 0x7f125c0cef60 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f126382a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c1622a0 con 0x7f125c0b94a0 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f126382a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c0d2180 con 0x7f125c15dc70 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f12615c6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f125c15dc70 0x7f125c161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f1261dc7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f125c0cef60 0x7f125c0d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58664/0 (socket says 172.21.15.5:58664) 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f1261dc7640 1 -- 172.21.15.5:0/4268328495 learned_addr learned my addr 172.21.15.5:0/4268328495 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f12615c6640 1 -- 172.21.15.5:0/4268328495 >> v1:172.21.15.80:6789/0 conn(0x7f125c0b94a0 legacy=0x7f125c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f12615c6640 1 -- 172.21.15.5:0/4268328495 >> v1:172.21.15.5:6789/0 conn(0x7f125c0cef60 legacy=0x7f125c0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f1253fff640 1 -- 172.21.15.5:0/4268328495 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864601503 0 0) 0x7f125c161fc0 con 0x7f125c0cef60 2024-04-25T09:05:58.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.203+0000 7f12615c6640 1 -- 172.21.15.5:0/4268328495 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c162580 con 0x7f125c15dc70 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f12615c6640 1 --2- 172.21.15.5:0/4268328495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c15dc70 0x7f125c161850 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f12580097a0 tx=0x7f125802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a87e27af4359e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f1253fff640 1 -- 172.21.15.5:0/4268328495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258037070 con 0x7f125c15dc70 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f1253fff640 1 -- 172.21.15.5:0/4268328495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1258032440 con 0x7f125c15dc70 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f1253fff640 1 -- 172.21.15.5:0/4268328495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258032810 con 0x7f125c15dc70 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f126382a640 1 -- 172.21.15.5:0/4268328495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c15dc70 msgr2=0x7f125c161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f126382a640 1 --2- 172.21.15.5:0/4268328495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c15dc70 0x7f125c161850 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f12580097a0 tx=0x7f125802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f126382a640 1 -- 172.21.15.5:0/4268328495 shutdown_connections 2024-04-25T09:05:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.204+0000 7f126382a640 1 --2- 172.21.15.5:0/4268328495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c15dc70 0x7f125c161850 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.205+0000 7f126382a640 1 -- 172.21.15.5:0/4268328495 >> 172.21.15.5:0/4268328495 conn(0x7f125c0668f0 msgr2=0x7f125c066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.205+0000 7f126382a640 1 -- 172.21.15.5:0/4268328495 shutdown_connections 2024-04-25T09:05:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.205+0000 7f126382a640 1 -- 172.21.15.5:0/4268328495 wait complete. 2024-04-25T09:05:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 Processor -- start 2024-04-25T09:05:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 -- start start 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c0b94a0 0x7f125c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f125c0cef60 0x7f125c1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f125c15dc70 0x7f125c1f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0d11f0 con 0x7f125c0b94a0 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0d2d20 con 0x7f125c15dc70 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.206+0000 7f126382a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0d2ea0 con 0x7f125c0cef60 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c0b94a0 0x7f125c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c0b94a0 0x7f125c0cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46454/0 (socket says 172.21.15.5:46454) 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 -- 172.21.15.5:0/1452332428 learned_addr learned my addr 172.21.15.5:0/1452332428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f1260dc5640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f125c0cef60 0x7f125c1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 -- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f125c0cef60 msgr2=0x7f125c1f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f125c0cef60 0x7f125c1f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 -- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f125c15dc70 msgr2=0x7f125c1f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f125c15dc70 0x7f125c1f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 -- 172.21.15.5:0/1452332428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0cc610 con 0x7f125c0b94a0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f1260dc5640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f125c0cef60 0x7f125c1f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f12615c6640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c0b94a0 0x7f125c0cbca0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f12580097a0 tx=0x7f12580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f1251ffb640 1 -- 172.21.15.5:0/1452332428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258037040 con 0x7f125c0b94a0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f1251ffb640 1 -- 172.21.15.5:0/1452332428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1258004250 con 0x7f125c0b94a0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c0cc8f0 con 0x7f125c0b94a0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f1251ffb640 1 -- 172.21.15.5:0/1452332428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258032e20 con 0x7f125c0b94a0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.207+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c0cceb0 con 0x7f125c0b94a0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.208+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c04ef20 con 0x7f125c0b94a0 2024-04-25T09:05:58.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.209+0000 7f1251ffb640 1 -- 172.21.15.5:0/1452332428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1258030770 con 0x7f125c0b94a0 2024-04-25T09:05:58.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.209+0000 7f1251ffb640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f124006b4d0 0x7f124006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.209+0000 7f1251ffb640 1 -- 172.21.15.5:0/1452332428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f12580ab500 con 0x7f125c0b94a0 2024-04-25T09:05:58.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.209+0000 7f1260dc5640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f124006b4d0 0x7f124006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.210+0000 7f1260dc5640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f124006b4d0 0x7f124006d990 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f125c0c99e0 tx=0x7f124c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.213+0000 7f1251ffb640 1 -- 172.21.15.5:0/1452332428 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f125807a4a0 con 0x7f125c0b94a0 2024-04-25T09:05:58.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.429+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f125c0d1820 con 0x7f125c0b94a0 2024-04-25T09:05:58.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.430+0000 7f1251ffb640 1 -- 172.21.15.5:0/1452332428 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f1258079da0 con 0x7f125c0b94a0 2024-04-25T09:05:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:58.419 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:52.172731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":16,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:05:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 82 2024-04-25T09:05:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f124006b4d0 msgr2=0x7f124006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f124006b4d0 0x7f124006d990 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f125c0c99e0 tx=0x7f124c009040 comp rx=0 tx=0).stop 2024-04-25T09:05:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c0b94a0 msgr2=0x7f125c0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c0b94a0 0x7f125c0cbca0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f12580097a0 tx=0x7f12580046c0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 shutdown_connections 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f124006b4d0 0x7f124006d990 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f125c15dc70 0x7f125c1f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f125c0cef60 0x7f125c1f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 --2- 172.21.15.5:0/1452332428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f125c0b94a0 0x7f125c0cbca0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 >> 172.21.15.5:0/1452332428 conn(0x7f125c0668f0 msgr2=0x7f125c0c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 shutdown_connections 2024-04-25T09:05:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.432+0000 7f126382a640 1 -- 172.21.15.5:0/1452332428 wait complete. 2024-04-25T09:05:58.431 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:05:58.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:05:58.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.544+0000 7f13318b3640 1 Processor -- start 2024-04-25T09:05:58.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.544+0000 7f13318b3640 1 -- start start 2024-04-25T09:05:58.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.544+0000 7f13318b3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f132c0d3990 0x7f132c0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.544+0000 7f13318b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0b6f50 0x7f132c0b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.544+0000 7f13318b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c0b29c0 con 0x7f132c15e0a0 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.544+0000 7f13318b3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c0d4330 con 0x7f132c0d3990 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.544+0000 7f13318b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0d1460 con 0x7f132c0b6f50 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f1323fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f132c0d3990 0x7f132c0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f1323fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f132c0d3990 0x7f132c0d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46464/0 (socket says 172.21.15.5:46464) 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f1323fff640 1 -- 172.21.15.5:0/2390923618 learned_addr learned my addr 172.21.15.5:0/2390923618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f132b7fe640 1 --2- 172.21.15.5:0/2390923618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0b6f50 0x7f132c0b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f1323fff640 1 -- 172.21.15.5:0/2390923618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0b6f50 msgr2=0x7f132c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f1323fff640 1 --2- 172.21.15.5:0/2390923618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0b6f50 0x7f132c0b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f1323fff640 1 -- 172.21.15.5:0/2390923618 >> v1:172.21.15.80:6789/0 conn(0x7f132c15e0a0 legacy=0x7f132c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.545+0000 7f1323fff640 1 -- 172.21.15.5:0/2390923618 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0d2080 con 0x7f132c0d3990 2024-04-25T09:05:58.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f1323fff640 1 --2- 172.21.15.5:0/2390923618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0d3990 0x7f132c0d3df0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f1314009870 tx=0x7f131402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ab36a44a74625e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f132a7fc640 1 -- 172.21.15.5:0/2390923618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314037070 con 0x7f132c0d3990 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f132a7fc640 1 -- 172.21.15.5:0/2390923618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314032440 con 0x7f132c0d3990 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f132a7fc640 1 -- 172.21.15.5:0/2390923618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314032810 con 0x7f132c0d3990 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f13318b3640 1 -- 172.21.15.5:0/2390923618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0d3990 msgr2=0x7f132c0d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f13318b3640 1 --2- 172.21.15.5:0/2390923618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0d3990 0x7f132c0d3df0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f1314009870 tx=0x7f131402a210 comp rx=0 tx=0).stop 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f13318b3640 1 -- 172.21.15.5:0/2390923618 shutdown_connections 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f13318b3640 1 --2- 172.21.15.5:0/2390923618 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0b6f50 0x7f132c0b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f13318b3640 1 --2- 172.21.15.5:0/2390923618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0d3990 0x7f132c0d3df0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.546+0000 7f13318b3640 1 -- 172.21.15.5:0/2390923618 >> 172.21.15.5:0/2390923618 conn(0x7f132c0668f0 msgr2=0x7f132c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.547+0000 7f13318b3640 1 -- 172.21.15.5:0/2390923618 shutdown_connections 2024-04-25T09:05:58.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.547+0000 7f13318b3640 1 -- 172.21.15.5:0/2390923618 wait complete. 2024-04-25T09:05:58.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 Processor -- start 2024-04-25T09:05:58.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 -- start start 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0b6f50 0x7f132c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0d3990 0x7f132c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f132c15e0a0 0x7f132c0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0d2920 con 0x7f132c0b6f50 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0d2640 con 0x7f132c15e0a0 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.548+0000 7f13318b3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0d2c00 con 0x7f132c0d3990 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0b6f50 0x7f132c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0b6f50 0x7f132c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46474/0 (socket says 172.21.15.5:46474) 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 -- 172.21.15.5:0/978798520 learned_addr learned my addr 172.21.15.5:0/978798520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f1323fff640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0d3990 0x7f132c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132b7fe640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f132c15e0a0 0x7f132c0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 -- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0d3990 msgr2=0x7f132c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0d3990 0x7f132c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 -- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f132c15e0a0 msgr2=0x7f132c0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f132c15e0a0 0x7f132c0cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 -- 172.21.15.5:0/978798520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c15a8a0 con 0x7f132c0b6f50 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f132affd640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0b6f50 0x7f132c15a360 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b420 tx=0x7f131c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f1328ff9640 1 -- 172.21.15.5:0/978798520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c011830 con 0x7f132c0b6f50 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f1328ff9640 1 -- 172.21.15.5:0/978798520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c016070 con 0x7f132c0b6f50 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132c15f030 con 0x7f132c0b6f50 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f1328ff9640 1 -- 172.21.15.5:0/978798520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c011c10 con 0x7f132c0b6f50 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.549+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c15f5f0 con 0x7f132c0b6f50 2024-04-25T09:05:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.550+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c04ef20 con 0x7f132c0b6f50 2024-04-25T09:05:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.551+0000 7f1328ff9640 1 -- 172.21.15.5:0/978798520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f131c01b460 con 0x7f132c0b6f50 2024-04-25T09:05:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.551+0000 7f1328ff9640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f130c06b4d0 0x7f130c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.551+0000 7f1328ff9640 1 -- 172.21.15.5:0/978798520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f131c089c30 con 0x7f132c0b6f50 2024-04-25T09:05:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.551+0000 7f1323fff640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f130c06b4d0 0x7f130c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.552+0000 7f1323fff640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f130c06b4d0 0x7f130c06d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1314034000 tx=0x7f131402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.555+0000 7f1328ff9640 1 -- 172.21.15.5:0/978798520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f131c020020 con 0x7f132c0b6f50 2024-04-25T09:05:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.808+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f132c071750 con 0x7f132c0b6f50 2024-04-25T09:05:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.808+0000 7f1328ff9640 1 -- 172.21.15.5:0/978798520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1469 (secure 0 0 0) 0x7f131c0583d0 con 0x7f132c0b6f50 2024-04-25T09:05:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:58.797 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":578,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035390,"num_in_osds":8,"osd_in_since":1714035382,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078868214,"bytes_used":2576662528,"bytes_avail":770517450752,"bytes_total":773094113280,"read_bytes_sec":238116,"write_bytes_sec":283057,"read_op_per_sec":7,"write_op_per_sec":102},"fsmap":{"epoch":82,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9090}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-04-25T09:05:50.512632+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f130c06b4d0 msgr2=0x7f130c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f130c06b4d0 0x7f130c06d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1314034000 tx=0x7f131402e000 comp rx=0 tx=0).stop 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0b6f50 msgr2=0x7f132c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0b6f50 0x7f132c15a360 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b420 tx=0x7f131c00b8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 shutdown_connections 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f130c06b4d0 0x7f130c06d990 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f132c15e0a0 0x7f132c0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f132c0d3990 0x7f132c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 --2- 172.21.15.5:0/978798520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c0b6f50 0x7f132c15a360 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 >> 172.21.15.5:0/978798520 conn(0x7f132c0668f0 msgr2=0x7f132c0d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 shutdown_connections 2024-04-25T09:05:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:58.810+0000 7f13318b3640 1 -- 172.21.15.5:0/978798520 wait complete. 2024-04-25T09:05:58.809 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:05:58.809 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:05:58.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:58.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:58.901 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:05:58.901 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:05:58.901 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:58.916 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:05:58.916 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:58.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:59.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.122+0000 7f734b5c1640 1 Processor -- start 2024-04-25T09:05:59.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.123+0000 7f734b5c1640 1 -- start start 2024-04-25T09:05:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.123+0000 7f734b5c1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f734415de70 0x7f73440b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.123+0000 7f734b5c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73440b2cc0 0x7f73440b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.123+0000 7f734b5c1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73440d20e0 con 0x7f73440b7130 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.123+0000 7f734b5c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73440d2a10 con 0x7f73440b2cc0 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.123+0000 7f734b5c1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73440d23c0 con 0x7f734415de70 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f7348b5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73440b2cc0 0x7f73440b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f7349b5e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f73440b7130 0x7f73440ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58672/0 (socket says 172.21.15.5:58672) 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f7349b5e640 1 -- 172.21.15.5:0/1717060727 learned_addr learned my addr 172.21.15.5:0/1717060727 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f734935d640 1 --2- 172.21.15.5:0/1717060727 >> v2:172.21.15.80:3300/0 conn(0x7f734415de70 0x7f73440b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f7348b5c640 1 -- 172.21.15.5:0/1717060727 >> v2:172.21.15.80:3300/0 conn(0x7f734415de70 msgr2=0x7f73440b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f7348b5c640 1 --2- 172.21.15.5:0/1717060727 >> v2:172.21.15.80:3300/0 conn(0x7f734415de70 0x7f73440b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f7348b5c640 1 -- 172.21.15.5:0/1717060727 >> v1:172.21.15.5:6789/0 conn(0x7f73440b7130 legacy=0x7f73440ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.124+0000 7f7348b5c640 1 -- 172.21.15.5:0/1717060727 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440d26a0 con 0x7f73440b2cc0 2024-04-25T09:05:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f7348b5c640 1 --2- 172.21.15.5:0/1717060727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73440b2cc0 0x7f73440b6bf0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f73380097a0 tx=0x7f733802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14faab76d633cc92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f7343fff640 1 -- 172.21.15.5:0/1717060727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338037070 con 0x7f73440b2cc0 2024-04-25T09:05:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f7343fff640 1 -- 172.21.15.5:0/1717060727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733802ad60 con 0x7f73440b2cc0 2024-04-25T09:05:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f7343fff640 1 -- 172.21.15.5:0/1717060727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338032660 con 0x7f73440b2cc0 2024-04-25T09:05:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 -- 172.21.15.5:0/1717060727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73440b2cc0 msgr2=0x7f73440b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 --2- 172.21.15.5:0/1717060727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73440b2cc0 0x7f73440b6bf0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f73380097a0 tx=0x7f733802a0d0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 -- 172.21.15.5:0/1717060727 shutdown_connections 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 --2- 172.21.15.5:0/1717060727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73440b2cc0 0x7f73440b6bf0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 --2- 172.21.15.5:0/1717060727 >> v2:172.21.15.80:3300/0 conn(0x7f734415de70 0x7f73440b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 -- 172.21.15.5:0/1717060727 >> 172.21.15.5:0/1717060727 conn(0x7f734406b000 msgr2=0x7f734406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 -- 172.21.15.5:0/1717060727 shutdown_connections 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.125+0000 7f734b5c1640 1 -- 172.21.15.5:0/1717060727 wait complete. 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 Processor -- start 2024-04-25T09:05:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 -- start start 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f73440b2cc0 0x7f734414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73440b7130 0x7f73440caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f734415de70 0x7f73440b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73440cf080 con 0x7f734415de70 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73440cef00 con 0x7f73440b7130 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f734b5c1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73440cf200 con 0x7f73440b2cc0 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f7349b5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f734415de70 0x7f73440b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f7349b5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f734415de70 0x7f73440b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46486/0 (socket says 172.21.15.5:46486) 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.127+0000 7f7349b5e640 1 -- 172.21.15.5:0/2357223366 learned_addr learned my addr 172.21.15.5:0/2357223366 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7348b5c640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73440b7130 0x7f73440caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f734935d640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f73440b2cc0 0x7f734414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7349b5e640 1 -- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f73440b2cc0 msgr2=0x7f734414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7349b5e640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f73440b2cc0 0x7f734414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7349b5e640 1 -- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73440b7130 msgr2=0x7f73440caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7349b5e640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73440b7130 0x7f73440caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7349b5e640 1 -- 172.21.15.5:0/2357223366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440b35c0 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7349b5e640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f734415de70 0x7f73440b5960 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f733400caf0 tx=0x7f7334002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7341ffb640 1 -- 172.21.15.5:0/2357223366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334018070 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7341ffb640 1 -- 172.21.15.5:0/2357223366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733400a700 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73440cb560 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f7341ffb640 1 -- 172.21.15.5:0/2357223366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400ab30 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.128+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73440cbb20 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.129+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73440b3790 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.130+0000 7f7341ffb640 1 -- 172.21.15.5:0/2357223366 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f733401b070 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.130+0000 7f7341ffb640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f733006b4d0 0x7f733006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.130+0000 7f7341ffb640 1 -- 172.21.15.5:0/2357223366 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7334089a30 con 0x7f734415de70 2024-04-25T09:05:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.130+0000 7f734935d640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f733006b4d0 0x7f733006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.131+0000 7f734935d640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f733006b4d0 0x7f733006d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f733c006fd0 tx=0x7f733c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.134+0000 7f7341ffb640 1 -- 172.21.15.5:0/2357223366 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7334058820 con 0x7f734415de70 2024-04-25T09:05:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.316+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f734404ef20 con 0x7f734415de70 2024-04-25T09:05:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.317+0000 7f7341ffb640 1 -- 172.21.15.5:0/2357223366 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16761 (secure 0 0 0) 0x7f7334058120 con 0x7f734415de70 2024-04-25T09:05:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:05:59.306 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:50.147831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:11.572493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:12.274797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.e","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/778491752":"2024-04-26T09:05:50.147770+0000","172.21.15.5:6834/778491752":"2024-04-26T09:05:50.147770+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f733006b4d0 msgr2=0x7f733006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f733006b4d0 0x7f733006d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f733c006fd0 tx=0x7f733c008040 comp rx=0 tx=0).stop 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f734415de70 msgr2=0x7f73440b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f734415de70 0x7f73440b5960 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f733400caf0 tx=0x7f7334002080 comp rx=0 tx=0).stop 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 shutdown_connections 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f733006b4d0 0x7f733006d990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f734415de70 0x7f73440b5960 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73440b7130 0x7f73440caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 --2- 172.21.15.5:0/2357223366 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f73440b2cc0 0x7f734414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 >> 172.21.15.5:0/2357223366 conn(0x7f734406b000 msgr2=0x7f73440b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 shutdown_connections 2024-04-25T09:05:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.319+0000 7f734b5c1640 1 -- 172.21.15.5:0/2357223366 wait complete. 2024-04-25T09:05:59.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:05:11.572493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:12.274797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:59.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.437+0000 7f85f1322640 1 Processor -- start 2024-04-25T09:05:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.437+0000 7f85f1322640 1 -- start start 2024-04-25T09:05:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85f1322640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85ec15df70 0x7f85ec0b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85f1322640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0cef20 0x7f85ec0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85f1322640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec0d1ed0 con 0x7f85ec0d2f70 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85f1322640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec0d1c80 con 0x7f85ec15df70 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85f1322640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0d2ae0 con 0x7f85ec0cef20 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85ec15df70 0x7f85ec0b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85ec15df70 0x7f85ec0b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46496/0 (socket says 172.21.15.5:46496) 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eaffd640 1 -- 172.21.15.5:0/3316644861 learned_addr learned my addr 172.21.15.5:0/3316644861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eb7fe640 1 --2- 172.21.15.5:0/3316644861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0cef20 0x7f85ec0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eaffd640 1 -- 172.21.15.5:0/3316644861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0cef20 msgr2=0x7f85ec0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eaffd640 1 --2- 172.21.15.5:0/3316644861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0cef20 0x7f85ec0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eaffd640 1 -- 172.21.15.5:0/3316644861 >> v1:172.21.15.80:6789/0 conn(0x7f85ec0d2f70 legacy=0x7f85ec0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.438+0000 7f85eaffd640 1 -- 172.21.15.5:0/3316644861 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0d21b0 con 0x7f85ec15df70 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.439+0000 7f85eaffd640 1 --2- 172.21.15.5:0/3316644861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec15df70 0x7f85ec0b94d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009870 tx=0x7f85dc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fa182a42abd093 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.439+0000 7f85ea7fc640 1 -- 172.21.15.5:0/3316644861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc037070 con 0x7f85ec15df70 2024-04-25T09:05:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.439+0000 7f85ea7fc640 1 -- 172.21.15.5:0/3316644861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc02ae50 con 0x7f85ec15df70 2024-04-25T09:05:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.439+0000 7f85ea7fc640 1 -- 172.21.15.5:0/3316644861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc032860 con 0x7f85ec15df70 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 -- 172.21.15.5:0/3316644861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec15df70 msgr2=0x7f85ec0b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 --2- 172.21.15.5:0/3316644861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec15df70 0x7f85ec0b94d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009870 tx=0x7f85dc02a300 comp rx=0 tx=0).stop 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 -- 172.21.15.5:0/3316644861 shutdown_connections 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 --2- 172.21.15.5:0/3316644861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0cef20 0x7f85ec0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 --2- 172.21.15.5:0/3316644861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec15df70 0x7f85ec0b94d0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 -- 172.21.15.5:0/3316644861 >> 172.21.15.5:0/3316644861 conn(0x7f85ec06b000 msgr2=0x7f85ec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 -- 172.21.15.5:0/3316644861 shutdown_connections 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.440+0000 7f85f1322640 1 -- 172.21.15.5:0/3316644861 wait complete. 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.441+0000 7f85f1322640 1 Processor -- start 2024-04-25T09:05:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.441+0000 7f85f1322640 1 -- start start 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85f1322640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85ec0cef20 0x7f85ec0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85f1322640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0d2f70 0x7f85ec152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85f1322640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec0ccc80 0x7f85ec145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85f1322640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0b9a10 con 0x7f85ec0ccc80 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85f1322640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0d2770 con 0x7f85ec0cef20 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85f1322640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0d3720 con 0x7f85ec0d2f70 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec0ccc80 0x7f85ec145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec0ccc80 0x7f85ec145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46506/0 (socket says 172.21.15.5:46506) 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 -- 172.21.15.5:0/1053872553 learned_addr learned my addr 172.21.15.5:0/1053872553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eaffd640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85ec0cef20 0x7f85ec0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 -- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0d2f70 msgr2=0x7f85ec152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85e3fff640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0d2f70 0x7f85ec152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0d2f70 0x7f85ec152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 -- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85ec0cef20 msgr2=0x7f85ec0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85ec0cef20 0x7f85ec0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 -- 172.21.15.5:0/1053872553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec1f4160 con 0x7f85ec0ccc80 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eaffd640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85ec0cef20 0x7f85ec0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85e3fff640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0d2f70 0x7f85ec152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85eb7fe640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec0ccc80 0x7f85ec145720 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009d30 tx=0x7f85e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.442+0000 7f85e37fe640 1 -- 172.21.15.5:0/1053872553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4018020 con 0x7f85ec0ccc80 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.443+0000 7f85e37fe640 1 -- 172.21.15.5:0/1053872553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4014480 con 0x7f85ec0ccc80 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.443+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec0cbbe0 con 0x7f85ec0ccc80 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.443+0000 7f85e37fe640 1 -- 172.21.15.5:0/1053872553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4014870 con 0x7f85ec0ccc80 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.443+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec0cc1a0 con 0x7f85ec0ccc80 2024-04-25T09:05:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.444+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec04ef20 con 0x7f85ec0ccc80 2024-04-25T09:05:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.444+0000 7f85e37fe640 1 -- 172.21.15.5:0/1053872553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85e4005d10 con 0x7f85ec0ccc80 2024-04-25T09:05:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.444+0000 7f85e37fe640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85cc06b4d0 0x7f85cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.445+0000 7f85e37fe640 1 -- 172.21.15.5:0/1053872553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f85e408ad60 con 0x7f85ec0ccc80 2024-04-25T09:05:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.445+0000 7f85eaffd640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85cc06b4d0 0x7f85cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.445+0000 7f85eaffd640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85cc06b4d0 0x7f85cc06d990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f85dc034000 tx=0x7f85dc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.449+0000 7f85e37fe640 1 -- 172.21.15.5:0/1053872553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85e4022070 con 0x7f85ec0ccc80 2024-04-25T09:05:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.632+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85ec0cfae0 con 0x7f85ec0ccc80 2024-04-25T09:05:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.633+0000 7f85e37fe640 1 -- 172.21.15.5:0/1053872553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85e4010040 con 0x7f85ec0ccc80 2024-04-25T09:05:59.621 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:05:59.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.634+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85cc06b4d0 msgr2=0x7f85cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.634+0000 7f85f1322640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85cc06b4d0 0x7f85cc06d990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f85dc034000 tx=0x7f85dc02e000 comp rx=0 tx=0).stop 2024-04-25T09:05:59.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.634+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec0ccc80 msgr2=0x7f85ec145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.634+0000 7f85f1322640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec0ccc80 0x7f85ec145720 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009d30 tx=0x7f85e400c490 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 shutdown_connections 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f85cc06b4d0 0x7f85cc06d990 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ec0ccc80 0x7f85ec145720 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f85ec0d2f70 0x7f85ec152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 --2- 172.21.15.5:0/1053872553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85ec0cef20 0x7f85ec0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 >> 172.21.15.5:0/1053872553 conn(0x7f85ec06b000 msgr2=0x7f85ec15ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 shutdown_connections 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.635+0000 7f85f1322640 1 -- 172.21.15.5:0/1053872553 wait complete. 2024-04-25T09:05:59.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:05:59.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.749+0000 7f9b2c083640 1 Processor -- start 2024-04-25T09:05:59.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.749+0000 7f9b2c083640 1 -- start start 2024-04-25T09:05:59.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2c083640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b240b2850 0x7f9b240cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2c083640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b24072690 con 0x7f9b240ae690 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2c083640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b240b2ca0 con 0x7f9b240b4550 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2c083640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b24071ff0 con 0x7f9b240b2850 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2a620640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b240b2850 0x7f9b240cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b29e1f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9b240ae690 0x7f9b240aea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58680/0 (socket says 172.21.15.5:58680) 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b29e1f640 1 -- 172.21.15.5:0/3833486658 learned_addr learned my addr 172.21.15.5:0/3833486658 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2a620640 1 -- 172.21.15.5:0/3833486658 >> v1:172.21.15.80:6789/0 conn(0x7f9b240b4550 legacy=0x7f9b240ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2a620640 1 -- 172.21.15.5:0/3833486658 >> v1:172.21.15.5:6789/0 conn(0x7f9b240ae690 legacy=0x7f9b240aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b2a620640 1 -- 172.21.15.5:0/3833486658 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240b2f50 con 0x7f9b240b2850 2024-04-25T09:05:59.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.750+0000 7f9b28e1d640 1 -- 172.21.15.5:0/3833486658 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607936574 0 0) 0x7f9b24072690 con 0x7f9b240ae690 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.751+0000 7f9b2a620640 1 --2- 172.21.15.5:0/3833486658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240cefd0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009d90 tx=0x7f9b1c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f914f905bee5ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.751+0000 7f9b28e1d640 1 -- 172.21.15.5:0/3833486658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c031600 con 0x7f9b240b2850 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.751+0000 7f9b28e1d640 1 -- 172.21.15.5:0/3833486658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0317a0 con 0x7f9b240b2850 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.751+0000 7f9b28e1d640 1 -- 172.21.15.5:0/3833486658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c031b70 con 0x7f9b240b2850 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.751+0000 7f9b2c083640 1 -- 172.21.15.5:0/3833486658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 msgr2=0x7f9b240cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.751+0000 7f9b2c083640 1 --2- 172.21.15.5:0/3833486658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240cefd0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009d90 tx=0x7f9b1c02a610 comp rx=0 tx=0).stop 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.752+0000 7f9b2c083640 1 -- 172.21.15.5:0/3833486658 shutdown_connections 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.752+0000 7f9b2c083640 1 --2- 172.21.15.5:0/3833486658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240cefd0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.752+0000 7f9b2c083640 1 -- 172.21.15.5:0/3833486658 >> 172.21.15.5:0/3833486658 conn(0x7f9b240b1550 msgr2=0x7f9b240b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.752+0000 7f9b2c083640 1 -- 172.21.15.5:0/3833486658 shutdown_connections 2024-04-25T09:05:59.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.752+0000 7f9b2c083640 1 -- 172.21.15.5:0/3833486658 wait complete. 2024-04-25T09:05:59.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 Processor -- start 2024-04-25T09:05:59.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 -- start start 2024-04-25T09:05:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b240ae690 0x7f9b2414ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b240b4550 0x7f9b240adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240cd990 con 0x7f9b240b2850 2024-04-25T09:05:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240cd6b0 con 0x7f9b240b4550 2024-04-25T09:05:59.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.753+0000 7f9b2c083640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240cdc70 con 0x7f9b240ae690 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46530/0 (socket says 172.21.15.5:46530) 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 -- 172.21.15.5:0/175310227 learned_addr learned my addr 172.21.15.5:0/175310227 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b29e1f640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b240ae690 0x7f9b2414ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2a620640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b240b4550 0x7f9b240adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 -- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b240ae690 msgr2=0x7f9b2414ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b240ae690 0x7f9b2414ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 -- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b240b4550 msgr2=0x7f9b240adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b240b4550 0x7f9b240adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 -- 172.21.15.5:0/175310227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b241482e0 con 0x7f9b240b2850 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2961e640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240ab560 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b420 tx=0x7f9b1400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b1a7fc640 1 -- 172.21.15.5:0/175310227 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011830 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b1a7fc640 1 -- 172.21.15.5:0/175310227 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14016070 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b241485c0 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b1a7fc640 1 -- 172.21.15.5:0/175310227 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011c10 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.754+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b24148b80 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.755+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2404ef20 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.756+0000 7f9b1a7fc640 1 -- 172.21.15.5:0/175310227 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b1401b460 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.756+0000 7f9b1a7fc640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b0806b4d0 0x7f9b0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.756+0000 7f9b1a7fc640 1 -- 172.21.15.5:0/175310227 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9b14089d40 con 0x7f9b240b2850 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.756+0000 7f9b29e1f640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b0806b4d0 0x7f9b0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.757+0000 7f9b29e1f640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b0806b4d0 0x7f9b0806d990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000f60 tx=0x7f9b20007b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.760+0000 7f9b1a7fc640 1 -- 172.21.15.5:0/175310227 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b14020020 con 0x7f9b240b2850 2024-04-25T09:05:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.937+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b2406e640 con 0x7f9b240b2850 2024-04-25T09:05:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.938+0000 7f9b1a7fc640 1 -- 172.21.15.5:0/175310227 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v128) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b14058b30 con 0x7f9b240b2850 2024-04-25T09:05:59.926 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:05:59.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b0806b4d0 msgr2=0x7f9b0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b0806b4d0 0x7f9b0806d990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000f60 tx=0x7f9b20007b50 comp rx=0 tx=0).stop 2024-04-25T09:05:59.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 msgr2=0x7f9b240ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240ab560 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b420 tx=0x7f9b1400b8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 shutdown_connections 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9b0806b4d0 0x7f9b0806d990 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b240b4550 0x7f9b240adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b240b2850 0x7f9b240ab560 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 --2- 172.21.15.5:0/175310227 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b240ae690 0x7f9b2414ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.939+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 >> 172.21.15.5:0/175310227 conn(0x7f9b240b1550 msgr2=0x7f9b2406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.940+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 shutdown_connections 2024-04-25T09:05:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:05:59.940+0000 7f9b2c083640 1 -- 172.21.15.5:0/175310227 wait complete. 2024-04-25T09:05:59.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:00.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.054+0000 7fdac5e10640 1 Processor -- start 2024-04-25T09:06:00.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.054+0000 7fdac5e10640 1 -- start start 2024-04-25T09:06:00.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdac5e10640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac00cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdac5e10640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac006f020 con 0x7fdac00cf1a0 2024-04-25T09:06:00.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdac5e10640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac0160440 con 0x7fdac015e3b0 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdac5e10640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac015c030 con 0x7fdac00cd240 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdabeffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdac00cf1a0 0x7fdac015f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58692/0 (socket says 172.21.15.5:58692) 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdabeffd640 1 -- 172.21.15.5:0/3997293560 learned_addr learned my addr 172.21.15.5:0/3997293560 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdabf7fe640 1 --2- 172.21.15.5:0/3997293560 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac00cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735098598 0 0) 0x7fdac006f020 con 0x7fdac00cf1a0 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.055+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa8003520 con 0x7fdac00cf1a0 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.056+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487414755 0 0) 0x7fdac0160440 con 0x7fdac015e3b0 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.056+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac006f020 con 0x7fdac015e3b0 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.056+0000 7fdabf7fe640 1 -- 172.21.15.5:0/3997293560 >> v1:172.21.15.80:6789/0 conn(0x7fdac015e3b0 legacy=0x7fdac015fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.056+0000 7fdabf7fe640 1 -- 172.21.15.5:0/3997293560 >> v1:172.21.15.5:6789/0 conn(0x7fdac00cf1a0 legacy=0x7fdac015f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.056+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037762737 0 0) 0x7fdaa8003520 con 0x7fdac00cf1a0 2024-04-25T09:06:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.056+0000 7fdabf7fe640 1 -- 172.21.15.5:0/3997293560 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00b5e20 con 0x7fdac00cd240 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.056+0000 7fdabf7fe640 1 --2- 172.21.15.5:0/3997293560 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac00cd620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdab00097d0 tx=0x7fdab002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b71663186130f793 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0037070 con 0x7fdac00cd240 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab002ac30 con 0x7fdac00cd240 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdabe7fc640 1 -- 172.21.15.5:0/3997293560 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4001670 con 0x7fdac00cd240 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdac5e10640 1 -- 172.21.15.5:0/3997293560 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 msgr2=0x7fdac00cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdac5e10640 1 --2- 172.21.15.5:0/3997293560 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac00cd620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdab00097d0 tx=0x7fdab002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdac5e10640 1 -- 172.21.15.5:0/3997293560 shutdown_connections 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdac5e10640 1 --2- 172.21.15.5:0/3997293560 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac00cd620 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdac5e10640 1 -- 172.21.15.5:0/3997293560 >> 172.21.15.5:0/3997293560 conn(0x7fdac006c930 msgr2=0x7fdac006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdac5e10640 1 -- 172.21.15.5:0/3997293560 shutdown_connections 2024-04-25T09:06:00.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.057+0000 7fdac5e10640 1 -- 172.21.15.5:0/3997293560 wait complete. 2024-04-25T09:06:00.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.058+0000 7fdac5e10640 1 Processor -- start 2024-04-25T09:06:00.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdac5e10640 1 -- start start 2024-04-25T09:06:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdac5e10640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdac5e10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdac00cf1a0 0x7fdac01e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdac5e10640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac015e3b0 0x7fdac0141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdac5e10640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac015c560 con 0x7fdac00cf1a0 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdac5e10640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac015c280 con 0x7fdac015e3b0 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdac5e10640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac015c840 con 0x7fdac00cd240 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdabeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdac00cf1a0 0x7fdac01e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.059+0000 7fdabeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdac00cf1a0 0x7fdac01e78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46546/0 (socket says 172.21.15.5:46546) 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabeffd640 1 -- 172.21.15.5:0/2099920228 learned_addr learned my addr 172.21.15.5:0/2099920228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabffff640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac015e3b0 0x7fdac0141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabeffd640 1 -- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 msgr2=0x7fdac015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabeffd640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabeffd640 1 -- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac015e3b0 msgr2=0x7fdac0141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabeffd640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac015e3b0 0x7fdac0141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabeffd640 1 -- 172.21.15.5:0/2099920228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0157c80 con 0x7fdac00cf1a0 2024-04-25T09:06:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdabeffd640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdac00cf1a0 0x7fdac01e78a0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fdab4000fd0 tx=0x7fdab400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdaa7fff640 1 -- 172.21.15.5:0/2099920228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4017070 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdaa7fff640 1 -- 172.21.15.5:0/2099920228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4005ad0 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac0157f60 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdaa7fff640 1 -- 172.21.15.5:0/2099920228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4007070 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.060+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac0158800 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.061+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac0158a00 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.062+0000 7fdaa7fff640 1 -- 172.21.15.5:0/2099920228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdab401a070 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.062+0000 7fdaa7fff640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdaac06b4d0 0x7fdaac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.062+0000 7fdaa7fff640 1 -- 172.21.15.5:0/2099920228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fdab4089710 con 0x7fdac00cf1a0 2024-04-25T09:06:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.062+0000 7fdabf7fe640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdaac06b4d0 0x7fdaac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.063+0000 7fdabf7fe640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdaac06b4d0 0x7fdaac06d990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdab0034000 tx=0x7fdab002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.066+0000 7fdaa7fff640 1 -- 172.21.15.5:0/2099920228 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdac0158a00 con 0x7fdac00cf1a0 2024-04-25T09:06:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.247+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdac004ef20 con 0x7fdac00cf1a0 2024-04-25T09:06:00.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.247+0000 7fdaa7fff640 1 -- 172.21.15.5:0/2099920228 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v128) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdab4057eb0 con 0x7fdac00cf1a0 2024-04-25T09:06:00.236 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:06:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdaac06b4d0 msgr2=0x7fdaac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdaac06b4d0 0x7fdaac06d990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdab0034000 tx=0x7fdab002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdac00cf1a0 msgr2=0x7fdac01e78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdac00cf1a0 0x7fdac01e78a0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fdab4000fd0 tx=0x7fdab400cbe0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 shutdown_connections 2024-04-25T09:06:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdaac06b4d0 0x7fdaac06d990 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac015e3b0 0x7fdac0141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdac00cf1a0 0x7fdac01e78a0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 --2- 172.21.15.5:0/2099920228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdac00cd240 0x7fdac015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 >> 172.21.15.5:0/2099920228 conn(0x7fdac006c930 msgr2=0x7fdac0154680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 shutdown_connections 2024-04-25T09:06:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.249+0000 7fdac5e10640 1 -- 172.21.15.5:0/2099920228 wait complete. 2024-04-25T09:06:00.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:06:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.362+0000 7f261803f640 1 Processor -- start 2024-04-25T09:06:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.362+0000 7f261803f640 1 -- start start 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f261803f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f261015e0a0 0x7f26100d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f261803f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f26100d3df0 0x7f26100cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f261803f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26100b7f60 con 0x7f26100d3990 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f261803f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100b29c0 con 0x7f261015e0a0 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f261803f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100d2080 con 0x7f26100d3df0 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f2615ddb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f261015e0a0 0x7f26100d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f26155da640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26100d3990 0x7f26100ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58708/0 (socket says 172.21.15.5:58708) 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.363+0000 7f26155da640 1 -- 172.21.15.5:0/2906419901 learned_addr learned my addr 172.21.15.5:0/2906419901 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f26165dc640 1 --2- 172.21.15.5:0/2906419901 >> v2:172.21.15.80:3300/0 conn(0x7f26100d3df0 0x7f26100cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2615ddb640 1 -- 172.21.15.5:0/2906419901 >> v2:172.21.15.80:3300/0 conn(0x7f26100d3df0 msgr2=0x7f26100cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2615ddb640 1 --2- 172.21.15.5:0/2906419901 >> v2:172.21.15.80:3300/0 conn(0x7f26100d3df0 0x7f26100cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2615ddb640 1 -- 172.21.15.5:0/2906419901 >> v1:172.21.15.5:6789/0 conn(0x7f26100d3990 legacy=0x7f26100ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2614dd9640 1 -- 172.21.15.5:0/2906419901 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922369028 0 0) 0x7f26100b7f60 con 0x7f26100d3990 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2615ddb640 1 -- 172.21.15.5:0/2906419901 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100d2360 con 0x7f261015e0a0 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f26165dc640 1 --2- 172.21.15.5:0/2906419901 >> v2:172.21.15.80:3300/0 conn(0x7f26100d3df0 0x7f26100cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2615ddb640 1 --2- 172.21.15.5:0/2906419901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26100d0d50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f26100b34f0 tx=0x7f260802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791dcb2a41953e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2614dd9640 1 -- 172.21.15.5:0/2906419901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608037070 con 0x7f261015e0a0 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2614dd9640 1 -- 172.21.15.5:0/2906419901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608032440 con 0x7f261015e0a0 2024-04-25T09:06:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.364+0000 7f2614dd9640 1 -- 172.21.15.5:0/2906419901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608032810 con 0x7f261015e0a0 2024-04-25T09:06:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 -- 172.21.15.5:0/2906419901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 msgr2=0x7f26100d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 --2- 172.21.15.5:0/2906419901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26100d0d50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f26100b34f0 tx=0x7f260802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 -- 172.21.15.5:0/2906419901 shutdown_connections 2024-04-25T09:06:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 --2- 172.21.15.5:0/2906419901 >> v2:172.21.15.80:3300/0 conn(0x7f26100d3df0 0x7f26100cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 --2- 172.21.15.5:0/2906419901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26100d0d50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 -- 172.21.15.5:0/2906419901 >> 172.21.15.5:0/2906419901 conn(0x7f26100668f0 msgr2=0x7f2610066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 -- 172.21.15.5:0/2906419901 shutdown_connections 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.365+0000 7f261803f640 1 -- 172.21.15.5:0/2906419901 wait complete. 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.366+0000 7f261803f640 1 Processor -- start 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f261803f640 1 -- start start 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f261803f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26100d3990 0x7f2610150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f261803f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26100d3df0 0x7f26100aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f261803f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26101f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f261803f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100d2c00 con 0x7f261015e0a0 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f261803f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100d2920 con 0x7f26100d3df0 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f261803f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26100d4280 con 0x7f26100d3990 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f26165dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26101f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f26165dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26101f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46576/0 (socket says 172.21.15.5:46576) 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.367+0000 7f26165dc640 1 -- 172.21.15.5:0/848431587 learned_addr learned my addr 172.21.15.5:0/848431587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f2615ddb640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26100d3990 0x7f2610150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f26155da640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26100d3df0 0x7f26100aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f26165dc640 1 -- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26100d3990 msgr2=0x7f2610150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f26165dc640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26100d3990 0x7f2610150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f26165dc640 1 -- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26100d3df0 msgr2=0x7f26100aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f26165dc640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26100d3df0 0x7f26100aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f26165dc640 1 -- 172.21.15.5:0/848431587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2610151350 con 0x7f261015e0a0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f2615ddb640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26100d3990 0x7f2610150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f26165dc640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26101f3cd0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f260000cd80 tx=0x7f260000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f260e7fc640 1 -- 172.21.15.5:0/848431587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260000f680 con 0x7f261015e0a0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f260e7fc640 1 -- 172.21.15.5:0/848431587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260000f840 con 0x7f261015e0a0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26100ce270 con 0x7f261015e0a0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f260e7fc640 1 -- 172.21.15.5:0/848431587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260000fc30 con 0x7f261015e0a0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.368+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26100ce830 con 0x7f261015e0a0 2024-04-25T09:06:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.369+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261004ef20 con 0x7f261015e0a0 2024-04-25T09:06:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.370+0000 7f260e7fc640 1 -- 172.21.15.5:0/848431587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f26000213f0 con 0x7f261015e0a0 2024-04-25T09:06:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.370+0000 7f260e7fc640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25fc06b4d0 0x7f25fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.370+0000 7f260e7fc640 1 -- 172.21.15.5:0/848431587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f260008b060 con 0x7f261015e0a0 2024-04-25T09:06:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.370+0000 7f2615ddb640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25fc06b4d0 0x7f25fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.371+0000 7f2615ddb640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25fc06b4d0 0x7f25fc06d990 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2608034000 tx=0x7f260802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.374+0000 7f260e7fc640 1 -- 172.21.15.5:0/848431587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2600014030 con 0x7f261015e0a0 2024-04-25T09:06:00.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.568+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26100d06b0 con 0x7f261015e0a0 2024-04-25T09:06:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.568+0000 7f260e7fc640 1 -- 172.21.15.5:0/848431587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v128) v1 ==== 80+0+118 (secure 0 0 0) 0x7f2600059e50 con 0x7f261015e0a0 2024-04-25T09:06:00.557 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6835/778491752 2024-04-26T09:05:50.147770+0000 2024-04-25T09:06:00.557 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6834/778491752 2024-04-26T09:05:50.147770+0000 2024-04-25T09:06:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:listed 2 entries 2024-04-25T09:06:00.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25fc06b4d0 msgr2=0x7f25fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25fc06b4d0 0x7f25fc06d990 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2608034000 tx=0x7f260802e000 comp rx=0 tx=0).stop 2024-04-25T09:06:00.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 msgr2=0x7f26101f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26101f3cd0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f260000cd80 tx=0x7f260000a650 comp rx=0 tx=0).stop 2024-04-25T09:06:00.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 shutdown_connections 2024-04-25T09:06:00.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f25fc06b4d0 0x7f25fc06d990 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f261015e0a0 0x7f26101f3cd0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26100d3df0 0x7f26100aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 --2- 172.21.15.5:0/848431587 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f26100d3990 0x7f2610150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 >> 172.21.15.5:0/848431587 conn(0x7f26100668f0 msgr2=0x7f261015d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 shutdown_connections 2024-04-25T09:06:00.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.570+0000 7f261803f640 1 -- 172.21.15.5:0/848431587 wait complete. 2024-04-25T09:06:00.570 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:06:00.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:00.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:00.597 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:06:00.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:00.598 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:06:00.653 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:00.654 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:00.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:00.672 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:00.672 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:00.709 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:00.710 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:00.710 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:00.730 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:00.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.863+0000 7fd04219e640 1 Processor -- start 2024-04-25T09:06:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.863+0000 7fd04219e640 1 -- start start 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.863+0000 7fd04219e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 0x7fd03c06b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.863+0000 7fd04219e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03c15ef10 con 0x7fd03c06bb30 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.863+0000 7fd04219e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03c15ff50 con 0x7fd03c0cea80 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.863+0000 7fd04219e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0cfd60 con 0x7fd03c06adf0 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd03c06bb30 0x7fd03c0d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45124/0 (socket says 172.21.15.5:45124) 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03bfff640 1 -- 172.21.15.5:0/1767118372 learned_addr learned my addr 172.21.15.5:0/1767118372 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03affd640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 0x7fd03c06b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257127759 0 0) 0x7fd03c15ef10 con 0x7fd03c06bb30 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd024003520 con 0x7fd03c06bb30 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568785363 0 0) 0x7fd03c15ff50 con 0x7fd03c0cea80 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd03c15ef10 con 0x7fd03c0cea80 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 157754091 0 0) 0x7fd024003520 con 0x7fd03c06bb30 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 msgr2=0x7fd03c06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 0x7fd03c06b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 >> v1:172.21.15.80:6789/0 conn(0x7fd03c0cea80 legacy=0x7fd03c15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c15f1a0 con 0x7fd03c06bb30 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fd0340019f0 con 0x7fd03c06bb30 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 >> v1:172.21.15.5:6789/0 conn(0x7fd03c06bb30 legacy=0x7fd03c0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 0x7fd024003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0240040d0 0x7fd024004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd024004d40 0x7fd0240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02400ba70 con 0x7fd0240040d0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02400bc20 con 0x7fd024004d40 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02400be20 con 0x7fd03c06adf0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03affd640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0240040d0 0x7fd024004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03b7fe640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 0x7fd024003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.864+0000 7fd03bfff640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd024004d40 0x7fd0240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03affd640 1 -- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 msgr2=0x7fd024003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03affd640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 0x7fd024003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03affd640 1 -- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd024004d40 msgr2=0x7fd0240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03affd640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd024004d40 0x7fd0240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03affd640 1 -- 172.21.15.5:0/1767118372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd024003520 con 0x7fd0240040d0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03b7fe640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd03c06adf0 0x7fd024003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03affd640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0240040d0 0x7fd024004800 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd030009ac0 tx=0x7fd024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ff90385aaea913 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.865+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030036070 con 0x7fd0240040d0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030031400 con 0x7fd0240040d0 2024-04-25T09:06:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd03a7fc640 1 -- 172.21.15.5:0/1767118372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030009690 con 0x7fd0240040d0 2024-04-25T09:06:00.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd04219e640 1 -- 172.21.15.5:0/1767118372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0240040d0 msgr2=0x7fd024004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd04219e640 1 --2- 172.21.15.5:0/1767118372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0240040d0 0x7fd024004800 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd030009ac0 tx=0x7fd024005830 comp rx=0 tx=0).stop 2024-04-25T09:06:00.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd03bfff640 1 -- 172.21.15.5:0/1767118372 reap_dead start 2024-04-25T09:06:00.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd04219e640 1 -- 172.21.15.5:0/1767118372 shutdown_connections 2024-04-25T09:06:00.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd04219e640 1 -- 172.21.15.5:0/1767118372 >> 172.21.15.5:0/1767118372 conn(0x7fd03c0d19f0 msgr2=0x7fd03c0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd04219e640 1 -- 172.21.15.5:0/1767118372 shutdown_connections 2024-04-25T09:06:00.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.866+0000 7fd04219e640 1 -- 172.21.15.5:0/1767118372 wait complete. 2024-04-25T09:06:00.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.867+0000 7fd04219e640 1 Processor -- start 2024-04-25T09:06:00.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.867+0000 7fd04219e640 1 -- start start 2024-04-25T09:06:00.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd04219e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd0240040d0 0x7fd03c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd04219e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd03c0b0ec0 0x7fd03c156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd04219e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0b4550 0x7fd03c1f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd04219e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c15f480 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd04219e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c06bf80 con 0x7fd03c0b4550 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd04219e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0d0270 con 0x7fd0240040d0 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd03affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd03c0b0ec0 0x7fd03c156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd03affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd03c0b0ec0 0x7fd03c156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57542/0 (socket says 172.21.15.5:57542) 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd03affd640 1 -- 172.21.15.5:0/654458273 learned_addr learned my addr 172.21.15.5:0/654458273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd03b7fe640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd0240040d0 0x7fd03c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.868+0000 7fd03bfff640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0b4550 0x7fd03c1f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd03affd640 1 -- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd0240040d0 msgr2=0x7fd03c0c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd03affd640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd0240040d0 0x7fd03c0c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd03affd640 1 -- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0b4550 msgr2=0x7fd03c1f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd03affd640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0b4550 0x7fd03c1f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd03affd640 1 -- 172.21.15.5:0/654458273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c0b16f0 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd03affd640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd03c0b0ec0 0x7fd03c156e50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd030009be0 tx=0x7fd030004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd023fff640 1 -- 172.21.15.5:0/654458273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030040020 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd023fff640 1 -- 172.21.15.5:0/654458273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030003c60 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c0b19d0 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd023fff640 1 -- 172.21.15.5:0/654458273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030036040 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.869+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03c0b1f90 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.870+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c04ef20 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.871+0000 7fd023fff640 1 -- 172.21.15.5:0/654458273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd030043020 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.871+0000 7fd023fff640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd02806b4d0 0x7fd02806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.871+0000 7fd023fff640 1 -- 172.21.15.5:0/654458273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd0300aa180 con 0x7fd03c0b0ec0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.871+0000 7fd03b7fe640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd02806b4d0 0x7fd02806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.872+0000 7fd03b7fe640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd02806b4d0 0x7fd02806d990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd02c007fd0 tx=0x7fd02c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:00.875+0000 7fd023fff640 1 -- 172.21.15.5:0/654458273 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd03004a070 con 0x7fd03c0b0ec0 2024-04-25T09:06:01.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.098+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd03c0b7970 con 0x7fd03c0b0ec0 2024-04-25T09:06:01.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.099+0000 7fd023fff640 1 -- 172.21.15.5:0/654458273 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4149 (secure 0 0 0) 0x7fd0300044e0 con 0x7fd03c0b0ec0 2024-04-25T09:06:01.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:01.088 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:52.172731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":16,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:06:01.088 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 82 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd02806b4d0 msgr2=0x7fd02806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd02806b4d0 0x7fd02806d990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd02c007fd0 tx=0x7fd02c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd03c0b0ec0 msgr2=0x7fd03c156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd03c0b0ec0 0x7fd03c156e50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd030009be0 tx=0x7fd030004730 comp rx=0 tx=0).stop 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 shutdown_connections 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd02806b4d0 0x7fd02806d990 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0b4550 0x7fd03c1f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd03c0b0ec0 0x7fd03c156e50 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 --2- 172.21.15.5:0/654458273 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd0240040d0 0x7fd03c0c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 >> 172.21.15.5:0/654458273 conn(0x7fd03c0d19f0 msgr2=0x7fd03c0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 shutdown_connections 2024-04-25T09:06:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.101+0000 7fd04219e640 1 -- 172.21.15.5:0/654458273 wait complete. 2024-04-25T09:06:01.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.214+0000 7fb485a58640 1 Processor -- start 2024-04-25T09:06:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.214+0000 7fb485a58640 1 -- start start 2024-04-25T09:06:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb485a58640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb480161fe0 0x7fb4800b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb485a58640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800b5740 con 0x7fb4800b3e10 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb485a58640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800b5a20 con 0x7fb4800668f0 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb485a58640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800b5d00 con 0x7fb480161fe0 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb477fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb480161fe0 0x7fb4800b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb47f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4800b3e10 0x7fb48006d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45128/0 (socket says 172.21.15.5:45128) 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb477fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb480161fe0 0x7fb4800b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57548/0 (socket says 172.21.15.5:57548) 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb47f7fe640 1 -- 172.21.15.5:0/3208496498 learned_addr learned my addr 172.21.15.5:0/3208496498 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb477fff640 1 -- 172.21.15.5:0/3208496498 >> v1:172.21.15.80:6789/0 conn(0x7fb4800668f0 legacy=0x7fb480066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb477fff640 1 -- 172.21.15.5:0/3208496498 >> v1:172.21.15.5:6789/0 conn(0x7fb4800b3e10 legacy=0x7fb48006d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb47e7fc640 1 -- 172.21.15.5:0/3208496498 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166084740 0 0) 0x7fb4800b5740 con 0x7fb4800b3e10 2024-04-25T09:06:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.215+0000 7fb477fff640 1 -- 172.21.15.5:0/3208496498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4801617e0 con 0x7fb480161fe0 2024-04-25T09:06:01.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.216+0000 7fb477fff640 1 --2- 172.21.15.5:0/3208496498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb480161fe0 0x7fb4800b38d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fb4680097a0 tx=0x7fb46802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c153e88d5244b68d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.216+0000 7fb47e7fc640 1 -- 172.21.15.5:0/3208496498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468037070 con 0x7fb480161fe0 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.216+0000 7fb47e7fc640 1 -- 172.21.15.5:0/3208496498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468032440 con 0x7fb480161fe0 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.216+0000 7fb47e7fc640 1 -- 172.21.15.5:0/3208496498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468032810 con 0x7fb480161fe0 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.217+0000 7fb485a58640 1 -- 172.21.15.5:0/3208496498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb480161fe0 msgr2=0x7fb4800b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.217+0000 7fb485a58640 1 --2- 172.21.15.5:0/3208496498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb480161fe0 0x7fb4800b38d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fb4680097a0 tx=0x7fb46802a230 comp rx=0 tx=0).stop 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.217+0000 7fb485a58640 1 -- 172.21.15.5:0/3208496498 shutdown_connections 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.217+0000 7fb485a58640 1 --2- 172.21.15.5:0/3208496498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb480161fe0 0x7fb4800b38d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.217+0000 7fb485a58640 1 -- 172.21.15.5:0/3208496498 >> 172.21.15.5:0/3208496498 conn(0x7fb4800b25d0 msgr2=0x7fb4800b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.217+0000 7fb485a58640 1 -- 172.21.15.5:0/3208496498 shutdown_connections 2024-04-25T09:06:01.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.217+0000 7fb485a58640 1 -- 172.21.15.5:0/3208496498 wait complete. 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.218+0000 7fb485a58640 1 Processor -- start 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.218+0000 7fb485a58640 1 -- start start 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4800668f0 0x7fb480140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4800b3e10 0x7fb4800cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb480161fe0 0x7fb4800cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006f1b0 con 0x7fb4800668f0 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006f030 con 0x7fb480161fe0 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006dbb0 con 0x7fb4800b3e10 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4800668f0 0x7fb480140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4800668f0 0x7fb480140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57560/0 (socket says 172.21.15.5:57560) 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 -- 172.21.15.5:0/2288491552 learned_addr learned my addr 172.21.15.5:0/2288491552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47f7fe640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb480161fe0 0x7fb4800cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb477fff640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4800b3e10 0x7fb4800cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 -- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4800b3e10 msgr2=0x7fb4800cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4800b3e10 0x7fb4800cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 -- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb480161fe0 msgr2=0x7fb4800cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb480161fe0 0x7fb4800cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 -- 172.21.15.5:0/2288491552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4801435d0 con 0x7fb4800668f0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb477fff640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4800b3e10 0x7fb4800cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47f7fe640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb480161fe0 0x7fb4800cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47effd640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4800668f0 0x7fb480140ee0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c450 tx=0x7fb47000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47cff9640 1 -- 172.21.15.5:0/2288491552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700052d0 con 0x7fb4800668f0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47cff9640 1 -- 172.21.15.5:0/2288491552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470005470 con 0x7fb4800668f0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4801596a0 con 0x7fb4800668f0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb47cff9640 1 -- 172.21.15.5:0/2288491552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470012870 con 0x7fb4800668f0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.219+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb480159c20 con 0x7fb4800668f0 2024-04-25T09:06:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.221+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48004ef20 con 0x7fb4800668f0 2024-04-25T09:06:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.221+0000 7fb47cff9640 1 -- 172.21.15.5:0/2288491552 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb470012a10 con 0x7fb4800668f0 2024-04-25T09:06:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.221+0000 7fb47cff9640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb46006b4d0 0x7fb46006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.222+0000 7fb47cff9640 1 -- 172.21.15.5:0/2288491552 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb470089ee0 con 0x7fb4800668f0 2024-04-25T09:06:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.222+0000 7fb477fff640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb46006b4d0 0x7fb46006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.222+0000 7fb477fff640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb46006b4d0 0x7fb46006d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb468034000 tx=0x7fb46802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.226+0000 7fb47cff9640 1 -- 172.21.15.5:0/2288491552 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb470058cd0 con 0x7fb4800668f0 2024-04-25T09:06:01.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.408+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb480072140 con 0x7fb4800668f0 2024-04-25T09:06:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.409+0000 7fb47cff9640 1 -- 172.21.15.5:0/2288491552 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16761 (secure 0 0 0) 0x7fb4700585d0 con 0x7fb4800668f0 2024-04-25T09:06:01.398 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:01.398 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:50.147831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:11.572493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:12.274797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.e","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/778491752":"2024-04-26T09:05:50.147770+0000","172.21.15.5:6834/778491752":"2024-04-26T09:05:50.147770+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:01.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb46006b4d0 msgr2=0x7fb46006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb46006b4d0 0x7fb46006d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb468034000 tx=0x7fb46802e000 comp rx=0 tx=0).stop 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4800668f0 msgr2=0x7fb480140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4800668f0 0x7fb480140ee0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c450 tx=0x7fb47000c910 comp rx=0 tx=0).stop 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 shutdown_connections 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb46006b4d0 0x7fb46006d990 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb480161fe0 0x7fb4800cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb4800b3e10 0x7fb4800cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 --2- 172.21.15.5:0/2288491552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4800668f0 0x7fb480140ee0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 >> 172.21.15.5:0/2288491552 conn(0x7fb4800b25d0 msgr2=0x7fb48015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 shutdown_connections 2024-04-25T09:06:01.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.412+0000 7fb485a58640 1 -- 172.21.15.5:0/2288491552 wait complete. 2024-04-25T09:06:01.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:05:11.572493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:12.274797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:01.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.527+0000 7f5bc6a38640 1 Processor -- start 2024-04-25T09:06:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.527+0000 7f5bc6a38640 1 -- start start 2024-04-25T09:06:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bc6a38640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5bc015f1b0 0x7f5bc00d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bc6a38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc00ccfd0 0x7f5bc00cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bc6a38640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc00cc530 con 0x7f5bc0160540 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bc6a38640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00cd940 con 0x7f5bc015f1b0 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bc6a38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00d0930 con 0x7f5bc00ccfd0 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bbf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5bc0160540 0x7f5bc00b4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45132/0 (socket says 172.21.15.5:45132) 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bbf7fe640 1 -- 172.21.15.5:0/2538164639 learned_addr learned my addr 172.21.15.5:0/2538164639 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bc4fd5640 1 --2- 172.21.15.5:0/2538164639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc00ccfd0 0x7f5bc00cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.528+0000 7f5bbffff640 1 --2- 172.21.15.5:0/2538164639 >> v2:172.21.15.80:3300/0 conn(0x7f5bc015f1b0 0x7f5bc00d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.529+0000 7f5bbeffd640 1 -- 172.21.15.5:0/2538164639 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851223004 0 0) 0x7f5bc00cc530 con 0x7f5bc0160540 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.529+0000 7f5bbeffd640 1 -- 172.21.15.5:0/2538164639 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bac003520 con 0x7f5bc0160540 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.529+0000 7f5bc4fd5640 1 -- 172.21.15.5:0/2538164639 >> v2:172.21.15.80:3300/0 conn(0x7f5bc015f1b0 msgr2=0x7f5bc00d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.529+0000 7f5bc4fd5640 1 --2- 172.21.15.5:0/2538164639 >> v2:172.21.15.80:3300/0 conn(0x7f5bc015f1b0 0x7f5bc00d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.529+0000 7f5bc4fd5640 1 -- 172.21.15.5:0/2538164639 >> v1:172.21.15.5:6789/0 conn(0x7f5bc0160540 legacy=0x7f5bc00b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.529+0000 7f5bc4fd5640 1 -- 172.21.15.5:0/2538164639 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00d0370 con 0x7f5bc00ccfd0 2024-04-25T09:06:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.529+0000 7f5bbffff640 1 --2- 172.21.15.5:0/2538164639 >> v2:172.21.15.80:3300/0 conn(0x7f5bc015f1b0 0x7f5bc00d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc4fd5640 1 --2- 172.21.15.5:0/2538164639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc00ccfd0 0x7f5bc00cd400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009d90 tx=0x7f5bb802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eedba4d170ff178 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bbeffd640 1 -- 172.21.15.5:0/2538164639 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8007740 con 0x7f5bc00ccfd0 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bbeffd640 1 -- 172.21.15.5:0/2538164639 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb80078e0 con 0x7f5bc00ccfd0 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bbeffd640 1 -- 172.21.15.5:0/2538164639 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8007c90 con 0x7f5bc00ccfd0 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 -- 172.21.15.5:0/2538164639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc00ccfd0 msgr2=0x7f5bc00cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/2538164639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc00ccfd0 0x7f5bc00cd400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009d90 tx=0x7f5bb802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 -- 172.21.15.5:0/2538164639 shutdown_connections 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/2538164639 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc00ccfd0 0x7f5bc00cd400 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/2538164639 >> v2:172.21.15.80:3300/0 conn(0x7f5bc015f1b0 0x7f5bc00d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 -- 172.21.15.5:0/2538164639 >> 172.21.15.5:0/2538164639 conn(0x7f5bc00d1a20 msgr2=0x7f5bc00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 -- 172.21.15.5:0/2538164639 shutdown_connections 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.530+0000 7f5bc6a38640 1 -- 172.21.15.5:0/2538164639 wait complete. 2024-04-25T09:06:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.532+0000 7f5bc6a38640 1 Processor -- start 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.532+0000 7f5bc6a38640 1 -- start start 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.532+0000 7f5bc6a38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bc00ccfd0 0x7f5bc01f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc6a38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc015f1b0 0x7f5bc00d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc6a38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc0160540 0x7f5bc00d2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc6a38640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00ccab0 con 0x7f5bc015f1b0 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc6a38640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00cc7d0 con 0x7f5bc00ccfd0 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc6a38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00b4f80 con 0x7f5bc0160540 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc015f1b0 0x7f5bc00d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc015f1b0 0x7f5bc00d1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57576/0 (socket says 172.21.15.5:57576) 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 -- 172.21.15.5:0/3369013654 learned_addr learned my addr 172.21.15.5:0/3369013654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbffff640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bc00ccfd0 0x7f5bc01f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc4fd5640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc0160540 0x7f5bc00d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 -- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc0160540 msgr2=0x7f5bc00d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc0160540 0x7f5bc00d2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 -- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bc00ccfd0 msgr2=0x7f5bc01f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bc00ccfd0 0x7f5bc01f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 -- 172.21.15.5:0/3369013654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00c5680 con 0x7f5bc015f1b0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbf7fe640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc015f1b0 0x7f5bc00d1e00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00010e0 tx=0x7f5bb000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbcff9640 1 -- 172.21.15.5:0/3369013654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0017070 con 0x7f5bc015f1b0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbcff9640 1 -- 172.21.15.5:0/3369013654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0005d00 con 0x7f5bc015f1b0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc00c5960 con 0x7f5bc015f1b0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bbcff9640 1 -- 172.21.15.5:0/3369013654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0007310 con 0x7f5bc015f1b0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.533+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc01f4a20 con 0x7f5bc015f1b0 2024-04-25T09:06:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.534+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc004ef20 con 0x7f5bc015f1b0 2024-04-25T09:06:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.535+0000 7f5bbcff9640 1 -- 172.21.15.5:0/3369013654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5bb001a070 con 0x7f5bc015f1b0 2024-04-25T09:06:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.535+0000 7f5bbcff9640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5ba006b4d0 0x7f5ba006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.535+0000 7f5bbcff9640 1 -- 172.21.15.5:0/3369013654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5bb0089540 con 0x7f5bc015f1b0 2024-04-25T09:06:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.535+0000 7f5bbffff640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5ba006b4d0 0x7f5ba006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.536+0000 7f5bbffff640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5ba006b4d0 0x7f5ba006d990 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009560 tx=0x7f5ba8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.540+0000 7f5bbcff9640 1 -- 172.21.15.5:0/3369013654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5bb0057d70 con 0x7f5bc015f1b0 2024-04-25T09:06:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.722+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bc00b79a0 con 0x7f5bc015f1b0 2024-04-25T09:06:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.722+0000 7f5bbcff9640 1 -- 172.21.15.5:0/3369013654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bb005be10 con 0x7f5bc015f1b0 2024-04-25T09:06:01.711 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5ba006b4d0 msgr2=0x7f5ba006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5ba006b4d0 0x7f5ba006d990 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009560 tx=0x7f5ba8009190 comp rx=0 tx=0).stop 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc015f1b0 msgr2=0x7f5bc00d1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc015f1b0 0x7f5bc00d1e00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00010e0 tx=0x7f5bb000c890 comp rx=0 tx=0).stop 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 shutdown_connections 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5ba006b4d0 0x7f5ba006d990 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bc0160540 0x7f5bc00d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bc015f1b0 0x7f5bc00d1e00 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 --2- 172.21.15.5:0/3369013654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bc00ccfd0 0x7f5bc01f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 >> 172.21.15.5:0/3369013654 conn(0x7f5bc00d1a20 msgr2=0x7f5bc015bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 shutdown_connections 2024-04-25T09:06:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.724+0000 7f5bc6a38640 1 -- 172.21.15.5:0/3369013654 wait complete. 2024-04-25T09:06:01.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.840+0000 7f9e41b90640 1 Processor -- start 2024-04-25T09:06:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.840+0000 7f9e41b90640 1 -- start start 2024-04-25T09:06:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.841+0000 7f9e41b90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 0x7f9e3c0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.841+0000 7f9e41b90640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c072690 con 0x7f9e3c0ae690 2024-04-25T09:06:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.841+0000 7f9e41b90640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c0b2f50 con 0x7f9e3c0ce190 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.841+0000 7f9e41b90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c071ff0 con 0x7f9e3c0b4550 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.841+0000 7f9e3b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9e3c0ae690 0x7f9e3c0aea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45148/0 (socket says 172.21.15.5:45148) 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.841+0000 7f9e3b7fe640 1 -- 172.21.15.5:0/2145595130 learned_addr learned my addr 172.21.15.5:0/2145595130 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3affd640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 0x7f9e3c0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642312096 0 0) 0x7f9e3c072690 con 0x7f9e3c0ae690 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e24003520 con 0x7f9e3c0ae690 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3347424585 0 0) 0x7f9e24003520 con 0x7f9e3c0ae690 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 msgr2=0x7f9e3c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 0x7f9e3c0b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 >> v1:172.21.15.80:6789/0 conn(0x7f9e3c0ce190 legacy=0x7f9e3c0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0cd3d0 con 0x7f9e3c0ae690 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f9e2c001670 con 0x7f9e3c0ae690 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 >> v1:172.21.15.5:6789/0 conn(0x7f9e3c0ae690 legacy=0x7f9e3c0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e240039e0 0x7f9e24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 0x7f9e24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e24004d40 0x7f9e240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400ba70 con 0x7f9e24004d40 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400bc20 con 0x7f9e240039e0 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400be20 con 0x7f9e3c0b4550 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3bfff640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e24004d40 0x7f9e240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3b7fe640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e240039e0 0x7f9e24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3affd640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 0x7f9e24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3bfff640 1 -- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 msgr2=0x7f9e24004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3bfff640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c0b4550 0x7f9e24004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3bfff640 1 -- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e240039e0 msgr2=0x7f9e24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3bfff640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e240039e0 0x7f9e24003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.842+0000 7f9e3bfff640 1 -- 172.21.15.5:0/2145595130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24003520 con 0x7f9e24004d40 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.843+0000 7f9e3bfff640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e24004d40 0x7f9e240051c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9e34001f60 tx=0x7f9e24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf137cbcd47a2a88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.843+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34001b30 con 0x7f9e24004d40 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.843+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34031620 con 0x7f9e24004d40 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.843+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/2145595130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34031a10 con 0x7f9e24004d40 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.844+0000 7f9e41b90640 1 -- 172.21.15.5:0/2145595130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e24004d40 msgr2=0x7f9e240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.844+0000 7f9e41b90640 1 --2- 172.21.15.5:0/2145595130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e24004d40 0x7f9e240051c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9e34001f60 tx=0x7f9e24005830 comp rx=0 tx=0).stop 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.844+0000 7f9e3bfff640 1 -- 172.21.15.5:0/2145595130 reap_dead start 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.844+0000 7f9e41b90640 1 -- 172.21.15.5:0/2145595130 shutdown_connections 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.844+0000 7f9e41b90640 1 -- 172.21.15.5:0/2145595130 >> 172.21.15.5:0/2145595130 conn(0x7f9e3c0b1550 msgr2=0x7f9e3c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.844+0000 7f9e41b90640 1 -- 172.21.15.5:0/2145595130 shutdown_connections 2024-04-25T09:06:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.844+0000 7f9e41b90640 1 -- 172.21.15.5:0/2145595130 wait complete. 2024-04-25T09:06:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.845+0000 7f9e41b90640 1 Processor -- start 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.845+0000 7f9e41b90640 1 -- start start 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e41b90640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c070510 0x7f9e3c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e41b90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c0708f0 0x7f9e3c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e41b90640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e3c0c9110 0x7f9e3c14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e41b90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0cdc70 con 0x7f9e3c0708f0 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e41b90640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0cd990 con 0x7f9e3c0c9110 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e41b90640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c15ad60 con 0x7f9e3c070510 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c0708f0 0x7f9e3c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c0708f0 0x7f9e3c0c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57598/0 (socket says 172.21.15.5:57598) 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 -- 172.21.15.5:0/2559984464 learned_addr learned my addr 172.21.15.5:0/2559984464 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3bfff640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e3c0c9110 0x7f9e3c14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3b7fe640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c070510 0x7f9e3c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 -- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c070510 msgr2=0x7f9e3c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c070510 0x7f9e3c0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 -- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e3c0c9110 msgr2=0x7f9e3c14eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e3c0c9110 0x7f9e3c14eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3affd640 1 -- 172.21.15.5:0/2559984464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0cabb0 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.846+0000 7f9e3bfff640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e3c0c9110 0x7f9e3c14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.847+0000 7f9e3affd640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c0708f0 0x7f9e3c0c8bd0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f9e300119d0 tx=0x7f9e30011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.847+0000 7f9e23fff640 1 -- 172.21.15.5:0/2559984464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000fb50 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.847+0000 7f9e23fff640 1 -- 172.21.15.5:0/2559984464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000fcf0 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.847+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c0cae90 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.847+0000 7f9e23fff640 1 -- 172.21.15.5:0/2559984464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000fea0 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.847+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c0cb450 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.848+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c04ef20 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.848+0000 7f9e23fff640 1 -- 172.21.15.5:0/2559984464 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9e30012040 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.849+0000 7f9e23fff640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9e2806b4d0 0x7f9e2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.849+0000 7f9e23fff640 1 -- 172.21.15.5:0/2559984464 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9e3008a980 con 0x7f9e3c0708f0 2024-04-25T09:06:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.849+0000 7f9e3b7fe640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9e2806b4d0 0x7f9e2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.850+0000 7f9e3b7fe640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9e2806b4d0 0x7f9e2806d990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c1f6b90 tx=0x7f9e2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:01.853+0000 7f9e23fff640 1 -- 172.21.15.5:0/2559984464 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9e30019030 con 0x7f9e3c0708f0 2024-04-25T09:06:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.068+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e3c06e640 con 0x7f9e3c0708f0 2024-04-25T09:06:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.069+0000 7f9e23fff640 1 -- 172.21.15.5:0/2559984464 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v128) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e30059120 con 0x7f9e3c0708f0 2024-04-25T09:06:02.057 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:06:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9e2806b4d0 msgr2=0x7f9e2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9e2806b4d0 0x7f9e2806d990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c1f6b90 tx=0x7f9e2c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c0708f0 msgr2=0x7f9e3c0c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c0708f0 0x7f9e3c0c8bd0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f9e300119d0 tx=0x7f9e30011e90 comp rx=0 tx=0).stop 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 shutdown_connections 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9e2806b4d0 0x7f9e2806d990 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e3c0c9110 0x7f9e3c14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c0708f0 0x7f9e3c0c8bd0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 --2- 172.21.15.5:0/2559984464 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9e3c070510 0x7f9e3c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 >> 172.21.15.5:0/2559984464 conn(0x7f9e3c0b1550 msgr2=0x7f9e3c06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 shutdown_connections 2024-04-25T09:06:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.071+0000 7f9e41b90640 1 -- 172.21.15.5:0/2559984464 wait complete. 2024-04-25T09:06:02.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.187+0000 7f5902e91640 1 Processor -- start 2024-04-25T09:06:02.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.187+0000 7f5902e91640 1 -- start start 2024-04-25T09:06:02.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5902e91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58fc15df10 0x7f58fc1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5902e91640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58fc0cefe0 0x7f58fc0d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5902e91640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc162150 con 0x7f58fc0b6250 2024-04-25T09:06:02.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5902e91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0d20d0 con 0x7f58fc15df10 2024-04-25T09:06:02.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5902e91640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc162430 con 0x7f58fc0cefe0 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5900c2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58fc15df10 0x7f58fc1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5900c2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58fc15df10 0x7f58fc1618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57610/0 (socket says 172.21.15.5:57610) 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5900c2d640 1 -- 172.21.15.5:0/3600063789 learned_addr learned my addr 172.21.15.5:0/3600063789 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f590142e640 1 --2- 172.21.15.5:0/3600063789 >> v2:172.21.15.80:3300/0 conn(0x7f58fc0cefe0 0x7f58fc0d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5900c2d640 1 -- 172.21.15.5:0/3600063789 >> v2:172.21.15.80:3300/0 conn(0x7f58fc0cefe0 msgr2=0x7f58fc0d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5900c2d640 1 --2- 172.21.15.5:0/3600063789 >> v2:172.21.15.80:3300/0 conn(0x7f58fc0cefe0 0x7f58fc0d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5900c2d640 1 -- 172.21.15.5:0/3600063789 >> v1:172.21.15.80:6789/0 conn(0x7f58fc0b6250 legacy=0x7f58fc0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.188+0000 7f5900c2d640 1 -- 172.21.15.5:0/3600063789 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc162710 con 0x7f58fc15df10 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.189+0000 7f5900c2d640 1 --2- 172.21.15.5:0/3600063789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc15df10 0x7f58fc1618d0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0b3610 tx=0x7f58f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03dd2aeb4b1879f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.189+0000 7f58fb7fe640 1 -- 172.21.15.5:0/3600063789 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0037070 con 0x7f58fc15df10 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.189+0000 7f58fb7fe640 1 -- 172.21.15.5:0/3600063789 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0032440 con 0x7f58fc15df10 2024-04-25T09:06:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.189+0000 7f58fb7fe640 1 -- 172.21.15.5:0/3600063789 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0032810 con 0x7f58fc15df10 2024-04-25T09:06:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 -- 172.21.15.5:0/3600063789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc15df10 msgr2=0x7f58fc1618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 --2- 172.21.15.5:0/3600063789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc15df10 0x7f58fc1618d0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0b3610 tx=0x7f58f002a270 comp rx=0 tx=0).stop 2024-04-25T09:06:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 -- 172.21.15.5:0/3600063789 shutdown_connections 2024-04-25T09:06:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 --2- 172.21.15.5:0/3600063789 >> v2:172.21.15.80:3300/0 conn(0x7f58fc0cefe0 0x7f58fc0d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 --2- 172.21.15.5:0/3600063789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc15df10 0x7f58fc1618d0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 -- 172.21.15.5:0/3600063789 >> 172.21.15.5:0/3600063789 conn(0x7f58fc0668f0 msgr2=0x7f58fc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 -- 172.21.15.5:0/3600063789 shutdown_connections 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.190+0000 7f5902e91640 1 -- 172.21.15.5:0/3600063789 wait complete. 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.191+0000 7f5902e91640 1 Processor -- start 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.191+0000 7f5902e91640 1 -- start start 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5902e91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0b6250 0x7f58fc154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5902e91640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58fc0cefe0 0x7f58fc160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5902e91640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58fc15df10 0x7f58fc15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5902e91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0d2aa0 con 0x7f58fc0b6250 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5902e91640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc161e10 con 0x7f58fc0cefe0 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5902e91640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0d2c20 con 0x7f58fc15df10 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0b6250 0x7f58fc154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0b6250 0x7f58fc154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57614/0 (socket says 172.21.15.5:57614) 2024-04-25T09:06:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 -- 172.21.15.5:0/2025509052 learned_addr learned my addr 172.21.15.5:0/2025509052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 -- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58fc15df10 msgr2=0x7f58fc15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58fc15df10 0x7f58fc15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 -- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58fc0cefe0 msgr2=0x7f58fc160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58fc0cefe0 0x7f58fc160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 -- 172.21.15.5:0/2025509052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc1612e0 con 0x7f58fc0b6250 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5900c2d640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0b6250 0x7f58fc154130 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f58f002a2b0 tx=0x7f58f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f58f97fa640 1 -- 172.21.15.5:0/2025509052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0037040 con 0x7f58fc0b6250 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f58f97fa640 1 -- 172.21.15.5:0/2025509052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0042070 con 0x7f58fc0b6250 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.192+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc161000 con 0x7f58fc0b6250 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.193+0000 7f58f97fa640 1 -- 172.21.15.5:0/2025509052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f003b870 con 0x7f58fc0b6250 2024-04-25T09:06:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.193+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc0c87d0 con 0x7f58fc0b6250 2024-04-25T09:06:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.194+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc04ef20 con 0x7f58fc0b6250 2024-04-25T09:06:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.194+0000 7f58f97fa640 1 -- 172.21.15.5:0/2025509052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f58f003ba10 con 0x7f58fc0b6250 2024-04-25T09:06:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.194+0000 7f58f97fa640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f58e006b500 0x7f58e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.195+0000 7f58f97fa640 1 -- 172.21.15.5:0/2025509052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f58f00aab40 con 0x7f58fc0b6250 2024-04-25T09:06:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.195+0000 7f58fbfff640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f58e006b500 0x7f58e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.195+0000 7f58fbfff640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f58e006b500 0x7f58e006d9c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f58e8000f60 tx=0x7f58e80079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.199+0000 7f58f97fa640 1 -- 172.21.15.5:0/2025509052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f58f0079890 con 0x7f58fc0b6250 2024-04-25T09:06:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.380+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58fc0b79c0 con 0x7f58fc0b6250 2024-04-25T09:06:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.381+0000 7f58f97fa640 1 -- 172.21.15.5:0/2025509052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v128) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58f0079190 con 0x7f58fc0b6250 2024-04-25T09:06:02.369 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:06:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f58e006b500 msgr2=0x7f58e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f58e006b500 0x7f58e006d9c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f58e8000f60 tx=0x7f58e80079d0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0b6250 msgr2=0x7f58fc154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0b6250 0x7f58fc154130 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f58f002a2b0 tx=0x7f58f00046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 shutdown_connections 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f58e006b500 0x7f58e006d9c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58fc15df10 0x7f58fc15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58fc0cefe0 0x7f58fc160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 --2- 172.21.15.5:0/2025509052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0b6250 0x7f58fc154130 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 >> 172.21.15.5:0/2025509052 conn(0x7f58fc0668f0 msgr2=0x7f58fc0b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 shutdown_connections 2024-04-25T09:06:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.383+0000 7f5902e91640 1 -- 172.21.15.5:0/2025509052 wait complete. 2024-04-25T09:06:02.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.494+0000 7f5be23c8640 1 Processor -- start 2024-04-25T09:06:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.494+0000 7f5be23c8640 1 -- start start 2024-04-25T09:06:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5be23c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc15de70 0x7f5bdc0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5be23c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bdc0b2cc0 0x7f5bdc0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5be23c8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc0d20e0 con 0x7f5bdc0b7130 2024-04-25T09:06:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5be23c8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0d2a10 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5be23c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0d23c0 con 0x7f5bdc15de70 2024-04-25T09:06:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bdc0b2cc0 0x7f5bdc0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bdc0b2cc0 0x7f5bdc0b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57622/0 (socket says 172.21.15.5:57622) 2024-04-25T09:06:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdb7fe640 1 -- 172.21.15.5:0/3960454870 learned_addr learned my addr 172.21.15.5:0/3960454870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdbfff640 1 --2- 172.21.15.5:0/3960454870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc15de70 0x7f5bdc0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdb7fe640 1 -- 172.21.15.5:0/3960454870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc15de70 msgr2=0x7f5bdc0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdb7fe640 1 --2- 172.21.15.5:0/3960454870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc15de70 0x7f5bdc0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdb7fe640 1 -- 172.21.15.5:0/3960454870 >> v1:172.21.15.80:6789/0 conn(0x7f5bdc0b7130 legacy=0x7f5bdc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdb7fe640 1 -- 172.21.15.5:0/3960454870 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0d26a0 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.495+0000 7f5bdbfff640 1 --2- 172.21.15.5:0/3960454870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc15de70 0x7f5bdc0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.496+0000 7f5bdb7fe640 1 --2- 172.21.15.5:0/3960454870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b6bf0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009870 tx=0x7f5bcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f61947c6133001b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.496+0000 7f5bdaffd640 1 -- 172.21.15.5:0/3960454870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc037070 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.496+0000 7f5bdaffd640 1 -- 172.21.15.5:0/3960454870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc032440 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.496+0000 7f5bdaffd640 1 -- 172.21.15.5:0/3960454870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc032810 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 -- 172.21.15.5:0/3960454870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 msgr2=0x7f5bdc0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 --2- 172.21.15.5:0/3960454870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b6bf0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009870 tx=0x7f5bcc02a270 comp rx=0 tx=0).stop 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 -- 172.21.15.5:0/3960454870 shutdown_connections 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 --2- 172.21.15.5:0/3960454870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b6bf0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 --2- 172.21.15.5:0/3960454870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc15de70 0x7f5bdc0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 -- 172.21.15.5:0/3960454870 >> 172.21.15.5:0/3960454870 conn(0x7f5bdc06b000 msgr2=0x7f5bdc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 -- 172.21.15.5:0/3960454870 shutdown_connections 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.497+0000 7f5be23c8640 1 -- 172.21.15.5:0/3960454870 wait complete. 2024-04-25T09:06:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.498+0000 7f5be23c8640 1 Processor -- start 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.498+0000 7f5be23c8640 1 -- start start 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be23c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be23c8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc0b7130 0x7f5bdc0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be23c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc15de70 0x7f5bdc0c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be23c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0cf080 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be23c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0cef00 con 0x7f5bdc15de70 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be23c8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0cf200 con 0x7f5bdc0b7130 2024-04-25T09:06:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57632/0 (socket says 172.21.15.5:57632) 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 -- 172.21.15.5:0/2282382454 learned_addr learned my addr 172.21.15.5:0/2282382454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdb7fe640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc0b7130 0x7f5bdc0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 -- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc0b7130 msgr2=0x7f5bdc0b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc0b7130 0x7f5bdc0b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be0965640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc15de70 0x7f5bdc0c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 -- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc15de70 msgr2=0x7f5bdc0c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc15de70 0x7f5bdc0c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5bdbfff640 1 -- 172.21.15.5:0/2282382454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0b35f0 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.499+0000 7f5be0965640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc15de70 0x7f5bdc0c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.500+0000 7f5bdbfff640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b43b0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400d800 tx=0x7f5bc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.500+0000 7f5bd8ff9640 1 -- 172.21.15.5:0/2282382454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4004030 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.500+0000 7f5bd8ff9640 1 -- 172.21.15.5:0/2282382454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc40041d0 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.500+0000 7f5bd8ff9640 1 -- 172.21.15.5:0/2282382454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40096a0 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.500+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc0b38d0 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.500+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc0cd250 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.501+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc04ef20 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.501+0000 7f5bd8ff9640 1 -- 172.21.15.5:0/2282382454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5bc4009840 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.502+0000 7f5bd8ff9640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bbc06b4d0 0x7f5bbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.502+0000 7f5bd8ff9640 1 -- 172.21.15.5:0/2282382454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5bc408a580 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.502+0000 7f5bdb7fe640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bbc06b4d0 0x7f5bbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.502+0000 7f5bdb7fe640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bbc06b4d0 0x7f5bbc06d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc034000 tx=0x7f5bcc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.506+0000 7f5bd8ff9640 1 -- 172.21.15.5:0/2282382454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5bc4059380 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.722+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bdc068b60 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.722+0000 7f5bd8ff9640 1 -- 172.21.15.5:0/2282382454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f5bc4058c80 con 0x7f5bdc0b2cc0 2024-04-25T09:06:02.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:02.711 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:52.172731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":16,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:06:02.711 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 82 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bbc06b4d0 msgr2=0x7f5bbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bbc06b4d0 0x7f5bbc06d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc034000 tx=0x7f5bcc02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 msgr2=0x7f5bdc0b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b43b0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400d800 tx=0x7f5bc400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 shutdown_connections 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5bbc06b4d0 0x7f5bbc06d990 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bdc15de70 0x7f5bdc0c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5bdc0b7130 0x7f5bdc0b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 --2- 172.21.15.5:0/2282382454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bdc0b2cc0 0x7f5bdc0b43b0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 >> 172.21.15.5:0/2282382454 conn(0x7f5bdc06b000 msgr2=0x7f5bdc0b8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 shutdown_connections 2024-04-25T09:06:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.725+0000 7f5be23c8640 1 -- 172.21.15.5:0/2282382454 wait complete. 2024-04-25T09:06:02.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.837+0000 7f9c88c22640 1 Processor -- start 2024-04-25T09:06:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.837+0000 7f9c88c22640 1 -- start start 2024-04-25T09:06:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.837+0000 7f9c88c22640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c8415e0a0 0x7f9c840d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.837+0000 7f9c88c22640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3df0 0x7f9c840cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.837+0000 7f9c88c22640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840b7f60 con 0x7f9c840d3990 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.837+0000 7f9c88c22640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c840b29c0 con 0x7f9c8415e0a0 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.837+0000 7f9c88c22640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840d2080 con 0x7f9c840d3df0 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c8259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c8415e0a0 0x7f9c840d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c8259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c8415e0a0 0x7f9c840d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57644/0 (socket says 172.21.15.5:57644) 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c8259c640 1 -- 172.21.15.5:0/1123157760 learned_addr learned my addr 172.21.15.5:0/1123157760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c82d9d640 1 --2- 172.21.15.5:0/1123157760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3df0 0x7f9c840cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c8259c640 1 -- 172.21.15.5:0/1123157760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3df0 msgr2=0x7f9c840cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c8259c640 1 --2- 172.21.15.5:0/1123157760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3df0 0x7f9c840cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c8259c640 1 -- 172.21.15.5:0/1123157760 >> v1:172.21.15.80:6789/0 conn(0x7f9c840d3990 legacy=0x7f9c840ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.838+0000 7f9c8259c640 1 -- 172.21.15.5:0/1123157760 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840d2360 con 0x7f9c8415e0a0 2024-04-25T09:06:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c8259c640 1 --2- 172.21.15.5:0/1123157760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c840d0d50 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009870 tx=0x7f9c7402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3c77a164b5ac9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c81d9b640 1 -- 172.21.15.5:0/1123157760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74037070 con 0x7f9c8415e0a0 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c81d9b640 1 -- 172.21.15.5:0/1123157760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74032440 con 0x7f9c8415e0a0 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c81d9b640 1 -- 172.21.15.5:0/1123157760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74032810 con 0x7f9c8415e0a0 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 -- 172.21.15.5:0/1123157760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 msgr2=0x7f9c840d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 --2- 172.21.15.5:0/1123157760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c840d0d50 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009870 tx=0x7f9c7402a210 comp rx=0 tx=0).stop 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 -- 172.21.15.5:0/1123157760 shutdown_connections 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 --2- 172.21.15.5:0/1123157760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3df0 0x7f9c840cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 --2- 172.21.15.5:0/1123157760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c840d0d50 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 -- 172.21.15.5:0/1123157760 >> 172.21.15.5:0/1123157760 conn(0x7f9c840668f0 msgr2=0x7f9c84066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 -- 172.21.15.5:0/1123157760 shutdown_connections 2024-04-25T09:06:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.839+0000 7f9c88c22640 1 -- 172.21.15.5:0/1123157760 wait complete. 2024-04-25T09:06:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 Processor -- start 2024-04-25T09:06:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 -- start start 2024-04-25T09:06:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3990 0x7f9c840c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c840d3df0 0x7f9c841f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c8415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840d2c00 con 0x7f9c8415e0a0 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840d2920 con 0x7f9c840d3df0 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.841+0000 7f9c88c22640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840d4280 con 0x7f9c840d3990 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c8415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c8415c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57654/0 (socket says 172.21.15.5:57654) 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 -- 172.21.15.5:0/2786966952 learned_addr learned my addr 172.21.15.5:0/2786966952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c8259c640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3990 0x7f9c840c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c7bfff640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c840d3df0 0x7f9c841f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 -- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3990 msgr2=0x7f9c840c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3990 0x7f9c840c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 -- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c840d3df0 msgr2=0x7f9c841f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c840d3df0 0x7f9c841f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 -- 172.21.15.5:0/2786966952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c841f4b60 con 0x7f9c8415e0a0 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c7bfff640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c840d3df0 0x7f9c841f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c82d9d640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c8415c980 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00cd70 tx=0x7f9c7c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c7affd640 1 -- 172.21.15.5:0/2786966952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003b90 con 0x7f9c8415e0a0 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c7affd640 1 -- 172.21.15.5:0/2786966952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c003d30 con 0x7f9c8415e0a0 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8415cec0 con 0x7f9c8415e0a0 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c7affd640 1 -- 172.21.15.5:0/2786966952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c004240 con 0x7f9c8415e0a0 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.842+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c840c8530 con 0x7f9c8415e0a0 2024-04-25T09:06:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.843+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8404ef20 con 0x7f9c8415e0a0 2024-04-25T09:06:02.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.844+0000 7f9c7affd640 1 -- 172.21.15.5:0/2786966952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c7c0043e0 con 0x7f9c8415e0a0 2024-04-25T09:06:02.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.844+0000 7f9c7affd640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c6406b4d0 0x7f9c6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.844+0000 7f9c7affd640 1 -- 172.21.15.5:0/2786966952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9c7c08ad30 con 0x7f9c8415e0a0 2024-04-25T09:06:02.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.844+0000 7f9c8259c640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c6406b4d0 0x7f9c6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.845+0000 7f9c8259c640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c6406b4d0 0x7f9c6406d990 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c74034000 tx=0x7f9c7402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:02.848+0000 7f9c7affd640 1 -- 172.21.15.5:0/2786966952 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c841f4b60 con 0x7f9c8415e0a0 2024-04-25T09:06:03.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.030+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c840d3500 con 0x7f9c8415e0a0 2024-04-25T09:06:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.032+0000 7f9c7affd640 1 -- 172.21.15.5:0/2786966952 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16761 (secure 0 0 0) 0x7f9c840d3500 con 0x7f9c8415e0a0 2024-04-25T09:06:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:03.020 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:50.147831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:11.572493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:12.274797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.e","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/778491752":"2024-04-26T09:05:50.147770+0000","172.21.15.5:6834/778491752":"2024-04-26T09:05:50.147770+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c6406b4d0 msgr2=0x7f9c6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c6406b4d0 0x7f9c6406d990 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c74034000 tx=0x7f9c7402e000 comp rx=0 tx=0).stop 2024-04-25T09:06:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 msgr2=0x7f9c8415c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c8415c980 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00cd70 tx=0x7f9c7c00a660 comp rx=0 tx=0).stop 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 shutdown_connections 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9c6406b4d0 0x7f9c6406d990 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c8415e0a0 0x7f9c8415c980 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c840d3df0 0x7f9c841f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 --2- 172.21.15.5:0/2786966952 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9c840d3990 0x7f9c840c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.033+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 >> 172.21.15.5:0/2786966952 conn(0x7f9c840668f0 msgr2=0x7f9c840b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.034+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 shutdown_connections 2024-04-25T09:06:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.034+0000 7f9c88c22640 1 -- 172.21.15.5:0/2786966952 wait complete. 2024-04-25T09:06:03.033 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:06:03.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.145+0000 7f0fab853640 1 Processor -- start 2024-04-25T09:06:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fab853640 1 -- start start 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fab853640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fa40d3df0 0x7f0fa40b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fab853640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40b29c0 con 0x7f0fa40d3990 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fab853640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40d2080 con 0x7f0fa415e0a0 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fab853640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40d1460 con 0x7f0fa40d3df0 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fa9df0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fa40d3df0 0x7f0fa40b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fa8dee640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0fa40d3990 0x7f0fa40b6f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45160/0 (socket says 172.21.15.5:45160) 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.146+0000 7f0fa8dee640 1 -- 172.21.15.5:0/220163420 learned_addr learned my addr 172.21.15.5:0/220163420 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.147+0000 7f0fa9df0640 1 -- 172.21.15.5:0/220163420 >> v1:172.21.15.80:6789/0 conn(0x7f0fa415e0a0 legacy=0x7f0fa40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.147+0000 7f0fa9df0640 1 -- 172.21.15.5:0/220163420 >> v1:172.21.15.5:6789/0 conn(0x7f0fa40d3990 legacy=0x7f0fa40b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.147+0000 7f0fa9df0640 1 -- 172.21.15.5:0/220163420 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40d2360 con 0x7f0fa40d3df0 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.147+0000 7f0fa9df0640 1 --2- 172.21.15.5:0/220163420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40b7660 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009d90 tx=0x7f0f9c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a8bd1fa58ec69e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0f9bfff640 1 -- 172.21.15.5:0/220163420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c007740 con 0x7f0fa40d3df0 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0f9bfff640 1 -- 172.21.15.5:0/220163420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c0078e0 con 0x7f0fa40d3df0 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0f9bfff640 1 -- 172.21.15.5:0/220163420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c007cb0 con 0x7f0fa40d3df0 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0fab853640 1 -- 172.21.15.5:0/220163420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3df0 msgr2=0x7f0fa40b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0fab853640 1 --2- 172.21.15.5:0/220163420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40b7660 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009d90 tx=0x7f0f9c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0fab853640 1 -- 172.21.15.5:0/220163420 shutdown_connections 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0fab853640 1 --2- 172.21.15.5:0/220163420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40b7660 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0fab853640 1 -- 172.21.15.5:0/220163420 >> 172.21.15.5:0/220163420 conn(0x7f0fa40668f0 msgr2=0x7f0fa4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0fab853640 1 -- 172.21.15.5:0/220163420 shutdown_connections 2024-04-25T09:06:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.148+0000 7f0fab853640 1 -- 172.21.15.5:0/220163420 wait complete. 2024-04-25T09:06:03.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.149+0000 7f0fab853640 1 Processor -- start 2024-04-25T09:06:03.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fab853640 1 -- start start 2024-04-25T09:06:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fab853640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3990 0x7f0fa40ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fab853640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fab853640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fa415e0a0 0x7f0fa40b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fab853640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40d2c00 con 0x7f0fa40d3990 2024-04-25T09:06:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fab853640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40d2920 con 0x7f0fa40d3df0 2024-04-25T09:06:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fab853640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40d4280 con 0x7f0fa415e0a0 2024-04-25T09:06:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fa95ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3990 0x7f0fa40ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fa95ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3990 0x7f0fa40ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57676/0 (socket says 172.21.15.5:57676) 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.150+0000 7f0fa95ef640 1 -- 172.21.15.5:0/2896111924 learned_addr learned my addr 172.21.15.5:0/2896111924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa8dee640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa9df0640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fa415e0a0 0x7f0fa40b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa95ef640 1 -- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fa415e0a0 msgr2=0x7f0fa40b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa95ef640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fa415e0a0 0x7f0fa40b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa95ef640 1 -- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fa40d3df0 msgr2=0x7f0fa40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa95ef640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa95ef640 1 -- 172.21.15.5:0/2896111924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40ccd70 con 0x7f0fa40d3990 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa8dee640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fa95ef640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3990 0x7f0fa40ab270 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c430 tx=0x7f0fa000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0f99ffb640 1 -- 172.21.15.5:0/2896111924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0011790 con 0x7f0fa40d3990 2024-04-25T09:06:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0f99ffb640 1 -- 172.21.15.5:0/2896111924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa0017070 con 0x7f0fa40d3990 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0f99ffb640 1 -- 172.21.15.5:0/2896111924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0011b70 con 0x7f0fa40d3990 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa40cd050 con 0x7f0fa40d3990 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.151+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa40cd610 con 0x7f0fa40d3990 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.152+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa404ef20 con 0x7f0fa40d3990 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.153+0000 7f0f99ffb640 1 -- 172.21.15.5:0/2896111924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0fa0011d10 con 0x7f0fa40d3990 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.153+0000 7f0f99ffb640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f8806b4d0 0x7f0f8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.153+0000 7f0f99ffb640 1 -- 172.21.15.5:0/2896111924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0fa008a0c0 con 0x7f0fa40d3990 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.153+0000 7f0fa8dee640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f8806b4d0 0x7f0f8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.154+0000 7f0fa8dee640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f8806b4d0 0x7f0f8806d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0fa41f7350 tx=0x7f0f94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.157+0000 7f0f99ffb640 1 -- 172.21.15.5:0/2896111924 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0fa0058f40 con 0x7f0fa40d3990 2024-04-25T09:06:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.377+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fa40b8bc0 con 0x7f0fa40d3990 2024-04-25T09:06:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.378+0000 7f0f99ffb640 1 -- 172.21.15.5:0/2896111924 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f0fa0058840 con 0x7f0fa40d3990 2024-04-25T09:06:03.367 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:03.367 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:52.172731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":16,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:06:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 82 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f8806b4d0 msgr2=0x7f0f8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f8806b4d0 0x7f0f8806d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0fa41f7350 tx=0x7f0f94009040 comp rx=0 tx=0).stop 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3990 msgr2=0x7f0fa40ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3990 0x7f0fa40ab270 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c430 tx=0x7f0fa000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 shutdown_connections 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f0f8806b4d0 0x7f0f8806d990 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0fa415e0a0 0x7f0fa40b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fa40d3df0 0x7f0fa40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 --2- 172.21.15.5:0/2896111924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40d3990 0x7f0fa40ab270 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 >> 172.21.15.5:0/2896111924 conn(0x7f0fa40668f0 msgr2=0x7f0fa415ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 shutdown_connections 2024-04-25T09:06:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.380+0000 7f0fab853640 1 -- 172.21.15.5:0/2896111924 wait complete. 2024-04-25T09:06:03.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.491+0000 7f935c590640 1 Processor -- start 2024-04-25T09:06:03.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.491+0000 7f935c590640 1 -- start start 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.492+0000 7f935c590640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f935415def0 0x7f93540d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.492+0000 7f935c590640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93540b94c0 0x7f93540d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.492+0000 7f935c590640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93540d2550 con 0x7f93540d0400 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.492+0000 7f935c590640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935415e2d0 con 0x7f93540b94c0 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.492+0000 7f935c590640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93540d2830 con 0x7f935415def0 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935a32c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f935415def0 0x7f93540d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f9359b2b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93540b94c0 0x7f93540d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935ab2d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f93540d0400 0x7f93540b5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:37034/0 (socket says 172.21.15.5:37034) 2024-04-25T09:06:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935ab2d640 1 -- 172.21.15.5:0/2616962369 learned_addr learned my addr 172.21.15.5:0/2616962369 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935a32c640 1 -- 172.21.15.5:0/2616962369 >> v2:172.21.15.80:3300/0 conn(0x7f93540b94c0 msgr2=0x7f93540d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935932a640 1 -- 172.21.15.5:0/2616962369 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400481797 0 0) 0x7f93540d2550 con 0x7f93540d0400 2024-04-25T09:06:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935a32c640 1 --2- 172.21.15.5:0/2616962369 >> v2:172.21.15.80:3300/0 conn(0x7f93540b94c0 0x7f93540d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935a32c640 1 -- 172.21.15.5:0/2616962369 >> v1:172.21.15.80:6789/0 conn(0x7f93540d0400 legacy=0x7f93540b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f935a32c640 1 -- 172.21.15.5:0/2616962369 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93540d2b10 con 0x7f935415def0 2024-04-25T09:06:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.493+0000 7f9359b2b640 1 --2- 172.21.15.5:0/2616962369 >> v2:172.21.15.80:3300/0 conn(0x7f93540b94c0 0x7f93540d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:03.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.494+0000 7f935a32c640 1 --2- 172.21.15.5:0/2616962369 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f935415def0 0x7f93540d35f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9344009d90 tx=0x7f934402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f0fe9813f51ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.494+0000 7f935932a640 1 -- 172.21.15.5:0/2616962369 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344007740 con 0x7f935415def0 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.494+0000 7f935932a640 1 -- 172.21.15.5:0/2616962369 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93440078e0 con 0x7f935415def0 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.494+0000 7f935932a640 1 -- 172.21.15.5:0/2616962369 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344007cb0 con 0x7f935415def0 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 -- 172.21.15.5:0/2616962369 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f935415def0 msgr2=0x7f93540d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 --2- 172.21.15.5:0/2616962369 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f935415def0 0x7f93540d35f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9344009d90 tx=0x7f934402a660 comp rx=0 tx=0).stop 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 -- 172.21.15.5:0/2616962369 shutdown_connections 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 --2- 172.21.15.5:0/2616962369 >> v2:172.21.15.80:3300/0 conn(0x7f93540b94c0 0x7f93540d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 --2- 172.21.15.5:0/2616962369 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f935415def0 0x7f93540d35f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 -- 172.21.15.5:0/2616962369 >> 172.21.15.5:0/2616962369 conn(0x7f935406b000 msgr2=0x7f935406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 -- 172.21.15.5:0/2616962369 shutdown_connections 2024-04-25T09:06:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.495+0000 7f935c590640 1 -- 172.21.15.5:0/2616962369 wait complete. 2024-04-25T09:06:03.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.496+0000 7f935c590640 1 Processor -- start 2024-04-25T09:06:03.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.496+0000 7f935c590640 1 -- start start 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935c590640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93540b94c0 0x7f935414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935c590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93540d0400 0x7f93540cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935c590640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f935415def0 0x7f935415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935c590640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93540d2260 con 0x7f93540d0400 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935c590640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93540d30d0 con 0x7f935415def0 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935c590640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93540d0850 con 0x7f93540b94c0 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93540d0400 0x7f93540cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93540d0400 0x7f93540cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57680/0 (socket says 172.21.15.5:57680) 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 -- 172.21.15.5:0/3723106291 learned_addr learned my addr 172.21.15.5:0/3723106291 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935a32c640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93540b94c0 0x7f935414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935ab2d640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f935415def0 0x7f935415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 -- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93540b94c0 msgr2=0x7f935414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93540b94c0 0x7f935414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 -- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f935415def0 msgr2=0x7f935415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f935415def0 0x7f935415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 -- 172.21.15.5:0/3723106291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93541f3a80 con 0x7f93540d0400 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9359b2b640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93540d0400 0x7f93540cb820 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f934800ec10 tx=0x7f934800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9352ffd640 1 -- 172.21.15.5:0/3723106291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348017070 con 0x7f93540d0400 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9352ffd640 1 -- 172.21.15.5:0/3723106291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800cc30 con 0x7f93540d0400 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f9352ffd640 1 -- 172.21.15.5:0/3723106291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348013470 con 0x7f93540d0400 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.497+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93540cbeb0 con 0x7f93540d0400 2024-04-25T09:06:03.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.498+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9354159530 con 0x7f93540d0400 2024-04-25T09:06:03.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.499+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935404ef20 con 0x7f93540d0400 2024-04-25T09:06:03.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.499+0000 7f9352ffd640 1 -- 172.21.15.5:0/3723106291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f934801a070 con 0x7f93540d0400 2024-04-25T09:06:03.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.499+0000 7f9352ffd640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f934006b4d0 0x7f934006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.500+0000 7f9352ffd640 1 -- 172.21.15.5:0/3723106291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f934808a140 con 0x7f93540d0400 2024-04-25T09:06:03.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.500+0000 7f935a32c640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f934006b4d0 0x7f934006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.500+0000 7f935a32c640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f934006b4d0 0x7f934006d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f934402f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.504+0000 7f9352ffd640 1 -- 172.21.15.5:0/3723106291 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9348058fc0 con 0x7f93540d0400 2024-04-25T09:06:03.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.721+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93540ca4b0 con 0x7f93540d0400 2024-04-25T09:06:03.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.722+0000 7f9352ffd640 1 -- 172.21.15.5:0/3723106291 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f93480588c0 con 0x7f93540d0400 2024-04-25T09:06:03.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:03.711 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:13.301049+0000","modified":"2024-04-25T09:05:52.172731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9090},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9090":{"gid":9090,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":16,"addr":"172.21.15.5:6833/3251950548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3251950548},{"type":"v1","addr":"172.21.15.5:6833","nonce":3251950548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:06:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 82 2024-04-25T09:06:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f934006b4d0 msgr2=0x7f934006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f934006b4d0 0x7f934006d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f934402f000 comp rx=0 tx=0).stop 2024-04-25T09:06:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93540d0400 msgr2=0x7f93540cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93540d0400 0x7f93540cb820 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f934800ec10 tx=0x7f934800c520 comp rx=0 tx=0).stop 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 shutdown_connections 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f934006b4d0 0x7f934006d990 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f935415def0 0x7f935415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93540d0400 0x7f93540cb820 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 --2- 172.21.15.5:0/3723106291 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f93540b94c0 0x7f935414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 >> 172.21.15.5:0/3723106291 conn(0x7f935406b000 msgr2=0x7f93540b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 shutdown_connections 2024-04-25T09:06:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.724+0000 7f935c590640 1 -- 172.21.15.5:0/3723106291 wait complete. 2024-04-25T09:06:03.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:03.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.835+0000 7f804229e640 1 Processor -- start 2024-04-25T09:06:03.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.835+0000 7f804229e640 1 -- start start 2024-04-25T09:06:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f804229e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f803c0b2cc0 0x7f803c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f804229e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f803c0b7130 0x7f803c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f804229e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0d20e0 con 0x7f803c15de70 2024-04-25T09:06:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f804229e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c0d2a10 con 0x7f803c0b2cc0 2024-04-25T09:06:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f804229e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c0d23c0 con 0x7f803c0b7130 2024-04-25T09:06:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f803b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f803c0b2cc0 0x7f803c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f803bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f803c15de70 0x7f803c0b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45166/0 (socket says 172.21.15.5:45166) 2024-04-25T09:06:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.836+0000 7f803bfff640 1 -- 172.21.15.5:0/3147487100 learned_addr learned my addr 172.21.15.5:0/3147487100 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.837+0000 7f804083b640 1 --2- 172.21.15.5:0/3147487100 >> v2:172.21.15.80:3300/0 conn(0x7f803c0b7130 0x7f803c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.837+0000 7f803b7fe640 1 -- 172.21.15.5:0/3147487100 >> v2:172.21.15.80:3300/0 conn(0x7f803c0b7130 msgr2=0x7f803c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.837+0000 7f803b7fe640 1 --2- 172.21.15.5:0/3147487100 >> v2:172.21.15.80:3300/0 conn(0x7f803c0b7130 0x7f803c0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.837+0000 7f803b7fe640 1 -- 172.21.15.5:0/3147487100 >> v1:172.21.15.5:6789/0 conn(0x7f803c15de70 legacy=0x7f803c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.837+0000 7f803b7fe640 1 -- 172.21.15.5:0/3147487100 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0d26a0 con 0x7f803c0b2cc0 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.837+0000 7f803b7fe640 1 --2- 172.21.15.5:0/3147487100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0b6bf0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f802c0097a0 tx=0x7f802c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5360767476b859c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.837+0000 7f803affd640 1 -- 172.21.15.5:0/3147487100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c037070 con 0x7f803c0b2cc0 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f803affd640 1 -- 172.21.15.5:0/3147487100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c032440 con 0x7f803c0b2cc0 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f803affd640 1 -- 172.21.15.5:0/3147487100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c032810 con 0x7f803c0b2cc0 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 -- 172.21.15.5:0/3147487100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 msgr2=0x7f803c0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 --2- 172.21.15.5:0/3147487100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0b6bf0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f802c0097a0 tx=0x7f802c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 -- 172.21.15.5:0/3147487100 shutdown_connections 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 --2- 172.21.15.5:0/3147487100 >> v2:172.21.15.80:3300/0 conn(0x7f803c0b7130 0x7f803c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 --2- 172.21.15.5:0/3147487100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0b6bf0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 -- 172.21.15.5:0/3147487100 >> 172.21.15.5:0/3147487100 conn(0x7f803c06b000 msgr2=0x7f803c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 -- 172.21.15.5:0/3147487100 shutdown_connections 2024-04-25T09:06:03.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.838+0000 7f804229e640 1 -- 172.21.15.5:0/3147487100 wait complete. 2024-04-25T09:06:03.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.839+0000 7f804229e640 1 Processor -- start 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.839+0000 7f804229e640 1 -- start start 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f804229e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f804229e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f803c0b7130 0x7f803c0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f804229e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c15de70 0x7f803c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f804229e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0cf0c0 con 0x7f803c0b2cc0 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f804229e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0cef40 con 0x7f803c15de70 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f804229e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0b5e30 con 0x7f803c0b7130 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f803bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f803bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57706/0 (socket says 172.21.15.5:57706) 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.840+0000 7f803bfff640 1 -- 172.21.15.5:0/1598066160 learned_addr learned my addr 172.21.15.5:0/1598066160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f803bfff640 1 -- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f803c0b7130 msgr2=0x7f803c0cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f803b7fe640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f803c0b7130 0x7f803c0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f804083b640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c15de70 0x7f803c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f803bfff640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f803c0b7130 0x7f803c0cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f803bfff640 1 -- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c15de70 msgr2=0x7f803c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f803bfff640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c15de70 0x7f803c0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f803bfff640 1 -- 172.21.15.5:0/1598066160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0b5220 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f803bfff640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0caba0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f803000c3f0 tx=0x7f803000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f8038ff9640 1 -- 172.21.15.5:0/1598066160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030017070 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f8038ff9640 1 -- 172.21.15.5:0/1598066160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030005ce0 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c0b5500 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f8038ff9640 1 -- 172.21.15.5:0/1598066160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300072f0 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.841+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c0b5ac0 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.842+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c04ef20 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.842+0000 7f8038ff9640 1 -- 172.21.15.5:0/1598066160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f803001a070 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.843+0000 7f8038ff9640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f802806b500 0x7f802806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.843+0000 7f8038ff9640 1 -- 172.21.15.5:0/1598066160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8030089630 con 0x7f803c0b2cc0 2024-04-25T09:06:03.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.843+0000 7f803b7fe640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f802806b500 0x7f802806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.844+0000 7f803b7fe640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f802806b500 0x7f802806d9c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f802c034000 tx=0x7f802c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:03.847+0000 7f8038ff9640 1 -- 172.21.15.5:0/1598066160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8030058420 con 0x7f803c0b2cc0 2024-04-25T09:06:04.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.028+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f803c071800 con 0x7f803c0b2cc0 2024-04-25T09:06:04.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.029+0000 7f8038ff9640 1 -- 172.21.15.5:0/1598066160 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16761 (secure 0 0 0) 0x7f8030057d20 con 0x7f803c0b2cc0 2024-04-25T09:06:04.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:04.018 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:05:50.147831+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:11.572493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:12.274797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.e","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/778491752":"2024-04-26T09:05:50.147770+0000","172.21.15.5:6834/778491752":"2024-04-26T09:05:50.147770+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:04.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f802806b500 msgr2=0x7f802806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f802806b500 0x7f802806d9c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f802c034000 tx=0x7f802c02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 msgr2=0x7f803c0caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0caba0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f803000c3f0 tx=0x7f803000c8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 shutdown_connections 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f802806b500 0x7f802806d9c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c15de70 0x7f803c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f803c0b7130 0x7f803c0cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 --2- 172.21.15.5:0/1598066160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f803c0b2cc0 0x7f803c0caba0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 >> 172.21.15.5:0/1598066160 conn(0x7f803c06b000 msgr2=0x7f803c1600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 shutdown_connections 2024-04-25T09:06:04.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.032+0000 7f804229e640 1 -- 172.21.15.5:0/1598066160 wait complete. 2024-04-25T09:06:04.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:06:04.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa075df4640 1 Processor -- start 2024-04-25T09:06:04.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa075df4640 1 -- start start 2024-04-25T09:06:04.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa075df4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0700b2cc0 0x7fa0700b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa075df4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0700b7130 0x7fa0700ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa075df4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700d20e0 con 0x7fa07015de70 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa075df4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0700d2a10 con 0x7fa0700b7130 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa075df4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700d23c0 con 0x7fa0700b2cc0 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa07015de70 0x7fa0700b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45180/0 (socket says 172.21.15.5:45180) 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06f7fe640 1 -- 172.21.15.5:0/3505913926 learned_addr learned my addr 172.21.15.5:0/3505913926 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06ffff640 1 --2- 172.21.15.5:0/3505913926 >> v2:172.21.15.5:3300/0 conn(0x7fa0700b7130 0x7fa0700ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06effd640 1 --2- 172.21.15.5:0/3505913926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0700b2cc0 0x7fa0700b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06e7fc640 1 -- 172.21.15.5:0/3505913926 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842006696 0 0) 0x7fa0700d20e0 con 0x7fa07015de70 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06e7fc640 1 -- 172.21.15.5:0/3505913926 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa058003520 con 0x7fa07015de70 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06ffff640 1 -- 172.21.15.5:0/3505913926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0700b2cc0 msgr2=0x7fa0700b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06ffff640 1 --2- 172.21.15.5:0/3505913926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0700b2cc0 0x7fa0700b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06ffff640 1 -- 172.21.15.5:0/3505913926 >> v1:172.21.15.5:6789/0 conn(0x7fa07015de70 legacy=0x7fa0700b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.146+0000 7fa06ffff640 1 -- 172.21.15.5:0/3505913926 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700d26a0 con 0x7fa0700b7130 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.147+0000 7fa06ffff640 1 --2- 172.21.15.5:0/3505913926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b7130 0x7fa0700ce7f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fa068009d90 tx=0x7fa06802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cb439ac85a401f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.147+0000 7fa06e7fc640 1 -- 172.21.15.5:0/3505913926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068007740 con 0x7fa0700b7130 2024-04-25T09:06:04.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.147+0000 7fa06e7fc640 1 -- 172.21.15.5:0/3505913926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680078e0 con 0x7fa0700b7130 2024-04-25T09:06:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.147+0000 7fa06e7fc640 1 -- 172.21.15.5:0/3505913926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068007cb0 con 0x7fa0700b7130 2024-04-25T09:06:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 -- 172.21.15.5:0/3505913926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b7130 msgr2=0x7fa0700ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 --2- 172.21.15.5:0/3505913926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b7130 0x7fa0700ce7f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fa068009d90 tx=0x7fa06802a660 comp rx=0 tx=0).stop 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 -- 172.21.15.5:0/3505913926 shutdown_connections 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 --2- 172.21.15.5:0/3505913926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b7130 0x7fa0700ce7f0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 --2- 172.21.15.5:0/3505913926 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa0700b2cc0 0x7fa0700b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 -- 172.21.15.5:0/3505913926 >> 172.21.15.5:0/3505913926 conn(0x7fa07006b000 msgr2=0x7fa07006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 -- 172.21.15.5:0/3505913926 shutdown_connections 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.148+0000 7fa075df4640 1 -- 172.21.15.5:0/3505913926 wait complete. 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.149+0000 7fa075df4640 1 Processor -- start 2024-04-25T09:06:04.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.149+0000 7fa075df4640 1 -- start start 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa075df4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b2cc0 0x7fa0700b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa075df4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0700b7130 0x7fa0700c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa075df4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa07015de70 0x7fa0700c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa075df4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700cf0c0 con 0x7fa0700b2cc0 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa075df4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700cef40 con 0x7fa0700b7130 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa075df4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700b5b20 con 0x7fa07015de70 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b2cc0 0x7fa0700b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b2cc0 0x7fa0700b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57730/0 (socket says 172.21.15.5:57730) 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 -- 172.21.15.5:0/3432626567 learned_addr learned my addr 172.21.15.5:0/3432626567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06ffff640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa07015de70 0x7fa0700c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06effd640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0700b7130 0x7fa0700c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 -- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa07015de70 msgr2=0x7fa0700c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa07015de70 0x7fa0700c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 -- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0700b7130 msgr2=0x7fa0700c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0700b7130 0x7fa0700c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 -- 172.21.15.5:0/3432626567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700b5fb0 con 0x7fa0700b2cc0 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa06f7fe640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b2cc0 0x7fa0700b4610 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c390 tx=0x7fa06000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.150+0000 7fa057fff640 1 -- 172.21.15.5:0/3432626567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060017070 con 0x7fa0700b2cc0 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.151+0000 7fa057fff640 1 -- 172.21.15.5:0/3432626567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060005ce0 con 0x7fa0700b2cc0 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.151+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0700b4f10 con 0x7fa0700b2cc0 2024-04-25T09:06:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.151+0000 7fa057fff640 1 -- 172.21.15.5:0/3432626567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600072f0 con 0x7fa0700b2cc0 2024-04-25T09:06:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.151+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0700b54d0 con 0x7fa0700b2cc0 2024-04-25T09:06:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.152+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07004ef20 con 0x7fa0700b2cc0 2024-04-25T09:06:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.152+0000 7fa057fff640 1 -- 172.21.15.5:0/3432626567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa06001a070 con 0x7fa0700b2cc0 2024-04-25T09:06:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.152+0000 7fa057fff640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa05c06b500 0x7fa05c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.153+0000 7fa057fff640 1 -- 172.21.15.5:0/3432626567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa0600896a0 con 0x7fa0700b2cc0 2024-04-25T09:06:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.153+0000 7fa06effd640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa05c06b500 0x7fa05c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.153+0000 7fa06effd640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa05c06b500 0x7fa05c06d9c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa0700d2350 tx=0x7fa064008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.158+0000 7fa057fff640 1 -- 172.21.15.5:0/3432626567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa060058400 con 0x7fa0700b2cc0 2024-04-25T09:06:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.374+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa07006b680 con 0x7fa0700b2cc0 2024-04-25T09:06:04.363 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:06:04.375+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:06:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.376+0000 7fa057fff640 1 -- 172.21.15.5:0/3432626567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa060057d00 con 0x7fa0700b2cc0 2024-04-25T09:06:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa05c06b500 msgr2=0x7fa05c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa05c06b500 0x7fa05c06d9c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa0700d2350 tx=0x7fa064008040 comp rx=0 tx=0).stop 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b2cc0 msgr2=0x7fa0700b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b2cc0 0x7fa0700b4610 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c390 tx=0x7fa06000c850 comp rx=0 tx=0).stop 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 shutdown_connections 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa05c06b500 0x7fa05c06d9c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa07015de70 0x7fa0700c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0700b7130 0x7fa0700c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 --2- 172.21.15.5:0/3432626567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0700b2cc0 0x7fa0700b4610 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 >> 172.21.15.5:0/3432626567 conn(0x7fa07006b000 msgr2=0x7fa070160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 shutdown_connections 2024-04-25T09:06:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.379+0000 7fa075df4640 1 -- 172.21.15.5:0/3432626567 wait complete. 2024-04-25T09:06:04.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:06:04.407 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:06:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.499+0000 7fde0f038640 1 Processor -- start 2024-04-25T09:06:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.499+0000 7fde0f038640 1 -- start start 2024-04-25T09:06:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0f038640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde080b2340 0x7fde080b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0f038640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde080b18c0 0x7fde080b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0f038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b2c60 0x7fde080d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0f038640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde080d03c0 con 0x7fde080b18c0 2024-04-25T09:06:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0f038640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0806ae90 con 0x7fde080b2340 2024-04-25T09:06:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0f038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080cfdb0 con 0x7fde080b2c60 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde080b18c0 0x7fde080b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde080b18c0 0x7fde080b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57754/0 (socket says 172.21.15.5:57754) 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 -- 172.21.15.5:0/746567004 learned_addr learned my addr 172.21.15.5:0/746567004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0d5d5640 1 --2- 172.21.15.5:0/746567004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b2c60 0x7fde080d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0cdd4640 1 --2- 172.21.15.5:0/746567004 >> v2:172.21.15.80:3300/0 conn(0x7fde080b2340 0x7fde080b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 -- 172.21.15.5:0/746567004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b2c60 msgr2=0x7fde080d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 --2- 172.21.15.5:0/746567004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b2c60 0x7fde080d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 -- 172.21.15.5:0/746567004 >> v2:172.21.15.80:3300/0 conn(0x7fde080b2340 msgr2=0x7fde080b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 --2- 172.21.15.5:0/746567004 >> v2:172.21.15.80:3300/0 conn(0x7fde080b2340 0x7fde080b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 -- 172.21.15.5:0/746567004 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0806b130 con 0x7fde080b18c0 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde0cdd4640 1 --2- 172.21.15.5:0/746567004 >> v2:172.21.15.80:3300/0 conn(0x7fde080b2340 0x7fde080b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde07fff640 1 --2- 172.21.15.5:0/746567004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b18c0 0x7fde080b2720 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fde08070d80 tx=0x7fddf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c73ffc6f5924f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde077fe640 1 -- 172.21.15.5:0/746567004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4037070 con 0x7fde080b18c0 2024-04-25T09:06:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde077fe640 1 -- 172.21.15.5:0/746567004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4032440 con 0x7fde080b18c0 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.500+0000 7fde077fe640 1 -- 172.21.15.5:0/746567004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4032810 con 0x7fde080b18c0 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 -- 172.21.15.5:0/746567004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b18c0 msgr2=0x7fde080b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 --2- 172.21.15.5:0/746567004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b18c0 0x7fde080b2720 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fde08070d80 tx=0x7fddf402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 -- 172.21.15.5:0/746567004 shutdown_connections 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 --2- 172.21.15.5:0/746567004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b2c60 0x7fde080d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 --2- 172.21.15.5:0/746567004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b18c0 0x7fde080b2720 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 --2- 172.21.15.5:0/746567004 >> v2:172.21.15.80:3300/0 conn(0x7fde080b2340 0x7fde080b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 -- 172.21.15.5:0/746567004 >> 172.21.15.5:0/746567004 conn(0x7fde080d1a40 msgr2=0x7fde080d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 -- 172.21.15.5:0/746567004 shutdown_connections 2024-04-25T09:06:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.501+0000 7fde0f038640 1 -- 172.21.15.5:0/746567004 wait complete. 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.502+0000 7fde0f038640 1 Processor -- start 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.502+0000 7fde0f038640 1 -- start start 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b18c0 0x7fde080b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde080b2340 0x7fde080b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b2c60 0x7fde080b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde080d1830 con 0x7fde080b2c60 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde080d16b0 con 0x7fde080b2340 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0806bfb0 con 0x7fde080b18c0 2024-04-25T09:06:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b2c60 0x7fde080b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b2c60 0x7fde080b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57758/0 (socket says 172.21.15.5:57758) 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 -- 172.21.15.5:0/4078739384 learned_addr learned my addr 172.21.15.5:0/4078739384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0cdd4640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b18c0 0x7fde080b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde07fff640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde080b2340 0x7fde080b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 -- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b18c0 msgr2=0x7fde080b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b18c0 0x7fde080b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 -- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde080b2340 msgr2=0x7fde080b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde080b2340 0x7fde080b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 -- 172.21.15.5:0/4078739384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080b6790 con 0x7fde080b2c60 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0d5d5640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b2c60 0x7fde080b08b0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fde0000efc0 tx=0x7fde0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde057fa640 1 -- 172.21.15.5:0/4078739384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00018020 con 0x7fde080b2c60 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde057fa640 1 -- 172.21.15.5:0/4078739384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00014480 con 0x7fde080b2c60 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde080b4800 con 0x7fde080b2c60 2024-04-25T09:06:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde057fa640 1 -- 172.21.15.5:0/4078739384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00009e60 con 0x7fde080b2c60 2024-04-25T09:06:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.504+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde080b4dc0 con 0x7fde080b2c60 2024-04-25T09:06:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.505+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0804ef20 con 0x7fde080b2c60 2024-04-25T09:06:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.505+0000 7fde057fa640 1 -- 172.21.15.5:0/4078739384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde00005d10 con 0x7fde080b2c60 2024-04-25T09:06:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.505+0000 7fde057fa640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fddec06b4d0 0x7fddec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.506+0000 7fde057fa640 1 -- 172.21.15.5:0/4078739384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fde0008aea0 con 0x7fde080b2c60 2024-04-25T09:06:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.506+0000 7fde0cdd4640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fddec06b4d0 0x7fddec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.506+0000 7fde0cdd4640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fddec06b4d0 0x7fddec06d990 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009950 tx=0x7fddfc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.510+0000 7fde057fa640 1 -- 172.21.15.5:0/4078739384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde00022030 con 0x7fde080b2c60 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:04.729+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fde080afe50 con 0x7fde080b2c60 2024-04-25T09:06:05.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.386+0000 7fde057fa640 1 -- 172.21.15.5:0/4078739384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) v1 ==== 104+0+0 (secure 0 0 0) 0x7fde00010040 con 0x7fde080b2c60 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fddec06b4d0 msgr2=0x7fddec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fddec06b4d0 0x7fddec06d990 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009950 tx=0x7fddfc008040 comp rx=0 tx=0).stop 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b2c60 msgr2=0x7fde080b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b2c60 0x7fde080b08b0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fde0000efc0 tx=0x7fde0000c490 comp rx=0 tx=0).stop 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 shutdown_connections 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fddec06b4d0 0x7fddec06d990 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde080b2c60 0x7fde080b08b0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde080b2340 0x7fde080b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 --2- 172.21.15.5:0/4078739384 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fde080b18c0 0x7fde080b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 >> 172.21.15.5:0/4078739384 conn(0x7fde080d1a40 msgr2=0x7fde080d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 shutdown_connections 2024-04-25T09:06:05.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.390+0000 7fde0f038640 1 -- 172.21.15.5:0/4078739384 wait complete. 2024-04-25T09:06:05.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:06:05.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.556+0000 7fad9539e640 1 Processor -- start 2024-04-25T09:06:05.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.556+0000 7fad9539e640 1 -- start start 2024-04-25T09:06:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad9539e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad900d0af0 0x7fad900d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad9539e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad900d2500 0x7fad900b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad9539e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad900b6ed0 con 0x7fad90161610 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad9539e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad901619f0 con 0x7fad900d2500 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad9539e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad900b74c0 con 0x7fad900d0af0 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad900d2500 0x7fad900b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad900d2500 0x7fad900b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57766/0 (socket says 172.21.15.5:57766) 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8f7fe640 1 -- 172.21.15.5:0/1384238036 learned_addr learned my addr 172.21.15.5:0/1384238036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8e7fc640 1 --2- 172.21.15.5:0/1384238036 >> v2:172.21.15.80:3300/0 conn(0x7fad900d0af0 0x7fad900d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8f7fe640 1 -- 172.21.15.5:0/1384238036 >> v2:172.21.15.80:3300/0 conn(0x7fad900d0af0 msgr2=0x7fad900d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8f7fe640 1 --2- 172.21.15.5:0/1384238036 >> v2:172.21.15.80:3300/0 conn(0x7fad900d0af0 0x7fad900d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8f7fe640 1 -- 172.21.15.5:0/1384238036 >> v1:172.21.15.80:6789/0 conn(0x7fad90161610 legacy=0x7fad900d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.557+0000 7fad8f7fe640 1 -- 172.21.15.5:0/1384238036 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad900d2d90 con 0x7fad900d2500 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.558+0000 7fad8f7fe640 1 --2- 172.21.15.5:0/1384238036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d2500 0x7fad900b7950 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fad900b7640 tx=0x7fad8002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ec3dcea3eb346a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.558+0000 7fad8dffb640 1 -- 172.21.15.5:0/1384238036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80036070 con 0x7fad900d2500 2024-04-25T09:06:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.558+0000 7fad8dffb640 1 -- 172.21.15.5:0/1384238036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80031600 con 0x7fad900d2500 2024-04-25T09:06:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.558+0000 7fad8dffb640 1 -- 172.21.15.5:0/1384238036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad800319d0 con 0x7fad900d2500 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 -- 172.21.15.5:0/1384238036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d2500 msgr2=0x7fad900b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 --2- 172.21.15.5:0/1384238036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d2500 0x7fad900b7950 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fad900b7640 tx=0x7fad8002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 -- 172.21.15.5:0/1384238036 shutdown_connections 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 --2- 172.21.15.5:0/1384238036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d2500 0x7fad900b7950 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 --2- 172.21.15.5:0/1384238036 >> v2:172.21.15.80:3300/0 conn(0x7fad900d0af0 0x7fad900d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 -- 172.21.15.5:0/1384238036 >> 172.21.15.5:0/1384238036 conn(0x7fad900668f0 msgr2=0x7fad90066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 -- 172.21.15.5:0/1384238036 shutdown_connections 2024-04-25T09:06:05.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.559+0000 7fad9539e640 1 -- 172.21.15.5:0/1384238036 wait complete. 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.560+0000 7fad9539e640 1 Processor -- start 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.560+0000 7fad9539e640 1 -- start start 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad9539e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d0af0 0x7fad900ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad9539e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad900d2500 0x7fad900b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad9539e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad90161610 0x7fad901489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad9539e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad900d2950 con 0x7fad900d0af0 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad9539e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad900b7150 con 0x7fad900d2500 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad9539e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad900d2ad0 con 0x7fad90161610 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d0af0 0x7fad900ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d0af0 0x7fad900ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57782/0 (socket says 172.21.15.5:57782) 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 -- 172.21.15.5:0/3024458841 learned_addr learned my addr 172.21.15.5:0/3024458841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8f7fe640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad90161610 0x7fad901489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8e7fc640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad900d2500 0x7fad900b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 -- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad90161610 msgr2=0x7fad901489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad90161610 0x7fad901489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 -- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad900d2500 msgr2=0x7fad900b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad900d2500 0x7fad900b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.561+0000 7fad8effd640 1 -- 172.21.15.5:0/3024458841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad901f7a00 con 0x7fad900d0af0 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.562+0000 7fad8effd640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d0af0 0x7fad900ccda0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c3c0 tx=0x7fad8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.562+0000 7fad777fe640 1 -- 172.21.15.5:0/3024458841 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880052d0 con 0x7fad900d0af0 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.562+0000 7fad777fe640 1 -- 172.21.15.5:0/3024458841 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88005490 con 0x7fad900d0af0 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.562+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad901f7ce0 con 0x7fad900d0af0 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.562+0000 7fad777fe640 1 -- 172.21.15.5:0/3024458841 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88007260 con 0x7fad900d0af0 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.562+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad901f82a0 con 0x7fad900d0af0 2024-04-25T09:06:05.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.563+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad901f84a0 con 0x7fad900d0af0 2024-04-25T09:06:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.563+0000 7fad777fe640 1 -- 172.21.15.5:0/3024458841 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad88007400 con 0x7fad900d0af0 2024-04-25T09:06:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.564+0000 7fad777fe640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad7c06b4d0 0x7fad7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.564+0000 7fad777fe640 1 -- 172.21.15.5:0/3024458841 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fad88089770 con 0x7fad900d0af0 2024-04-25T09:06:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.564+0000 7fad8e7fc640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad7c06b4d0 0x7fad7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.565+0000 7fad8e7fc640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad7c06b4d0 0x7fad7c06d990 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fad9015c3f0 tx=0x7fad84008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.568+0000 7fad777fe640 1 -- 172.21.15.5:0/3024458841 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad900b6ed0 con 0x7fad900d0af0 2024-04-25T09:06:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:05.749+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad9004ef20 con 0x7fad900d0af0 2024-04-25T09:06:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.388+0000 7fad777fe640 1 -- 172.21.15.5:0/3024458841 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v130) v1 ==== 181+0+0 (secure 0 0 0) 0x7fad88058590 con 0x7fad900d0af0 2024-04-25T09:06:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:06:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.391+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad7c06b4d0 msgr2=0x7fad7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.391+0000 7fad9539e640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad7c06b4d0 0x7fad7c06d990 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fad9015c3f0 tx=0x7fad84008040 comp rx=0 tx=0).stop 2024-04-25T09:06:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.391+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d0af0 msgr2=0x7fad900ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.391+0000 7fad9539e640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d0af0 0x7fad900ccda0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c3c0 tx=0x7fad8800c880 comp rx=0 tx=0).stop 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 shutdown_connections 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad7c06b4d0 0x7fad7c06d990 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad90161610 0x7fad901489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad900d2500 0x7fad900b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 --2- 172.21.15.5:0/3024458841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad900d0af0 0x7fad900ccda0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 >> 172.21.15.5:0/3024458841 conn(0x7fad900668f0 msgr2=0x7fad9015fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 shutdown_connections 2024-04-25T09:06:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.392+0000 7fad9539e640 1 -- 172.21.15.5:0/3024458841 wait complete. 2024-04-25T09:06:06.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:06:06.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.513+0000 7f5cbcd3b640 1 Processor -- start 2024-04-25T09:06:06.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.513+0000 7f5cbcd3b640 1 -- start start 2024-04-25T09:06:06.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cbcd3b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cb815dc50 0x7f5cb806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cbcd3b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb8162080 0x7f5cb80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cbcd3b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80b0e80 con 0x7f5cb815e030 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cbcd3b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb806be20 con 0x7f5cb8162080 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cbcd3b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb80b1120 con 0x7f5cb815dc50 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb8162080 0x7f5cb80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb5d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5cb815e030 0x7f5cb8161970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45194/0 (socket says 172.21.15.5:45194) 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb5d9b640 1 -- 172.21.15.5:0/2885859650 learned_addr learned my addr 172.21.15.5:0/2885859650 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb659c640 1 --2- 172.21.15.5:0/2885859650 >> v2:172.21.15.80:3300/0 conn(0x7f5cb815dc50 0x7f5cb806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb6d9d640 1 -- 172.21.15.5:0/2885859650 >> v2:172.21.15.80:3300/0 conn(0x7f5cb815dc50 msgr2=0x7f5cb806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb6d9d640 1 --2- 172.21.15.5:0/2885859650 >> v2:172.21.15.80:3300/0 conn(0x7f5cb815dc50 0x7f5cb806b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb6d9d640 1 -- 172.21.15.5:0/2885859650 >> v1:172.21.15.5:6789/0 conn(0x7f5cb815e030 legacy=0x7f5cb8161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.514+0000 7f5cb6d9d640 1 -- 172.21.15.5:0/2885859650 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80b1400 con 0x7f5cb8162080 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.515+0000 7f5cb6d9d640 1 --2- 172.21.15.5:0/2885859650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb8162080 0x7f5cb80b1c00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80d29a0 tx=0x7f5cb002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c124fba141777625 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.515+0000 7f5cb559a640 1 -- 172.21.15.5:0/2885859650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0007740 con 0x7f5cb8162080 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.515+0000 7f5cb559a640 1 -- 172.21.15.5:0/2885859650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb00078e0 con 0x7f5cb8162080 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.515+0000 7f5cb559a640 1 -- 172.21.15.5:0/2885859650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0007cb0 con 0x7f5cb8162080 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.515+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/2885859650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb8162080 msgr2=0x7f5cb80b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.515+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/2885859650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb8162080 0x7f5cb80b1c00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80d29a0 tx=0x7f5cb002a570 comp rx=0 tx=0).stop 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.516+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/2885859650 shutdown_connections 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.516+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/2885859650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb8162080 0x7f5cb80b1c00 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.516+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/2885859650 >> v2:172.21.15.80:3300/0 conn(0x7f5cb815dc50 0x7f5cb806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.516+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/2885859650 >> 172.21.15.5:0/2885859650 conn(0x7f5cb80b34a0 msgr2=0x7f5cb80b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.516+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/2885859650 shutdown_connections 2024-04-25T09:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.516+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/2885859650 wait complete. 2024-04-25T09:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.517+0000 7f5cbcd3b640 1 Processor -- start 2024-04-25T09:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.517+0000 7f5cbcd3b640 1 -- start start 2024-04-25T09:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cbcd3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb815dc50 0x7f5cb80c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cbcd3b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5cb815e030 0x7f5cb80c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cbcd3b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cb8162080 0x7f5cb80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cbcd3b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8162530 con 0x7f5cb815dc50 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cbcd3b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb806bb30 con 0x7f5cb8162080 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cbcd3b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb81626b0 con 0x7f5cb815e030 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb815dc50 0x7f5cb80c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb815dc50 0x7f5cb80c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57798/0 (socket says 172.21.15.5:57798) 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 -- 172.21.15.5:0/3350888206 learned_addr learned my addr 172.21.15.5:0/3350888206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb5d9b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5cb815e030 0x7f5cb80c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb6d9d640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cb8162080 0x7f5cb80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 -- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5cb815e030 msgr2=0x7f5cb80c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5cb815e030 0x7f5cb80c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 -- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cb8162080 msgr2=0x7f5cb80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cb8162080 0x7f5cb80c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 -- 172.21.15.5:0/3350888206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80b5c20 con 0x7f5cb815dc50 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb5d9b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5cb815e030 0x7f5cb80c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb6d9d640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cb8162080 0x7f5cb80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.518+0000 7f5cb659c640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb815dc50 0x7f5cb80c5d90 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c7f0 tx=0x7f5ca800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.519+0000 7f5ca6ffd640 1 -- 172.21.15.5:0/3350888206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8015070 con 0x7f5cb815dc50 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.519+0000 7f5ca6ffd640 1 -- 172.21.15.5:0/3350888206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8004220 con 0x7f5cb815dc50 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.519+0000 7f5ca6ffd640 1 -- 172.21.15.5:0/3350888206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8007620 con 0x7f5cb815dc50 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.519+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb80b5ec0 con 0x7f5cb815dc50 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.519+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb80b6480 con 0x7f5cb815dc50 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.520+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb804ef20 con 0x7f5cb815dc50 2024-04-25T09:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.520+0000 7f5ca6ffd640 1 -- 172.21.15.5:0/3350888206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ca80079d0 con 0x7f5cb815dc50 2024-04-25T09:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.520+0000 7f5ca6ffd640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c9806b4d0 0x7f5c9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.521+0000 7f5ca6ffd640 1 -- 172.21.15.5:0/3350888206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5501+0+0 (secure 0 0 0) 0x7f5ca808a470 con 0x7f5cb815dc50 2024-04-25T09:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.521+0000 7f5cb5d9b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c9806b4d0 0x7f5c9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.521+0000 7f5cb5d9b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c9806b4d0 0x7f5c9806d990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80cf050 tx=0x7f5cac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.525+0000 7f5ca6ffd640 1 -- 172.21.15.5:0/3350888206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ca80593b0 con 0x7f5cb815dc50 2024-04-25T09:06:06.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:06.709+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5cb80b3280 con 0x7f5cb815dc50 2024-04-25T09:06:07.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.393+0000 7f5ca6ffd640 1 -- 172.21.15.5:0/3350888206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v131) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5ca8058cb0 con 0x7f5cb815dc50 2024-04-25T09:06:07.380 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c9806b4d0 msgr2=0x7f5c9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c9806b4d0 0x7f5c9806d990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80cf050 tx=0x7f5cac009040 comp rx=0 tx=0).stop 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb815dc50 msgr2=0x7f5cb80c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb815dc50 0x7f5cb80c5d90 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c7f0 tx=0x7f5ca800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 shutdown_connections 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5c9806b4d0 0x7f5c9806d990 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cb8162080 0x7f5cb80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5cb815e030 0x7f5cb80c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 --2- 172.21.15.5:0/3350888206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb815dc50 0x7f5cb80c5d90 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 >> 172.21.15.5:0/3350888206 conn(0x7f5cb80b34a0 msgr2=0x7f5cb80b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:07.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 shutdown_connections 2024-04-25T09:06:07.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.397+0000 7f5cbcd3b640 1 -- 172.21.15.5:0/3350888206 wait complete. 2024-04-25T09:06:07.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:06:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.545+0000 7f2ce9e5d640 1 Processor -- start 2024-04-25T09:06:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.546+0000 7f2ce9e5d640 1 -- start start 2024-04-25T09:06:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.546+0000 7f2ce9e5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.546+0000 7f2ce9e5d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ce40cee10 0x7f2ce40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.546+0000 7f2ce9e5d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce4162150 con 0x7f2ce415df10 2024-04-25T09:06:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.546+0000 7f2ce9e5d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40d20d0 con 0x7f2ce40cee10 2024-04-25T09:06:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.546+0000 7f2ce9e5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4162430 con 0x7f2ce40b6250 2024-04-25T09:06:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce2ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce2ffd640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce40ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:57798/0 (socket says 172.21.15.5:57798) 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/3074703209 learned_addr learned my addr 172.21.15.5:0/3074703209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ce40cee10 0x7f2ce40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce37fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2ce415df10 0x7f2ce41618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:37058/0 (socket says 172.21.15.5:37058) 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/3074703209 >> v2:172.21.15.80:3300/0 conn(0x7f2ce40cee10 msgr2=0x7f2ce40d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce2ffd640 1 --2- 172.21.15.5:0/3074703209 >> v2:172.21.15.80:3300/0 conn(0x7f2ce40cee10 0x7f2ce40d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce27fc640 1 -- 172.21.15.5:0/3074703209 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903240361 0 0) 0x7f2ce4162150 con 0x7f2ce415df10 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/3074703209 >> v1:172.21.15.80:6789/0 conn(0x7f2ce415df10 legacy=0x7f2ce41618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.547+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/3074703209 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4162710 con 0x7f2ce40b6250 2024-04-25T09:06:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce2ffd640 1 --2- 172.21.15.5:0/3074703209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce40ce8d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009870 tx=0x7f2ccc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794ec1d65dfa275 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce27fc640 1 -- 172.21.15.5:0/3074703209 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc037070 con 0x7f2ce40b6250 2024-04-25T09:06:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce27fc640 1 -- 172.21.15.5:0/3074703209 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc032440 con 0x7f2ce40b6250 2024-04-25T09:06:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce27fc640 1 -- 172.21.15.5:0/3074703209 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc032810 con 0x7f2ce40b6250 2024-04-25T09:06:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/3074703209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 msgr2=0x7f2ce40ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/3074703209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce40ce8d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009870 tx=0x7f2ccc02a270 comp rx=0 tx=0).stop 2024-04-25T09:06:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/3074703209 shutdown_connections 2024-04-25T09:06:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/3074703209 >> v2:172.21.15.80:3300/0 conn(0x7f2ce40cee10 0x7f2ce40d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/3074703209 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce40ce8d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/3074703209 >> 172.21.15.5:0/3074703209 conn(0x7f2ce40668f0 msgr2=0x7f2ce4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/3074703209 shutdown_connections 2024-04-25T09:06:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.548+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/3074703209 wait complete. 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 Processor -- start 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 -- start start 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce40cee10 0x7f2ce415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce415df10 0x7f2ce40cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40d2c20 con 0x7f2ce40cee10 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40d2aa0 con 0x7f2ce415df10 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.550+0000 7f2ce9e5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40d2da0 con 0x7f2ce40b6250 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce40cee10 0x7f2ce415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce40cee10 0x7f2ce415f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57800/0 (socket says 172.21.15.5:57800) 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/1982041187 learned_addr learned my addr 172.21.15.5:0/1982041187 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce37fe640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce3fff640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce415df10 0x7f2ce40cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 msgr2=0x7f2ce4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce4158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce415df10 msgr2=0x7f2ce40cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce415df10 0x7f2ce40cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 -- 172.21.15.5:0/1982041187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce415e6d0 con 0x7f2ce40cee10 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce2ffd640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce40cee10 0x7f2ce415f770 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc000c00 tx=0x7f2ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2cdbfff640 1 -- 172.21.15.5:0/1982041187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc037040 con 0x7f2ce40cee10 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2cdbfff640 1 -- 172.21.15.5:0/1982041187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc042070 con 0x7f2ce40cee10 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce415e9b0 con 0x7f2ce40cee10 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2cdbfff640 1 -- 172.21.15.5:0/1982041187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc030880 con 0x7f2ce40cee10 2024-04-25T09:06:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.551+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce415ef70 con 0x7f2ce40cee10 2024-04-25T09:06:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.552+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce404ef20 con 0x7f2ce40cee10 2024-04-25T09:06:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.553+0000 7f2cdbfff640 1 -- 172.21.15.5:0/1982041187 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ccc030a20 con 0x7f2ce40cee10 2024-04-25T09:06:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.553+0000 7f2cdbfff640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2cc406b4d0 0x7f2cc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.553+0000 7f2cdbfff640 1 -- 172.21.15.5:0/1982041187 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2ccc0aa640 con 0x7f2ce40cee10 2024-04-25T09:06:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.553+0000 7f2ce37fe640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2cc406b4d0 0x7f2cc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.554+0000 7f2ce37fe640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2cc406b4d0 0x7f2cc406d990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40012e0 tx=0x7f2cd4001630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:07.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.558+0000 7f2cdbfff640 1 -- 172.21.15.5:0/1982041187 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ccc0791a0 con 0x7f2ce40cee10 2024-04-25T09:06:07.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.737+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2ce415cb10 con 0x7f2ce40cee10 2024-04-25T09:06:07.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.740+0000 7f2cdbfff640 1 -- 172.21.15.5:0/1982041187 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2ccc07d240 con 0x7f2ce40cee10 2024-04-25T09:06:07.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2cc406b4d0 msgr2=0x7f2cc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2cc406b4d0 0x7f2cc406d990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40012e0 tx=0x7f2cd4001630 comp rx=0 tx=0).stop 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce40cee10 msgr2=0x7f2ce415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce40cee10 0x7f2ce415f770 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc000c00 tx=0x7f2ccc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 shutdown_connections 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2cc406b4d0 0x7f2cc406d990 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce415df10 0x7f2ce40cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce40cee10 0x7f2ce415f770 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 --2- 172.21.15.5:0/1982041187 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2ce40b6250 0x7f2ce4158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 >> 172.21.15.5:0/1982041187 conn(0x7f2ce40668f0 msgr2=0x7f2ce40b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 shutdown_connections 2024-04-25T09:06:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.742+0000 7f2ce9e5d640 1 -- 172.21.15.5:0/1982041187 wait complete. 2024-04-25T09:06:07.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-04-25T09:06:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.854+0000 7f427909e640 1 Processor -- start 2024-04-25T09:06:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.854+0000 7f427909e640 1 -- start start 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f427909e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f427415de70 0x7f42740b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f427909e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740d20e0 con 0x7f42740ce7f0 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f427909e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740d23c0 con 0x7f42740b2cc0 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f427909e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42740d2a10 con 0x7f427415de70 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f427359e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42740ce7f0 0x7f42740cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45200/0 (socket says 172.21.15.5:45200) 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f427359e640 1 -- 172.21.15.5:0/435408198 learned_addr learned my addr 172.21.15.5:0/435408198 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f4272d9d640 1 --2- 172.21.15.5:0/435408198 >> v2:172.21.15.80:3300/0 conn(0x7f427415de70 0x7f42740b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124335400 0 0) 0x7f42740d20e0 con 0x7f42740ce7f0 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.855+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4260003520 con 0x7f42740ce7f0 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2632414101 0 0) 0x7f4260003520 con 0x7f42740ce7f0 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 >> v2:172.21.15.80:3300/0 conn(0x7f427415de70 msgr2=0x7f42740b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 --2- 172.21.15.5:0/435408198 >> v2:172.21.15.80:3300/0 conn(0x7f427415de70 0x7f42740b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 >> v1:172.21.15.80:6789/0 conn(0x7f42740b2cc0 legacy=0x7f42740b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42740d26a0 con 0x7f42740ce7f0 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f42640019f0 con 0x7f42740ce7f0 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 >> v1:172.21.15.5:6789/0 conn(0x7f42740ce7f0 legacy=0x7f42740cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42600039b0 0x7f4260003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600043b0 0x7f4260004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260005080 0x7f426000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740d2a10 con 0x7f42600039b0 2024-04-25T09:06:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426000bfe0 con 0x7f4260005080 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426000c1e0 con 0x7f42600043b0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4272d9d640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42600039b0 0x7f4260003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f427359e640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260005080 0x7f426000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f427259c640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600043b0 0x7f4260004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4272d9d640 1 -- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600043b0 msgr2=0x7f4260004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4272d9d640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600043b0 0x7f4260004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4272d9d640 1 -- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260005080 msgr2=0x7f426000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4272d9d640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260005080 0x7f426000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f4272d9d640 1 -- 172.21.15.5:0/435408198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260003520 con 0x7f42600039b0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.856+0000 7f427359e640 1 -- 172.21.15.5:0/435408198 reap_dead start 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.857+0000 7f4272d9d640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42600039b0 0x7f4260003d90 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f426c009ac0 tx=0x7f4260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b1a41baa574345 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.857+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c036070 con 0x7f42600039b0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.857+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c031400 con 0x7f42600039b0 2024-04-25T09:06:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.857+0000 7f4271d9b640 1 -- 172.21.15.5:0/435408198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c009690 con 0x7f42600039b0 2024-04-25T09:06:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.857+0000 7f427909e640 1 -- 172.21.15.5:0/435408198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42600039b0 msgr2=0x7f4260003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.857+0000 7f427909e640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42600039b0 0x7f4260003d90 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f426c009ac0 tx=0x7f4260005830 comp rx=0 tx=0).stop 2024-04-25T09:06:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.858+0000 7f427909e640 1 -- 172.21.15.5:0/435408198 shutdown_connections 2024-04-25T09:06:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.858+0000 7f427909e640 1 --2- 172.21.15.5:0/435408198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42600039b0 0x7f4260003d90 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.858+0000 7f427909e640 1 -- 172.21.15.5:0/435408198 >> 172.21.15.5:0/435408198 conn(0x7f427406b000 msgr2=0x7f427406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.858+0000 7f427909e640 1 -- 172.21.15.5:0/435408198 shutdown_connections 2024-04-25T09:06:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.858+0000 7f427909e640 1 -- 172.21.15.5:0/435408198 wait complete. 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.859+0000 7f427909e640 1 Processor -- start 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.859+0000 7f427909e640 1 -- start start 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427909e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600039b0 0x7f427414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427909e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b4610 0x7f4274160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427909e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42740b4a90 0x7f4274160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427909e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740cf010 con 0x7f42740b4610 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427909e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740cee90 con 0x7f42740b4a90 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427909e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42740cf190 con 0x7f42600039b0 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b4610 0x7f4274160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b4610 0x7f4274160440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57816/0 (socket says 172.21.15.5:57816) 2024-04-25T09:06:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 -- 172.21.15.5:0/483051059 learned_addr learned my addr 172.21.15.5:0/483051059 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427359e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42740b4a90 0x7f4274160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 -- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600039b0 msgr2=0x7f427414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600039b0 0x7f427414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 -- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42740b4a90 msgr2=0x7f4274160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42740b4a90 0x7f4274160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 -- 172.21.15.5:0/483051059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42740b4f80 con 0x7f42740b4610 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427359e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42740b4a90 0x7f4274160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.860+0000 7f427259c640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b4610 0x7f4274160440 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f425c00f800 tx=0x7f425c00fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.861+0000 7f426b7fe640 1 -- 172.21.15.5:0/483051059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0052e0 con 0x7f42740b4610 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.861+0000 7f426b7fe640 1 -- 172.21.15.5:0/483051059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c018070 con 0x7f42740b4610 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.861+0000 7f426b7fe640 1 -- 172.21.15.5:0/483051059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00d910 con 0x7f42740b4610 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.861+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42740b5260 con 0x7f42740b4610 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.861+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427414c7d0 con 0x7f42740b4610 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.862+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427404ef20 con 0x7f42740b4610 2024-04-25T09:06:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.862+0000 7f426b7fe640 1 -- 172.21.15.5:0/483051059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f425c00dab0 con 0x7f42740b4610 2024-04-25T09:06:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.862+0000 7f426b7fe640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f425406b500 0x7f425406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.863+0000 7f426b7fe640 1 -- 172.21.15.5:0/483051059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f425c089e90 con 0x7f42740b4610 2024-04-25T09:06:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.863+0000 7f4272d9d640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f425406b500 0x7f425406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.863+0000 7f4272d9d640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f425406b500 0x7f425406d9c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f426c033000 tx=0x7f426c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:07.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:07.867+0000 7f426b7fe640 1 -- 172.21.15.5:0/483051059 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f425c01a310 con 0x7f42740b4610 2024-04-25T09:06:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.119+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f4274068cb0 con 0x7f42740b4610 2024-04-25T09:06:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.394+0000 7f426b7fe640 1 -- 172.21.15.5:0/483051059 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v461) v1 ==== 166+0+0 (secure 0 0 0) 0x7f425c058fb0 con 0x7f42740b4610 2024-04-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f425406b500 msgr2=0x7f425406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f425406b500 0x7f425406d9c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f426c033000 tx=0x7f426c02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b4610 msgr2=0x7f4274160440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b4610 0x7f4274160440 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f425c00f800 tx=0x7f425c00fcc0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 shutdown_connections 2024-04-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f425406b500 0x7f425406d9c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42740b4a90 0x7f4274160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b4610 0x7f4274160440 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 --2- 172.21.15.5:0/483051059 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42600039b0 0x7f427414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 >> 172.21.15.5:0/483051059 conn(0x7f427406b000 msgr2=0x7f42740b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 shutdown_connections 2024-04-25T09:06:08.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.396+0000 7f427909e640 1 -- 172.21.15.5:0/483051059 wait complete. 2024-04-25T09:06:08.395 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:06:08.396 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:06:08.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:08.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.510+0000 7f9e0109e640 1 Processor -- start 2024-04-25T09:06:08.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.510+0000 7f9e0109e640 1 -- start start 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.510+0000 7f9e0109e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9dfc15de70 0x7f9dfc0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.510+0000 7f9e0109e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dfc0ce7f0 0x7f9dfc0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.510+0000 7f9e0109e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0cf1c0 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.510+0000 7f9e0109e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0d2a10 con 0x7f9dfc0ce7f0 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.510+0000 7f9e0109e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0d20e0 con 0x7f9dfc15de70 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.511+0000 7f9dfb59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dfc0ce7f0 0x7f9dfc0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.511+0000 7f9dfb59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dfc0ce7f0 0x7f9dfc0cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57820/0 (socket says 172.21.15.5:57820) 2024-04-25T09:06:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.511+0000 7f9dfb59e640 1 -- 172.21.15.5:0/2980390256 learned_addr learned my addr 172.21.15.5:0/2980390256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.511+0000 7f9dfb59e640 1 -- 172.21.15.5:0/2980390256 >> v2:172.21.15.80:3300/0 conn(0x7f9dfc15de70 msgr2=0x7f9dfc0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.511+0000 7f9dfb59e640 1 --2- 172.21.15.5:0/2980390256 >> v2:172.21.15.80:3300/0 conn(0x7f9dfc15de70 0x7f9dfc0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.511+0000 7f9dfb59e640 1 -- 172.21.15.5:0/2980390256 >> v1:172.21.15.80:6789/0 conn(0x7f9dfc0b2cc0 legacy=0x7f9dfc0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.511+0000 7f9dfb59e640 1 -- 172.21.15.5:0/2980390256 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0d23c0 con 0x7f9dfc0ce7f0 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9dfb59e640 1 --2- 172.21.15.5:0/2980390256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0ce7f0 0x7f9dfc0cec80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0d1650 tx=0x7f9df402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5ceddd40978676 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9dfa59c640 1 -- 172.21.15.5:0/2980390256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4036070 con 0x7f9dfc0ce7f0 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9dfa59c640 1 -- 172.21.15.5:0/2980390256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4031600 con 0x7f9dfc0ce7f0 2024-04-25T09:06:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9dfa59c640 1 -- 172.21.15.5:0/2980390256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40319d0 con 0x7f9dfc0ce7f0 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 -- 172.21.15.5:0/2980390256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0ce7f0 msgr2=0x7f9dfc0cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 --2- 172.21.15.5:0/2980390256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0ce7f0 0x7f9dfc0cec80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0d1650 tx=0x7f9df402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 -- 172.21.15.5:0/2980390256 shutdown_connections 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 --2- 172.21.15.5:0/2980390256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0ce7f0 0x7f9dfc0cec80 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 --2- 172.21.15.5:0/2980390256 >> v2:172.21.15.80:3300/0 conn(0x7f9dfc15de70 0x7f9dfc0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 -- 172.21.15.5:0/2980390256 >> 172.21.15.5:0/2980390256 conn(0x7f9dfc06b000 msgr2=0x7f9dfc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 -- 172.21.15.5:0/2980390256 shutdown_connections 2024-04-25T09:06:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.512+0000 7f9e0109e640 1 -- 172.21.15.5:0/2980390256 wait complete. 2024-04-25T09:06:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 Processor -- start 2024-04-25T09:06:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 -- start start 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0b2cc0 0x7f9dfc154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dfc0ce7f0 0x7f9dfc0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc15de70 0x7f9dfc0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b7300 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b9920 con 0x7f9dfc15de70 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.514+0000 7f9e0109e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0d2ea0 con 0x7f9dfc0ce7f0 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0b2cc0 0x7f9dfc154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0b2cc0 0x7f9dfc154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57828/0 (socket says 172.21.15.5:57828) 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 -- 172.21.15.5:0/3654618527 learned_addr learned my addr 172.21.15.5:0/3654618527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9df3fff640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dfc0ce7f0 0x7f9dfc0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfb59e640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc15de70 0x7f9dfc0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 -- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dfc0ce7f0 msgr2=0x7f9dfc0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dfc0ce7f0 0x7f9dfc0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 -- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc15de70 msgr2=0x7f9dfc0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc15de70 0x7f9dfc0c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 -- 172.21.15.5:0/3654618527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0c8130 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9dfad9d640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0b2cc0 0x7f9dfc154de0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00b410 tx=0x7f9dec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9df37fe640 1 -- 172.21.15.5:0/3654618527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec015020 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9df37fe640 1 -- 172.21.15.5:0/3654618527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec011850 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0c8410 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9df37fe640 1 -- 172.21.15.5:0/3654618527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011c40 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.515+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc0c7e40 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.516+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc0c85e0 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.517+0000 7f9df37fe640 1 -- 172.21.15.5:0/3654618527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9dec018020 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.517+0000 7f9df37fe640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ddc06b4d0 0x7f9ddc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.517+0000 7f9df37fe640 1 -- 172.21.15.5:0/3654618527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9dec089ee0 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.517+0000 7f9df3fff640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ddc06b4d0 0x7f9ddc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.518+0000 7f9df3fff640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ddc06b4d0 0x7f9ddc06d990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9de4007fd0 tx=0x7f9de4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.521+0000 7f9df37fe640 1 -- 172.21.15.5:0/3654618527 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9dec01f020 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.701+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dfc04ef20 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.702+0000 7f9df37fe640 1 -- 172.21.15.5:0/3654618527 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+13070 (secure 0 0 0) 0x7f9dec0172c0 con 0x7f9dfc0b2cc0 2024-04-25T09:06:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:08.689 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":131,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:07.388957+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/3251950548":"2024-04-26T09:06:04.376105+0000","172.21.15.5:6832/3251950548":"2024-04-26T09:06:04.376105+0000","172.21.15.5:6835/778491752":"2024-04-26T09:05:50.147770+0000","172.21.15.5:6834/778491752":"2024-04-26T09:05:50.147770+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ddc06b4d0 msgr2=0x7f9ddc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ddc06b4d0 0x7f9ddc06d990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9de4007fd0 tx=0x7f9de4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0b2cc0 msgr2=0x7f9dfc154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0b2cc0 0x7f9dfc154de0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00b410 tx=0x7f9dec00b8d0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 shutdown_connections 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f9ddc06b4d0 0x7f9ddc06d990 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc15de70 0x7f9dfc0c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9dfc0ce7f0 0x7f9dfc0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 --2- 172.21.15.5:0/3654618527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dfc0b2cc0 0x7f9dfc154de0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 >> 172.21.15.5:0/3654618527 conn(0x7f9dfc06b000 msgr2=0x7f9dfc068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 shutdown_connections 2024-04-25T09:06:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.704+0000 7f9e0109e640 1 -- 172.21.15.5:0/3654618527 wait complete. 2024-04-25T09:06:08.703 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:08.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.820+0000 7f1c849a5640 1 Processor -- start 2024-04-25T09:06:08.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.820+0000 7f1c849a5640 1 -- start start 2024-04-25T09:06:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c849a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c800d4230 0x7f1c80168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c849a5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800b9b20 con 0x7f1c800b96e0 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c849a5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800d2740 con 0x7f1c801614b0 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c849a5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c800d2a20 con 0x7f1c800d4230 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c7dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c800b96e0 0x7f1c800d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45204/0 (socket says 172.21.15.5:45204) 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c7dd9b640 1 -- 172.21.15.5:0/738054012 learned_addr learned my addr 172.21.15.5:0/738054012 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c7ed9d640 1 --2- 172.21.15.5:0/738054012 >> v2:172.21.15.80:3300/0 conn(0x7f1c800d4230 0x7f1c80168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407834023 0 0) 0x7f1c800b9b20 con 0x7f1c800b96e0 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.821+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c68003520 con 0x7f1c800b96e0 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033583467 0 0) 0x7f1c68003520 con 0x7f1c800b96e0 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 >> v2:172.21.15.80:3300/0 conn(0x7f1c800d4230 msgr2=0x7f1c80168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 --2- 172.21.15.5:0/738054012 >> v2:172.21.15.80:3300/0 conn(0x7f1c800d4230 0x7f1c80168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 >> v1:172.21.15.80:6789/0 conn(0x7f1c801614b0 legacy=0x7f1c800d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800d2d00 con 0x7f1c800b96e0 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f1c74001670 con 0x7f1c800b96e0 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 >> v1:172.21.15.5:6789/0 conn(0x7f1c800b96e0 legacy=0x7f1c800d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c680039b0 0x7f1c68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c68004800 0x7f1c68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680051c0 0x7f1c6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800d2a20 con 0x7f1c680039b0 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6800c060 con 0x7f1c68004800 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6800c260 con 0x7f1c680051c0 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c680039b0 0x7f1c68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7dd9b640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c68004800 0x7f1c68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7ed9d640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680051c0 0x7f1c6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7e59c640 1 -- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680051c0 msgr2=0x7f1c6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680051c0 0x7f1c6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7e59c640 1 -- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c68004800 msgr2=0x7f1c68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c68004800 0x7f1c68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7e59c640 1 -- 172.21.15.5:0/738054012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68003520 con 0x7f1c680039b0 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7ed9d640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680051c0 0x7f1c6800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.822+0000 7f1c7ed9d640 1 -- 172.21.15.5:0/738054012 reap_dead start 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.823+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c680039b0 0x7f1c68003dd0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f1c70001750 tx=0x7f1c68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a12a2eb32c20762 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.823+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70001370 con 0x7f1c680039b0 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.823+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c700052d0 con 0x7f1c680039b0 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.823+0000 7f1c7d59a640 1 -- 172.21.15.5:0/738054012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7002abc0 con 0x7f1c680039b0 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.823+0000 7f1c849a5640 1 -- 172.21.15.5:0/738054012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c680039b0 msgr2=0x7f1c68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.823+0000 7f1c849a5640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c680039b0 0x7f1c68003dd0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f1c70001750 tx=0x7f1c68005830 comp rx=0 tx=0).stop 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.824+0000 7f1c849a5640 1 -- 172.21.15.5:0/738054012 shutdown_connections 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.824+0000 7f1c849a5640 1 --2- 172.21.15.5:0/738054012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c680039b0 0x7f1c68003dd0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.824+0000 7f1c849a5640 1 -- 172.21.15.5:0/738054012 >> 172.21.15.5:0/738054012 conn(0x7f1c8006b000 msgr2=0x7f1c8006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.824+0000 7f1c849a5640 1 -- 172.21.15.5:0/738054012 shutdown_connections 2024-04-25T09:06:08.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.824+0000 7f1c849a5640 1 -- 172.21.15.5:0/738054012 wait complete. 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.825+0000 7f1c849a5640 1 Processor -- start 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.825+0000 7f1c849a5640 1 -- start start 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c849a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680039b0 0x7f1c80154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c849a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c8014afa0 0x7f1c800c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c849a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c800c9a90 0x7f1c800c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c849a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800d37e0 con 0x7f1c8014afa0 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c849a5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800d32c0 con 0x7f1c800c9a90 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c849a5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800d3b20 con 0x7f1c680039b0 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c8014afa0 0x7f1c800c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c8014afa0 0x7f1c800c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57852/0 (socket says 172.21.15.5:57852) 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 -- 172.21.15.5:0/2149555943 learned_addr learned my addr 172.21.15.5:0/2149555943 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680039b0 0x7f1c80154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 -- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680039b0 msgr2=0x7f1c80154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680039b0 0x7f1c80154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7ed9d640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c800c9a90 0x7f1c800c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 -- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c800c9a90 msgr2=0x7f1c800c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c800c9a90 0x7f1c800c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 -- 172.21.15.5:0/2149555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800c7af0 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680039b0 0x7f1c80154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7ed9d640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c800c9a90 0x7f1c800c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c7dd9b640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c8014afa0 0x7f1c800c8b90 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f1c74004ef0 tx=0x7f1c74007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.826+0000 7f1c6effd640 1 -- 172.21.15.5:0/2149555943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400f750 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.827+0000 7f1c6effd640 1 -- 172.21.15.5:0/2149555943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74018070 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.827+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c800c7dd0 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.827+0000 7f1c6effd640 1 -- 172.21.15.5:0/2149555943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400fb70 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.827+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c800c8390 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.828+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c80068670 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.828+0000 7f1c6effd640 1 -- 172.21.15.5:0/2149555943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c7400fd10 con 0x7f1c8014afa0 2024-04-25T09:06:08.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.828+0000 7f1c6effd640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1c6006b500 0x7f1c6006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.829+0000 7f1c6effd640 1 -- 172.21.15.5:0/2149555943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1c74089e40 con 0x7f1c8014afa0 2024-04-25T09:06:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.829+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1c6006b500 0x7f1c6006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.829+0000 7f1c7e59c640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1c6006b500 0x7f1c6006d9c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1c70032000 tx=0x7f1c7002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:08.833+0000 7f1c6effd640 1 -- 172.21.15.5:0/2149555943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c80068670 con 0x7f1c8014afa0 2024-04-25T09:06:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.011+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c8004ef20 con 0x7f1c8014afa0 2024-04-25T09:06:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.012+0000 7f1c6effd640 1 -- 172.21.15.5:0/2149555943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c74058ff0 con 0x7f1c8014afa0 2024-04-25T09:06:08.999 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:06:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.013+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1c6006b500 msgr2=0x7f1c6006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.013+0000 7f1c849a5640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1c6006b500 0x7f1c6006d9c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1c70032000 tx=0x7f1c7002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c8014afa0 msgr2=0x7f1c800c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c8014afa0 0x7f1c800c8b90 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f1c74004ef0 tx=0x7f1c74007430 comp rx=0 tx=0).stop 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 shutdown_connections 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1c6006b500 0x7f1c6006d9c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c800c9a90 0x7f1c800c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c8014afa0 0x7f1c800c8b90 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 --2- 172.21.15.5:0/2149555943 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c680039b0 0x7f1c80154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 >> 172.21.15.5:0/2149555943 conn(0x7f1c8006b000 msgr2=0x7f1c800ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 shutdown_connections 2024-04-25T09:06:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.014+0000 7f1c849a5640 1 -- 172.21.15.5:0/2149555943 wait complete. 2024-04-25T09:06:09.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-04-25T09:06:09.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5f205d640 1 Processor -- start 2024-04-25T09:06:09.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5f205d640 1 -- start start 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5f205d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 0x7fa5ec0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5f205d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec15ef10 con 0x7fa5ec0cea80 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5f205d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec15ff50 con 0x7fa5ec06adf0 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5f205d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0cfd60 con 0x7fa5ec06bd00 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5eb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa5ec0cea80 0x7fa5ec15f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45216/0 (socket says 172.21.15.5:45216) 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.126+0000 7fa5eb7fe640 1 -- 172.21.15.5:0/305782393 learned_addr learned my addr 172.21.15.5:0/305782393 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ebfff640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 0x7fa5ec0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119574118 0 0) 0x7fa5ec15ef10 con 0x7fa5ec0cea80 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d4003520 con 0x7fa5ec0cea80 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704378681 0 0) 0x7fa5d4003520 con 0x7fa5ec0cea80 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 msgr2=0x7fa5ec0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 0x7fa5ec0d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 >> v1:172.21.15.80:6789/0 conn(0x7fa5ec06adf0 legacy=0x7fa5ec06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec15f1a0 con 0x7fa5ec0cea80 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fa5dc001670 con 0x7fa5ec0cea80 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 >> v1:172.21.15.5:6789/0 conn(0x7fa5ec0cea80 legacy=0x7fa5ec15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d40039e0 0x7fa5d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5d4004390 0x7fa5d4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 0x7fa5d40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d400b9c0 con 0x7fa5d4004390 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d400bb70 con 0x7fa5d40039e0 2024-04-25T09:06:09.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d400bd70 con 0x7fa5ec06bd00 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5eaffd640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5d4004390 0x7fa5d4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5eb7fe640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d40039e0 0x7fa5d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.127+0000 7fa5ebfff640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 0x7fa5d40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5eaffd640 1 -- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 msgr2=0x7fa5d40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5eaffd640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5ec06bd00 0x7fa5d40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5eaffd640 1 -- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d40039e0 msgr2=0x7fa5d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5eaffd640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d40039e0 0x7fa5d4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5eaffd640 1 -- 172.21.15.5:0/305782393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4003520 con 0x7fa5d4004390 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5eaffd640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5d4004390 0x7fa5d4004860 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0001860 tx=0x7fa5d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9ef3713c87efeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0037070 con 0x7fa5d4004390 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e002abf0 con 0x7fa5d4004390 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.128+0000 7fa5ea7fc640 1 -- 172.21.15.5:0/305782393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0001430 con 0x7fa5d4004390 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.129+0000 7fa5f205d640 1 -- 172.21.15.5:0/305782393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5d4004390 msgr2=0x7fa5d4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.129+0000 7fa5f205d640 1 --2- 172.21.15.5:0/305782393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5d4004390 0x7fa5d4004860 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0001860 tx=0x7fa5d4005830 comp rx=0 tx=0).stop 2024-04-25T09:06:09.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.129+0000 7fa5ebfff640 1 -- 172.21.15.5:0/305782393 reap_dead start 2024-04-25T09:06:09.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.129+0000 7fa5f205d640 1 -- 172.21.15.5:0/305782393 shutdown_connections 2024-04-25T09:06:09.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.129+0000 7fa5f205d640 1 -- 172.21.15.5:0/305782393 >> 172.21.15.5:0/305782393 conn(0x7fa5ec0d19f0 msgr2=0x7fa5ec0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:09.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.129+0000 7fa5f205d640 1 -- 172.21.15.5:0/305782393 shutdown_connections 2024-04-25T09:06:09.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.129+0000 7fa5f205d640 1 -- 172.21.15.5:0/305782393 wait complete. 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.130+0000 7fa5f205d640 1 Processor -- start 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5f205d640 1 -- start start 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5f205d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5d4004390 0x7fa5ec0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5f205d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec1f3ae0 0x7fa5ec14e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5f205d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec15b0a0 0x7fa5ec15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5f205d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0d0270 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5f205d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec15f480 con 0x7fa5ec15b0a0 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5f205d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0d1660 con 0x7fa5d4004390 2024-04-25T09:06:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec1f3ae0 0x7fa5ec14e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec1f3ae0 0x7fa5ec14e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57872/0 (socket says 172.21.15.5:57872) 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5eaffd640 1 -- 172.21.15.5:0/3879014022 learned_addr learned my addr 172.21.15.5:0/3879014022 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.131+0000 7fa5eb7fe640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5d4004390 0x7fa5ec0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5ebfff640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec15b0a0 0x7fa5ec15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5eaffd640 1 -- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5d4004390 msgr2=0x7fa5ec0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5eaffd640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5d4004390 0x7fa5ec0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5eaffd640 1 -- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec15b0a0 msgr2=0x7fa5ec15b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5eaffd640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec15b0a0 0x7fa5ec15b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5eaffd640 1 -- 172.21.15.5:0/3879014022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec1f4eb0 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5eaffd640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec1f3ae0 0x7fa5ec14e930 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0001980 tx=0x7fa5e0001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5d3fff640 1 -- 172.21.15.5:0/3879014022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e003f020 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5d3fff640 1 -- 172.21.15.5:0/3879014022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e0005270 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec0b60c0 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5d3fff640 1 -- 172.21.15.5:0/3879014022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0037040 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.132+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec1f4330 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.133+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec0b30f0 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.134+0000 7fa5d3fff640 1 -- 172.21.15.5:0/3879014022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa5e0042020 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.134+0000 7fa5d3fff640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa5d806b500 0x7fa5d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.134+0000 7fa5d3fff640 1 -- 172.21.15.5:0/3879014022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa5e00a9bc0 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.134+0000 7fa5eb7fe640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa5d806b500 0x7fa5d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.135+0000 7fa5eb7fe640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa5d806b500 0x7fa5d806d9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc001050 tx=0x7fa5dc001cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.138+0000 7fa5d3fff640 1 -- 172.21.15.5:0/3879014022 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5ec0b30f0 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.388+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) v1 -- 0x7fa5ec04ef20 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.398+0000 7fa5d3fff640 1 -- 172.21.15.5:0/3879014022 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v462) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa5e00ab0e0 con 0x7fa5ec1f3ae0 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa5d806b500 msgr2=0x7fa5d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa5d806b500 0x7fa5d806d9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc001050 tx=0x7fa5dc001cb0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec1f3ae0 msgr2=0x7fa5ec14e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec1f3ae0 0x7fa5ec14e930 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0001980 tx=0x7fa5e0001230 comp rx=0 tx=0).stop 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 shutdown_connections 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fa5d806b500 0x7fa5d806d9c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec15b0a0 0x7fa5ec15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec1f3ae0 0x7fa5ec14e930 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 --2- 172.21.15.5:0/3879014022 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa5d4004390 0x7fa5ec0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 >> 172.21.15.5:0/3879014022 conn(0x7fa5ec0d19f0 msgr2=0x7fa5ec0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 shutdown_connections 2024-04-25T09:06:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.401+0000 7fa5f205d640 1 -- 172.21.15.5:0/3879014022 wait complete. 2024-04-25T09:06:09.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:06:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.516+0000 7fac3033b640 1 Processor -- start 2024-04-25T09:06:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.516+0000 7fac3033b640 1 -- start start 2024-04-25T09:06:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac3033b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac280b72b0 0x7fac280cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac3033b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280d0d20 0x7fac280ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac3033b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac280cc010 con 0x7fac280ce6e0 2024-04-25T09:06:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac3033b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac280cdde0 con 0x7fac280b72b0 2024-04-25T09:06:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac3033b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac280cc2f0 con 0x7fac280d0d20 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac2e0d7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac280b72b0 0x7fac280cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac2e8d8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fac280ce6e0 0x7fac2806b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45232/0 (socket says 172.21.15.5:45232) 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.517+0000 7fac2e8d8640 1 -- 172.21.15.5:0/2875875167 learned_addr learned my addr 172.21.15.5:0/2875875167 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.518+0000 7fac2d8d6640 1 --2- 172.21.15.5:0/2875875167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280d0d20 0x7fac280ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.518+0000 7fac2e0d7640 1 -- 172.21.15.5:0/2875875167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280d0d20 msgr2=0x7fac280ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.518+0000 7fac2e0d7640 1 --2- 172.21.15.5:0/2875875167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280d0d20 0x7fac280ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.518+0000 7fac2e0d7640 1 -- 172.21.15.5:0/2875875167 >> v1:172.21.15.5:6789/0 conn(0x7fac280ce6e0 legacy=0x7fac2806b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.518+0000 7fac2e0d7640 1 -- 172.21.15.5:0/2875875167 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280cc5d0 con 0x7fac280b72b0 2024-04-25T09:06:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.518+0000 7fac2d0d5640 1 -- 172.21.15.5:0/2875875167 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879733418 0 0) 0x7fac280cc010 con 0x7fac280ce6e0 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.518+0000 7fac2e0d7640 1 --2- 172.21.15.5:0/2875875167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280b72b0 0x7fac280cfd70 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fac200097a0 tx=0x7fac2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b2bc1689ea9741 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac2d0d5640 1 -- 172.21.15.5:0/2875875167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20037070 con 0x7fac280b72b0 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac2d0d5640 1 -- 172.21.15.5:0/2875875167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20032440 con 0x7fac280b72b0 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac2d0d5640 1 -- 172.21.15.5:0/2875875167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20032810 con 0x7fac280b72b0 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 -- 172.21.15.5:0/2875875167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280b72b0 msgr2=0x7fac280cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 --2- 172.21.15.5:0/2875875167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280b72b0 0x7fac280cfd70 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fac200097a0 tx=0x7fac2002a180 comp rx=0 tx=0).stop 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 -- 172.21.15.5:0/2875875167 shutdown_connections 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 --2- 172.21.15.5:0/2875875167 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280d0d20 0x7fac280ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 --2- 172.21.15.5:0/2875875167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280b72b0 0x7fac280cfd70 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 -- 172.21.15.5:0/2875875167 >> 172.21.15.5:0/2875875167 conn(0x7fac280d1920 msgr2=0x7fac280d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:09.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 -- 172.21.15.5:0/2875875167 shutdown_connections 2024-04-25T09:06:09.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.519+0000 7fac3033b640 1 -- 172.21.15.5:0/2875875167 wait complete. 2024-04-25T09:06:09.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.520+0000 7fac3033b640 1 Processor -- start 2024-04-25T09:06:09.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac3033b640 1 -- start start 2024-04-25T09:06:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac3033b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280b72b0 0x7fac280cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac3033b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac280ce6e0 0x7fac280c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac3033b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280d0d20 0x7fac280c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac3033b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac280d1550 con 0x7fac280d0d20 2024-04-25T09:06:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac3033b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac280b4770 con 0x7fac280ce6e0 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac3033b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac280d1180 con 0x7fac280b72b0 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac2e8d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280d0d20 0x7fac280c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac2e8d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280d0d20 0x7fac280c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57890/0 (socket says 172.21.15.5:57890) 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac2e8d8640 1 -- 172.21.15.5:0/1760185321 learned_addr learned my addr 172.21.15.5:0/1760185321 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.521+0000 7fac2e0d7640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280b72b0 0x7fac280cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac2d8d6640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac280ce6e0 0x7fac280c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac2e8d8640 1 -- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280b72b0 msgr2=0x7fac280cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac2e8d8640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280b72b0 0x7fac280cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac2e8d8640 1 -- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac280ce6e0 msgr2=0x7fac280c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac2e8d8640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac280ce6e0 0x7fac280c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac2e8d8640 1 -- 172.21.15.5:0/1760185321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac281f41f0 con 0x7fac280d0d20 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac2e8d8640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280d0d20 0x7fac280c7420 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fac1800c7d0 tx=0x7fac1800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac26ffd640 1 -- 172.21.15.5:0/1760185321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18018070 con 0x7fac280d0d20 2024-04-25T09:06:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac26ffd640 1 -- 172.21.15.5:0/1760185321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1800a640 con 0x7fac280d0d20 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac280c7a80 con 0x7fac280d0d20 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac26ffd640 1 -- 172.21.15.5:0/1760185321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800aa70 con 0x7fac280d0d20 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.522+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac280b05a0 con 0x7fac280d0d20 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.523+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2804ef20 con 0x7fac280d0d20 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.523+0000 7fac26ffd640 1 -- 172.21.15.5:0/1760185321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac1801b070 con 0x7fac280d0d20 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.524+0000 7fac26ffd640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.524+0000 7fac26ffd640 1 -- 172.21.15.5:0/1760185321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fac18089480 con 0x7fac280d0d20 2024-04-25T09:06:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.524+0000 7fac2e0d7640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.525+0000 7fac2e0d7640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac1406b4d0 0x7fac1406d990 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fac20034000 tx=0x7fac2002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.528+0000 7fac26ffd640 1 -- 172.21.15.5:0/1760185321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac18057f50 con 0x7fac280d0d20 2024-04-25T09:06:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.706+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fac2806d3b0 con 0x7fac280d0d20 2024-04-25T09:06:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.710+0000 7fac26ffd640 1 -- 172.21.15.5:0/1760185321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac1805bff0 con 0x7fac280d0d20 2024-04-25T09:06:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac1406b4d0 msgr2=0x7fac1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac1406b4d0 0x7fac1406d990 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fac20034000 tx=0x7fac2002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280d0d20 msgr2=0x7fac280c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280d0d20 0x7fac280c7420 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fac1800c7d0 tx=0x7fac1800cc90 comp rx=0 tx=0).stop 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 shutdown_connections 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac280d0d20 0x7fac280c7420 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac280ce6e0 0x7fac280c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 --2- 172.21.15.5:0/1760185321 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac280b72b0 0x7fac280cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 >> 172.21.15.5:0/1760185321 conn(0x7fac280d1920 msgr2=0x7fac280b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 shutdown_connections 2024-04-25T09:06:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:09.712+0000 7fac3033b640 1 -- 172.21.15.5:0/1760185321 wait complete. 2024-04-25T09:06:09.710 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:06:09.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:09.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:09.810 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:06:09.811 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:09.811 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:09.827 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:09.827 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:09.827 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:09.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:09.845 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:09.845 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:09.882 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:09.882 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:09.882 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:09.903 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:09.903 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:06:09.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:10.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.035+0000 7f4134476640 1 Processor -- start 2024-04-25T09:06:10.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.035+0000 7f4134476640 1 -- start start 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.036+0000 7f4134476640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 0x7f412c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.036+0000 7f4134476640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0b7f60 con 0x7f412c0d3990 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.036+0000 7f4134476640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0cf400 con 0x7f412c0d3df0 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.036+0000 7f4134476640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0b29c0 con 0x7f412c15e0a0 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.036+0000 7f4131a11640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f412c0d3990 0x7f412c0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45236/0 (socket says 172.21.15.5:45236) 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.036+0000 7f4131a11640 1 -- 172.21.15.5:0/1025939461 learned_addr learned my addr 172.21.15.5:0/1025939461 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4132212640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 0x7f412c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389366779 0 0) 0x7f412c0b7f60 con 0x7f412c0d3990 2024-04-25T09:06:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4114003520 con 0x7f412c0d3990 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1749036408 0 0) 0x7f4114003520 con 0x7f412c0d3990 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 msgr2=0x7f412c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 0x7f412c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 >> v1:172.21.15.80:6789/0 conn(0x7f412c0d3df0 legacy=0x7f412c0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0d2080 con 0x7f412c0d3990 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f4120001670 con 0x7f412c0d3990 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 >> v1:172.21.15.5:6789/0 conn(0x7f412c0d3990 legacy=0x7f412c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 0x7f41140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f4114004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4114004d40 0x7f41140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0b29c0 con 0x7f4114003fb0 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411400bb00 con 0x7f4114004d40 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411400bd00 con 0x7f412c15e0a0 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4131a11640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f4114004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4132212640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 0x7f41140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.037+0000 7f4132a13640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4114004d40 0x7f41140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131a11640 1 -- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 msgr2=0x7f41140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131a11640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c15e0a0 0x7f41140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131a11640 1 -- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4114004d40 msgr2=0x7f41140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131a11640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4114004d40 0x7f41140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131a11640 1 -- 172.21.15.5:0/1025939461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114003520 con 0x7f4114003fb0 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131a11640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f4114004800 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f412000c190 tx=0x7f4114005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3451888cd8735f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120007c60 con 0x7f4114003fb0 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120005af0 con 0x7f4114003fb0 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.038+0000 7f4131210640 1 -- 172.21.15.5:0/1025939461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120007070 con 0x7f4114003fb0 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.039+0000 7f4134476640 1 -- 172.21.15.5:0/1025939461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 msgr2=0x7f4114004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.039+0000 7f4134476640 1 --2- 172.21.15.5:0/1025939461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f4114004800 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f412000c190 tx=0x7f4114005830 comp rx=0 tx=0).stop 2024-04-25T09:06:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.039+0000 7f4132a13640 1 -- 172.21.15.5:0/1025939461 reap_dead start 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.039+0000 7f4134476640 1 -- 172.21.15.5:0/1025939461 shutdown_connections 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.039+0000 7f4134476640 1 -- 172.21.15.5:0/1025939461 >> 172.21.15.5:0/1025939461 conn(0x7f412c0668f0 msgr2=0x7f412c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.039+0000 7f4134476640 1 -- 172.21.15.5:0/1025939461 shutdown_connections 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.039+0000 7f4134476640 1 -- 172.21.15.5:0/1025939461 wait complete. 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.040+0000 7f4134476640 1 Processor -- start 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.040+0000 7f4134476640 1 -- start start 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4134476640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f412c1610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4134476640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412c0cc410 0x7f412c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4134476640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c1f3aa0 0x7f412c1f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4134476640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0d2920 con 0x7f4114003fb0 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4134476640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0d2640 con 0x7f412c0cc410 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4134476640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0d2c00 con 0x7f412c1f3aa0 2024-04-25T09:06:10.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f412c1610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f412c1610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57902/0 (socket says 172.21.15.5:57902) 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 -- 172.21.15.5:0/865498654 learned_addr learned my addr 172.21.15.5:0/865498654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4131a11640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412c0cc410 0x7f412c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132a13640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c1f3aa0 0x7f412c1f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 -- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c1f3aa0 msgr2=0x7f412c1f3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c1f3aa0 0x7f412c1f3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 -- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412c0cc410 msgr2=0x7f412c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412c0cc410 0x7f412c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132212640 1 -- 172.21.15.5:0/865498654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c1f4860 con 0x7f4114003fb0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4132a13640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c1f3aa0 0x7f412c1f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.041+0000 7f4131a11640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412c0cc410 0x7f412c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.042+0000 7f4132212640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f412c1610a0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f41240119d0 tx=0x7f4124011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.042+0000 7f412affd640 1 -- 172.21.15.5:0/865498654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412400fb50 con 0x7f4114003fb0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.042+0000 7f412affd640 1 -- 172.21.15.5:0/865498654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412400fcf0 con 0x7f4114003fb0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.042+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c0cac40 con 0x7f4114003fb0 2024-04-25T09:06:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.042+0000 7f412affd640 1 -- 172.21.15.5:0/865498654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412400fea0 con 0x7f4114003fb0 2024-04-25T09:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.042+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c0cb200 con 0x7f4114003fb0 2024-04-25T09:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.043+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c04ef20 con 0x7f4114003fb0 2024-04-25T09:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.043+0000 7f412affd640 1 -- 172.21.15.5:0/865498654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4124012040 con 0x7f4114003fb0 2024-04-25T09:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.044+0000 7f412affd640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f411806b4d0 0x7f411806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.044+0000 7f412affd640 1 -- 172.21.15.5:0/865498654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f412408a600 con 0x7f4114003fb0 2024-04-25T09:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.044+0000 7f4131a11640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f411806b4d0 0x7f411806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.045+0000 7f4131a11640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f411806b4d0 0x7f411806d990 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f412000c160 tx=0x7f412002d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.048+0000 7f412affd640 1 -- 172.21.15.5:0/865498654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4124019030 con 0x7f4114003fb0 2024-04-25T09:06:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.268+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f412c0b7ef0 con 0x7f4114003fb0 2024-04-25T09:06:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.268+0000 7f412affd640 1 -- 172.21.15.5:0/865498654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2905 (secure 0 0 0) 0x7f4124059720 con 0x7f4114003fb0 2024-04-25T09:06:10.256 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:10.256 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":84,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3932097921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3932097921},{"type":"v1","addr":"172.21.15.80:6836","nonce":3932097921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3644778812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3644778812},{"type":"v1","addr":"172.21.15.80:6837","nonce":3644778812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9522,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3925211194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3925211194},{"type":"v1","addr":"172.21.15.5:6833","nonce":3925211194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[]} 2024-04-25T09:06:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 84 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f411806b4d0 msgr2=0x7f411806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f411806b4d0 0x7f411806d990 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f412000c160 tx=0x7f412002d000 comp rx=0 tx=0).stop 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 msgr2=0x7f412c1610a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f412c1610a0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f41240119d0 tx=0x7f4124011e90 comp rx=0 tx=0).stop 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 shutdown_connections 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f411806b4d0 0x7f411806d990 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f412c1f3aa0 0x7f412c1f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412c0cc410 0x7f412c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 --2- 172.21.15.5:0/865498654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4114003fb0 0x7f412c1610a0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 >> 172.21.15.5:0/865498654 conn(0x7f412c0668f0 msgr2=0x7f412c15d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 shutdown_connections 2024-04-25T09:06:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.270+0000 7f4134476640 1 -- 172.21.15.5:0/865498654 wait complete. 2024-04-25T09:06:10.269 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:06:10.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:06:10.270 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:06:10.270 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:06:10.270 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:06:10.270 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:10.270 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:06:10.271 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:06:10.271 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:06:10.271 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:10.271 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:06:10.271 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:06:10.271 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:06:10.271 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:10.279 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:06:10.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:06:10.279 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:06:10.280 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:10.283 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:06:10.283 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:06:10.284 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:06:10.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:06:10.321 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:06:10.322 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:10.326 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:06:10.326 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:10.327 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:06:10.327 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:10.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:06:10.353 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:06:10.397 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:06:10.410 INFO:tasks.ceph.mds.d.smithi080.stdout:starting mds.d at 2024-04-25T09:06:10.410 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2024-04-25T09:06:10.410 INFO:tasks.ceph.mds.d.smithi080.stderr:2024-04-25T09:06:10.422+0000 7fd4251e5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-25T09:06:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.447+0000 7f4ac65c1640 1 Processor -- start 2024-04-25T09:06:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.447+0000 7f4ac65c1640 1 -- start start 2024-04-25T09:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4ac65c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ac015bdc0 0x7f4ac00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4ac65c1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac00b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4ac65c1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac00cdcb0 con 0x7f4ac00cd6e0 2024-04-25T09:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4ac65c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac00cdf90 con 0x7f4ac015bdc0 2024-04-25T09:06:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4ac65c1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00b47e0 con 0x7f4ac00ce9a0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ac015bdc0 0x7f4ac00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ac00cd6e0 0x7f4ac00ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45248/0 (socket says 172.21.15.5:45248) 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abf7fe640 1 -- 172.21.15.5:0/1316849787 learned_addr learned my addr 172.21.15.5:0/1316849787 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4ac4b5e640 1 --2- 172.21.15.5:0/1316849787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac00b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abffff640 1 -- 172.21.15.5:0/1316849787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 msgr2=0x7f4ac00b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abffff640 1 --2- 172.21.15.5:0/1316849787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac00b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abffff640 1 -- 172.21.15.5:0/1316849787 >> v1:172.21.15.5:6789/0 conn(0x7f4ac00cd6e0 legacy=0x7f4ac00ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abffff640 1 -- 172.21.15.5:0/1316849787 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00b4ac0 con 0x7f4ac015bdc0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.448+0000 7f4abeffd640 1 -- 172.21.15.5:0/1316849787 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749670230 0 0) 0x7f4ac00cdcb0 con 0x7f4ac00cd6e0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.449+0000 7f4abffff640 1 --2- 172.21.15.5:0/1316849787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00cd1a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097a0 tx=0x7f4ab002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0635b0e7453d1e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.449+0000 7f4abeffd640 1 -- 172.21.15.5:0/1316849787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0037070 con 0x7f4ac015bdc0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.449+0000 7f4abeffd640 1 -- 172.21.15.5:0/1316849787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0032440 con 0x7f4ac015bdc0 2024-04-25T09:06:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.449+0000 7f4abeffd640 1 -- 172.21.15.5:0/1316849787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0032810 con 0x7f4ac015bdc0 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.449+0000 7f4ac65c1640 1 -- 172.21.15.5:0/1316849787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 msgr2=0x7f4ac00cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.449+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/1316849787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00cd1a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097a0 tx=0x7f4ab002a180 comp rx=0 tx=0).stop 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.450+0000 7f4ac65c1640 1 -- 172.21.15.5:0/1316849787 shutdown_connections 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.450+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/1316849787 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac00b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.450+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/1316849787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00cd1a0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.450+0000 7f4ac65c1640 1 -- 172.21.15.5:0/1316849787 >> 172.21.15.5:0/1316849787 conn(0x7f4ac00d18f0 msgr2=0x7f4ac00d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.450+0000 7f4ac65c1640 1 -- 172.21.15.5:0/1316849787 shutdown_connections 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.450+0000 7f4ac65c1640 1 -- 172.21.15.5:0/1316849787 wait complete. 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.451+0000 7f4ac65c1640 1 Processor -- start 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.451+0000 7f4ac65c1640 1 -- start start 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac65c1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac00cd6e0 0x7f4ac0150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac65c1640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac0154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac65c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac65c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac015c1a0 con 0x7f4ac015bdc0 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac65c1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00d09a0 con 0x7f4ac00cd6e0 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac65c1640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac015c320 con 0x7f4ac00ce9a0 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57962/0 (socket says 172.21.15.5:57962) 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 -- 172.21.15.5:0/2169219123 learned_addr learned my addr 172.21.15.5:0/2169219123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4abf7fe640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac0154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4abffff640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac00cd6e0 0x7f4ac0150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 -- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 msgr2=0x7f4ac0154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac0154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 -- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac00cd6e0 msgr2=0x7f4ac0150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac00cd6e0 0x7f4ac0150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 -- 172.21.15.5:0/2169219123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00c93e0 con 0x7f4ac015bdc0 2024-04-25T09:06:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac4b5e640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00c68b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800ef90 tx=0x7f4ab800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4abcff9640 1 -- 172.21.15.5:0/2169219123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8018020 con 0x7f4ac015bdc0 2024-04-25T09:06:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4abcff9640 1 -- 172.21.15.5:0/2169219123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab8014480 con 0x7f4ac015bdc0 2024-04-25T09:06:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.452+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac00c96c0 con 0x7f4ac015bdc0 2024-04-25T09:06:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.453+0000 7f4abcff9640 1 -- 172.21.15.5:0/2169219123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8014870 con 0x7f4ac015bdc0 2024-04-25T09:06:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.453+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac015de00 con 0x7f4ac015bdc0 2024-04-25T09:06:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.454+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac00d0d20 con 0x7f4ac015bdc0 2024-04-25T09:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.454+0000 7f4abcff9640 1 -- 172.21.15.5:0/2169219123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ab8005d10 con 0x7f4ac015bdc0 2024-04-25T09:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.454+0000 7f4abcff9640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4aac06b4d0 0x7f4aac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.455+0000 7f4abcff9640 1 -- 172.21.15.5:0/2169219123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4ab808ace0 con 0x7f4ac015bdc0 2024-04-25T09:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.455+0000 7f4abffff640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4aac06b4d0 0x7f4aac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.455+0000 7f4abffff640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4aac06b4d0 0x7f4aac06d990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0034000 tx=0x7f4ab002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.459+0000 7f4abcff9640 1 -- 172.21.15.5:0/2169219123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ac00d0d20 con 0x7f4ac015bdc0 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:10.652+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4ac004ef20 con 0x7f4ac015bdc0 2024-04-25T09:06:11.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.404+0000 7f4abcff9640 1 -- 172.21.15.5:0/2169219123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v133) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ab8022030 con 0x7f4ac015bdc0 2024-04-25T09:06:11.391 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4aac06b4d0 msgr2=0x7f4aac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4aac06b4d0 0x7f4aac06d990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0034000 tx=0x7f4ab002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 msgr2=0x7f4ac00c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00c68b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800ef90 tx=0x7f4ab800c490 comp rx=0 tx=0).stop 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 shutdown_connections 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4aac06b4d0 0x7f4aac06d990 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ac015bdc0 0x7f4ac00c68b0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4ac00ce9a0 0x7f4ac0154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 --2- 172.21.15.5:0/2169219123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac00cd6e0 0x7f4ac0150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 >> 172.21.15.5:0/2169219123 conn(0x7f4ac00d18f0 msgr2=0x7f4ac00b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 shutdown_connections 2024-04-25T09:06:11.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.407+0000 7f4ac65c1640 1 -- 172.21.15.5:0/2169219123 wait complete. 2024-04-25T09:06:11.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:06:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.571+0000 7f7898f22640 1 Processor -- start 2024-04-25T09:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.571+0000 7f7898f22640 1 -- start start 2024-04-25T09:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f7898f22640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 0x7f78940b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f7898f22640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940d20e0 con 0x7f789415de70 2024-04-25T09:06:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f7898f22640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940d23c0 con 0x7f78940b7130 2024-04-25T09:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f7898f22640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940d2a10 con 0x7f78940b2cc0 2024-04-25T09:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f789259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f789415de70 0x7f78940b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38894/0 (socket says 172.21.15.5:38894) 2024-04-25T09:06:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f789259c640 1 -- 172.21.15.5:0/1434511600 learned_addr learned my addr 172.21.15.5:0/1434511600 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652884624 0 0) 0x7f78940d20e0 con 0x7f789415de70 2024-04-25T09:06:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7880003520 con 0x7f789415de70 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.572+0000 7f7891d9b640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 0x7f78940b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3139248325 0 0) 0x7f7880003520 con 0x7f789415de70 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 msgr2=0x7f78940b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 0x7f78940b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 >> v1:172.21.15.80:6789/0 conn(0x7f78940b7130 legacy=0x7f78940ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940d26a0 con 0x7f789415de70 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f788c001670 con 0x7f789415de70 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 >> v1:172.21.15.5:6789/0 conn(0x7f789415de70 legacy=0x7f78940b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 0x7f78800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7880003f60 0x7f7880004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7880004d40 0x7f78800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940d2a10 con 0x7f7880004d40 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788000baa0 con 0x7f7880003f60 2024-04-25T09:06:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788000bca0 con 0x7f78940b2cc0 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f789259c640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 0x7f78800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f7892d9d640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7880004d40 0x7f78800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f7891d9b640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7880003f60 0x7f7880004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f7892d9d640 1 -- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 msgr2=0x7f78800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f7892d9d640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78940b2cc0 0x7f78800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f7892d9d640 1 -- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7880003f60 msgr2=0x7f7880004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f7892d9d640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7880003f60 0x7f7880004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.573+0000 7f7892d9d640 1 -- 172.21.15.5:0/1434511600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880003520 con 0x7f7880004d40 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.574+0000 7f7892d9d640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7880004d40 0x7f78800051c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f7884001e50 tx=0x7f7880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9840d4f9300917 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.574+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884001a70 con 0x7f7880004d40 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.574+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884003970 con 0x7f7880004d40 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.574+0000 7f789159a640 1 -- 172.21.15.5:0/1434511600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884003d60 con 0x7f7880004d40 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.575+0000 7f7898f22640 1 -- 172.21.15.5:0/1434511600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7880004d40 msgr2=0x7f78800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.575+0000 7f7898f22640 1 --2- 172.21.15.5:0/1434511600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7880004d40 0x7f78800051c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f7884001e50 tx=0x7f7880005830 comp rx=0 tx=0).stop 2024-04-25T09:06:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.575+0000 7f7892d9d640 1 -- 172.21.15.5:0/1434511600 reap_dead start 2024-04-25T09:06:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.575+0000 7f7898f22640 1 -- 172.21.15.5:0/1434511600 shutdown_connections 2024-04-25T09:06:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.575+0000 7f7898f22640 1 -- 172.21.15.5:0/1434511600 >> 172.21.15.5:0/1434511600 conn(0x7f789406b000 msgr2=0x7f789406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.575+0000 7f7898f22640 1 -- 172.21.15.5:0/1434511600 shutdown_connections 2024-04-25T09:06:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.575+0000 7f7898f22640 1 -- 172.21.15.5:0/1434511600 wait complete. 2024-04-25T09:06:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.576+0000 7f7898f22640 1 Processor -- start 2024-04-25T09:06:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.576+0000 7f7898f22640 1 -- start start 2024-04-25T09:06:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7898f22640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7880004d40 0x7f78940b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7898f22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78940b42b0 0x7f7894154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7898f22640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78940c9890 0x7f78940c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7898f22640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940b6bf0 con 0x7f78940b42b0 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7898f22640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940cf110 con 0x7f78940c9890 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7898f22640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940b6d70 con 0x7f7880004d40 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7891d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78940b42b0 0x7f7894154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7891d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78940b42b0 0x7f7894154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58940/0 (socket says 172.21.15.5:58940) 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7891d9b640 1 -- 172.21.15.5:0/2575481409 learned_addr learned my addr 172.21.15.5:0/2575481409 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f789259c640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7880004d40 0x7f78940b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.577+0000 7f7892d9d640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78940c9890 0x7f78940c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7891d9b640 1 -- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7880004d40 msgr2=0x7f78940b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7891d9b640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7880004d40 0x7f78940b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7891d9b640 1 -- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78940c9890 msgr2=0x7f78940c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7891d9b640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78940c9890 0x7f78940c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7891d9b640 1 -- 172.21.15.5:0/2575481409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940b4900 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f789259c640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7880004d40 0x7f78940b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7892d9d640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78940c9890 0x7f78940c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7891d9b640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78940b42b0 0x7f7894154a10 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f787c011a00 tx=0x7f787c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f788affd640 1 -- 172.21.15.5:0/2575481409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c00fb50 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f788affd640 1 -- 172.21.15.5:0/2575481409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c00fcf0 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f788affd640 1 -- 172.21.15.5:0/2575481409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c00fea0 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78940b4be0 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.578+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78940b51a0 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.579+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789404ef20 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.579+0000 7f788affd640 1 -- 172.21.15.5:0/2575481409 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f787c012040 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.580+0000 7f788affd640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f787406b4d0 0x7f787406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.580+0000 7f788affd640 1 -- 172.21.15.5:0/2575481409 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f787c08a650 con 0x7f78940b42b0 2024-04-25T09:06:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.580+0000 7f789259c640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f787406b4d0 0x7f787406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.581+0000 7f789259c640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f787406b4d0 0x7f787406d990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f788c007d90 tx=0x7f788c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.584+0000 7f788affd640 1 -- 172.21.15.5:0/2575481409 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f787c019030 con 0x7f78940b42b0 2024-04-25T09:06:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.830+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f78940b90a0 con 0x7f78940b42b0 2024-04-25T09:06:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.831+0000 7f788affd640 1 -- 172.21.15.5:0/2575481409 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f787c059790 con 0x7f78940b42b0 2024-04-25T09:06:11.818 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:11.818 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:11.818 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-04-25T09:06:11.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.818 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-04-25T09:06:11.818 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmtTooLxAAtbB074XHmPWF1Ubp++E61A==", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmdzmGOhAAqe4Q2dsTqIDOcwlYAtmo1w==", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:06:11.819 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipm9PAWNhAA9XYWXLWoUut55E5nQPVDJA==", 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-04-25T09:06:11.820 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipm9uiqBRAAQJuOVipAzJM0tk6udA5pBg==", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCWGipmZrxJKBAArXwicxLBy18PPCnQO7AqBQ==", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCZGipmOhilJhAA0uamXgQvFPuDKV7wlQBW6w==", 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCcGipmxqGXJBAATgDGH10S4SqQJik8wTz7ew==", 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.822 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCfGipmn46DIhAA4V9aMzHyv7iZT22rKkcKMQ==", 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQClGipmebdtJRAAxTNE3gQHrTy71oDoEOUzYA==", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCoGipm0fkKIxAAs6s1sM72pD8ahbwlxF/XkA==", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCrGipmlAbVIBAAJ9XTMtx+i+2qCi6jtrDVeA==", 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCuGipmfaXRHhAAw4GHW/sUKddjxOPP5wVoGA==", 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:11.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA==", 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.826 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmYew3EhAAlGOSy+U2VoYyCEc/lub0Yg==", 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmFuMsDxAACjjVyUsDyv5phj5k1BTMmA==", 2024-04-25T09:06:11.827 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCVGipmJlKZFxAABn0FhGh719Iy/01nWxHsaQ==", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-04-25T09:06:11.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmCDUWExAAsJLkCmb92LKyCdrYHF6uPQ==", 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmrXcKLBAAAdkbvDg98qiORPxe/2GxjA==", 2024-04-25T09:06:11.829 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCUGipmQoxeJxAAq0nT3wF6yIvOlWHuGqIUrg==", 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:11.831 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-25T09:06:11.831 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f787406b4d0 msgr2=0x7f787406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f787406b4d0 0x7f787406d990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f788c007d90 tx=0x7f788c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78940b42b0 msgr2=0x7f7894154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78940b42b0 0x7f7894154a10 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f787c011a00 tx=0x7f787c011ec0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 shutdown_connections 2024-04-25T09:06:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f787406b4d0 0x7f787406d990 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78940c9890 0x7f78940c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78940b42b0 0x7f7894154a10 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 --2- 172.21.15.5:0/2575481409 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7880004d40 0x7f78940b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 >> 172.21.15.5:0/2575481409 conn(0x7f789406b000 msgr2=0x7f78940ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 shutdown_connections 2024-04-25T09:06:11.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.832+0000 7f7898f22640 1 -- 172.21.15.5:0/2575481409 wait complete. 2024-04-25T09:06:11.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.946+0000 7f3bb7aab640 1 Processor -- start 2024-04-25T09:06:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.947+0000 7f3bb7aab640 1 -- start start 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.947+0000 7f3bb7aab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bb015bdc0 0x7f3bb00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.947+0000 7f3bb7aab640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb00cdcb0 con 0x7f3bb00ce9a0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.947+0000 7f3bb7aab640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb00cdf90 con 0x7f3bb00cd6e0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.947+0000 7f3bb7aab640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb00b47e0 con 0x7f3bb015bdc0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb6048640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3bb00ce9a0 0x7f3bb00b52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38904/0 (socket says 172.21.15.5:38904) 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb6048640 1 -- 172.21.15.5:0/3393484469 learned_addr learned my addr 172.21.15.5:0/3393484469 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb5847640 1 --2- 172.21.15.5:0/3393484469 >> v2:172.21.15.80:3300/0 conn(0x7f3bb015bdc0 0x7f3bb00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb4845640 1 -- 172.21.15.5:0/3393484469 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078548698 0 0) 0x7f3bb00cdcb0 con 0x7f3bb00ce9a0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb4845640 1 -- 172.21.15.5:0/3393484469 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b9c003520 con 0x7f3bb00ce9a0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb4845640 1 -- 172.21.15.5:0/3393484469 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501828756 0 0) 0x7f3bb00cdf90 con 0x7f3bb00cd6e0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb4845640 1 -- 172.21.15.5:0/3393484469 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb00cdcb0 con 0x7f3bb00cd6e0 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb5847640 1 -- 172.21.15.5:0/3393484469 >> v1:172.21.15.80:6789/0 conn(0x7f3bb00cd6e0 legacy=0x7f3bb00ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb5847640 1 -- 172.21.15.5:0/3393484469 >> v1:172.21.15.5:6789/0 conn(0x7f3bb00ce9a0 legacy=0x7f3bb00b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.948+0000 7f3bb5847640 1 -- 172.21.15.5:0/3393484469 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00b4ac0 con 0x7f3bb015bdc0 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.949+0000 7f3bb5847640 1 --2- 172.21.15.5:0/3393484469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00cd1a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0097a0 tx=0x7f3bac02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86832f2d0311ff87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.949+0000 7f3bb4845640 1 -- 172.21.15.5:0/3393484469 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac037070 con 0x7f3bb015bdc0 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.949+0000 7f3bb4845640 1 -- 172.21.15.5:0/3393484469 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac032440 con 0x7f3bb015bdc0 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.949+0000 7f3bb4845640 1 -- 172.21.15.5:0/3393484469 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac032810 con 0x7f3bb015bdc0 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.949+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3393484469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb015bdc0 msgr2=0x7f3bb00cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.949+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3393484469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00cd1a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0097a0 tx=0x7f3bac02a230 comp rx=0 tx=0).stop 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.950+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3393484469 shutdown_connections 2024-04-25T09:06:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.950+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3393484469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00cd1a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.950+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3393484469 >> 172.21.15.5:0/3393484469 conn(0x7f3bb00d18f0 msgr2=0x7f3bb00d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.950+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3393484469 shutdown_connections 2024-04-25T09:06:11.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.950+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3393484469 wait complete. 2024-04-25T09:06:11.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 Processor -- start 2024-04-25T09:06:11.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 -- start start 2024-04-25T09:06:11.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb00cd6e0 0x7f3bb0150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bb00ce9a0 0x7f3bb00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb015c1a0 con 0x7f3bb015bdc0 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00d09a0 con 0x7f3bb00cd6e0 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.951+0000 7f3bb7aab640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb015c320 con 0x7f3bb00ce9a0 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58944/0 (socket says 172.21.15.5:58944) 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 -- 172.21.15.5:0/3054923544 learned_addr learned my addr 172.21.15.5:0/3054923544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb5847640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb00cd6e0 0x7f3bb0150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb5046640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bb00ce9a0 0x7f3bb00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 -- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bb00ce9a0 msgr2=0x7f3bb00c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bb00ce9a0 0x7f3bb00c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 -- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb00cd6e0 msgr2=0x7f3bb0150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb00cd6e0 0x7f3bb0150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 -- 172.21.15.5:0/3054923544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb01509d0 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb5046640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bb00ce9a0 0x7f3bb00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb6048640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00c75d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800cbb0 tx=0x7f3ba800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3ba67fc640 1 -- 172.21.15.5:0/3054923544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8017070 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3ba67fc640 1 -- 172.21.15.5:0/3054923544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba800ad40 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb01545d0 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3ba67fc640 1 -- 172.21.15.5:0/3054923544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8012600 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.952+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb015d290 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.953+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0154bf0 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.954+0000 7f3ba67fc640 1 -- 172.21.15.5:0/3054923544 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ba801a070 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.954+0000 7f3ba67fc640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b9406b4d0 0x7f3b9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.954+0000 7f3ba67fc640 1 -- 172.21.15.5:0/3054923544 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ba8089b20 con 0x7f3bb015bdc0 2024-04-25T09:06:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.954+0000 7f3bb5847640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b9406b4d0 0x7f3b9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.955+0000 7f3bb5847640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b9406b4d0 0x7f3b9406d990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3bac034000 tx=0x7f3bac02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:11.958+0000 7f3ba67fc640 1 -- 172.21.15.5:0/3054923544 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ba80586a0 con 0x7f3bb015bdc0 2024-04-25T09:06:12.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.137+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb004ef20 con 0x7f3bb015bdc0 2024-04-25T09:06:12.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.138+0000 7f3ba67fc640 1 -- 172.21.15.5:0/3054923544 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12817 (secure 0 0 0) 0x7f3ba805c740 con 0x7f3bb015bdc0 2024-04-25T09:06:12.126 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:12.126 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":134,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:11.407847+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b9406b4d0 msgr2=0x7f3b9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b9406b4d0 0x7f3b9406d990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3bac034000 tx=0x7f3bac02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb015bdc0 msgr2=0x7f3bb00c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00c75d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800cbb0 tx=0x7f3ba800a430 comp rx=0 tx=0).stop 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 shutdown_connections 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3b9406b4d0 0x7f3b9406d990 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb015bdc0 0x7f3bb00c75d0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3bb00ce9a0 0x7f3bb00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 --2- 172.21.15.5:0/3054923544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bb00cd6e0 0x7f3bb0150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 >> 172.21.15.5:0/3054923544 conn(0x7f3bb00d18f0 msgr2=0x7f3bb00b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 shutdown_connections 2024-04-25T09:06:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.140+0000 7f3bb7aab640 1 -- 172.21.15.5:0/3054923544 wait complete. 2024-04-25T09:06:12.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:12.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.255+0000 7f79fca9c640 1 Processor -- start 2024-04-25T09:06:12.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.255+0000 7f79fca9c640 1 -- start start 2024-04-25T09:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79fca9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79f8161800 0x7f79f80712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79fca9c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79fca9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f8162660 con 0x7f79f80ad840 2024-04-25T09:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79fca9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f80b48b0 con 0x7f79f8161800 2024-04-25T09:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79fca9c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8071890 con 0x7f79f80b2de0 2024-04-25T09:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79f659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79f8161800 0x7f79f80712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79f659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79f8161800 0x7f79f80712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58948/0 (socket says 172.21.15.5:58948) 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79f659c640 1 -- 172.21.15.5:0/2526792205 learned_addr learned my addr 172.21.15.5:0/2526792205 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79f5d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79f80ad840 0x7f79f8161be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38918/0 (socket says 172.21.15.5:38918) 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79f6d9d640 1 --2- 172.21.15.5:0/2526792205 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.256+0000 7f79f659c640 1 -- 172.21.15.5:0/2526792205 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 msgr2=0x7f79f80b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f659c640 1 --2- 172.21.15.5:0/2526792205 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f659c640 1 -- 172.21.15.5:0/2526792205 >> v1:172.21.15.5:6789/0 conn(0x7f79f80ad840 legacy=0x7f79f8161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f559a640 1 -- 172.21.15.5:0/2526792205 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289864459 0 0) 0x7f79e0001110 con 0x7f79f80ad840 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f659c640 1 -- 172.21.15.5:0/2526792205 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8072510 con 0x7f79f8161800 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f6d9d640 1 --2- 172.21.15.5:0/2526792205 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f659c640 1 --2- 172.21.15.5:0/2526792205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80712b0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009870 tx=0x7f79f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f4d5caa02d1958 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f559a640 1 -- 172.21.15.5:0/2526792205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0037070 con 0x7f79f8161800 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f559a640 1 -- 172.21.15.5:0/2526792205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f0032440 con 0x7f79f8161800 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.257+0000 7f79f559a640 1 -- 172.21.15.5:0/2526792205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0032810 con 0x7f79f8161800 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 -- 172.21.15.5:0/2526792205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 msgr2=0x7f79f80712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 --2- 172.21.15.5:0/2526792205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80712b0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009870 tx=0x7f79f002a270 comp rx=0 tx=0).stop 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 -- 172.21.15.5:0/2526792205 shutdown_connections 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 --2- 172.21.15.5:0/2526792205 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 --2- 172.21.15.5:0/2526792205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80712b0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 -- 172.21.15.5:0/2526792205 >> 172.21.15.5:0/2526792205 conn(0x7f79f806c930 msgr2=0x7f79f806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 -- 172.21.15.5:0/2526792205 shutdown_connections 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.258+0000 7f79fca9c640 1 -- 172.21.15.5:0/2526792205 wait complete. 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.259+0000 7f79fca9c640 1 Processor -- start 2024-04-25T09:06:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79fca9c640 1 -- start start 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79fca9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79f80ad840 0x7f79f8147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79fca9c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79fca9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79fca9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80b52d0 con 0x7f79f8161800 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79fca9c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8072ad0 con 0x7f79f80ad840 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79fca9c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80b5450 con 0x7f79f80b2de0 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79f6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79f6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58962/0 (socket says 172.21.15.5:58962) 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.260+0000 7f79f6d9d640 1 -- 172.21.15.5:0/3533236635 learned_addr learned my addr 172.21.15.5:0/3533236635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f5d9b640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f659c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79f80ad840 0x7f79f8147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f6d9d640 1 -- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 msgr2=0x7f79f80c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f6d9d640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f6d9d640 1 -- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79f80ad840 msgr2=0x7f79f8147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f6d9d640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79f80ad840 0x7f79f8147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f6d9d640 1 -- 172.21.15.5:0/3533236635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8147780 con 0x7f79f8161800 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f659c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79f80ad840 0x7f79f8147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79f6d9d640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80c5540 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f79e800cef0 tx=0x7f79e800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79eeffd640 1 -- 172.21.15.5:0/3533236635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e801a070 con 0x7f79f8161800 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79eeffd640 1 -- 172.21.15.5:0/3533236635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e800d860 con 0x7f79f8161800 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f815c3f0 con 0x7f79f8161800 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79eeffd640 1 -- 172.21.15.5:0/3533236635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800dc50 con 0x7f79f8161800 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.261+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f815c9b0 con 0x7f79f8161800 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.262+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f804ef20 con 0x7f79f8161800 2024-04-25T09:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.263+0000 7f79eeffd640 1 -- 172.21.15.5:0/3533236635 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79e801d070 con 0x7f79f8161800 2024-04-25T09:06:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.263+0000 7f79eeffd640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79d806b4d0 0x7f79d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.263+0000 7f79eeffd640 1 -- 172.21.15.5:0/3533236635 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79e808a7e0 con 0x7f79f8161800 2024-04-25T09:06:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.263+0000 7f79f659c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79d806b4d0 0x7f79d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.264+0000 7f79f659c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79d806b4d0 0x7f79d806d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79f0034000 tx=0x7f79f002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.267+0000 7f79eeffd640 1 -- 172.21.15.5:0/3533236635 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79f8147780 con 0x7f79f8161800 2024-04-25T09:06:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.449+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79f806d640 con 0x7f79f8161800 2024-04-25T09:06:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.449+0000 7f79eeffd640 1 -- 172.21.15.5:0/3533236635 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79e80599d0 con 0x7f79f8161800 2024-04-25T09:06:12.437 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:06:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79d806b4d0 msgr2=0x7f79d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79d806b4d0 0x7f79d806d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79f0034000 tx=0x7f79f002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 msgr2=0x7f79f80c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80c5540 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f79e800cef0 tx=0x7f79e800a710 comp rx=0 tx=0).stop 2024-04-25T09:06:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 shutdown_connections 2024-04-25T09:06:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79d806b4d0 0x7f79d806d990 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f8161800 0x7f79f80c5540 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79f80b2de0 0x7f79f80c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 --2- 172.21.15.5:0/3533236635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79f80ad840 0x7f79f8147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.451+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 >> 172.21.15.5:0/3533236635 conn(0x7f79f806c930 msgr2=0x7f79f80b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.452+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 shutdown_connections 2024-04-25T09:06:12.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.452+0000 7f79fca9c640 1 -- 172.21.15.5:0/3533236635 wait complete. 2024-04-25T09:06:12.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:06:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.564+0000 7f5b30902640 1 Processor -- start 2024-04-25T09:06:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.564+0000 7f5b30902640 1 -- start start 2024-04-25T09:06:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b30902640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b2c15de70 0x7f5b2c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b30902640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c0b2cc0 0x7f5b2c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b30902640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0d20e0 con 0x7f5b2c0b7130 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b30902640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c0d2a10 con 0x7f5b2c15de70 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b30902640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0d23c0 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b2ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5b2c0b7130 0x7f5b2c0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38932/0 (socket says 172.21.15.5:38932) 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b2ad9d640 1 -- 172.21.15.5:0/1511495621 learned_addr learned my addr 172.21.15.5:0/1511495621 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b21d9b640 1 --2- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c0b2cc0 0x7f5b2c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b2a59c640 1 --2- 172.21.15.5:0/1511495621 >> v2:172.21.15.80:3300/0 conn(0x7f5b2c15de70 0x7f5b2c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b29d9b640 1 -- 172.21.15.5:0/1511495621 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636815653 0 0) 0x7f5b2c0d20e0 con 0x7f5b2c0b7130 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b29d9b640 1 -- 172.21.15.5:0/1511495621 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b18003520 con 0x7f5b2c0b7130 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b2a59c640 1 -- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c0b2cc0 msgr2=0x7f5b2c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b2a59c640 1 --2- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c0b2cc0 0x7f5b2c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b2a59c640 1 -- 172.21.15.5:0/1511495621 >> v1:172.21.15.5:6789/0 conn(0x7f5b2c0b7130 legacy=0x7f5b2c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b29d9b640 1 -- 172.21.15.5:0/1511495621 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 553528074 0 0) 0x7f5b18003520 con 0x7f5b2c0b7130 2024-04-25T09:06:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.565+0000 7f5b2a59c640 1 -- 172.21.15.5:0/1511495621 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0d26a0 con 0x7f5b2c15de70 2024-04-25T09:06:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.566+0000 7f5b2a59c640 1 --2- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c15de70 0x7f5b2c0b93e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0097a0 tx=0x7f5b1c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c545098159f1d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.566+0000 7f5b29d9b640 1 -- 172.21.15.5:0/1511495621 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c037070 con 0x7f5b2c15de70 2024-04-25T09:06:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.566+0000 7f5b29d9b640 1 -- 172.21.15.5:0/1511495621 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c02aba0 con 0x7f5b2c15de70 2024-04-25T09:06:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.566+0000 7f5b29d9b640 1 -- 172.21.15.5:0/1511495621 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240019f0 con 0x7f5b2c15de70 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 -- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c15de70 msgr2=0x7f5b2c0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 --2- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c15de70 0x7f5b2c0b93e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0097a0 tx=0x7f5b1c02a110 comp rx=0 tx=0).stop 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 -- 172.21.15.5:0/1511495621 shutdown_connections 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 --2- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c0b2cc0 0x7f5b2c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 --2- 172.21.15.5:0/1511495621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c15de70 0x7f5b2c0b93e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 -- 172.21.15.5:0/1511495621 >> 172.21.15.5:0/1511495621 conn(0x7f5b2c06b000 msgr2=0x7f5b2c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 -- 172.21.15.5:0/1511495621 shutdown_connections 2024-04-25T09:06:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.567+0000 7f5b30902640 1 -- 172.21.15.5:0/1511495621 wait complete. 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.568+0000 7f5b30902640 1 Processor -- start 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.568+0000 7f5b30902640 1 -- start start 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b30902640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c0b2cc0 0x7f5b2c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b30902640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c0b7130 0x7f5b2c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b30902640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c15de70 0x7f5b2c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b30902640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0cf080 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b30902640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0cef00 con 0x7f5b2c0b7130 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b30902640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0cf200 con 0x7f5b2c15de70 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b2a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c0b2cc0 0x7f5b2c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b2a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c0b2cc0 0x7f5b2c158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58970/0 (socket says 172.21.15.5:58970) 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.569+0000 7f5b2a59c640 1 -- 172.21.15.5:0/2509237796 learned_addr learned my addr 172.21.15.5:0/2509237796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2ad9d640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c15de70 0x7f5b2c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b21d9b640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c0b7130 0x7f5b2c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2a59c640 1 -- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c15de70 msgr2=0x7f5b2c0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2a59c640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c15de70 0x7f5b2c0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2a59c640 1 -- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c0b7130 msgr2=0x7f5b2c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2a59c640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c0b7130 0x7f5b2c0cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2a59c640 1 -- 172.21.15.5:0/2509237796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0b3660 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2ad9d640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c15de70 0x7f5b2c0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b21d9b640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c0b7130 0x7f5b2c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b2a59c640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c0b2cc0 0x7f5b2c158690 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c035040 tx=0x7f5b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b237fe640 1 -- 172.21.15.5:0/2509237796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c041030 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b237fe640 1 -- 172.21.15.5:0/2509237796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c03d420 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b237fe640 1 -- 172.21.15.5:0/2509237796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c037040 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0b3940 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.570+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c0b3f00 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.571+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c04ef20 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.572+0000 7f5b237fe640 1 -- 172.21.15.5:0/2509237796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b1c044070 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.572+0000 7f5b237fe640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b0c06b4d0 0x7f5b0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.572+0000 7f5b237fe640 1 -- 172.21.15.5:0/2509237796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b1c0aa2e0 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.572+0000 7f5b21d9b640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b0c06b4d0 0x7f5b0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.573+0000 7f5b21d9b640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b0c06b4d0 0x7f5b0c06d990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c1f7660 tx=0x7f5b14008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.576+0000 7f5b237fe640 1 -- 172.21.15.5:0/2509237796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b1c0795d0 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.759+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b2c0cae50 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.759+0000 7f5b237fe640 1 -- 172.21.15.5:0/2509237796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5b1c078ed0 con 0x7f5b2c0b2cc0 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-25T09:06:12.747 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b0c06b4d0 msgr2=0x7f5b0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b0c06b4d0 0x7f5b0c06d990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c1f7660 tx=0x7f5b14008040 comp rx=0 tx=0).stop 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c0b2cc0 msgr2=0x7f5b2c158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c0b2cc0 0x7f5b2c158690 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c035040 tx=0x7f5b1c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 shutdown_connections 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5b0c06b4d0 0x7f5b0c06d990 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5b2c15de70 0x7f5b2c0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b2c0b7130 0x7f5b2c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 --2- 172.21.15.5:0/2509237796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c0b2cc0 0x7f5b2c158690 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 >> 172.21.15.5:0/2509237796 conn(0x7f5b2c06b000 msgr2=0x7f5b2c160810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 shutdown_connections 2024-04-25T09:06:12.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.761+0000 7f5b30902640 1 -- 172.21.15.5:0/2509237796 wait complete. 2024-04-25T09:06:12.759 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:06:12.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:06:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.877+0000 7ff22fb09640 1 Processor -- start 2024-04-25T09:06:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.877+0000 7ff22fb09640 1 -- start start 2024-04-25T09:06:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.878+0000 7ff22fb09640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff22815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.878+0000 7ff22fb09640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2280cd130 0x7ff2280ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.878+0000 7ff22fb09640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2280ce800 con 0x7ff228162650 2024-04-25T09:06:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.878+0000 7ff22fb09640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280cf3d0 con 0x7ff2280cd130 2024-04-25T09:06:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.878+0000 7ff22fb09640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280ceaa0 con 0x7ff228158540 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22d8a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff22815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22d8a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff22815eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:33316/0 (socket says 172.21.15.5:33316) 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22d8a5640 1 -- 172.21.15.5:0/1567457091 learned_addr learned my addr 172.21.15.5:0/1567457091 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22e0a6640 1 --2- 172.21.15.5:0/1567457091 >> v2:172.21.15.80:3300/0 conn(0x7ff2280cd130 0x7ff2280ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22d8a5640 1 -- 172.21.15.5:0/1567457091 >> v2:172.21.15.80:3300/0 conn(0x7ff2280cd130 msgr2=0x7ff2280ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22d8a5640 1 --2- 172.21.15.5:0/1567457091 >> v2:172.21.15.80:3300/0 conn(0x7ff2280cd130 0x7ff2280ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22d8a5640 1 -- 172.21.15.5:0/1567457091 >> v1:172.21.15.80:6789/0 conn(0x7ff228162650 legacy=0x7ff2280cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.879+0000 7ff22d8a5640 1 -- 172.21.15.5:0/1567457091 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2280ced80 con 0x7ff228158540 2024-04-25T09:06:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22d8a5640 1 --2- 172.21.15.5:0/1567457091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff22815eb80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff224009870 tx=0x7ff22402a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e5be03cca50769d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22c8a3640 1 -- 172.21.15.5:0/1567457091 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224037070 con 0x7ff228158540 2024-04-25T09:06:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22c8a3640 1 -- 172.21.15.5:0/1567457091 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22402adf0 con 0x7ff228158540 2024-04-25T09:06:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22c8a3640 1 -- 172.21.15.5:0/1567457091 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224032660 con 0x7ff228158540 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22fb09640 1 -- 172.21.15.5:0/1567457091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 msgr2=0x7ff22815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22fb09640 1 --2- 172.21.15.5:0/1567457091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff22815eb80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff224009870 tx=0x7ff22402a160 comp rx=0 tx=0).stop 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22fb09640 1 -- 172.21.15.5:0/1567457091 shutdown_connections 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22fb09640 1 --2- 172.21.15.5:0/1567457091 >> v2:172.21.15.80:3300/0 conn(0x7ff2280cd130 0x7ff2280ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22fb09640 1 --2- 172.21.15.5:0/1567457091 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff22815eb80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.880+0000 7ff22fb09640 1 -- 172.21.15.5:0/1567457091 >> 172.21.15.5:0/1567457091 conn(0x7ff2280b1da0 msgr2=0x7ff2280b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.881+0000 7ff22fb09640 1 -- 172.21.15.5:0/1567457091 shutdown_connections 2024-04-25T09:06:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.881+0000 7ff22fb09640 1 -- 172.21.15.5:0/1567457091 wait complete. 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 Processor -- start 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 -- start start 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2280cd130 0x7ff228161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff228155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228162650 0x7ff22815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22815f0c0 con 0x7ff228162650 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280cf860 con 0x7ff2280cd130 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.882+0000 7ff22fb09640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22815f240 con 0x7ff228158540 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228162650 0x7ff22815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228162650 0x7ff22815b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58984/0 (socket says 172.21.15.5:58984) 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 -- 172.21.15.5:0/2110347776 learned_addr learned my addr 172.21.15.5:0/2110347776 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22d8a5640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2280cd130 0x7ff228161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22d0a4640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff228155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 -- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 msgr2=0x7ff228155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff228155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 -- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2280cd130 msgr2=0x7ff228161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2280cd130 0x7ff228161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 -- 172.21.15.5:0/2110347776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228155fd0 con 0x7ff228162650 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22d8a5640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2280cd130 0x7ff228161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22e0a6640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228162650 0x7ff22815b1e0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7ff22000efc0 tx=0x7ff22000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff21e7fc640 1 -- 172.21.15.5:0/2110347776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220018020 con 0x7ff228162650 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff21e7fc640 1 -- 172.21.15.5:0/2110347776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220014480 con 0x7ff228162650 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff21e7fc640 1 -- 172.21.15.5:0/2110347776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220014870 con 0x7ff228162650 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2281562b0 con 0x7ff228162650 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.883+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22815b720 con 0x7ff228162650 2024-04-25T09:06:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.884+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22804ef20 con 0x7ff228162650 2024-04-25T09:06:12.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.885+0000 7ff21e7fc640 1 -- 172.21.15.5:0/2110347776 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff22001b020 con 0x7ff228162650 2024-04-25T09:06:12.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.885+0000 7ff21e7fc640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20c06b500 0x7ff20c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.885+0000 7ff21e7fc640 1 -- 172.21.15.5:0/2110347776 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff22008aaf0 con 0x7ff228162650 2024-04-25T09:06:12.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.886+0000 7ff22d8a5640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20c06b500 0x7ff20c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.886+0000 7ff22d8a5640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20c06b500 0x7ff20c06d9c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff224034000 tx=0x7ff22402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:12.889+0000 7ff21e7fc640 1 -- 172.21.15.5:0/2110347776 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff220022030 con 0x7ff228162650 2024-04-25T09:06:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.074+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff228074120 con 0x7ff228162650 2024-04-25T09:06:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.411+0000 7ff21e7fc640 1 -- 172.21.15.5:0/2110347776 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff220010040 con 0x7ff228162650 2024-04-25T09:06:13.399 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20c06b500 msgr2=0x7ff20c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20c06b500 0x7ff20c06d9c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff224034000 tx=0x7ff22402e000 comp rx=0 tx=0).stop 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228162650 msgr2=0x7ff22815b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228162650 0x7ff22815b1e0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7ff22000efc0 tx=0x7ff22000c490 comp rx=0 tx=0).stop 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 shutdown_connections 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff20c06b500 0x7ff20c06d9c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228162650 0x7ff22815b1e0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff228158540 0x7ff228155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 --2- 172.21.15.5:0/2110347776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2280cd130 0x7ff228161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 >> 172.21.15.5:0/2110347776 conn(0x7ff2280b1da0 msgr2=0x7ff2280afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.413+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 shutdown_connections 2024-04-25T09:06:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.414+0000 7ff22fb09640 1 -- 172.21.15.5:0/2110347776 wait complete. 2024-04-25T09:06:13.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:06:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.535+0000 7f8674390640 1 Processor -- start 2024-04-25T09:06:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.535+0000 7f8674390640 1 -- start start 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f8674390640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c067000 0x7f866c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f8674390640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f866c0ccd50 0x7f866c0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f8674390640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c0715c0 con 0x7f866c15bbb0 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f8674390640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c06d9d0 con 0x7f866c0ccd50 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f8674390640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c06dc00 con 0x7f866c067000 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f867212c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f866c15bbb0 0x7f866c0668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38946/0 (socket says 172.21.15.5:38946) 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f867212c640 1 -- 172.21.15.5:0/3132913266 learned_addr learned my addr 172.21.15.5:0/3132913266 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.536+0000 7f867292d640 1 --2- 172.21.15.5:0/3132913266 >> v2:172.21.15.5:3300/0 conn(0x7f866c0ccd50 0x7f866c0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867192b640 1 --2- 172.21.15.5:0/3132913266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c067000 0x7f866c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867292d640 1 -- 172.21.15.5:0/3132913266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c067000 msgr2=0x7f866c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867292d640 1 --2- 172.21.15.5:0/3132913266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c067000 0x7f866c06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867292d640 1 -- 172.21.15.5:0/3132913266 >> v1:172.21.15.5:6789/0 conn(0x7f866c15bbb0 legacy=0x7f866c0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867292d640 1 -- 172.21.15.5:0/3132913266 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0718a0 con 0x7f866c0ccd50 2024-04-25T09:06:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867112a640 1 -- 172.21.15.5:0/3132913266 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801301775 0 0) 0x7f866c0715c0 con 0x7f866c15bbb0 2024-04-25T09:06:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867192b640 1 --2- 172.21.15.5:0/3132913266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c067000 0x7f866c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.537+0000 7f867292d640 1 --2- 172.21.15.5:0/3132913266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c0ccd50 0x7f866c0caee0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f865c009d90 tx=0x7f865c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8195f52133611 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f867112a640 1 -- 172.21.15.5:0/3132913266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c031600 con 0x7f866c0ccd50 2024-04-25T09:06:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f867112a640 1 -- 172.21.15.5:0/3132913266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c0317a0 con 0x7f866c0ccd50 2024-04-25T09:06:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f867112a640 1 -- 172.21.15.5:0/3132913266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c031b70 con 0x7f866c0ccd50 2024-04-25T09:06:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 -- 172.21.15.5:0/3132913266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c0ccd50 msgr2=0x7f866c0caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 --2- 172.21.15.5:0/3132913266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c0ccd50 0x7f866c0caee0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f865c009d90 tx=0x7f865c02a5d0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 -- 172.21.15.5:0/3132913266 shutdown_connections 2024-04-25T09:06:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 --2- 172.21.15.5:0/3132913266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c0ccd50 0x7f866c0caee0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 --2- 172.21.15.5:0/3132913266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c067000 0x7f866c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 -- 172.21.15.5:0/3132913266 >> 172.21.15.5:0/3132913266 conn(0x7f866c0cd310 msgr2=0x7f866c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 -- 172.21.15.5:0/3132913266 shutdown_connections 2024-04-25T09:06:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.538+0000 7f8674390640 1 -- 172.21.15.5:0/3132913266 wait complete. 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.539+0000 7f8674390640 1 Processor -- start 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.539+0000 7f8674390640 1 -- start start 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f8674390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c067000 0x7f866c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f8674390640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c0ccd50 0x7f866c1f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f8674390640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c15bbb0 0x7f866c1f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f8674390640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c072380 con 0x7f866c067000 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f8674390640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c071e60 con 0x7f866c15bbb0 2024-04-25T09:06:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f8674390640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0cb420 con 0x7f866c0ccd50 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f867212c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c067000 0x7f866c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f867212c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c067000 0x7f866c0cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58998/0 (socket says 172.21.15.5:58998) 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f867212c640 1 -- 172.21.15.5:0/496910334 learned_addr learned my addr 172.21.15.5:0/496910334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f867192b640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c0ccd50 0x7f866c1f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.540+0000 7f867292d640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c15bbb0 0x7f866c1f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f867212c640 1 -- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c0ccd50 msgr2=0x7f866c1f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f867212c640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c0ccd50 0x7f866c1f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f867212c640 1 -- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c15bbb0 msgr2=0x7f866c1f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f867212c640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c15bbb0 0x7f866c1f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f867212c640 1 -- 172.21.15.5:0/496910334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c1553f0 con 0x7f866c067000 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f867212c640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c067000 0x7f866c0cf0c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f866400c430 tx=0x7f866400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f866affd640 1 -- 172.21.15.5:0/496910334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640074e0 con 0x7f866c067000 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f866affd640 1 -- 172.21.15.5:0/496910334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86640047e0 con 0x7f866c067000 2024-04-25T09:06:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c0ce5e0 con 0x7f866c067000 2024-04-25T09:06:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f866affd640 1 -- 172.21.15.5:0/496910334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664004bd0 con 0x7f866c067000 2024-04-25T09:06:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.541+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c154ec0 con 0x7f866c067000 2024-04-25T09:06:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.542+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c155180 con 0x7f866c067000 2024-04-25T09:06:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.543+0000 7f866affd640 1 -- 172.21.15.5:0/496910334 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8664011070 con 0x7f866c067000 2024-04-25T09:06:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.543+0000 7f866affd640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.543+0000 7f866affd640 1 -- 172.21.15.5:0/496910334 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8664089c00 con 0x7f866c067000 2024-04-25T09:06:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.543+0000 7f867192b640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.544+0000 7f867192b640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865806b4d0 0x7f865806d990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f866c14e170 tx=0x7f8660008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.548+0000 7f866affd640 1 -- 172.21.15.5:0/496910334 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8664090080 con 0x7f866c067000 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:13.728+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f866c04ef20 con 0x7f866c067000 2024-04-25T09:06:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.413+0000 7f866affd640 1 -- 172.21.15.5:0/496910334 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8664058c60 con 0x7f866c067000 2024-04-25T09:06:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-25T09:06:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865806b4d0 msgr2=0x7f865806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865806b4d0 0x7f865806d990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f866c14e170 tx=0x7f8660008040 comp rx=0 tx=0).stop 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c067000 msgr2=0x7f866c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c067000 0x7f866c0cf0c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f866400c430 tx=0x7f866400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 shutdown_connections 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c15bbb0 0x7f866c1f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f866c0ccd50 0x7f866c1f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 --2- 172.21.15.5:0/496910334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f866c067000 0x7f866c0cf0c0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 >> 172.21.15.5:0/496910334 conn(0x7f866c0cd310 msgr2=0x7f866c0cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.417+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 shutdown_connections 2024-04-25T09:06:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.418+0000 7f8674390640 1 -- 172.21.15.5:0/496910334 wait complete. 2024-04-25T09:06:14.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:06:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.554+0000 7fb7e7c93640 1 Processor -- start 2024-04-25T09:06:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.554+0000 7fb7e7c93640 1 -- start start 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e7c93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7e00b6250 0x7fb7e00ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e7c93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e00cee10 0x7fb7e00d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e7c93640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0162150 con 0x7fb7e015df10 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e7c93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00d20d0 con 0x7fb7e00b6250 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e7c93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0162430 con 0x7fb7e00cee10 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e522e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7e00b6250 0x7fb7e00ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e522e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7e00b6250 0x7fb7e00ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59002/0 (socket says 172.21.15.5:59002) 2024-04-25T09:06:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.555+0000 7fb7e522e640 1 -- 172.21.15.5:0/719164708 learned_addr learned my addr 172.21.15.5:0/719164708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.556+0000 7fb7e6230640 1 --2- 172.21.15.5:0/719164708 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e00cee10 0x7fb7e00d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.556+0000 7fb7e522e640 1 -- 172.21.15.5:0/719164708 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e00cee10 msgr2=0x7fb7e00d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.556+0000 7fb7e522e640 1 --2- 172.21.15.5:0/719164708 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e00cee10 0x7fb7e00d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.556+0000 7fb7e522e640 1 -- 172.21.15.5:0/719164708 >> v1:172.21.15.80:6789/0 conn(0x7fb7e015df10 legacy=0x7fb7e01618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.556+0000 7fb7e522e640 1 -- 172.21.15.5:0/719164708 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0162710 con 0x7fb7e00b6250 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.556+0000 7fb7e522e640 1 --2- 172.21.15.5:0/719164708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00b6250 0x7fb7e00ce8d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009870 tx=0x7fb7d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb63588161059d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e4a2d640 1 -- 172.21.15.5:0/719164708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4037070 con 0x7fb7e00b6250 2024-04-25T09:06:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e4a2d640 1 -- 172.21.15.5:0/719164708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4032440 con 0x7fb7e00b6250 2024-04-25T09:06:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e4a2d640 1 -- 172.21.15.5:0/719164708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4032810 con 0x7fb7e00b6250 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 -- 172.21.15.5:0/719164708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00b6250 msgr2=0x7fb7e00ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/719164708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00b6250 0x7fb7e00ce8d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009870 tx=0x7fb7d402a270 comp rx=0 tx=0).stop 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 -- 172.21.15.5:0/719164708 shutdown_connections 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/719164708 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e00cee10 0x7fb7e00d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/719164708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00b6250 0x7fb7e00ce8d0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 -- 172.21.15.5:0/719164708 >> 172.21.15.5:0/719164708 conn(0x7fb7e00668f0 msgr2=0x7fb7e0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 -- 172.21.15.5:0/719164708 shutdown_connections 2024-04-25T09:06:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.557+0000 7fb7e7c93640 1 -- 172.21.15.5:0/719164708 wait complete. 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.558+0000 7fb7e7c93640 1 Processor -- start 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.558+0000 7fb7e7c93640 1 -- start start 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e7c93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e00b6250 0x7fb7e015d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e7c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00cee10 0x7fb7e00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e7c93640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e015df10 0x7fb7e01f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e7c93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00d2c20 con 0x7fb7e00cee10 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e7c93640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00d2aa0 con 0x7fb7e00b6250 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e7c93640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00d2da0 con 0x7fb7e015df10 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e522e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00cee10 0x7fb7e00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e522e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00cee10 0x7fb7e00b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59010/0 (socket says 172.21.15.5:59010) 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e522e640 1 -- 172.21.15.5:0/2885324176 learned_addr learned my addr 172.21.15.5:0/2885324176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e6230640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e015df10 0x7fb7e01f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.559+0000 7fb7e5a2f640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e00b6250 0x7fb7e015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e522e640 1 -- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e015df10 msgr2=0x7fb7e01f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e522e640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e015df10 0x7fb7e01f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e522e640 1 -- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e00b6250 msgr2=0x7fb7e015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e522e640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e00b6250 0x7fb7e015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e522e640 1 -- 172.21.15.5:0/2885324176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e01e7ad0 con 0x7fb7e00cee10 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e5a2f640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e00b6250 0x7fb7e015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e522e640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00cee10 0x7fb7e00b1d90 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fb7d402a2b0 tx=0x7fb7d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7de7fc640 1 -- 172.21.15.5:0/2885324176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4037040 con 0x7fb7e00cee10 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7de7fc640 1 -- 172.21.15.5:0/2885324176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4042070 con 0x7fb7e00cee10 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e01e7db0 con 0x7fb7e00cee10 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7de7fc640 1 -- 172.21.15.5:0/2885324176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4030860 con 0x7fb7e00cee10 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.560+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e00cca70 con 0x7fb7e00cee10 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.561+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e004ef20 con 0x7fb7e00cee10 2024-04-25T09:06:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.562+0000 7fb7de7fc640 1 -- 172.21.15.5:0/2885324176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb7d4030a00 con 0x7fb7e00cee10 2024-04-25T09:06:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.562+0000 7fb7de7fc640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7cc06b500 0x7fb7cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.562+0000 7fb7de7fc640 1 -- 172.21.15.5:0/2885324176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb7d40aab50 con 0x7fb7e00cee10 2024-04-25T09:06:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.562+0000 7fb7e5a2f640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7cc06b500 0x7fb7cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.563+0000 7fb7e5a2f640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7cc06b500 0x7fb7cc06d9c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0001d60 tx=0x7fb7d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.566+0000 7fb7de7fc640 1 -- 172.21.15.5:0/2885324176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7d40799a0 con 0x7fb7e00cee10 2024-04-25T09:06:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:14.787+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7e00d1910 con 0x7fb7e00cee10 2024-04-25T09:06:15.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.431+0000 7fb7de7fc640 1 -- 172.21.15.5:0/2885324176 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v87) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb7d40792a0 con 0x7fb7e00cee10 2024-04-25T09:06:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 20 and data pool 21 2024-04-25T09:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.438+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7cc06b500 msgr2=0x7fb7cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.438+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7cc06b500 0x7fb7cc06d9c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0001d60 tx=0x7fb7d0009040 comp rx=0 tx=0).stop 2024-04-25T09:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.438+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00cee10 msgr2=0x7fb7e00b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.438+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00cee10 0x7fb7e00b1d90 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fb7d402a2b0 tx=0x7fb7d40046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.443+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 shutdown_connections 2024-04-25T09:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.445+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb7cc06b500 0x7fb7cc06d9c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.445+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7e015df10 0x7fb7e01f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.445+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7e00cee10 0x7fb7e00b1d90 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.445+0000 7fb7e7c93640 1 --2- 172.21.15.5:0/2885324176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e00b6250 0x7fb7e015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.445+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 >> 172.21.15.5:0/2885324176 conn(0x7fb7e00668f0 msgr2=0x7fb7e00d3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.448+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 shutdown_connections 2024-04-25T09:06:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.448+0000 7fb7e7c93640 1 -- 172.21.15.5:0/2885324176 wait complete. 2024-04-25T09:06:15.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:15.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.572+0000 7f780c509640 1 Processor -- start 2024-04-25T09:06:15.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.572+0000 7f780c509640 1 -- start start 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780c509640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78040b0a50 0x7f78040ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780c509640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78040cbf40 0x7f78040ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780c509640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780406ba50 con 0x7f78040b0e30 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780c509640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780406b800 con 0x7f78040cbf40 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780c509640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780406bd30 con 0x7f78040b0a50 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780aaa6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78040cbf40 0x7f78040ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780aaa6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78040cbf40 0x7f78040ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59022/0 (socket says 172.21.15.5:59022) 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.573+0000 7f780aaa6640 1 -- 172.21.15.5:0/132344176 learned_addr learned my addr 172.21.15.5:0/132344176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.574+0000 7f780a2a5640 1 --2- 172.21.15.5:0/132344176 >> v2:172.21.15.80:3300/0 conn(0x7f78040b0a50 0x7f78040ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.574+0000 7f780aaa6640 1 -- 172.21.15.5:0/132344176 >> v2:172.21.15.80:3300/0 conn(0x7f78040b0a50 msgr2=0x7f78040ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.574+0000 7f780aaa6640 1 --2- 172.21.15.5:0/132344176 >> v2:172.21.15.80:3300/0 conn(0x7f78040b0a50 0x7f78040ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.574+0000 7f780aaa6640 1 -- 172.21.15.5:0/132344176 >> v1:172.21.15.80:6789/0 conn(0x7f78040b0e30 legacy=0x7f78040d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.574+0000 7f780aaa6640 1 -- 172.21.15.5:0/132344176 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780406c010 con 0x7f78040cbf40 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.574+0000 7f78092a3640 1 -- 172.21.15.5:0/132344176 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912602973 0 0) 0x7f780406ba50 con 0x7f78040b0e30 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.574+0000 7f780aaa6640 1 --2- 172.21.15.5:0/132344176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040cbf40 0x7f78040ce740 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f7804071950 tx=0x7f77f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd6d0e81900d1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f78092a3640 1 -- 172.21.15.5:0/132344176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4036070 con 0x7f78040cbf40 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f78092a3640 1 -- 172.21.15.5:0/132344176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4031600 con 0x7f78040cbf40 2024-04-25T09:06:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f78092a3640 1 -- 172.21.15.5:0/132344176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40319d0 con 0x7f78040cbf40 2024-04-25T09:06:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 -- 172.21.15.5:0/132344176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040cbf40 msgr2=0x7f78040ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 --2- 172.21.15.5:0/132344176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040cbf40 0x7f78040ce740 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f7804071950 tx=0x7f77f402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 -- 172.21.15.5:0/132344176 shutdown_connections 2024-04-25T09:06:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 --2- 172.21.15.5:0/132344176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040cbf40 0x7f78040ce740 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 --2- 172.21.15.5:0/132344176 >> v2:172.21.15.80:3300/0 conn(0x7f78040b0a50 0x7f78040ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 -- 172.21.15.5:0/132344176 >> 172.21.15.5:0/132344176 conn(0x7f78040d18f0 msgr2=0x7f78040d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 -- 172.21.15.5:0/132344176 shutdown_connections 2024-04-25T09:06:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.575+0000 7f780c509640 1 -- 172.21.15.5:0/132344176 wait complete. 2024-04-25T09:06:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.576+0000 7f780c509640 1 Processor -- start 2024-04-25T09:06:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f780c509640 1 -- start start 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f780c509640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78040b0a50 0x7f780414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f780c509640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040b0e30 0x7f78040cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f780c509640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78040cbf40 0x7f78040ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f780c509640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040b2bf0 con 0x7f78040b0e30 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f780c509640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040cfd60 con 0x7f78040b0a50 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f780c509640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78040ca270 con 0x7f78040cbf40 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f7809aa4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040b0e30 0x7f78040cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f7809aa4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040b0e30 0x7f78040cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59036/0 (socket says 172.21.15.5:59036) 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.577+0000 7f7809aa4640 1 -- 172.21.15.5:0/4228587668 learned_addr learned my addr 172.21.15.5:0/4228587668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f780a2a5640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78040b0a50 0x7f780414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f780aaa6640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78040cbf40 0x7f78040ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7809aa4640 1 -- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78040cbf40 msgr2=0x7f78040ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7809aa4640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78040cbf40 0x7f78040ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7809aa4640 1 -- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78040b0a50 msgr2=0x7f780414edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7809aa4640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78040b0a50 0x7f780414edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7809aa4640 1 -- 172.21.15.5:0/4228587668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040ca550 con 0x7f78040b0e30 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f780a2a5640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78040b0a50 0x7f780414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7809aa4640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040b0e30 0x7f78040cc860 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c480 tx=0x7f77f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7802ffd640 1 -- 172.21.15.5:0/4228587668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8017070 con 0x7f78040b0e30 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7802ffd640 1 -- 172.21.15.5:0/4228587668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8005480 con 0x7f78040b0e30 2024-04-25T09:06:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78040ca830 con 0x7f78040b0e30 2024-04-25T09:06:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f7802ffd640 1 -- 172.21.15.5:0/4228587668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8003830 con 0x7f78040b0e30 2024-04-25T09:06:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.578+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78040c94f0 con 0x7f78040b0e30 2024-04-25T09:06:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.579+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780406cd70 con 0x7f78040b0e30 2024-04-25T09:06:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.580+0000 7f7802ffd640 1 -- 172.21.15.5:0/4228587668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77f801a070 con 0x7f78040b0e30 2024-04-25T09:06:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.580+0000 7f7802ffd640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77f006b4d0 0x7f77f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.580+0000 7f7802ffd640 1 -- 172.21.15.5:0/4228587668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77f8089510 con 0x7f78040b0e30 2024-04-25T09:06:15.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.580+0000 7f780a2a5640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77f006b4d0 0x7f77f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.581+0000 7f780a2a5640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77f006b4d0 0x7f77f006d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009b90 tx=0x7f77fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.584+0000 7f7802ffd640 1 -- 172.21.15.5:0/4228587668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f77f8058420 con 0x7f78040b0e30 2024-04-25T09:06:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.767+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f780404ef20 con 0x7f78040b0e30 2024-04-25T09:06:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.768+0000 7f7802ffd640 1 -- 172.21.15.5:0/4228587668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f77f8057d20 con 0x7f78040b0e30 2024-04-25T09:06:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:15.756 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":137,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:14.788425+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:13.105023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:13.759633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77f006b4d0 msgr2=0x7f77f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77f006b4d0 0x7f77f006d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009b90 tx=0x7f77fc008040 comp rx=0 tx=0).stop 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040b0e30 msgr2=0x7f78040cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040b0e30 0x7f78040cc860 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c480 tx=0x7f77f800c940 comp rx=0 tx=0).stop 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 shutdown_connections 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f77f006b4d0 0x7f77f006d990 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78040cbf40 0x7f78040ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040b0e30 0x7f78040cc860 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 --2- 172.21.15.5:0/4228587668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78040b0a50 0x7f780414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.770+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 >> 172.21.15.5:0/4228587668 conn(0x7f78040d18f0 msgr2=0x7f78040d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.771+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 shutdown_connections 2024-04-25T09:06:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.771+0000 7f780c509640 1 -- 172.21.15.5:0/4228587668 wait complete. 2024-04-25T09:06:15.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.883+0000 7f016b0f5640 1 Processor -- start 2024-04-25T09:06:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.883+0000 7f016b0f5640 1 -- start start 2024-04-25T09:06:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f016b0f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f016406adf0 0x7f016406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f016b0f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016415ef10 con 0x7f016406bb30 2024-04-25T09:06:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f016b0f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016406bf10 con 0x7f01640cea80 2024-04-25T09:06:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f016b0f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01640cfd60 con 0x7f016406adf0 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f0163fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f016406adf0 0x7f016406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f0169692640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f016406bb30 0x7f01640d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38960/0 (socket says 172.21.15.5:38960) 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f0169692640 1 -- 172.21.15.5:0/21768288 learned_addr learned my addr 172.21.15.5:0/21768288 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f0163fff640 1 -- 172.21.15.5:0/21768288 >> v1:172.21.15.80:6789/0 conn(0x7f01640cea80 legacy=0x7f016415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f0163fff640 1 -- 172.21.15.5:0/21768288 >> v1:172.21.15.5:6789/0 conn(0x7f016406bb30 legacy=0x7f01640d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f01637fe640 1 -- 172.21.15.5:0/21768288 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359586356 0 0) 0x7f016415ef10 con 0x7f016406bb30 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.884+0000 7f0163fff640 1 -- 172.21.15.5:0/21768288 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016415ff50 con 0x7f016406adf0 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.885+0000 7f0163fff640 1 --2- 172.21.15.5:0/21768288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016406b5f0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f01500097a0 tx=0x7f015002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b02d65ee28543e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.885+0000 7f01637fe640 1 -- 172.21.15.5:0/21768288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150037070 con 0x7f016406adf0 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.885+0000 7f01637fe640 1 -- 172.21.15.5:0/21768288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150032440 con 0x7f016406adf0 2024-04-25T09:06:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.885+0000 7f01637fe640 1 -- 172.21.15.5:0/21768288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150032810 con 0x7f016406adf0 2024-04-25T09:06:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.885+0000 7f016b0f5640 1 -- 172.21.15.5:0/21768288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 msgr2=0x7f016406b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.885+0000 7f016b0f5640 1 --2- 172.21.15.5:0/21768288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016406b5f0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f01500097a0 tx=0x7f015002a230 comp rx=0 tx=0).stop 2024-04-25T09:06:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.886+0000 7f016b0f5640 1 -- 172.21.15.5:0/21768288 shutdown_connections 2024-04-25T09:06:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.886+0000 7f016b0f5640 1 --2- 172.21.15.5:0/21768288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016406b5f0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.886+0000 7f016b0f5640 1 -- 172.21.15.5:0/21768288 >> 172.21.15.5:0/21768288 conn(0x7f01640d19f0 msgr2=0x7f01640d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.886+0000 7f016b0f5640 1 -- 172.21.15.5:0/21768288 shutdown_connections 2024-04-25T09:06:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.886+0000 7f016b0f5640 1 -- 172.21.15.5:0/21768288 wait complete. 2024-04-25T09:06:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.887+0000 7f016b0f5640 1 Processor -- start 2024-04-25T09:06:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.887+0000 7f016b0f5640 1 -- start start 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f016b0f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016409eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f016b0f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f016406bb30 0x7f01641e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f016b0f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01640cea80 0x7f01641e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f016b0f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01640cff90 con 0x7f016406adf0 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f016b0f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016415f480 con 0x7f016406bb30 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f016b0f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01640d0270 con 0x7f01640cea80 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016409eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016409eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59052/0 (socket says 172.21.15.5:59052) 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 -- 172.21.15.5:0/3199423510 learned_addr learned my addr 172.21.15.5:0/3199423510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0169692640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01640cea80 0x7f01641e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0163fff640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f016406bb30 0x7f01641e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 -- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01640cea80 msgr2=0x7f01641e7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01640cea80 0x7f01641e7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 -- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f016406bb30 msgr2=0x7f01641e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f016406bb30 0x7f01641e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 -- 172.21.15.5:0/3199423510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640c7eb0 con 0x7f016406adf0 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0169692640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01640cea80 0x7f01641e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0163fff640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f016406bb30 0x7f01641e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f0168e91640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016409eb30 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f015800c400 tx=0x7f015800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.888+0000 7f01617fa640 1 -- 172.21.15.5:0/3199423510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158017070 con 0x7f016406adf0 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.889+0000 7f01617fa640 1 -- 172.21.15.5:0/3199423510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01580052d0 con 0x7f016406adf0 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.889+0000 7f01617fa640 1 -- 172.21.15.5:0/3199423510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158003830 con 0x7f016406adf0 2024-04-25T09:06:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.889+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01640c7bd0 con 0x7f016406adf0 2024-04-25T09:06:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.889+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01640b5040 con 0x7f016406adf0 2024-04-25T09:06:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.890+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016406c560 con 0x7f016406adf0 2024-04-25T09:06:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.890+0000 7f01617fa640 1 -- 172.21.15.5:0/3199423510 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f015801a070 con 0x7f016406adf0 2024-04-25T09:06:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.891+0000 7f01617fa640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.891+0000 7f01617fa640 1 -- 172.21.15.5:0/3199423510 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0158089620 con 0x7f016406adf0 2024-04-25T09:06:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.891+0000 7f0163fff640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.891+0000 7f0163fff640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0150034000 tx=0x7f015002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:15.895+0000 7f01617fa640 1 -- 172.21.15.5:0/3199423510 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f016406c560 con 0x7f016406adf0 2024-04-25T09:06:16.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.075+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01640b76f0 con 0x7f016406adf0 2024-04-25T09:06:16.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.076+0000 7f01617fa640 1 -- 172.21.15.5:0/3199423510 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f0158058400 con 0x7f016406adf0 2024-04-25T09:06:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:16.064 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":137,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:14.788425+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:13.105023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:13.759633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:16.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 msgr2=0x7f014806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0150034000 tx=0x7f015002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 msgr2=0x7f016409eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016409eb30 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f015800c400 tx=0x7f015800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 shutdown_connections 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f014806b4d0 0x7f014806d990 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01640cea80 0x7f01641e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f016406bb30 0x7f01641e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 --2- 172.21.15.5:0/3199423510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f016406adf0 0x7f016409eb30 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 >> 172.21.15.5:0/3199423510 conn(0x7f01640d19f0 msgr2=0x7f016406fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 shutdown_connections 2024-04-25T09:06:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.078+0000 7f016b0f5640 1 -- 172.21.15.5:0/3199423510 wait complete. 2024-04-25T09:06:16.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:06:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.193+0000 7f36fcba5640 1 Processor -- start 2024-04-25T09:06:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.193+0000 7f36fcba5640 1 -- start start 2024-04-25T09:06:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36fcba5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36f806adf0 0x7f36f8168f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36fcba5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f80cce90 con 0x7f36f80d0c80 2024-04-25T09:06:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36fcba5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f80d27f0 con 0x7f36f815e0b0 2024-04-25T09:06:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36fcba5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80cfee0 con 0x7f36f806adf0 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f5d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f36f80d0c80 0x7f36f80cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38972/0 (socket says 172.21.15.5:38972) 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f5d9b640 1 -- 172.21.15.5:0/1823489001 learned_addr learned my addr 172.21.15.5:0/1823489001 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f6d9d640 1 --2- 172.21.15.5:0/1823489001 >> v2:172.21.15.5:3300/0 conn(0x7f36f806adf0 0x7f36f8168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f559a640 1 -- 172.21.15.5:0/1823489001 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176577319 0 0) 0x7f36f80cce90 con 0x7f36f80d0c80 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f559a640 1 -- 172.21.15.5:0/1823489001 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e0003520 con 0x7f36f80d0c80 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f6d9d640 1 -- 172.21.15.5:0/1823489001 >> v1:172.21.15.80:6789/0 conn(0x7f36f815e0b0 legacy=0x7f36f80cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f6d9d640 1 -- 172.21.15.5:0/1823489001 >> v1:172.21.15.5:6789/0 conn(0x7f36f80d0c80 legacy=0x7f36f80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.194+0000 7f36f6d9d640 1 -- 172.21.15.5:0/1823489001 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80d01c0 con 0x7f36f806adf0 2024-04-25T09:06:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36f6d9d640 1 --2- 172.21.15.5:0/1823489001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f8168f40 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097d0 tx=0x7f36e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2878f0cc962eed6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36f559a640 1 -- 172.21.15.5:0/1823489001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8037070 con 0x7f36f806adf0 2024-04-25T09:06:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36f559a640 1 -- 172.21.15.5:0/1823489001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e8032440 con 0x7f36f806adf0 2024-04-25T09:06:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36f559a640 1 -- 172.21.15.5:0/1823489001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8032810 con 0x7f36f806adf0 2024-04-25T09:06:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36fcba5640 1 -- 172.21.15.5:0/1823489001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 msgr2=0x7f36f8168f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36fcba5640 1 --2- 172.21.15.5:0/1823489001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f8168f40 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097d0 tx=0x7f36e802a270 comp rx=0 tx=0).stop 2024-04-25T09:06:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36fcba5640 1 -- 172.21.15.5:0/1823489001 shutdown_connections 2024-04-25T09:06:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36fcba5640 1 --2- 172.21.15.5:0/1823489001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f8168f40 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.195+0000 7f36fcba5640 1 -- 172.21.15.5:0/1823489001 >> 172.21.15.5:0/1823489001 conn(0x7f36f80d1a20 msgr2=0x7f36f80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.196+0000 7f36fcba5640 1 -- 172.21.15.5:0/1823489001 shutdown_connections 2024-04-25T09:06:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.196+0000 7f36fcba5640 1 -- 172.21.15.5:0/1823489001 wait complete. 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.197+0000 7f36fcba5640 1 Processor -- start 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.197+0000 7f36fcba5640 1 -- start start 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f80d0c80 0x7f36f80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36f815e0b0 0x7f36f8159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f815e490 con 0x7f36f806adf0 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80d0780 con 0x7f36f80d0c80 2024-04-25T09:06:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80cfb90 con 0x7f36f815e0b0 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f814de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59066/0 (socket says 172.21.15.5:59066) 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 -- 172.21.15.5:0/3357915064 learned_addr learned my addr 172.21.15.5:0/3357915064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f6d9d640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36f815e0b0 0x7f36f8159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f5d9b640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f80d0c80 0x7f36f80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 -- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36f815e0b0 msgr2=0x7f36f8159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36f815e0b0 0x7f36f8159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 -- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f80d0c80 msgr2=0x7f36f80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f80d0c80 0x7f36f80c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 -- 172.21.15.5:0/3357915064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80c8300 con 0x7f36f806adf0 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f6d9d640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36f815e0b0 0x7f36f8159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f5d9b640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f80d0c80 0x7f36f80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36f659c640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f814de10 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c7c0 tx=0x7f36f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36e6ffd640 1 -- 172.21.15.5:0/3357915064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0016020 con 0x7f36f806adf0 2024-04-25T09:06:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36e6ffd640 1 -- 172.21.15.5:0/3357915064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f0006d50 con 0x7f36f806adf0 2024-04-25T09:06:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f80c7260 con 0x7f36f806adf0 2024-04-25T09:06:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36e6ffd640 1 -- 172.21.15.5:0/3357915064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0003bb0 con 0x7f36f806adf0 2024-04-25T09:06:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.198+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f80c7820 con 0x7f36f806adf0 2024-04-25T09:06:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.199+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f804ef20 con 0x7f36f806adf0 2024-04-25T09:06:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.200+0000 7f36e6ffd640 1 -- 172.21.15.5:0/3357915064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36f000a850 con 0x7f36f806adf0 2024-04-25T09:06:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.200+0000 7f36e6ffd640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f36d806b4d0 0x7f36d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.200+0000 7f36e6ffd640 1 -- 172.21.15.5:0/3357915064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36f0089eb0 con 0x7f36f806adf0 2024-04-25T09:06:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.201+0000 7f36f5d9b640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f36d806b4d0 0x7f36d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.201+0000 7f36f5d9b640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f36d806b4d0 0x7f36d806d990 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f36f80c8510 tx=0x7f36ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.205+0000 7f36e6ffd640 1 -- 172.21.15.5:0/3357915064 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36f0020020 con 0x7f36f806adf0 2024-04-25T09:06:16.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.425+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f36f80b79a0 con 0x7f36f806adf0 2024-04-25T09:06:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.431+0000 7f36e6ffd640 1 -- 172.21.15.5:0/3357915064 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v88) v1 ==== 118+0+0 (secure 0 0 0) 0x7f36f0019310 con 0x7f36f806adf0 2024-04-25T09:06:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.433+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f36d806b4d0 msgr2=0x7f36d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.433+0000 7f36fcba5640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f36d806b4d0 0x7f36d806d990 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f36f80c8510 tx=0x7f36ec009040 comp rx=0 tx=0).stop 2024-04-25T09:06:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.433+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 msgr2=0x7f36f814de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.433+0000 7f36fcba5640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f814de10 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c7c0 tx=0x7f36f000cc80 comp rx=0 tx=0).stop 2024-04-25T09:06:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 shutdown_connections 2024-04-25T09:06:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f36d806b4d0 0x7f36d806d990 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f36f815e0b0 0x7f36f8159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f80d0c80 0x7f36f80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 --2- 172.21.15.5:0/3357915064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f806adf0 0x7f36f814de10 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 >> 172.21.15.5:0/3357915064 conn(0x7f36f80d1a20 msgr2=0x7f36f8161ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 shutdown_connections 2024-04-25T09:06:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.434+0000 7f36fcba5640 1 -- 172.21.15.5:0/3357915064 wait complete. 2024-04-25T09:06:16.433 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:06:16.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:06:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.550+0000 7f78d4522640 1 Processor -- start 2024-04-25T09:06:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.550+0000 7f78d4522640 1 -- start start 2024-04-25T09:06:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d4522640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78cc1614b0 0x7f78cc0b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d4522640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78cc0d1f60 0x7f78cc0d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d4522640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d4522640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc0d2740 con 0x7f78cc0d1f60 2024-04-25T09:06:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d4522640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc0d2a20 con 0x7f78cc1614b0 2024-04-25T09:06:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d4522640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0d2d00 con 0x7f78cc0d4060 2024-04-25T09:06:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78cc0d1f60 0x7f78cc0d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f78cc0d1f60 0x7f78cc0d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59070/0 (socket says 172.21.15.5:59070) 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 -- 172.21.15.5:0/2241558301 learned_addr learned my addr 172.21.15.5:0/2241558301 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d2abf640 1 --2- 172.21.15.5:0/2241558301 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d22be640 1 --2- 172.21.15.5:0/2241558301 >> v2:172.21.15.80:3300/0 conn(0x7f78cc1614b0 0x7f78cc0b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 -- 172.21.15.5:0/2241558301 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 msgr2=0x7f78cc0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 --2- 172.21.15.5:0/2241558301 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc0b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 -- 172.21.15.5:0/2241558301 >> v2:172.21.15.80:3300/0 conn(0x7f78cc1614b0 msgr2=0x7f78cc0b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 --2- 172.21.15.5:0/2241558301 >> v2:172.21.15.80:3300/0 conn(0x7f78cc1614b0 0x7f78cc0b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.551+0000 7f78d1abd640 1 -- 172.21.15.5:0/2241558301 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0d2fe0 con 0x7f78cc0d1f60 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.552+0000 7f78d1abd640 1 --2- 172.21.15.5:0/2241558301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc0d1f60 0x7f78cc0d3b20 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f78cc08ca90 tx=0x7f78c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e870ed457a12e727 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.552+0000 7f78d12bc640 1 -- 172.21.15.5:0/2241558301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0037070 con 0x7f78cc0d1f60 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.552+0000 7f78d12bc640 1 -- 172.21.15.5:0/2241558301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0032440 con 0x7f78cc0d1f60 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.552+0000 7f78d12bc640 1 -- 172.21.15.5:0/2241558301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0032810 con 0x7f78cc0d1f60 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 -- 172.21.15.5:0/2241558301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc0d1f60 msgr2=0x7f78cc0d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 --2- 172.21.15.5:0/2241558301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc0d1f60 0x7f78cc0d3b20 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f78cc08ca90 tx=0x7f78c002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 -- 172.21.15.5:0/2241558301 shutdown_connections 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 --2- 172.21.15.5:0/2241558301 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc0b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 --2- 172.21.15.5:0/2241558301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc0d1f60 0x7f78cc0d3b20 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 --2- 172.21.15.5:0/2241558301 >> v2:172.21.15.80:3300/0 conn(0x7f78cc1614b0 0x7f78cc0b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 -- 172.21.15.5:0/2241558301 >> 172.21.15.5:0/2241558301 conn(0x7f78cc06b000 msgr2=0x7f78cc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 -- 172.21.15.5:0/2241558301 shutdown_connections 2024-04-25T09:06:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.553+0000 7f78d4522640 1 -- 172.21.15.5:0/2241558301 wait complete. 2024-04-25T09:06:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.554+0000 7f78d4522640 1 Processor -- start 2024-04-25T09:06:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.554+0000 7f78d4522640 1 -- start start 2024-04-25T09:06:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d4522640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78cc0d1f60 0x7f78cc1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d4522640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d4522640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc1614b0 0x7f78cc0b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d4522640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0d23a0 con 0x7f78cc1614b0 2024-04-25T09:06:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d4522640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0d37e0 con 0x7f78cc0d1f60 2024-04-25T09:06:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d4522640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0d2520 con 0x7f78cc0d4060 2024-04-25T09:06:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc1614b0 0x7f78cc0b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc1614b0 0x7f78cc0b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59076/0 (socket says 172.21.15.5:59076) 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 -- 172.21.15.5:0/4105938138 learned_addr learned my addr 172.21.15.5:0/4105938138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d1abd640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d22be640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78cc0d1f60 0x7f78cc1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 -- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 msgr2=0x7f78cc14ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc14ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 -- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78cc0d1f60 msgr2=0x7f78cc1f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78cc0d1f60 0x7f78cc1f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.555+0000 7f78d2abf640 1 -- 172.21.15.5:0/4105938138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0b34f0 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.556+0000 7f78d2abf640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc1614b0 0x7f78cc0b88e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f78c400d830 tx=0x7f78c400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.556+0000 7f78caffd640 1 -- 172.21.15.5:0/4105938138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4018020 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.556+0000 7f78caffd640 1 -- 172.21.15.5:0/4105938138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c40096c0 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.556+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc0b37d0 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.556+0000 7f78caffd640 1 -- 172.21.15.5:0/4105938138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4009a90 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.556+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc0b3d90 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.557+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc04ef20 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.557+0000 7f78caffd640 1 -- 172.21.15.5:0/4105938138 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f78c401b020 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.558+0000 7f78caffd640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f78b806b500 0x7f78b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.558+0000 7f78caffd640 1 -- 172.21.15.5:0/4105938138 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78c408a230 con 0x7f78cc1614b0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.558+0000 7f78d22be640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f78b806b500 0x7f78b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.559+0000 7f78d22be640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f78b806b500 0x7f78b806d9c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f78bc003b80 tx=0x7f78bc0098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.562+0000 7f78caffd640 1 -- 172.21.15.5:0/4105938138 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78c4022030 con 0x7f78cc1614b0 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:16.782+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f78cc0b9890 con 0x7f78cc1614b0 2024-04-25T09:06:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.441+0000 7f78caffd640 1 -- 172.21.15.5:0/4105938138 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v89) v1 ==== 122+0+0 (secure 0 0 0) 0x7f78c4058af0 con 0x7f78cc1614b0 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f78b806b500 msgr2=0x7f78b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f78b806b500 0x7f78b806d9c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f78bc003b80 tx=0x7f78bc0098d0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc1614b0 msgr2=0x7f78cc0b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc1614b0 0x7f78cc0b88e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f78c400d830 tx=0x7f78c400dcf0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 shutdown_connections 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f78b806b500 0x7f78b806d9c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78cc1614b0 0x7f78cc0b88e0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f78cc0d4060 0x7f78cc14ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 --2- 172.21.15.5:0/4105938138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78cc0d1f60 0x7f78cc1f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.443+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 >> 172.21.15.5:0/4105938138 conn(0x7f78cc06b000 msgr2=0x7f78cc15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.444+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 shutdown_connections 2024-04-25T09:06:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.444+0000 7f78d4522640 1 -- 172.21.15.5:0/4105938138 wait complete. 2024-04-25T09:06:17.444 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:06:17.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:17.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.564+0000 7fdf3723f640 1 Processor -- start 2024-04-25T09:06:17.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.564+0000 7fdf3723f640 1 -- start start 2024-04-25T09:06:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf3723f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf300d3990 0x7fdf300d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf3723f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf300b6f50 0x7fdf300b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf3723f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300b29c0 con 0x7fdf3015e0a0 2024-04-25T09:06:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf3723f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf300d4330 con 0x7fdf300b6f50 2024-04-25T09:06:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf3723f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf300d1460 con 0x7fdf300d3990 2024-04-25T09:06:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf357dc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf300b6f50 0x7fdf300b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf357dc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf300b6f50 0x7fdf300b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59090/0 (socket says 172.21.15.5:59090) 2024-04-25T09:06:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.565+0000 7fdf357dc640 1 -- 172.21.15.5:0/2985725792 learned_addr learned my addr 172.21.15.5:0/2985725792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.566+0000 7fdf2ffff640 1 --2- 172.21.15.5:0/2985725792 >> v2:172.21.15.80:3300/0 conn(0x7fdf300d3990 0x7fdf300d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.566+0000 7fdf357dc640 1 -- 172.21.15.5:0/2985725792 >> v2:172.21.15.80:3300/0 conn(0x7fdf300d3990 msgr2=0x7fdf300d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.566+0000 7fdf357dc640 1 --2- 172.21.15.5:0/2985725792 >> v2:172.21.15.80:3300/0 conn(0x7fdf300d3990 0x7fdf300d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.566+0000 7fdf357dc640 1 -- 172.21.15.5:0/2985725792 >> v1:172.21.15.80:6789/0 conn(0x7fdf3015e0a0 legacy=0x7fdf300d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.566+0000 7fdf357dc640 1 -- 172.21.15.5:0/2985725792 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300d2080 con 0x7fdf300b6f50 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.566+0000 7fdf357dc640 1 --2- 172.21.15.5:0/2985725792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300b6f50 0x7fdf300b73e0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fdf300676e0 tx=0x7fdf2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e86a241b807505 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/2985725792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20037070 con 0x7fdf300b6f50 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/2985725792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20032440 con 0x7fdf300b6f50 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/2985725792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20032810 con 0x7fdf300b6f50 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 -- 172.21.15.5:0/2985725792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300b6f50 msgr2=0x7fdf300b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 --2- 172.21.15.5:0/2985725792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300b6f50 0x7fdf300b73e0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fdf300676e0 tx=0x7fdf2002a270 comp rx=0 tx=0).stop 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 -- 172.21.15.5:0/2985725792 shutdown_connections 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 --2- 172.21.15.5:0/2985725792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300b6f50 0x7fdf300b73e0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 --2- 172.21.15.5:0/2985725792 >> v2:172.21.15.80:3300/0 conn(0x7fdf300d3990 0x7fdf300d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 -- 172.21.15.5:0/2985725792 >> 172.21.15.5:0/2985725792 conn(0x7fdf300668f0 msgr2=0x7fdf30066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 -- 172.21.15.5:0/2985725792 shutdown_connections 2024-04-25T09:06:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.567+0000 7fdf3723f640 1 -- 172.21.15.5:0/2985725792 wait complete. 2024-04-25T09:06:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 Processor -- start 2024-04-25T09:06:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 -- start start 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf300b6f50 0x7fdf3015c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300d3990 0x7fdf301f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf3015e0a0 0x7fdf300c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300d2920 con 0x7fdf300d3990 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300d2640 con 0x7fdf300b6f50 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.569+0000 7fdf3723f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300d2c00 con 0x7fdf3015e0a0 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300d3990 0x7fdf301f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300d3990 0x7fdf301f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59092/0 (socket says 172.21.15.5:59092) 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 -- 172.21.15.5:0/4258281620 learned_addr learned my addr 172.21.15.5:0/4258281620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf357dc640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf3015e0a0 0x7fdf300c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf34fdb640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf300b6f50 0x7fdf3015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 -- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf3015e0a0 msgr2=0x7fdf300c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf3015e0a0 0x7fdf300c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 -- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf300b6f50 msgr2=0x7fdf3015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf300b6f50 0x7fdf3015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 -- 172.21.15.5:0/4258281620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3015cec0 con 0x7fdf300d3990 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2ffff640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300d3990 0x7fdf301f4ea0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e9e0 tx=0x7fdf2400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2d7fa640 1 -- 172.21.15.5:0/4258281620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24017070 con 0x7fdf300d3990 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2d7fa640 1 -- 172.21.15.5:0/4258281620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400c9d0 con 0x7fdf300d3990 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf301f4a60 con 0x7fdf300d3990 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf2d7fa640 1 -- 172.21.15.5:0/4258281620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400cdc0 con 0x7fdf300d3990 2024-04-25T09:06:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.570+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf300cc4b0 con 0x7fdf300d3990 2024-04-25T09:06:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.571+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3004ef20 con 0x7fdf300d3990 2024-04-25T09:06:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.572+0000 7fdf2d7fa640 1 -- 172.21.15.5:0/4258281620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf2401a070 con 0x7fdf300d3990 2024-04-25T09:06:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.572+0000 7fdf2d7fa640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1c06b4d0 0x7fdf1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.572+0000 7fdf2d7fa640 1 -- 172.21.15.5:0/4258281620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf2408a240 con 0x7fdf300d3990 2024-04-25T09:06:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.572+0000 7fdf34fdb640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1c06b4d0 0x7fdf1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.573+0000 7fdf34fdb640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1c06b4d0 0x7fdf1c06d990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fdf280012e0 tx=0x7fdf28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.577+0000 7fdf2d7fa640 1 -- 172.21.15.5:0/4258281620 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf240590c0 con 0x7fdf300d3990 2024-04-25T09:06:17.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:17.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:17.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.794+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf301f53e0 con 0x7fdf300d3990 2024-04-25T09:06:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.795+0000 7fdf2d7fa640 1 -- 172.21.15.5:0/4258281620 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fdf240589c0 con 0x7fdf300d3990 2024-04-25T09:06:17.783 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":9591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1089300174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1089300174},{"type":"v1","addr":"172.21.15.5:6833","nonce":1089300174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:14.788729+0000","modified":"2024-04-25T09:06:16.783115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9597":{"gid":9597,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1713726638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1713726638},{"type":"v1","addr":"172.21.15.5:6835","nonce":1713726638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:06:17.784 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 89 2024-04-25T09:06:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1c06b4d0 msgr2=0x7fdf1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1c06b4d0 0x7fdf1c06d990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fdf280012e0 tx=0x7fdf28009040 comp rx=0 tx=0).stop 2024-04-25T09:06:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300d3990 msgr2=0x7fdf301f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300d3990 0x7fdf301f4ea0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e9e0 tx=0x7fdf2400eea0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 shutdown_connections 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fdf1c06b4d0 0x7fdf1c06d990 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fdf3015e0a0 0x7fdf300c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf300d3990 0x7fdf301f4ea0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 --2- 172.21.15.5:0/4258281620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf300b6f50 0x7fdf3015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 >> 172.21.15.5:0/4258281620 conn(0x7fdf300668f0 msgr2=0x7fdf300b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 shutdown_connections 2024-04-25T09:06:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.797+0000 7fdf3723f640 1 -- 172.21.15.5:0/4258281620 wait complete. 2024-04-25T09:06:17.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.982+0000 7fb70e24a640 1 Processor -- start 2024-04-25T09:06:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.982+0000 7fb70e24a640 1 -- start start 2024-04-25T09:06:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb70e24a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7080cc120 0x7fb7080cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb70e24a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7080cfbb0 0x7fb70815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb70e24a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080b3860 con 0x7fb70815c620 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb70e24a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080d0010 con 0x7fb7080cfbb0 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb706ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7080cfbb0 0x7fb70815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb706ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7080cfbb0 0x7fb70815c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59098/0 (socket says 172.21.15.5:59098) 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb706ffd640 1 -- 172.21.15.5:0/2615186359 learned_addr learned my addr 172.21.15.5:0/2615186359 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb70e24a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70806d280 con 0x7fb7080cc120 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb7077fe640 1 --2- 172.21.15.5:0/2615186359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7080cc120 0x7fb7080cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb706ffd640 1 -- 172.21.15.5:0/2615186359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7080cc120 msgr2=0x7fb7080cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb706ffd640 1 --2- 172.21.15.5:0/2615186359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7080cc120 0x7fb7080cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb706ffd640 1 -- 172.21.15.5:0/2615186359 >> v1:172.21.15.5:6789/0 conn(0x7fb70815c620 legacy=0x7fb70815f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb7067fc640 1 -- 172.21.15.5:0/2615186359 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601691064 0 0) 0x7fb7080b3860 con 0x7fb70815c620 2024-04-25T09:06:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.983+0000 7fb706ffd640 1 -- 172.21.15.5:0/2615186359 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70806c4c0 con 0x7fb7080cfbb0 2024-04-25T09:06:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.984+0000 7fb706ffd640 1 --2- 172.21.15.5:0/2615186359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cfbb0 0x7fb70815c0e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009870 tx=0x7fb6fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e39f0f9e312041c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.984+0000 7fb7067fc640 1 -- 172.21.15.5:0/2615186359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc037070 con 0x7fb7080cfbb0 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.984+0000 7fb7067fc640 1 -- 172.21.15.5:0/2615186359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc032440 con 0x7fb7080cfbb0 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.984+0000 7fb7067fc640 1 -- 172.21.15.5:0/2615186359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc032810 con 0x7fb7080cfbb0 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 -- 172.21.15.5:0/2615186359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cfbb0 msgr2=0x7fb70815c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 --2- 172.21.15.5:0/2615186359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cfbb0 0x7fb70815c0e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009870 tx=0x7fb6fc02a270 comp rx=0 tx=0).stop 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 -- 172.21.15.5:0/2615186359 shutdown_connections 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 --2- 172.21.15.5:0/2615186359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cfbb0 0x7fb70815c0e0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 --2- 172.21.15.5:0/2615186359 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb7080cc120 0x7fb7080cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 -- 172.21.15.5:0/2615186359 >> 172.21.15.5:0/2615186359 conn(0x7fb7080668f0 msgr2=0x7fb708066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 -- 172.21.15.5:0/2615186359 shutdown_connections 2024-04-25T09:06:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.985+0000 7fb70e24a640 1 -- 172.21.15.5:0/2615186359 wait complete. 2024-04-25T09:06:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.986+0000 7fb70e24a640 1 Processor -- start 2024-04-25T09:06:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.986+0000 7fb70e24a640 1 -- start start 2024-04-25T09:06:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb70e24a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cc120 0x7fb708149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb70e24a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7080cfbb0 0x7fb708154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb70e24a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb70815c620 0x7fb7080c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb70e24a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70806cd60 con 0x7fb7080cc120 2024-04-25T09:06:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb70e24a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70806ca80 con 0x7fb7080cfbb0 2024-04-25T09:06:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb70e24a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70815ce50 con 0x7fb70815c620 2024-04-25T09:06:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cc120 0x7fb708149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cc120 0x7fb708149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59100/0 (socket says 172.21.15.5:59100) 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 -- 172.21.15.5:0/221219983 learned_addr learned my addr 172.21.15.5:0/221219983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 -- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb70815c620 msgr2=0x7fb7080c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb70815c620 0x7fb7080c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 -- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7080cfbb0 msgr2=0x7fb708154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7080cfbb0 0x7fb708154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 -- 172.21.15.5:0/221219983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7081497c0 con 0x7fb7080cc120 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.987+0000 7fb7077fe640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cc120 0x7fb708149280 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e870 tx=0x7fb6f800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.988+0000 7fb6effff640 1 -- 172.21.15.5:0/221219983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8017070 con 0x7fb7080cc120 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.988+0000 7fb6effff640 1 -- 172.21.15.5:0/221219983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f800c940 con 0x7fb7080cc120 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.988+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb708155b10 con 0x7fb7080cc120 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.988+0000 7fb6effff640 1 -- 172.21.15.5:0/221219983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800cd30 con 0x7fb7080cc120 2024-04-25T09:06:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.988+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7080c73a0 con 0x7fb7080cc120 2024-04-25T09:06:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.989+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70804ef20 con 0x7fb7080cc120 2024-04-25T09:06:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.989+0000 7fb6effff640 1 -- 172.21.15.5:0/221219983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb6f801a070 con 0x7fb7080cc120 2024-04-25T09:06:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.989+0000 7fb6effff640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6f406b4d0 0x7fb6f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.990+0000 7fb6effff640 1 -- 172.21.15.5:0/221219983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6f808a160 con 0x7fb7080cc120 2024-04-25T09:06:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.990+0000 7fb706ffd640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6f406b4d0 0x7fb6f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.990+0000 7fb706ffd640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6f406b4d0 0x7fb6f406d990 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc034000 tx=0x7fb6fc02c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:17.994+0000 7fb6effff640 1 -- 172.21.15.5:0/221219983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6f8058f50 con 0x7fb7080cc120 2024-04-25T09:06:18.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.173+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb708066cd0 con 0x7fb7080cc120 2024-04-25T09:06:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.175+0000 7fb6effff640 1 -- 172.21.15.5:0/221219983 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16595 (secure 0 0 0) 0x7fb6f8058850 con 0x7fb7080cc120 2024-04-25T09:06:18.163 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:18.163 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":138,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:16.431015+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:13.105023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:13.759633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.176+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6f406b4d0 msgr2=0x7fb6f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.176+0000 7fb70e24a640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6f406b4d0 0x7fb6f406d990 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc034000 tx=0x7fb6fc02c000 comp rx=0 tx=0).stop 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cc120 msgr2=0x7fb708149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cc120 0x7fb708149280 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e870 tx=0x7fb6f800ed30 comp rx=0 tx=0).stop 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 shutdown_connections 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb6f406b4d0 0x7fb6f406d990 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb70815c620 0x7fb7080c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7080cfbb0 0x7fb708154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 --2- 172.21.15.5:0/221219983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7080cc120 0x7fb708149280 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 >> 172.21.15.5:0/221219983 conn(0x7fb7080668f0 msgr2=0x7fb70815aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 shutdown_connections 2024-04-25T09:06:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.177+0000 7fb70e24a640 1 -- 172.21.15.5:0/221219983 wait complete. 2024-04-25T09:06:18.176 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:06:18.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 Processor -- start 2024-04-25T09:06:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 -- start start 2024-04-25T09:06:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f3c15de70 0x7f3f3c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b7130 0x7f3f3c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c0d2a10 con 0x7f3f3c0b7130 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c0d20e0 con 0x7f3f3c15de70 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.289+0000 7f3f42288640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0d23c0 con 0x7f3f3c0b2cc0 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b7130 0x7f3f3c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b7130 0x7f3f3c0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59114/0 (socket says 172.21.15.5:59114) 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 -- 172.21.15.5:0/482672305 learned_addr learned my addr 172.21.15.5:0/482672305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f3b7fe640 1 --2- 172.21.15.5:0/482672305 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f3bfff640 1 --2- 172.21.15.5:0/482672305 >> v2:172.21.15.80:3300/0 conn(0x7f3f3c15de70 0x7f3f3c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 -- 172.21.15.5:0/482672305 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 msgr2=0x7f3f3c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 --2- 172.21.15.5:0/482672305 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 -- 172.21.15.5:0/482672305 >> v2:172.21.15.80:3300/0 conn(0x7f3f3c15de70 msgr2=0x7f3f3c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 --2- 172.21.15.5:0/482672305 >> v2:172.21.15.80:3300/0 conn(0x7f3f3c15de70 0x7f3f3c0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f40825640 1 -- 172.21.15.5:0/482672305 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0d26a0 con 0x7f3f3c0b7130 2024-04-25T09:06:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.290+0000 7f3f3bfff640 1 --2- 172.21.15.5:0/482672305 >> v2:172.21.15.80:3300/0 conn(0x7f3f3c15de70 0x7f3f3c0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f40825640 1 --2- 172.21.15.5:0/482672305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c0ce7f0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0d1650 tx=0x7f3f3402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810f63c62e837929 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f3affd640 1 -- 172.21.15.5:0/482672305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34036070 con 0x7f3f3c0b7130 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f3affd640 1 -- 172.21.15.5:0/482672305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34031600 con 0x7f3f3c0b7130 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f3affd640 1 -- 172.21.15.5:0/482672305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340319d0 con 0x7f3f3c0b7130 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 -- 172.21.15.5:0/482672305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 msgr2=0x7f3f3c0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 --2- 172.21.15.5:0/482672305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c0ce7f0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0d1650 tx=0x7f3f3402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 -- 172.21.15.5:0/482672305 shutdown_connections 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 --2- 172.21.15.5:0/482672305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c0ce7f0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 --2- 172.21.15.5:0/482672305 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 --2- 172.21.15.5:0/482672305 >> v2:172.21.15.80:3300/0 conn(0x7f3f3c15de70 0x7f3f3c0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 -- 172.21.15.5:0/482672305 >> 172.21.15.5:0/482672305 conn(0x7f3f3c06b000 msgr2=0x7f3f3c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 -- 172.21.15.5:0/482672305 shutdown_connections 2024-04-25T09:06:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.291+0000 7f3f42288640 1 -- 172.21.15.5:0/482672305 wait complete. 2024-04-25T09:06:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.292+0000 7f3f42288640 1 Processor -- start 2024-04-25T09:06:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.293+0000 7f3f42288640 1 -- start start 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.293+0000 7f3f42288640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.293+0000 7f3f42288640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.293+0000 7f3f42288640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c15de70 0x7f3f3c160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.293+0000 7f3f42288640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0ceeb0 con 0x7f3f3c0b7130 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.293+0000 7f3f42288640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0ced30 con 0x7f3f3c15de70 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.293+0000 7f3f42288640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0cf030 con 0x7f3f3c0b2cc0 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59120/0 (socket says 172.21.15.5:59120) 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 -- 172.21.15.5:0/429635287 learned_addr learned my addr 172.21.15.5:0/429635287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3bfff640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f40825640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c15de70 0x7f3f3c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 -- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 msgr2=0x7f3f3c156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 -- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c15de70 msgr2=0x7f3f3c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c15de70 0x7f3f3c160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 -- 172.21.15.5:0/429635287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0b8140 con 0x7f3f3c0b7130 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f3b7fe640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c160040 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400e890 tx=0x7f3f2400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f38ff9640 1 -- 172.21.15.5:0/429635287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24017070 con 0x7f3f3c0b7130 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f38ff9640 1 -- 172.21.15.5:0/429635287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2400c940 con 0x7f3f3c0b7130 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f38ff9640 1 -- 172.21.15.5:0/429635287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400cd10 con 0x7f3f3c0b7130 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c1f7390 con 0x7f3f3c0b7130 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.294+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c1570e0 con 0x7f3f3c0b7130 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.295+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c04ef20 con 0x7f3f3c0b7130 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.296+0000 7f3f38ff9640 1 -- 172.21.15.5:0/429635287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f2401a070 con 0x7f3f3c0b7130 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.296+0000 7f3f38ff9640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1c06b4d0 0x7f3f1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.296+0000 7f3f38ff9640 1 -- 172.21.15.5:0/429635287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f2408a0c0 con 0x7f3f3c0b7130 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.297+0000 7f3f3bfff640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1c06b4d0 0x7f3f1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.297+0000 7f3f3bfff640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1c06b4d0 0x7f3f1c06d990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006fd0 tx=0x7f3f2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.301+0000 7f3f38ff9640 1 -- 172.21.15.5:0/429635287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f240588f0 con 0x7f3f3c0b7130 2024-04-25T09:06:18.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.480+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f3c0b6c90 con 0x7f3f1c06b4d0 2024-04-25T09:06:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.486+0000 7f3f38ff9640 1 -- 172.21.15.5:0/429635287 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252444 (secure 0 0 0) 0x7f3f3c0b6c90 con 0x7f3f1c06b4d0 2024-04-25T09:06:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:18.479 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:06:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1c06b4d0 msgr2=0x7f3f1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1c06b4d0 0x7f3f1c06d990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006fd0 tx=0x7f3f2c008040 comp rx=0 tx=0).stop 2024-04-25T09:06:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 msgr2=0x7f3f3c160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c160040 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400e890 tx=0x7f3f2400ed50 comp rx=0 tx=0).stop 2024-04-25T09:06:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 shutdown_connections 2024-04-25T09:06:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3f1c06b4d0 0x7f3f1c06d990 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c15de70 0x7f3f3c160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b7130 0x7f3f3c160040 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 --2- 172.21.15.5:0/429635287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3f3c0b2cc0 0x7f3f3c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 >> 172.21.15.5:0/429635287 conn(0x7f3f3c06b000 msgr2=0x7f3f3c15e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 shutdown_connections 2024-04-25T09:06:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.489+0000 7f3f42288640 1 -- 172.21.15.5:0/429635287 wait complete. 2024-04-25T09:06:18.488 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-04-25T09:06:16.519337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415376,"kb_used_data":14628,"kb_used_omap":12,"kb_used_meta":400627,"kb_avail":754559344,"statfs":{"total":773094113280,"available":772668768256,"internally_reserved":0,"allocated":14979072,"data_stored":7179970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":410242609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001087"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450607+0000","last_change":"2024-04-25T09:06:15.450030+0000","last_active":"2024-04-25T09:06:15.450607+0000","last_peered":"2024-04-25T09:06:15.450607+0000","last_clean":"2024-04-25T09:06:15.450607+0000","last_became_active":"2024-04-25T09:06:15.449734+0000","last_became_peered":"2024-04-25T09:06:15.449734+0000","last_unstale":"2024-04-25T09:06:15.450607+0000","last_undegraded":"2024-04-25T09:06:15.450607+0000","last_fullsized":"2024-04-25T09:06:15.450607+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:53.782825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.446915+0000","last_change":"2024-04-25T09:06:15.444124+0000","last_active":"2024-04-25T09:06:15.446915+0000","last_peered":"2024-04-25T09:06:15.446915+0000","last_clean":"2024-04-25T09:06:15.446915+0000","last_became_active":"2024-04-25T09:06:15.443703+0000","last_became_peered":"2024-04-25T09:06:15.443703+0000","last_unstale":"2024-04-25T09:06:15.446915+0000","last_undegraded":"2024-04-25T09:06:15.446915+0000","last_fullsized":"2024-04-25T09:06:15.446915+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:06.760446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447926+0000","last_change":"2024-04-25T09:06:15.441804+0000","last_active":"2024-04-25T09:06:15.447926+0000","last_peered":"2024-04-25T09:06:15.447926+0000","last_clean":"2024-04-25T09:06:15.447926+0000","last_became_active":"2024-04-25T09:06:15.441205+0000","last_became_peered":"2024-04-25T09:06:15.441205+0000","last_unstale":"2024-04-25T09:06:15.447926+0000","last_undegraded":"2024-04-25T09:06:15.447926+0000","last_fullsized":"2024-04-25T09:06:15.447926+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:32.922291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441544+0000","last_change":"2024-04-25T09:06:15.439997+0000","last_active":"2024-04-25T09:06:16.441544+0000","last_peered":"2024-04-25T09:06:16.441544+0000","last_clean":"2024-04-25T09:06:16.441544+0000","last_became_active":"2024-04-25T09:06:15.439669+0000","last_became_peered":"2024-04-25T09:06:15.439669+0000","last_unstale":"2024-04-25T09:06:16.441544+0000","last_undegraded":"2024-04-25T09:06:16.441544+0000","last_fullsized":"2024-04-25T09:06:16.441544+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:19.588891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442633+0000","last_change":"2024-04-25T09:06:15.447309+0000","last_active":"2024-04-25T09:06:16.442633+0000","last_peered":"2024-04-25T09:06:16.442633+0000","last_clean":"2024-04-25T09:06:16.442633+0000","last_became_active":"2024-04-25T09:06:15.446968+0000","last_became_peered":"2024-04-25T09:06:15.446968+0000","last_unstale":"2024-04-25T09:06:16.442633+0000","last_undegraded":"2024-04-25T09:06:16.442633+0000","last_fullsized":"2024-04-25T09:06:16.442633+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:30.480835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.445282+0000","last_change":"2024-04-25T09:06:15.443234+0000","last_active":"2024-04-25T09:06:15.445282+0000","last_peered":"2024-04-25T09:06:15.445282+0000","last_clean":"2024-04-25T09:06:15.445282+0000","last_became_active":"2024-04-25T09:06:15.442922+0000","last_became_peered":"2024-04-25T09:06:15.442922+0000","last_unstale":"2024-04-25T09:06:15.445282+0000","last_undegraded":"2024-04-25T09:06:15.445282+0000","last_fullsized":"2024-04-25T09:06:15.445282+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:09.251777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.442746+0000","last_change":"2024-04-25T09:06:15.442192+0000","last_active":"2024-04-25T09:06:15.442746+0000","last_peered":"2024-04-25T09:06:15.442746+0000","last_clean":"2024-04-25T09:06:15.442746+0000","last_became_active":"2024-04-25T09:06:15.441885+0000","last_became_peered":"2024-04-25T09:06:15.441885+0000","last_unstale":"2024-04-25T09:06:15.442746+0000","last_undegraded":"2024-04-25T09:06:15.442746+0000","last_fullsized":"2024-04-25T09:06:15.442746+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:06.760446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.443329+0000","last_change":"2024-04-25T09:06:15.441866+0000","last_active":"2024-04-25T09:06:15.443329+0000","last_peered":"2024-04-25T09:06:15.443329+0000","last_clean":"2024-04-25T09:06:15.443329+0000","last_became_active":"2024-04-25T09:06:15.441574+0000","last_became_peered":"2024-04-25T09:06:15.441574+0000","last_unstale":"2024-04-25T09:06:15.443329+0000","last_undegraded":"2024-04-25T09:06:15.443329+0000","last_fullsized":"2024-04-25T09:06:15.443329+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.866520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.446856+0000","last_change":"2024-04-25T09:06:15.444536+0000","last_active":"2024-04-25T09:06:15.446856+0000","last_peered":"2024-04-25T09:06:15.446856+0000","last_clean":"2024-04-25T09:06:15.446856+0000","last_became_active":"2024-04-25T09:06:15.444192+0000","last_became_peered":"2024-04-25T09:06:15.444192+0000","last_unstale":"2024-04-25T09:06:15.446856+0000","last_undegraded":"2024-04-25T09:06:15.446856+0000","last_fullsized":"2024-04-25T09:06:15.446856+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:00.046072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447074+0000","last_change":"2024-04-25T09:06:15.442269+0000","last_active":"2024-04-25T09:06:15.447074+0000","last_peered":"2024-04-25T09:06:15.447074+0000","last_clean":"2024-04-25T09:06:15.447074+0000","last_became_active":"2024-04-25T09:06:15.441989+0000","last_became_peered":"2024-04-25T09:06:15.441989+0000","last_unstale":"2024-04-25T09:06:15.447074+0000","last_undegraded":"2024-04-25T09:06:15.447074+0000","last_fullsized":"2024-04-25T09:06:15.447074+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:32.988183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457747+0000","last_change":"2024-04-25T09:06:15.452668+0000","last_active":"2024-04-25T09:06:15.457747+0000","last_peered":"2024-04-25T09:06:15.457747+0000","last_clean":"2024-04-25T09:06:15.457747+0000","last_became_active":"2024-04-25T09:06:15.451664+0000","last_became_peered":"2024-04-25T09:06:15.451664+0000","last_unstale":"2024-04-25T09:06:15.457747+0000","last_undegraded":"2024-04-25T09:06:15.457747+0000","last_fullsized":"2024-04-25T09:06:15.457747+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:54.760347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447571+0000","last_change":"2024-04-25T09:06:15.441759+0000","last_active":"2024-04-25T09:06:15.447571+0000","last_peered":"2024-04-25T09:06:15.447571+0000","last_clean":"2024-04-25T09:06:15.447571+0000","last_became_active":"2024-04-25T09:06:15.441499+0000","last_became_peered":"2024-04-25T09:06:15.441499+0000","last_unstale":"2024-04-25T09:06:15.447571+0000","last_undegraded":"2024-04-25T09:06:15.447571+0000","last_fullsized":"2024-04-25T09:06:15.447571+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:43.988107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442697+0000","last_change":"2024-04-25T09:06:15.447329+0000","last_active":"2024-04-25T09:06:16.442697+0000","last_peered":"2024-04-25T09:06:16.442697+0000","last_clean":"2024-04-25T09:06:16.442697+0000","last_became_active":"2024-04-25T09:06:15.447036+0000","last_became_peered":"2024-04-25T09:06:15.447036+0000","last_unstale":"2024-04-25T09:06:16.442697+0000","last_undegraded":"2024-04-25T09:06:16.442697+0000","last_fullsized":"2024-04-25T09:06:16.442697+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:01.900458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441598+0000","last_change":"2024-04-25T09:06:15.438329+0000","last_active":"2024-04-25T09:06:16.441598+0000","last_peered":"2024-04-25T09:06:16.441598+0000","last_clean":"2024-04-25T09:06:16.441598+0000","last_became_active":"2024-04-25T09:06:15.437099+0000","last_became_peered":"2024-04-25T09:06:15.437099+0000","last_unstale":"2024-04-25T09:06:16.441598+0000","last_undegraded":"2024-04-25T09:06:16.441598+0000","last_fullsized":"2024-04-25T09:06:16.441598+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:27.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452628+0000","last_change":"2024-04-25T09:06:15.450102+0000","last_active":"2024-04-25T09:06:15.452628+0000","last_peered":"2024-04-25T09:06:15.452628+0000","last_clean":"2024-04-25T09:06:15.452628+0000","last_became_active":"2024-04-25T09:06:15.449844+0000","last_became_peered":"2024-04-25T09:06:15.449844+0000","last_unstale":"2024-04-25T09:06:15.452628+0000","last_undegraded":"2024-04-25T09:06:15.452628+0000","last_fullsized":"2024-04-25T09:06:15.452628+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:09.734821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.437888+0000","last_change":"2024-04-25T09:06:15.448723+0000","last_active":"2024-04-25T09:06:16.437888+0000","last_peered":"2024-04-25T09:06:16.437888+0000","last_clean":"2024-04-25T09:06:16.437888+0000","last_became_active":"2024-04-25T09:06:15.448427+0000","last_became_peered":"2024-04-25T09:06:15.448427+0000","last_unstale":"2024-04-25T09:06:16.437888+0000","last_undegraded":"2024-04-25T09:06:16.437888+0000","last_fullsized":"2024-04-25T09:06:16.437888+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:54.760347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447806+0000","last_change":"2024-04-25T09:06:15.446006+0000","last_active":"2024-04-25T09:06:15.447806+0000","last_peered":"2024-04-25T09:06:15.447806+0000","last_clean":"2024-04-25T09:06:15.447806+0000","last_became_active":"2024-04-25T09:06:15.445747+0000","last_became_peered":"2024-04-25T09:06:15.445747+0000","last_unstale":"2024-04-25T09:06:15.447806+0000","last_undegraded":"2024-04-25T09:06:15.447806+0000","last_fullsized":"2024-04-25T09:06:15.447806+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:14.460782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447894+0000","last_change":"2024-04-25T09:06:15.439807+0000","last_active":"2024-04-25T09:06:15.447894+0000","last_peered":"2024-04-25T09:06:15.447894+0000","last_clean":"2024-04-25T09:06:15.447894+0000","last_became_active":"2024-04-25T09:06:15.439540+0000","last_became_peered":"2024-04-25T09:06:15.439540+0000","last_unstale":"2024-04-25T09:06:15.447894+0000","last_undegraded":"2024-04-25T09:06:15.447894+0000","last_fullsized":"2024-04-25T09:06:15.447894+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:01.900458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458025+0000","last_change":"2024-04-25T09:06:15.455243+0000","last_active":"2024-04-25T09:06:15.458025+0000","last_peered":"2024-04-25T09:06:15.458025+0000","last_clean":"2024-04-25T09:06:15.458025+0000","last_became_active":"2024-04-25T09:06:15.454906+0000","last_became_peered":"2024-04-25T09:06:15.454906+0000","last_unstale":"2024-04-25T09:06:15.458025+0000","last_undegraded":"2024-04-25T09:06:15.458025+0000","last_fullsized":"2024-04-25T09:06:15.458025+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:14.405830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438211+0000","last_change":"2024-04-25T09:06:15.432719+0000","last_active":"2024-04-25T09:06:16.438211+0000","last_peered":"2024-04-25T09:06:16.438211+0000","last_clean":"2024-04-25T09:06:16.438211+0000","last_became_active":"2024-04-25T09:06:15.432408+0000","last_became_peered":"2024-04-25T09:06:15.432408+0000","last_unstale":"2024-04-25T09:06:16.438211+0000","last_undegraded":"2024-04-25T09:06:16.438211+0000","last_fullsized":"2024-04-25T09:06:16.438211+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:14.405830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447044+0000","last_change":"2024-04-25T09:06:15.443520+0000","last_active":"2024-04-25T09:06:15.447044+0000","last_peered":"2024-04-25T09:06:15.447044+0000","last_clean":"2024-04-25T09:06:15.447044+0000","last_became_active":"2024-04-25T09:06:15.443178+0000","last_became_peered":"2024-04-25T09:06:15.443178+0000","last_unstale":"2024-04-25T09:06:15.447044+0000","last_undegraded":"2024-04-25T09:06:15.447044+0000","last_fullsized":"2024-04-25T09:06:15.447044+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:07.971008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441391+0000","last_change":"2024-04-25T09:06:15.432476+0000","last_active":"2024-04-25T09:06:16.441391+0000","last_peered":"2024-04-25T09:06:16.441391+0000","last_clean":"2024-04-25T09:06:16.441391+0000","last_became_active":"2024-04-25T09:06:15.431966+0000","last_became_peered":"2024-04-25T09:06:15.431966+0000","last_unstale":"2024-04-25T09:06:16.441391+0000","last_undegraded":"2024-04-25T09:06:16.441391+0000","last_fullsized":"2024-04-25T09:06:16.441391+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:07.054489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441316+0000","last_change":"2024-04-25T09:06:15.442638+0000","last_active":"2024-04-25T09:06:16.441316+0000","last_peered":"2024-04-25T09:06:16.441316+0000","last_clean":"2024-04-25T09:06:16.441316+0000","last_became_active":"2024-04-25T09:06:15.442227+0000","last_became_peered":"2024-04-25T09:06:15.442227+0000","last_unstale":"2024-04-25T09:06:16.441316+0000","last_undegraded":"2024-04-25T09:06:16.441316+0000","last_fullsized":"2024-04-25T09:06:16.441316+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:39.240063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447112+0000","last_change":"2024-04-25T09:06:15.442745+0000","last_active":"2024-04-25T09:06:15.447112+0000","last_peered":"2024-04-25T09:06:15.447112+0000","last_clean":"2024-04-25T09:06:15.447112+0000","last_became_active":"2024-04-25T09:06:15.442418+0000","last_became_peered":"2024-04-25T09:06:15.442418+0000","last_unstale":"2024-04-25T09:06:15.447112+0000","last_undegraded":"2024-04-25T09:06:15.447112+0000","last_fullsized":"2024-04-25T09:06:15.447112+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.724714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438401+0000","last_change":"2024-04-25T09:06:15.448258+0000","last_active":"2024-04-25T09:06:16.438401+0000","last_peered":"2024-04-25T09:06:16.438401+0000","last_clean":"2024-04-25T09:06:16.438401+0000","last_became_active":"2024-04-25T09:06:15.447958+0000","last_became_peered":"2024-04-25T09:06:15.447958+0000","last_unstale":"2024-04-25T09:06:16.438401+0000","last_undegraded":"2024-04-25T09:06:16.438401+0000","last_fullsized":"2024-04-25T09:06:16.438401+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:36.468863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450543+0000","last_change":"2024-04-25T09:06:15.448827+0000","last_active":"2024-04-25T09:06:15.450543+0000","last_peered":"2024-04-25T09:06:15.450543+0000","last_clean":"2024-04-25T09:06:15.450543+0000","last_became_active":"2024-04-25T09:06:15.448482+0000","last_became_peered":"2024-04-25T09:06:15.448482+0000","last_unstale":"2024-04-25T09:06:15.450543+0000","last_undegraded":"2024-04-25T09:06:15.450543+0000","last_fullsized":"2024-04-25T09:06:15.450543+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:08.317882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438352+0000","last_change":"2024-04-25T09:06:15.442624+0000","last_active":"2024-04-25T09:06:16.438352+0000","last_peered":"2024-04-25T09:06:16.438352+0000","last_clean":"2024-04-25T09:06:16.438352+0000","last_became_active":"2024-04-25T09:06:15.442325+0000","last_became_peered":"2024-04-25T09:06:15.442325+0000","last_unstale":"2024-04-25T09:06:16.438352+0000","last_undegraded":"2024-04-25T09:06:16.438352+0000","last_fullsized":"2024-04-25T09:06:16.438352+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:52.214994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452505+0000","last_change":"2024-04-25T09:06:15.447896+0000","last_active":"2024-04-25T09:06:15.452505+0000","last_peered":"2024-04-25T09:06:15.452505+0000","last_clean":"2024-04-25T09:06:15.452505+0000","last_became_active":"2024-04-25T09:06:15.447590+0000","last_became_peered":"2024-04-25T09:06:15.447590+0000","last_unstale":"2024-04-25T09:06:15.452505+0000","last_undegraded":"2024-04-25T09:06:15.452505+0000","last_fullsized":"2024-04-25T09:06:15.452505+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:53.511662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458189+0000","last_change":"2024-04-25T09:06:15.454881+0000","last_active":"2024-04-25T09:06:15.458189+0000","last_peered":"2024-04-25T09:06:15.458189+0000","last_clean":"2024-04-25T09:06:15.458189+0000","last_became_active":"2024-04-25T09:06:15.454541+0000","last_became_peered":"2024-04-25T09:06:15.454541+0000","last_unstale":"2024-04-25T09:06:15.458189+0000","last_undegraded":"2024-04-25T09:06:15.458189+0000","last_fullsized":"2024-04-25T09:06:15.458189+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:03.195824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441515+0000","last_change":"2024-04-25T09:06:15.450599+0000","last_active":"2024-04-25T09:06:16.441515+0000","last_peered":"2024-04-25T09:06:16.441515+0000","last_clean":"2024-04-25T09:06:16.441515+0000","last_became_active":"2024-04-25T09:06:15.449953+0000","last_became_peered":"2024-04-25T09:06:15.449953+0000","last_unstale":"2024-04-25T09:06:16.441515+0000","last_undegraded":"2024-04-25T09:06:16.441515+0000","last_fullsized":"2024-04-25T09:06:16.441515+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:20.901293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452041+0000","last_change":"2024-04-25T09:06:15.450671+0000","last_active":"2024-04-25T09:06:15.452041+0000","last_peered":"2024-04-25T09:06:15.452041+0000","last_clean":"2024-04-25T09:06:15.452041+0000","last_became_active":"2024-04-25T09:06:15.450376+0000","last_became_peered":"2024-04-25T09:06:15.450376+0000","last_unstale":"2024-04-25T09:06:15.452041+0000","last_undegraded":"2024-04-25T09:06:15.452041+0000","last_fullsized":"2024-04-25T09:06:15.452041+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:53.511662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.437945+0000","last_change":"2024-04-25T09:06:15.435570+0000","last_active":"2024-04-25T09:06:16.437945+0000","last_peered":"2024-04-25T09:06:16.437945+0000","last_clean":"2024-04-25T09:06:16.437945+0000","last_became_active":"2024-04-25T09:06:15.435229+0000","last_became_peered":"2024-04-25T09:06:15.435229+0000","last_unstale":"2024-04-25T09:06:16.437945+0000","last_undegraded":"2024-04-25T09:06:16.437945+0000","last_fullsized":"2024-04-25T09:06:16.437945+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.474349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447093+0000","last_change":"2024-04-25T09:06:15.444056+0000","last_active":"2024-04-25T09:06:15.447093+0000","last_peered":"2024-04-25T09:06:15.447093+0000","last_clean":"2024-04-25T09:06:15.447093+0000","last_became_active":"2024-04-25T09:06:15.443771+0000","last_became_peered":"2024-04-25T09:06:15.443771+0000","last_unstale":"2024-04-25T09:06:15.447093+0000","last_undegraded":"2024-04-25T09:06:15.447093+0000","last_fullsized":"2024-04-25T09:06:15.447093+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:35.367684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"137'4","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458872+0000","last_change":"2024-04-25T09:06:14.433999+0000","last_active":"2024-04-25T09:06:15.458872+0000","last_peered":"2024-04-25T09:06:15.458872+0000","last_clean":"2024-04-25T09:06:15.458872+0000","last_became_active":"2024-04-25T09:06:14.433663+0000","last_became_peered":"2024-04-25T09:06:14.433663+0000","last_unstale":"2024-04-25T09:06:15.458872+0000","last_undegraded":"2024-04-25T09:06:15.458872+0000","last_fullsized":"2024-04-25T09:06:15.458872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:11.018045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.449466+0000","last_change":"2024-04-25T09:06:15.444593+0000","last_active":"2024-04-25T09:06:15.449466+0000","last_peered":"2024-04-25T09:06:15.449466+0000","last_clean":"2024-04-25T09:06:15.449466+0000","last_became_active":"2024-04-25T09:06:15.443868+0000","last_became_peered":"2024-04-25T09:06:15.443868+0000","last_unstale":"2024-04-25T09:06:15.449466+0000","last_undegraded":"2024-04-25T09:06:15.449466+0000","last_fullsized":"2024-04-25T09:06:15.449466+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:22.829742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.455298+0000","last_change":"2024-04-25T09:06:14.429274+0000","last_active":"2024-04-25T09:06:15.455298+0000","last_peered":"2024-04-25T09:06:15.455298+0000","last_clean":"2024-04-25T09:06:15.455298+0000","last_became_active":"2024-04-25T09:06:14.428579+0000","last_became_peered":"2024-04-25T09:06:14.428579+0000","last_unstale":"2024-04-25T09:06:15.455298+0000","last_undegraded":"2024-04-25T09:06:15.455298+0000","last_fullsized":"2024-04-25T09:06:15.455298+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:03.875052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450902+0000","last_change":"2024-04-25T09:06:15.448072+0000","last_active":"2024-04-25T09:06:15.450902+0000","last_peered":"2024-04-25T09:06:15.450902+0000","last_clean":"2024-04-25T09:06:15.450902+0000","last_became_active":"2024-04-25T09:06:15.447373+0000","last_became_peered":"2024-04-25T09:06:15.447373+0000","last_unstale":"2024-04-25T09:06:15.450902+0000","last_undegraded":"2024-04-25T09:06:15.450902+0000","last_fullsized":"2024-04-25T09:06:15.450902+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:23.892451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"137'2","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441435+0000","last_change":"2024-04-25T09:06:14.425336+0000","last_active":"2024-04-25T09:06:16.441435+0000","last_peered":"2024-04-25T09:06:16.441435+0000","last_clean":"2024-04-25T09:06:16.441435+0000","last_became_active":"2024-04-25T09:06:14.424420+0000","last_became_peered":"2024-04-25T09:06:14.424420+0000","last_unstale":"2024-04-25T09:06:16.441435+0000","last_undegraded":"2024-04-25T09:06:16.441435+0000","last_fullsized":"2024-04-25T09:06:16.441435+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:29.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447009+0000","last_change":"2024-04-25T09:06:15.441997+0000","last_active":"2024-04-25T09:06:15.447009+0000","last_peered":"2024-04-25T09:06:15.447009+0000","last_clean":"2024-04-25T09:06:15.447009+0000","last_became_active":"2024-04-25T09:06:15.441185+0000","last_became_peered":"2024-04-25T09:06:15.441185+0000","last_unstale":"2024-04-25T09:06:15.447009+0000","last_undegraded":"2024-04-25T09:06:15.447009+0000","last_fullsized":"2024-04-25T09:06:15.447009+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:40.852520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"137'2","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441587+0000","last_change":"2024-04-25T09:06:14.435638+0000","last_active":"2024-04-25T09:06:16.441587+0000","last_peered":"2024-04-25T09:06:16.441587+0000","last_clean":"2024-04-25T09:06:16.441587+0000","last_became_active":"2024-04-25T09:06:14.435360+0000","last_became_peered":"2024-04-25T09:06:14.435360+0000","last_unstale":"2024-04-25T09:06:16.441587+0000","last_undegraded":"2024-04-25T09:06:16.441587+0000","last_fullsized":"2024-04-25T09:06:16.441587+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:09.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.442672+0000","last_change":"2024-04-25T09:06:15.440085+0000","last_active":"2024-04-25T09:06:15.442672+0000","last_peered":"2024-04-25T09:06:15.442672+0000","last_clean":"2024-04-25T09:06:15.442672+0000","last_became_active":"2024-04-25T09:06:15.439711+0000","last_became_peered":"2024-04-25T09:06:15.439711+0000","last_unstale":"2024-04-25T09:06:15.442672+0000","last_undegraded":"2024-04-25T09:06:15.442672+0000","last_fullsized":"2024-04-25T09:06:15.442672+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:46.730173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438227+0000","last_change":"2024-04-25T09:06:14.431712+0000","last_active":"2024-04-25T09:06:16.438227+0000","last_peered":"2024-04-25T09:06:16.438227+0000","last_clean":"2024-04-25T09:06:16.438227+0000","last_became_active":"2024-04-25T09:06:14.430212+0000","last_became_peered":"2024-04-25T09:06:14.430212+0000","last_unstale":"2024-04-25T09:06:16.438227+0000","last_undegraded":"2024-04-25T09:06:16.438227+0000","last_fullsized":"2024-04-25T09:06:16.438227+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.429023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441793+0000","last_change":"2024-04-25T09:06:15.440924+0000","last_active":"2024-04-25T09:06:16.441793+0000","last_peered":"2024-04-25T09:06:16.441793+0000","last_clean":"2024-04-25T09:06:16.441793+0000","last_became_active":"2024-04-25T09:06:15.440647+0000","last_became_peered":"2024-04-25T09:06:15.440647+0000","last_unstale":"2024-04-25T09:06:16.441793+0000","last_undegraded":"2024-04-25T09:06:16.441793+0000","last_fullsized":"2024-04-25T09:06:16.441793+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:19.583182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442570+0000","last_change":"2024-04-25T09:06:14.430328+0000","last_active":"2024-04-25T09:06:16.442570+0000","last_peered":"2024-04-25T09:06:16.442570+0000","last_clean":"2024-04-25T09:06:16.442570+0000","last_became_active":"2024-04-25T09:06:14.430026+0000","last_became_peered":"2024-04-25T09:06:14.430026+0000","last_unstale":"2024-04-25T09:06:16.442570+0000","last_undegraded":"2024-04-25T09:06:16.442570+0000","last_fullsized":"2024-04-25T09:06:16.442570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:13.401480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.433728+0000","last_change":"2024-04-25T09:06:15.432958+0000","last_active":"2024-04-25T09:06:15.433728+0000","last_peered":"2024-04-25T09:06:15.433728+0000","last_clean":"2024-04-25T09:06:15.433728+0000","last_became_active":"2024-04-25T09:06:15.432583+0000","last_became_peered":"2024-04-25T09:06:15.432583+0000","last_unstale":"2024-04-25T09:06:15.433728+0000","last_undegraded":"2024-04-25T09:06:15.433728+0000","last_fullsized":"2024-04-25T09:06:15.433728+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:43.166874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438068+0000","last_change":"2024-04-25T09:06:14.422970+0000","last_active":"2024-04-25T09:06:16.438068+0000","last_peered":"2024-04-25T09:06:16.438068+0000","last_clean":"2024-04-25T09:06:16.438068+0000","last_became_active":"2024-04-25T09:06:14.422663+0000","last_became_peered":"2024-04-25T09:06:14.422663+0000","last_unstale":"2024-04-25T09:06:16.438068+0000","last_undegraded":"2024-04-25T09:06:16.438068+0000","last_fullsized":"2024-04-25T09:06:16.438068+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:31.641370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442509+0000","last_change":"2024-04-25T09:06:15.444263+0000","last_active":"2024-04-25T09:06:16.442509+0000","last_peered":"2024-04-25T09:06:16.442509+0000","last_clean":"2024-04-25T09:06:16.442509+0000","last_became_active":"2024-04-25T09:06:15.443976+0000","last_became_peered":"2024-04-25T09:06:15.443976+0000","last_unstale":"2024-04-25T09:06:16.442509+0000","last_undegraded":"2024-04-25T09:06:16.442509+0000","last_fullsized":"2024-04-25T09:06:16.442509+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:41.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441193+0000","last_change":"2024-04-25T09:06:14.431835+0000","last_active":"2024-04-25T09:06:16.441193+0000","last_peered":"2024-04-25T09:06:16.441193+0000","last_clean":"2024-04-25T09:06:16.441193+0000","last_became_active":"2024-04-25T09:06:14.431505+0000","last_became_peered":"2024-04-25T09:06:14.431505+0000","last_unstale":"2024-04-25T09:06:16.441193+0000","last_undegraded":"2024-04-25T09:06:16.441193+0000","last_fullsized":"2024-04-25T09:06:16.441193+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:00.896108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442992+0000","last_change":"2024-04-25T09:06:15.448247+0000","last_active":"2024-04-25T09:06:16.442992+0000","last_peered":"2024-04-25T09:06:16.442992+0000","last_clean":"2024-04-25T09:06:16.442992+0000","last_became_active":"2024-04-25T09:06:15.447966+0000","last_became_peered":"2024-04-25T09:06:15.447966+0000","last_unstale":"2024-04-25T09:06:16.442992+0000","last_undegraded":"2024-04-25T09:06:16.442992+0000","last_fullsized":"2024-04-25T09:06:16.442992+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:48.715015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.426707+0000","last_change":"2024-04-25T09:06:14.434634+0000","last_active":"2024-04-25T09:06:15.426707+0000","last_peered":"2024-04-25T09:06:15.426707+0000","last_clean":"2024-04-25T09:06:15.426707+0000","last_became_active":"2024-04-25T09:06:14.434129+0000","last_became_peered":"2024-04-25T09:06:14.434129+0000","last_unstale":"2024-04-25T09:06:15.426707+0000","last_undegraded":"2024-04-25T09:06:15.426707+0000","last_fullsized":"2024-04-25T09:06:15.426707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:40.636157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447093+0000","last_change":"2024-04-25T09:06:15.443926+0000","last_active":"2024-04-25T09:06:15.447093+0000","last_peered":"2024-04-25T09:06:15.447093+0000","last_clean":"2024-04-25T09:06:15.447093+0000","last_became_active":"2024-04-25T09:06:15.443647+0000","last_became_peered":"2024-04-25T09:06:15.443647+0000","last_unstale":"2024-04-25T09:06:15.447093+0000","last_undegraded":"2024-04-25T09:06:15.447093+0000","last_fullsized":"2024-04-25T09:06:15.447093+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:57.816707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.436136+0000","last_change":"2024-04-25T09:06:14.433167+0000","last_active":"2024-04-25T09:06:15.436136+0000","last_peered":"2024-04-25T09:06:15.436136+0000","last_clean":"2024-04-25T09:06:15.436136+0000","last_became_active":"2024-04-25T09:06:14.432798+0000","last_became_peered":"2024-04-25T09:06:14.432798+0000","last_unstale":"2024-04-25T09:06:15.436136+0000","last_undegraded":"2024-04-25T09:06:15.436136+0000","last_fullsized":"2024-04-25T09:06:15.436136+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:13.742702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438478+0000","last_change":"2024-04-25T09:06:15.443678+0000","last_active":"2024-04-25T09:06:16.438478+0000","last_peered":"2024-04-25T09:06:16.438478+0000","last_clean":"2024-04-25T09:06:16.438478+0000","last_became_active":"2024-04-25T09:06:15.443321+0000","last_became_peered":"2024-04-25T09:06:15.443321+0000","last_unstale":"2024-04-25T09:06:16.438478+0000","last_undegraded":"2024-04-25T09:06:16.438478+0000","last_fullsized":"2024-04-25T09:06:16.438478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.256002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"137'6","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.460665+0000","last_change":"2024-04-25T09:06:14.437595+0000","last_active":"2024-04-25T09:06:15.460665+0000","last_peered":"2024-04-25T09:06:15.460665+0000","last_clean":"2024-04-25T09:06:15.460665+0000","last_became_active":"2024-04-25T09:06:14.437215+0000","last_became_peered":"2024-04-25T09:06:14.437215+0000","last_unstale":"2024-04-25T09:06:15.460665+0000","last_undegraded":"2024-04-25T09:06:15.460665+0000","last_fullsized":"2024-04-25T09:06:15.460665+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:42.162524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447986+0000","last_change":"2024-04-25T09:06:15.443216+0000","last_active":"2024-04-25T09:06:15.447986+0000","last_peered":"2024-04-25T09:06:15.447986+0000","last_clean":"2024-04-25T09:06:15.447986+0000","last_became_active":"2024-04-25T09:06:15.442961+0000","last_became_peered":"2024-04-25T09:06:15.442961+0000","last_unstale":"2024-04-25T09:06:15.447986+0000","last_undegraded":"2024-04-25T09:06:15.447986+0000","last_fullsized":"2024-04-25T09:06:15.447986+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:40.517028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458677+0000","last_change":"2024-04-25T09:06:14.431876+0000","last_active":"2024-04-25T09:06:15.458677+0000","last_peered":"2024-04-25T09:06:15.458677+0000","last_clean":"2024-04-25T09:06:15.458677+0000","last_became_active":"2024-04-25T09:06:14.430732+0000","last_became_peered":"2024-04-25T09:06:14.430732+0000","last_unstale":"2024-04-25T09:06:15.458677+0000","last_undegraded":"2024-04-25T09:06:15.458677+0000","last_fullsized":"2024-04-25T09:06:15.458677+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:09.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.446521+0000","last_change":"2024-04-25T09:06:15.444250+0000","last_active":"2024-04-25T09:06:15.446521+0000","last_peered":"2024-04-25T09:06:15.446521+0000","last_clean":"2024-04-25T09:06:15.446521+0000","last_became_active":"2024-04-25T09:06:15.443790+0000","last_became_peered":"2024-04-25T09:06:15.443790+0000","last_unstale":"2024-04-25T09:06:15.446521+0000","last_undegraded":"2024-04-25T09:06:15.446521+0000","last_fullsized":"2024-04-25T09:06:15.446521+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:06.022743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.441869+0000","last_change":"2024-04-25T09:06:14.425532+0000","last_active":"2024-04-25T09:06:15.441869+0000","last_peered":"2024-04-25T09:06:15.441869+0000","last_clean":"2024-04-25T09:06:15.441869+0000","last_became_active":"2024-04-25T09:06:14.425273+0000","last_became_peered":"2024-04-25T09:06:14.425273+0000","last_unstale":"2024-04-25T09:06:15.441869+0000","last_undegraded":"2024-04-25T09:06:15.441869+0000","last_fullsized":"2024-04-25T09:06:15.441869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:31.851106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442561+0000","last_change":"2024-04-25T09:06:15.439717+0000","last_active":"2024-04-25T09:06:16.442561+0000","last_peered":"2024-04-25T09:06:16.442561+0000","last_clean":"2024-04-25T09:06:16.442561+0000","last_became_active":"2024-04-25T09:06:15.439451+0000","last_became_peered":"2024-04-25T09:06:15.439451+0000","last_unstale":"2024-04-25T09:06:16.442561+0000","last_undegraded":"2024-04-25T09:06:16.442561+0000","last_fullsized":"2024-04-25T09:06:16.442561+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:37.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.433903+0000","last_change":"2024-04-25T09:06:14.431768+0000","last_active":"2024-04-25T09:06:15.433903+0000","last_peered":"2024-04-25T09:06:15.433903+0000","last_clean":"2024-04-25T09:06:15.433903+0000","last_became_active":"2024-04-25T09:06:14.431472+0000","last_became_peered":"2024-04-25T09:06:14.431472+0000","last_unstale":"2024-04-25T09:06:15.433903+0000","last_undegraded":"2024-04-25T09:06:15.433903+0000","last_fullsized":"2024-04-25T09:06:15.433903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:35.594063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.451714+0000","last_change":"2024-04-25T09:06:15.448339+0000","last_active":"2024-04-25T09:06:15.451714+0000","last_peered":"2024-04-25T09:06:15.451714+0000","last_clean":"2024-04-25T09:06:15.451714+0000","last_became_active":"2024-04-25T09:06:15.445898+0000","last_became_peered":"2024-04-25T09:06:15.445898+0000","last_unstale":"2024-04-25T09:06:15.451714+0000","last_undegraded":"2024-04-25T09:06:15.451714+0000","last_fullsized":"2024-04-25T09:06:15.451714+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:13.148146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"137'8","reported_seq":22,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438010+0000","last_change":"2024-04-25T09:06:14.426706+0000","last_active":"2024-04-25T09:06:16.438010+0000","last_peered":"2024-04-25T09:06:16.438010+0000","last_clean":"2024-04-25T09:06:16.438010+0000","last_became_active":"2024-04-25T09:06:14.425588+0000","last_became_peered":"2024-04-25T09:06:14.425588+0000","last_unstale":"2024-04-25T09:06:16.438010+0000","last_undegraded":"2024-04-25T09:06:16.438010+0000","last_fullsized":"2024-04-25T09:06:16.438010+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:35.594063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450876+0000","last_change":"2024-04-25T09:06:15.449645+0000","last_active":"2024-04-25T09:06:15.450876+0000","last_peered":"2024-04-25T09:06:15.450876+0000","last_clean":"2024-04-25T09:06:15.450876+0000","last_became_active":"2024-04-25T09:06:15.449402+0000","last_became_peered":"2024-04-25T09:06:15.449402+0000","last_unstale":"2024-04-25T09:06:15.450876+0000","last_undegraded":"2024-04-25T09:06:15.450876+0000","last_fullsized":"2024-04-25T09:06:15.450876+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:48.073424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442891+0000","last_change":"2024-04-25T09:06:14.424752+0000","last_active":"2024-04-25T09:06:16.442891+0000","last_peered":"2024-04-25T09:06:16.442891+0000","last_clean":"2024-04-25T09:06:16.442891+0000","last_became_active":"2024-04-25T09:06:14.424414+0000","last_became_peered":"2024-04-25T09:06:14.424414+0000","last_unstale":"2024-04-25T09:06:16.442891+0000","last_undegraded":"2024-04-25T09:06:16.442891+0000","last_fullsized":"2024-04-25T09:06:16.442891+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:51.210645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438388+0000","last_change":"2024-04-25T09:06:15.438373+0000","last_active":"2024-04-25T09:06:16.438388+0000","last_peered":"2024-04-25T09:06:16.438388+0000","last_clean":"2024-04-25T09:06:16.438388+0000","last_became_active":"2024-04-25T09:06:15.438000+0000","last_became_peered":"2024-04-25T09:06:15.438000+0000","last_unstale":"2024-04-25T09:06:16.438388+0000","last_undegraded":"2024-04-25T09:06:16.438388+0000","last_fullsized":"2024-04-25T09:06:16.438388+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.108344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457726+0000","last_change":"2024-04-25T09:06:14.429540+0000","last_active":"2024-04-25T09:06:15.457726+0000","last_peered":"2024-04-25T09:06:15.457726+0000","last_clean":"2024-04-25T09:06:15.457726+0000","last_became_active":"2024-04-25T09:06:14.428948+0000","last_became_peered":"2024-04-25T09:06:14.428948+0000","last_unstale":"2024-04-25T09:06:15.457726+0000","last_undegraded":"2024-04-25T09:06:15.457726+0000","last_fullsized":"2024-04-25T09:06:15.457726+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:50.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447954+0000","last_change":"2024-04-25T09:06:15.442660+0000","last_active":"2024-04-25T09:06:15.447954+0000","last_peered":"2024-04-25T09:06:15.447954+0000","last_clean":"2024-04-25T09:06:15.447954+0000","last_became_active":"2024-04-25T09:06:15.442385+0000","last_became_peered":"2024-04-25T09:06:15.442385+0000","last_unstale":"2024-04-25T09:06:15.447954+0000","last_undegraded":"2024-04-25T09:06:15.447954+0000","last_fullsized":"2024-04-25T09:06:15.447954+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:46.377252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438517+0000","last_change":"2024-04-25T09:06:14.433136+0000","last_active":"2024-04-25T09:06:16.438517+0000","last_peered":"2024-04-25T09:06:16.438517+0000","last_clean":"2024-04-25T09:06:16.438517+0000","last_became_active":"2024-04-25T09:06:14.432856+0000","last_became_peered":"2024-04-25T09:06:14.432856+0000","last_unstale":"2024-04-25T09:06:16.438517+0000","last_undegraded":"2024-04-25T09:06:16.438517+0000","last_fullsized":"2024-04-25T09:06:16.438517+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:59.611087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457777+0000","last_change":"2024-04-25T09:06:15.454702+0000","last_active":"2024-04-25T09:06:15.457777+0000","last_peered":"2024-04-25T09:06:15.457777+0000","last_clean":"2024-04-25T09:06:15.457777+0000","last_became_active":"2024-04-25T09:06:15.454415+0000","last_became_peered":"2024-04-25T09:06:15.454415+0000","last_unstale":"2024-04-25T09:06:15.457777+0000","last_undegraded":"2024-04-25T09:06:15.457777+0000","last_fullsized":"2024-04-25T09:06:15.457777+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.474349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.426844+0000","last_change":"2024-04-25T09:06:14.432452+0000","last_active":"2024-04-25T09:06:15.426844+0000","last_peered":"2024-04-25T09:06:15.426844+0000","last_clean":"2024-04-25T09:06:15.426844+0000","last_became_active":"2024-04-25T09:06:14.432094+0000","last_became_peered":"2024-04-25T09:06:14.432094+0000","last_unstale":"2024-04-25T09:06:15.426844+0000","last_undegraded":"2024-04-25T09:06:15.426844+0000","last_fullsized":"2024-04-25T09:06:15.426844+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:56.760867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441639+0000","last_change":"2024-04-25T09:06:15.449672+0000","last_active":"2024-04-25T09:06:16.441639+0000","last_peered":"2024-04-25T09:06:16.441639+0000","last_clean":"2024-04-25T09:06:16.441639+0000","last_became_active":"2024-04-25T09:06:15.447758+0000","last_became_peered":"2024-04-25T09:06:15.447758+0000","last_unstale":"2024-04-25T09:06:16.441639+0000","last_undegraded":"2024-04-25T09:06:16.441639+0000","last_fullsized":"2024-04-25T09:06:16.441639+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:09.685598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458306+0000","last_change":"2024-04-25T09:06:14.427644+0000","last_active":"2024-04-25T09:06:15.458306+0000","last_peered":"2024-04-25T09:06:15.458306+0000","last_clean":"2024-04-25T09:06:15.458306+0000","last_became_active":"2024-04-25T09:06:14.427306+0000","last_became_peered":"2024-04-25T09:06:14.427306+0000","last_unstale":"2024-04-25T09:06:15.458306+0000","last_undegraded":"2024-04-25T09:06:15.458306+0000","last_fullsized":"2024-04-25T09:06:15.458306+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:39.065926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452546+0000","last_change":"2024-04-25T09:06:15.447741+0000","last_active":"2024-04-25T09:06:15.452546+0000","last_peered":"2024-04-25T09:06:15.452546+0000","last_clean":"2024-04-25T09:06:15.452546+0000","last_became_active":"2024-04-25T09:06:15.445188+0000","last_became_peered":"2024-04-25T09:06:15.445188+0000","last_unstale":"2024-04-25T09:06:15.452546+0000","last_undegraded":"2024-04-25T09:06:15.452546+0000","last_fullsized":"2024-04-25T09:06:15.452546+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:22.829742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434724+0000","last_change":"2024-04-25T09:06:14.434495+0000","last_active":"2024-04-25T09:06:15.434724+0000","last_peered":"2024-04-25T09:06:15.434724+0000","last_clean":"2024-04-25T09:06:15.434724+0000","last_became_active":"2024-04-25T09:06:14.433752+0000","last_became_peered":"2024-04-25T09:06:14.433752+0000","last_unstale":"2024-04-25T09:06:15.434724+0000","last_undegraded":"2024-04-25T09:06:15.434724+0000","last_fullsized":"2024-04-25T09:06:15.434724+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:55.298765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441179+0000","last_change":"2024-04-25T09:06:15.444596+0000","last_active":"2024-04-25T09:06:16.441179+0000","last_peered":"2024-04-25T09:06:16.441179+0000","last_clean":"2024-04-25T09:06:16.441179+0000","last_became_active":"2024-04-25T09:06:15.444317+0000","last_became_peered":"2024-04-25T09:06:15.444317+0000","last_unstale":"2024-04-25T09:06:16.441179+0000","last_undegraded":"2024-04-25T09:06:16.441179+0000","last_fullsized":"2024-04-25T09:06:16.441179+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:41.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434578+0000","last_change":"2024-04-25T09:06:14.433101+0000","last_active":"2024-04-25T09:06:15.434578+0000","last_peered":"2024-04-25T09:06:15.434578+0000","last_clean":"2024-04-25T09:06:15.434578+0000","last_became_active":"2024-04-25T09:06:14.431742+0000","last_became_peered":"2024-04-25T09:06:14.431742+0000","last_unstale":"2024-04-25T09:06:15.434578+0000","last_undegraded":"2024-04-25T09:06:15.434578+0000","last_fullsized":"2024-04-25T09:06:15.434578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:52.507313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452291+0000","last_change":"2024-04-25T09:06:15.445838+0000","last_active":"2024-04-25T09:06:15.452291+0000","last_peered":"2024-04-25T09:06:15.452291+0000","last_clean":"2024-04-25T09:06:15.452291+0000","last_became_active":"2024-04-25T09:06:15.444975+0000","last_became_peered":"2024-04-25T09:06:15.444975+0000","last_unstale":"2024-04-25T09:06:15.452291+0000","last_undegraded":"2024-04-25T09:06:15.452291+0000","last_fullsized":"2024-04-25T09:06:15.452291+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:00.046072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.442584+0000","last_change":"2024-04-25T09:06:14.428828+0000","last_active":"2024-04-25T09:06:15.442584+0000","last_peered":"2024-04-25T09:06:15.442584+0000","last_clean":"2024-04-25T09:06:15.442584+0000","last_became_active":"2024-04-25T09:06:14.428494+0000","last_became_peered":"2024-04-25T09:06:14.428494+0000","last_unstale":"2024-04-25T09:06:15.442584+0000","last_undegraded":"2024-04-25T09:06:15.442584+0000","last_fullsized":"2024-04-25T09:06:15.442584+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:33.914563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.443037+0000","last_change":"2024-04-25T09:06:15.440355+0000","last_active":"2024-04-25T09:06:16.443037+0000","last_peered":"2024-04-25T09:06:16.443037+0000","last_clean":"2024-04-25T09:06:16.443037+0000","last_became_active":"2024-04-25T09:06:15.440063+0000","last_became_peered":"2024-04-25T09:06:15.440063+0000","last_unstale":"2024-04-25T09:06:16.443037+0000","last_undegraded":"2024-04-25T09:06:16.443037+0000","last_fullsized":"2024-04-25T09:06:16.443037+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:32.922291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.455826+0000","last_change":"2024-04-25T09:06:14.431308+0000","last_active":"2024-04-25T09:06:15.455826+0000","last_peered":"2024-04-25T09:06:15.455826+0000","last_clean":"2024-04-25T09:06:15.455826+0000","last_became_active":"2024-04-25T09:06:14.431000+0000","last_became_peered":"2024-04-25T09:06:14.431000+0000","last_unstale":"2024-04-25T09:06:15.455826+0000","last_undegraded":"2024-04-25T09:06:15.455826+0000","last_fullsized":"2024-04-25T09:06:15.455826+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:16.636222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.451069+0000","last_change":"2024-04-25T09:06:15.445736+0000","last_active":"2024-04-25T09:06:15.451069+0000","last_peered":"2024-04-25T09:06:15.451069+0000","last_clean":"2024-04-25T09:06:15.451069+0000","last_became_active":"2024-04-25T09:06:15.443571+0000","last_became_peered":"2024-04-25T09:06:15.443571+0000","last_unstale":"2024-04-25T09:06:15.451069+0000","last_undegraded":"2024-04-25T09:06:15.451069+0000","last_fullsized":"2024-04-25T09:06:15.451069+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:29.759150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.437887+0000","last_change":"2024-04-25T09:06:14.434720+0000","last_active":"2024-04-25T09:06:16.437887+0000","last_peered":"2024-04-25T09:06:16.437887+0000","last_clean":"2024-04-25T09:06:16.437887+0000","last_became_active":"2024-04-25T09:06:14.434432+0000","last_became_peered":"2024-04-25T09:06:14.434432+0000","last_unstale":"2024-04-25T09:06:16.437887+0000","last_undegraded":"2024-04-25T09:06:16.437887+0000","last_fullsized":"2024-04-25T09:06:16.437887+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:59.611087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.433189+0000","last_change":"2024-04-25T09:06:15.432091+0000","last_active":"2024-04-25T09:06:15.433189+0000","last_peered":"2024-04-25T09:06:15.433189+0000","last_clean":"2024-04-25T09:06:15.433189+0000","last_became_active":"2024-04-25T09:06:15.431705+0000","last_became_peered":"2024-04-25T09:06:15.431705+0000","last_unstale":"2024-04-25T09:06:15.433189+0000","last_undegraded":"2024-04-25T09:06:15.433189+0000","last_fullsized":"2024-04-25T09:06:15.433189+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:40.070275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.444426+0000","last_change":"2024-04-25T09:06:14.435433+0000","last_active":"2024-04-25T09:06:15.444426+0000","last_peered":"2024-04-25T09:06:15.444426+0000","last_clean":"2024-04-25T09:06:15.444426+0000","last_became_active":"2024-04-25T09:06:14.433930+0000","last_became_peered":"2024-04-25T09:06:14.433930+0000","last_unstale":"2024-04-25T09:06:15.444426+0000","last_undegraded":"2024-04-25T09:06:15.444426+0000","last_fullsized":"2024-04-25T09:06:15.444426+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:40.178105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.448979+0000","last_change":"2024-04-25T09:06:15.446950+0000","last_active":"2024-04-25T09:06:15.448979+0000","last_peered":"2024-04-25T09:06:15.448979+0000","last_clean":"2024-04-25T09:06:15.448979+0000","last_became_active":"2024-04-25T09:06:15.446661+0000","last_became_peered":"2024-04-25T09:06:15.446661+0000","last_unstale":"2024-04-25T09:06:15.448979+0000","last_undegraded":"2024-04-25T09:06:15.448979+0000","last_fullsized":"2024-04-25T09:06:15.448979+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:15.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.441950+0000","last_change":"2024-04-25T09:06:14.432722+0000","last_active":"2024-04-25T09:06:15.441950+0000","last_peered":"2024-04-25T09:06:15.441950+0000","last_clean":"2024-04-25T09:06:15.441950+0000","last_became_active":"2024-04-25T09:06:14.432445+0000","last_became_peered":"2024-04-25T09:06:14.432445+0000","last_unstale":"2024-04-25T09:06:15.441950+0000","last_undegraded":"2024-04-25T09:06:15.441950+0000","last_fullsized":"2024-04-25T09:06:15.441950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:21.068742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438192+0000","last_change":"2024-04-25T09:06:15.437683+0000","last_active":"2024-04-25T09:06:16.438192+0000","last_peered":"2024-04-25T09:06:16.438192+0000","last_clean":"2024-04-25T09:06:16.438192+0000","last_became_active":"2024-04-25T09:06:15.437372+0000","last_became_peered":"2024-04-25T09:06:15.437372+0000","last_unstale":"2024-04-25T09:06:16.438192+0000","last_undegraded":"2024-04-25T09:06:16.438192+0000","last_fullsized":"2024-04-25T09:06:16.438192+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:03.195824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.437470+0000","last_change":"2024-04-25T09:06:14.428925+0000","last_active":"2024-04-25T09:06:15.437470+0000","last_peered":"2024-04-25T09:06:15.437470+0000","last_clean":"2024-04-25T09:06:15.437470+0000","last_became_active":"2024-04-25T09:06:14.428606+0000","last_became_peered":"2024-04-25T09:06:14.428606+0000","last_unstale":"2024-04-25T09:06:15.437470+0000","last_undegraded":"2024-04-25T09:06:15.437470+0000","last_fullsized":"2024-04-25T09:06:15.437470+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:45.725823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442800+0000","last_change":"2024-04-25T09:06:15.444840+0000","last_active":"2024-04-25T09:06:16.442800+0000","last_peered":"2024-04-25T09:06:16.442800+0000","last_clean":"2024-04-25T09:06:16.442800+0000","last_became_active":"2024-04-25T09:06:15.444582+0000","last_became_peered":"2024-04-25T09:06:15.444582+0000","last_unstale":"2024-04-25T09:06:16.442800+0000","last_undegraded":"2024-04-25T09:06:16.442800+0000","last_fullsized":"2024-04-25T09:06:16.442800+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:10.668602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434887+0000","last_change":"2024-04-25T09:06:14.430077+0000","last_active":"2024-04-25T09:06:15.434887+0000","last_peered":"2024-04-25T09:06:15.434887+0000","last_clean":"2024-04-25T09:06:15.434887+0000","last_became_active":"2024-04-25T09:06:14.429795+0000","last_became_peered":"2024-04-25T09:06:14.429795+0000","last_unstale":"2024-04-25T09:06:15.434887+0000","last_undegraded":"2024-04-25T09:06:15.434887+0000","last_fullsized":"2024-04-25T09:06:15.434887+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:56.128849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450884+0000","last_change":"2024-04-25T09:06:15.449032+0000","last_active":"2024-04-25T09:06:15.450884+0000","last_peered":"2024-04-25T09:06:15.450884+0000","last_clean":"2024-04-25T09:06:15.450884+0000","last_became_active":"2024-04-25T09:06:15.448702+0000","last_became_peered":"2024-04-25T09:06:15.448702+0000","last_unstale":"2024-04-25T09:06:15.450884+0000","last_undegraded":"2024-04-25T09:06:15.450884+0000","last_fullsized":"2024-04-25T09:06:15.450884+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:02.994038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.448521+0000","last_change":"2024-04-25T09:06:14.432478+0000","last_active":"2024-04-25T09:06:15.448521+0000","last_peered":"2024-04-25T09:06:15.448521+0000","last_clean":"2024-04-25T09:06:15.448521+0000","last_became_active":"2024-04-25T09:06:14.430841+0000","last_became_peered":"2024-04-25T09:06:14.430841+0000","last_unstale":"2024-04-25T09:06:15.448521+0000","last_undegraded":"2024-04-25T09:06:15.448521+0000","last_fullsized":"2024-04-25T09:06:15.448521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:40.525677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442574+0000","last_change":"2024-04-25T09:06:15.448215+0000","last_active":"2024-04-25T09:06:16.442574+0000","last_peered":"2024-04-25T09:06:16.442574+0000","last_clean":"2024-04-25T09:06:16.442574+0000","last_became_active":"2024-04-25T09:06:15.447925+0000","last_became_peered":"2024-04-25T09:06:15.447925+0000","last_unstale":"2024-04-25T09:06:16.442574+0000","last_undegraded":"2024-04-25T09:06:16.442574+0000","last_fullsized":"2024-04-25T09:06:16.442574+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:27.727458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.426148+0000","last_change":"2024-04-25T09:06:14.430515+0000","last_active":"2024-04-25T09:06:15.426148+0000","last_peered":"2024-04-25T09:06:15.426148+0000","last_clean":"2024-04-25T09:06:15.426148+0000","last_became_active":"2024-04-25T09:06:14.430162+0000","last_became_peered":"2024-04-25T09:06:14.430162+0000","last_unstale":"2024-04-25T09:06:15.426148+0000","last_undegraded":"2024-04-25T09:06:15.426148+0000","last_fullsized":"2024-04-25T09:06:15.426148+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:38.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.445199+0000","last_change":"2024-04-25T09:06:15.442638+0000","last_active":"2024-04-25T09:06:15.445199+0000","last_peered":"2024-04-25T09:06:15.445199+0000","last_clean":"2024-04-25T09:06:15.445199+0000","last_became_active":"2024-04-25T09:06:15.442011+0000","last_became_peered":"2024-04-25T09:06:15.442011+0000","last_unstale":"2024-04-25T09:06:15.445199+0000","last_undegraded":"2024-04-25T09:06:15.445199+0000","last_fullsized":"2024-04-25T09:06:15.445199+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:06.022743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"137'3","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457300+0000","last_change":"2024-04-25T09:06:14.428373+0000","last_active":"2024-04-25T09:06:15.457300+0000","last_peered":"2024-04-25T09:06:15.457300+0000","last_clean":"2024-04-25T09:06:15.457300+0000","last_became_active":"2024-04-25T09:06:14.428092+0000","last_became_peered":"2024-04-25T09:06:14.428092+0000","last_unstale":"2024-04-25T09:06:15.457300+0000","last_undegraded":"2024-04-25T09:06:15.457300+0000","last_fullsized":"2024-04-25T09:06:15.457300+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:47.710666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":389,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434684+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:06:15.434684+0000","last_peered":"2024-04-25T09:06:15.434684+0000","last_clean":"2024-04-25T09:06:15.434684+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:06:15.434684+0000","last_undegraded":"2024-04-25T09:06:15.434684+0000","last_fullsized":"2024-04-25T09:06:15.434684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55652,"kb_used_data":2264,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316188,"statfs":{"total":96636764160,"available":96579776512,"internally_reserved":0,"allocated":2318336,"data_stored":1340333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59236,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312604,"statfs":{"total":96636764160,"available":96576106496,"internally_reserved":0,"allocated":1728512,"data_stored":749459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1720320,"data_stored":749335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55072,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316768,"statfs":{"total":96636764160,"available":96580370432,"internally_reserved":0,"allocated":1716224,"data_stored":749313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59224,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312616,"statfs":{"total":96636764160,"available":96576118784,"internally_reserved":0,"allocated":1716224,"data_stored":749313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55080,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316760,"statfs":{"total":96636764160,"available":96580362240,"internally_reserved":0,"allocated":1732608,"data_stored":750995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46748,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325092,"statfs":{"total":96636764160,"available":96588894208,"internally_reserved":0,"allocated":1720320,"data_stored":749895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37612,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334228,"statfs":{"total":96636764160,"available":96598249472,"internally_reserved":0,"allocated":2326528,"data_stored":1341327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:18.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:18.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.640+0000 7f7fff5b7640 1 Processor -- start 2024-04-25T09:06:18.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.641+0000 7f7fff5b7640 1 -- start start 2024-04-25T09:06:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.641+0000 7f7fff5b7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ff815de70 0x7f7ff80b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.641+0000 7f7fff5b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ff80ce7f0 0x7f7ff80cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.641+0000 7f7fff5b7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff80cf1c0 con 0x7f7ff80b2cc0 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.641+0000 7f7fff5b7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff80d2a10 con 0x7f7ff815de70 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.641+0000 7f7fff5b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff80d20e0 con 0x7f7ff80ce7f0 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffd353640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ff815de70 0x7f7ff80b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffd353640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ff815de70 0x7f7ff80b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59134/0 (socket says 172.21.15.5:59134) 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffd353640 1 -- 172.21.15.5:0/2291170683 learned_addr learned my addr 172.21.15.5:0/2291170683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffdb54640 1 --2- 172.21.15.5:0/2291170683 >> v2:172.21.15.80:3300/0 conn(0x7f7ff80ce7f0 0x7f7ff80cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffd353640 1 -- 172.21.15.5:0/2291170683 >> v2:172.21.15.80:3300/0 conn(0x7f7ff80ce7f0 msgr2=0x7f7ff80cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffd353640 1 --2- 172.21.15.5:0/2291170683 >> v2:172.21.15.80:3300/0 conn(0x7f7ff80ce7f0 0x7f7ff80cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffd353640 1 -- 172.21.15.5:0/2291170683 >> v1:172.21.15.80:6789/0 conn(0x7f7ff80b2cc0 legacy=0x7f7ff80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffd353640 1 -- 172.21.15.5:0/2291170683 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80d23c0 con 0x7f7ff815de70 2024-04-25T09:06:18.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.642+0000 7f7ffdb54640 1 --2- 172.21.15.5:0/2291170683 >> v2:172.21.15.80:3300/0 conn(0x7f7ff80ce7f0 0x7f7ff80cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7ffd353640 1 --2- 172.21.15.5:0/2291170683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff80b93e0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80d1970 tx=0x7f7ff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22f724fa93afd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7feffff640 1 -- 172.21.15.5:0/2291170683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0037070 con 0x7f7ff815de70 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7feffff640 1 -- 172.21.15.5:0/2291170683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff0032440 con 0x7f7ff815de70 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7feffff640 1 -- 172.21.15.5:0/2291170683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0032810 con 0x7f7ff815de70 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7fff5b7640 1 -- 172.21.15.5:0/2291170683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 msgr2=0x7f7ff80b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/2291170683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff80b93e0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80d1970 tx=0x7f7ff002a270 comp rx=0 tx=0).stop 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7fff5b7640 1 -- 172.21.15.5:0/2291170683 shutdown_connections 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/2291170683 >> v2:172.21.15.80:3300/0 conn(0x7f7ff80ce7f0 0x7f7ff80cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/2291170683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff80b93e0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.643+0000 7f7fff5b7640 1 -- 172.21.15.5:0/2291170683 >> 172.21.15.5:0/2291170683 conn(0x7f7ff806b000 msgr2=0x7f7ff806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.644+0000 7f7fff5b7640 1 -- 172.21.15.5:0/2291170683 shutdown_connections 2024-04-25T09:06:18.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.644+0000 7f7fff5b7640 1 -- 172.21.15.5:0/2291170683 wait complete. 2024-04-25T09:06:18.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 Processor -- start 2024-04-25T09:06:18.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 -- start start 2024-04-25T09:06:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ff80b2cc0 0x7f7ff80c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff80ce7f0 0x7f7ff80b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff8148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80b7300 con 0x7f7ff815de70 2024-04-25T09:06:18.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80b9920 con 0x7f7ff80ce7f0 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.645+0000 7f7fff5b7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80d2ea0 con 0x7f7ff80b2cc0 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff8148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff8148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59138/0 (socket says 172.21.15.5:59138) 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 -- 172.21.15.5:0/1713583516 learned_addr learned my addr 172.21.15.5:0/1713583516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffd353640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ff80b2cc0 0x7f7ff80c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffcb52640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff80ce7f0 0x7f7ff80b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 -- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ff80b2cc0 msgr2=0x7f7ff80c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ff80b2cc0 0x7f7ff80c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 -- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff80ce7f0 msgr2=0x7f7ff80b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff80ce7f0 0x7f7ff80b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 -- 172.21.15.5:0/1713583516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80b4eb0 con 0x7f7ff815de70 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffcb52640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff80ce7f0 0x7f7ff80b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7ffdb54640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff8148e20 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4007ef0 tx=0x7f7ff400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7fedffb640 1 -- 172.21.15.5:0/1713583516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff401a070 con 0x7f7ff815de70 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7fedffb640 1 -- 172.21.15.5:0/1713583516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff4003b90 con 0x7f7ff815de70 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff80b40f0 con 0x7f7ff815de70 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7fedffb640 1 -- 172.21.15.5:0/1713583516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4004030 con 0x7f7ff815de70 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.646+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff80b46b0 con 0x7f7ff815de70 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.647+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff804ef20 con 0x7f7ff815de70 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.648+0000 7f7fedffb640 1 -- 172.21.15.5:0/1713583516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ff401d070 con 0x7f7ff815de70 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.648+0000 7f7fedffb640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fdc06b4d0 0x7f7fdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.648+0000 7f7fedffb640 1 -- 172.21.15.5:0/1713583516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ff408a380 con 0x7f7ff815de70 2024-04-25T09:06:18.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.648+0000 7f7ffd353640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fdc06b4d0 0x7f7fdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.649+0000 7f7ffd353640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fdc06b4d0 0x7f7fdc06d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0034000 tx=0x7f7ff002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.652+0000 7f7fedffb640 1 -- 172.21.15.5:0/1713583516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ff4010070 con 0x7f7ff815de70 2024-04-25T09:06:18.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.829+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ff80b6720 con 0x7f7fdc06b4d0 2024-04-25T09:06:18.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.836+0000 7f7fedffb640 1 -- 172.21.15.5:0/1713583516 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252444 (secure 0 0 0) 0x7f7ff80b6720 con 0x7f7fdc06b4d0 2024-04-25T09:06:18.826 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:18.828 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:06:18.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.838+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fdc06b4d0 msgr2=0x7f7fdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.838+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fdc06b4d0 0x7f7fdc06d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0034000 tx=0x7f7ff002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.838+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 msgr2=0x7f7ff8148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.838+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff8148e20 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4007ef0 tx=0x7f7ff400d4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 shutdown_connections 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7fdc06b4d0 0x7f7fdc06d990 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ff815de70 0x7f7ff8148e20 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff80ce7f0 0x7f7ff80b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 --2- 172.21.15.5:0/1713583516 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ff80b2cc0 0x7f7ff80c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 >> 172.21.15.5:0/1713583516 conn(0x7f7ff806b000 msgr2=0x7f7ff80cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 shutdown_connections 2024-04-25T09:06:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.839+0000 7f7fff5b7640 1 -- 172.21.15.5:0/1713583516 wait complete. 2024-04-25T09:06:18.838 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2024-04-25T09:06:18.519978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415376,"kb_used_data":14628,"kb_used_omap":12,"kb_used_meta":400627,"kb_avail":754559344,"statfs":{"total":773094113280,"available":772668768256,"internally_reserved":0,"allocated":14979072,"data_stored":7179970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":410242609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.107532"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450607+0000","last_change":"2024-04-25T09:06:15.450030+0000","last_active":"2024-04-25T09:06:15.450607+0000","last_peered":"2024-04-25T09:06:15.450607+0000","last_clean":"2024-04-25T09:06:15.450607+0000","last_became_active":"2024-04-25T09:06:15.449734+0000","last_became_peered":"2024-04-25T09:06:15.449734+0000","last_unstale":"2024-04-25T09:06:15.450607+0000","last_undegraded":"2024-04-25T09:06:15.450607+0000","last_fullsized":"2024-04-25T09:06:15.450607+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:53.782825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.446915+0000","last_change":"2024-04-25T09:06:15.444124+0000","last_active":"2024-04-25T09:06:15.446915+0000","last_peered":"2024-04-25T09:06:15.446915+0000","last_clean":"2024-04-25T09:06:15.446915+0000","last_became_active":"2024-04-25T09:06:15.443703+0000","last_became_peered":"2024-04-25T09:06:15.443703+0000","last_unstale":"2024-04-25T09:06:15.446915+0000","last_undegraded":"2024-04-25T09:06:15.446915+0000","last_fullsized":"2024-04-25T09:06:15.446915+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:06.760446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447926+0000","last_change":"2024-04-25T09:06:15.441804+0000","last_active":"2024-04-25T09:06:15.447926+0000","last_peered":"2024-04-25T09:06:15.447926+0000","last_clean":"2024-04-25T09:06:15.447926+0000","last_became_active":"2024-04-25T09:06:15.441205+0000","last_became_peered":"2024-04-25T09:06:15.441205+0000","last_unstale":"2024-04-25T09:06:15.447926+0000","last_undegraded":"2024-04-25T09:06:15.447926+0000","last_fullsized":"2024-04-25T09:06:15.447926+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:32.922291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441544+0000","last_change":"2024-04-25T09:06:15.439997+0000","last_active":"2024-04-25T09:06:16.441544+0000","last_peered":"2024-04-25T09:06:16.441544+0000","last_clean":"2024-04-25T09:06:16.441544+0000","last_became_active":"2024-04-25T09:06:15.439669+0000","last_became_peered":"2024-04-25T09:06:15.439669+0000","last_unstale":"2024-04-25T09:06:16.441544+0000","last_undegraded":"2024-04-25T09:06:16.441544+0000","last_fullsized":"2024-04-25T09:06:16.441544+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:19.588891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442633+0000","last_change":"2024-04-25T09:06:15.447309+0000","last_active":"2024-04-25T09:06:16.442633+0000","last_peered":"2024-04-25T09:06:16.442633+0000","last_clean":"2024-04-25T09:06:16.442633+0000","last_became_active":"2024-04-25T09:06:15.446968+0000","last_became_peered":"2024-04-25T09:06:15.446968+0000","last_unstale":"2024-04-25T09:06:16.442633+0000","last_undegraded":"2024-04-25T09:06:16.442633+0000","last_fullsized":"2024-04-25T09:06:16.442633+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:30.480835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.445282+0000","last_change":"2024-04-25T09:06:15.443234+0000","last_active":"2024-04-25T09:06:15.445282+0000","last_peered":"2024-04-25T09:06:15.445282+0000","last_clean":"2024-04-25T09:06:15.445282+0000","last_became_active":"2024-04-25T09:06:15.442922+0000","last_became_peered":"2024-04-25T09:06:15.442922+0000","last_unstale":"2024-04-25T09:06:15.445282+0000","last_undegraded":"2024-04-25T09:06:15.445282+0000","last_fullsized":"2024-04-25T09:06:15.445282+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:09.251777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.442746+0000","last_change":"2024-04-25T09:06:15.442192+0000","last_active":"2024-04-25T09:06:15.442746+0000","last_peered":"2024-04-25T09:06:15.442746+0000","last_clean":"2024-04-25T09:06:15.442746+0000","last_became_active":"2024-04-25T09:06:15.441885+0000","last_became_peered":"2024-04-25T09:06:15.441885+0000","last_unstale":"2024-04-25T09:06:15.442746+0000","last_undegraded":"2024-04-25T09:06:15.442746+0000","last_fullsized":"2024-04-25T09:06:15.442746+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:06.760446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.443329+0000","last_change":"2024-04-25T09:06:15.441866+0000","last_active":"2024-04-25T09:06:15.443329+0000","last_peered":"2024-04-25T09:06:15.443329+0000","last_clean":"2024-04-25T09:06:15.443329+0000","last_became_active":"2024-04-25T09:06:15.441574+0000","last_became_peered":"2024-04-25T09:06:15.441574+0000","last_unstale":"2024-04-25T09:06:15.443329+0000","last_undegraded":"2024-04-25T09:06:15.443329+0000","last_fullsized":"2024-04-25T09:06:15.443329+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.866520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.446856+0000","last_change":"2024-04-25T09:06:15.444536+0000","last_active":"2024-04-25T09:06:15.446856+0000","last_peered":"2024-04-25T09:06:15.446856+0000","last_clean":"2024-04-25T09:06:15.446856+0000","last_became_active":"2024-04-25T09:06:15.444192+0000","last_became_peered":"2024-04-25T09:06:15.444192+0000","last_unstale":"2024-04-25T09:06:15.446856+0000","last_undegraded":"2024-04-25T09:06:15.446856+0000","last_fullsized":"2024-04-25T09:06:15.446856+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:00.046072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447074+0000","last_change":"2024-04-25T09:06:15.442269+0000","last_active":"2024-04-25T09:06:15.447074+0000","last_peered":"2024-04-25T09:06:15.447074+0000","last_clean":"2024-04-25T09:06:15.447074+0000","last_became_active":"2024-04-25T09:06:15.441989+0000","last_became_peered":"2024-04-25T09:06:15.441989+0000","last_unstale":"2024-04-25T09:06:15.447074+0000","last_undegraded":"2024-04-25T09:06:15.447074+0000","last_fullsized":"2024-04-25T09:06:15.447074+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:32.988183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457747+0000","last_change":"2024-04-25T09:06:15.452668+0000","last_active":"2024-04-25T09:06:15.457747+0000","last_peered":"2024-04-25T09:06:15.457747+0000","last_clean":"2024-04-25T09:06:15.457747+0000","last_became_active":"2024-04-25T09:06:15.451664+0000","last_became_peered":"2024-04-25T09:06:15.451664+0000","last_unstale":"2024-04-25T09:06:15.457747+0000","last_undegraded":"2024-04-25T09:06:15.457747+0000","last_fullsized":"2024-04-25T09:06:15.457747+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:54.760347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447571+0000","last_change":"2024-04-25T09:06:15.441759+0000","last_active":"2024-04-25T09:06:15.447571+0000","last_peered":"2024-04-25T09:06:15.447571+0000","last_clean":"2024-04-25T09:06:15.447571+0000","last_became_active":"2024-04-25T09:06:15.441499+0000","last_became_peered":"2024-04-25T09:06:15.441499+0000","last_unstale":"2024-04-25T09:06:15.447571+0000","last_undegraded":"2024-04-25T09:06:15.447571+0000","last_fullsized":"2024-04-25T09:06:15.447571+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:43.988107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442697+0000","last_change":"2024-04-25T09:06:15.447329+0000","last_active":"2024-04-25T09:06:16.442697+0000","last_peered":"2024-04-25T09:06:16.442697+0000","last_clean":"2024-04-25T09:06:16.442697+0000","last_became_active":"2024-04-25T09:06:15.447036+0000","last_became_peered":"2024-04-25T09:06:15.447036+0000","last_unstale":"2024-04-25T09:06:16.442697+0000","last_undegraded":"2024-04-25T09:06:16.442697+0000","last_fullsized":"2024-04-25T09:06:16.442697+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:01.900458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441598+0000","last_change":"2024-04-25T09:06:15.438329+0000","last_active":"2024-04-25T09:06:16.441598+0000","last_peered":"2024-04-25T09:06:16.441598+0000","last_clean":"2024-04-25T09:06:16.441598+0000","last_became_active":"2024-04-25T09:06:15.437099+0000","last_became_peered":"2024-04-25T09:06:15.437099+0000","last_unstale":"2024-04-25T09:06:16.441598+0000","last_undegraded":"2024-04-25T09:06:16.441598+0000","last_fullsized":"2024-04-25T09:06:16.441598+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:27.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452628+0000","last_change":"2024-04-25T09:06:15.450102+0000","last_active":"2024-04-25T09:06:15.452628+0000","last_peered":"2024-04-25T09:06:15.452628+0000","last_clean":"2024-04-25T09:06:15.452628+0000","last_became_active":"2024-04-25T09:06:15.449844+0000","last_became_peered":"2024-04-25T09:06:15.449844+0000","last_unstale":"2024-04-25T09:06:15.452628+0000","last_undegraded":"2024-04-25T09:06:15.452628+0000","last_fullsized":"2024-04-25T09:06:15.452628+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:09.734821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.437888+0000","last_change":"2024-04-25T09:06:15.448723+0000","last_active":"2024-04-25T09:06:16.437888+0000","last_peered":"2024-04-25T09:06:16.437888+0000","last_clean":"2024-04-25T09:06:16.437888+0000","last_became_active":"2024-04-25T09:06:15.448427+0000","last_became_peered":"2024-04-25T09:06:15.448427+0000","last_unstale":"2024-04-25T09:06:16.437888+0000","last_undegraded":"2024-04-25T09:06:16.437888+0000","last_fullsized":"2024-04-25T09:06:16.437888+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:54.760347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447806+0000","last_change":"2024-04-25T09:06:15.446006+0000","last_active":"2024-04-25T09:06:15.447806+0000","last_peered":"2024-04-25T09:06:15.447806+0000","last_clean":"2024-04-25T09:06:15.447806+0000","last_became_active":"2024-04-25T09:06:15.445747+0000","last_became_peered":"2024-04-25T09:06:15.445747+0000","last_unstale":"2024-04-25T09:06:15.447806+0000","last_undegraded":"2024-04-25T09:06:15.447806+0000","last_fullsized":"2024-04-25T09:06:15.447806+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:14.460782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447894+0000","last_change":"2024-04-25T09:06:15.439807+0000","last_active":"2024-04-25T09:06:15.447894+0000","last_peered":"2024-04-25T09:06:15.447894+0000","last_clean":"2024-04-25T09:06:15.447894+0000","last_became_active":"2024-04-25T09:06:15.439540+0000","last_became_peered":"2024-04-25T09:06:15.439540+0000","last_unstale":"2024-04-25T09:06:15.447894+0000","last_undegraded":"2024-04-25T09:06:15.447894+0000","last_fullsized":"2024-04-25T09:06:15.447894+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:01.900458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458025+0000","last_change":"2024-04-25T09:06:15.455243+0000","last_active":"2024-04-25T09:06:15.458025+0000","last_peered":"2024-04-25T09:06:15.458025+0000","last_clean":"2024-04-25T09:06:15.458025+0000","last_became_active":"2024-04-25T09:06:15.454906+0000","last_became_peered":"2024-04-25T09:06:15.454906+0000","last_unstale":"2024-04-25T09:06:15.458025+0000","last_undegraded":"2024-04-25T09:06:15.458025+0000","last_fullsized":"2024-04-25T09:06:15.458025+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:14.405830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438211+0000","last_change":"2024-04-25T09:06:15.432719+0000","last_active":"2024-04-25T09:06:16.438211+0000","last_peered":"2024-04-25T09:06:16.438211+0000","last_clean":"2024-04-25T09:06:16.438211+0000","last_became_active":"2024-04-25T09:06:15.432408+0000","last_became_peered":"2024-04-25T09:06:15.432408+0000","last_unstale":"2024-04-25T09:06:16.438211+0000","last_undegraded":"2024-04-25T09:06:16.438211+0000","last_fullsized":"2024-04-25T09:06:16.438211+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:14.405830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447044+0000","last_change":"2024-04-25T09:06:15.443520+0000","last_active":"2024-04-25T09:06:15.447044+0000","last_peered":"2024-04-25T09:06:15.447044+0000","last_clean":"2024-04-25T09:06:15.447044+0000","last_became_active":"2024-04-25T09:06:15.443178+0000","last_became_peered":"2024-04-25T09:06:15.443178+0000","last_unstale":"2024-04-25T09:06:15.447044+0000","last_undegraded":"2024-04-25T09:06:15.447044+0000","last_fullsized":"2024-04-25T09:06:15.447044+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:07.971008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441391+0000","last_change":"2024-04-25T09:06:15.432476+0000","last_active":"2024-04-25T09:06:16.441391+0000","last_peered":"2024-04-25T09:06:16.441391+0000","last_clean":"2024-04-25T09:06:16.441391+0000","last_became_active":"2024-04-25T09:06:15.431966+0000","last_became_peered":"2024-04-25T09:06:15.431966+0000","last_unstale":"2024-04-25T09:06:16.441391+0000","last_undegraded":"2024-04-25T09:06:16.441391+0000","last_fullsized":"2024-04-25T09:06:16.441391+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:07.054489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441316+0000","last_change":"2024-04-25T09:06:15.442638+0000","last_active":"2024-04-25T09:06:16.441316+0000","last_peered":"2024-04-25T09:06:16.441316+0000","last_clean":"2024-04-25T09:06:16.441316+0000","last_became_active":"2024-04-25T09:06:15.442227+0000","last_became_peered":"2024-04-25T09:06:15.442227+0000","last_unstale":"2024-04-25T09:06:16.441316+0000","last_undegraded":"2024-04-25T09:06:16.441316+0000","last_fullsized":"2024-04-25T09:06:16.441316+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:39.240063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447112+0000","last_change":"2024-04-25T09:06:15.442745+0000","last_active":"2024-04-25T09:06:15.447112+0000","last_peered":"2024-04-25T09:06:15.447112+0000","last_clean":"2024-04-25T09:06:15.447112+0000","last_became_active":"2024-04-25T09:06:15.442418+0000","last_became_peered":"2024-04-25T09:06:15.442418+0000","last_unstale":"2024-04-25T09:06:15.447112+0000","last_undegraded":"2024-04-25T09:06:15.447112+0000","last_fullsized":"2024-04-25T09:06:15.447112+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.724714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438401+0000","last_change":"2024-04-25T09:06:15.448258+0000","last_active":"2024-04-25T09:06:16.438401+0000","last_peered":"2024-04-25T09:06:16.438401+0000","last_clean":"2024-04-25T09:06:16.438401+0000","last_became_active":"2024-04-25T09:06:15.447958+0000","last_became_peered":"2024-04-25T09:06:15.447958+0000","last_unstale":"2024-04-25T09:06:16.438401+0000","last_undegraded":"2024-04-25T09:06:16.438401+0000","last_fullsized":"2024-04-25T09:06:16.438401+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:36.468863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450543+0000","last_change":"2024-04-25T09:06:15.448827+0000","last_active":"2024-04-25T09:06:15.450543+0000","last_peered":"2024-04-25T09:06:15.450543+0000","last_clean":"2024-04-25T09:06:15.450543+0000","last_became_active":"2024-04-25T09:06:15.448482+0000","last_became_peered":"2024-04-25T09:06:15.448482+0000","last_unstale":"2024-04-25T09:06:15.450543+0000","last_undegraded":"2024-04-25T09:06:15.450543+0000","last_fullsized":"2024-04-25T09:06:15.450543+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:08.317882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438352+0000","last_change":"2024-04-25T09:06:15.442624+0000","last_active":"2024-04-25T09:06:16.438352+0000","last_peered":"2024-04-25T09:06:16.438352+0000","last_clean":"2024-04-25T09:06:16.438352+0000","last_became_active":"2024-04-25T09:06:15.442325+0000","last_became_peered":"2024-04-25T09:06:15.442325+0000","last_unstale":"2024-04-25T09:06:16.438352+0000","last_undegraded":"2024-04-25T09:06:16.438352+0000","last_fullsized":"2024-04-25T09:06:16.438352+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:52.214994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452505+0000","last_change":"2024-04-25T09:06:15.447896+0000","last_active":"2024-04-25T09:06:15.452505+0000","last_peered":"2024-04-25T09:06:15.452505+0000","last_clean":"2024-04-25T09:06:15.452505+0000","last_became_active":"2024-04-25T09:06:15.447590+0000","last_became_peered":"2024-04-25T09:06:15.447590+0000","last_unstale":"2024-04-25T09:06:15.452505+0000","last_undegraded":"2024-04-25T09:06:15.452505+0000","last_fullsized":"2024-04-25T09:06:15.452505+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:53.511662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458189+0000","last_change":"2024-04-25T09:06:15.454881+0000","last_active":"2024-04-25T09:06:15.458189+0000","last_peered":"2024-04-25T09:06:15.458189+0000","last_clean":"2024-04-25T09:06:15.458189+0000","last_became_active":"2024-04-25T09:06:15.454541+0000","last_became_peered":"2024-04-25T09:06:15.454541+0000","last_unstale":"2024-04-25T09:06:15.458189+0000","last_undegraded":"2024-04-25T09:06:15.458189+0000","last_fullsized":"2024-04-25T09:06:15.458189+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:03.195824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441515+0000","last_change":"2024-04-25T09:06:15.450599+0000","last_active":"2024-04-25T09:06:16.441515+0000","last_peered":"2024-04-25T09:06:16.441515+0000","last_clean":"2024-04-25T09:06:16.441515+0000","last_became_active":"2024-04-25T09:06:15.449953+0000","last_became_peered":"2024-04-25T09:06:15.449953+0000","last_unstale":"2024-04-25T09:06:16.441515+0000","last_undegraded":"2024-04-25T09:06:16.441515+0000","last_fullsized":"2024-04-25T09:06:16.441515+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:20.901293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452041+0000","last_change":"2024-04-25T09:06:15.450671+0000","last_active":"2024-04-25T09:06:15.452041+0000","last_peered":"2024-04-25T09:06:15.452041+0000","last_clean":"2024-04-25T09:06:15.452041+0000","last_became_active":"2024-04-25T09:06:15.450376+0000","last_became_peered":"2024-04-25T09:06:15.450376+0000","last_unstale":"2024-04-25T09:06:15.452041+0000","last_undegraded":"2024-04-25T09:06:15.452041+0000","last_fullsized":"2024-04-25T09:06:15.452041+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:53.511662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.437945+0000","last_change":"2024-04-25T09:06:15.435570+0000","last_active":"2024-04-25T09:06:16.437945+0000","last_peered":"2024-04-25T09:06:16.437945+0000","last_clean":"2024-04-25T09:06:16.437945+0000","last_became_active":"2024-04-25T09:06:15.435229+0000","last_became_peered":"2024-04-25T09:06:15.435229+0000","last_unstale":"2024-04-25T09:06:16.437945+0000","last_undegraded":"2024-04-25T09:06:16.437945+0000","last_fullsized":"2024-04-25T09:06:16.437945+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.474349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447093+0000","last_change":"2024-04-25T09:06:15.444056+0000","last_active":"2024-04-25T09:06:15.447093+0000","last_peered":"2024-04-25T09:06:15.447093+0000","last_clean":"2024-04-25T09:06:15.447093+0000","last_became_active":"2024-04-25T09:06:15.443771+0000","last_became_peered":"2024-04-25T09:06:15.443771+0000","last_unstale":"2024-04-25T09:06:15.447093+0000","last_undegraded":"2024-04-25T09:06:15.447093+0000","last_fullsized":"2024-04-25T09:06:15.447093+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:35.367684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"137'4","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458872+0000","last_change":"2024-04-25T09:06:14.433999+0000","last_active":"2024-04-25T09:06:15.458872+0000","last_peered":"2024-04-25T09:06:15.458872+0000","last_clean":"2024-04-25T09:06:15.458872+0000","last_became_active":"2024-04-25T09:06:14.433663+0000","last_became_peered":"2024-04-25T09:06:14.433663+0000","last_unstale":"2024-04-25T09:06:15.458872+0000","last_undegraded":"2024-04-25T09:06:15.458872+0000","last_fullsized":"2024-04-25T09:06:15.458872+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:11.018045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.449466+0000","last_change":"2024-04-25T09:06:15.444593+0000","last_active":"2024-04-25T09:06:15.449466+0000","last_peered":"2024-04-25T09:06:15.449466+0000","last_clean":"2024-04-25T09:06:15.449466+0000","last_became_active":"2024-04-25T09:06:15.443868+0000","last_became_peered":"2024-04-25T09:06:15.443868+0000","last_unstale":"2024-04-25T09:06:15.449466+0000","last_undegraded":"2024-04-25T09:06:15.449466+0000","last_fullsized":"2024-04-25T09:06:15.449466+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:22.829742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.455298+0000","last_change":"2024-04-25T09:06:14.429274+0000","last_active":"2024-04-25T09:06:15.455298+0000","last_peered":"2024-04-25T09:06:15.455298+0000","last_clean":"2024-04-25T09:06:15.455298+0000","last_became_active":"2024-04-25T09:06:14.428579+0000","last_became_peered":"2024-04-25T09:06:14.428579+0000","last_unstale":"2024-04-25T09:06:15.455298+0000","last_undegraded":"2024-04-25T09:06:15.455298+0000","last_fullsized":"2024-04-25T09:06:15.455298+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:03.875052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450902+0000","last_change":"2024-04-25T09:06:15.448072+0000","last_active":"2024-04-25T09:06:15.450902+0000","last_peered":"2024-04-25T09:06:15.450902+0000","last_clean":"2024-04-25T09:06:15.450902+0000","last_became_active":"2024-04-25T09:06:15.447373+0000","last_became_peered":"2024-04-25T09:06:15.447373+0000","last_unstale":"2024-04-25T09:06:15.450902+0000","last_undegraded":"2024-04-25T09:06:15.450902+0000","last_fullsized":"2024-04-25T09:06:15.450902+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:23.892451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"137'2","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441435+0000","last_change":"2024-04-25T09:06:14.425336+0000","last_active":"2024-04-25T09:06:16.441435+0000","last_peered":"2024-04-25T09:06:16.441435+0000","last_clean":"2024-04-25T09:06:16.441435+0000","last_became_active":"2024-04-25T09:06:14.424420+0000","last_became_peered":"2024-04-25T09:06:14.424420+0000","last_unstale":"2024-04-25T09:06:16.441435+0000","last_undegraded":"2024-04-25T09:06:16.441435+0000","last_fullsized":"2024-04-25T09:06:16.441435+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:29.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447009+0000","last_change":"2024-04-25T09:06:15.441997+0000","last_active":"2024-04-25T09:06:15.447009+0000","last_peered":"2024-04-25T09:06:15.447009+0000","last_clean":"2024-04-25T09:06:15.447009+0000","last_became_active":"2024-04-25T09:06:15.441185+0000","last_became_peered":"2024-04-25T09:06:15.441185+0000","last_unstale":"2024-04-25T09:06:15.447009+0000","last_undegraded":"2024-04-25T09:06:15.447009+0000","last_fullsized":"2024-04-25T09:06:15.447009+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:40.852520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"137'2","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441587+0000","last_change":"2024-04-25T09:06:14.435638+0000","last_active":"2024-04-25T09:06:16.441587+0000","last_peered":"2024-04-25T09:06:16.441587+0000","last_clean":"2024-04-25T09:06:16.441587+0000","last_became_active":"2024-04-25T09:06:14.435360+0000","last_became_peered":"2024-04-25T09:06:14.435360+0000","last_unstale":"2024-04-25T09:06:16.441587+0000","last_undegraded":"2024-04-25T09:06:16.441587+0000","last_fullsized":"2024-04-25T09:06:16.441587+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:09.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.442672+0000","last_change":"2024-04-25T09:06:15.440085+0000","last_active":"2024-04-25T09:06:15.442672+0000","last_peered":"2024-04-25T09:06:15.442672+0000","last_clean":"2024-04-25T09:06:15.442672+0000","last_became_active":"2024-04-25T09:06:15.439711+0000","last_became_peered":"2024-04-25T09:06:15.439711+0000","last_unstale":"2024-04-25T09:06:15.442672+0000","last_undegraded":"2024-04-25T09:06:15.442672+0000","last_fullsized":"2024-04-25T09:06:15.442672+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:46.730173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438227+0000","last_change":"2024-04-25T09:06:14.431712+0000","last_active":"2024-04-25T09:06:16.438227+0000","last_peered":"2024-04-25T09:06:16.438227+0000","last_clean":"2024-04-25T09:06:16.438227+0000","last_became_active":"2024-04-25T09:06:14.430212+0000","last_became_peered":"2024-04-25T09:06:14.430212+0000","last_unstale":"2024-04-25T09:06:16.438227+0000","last_undegraded":"2024-04-25T09:06:16.438227+0000","last_fullsized":"2024-04-25T09:06:16.438227+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.429023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441793+0000","last_change":"2024-04-25T09:06:15.440924+0000","last_active":"2024-04-25T09:06:16.441793+0000","last_peered":"2024-04-25T09:06:16.441793+0000","last_clean":"2024-04-25T09:06:16.441793+0000","last_became_active":"2024-04-25T09:06:15.440647+0000","last_became_peered":"2024-04-25T09:06:15.440647+0000","last_unstale":"2024-04-25T09:06:16.441793+0000","last_undegraded":"2024-04-25T09:06:16.441793+0000","last_fullsized":"2024-04-25T09:06:16.441793+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:19.583182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442570+0000","last_change":"2024-04-25T09:06:14.430328+0000","last_active":"2024-04-25T09:06:16.442570+0000","last_peered":"2024-04-25T09:06:16.442570+0000","last_clean":"2024-04-25T09:06:16.442570+0000","last_became_active":"2024-04-25T09:06:14.430026+0000","last_became_peered":"2024-04-25T09:06:14.430026+0000","last_unstale":"2024-04-25T09:06:16.442570+0000","last_undegraded":"2024-04-25T09:06:16.442570+0000","last_fullsized":"2024-04-25T09:06:16.442570+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:13.401480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.433728+0000","last_change":"2024-04-25T09:06:15.432958+0000","last_active":"2024-04-25T09:06:15.433728+0000","last_peered":"2024-04-25T09:06:15.433728+0000","last_clean":"2024-04-25T09:06:15.433728+0000","last_became_active":"2024-04-25T09:06:15.432583+0000","last_became_peered":"2024-04-25T09:06:15.432583+0000","last_unstale":"2024-04-25T09:06:15.433728+0000","last_undegraded":"2024-04-25T09:06:15.433728+0000","last_fullsized":"2024-04-25T09:06:15.433728+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:43.166874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438068+0000","last_change":"2024-04-25T09:06:14.422970+0000","last_active":"2024-04-25T09:06:16.438068+0000","last_peered":"2024-04-25T09:06:16.438068+0000","last_clean":"2024-04-25T09:06:16.438068+0000","last_became_active":"2024-04-25T09:06:14.422663+0000","last_became_peered":"2024-04-25T09:06:14.422663+0000","last_unstale":"2024-04-25T09:06:16.438068+0000","last_undegraded":"2024-04-25T09:06:16.438068+0000","last_fullsized":"2024-04-25T09:06:16.438068+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:31.641370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442509+0000","last_change":"2024-04-25T09:06:15.444263+0000","last_active":"2024-04-25T09:06:16.442509+0000","last_peered":"2024-04-25T09:06:16.442509+0000","last_clean":"2024-04-25T09:06:16.442509+0000","last_became_active":"2024-04-25T09:06:15.443976+0000","last_became_peered":"2024-04-25T09:06:15.443976+0000","last_unstale":"2024-04-25T09:06:16.442509+0000","last_undegraded":"2024-04-25T09:06:16.442509+0000","last_fullsized":"2024-04-25T09:06:16.442509+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:41.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441193+0000","last_change":"2024-04-25T09:06:14.431835+0000","last_active":"2024-04-25T09:06:16.441193+0000","last_peered":"2024-04-25T09:06:16.441193+0000","last_clean":"2024-04-25T09:06:16.441193+0000","last_became_active":"2024-04-25T09:06:14.431505+0000","last_became_peered":"2024-04-25T09:06:14.431505+0000","last_unstale":"2024-04-25T09:06:16.441193+0000","last_undegraded":"2024-04-25T09:06:16.441193+0000","last_fullsized":"2024-04-25T09:06:16.441193+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:00.896108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442992+0000","last_change":"2024-04-25T09:06:15.448247+0000","last_active":"2024-04-25T09:06:16.442992+0000","last_peered":"2024-04-25T09:06:16.442992+0000","last_clean":"2024-04-25T09:06:16.442992+0000","last_became_active":"2024-04-25T09:06:15.447966+0000","last_became_peered":"2024-04-25T09:06:15.447966+0000","last_unstale":"2024-04-25T09:06:16.442992+0000","last_undegraded":"2024-04-25T09:06:16.442992+0000","last_fullsized":"2024-04-25T09:06:16.442992+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:48.715015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.426707+0000","last_change":"2024-04-25T09:06:14.434634+0000","last_active":"2024-04-25T09:06:15.426707+0000","last_peered":"2024-04-25T09:06:15.426707+0000","last_clean":"2024-04-25T09:06:15.426707+0000","last_became_active":"2024-04-25T09:06:14.434129+0000","last_became_peered":"2024-04-25T09:06:14.434129+0000","last_unstale":"2024-04-25T09:06:15.426707+0000","last_undegraded":"2024-04-25T09:06:15.426707+0000","last_fullsized":"2024-04-25T09:06:15.426707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:40.636157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447093+0000","last_change":"2024-04-25T09:06:15.443926+0000","last_active":"2024-04-25T09:06:15.447093+0000","last_peered":"2024-04-25T09:06:15.447093+0000","last_clean":"2024-04-25T09:06:15.447093+0000","last_became_active":"2024-04-25T09:06:15.443647+0000","last_became_peered":"2024-04-25T09:06:15.443647+0000","last_unstale":"2024-04-25T09:06:15.447093+0000","last_undegraded":"2024-04-25T09:06:15.447093+0000","last_fullsized":"2024-04-25T09:06:15.447093+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:57.816707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.436136+0000","last_change":"2024-04-25T09:06:14.433167+0000","last_active":"2024-04-25T09:06:15.436136+0000","last_peered":"2024-04-25T09:06:15.436136+0000","last_clean":"2024-04-25T09:06:15.436136+0000","last_became_active":"2024-04-25T09:06:14.432798+0000","last_became_peered":"2024-04-25T09:06:14.432798+0000","last_unstale":"2024-04-25T09:06:15.436136+0000","last_undegraded":"2024-04-25T09:06:15.436136+0000","last_fullsized":"2024-04-25T09:06:15.436136+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:13.742702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438478+0000","last_change":"2024-04-25T09:06:15.443678+0000","last_active":"2024-04-25T09:06:16.438478+0000","last_peered":"2024-04-25T09:06:16.438478+0000","last_clean":"2024-04-25T09:06:16.438478+0000","last_became_active":"2024-04-25T09:06:15.443321+0000","last_became_peered":"2024-04-25T09:06:15.443321+0000","last_unstale":"2024-04-25T09:06:16.438478+0000","last_undegraded":"2024-04-25T09:06:16.438478+0000","last_fullsized":"2024-04-25T09:06:16.438478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.256002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"137'6","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.460665+0000","last_change":"2024-04-25T09:06:14.437595+0000","last_active":"2024-04-25T09:06:15.460665+0000","last_peered":"2024-04-25T09:06:15.460665+0000","last_clean":"2024-04-25T09:06:15.460665+0000","last_became_active":"2024-04-25T09:06:14.437215+0000","last_became_peered":"2024-04-25T09:06:14.437215+0000","last_unstale":"2024-04-25T09:06:15.460665+0000","last_undegraded":"2024-04-25T09:06:15.460665+0000","last_fullsized":"2024-04-25T09:06:15.460665+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:42.162524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447986+0000","last_change":"2024-04-25T09:06:15.443216+0000","last_active":"2024-04-25T09:06:15.447986+0000","last_peered":"2024-04-25T09:06:15.447986+0000","last_clean":"2024-04-25T09:06:15.447986+0000","last_became_active":"2024-04-25T09:06:15.442961+0000","last_became_peered":"2024-04-25T09:06:15.442961+0000","last_unstale":"2024-04-25T09:06:15.447986+0000","last_undegraded":"2024-04-25T09:06:15.447986+0000","last_fullsized":"2024-04-25T09:06:15.447986+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:40.517028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458677+0000","last_change":"2024-04-25T09:06:14.431876+0000","last_active":"2024-04-25T09:06:15.458677+0000","last_peered":"2024-04-25T09:06:15.458677+0000","last_clean":"2024-04-25T09:06:15.458677+0000","last_became_active":"2024-04-25T09:06:14.430732+0000","last_became_peered":"2024-04-25T09:06:14.430732+0000","last_unstale":"2024-04-25T09:06:15.458677+0000","last_undegraded":"2024-04-25T09:06:15.458677+0000","last_fullsized":"2024-04-25T09:06:15.458677+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:09.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.446521+0000","last_change":"2024-04-25T09:06:15.444250+0000","last_active":"2024-04-25T09:06:15.446521+0000","last_peered":"2024-04-25T09:06:15.446521+0000","last_clean":"2024-04-25T09:06:15.446521+0000","last_became_active":"2024-04-25T09:06:15.443790+0000","last_became_peered":"2024-04-25T09:06:15.443790+0000","last_unstale":"2024-04-25T09:06:15.446521+0000","last_undegraded":"2024-04-25T09:06:15.446521+0000","last_fullsized":"2024-04-25T09:06:15.446521+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:06.022743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.441869+0000","last_change":"2024-04-25T09:06:14.425532+0000","last_active":"2024-04-25T09:06:15.441869+0000","last_peered":"2024-04-25T09:06:15.441869+0000","last_clean":"2024-04-25T09:06:15.441869+0000","last_became_active":"2024-04-25T09:06:14.425273+0000","last_became_peered":"2024-04-25T09:06:14.425273+0000","last_unstale":"2024-04-25T09:06:15.441869+0000","last_undegraded":"2024-04-25T09:06:15.441869+0000","last_fullsized":"2024-04-25T09:06:15.441869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:31.851106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442561+0000","last_change":"2024-04-25T09:06:15.439717+0000","last_active":"2024-04-25T09:06:16.442561+0000","last_peered":"2024-04-25T09:06:16.442561+0000","last_clean":"2024-04-25T09:06:16.442561+0000","last_became_active":"2024-04-25T09:06:15.439451+0000","last_became_peered":"2024-04-25T09:06:15.439451+0000","last_unstale":"2024-04-25T09:06:16.442561+0000","last_undegraded":"2024-04-25T09:06:16.442561+0000","last_fullsized":"2024-04-25T09:06:16.442561+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:37.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.433903+0000","last_change":"2024-04-25T09:06:14.431768+0000","last_active":"2024-04-25T09:06:15.433903+0000","last_peered":"2024-04-25T09:06:15.433903+0000","last_clean":"2024-04-25T09:06:15.433903+0000","last_became_active":"2024-04-25T09:06:14.431472+0000","last_became_peered":"2024-04-25T09:06:14.431472+0000","last_unstale":"2024-04-25T09:06:15.433903+0000","last_undegraded":"2024-04-25T09:06:15.433903+0000","last_fullsized":"2024-04-25T09:06:15.433903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:35.594063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.451714+0000","last_change":"2024-04-25T09:06:15.448339+0000","last_active":"2024-04-25T09:06:15.451714+0000","last_peered":"2024-04-25T09:06:15.451714+0000","last_clean":"2024-04-25T09:06:15.451714+0000","last_became_active":"2024-04-25T09:06:15.445898+0000","last_became_peered":"2024-04-25T09:06:15.445898+0000","last_unstale":"2024-04-25T09:06:15.451714+0000","last_undegraded":"2024-04-25T09:06:15.451714+0000","last_fullsized":"2024-04-25T09:06:15.451714+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:13.148146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"137'8","reported_seq":22,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438010+0000","last_change":"2024-04-25T09:06:14.426706+0000","last_active":"2024-04-25T09:06:16.438010+0000","last_peered":"2024-04-25T09:06:16.438010+0000","last_clean":"2024-04-25T09:06:16.438010+0000","last_became_active":"2024-04-25T09:06:14.425588+0000","last_became_peered":"2024-04-25T09:06:14.425588+0000","last_unstale":"2024-04-25T09:06:16.438010+0000","last_undegraded":"2024-04-25T09:06:16.438010+0000","last_fullsized":"2024-04-25T09:06:16.438010+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:35.594063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450876+0000","last_change":"2024-04-25T09:06:15.449645+0000","last_active":"2024-04-25T09:06:15.450876+0000","last_peered":"2024-04-25T09:06:15.450876+0000","last_clean":"2024-04-25T09:06:15.450876+0000","last_became_active":"2024-04-25T09:06:15.449402+0000","last_became_peered":"2024-04-25T09:06:15.449402+0000","last_unstale":"2024-04-25T09:06:15.450876+0000","last_undegraded":"2024-04-25T09:06:15.450876+0000","last_fullsized":"2024-04-25T09:06:15.450876+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:48.073424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442891+0000","last_change":"2024-04-25T09:06:14.424752+0000","last_active":"2024-04-25T09:06:16.442891+0000","last_peered":"2024-04-25T09:06:16.442891+0000","last_clean":"2024-04-25T09:06:16.442891+0000","last_became_active":"2024-04-25T09:06:14.424414+0000","last_became_peered":"2024-04-25T09:06:14.424414+0000","last_unstale":"2024-04-25T09:06:16.442891+0000","last_undegraded":"2024-04-25T09:06:16.442891+0000","last_fullsized":"2024-04-25T09:06:16.442891+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:51.210645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438388+0000","last_change":"2024-04-25T09:06:15.438373+0000","last_active":"2024-04-25T09:06:16.438388+0000","last_peered":"2024-04-25T09:06:16.438388+0000","last_clean":"2024-04-25T09:06:16.438388+0000","last_became_active":"2024-04-25T09:06:15.438000+0000","last_became_peered":"2024-04-25T09:06:15.438000+0000","last_unstale":"2024-04-25T09:06:16.438388+0000","last_undegraded":"2024-04-25T09:06:16.438388+0000","last_fullsized":"2024-04-25T09:06:16.438388+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.108344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457726+0000","last_change":"2024-04-25T09:06:14.429540+0000","last_active":"2024-04-25T09:06:15.457726+0000","last_peered":"2024-04-25T09:06:15.457726+0000","last_clean":"2024-04-25T09:06:15.457726+0000","last_became_active":"2024-04-25T09:06:14.428948+0000","last_became_peered":"2024-04-25T09:06:14.428948+0000","last_unstale":"2024-04-25T09:06:15.457726+0000","last_undegraded":"2024-04-25T09:06:15.457726+0000","last_fullsized":"2024-04-25T09:06:15.457726+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:50.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.447954+0000","last_change":"2024-04-25T09:06:15.442660+0000","last_active":"2024-04-25T09:06:15.447954+0000","last_peered":"2024-04-25T09:06:15.447954+0000","last_clean":"2024-04-25T09:06:15.447954+0000","last_became_active":"2024-04-25T09:06:15.442385+0000","last_became_peered":"2024-04-25T09:06:15.442385+0000","last_unstale":"2024-04-25T09:06:15.447954+0000","last_undegraded":"2024-04-25T09:06:15.447954+0000","last_fullsized":"2024-04-25T09:06:15.447954+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:46.377252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438517+0000","last_change":"2024-04-25T09:06:14.433136+0000","last_active":"2024-04-25T09:06:16.438517+0000","last_peered":"2024-04-25T09:06:16.438517+0000","last_clean":"2024-04-25T09:06:16.438517+0000","last_became_active":"2024-04-25T09:06:14.432856+0000","last_became_peered":"2024-04-25T09:06:14.432856+0000","last_unstale":"2024-04-25T09:06:16.438517+0000","last_undegraded":"2024-04-25T09:06:16.438517+0000","last_fullsized":"2024-04-25T09:06:16.438517+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:59.611087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457777+0000","last_change":"2024-04-25T09:06:15.454702+0000","last_active":"2024-04-25T09:06:15.457777+0000","last_peered":"2024-04-25T09:06:15.457777+0000","last_clean":"2024-04-25T09:06:15.457777+0000","last_became_active":"2024-04-25T09:06:15.454415+0000","last_became_peered":"2024-04-25T09:06:15.454415+0000","last_unstale":"2024-04-25T09:06:15.457777+0000","last_undegraded":"2024-04-25T09:06:15.457777+0000","last_fullsized":"2024-04-25T09:06:15.457777+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.474349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.426844+0000","last_change":"2024-04-25T09:06:14.432452+0000","last_active":"2024-04-25T09:06:15.426844+0000","last_peered":"2024-04-25T09:06:15.426844+0000","last_clean":"2024-04-25T09:06:15.426844+0000","last_became_active":"2024-04-25T09:06:14.432094+0000","last_became_peered":"2024-04-25T09:06:14.432094+0000","last_unstale":"2024-04-25T09:06:15.426844+0000","last_undegraded":"2024-04-25T09:06:15.426844+0000","last_fullsized":"2024-04-25T09:06:15.426844+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:56.760867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441639+0000","last_change":"2024-04-25T09:06:15.449672+0000","last_active":"2024-04-25T09:06:16.441639+0000","last_peered":"2024-04-25T09:06:16.441639+0000","last_clean":"2024-04-25T09:06:16.441639+0000","last_became_active":"2024-04-25T09:06:15.447758+0000","last_became_peered":"2024-04-25T09:06:15.447758+0000","last_unstale":"2024-04-25T09:06:16.441639+0000","last_undegraded":"2024-04-25T09:06:16.441639+0000","last_fullsized":"2024-04-25T09:06:16.441639+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:09.685598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.458306+0000","last_change":"2024-04-25T09:06:14.427644+0000","last_active":"2024-04-25T09:06:15.458306+0000","last_peered":"2024-04-25T09:06:15.458306+0000","last_clean":"2024-04-25T09:06:15.458306+0000","last_became_active":"2024-04-25T09:06:14.427306+0000","last_became_peered":"2024-04-25T09:06:14.427306+0000","last_unstale":"2024-04-25T09:06:15.458306+0000","last_undegraded":"2024-04-25T09:06:15.458306+0000","last_fullsized":"2024-04-25T09:06:15.458306+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:39.065926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452546+0000","last_change":"2024-04-25T09:06:15.447741+0000","last_active":"2024-04-25T09:06:15.452546+0000","last_peered":"2024-04-25T09:06:15.452546+0000","last_clean":"2024-04-25T09:06:15.452546+0000","last_became_active":"2024-04-25T09:06:15.445188+0000","last_became_peered":"2024-04-25T09:06:15.445188+0000","last_unstale":"2024-04-25T09:06:15.452546+0000","last_undegraded":"2024-04-25T09:06:15.452546+0000","last_fullsized":"2024-04-25T09:06:15.452546+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:22.829742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434724+0000","last_change":"2024-04-25T09:06:14.434495+0000","last_active":"2024-04-25T09:06:15.434724+0000","last_peered":"2024-04-25T09:06:15.434724+0000","last_clean":"2024-04-25T09:06:15.434724+0000","last_became_active":"2024-04-25T09:06:14.433752+0000","last_became_peered":"2024-04-25T09:06:14.433752+0000","last_unstale":"2024-04-25T09:06:15.434724+0000","last_undegraded":"2024-04-25T09:06:15.434724+0000","last_fullsized":"2024-04-25T09:06:15.434724+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:55.298765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.441179+0000","last_change":"2024-04-25T09:06:15.444596+0000","last_active":"2024-04-25T09:06:16.441179+0000","last_peered":"2024-04-25T09:06:16.441179+0000","last_clean":"2024-04-25T09:06:16.441179+0000","last_became_active":"2024-04-25T09:06:15.444317+0000","last_became_peered":"2024-04-25T09:06:15.444317+0000","last_unstale":"2024-04-25T09:06:16.441179+0000","last_undegraded":"2024-04-25T09:06:16.441179+0000","last_fullsized":"2024-04-25T09:06:16.441179+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:41.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434578+0000","last_change":"2024-04-25T09:06:14.433101+0000","last_active":"2024-04-25T09:06:15.434578+0000","last_peered":"2024-04-25T09:06:15.434578+0000","last_clean":"2024-04-25T09:06:15.434578+0000","last_became_active":"2024-04-25T09:06:14.431742+0000","last_became_peered":"2024-04-25T09:06:14.431742+0000","last_unstale":"2024-04-25T09:06:15.434578+0000","last_undegraded":"2024-04-25T09:06:15.434578+0000","last_fullsized":"2024-04-25T09:06:15.434578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:52.507313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.452291+0000","last_change":"2024-04-25T09:06:15.445838+0000","last_active":"2024-04-25T09:06:15.452291+0000","last_peered":"2024-04-25T09:06:15.452291+0000","last_clean":"2024-04-25T09:06:15.452291+0000","last_became_active":"2024-04-25T09:06:15.444975+0000","last_became_peered":"2024-04-25T09:06:15.444975+0000","last_unstale":"2024-04-25T09:06:15.452291+0000","last_undegraded":"2024-04-25T09:06:15.452291+0000","last_fullsized":"2024-04-25T09:06:15.452291+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:00.046072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.442584+0000","last_change":"2024-04-25T09:06:14.428828+0000","last_active":"2024-04-25T09:06:15.442584+0000","last_peered":"2024-04-25T09:06:15.442584+0000","last_clean":"2024-04-25T09:06:15.442584+0000","last_became_active":"2024-04-25T09:06:14.428494+0000","last_became_peered":"2024-04-25T09:06:14.428494+0000","last_unstale":"2024-04-25T09:06:15.442584+0000","last_undegraded":"2024-04-25T09:06:15.442584+0000","last_fullsized":"2024-04-25T09:06:15.442584+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:33.914563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.443037+0000","last_change":"2024-04-25T09:06:15.440355+0000","last_active":"2024-04-25T09:06:16.443037+0000","last_peered":"2024-04-25T09:06:16.443037+0000","last_clean":"2024-04-25T09:06:16.443037+0000","last_became_active":"2024-04-25T09:06:15.440063+0000","last_became_peered":"2024-04-25T09:06:15.440063+0000","last_unstale":"2024-04-25T09:06:16.443037+0000","last_undegraded":"2024-04-25T09:06:16.443037+0000","last_fullsized":"2024-04-25T09:06:16.443037+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:32.922291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.455826+0000","last_change":"2024-04-25T09:06:14.431308+0000","last_active":"2024-04-25T09:06:15.455826+0000","last_peered":"2024-04-25T09:06:15.455826+0000","last_clean":"2024-04-25T09:06:15.455826+0000","last_became_active":"2024-04-25T09:06:14.431000+0000","last_became_peered":"2024-04-25T09:06:14.431000+0000","last_unstale":"2024-04-25T09:06:15.455826+0000","last_undegraded":"2024-04-25T09:06:15.455826+0000","last_fullsized":"2024-04-25T09:06:15.455826+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:16.636222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.451069+0000","last_change":"2024-04-25T09:06:15.445736+0000","last_active":"2024-04-25T09:06:15.451069+0000","last_peered":"2024-04-25T09:06:15.451069+0000","last_clean":"2024-04-25T09:06:15.451069+0000","last_became_active":"2024-04-25T09:06:15.443571+0000","last_became_peered":"2024-04-25T09:06:15.443571+0000","last_unstale":"2024-04-25T09:06:15.451069+0000","last_undegraded":"2024-04-25T09:06:15.451069+0000","last_fullsized":"2024-04-25T09:06:15.451069+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:29.759150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.437887+0000","last_change":"2024-04-25T09:06:14.434720+0000","last_active":"2024-04-25T09:06:16.437887+0000","last_peered":"2024-04-25T09:06:16.437887+0000","last_clean":"2024-04-25T09:06:16.437887+0000","last_became_active":"2024-04-25T09:06:14.434432+0000","last_became_peered":"2024-04-25T09:06:14.434432+0000","last_unstale":"2024-04-25T09:06:16.437887+0000","last_undegraded":"2024-04-25T09:06:16.437887+0000","last_fullsized":"2024-04-25T09:06:16.437887+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:59.611087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.433189+0000","last_change":"2024-04-25T09:06:15.432091+0000","last_active":"2024-04-25T09:06:15.433189+0000","last_peered":"2024-04-25T09:06:15.433189+0000","last_clean":"2024-04-25T09:06:15.433189+0000","last_became_active":"2024-04-25T09:06:15.431705+0000","last_became_peered":"2024-04-25T09:06:15.431705+0000","last_unstale":"2024-04-25T09:06:15.433189+0000","last_undegraded":"2024-04-25T09:06:15.433189+0000","last_fullsized":"2024-04-25T09:06:15.433189+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:40.070275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.444426+0000","last_change":"2024-04-25T09:06:14.435433+0000","last_active":"2024-04-25T09:06:15.444426+0000","last_peered":"2024-04-25T09:06:15.444426+0000","last_clean":"2024-04-25T09:06:15.444426+0000","last_became_active":"2024-04-25T09:06:14.433930+0000","last_became_peered":"2024-04-25T09:06:14.433930+0000","last_unstale":"2024-04-25T09:06:15.444426+0000","last_undegraded":"2024-04-25T09:06:15.444426+0000","last_fullsized":"2024-04-25T09:06:15.444426+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:40.178105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.448979+0000","last_change":"2024-04-25T09:06:15.446950+0000","last_active":"2024-04-25T09:06:15.448979+0000","last_peered":"2024-04-25T09:06:15.448979+0000","last_clean":"2024-04-25T09:06:15.448979+0000","last_became_active":"2024-04-25T09:06:15.446661+0000","last_became_peered":"2024-04-25T09:06:15.446661+0000","last_unstale":"2024-04-25T09:06:15.448979+0000","last_undegraded":"2024-04-25T09:06:15.448979+0000","last_fullsized":"2024-04-25T09:06:15.448979+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:15.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.441950+0000","last_change":"2024-04-25T09:06:14.432722+0000","last_active":"2024-04-25T09:06:15.441950+0000","last_peered":"2024-04-25T09:06:15.441950+0000","last_clean":"2024-04-25T09:06:15.441950+0000","last_became_active":"2024-04-25T09:06:14.432445+0000","last_became_peered":"2024-04-25T09:06:14.432445+0000","last_unstale":"2024-04-25T09:06:15.441950+0000","last_undegraded":"2024-04-25T09:06:15.441950+0000","last_fullsized":"2024-04-25T09:06:15.441950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:21.068742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.438192+0000","last_change":"2024-04-25T09:06:15.437683+0000","last_active":"2024-04-25T09:06:16.438192+0000","last_peered":"2024-04-25T09:06:16.438192+0000","last_clean":"2024-04-25T09:06:16.438192+0000","last_became_active":"2024-04-25T09:06:15.437372+0000","last_became_peered":"2024-04-25T09:06:15.437372+0000","last_unstale":"2024-04-25T09:06:16.438192+0000","last_undegraded":"2024-04-25T09:06:16.438192+0000","last_fullsized":"2024-04-25T09:06:16.438192+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:03.195824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.437470+0000","last_change":"2024-04-25T09:06:14.428925+0000","last_active":"2024-04-25T09:06:15.437470+0000","last_peered":"2024-04-25T09:06:15.437470+0000","last_clean":"2024-04-25T09:06:15.437470+0000","last_became_active":"2024-04-25T09:06:14.428606+0000","last_became_peered":"2024-04-25T09:06:14.428606+0000","last_unstale":"2024-04-25T09:06:15.437470+0000","last_undegraded":"2024-04-25T09:06:15.437470+0000","last_fullsized":"2024-04-25T09:06:15.437470+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:45.725823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442800+0000","last_change":"2024-04-25T09:06:15.444840+0000","last_active":"2024-04-25T09:06:16.442800+0000","last_peered":"2024-04-25T09:06:16.442800+0000","last_clean":"2024-04-25T09:06:16.442800+0000","last_became_active":"2024-04-25T09:06:15.444582+0000","last_became_peered":"2024-04-25T09:06:15.444582+0000","last_unstale":"2024-04-25T09:06:16.442800+0000","last_undegraded":"2024-04-25T09:06:16.442800+0000","last_fullsized":"2024-04-25T09:06:16.442800+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:10.668602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434887+0000","last_change":"2024-04-25T09:06:14.430077+0000","last_active":"2024-04-25T09:06:15.434887+0000","last_peered":"2024-04-25T09:06:15.434887+0000","last_clean":"2024-04-25T09:06:15.434887+0000","last_became_active":"2024-04-25T09:06:14.429795+0000","last_became_peered":"2024-04-25T09:06:14.429795+0000","last_unstale":"2024-04-25T09:06:15.434887+0000","last_undegraded":"2024-04-25T09:06:15.434887+0000","last_fullsized":"2024-04-25T09:06:15.434887+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:56.128849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.450884+0000","last_change":"2024-04-25T09:06:15.449032+0000","last_active":"2024-04-25T09:06:15.450884+0000","last_peered":"2024-04-25T09:06:15.450884+0000","last_clean":"2024-04-25T09:06:15.450884+0000","last_became_active":"2024-04-25T09:06:15.448702+0000","last_became_peered":"2024-04-25T09:06:15.448702+0000","last_unstale":"2024-04-25T09:06:15.450884+0000","last_undegraded":"2024-04-25T09:06:15.450884+0000","last_fullsized":"2024-04-25T09:06:15.450884+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:02.994038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.448521+0000","last_change":"2024-04-25T09:06:14.432478+0000","last_active":"2024-04-25T09:06:15.448521+0000","last_peered":"2024-04-25T09:06:15.448521+0000","last_clean":"2024-04-25T09:06:15.448521+0000","last_became_active":"2024-04-25T09:06:14.430841+0000","last_became_peered":"2024-04-25T09:06:14.430841+0000","last_unstale":"2024-04-25T09:06:15.448521+0000","last_undegraded":"2024-04-25T09:06:15.448521+0000","last_fullsized":"2024-04-25T09:06:15.448521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:40.525677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-25T09:06:16.442574+0000","last_change":"2024-04-25T09:06:15.448215+0000","last_active":"2024-04-25T09:06:16.442574+0000","last_peered":"2024-04-25T09:06:16.442574+0000","last_clean":"2024-04-25T09:06:16.442574+0000","last_became_active":"2024-04-25T09:06:15.447925+0000","last_became_peered":"2024-04-25T09:06:15.447925+0000","last_unstale":"2024-04-25T09:06:16.442574+0000","last_undegraded":"2024-04-25T09:06:16.442574+0000","last_fullsized":"2024-04-25T09:06:16.442574+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:27.727458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.426148+0000","last_change":"2024-04-25T09:06:14.430515+0000","last_active":"2024-04-25T09:06:15.426148+0000","last_peered":"2024-04-25T09:06:15.426148+0000","last_clean":"2024-04-25T09:06:15.426148+0000","last_became_active":"2024-04-25T09:06:14.430162+0000","last_became_peered":"2024-04-25T09:06:14.430162+0000","last_unstale":"2024-04-25T09:06:15.426148+0000","last_undegraded":"2024-04-25T09:06:15.426148+0000","last_fullsized":"2024-04-25T09:06:15.426148+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:38.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.445199+0000","last_change":"2024-04-25T09:06:15.442638+0000","last_active":"2024-04-25T09:06:15.445199+0000","last_peered":"2024-04-25T09:06:15.445199+0000","last_clean":"2024-04-25T09:06:15.445199+0000","last_became_active":"2024-04-25T09:06:15.442011+0000","last_became_peered":"2024-04-25T09:06:15.442011+0000","last_unstale":"2024-04-25T09:06:15.445199+0000","last_undegraded":"2024-04-25T09:06:15.445199+0000","last_fullsized":"2024-04-25T09:06:15.445199+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:14.411539+0000","last_clean_scrub_stamp":"2024-04-25T09:06:14.411539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:06.022743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"137'3","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.457300+0000","last_change":"2024-04-25T09:06:14.428373+0000","last_active":"2024-04-25T09:06:15.457300+0000","last_peered":"2024-04-25T09:06:15.457300+0000","last_clean":"2024-04-25T09:06:15.457300+0000","last_became_active":"2024-04-25T09:06:14.428092+0000","last_became_peered":"2024-04-25T09:06:14.428092+0000","last_unstale":"2024-04-25T09:06:15.457300+0000","last_undegraded":"2024-04-25T09:06:15.457300+0000","last_fullsized":"2024-04-25T09:06:15.457300+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:13.407190+0000","last_clean_scrub_stamp":"2024-04-25T09:06:13.407190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:47.710666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":389,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-04-25T09:06:15.434684+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:06:15.434684+0000","last_peered":"2024-04-25T09:06:15.434684+0000","last_clean":"2024-04-25T09:06:15.434684+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:06:15.434684+0000","last_undegraded":"2024-04-25T09:06:15.434684+0000","last_fullsized":"2024-04-25T09:06:15.434684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55652,"kb_used_data":2264,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316188,"statfs":{"total":96636764160,"available":96579776512,"internally_reserved":0,"allocated":2318336,"data_stored":1340333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59236,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312604,"statfs":{"total":96636764160,"available":96576106496,"internally_reserved":0,"allocated":1728512,"data_stored":749459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1720320,"data_stored":749335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55072,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316768,"statfs":{"total":96636764160,"available":96580370432,"internally_reserved":0,"allocated":1716224,"data_stored":749313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59224,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312616,"statfs":{"total":96636764160,"available":96576118784,"internally_reserved":0,"allocated":1716224,"data_stored":749313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55080,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316760,"statfs":{"total":96636764160,"available":96580362240,"internally_reserved":0,"allocated":1732608,"data_stored":750995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46748,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325092,"statfs":{"total":96636764160,"available":96588894208,"internally_reserved":0,"allocated":1720320,"data_stored":749895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37612,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334228,"statfs":{"total":96636764160,"available":96598249472,"internally_reserved":0,"allocated":2326528,"data_stored":1341327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:18.842 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:06:18.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:06:18.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.998+0000 7f6295f9b640 1 Processor -- start 2024-04-25T09:06:18.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.998+0000 7f6295f9b640 1 -- start start 2024-04-25T09:06:18.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f6295f9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f629006c1d0 0x7f629006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f6295f9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62900cfa20 0x7f62900cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f6295f9b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629015bfd0 con 0x7f629015bbf0 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f6295f9b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62900b28c0 con 0x7f62900cfa20 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f6295f9b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62900b2e80 con 0x7f629006c1d0 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62900cfa20 0x7f62900cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62900cfa20 0x7f62900cfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59154/0 (socket says 172.21.15.5:59154) 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628ffff640 1 -- 172.21.15.5:0/3035847501 learned_addr learned my addr 172.21.15.5:0/3035847501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628effd640 1 --2- 172.21.15.5:0/3035847501 >> v2:172.21.15.80:3300/0 conn(0x7f629006c1d0 0x7f629006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628ffff640 1 -- 172.21.15.5:0/3035847501 >> v2:172.21.15.80:3300/0 conn(0x7f629006c1d0 msgr2=0x7f629006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628ffff640 1 --2- 172.21.15.5:0/3035847501 >> v2:172.21.15.80:3300/0 conn(0x7f629006c1d0 0x7f629006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628ffff640 1 -- 172.21.15.5:0/3035847501 >> v1:172.21.15.80:6789/0 conn(0x7f629015bbf0 legacy=0x7f62900cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:18.999+0000 7f628ffff640 1 -- 172.21.15.5:0/3035847501 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629006cc90 con 0x7f62900cfa20 2024-04-25T09:06:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.000+0000 7f628ffff640 1 --2- 172.21.15.5:0/3035847501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62900cfa20 0x7f62900cfeb0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f62900678d0 tx=0x7f628802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473f058f58111803 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.000+0000 7f628e7fc640 1 -- 172.21.15.5:0/3035847501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288036070 con 0x7f62900cfa20 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.000+0000 7f628e7fc640 1 -- 172.21.15.5:0/3035847501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288031600 con 0x7f62900cfa20 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.000+0000 7f628e7fc640 1 -- 172.21.15.5:0/3035847501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62880319d0 con 0x7f62900cfa20 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.000+0000 7f6295f9b640 1 -- 172.21.15.5:0/3035847501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62900cfa20 msgr2=0x7f62900cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.000+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3035847501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62900cfa20 0x7f62900cfeb0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f62900678d0 tx=0x7f628802a6a0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.001+0000 7f6295f9b640 1 -- 172.21.15.5:0/3035847501 shutdown_connections 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.001+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3035847501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62900cfa20 0x7f62900cfeb0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.001+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3035847501 >> v2:172.21.15.80:3300/0 conn(0x7f629006c1d0 0x7f629006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.001+0000 7f6295f9b640 1 -- 172.21.15.5:0/3035847501 >> 172.21.15.5:0/3035847501 conn(0x7f6290066ad0 msgr2=0x7f6290066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.001+0000 7f6295f9b640 1 -- 172.21.15.5:0/3035847501 shutdown_connections 2024-04-25T09:06:18.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.001+0000 7f6295f9b640 1 -- 172.21.15.5:0/3035847501 wait complete. 2024-04-25T09:06:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.002+0000 7f6295f9b640 1 Processor -- start 2024-04-25T09:06:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.002+0000 7f6295f9b640 1 -- start start 2024-04-25T09:06:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6295f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629006c1d0 0x7f629014d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6295f9b640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62900cfa20 0x7f62900a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6295f9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015bbf0 0x7f62900abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6295f9b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900ce2d0 con 0x7f629006c1d0 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6295f9b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900b2b10 con 0x7f629015bbf0 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6295f9b640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900b4d10 con 0x7f62900cfa20 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629006c1d0 0x7f629014d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629006c1d0 0x7f629014d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59162/0 (socket says 172.21.15.5:59162) 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 -- 172.21.15.5:0/3900759988 learned_addr learned my addr 172.21.15.5:0/3900759988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628effd640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62900cfa20 0x7f62900a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628ffff640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015bbf0 0x7f62900abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 -- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62900cfa20 msgr2=0x7f62900a9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62900cfa20 0x7f62900a9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 -- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015bbf0 msgr2=0x7f62900abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015bbf0 0x7f62900abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 -- 172.21.15.5:0/3900759988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900aa430 con 0x7f629006c1d0 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f628f7fe640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629006c1d0 0x7f629014d260 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f628000c3c0 tx=0x7f628000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6277fff640 1 -- 172.21.15.5:0/3900759988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62800052d0 con 0x7f629006c1d0 2024-04-25T09:06:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.003+0000 7f6277fff640 1 -- 172.21.15.5:0/3900759988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280005490 con 0x7f629006c1d0 2024-04-25T09:06:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.004+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900aa710 con 0x7f629006c1d0 2024-04-25T09:06:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.004+0000 7f6277fff640 1 -- 172.21.15.5:0/3900759988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280007260 con 0x7f629006c1d0 2024-04-25T09:06:18.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.004+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62900aacd0 con 0x7f629006c1d0 2024-04-25T09:06:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.005+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629004ef20 con 0x7f629006c1d0 2024-04-25T09:06:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.005+0000 7f6277fff640 1 -- 172.21.15.5:0/3900759988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6280007400 con 0x7f629006c1d0 2024-04-25T09:06:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.005+0000 7f6277fff640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f627c06b4d0 0x7f627c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.006+0000 7f6277fff640 1 -- 172.21.15.5:0/3900759988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6280089530 con 0x7f629006c1d0 2024-04-25T09:06:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.006+0000 7f628effd640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f627c06b4d0 0x7f627c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.006+0000 7f628effd640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f627c06b4d0 0x7f627c06d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6290067060 tx=0x7f6284008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.010+0000 7f6277fff640 1 -- 172.21.15.5:0/3900759988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6280057df0 con 0x7f629006c1d0 2024-04-25T09:06:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.257+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f62900cdcb0 con 0x7f629006c1d0 2024-04-25T09:06:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.259+0000 7f6277fff640 1 -- 172.21.15.5:0/3900759988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f628005be90 con 0x7f629006c1d0 2024-04-25T09:06:19.248 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-25T09:06:19.248 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCVGipmS/6lCRAAEUzHaJP7fJg1hZJuKRGXTA== 2024-04-25T09:06:19.248 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-04-25T09:06:19.248 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-04-25T09:06:19.248 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f627c06b4d0 msgr2=0x7f627c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f627c06b4d0 0x7f627c06d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6290067060 tx=0x7f6284008040 comp rx=0 tx=0).stop 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629006c1d0 msgr2=0x7f629014d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629006c1d0 0x7f629014d260 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f628000c3c0 tx=0x7f628000c880 comp rx=0 tx=0).stop 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 shutdown_connections 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f627c06b4d0 0x7f627c06d990 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015bbf0 0x7f62900abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f62900cfa20 0x7f62900a9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 --2- 172.21.15.5:0/3900759988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f629006c1d0 0x7f629014d260 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 >> 172.21.15.5:0/3900759988 conn(0x7f6290066ad0 msgr2=0x7f629015e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 shutdown_connections 2024-04-25T09:06:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.262+0000 7f6295f9b640 1 -- 172.21.15.5:0/3900759988 wait complete. 2024-04-25T09:06:19.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.374+0000 7fc7d25f9640 1 Processor -- start 2024-04-25T09:06:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.374+0000 7fc7d25f9640 1 -- start start 2024-04-25T09:06:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.375+0000 7fc7d25f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7cc0d3df0 0x7fc7cc0b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.375+0000 7fc7d25f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc0b29c0 con 0x7fc7cc0d3990 2024-04-25T09:06:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.375+0000 7fc7d25f9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc0d2080 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.375+0000 7fc7d25f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc0d1460 con 0x7fc7cc0d3df0 2024-04-25T09:06:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.375+0000 7fc7d0b96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7cc0d3df0 0x7fc7cc0b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.375+0000 7fc7cb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc7cc0d3990 0x7fc7cc0b6f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38988/0 (socket says 172.21.15.5:38988) 2024-04-25T09:06:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.375+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3933463930 learned_addr learned my addr 172.21.15.5:0/3933463930 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.376+0000 7fc7d0b96640 1 -- 172.21.15.5:0/3933463930 >> v1:172.21.15.80:6789/0 conn(0x7fc7cc15e0a0 legacy=0x7fc7cc0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.376+0000 7fc7d0b96640 1 -- 172.21.15.5:0/3933463930 >> v1:172.21.15.5:6789/0 conn(0x7fc7cc0d3990 legacy=0x7fc7cc0b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.376+0000 7fc7d0b96640 1 -- 172.21.15.5:0/3933463930 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0d2360 con 0x7fc7cc0d3df0 2024-04-25T09:06:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.376+0000 7fc7caffd640 1 -- 172.21.15.5:0/3933463930 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032819717 0 0) 0x7fc7cc0b29c0 con 0x7fc7cc0d3990 2024-04-25T09:06:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.376+0000 7fc7d0b96640 1 --2- 172.21.15.5:0/3933463930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc0b7660 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009d90 tx=0x7fc7c402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48377adac3e8a355 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7caffd640 1 -- 172.21.15.5:0/3933463930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4007740 con 0x7fc7cc0d3df0 2024-04-25T09:06:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7caffd640 1 -- 172.21.15.5:0/3933463930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c40078e0 con 0x7fc7cc0d3df0 2024-04-25T09:06:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7caffd640 1 -- 172.21.15.5:0/3933463930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4007cb0 con 0x7fc7cc0d3df0 2024-04-25T09:06:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7d25f9640 1 -- 172.21.15.5:0/3933463930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0d3df0 msgr2=0x7fc7cc0b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/3933463930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc0b7660 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009d90 tx=0x7fc7c402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7d25f9640 1 -- 172.21.15.5:0/3933463930 shutdown_connections 2024-04-25T09:06:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/3933463930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc0b7660 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7d25f9640 1 -- 172.21.15.5:0/3933463930 >> 172.21.15.5:0/3933463930 conn(0x7fc7cc0668f0 msgr2=0x7fc7cc066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7d25f9640 1 -- 172.21.15.5:0/3933463930 shutdown_connections 2024-04-25T09:06:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.377+0000 7fc7d25f9640 1 -- 172.21.15.5:0/3933463930 wait complete. 2024-04-25T09:06:19.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.378+0000 7fc7d25f9640 1 Processor -- start 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d25f9640 1 -- start start 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d25f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7cc0d3990 0x7fc7cc15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d25f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d25f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc15e0a0 0x7fc7cc1f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d25f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0d2c00 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d25f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0d2920 con 0x7fc7cc0d3df0 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d25f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0d4280 con 0x7fc7cc0d3990 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d0b96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc15e0a0 0x7fc7cc1f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d0b96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc15e0a0 0x7fc7cc1f70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59184/0 (socket says 172.21.15.5:59184) 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7d0b96640 1 -- 172.21.15.5:0/2261960266 learned_addr learned my addr 172.21.15.5:0/2261960266 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7cb7fe640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.379+0000 7fc7cbfff640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7cc0d3990 0x7fc7cc15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d0b96640 1 -- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7cc0d3990 msgr2=0x7fc7cc15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d0b96640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7cc0d3990 0x7fc7cc15ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d0b96640 1 -- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7cc0d3df0 msgr2=0x7fc7cc157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d0b96640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d0b96640 1 -- 172.21.15.5:0/2261960266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc15b3a0 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7cb7fe640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d0b96640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc15e0a0 0x7fc7cc1f70d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009d90 tx=0x7fc7c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7c8ff9640 1 -- 172.21.15.5:0/2261960266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4040070 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7c8ff9640 1 -- 172.21.15.5:0/2261960266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4031c40 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0aaeb0 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7c8ff9640 1 -- 172.21.15.5:0/2261960266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4003990 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.380+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc0ab470 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.381+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc160010 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.381+0000 7fc7c8ff9640 1 -- 172.21.15.5:0/2261960266 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc7c4039040 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.382+0000 7fc7c8ff9640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc7b806b500 0x7fc7b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.382+0000 7fc7c8ff9640 1 -- 172.21.15.5:0/2261960266 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7c40ab480 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.382+0000 7fc7cbfff640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc7b806b500 0x7fc7b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.383+0000 7fc7cbfff640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc7b806b500 0x7fc7b806d9c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000f60 tx=0x7fc7bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:19.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.386+0000 7fc7c8ff9640 1 -- 172.21.15.5:0/2261960266 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc7cc160010 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.607+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7cc04ef20 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.608+0000 7fc7c8ff9640 1 -- 172.21.15.5:0/2261960266 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fc7c4079c90 con 0x7fc7cc15e0a0 2024-04-25T09:06:19.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:19.597 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":9591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1089300174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1089300174},{"type":"v1","addr":"172.21.15.5:6833","nonce":1089300174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:14.788729+0000","modified":"2024-04-25T09:06:16.783115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9597":{"gid":9597,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1713726638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1713726638},{"type":"v1","addr":"172.21.15.5:6835","nonce":1713726638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:06:19.597 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 89 2024-04-25T09:06:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc7b806b500 msgr2=0x7fc7b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc7b806b500 0x7fc7b806d9c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000f60 tx=0x7fc7bc009040 comp rx=0 tx=0).stop 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc15e0a0 msgr2=0x7fc7cc1f70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc15e0a0 0x7fc7cc1f70d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009d90 tx=0x7fc7c4004a40 comp rx=0 tx=0).stop 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 shutdown_connections 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fc7b806b500 0x7fc7b806d9c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc15e0a0 0x7fc7cc1f70d0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7cc0d3df0 0x7fc7cc157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 --2- 172.21.15.5:0/2261960266 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc7cc0d3990 0x7fc7cc15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 >> 172.21.15.5:0/2261960266 conn(0x7fc7cc0668f0 msgr2=0x7fc7cc0cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 shutdown_connections 2024-04-25T09:06:19.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:19.610+0000 7fc7d25f9640 1 -- 172.21.15.5:0/2261960266 wait complete. 2024-04-25T09:06:20.012 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:14.788729+0000', 'modified': '2024-04-25T09:06:16.783115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9597': {'gid': 9597, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1713726638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1713726638}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1713726638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:20.012 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:06:20.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:06:20.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.129+0000 7f5fcc41f640 1 Processor -- start 2024-04-25T09:06:20.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.129+0000 7f5fcc41f640 1 -- start start 2024-04-25T09:06:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fcc41f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc406b7d0 0x7f5fc406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fcc41f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fc415e120 0x7f5fc40d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fcc41f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40b4730 con 0x7f5fc406bbb0 2024-04-25T09:06:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fcc41f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc40d0b70 con 0x7f5fc415e120 2024-04-25T09:06:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fcc41f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40cbf30 con 0x7f5fc406b7d0 2024-04-25T09:06:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fca1bb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc406b7d0 0x7f5fc406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fca9bc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fc415e120 0x7f5fc40d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fca1bb640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc406b7d0 0x7f5fc406aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:33520/0 (socket says 172.21.15.5:33520) 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.130+0000 7f5fca1bb640 1 -- 172.21.15.5:0/937691961 learned_addr learned my addr 172.21.15.5:0/937691961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.131+0000 7f5fca9bc640 1 -- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc406b7d0 msgr2=0x7f5fc406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.131+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc406b7d0 0x7f5fc406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.131+0000 7f5fca9bc640 1 -- 172.21.15.5:0/937691961 >> v1:172.21.15.80:6789/0 conn(0x7f5fc406bbb0 legacy=0x7f5fc415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.131+0000 7f5fca9bc640 1 -- 172.21.15.5:0/937691961 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40d0da0 con 0x7f5fc415e120 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.131+0000 7f5fc91b9640 1 -- 172.21.15.5:0/937691961 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415588871 0 0) 0x7f5fb4001110 con 0x7f5fc406bbb0 2024-04-25T09:06:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.131+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc406b7d0 0x7f5fc406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.131+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc415e120 0x7f5fc40d0630 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009d90 tx=0x7f5fbc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f743b6e2202c5318 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fc91b9640 1 -- 172.21.15.5:0/937691961 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc007740 con 0x7f5fc415e120 2024-04-25T09:06:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fc91b9640 1 -- 172.21.15.5:0/937691961 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc0078e0 con 0x7f5fc415e120 2024-04-25T09:06:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fc91b9640 1 -- 172.21.15.5:0/937691961 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc007cb0 con 0x7f5fc415e120 2024-04-25T09:06:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 -- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc415e120 msgr2=0x7f5fc40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc415e120 0x7f5fc40d0630 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009d90 tx=0x7f5fbc02a6f0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 -- 172.21.15.5:0/937691961 shutdown_connections 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc415e120 0x7f5fc40d0630 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/937691961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc406b7d0 0x7f5fc406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 -- 172.21.15.5:0/937691961 >> 172.21.15.5:0/937691961 conn(0x7f5fc40d18e0 msgr2=0x7f5fc40d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 -- 172.21.15.5:0/937691961 shutdown_connections 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.132+0000 7f5fcc41f640 1 -- 172.21.15.5:0/937691961 wait complete. 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 Processor -- start 2024-04-25T09:06:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 -- start start 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc406b7d0 0x7f5fc414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc406bbb0 0x7f5fc40b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc415e120 0x7f5fc40b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40cc460 con 0x7f5fc406bbb0 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40cc7d0 con 0x7f5fc406b7d0 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.134+0000 7f5fcc41f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40ccc60 con 0x7f5fc415e120 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc406bbb0 0x7f5fc40b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc406bbb0 0x7f5fc40b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59188/0 (socket says 172.21.15.5:59188) 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3768928965 learned_addr learned my addr 172.21.15.5:0/3768928965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc406b7d0 0x7f5fc414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc415e120 0x7f5fc40b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc415e120 msgr2=0x7f5fc40b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc415e120 0x7f5fc40b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc406b7d0 msgr2=0x7f5fc414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc406b7d0 0x7f5fc414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3768928965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4154860 con 0x7f5fc406bbb0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc406bbb0 0x7f5fc40b6450 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c750 tx=0x7f5fb400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fbaffd640 1 -- 172.21.15.5:0/3768928965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4017070 con 0x7f5fc406bbb0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fbaffd640 1 -- 172.21.15.5:0/3768928965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb40052b0 con 0x7f5fc406bbb0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc4154b40 con 0x7f5fc406bbb0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fbaffd640 1 -- 172.21.15.5:0/3768928965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400a880 con 0x7f5fc406bbb0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.135+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc4155100 con 0x7f5fc406bbb0 2024-04-25T09:06:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.137+0000 7f5fbaffd640 1 -- 172.21.15.5:0/3768928965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5fb401a070 con 0x7f5fc406bbb0 2024-04-25T09:06:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.137+0000 7f5fbaffd640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5fa806b4d0 0x7f5fa806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.137+0000 7f5fbaffd640 1 -- 172.21.15.5:0/3768928965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fb4089580 con 0x7f5fc406bbb0 2024-04-25T09:06:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.138+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5fa806b4d0 0x7f5fa806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.138+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5fa806b4d0 0x7f5fa806d990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40b7910 tx=0x7f5fc0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 Processor -- start 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 -- start start 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba75610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba93020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba4af10 0x55a5dba91190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5db9ada10 con 0x55a5dba92ad0 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5db956b30 con 0x55a5dba4af10 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.139+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5db9a9c50 con 0x55a5dba75230 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba93020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba93020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59192/0 (socket says 172.21.15.5:59192) 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 -- 172.21.15.5:0/424690073 learned_addr learned my addr 172.21.15.5:0/424690073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba4af10 0x55a5dba91190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba75610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 -- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 msgr2=0x55a5dba75610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba75610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 -- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba4af10 msgr2=0x55a5dba91190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba4af10 0x55a5dba91190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 -- 172.21.15.5:0/424690073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5db96be10 con 0x55a5dba92ad0 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba93020 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f5fb405fe40 tx=0x7f5fb4001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688e019ce3e181e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fa7fff640 1 -- 172.21.15.5:0/424690073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb405bdb0 con 0x55a5dba92ad0 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fa7fff640 1 -- 172.21.15.5:0/424690073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4060370 con 0x55a5dba92ad0 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.140+0000 7f5fa7fff640 1 -- 172.21.15.5:0/424690073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4054380 con 0x55a5dba92ad0 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 -- 172.21.15.5:0/424690073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 msgr2=0x55a5dba93020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba93020 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f5fb405fe40 tx=0x7f5fb4001080 comp rx=0 tx=0).stop 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 -- 172.21.15.5:0/424690073 shutdown_connections 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba4af10 0x55a5dba91190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba93020 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 --2- 172.21.15.5:0/424690073 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba75610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 -- 172.21.15.5:0/424690073 >> 172.21.15.5:0/424690073 conn(0x55a5dba47840 msgr2=0x55a5dba90040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 -- 172.21.15.5:0/424690073 shutdown_connections 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.141+0000 7f5fcf200740 1 -- 172.21.15.5:0/424690073 wait complete. 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.142+0000 7f5fcf200740 1 -- start start 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.142+0000 7f5fcf200740 1 Processor -- start 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dba78300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba92ad0 0x55a5dba73570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dbaa0250 0x55a5dba73ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5dba4bcb0 con 0x55a5dbaa0250 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5db96a0c0 con 0x55a5dba75230 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5dba45770 con 0x55a5dba92ad0 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 10 client.0 _ll_register_callbacks cb 0x55a5db95dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dbaa0250 0x55a5dba73ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dbaa0250 0x55a5dba73ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59194/0 (socket says 172.21.15.5:59194) 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 -- 172.21.15.5:0/3621928444 learned_addr learned my addr 172.21.15.5:0/3621928444 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dba78300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba92ad0 0x55a5dba73570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 -- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba92ad0 msgr2=0x55a5dba73570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba92ad0 0x55a5dba73570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 -- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 msgr2=0x55a5dba78300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dba78300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 -- 172.21.15.5:0/3621928444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5db6c22d0 con 0x55a5dbaa0250 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dba78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba92ad0 0x55a5dba73570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dbaa0250 0x55a5dba73ab0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc02a730 tx=0x7f5fbc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7535102808d71b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fa57fa640 1 -- 172.21.15.5:0/3621928444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc009450 con 0x55a5dbaa0250 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fa57fa640 1 -- 172.21.15.5:0/3621928444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fbc046ac0 con 0x55a5dbaa0250 2024-04-25T09:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fb4060370 con 0x55a5dbaa0250 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.143+0000 7f5fa57fa640 1 -- 172.21.15.5:0/3621928444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fbc046cc0 con 0x55a5dbaa0250 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 10 client.9747 fetch_fsmap learned FSMap version 89 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55a5db78c6b0 con 0x55a5dbaa0250 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fa57fa640 1 -- 172.21.15.5:0/3621928444 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4060370 con 0x55a5dbaa0250 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fa57fa640 1 -- 172.21.15.5:0/3621928444 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5fbc046020 con 0x55a5dbaa0250 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 10 client.9747 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 10 client.9747 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 20 client.9747 populate_metadata read hostname 'smithi005' 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba95d60 0x55a5dba77320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 4 client.9747 mds_command: new command op to 9597 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 --> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5dba0c920 con 0x55a5dba95d60 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba95d60 0x55a5dba77320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fa57fa640 10 client.9747 ms_handle_connect on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.144+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba95d60 0x55a5dba77320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c28235a0db3a153 server_cookie=6e24cbbd2ae654db in_seq=0 out_seq=0 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fa57fa640 1 -- 172.21.15.5:0/3621928444 <== mds.0 v2:172.21.15.5:6834/1713726638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5dba0c920 con 0x55a5dba95d60 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fa57fa640 10 client.9747 handle_command_reply: tid=0 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 client.9747 shutdown 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dbaa0250 msgr2=0x55a5dba73ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dbaa0250 0x55a5dba73ab0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc02a730 tx=0x7f5fbc004ab0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 shutdown_connections 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dbaa0250 0x55a5dba73ab0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba92ad0 0x55a5dba73570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba95d60 0x55a5dba77320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3621928444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dba78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fa57fa640 0 client.9747 ms_handle_reset on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 >> 172.21.15.5:0/3621928444 conn(0x55a5dba4af10 msgr2=0x55a5dba93e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 shutdown_connections 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 1 -- 172.21.15.5:0/3621928444 wait complete. 2024-04-25T09:06:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.145+0000 7f5fcf200740 20 client.9747 trim_cache size 0 max 16384 2024-04-25T09:06:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.161+0000 7f5fcf200740 1 Processor -- start 2024-04-25T09:06:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.161+0000 7f5fcf200740 1 -- start start 2024-04-25T09:06:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba74580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dbaf2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dbaa0250 0x55a5dbab2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fcf200740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41ff220 con 0x55a5dba92ad0 2024-04-25T09:06:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4157750 con 0x55a5dbaa0250 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4157d20 con 0x55a5dba75230 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dbaf2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dbaf2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59206/0 (socket says 172.21.15.5:59206) 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3450443822 learned_addr learned my addr 172.21.15.5:0/3450443822 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba74580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dbaa0250 0x55a5dbab2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 msgr2=0x55a5dba74580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba74580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dbaa0250 msgr2=0x55a5dbab2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dbaa0250 0x55a5dbab2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 -- 172.21.15.5:0/3450443822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5dba6aa00 con 0x55a5dba92ad0 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.162+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dbaf2130 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40013b0 tx=0x7f5fb401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c37108155a8ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fa77fe640 1 -- 172.21.15.5:0/3450443822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4074070 con 0x55a5dba92ad0 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fa77fe640 1 -- 172.21.15.5:0/3450443822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4060370 con 0x55a5dba92ad0 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fa77fe640 1 -- 172.21.15.5:0/3450443822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb405bdb0 con 0x55a5dba92ad0 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 -- 172.21.15.5:0/3450443822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 msgr2=0x55a5dbaf2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dbaf2130 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40013b0 tx=0x7f5fb401e000 comp rx=0 tx=0).stop 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 -- 172.21.15.5:0/3450443822 shutdown_connections 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dbaa0250 0x55a5dbab2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dbaf2130 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 --2- 172.21.15.5:0/3450443822 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dba75230 0x55a5dba74580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 -- 172.21.15.5:0/3450443822 >> 172.21.15.5:0/3450443822 conn(0x55a5dba4af10 msgr2=0x55a5dba4b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 -- 172.21.15.5:0/3450443822 shutdown_connections 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.163+0000 7f5fcf200740 1 -- 172.21.15.5:0/3450443822 wait complete. 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.164+0000 7f5fcf200740 1 -- start start 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.164+0000 7f5fcf200740 1 Processor -- start 2024-04-25T09:06:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dbab2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba448a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fcf200740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dbaa0250 0x55a5dba8e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fcf200740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5dba95be0 con 0x55a5dba92ad0 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5dba95760 con 0x55a5dba75230 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fcf200740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5dba961e0 con 0x55a5dbaa0250 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fcf200740 10 client.0 _ll_register_callbacks cb 0x55a5dba45c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59218/0 (socket says 172.21.15.5:59218) 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 -- 172.21.15.5:0/1082529430 learned_addr learned my addr 172.21.15.5:0/1082529430 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fca9bc640 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dbaa0250 0x55a5dba8e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dbab2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 -- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dbaa0250 msgr2=0x55a5dba8e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dbaa0250 0x55a5dba8e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 -- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 msgr2=0x55a5dbab2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dbab2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 -- 172.21.15.5:0/1082529430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5dbafb3a0 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fc99ba640 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba448a0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4057ed0 tx=0x7f5fb400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44572d29dd509731 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.165+0000 7f5fa57fa640 1 -- 172.21.15.5:0/1082529430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4074070 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fa57fa640 1 -- 172.21.15.5:0/1082529430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fb40600e0 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fb4060370 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fa57fa640 1 -- 172.21.15.5:0/1082529430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fb407e050 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 10 client.9753 fetch_fsmap learned FSMap version 89 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55a5dba93e10 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fa57fa640 1 -- 172.21.15.5:0/1082529430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4060370 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fa57fa640 1 -- 172.21.15.5:0/1082529430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5fb4076b30 con 0x55a5dba92ad0 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 10 client.9753 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 10 client.9753 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 20 client.9753 populate_metadata read hostname 'smithi005' 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba492f0 0x55a5dba496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 4 client.9753 mds_command: new command op to 9597 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 --> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a5db9baf50 con 0x55a5dba492f0 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba492f0 0x55a5dba496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fca1bb640 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba492f0 0x55a5dba496d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a5a8938f2643229 server_cookie=9f3385766232a699 in_seq=0 out_seq=0 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.166+0000 7f5fa57fa640 10 client.9753 ms_handle_connect on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fa57fa640 1 -- 172.21.15.5:0/1082529430 <== mds.0 v2:172.21.15.5:6834/1713726638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55a5db9baf50 con 0x55a5dba492f0 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fa57fa640 10 client.9753 handle_command_reply: tid=0 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 client.9753 shutdown 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 msgr2=0x55a5dba448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba448a0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4057ed0 tx=0x7f5fb400cf90 comp rx=0 tx=0).stop 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 shutdown_connections 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55a5dbaa0250 0x55a5dba8e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a5dba92ad0 0x55a5dba448a0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55a5dba492f0 0x55a5dba496d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 --2- 172.21.15.5:0/1082529430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5dba75230 0x55a5dbab2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fa57fa640 0 client.9753 ms_handle_reset on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 >> 172.21.15.5:0/1082529430 conn(0x55a5dba4af10 msgr2=0x55a5dba71120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 shutdown_connections 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 1 -- 172.21.15.5:0/1082529430 wait complete. 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcf200740 20 client.9753 trim_cache size 0 max 16384 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:06:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9597, 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 4.7362264219999997, 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 89, 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 138, 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 138, 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 9.7561201690000008 2024-04-25T09:06:20.163 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5fa806b4d0 msgr2=0x7f5fa806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5fa806b4d0 0x7f5fa806d990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40b7910 tx=0x7f5fc0008040 comp rx=0 tx=0).stop 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc406bbb0 msgr2=0x7f5fc40b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc406bbb0 0x7f5fc40b6450 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c750 tx=0x7f5fb400cc10 comp rx=0 tx=0).stop 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 shutdown_connections 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f5fa806b4d0 0x7f5fa806d990 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5fc415e120 0x7f5fc40b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc406bbb0 0x7f5fc40b6450 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 --2- 172.21.15.5:0/3768928965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fc406b7d0 0x7f5fc414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.167+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 >> 172.21.15.5:0/3768928965 conn(0x7f5fc40d18e0 msgr2=0x7f5fc40ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.168+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 shutdown_connections 2024-04-25T09:06:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.168+0000 7f5fcc41f640 1 -- 172.21.15.5:0/3768928965 wait complete. 2024-04-25T09:06:20.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:06:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.279+0000 7fbacd3f9640 1 Processor -- start 2024-04-25T09:06:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.279+0000 7fbacd3f9640 1 -- start start 2024-04-25T09:06:20.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbacd3f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbacd3f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbac80d3990 0x7fbac80d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbacd3f9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbac80ce5e0 0x7fbac80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbacd3f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac80d4330 con 0x7fbac80d3990 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbacd3f9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac80b29c0 con 0x7fbac80ce5e0 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbacd3f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80d2080 con 0x7fbac815e0a0 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbac80d3990 0x7fbac80d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbac80d3990 0x7fbac80d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59220/0 (socket says 172.21.15.5:59220) 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 -- 172.21.15.5:0/3635675894 learned_addr learned my addr 172.21.15.5:0/3635675894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 -- 172.21.15.5:0/3635675894 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 msgr2=0x7fbac80d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/3635675894 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac77fe640 1 --2- 172.21.15.5:0/3635675894 >> v2:172.21.15.80:3300/0 conn(0x7fbac80ce5e0 0x7fbac80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 --2- 172.21.15.5:0/3635675894 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 -- 172.21.15.5:0/3635675894 >> v2:172.21.15.80:3300/0 conn(0x7fbac80ce5e0 msgr2=0x7fbac80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 --2- 172.21.15.5:0/3635675894 >> v2:172.21.15.80:3300/0 conn(0x7fbac80ce5e0 0x7fbac80cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.280+0000 7fbac67fc640 1 -- 172.21.15.5:0/3635675894 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80d2360 con 0x7fbac80d3990 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.281+0000 7fbac67fc640 1 --2- 172.21.15.5:0/3635675894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80d3990 0x7fbac80d3df0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fbac808cfd0 tx=0x7fbabc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5e41f7db036393 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.281+0000 7fbac5ffb640 1 -- 172.21.15.5:0/3635675894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc037070 con 0x7fbac80d3990 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.281+0000 7fbac5ffb640 1 -- 172.21.15.5:0/3635675894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc032440 con 0x7fbac80d3990 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.281+0000 7fbac5ffb640 1 -- 172.21.15.5:0/3635675894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc032810 con 0x7fbac80d3990 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 -- 172.21.15.5:0/3635675894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80d3990 msgr2=0x7fbac80d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/3635675894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80d3990 0x7fbac80d3df0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fbac808cfd0 tx=0x7fbabc02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 -- 172.21.15.5:0/3635675894 shutdown_connections 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/3635675894 >> v2:172.21.15.80:3300/0 conn(0x7fbac80ce5e0 0x7fbac80cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/3635675894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80d3990 0x7fbac80d3df0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/3635675894 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 -- 172.21.15.5:0/3635675894 >> 172.21.15.5:0/3635675894 conn(0x7fbac80668f0 msgr2=0x7fbac8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 -- 172.21.15.5:0/3635675894 shutdown_connections 2024-04-25T09:06:20.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.282+0000 7fbacd3f9640 1 -- 172.21.15.5:0/3635675894 wait complete. 2024-04-25T09:06:20.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.283+0000 7fbacd3f9640 1 Processor -- start 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.283+0000 7fbacd3f9640 1 -- start start 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbacd3f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80ce5e0 0x7fbac81f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbacd3f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbac80d3990 0x7fbac80b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbacd3f9640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbacd3f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80d2c00 con 0x7fbac80ce5e0 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbacd3f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80d2920 con 0x7fbac80d3990 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbacd3f9640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac815e480 con 0x7fbac815e0a0 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80ce5e0 0x7fbac81f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80ce5e0 0x7fbac81f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59228/0 (socket says 172.21.15.5:59228) 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 -- 172.21.15.5:0/2561733923 learned_addr learned my addr 172.21.15.5:0/2561733923 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac77fe640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 -- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 msgr2=0x7fbac80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac67fc640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbac80d3990 0x7fbac80b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 -- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbac80d3990 msgr2=0x7fbac80b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbac80d3990 0x7fbac80b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 -- 172.21.15.5:0/2561733923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80ccc90 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac77fe640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac67fc640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbac80d3990 0x7fbac80b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.284+0000 7fbac6ffd640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80ce5e0 0x7fbac81f2f20 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c7f0 tx=0x7fbab800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.285+0000 7fbaaf7fe640 1 -- 172.21.15.5:0/2561733923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8015070 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.285+0000 7fbaaf7fe640 1 -- 172.21.15.5:0/2561733923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8004240 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.285+0000 7fbaaf7fe640 1 -- 172.21.15.5:0/2561733923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8007620 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.285+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac80cdab0 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.285+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac80caf00 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.286+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac804ef20 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.286+0000 7fbaaf7fe640 1 -- 172.21.15.5:0/2561733923 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbab80079d0 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.286+0000 7fbaaf7fe640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab406b4d0 0x7fbab406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.287+0000 7fbaaf7fe640 1 -- 172.21.15.5:0/2561733923 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbab808a580 con 0x7fbac80ce5e0 2024-04-25T09:06:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.287+0000 7fbac67fc640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab406b4d0 0x7fbab406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.287+0000 7fbac67fc640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab406b4d0 0x7fbab406d990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbabc034000 tx=0x7fbabc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.291+0000 7fbaaf7fe640 1 -- 172.21.15.5:0/2561733923 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbab8059490 con 0x7fbac80ce5e0 2024-04-25T09:06:20.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.508+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbac8071750 con 0x7fbac80ce5e0 2024-04-25T09:06:20.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.508+0000 7fbaaf7fe640 1 -- 172.21.15.5:0/2561733923 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbab8058d90 con 0x7fbac80ce5e0 2024-04-25T09:06:20.496 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:06:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab406b4d0 msgr2=0x7fbab406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab406b4d0 0x7fbab406d990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbabc034000 tx=0x7fbabc02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80ce5e0 msgr2=0x7fbac81f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80ce5e0 0x7fbac81f2f20 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c7f0 tx=0x7fbab800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 shutdown_connections 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbab406b4d0 0x7fbab406d990 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbac815e0a0 0x7fbac80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbac80d3990 0x7fbac80b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 --2- 172.21.15.5:0/2561733923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac80ce5e0 0x7fbac81f2f20 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 >> 172.21.15.5:0/2561733923 conn(0x7fbac80668f0 msgr2=0x7fbac80d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 shutdown_connections 2024-04-25T09:06:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:20.510+0000 7fbacd3f9640 1 -- 172.21.15.5:0/2561733923 wait complete. 2024-04-25T09:06:20.509 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:06:20.509 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:06:20.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-25T09:06:20.509 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:06:20.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:20.510 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:06:20.510 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:06:20.510 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:06:20.510 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:20.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:20.510 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:06:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42179sec preferred_lft 42179sec 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:06:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::a045:90ff:fe46:675f/64 scope link 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether b2:40:26:7e:8a:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::b040:26ff:fe7e:8ab9/64 scope link 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:20.530 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 06:ee:25:d7:13:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:06:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4ee:25ff:fed7:136b/64 scope link 2024-04-25T09:06:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:20.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:20.531 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:06:20.588 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-25T09:06:20.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:20.590 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-25T09:06:20.646 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-25T09:06:20.646 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:06:20.646 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:06:20.646 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:06:20.646 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:06:20.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:20.646 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-25T09:06:20.646 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:20.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:06:20.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:06:20.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:06:20.647 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:20.702 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-04-25T09:06:20.715+0000 7f1440ff2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:06:20.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:20.732 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:06:20.787 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:06:20.787 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:06:20.787 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:20.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:20.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-25T09:06:20.851 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:20.851 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:20.906 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:20.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:20.907 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:20.962 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T09:06:20.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:20.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:06:21.044 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:06:21.044 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:06:21.051 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T09:06:21.051 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T09:06:21.051 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.80:3300,172.21.15.80:3301" 2024-04-25T09:06:21.052 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@dc25bcb4-77ea-4563-9f35-ae8cfdf8a422.cephfs=/ 2024-04-25T09:06:21.052 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.80:3300/172.21.15.80:3301" will pass to kernel 2024-04-25T09:06:21.052 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:06:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:06:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:06:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:06:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:06:21.054 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:06:21.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:21.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:21.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:21.115 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:06:21.175 INFO:teuthology.orchestra.run.smithi005.stdout:client7463 2024-04-25T09:06:21.175 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:21.175 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:21.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:21.231 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:21.231 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:21.231 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:06:21.231 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:21.231 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:21.231 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:21.231 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103842 s, 101 MB/s 2024-04-25T09:06:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899114 s, 117 MB/s 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797969 s, 131 MB/s 2024-04-25T09:06:21.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813567 s, 129 MB/s 2024-04-25T09:06:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.342 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828337 s, 127 MB/s 2024-04-25T09:06:21.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832201 s, 126 MB/s 2024-04-25T09:06:21.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826084 s, 127 MB/s 2024-04-25T09:06:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070693 s, 148 MB/s 2024-04-25T09:06:21.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795931 s, 132 MB/s 2024-04-25T09:06:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843898 s, 124 MB/s 2024-04-25T09:06:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744187 s, 141 MB/s 2024-04-25T09:06:21.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830641 s, 126 MB/s 2024-04-25T09:06:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669133 s, 157 MB/s 2024-04-25T09:06:21.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687642 s, 152 MB/s 2024-04-25T09:06:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820396 s, 128 MB/s 2024-04-25T09:06:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072373 s, 145 MB/s 2024-04-25T09:06:21.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078006 s, 134 MB/s 2024-04-25T09:06:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758937 s, 138 MB/s 2024-04-25T09:06:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007016 s, 149 MB/s 2024-04-25T09:06:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718796 s, 146 MB/s 2024-04-25T09:06:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076464 s, 137 MB/s 2024-04-25T09:06:21.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684293 s, 153 MB/s 2024-04-25T09:06:21.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763625 s, 137 MB/s 2024-04-25T09:06:21.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810173 s, 129 MB/s 2024-04-25T09:06:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745842 s, 141 MB/s 2024-04-25T09:06:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077035 s, 136 MB/s 2024-04-25T09:06:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783603 s, 134 MB/s 2024-04-25T09:06:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668721 s, 157 MB/s 2024-04-25T09:06:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675514 s, 155 MB/s 2024-04-25T09:06:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784153 s, 134 MB/s 2024-04-25T09:06:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727276 s, 144 MB/s 2024-04-25T09:06:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765898 s, 137 MB/s 2024-04-25T09:06:21.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:21.570 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:21.571 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:21.571 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:06:21.571 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:21.571 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:21.571 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:21.571 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076888 s, 136 MB/s 2024-04-25T09:06:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749341 s, 140 MB/s 2024-04-25T09:06:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843792 s, 124 MB/s 2024-04-25T09:06:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077123 s, 136 MB/s 2024-04-25T09:06:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787829 s, 133 MB/s 2024-04-25T09:06:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772805 s, 136 MB/s 2024-04-25T09:06:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905291 s, 116 MB/s 2024-04-25T09:06:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715823 s, 146 MB/s 2024-04-25T09:06:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755402 s, 139 MB/s 2024-04-25T09:06:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732991 s, 143 MB/s 2024-04-25T09:06:21.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718722 s, 146 MB/s 2024-04-25T09:06:21.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751195 s, 140 MB/s 2024-04-25T09:06:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745779 s, 141 MB/s 2024-04-25T09:06:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701569 s, 149 MB/s 2024-04-25T09:06:21.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779089 s, 135 MB/s 2024-04-25T09:06:21.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666427 s, 157 MB/s 2024-04-25T09:06:21.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662661 s, 158 MB/s 2024-04-25T09:06:21.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762308 s, 138 MB/s 2024-04-25T09:06:21.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.788 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687792 s, 152 MB/s 2024-04-25T09:06:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750978 s, 140 MB/s 2024-04-25T09:06:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00814049 s, 129 MB/s 2024-04-25T09:06:21.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657888 s, 159 MB/s 2024-04-25T09:06:21.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668095 s, 157 MB/s 2024-04-25T09:06:21.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688527 s, 152 MB/s 2024-04-25T09:06:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729755 s, 144 MB/s 2024-04-25T09:06:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779222 s, 135 MB/s 2024-04-25T09:06:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668078 s, 157 MB/s 2024-04-25T09:06:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724232 s, 145 MB/s 2024-04-25T09:06:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676312 s, 155 MB/s 2024-04-25T09:06:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702102 s, 149 MB/s 2024-04-25T09:06:21.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639649 s, 164 MB/s 2024-04-25T09:06:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750151 s, 140 MB/s 2024-04-25T09:06:21.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:21.893 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:21.893 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:21.893 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:06:21.893 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:21.893 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:21.893 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:21.893 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896738 s, 117 MB/s 2024-04-25T09:06:21.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681218 s, 154 MB/s 2024-04-25T09:06:21.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672168 s, 156 MB/s 2024-04-25T09:06:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776151 s, 135 MB/s 2024-04-25T09:06:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696799 s, 150 MB/s 2024-04-25T09:06:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696004 s, 151 MB/s 2024-04-25T09:06:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703168 s, 149 MB/s 2024-04-25T09:06:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744534 s, 141 MB/s 2024-04-25T09:06:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669976 s, 157 MB/s 2024-04-25T09:06:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673285 s, 156 MB/s 2024-04-25T09:06:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767566 s, 137 MB/s 2024-04-25T09:06:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764914 s, 137 MB/s 2024-04-25T09:06:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747972 s, 140 MB/s 2024-04-25T09:06:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006529 s, 161 MB/s 2024-04-25T09:06:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743445 s, 141 MB/s 2024-04-25T09:06:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755869 s, 139 MB/s 2024-04-25T09:06:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735367 s, 143 MB/s 2024-04-25T09:06:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753156 s, 139 MB/s 2024-04-25T09:06:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720731 s, 145 MB/s 2024-04-25T09:06:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765937 s, 137 MB/s 2024-04-25T09:06:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733451 s, 143 MB/s 2024-04-25T09:06:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707796 s, 148 MB/s 2024-04-25T09:06:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650879 s, 161 MB/s 2024-04-25T09:06:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745899 s, 141 MB/s 2024-04-25T09:06:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768334 s, 136 MB/s 2024-04-25T09:06:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751969 s, 139 MB/s 2024-04-25T09:06:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075771 s, 138 MB/s 2024-04-25T09:06:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722354 s, 145 MB/s 2024-04-25T09:06:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716189 s, 146 MB/s 2024-04-25T09:06:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692083 s, 152 MB/s 2024-04-25T09:06:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751976 s, 139 MB/s 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706469 s, 148 MB/s 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:22.214 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:22.214 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:22.214 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:06:22.214 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:22.214 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:22.214 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:22.214 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683503 s, 153 MB/s 2024-04-25T09:06:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661463 s, 159 MB/s 2024-04-25T09:06:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074841 s, 140 MB/s 2024-04-25T09:06:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680775 s, 154 MB/s 2024-04-25T09:06:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710212 s, 148 MB/s 2024-04-25T09:06:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717332 s, 146 MB/s 2024-04-25T09:06:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755841 s, 139 MB/s 2024-04-25T09:06:22.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735314 s, 143 MB/s 2024-04-25T09:06:22.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708925 s, 148 MB/s 2024-04-25T09:06:22.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762166 s, 138 MB/s 2024-04-25T09:06:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693513 s, 151 MB/s 2024-04-25T09:06:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652172 s, 161 MB/s 2024-04-25T09:06:22.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.374 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676791 s, 155 MB/s 2024-04-25T09:06:22.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.382 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645611 s, 162 MB/s 2024-04-25T09:06:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713227 s, 147 MB/s 2024-04-25T09:06:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749272 s, 140 MB/s 2024-04-25T09:06:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843809 s, 124 MB/s 2024-04-25T09:06:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714103 s, 147 MB/s 2024-04-25T09:06:22.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696437 s, 151 MB/s 2024-04-25T09:06:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724567 s, 145 MB/s 2024-04-25T09:06:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760639 s, 138 MB/s 2024-04-25T09:06:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728318 s, 144 MB/s 2024-04-25T09:06:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822726 s, 127 MB/s 2024-04-25T09:06:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705477 s, 149 MB/s 2024-04-25T09:06:22.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641815 s, 163 MB/s 2024-04-25T09:06:22.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.481 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073808 s, 142 MB/s 2024-04-25T09:06:22.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076304 s, 137 MB/s 2024-04-25T09:06:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746678 s, 140 MB/s 2024-04-25T09:06:22.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738135 s, 142 MB/s 2024-04-25T09:06:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642114 s, 163 MB/s 2024-04-25T09:06:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612647 s, 171 MB/s 2024-04-25T09:06:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739099 s, 142 MB/s 2024-04-25T09:06:22.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:22.529 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:22.530 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:22.530 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:06:22.530 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:22.530 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:22.530 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:22.530 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684358 s, 153 MB/s 2024-04-25T09:06:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723056 s, 145 MB/s 2024-04-25T09:06:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682626 s, 154 MB/s 2024-04-25T09:06:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640009 s, 164 MB/s 2024-04-25T09:06:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738855 s, 142 MB/s 2024-04-25T09:06:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698542 s, 150 MB/s 2024-04-25T09:06:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715907 s, 146 MB/s 2024-04-25T09:06:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628497 s, 167 MB/s 2024-04-25T09:06:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722482 s, 145 MB/s 2024-04-25T09:06:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734516 s, 143 MB/s 2024-04-25T09:06:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749744 s, 140 MB/s 2024-04-25T09:06:22.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060811 s, 172 MB/s 2024-04-25T09:06:22.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720837 s, 145 MB/s 2024-04-25T09:06:22.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738171 s, 142 MB/s 2024-04-25T09:06:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642364 s, 163 MB/s 2024-04-25T09:06:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815462 s, 129 MB/s 2024-04-25T09:06:22.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636998 s, 165 MB/s 2024-04-25T09:06:22.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700262 s, 150 MB/s 2024-04-25T09:06:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072798 s, 144 MB/s 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735656 s, 143 MB/s 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675551 s, 155 MB/s 2024-04-25T09:06:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062227 s, 169 MB/s 2024-04-25T09:06:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687023 s, 153 MB/s 2024-04-25T09:06:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600734 s, 175 MB/s 2024-04-25T09:06:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640289 s, 164 MB/s 2024-04-25T09:06:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727382 s, 144 MB/s 2024-04-25T09:06:22.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738217 s, 142 MB/s 2024-04-25T09:06:22.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666255 s, 157 MB/s 2024-04-25T09:06:22.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730174 s, 144 MB/s 2024-04-25T09:06:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697039 s, 150 MB/s 2024-04-25T09:06:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621755 s, 169 MB/s 2024-04-25T09:06:22.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645454 s, 162 MB/s 2024-04-25T09:06:22.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:22.838 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:22.838 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:22.838 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:06:22.838 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:22.838 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:22.838 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:22.838 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747181 s, 140 MB/s 2024-04-25T09:06:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078517 s, 134 MB/s 2024-04-25T09:06:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639261 s, 164 MB/s 2024-04-25T09:06:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650366 s, 161 MB/s 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709283 s, 148 MB/s 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795817 s, 132 MB/s 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688686 s, 152 MB/s 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637969 s, 164 MB/s 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675109 s, 155 MB/s 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766303 s, 137 MB/s 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705768 s, 149 MB/s 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669477 s, 157 MB/s 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654575 s, 160 MB/s 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613362 s, 171 MB/s 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651675 s, 161 MB/s 2024-04-25T09:06:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688776 s, 152 MB/s 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661996 s, 158 MB/s 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631539 s, 166 MB/s 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075151 s, 140 MB/s 2024-04-25T09:06:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737859 s, 142 MB/s 2024-04-25T09:06:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665337 s, 158 MB/s 2024-04-25T09:06:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799182 s, 131 MB/s 2024-04-25T09:06:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674045 s, 156 MB/s 2024-04-25T09:06:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743752 s, 141 MB/s 2024-04-25T09:06:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747441 s, 140 MB/s 2024-04-25T09:06:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749522 s, 140 MB/s 2024-04-25T09:06:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673176 s, 156 MB/s 2024-04-25T09:06:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758254 s, 138 MB/s 2024-04-25T09:06:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734193 s, 143 MB/s 2024-04-25T09:06:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068015 s, 154 MB/s 2024-04-25T09:06:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717376 s, 146 MB/s 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632982 s, 166 MB/s 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:23.149 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:23.149 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:23.149 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:06:23.149 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:23.149 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:23.149 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:23.149 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:23.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632469 s, 166 MB/s 2024-04-25T09:06:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765682 s, 137 MB/s 2024-04-25T09:06:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757774 s, 138 MB/s 2024-04-25T09:06:23.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743738 s, 141 MB/s 2024-04-25T09:06:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763361 s, 137 MB/s 2024-04-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729926 s, 144 MB/s 2024-04-25T09:06:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658683 s, 159 MB/s 2024-04-25T09:06:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723982 s, 145 MB/s 2024-04-25T09:06:23.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717813 s, 146 MB/s 2024-04-25T09:06:23.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737924 s, 142 MB/s 2024-04-25T09:06:23.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725114 s, 145 MB/s 2024-04-25T09:06:23.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652562 s, 161 MB/s 2024-04-25T09:06:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737771 s, 142 MB/s 2024-04-25T09:06:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751294 s, 140 MB/s 2024-04-25T09:06:23.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737953 s, 142 MB/s 2024-04-25T09:06:23.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075484 s, 139 MB/s 2024-04-25T09:06:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693836 s, 151 MB/s 2024-04-25T09:06:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625116 s, 168 MB/s 2024-04-25T09:06:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072222 s, 145 MB/s 2024-04-25T09:06:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725082 s, 145 MB/s 2024-04-25T09:06:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631997 s, 166 MB/s 2024-04-25T09:06:23.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761431 s, 138 MB/s 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768351 s, 136 MB/s 2024-04-25T09:06:23.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749382 s, 140 MB/s 2024-04-25T09:06:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749403 s, 140 MB/s 2024-04-25T09:06:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714312 s, 147 MB/s 2024-04-25T09:06:23.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788492 s, 133 MB/s 2024-04-25T09:06:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754903 s, 139 MB/s 2024-04-25T09:06:23.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064945 s, 161 MB/s 2024-04-25T09:06:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648859 s, 162 MB/s 2024-04-25T09:06:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743552 s, 141 MB/s 2024-04-25T09:06:23.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699996 s, 150 MB/s 2024-04-25T09:06:23.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:23.466 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:23.466 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:23.466 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:06:23.466 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:23.466 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:23.466 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:23.466 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731108 s, 143 MB/s 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720729 s, 145 MB/s 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669957 s, 157 MB/s 2024-04-25T09:06:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901247 s, 116 MB/s 2024-04-25T09:06:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836549 s, 125 MB/s 2024-04-25T09:06:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718741 s, 146 MB/s 2024-04-25T09:06:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756186 s, 139 MB/s 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674819 s, 155 MB/s 2024-04-25T09:06:23.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666537 s, 157 MB/s 2024-04-25T09:06:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828663 s, 127 MB/s 2024-04-25T09:06:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626263 s, 167 MB/s 2024-04-25T09:06:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726686 s, 144 MB/s 2024-04-25T09:06:23.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665309 s, 158 MB/s 2024-04-25T09:06:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062916 s, 167 MB/s 2024-04-25T09:06:23.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734304 s, 143 MB/s 2024-04-25T09:06:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729293 s, 144 MB/s 2024-04-25T09:06:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715425 s, 147 MB/s 2024-04-25T09:06:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742431 s, 141 MB/s 2024-04-25T09:06:23.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.677 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646996 s, 162 MB/s 2024-04-25T09:06:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067351 s, 156 MB/s 2024-04-25T09:06:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697802 s, 150 MB/s 2024-04-25T09:06:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695594 s, 151 MB/s 2024-04-25T09:06:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745112 s, 141 MB/s 2024-04-25T09:06:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616908 s, 170 MB/s 2024-04-25T09:06:23.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708204 s, 148 MB/s 2024-04-25T09:06:23.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702909 s, 149 MB/s 2024-04-25T09:06:23.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655426 s, 160 MB/s 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725385 s, 145 MB/s 2024-04-25T09:06:23.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623083 s, 168 MB/s 2024-04-25T09:06:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719002 s, 146 MB/s 2024-04-25T09:06:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084867 s, 124 MB/s 2024-04-25T09:06:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748625 s, 140 MB/s 2024-04-25T09:06:23.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:23.781 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:23.781 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:23.781 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:06:23.781 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:23.781 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:23.781 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:23.781 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756293 s, 139 MB/s 2024-04-25T09:06:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007091 s, 148 MB/s 2024-04-25T09:06:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654504 s, 160 MB/s 2024-04-25T09:06:23.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789262 s, 133 MB/s 2024-04-25T09:06:23.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725618 s, 145 MB/s 2024-04-25T09:06:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714971 s, 147 MB/s 2024-04-25T09:06:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754207 s, 139 MB/s 2024-04-25T09:06:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708122 s, 148 MB/s 2024-04-25T09:06:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708458 s, 148 MB/s 2024-04-25T09:06:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734927 s, 143 MB/s 2024-04-25T09:06:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624997 s, 168 MB/s 2024-04-25T09:06:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662809 s, 158 MB/s 2024-04-25T09:06:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739123 s, 142 MB/s 2024-04-25T09:06:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756914 s, 139 MB/s 2024-04-25T09:06:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076158 s, 138 MB/s 2024-04-25T09:06:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679714 s, 154 MB/s 2024-04-25T09:06:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705688 s, 149 MB/s 2024-04-25T09:06:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830046 s, 126 MB/s 2024-04-25T09:06:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722961 s, 145 MB/s 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728377 s, 144 MB/s 2024-04-25T09:06:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718085 s, 146 MB/s 2024-04-25T09:06:24.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848112 s, 124 MB/s 2024-04-25T09:06:24.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699725 s, 150 MB/s 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745729 s, 141 MB/s 2024-04-25T09:06:24.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734702 s, 143 MB/s 2024-04-25T09:06:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702211 s, 149 MB/s 2024-04-25T09:06:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734839 s, 143 MB/s 2024-04-25T09:06:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797086 s, 132 MB/s 2024-04-25T09:06:24.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735409 s, 143 MB/s 2024-04-25T09:06:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767683 s, 137 MB/s 2024-04-25T09:06:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727581 s, 144 MB/s 2024-04-25T09:06:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617122 s, 170 MB/s 2024-04-25T09:06:24.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:24.101 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:24.101 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:06:24.101 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:24.101 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:24.101 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:24.101 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:24.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693619 s, 151 MB/s 2024-04-25T09:06:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073233 s, 143 MB/s 2024-04-25T09:06:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063145 s, 166 MB/s 2024-04-25T09:06:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712029 s, 147 MB/s 2024-04-25T09:06:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737917 s, 142 MB/s 2024-04-25T09:06:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657996 s, 159 MB/s 2024-04-25T09:06:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631669 s, 166 MB/s 2024-04-25T09:06:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712883 s, 147 MB/s 2024-04-25T09:06:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677953 s, 155 MB/s 2024-04-25T09:06:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063834 s, 164 MB/s 2024-04-25T09:06:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062163 s, 169 MB/s 2024-04-25T09:06:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721178 s, 145 MB/s 2024-04-25T09:06:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074437 s, 141 MB/s 2024-04-25T09:06:24.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693842 s, 151 MB/s 2024-04-25T09:06:24.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715018 s, 147 MB/s 2024-04-25T09:06:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733783 s, 143 MB/s 2024-04-25T09:06:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714773 s, 147 MB/s 2024-04-25T09:06:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732616 s, 143 MB/s 2024-04-25T09:06:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852075 s, 123 MB/s 2024-04-25T09:06:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677315 s, 155 MB/s 2024-04-25T09:06:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694754 s, 151 MB/s 2024-04-25T09:06:24.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751857 s, 139 MB/s 2024-04-25T09:06:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742959 s, 141 MB/s 2024-04-25T09:06:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724321 s, 145 MB/s 2024-04-25T09:06:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724812 s, 145 MB/s 2024-04-25T09:06:24.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646311 s, 162 MB/s 2024-04-25T09:06:24.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072117 s, 145 MB/s 2024-04-25T09:06:24.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749886 s, 140 MB/s 2024-04-25T09:06:24.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728021 s, 144 MB/s 2024-04-25T09:06:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767412 s, 137 MB/s 2024-04-25T09:06:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750006 s, 140 MB/s 2024-04-25T09:06:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640614 s, 164 MB/s 2024-04-25T09:06:24.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.415 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:24.418 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:24.418 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:06:24.418 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:24.418 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:24.418 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:24.418 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870022 s, 121 MB/s 2024-04-25T09:06:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734921 s, 143 MB/s 2024-04-25T09:06:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772643 s, 136 MB/s 2024-04-25T09:06:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777709 s, 135 MB/s 2024-04-25T09:06:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715862 s, 146 MB/s 2024-04-25T09:06:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674279 s, 156 MB/s 2024-04-25T09:06:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729826 s, 144 MB/s 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658125 s, 159 MB/s 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659787 s, 159 MB/s 2024-04-25T09:06:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746073 s, 141 MB/s 2024-04-25T09:06:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668128 s, 157 MB/s 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722835 s, 145 MB/s 2024-04-25T09:06:24.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757763 s, 138 MB/s 2024-04-25T09:06:24.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836074 s, 125 MB/s 2024-04-25T09:06:24.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729237 s, 144 MB/s 2024-04-25T09:06:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840683 s, 125 MB/s 2024-04-25T09:06:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673686 s, 156 MB/s 2024-04-25T09:06:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751639 s, 140 MB/s 2024-04-25T09:06:24.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732031 s, 143 MB/s 2024-04-25T09:06:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739678 s, 142 MB/s 2024-04-25T09:06:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869354 s, 121 MB/s 2024-04-25T09:06:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644414 s, 163 MB/s 2024-04-25T09:06:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080015 s, 131 MB/s 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729273 s, 144 MB/s 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630516 s, 166 MB/s 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728249 s, 144 MB/s 2024-04-25T09:06:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739727 s, 142 MB/s 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072129 s, 145 MB/s 2024-04-25T09:06:24.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077173 s, 136 MB/s 2024-04-25T09:06:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735982 s, 142 MB/s 2024-04-25T09:06:24.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.731 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765901 s, 137 MB/s 2024-04-25T09:06:24.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638948 s, 164 MB/s 2024-04-25T09:06:24.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.739 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:24.740 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:24.740 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:06:24.740 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:24.740 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:24.740 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:24.740 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809162 s, 130 MB/s 2024-04-25T09:06:24.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754499 s, 139 MB/s 2024-04-25T09:06:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726531 s, 144 MB/s 2024-04-25T09:06:24.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869456 s, 121 MB/s 2024-04-25T09:06:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713841 s, 147 MB/s 2024-04-25T09:06:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764697 s, 137 MB/s 2024-04-25T09:06:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075715 s, 138 MB/s 2024-04-25T09:06:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707979 s, 148 MB/s 2024-04-25T09:06:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745598 s, 141 MB/s 2024-04-25T09:06:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764643 s, 137 MB/s 2024-04-25T09:06:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673409 s, 156 MB/s 2024-04-25T09:06:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723398 s, 145 MB/s 2024-04-25T09:06:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730638 s, 144 MB/s 2024-04-25T09:06:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00811002 s, 129 MB/s 2024-04-25T09:06:24.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081046 s, 129 MB/s 2024-04-25T09:06:24.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072592 s, 144 MB/s 2024-04-25T09:06:24.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.939 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646459 s, 162 MB/s 2024-04-25T09:06:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640444 s, 164 MB/s 2024-04-25T09:06:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071781 s, 146 MB/s 2024-04-25T09:06:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729843 s, 144 MB/s 2024-04-25T09:06:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707853 s, 148 MB/s 2024-04-25T09:06:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669554 s, 157 MB/s 2024-04-25T09:06:24.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070656 s, 148 MB/s 2024-04-25T09:06:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745504 s, 141 MB/s 2024-04-25T09:06:25.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759114 s, 138 MB/s 2024-04-25T09:06:25.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687425 s, 153 MB/s 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789496 s, 133 MB/s 2024-04-25T09:06:25.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074953 s, 140 MB/s 2024-04-25T09:06:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753282 s, 139 MB/s 2024-04-25T09:06:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731315 s, 143 MB/s 2024-04-25T09:06:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675464 s, 155 MB/s 2024-04-25T09:06:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752123 s, 139 MB/s 2024-04-25T09:06:25.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:25.061 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:25.062 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:25.062 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:06:25.062 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:25.062 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:25.062 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:25.062 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699259 s, 150 MB/s 2024-04-25T09:06:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854258 s, 123 MB/s 2024-04-25T09:06:25.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660188 s, 159 MB/s 2024-04-25T09:06:25.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750668 s, 140 MB/s 2024-04-25T09:06:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723599 s, 145 MB/s 2024-04-25T09:06:25.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.168 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071017 s, 148 MB/s 2024-04-25T09:06:25.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075626 s, 139 MB/s 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758077 s, 138 MB/s 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707111 s, 148 MB/s 2024-04-25T09:06:25.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743371 s, 141 MB/s 2024-04-25T09:06:25.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697261 s, 150 MB/s 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776023 s, 135 MB/s 2024-04-25T09:06:25.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651314 s, 161 MB/s 2024-04-25T09:06:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646991 s, 162 MB/s 2024-04-25T09:06:25.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.241 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707054 s, 148 MB/s 2024-04-25T09:06:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697 s, 150 MB/s 2024-04-25T09:06:25.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636742 s, 165 MB/s 2024-04-25T09:06:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701531 s, 149 MB/s 2024-04-25T09:06:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687275 s, 153 MB/s 2024-04-25T09:06:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780017 s, 134 MB/s 2024-04-25T09:06:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728046 s, 144 MB/s 2024-04-25T09:06:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073047 s, 144 MB/s 2024-04-25T09:06:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710561 s, 148 MB/s 2024-04-25T09:06:25.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718637 s, 146 MB/s 2024-04-25T09:06:25.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707104 s, 148 MB/s 2024-04-25T09:06:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705431 s, 149 MB/s 2024-04-25T09:06:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740861 s, 142 MB/s 2024-04-25T09:06:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742894 s, 141 MB/s 2024-04-25T09:06:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722722 s, 145 MB/s 2024-04-25T09:06:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649247 s, 162 MB/s 2024-04-25T09:06:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721292 s, 145 MB/s 2024-04-25T09:06:25.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.377 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700349 s, 150 MB/s 2024-04-25T09:06:25.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:25.378 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:25.378 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:25.378 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:06:25.378 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:25.378 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:25.378 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:25.378 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:25.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647585 s, 162 MB/s 2024-04-25T09:06:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006338 s, 165 MB/s 2024-04-25T09:06:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667773 s, 157 MB/s 2024-04-25T09:06:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693101 s, 151 MB/s 2024-04-25T09:06:25.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657745 s, 159 MB/s 2024-04-25T09:06:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704116 s, 149 MB/s 2024-04-25T09:06:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744447 s, 141 MB/s 2024-04-25T09:06:25.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662611 s, 158 MB/s 2024-04-25T09:06:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709644 s, 148 MB/s 2024-04-25T09:06:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720311 s, 146 MB/s 2024-04-25T09:06:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634904 s, 165 MB/s 2024-04-25T09:06:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735087 s, 143 MB/s 2024-04-25T09:06:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646207 s, 162 MB/s 2024-04-25T09:06:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649606 s, 161 MB/s 2024-04-25T09:06:25.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737642 s, 142 MB/s 2024-04-25T09:06:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071916 s, 146 MB/s 2024-04-25T09:06:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675928 s, 155 MB/s 2024-04-25T09:06:25.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712744 s, 147 MB/s 2024-04-25T09:06:25.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.585 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772049 s, 136 MB/s 2024-04-25T09:06:25.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757398 s, 138 MB/s 2024-04-25T09:06:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072153 s, 145 MB/s 2024-04-25T09:06:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837849 s, 125 MB/s 2024-04-25T09:06:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712399 s, 147 MB/s 2024-04-25T09:06:25.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061142 s, 171 MB/s 2024-04-25T09:06:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073199 s, 143 MB/s 2024-04-25T09:06:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739435 s, 142 MB/s 2024-04-25T09:06:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745729 s, 141 MB/s 2024-04-25T09:06:25.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636428 s, 165 MB/s 2024-04-25T09:06:25.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647322 s, 162 MB/s 2024-04-25T09:06:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766329 s, 137 MB/s 2024-04-25T09:06:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705106 s, 149 MB/s 2024-04-25T09:06:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603135 s, 174 MB/s 2024-04-25T09:06:25.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:25.689 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:25.689 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:25.689 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:06:25.689 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:25.689 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:25.689 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:25.689 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754171 s, 139 MB/s 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694172 s, 151 MB/s 2024-04-25T09:06:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062668 s, 167 MB/s 2024-04-25T09:06:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773278 s, 136 MB/s 2024-04-25T09:06:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735571 s, 143 MB/s 2024-04-25T09:06:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676935 s, 155 MB/s 2024-04-25T09:06:25.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629072 s, 167 MB/s 2024-04-25T09:06:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743291 s, 141 MB/s 2024-04-25T09:06:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720371 s, 146 MB/s 2024-04-25T09:06:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737284 s, 142 MB/s 2024-04-25T09:06:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737207 s, 142 MB/s 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763811 s, 137 MB/s 2024-04-25T09:06:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734004 s, 143 MB/s 2024-04-25T09:06:25.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071665 s, 146 MB/s 2024-04-25T09:06:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647428 s, 162 MB/s 2024-04-25T09:06:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688661 s, 152 MB/s 2024-04-25T09:06:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631669 s, 166 MB/s 2024-04-25T09:06:25.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.890 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745097 s, 141 MB/s 2024-04-25T09:06:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691545 s, 152 MB/s 2024-04-25T09:06:25.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.906 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742423 s, 141 MB/s 2024-04-25T09:06:25.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705386 s, 149 MB/s 2024-04-25T09:06:25.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705609 s, 149 MB/s 2024-04-25T09:06:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755059 s, 139 MB/s 2024-04-25T09:06:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757225 s, 138 MB/s 2024-04-25T09:06:25.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.947 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688493 s, 152 MB/s 2024-04-25T09:06:25.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.955 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687089 s, 153 MB/s 2024-04-25T09:06:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658638 s, 159 MB/s 2024-04-25T09:06:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745763 s, 141 MB/s 2024-04-25T09:06:25.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708203 s, 148 MB/s 2024-04-25T09:06:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727345 s, 144 MB/s 2024-04-25T09:06:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706137 s, 148 MB/s 2024-04-25T09:06:26.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695129 s, 151 MB/s 2024-04-25T09:06:26.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:26.003 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:26.003 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:26.004 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:06:26.004 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:26.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:26.004 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:26.004 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:26.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751747 s, 139 MB/s 2024-04-25T09:06:26.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656 s, 160 MB/s 2024-04-25T09:06:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638269 s, 164 MB/s 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736895 s, 142 MB/s 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891147 s, 118 MB/s 2024-04-25T09:06:26.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643192 s, 163 MB/s 2024-04-25T09:06:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625838 s, 168 MB/s 2024-04-25T09:06:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709068 s, 148 MB/s 2024-04-25T09:06:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747086 s, 140 MB/s 2024-04-25T09:06:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719532 s, 146 MB/s 2024-04-25T09:06:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663105 s, 158 MB/s 2024-04-25T09:06:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787198 s, 133 MB/s 2024-04-25T09:06:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663314 s, 158 MB/s 2024-04-25T09:06:26.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.173 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746852 s, 140 MB/s 2024-04-25T09:06:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739896 s, 142 MB/s 2024-04-25T09:06:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675146 s, 155 MB/s 2024-04-25T09:06:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660594 s, 159 MB/s 2024-04-25T09:06:26.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069756 s, 150 MB/s 2024-04-25T09:06:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704301 s, 149 MB/s 2024-04-25T09:06:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729222 s, 144 MB/s 2024-04-25T09:06:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731603 s, 143 MB/s 2024-04-25T09:06:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720381 s, 146 MB/s 2024-04-25T09:06:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677035 s, 155 MB/s 2024-04-25T09:06:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710358 s, 148 MB/s 2024-04-25T09:06:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743232 s, 141 MB/s 2024-04-25T09:06:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763667 s, 137 MB/s 2024-04-25T09:06:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752452 s, 139 MB/s 2024-04-25T09:06:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742165 s, 141 MB/s 2024-04-25T09:06:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722977 s, 145 MB/s 2024-04-25T09:06:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704798 s, 149 MB/s 2024-04-25T09:06:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644849 s, 163 MB/s 2024-04-25T09:06:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771542 s, 136 MB/s 2024-04-25T09:06:26.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:26.320 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:26.320 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:26.320 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:06:26.320 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:26.320 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:26.320 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:26.321 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636499 s, 165 MB/s 2024-04-25T09:06:26.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660399 s, 159 MB/s 2024-04-25T09:06:26.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760332 s, 138 MB/s 2024-04-25T09:06:26.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752672 s, 139 MB/s 2024-04-25T09:06:26.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075398 s, 139 MB/s 2024-04-25T09:06:26.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642809 s, 163 MB/s 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767343 s, 137 MB/s 2024-04-25T09:06:26.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071887 s, 146 MB/s 2024-04-25T09:06:26.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746881 s, 140 MB/s 2024-04-25T09:06:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733105 s, 143 MB/s 2024-04-25T09:06:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675367 s, 155 MB/s 2024-04-25T09:06:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691365 s, 152 MB/s 2024-04-25T09:06:26.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728641 s, 144 MB/s 2024-04-25T09:06:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725629 s, 145 MB/s 2024-04-25T09:06:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706966 s, 148 MB/s 2024-04-25T09:06:26.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713695 s, 147 MB/s 2024-04-25T09:06:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685478 s, 153 MB/s 2024-04-25T09:06:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741759 s, 141 MB/s 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068978 s, 152 MB/s 2024-04-25T09:06:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755475 s, 139 MB/s 2024-04-25T09:06:26.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764514 s, 137 MB/s 2024-04-25T09:06:26.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072233 s, 145 MB/s 2024-04-25T09:06:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697172 s, 150 MB/s 2024-04-25T09:06:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787472 s, 133 MB/s 2024-04-25T09:06:26.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668729 s, 157 MB/s 2024-04-25T09:06:26.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650129 s, 161 MB/s 2024-04-25T09:06:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.595 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719826 s, 146 MB/s 2024-04-25T09:06:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166437 s, 63.0 MB/s 2024-04-25T09:06:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716149 s, 146 MB/s 2024-04-25T09:06:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639572 s, 164 MB/s 2024-04-25T09:06:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743358 s, 141 MB/s 2024-04-25T09:06:26.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708523 s, 148 MB/s 2024-04-25T09:06:26.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:26.645 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:26.645 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:26.645 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:06:26.646 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:26.646 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:26.646 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:26.646 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070939 s, 148 MB/s 2024-04-25T09:06:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753243 s, 139 MB/s 2024-04-25T09:06:26.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692754 s, 151 MB/s 2024-04-25T09:06:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756472 s, 139 MB/s 2024-04-25T09:06:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732273 s, 143 MB/s 2024-04-25T09:06:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861574 s, 122 MB/s 2024-04-25T09:06:26.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684071 s, 153 MB/s 2024-04-25T09:06:26.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685008 s, 153 MB/s 2024-04-25T09:06:26.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688381 s, 152 MB/s 2024-04-25T09:06:26.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668565 s, 157 MB/s 2024-04-25T09:06:26.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622396 s, 168 MB/s 2024-04-25T09:06:26.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658744 s, 159 MB/s 2024-04-25T09:06:26.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665688 s, 158 MB/s 2024-04-25T09:06:26.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748607 s, 140 MB/s 2024-04-25T09:06:26.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072072 s, 145 MB/s 2024-04-25T09:06:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728199 s, 144 MB/s 2024-04-25T09:06:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679327 s, 154 MB/s 2024-04-25T09:06:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763637 s, 137 MB/s 2024-04-25T09:06:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656055 s, 160 MB/s 2024-04-25T09:06:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071782 s, 146 MB/s 2024-04-25T09:06:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745276 s, 141 MB/s 2024-04-25T09:06:26.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657134 s, 160 MB/s 2024-04-25T09:06:26.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822741 s, 127 MB/s 2024-04-25T09:06:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686271 s, 153 MB/s 2024-04-25T09:06:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747489 s, 140 MB/s 2024-04-25T09:06:26.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735386 s, 143 MB/s 2024-04-25T09:06:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788399 s, 133 MB/s 2024-04-25T09:06:26.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.929 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653175 s, 161 MB/s 2024-04-25T09:06:26.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739632 s, 142 MB/s 2024-04-25T09:06:26.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633462 s, 166 MB/s 2024-04-25T09:06:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743861 s, 141 MB/s 2024-04-25T09:06:26.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:26.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683091 s, 154 MB/s 2024-04-25T09:06:26.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:26.962 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:26.962 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:26.962 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:06:26.962 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:26.962 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:26.962 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:26.962 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631439 s, 166 MB/s 2024-04-25T09:06:27.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698704 s, 150 MB/s 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745935 s, 141 MB/s 2024-04-25T09:06:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065639 s, 160 MB/s 2024-04-25T09:06:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702071 s, 149 MB/s 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730455 s, 144 MB/s 2024-04-25T09:06:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659137 s, 159 MB/s 2024-04-25T09:06:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716065 s, 146 MB/s 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659782 s, 159 MB/s 2024-04-25T09:06:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610102 s, 172 MB/s 2024-04-25T09:06:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718601 s, 146 MB/s 2024-04-25T09:06:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631149 s, 166 MB/s 2024-04-25T09:06:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760364 s, 138 MB/s 2024-04-25T09:06:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718617 s, 146 MB/s 2024-04-25T09:06:27.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653187 s, 161 MB/s 2024-04-25T09:06:27.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720781 s, 145 MB/s 2024-04-25T09:06:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733399 s, 143 MB/s 2024-04-25T09:06:27.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759275 s, 138 MB/s 2024-04-25T09:06:27.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.167 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649798 s, 161 MB/s 2024-04-25T09:06:27.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075747 s, 138 MB/s 2024-04-25T09:06:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.184 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756503 s, 139 MB/s 2024-04-25T09:06:27.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645338 s, 162 MB/s 2024-04-25T09:06:27.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076279 s, 137 MB/s 2024-04-25T09:06:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647794 s, 162 MB/s 2024-04-25T09:06:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721313 s, 145 MB/s 2024-04-25T09:06:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731526 s, 143 MB/s 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716177 s, 146 MB/s 2024-04-25T09:06:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796394 s, 132 MB/s 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737459 s, 142 MB/s 2024-04-25T09:06:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728661 s, 144 MB/s 2024-04-25T09:06:27.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697723 s, 150 MB/s 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651725 s, 161 MB/s 2024-04-25T09:06:27.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:27.273 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:27.273 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:27.273 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:06:27.273 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:27.274 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:27.274 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:27.274 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623384 s, 168 MB/s 2024-04-25T09:06:27.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739216 s, 142 MB/s 2024-04-25T09:06:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783757 s, 134 MB/s 2024-04-25T09:06:27.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727906 s, 144 MB/s 2024-04-25T09:06:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651835 s, 161 MB/s 2024-04-25T09:06:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065289 s, 161 MB/s 2024-04-25T09:06:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700233 s, 150 MB/s 2024-04-25T09:06:27.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641264 s, 164 MB/s 2024-04-25T09:06:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748278 s, 140 MB/s 2024-04-25T09:06:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713663 s, 147 MB/s 2024-04-25T09:06:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074657 s, 140 MB/s 2024-04-25T09:06:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629894 s, 166 MB/s 2024-04-25T09:06:27.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797982 s, 131 MB/s 2024-04-25T09:06:27.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713824 s, 147 MB/s 2024-04-25T09:06:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843744 s, 124 MB/s 2024-04-25T09:06:27.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723847 s, 145 MB/s 2024-04-25T09:06:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659234 s, 159 MB/s 2024-04-25T09:06:27.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.475 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738486 s, 142 MB/s 2024-04-25T09:06:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798944 s, 131 MB/s 2024-04-25T09:06:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747988 s, 140 MB/s 2024-04-25T09:06:27.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729797 s, 144 MB/s 2024-04-25T09:06:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652477 s, 161 MB/s 2024-04-25T09:06:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764925 s, 137 MB/s 2024-04-25T09:06:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721928 s, 145 MB/s 2024-04-25T09:06:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662961 s, 158 MB/s 2024-04-25T09:06:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730066 s, 144 MB/s 2024-04-25T09:06:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724777 s, 145 MB/s 2024-04-25T09:06:27.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742378 s, 141 MB/s 2024-04-25T09:06:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613625 s, 171 MB/s 2024-04-25T09:06:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693551 s, 151 MB/s 2024-04-25T09:06:27.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.579 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.579 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700437 s, 150 MB/s 2024-04-25T09:06:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760628 s, 138 MB/s 2024-04-25T09:06:27.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:27.589 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:27.589 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:27.589 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:06:27.589 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:27.589 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:27.590 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:27.590 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756589 s, 139 MB/s 2024-04-25T09:06:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674771 s, 155 MB/s 2024-04-25T09:06:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657062 s, 160 MB/s 2024-04-25T09:06:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726215 s, 144 MB/s 2024-04-25T09:06:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079877 s, 131 MB/s 2024-04-25T09:06:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739339 s, 142 MB/s 2024-04-25T09:06:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834357 s, 126 MB/s 2024-04-25T09:06:27.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744016 s, 141 MB/s 2024-04-25T09:06:27.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078308 s, 134 MB/s 2024-04-25T09:06:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749422 s, 140 MB/s 2024-04-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698089 s, 150 MB/s 2024-04-25T09:06:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072306 s, 145 MB/s 2024-04-25T09:06:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738032 s, 142 MB/s 2024-04-25T09:06:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783413 s, 134 MB/s 2024-04-25T09:06:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066979 s, 157 MB/s 2024-04-25T09:06:27.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725493 s, 145 MB/s 2024-04-25T09:06:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709826 s, 148 MB/s 2024-04-25T09:06:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742874 s, 141 MB/s 2024-04-25T09:06:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645694 s, 162 MB/s 2024-04-25T09:06:27.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730842 s, 143 MB/s 2024-04-25T09:06:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703478 s, 149 MB/s 2024-04-25T09:06:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714979 s, 147 MB/s 2024-04-25T09:06:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750177 s, 140 MB/s 2024-04-25T09:06:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770489 s, 136 MB/s 2024-04-25T09:06:27.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736666 s, 142 MB/s 2024-04-25T09:06:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697866 s, 150 MB/s 2024-04-25T09:06:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636125 s, 165 MB/s 2024-04-25T09:06:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718383 s, 146 MB/s 2024-04-25T09:06:27.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725927 s, 144 MB/s 2024-04-25T09:06:27.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640377 s, 164 MB/s 2024-04-25T09:06:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682707 s, 154 MB/s 2024-04-25T09:06:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614383 s, 171 MB/s 2024-04-25T09:06:27.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:27.906 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:27.906 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:27.906 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:06:27.906 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:27.906 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:27.906 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:27.906 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:27.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745865 s, 141 MB/s 2024-04-25T09:06:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007878 s, 133 MB/s 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649836 s, 161 MB/s 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728932 s, 144 MB/s 2024-04-25T09:06:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737607 s, 142 MB/s 2024-04-25T09:06:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679682 s, 154 MB/s 2024-04-25T09:06:28.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670882 s, 156 MB/s 2024-04-25T09:06:28.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646169 s, 162 MB/s 2024-04-25T09:06:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733556 s, 143 MB/s 2024-04-25T09:06:28.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751422 s, 140 MB/s 2024-04-25T09:06:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627794 s, 167 MB/s 2024-04-25T09:06:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726928 s, 144 MB/s 2024-04-25T09:06:28.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693554 s, 151 MB/s 2024-04-25T09:06:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763876 s, 137 MB/s 2024-04-25T09:06:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780566 s, 134 MB/s 2024-04-25T09:06:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754238 s, 139 MB/s 2024-04-25T09:06:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735044 s, 143 MB/s 2024-04-25T09:06:28.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725861 s, 144 MB/s 2024-04-25T09:06:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763966 s, 137 MB/s 2024-04-25T09:06:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697916 s, 150 MB/s 2024-04-25T09:06:28.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702972 s, 149 MB/s 2024-04-25T09:06:28.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779369 s, 135 MB/s 2024-04-25T09:06:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670711 s, 156 MB/s 2024-04-25T09:06:28.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761563 s, 138 MB/s 2024-04-25T09:06:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659949 s, 159 MB/s 2024-04-25T09:06:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731295 s, 143 MB/s 2024-04-25T09:06:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724171 s, 145 MB/s 2024-04-25T09:06:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647422 s, 162 MB/s 2024-04-25T09:06:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745343 s, 141 MB/s 2024-04-25T09:06:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662851 s, 158 MB/s 2024-04-25T09:06:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730096 s, 144 MB/s 2024-04-25T09:06:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739581 s, 142 MB/s 2024-04-25T09:06:28.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:28.223 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:28.223 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:28.223 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:06:28.224 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:28.224 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:28.224 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:28.224 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650814 s, 161 MB/s 2024-04-25T09:06:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632335 s, 166 MB/s 2024-04-25T09:06:28.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635721 s, 165 MB/s 2024-04-25T09:06:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064517 s, 163 MB/s 2024-04-25T09:06:28.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841822 s, 125 MB/s 2024-04-25T09:06:28.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.326 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718085 s, 146 MB/s 2024-04-25T09:06:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680012 s, 154 MB/s 2024-04-25T09:06:28.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.342 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679603 s, 154 MB/s 2024-04-25T09:06:28.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063555 s, 165 MB/s 2024-04-25T09:06:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781747 s, 134 MB/s 2024-04-25T09:06:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703867 s, 149 MB/s 2024-04-25T09:06:28.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.374 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717027 s, 146 MB/s 2024-04-25T09:06:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693617 s, 151 MB/s 2024-04-25T09:06:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746203 s, 141 MB/s 2024-04-25T09:06:28.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073642 s, 142 MB/s 2024-04-25T09:06:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647115 s, 162 MB/s 2024-04-25T09:06:28.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620585 s, 169 MB/s 2024-04-25T09:06:28.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076241 s, 138 MB/s 2024-04-25T09:06:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701332 s, 150 MB/s 2024-04-25T09:06:28.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736933 s, 142 MB/s 2024-04-25T09:06:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634402 s, 165 MB/s 2024-04-25T09:06:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760999 s, 138 MB/s 2024-04-25T09:06:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626895 s, 167 MB/s 2024-04-25T09:06:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076481 s, 137 MB/s 2024-04-25T09:06:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644772 s, 163 MB/s 2024-04-25T09:06:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860474 s, 122 MB/s 2024-04-25T09:06:28.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737628 s, 142 MB/s 2024-04-25T09:06:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651099 s, 161 MB/s 2024-04-25T09:06:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725712 s, 144 MB/s 2024-04-25T09:06:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790757 s, 133 MB/s 2024-04-25T09:06:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747449 s, 140 MB/s 2024-04-25T09:06:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694179 s, 151 MB/s 2024-04-25T09:06:28.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:28.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:28.535 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:28.535 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:06:28.535 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:28.535 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:28.535 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:28.535 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725541 s, 145 MB/s 2024-04-25T09:06:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745092 s, 141 MB/s 2024-04-25T09:06:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847188 s, 124 MB/s 2024-04-25T09:06:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726902 s, 144 MB/s 2024-04-25T09:06:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694931 s, 151 MB/s 2024-04-25T09:06:28.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723918 s, 145 MB/s 2024-04-25T09:06:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727149 s, 144 MB/s 2024-04-25T09:06:28.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736655 s, 142 MB/s 2024-04-25T09:06:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637785 s, 164 MB/s 2024-04-25T09:06:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673513 s, 156 MB/s 2024-04-25T09:06:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751238 s, 140 MB/s 2024-04-25T09:06:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678308 s, 155 MB/s 2024-04-25T09:06:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780627 s, 134 MB/s 2024-04-25T09:06:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760015 s, 138 MB/s 2024-04-25T09:06:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073707 s, 142 MB/s 2024-04-25T09:06:28.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698168 s, 150 MB/s 2024-04-25T09:06:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732553 s, 143 MB/s 2024-04-25T09:06:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652397 s, 161 MB/s 2024-04-25T09:06:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076527 s, 137 MB/s 2024-04-25T09:06:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744438 s, 141 MB/s 2024-04-25T09:06:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777215 s, 135 MB/s 2024-04-25T09:06:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072192 s, 145 MB/s 2024-04-25T09:06:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064856 s, 162 MB/s 2024-04-25T09:06:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673989 s, 156 MB/s 2024-04-25T09:06:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714695 s, 147 MB/s 2024-04-25T09:06:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730083 s, 144 MB/s 2024-04-25T09:06:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:28.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:28.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735492 s, 143 MB/s 2024-04-25T09:06:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.797542 s, 1.3 MB/s 2024-04-25T09:06:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771013 s, 136 MB/s 2024-04-25T09:06:29.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0082758 s, 127 MB/s 2024-04-25T09:06:29.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.638 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839126 s, 125 MB/s 2024-04-25T09:06:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100828 s, 104 MB/s 2024-04-25T09:06:29.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:29.651 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:29.651 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:29.651 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:06:29.651 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:29.651 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:29.651 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:29.651 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:29.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745867 s, 141 MB/s 2024-04-25T09:06:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822254 s, 128 MB/s 2024-04-25T09:06:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751786 s, 139 MB/s 2024-04-25T09:06:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668091 s, 157 MB/s 2024-04-25T09:06:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080619 s, 130 MB/s 2024-04-25T09:06:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072272 s, 145 MB/s 2024-04-25T09:06:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808755 s, 130 MB/s 2024-04-25T09:06:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741553 s, 141 MB/s 2024-04-25T09:06:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071173 s, 147 MB/s 2024-04-25T09:06:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713923 s, 147 MB/s 2024-04-25T09:06:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720897 s, 145 MB/s 2024-04-25T09:06:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757667 s, 138 MB/s 2024-04-25T09:06:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700629 s, 150 MB/s 2024-04-25T09:06:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779039 s, 135 MB/s 2024-04-25T09:06:29.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715063 s, 147 MB/s 2024-04-25T09:06:29.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698588 s, 150 MB/s 2024-04-25T09:06:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828171 s, 127 MB/s 2024-04-25T09:06:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758189 s, 138 MB/s 2024-04-25T09:06:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740774 s, 142 MB/s 2024-04-25T09:06:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685671 s, 153 MB/s 2024-04-25T09:06:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766196 s, 137 MB/s 2024-04-25T09:06:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666939 s, 157 MB/s 2024-04-25T09:06:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744595 s, 141 MB/s 2024-04-25T09:06:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718322 s, 146 MB/s 2024-04-25T09:06:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662039 s, 158 MB/s 2024-04-25T09:06:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068438 s, 153 MB/s 2024-04-25T09:06:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787539 s, 133 MB/s 2024-04-25T09:06:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771426 s, 136 MB/s 2024-04-25T09:06:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660374 s, 159 MB/s 2024-04-25T09:06:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668041 s, 157 MB/s 2024-04-25T09:06:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685302 s, 153 MB/s 2024-04-25T09:06:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736109 s, 142 MB/s 2024-04-25T09:06:29.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:29.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:29.973 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:29.973 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:06:29.973 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:29.973 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:29.973 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:29.973 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759592 s, 138 MB/s 2024-04-25T09:06:30.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759086 s, 138 MB/s 2024-04-25T09:06:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783914 s, 134 MB/s 2024-04-25T09:06:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713085 s, 147 MB/s 2024-04-25T09:06:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719609 s, 146 MB/s 2024-04-25T09:06:30.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804621 s, 130 MB/s 2024-04-25T09:06:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737514 s, 142 MB/s 2024-04-25T09:06:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778651 s, 135 MB/s 2024-04-25T09:06:30.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.108 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748885 s, 140 MB/s 2024-04-25T09:06:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675548 s, 155 MB/s 2024-04-25T09:06:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692509 s, 151 MB/s 2024-04-25T09:06:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790811 s, 133 MB/s 2024-04-25T09:06:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670426 s, 156 MB/s 2024-04-25T09:06:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785609 s, 133 MB/s 2024-04-25T09:06:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785727 s, 133 MB/s 2024-04-25T09:06:30.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724315 s, 145 MB/s 2024-04-25T09:06:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075445 s, 139 MB/s 2024-04-25T09:06:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774858 s, 135 MB/s 2024-04-25T09:06:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071304 s, 147 MB/s 2024-04-25T09:06:30.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719475 s, 146 MB/s 2024-04-25T09:06:30.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674053 s, 156 MB/s 2024-04-25T09:06:30.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671228 s, 156 MB/s 2024-04-25T09:06:30.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717125 s, 146 MB/s 2024-04-25T09:06:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805728 s, 130 MB/s 2024-04-25T09:06:30.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074104 s, 142 MB/s 2024-04-25T09:06:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715145 s, 147 MB/s 2024-04-25T09:06:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754187 s, 139 MB/s 2024-04-25T09:06:30.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651939 s, 161 MB/s 2024-04-25T09:06:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753512 s, 139 MB/s 2024-04-25T09:06:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748562 s, 140 MB/s 2024-04-25T09:06:30.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752326 s, 139 MB/s 2024-04-25T09:06:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751103 s, 140 MB/s 2024-04-25T09:06:30.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:30.297 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:30.297 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:30.297 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:06:30.298 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:30.298 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:30.298 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:30.298 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:30.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765798 s, 137 MB/s 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698531 s, 150 MB/s 2024-04-25T09:06:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731122 s, 143 MB/s 2024-04-25T09:06:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783491 s, 134 MB/s 2024-04-25T09:06:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682058 s, 154 MB/s 2024-04-25T09:06:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771566 s, 136 MB/s 2024-04-25T09:06:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106222 s, 98.7 MB/s 2024-04-25T09:06:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785289 s, 134 MB/s 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087627 s, 120 MB/s 2024-04-25T09:06:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781483 s, 134 MB/s 2024-04-25T09:06:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748274 s, 140 MB/s 2024-04-25T09:06:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750594 s, 140 MB/s 2024-04-25T09:06:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640817 s, 164 MB/s 2024-04-25T09:06:30.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771186 s, 136 MB/s 2024-04-25T09:06:30.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662376 s, 158 MB/s 2024-04-25T09:06:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751594 s, 140 MB/s 2024-04-25T09:06:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078308 s, 134 MB/s 2024-04-25T09:06:30.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839732 s, 125 MB/s 2024-04-25T09:06:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719787 s, 146 MB/s 2024-04-25T09:06:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071389 s, 147 MB/s 2024-04-25T09:06:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721617 s, 145 MB/s 2024-04-25T09:06:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738686 s, 142 MB/s 2024-04-25T09:06:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754373 s, 139 MB/s 2024-04-25T09:06:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627547 s, 167 MB/s 2024-04-25T09:06:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730252 s, 144 MB/s 2024-04-25T09:06:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756244 s, 139 MB/s 2024-04-25T09:06:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671652 s, 156 MB/s 2024-04-25T09:06:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650084 s, 161 MB/s 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662795 s, 158 MB/s 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626181 s, 167 MB/s 2024-04-25T09:06:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732898 s, 143 MB/s 2024-04-25T09:06:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743435 s, 141 MB/s 2024-04-25T09:06:30.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:30.623 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:30.623 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:30.623 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:06:30.624 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:30.624 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:30.624 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:30.624 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:30.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705961 s, 149 MB/s 2024-04-25T09:06:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759443 s, 138 MB/s 2024-04-25T09:06:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734467 s, 143 MB/s 2024-04-25T09:06:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074326 s, 141 MB/s 2024-04-25T09:06:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693619 s, 151 MB/s 2024-04-25T09:06:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728089 s, 144 MB/s 2024-04-25T09:06:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783197 s, 134 MB/s 2024-04-25T09:06:30.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737248 s, 142 MB/s 2024-04-25T09:06:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755616 s, 139 MB/s 2024-04-25T09:06:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753088 s, 139 MB/s 2024-04-25T09:06:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809435 s, 130 MB/s 2024-04-25T09:06:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766663 s, 137 MB/s 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662796 s, 158 MB/s 2024-04-25T09:06:30.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700307 s, 150 MB/s 2024-04-25T09:06:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719774 s, 146 MB/s 2024-04-25T09:06:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739974 s, 142 MB/s 2024-04-25T09:06:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075905 s, 138 MB/s 2024-04-25T09:06:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070747 s, 148 MB/s 2024-04-25T09:06:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628309 s, 167 MB/s 2024-04-25T09:06:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848488 s, 124 MB/s 2024-04-25T09:06:30.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724591 s, 145 MB/s 2024-04-25T09:06:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726136 s, 144 MB/s 2024-04-25T09:06:30.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746712 s, 140 MB/s 2024-04-25T09:06:30.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698568 s, 150 MB/s 2024-04-25T09:06:30.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622721 s, 168 MB/s 2024-04-25T09:06:30.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.893 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672072 s, 156 MB/s 2024-04-25T09:06:30.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.901 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727022 s, 144 MB/s 2024-04-25T09:06:30.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070115 s, 150 MB/s 2024-04-25T09:06:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006259 s, 168 MB/s 2024-04-25T09:06:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666225 s, 157 MB/s 2024-04-25T09:06:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698577 s, 150 MB/s 2024-04-25T09:06:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620701 s, 169 MB/s 2024-04-25T09:06:30.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:30.940 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:30.940 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:30.940 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:06:30.940 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:30.940 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:30.940 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:30.940 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:31.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742539 s, 141 MB/s 2024-04-25T09:06:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670309 s, 156 MB/s 2024-04-25T09:06:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650514 s, 161 MB/s 2024-04-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648057 s, 162 MB/s 2024-04-25T09:06:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683851 s, 153 MB/s 2024-04-25T09:06:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067582 s, 155 MB/s 2024-04-25T09:06:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742264 s, 141 MB/s 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663062 s, 158 MB/s 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755708 s, 139 MB/s 2024-04-25T09:06:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719894 s, 146 MB/s 2024-04-25T09:06:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728486 s, 144 MB/s 2024-04-25T09:06:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725753 s, 144 MB/s 2024-04-25T09:06:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838783 s, 125 MB/s 2024-04-25T09:06:31.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679227 s, 154 MB/s 2024-04-25T09:06:31.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749157 s, 140 MB/s 2024-04-25T09:06:31.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.126 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081668 s, 128 MB/s 2024-04-25T09:06:31.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643093 s, 163 MB/s 2024-04-25T09:06:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683367 s, 153 MB/s 2024-04-25T09:06:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734524 s, 143 MB/s 2024-04-25T09:06:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647128 s, 162 MB/s 2024-04-25T09:06:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690934 s, 152 MB/s 2024-04-25T09:06:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060749 s, 173 MB/s 2024-04-25T09:06:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731038 s, 143 MB/s 2024-04-25T09:06:31.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642586 s, 163 MB/s 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647509 s, 162 MB/s 2024-04-25T09:06:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732098 s, 143 MB/s 2024-04-25T09:06:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714681 s, 147 MB/s 2024-04-25T09:06:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643522 s, 163 MB/s 2024-04-25T09:06:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642165 s, 163 MB/s 2024-04-25T09:06:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639767 s, 164 MB/s 2024-04-25T09:06:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731045 s, 143 MB/s 2024-04-25T09:06:31.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742258 s, 141 MB/s 2024-04-25T09:06:31.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:31.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:31.250 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:31.250 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:06:31.250 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:31.250 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:31.250 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:31.250 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:31.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737226 s, 142 MB/s 2024-04-25T09:06:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649966 s, 161 MB/s 2024-04-25T09:06:31.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695713 s, 151 MB/s 2024-04-25T09:06:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704801 s, 149 MB/s 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739438 s, 142 MB/s 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752818 s, 139 MB/s 2024-04-25T09:06:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705544 s, 149 MB/s 2024-04-25T09:06:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074437 s, 141 MB/s 2024-04-25T09:06:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767483 s, 137 MB/s 2024-04-25T09:06:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667116 s, 157 MB/s 2024-04-25T09:06:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765053 s, 137 MB/s 2024-04-25T09:06:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670096 s, 156 MB/s 2024-04-25T09:06:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781054 s, 134 MB/s 2024-04-25T09:06:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757537 s, 138 MB/s 2024-04-25T09:06:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691786 s, 152 MB/s 2024-04-25T09:06:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804916 s, 130 MB/s 2024-04-25T09:06:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647918 s, 162 MB/s 2024-04-25T09:06:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694266 s, 151 MB/s 2024-04-25T09:06:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718831 s, 146 MB/s 2024-04-25T09:06:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070066 s, 150 MB/s 2024-04-25T09:06:31.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724305 s, 145 MB/s 2024-04-25T09:06:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750804 s, 140 MB/s 2024-04-25T09:06:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652359 s, 161 MB/s 2024-04-25T09:06:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722562 s, 145 MB/s 2024-04-25T09:06:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758079 s, 138 MB/s 2024-04-25T09:06:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702636 s, 149 MB/s 2024-04-25T09:06:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733212 s, 143 MB/s 2024-04-25T09:06:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757689 s, 138 MB/s 2024-04-25T09:06:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732474 s, 143 MB/s 2024-04-25T09:06:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719988 s, 146 MB/s 2024-04-25T09:06:31.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667742 s, 157 MB/s 2024-04-25T09:06:31.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729979 s, 144 MB/s 2024-04-25T09:06:31.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:31.569 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:31.569 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:31.569 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:06:31.569 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:31.569 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:31.569 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:31.569 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725977 s, 144 MB/s 2024-04-25T09:06:31.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750152 s, 140 MB/s 2024-04-25T09:06:31.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677047 s, 155 MB/s 2024-04-25T09:06:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.658 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645947 s, 162 MB/s 2024-04-25T09:06:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724084 s, 145 MB/s 2024-04-25T09:06:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773958 s, 135 MB/s 2024-04-25T09:06:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643972 s, 163 MB/s 2024-04-25T09:06:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773982 s, 135 MB/s 2024-04-25T09:06:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642942 s, 163 MB/s 2024-04-25T09:06:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839167 s, 125 MB/s 2024-04-25T09:06:31.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755471 s, 139 MB/s 2024-04-25T09:06:31.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738514 s, 142 MB/s 2024-04-25T09:06:31.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693109 s, 151 MB/s 2024-04-25T09:06:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658128 s, 159 MB/s 2024-04-25T09:06:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636874 s, 165 MB/s 2024-04-25T09:06:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739004 s, 142 MB/s 2024-04-25T09:06:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621611 s, 169 MB/s 2024-04-25T09:06:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689751 s, 152 MB/s 2024-04-25T09:06:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077505 s, 135 MB/s 2024-04-25T09:06:31.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641673 s, 163 MB/s 2024-04-25T09:06:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652816 s, 161 MB/s 2024-04-25T09:06:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734141 s, 143 MB/s 2024-04-25T09:06:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697509 s, 150 MB/s 2024-04-25T09:06:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738233 s, 142 MB/s 2024-04-25T09:06:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743773 s, 141 MB/s 2024-04-25T09:06:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748334 s, 140 MB/s 2024-04-25T09:06:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664425 s, 158 MB/s 2024-04-25T09:06:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673355 s, 156 MB/s 2024-04-25T09:06:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784087 s, 134 MB/s 2024-04-25T09:06:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085334 s, 123 MB/s 2024-04-25T09:06:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685322 s, 153 MB/s 2024-04-25T09:06:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636227 s, 165 MB/s 2024-04-25T09:06:31.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:31.884 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:06:31.884 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-25T09:06:31.884 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:06:31.884 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:06:31.884 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:06:31.884 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-04-25T09:06:31.884 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-25T09:06:31.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732063 s, 143 MB/s 2024-04-25T09:06:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756209 s, 139 MB/s 2024-04-25T09:06:31.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639366 s, 164 MB/s 2024-04-25T09:06:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073155 s, 143 MB/s 2024-04-25T09:06:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780777 s, 134 MB/s 2024-04-25T09:06:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668439 s, 157 MB/s 2024-04-25T09:06:31.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:31.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:31.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751264 s, 140 MB/s 2024-04-25T09:06:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076065 s, 138 MB/s 2024-04-25T09:06:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680517 s, 154 MB/s 2024-04-25T09:06:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765068 s, 137 MB/s 2024-04-25T09:06:32.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077955 s, 135 MB/s 2024-04-25T09:06:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676489 s, 155 MB/s 2024-04-25T09:06:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635789 s, 165 MB/s 2024-04-25T09:06:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717296 s, 146 MB/s 2024-04-25T09:06:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083952 s, 125 MB/s 2024-04-25T09:06:32.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062216 s, 169 MB/s 2024-04-25T09:06:32.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717764 s, 146 MB/s 2024-04-25T09:06:32.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680628 s, 154 MB/s 2024-04-25T09:06:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732683 s, 143 MB/s 2024-04-25T09:06:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711328 s, 147 MB/s 2024-04-25T09:06:32.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747117 s, 140 MB/s 2024-04-25T09:06:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699242 s, 150 MB/s 2024-04-25T09:06:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667579 s, 157 MB/s 2024-04-25T09:06:32.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718933 s, 146 MB/s 2024-04-25T09:06:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672115 s, 156 MB/s 2024-04-25T09:06:32.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739545 s, 142 MB/s 2024-04-25T09:06:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731762 s, 143 MB/s 2024-04-25T09:06:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724146 s, 145 MB/s 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682603 s, 154 MB/s 2024-04-25T09:06:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685033 s, 153 MB/s 2024-04-25T09:06:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735929 s, 142 MB/s 2024-04-25T09:06:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-25T09:06:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-25T09:06:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673535 s, 156 MB/s 2024-04-25T09:06:32.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-04-25T09:06:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.355+0000 7f5188c38640 1 Processor -- start 2024-04-25T09:06:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.356+0000 7f5188c38640 1 -- start start 2024-04-25T09:06:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.356+0000 7f5188c38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f51840ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.356+0000 7f5188c38640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51840cee10 0x7f51840d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.356+0000 7f5188c38640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5184162150 con 0x7f518415df10 2024-04-25T09:06:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.356+0000 7f5188c38640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51840d20d0 con 0x7f51840cee10 2024-04-25T09:06:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.356+0000 7f5188c38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5184162430 con 0x7f51840b6250 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f5182d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51840cee10 0x7f51840d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f5182d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51840cee10 0x7f51840d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55098/0 (socket says 172.21.15.5:55098) 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f5182d9d640 1 -- 172.21.15.5:0/1774358147 learned_addr learned my addr 172.21.15.5:0/1774358147 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f517bfff640 1 --2- 172.21.15.5:0/1774358147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f51840ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f5182d9d640 1 -- 172.21.15.5:0/1774358147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 msgr2=0x7f51840ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f5182d9d640 1 --2- 172.21.15.5:0/1774358147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f51840ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f5182d9d640 1 -- 172.21.15.5:0/1774358147 >> v1:172.21.15.80:6789/0 conn(0x7f518415df10 legacy=0x7f51841618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.357+0000 7f5182d9d640 1 -- 172.21.15.5:0/1774358147 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184162710 con 0x7f51840cee10 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5182d9d640 1 --2- 172.21.15.5:0/1774358147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51840cee10 0x7f51840d2560 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f517c009e50 tx=0x7f517c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c44ab48af8aaff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5181d9b640 1 -- 172.21.15.5:0/1774358147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c036070 con 0x7f51840cee10 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5181d9b640 1 -- 172.21.15.5:0/1774358147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c031600 con 0x7f51840cee10 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5181d9b640 1 -- 172.21.15.5:0/1774358147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0319d0 con 0x7f51840cee10 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 -- 172.21.15.5:0/1774358147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51840cee10 msgr2=0x7f51840d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 --2- 172.21.15.5:0/1774358147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51840cee10 0x7f51840d2560 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f517c009e50 tx=0x7f517c02a710 comp rx=0 tx=0).stop 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 -- 172.21.15.5:0/1774358147 shutdown_connections 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 --2- 172.21.15.5:0/1774358147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51840cee10 0x7f51840d2560 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 --2- 172.21.15.5:0/1774358147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f51840ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 -- 172.21.15.5:0/1774358147 >> 172.21.15.5:0/1774358147 conn(0x7f51840668f0 msgr2=0x7f5184066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 -- 172.21.15.5:0/1774358147 shutdown_connections 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.358+0000 7f5188c38640 1 -- 172.21.15.5:0/1774358147 wait complete. 2024-04-25T09:06:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 Processor -- start 2024-04-25T09:06:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 -- start start 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f5184156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51840cee10 0x7f51841e8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518415df10 0x7f51840c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840d2c20 con 0x7f518415df10 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840d2aa0 con 0x7f51840cee10 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.360+0000 7f5188c38640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51840d2da0 con 0x7f51840b6250 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518415df10 0x7f51840c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518415df10 0x7f51840c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55100/0 (socket says 172.21.15.5:55100) 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f517bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51840cee10 0x7f51841e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f518259c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f5184156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 -- 172.21.15.5:0/1808409920 learned_addr learned my addr 172.21.15.5:0/1808409920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 -- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 msgr2=0x7f5184156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f5184156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 -- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51840cee10 msgr2=0x7f51841e8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51840cee10 0x7f51841e8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 -- 172.21.15.5:0/1808409920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184156f90 con 0x7f518415df10 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5182d9d640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518415df10 0x7f51840c8a90 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f517c009f70 tx=0x7f517c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f517affd640 1 -- 172.21.15.5:0/1808409920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c03f020 con 0x7f518415df10 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f517affd640 1 -- 172.21.15.5:0/1808409920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c037040 con 0x7f518415df10 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51841e8b70 con 0x7f518415df10 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f517affd640 1 -- 172.21.15.5:0/1808409920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c036070 con 0x7f518415df10 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.361+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51841e9130 con 0x7f518415df10 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.362+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518404ef20 con 0x7f518415df10 2024-04-25T09:06:32.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.363+0000 7f517affd640 1 -- 172.21.15.5:0/1808409920 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f517c042020 con 0x7f518415df10 2024-04-25T09:06:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.363+0000 7f517affd640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f516406b4d0 0x7f516406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.363+0000 7f517affd640 1 -- 172.21.15.5:0/1808409920 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f517c0aa480 con 0x7f518415df10 2024-04-25T09:06:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.363+0000 7f518259c640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f516406b4d0 0x7f516406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.364+0000 7f518259c640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f516406b4d0 0x7f516406d990 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f51840d4130 tx=0x7f5174009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.368+0000 7f517affd640 1 -- 172.21.15.5:0/1808409920 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f517c049030 con 0x7f518415df10 2024-04-25T09:06:32.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:32.594+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f51840d1910 con 0x7f518415df10 2024-04-25T09:06:33.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.598+0000 7f517affd640 1 -- 172.21.15.5:0/1808409920 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v90) v1 ==== 105+0+0 (secure 0 0 0) 0x7f517c078c90 con 0x7f518415df10 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f516406b4d0 msgr2=0x7f516406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f516406b4d0 0x7f516406d990 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f51840d4130 tx=0x7f5174009040 comp rx=0 tx=0).stop 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518415df10 msgr2=0x7f51840c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518415df10 0x7f51840c8a90 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f517c009f70 tx=0x7f517c004a40 comp rx=0 tx=0).stop 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 shutdown_connections 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f516406b4d0 0x7f516406d990 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518415df10 0x7f51840c8a90 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51840cee10 0x7f51841e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 --2- 172.21.15.5:0/1808409920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51840b6250 0x7f5184156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 >> 172.21.15.5:0/1808409920 conn(0x7f51840668f0 msgr2=0x7f51840b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 shutdown_connections 2024-04-25T09:06:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.601+0000 7f5188c38640 1 -- 172.21.15.5:0/1808409920 wait complete. 2024-04-25T09:06:33.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-25T09:06:33.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.724+0000 7f20b93b0640 1 Processor -- start 2024-04-25T09:06:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.725+0000 7f20b93b0640 1 -- start start 2024-04-25T09:06:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.725+0000 7f20b93b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40b6250 0x7f20b40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.725+0000 7f20b93b0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20b40cee10 0x7f20b40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.725+0000 7f20b93b0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b4162150 con 0x7f20b415df10 2024-04-25T09:06:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.725+0000 7f20b93b0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b40d20d0 con 0x7f20b40cee10 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.725+0000 7f20b93b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b4162430 con 0x7f20b40b6250 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b27fc640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40b6250 0x7f20b40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20b40cee10 0x7f20b40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b2ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f20b415df10 0x7f20b41618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:50106/0 (socket says 172.21.15.5:50106) 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b2ffd640 1 -- 172.21.15.5:0/1576406147 learned_addr learned my addr 172.21.15.5:0/1576406147 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b1ffb640 1 -- 172.21.15.5:0/1576406147 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789531960 0 0) 0x7f20b4162150 con 0x7f20b415df10 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b1ffb640 1 -- 172.21.15.5:0/1576406147 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f209c003520 con 0x7f20b415df10 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b37fe640 1 -- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40b6250 msgr2=0x7f20b40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b37fe640 1 --2- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40b6250 0x7f20b40ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b37fe640 1 -- 172.21.15.5:0/1576406147 >> v1:172.21.15.80:6789/0 conn(0x7f20b415df10 legacy=0x7f20b41618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b37fe640 1 -- 172.21.15.5:0/1576406147 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4162710 con 0x7f20b40cee10 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.726+0000 7f20b27fc640 1 --2- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40b6250 0x7f20b40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.727+0000 7f20b37fe640 1 --2- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40cee10 0x7f20b40d2560 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009d90 tx=0x7f20a402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44101d206b9117a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.727+0000 7f20b1ffb640 1 -- 172.21.15.5:0/1576406147 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007740 con 0x7f20b40cee10 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.727+0000 7f20b1ffb640 1 -- 172.21.15.5:0/1576406147 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a40078e0 con 0x7f20b40cee10 2024-04-25T09:06:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.727+0000 7f20b1ffb640 1 -- 172.21.15.5:0/1576406147 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007cb0 con 0x7f20b40cee10 2024-04-25T09:06:33.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 -- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40cee10 msgr2=0x7f20b40d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 --2- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40cee10 0x7f20b40d2560 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009d90 tx=0x7f20a402a660 comp rx=0 tx=0).stop 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 -- 172.21.15.5:0/1576406147 shutdown_connections 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 --2- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40cee10 0x7f20b40d2560 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 --2- 172.21.15.5:0/1576406147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40b6250 0x7f20b40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 -- 172.21.15.5:0/1576406147 >> 172.21.15.5:0/1576406147 conn(0x7f20b40668f0 msgr2=0x7f20b4066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 -- 172.21.15.5:0/1576406147 shutdown_connections 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.728+0000 7f20b93b0640 1 -- 172.21.15.5:0/1576406147 wait complete. 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.729+0000 7f20b93b0640 1 Processor -- start 2024-04-25T09:06:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.729+0000 7f20b93b0640 1 -- start start 2024-04-25T09:06:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b93b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40b6250 0x7f20b40c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b93b0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40cee10 0x7f20b41509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b93b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b415df10 0x7f20b41f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b93b0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40d2c20 con 0x7f20b415df10 2024-04-25T09:06:33.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b93b0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40d2aa0 con 0x7f20b40b6250 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b93b0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40d2da0 con 0x7f20b40cee10 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b415df10 0x7f20b41f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b415df10 0x7f20b41f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55116/0 (socket says 172.21.15.5:55116) 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 -- 172.21.15.5:0/172945413 learned_addr learned my addr 172.21.15.5:0/172945413 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b27fc640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40cee10 0x7f20b41509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b2ffd640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40b6250 0x7f20b40c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 -- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40cee10 msgr2=0x7f20b41509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40cee10 0x7f20b41509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 -- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40b6250 msgr2=0x7f20b40c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40b6250 0x7f20b40c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.730+0000 7f20b37fe640 1 -- 172.21.15.5:0/172945413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b41f85f0 con 0x7f20b415df10 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.731+0000 7f20b37fe640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b415df10 0x7f20b41f80b0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f20a402ac50 tx=0x7f20a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.731+0000 7f209b7fe640 1 -- 172.21.15.5:0/172945413 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4040070 con 0x7f20b415df10 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.731+0000 7f209b7fe640 1 -- 172.21.15.5:0/172945413 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a4031bc0 con 0x7f20b415df10 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.731+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b41f3f00 con 0x7f20b415df10 2024-04-25T09:06:33.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.731+0000 7f209b7fe640 1 -- 172.21.15.5:0/172945413 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4009450 con 0x7f20b415df10 2024-04-25T09:06:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.731+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b41e7ef0 con 0x7f20b415df10 2024-04-25T09:06:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.732+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b404ef20 con 0x7f20b415df10 2024-04-25T09:06:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.732+0000 7f209b7fe640 1 -- 172.21.15.5:0/172945413 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20a4039040 con 0x7f20b415df10 2024-04-25T09:06:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.733+0000 7f209b7fe640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f20a006b4d0 0x7f20a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.733+0000 7f209b7fe640 1 -- 172.21.15.5:0/172945413 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f20a40abad0 con 0x7f20b415df10 2024-04-25T09:06:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.733+0000 7f20b2ffd640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f20a006b4d0 0x7f20a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.734+0000 7f20b2ffd640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f20a006b4d0 0x7f20a006d990 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f20ac005880 tx=0x7f20ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.737+0000 7f209b7fe640 1 -- 172.21.15.5:0/172945413 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20a407aa50 con 0x7f20b415df10 2024-04-25T09:06:33.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:33.954+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f20b40d1910 con 0x7f20b415df10 2024-04-25T09:06:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.605+0000 7f209b7fe640 1 -- 172.21.15.5:0/172945413 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v91) v1 ==== 121+0+0 (secure 0 0 0) 0x7f20a407a350 con 0x7f20b415df10 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f20a006b4d0 msgr2=0x7f20a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f20a006b4d0 0x7f20a006d990 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f20ac005880 tx=0x7f20ac009040 comp rx=0 tx=0).stop 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b415df10 msgr2=0x7f20b41f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b415df10 0x7f20b41f80b0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f20a402ac50 tx=0x7f20a4004a40 comp rx=0 tx=0).stop 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 shutdown_connections 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f20a006b4d0 0x7f20a006d990 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b415df10 0x7f20b41f80b0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20b40cee10 0x7f20b41509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 --2- 172.21.15.5:0/172945413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b40b6250 0x7f20b40c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 >> 172.21.15.5:0/172945413 conn(0x7f20b40668f0 msgr2=0x7f20b415bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 shutdown_connections 2024-04-25T09:06:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.607+0000 7f20b93b0640 1 -- 172.21.15.5:0/172945413 wait complete. 2024-04-25T09:06:34.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.739+0000 7f1e21615640 1 Processor -- start 2024-04-25T09:06:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.739+0000 7f1e21615640 1 -- start start 2024-04-25T09:06:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e21615640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e1c0b2cc0 0x7f1e1c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e21615640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c0b7130 0x7f1e1c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e21615640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0d20e0 con 0x7f1e1c15de70 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e21615640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0d2a10 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e21615640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0d23c0 con 0x7f1e1c0b7130 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e13fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e1c0b2cc0 0x7f1e1c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e1affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e1c15de70 0x7f1e1c0b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48894/0 (socket says 172.21.15.5:48894) 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e1affd640 1 -- 172.21.15.5:0/2656720796 learned_addr learned my addr 172.21.15.5:0/2656720796 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e13fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e1c0b2cc0 0x7f1e1c0b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55130/0 (socket says 172.21.15.5:55130) 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e1b7fe640 1 --2- 172.21.15.5:0/2656720796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c0b7130 0x7f1e1c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e13fff640 1 -- 172.21.15.5:0/2656720796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c0b7130 msgr2=0x7f1e1c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e13fff640 1 --2- 172.21.15.5:0/2656720796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c0b7130 0x7f1e1c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e13fff640 1 -- 172.21.15.5:0/2656720796 >> v1:172.21.15.5:6789/0 conn(0x7f1e1c15de70 legacy=0x7f1e1c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.740+0000 7f1e13fff640 1 -- 172.21.15.5:0/2656720796 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0d26a0 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.741+0000 7f1e13fff640 1 --2- 172.21.15.5:0/2656720796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c0b6bf0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1e040097a0 tx=0x7f1e0402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e24b788a0b32b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.741+0000 7f1e1a7fc640 1 -- 172.21.15.5:0/2656720796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04037070 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.741+0000 7f1e1a7fc640 1 -- 172.21.15.5:0/2656720796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04032440 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.741+0000 7f1e1a7fc640 1 -- 172.21.15.5:0/2656720796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04032810 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 -- 172.21.15.5:0/2656720796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 msgr2=0x7f1e1c0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 --2- 172.21.15.5:0/2656720796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c0b6bf0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1e040097a0 tx=0x7f1e0402a180 comp rx=0 tx=0).stop 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 -- 172.21.15.5:0/2656720796 shutdown_connections 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 --2- 172.21.15.5:0/2656720796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c0b7130 0x7f1e1c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 --2- 172.21.15.5:0/2656720796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c0b6bf0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 -- 172.21.15.5:0/2656720796 >> 172.21.15.5:0/2656720796 conn(0x7f1e1c06b000 msgr2=0x7f1e1c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 -- 172.21.15.5:0/2656720796 shutdown_connections 2024-04-25T09:06:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.742+0000 7f1e21615640 1 -- 172.21.15.5:0/2656720796 wait complete. 2024-04-25T09:06:34.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.743+0000 7f1e21615640 1 Processor -- start 2024-04-25T09:06:34.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.743+0000 7f1e21615640 1 -- start start 2024-04-25T09:06:34.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e21615640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c1f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e21615640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c0b7130 0x7f1e1c0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e21615640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c15de70 0x7f1e1c0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e21615640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cf100 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e21615640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cef80 con 0x7f1e1c0b7130 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e21615640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0d2ea0 con 0x7f1e1c15de70 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c1f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c1f3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55140/0 (socket says 172.21.15.5:55140) 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 -- 172.21.15.5:0/3291264579 learned_addr learned my addr 172.21.15.5:0/3291264579 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e13fff640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c0b7130 0x7f1e1c0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1b7fe640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c15de70 0x7f1e1c0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 -- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c15de70 msgr2=0x7f1e1c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c15de70 0x7f1e1c0cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 -- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c0b7130 msgr2=0x7f1e1c0b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c0b7130 0x7f1e1c0b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 -- 172.21.15.5:0/3291264579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0b35c0 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e1affd640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c1f3d30 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00c3f0 tx=0x7f1e0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.744+0000 7f1e137fe640 1 -- 172.21.15.5:0/3291264579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c017070 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.745+0000 7f1e137fe640 1 -- 172.21.15.5:0/3291264579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c005ce0 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.745+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c0b3860 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.745+0000 7f1e137fe640 1 -- 172.21.15.5:0/3291264579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0072f0 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.745+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c0b3e20 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.745+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c04ef20 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.746+0000 7f1e137fe640 1 -- 172.21.15.5:0/3291264579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e0c01a070 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.746+0000 7f1e137fe640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dfc06b4d0 0x7f1dfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.747+0000 7f1e137fe640 1 -- 172.21.15.5:0/3291264579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1e0c089640 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.747+0000 7f1e13fff640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dfc06b4d0 0x7f1dfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.747+0000 7f1e13fff640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dfc06b4d0 0x7f1dfc06d990 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1e04034000 tx=0x7f1e0402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.751+0000 7f1e137fe640 1 -- 172.21.15.5:0/3291264579 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e0c058400 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.966+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e1c15f5d0 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.966+0000 7f1e137fe640 1 -- 172.21.15.5:0/3291264579 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f1e0c057d00 con 0x7f1e1c0b2cc0 2024-04-25T09:06:34.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:34.955 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:06:14.788729+0000","modified":"2024-04-25T09:06:34.609102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9591":{"gid":9591,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6833/1089300174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1089300174},{"type":"v1","addr":"172.21.15.5:6833","nonce":1089300174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9597":{"gid":9597,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1713726638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1713726638},{"type":"v1","addr":"172.21.15.5:6835","nonce":1713726638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:06:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dfc06b4d0 msgr2=0x7f1dfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dfc06b4d0 0x7f1dfc06d990 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1e04034000 tx=0x7f1e0402e000 comp rx=0 tx=0).stop 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 msgr2=0x7f1e1c1f3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c1f3d30 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00c3f0 tx=0x7f1e0c00c8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 shutdown_connections 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f1dfc06b4d0 0x7f1dfc06d990 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e1c15de70 0x7f1e1c0cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c0b7130 0x7f1e1c0b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 --2- 172.21.15.5:0/3291264579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e1c0b2cc0 0x7f1e1c1f3d30 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 >> 172.21.15.5:0/3291264579 conn(0x7f1e1c06b000 msgr2=0x7f1e1c15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 shutdown_connections 2024-04-25T09:06:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:34.968+0000 7f1e21615640 1 -- 172.21.15.5:0/3291264579 wait complete. 2024-04-25T09:06:35.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T09:06:14.788729+0000', 'modified': '2024-04-25T09:06:34.609102+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9591': {'gid': 9591, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6833/1089300174', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1089300174}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 1089300174}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_9597': {'gid': 9597, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1713726638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1713726638}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1713726638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:35.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:06:35.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:06:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.497+0000 7fad835e2640 1 Processor -- start 2024-04-25T09:06:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.497+0000 7fad835e2640 1 -- start start 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad835e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad7c0b2cc0 0x7fad7c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad835e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c0b7130 0x7fad7c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad835e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c0d20e0 con 0x7fad7c15de70 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad835e2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c0d2a10 con 0x7fad7c0b2cc0 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad835e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0d23c0 con 0x7fad7c0b7130 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad80b7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad7c0b2cc0 0x7fad7c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad80b7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad7c0b2cc0 0x7fad7c0b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55154/0 (socket says 172.21.15.5:55154) 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad80b7d640 1 -- 172.21.15.5:0/2343996693 learned_addr learned my addr 172.21.15.5:0/2343996693 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad81b7f640 1 --2- 172.21.15.5:0/2343996693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c0b7130 0x7fad7c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad80b7d640 1 -- 172.21.15.5:0/2343996693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c0b7130 msgr2=0x7fad7c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad80b7d640 1 --2- 172.21.15.5:0/2343996693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c0b7130 0x7fad7c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad80b7d640 1 -- 172.21.15.5:0/2343996693 >> v1:172.21.15.80:6789/0 conn(0x7fad7c15de70 legacy=0x7fad7c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.498+0000 7fad80b7d640 1 -- 172.21.15.5:0/2343996693 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0d26a0 con 0x7fad7c0b2cc0 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.499+0000 7fad80b7d640 1 --2- 172.21.15.5:0/2343996693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b2cc0 0x7fad7c0b6bf0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fad78009870 tx=0x7fad7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd574fc4a912517a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.499+0000 7fad73fff640 1 -- 172.21.15.5:0/2343996693 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78037070 con 0x7fad7c0b2cc0 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.499+0000 7fad73fff640 1 -- 172.21.15.5:0/2343996693 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78032440 con 0x7fad7c0b2cc0 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.499+0000 7fad73fff640 1 -- 172.21.15.5:0/2343996693 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78032810 con 0x7fad7c0b2cc0 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 -- 172.21.15.5:0/2343996693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b2cc0 msgr2=0x7fad7c0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 --2- 172.21.15.5:0/2343996693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b2cc0 0x7fad7c0b6bf0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fad78009870 tx=0x7fad7802a270 comp rx=0 tx=0).stop 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 -- 172.21.15.5:0/2343996693 shutdown_connections 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 --2- 172.21.15.5:0/2343996693 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c0b7130 0x7fad7c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 --2- 172.21.15.5:0/2343996693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b2cc0 0x7fad7c0b6bf0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 -- 172.21.15.5:0/2343996693 >> 172.21.15.5:0/2343996693 conn(0x7fad7c06b000 msgr2=0x7fad7c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 -- 172.21.15.5:0/2343996693 shutdown_connections 2024-04-25T09:06:35.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.500+0000 7fad835e2640 1 -- 172.21.15.5:0/2343996693 wait complete. 2024-04-25T09:06:35.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.501+0000 7fad835e2640 1 Processor -- start 2024-04-25T09:06:35.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.501+0000 7fad835e2640 1 -- start start 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad835e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad7c0b2cc0 0x7fad7c1f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad835e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b7130 0x7fad7c0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad835e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c15de70 0x7fad7c0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad835e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0cf100 con 0x7fad7c0b7130 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad835e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0cef80 con 0x7fad7c0b2cc0 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad835e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0d2ea0 con 0x7fad7c15de70 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b7130 0x7fad7c0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b7130 0x7fad7c0b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55156/0 (socket says 172.21.15.5:55156) 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 -- 172.21.15.5:0/3524798005 learned_addr learned my addr 172.21.15.5:0/3524798005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad8137e640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad7c0b2cc0 0x7fad7c1f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad81b7f640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c15de70 0x7fad7c0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 -- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c15de70 msgr2=0x7fad7c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c15de70 0x7fad7c0cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 -- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad7c0b2cc0 msgr2=0x7fad7c1f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad7c0b2cc0 0x7fad7c1f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.502+0000 7fad80b7d640 1 -- 172.21.15.5:0/3524798005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0b35c0 con 0x7fad7c0b7130 2024-04-25T09:06:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.503+0000 7fad80b7d640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b7130 0x7fad7c0b4900 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fad78000c00 tx=0x7fad780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.503+0000 7fad71ffb640 1 -- 172.21.15.5:0/3524798005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78041020 con 0x7fad7c0b7130 2024-04-25T09:06:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.503+0000 7fad71ffb640 1 -- 172.21.15.5:0/3524798005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad780306c0 con 0x7fad7c0b7130 2024-04-25T09:06:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.503+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c0b3860 con 0x7fad7c0b7130 2024-04-25T09:06:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.503+0000 7fad71ffb640 1 -- 172.21.15.5:0/3524798005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78037040 con 0x7fad7c0b7130 2024-04-25T09:06:35.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.503+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c0b3e20 con 0x7fad7c0b7130 2024-04-25T09:06:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.504+0000 7fad71ffb640 1 -- 172.21.15.5:0/3524798005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad78044020 con 0x7fad7c0b7130 2024-04-25T09:06:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.505+0000 7fad71ffb640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad6006b4d0 0x7fad6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.505+0000 7fad71ffb640 1 -- 172.21.15.5:0/3524798005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fad780aaa90 con 0x7fad7c0b7130 2024-04-25T09:06:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.505+0000 7fad8137e640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad6006b4d0 0x7fad6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.506+0000 7fad8137e640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad6006b4d0 0x7fad6006d990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fad6c007fd0 tx=0x7fad6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.506+0000 7fad863b6740 1 Processor -- start 2024-04-25T09:06:35.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.506+0000 7fad863b6740 1 -- start start 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b482610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4a0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad863b6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b457f10 0x55df9b49e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad863b6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9b3baa10 con 0x55df9b457f10 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9b363b30 con 0x55df9b49fad0 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df9b3b6c50 con 0x55df9b482230 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b457f10 0x55df9b49e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b457f10 0x55df9b49e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55158/0 (socket says 172.21.15.5:55158) 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 -- 172.21.15.5:0/2679129621 learned_addr learned my addr 172.21.15.5:0/2679129621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad8137e640 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b482610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad80b7d640 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 -- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 msgr2=0x55df9b482610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b482610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 -- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 msgr2=0x55df9b4a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.507+0000 7fad81b7f640 1 -- 172.21.15.5:0/2679129621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df9b378e10 con 0x55df9b457f10 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad81b7f640 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b457f10 0x55df9b49e190 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fad74007400 tx=0x7fad740078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cda338d5f80ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad66ffd640 1 -- 172.21.15.5:0/2679129621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740147e0 con 0x55df9b457f10 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad66ffd640 1 -- 172.21.15.5:0/2679129621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7401a070 con 0x55df9b457f10 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad66ffd640 1 -- 172.21.15.5:0/2679129621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74014ba0 con 0x55df9b457f10 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 -- 172.21.15.5:0/2679129621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b457f10 msgr2=0x55df9b49e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b457f10 0x55df9b49e190 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fad74007400 tx=0x7fad740078c0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 -- 172.21.15.5:0/2679129621 shutdown_connections 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b457f10 0x55df9b49e190 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 --2- 172.21.15.5:0/2679129621 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b482610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 -- 172.21.15.5:0/2679129621 >> 172.21.15.5:0/2679129621 conn(0x55df9b454840 msgr2=0x55df9b49d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 -- 172.21.15.5:0/2679129621 shutdown_connections 2024-04-25T09:06:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.508+0000 7fad863b6740 1 -- 172.21.15.5:0/2679129621 wait complete. 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.509+0000 7fad863b6740 1 -- start start 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.509+0000 7fad863b6740 1 Processor -- start 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b4940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b495f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad863b6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b496460 0x55df9b4831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad863b6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9b458cb0 con 0x55df9b496460 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9b3770c0 con 0x55df9b49fad0 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df9b452770 con 0x55df9b482230 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad863b6740 10 client.0 _ll_register_callbacks cb 0x55df9b36aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b496460 0x55df9b4831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b496460 0x55df9b4831e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55170/0 (socket says 172.21.15.5:55170) 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 -- 172.21.15.5:0/405283870 learned_addr learned my addr 172.21.15.5:0/405283870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad8137e640 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b4940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad80b7d640 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b495f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 -- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 msgr2=0x55df9b4940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b4940f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 -- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 msgr2=0x55df9b495f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b495f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.510+0000 7fad81b7f640 1 -- 172.21.15.5:0/405283870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df9b0cf2d0 con 0x55df9b496460 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad81b7f640 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b496460 0x55df9b4831e0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fad74000f80 tx=0x7fad74004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b282114a2945e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad5bfff640 1 -- 172.21.15.5:0/405283870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74024070 con 0x55df9b496460 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad5bfff640 1 -- 172.21.15.5:0/405283870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fad74014da0 con 0x55df9b496460 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad7401a070 con 0x55df9b496460 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad5bfff640 1 -- 172.21.15.5:0/405283870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad74015470 con 0x55df9b496460 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 10 client.9789 fetch_fsmap learned FSMap version 92 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55df9b1996b0 con 0x55df9b496460 2024-04-25T09:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad5bfff640 1 -- 172.21.15.5:0/405283870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7401a070 con 0x55df9b496460 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad5bfff640 1 -- 172.21.15.5:0/405283870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 92) v1 ==== 3282+0+0 (secure 0 0 0) 0x7fad74015610 con 0x55df9b496460 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 10 client.9789 fetch_fsmap finished waiting for FSMap version 92 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 10 client.9789 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 20 client.9789 populate_metadata read hostname 'smithi005' 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b4addf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 4 client.9789 mds_command: new command op to 9597 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 --> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df9b419920 con 0x55df9b4ada10 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.511+0000 7fad8137e640 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b4addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad8137e640 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b4addf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5817f413b8d42abe server_cookie=4ee5fb31fe0689fb in_seq=0 out_seq=0 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad5bfff640 10 client.9789 ms_handle_connect on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad5bfff640 1 -- 172.21.15.5:0/405283870 <== mds.0 v2:172.21.15.5:6834/1713726638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df9b419920 con 0x55df9b4ada10 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad5bfff640 10 client.9789 handle_command_reply: tid=0 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad863b6740 1 client.9789 shutdown 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b496460 msgr2=0x55df9b4831e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad863b6740 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b496460 0x55df9b4831e0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fad74000f80 tx=0x7fad74004ab0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 shutdown_connections 2024-04-25T09:06:35.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad863b6740 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b496460 0x55df9b4831e0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.512+0000 7fad863b6740 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b4addf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.513+0000 7fad863b6740 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b495f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.513+0000 7fad5bfff640 0 client.9789 ms_handle_reset on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.513+0000 7fad863b6740 1 --2- 172.21.15.5:0/405283870 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b482230 0x55df9b4940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.513+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 >> 172.21.15.5:0/405283870 conn(0x55df9b457f10 msgr2=0x55df9b4a0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.513+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 shutdown_connections 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.513+0000 7fad863b6740 1 -- 172.21.15.5:0/405283870 wait complete. 2024-04-25T09:06:35.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.513+0000 7fad863b6740 20 client.9789 trim_cache size 0 max 16384 2024-04-25T09:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.528+0000 7fad863b6740 1 Processor -- start 2024-04-25T09:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.528+0000 7fad863b6740 1 -- start start 2024-04-25T09:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad863b6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b502370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 0x55df9b484320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b484860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad863b6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c200140 con 0x55df9b482230 2024-04-25T09:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0cd150 con 0x55df9b49fad0 2024-04-25T09:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1f7a10 con 0x55df9b496460 2024-04-25T09:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad8137e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b502370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad8137e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b502370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55182/0 (socket says 172.21.15.5:55182) 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad8137e640 1 -- 172.21.15.5:0/2896806785 learned_addr learned my addr 172.21.15.5:0/2896806785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad8137e640 1 -- 172.21.15.5:0/2896806785 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 msgr2=0x55df9b484320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad8137e640 1 --2- 172.21.15.5:0/2896806785 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 0x55df9b484320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad8137e640 1 -- 172.21.15.5:0/2896806785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 msgr2=0x55df9b484860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.529+0000 7fad8137e640 1 --2- 172.21.15.5:0/2896806785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b484860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad8137e640 1 -- 172.21.15.5:0/2896806785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df9b496290 con 0x55df9b482230 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad8137e640 1 --2- 172.21.15.5:0/2896806785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b502370 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0054e0 tx=0x7fad6c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5f6241a2dca96f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad667fc640 1 -- 172.21.15.5:0/2896806785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c02b020 con 0x55df9b482230 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad667fc640 1 -- 172.21.15.5:0/2896806785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c003c80 con 0x55df9b482230 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad667fc640 1 -- 172.21.15.5:0/2896806785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c027e60 con 0x55df9b482230 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 -- 172.21.15.5:0/2896806785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 msgr2=0x55df9b502370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 --2- 172.21.15.5:0/2896806785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b502370 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0054e0 tx=0x7fad6c012000 comp rx=0 tx=0).stop 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 -- 172.21.15.5:0/2896806785 shutdown_connections 2024-04-25T09:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 --2- 172.21.15.5:0/2896806785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b484860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 --2- 172.21.15.5:0/2896806785 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 0x55df9b484320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 --2- 172.21.15.5:0/2896806785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b502370 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 -- 172.21.15.5:0/2896806785 >> 172.21.15.5:0/2896806785 conn(0x55df9b457f10 msgr2=0x55df9b44ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 -- 172.21.15.5:0/2896806785 shutdown_connections 2024-04-25T09:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.530+0000 7fad863b6740 1 -- 172.21.15.5:0/2896806785 wait complete. 2024-04-25T09:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.531+0000 7fad863b6740 1 -- start start 2024-04-25T09:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.531+0000 7fad863b6740 1 Processor -- start 2024-04-25T09:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad863b6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b455d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 0x55df9b492e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad863b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4841b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad863b6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9b495c00 con 0x55df9b482230 2024-04-25T09:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9b458cb0 con 0x55df9b49fad0 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad863b6740 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df9b49c170 con 0x55df9b496460 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad863b6740 10 client.0 _ll_register_callbacks cb 0x55df9b452c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b455d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b455d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55196/0 (socket says 172.21.15.5:55196) 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 -- 172.21.15.5:0/3351427677 learned_addr learned my addr 172.21.15.5:0/3351427677 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad80b7d640 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 0x55df9b492e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad81b7f640 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4841b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 -- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 msgr2=0x55df9b492e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 0x55df9b492e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 -- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 msgr2=0x55df9b4841b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4841b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 -- 172.21.15.5:0/3351427677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df9b501fb0 con 0x55df9b482230 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad8137e640 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b455d50 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000fb0 tx=0x7fad6c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d747f8908f033895 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.532+0000 7fad5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-25T09:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad5bfff640 1 -- 172.21.15.5:0/3351427677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c027e60 con 0x55df9b482230 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad5bfff640 1 -- 172.21.15.5:0/3351427677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fad6c030ac0 con 0x55df9b482230 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad6c003c80 con 0x55df9b482230 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad5bfff640 1 -- 172.21.15.5:0/3351427677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6c0278f0 con 0x55df9b482230 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 10 client.9795 fetch_fsmap learned FSMap version 92 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55df9b501d30 con 0x55df9b482230 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad5bfff640 1 -- 172.21.15.5:0/3351427677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c003c80 con 0x55df9b482230 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad5bfff640 1 -- 172.21.15.5:0/3351427677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 92) v1 ==== 3282+0+0 (secure 0 0 0) 0x7fad6c030ce0 con 0x55df9b482230 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 10 client.9795 fetch_fsmap finished waiting for FSMap version 92 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 10 client.9795 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 20 client.9795 populate_metadata read hostname 'smithi005' 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b5009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 4 client.9795 mds_command: new command op to 9597 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 --> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55df9b497c20 con 0x55df9b4ada10 2024-04-25T09:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.533+0000 7fad80b7d640 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b5009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad80b7d640 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b5009f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313536b67461ea07 server_cookie=f38292cbb4e09ee3 in_seq=0 out_seq=0 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad5bfff640 10 client.9795 ms_handle_connect on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad5bfff640 1 -- 172.21.15.5:0/3351427677 <== mds.0 v2:172.21.15.5:6834/1713726638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55df9b497c20 con 0x55df9b4ada10 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad5bfff640 10 client.9795 handle_command_reply: tid=0 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 client.9795 shutdown 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 msgr2=0x55df9b455d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b455d50 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000fb0 tx=0x7fad6c000bc0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 shutdown_connections 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:6834/1713726638,v1:172.21.15.5:6835/1713726638] conn(0x55df9b4ada10 0x55df9b5009f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55df9b49fad0 0x55df9b4841b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x55df9b496460 0x55df9b492e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad5bfff640 0 client.9795 ms_handle_reset on v2:172.21.15.5:6834/1713726638 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 --2- 172.21.15.5:0/3351427677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df9b482230 0x55df9b455d50 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 >> 172.21.15.5:0/3351427677 conn(0x55df9b457f10 msgr2=0x55df9b4582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 shutdown_connections 2024-04-25T09:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 1 -- 172.21.15.5:0/3351427677 wait complete. 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.534+0000 7fad863b6740 20 client.9795 trim_cache size 0 max 16384 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "dc25bcb4-77ea-4563-9f35-ae8cfdf8a422", 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9597, 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 20.103382172, 2024-04-25T09:06:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 92, 2024-04-25T09:06:35.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 140, 2024-04-25T09:06:35.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 140, 2024-04-25T09:06:35.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 25.123276540999999 2024-04-25T09:06:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad6006b4d0 msgr2=0x7fad6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad6006b4d0 0x7fad6006d990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fad6c007fd0 tx=0x7fad6c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b7130 msgr2=0x7fad7c0b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b7130 0x7fad7c0b4900 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fad78000c00 tx=0x7fad780046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 shutdown_connections 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fad6006b4d0 0x7fad6006d990 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad7c15de70 0x7fad7c0cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad7c0b7130 0x7fad7c0b4900 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 --2- 172.21.15.5:0/3524798005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad7c0b2cc0 0x7fad7c1f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 >> 172.21.15.5:0/3524798005 conn(0x7fad7c06b000 msgr2=0x7fad7c15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 shutdown_connections 2024-04-25T09:06:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.535+0000 7fad835e2640 1 -- 172.21.15.5:0/3524798005 wait complete. 2024-04-25T09:06:35.533 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:06:35.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:35.568 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:35.617 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:06:35.618 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:35.618 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:35.633 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:35.633 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:35.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:35.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.841+0000 7f43a68f5640 1 Processor -- start 2024-04-25T09:06:35.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.841+0000 7f43a68f5640 1 -- start start 2024-04-25T09:06:35.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f43a68f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43a006dd20 0x7f43a00ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f43a68f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00b4bd0 con 0x7f43a00b3860 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f43a68f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00b2aa0 con 0x7f43a0156250 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f43a68f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00b2850 con 0x7f43a006dd20 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f439f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43a006dd20 0x7f43a00ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f43a4e92640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f43a00b3860 0x7f43a015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48898/0 (socket says 172.21.15.5:48898) 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f439f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43a006dd20 0x7f43a00ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55202/0 (socket says 172.21.15.5:55202) 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f43a4e92640 1 -- 172.21.15.5:0/736760101 learned_addr learned my addr 172.21.15.5:0/736760101 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f439f7fe640 1 -- 172.21.15.5:0/736760101 >> v1:172.21.15.80:6789/0 conn(0x7f43a0156250 legacy=0x7f43a00b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f439f7fe640 1 -- 172.21.15.5:0/736760101 >> v1:172.21.15.5:6789/0 conn(0x7f43a00b3860 legacy=0x7f43a015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f439effd640 1 -- 172.21.15.5:0/736760101 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764629312 0 0) 0x7f4398001490 con 0x7f43a00b3860 2024-04-25T09:06:35.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.842+0000 7f439f7fe640 1 -- 172.21.15.5:0/736760101 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00b2d80 con 0x7f43a006dd20 2024-04-25T09:06:35.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.843+0000 7f439f7fe640 1 --2- 172.21.15.5:0/736760101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a006dd20 0x7f43a00ae690 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f43900097a0 tx=0x7f439002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a52920a5cce01e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.843+0000 7f439effd640 1 -- 172.21.15.5:0/736760101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390037070 con 0x7f43a006dd20 2024-04-25T09:06:35.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.843+0000 7f439effd640 1 -- 172.21.15.5:0/736760101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439002ae50 con 0x7f43a006dd20 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.843+0000 7f439effd640 1 -- 172.21.15.5:0/736760101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390032660 con 0x7f43a006dd20 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.844+0000 7f43a68f5640 1 -- 172.21.15.5:0/736760101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a006dd20 msgr2=0x7f43a00ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.844+0000 7f43a68f5640 1 --2- 172.21.15.5:0/736760101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a006dd20 0x7f43a00ae690 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f43900097a0 tx=0x7f439002a140 comp rx=0 tx=0).stop 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.844+0000 7f43a68f5640 1 -- 172.21.15.5:0/736760101 shutdown_connections 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.844+0000 7f43a68f5640 1 --2- 172.21.15.5:0/736760101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a006dd20 0x7f43a00ae690 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.844+0000 7f43a68f5640 1 -- 172.21.15.5:0/736760101 >> 172.21.15.5:0/736760101 conn(0x7f43a00668f0 msgr2=0x7f43a0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.844+0000 7f43a68f5640 1 -- 172.21.15.5:0/736760101 shutdown_connections 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.844+0000 7f43a68f5640 1 -- 172.21.15.5:0/736760101 wait complete. 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.845+0000 7f43a68f5640 1 Processor -- start 2024-04-25T09:06:35.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.845+0000 7f43a68f5640 1 -- start start 2024-04-25T09:06:35.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a68f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a00b3860 0x7f43a014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a68f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43a0156250 0x7f43a01512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a68f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a0152e30 0x7f43a0159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a68f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00aebd0 con 0x7f43a00b3860 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a68f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00b3340 con 0x7f43a0152e30 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a68f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00aed50 con 0x7f43a0156250 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a00b3860 0x7f43a014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a00b3860 0x7f43a014d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55218/0 (socket says 172.21.15.5:55218) 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 -- 172.21.15.5:0/2019701931 learned_addr learned my addr 172.21.15.5:0/2019701931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439f7fe640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43a0156250 0x7f43a01512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a4e92640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a0152e30 0x7f43a0159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 -- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43a0156250 msgr2=0x7f43a01512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43a0156250 0x7f43a01512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 -- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a0152e30 msgr2=0x7f43a0159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a0152e30 0x7f43a0159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 -- 172.21.15.5:0/2019701931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0151d90 con 0x7f43a00b3860 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439f7fe640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43a0156250 0x7f43a01512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f43a4e92640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a0152e30 0x7f43a0159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.846+0000 7f439ffff640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a00b3860 0x7f43a014d250 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f438800b3f0 tx=0x7f438800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.847+0000 7f439cff9640 1 -- 172.21.15.5:0/2019701931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388015020 con 0x7f43a00b3860 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.847+0000 7f439cff9640 1 -- 172.21.15.5:0/2019701931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388011830 con 0x7f43a00b3860 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.847+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a0152070 con 0x7f43a00b3860 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.847+0000 7f439cff9640 1 -- 172.21.15.5:0/2019701931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011c20 con 0x7f43a00b3860 2024-04-25T09:06:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.847+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a0152630 con 0x7f43a00b3860 2024-04-25T09:06:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.848+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a004ef20 con 0x7f43a00b3860 2024-04-25T09:06:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.848+0000 7f439cff9640 1 -- 172.21.15.5:0/2019701931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4388018020 con 0x7f43a00b3860 2024-04-25T09:06:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.849+0000 7f439cff9640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f438006b4d0 0x7f438006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.849+0000 7f439cff9640 1 -- 172.21.15.5:0/2019701931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4388089db0 con 0x7f43a00b3860 2024-04-25T09:06:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.849+0000 7f439f7fe640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f438006b4d0 0x7f438006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.850+0000 7f439f7fe640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f438006b4d0 0x7f438006d990 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4390034000 tx=0x7f439002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:35.853+0000 7f439cff9640 1 -- 172.21.15.5:0/2019701931 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f438801f030 con 0x7f43a00b3860 2024-04-25T09:06:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.033+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43a00b44a0 con 0x7f43a00b3860 2024-04-25T09:06:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.034+0000 7f439cff9640 1 -- 172.21.15.5:0/2019701931 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16644 (secure 0 0 0) 0x7f43880172c0 con 0x7f43a00b3860 2024-04-25T09:06:36.023 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:36.023 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":140,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:29.582257+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:13.105023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:13.759633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f438006b4d0 msgr2=0x7f438006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f438006b4d0 0x7f438006d990 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4390034000 tx=0x7f439002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a00b3860 msgr2=0x7f43a014d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a00b3860 0x7f43a014d250 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f438800b3f0 tx=0x7f438800b8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 shutdown_connections 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f438006b4d0 0x7f438006d990 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a0152e30 0x7f43a0159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43a0156250 0x7f43a01512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 --2- 172.21.15.5:0/2019701931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a00b3860 0x7f43a014d250 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 >> 172.21.15.5:0/2019701931 conn(0x7f43a00668f0 msgr2=0x7f43a00af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 shutdown_connections 2024-04-25T09:06:36.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.036+0000 7f43a68f5640 1 -- 172.21.15.5:0/2019701931 wait complete. 2024-04-25T09:06:36.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:13.105023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:13.759633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:36.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:36.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.150+0000 7faf5106f640 1 Processor -- start 2024-04-25T09:06:36.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.150+0000 7faf5106f640 1 -- start start 2024-04-25T09:06:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.151+0000 7faf5106f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 0x7faf4c0d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.151+0000 7faf5106f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c15e260 con 0x7faf4c0ce1c0 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.151+0000 7faf5106f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c0d18c0 con 0x7faf4c15de80 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.151+0000 7faf5106f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0d3770 con 0x7faf4c0d2dc0 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.151+0000 7faf4a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf4c0ce1c0 0x7faf4c0d2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48912/0 (socket says 172.21.15.5:48912) 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.151+0000 7faf4a59c640 1 -- 172.21.15.5:0/977981801 learned_addr learned my addr 172.21.15.5:0/977981801 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.151+0000 7faf4b59e640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 0x7faf4c0d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068433808 0 0) 0x7faf4c15e260 con 0x7faf4c0ce1c0 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf38003520 con 0x7faf4c0ce1c0 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489572119 0 0) 0x7faf4c0d18c0 con 0x7faf4c15de80 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c15e260 con 0x7faf4c15de80 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208085128 0 0) 0x7faf38003520 con 0x7faf4c0ce1c0 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 msgr2=0x7faf4c0d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 0x7faf4c0d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 >> v1:172.21.15.80:6789/0 conn(0x7faf4c15de80 legacy=0x7faf4c0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0ce780 con 0x7faf4c0ce1c0 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7faf34001610 con 0x7faf4c0ce1c0 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 >> v1:172.21.15.5:6789/0 conn(0x7faf4c0ce1c0 legacy=0x7faf4c0d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 0x7faf38003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf38004120 0x7faf38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf38004d40 0x7faf380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0d3770 con 0x7faf38004120 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3800bb80 con 0x7faf38004d40 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3800bd80 con 0x7faf4c0d2dc0 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4a59c640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf38004120 0x7faf38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4ad9d640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 0x7faf38003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4b59e640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf38004d40 0x7faf380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4a59c640 1 -- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 msgr2=0x7faf38003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4a59c640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf4c0d2dc0 0x7faf38003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4a59c640 1 -- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf38004d40 msgr2=0x7faf380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4a59c640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf38004d40 0x7faf380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.152+0000 7faf4a59c640 1 -- 172.21.15.5:0/977981801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38003520 con 0x7faf38004120 2024-04-25T09:06:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.153+0000 7faf4a59c640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf38004120 0x7faf38004800 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7faf34007f50 tx=0x7faf38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b15f3ba70405fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.153+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34007ba0 con 0x7faf38004120 2024-04-25T09:06:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.153+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34005bb0 con 0x7faf38004120 2024-04-25T09:06:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.153+0000 7faf49d9b640 1 -- 172.21.15.5:0/977981801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34007070 con 0x7faf38004120 2024-04-25T09:06:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.154+0000 7faf5106f640 1 -- 172.21.15.5:0/977981801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf38004120 msgr2=0x7faf38004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.154+0000 7faf5106f640 1 --2- 172.21.15.5:0/977981801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf38004120 0x7faf38004800 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7faf34007f50 tx=0x7faf38005830 comp rx=0 tx=0).stop 2024-04-25T09:06:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.154+0000 7faf4b59e640 1 -- 172.21.15.5:0/977981801 reap_dead start 2024-04-25T09:06:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.154+0000 7faf5106f640 1 -- 172.21.15.5:0/977981801 shutdown_connections 2024-04-25T09:06:36.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.154+0000 7faf5106f640 1 -- 172.21.15.5:0/977981801 >> 172.21.15.5:0/977981801 conn(0x7faf4c06b000 msgr2=0x7faf4c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.154+0000 7faf5106f640 1 -- 172.21.15.5:0/977981801 shutdown_connections 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.154+0000 7faf5106f640 1 -- 172.21.15.5:0/977981801 wait complete. 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.155+0000 7faf5106f640 1 Processor -- start 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.155+0000 7faf5106f640 1 -- start start 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf5106f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf38004120 0x7faf4c157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf5106f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4c157e90 0x7faf4c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf5106f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c0cc910 0x7faf4c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf5106f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0d3230 con 0x7faf4c157e90 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf5106f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0d1ef0 con 0x7faf4c0cc910 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf5106f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0d33b0 con 0x7faf38004120 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf4a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4c157e90 0x7faf4c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf4a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4c157e90 0x7faf4c0b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55234/0 (socket says 172.21.15.5:55234) 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf4a59c640 1 -- 172.21.15.5:0/2775866057 learned_addr learned my addr 172.21.15.5:0/2775866057 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.156+0000 7faf4ad9d640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf38004120 0x7faf4c157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4b59e640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c0cc910 0x7faf4c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4a59c640 1 -- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf38004120 msgr2=0x7faf4c157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4a59c640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf38004120 0x7faf4c157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4a59c640 1 -- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c0cc910 msgr2=0x7faf4c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4a59c640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c0cc910 0x7faf4c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4a59c640 1 -- 172.21.15.5:0/2775866057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c1579a0 con 0x7faf4c157e90 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4b59e640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c0cc910 0x7faf4c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf4a59c640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4c157e90 0x7faf4c0b3f20 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7faf3402ac40 tx=0x7faf34001910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf437fe640 1 -- 172.21.15.5:0/2775866057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34041020 con 0x7faf4c157e90 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf437fe640 1 -- 172.21.15.5:0/2775866057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34005e20 con 0x7faf4c157e90 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf437fe640 1 -- 172.21.15.5:0/2775866057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf340072d0 con 0x7faf4c157e90 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c15e470 con 0x7faf4c157e90 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.157+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c15ea30 con 0x7faf4c157e90 2024-04-25T09:06:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.158+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c04ef20 con 0x7faf4c157e90 2024-04-25T09:06:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.158+0000 7faf437fe640 1 -- 172.21.15.5:0/2775866057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf34044020 con 0x7faf4c157e90 2024-04-25T09:06:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.159+0000 7faf437fe640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf2c06b4d0 0x7faf2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.159+0000 7faf437fe640 1 -- 172.21.15.5:0/2775866057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7faf340aa7c0 con 0x7faf4c157e90 2024-04-25T09:06:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.159+0000 7faf4ad9d640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf2c06b4d0 0x7faf2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.159+0000 7faf4ad9d640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf2c06b4d0 0x7faf2c06d990 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0b2e70 tx=0x7faf44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.163+0000 7faf437fe640 1 -- 172.21.15.5:0/2775866057 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf3404b020 con 0x7faf4c157e90 2024-04-25T09:06:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.343+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf4c0cecd0 con 0x7faf4c157e90 2024-04-25T09:06:36.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.344+0000 7faf437fe640 1 -- 172.21.15.5:0/2775866057 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf340797d0 con 0x7faf4c157e90 2024-04-25T09:06:36.332 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:06:36.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf2c06b4d0 msgr2=0x7faf2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf2c06b4d0 0x7faf2c06d990 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0b2e70 tx=0x7faf44009040 comp rx=0 tx=0).stop 2024-04-25T09:06:36.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4c157e90 msgr2=0x7faf4c0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4c157e90 0x7faf4c0b3f20 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7faf3402ac40 tx=0x7faf34001910 comp rx=0 tx=0).stop 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 shutdown_connections 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7faf2c06b4d0 0x7faf2c06d990 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c0cc910 0x7faf4c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4c157e90 0x7faf4c0b3f20 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 --2- 172.21.15.5:0/2775866057 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7faf38004120 0x7faf4c157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 >> 172.21.15.5:0/2775866057 conn(0x7faf4c06b000 msgr2=0x7faf4c0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 shutdown_connections 2024-04-25T09:06:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.346+0000 7faf5106f640 1 -- 172.21.15.5:0/2775866057 wait complete. 2024-04-25T09:06:36.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:36.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.460+0000 7ff65734c640 1 Processor -- start 2024-04-25T09:06:36.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.460+0000 7ff65734c640 1 -- start start 2024-04-25T09:06:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff65734c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6500ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff65734c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff650162150 con 0x7ff65015df10 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff65734c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff650162430 con 0x7ff6500cee10 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff65734c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500d20d0 con 0x7ff6500b6250 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff6550e8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff65015df10 0x7ff6501618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48922/0 (socket says 172.21.15.5:48922) 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff6550e8640 1 -- 172.21.15.5:0/3799469702 learned_addr learned my addr 172.21.15.5:0/3799469702 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff6548e7640 1 --2- 172.21.15.5:0/3799469702 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6500ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.461+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328219931 0 0) 0x7ff650162150 con 0x7ff65015df10 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.462+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff63c003520 con 0x7ff65015df10 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.462+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839443108 0 0) 0x7ff650162430 con 0x7ff6500cee10 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.462+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff650162150 con 0x7ff6500cee10 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.462+0000 7ff6548e7640 1 -- 172.21.15.5:0/3799469702 >> v1:172.21.15.80:6789/0 conn(0x7ff6500cee10 legacy=0x7ff6500d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.462+0000 7ff6548e7640 1 -- 172.21.15.5:0/3799469702 >> v1:172.21.15.5:6789/0 conn(0x7ff65015df10 legacy=0x7ff6501618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.462+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3204389223 0 0) 0x7ff63c003520 con 0x7ff65015df10 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.462+0000 7ff6548e7640 1 -- 172.21.15.5:0/3799469702 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650162710 con 0x7ff6500b6250 2024-04-25T09:06:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff6548e7640 1 --2- 172.21.15.5:0/3799469702 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6500ce8d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6400097d0 tx=0x7ff64002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3175118eb3d3b4b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640037070 con 0x7ff6500b6250 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64002ac30 con 0x7ff6500b6250 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff647fff640 1 -- 172.21.15.5:0/3799469702 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c001670 con 0x7ff6500b6250 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff65734c640 1 -- 172.21.15.5:0/3799469702 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 msgr2=0x7ff6500ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff65734c640 1 --2- 172.21.15.5:0/3799469702 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6500ce8d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6400097d0 tx=0x7ff64002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff65734c640 1 -- 172.21.15.5:0/3799469702 shutdown_connections 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff65734c640 1 --2- 172.21.15.5:0/3799469702 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6500ce8d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.463+0000 7ff65734c640 1 -- 172.21.15.5:0/3799469702 >> 172.21.15.5:0/3799469702 conn(0x7ff6500668f0 msgr2=0x7ff650066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.464+0000 7ff65734c640 1 -- 172.21.15.5:0/3799469702 shutdown_connections 2024-04-25T09:06:36.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.464+0000 7ff65734c640 1 -- 172.21.15.5:0/3799469702 wait complete. 2024-04-25T09:06:36.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 Processor -- start 2024-04-25T09:06:36.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 -- start start 2024-04-25T09:06:36.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6501f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6500cee10 0x7ff6501603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65015df10 0x7ff6500cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500d2df0 con 0x7ff65015df10 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500d2c70 con 0x7ff6500cee10 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff65734c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500d2f70 con 0x7ff6500b6250 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff6558e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65015df10 0x7ff6500cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.465+0000 7ff6558e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65015df10 0x7ff6500cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55246/0 (socket says 172.21.15.5:55246) 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6558e9640 1 -- 172.21.15.5:0/2277921012 learned_addr learned my addr 172.21.15.5:0/2277921012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6548e7640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6500cee10 0x7ff6501603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6550e8640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6501f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6558e9640 1 -- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 msgr2=0x7ff6501f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6558e9640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6501f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6558e9640 1 -- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6500cee10 msgr2=0x7ff6501603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6558e9640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6500cee10 0x7ff6501603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6558e9640 1 -- 172.21.15.5:0/2277921012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6501f4490 con 0x7ff65015df10 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff6558e9640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65015df10 0x7ff6500cacd0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff64800c790 tx=0x7ff64800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff645ffb640 1 -- 172.21.15.5:0/2277921012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648003b70 con 0x7ff65015df10 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff645ffb640 1 -- 172.21.15.5:0/2277921012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff648003d10 con 0x7ff65015df10 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6501f4770 con 0x7ff65015df10 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff645ffb640 1 -- 172.21.15.5:0/2277921012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800aa50 con 0x7ff65015df10 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.466+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6501f5010 con 0x7ff65015df10 2024-04-25T09:06:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.467+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6501f4940 con 0x7ff65015df10 2024-04-25T09:06:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.468+0000 7ff645ffb640 1 -- 172.21.15.5:0/2277921012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff64800abf0 con 0x7ff65015df10 2024-04-25T09:06:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.468+0000 7ff645ffb640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff63406b4d0 0x7ff63406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.468+0000 7ff645ffb640 1 -- 172.21.15.5:0/2277921012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff64808a0a0 con 0x7ff65015df10 2024-04-25T09:06:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.469+0000 7ff6550e8640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff63406b4d0 0x7ff63406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.469+0000 7ff6550e8640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff63406b4d0 0x7ff63406d990 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0017e0 tx=0x7ff64c001610 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.472+0000 7ff645ffb640 1 -- 172.21.15.5:0/2277921012 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff6480588b0 con 0x7ff65015df10 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.654+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff65004ef20 con 0x7ff65015df10 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.654+0000 7ff645ffb640 1 -- 172.21.15.5:0/2277921012 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v140) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff64805c950 con 0x7ff65015df10 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff63406b4d0 msgr2=0x7ff63406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff63406b4d0 0x7ff63406d990 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0017e0 tx=0x7ff64c001610 comp rx=0 tx=0).stop 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65015df10 msgr2=0x7ff6500cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65015df10 0x7ff6500cacd0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff64800c790 tx=0x7ff64800cc50 comp rx=0 tx=0).stop 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 shutdown_connections 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff63406b4d0 0x7ff63406d990 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff65015df10 0x7ff6500cacd0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6500cee10 0x7ff6501603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 --2- 172.21.15.5:0/2277921012 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff6500b6250 0x7ff6501f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 >> 172.21.15.5:0/2277921012 conn(0x7ff6500668f0 msgr2=0x7ff650161830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 shutdown_connections 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.656+0000 7ff65734c640 1 -- 172.21.15.5:0/2277921012 wait complete. 2024-04-25T09:06:36.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:36.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.771+0000 7f3a6fe5a640 1 Processor -- start 2024-04-25T09:06:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.771+0000 7f3a6fe5a640 1 -- start start 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.772+0000 7f3a6fe5a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a6815de80 0x7f3a680ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.772+0000 7f3a6fe5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6815e260 con 0x7f3a680d2dc0 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.772+0000 7f3a6fe5a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a680cf2e0 con 0x7f3a680ce1c0 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.772+0000 7f3a6fe5a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680d1ef0 con 0x7f3a6815de80 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.772+0000 7f3a6e3f7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3a680d2dc0 0x7f3a680b6cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48934/0 (socket says 172.21.15.5:48934) 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.772+0000 7f3a6e3f7640 1 -- 172.21.15.5:0/107972266 learned_addr learned my addr 172.21.15.5:0/107972266 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.773+0000 7f3a6dbf6640 1 --2- 172.21.15.5:0/107972266 >> v2:172.21.15.80:3300/0 conn(0x7f3a6815de80 0x7f3a680ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.773+0000 7f3a6cbf4640 1 -- 172.21.15.5:0/107972266 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736538297 0 0) 0x7f3a6815e260 con 0x7f3a680d2dc0 2024-04-25T09:06:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.773+0000 7f3a6cbf4640 1 -- 172.21.15.5:0/107972266 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a54003520 con 0x7f3a680d2dc0 2024-04-25T09:06:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.773+0000 7f3a6cbf4640 1 -- 172.21.15.5:0/107972266 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982237172 0 0) 0x7f3a54003520 con 0x7f3a680d2dc0 2024-04-25T09:06:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.773+0000 7f3a6dbf6640 1 -- 172.21.15.5:0/107972266 >> v1:172.21.15.80:6789/0 conn(0x7f3a680ce1c0 legacy=0x7f3a680d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.773+0000 7f3a6dbf6640 1 -- 172.21.15.5:0/107972266 >> v1:172.21.15.5:6789/0 conn(0x7f3a680d2dc0 legacy=0x7f3a680b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.773+0000 7f3a6dbf6640 1 -- 172.21.15.5:0/107972266 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680d18c0 con 0x7f3a6815de80 2024-04-25T09:06:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.774+0000 7f3a6dbf6640 1 --2- 172.21.15.5:0/107972266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a6815de80 0x7f3a680ceda0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097a0 tx=0x7f3a6402a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c73453515bc5e53c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.774+0000 7f3a6cbf4640 1 -- 172.21.15.5:0/107972266 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64037070 con 0x7f3a6815de80 2024-04-25T09:06:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.774+0000 7f3a6cbf4640 1 -- 172.21.15.5:0/107972266 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6402aad0 con 0x7f3a6815de80 2024-04-25T09:06:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.774+0000 7f3a6cbf4640 1 -- 172.21.15.5:0/107972266 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a600019f0 con 0x7f3a6815de80 2024-04-25T09:06:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.775+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/107972266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a6815de80 msgr2=0x7f3a680ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.775+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/107972266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a6815de80 0x7f3a680ceda0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097a0 tx=0x7f3a6402a040 comp rx=0 tx=0).stop 2024-04-25T09:06:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.775+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/107972266 shutdown_connections 2024-04-25T09:06:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.775+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/107972266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a6815de80 0x7f3a680ceda0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.775+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/107972266 >> 172.21.15.5:0/107972266 conn(0x7f3a6806b000 msgr2=0x7f3a6806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.775+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/107972266 shutdown_connections 2024-04-25T09:06:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.775+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/107972266 wait complete. 2024-04-25T09:06:36.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.776+0000 7f3a6fe5a640 1 Processor -- start 2024-04-25T09:06:36.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.776+0000 7f3a6fe5a640 1 -- start start 2024-04-25T09:06:36.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6fe5a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3a680ce1c0 0x7f3a6815e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6fe5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2dc0 0x7f3a681f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6fe5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6815de80 0x7f3a680b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6fe5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680b7400 con 0x7f3a6815de80 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6fe5a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680d1b80 con 0x7f3a680d2dc0 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6fe5a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680b7580 con 0x7f3a680ce1c0 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6815de80 0x7f3a680b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6815de80 0x7f3a680b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55250/0 (socket says 172.21.15.5:55250) 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 -- 172.21.15.5:0/655897124 learned_addr learned my addr 172.21.15.5:0/655897124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6d3f5640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2dc0 0x7f3a681f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6dbf6640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3a680ce1c0 0x7f3a6815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 -- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3a680ce1c0 msgr2=0x7f3a6815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3a680ce1c0 0x7f3a6815e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 -- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2dc0 msgr2=0x7f3a681f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2dc0 0x7f3a681f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 -- 172.21.15.5:0/655897124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680b1f50 con 0x7f3a6815de80 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6e3f7640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6815de80 0x7f3a680b1a10 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c8c0 tx=0x7f3a6000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a5e7fc640 1 -- 172.21.15.5:0/655897124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60018070 con 0x7f3a6815de80 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a5e7fc640 1 -- 172.21.15.5:0/655897124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000a640 con 0x7f3a6815de80 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.777+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a68160c80 con 0x7f3a6815de80 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.778+0000 7f3a5e7fc640 1 -- 172.21.15.5:0/655897124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000aa10 con 0x7f3a6815de80 2024-04-25T09:06:36.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.778+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68161240 con 0x7f3a6815de80 2024-04-25T09:06:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.779+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6804ef20 con 0x7f3a6815de80 2024-04-25T09:06:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.779+0000 7f3a5e7fc640 1 -- 172.21.15.5:0/655897124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a6001b070 con 0x7f3a6815de80 2024-04-25T09:06:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.779+0000 7f3a5e7fc640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3a4c06b4d0 0x7f3a4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.779+0000 7f3a5e7fc640 1 -- 172.21.15.5:0/655897124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3a600897d0 con 0x7f3a6815de80 2024-04-25T09:06:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.780+0000 7f3a6dbf6640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3a4c06b4d0 0x7f3a4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.780+0000 7f3a6dbf6640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3a4c06b4d0 0x7f3a4c06d990 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3a64034000 tx=0x7f3a6402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.784+0000 7f3a5e7fc640 1 -- 172.21.15.5:0/655897124 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a60058070 con 0x7f3a6815de80 2024-04-25T09:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.963+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a680b4a70 con 0x7f3a6815de80 2024-04-25T09:06:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.963+0000 7f3a5e7fc640 1 -- 172.21.15.5:0/655897124 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v140) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a6005c110 con 0x7f3a6815de80 2024-04-25T09:06:36.952 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3a4c06b4d0 msgr2=0x7f3a4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3a4c06b4d0 0x7f3a4c06d990 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3a64034000 tx=0x7f3a6402e000 comp rx=0 tx=0).stop 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6815de80 msgr2=0x7f3a680b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6815de80 0x7f3a680b1a10 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c8c0 tx=0x7f3a6000cd80 comp rx=0 tx=0).stop 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 shutdown_connections 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3a4c06b4d0 0x7f3a4c06d990 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6815de80 0x7f3a680b1a10 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2dc0 0x7f3a681f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 --2- 172.21.15.5:0/655897124 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3a680ce1c0 0x7f3a6815e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 >> 172.21.15.5:0/655897124 conn(0x7f3a6806b000 msgr2=0x7f3a680cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 shutdown_connections 2024-04-25T09:06:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:36.966+0000 7f3a6fe5a640 1 -- 172.21.15.5:0/655897124 wait complete. 2024-04-25T09:06:36.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:06:37.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.078+0000 7f6a73ec4640 1 Processor -- start 2024-04-25T09:06:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.078+0000 7f6a73ec4640 1 -- start start 2024-04-25T09:06:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.079+0000 7f6a73ec4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a6c071b00 0x7f6a6c1655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.079+0000 7f6a73ec4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c06f160 con 0x7f6a6c0b45e0 2024-04-25T09:06:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.079+0000 7f6a73ec4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0b3820 con 0x7f6a6c0afe80 2024-04-25T09:06:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.079+0000 7f6a73ec4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c0b0260 con 0x7f6a6c071b00 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.079+0000 7f6a7145f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6a6c0b45e0 0x7f6a6c0713f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48950/0 (socket says 172.21.15.5:48950) 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.079+0000 7f6a7145f640 1 -- 172.21.15.5:0/776715217 learned_addr learned my addr 172.21.15.5:0/776715217 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.079+0000 7f6a72461640 1 --2- 172.21.15.5:0/776715217 >> v2:172.21.15.80:3300/0 conn(0x7f6a6c071b00 0x7f6a6c1655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.080+0000 7f6a70c5e640 1 -- 172.21.15.5:0/776715217 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058732957 0 0) 0x7f6a6c06f160 con 0x7f6a6c0b45e0 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.080+0000 7f6a70c5e640 1 -- 172.21.15.5:0/776715217 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a58003520 con 0x7f6a6c0b45e0 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.080+0000 7f6a72461640 1 -- 172.21.15.5:0/776715217 >> v1:172.21.15.80:6789/0 conn(0x7f6a6c0afe80 legacy=0x7f6a6c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.080+0000 7f6a72461640 1 -- 172.21.15.5:0/776715217 >> v1:172.21.15.5:6789/0 conn(0x7f6a6c0b45e0 legacy=0x7f6a6c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.080+0000 7f6a72461640 1 -- 172.21.15.5:0/776715217 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0b3b00 con 0x7f6a6c071b00 2024-04-25T09:06:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a72461640 1 --2- 172.21.15.5:0/776715217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 0x7f6a6c1655c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6a640097a0 tx=0x7f6a6402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741c8607a8d65403 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a70c5e640 1 -- 172.21.15.5:0/776715217 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64037070 con 0x7f6a6c071b00 2024-04-25T09:06:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a70c5e640 1 -- 172.21.15.5:0/776715217 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64032440 con 0x7f6a6c071b00 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a70c5e640 1 -- 172.21.15.5:0/776715217 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64032810 con 0x7f6a6c071b00 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a73ec4640 1 -- 172.21.15.5:0/776715217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 msgr2=0x7f6a6c1655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/776715217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 0x7f6a6c1655c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6a640097a0 tx=0x7f6a6402a230 comp rx=0 tx=0).stop 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a73ec4640 1 -- 172.21.15.5:0/776715217 shutdown_connections 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/776715217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 0x7f6a6c1655c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a73ec4640 1 -- 172.21.15.5:0/776715217 >> 172.21.15.5:0/776715217 conn(0x7f6a6c0d0870 msgr2=0x7f6a6c0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a73ec4640 1 -- 172.21.15.5:0/776715217 shutdown_connections 2024-04-25T09:06:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.081+0000 7f6a73ec4640 1 -- 172.21.15.5:0/776715217 wait complete. 2024-04-25T09:06:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 Processor -- start 2024-04-25T09:06:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 -- start start 2024-04-25T09:06:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 0x7f6a6c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6c0afe80 0x7f6a6c1424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6c0b45e0 0x7f6a6c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c15f2b0 con 0x7f6a6c0afe80 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0b40c0 con 0x7f6a6c071b00 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a73ec4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c06ed20 con 0x7f6a6c0b45e0 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a7145f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6c0afe80 0x7f6a6c1424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a7145f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6c0afe80 0x7f6a6c1424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55262/0 (socket says 172.21.15.5:55262) 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a7145f640 1 -- 172.21.15.5:0/2660768600 learned_addr learned my addr 172.21.15.5:0/2660768600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.083+0000 7f6a71c60640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 0x7f6a6c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a72461640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6c0b45e0 0x7f6a6c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a7145f640 1 -- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6c0b45e0 msgr2=0x7f6a6c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a7145f640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6c0b45e0 0x7f6a6c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a7145f640 1 -- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 msgr2=0x7f6a6c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a7145f640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 0x7f6a6c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a7145f640 1 -- 172.21.15.5:0/2660768600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c151820 con 0x7f6a6c0afe80 2024-04-25T09:06:37.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a7145f640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6c0afe80 0x7f6a6c1424b0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c500 tx=0x7f6a5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a627fc640 1 -- 172.21.15.5:0/2660768600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c017070 con 0x7f6a6c0afe80 2024-04-25T09:06:37.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a627fc640 1 -- 172.21.15.5:0/2660768600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c005ce0 con 0x7f6a6c0afe80 2024-04-25T09:06:37.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c151b00 con 0x7f6a6c0afe80 2024-04-25T09:06:37.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a627fc640 1 -- 172.21.15.5:0/2660768600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c007330 con 0x7f6a6c0afe80 2024-04-25T09:06:37.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.084+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c1520c0 con 0x7f6a6c0afe80 2024-04-25T09:06:37.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.085+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c0af9c0 con 0x7f6a6c0afe80 2024-04-25T09:06:37.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.086+0000 7f6a627fc640 1 -- 172.21.15.5:0/2660768600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a5c01a070 con 0x7f6a6c0afe80 2024-04-25T09:06:37.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.086+0000 7f6a627fc640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b4d0 0x7f6a5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.086+0000 7f6a627fc640 1 -- 172.21.15.5:0/2660768600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6a5c089610 con 0x7f6a6c0afe80 2024-04-25T09:06:37.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.086+0000 7f6a71c60640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b4d0 0x7f6a5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.087+0000 7f6a71c60640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b4d0 0x7f6a5006d990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6a68001e70 tx=0x7f6a68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.090+0000 7f6a627fc640 1 -- 172.21.15.5:0/2660768600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a6c0af9c0 con 0x7f6a6c0afe80 2024-04-25T09:06:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.283+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a6c04ef20 con 0x7f6a6c0afe80 2024-04-25T09:06:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.283+0000 7f6a627fc640 1 -- 172.21.15.5:0/2660768600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a5c057f70 con 0x7f6a6c0afe80 2024-04-25T09:06:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b4d0 msgr2=0x7f6a5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b4d0 0x7f6a5006d990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6a68001e70 tx=0x7f6a68009040 comp rx=0 tx=0).stop 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6c0afe80 msgr2=0x7f6a6c1424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6c0afe80 0x7f6a6c1424b0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c500 tx=0x7f6a5c00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 shutdown_connections 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f6a5006b4d0 0x7f6a5006d990 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6a6c0b45e0 0x7f6a6c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a6c0afe80 0x7f6a6c1424b0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 --2- 172.21.15.5:0/2660768600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a6c071b00 0x7f6a6c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 >> 172.21.15.5:0/2660768600 conn(0x7f6a6c0d0870 msgr2=0x7f6a6c06db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 shutdown_connections 2024-04-25T09:06:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:37.285+0000 7f6a73ec4640 1 -- 172.21.15.5:0/2660768600 wait complete. 2024-04-25T09:06:37.284 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:06:37.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:37.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:37.897 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:06:37.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:37.897 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:06:37.912 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:37.912 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:37.929 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:37.929 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:37.930 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:37.967 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:37.968 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:37.968 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:37.986 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:37.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.121+0000 7effe63a5640 1 Processor -- start 2024-04-25T09:06:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.121+0000 7effe63a5640 1 -- start start 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effe63a5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effe0154f10 0x7effe00b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effe63a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7effe00cfc90 0x7effe0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effe63a5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe00b3f30 con 0x7effe015bbd0 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effe63a5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe015b0f0 con 0x7effe0154f10 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effe63a5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe015b3d0 con 0x7effe00cfc90 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effdffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effe0154f10 0x7effe00b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effdffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effe0154f10 0x7effe00b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55276/0 (socket says 172.21.15.5:55276) 2024-04-25T09:06:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effdffff640 1 -- 172.21.15.5:0/3222370308 learned_addr learned my addr 172.21.15.5:0/3222370308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effdffff640 1 -- 172.21.15.5:0/3222370308 >> v2:172.21.15.80:3300/0 conn(0x7effe00cfc90 msgr2=0x7effe0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effdffff640 1 --2- 172.21.15.5:0/3222370308 >> v2:172.21.15.80:3300/0 conn(0x7effe00cfc90 0x7effe0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effdffff640 1 -- 172.21.15.5:0/3222370308 >> v1:172.21.15.80:6789/0 conn(0x7effe015bbd0 legacy=0x7effe00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.122+0000 7effdffff640 1 -- 172.21.15.5:0/3222370308 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe01552f0 con 0x7effe0154f10 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.123+0000 7effdffff640 1 --2- 172.21.15.5:0/3222370308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe0154f10 0x7effe00b3470 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7effe00b4c10 tx=0x7effd002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5085ff3dd859db1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.123+0000 7effdeffd640 1 -- 172.21.15.5:0/3222370308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0037070 con 0x7effe0154f10 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.123+0000 7effdeffd640 1 -- 172.21.15.5:0/3222370308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd0032440 con 0x7effe0154f10 2024-04-25T09:06:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.123+0000 7effdeffd640 1 -- 172.21.15.5:0/3222370308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0032810 con 0x7effe0154f10 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.123+0000 7effe63a5640 1 -- 172.21.15.5:0/3222370308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe0154f10 msgr2=0x7effe00b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.123+0000 7effe63a5640 1 --2- 172.21.15.5:0/3222370308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe0154f10 0x7effe00b3470 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7effe00b4c10 tx=0x7effd002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.124+0000 7effe63a5640 1 -- 172.21.15.5:0/3222370308 shutdown_connections 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.124+0000 7effe63a5640 1 --2- 172.21.15.5:0/3222370308 >> v2:172.21.15.80:3300/0 conn(0x7effe00cfc90 0x7effe0070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.124+0000 7effe63a5640 1 --2- 172.21.15.5:0/3222370308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe0154f10 0x7effe00b3470 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.124+0000 7effe63a5640 1 -- 172.21.15.5:0/3222370308 >> 172.21.15.5:0/3222370308 conn(0x7effe00668f0 msgr2=0x7effe0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.124+0000 7effe63a5640 1 -- 172.21.15.5:0/3222370308 shutdown_connections 2024-04-25T09:06:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.124+0000 7effe63a5640 1 -- 172.21.15.5:0/3222370308 wait complete. 2024-04-25T09:06:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.125+0000 7effe63a5640 1 Processor -- start 2024-04-25T09:06:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.125+0000 7effe63a5640 1 -- start start 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe63a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe00cfc90 0x7effe014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe63a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effe0154f10 0x7effe01e5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe63a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effe015bbd0 0x7effe01e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe63a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00b3b30 con 0x7effe00cfc90 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe63a5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00b39b0 con 0x7effe0154f10 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe63a5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00b3cb0 con 0x7effe015bbd0 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe00cfc90 0x7effe014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe00cfc90 0x7effe014a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55284/0 (socket says 172.21.15.5:55284) 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 -- 172.21.15.5:0/3738306443 learned_addr learned my addr 172.21.15.5:0/3738306443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe4942640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effe015bbd0 0x7effe01e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdf7fe640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effe0154f10 0x7effe01e5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 -- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effe015bbd0 msgr2=0x7effe01e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effe015bbd0 0x7effe01e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 -- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effe0154f10 msgr2=0x7effe01e5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effe0154f10 0x7effe01e5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 -- 172.21.15.5:0/3738306443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe014acd0 con 0x7effe00cfc90 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdf7fe640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effe0154f10 0x7effe01e5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe4942640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effe015bbd0 0x7effe01e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdffff640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe00cfc90 0x7effe014a790 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7effd002a1e0 tx=0x7effd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdcff9640 1 -- 172.21.15.5:0/3738306443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0041070 con 0x7effe00cfc90 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdcff9640 1 -- 172.21.15.5:0/3738306443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd003c870 con 0x7effe00cfc90 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effdcff9640 1 -- 172.21.15.5:0/3738306443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0037040 con 0x7effe00cfc90 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.126+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe01e4540 con 0x7effe00cfc90 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.127+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe01e4b00 con 0x7effe00cfc90 2024-04-25T09:06:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.128+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe004ef20 con 0x7effe00cfc90 2024-04-25T09:06:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.128+0000 7effdcff9640 1 -- 172.21.15.5:0/3738306443 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effd0044070 con 0x7effe00cfc90 2024-04-25T09:06:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.128+0000 7effdcff9640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effcc06b4d0 0x7effcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.128+0000 7effdcff9640 1 -- 172.21.15.5:0/3738306443 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7effd00aae10 con 0x7effe00cfc90 2024-04-25T09:06:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.129+0000 7effdf7fe640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effcc06b4d0 0x7effcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.129+0000 7effdf7fe640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effcc06b4d0 0x7effcc06d990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7effe00b30e0 tx=0x7effd4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.133+0000 7effdcff9640 1 -- 172.21.15.5:0/3738306443 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effd0079e20 con 0x7effe00cfc90 2024-04-25T09:06:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.350+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effe00cfa70 con 0x7effe00cfc90 2024-04-25T09:06:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.350+0000 7effdcff9640 1 -- 172.21.15.5:0/3738306443 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7effd0079720 con 0x7effe00cfc90 2024-04-25T09:06:38.339 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:38.339 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:06:14.788729+0000","modified":"2024-04-25T09:06:34.609102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9591":{"gid":9591,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6833/1089300174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1089300174},{"type":"v1","addr":"172.21.15.5:6833","nonce":1089300174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9597":{"gid":9597,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1713726638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1713726638},{"type":"v1","addr":"172.21.15.5:6835","nonce":1713726638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:06:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2024-04-25T09:06:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.352+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effcc06b4d0 msgr2=0x7effcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.352+0000 7effe63a5640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effcc06b4d0 0x7effcc06d990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7effe00b30e0 tx=0x7effd4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.352+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe00cfc90 msgr2=0x7effe014a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.352+0000 7effe63a5640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe00cfc90 0x7effe014a790 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7effd002a1e0 tx=0x7effd00046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.352+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 shutdown_connections 2024-04-25T09:06:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.352+0000 7effe63a5640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7effcc06b4d0 0x7effcc06d990 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.353+0000 7effe63a5640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7effe015bbd0 0x7effe01e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.353+0000 7effe63a5640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effe0154f10 0x7effe01e5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.353+0000 7effe63a5640 1 --2- 172.21.15.5:0/3738306443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effe00cfc90 0x7effe014a790 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.353+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 >> 172.21.15.5:0/3738306443 conn(0x7effe00668f0 msgr2=0x7effe0159990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.353+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 shutdown_connections 2024-04-25T09:06:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.353+0000 7effe63a5640 1 -- 172.21.15.5:0/3738306443 wait complete. 2024-04-25T09:06:38.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.467+0000 7f29b1c4a640 1 Processor -- start 2024-04-25T09:06:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.467+0000 7f29b1c4a640 1 -- start start 2024-04-25T09:06:38.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29b1c4a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29ac15e0a0 0x7f29ac0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29b1c4a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29ac0d3df0 0x7f29ac0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29b1c4a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac0b7f60 con 0x7f29ac0d3990 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29b1c4a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac0b29c0 con 0x7f29ac15e0a0 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29b1c4a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac0d2080 con 0x7f29ac0d3df0 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29ab7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29ac15e0a0 0x7f29ac0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29ab7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29ac15e0a0 0x7f29ac0d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55288/0 (socket says 172.21.15.5:55288) 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29ab7fe640 1 -- 172.21.15.5:0/772218166 learned_addr learned my addr 172.21.15.5:0/772218166 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29abfff640 1 --2- 172.21.15.5:0/772218166 >> v2:172.21.15.80:3300/0 conn(0x7f29ac0d3df0 0x7f29ac0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29ab7fe640 1 -- 172.21.15.5:0/772218166 >> v2:172.21.15.80:3300/0 conn(0x7f29ac0d3df0 msgr2=0x7f29ac0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29ab7fe640 1 --2- 172.21.15.5:0/772218166 >> v2:172.21.15.80:3300/0 conn(0x7f29ac0d3df0 0x7f29ac0cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29ab7fe640 1 -- 172.21.15.5:0/772218166 >> v1:172.21.15.80:6789/0 conn(0x7f29ac0d3990 legacy=0x7f29ac0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.468+0000 7f29ab7fe640 1 -- 172.21.15.5:0/772218166 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0d2360 con 0x7f29ac15e0a0 2024-04-25T09:06:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.469+0000 7f29ab7fe640 1 --2- 172.21.15.5:0/772218166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0d0d50 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0b34f0 tx=0x7f299c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288e1cb471c55693 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.469+0000 7f29aa7fc640 1 -- 172.21.15.5:0/772218166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c037070 con 0x7f29ac15e0a0 2024-04-25T09:06:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.469+0000 7f29aa7fc640 1 -- 172.21.15.5:0/772218166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c032440 con 0x7f29ac15e0a0 2024-04-25T09:06:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.469+0000 7f29aa7fc640 1 -- 172.21.15.5:0/772218166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c032810 con 0x7f29ac15e0a0 2024-04-25T09:06:38.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 -- 172.21.15.5:0/772218166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 msgr2=0x7f29ac0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/772218166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0d0d50 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0b34f0 tx=0x7f299c02a270 comp rx=0 tx=0).stop 2024-04-25T09:06:38.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 -- 172.21.15.5:0/772218166 shutdown_connections 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/772218166 >> v2:172.21.15.80:3300/0 conn(0x7f29ac0d3df0 0x7f29ac0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/772218166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0d0d50 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 -- 172.21.15.5:0/772218166 >> 172.21.15.5:0/772218166 conn(0x7f29ac0668f0 msgr2=0x7f29ac066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 -- 172.21.15.5:0/772218166 shutdown_connections 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.470+0000 7f29b1c4a640 1 -- 172.21.15.5:0/772218166 wait complete. 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.471+0000 7f29b1c4a640 1 Processor -- start 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.471+0000 7f29b1c4a640 1 -- start start 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29b1c4a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29ac0d3990 0x7f29ac159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29b1c4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29ac0d3df0 0x7f29ac14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29b1c4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29b1c4a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0d2c00 con 0x7f29ac15e0a0 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29b1c4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0d2920 con 0x7f29ac0d3df0 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29b1c4a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0d4280 con 0x7f29ac0d3990 2024-04-25T09:06:38.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55300/0 (socket says 172.21.15.5:55300) 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 -- 172.21.15.5:0/697588072 learned_addr learned my addr 172.21.15.5:0/697588072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29ab7fe640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29ac0d3990 0x7f29ac159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29aaffd640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29ac0d3df0 0x7f29ac14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 -- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29ac0d3990 msgr2=0x7f29ac159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29ac0d3990 0x7f29ac159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 -- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29ac0d3df0 msgr2=0x7f29ac14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29ac0d3df0 0x7f29ac14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.472+0000 7f29abfff640 1 -- 172.21.15.5:0/697588072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0cbf50 con 0x7f29ac15e0a0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.473+0000 7f29abfff640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0cb550 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f29a4007e90 tx=0x7f29a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.473+0000 7f2993fff640 1 -- 172.21.15.5:0/697588072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4014420 con 0x7f29ac15e0a0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.473+0000 7f2993fff640 1 -- 172.21.15.5:0/697588072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4019070 con 0x7f29ac15e0a0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.473+0000 7f2993fff640 1 -- 172.21.15.5:0/697588072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4014800 con 0x7f29ac15e0a0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.473+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac0c7730 con 0x7f29ac15e0a0 2024-04-25T09:06:38.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.473+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac0c7cf0 con 0x7f29ac15e0a0 2024-04-25T09:06:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.474+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac0b9520 con 0x7f29ac15e0a0 2024-04-25T09:06:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.474+0000 7f2993fff640 1 -- 172.21.15.5:0/697588072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29a40149a0 con 0x7f29ac15e0a0 2024-04-25T09:06:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.475+0000 7f2993fff640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f299806b4d0 0x7f299806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.475+0000 7f2993fff640 1 -- 172.21.15.5:0/697588072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f29a408a8d0 con 0x7f29ac15e0a0 2024-04-25T09:06:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.475+0000 7f29ab7fe640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f299806b4d0 0x7f299806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.476+0000 7f29ab7fe640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f299806b4d0 0x7f299806d990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f299c034000 tx=0x7f299c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.479+0000 7f2993fff640 1 -- 172.21.15.5:0/697588072 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29ac0b9520 con 0x7f29ac15e0a0 2024-04-25T09:06:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.663+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29ac0c7ef0 con 0x7f29ac15e0a0 2024-04-25T09:06:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.664+0000 7f2993fff640 1 -- 172.21.15.5:0/697588072 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16644 (secure 0 0 0) 0x7f29ac0c7ef0 con 0x7f29ac15e0a0 2024-04-25T09:06:38.652 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":140,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:29.582257+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:13.105023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:13.759633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f299806b4d0 msgr2=0x7f299806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f299806b4d0 0x7f299806d990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f299c034000 tx=0x7f299c02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 msgr2=0x7f29ac0cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0cb550 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f29a4007e90 tx=0x7f29a400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 shutdown_connections 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f299806b4d0 0x7f299806d990 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ac15e0a0 0x7f29ac0cb550 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29ac0d3df0 0x7f29ac14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 --2- 172.21.15.5:0/697588072 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29ac0d3990 0x7f29ac159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 >> 172.21.15.5:0/697588072 conn(0x7f29ac0668f0 msgr2=0x7f29ac0c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 shutdown_connections 2024-04-25T09:06:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.666+0000 7f29b1c4a640 1 -- 172.21.15.5:0/697588072 wait complete. 2024-04-25T09:06:38.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:56:32.432002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:13.105023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:13.759633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:38.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:38.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.782+0000 7f90a31e7640 1 Processor -- start 2024-04-25T09:06:38.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.782+0000 7f90a31e7640 1 -- start start 2024-04-25T09:06:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.782+0000 7f90a31e7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f909c1614b0 0x7f909c0b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.782+0000 7f90a31e7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f909c0d1f60 0x7f909c0d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.782+0000 7f90a31e7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0d2740 con 0x7f909c0d4060 2024-04-25T09:06:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.782+0000 7f90a31e7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c0d44b0 con 0x7f909c0d1f60 2024-04-25T09:06:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.782+0000 7f90a31e7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c0d2a20 con 0x7f909c1614b0 2024-04-25T09:06:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f909bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f909c0d1f60 0x7f909c0d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f909bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f909c0d1f60 0x7f909c0d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55304/0 (socket says 172.21.15.5:55304) 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f909bfff640 1 -- 172.21.15.5:0/3346538529 learned_addr learned my addr 172.21.15.5:0/3346538529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f909bfff640 1 -- 172.21.15.5:0/3346538529 >> v2:172.21.15.80:3300/0 conn(0x7f909c1614b0 msgr2=0x7f909c0b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f90a0f83640 1 --2- 172.21.15.5:0/3346538529 >> v2:172.21.15.80:3300/0 conn(0x7f909c1614b0 0x7f909c0b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f909bfff640 1 --2- 172.21.15.5:0/3346538529 >> v2:172.21.15.80:3300/0 conn(0x7f909c1614b0 0x7f909c0b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f909bfff640 1 -- 172.21.15.5:0/3346538529 >> v1:172.21.15.80:6789/0 conn(0x7f909c0d4060 legacy=0x7f909c0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.783+0000 7f909bfff640 1 -- 172.21.15.5:0/3346538529 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0d2d00 con 0x7f909c0d1f60 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f909bfff640 1 --2- 172.21.15.5:0/3346538529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d1f60 0x7f909c0d3b20 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f909c08ca90 tx=0x7f908402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24233c2c7a23159 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f909b7fe640 1 -- 172.21.15.5:0/3346538529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084037070 con 0x7f909c0d1f60 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f909b7fe640 1 -- 172.21.15.5:0/3346538529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9084032440 con 0x7f909c0d1f60 2024-04-25T09:06:38.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f909b7fe640 1 -- 172.21.15.5:0/3346538529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084032810 con 0x7f909c0d1f60 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 -- 172.21.15.5:0/3346538529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d1f60 msgr2=0x7f909c0d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 --2- 172.21.15.5:0/3346538529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d1f60 0x7f909c0d3b20 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f909c08ca90 tx=0x7f908402a230 comp rx=0 tx=0).stop 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 -- 172.21.15.5:0/3346538529 shutdown_connections 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 --2- 172.21.15.5:0/3346538529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d1f60 0x7f909c0d3b20 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 --2- 172.21.15.5:0/3346538529 >> v2:172.21.15.80:3300/0 conn(0x7f909c1614b0 0x7f909c0b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 -- 172.21.15.5:0/3346538529 >> 172.21.15.5:0/3346538529 conn(0x7f909c06b000 msgr2=0x7f909c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 -- 172.21.15.5:0/3346538529 shutdown_connections 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.784+0000 7f90a31e7640 1 -- 172.21.15.5:0/3346538529 wait complete. 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 Processor -- start 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 -- start start 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f909c0d1f60 0x7f909c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d4060 0x7f909c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909c1614b0 0x7f909c1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0d37e0 con 0x7f909c0d4060 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0d32c0 con 0x7f909c1614b0 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.786+0000 7f90a31e7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0d23a0 con 0x7f909c0d1f60 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d4060 0x7f909c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d4060 0x7f909c152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55308/0 (socket says 172.21.15.5:55308) 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 -- 172.21.15.5:0/2477982014 learned_addr learned my addr 172.21.15.5:0/2477982014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90a0f83640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f909c0d1f60 0x7f909c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90a1784640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909c1614b0 0x7f909c1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 -- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f909c0d1f60 msgr2=0x7f909c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f909c0d1f60 0x7f909c15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 -- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909c1614b0 msgr2=0x7f909c1574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909c1614b0 0x7f909c1574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 -- 172.21.15.5:0/2477982014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c15b780 con 0x7f909c0d4060 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90a0f83640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f909c0d1f60 0x7f909c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90a1784640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909c1614b0 0x7f909c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f909bfff640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d4060 0x7f909c152d80 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f9084000c00 tx=0x7f90840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90997fa640 1 -- 172.21.15.5:0/2477982014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084041020 con 0x7f909c0d4060 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90997fa640 1 -- 172.21.15.5:0/2477982014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9084030970 con 0x7f909c0d4060 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90997fa640 1 -- 172.21.15.5:0/2477982014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084037040 con 0x7f909c0d4060 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c155b20 con 0x7f909c0d4060 2024-04-25T09:06:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.787+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c0b4360 con 0x7f909c0d4060 2024-04-25T09:06:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.788+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c04ef20 con 0x7f909c0d4060 2024-04-25T09:06:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.789+0000 7f90997fa640 1 -- 172.21.15.5:0/2477982014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9084044020 con 0x7f909c0d4060 2024-04-25T09:06:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.789+0000 7f90997fa640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f907c06b4d0 0x7f907c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.789+0000 7f90997fa640 1 -- 172.21.15.5:0/2477982014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f90840aa960 con 0x7f909c0d4060 2024-04-25T09:06:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.789+0000 7f90a0f83640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f907c06b4d0 0x7f907c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.790+0000 7f90a0f83640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f907c06b4d0 0x7f907c06d990 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f909c15ff00 tx=0x7f90940075b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.794+0000 7f90997fa640 1 -- 172.21.15.5:0/2477982014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f908404b070 con 0x7f909c0d4060 2024-04-25T09:06:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.972+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f909c15f870 con 0x7f909c0d4060 2024-04-25T09:06:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.973+0000 7f90997fa640 1 -- 172.21.15.5:0/2477982014 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9084079730 con 0x7f909c0d4060 2024-04-25T09:06:38.961 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-25T09:06:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.974+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f907c06b4d0 msgr2=0x7f907c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.974+0000 7f90a31e7640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f907c06b4d0 0x7f907c06d990 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f909c15ff00 tx=0x7f90940075b0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.974+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d4060 msgr2=0x7f909c152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.974+0000 7f90a31e7640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d4060 0x7f909c152d80 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f9084000c00 tx=0x7f90840046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 shutdown_connections 2024-04-25T09:06:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f907c06b4d0 0x7f907c06d990 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f909c1614b0 0x7f909c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f909c0d4060 0x7f909c152d80 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 --2- 172.21.15.5:0/2477982014 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f909c0d1f60 0x7f909c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 >> 172.21.15.5:0/2477982014 conn(0x7f909c06b000 msgr2=0x7f909c160430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 shutdown_connections 2024-04-25T09:06:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:38.975+0000 7f90a31e7640 1 -- 172.21.15.5:0/2477982014 wait complete. 2024-04-25T09:06:38.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.090+0000 7f7e1217e640 1 Processor -- start 2024-04-25T09:06:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.090+0000 7f7e1217e640 1 -- start start 2024-04-25T09:06:39.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.090+0000 7f7e1217e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e0c1614b0 0x7f7e0c0b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.090+0000 7f7e1217e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c0d4230 0x7f7e0c0b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.090+0000 7f7e1217e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0d2740 con 0x7f7e0c0d1f60 2024-04-25T09:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.090+0000 7f7e1217e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c0d2a20 con 0x7f7e0c1614b0 2024-04-25T09:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.090+0000 7f7e1217e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0d2d00 con 0x7f7e0c0d4230 2024-04-25T09:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e0c0d1f60 0x7f7e0c0d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48964/0 (socket says 172.21.15.5:48964) 2024-04-25T09:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0affd640 1 -- 172.21.15.5:0/978708632 learned_addr learned my addr 172.21.15.5:0/978708632 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0bfff640 1 --2- 172.21.15.5:0/978708632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c0d4230 0x7f7e0c0b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0b7fe640 1 --2- 172.21.15.5:0/978708632 >> v2:172.21.15.80:3300/0 conn(0x7f7e0c1614b0 0x7f7e0c0b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0a7fc640 1 -- 172.21.15.5:0/978708632 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534808928 0 0) 0x7f7e0c0d2740 con 0x7f7e0c0d1f60 2024-04-25T09:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0a7fc640 1 -- 172.21.15.5:0/978708632 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003520 con 0x7f7e0c0d1f60 2024-04-25T09:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0bfff640 1 -- 172.21.15.5:0/978708632 >> v2:172.21.15.80:3300/0 conn(0x7f7e0c1614b0 msgr2=0x7f7e0c0b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0bfff640 1 --2- 172.21.15.5:0/978708632 >> v2:172.21.15.80:3300/0 conn(0x7f7e0c1614b0 0x7f7e0c0b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0bfff640 1 -- 172.21.15.5:0/978708632 >> v1:172.21.15.5:6789/0 conn(0x7f7e0c0d1f60 legacy=0x7f7e0c0d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.091+0000 7f7e0bfff640 1 -- 172.21.15.5:0/978708632 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0d2fe0 con 0x7f7e0c0d4230 2024-04-25T09:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.092+0000 7f7e0bfff640 1 --2- 172.21.15.5:0/978708632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c0d4230 0x7f7e0c0b6cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009d90 tx=0x7f7e0402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=140f641cacaddbf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.092+0000 7f7e0a7fc640 1 -- 172.21.15.5:0/978708632 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007740 con 0x7f7e0c0d4230 2024-04-25T09:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.092+0000 7f7e0a7fc640 1 -- 172.21.15.5:0/978708632 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040078e0 con 0x7f7e0c0d4230 2024-04-25T09:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.092+0000 7f7e0a7fc640 1 -- 172.21.15.5:0/978708632 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007c90 con 0x7f7e0c0d4230 2024-04-25T09:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 -- 172.21.15.5:0/978708632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c0d4230 msgr2=0x7f7e0c0b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 --2- 172.21.15.5:0/978708632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c0d4230 0x7f7e0c0b6cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009d90 tx=0x7f7e0402a660 comp rx=0 tx=0).stop 2024-04-25T09:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 -- 172.21.15.5:0/978708632 shutdown_connections 2024-04-25T09:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 --2- 172.21.15.5:0/978708632 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c0d4230 0x7f7e0c0b6cc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 --2- 172.21.15.5:0/978708632 >> v2:172.21.15.80:3300/0 conn(0x7f7e0c1614b0 0x7f7e0c0b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 -- 172.21.15.5:0/978708632 >> 172.21.15.5:0/978708632 conn(0x7f7e0c06b000 msgr2=0x7f7e0c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 -- 172.21.15.5:0/978708632 shutdown_connections 2024-04-25T09:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.093+0000 7f7e1217e640 1 -- 172.21.15.5:0/978708632 wait complete. 2024-04-25T09:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.094+0000 7f7e1217e640 1 Processor -- start 2024-04-25T09:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.094+0000 7f7e1217e640 1 -- start start 2024-04-25T09:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e1217e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0c0d1f60 0x7f7e0c0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e1217e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e0c0d4230 0x7f7e0c14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e1217e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c1614b0 0x7f7e0c0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e1217e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0d23a0 con 0x7f7e0c0d4230 2024-04-25T09:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e1217e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0d37e0 con 0x7f7e0c0d1f60 2024-04-25T09:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e1217e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0d2520 con 0x7f7e0c1614b0 2024-04-25T09:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e0c0d4230 0x7f7e0c14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e0c0d4230 0x7f7e0c14f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55322/0 (socket says 172.21.15.5:55322) 2024-04-25T09:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 -- 172.21.15.5:0/3088612287 learned_addr learned my addr 172.21.15.5:0/3088612287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0bfff640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c1614b0 0x7f7e0c0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0b7fe640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0c0d1f60 0x7f7e0c0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 -- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c1614b0 msgr2=0x7f7e0c0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c1614b0 0x7f7e0c0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 -- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0c0d1f60 msgr2=0x7f7e0c0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0c0d1f60 0x7f7e0c0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 -- 172.21.15.5:0/3088612287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0ccf00 con 0x7f7e0c0d4230 2024-04-25T09:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.095+0000 7f7e0affd640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e0c0d4230 0x7f7e0c14f270 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c4d0 tx=0x7f7e0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.096+0000 7f7df3fff640 1 -- 172.21.15.5:0/3088612287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00017070 con 0x7f7e0c0d4230 2024-04-25T09:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.096+0000 7f7df3fff640 1 -- 172.21.15.5:0/3088612287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00005d00 con 0x7f7e0c0d4230 2024-04-25T09:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.096+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c1f7650 con 0x7f7e0c0d4230 2024-04-25T09:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.096+0000 7f7df3fff640 1 -- 172.21.15.5:0/3088612287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000072b0 con 0x7f7e0c0d4230 2024-04-25T09:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.096+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c0b3880 con 0x7f7e0c0d4230 2024-04-25T09:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.096+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c04ef20 con 0x7f7e0c0d4230 2024-04-25T09:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.097+0000 7f7df3fff640 1 -- 172.21.15.5:0/3088612287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e0001a070 con 0x7f7e0c0d4230 2024-04-25T09:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.097+0000 7f7df3fff640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df806b4d0 0x7f7df806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.098+0000 7f7df3fff640 1 -- 172.21.15.5:0/3088612287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7e00089460 con 0x7f7e0c0d4230 2024-04-25T09:06:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.098+0000 7f7e0b7fe640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df806b4d0 0x7f7df806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.098+0000 7f7e0b7fe640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df806b4d0 0x7f7df806d990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0b7d50 tx=0x7f7dfc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.102+0000 7f7df3fff640 1 -- 172.21.15.5:0/3088612287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e00057d00 con 0x7f7e0c0d4230 2024-04-25T09:06:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.281+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e0c0718e0 con 0x7f7e0c0d4230 2024-04-25T09:06:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.282+0000 7f7df3fff640 1 -- 172.21.15.5:0/3088612287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v140) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e0005bda0 con 0x7f7e0c0d4230 2024-04-25T09:06:39.270 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-25T09:06:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.283+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df806b4d0 msgr2=0x7f7df806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.283+0000 7f7e1217e640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df806b4d0 0x7f7df806d990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0b7d50 tx=0x7f7dfc009190 comp rx=0 tx=0).stop 2024-04-25T09:06:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.283+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e0c0d4230 msgr2=0x7f7e0c14f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.283+0000 7f7e1217e640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e0c0d4230 0x7f7e0c14f270 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c4d0 tx=0x7f7e0000c990 comp rx=0 tx=0).stop 2024-04-25T09:06:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 shutdown_connections 2024-04-25T09:06:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7df806b4d0 0x7f7df806d990 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7e0c1614b0 0x7f7e0c0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e0c0d4230 0x7f7e0c14f270 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 --2- 172.21.15.5:0/3088612287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0c0d1f60 0x7f7e0c0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 >> 172.21.15.5:0/3088612287 conn(0x7f7e0c06b000 msgr2=0x7f7e0c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 shutdown_connections 2024-04-25T09:06:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.284+0000 7f7e1217e640 1 -- 172.21.15.5:0/3088612287 wait complete. 2024-04-25T09:06:39.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.398+0000 7f961984a640 1 Processor -- start 2024-04-25T09:06:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.398+0000 7f961984a640 1 -- start start 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f961984a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f9614066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f961984a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96140ae250 0x7f96140ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f961984a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140b3a00 con 0x7f961415dc00 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f961984a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96140b5b60 con 0x7f96140ae250 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f961984a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9614067290 con 0x7f96140668f0 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f96137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96140ae250 0x7f96140ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f96137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96140ae250 0x7f96140ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55328/0 (socket says 172.21.15.5:55328) 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f96137fe640 1 -- 172.21.15.5:0/3365741633 learned_addr learned my addr 172.21.15.5:0/3365741633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.399+0000 7f96127fc640 1 --2- 172.21.15.5:0/3365741633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f9614066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.400+0000 7f96137fe640 1 -- 172.21.15.5:0/3365741633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 msgr2=0x7f9614066d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.400+0000 7f96137fe640 1 --2- 172.21.15.5:0/3365741633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f9614066d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.400+0000 7f96137fe640 1 -- 172.21.15.5:0/3365741633 >> v1:172.21.15.80:6789/0 conn(0x7f961415dc00 legacy=0x7f96140b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.400+0000 7f96137fe640 1 -- 172.21.15.5:0/3365741633 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140b3ce0 con 0x7f96140ae250 2024-04-25T09:06:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.400+0000 7f96137fe640 1 --2- 172.21.15.5:0/3365741633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96140ae250 0x7f96140ae6e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f9604009e50 tx=0x7f960402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12564ffb77e125a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.400+0000 7f9611ffb640 1 -- 172.21.15.5:0/3365741633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604036070 con 0x7f96140ae250 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f9611ffb640 1 -- 172.21.15.5:0/3365741633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604031600 con 0x7f96140ae250 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f9611ffb640 1 -- 172.21.15.5:0/3365741633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040319d0 con 0x7f96140ae250 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 -- 172.21.15.5:0/3365741633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96140ae250 msgr2=0x7f96140ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 --2- 172.21.15.5:0/3365741633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96140ae250 0x7f96140ae6e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f9604009e50 tx=0x7f960402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 -- 172.21.15.5:0/3365741633 shutdown_connections 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 --2- 172.21.15.5:0/3365741633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96140ae250 0x7f96140ae6e0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 --2- 172.21.15.5:0/3365741633 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f9614066d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 -- 172.21.15.5:0/3365741633 >> 172.21.15.5:0/3365741633 conn(0x7f96140b2560 msgr2=0x7f96140b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 -- 172.21.15.5:0/3365741633 shutdown_connections 2024-04-25T09:06:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.401+0000 7f961984a640 1 -- 172.21.15.5:0/3365741633 wait complete. 2024-04-25T09:06:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.402+0000 7f961984a640 1 Processor -- start 2024-04-25T09:06:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f961984a640 1 -- start start 2024-04-25T09:06:39.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f961984a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f96140cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f961984a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96140ae250 0x7f9614149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f961984a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961415dc00 0x7f961415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f961984a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961406d450 con 0x7f961415dc00 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f961984a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614072410 con 0x7f96140ae250 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f961984a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961415dfe0 con 0x7f96140668f0 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f96137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961415dc00 0x7f961415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f96137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961415dc00 0x7f961415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55336/0 (socket says 172.21.15.5:55336) 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.403+0000 7f96137fe640 1 -- 172.21.15.5:0/3135175164 learned_addr learned my addr 172.21.15.5:0/3135175164 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f96127fc640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96140ae250 0x7f9614149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f9612ffd640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f96140cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f96137fe640 1 -- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 msgr2=0x7f96140cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f96137fe640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f96140cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f96137fe640 1 -- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96140ae250 msgr2=0x7f9614149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f96137fe640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96140ae250 0x7f9614149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f96137fe640 1 -- 172.21.15.5:0/3135175164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961415b7f0 con 0x7f961415dc00 2024-04-25T09:06:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f9612ffd640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f96140cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f96137fe640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961415dc00 0x7f961415f300 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f9604034040 tx=0x7f9604004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f960bfff640 1 -- 172.21.15.5:0/3135175164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604036050 con 0x7f961415dc00 2024-04-25T09:06:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f960bfff640 1 -- 172.21.15.5:0/3135175164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604042070 con 0x7f961415dc00 2024-04-25T09:06:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f960bfff640 1 -- 172.21.15.5:0/3135175164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604009510 con 0x7f961415dc00 2024-04-25T09:06:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961415bad0 con 0x7f961415dc00 2024-04-25T09:06:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.404+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96140cd010 con 0x7f961415dc00 2024-04-25T09:06:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.405+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9614068780 con 0x7f961415dc00 2024-04-25T09:06:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.406+0000 7f960bfff640 1 -- 172.21.15.5:0/3135175164 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9604007bd0 con 0x7f961415dc00 2024-04-25T09:06:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.406+0000 7f960bfff640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f95f406b4d0 0x7f95f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.406+0000 7f960bfff640 1 -- 172.21.15.5:0/3135175164 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f96040ab160 con 0x7f961415dc00 2024-04-25T09:06:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.406+0000 7f9612ffd640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f95f406b4d0 0x7f95f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.407+0000 7f9612ffd640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f95f406b4d0 0x7f95f406d990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f960c003eb0 tx=0x7f960c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.410+0000 7f960bfff640 1 -- 172.21.15.5:0/3135175164 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9614068780 con 0x7f961415dc00 2024-04-25T09:06:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.594+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f961404ef20 con 0x7f961415dc00 2024-04-25T09:06:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.594+0000 7f960bfff640 1 -- 172.21.15.5:0/3135175164 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v140) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9604079f30 con 0x7f961415dc00 2024-04-25T09:06:39.583 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f95f406b4d0 msgr2=0x7f95f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f95f406b4d0 0x7f95f406d990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f960c003eb0 tx=0x7f960c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961415dc00 msgr2=0x7f961415f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961415dc00 0x7f961415f300 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f9604034040 tx=0x7f9604004a40 comp rx=0 tx=0).stop 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 shutdown_connections 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f95f406b4d0 0x7f95f406d990 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961415dc00 0x7f961415f300 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96140ae250 0x7f9614149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 --2- 172.21.15.5:0/3135175164 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f96140668f0 0x7f96140cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 >> 172.21.15.5:0/3135175164 conn(0x7f96140b2560 msgr2=0x7f96140ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 shutdown_connections 2024-04-25T09:06:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.596+0000 7f961984a640 1 -- 172.21.15.5:0/3135175164 wait complete. 2024-04-25T09:06:39.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:39.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.709+0000 7f0186a31640 1 Processor -- start 2024-04-25T09:06:39.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.709+0000 7f0186a31640 1 -- start start 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f0186a31640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f018006adf0 0x7f018006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f0186a31640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018015ef10 con 0x7f018006bb30 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f0186a31640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018006bf10 con 0x7f01800cea80 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f0186a31640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800cfd60 con 0x7f018006adf0 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f0184fce640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f018006bb30 0x7f01800d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48978/0 (socket says 172.21.15.5:48978) 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f0184fce640 1 -- 172.21.15.5:0/248835337 learned_addr learned my addr 172.21.15.5:0/248835337 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017f7fe640 1 --2- 172.21.15.5:0/248835337 >> v2:172.21.15.80:3300/0 conn(0x7f018006adf0 0x7f018006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955650637 0 0) 0x7f018015ef10 con 0x7f018006bb30 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0168003520 con 0x7f018006bb30 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 624157826 0 0) 0x7f0168003520 con 0x7f018006bb30 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 >> v2:172.21.15.80:3300/0 conn(0x7f018006adf0 msgr2=0x7f018006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 --2- 172.21.15.5:0/248835337 >> v2:172.21.15.80:3300/0 conn(0x7f018006adf0 0x7f018006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 >> v1:172.21.15.80:6789/0 conn(0x7f01800cea80 legacy=0x7f018015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018015ff50 con 0x7f018006bb30 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f01780019f0 con 0x7f018006bb30 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 >> v1:172.21.15.5:6789/0 conn(0x7f018006bb30 legacy=0x7f01800d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01680039b0 0x7f0168003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168004800 0x7f0168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.710+0000 7f017effd640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680051c0 0x7f016800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016800c030 con 0x7f0168004800 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016800c1e0 con 0x7f01680051c0 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016800c3e0 con 0x7f01680039b0 2024-04-25T09:06:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017f7fe640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168004800 0x7f0168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017ffff640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01680039b0 0x7f0168003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f0184fce640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680051c0 0x7f016800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017f7fe640 1 -- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01680039b0 msgr2=0x7f0168003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017f7fe640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f01680039b0 0x7f0168003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017f7fe640 1 -- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680051c0 msgr2=0x7f016800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017f7fe640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01680051c0 0x7f016800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f017f7fe640 1 -- 172.21.15.5:0/248835337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168003520 con 0x7f0168004800 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.711+0000 7f0184fce640 1 -- 172.21.15.5:0/248835337 reap_dead start 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f017f7fe640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168004800 0x7f0168004c80 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f0170009ac0 tx=0x7f0168005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0b34e5154fd0df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170036070 con 0x7f0168004800 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0170031400 con 0x7f0168004800 2024-04-25T09:06:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f017effd640 1 -- 172.21.15.5:0/248835337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170009690 con 0x7f0168004800 2024-04-25T09:06:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f0186a31640 1 -- 172.21.15.5:0/248835337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168004800 msgr2=0x7f0168004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f0186a31640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168004800 0x7f0168004c80 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f0170009ac0 tx=0x7f0168005830 comp rx=0 tx=0).stop 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f0186a31640 1 -- 172.21.15.5:0/248835337 shutdown_connections 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f0186a31640 1 --2- 172.21.15.5:0/248835337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168004800 0x7f0168004c80 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f0186a31640 1 -- 172.21.15.5:0/248835337 >> 172.21.15.5:0/248835337 conn(0x7f01800d19f0 msgr2=0x7f01800d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f0186a31640 1 -- 172.21.15.5:0/248835337 shutdown_connections 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.712+0000 7f0186a31640 1 -- 172.21.15.5:0/248835337 wait complete. 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 Processor -- start 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 -- start start 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0168004800 0x7f01801461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01800b1a90 0x7f01801601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01800b1f10 0x7f01801606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800cff90 con 0x7f01800b1a90 2024-04-25T09:06:39.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018015f480 con 0x7f01800b1f10 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f0186a31640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01800d0270 con 0x7f0168004800 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.714+0000 7f017f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01800b1a90 0x7f01801601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01800b1a90 0x7f01801601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55356/0 (socket says 172.21.15.5:55356) 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 -- 172.21.15.5:0/2144223049 learned_addr learned my addr 172.21.15.5:0/2144223049 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f0184fce640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01800b1f10 0x7f01801606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017ffff640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0168004800 0x7f01801461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 -- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0168004800 msgr2=0x7f01801461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0168004800 0x7f01801461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 -- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01800b1f10 msgr2=0x7f01801606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01800b1f10 0x7f01801606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 -- 172.21.15.5:0/2144223049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180146b00 con 0x7f01800b1a90 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017f7fe640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01800b1a90 0x7f01801601b0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f0170034040 tx=0x7f0170004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017cff9640 1 -- 172.21.15.5:0/2144223049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017003f020 con 0x7f01800b1a90 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017cff9640 1 -- 172.21.15.5:0/2144223049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0170037040 con 0x7f01800b1a90 2024-04-25T09:06:39.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0180146de0 con 0x7f01800b1a90 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f017cff9640 1 -- 172.21.15.5:0/2144223049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170036070 con 0x7f01800b1a90 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.715+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01801473a0 con 0x7f01800b1a90 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.716+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018004ef20 con 0x7f01800b1a90 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.717+0000 7f017cff9640 1 -- 172.21.15.5:0/2144223049 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0170042020 con 0x7f01800b1a90 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.717+0000 7f017cff9640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f016c06b500 0x7f016c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.717+0000 7f017cff9640 1 -- 172.21.15.5:0/2144223049 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f01700aa280 con 0x7f01800b1a90 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.718+0000 7f017ffff640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f016c06b500 0x7f016c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.718+0000 7f017ffff640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f016c06b500 0x7f016c06d9c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0174000c00 tx=0x7f0174009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.721+0000 7f017cff9640 1 -- 172.21.15.5:0/2144223049 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0170049030 con 0x7f01800b1a90 2024-04-25T09:06:39.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.937+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01800cefa0 con 0x7f01800b1a90 2024-04-25T09:06:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.938+0000 7f017cff9640 1 -- 172.21.15.5:0/2144223049 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f01700791a0 con 0x7f01800b1a90 2024-04-25T09:06:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:39.926 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:06:14.788729+0000","modified":"2024-04-25T09:06:34.609102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9591":{"gid":9591,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6833/1089300174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1089300174},{"type":"v1","addr":"172.21.15.5:6833","nonce":1089300174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9597":{"gid":9597,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1713726638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1713726638},{"type":"v1","addr":"172.21.15.5:6835","nonce":1713726638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:06:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.939+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f016c06b500 msgr2=0x7f016c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.939+0000 7f0186a31640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f016c06b500 0x7f016c06d9c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0174000c00 tx=0x7f0174009040 comp rx=0 tx=0).stop 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.939+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01800b1a90 msgr2=0x7f01801601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.939+0000 7f0186a31640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01800b1a90 0x7f01801601b0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f0170034040 tx=0x7f0170004730 comp rx=0 tx=0).stop 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 shutdown_connections 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f016c06b500 0x7f016c06d9c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01800b1f10 0x7f01801606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01800b1a90 0x7f01801601b0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 --2- 172.21.15.5:0/2144223049 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0168004800 0x7f01801461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 >> 172.21.15.5:0/2144223049 conn(0x7f01800d19f0 msgr2=0x7f0180161c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 shutdown_connections 2024-04-25T09:06:39.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:39.940+0000 7f0186a31640 1 -- 172.21.15.5:0/2144223049 wait complete. 2024-04-25T09:06:39.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.051+0000 7fe10c722640 1 Processor -- start 2024-04-25T09:06:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.051+0000 7fe10c722640 1 -- start start 2024-04-25T09:06:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.052+0000 7fe10c722640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe10415e0a0 0x7fe1040d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.052+0000 7fe10c722640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe1040d3df0 0x7fe1040cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.052+0000 7fe10c722640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040b7f60 con 0x7fe1040d3990 2024-04-25T09:06:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.052+0000 7fe10c722640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1040b29c0 con 0x7fe1040d3df0 2024-04-25T09:06:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.052+0000 7fe10c722640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040d2080 con 0x7fe10415e0a0 2024-04-25T09:06:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10a4be640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe10415e0a0 0x7fe1040d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10acbf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe1040d3df0 0x7fe1040cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10a4be640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe10415e0a0 0x7fe1040d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:48774/0 (socket says 172.21.15.5:48774) 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10a4be640 1 -- 172.21.15.5:0/4267949192 learned_addr learned my addr 172.21.15.5:0/4267949192 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10acbf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe1040d3df0 0x7fe1040cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:47816/0 (socket says 172.21.15.5:47816) 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10a4be640 1 -- 172.21.15.5:0/4267949192 >> v2:172.21.15.80:3300/0 conn(0x7fe1040d3df0 msgr2=0x7fe1040cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10a4be640 1 --2- 172.21.15.5:0/4267949192 >> v2:172.21.15.80:3300/0 conn(0x7fe1040d3df0 0x7fe1040cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe1094bc640 1 -- 172.21.15.5:0/4267949192 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324384627 0 0) 0x7fe1040b7f60 con 0x7fe1040d3990 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10a4be640 1 -- 172.21.15.5:0/4267949192 >> v1:172.21.15.80:6789/0 conn(0x7fe1040d3990 legacy=0x7fe1040ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.053+0000 7fe10a4be640 1 -- 172.21.15.5:0/4267949192 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040d2360 con 0x7fe10415e0a0 2024-04-25T09:06:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.054+0000 7fe10a4be640 1 --2- 172.21.15.5:0/4267949192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe10415e0a0 0x7fe1040d0d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009870 tx=0x7fe0fc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ee7a1e416cd2b51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.054+0000 7fe1094bc640 1 -- 172.21.15.5:0/4267949192 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc037070 con 0x7fe10415e0a0 2024-04-25T09:06:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.054+0000 7fe1094bc640 1 -- 172.21.15.5:0/4267949192 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc032440 con 0x7fe10415e0a0 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.054+0000 7fe1094bc640 1 -- 172.21.15.5:0/4267949192 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc032810 con 0x7fe10415e0a0 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 -- 172.21.15.5:0/4267949192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe10415e0a0 msgr2=0x7fe1040d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 --2- 172.21.15.5:0/4267949192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe10415e0a0 0x7fe1040d0d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009870 tx=0x7fe0fc02a270 comp rx=0 tx=0).stop 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 -- 172.21.15.5:0/4267949192 shutdown_connections 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 --2- 172.21.15.5:0/4267949192 >> v2:172.21.15.80:3300/0 conn(0x7fe1040d3df0 0x7fe1040cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 --2- 172.21.15.5:0/4267949192 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe10415e0a0 0x7fe1040d0d50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 -- 172.21.15.5:0/4267949192 >> 172.21.15.5:0/4267949192 conn(0x7fe1040668f0 msgr2=0x7fe104066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 -- 172.21.15.5:0/4267949192 shutdown_connections 2024-04-25T09:06:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.055+0000 7fe10c722640 1 -- 172.21.15.5:0/4267949192 wait complete. 2024-04-25T09:06:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.056+0000 7fe10c722640 1 Processor -- start 2024-04-25T09:06:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.056+0000 7fe10c722640 1 -- start start 2024-04-25T09:06:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10c722640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1040d3990 0x7fe1041f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10c722640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1040d3df0 0x7fe1041f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10c722640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10415e0a0 0x7fe1041f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10c722640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040d2c00 con 0x7fe10415e0a0 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10c722640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040d2920 con 0x7fe1040d3990 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10c722640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040d4280 con 0x7fe1040d3df0 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10415e0a0 0x7fe1041f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10415e0a0 0x7fe1041f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55372/0 (socket says 172.21.15.5:55372) 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 -- 172.21.15.5:0/619225096 learned_addr learned my addr 172.21.15.5:0/619225096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe109cbd640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1040d3df0 0x7fe1041f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10a4be640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1040d3990 0x7fe1041f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 -- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1040d3df0 msgr2=0x7fe1041f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1040d3df0 0x7fe1041f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 -- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1040d3990 msgr2=0x7fe1041f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1040d3990 0x7fe1041f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 -- 172.21.15.5:0/619225096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1041f8030 con 0x7fe10415e0a0 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe10acbf640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10415e0a0 0x7fe1041f0f50 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400efc0 tx=0x7fe0f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.057+0000 7fe102ffd640 1 -- 172.21.15.5:0/619225096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4018020 con 0x7fe10415e0a0 2024-04-25T09:06:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.058+0000 7fe102ffd640 1 -- 172.21.15.5:0/619225096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4014480 con 0x7fe10415e0a0 2024-04-25T09:06:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.058+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1041f4100 con 0x7fe10415e0a0 2024-04-25T09:06:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.058+0000 7fe102ffd640 1 -- 172.21.15.5:0/619225096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4014870 con 0x7fe10415e0a0 2024-04-25T09:06:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.058+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1041f46c0 con 0x7fe10415e0a0 2024-04-25T09:06:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.058+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1040cfaa0 con 0x7fe10415e0a0 2024-04-25T09:06:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.059+0000 7fe102ffd640 1 -- 172.21.15.5:0/619225096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe0f4005d10 con 0x7fe10415e0a0 2024-04-25T09:06:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.059+0000 7fe102ffd640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0f006b4d0 0x7fe0f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.060+0000 7fe102ffd640 1 -- 172.21.15.5:0/619225096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe0f408aa50 con 0x7fe10415e0a0 2024-04-25T09:06:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.060+0000 7fe10a4be640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0f006b4d0 0x7fe0f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.060+0000 7fe10a4be640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0f006b4d0 0x7fe0f006d990 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc034000 tx=0x7fe0fc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.064+0000 7fe102ffd640 1 -- 172.21.15.5:0/619225096 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1040cfaa0 con 0x7fe10415e0a0 2024-04-25T09:06:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.242+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1040b2fc0 con 0x7fe10415e0a0 2024-04-25T09:06:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.244+0000 7fe102ffd640 1 -- 172.21.15.5:0/619225096 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16644 (secure 0 0 0) 0x7fe0f4022070 con 0x7fe10415e0a0 2024-04-25T09:06:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:40.232 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":140,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:29.582257+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:13.105023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:13.759633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0f006b4d0 msgr2=0x7fe0f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0f006b4d0 0x7fe0f006d990 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc034000 tx=0x7fe0fc02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10415e0a0 msgr2=0x7fe1041f0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10415e0a0 0x7fe1041f0f50 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400efc0 tx=0x7fe0f400c490 comp rx=0 tx=0).stop 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 shutdown_connections 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe0f006b4d0 0x7fe0f006d990 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10415e0a0 0x7fe1041f0f50 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe1040d3df0 0x7fe1041f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 --2- 172.21.15.5:0/619225096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1040d3990 0x7fe1041f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 >> 172.21.15.5:0/619225096 conn(0x7fe1040668f0 msgr2=0x7fe10415d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 shutdown_connections 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.246+0000 7fe10c722640 1 -- 172.21.15.5:0/619225096 wait complete. 2024-04-25T09:06:40.245 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:06:40.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:40.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.358+0000 7fe48bd30640 1 Processor -- start 2024-04-25T09:06:40.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.358+0000 7fe48bd30640 1 -- start start 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe48bd30640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe48406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe48bd30640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48415ef10 con 0x7fe48406bb30 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe48bd30640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48415ff50 con 0x7fe4840cea80 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe48bd30640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840cfd60 con 0x7fe48406adf0 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe48a2cd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe48406bb30 0x7fe4840d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48994/0 (socket says 172.21.15.5:48994) 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe48a2cd640 1 -- 172.21.15.5:0/2974832433 learned_addr learned my addr 172.21.15.5:0/2974832433 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe4892cb640 1 --2- 172.21.15.5:0/2974832433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe48406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe488aca640 1 -- 172.21.15.5:0/2974832433 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713129843 0 0) 0x7fe48415ef10 con 0x7fe48406bb30 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.359+0000 7fe488aca640 1 -- 172.21.15.5:0/2974832433 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe470003520 con 0x7fe48406bb30 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.360+0000 7fe4892cb640 1 -- 172.21.15.5:0/2974832433 >> v1:172.21.15.80:6789/0 conn(0x7fe4840cea80 legacy=0x7fe48415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.360+0000 7fe4892cb640 1 -- 172.21.15.5:0/2974832433 >> v1:172.21.15.5:6789/0 conn(0x7fe48406bb30 legacy=0x7fe4840d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.360+0000 7fe488aca640 1 -- 172.21.15.5:0/2974832433 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276861841 0 0) 0x7fe48415ff50 con 0x7fe4840cea80 2024-04-25T09:06:40.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.360+0000 7fe4892cb640 1 -- 172.21.15.5:0/2974832433 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48415f1a0 con 0x7fe48406adf0 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.360+0000 7fe4892cb640 1 --2- 172.21.15.5:0/2974832433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe48406b5f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe4740097d0 tx=0x7fe47402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f036fa519210c57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.360+0000 7fe488aca640 1 -- 172.21.15.5:0/2974832433 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474037070 con 0x7fe48406adf0 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe488aca640 1 -- 172.21.15.5:0/2974832433 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474032440 con 0x7fe48406adf0 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe488aca640 1 -- 172.21.15.5:0/2974832433 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474032810 con 0x7fe48406adf0 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe48bd30640 1 -- 172.21.15.5:0/2974832433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 msgr2=0x7fe48406b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe48bd30640 1 --2- 172.21.15.5:0/2974832433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe48406b5f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe4740097d0 tx=0x7fe47402a210 comp rx=0 tx=0).stop 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe48bd30640 1 -- 172.21.15.5:0/2974832433 shutdown_connections 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe48bd30640 1 --2- 172.21.15.5:0/2974832433 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe48406b5f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe48bd30640 1 -- 172.21.15.5:0/2974832433 >> 172.21.15.5:0/2974832433 conn(0x7fe4840d19f0 msgr2=0x7fe4840d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe48bd30640 1 -- 172.21.15.5:0/2974832433 shutdown_connections 2024-04-25T09:06:40.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.361+0000 7fe48bd30640 1 -- 172.21.15.5:0/2974832433 wait complete. 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.362+0000 7fe48bd30640 1 Processor -- start 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.362+0000 7fe48bd30640 1 -- start start 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe48bd30640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe484159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe48bd30640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48406bb30 0x7fe4840c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe48bd30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4840cea80 0x7fe4840c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe48bd30640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48415f480 con 0x7fe48406bb30 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe48bd30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48406bf80 con 0x7fe4840cea80 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe48bd30640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840d0270 con 0x7fe48406adf0 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe4892cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48406bb30 0x7fe4840c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe4892cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48406bb30 0x7fe4840c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55380/0 (socket says 172.21.15.5:55380) 2024-04-25T09:06:40.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe4892cb640 1 -- 172.21.15.5:0/1078013065 learned_addr learned my addr 172.21.15.5:0/1078013065 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe489acc640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe484159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.363+0000 7fe48a2cd640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4840cea80 0x7fe4840c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe4892cb640 1 -- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 msgr2=0x7fe484159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe4892cb640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe484159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe4892cb640 1 -- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4840cea80 msgr2=0x7fe4840c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe4892cb640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4840cea80 0x7fe4840c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe4892cb640 1 -- 172.21.15.5:0/1078013065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4840c66a0 con 0x7fe48406bb30 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe4892cb640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48406bb30 0x7fe4840c5520 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fe474035040 tx=0x7fe4740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1078013065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474041070 con 0x7fe48406bb30 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1078013065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474004220 con 0x7fe48406bb30 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4840c5e00 con 0x7fe48406bb30 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1078013065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474037040 con 0x7fe48406bb30 2024-04-25T09:06:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.364+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4840c63c0 con 0x7fe48406bb30 2024-04-25T09:06:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.365+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48404ef20 con 0x7fe48406bb30 2024-04-25T09:06:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.365+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1078013065 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe474003610 con 0x7fe48406bb30 2024-04-25T09:06:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.366+0000 7fe47a7fc640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe46806b4d0 0x7fe46806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.366+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1078013065 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe4740aa910 con 0x7fe48406bb30 2024-04-25T09:06:40.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.366+0000 7fe489acc640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe46806b4d0 0x7fe46806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.367+0000 7fe489acc640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe46806b4d0 0x7fe46806d990 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe480000f60 tx=0x7fe480009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.370+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1078013065 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe474079130 con 0x7fe48406bb30 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.588+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4840b7970 con 0x7fe48406bb30 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.588+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1078013065 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7fe47407d1d0 con 0x7fe48406bb30 2024-04-25T09:06:40.577 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:40.577 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:06:14.788729+0000","modified":"2024-04-25T09:06:34.609102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9591":{"gid":9591,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6833/1089300174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1089300174},{"type":"v1","addr":"172.21.15.5:6833","nonce":1089300174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9597":{"gid":9597,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1713726638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1713726638},{"type":"v1","addr":"172.21.15.5:6835","nonce":1713726638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:06:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe46806b4d0 msgr2=0x7fe46806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe46806b4d0 0x7fe46806d990 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe480000f60 tx=0x7fe480009040 comp rx=0 tx=0).stop 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48406bb30 msgr2=0x7fe4840c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48406bb30 0x7fe4840c5520 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fe474035040 tx=0x7fe4740046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 shutdown_connections 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fe46806b4d0 0x7fe46806d990 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4840cea80 0x7fe4840c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48406bb30 0x7fe4840c5520 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 --2- 172.21.15.5:0/1078013065 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe48406adf0 0x7fe484159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 >> 172.21.15.5:0/1078013065 conn(0x7fe4840d19f0 msgr2=0x7fe4840aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 shutdown_connections 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.590+0000 7fe48bd30640 1 -- 172.21.15.5:0/1078013065 wait complete. 2024-04-25T09:06:40.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:40.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.702+0000 7fbc6f67d640 1 Processor -- start 2024-04-25T09:06:40.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.703+0000 7fbc6f67d640 1 -- start start 2024-04-25T09:06:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.703+0000 7fbc6f67d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6815e120 0x7fbc6806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.703+0000 7fbc6f67d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc6806bbb0 0x7fbc680d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.703+0000 7fbc6f67d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc680b4730 con 0x7fbc6806b7d0 2024-04-25T09:06:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.703+0000 7fbc6f67d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc680d0b70 con 0x7fbc6806bbb0 2024-04-25T09:06:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.703+0000 7fbc6f67d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680cbf30 con 0x7fbc6815e120 2024-04-25T09:06:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6dc1a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc6806bbb0 0x7fbc680d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6dc1a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc6806bbb0 0x7fbc680d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55394/0 (socket says 172.21.15.5:55394) 2024-04-25T09:06:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6dc1a640 1 -- 172.21.15.5:0/666642138 learned_addr learned my addr 172.21.15.5:0/666642138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6cc18640 1 --2- 172.21.15.5:0/666642138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6815e120 0x7fbc6806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6dc1a640 1 -- 172.21.15.5:0/666642138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6815e120 msgr2=0x7fbc6806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6dc1a640 1 --2- 172.21.15.5:0/666642138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6815e120 0x7fbc6806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6dc1a640 1 -- 172.21.15.5:0/666642138 >> v1:172.21.15.80:6789/0 conn(0x7fbc6806b7d0 legacy=0x7fbc6815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.704+0000 7fbc6dc1a640 1 -- 172.21.15.5:0/666642138 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc680d0da0 con 0x7fbc6806bbb0 2024-04-25T09:06:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6dc1a640 1 --2- 172.21.15.5:0/666642138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc680d0630 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009e50 tx=0x7fbc6002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4d5e53d1a5c11b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc5ffff640 1 -- 172.21.15.5:0/666642138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc60036070 con 0x7fbc6806bbb0 2024-04-25T09:06:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc5ffff640 1 -- 172.21.15.5:0/666642138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc60031600 con 0x7fbc6806bbb0 2024-04-25T09:06:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc5ffff640 1 -- 172.21.15.5:0/666642138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc600319d0 con 0x7fbc6806bbb0 2024-04-25T09:06:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6f67d640 1 -- 172.21.15.5:0/666642138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 msgr2=0x7fbc680d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/666642138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc680d0630 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009e50 tx=0x7fbc6002a7a0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6f67d640 1 -- 172.21.15.5:0/666642138 shutdown_connections 2024-04-25T09:06:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/666642138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc680d0630 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/666642138 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6815e120 0x7fbc6806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6f67d640 1 -- 172.21.15.5:0/666642138 >> 172.21.15.5:0/666642138 conn(0x7fbc680d18e0 msgr2=0x7fbc680d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.705+0000 7fbc6f67d640 1 -- 172.21.15.5:0/666642138 shutdown_connections 2024-04-25T09:06:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.706+0000 7fbc6f67d640 1 -- 172.21.15.5:0/666642138 wait complete. 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 Processor -- start 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 -- start start 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6806b7d0 0x7fbc68151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc6814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc6815e120 0x7fbc680cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680cc460 con 0x7fbc6806bbb0 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680cc7d0 con 0x7fbc6815e120 2024-04-25T09:06:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6f67d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680ccc60 con 0x7fbc6806b7d0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.707+0000 7fbc6cc18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc6814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc6814eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55406/0 (socket says 172.21.15.5:55406) 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 -- 172.21.15.5:0/4211355371 learned_addr learned my addr 172.21.15.5:0/4211355371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6d419640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6806b7d0 0x7fbc68151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6dc1a640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc6815e120 0x7fbc680cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 -- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6806b7d0 msgr2=0x7fbc68151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6806b7d0 0x7fbc68151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 -- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc6815e120 msgr2=0x7fbc680cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc6815e120 0x7fbc680cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 -- 172.21.15.5:0/4211355371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68150c50 con 0x7fbc6806bbb0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6cc18640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc6814eca0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800d620 tx=0x7fbc5800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc5dffb640 1 -- 172.21.15.5:0/4211355371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800b620 con 0x7fbc6806bbb0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc5dffb640 1 -- 172.21.15.5:0/4211355371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc58019070 con 0x7fbc6806bbb0 2024-04-25T09:06:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc68150f30 con 0x7fbc6806bbb0 2024-04-25T09:06:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc5dffb640 1 -- 172.21.15.5:0/4211355371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800ba00 con 0x7fbc6806bbb0 2024-04-25T09:06:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.708+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc681514f0 con 0x7fbc6806bbb0 2024-04-25T09:06:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.710+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc68152460 con 0x7fbc6806bbb0 2024-04-25T09:06:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.710+0000 7fbc5dffb640 1 -- 172.21.15.5:0/4211355371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc5800bba0 con 0x7fbc6806bbb0 2024-04-25T09:06:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.710+0000 7fbc5dffb640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbc4c06b4d0 0x7fbc4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.710+0000 7fbc5dffb640 1 -- 172.21.15.5:0/4211355371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbc5808a4e0 con 0x7fbc6806bbb0 2024-04-25T09:06:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.710+0000 7fbc6d419640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbc4c06b4d0 0x7fbc4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.711+0000 7fbc6d419640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbc4c06b4d0 0x7fbc4c06d990 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001780 tx=0x7fbc64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.714+0000 7fbc5dffb640 1 -- 172.21.15.5:0/4211355371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc58058cf0 con 0x7fbc6806bbb0 2024-04-25T09:06:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.934+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc6804ef20 con 0x7fbc6806bbb0 2024-04-25T09:06:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.935+0000 7fbc5dffb640 1 -- 172.21.15.5:0/4211355371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7fbc5805cd90 con 0x7fbc6806bbb0 2024-04-25T09:06:40.923 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:40.923 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:06:14.788729+0000","modified":"2024-04-25T09:06:34.609102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9591":{"gid":9591,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6833/1089300174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1089300174},{"type":"v1","addr":"172.21.15.5:6833","nonce":1089300174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9597":{"gid":9597,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1713726638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1713726638},{"type":"v1","addr":"172.21.15.5:6835","nonce":1713726638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:06:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2024-04-25T09:06:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbc4c06b4d0 msgr2=0x7fbc4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbc4c06b4d0 0x7fbc4c06d990 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001780 tx=0x7fbc64009040 comp rx=0 tx=0).stop 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 msgr2=0x7fbc6814eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc6814eca0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800d620 tx=0x7fbc5800dae0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 shutdown_connections 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fbc4c06b4d0 0x7fbc4c06d990 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc6815e120 0x7fbc680cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6806bbb0 0x7fbc6814eca0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 --2- 172.21.15.5:0/4211355371 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbc6806b7d0 0x7fbc68151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 >> 172.21.15.5:0/4211355371 conn(0x7fbc680d18e0 msgr2=0x7fbc680d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 shutdown_connections 2024-04-25T09:06:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:40.937+0000 7fbc6f67d640 1 -- 172.21.15.5:0/4211355371 wait complete. 2024-04-25T09:06:40.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.048+0000 7ff9f2fb7640 1 Processor -- start 2024-04-25T09:06:41.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.048+0000 7ff9f2fb7640 1 -- start start 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f2fb7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9ec15de70 0x7ff9ec0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f2fb7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f2fb7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec0d20e0 con 0x7ff9ec0b7130 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f2fb7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0d2a10 con 0x7ff9ec15de70 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f2fb7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0d23c0 con 0x7ff9ec0b2cc0 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f0d53640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9ec15de70 0x7ff9ec0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f1554640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff9ec0b7130 0x7ff9ec0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49070/0 (socket says 172.21.15.5:49070) 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f0d53640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9ec15de70 0x7ff9ec0b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56890/0 (socket says 172.21.15.5:56890) 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.049+0000 7ff9f1554640 1 -- 172.21.15.5:0/4058823879 learned_addr learned my addr 172.21.15.5:0/4058823879 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9f0d53640 1 -- 172.21.15.5:0/4058823879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 msgr2=0x7ff9ec0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9ebfff640 1 --2- 172.21.15.5:0/4058823879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9eb7fe640 1 -- 172.21.15.5:0/4058823879 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463487359 0 0) 0x7ff9ec0d20e0 con 0x7ff9ec0b7130 2024-04-25T09:06:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9f0d53640 1 --2- 172.21.15.5:0/4058823879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9f0d53640 1 -- 172.21.15.5:0/4058823879 >> v1:172.21.15.5:6789/0 conn(0x7ff9ec0b7130 legacy=0x7ff9ec0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9f0d53640 1 -- 172.21.15.5:0/4058823879 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0d26a0 con 0x7ff9ec15de70 2024-04-25T09:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9ebfff640 1 --2- 172.21.15.5:0/4058823879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9f0d53640 1 --2- 172.21.15.5:0/4058823879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0b93e0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009d90 tx=0x7ff9e402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1581978e0803d0c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9eb7fe640 1 -- 172.21.15.5:0/4058823879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4007740 con 0x7ff9ec15de70 2024-04-25T09:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9eb7fe640 1 -- 172.21.15.5:0/4058823879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e40078e0 con 0x7ff9ec15de70 2024-04-25T09:06:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.050+0000 7ff9eb7fe640 1 -- 172.21.15.5:0/4058823879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4007cb0 con 0x7ff9ec15de70 2024-04-25T09:06:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/4058823879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 msgr2=0x7ff9ec0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/4058823879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0b93e0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009d90 tx=0x7ff9e402a660 comp rx=0 tx=0).stop 2024-04-25T09:06:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/4058823879 shutdown_connections 2024-04-25T09:06:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/4058823879 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/4058823879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0b93e0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/4058823879 >> 172.21.15.5:0/4058823879 conn(0x7ff9ec06b000 msgr2=0x7ff9ec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/4058823879 shutdown_connections 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.051+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/4058823879 wait complete. 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.052+0000 7ff9f2fb7640 1 Processor -- start 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.052+0000 7ff9f2fb7640 1 -- start start 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f2fb7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f2fb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9ec0b7130 0x7ff9ec157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f2fb7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f2fb7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cf080 con 0x7ff9ec15de70 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f2fb7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cef00 con 0x7ff9ec0b7130 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f2fb7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cf200 con 0x7ff9ec0b2cc0 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f1554640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f1554640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56896/0 (socket says 172.21.15.5:56896) 2024-04-25T09:06:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f1554640 1 -- 172.21.15.5:0/3725893590 learned_addr learned my addr 172.21.15.5:0/3725893590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9f0d53640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.053+0000 7ff9ebfff640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9ec0b7130 0x7ff9ec157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f1554640 1 -- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 msgr2=0x7ff9ec0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f1554640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f1554640 1 -- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9ec0b7130 msgr2=0x7ff9ec157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f1554640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9ec0b7130 0x7ff9ec157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f1554640 1 -- 172.21.15.5:0/3725893590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0cb0e0 con 0x7ff9ec15de70 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f1554640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0cc430 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c480 tx=0x7ff9dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9e97fa640 1 -- 172.21.15.5:0/3725893590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc018070 con 0x7ff9ec15de70 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9e97fa640 1 -- 172.21.15.5:0/3725893590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc007500 con 0x7ff9ec15de70 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9e97fa640 1 -- 172.21.15.5:0/3725893590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc004a20 con 0x7ff9ec15de70 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec0cb380 con 0x7ff9ec15de70 2024-04-25T09:06:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.054+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec0cb940 con 0x7ff9ec15de70 2024-04-25T09:06:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.055+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec04ef20 con 0x7ff9ec15de70 2024-04-25T09:06:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.055+0000 7ff9e97fa640 1 -- 172.21.15.5:0/3725893590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9dc004bc0 con 0x7ff9ec15de70 2024-04-25T09:06:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.056+0000 7ff9e97fa640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff9d806b4d0 0x7ff9d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.056+0000 7ff9e97fa640 1 -- 172.21.15.5:0/3725893590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff9dc0893d0 con 0x7ff9ec15de70 2024-04-25T09:06:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.056+0000 7ff9f0d53640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff9d806b4d0 0x7ff9d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.057+0000 7ff9f0d53640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff9d806b4d0 0x7ff9d806d990 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4034000 tx=0x7ff9e4033040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.060+0000 7ff9e97fa640 1 -- 172.21.15.5:0/3725893590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9dc0582c0 con 0x7ff9ec15de70 2024-04-25T09:06:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.240+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9ec1611d0 con 0x7ff9ec15de70 2024-04-25T09:06:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.241+0000 7ff9e97fa640 1 -- 172.21.15.5:0/3725893590 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16644 (secure 0 0 0) 0x7ff9dc057bc0 con 0x7ff9ec15de70 2024-04-25T09:06:41.229 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:41.230 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":140,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:29.582257+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:13.105023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:13.759633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff9d806b4d0 msgr2=0x7ff9d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff9d806b4d0 0x7ff9d806d990 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4034000 tx=0x7ff9e4033040 comp rx=0 tx=0).stop 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 msgr2=0x7ff9ec0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0cc430 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c480 tx=0x7ff9dc00c940 comp rx=0 tx=0).stop 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 shutdown_connections 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff9d806b4d0 0x7ff9d806d990 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9ec15de70 0x7ff9ec0cc430 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9ec0b7130 0x7ff9ec157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 --2- 172.21.15.5:0/3725893590 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff9ec0b2cc0 0x7ff9ec0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 >> 172.21.15.5:0/3725893590 conn(0x7ff9ec06b000 msgr2=0x7ff9ec15e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 shutdown_connections 2024-04-25T09:06:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.243+0000 7ff9f2fb7640 1 -- 172.21.15.5:0/3725893590 wait complete. 2024-04-25T09:06:41.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:06:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.356+0000 7f479f012640 1 Processor -- start 2024-04-25T09:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.356+0000 7f479f012640 1 -- start start 2024-04-25T09:06:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f479f012640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47980cea80 0x7f479815f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f479f012640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479815fd80 0x7f479806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f479f012640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479815ef10 con 0x7f479806adf0 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f479f012640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980cfd60 con 0x7f47980cea80 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f479f012640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479815f480 con 0x7f479815fd80 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f479cdae640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47980cea80 0x7f479815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f4797fff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479815fd80 0x7f479806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f4797fff640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479815fd80 0x7f479806b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:47690/0 (socket says 172.21.15.5:47690) 2024-04-25T09:06:41.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.357+0000 7f4797fff640 1 -- 172.21.15.5:0/641659665 learned_addr learned my addr 172.21.15.5:0/641659665 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.358+0000 7f479cdae640 1 -- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479815fd80 msgr2=0x7f479806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.358+0000 7f479cdae640 1 --2- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479815fd80 0x7f479806b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.358+0000 7f479cdae640 1 -- 172.21.15.5:0/641659665 >> v1:172.21.15.80:6789/0 conn(0x7f479806adf0 legacy=0x7f47980d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.358+0000 7f479cdae640 1 -- 172.21.15.5:0/641659665 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479815f1a0 con 0x7f47980cea80 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.358+0000 7f4797fff640 1 --2- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479815fd80 0x7f479806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.358+0000 7f47977fe640 1 -- 172.21.15.5:0/641659665 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368468710 0 0) 0x7f479815ef10 con 0x7f479806adf0 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479cdae640 1 --2- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47980cea80 0x7f479815f840 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f47880097a0 tx=0x7f478802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ecc8a4a51e5e358 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f47977fe640 1 -- 172.21.15.5:0/641659665 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788037070 con 0x7f47980cea80 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f47977fe640 1 -- 172.21.15.5:0/641659665 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788032440 con 0x7f47980cea80 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f47977fe640 1 -- 172.21.15.5:0/641659665 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788032810 con 0x7f47980cea80 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 -- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47980cea80 msgr2=0x7f479815f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 --2- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47980cea80 0x7f479815f840 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f47880097a0 tx=0x7f478802a180 comp rx=0 tx=0).stop 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 -- 172.21.15.5:0/641659665 shutdown_connections 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 --2- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479815fd80 0x7f479806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 --2- 172.21.15.5:0/641659665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47980cea80 0x7f479815f840 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 -- 172.21.15.5:0/641659665 >> 172.21.15.5:0/641659665 conn(0x7f47980d19f0 msgr2=0x7f47980d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 -- 172.21.15.5:0/641659665 shutdown_connections 2024-04-25T09:06:41.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.359+0000 7f479f012640 1 -- 172.21.15.5:0/641659665 wait complete. 2024-04-25T09:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 Processor -- start 2024-04-25T09:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 -- start start 2024-04-25T09:06:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479806adf0 0x7f4798156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47980cea80 0x7f47980b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4798156840 0x7f47980c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980d1660 con 0x7f47980cea80 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980d0270 con 0x7f4798156840 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.361+0000 7f479f012640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47980d17e0 con 0x7f479806adf0 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47980cea80 0x7f47980b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47980cea80 0x7f47980b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56906/0 (socket says 172.21.15.5:56906) 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 -- 172.21.15.5:0/3183786806 learned_addr learned my addr 172.21.15.5:0/3183786806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f479cdae640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479806adf0 0x7f4798156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f479d5af640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4798156840 0x7f47980c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 -- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479806adf0 msgr2=0x7f4798156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479806adf0 0x7f4798156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 -- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4798156840 msgr2=0x7f47980c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4798156840 0x7f47980c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 -- 172.21.15.5:0/3183786806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980b3260 con 0x7f47980cea80 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f479cdae640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479806adf0 0x7f4798156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f4797fff640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47980cea80 0x7f47980b2d20 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f478c00e9b0 tx=0x7f478c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f47957fa640 1 -- 172.21.15.5:0/3183786806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c017070 con 0x7f47980cea80 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f47957fa640 1 -- 172.21.15.5:0/3183786806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00c9a0 con 0x7f47980cea80 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f47957fa640 1 -- 172.21.15.5:0/3183786806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00cd50 con 0x7f47980cea80 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47980c6940 con 0x7f47980cea80 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.362+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47980c6f00 con 0x7f47980cea80 2024-04-25T09:06:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.363+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479804ef20 con 0x7f47980cea80 2024-04-25T09:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.364+0000 7f47957fa640 1 -- 172.21.15.5:0/3183786806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f478c01a070 con 0x7f47980cea80 2024-04-25T09:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.364+0000 7f47957fa640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f478406b4d0 0x7f478406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.364+0000 7f47957fa640 1 -- 172.21.15.5:0/3183786806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f478c08a100 con 0x7f47980cea80 2024-04-25T09:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.365+0000 7f479cdae640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f478406b4d0 0x7f478406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.365+0000 7f479cdae640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f478406b4d0 0x7f478406d990 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4788034000 tx=0x7f478802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.368+0000 7f47957fa640 1 -- 172.21.15.5:0/3183786806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f478c058870 con 0x7f47980cea80 2024-04-25T09:06:41.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.595+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f47980cefa0 con 0x7f47980cea80 2024-04-25T09:06:41.583 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-04-25T09:06:41.595+0000 7f7b6b3f0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:06:41.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.597+0000 7f47957fa640 1 -- 172.21.15.5:0/3183786806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7f478c05c910 con 0x7f47980cea80 2024-04-25T09:06:41.585 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f478406b4d0 msgr2=0x7f478406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f478406b4d0 0x7f478406d990 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4788034000 tx=0x7f478802e000 comp rx=0 tx=0).stop 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47980cea80 msgr2=0x7f47980b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47980cea80 0x7f47980b2d20 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f478c00e9b0 tx=0x7f478c00ee70 comp rx=0 tx=0).stop 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 shutdown_connections 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f478406b4d0 0x7f478406d990 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4798156840 0x7f47980c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47980cea80 0x7f47980b2d20 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 --2- 172.21.15.5:0/3183786806 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f479806adf0 0x7f4798156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 >> 172.21.15.5:0/3183786806 conn(0x7f47980d19f0 msgr2=0x7f47980af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 shutdown_connections 2024-04-25T09:06:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.600+0000 7f479f012640 1 -- 172.21.15.5:0/3183786806 wait complete. 2024-04-25T09:06:41.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:06:41.628 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-04-25T09:06:41.630 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-25T09:06:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.721+0000 7fcab2de0640 1 Processor -- start 2024-04-25T09:06:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.721+0000 7fcab2de0640 1 -- start start 2024-04-25T09:06:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab2de0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab2de0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaac0d1f60 0x7fcaac0d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab2de0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaac0d4060 0x7fcaac0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab2de0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0d2740 con 0x7fcaac0d4060 2024-04-25T09:06:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab2de0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0d2a20 con 0x7fcaac0d1f60 2024-04-25T09:06:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab2de0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0d2d00 con 0x7fcaac1614b0 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaac0d4060 0x7fcaac0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaac0d4060 0x7fcaac0b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56960/0 (socket says 172.21.15.5:56960) 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 -- 172.21.15.5:0/3398694532 learned_addr learned my addr 172.21.15.5:0/3398694532 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcaabfff640 1 --2- 172.21.15.5:0/3398694532 >> v2:172.21.15.80:3300/0 conn(0x7fcaac0d1f60 0x7fcaac0d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab0b7c640 1 --2- 172.21.15.5:0/3398694532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 -- 172.21.15.5:0/3398694532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 msgr2=0x7fcaac0b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 --2- 172.21.15.5:0/3398694532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 -- 172.21.15.5:0/3398694532 >> v2:172.21.15.80:3300/0 conn(0x7fcaac0d1f60 msgr2=0x7fcaac0d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 --2- 172.21.15.5:0/3398694532 >> v2:172.21.15.80:3300/0 conn(0x7fcaac0d1f60 0x7fcaac0d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab137d640 1 -- 172.21.15.5:0/3398694532 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0d2fe0 con 0x7fcaac0d4060 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.722+0000 7fcab0b7c640 1 --2- 172.21.15.5:0/3398694532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.723+0000 7fcab137d640 1 --2- 172.21.15.5:0/3398694532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0b5610 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0b6710 tx=0x7fcaa402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d494376acb373079 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.723+0000 7fcaab7fe640 1 -- 172.21.15.5:0/3398694532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4036070 con 0x7fcaac0d4060 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.723+0000 7fcaab7fe640 1 -- 172.21.15.5:0/3398694532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4031600 con 0x7fcaac0d4060 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.723+0000 7fcaab7fe640 1 -- 172.21.15.5:0/3398694532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40319d0 con 0x7fcaac0d4060 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 -- 172.21.15.5:0/3398694532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 msgr2=0x7fcaac0b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 --2- 172.21.15.5:0/3398694532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0b5610 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0b6710 tx=0x7fcaa402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 -- 172.21.15.5:0/3398694532 shutdown_connections 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 --2- 172.21.15.5:0/3398694532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0b5610 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 --2- 172.21.15.5:0/3398694532 >> v2:172.21.15.80:3300/0 conn(0x7fcaac0d1f60 0x7fcaac0d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 --2- 172.21.15.5:0/3398694532 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 -- 172.21.15.5:0/3398694532 >> 172.21.15.5:0/3398694532 conn(0x7fcaac06b000 msgr2=0x7fcaac06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 -- 172.21.15.5:0/3398694532 shutdown_connections 2024-04-25T09:06:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.724+0000 7fcab2de0640 1 -- 172.21.15.5:0/3398694532 wait complete. 2024-04-25T09:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.725+0000 7fcab2de0640 1 Processor -- start 2024-04-25T09:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.725+0000 7fcab2de0640 1 -- start start 2024-04-25T09:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab2de0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaac0d1f60 0x7fcaac146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab2de0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab2de0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab2de0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0d23a0 con 0x7fcaac0d4060 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab2de0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0d37e0 con 0x7fcaac0d1f60 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab2de0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0d2520 con 0x7fcaac1614b0 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56974/0 (socket says 172.21.15.5:56974) 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 -- 172.21.15.5:0/2922136275 learned_addr learned my addr 172.21.15.5:0/2922136275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab0b7c640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaac0d1f60 0x7fcaac146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcab137d640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 -- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 msgr2=0x7fcaac0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 -- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaac0d1f60 msgr2=0x7fcaac146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaac0d1f60 0x7fcaac146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 -- 172.21.15.5:0/2922136275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0cb200 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.726+0000 7fcaabfff640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0c6660 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fca9800e890 tx=0x7fca9800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.727+0000 7fcaa97fa640 1 -- 172.21.15.5:0/2922136275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98017070 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.727+0000 7fcaa97fa640 1 -- 172.21.15.5:0/2922136275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9800c940 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.727+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac0cb4e0 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.727+0000 7fcaa97fa640 1 -- 172.21.15.5:0/2922136275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800cd10 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.727+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac0cbaa0 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.728+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac04ef20 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.728+0000 7fcaa97fa640 1 -- 172.21.15.5:0/2922136275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca9801a070 con 0x7fcaac0d4060 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.729+0000 7fcaa97fa640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9006b4d0 0x7fca9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.729+0000 7fcaa97fa640 1 -- 172.21.15.5:0/2922136275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fca9808a590 con 0x7fcaac0d4060 2024-04-25T09:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.729+0000 7fcab0b7c640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9006b4d0 0x7fca9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.729+0000 7fcab0b7c640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9006b4d0 0x7fca9006d990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcaac1e9780 tx=0x7fcaa0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.733+0000 7fcaa97fa640 1 -- 172.21.15.5:0/2922136275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca980593a0 con 0x7fcaac0d4060 2024-04-25T09:06:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:41.955+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcaac0d1a70 con 0x7fcaac0d4060 2024-04-25T09:06:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.628+0000 7fcaa97fa640 1 -- 172.21.15.5:0/2922136275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 104+0+0 (secure 0 0 0) 0x7fca98058ca0 con 0x7fcaac0d4060 2024-04-25T09:06:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9006b4d0 msgr2=0x7fca9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9006b4d0 0x7fca9006d990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcaac1e9780 tx=0x7fcaa0008040 comp rx=0 tx=0).stop 2024-04-25T09:06:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 msgr2=0x7fcaac0c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0c6660 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fca9800e890 tx=0x7fca9800ed50 comp rx=0 tx=0).stop 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 shutdown_connections 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fca9006b4d0 0x7fca9006d990 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcaac1614b0 0x7fcaac0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaac0d4060 0x7fcaac0c6660 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 --2- 172.21.15.5:0/2922136275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaac0d1f60 0x7fcaac146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 >> 172.21.15.5:0/2922136275 conn(0x7fcaac06b000 msgr2=0x7fcaac15b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 shutdown_connections 2024-04-25T09:06:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.631+0000 7fcab2de0640 1 -- 172.21.15.5:0/2922136275 wait complete. 2024-04-25T09:06:42.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:06:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.798+0000 7f49f7c6f640 1 Processor -- start 2024-04-25T09:06:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.799+0000 7f49f7c6f640 1 -- start start 2024-04-25T09:06:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.799+0000 7f49f7c6f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f0161610 0x7f49f00d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.799+0000 7f49f7c6f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49f00d26d0 0x7f49f00b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.799+0000 7f49f7c6f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00b6ed0 con 0x7f49f00d0920 2024-04-25T09:06:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.799+0000 7f49f7c6f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f01619f0 con 0x7f49f00d26d0 2024-04-25T09:06:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.799+0000 7f49f7c6f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00b74c0 con 0x7f49f0161610 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f520a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49f00d0920 0x7f49f00d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49088/0 (socket says 172.21.15.5:49088) 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f620c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49f00d26d0 0x7f49f00b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f520a640 1 -- 172.21.15.5:0/3909847448 learned_addr learned my addr 172.21.15.5:0/3909847448 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f5a0b640 1 --2- 172.21.15.5:0/3909847448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f0161610 0x7f49f00d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f4a09640 1 -- 172.21.15.5:0/3909847448 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533902399 0 0) 0x7f49e4001110 con 0x7f49f00d0920 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f4a09640 1 -- 172.21.15.5:0/3909847448 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d8003520 con 0x7f49f00d0920 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f620c640 1 -- 172.21.15.5:0/3909847448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f0161610 msgr2=0x7f49f00d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f620c640 1 --2- 172.21.15.5:0/3909847448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f0161610 0x7f49f00d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f620c640 1 -- 172.21.15.5:0/3909847448 >> v1:172.21.15.5:6789/0 conn(0x7f49f00d0920 legacy=0x7f49f00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.800+0000 7f49f620c640 1 -- 172.21.15.5:0/3909847448 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00d0d80 con 0x7f49f00d26d0 2024-04-25T09:06:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.801+0000 7f49f620c640 1 --2- 172.21.15.5:0/3909847448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d26d0 0x7f49f00b7950 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009d90 tx=0x7f49e002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb40e48b75b8d3cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.801+0000 7f49f4a09640 1 -- 172.21.15.5:0/3909847448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0031600 con 0x7f49f00d26d0 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.801+0000 7f49f4a09640 1 -- 172.21.15.5:0/3909847448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e00317a0 con 0x7f49f00d26d0 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.801+0000 7f49f4a09640 1 -- 172.21.15.5:0/3909847448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0031b50 con 0x7f49f00d26d0 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.801+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3909847448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d26d0 msgr2=0x7f49f00b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.801+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3909847448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d26d0 0x7f49f00b7950 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009d90 tx=0x7f49e002a5d0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.801+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3909847448 shutdown_connections 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.802+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3909847448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d26d0 0x7f49f00b7950 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.802+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3909847448 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f0161610 0x7f49f00d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.802+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3909847448 >> 172.21.15.5:0/3909847448 conn(0x7f49f00668f0 msgr2=0x7f49f0066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.802+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3909847448 shutdown_connections 2024-04-25T09:06:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.802+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3909847448 wait complete. 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.803+0000 7f49f7c6f640 1 Processor -- start 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.803+0000 7f49f7c6f640 1 -- start start 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f7c6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d0920 0x7f49f014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f7c6f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f00d26d0 0x7f49f00b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f7c6f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f0161610 0x7f49f00b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f7c6f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00d3070 con 0x7f49f00d0920 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f7c6f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00d2b40 con 0x7f49f0161610 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f7c6f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00b7150 con 0x7f49f00d26d0 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d0920 0x7f49f014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d0920 0x7f49f014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56996/0 (socket says 172.21.15.5:56996) 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 -- 172.21.15.5:0/3510332277 learned_addr learned my addr 172.21.15.5:0/3510332277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f520a640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f00d26d0 0x7f49f00b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f620c640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f0161610 0x7f49f00b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 -- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f00d26d0 msgr2=0x7f49f00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f00d26d0 0x7f49f00b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 -- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f0161610 msgr2=0x7f49f00b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f0161610 0x7f49f00b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 -- 172.21.15.5:0/3510332277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00b3080 con 0x7f49f00d0920 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f5a0b640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d0920 0x7f49f014bb20 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f49e800d5f0 tx=0x7f49e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49ee7fc640 1 -- 172.21.15.5:0/3510332277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80125f0 con 0x7f49f00d0920 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49ee7fc640 1 -- 172.21.15.5:0/3510332277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8019070 con 0x7f49f00d0920 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49ee7fc640 1 -- 172.21.15.5:0/3510332277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80129d0 con 0x7f49f00d0920 2024-04-25T09:06:42.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.804+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f00b3360 con 0x7f49f00d0920 2024-04-25T09:06:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.805+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f00b3920 con 0x7f49f00d0920 2024-04-25T09:06:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.806+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f004ef20 con 0x7f49f00d0920 2024-04-25T09:06:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.806+0000 7f49ee7fc640 1 -- 172.21.15.5:0/3510332277 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49e8012b70 con 0x7f49f00d0920 2024-04-25T09:06:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.806+0000 7f49ee7fc640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49dc06b4d0 0x7f49dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.806+0000 7f49ee7fc640 1 -- 172.21.15.5:0/3510332277 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f49e808a630 con 0x7f49f00d0920 2024-04-25T09:06:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.807+0000 7f49f520a640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49dc06b4d0 0x7f49dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.807+0000 7f49f520a640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49dc06b4d0 0x7f49dc06d990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f49f00c9200 tx=0x7f49e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.810+0000 7f49ee7fc640 1 -- 172.21.15.5:0/3510332277 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49e8059440 con 0x7f49f00d0920 2024-04-25T09:06:42.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:42.991+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f49f00b2500 con 0x7f49f00d0920 2024-04-25T09:06:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.629+0000 7f49ee7fc640 1 -- 172.21.15.5:0/3510332277 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v142) v1 ==== 181+0+0 (secure 0 0 0) 0x7f49e8058d40 con 0x7f49f00d0920 2024-04-25T09:06:43.618 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:06:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.633+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49dc06b4d0 msgr2=0x7f49dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.633+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49dc06b4d0 0x7f49dc06d990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f49f00c9200 tx=0x7f49e4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:43.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d0920 msgr2=0x7f49f014bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d0920 0x7f49f014bb20 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f49e800d5f0 tx=0x7f49e800dab0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 shutdown_connections 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f49dc06b4d0 0x7f49dc06d990 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49f0161610 0x7f49f00b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f49f00d26d0 0x7f49f00b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 --2- 172.21.15.5:0/3510332277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49f00d0920 0x7f49f014bb20 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 >> 172.21.15.5:0/3510332277 conn(0x7f49f00668f0 msgr2=0x7f49f015f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 shutdown_connections 2024-04-25T09:06:43.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.634+0000 7f49f7c6f640 1 -- 172.21.15.5:0/3510332277 wait complete. 2024-04-25T09:06:43.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:06:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.758+0000 7f42ea841640 1 Processor -- start 2024-04-25T09:06:43.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.759+0000 7f42ea841640 1 -- start start 2024-04-25T09:06:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.759+0000 7f42ea841640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42e40b9470 0x7f42e40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.759+0000 7f42ea841640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42e40cecf0 0x7f42e40d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.759+0000 7f42ea841640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e4162070 con 0x7f42e415dbd0 2024-04-25T09:06:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.759+0000 7f42ea841640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40cf120 con 0x7f42e40b9470 2024-04-25T09:06:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.759+0000 7f42ea841640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e4162350 con 0x7f42e40cecf0 2024-04-25T09:06:43.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42e40b9470 0x7f42e40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42e415dbd0 0x7f42e41617b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49090/0 (socket says 172.21.15.5:49090) 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e3fff640 1 -- 172.21.15.5:0/1270379891 learned_addr learned my addr 172.21.15.5:0/1270379891 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e8dde640 1 --2- 172.21.15.5:0/1270379891 >> v2:172.21.15.80:3300/0 conn(0x7f42e40cecf0 0x7f42e40d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e37fe640 1 -- 172.21.15.5:0/1270379891 >> v2:172.21.15.80:3300/0 conn(0x7f42e40cecf0 msgr2=0x7f42e40d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e37fe640 1 --2- 172.21.15.5:0/1270379891 >> v2:172.21.15.80:3300/0 conn(0x7f42e40cecf0 0x7f42e40d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e37fe640 1 -- 172.21.15.5:0/1270379891 >> v1:172.21.15.5:6789/0 conn(0x7f42e415dbd0 legacy=0x7f42e41617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e37fe640 1 -- 172.21.15.5:0/1270379891 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40d1c50 con 0x7f42e40b9470 2024-04-25T09:06:43.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.760+0000 7f42e2ffd640 1 -- 172.21.15.5:0/1270379891 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98639822 0 0) 0x7f42e4162070 con 0x7f42e415dbd0 2024-04-25T09:06:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42e37fe640 1 --2- 172.21.15.5:0/1270379891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40b9470 0x7f42e40ce7b0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f42e40d15d0 tx=0x7f42d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7097a6ee2643c688 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42e2ffd640 1 -- 172.21.15.5:0/1270379891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037070 con 0x7f42e40b9470 2024-04-25T09:06:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42e2ffd640 1 -- 172.21.15.5:0/1270379891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4032440 con 0x7f42e40b9470 2024-04-25T09:06:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42e2ffd640 1 -- 172.21.15.5:0/1270379891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4032810 con 0x7f42e40b9470 2024-04-25T09:06:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 -- 172.21.15.5:0/1270379891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40b9470 msgr2=0x7f42e40ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 --2- 172.21.15.5:0/1270379891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40b9470 0x7f42e40ce7b0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f42e40d15d0 tx=0x7f42d402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 -- 172.21.15.5:0/1270379891 shutdown_connections 2024-04-25T09:06:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 --2- 172.21.15.5:0/1270379891 >> v2:172.21.15.80:3300/0 conn(0x7f42e40cecf0 0x7f42e40d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 --2- 172.21.15.5:0/1270379891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40b9470 0x7f42e40ce7b0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 -- 172.21.15.5:0/1270379891 >> 172.21.15.5:0/1270379891 conn(0x7f42e4066ad0 msgr2=0x7f42e4066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 -- 172.21.15.5:0/1270379891 shutdown_connections 2024-04-25T09:06:43.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.761+0000 7f42ea841640 1 -- 172.21.15.5:0/1270379891 wait complete. 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 Processor -- start 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 -- start start 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42e40b9470 0x7f42e415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40cecf0 0x7f42e40aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e415dbd0 0x7f42e41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e415dfb0 con 0x7f42e40cecf0 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4162630 con 0x7f42e415dbd0 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.763+0000 7f42ea841640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e415e130 con 0x7f42e40b9470 2024-04-25T09:06:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40cecf0 0x7f42e40aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40cecf0 0x7f42e40aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57014/0 (socket says 172.21.15.5:57014) 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 -- 172.21.15.5:0/697087123 learned_addr learned my addr 172.21.15.5:0/697087123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e8dde640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e415dbd0 0x7f42e41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e3fff640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42e40b9470 0x7f42e415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 -- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42e40b9470 msgr2=0x7f42e415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42e40b9470 0x7f42e415c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 -- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e415dbd0 msgr2=0x7f42e41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e415dbd0 0x7f42e41602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 -- 172.21.15.5:0/697087123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40aae40 con 0x7f42e40cecf0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e3fff640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42e40b9470 0x7f42e415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e37fe640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40cecf0 0x7f42e40aa4d0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f42d4000c00 tx=0x7f42d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e0ff9640 1 -- 172.21.15.5:0/697087123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037040 con 0x7f42e40cecf0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e0ff9640 1 -- 172.21.15.5:0/697087123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4042070 con 0x7f42e40cecf0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e40ab120 con 0x7f42e40cecf0 2024-04-25T09:06:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42e0ff9640 1 -- 172.21.15.5:0/697087123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4030bd0 con 0x7f42e40cecf0 2024-04-25T09:06:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.764+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e40ab6e0 con 0x7f42e40cecf0 2024-04-25T09:06:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.765+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e40aba20 con 0x7f42e40cecf0 2024-04-25T09:06:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.766+0000 7f42e0ff9640 1 -- 172.21.15.5:0/697087123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42d4047460 con 0x7f42e40cecf0 2024-04-25T09:06:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.766+0000 7f42e0ff9640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42c406b4d0 0x7f42c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.766+0000 7f42e0ff9640 1 -- 172.21.15.5:0/697087123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f42d40aab90 con 0x7f42e40cecf0 2024-04-25T09:06:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.767+0000 7f42e3fff640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42c406b4d0 0x7f42c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.767+0000 7f42e3fff640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42c406b4d0 0x7f42c406d990 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000f60 tx=0x7f42cc007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.771+0000 7f42e0ff9640 1 -- 172.21.15.5:0/697087123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42d4032e20 con 0x7f42e40cecf0 2024-04-25T09:06:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:43.948+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42e40d1760 con 0x7f42e40cecf0 2024-04-25T09:06:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.643+0000 7f42e0ff9640 1 -- 172.21.15.5:0/697087123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v143) v1 ==== 169+0+0 (secure 0 0 0) 0x7f42d4079b50 con 0x7f42e40cecf0 2024-04-25T09:06:44.632 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-25T09:06:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42c406b4d0 msgr2=0x7f42c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42c406b4d0 0x7f42c406d990 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000f60 tx=0x7f42cc007ca0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40cecf0 msgr2=0x7f42e40aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40cecf0 0x7f42e40aa4d0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f42d4000c00 tx=0x7f42d40046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 shutdown_connections 2024-04-25T09:06:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f42c406b4d0 0x7f42c406d990 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e415dbd0 0x7f42e41602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e40cecf0 0x7f42e40aa4d0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 --2- 172.21.15.5:0/697087123 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42e40b9470 0x7f42e415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.647+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 >> 172.21.15.5:0/697087123 conn(0x7f42e4066ad0 msgr2=0x7f42e40b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.648+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 shutdown_connections 2024-04-25T09:06:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.648+0000 7f42ea841640 1 -- 172.21.15.5:0/697087123 wait complete. 2024-04-25T09:06:44.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:06:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.779+0000 7f81bef9d640 1 Processor -- start 2024-04-25T09:06:44.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.779+0000 7f81bef9d640 1 -- start start 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bef9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81b80b4550 0x7f81b80b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bef9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ce190 0x7f81b80cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bef9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b8072690 con 0x7f81b80ae690 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bef9d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b8071ff0 con 0x7f81b80b4550 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bef9d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80b2f50 con 0x7f81b80ce190 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81b7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81b80b4550 0x7f81b80b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bd53a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ce190 0x7f81b80cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bcd39640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f81b80ae690 0x7f81b80aea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:58042/0 (socket says 172.21.15.5:58042) 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.780+0000 7f81bcd39640 1 -- 172.21.15.5:0/2087824438 learned_addr learned my addr 172.21.15.5:0/2087824438 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.781+0000 7f81b7fff640 1 -- 172.21.15.5:0/2087824438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ce190 msgr2=0x7f81b80cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.781+0000 7f81b7fff640 1 --2- 172.21.15.5:0/2087824438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ce190 0x7f81b80cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.781+0000 7f81b7fff640 1 -- 172.21.15.5:0/2087824438 >> v1:172.21.15.80:6789/0 conn(0x7f81b80ae690 legacy=0x7f81b80aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.781+0000 7f81b77fe640 1 -- 172.21.15.5:0/2087824438 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433172573 0 0) 0x7f81b8072690 con 0x7f81b80ae690 2024-04-25T09:06:44.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.781+0000 7f81b7fff640 1 -- 172.21.15.5:0/2087824438 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80cd3d0 con 0x7f81b80b4550 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.781+0000 7f81b7fff640 1 --2- 172.21.15.5:0/2087824438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80b4550 0x7f81b80b2850 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f81a00097a0 tx=0x7f81a002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cac4a0053acfae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81b77fe640 1 -- 172.21.15.5:0/2087824438 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0037070 con 0x7f81b80b4550 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81b77fe640 1 -- 172.21.15.5:0/2087824438 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a002ae50 con 0x7f81b80b4550 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81b77fe640 1 -- 172.21.15.5:0/2087824438 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0032660 con 0x7f81b80b4550 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 -- 172.21.15.5:0/2087824438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80b4550 msgr2=0x7f81b80b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 --2- 172.21.15.5:0/2087824438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80b4550 0x7f81b80b2850 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f81a00097a0 tx=0x7f81a002a100 comp rx=0 tx=0).stop 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 -- 172.21.15.5:0/2087824438 shutdown_connections 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 --2- 172.21.15.5:0/2087824438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ce190 0x7f81b80cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 --2- 172.21.15.5:0/2087824438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80b4550 0x7f81b80b2850 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 -- 172.21.15.5:0/2087824438 >> 172.21.15.5:0/2087824438 conn(0x7f81b80b1550 msgr2=0x7f81b80b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 -- 172.21.15.5:0/2087824438 shutdown_connections 2024-04-25T09:06:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.782+0000 7f81bef9d640 1 -- 172.21.15.5:0/2087824438 wait complete. 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.783+0000 7f81bef9d640 1 Processor -- start 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.783+0000 7f81bef9d640 1 -- start start 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bef9d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ae690 0x7f81b8155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bef9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b80b4550 0x7f81b814b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bef9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80ce190 0x7f81b814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bef9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80cdc70 con 0x7f81b80b4550 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bef9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80cd990 con 0x7f81b80ce190 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bef9d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b815ad60 con 0x7f81b80ae690 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b80b4550 0x7f81b814b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bd53a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80ce190 0x7f81b814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81bcd39640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ae690 0x7f81b8155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b80b4550 0x7f81b814b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57022/0 (socket says 172.21.15.5:57022) 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.784+0000 7f81b7fff640 1 -- 172.21.15.5:0/1396816858 learned_addr learned my addr 172.21.15.5:0/1396816858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b7fff640 1 -- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ae690 msgr2=0x7f81b8155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b7fff640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ae690 0x7f81b8155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b7fff640 1 -- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80ce190 msgr2=0x7f81b814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b7fff640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80ce190 0x7f81b814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b7fff640 1 -- 172.21.15.5:0/1396816858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b814b890 con 0x7f81b80b4550 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b7fff640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b80b4550 0x7f81b814b350 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f81a00098c0 tx=0x7f81a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b57fa640 1 -- 172.21.15.5:0/1396816858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0041030 con 0x7f81b80b4550 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b57fa640 1 -- 172.21.15.5:0/1396816858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a002ac50 con 0x7f81b80b4550 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b8155ba0 con 0x7f81b80b4550 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81b57fa640 1 -- 172.21.15.5:0/1396816858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0037040 con 0x7f81b80b4550 2024-04-25T09:06:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.785+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b8156160 con 0x7f81b80b4550 2024-04-25T09:06:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.786+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b804ef20 con 0x7f81b80b4550 2024-04-25T09:06:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.787+0000 7f81b57fa640 1 -- 172.21.15.5:0/1396816858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81a0044070 con 0x7f81b80b4550 2024-04-25T09:06:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.787+0000 7f81b57fa640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f819806b4d0 0x7f819806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.787+0000 7f81b57fa640 1 -- 172.21.15.5:0/1396816858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f81a002ae00 con 0x7f81b80b4550 2024-04-25T09:06:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.787+0000 7f81bcd39640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f819806b4d0 0x7f819806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.788+0000 7f81bcd39640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f819806b4d0 0x7f819806d990 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f81b00012e0 tx=0x7f81b0001630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.791+0000 7f81b57fa640 1 -- 172.21.15.5:0/1396816858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81a004b070 con 0x7f81b80b4550 2024-04-25T09:06:44.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.973+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f81b806e640 con 0x7f81b80b4550 2024-04-25T09:06:44.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.976+0000 7f81b57fa640 1 -- 172.21.15.5:0/1396816858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f81a0078e10 con 0x7f81b80b4550 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f819806b4d0 msgr2=0x7f819806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f819806b4d0 0x7f819806d990 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f81b00012e0 tx=0x7f81b0001630 comp rx=0 tx=0).stop 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b80b4550 msgr2=0x7f81b814b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b80b4550 0x7f81b814b350 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f81a00098c0 tx=0x7f81a00046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 shutdown_connections 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f819806b4d0 0x7f819806d990 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81b80ce190 0x7f81b814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81b80b4550 0x7f81b814b350 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 --2- 172.21.15.5:0/1396816858 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f81b80ae690 0x7f81b8155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 >> 172.21.15.5:0/1396816858 conn(0x7f81b80b1550 msgr2=0x7f81b80cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.978+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 shutdown_connections 2024-04-25T09:06:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:44.979+0000 7f81bef9d640 1 -- 172.21.15.5:0/1396816858 wait complete. 2024-04-25T09:06:44.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-04-25T09:06:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.092+0000 7f29ff04c640 1 Processor -- start 2024-04-25T09:06:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.092+0000 7f29ff04c640 1 -- start start 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29ff04c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29f815de70 0x7f29f80b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29ff04c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29f80ce7f0 0x7f29f80cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29ff04c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f80cf1c0 con 0x7f29f80b2cc0 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29ff04c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80d2a10 con 0x7f29f815de70 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29ff04c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80d20e0 con 0x7f29f80ce7f0 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29f7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29f80b2cc0 0x7f29f80b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49096/0 (socket says 172.21.15.5:49096) 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29fcde8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29f815de70 0x7f29f80b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29f7fff640 1 -- 172.21.15.5:0/774865858 learned_addr learned my addr 172.21.15.5:0/774865858 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29fd5e9640 1 --2- 172.21.15.5:0/774865858 >> v2:172.21.15.80:3300/0 conn(0x7f29f80ce7f0 0x7f29f80cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29fcde8640 1 -- 172.21.15.5:0/774865858 >> v2:172.21.15.80:3300/0 conn(0x7f29f80ce7f0 msgr2=0x7f29f80cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29fcde8640 1 --2- 172.21.15.5:0/774865858 >> v2:172.21.15.80:3300/0 conn(0x7f29f80ce7f0 0x7f29f80cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29fcde8640 1 -- 172.21.15.5:0/774865858 >> v1:172.21.15.5:6789/0 conn(0x7f29f80b2cc0 legacy=0x7f29f80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.093+0000 7f29fcde8640 1 -- 172.21.15.5:0/774865858 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80d23c0 con 0x7f29f815de70 2024-04-25T09:06:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.094+0000 7f29fcde8640 1 --2- 172.21.15.5:0/774865858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f815de70 0x7f29f80b93e0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f29f80d1970 tx=0x7f29f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec474ebaca05a7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.094+0000 7f29f77fe640 1 -- 172.21.15.5:0/774865858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0037070 con 0x7f29f815de70 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.094+0000 7f29f77fe640 1 -- 172.21.15.5:0/774865858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f0032440 con 0x7f29f815de70 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.094+0000 7f29f77fe640 1 -- 172.21.15.5:0/774865858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0032810 con 0x7f29f815de70 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 -- 172.21.15.5:0/774865858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f815de70 msgr2=0x7f29f80b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 --2- 172.21.15.5:0/774865858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f815de70 0x7f29f80b93e0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f29f80d1970 tx=0x7f29f002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 -- 172.21.15.5:0/774865858 shutdown_connections 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 --2- 172.21.15.5:0/774865858 >> v2:172.21.15.80:3300/0 conn(0x7f29f80ce7f0 0x7f29f80cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 --2- 172.21.15.5:0/774865858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f815de70 0x7f29f80b93e0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 -- 172.21.15.5:0/774865858 >> 172.21.15.5:0/774865858 conn(0x7f29f806b000 msgr2=0x7f29f806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 -- 172.21.15.5:0/774865858 shutdown_connections 2024-04-25T09:06:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.095+0000 7f29ff04c640 1 -- 172.21.15.5:0/774865858 wait complete. 2024-04-25T09:06:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.096+0000 7f29ff04c640 1 Processor -- start 2024-04-25T09:06:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.096+0000 7f29ff04c640 1 -- start start 2024-04-25T09:06:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29ff04c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f80b2cc0 0x7f29f80caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29ff04c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f80ce7f0 0x7f29f80b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29ff04c640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29f815de70 0x7f29f80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29ff04c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b7300 con 0x7f29f80b2cc0 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29ff04c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b9920 con 0x7f29f80ce7f0 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29ff04c640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80d2ea0 con 0x7f29f815de70 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f80b2cc0 0x7f29f80caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f80b2cc0 0x7f29f80caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57044/0 (socket says 172.21.15.5:57044) 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 -- 172.21.15.5:0/1532329141 learned_addr learned my addr 172.21.15.5:0/1532329141 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 -- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29f815de70 msgr2=0x7f29f80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29f815de70 0x7f29f80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 -- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f80ce7f0 msgr2=0x7f29f80b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f80ce7f0 0x7f29f80b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.097+0000 7f29fcde8640 1 -- 172.21.15.5:0/1532329141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80cb0e0 con 0x7f29f80b2cc0 2024-04-25T09:06:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.098+0000 7f29fcde8640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f80b2cc0 0x7f29f80caba0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f29f0000c00 tx=0x7f29f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.098+0000 7f29f57fa640 1 -- 172.21.15.5:0/1532329141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0037040 con 0x7f29f80b2cc0 2024-04-25T09:06:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.098+0000 7f29f57fa640 1 -- 172.21.15.5:0/1532329141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f0030770 con 0x7f29f80b2cc0 2024-04-25T09:06:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.098+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80c8eb0 con 0x7f29f80b2cc0 2024-04-25T09:06:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.098+0000 7f29f57fa640 1 -- 172.21.15.5:0/1532329141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0030b40 con 0x7f29f80b2cc0 2024-04-25T09:06:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.098+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f80c9470 con 0x7f29f80b2cc0 2024-04-25T09:06:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.099+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f804ef20 con 0x7f29f80b2cc0 2024-04-25T09:06:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.099+0000 7f29f57fa640 1 -- 172.21.15.5:0/1532329141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29f0044020 con 0x7f29f80b2cc0 2024-04-25T09:06:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.100+0000 7f29f57fa640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f29d806b4d0 0x7f29d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.100+0000 7f29f57fa640 1 -- 172.21.15.5:0/1532329141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f29f00aa3f0 con 0x7f29f80b2cc0 2024-04-25T09:06:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.100+0000 7f29f7fff640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f29d806b4d0 0x7f29d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.100+0000 7f29f7fff640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f29d806b4d0 0x7f29d806d990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f29e80012e0 tx=0x7f29e8001630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.104+0000 7f29f57fa640 1 -- 172.21.15.5:0/1532329141 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29f0032e20 con 0x7f29f80b2cc0 2024-04-25T09:06:45.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.382+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) v1 -- 0x7f29f8068b00 con 0x7f29f80b2cc0 2024-04-25T09:06:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.644+0000 7f29f57fa640 1 -- 172.21.15.5:0/1532329141 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v494) v1 ==== 159+0+0 (secure 0 0 0) 0x7f29f00313a0 con 0x7f29f80b2cc0 2024-04-25T09:06:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f29d806b4d0 msgr2=0x7f29d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f29d806b4d0 0x7f29d806d990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f29e80012e0 tx=0x7f29e8001630 comp rx=0 tx=0).stop 2024-04-25T09:06:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f80b2cc0 msgr2=0x7f29f80caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f80b2cc0 0x7f29f80caba0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f29f0000c00 tx=0x7f29f00046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 shutdown_connections 2024-04-25T09:06:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f29d806b4d0 0x7f29d806d990 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f29f815de70 0x7f29f80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f80ce7f0 0x7f29f80b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 --2- 172.21.15.5:0/1532329141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f80b2cc0 0x7f29f80caba0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 >> 172.21.15.5:0/1532329141 conn(0x7f29f806b000 msgr2=0x7f29f80cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 shutdown_connections 2024-04-25T09:06:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:45.647+0000 7f29ff04c640 1 -- 172.21.15.5:0/1532329141 wait complete. 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ERROR 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner: 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs/test_scrub_checks.py", line 190, in test_scrub_when_mds_is_inactive 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner: sr_mds_id = self.get_daemon_names('up:standby-replay', status=status)[0] 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner:AttributeError: 'TestScrubControls' object has no attribute 'get_daemon_names' 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner: 2024-04-25T09:06:45.648 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner:Ran 9 tests in 575.632s 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner: 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner: 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs/test_scrub_checks.py", line 190, in test_scrub_when_mds_is_inactive 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner: sr_mds_id = self.get_daemon_names('up:standby-replay', status=status)[0] 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner:AttributeError: 'TestScrubControls' object has no attribute 'get_daemon_names' 2024-04-25T09:06:45.649 INFO:tasks.cephfs_test_runner: 2024-04-25T09:06:45.650 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:06:45.854 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4bafad7c786d4396b254a6fbf7e7e3ef Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:06:45.855 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T09:06:45.865 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T09:06:45.890 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T09:06:45.890 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:45.890 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:45.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:45.913 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-25T09:06:45.913 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:45.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16846 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:45.970 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:45.970 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:45.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:45.988 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T09:06:45.988 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:46.045 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16481 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:46.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.045 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:06:46.062 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:06:46.062 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:06:46.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:06:46.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:06:46.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-25T09:06:46.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.290 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-25T09:06:46.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-25T09:06:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-04-25T09:06:46.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:06:46.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.376 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T09:06:46.393 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T09:06:46.394 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:06:46.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.394 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:06:46.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.532 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T09:06:46.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.627 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T09:06:46.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:46.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T09:06:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-04-25T09:06:46.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:06:46.716 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T09:06:46.726 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:06:46.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.842+0000 7f3087f29640 1 Processor -- start 2024-04-25T09:06:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.843+0000 7f3087f29640 1 -- start start 2024-04-25T09:06:46.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.843+0000 7f3087f29640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f30800cfd80 0x7f308015c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.843+0000 7f3087f29640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 0x7f30800b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.843+0000 7f3087f29640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308006d280 con 0x7f30800cc120 2024-04-25T09:06:46.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.843+0000 7f3087f29640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308006c4c0 con 0x7f30800cfd80 2024-04-25T09:06:46.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.843+0000 7f3087f29640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308006c7a0 con 0x7f308015c620 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3085cc5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f30800cc120 0x7f30800cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49100/0 (socket says 172.21.15.5:49100) 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3085cc5640 1 -- 172.21.15.5:0/3944793859 learned_addr learned my addr 172.21.15.5:0/3944793859 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f30854c4640 1 --2- 172.21.15.5:0/3944793859 >> v2:172.21.15.80:3300/0 conn(0x7f30800cfd80 0x7f308015c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f30864c6640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 0x7f30800b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169939674 0 0) 0x7f308006d280 con 0x7f30800cc120 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f306c003520 con 0x7f30800cc120 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509673494 0 0) 0x7f306c003520 con 0x7f30800cc120 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 msgr2=0x7f30800b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 0x7f30800b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 >> v2:172.21.15.80:3300/0 conn(0x7f30800cfd80 msgr2=0x7f308015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 --2- 172.21.15.5:0/3944793859 >> v2:172.21.15.80:3300/0 conn(0x7f30800cfd80 0x7f308015c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308006ca80 con 0x7f30800cc120 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f307c001670 con 0x7f30800cc120 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 >> v1:172.21.15.5:6789/0 conn(0x7f30800cc120 legacy=0x7f30800cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f306c0039b0 0x7f306c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f306c004800 0x7f306c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 0x7f306c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308006c4c0 con 0x7f306c004800 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308006c7a0 con 0x7f306c0039b0 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c00b9c0 con 0x7f308015c620 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f30854c4640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f306c004800 0x7f306c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.844+0000 7f3085cc5640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f306c0039b0 0x7f306c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.845+0000 7f30864c6640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 0x7f306c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.845+0000 7f30854c4640 1 -- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 msgr2=0x7f306c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.845+0000 7f30854c4640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f308015c620 0x7f306c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.845+0000 7f30854c4640 1 -- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f306c0039b0 msgr2=0x7f306c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.845+0000 7f30854c4640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f306c0039b0 0x7f306c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.845+0000 7f30854c4640 1 -- 172.21.15.5:0/3944793859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c003520 con 0x7f306c004800 2024-04-25T09:06:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.845+0000 7f30854c4640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f306c004800 0x7f306c004c80 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ac0 tx=0x7f306c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a19a5a76b2f57d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070036070 con 0x7f306c004800 2024-04-25T09:06:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3070031400 con 0x7f306c004800 2024-04-25T09:06:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3084cc3640 1 -- 172.21.15.5:0/3944793859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070009690 con 0x7f306c004800 2024-04-25T09:06:46.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3087f29640 1 -- 172.21.15.5:0/3944793859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f306c004800 msgr2=0x7f306c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3087f29640 1 --2- 172.21.15.5:0/3944793859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f306c004800 0x7f306c004c80 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ac0 tx=0x7f306c005830 comp rx=0 tx=0).stop 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f30864c6640 1 -- 172.21.15.5:0/3944793859 reap_dead start 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3087f29640 1 -- 172.21.15.5:0/3944793859 shutdown_connections 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3087f29640 1 -- 172.21.15.5:0/3944793859 >> 172.21.15.5:0/3944793859 conn(0x7f30800668f0 msgr2=0x7f3080066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3087f29640 1 -- 172.21.15.5:0/3944793859 shutdown_connections 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.846+0000 7f3087f29640 1 -- 172.21.15.5:0/3944793859 wait complete. 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 Processor -- start 2024-04-25T09:06:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 -- start start 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f306c004800 0x7f30800ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30800cb410 0x7f30801f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30801f0dc0 0x7f30801f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800cc500 con 0x7f30801f0dc0 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308015ce50 con 0x7f30800cb410 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f3087f29640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800cc680 con 0x7f306c004800 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f30864c6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30801f0dc0 0x7f30801f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f30864c6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30801f0dc0 0x7f30801f17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57060/0 (socket says 172.21.15.5:57060) 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.848+0000 7f30864c6640 1 -- 172.21.15.5:0/3721585567 learned_addr learned my addr 172.21.15.5:0/3721585567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f3085cc5640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f306c004800 0x7f30800ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30854c4640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30800cb410 0x7f30801f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30864c6640 1 -- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f306c004800 msgr2=0x7f30800ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30864c6640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f306c004800 0x7f30800ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30864c6640 1 -- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30800cb410 msgr2=0x7f30801f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30864c6640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30800cb410 0x7f30801f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30864c6640 1 -- 172.21.15.5:0/3721585567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080145060 con 0x7f30801f0dc0 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30854c4640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30800cb410 0x7f30801f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f3085cc5640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f306c004800 0x7f30800ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30864c6640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30801f0dc0 0x7f30801f17f0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f3080072620 tx=0x7f307800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30767fc640 1 -- 172.21.15.5:0/3721585567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078015430 con 0x7f30801f0dc0 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30767fc640 1 -- 172.21.15.5:0/3721585567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307801d070 con 0x7f30801f0dc0 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30801444e0 con 0x7f30801f0dc0 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f30767fc640 1 -- 172.21.15.5:0/3721585567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078015810 con 0x7f30801f0dc0 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.849+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3080144aa0 con 0x7f30801f0dc0 2024-04-25T09:06:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.850+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30800cf8e0 con 0x7f30801f0dc0 2024-04-25T09:06:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.851+0000 7f30767fc640 1 -- 172.21.15.5:0/3721585567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30780159b0 con 0x7f30801f0dc0 2024-04-25T09:06:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.851+0000 7f30767fc640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f306406b500 0x7f306406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.851+0000 7f30767fc640 1 -- 172.21.15.5:0/3721585567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f307808a8b0 con 0x7f30801f0dc0 2024-04-25T09:06:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.851+0000 7f3085cc5640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f306406b500 0x7f306406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.852+0000 7f3085cc5640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f306406b500 0x7f306406d9c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f307c001eb0 tx=0x7f307c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:46.855+0000 7f30767fc640 1 -- 172.21.15.5:0/3721585567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30800cf8e0 con 0x7f30801f0dc0 2024-04-25T09:06:47.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.035+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3080144de0 con 0x7f306406b500 2024-04-25T09:06:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.037+0000 7f30767fc640 1 -- 172.21.15.5:0/3721585567 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13540 (secure 0 0 0) 0x7f3080144de0 con 0x7f306406b500 2024-04-25T09:06:47.025 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:06:47.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f306406b500 msgr2=0x7f306406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f306406b500 0x7f306406d9c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f307c001eb0 tx=0x7f307c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30801f0dc0 msgr2=0x7f30801f17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30801f0dc0 0x7f30801f17f0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f3080072620 tx=0x7f307800f580 comp rx=0 tx=0).stop 2024-04-25T09:06:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 shutdown_connections 2024-04-25T09:06:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f306406b500 0x7f306406d9c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30801f0dc0 0x7f30801f17f0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30800cb410 0x7f30801f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 --2- 172.21.15.5:0/3721585567 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f306c004800 0x7f30800ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 >> 172.21.15.5:0/3721585567 conn(0x7f30800668f0 msgr2=0x7f308015fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 shutdown_connections 2024-04-25T09:06:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.039+0000 7f3087f29640 1 -- 172.21.15.5:0/3721585567 wait complete. 2024-04-25T09:06:47.038 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-04-25T09:06:46.526128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":454804,"kb_used_data":15208,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754519916,"statfs":{"total":773094113280,"available":772628393984,"internally_reserved":0,"allocated":15572992,"data_stored":7462736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1075972927,"num_objects":-1046,"num_object_clones":0,"num_object_copies":-2092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1046,"num_whiteouts":0,"num_read":-13,"num_read_kb":-2187,"num_write":-1107,"num_write_kb":-1050903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-14,"num_bytes_recovered":-14680064,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001326"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":402,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.320738+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:06:45.320738+0000","last_peered":"2024-04-25T09:06:45.320738+0000","last_clean":"2024-04-25T09:06:45.320738+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:06:45.320738+0000","last_undegraded":"2024-04-25T09:06:45.320738+0000","last_fullsized":"2024-04-25T09:06:45.320738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59304,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55724,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316116,"statfs":{"total":96636764160,"available":96579702784,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:47.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:47.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.152+0000 7f7ee57f5640 1 Processor -- start 2024-04-25T09:06:47.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.152+0000 7f7ee57f5640 1 -- start start 2024-04-25T09:06:47.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.152+0000 7f7ee57f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee015df80 0x7f7ee00ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.152+0000 7f7ee57f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ee0071bd0 0x7f7ee00cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.152+0000 7f7ee57f5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0072150 con 0x7f7ee006cbf0 2024-04-25T09:06:47.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.152+0000 7f7ee57f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee00cbd50 con 0x7f7ee0071bd0 2024-04-25T09:06:47.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.152+0000 7f7ee57f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00cc030 con 0x7f7ee015df80 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7edf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ee0071bd0 0x7f7ee00cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7edf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ee0071bd0 0x7f7ee00cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57064/0 (socket says 172.21.15.5:57064) 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7edf7fe640 1 -- 172.21.15.5:0/1895316862 learned_addr learned my addr 172.21.15.5:0/1895316862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7ede7fc640 1 --2- 172.21.15.5:0/1895316862 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee015df80 0x7f7ee00ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7edf7fe640 1 -- 172.21.15.5:0/1895316862 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee015df80 msgr2=0x7f7ee00ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7edf7fe640 1 --2- 172.21.15.5:0/1895316862 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee015df80 0x7f7ee00ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7edf7fe640 1 -- 172.21.15.5:0/1895316862 >> v1:172.21.15.80:6789/0 conn(0x7f7ee006cbf0 legacy=0x7f7ee00cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.153+0000 7f7edf7fe640 1 -- 172.21.15.5:0/1895316862 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00cc310 con 0x7f7ee0071bd0 2024-04-25T09:06:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7edf7fe640 1 --2- 172.21.15.5:0/1895316862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee0071bd0 0x7f7ee00cd050 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009870 tx=0x7f7ed802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a474dda4d735f4ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7eddffb640 1 -- 172.21.15.5:0/1895316862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8037070 con 0x7f7ee0071bd0 2024-04-25T09:06:47.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7eddffb640 1 -- 172.21.15.5:0/1895316862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed802ae50 con 0x7f7ee0071bd0 2024-04-25T09:06:47.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7eddffb640 1 -- 172.21.15.5:0/1895316862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8032860 con 0x7f7ee0071bd0 2024-04-25T09:06:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 -- 172.21.15.5:0/1895316862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee0071bd0 msgr2=0x7f7ee00cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/1895316862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee0071bd0 0x7f7ee00cd050 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009870 tx=0x7f7ed802a300 comp rx=0 tx=0).stop 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 -- 172.21.15.5:0/1895316862 shutdown_connections 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/1895316862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee0071bd0 0x7f7ee00cd050 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/1895316862 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee015df80 0x7f7ee00ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 -- 172.21.15.5:0/1895316862 >> 172.21.15.5:0/1895316862 conn(0x7f7ee00b1c50 msgr2=0x7f7ee00b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 -- 172.21.15.5:0/1895316862 shutdown_connections 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.154+0000 7f7ee57f5640 1 -- 172.21.15.5:0/1895316862 wait complete. 2024-04-25T09:06:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 Processor -- start 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 -- start start 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee006cbf0 0x7f7ee00c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee0071bd0 0x7f7ee006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee015df80 0x7f7ee01f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee006cfd0 con 0x7f7ee015df80 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00ce360 con 0x7f7ee006cbf0 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.156+0000 7f7ee57f5640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee006d150 con 0x7f7ee0071bd0 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee015df80 0x7f7ee01f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee015df80 0x7f7ee01f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57068/0 (socket says 172.21.15.5:57068) 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 -- 172.21.15.5:0/3424624004 learned_addr learned my addr 172.21.15.5:0/3424624004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7ede7fc640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee0071bd0 0x7f7ee006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edeffd640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee006cbf0 0x7f7ee00c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 -- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee0071bd0 msgr2=0x7f7ee006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee0071bd0 0x7f7ee006dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 -- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee006cbf0 msgr2=0x7f7ee00c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee006cbf0 0x7f7ee00c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 -- 172.21.15.5:0/3424624004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00c8a70 con 0x7f7ee015df80 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7ede7fc640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee0071bd0 0x7f7ee006dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7edf7fe640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee015df80 0x7f7ee01f3520 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009870 tx=0x7f7ed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7ec77fe640 1 -- 172.21.15.5:0/3424624004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8041070 con 0x7f7ee015df80 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7ec77fe640 1 -- 172.21.15.5:0/3424624004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed803c680 con 0x7f7ee015df80 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7ec77fe640 1 -- 172.21.15.5:0/3424624004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8037040 con 0x7f7ee015df80 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee00c8d50 con 0x7f7ee015df80 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.157+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee00c86d0 con 0x7f7ee015df80 2024-04-25T09:06:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.158+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee00c9140 con 0x7f7ee015df80 2024-04-25T09:06:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.159+0000 7f7ec77fe640 1 -- 172.21.15.5:0/3424624004 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ed8044070 con 0x7f7ee015df80 2024-04-25T09:06:47.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.159+0000 7f7ec77fe640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7ecc06b4d0 0x7f7ecc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.159+0000 7f7ec77fe640 1 -- 172.21.15.5:0/3424624004 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ed80aa820 con 0x7f7ee015df80 2024-04-25T09:06:47.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.160+0000 7f7edeffd640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7ecc06b4d0 0x7f7ecc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.160+0000 7f7edeffd640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7ecc06b4d0 0x7f7ecc06d990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.164+0000 7f7ec77fe640 1 -- 172.21.15.5:0/3424624004 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ed8079ab0 con 0x7f7ee015df80 2024-04-25T09:06:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.339+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ee00c8f20 con 0x7f7ecc06b4d0 2024-04-25T09:06:47.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.340+0000 7f7ec77fe640 1 -- 172.21.15.5:0/3424624004 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13540 (secure 0 0 0) 0x7f7ee00c8f20 con 0x7f7ecc06b4d0 2024-04-25T09:06:47.328 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:47.329 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7ecc06b4d0 msgr2=0x7f7ecc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7ecc06b4d0 0x7f7ecc06d990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee015df80 msgr2=0x7f7ee01f3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee015df80 0x7f7ee01f3520 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009870 tx=0x7f7ed80046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 shutdown_connections 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7ecc06b4d0 0x7f7ecc06d990 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee015df80 0x7f7ee01f3520 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ee0071bd0 0x7f7ee006dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 --2- 172.21.15.5:0/3424624004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee006cbf0 0x7f7ee00c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 >> 172.21.15.5:0/3424624004 conn(0x7f7ee00b1c50 msgr2=0x7f7ee00ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 shutdown_connections 2024-04-25T09:06:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.342+0000 7f7ee57f5640 1 -- 172.21.15.5:0/3424624004 wait complete. 2024-04-25T09:06:47.341 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-04-25T09:06:46.526128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":454804,"kb_used_data":15208,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754519916,"statfs":{"total":773094113280,"available":772628393984,"internally_reserved":0,"allocated":15572992,"data_stored":7462736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1075972927,"num_objects":-1046,"num_object_clones":0,"num_object_copies":-2092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1046,"num_whiteouts":0,"num_read":-13,"num_read_kb":-2187,"num_write":-1107,"num_write_kb":-1050903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-14,"num_bytes_recovered":-14680064,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001326"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":402,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.320738+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:06:45.320738+0000","last_peered":"2024-04-25T09:06:45.320738+0000","last_clean":"2024-04-25T09:06:45.320738+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:06:45.320738+0000","last_undegraded":"2024-04-25T09:06:45.320738+0000","last_fullsized":"2024-04-25T09:06:45.320738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59304,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55724,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316116,"statfs":{"total":96636764160,"available":96579702784,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:47.342 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:06:47.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.455+0000 7efcf3570640 1 Processor -- start 2024-04-25T09:06:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.455+0000 7efcf3570640 1 -- start start 2024-04-25T09:06:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf3570640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efcec06b7d0 0x7efcec06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf3570640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec06bbb0 0x7efcec0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf3570640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcec0b4730 con 0x7efcec15da10 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf3570640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcec0d0b70 con 0x7efcec06b7d0 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf3570640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0cbf30 con 0x7efcec06bbb0 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf130c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efcec06b7d0 0x7efcec06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf1b0d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efcec15da10 0x7efcec15de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49110/0 (socket says 172.21.15.5:49110) 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf1b0d640 1 -- 172.21.15.5:0/911357911 learned_addr learned my addr 172.21.15.5:0/911357911 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf0b0b640 1 --2- 172.21.15.5:0/911357911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec06bbb0 0x7efcec0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf130c640 1 -- 172.21.15.5:0/911357911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec06bbb0 msgr2=0x7efcec0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf130c640 1 --2- 172.21.15.5:0/911357911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec06bbb0 0x7efcec0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf130c640 1 -- 172.21.15.5:0/911357911 >> v1:172.21.15.5:6789/0 conn(0x7efcec15da10 legacy=0x7efcec15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcdffff640 1 -- 172.21.15.5:0/911357911 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751999819 0 0) 0x7efce4001490 con 0x7efcec15da10 2024-04-25T09:06:47.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.456+0000 7efcf130c640 1 -- 172.21.15.5:0/911357911 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec0d0da0 con 0x7efcec06b7d0 2024-04-25T09:06:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcf130c640 1 --2- 172.21.15.5:0/911357911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec06aef0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7efce00097a0 tx=0x7efce002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e68f3371ecc25cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcdffff640 1 -- 172.21.15.5:0/911357911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0037070 con 0x7efcec06b7d0 2024-04-25T09:06:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcdffff640 1 -- 172.21.15.5:0/911357911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0032440 con 0x7efcec06b7d0 2024-04-25T09:06:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcdffff640 1 -- 172.21.15.5:0/911357911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0032810 con 0x7efcec06b7d0 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcf3570640 1 -- 172.21.15.5:0/911357911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 msgr2=0x7efcec06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcf3570640 1 --2- 172.21.15.5:0/911357911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec06aef0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7efce00097a0 tx=0x7efce002a210 comp rx=0 tx=0).stop 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcf3570640 1 -- 172.21.15.5:0/911357911 shutdown_connections 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcf3570640 1 --2- 172.21.15.5:0/911357911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec06bbb0 0x7efcec0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcf3570640 1 --2- 172.21.15.5:0/911357911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec06aef0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.457+0000 7efcf3570640 1 -- 172.21.15.5:0/911357911 >> 172.21.15.5:0/911357911 conn(0x7efcec0d18e0 msgr2=0x7efcec0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.458+0000 7efcf3570640 1 -- 172.21.15.5:0/911357911 shutdown_connections 2024-04-25T09:06:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.458+0000 7efcf3570640 1 -- 172.21.15.5:0/911357911 wait complete. 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 Processor -- start 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 -- start start 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcec06bbb0 0x7efcec0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec15da10 0x7efcec0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0cc460 con 0x7efcec06b7d0 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0cc7d0 con 0x7efcec06bbb0 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.459+0000 7efcf3570640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0ccc60 con 0x7efcec15da10 2024-04-25T09:06:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57086/0 (socket says 172.21.15.5:57086) 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 -- 172.21.15.5:0/3574462638 learned_addr learned my addr 172.21.15.5:0/3574462638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf1b0d640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec15da10 0x7efcec0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf0b0b640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcec06bbb0 0x7efcec0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 -- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec15da10 msgr2=0x7efcec0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec15da10 0x7efcec0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 -- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcec06bbb0 msgr2=0x7efcec0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcec06bbb0 0x7efcec0cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 -- 172.21.15.5:0/3574462638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec0b6530 con 0x7efcec06b7d0 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf0b0b640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcec06bbb0 0x7efcec0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf130c640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec160ed0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7efce0035040 tx=0x7efce00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcddffb640 1 -- 172.21.15.5:0/3574462638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0037040 con 0x7efcec06b7d0 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcddffb640 1 -- 172.21.15.5:0/3574462638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0030500 con 0x7efcec06b7d0 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcddffb640 1 -- 172.21.15.5:0/3574462638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0030910 con 0x7efcec06b7d0 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.460+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec0b6810 con 0x7efcec06b7d0 2024-04-25T09:06:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.461+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec0b6dd0 con 0x7efcec06b7d0 2024-04-25T09:06:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.462+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcec04ef20 con 0x7efcec06b7d0 2024-04-25T09:06:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.462+0000 7efcddffb640 1 -- 172.21.15.5:0/3574462638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efce0044020 con 0x7efcec06b7d0 2024-04-25T09:06:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.462+0000 7efcddffb640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efcd006b4d0 0x7efcd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.463+0000 7efcddffb640 1 -- 172.21.15.5:0/3574462638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efce00aa170 con 0x7efcec06b7d0 2024-04-25T09:06:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.463+0000 7efcf0b0b640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efcd006b4d0 0x7efcd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.463+0000 7efcf0b0b640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efcd006b4d0 0x7efcd006d990 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efcec15b8d0 tx=0x7efce8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.467+0000 7efcddffb640 1 -- 172.21.15.5:0/3574462638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efce0079380 con 0x7efcec06b7d0 2024-04-25T09:06:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.644+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efcec06eec0 con 0x7efcd006b4d0 2024-04-25T09:06:47.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.645+0000 7efcddffb640 1 -- 172.21.15.5:0/3574462638 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13540 (secure 0 0 0) 0x7efcec06eec0 con 0x7efcd006b4d0 2024-04-25T09:06:47.634 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:06:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efcd006b4d0 msgr2=0x7efcd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efcd006b4d0 0x7efcd006d990 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efcec15b8d0 tx=0x7efce8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 msgr2=0x7efcec160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec160ed0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7efce0035040 tx=0x7efce00046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 shutdown_connections 2024-04-25T09:06:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7efcd006b4d0 0x7efcd006d990 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcec15da10 0x7efcec0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcec06bbb0 0x7efcec0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 --2- 172.21.15.5:0/3574462638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcec06b7d0 0x7efcec160ed0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 >> 172.21.15.5:0/3574462638 conn(0x7efcec0d18e0 msgr2=0x7efcec06e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 shutdown_connections 2024-04-25T09:06:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.647+0000 7efcf3570640 1 -- 172.21.15.5:0/3574462638 wait complete. 2024-04-25T09:06:47.646 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-04-25T09:06:46.526128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":454804,"kb_used_data":15208,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754519916,"statfs":{"total":773094113280,"available":772628393984,"internally_reserved":0,"allocated":15572992,"data_stored":7462736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1075972927,"num_objects":-1046,"num_object_clones":0,"num_object_copies":-2092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1046,"num_whiteouts":0,"num_read":-13,"num_read_kb":-2187,"num_write":-1107,"num_write_kb":-1050903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-14,"num_bytes_recovered":-14680064,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001326"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":402,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.320738+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:06:45.320738+0000","last_peered":"2024-04-25T09:06:45.320738+0000","last_clean":"2024-04-25T09:06:45.320738+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:06:45.320738+0000","last_undegraded":"2024-04-25T09:06:45.320738+0000","last_fullsized":"2024-04-25T09:06:45.320738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59304,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55724,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316116,"statfs":{"total":96636764160,"available":96579702784,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:47.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.759+0000 7f3dbabc4640 1 Processor -- start 2024-04-25T09:06:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.759+0000 7f3dbabc4640 1 -- start start 2024-04-25T09:06:47.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.760+0000 7f3dbabc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3db415bdc0 0x7f3db40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.760+0000 7f3dbabc4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db40cdcb0 con 0x7f3db40ce9a0 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.760+0000 7f3dbabc4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db40cdf90 con 0x7f3db40cd6e0 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.760+0000 7f3dbabc4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db40b47e0 con 0x7f3db415bdc0 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.760+0000 7f3db9161640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3db40ce9a0 0x7f3db40b52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49112/0 (socket says 172.21.15.5:49112) 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.760+0000 7f3db9161640 1 -- 172.21.15.5:0/3571031674 learned_addr learned my addr 172.21.15.5:0/3571031674 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db8960640 1 --2- 172.21.15.5:0/3571031674 >> v2:172.21.15.80:3300/0 conn(0x7f3db415bdc0 0x7f3db40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652639144 0 0) 0x7f3db40cdcb0 con 0x7f3db40ce9a0 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d9c003520 con 0x7f3db40ce9a0 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145156235 0 0) 0x7f3d9c003520 con 0x7f3db40ce9a0 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 >> v2:172.21.15.80:3300/0 conn(0x7f3db415bdc0 msgr2=0x7f3db40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 --2- 172.21.15.5:0/3571031674 >> v2:172.21.15.80:3300/0 conn(0x7f3db415bdc0 0x7f3db40cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 >> v1:172.21.15.80:6789/0 conn(0x7f3db40cd6e0 legacy=0x7f3db40ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40b4ac0 con 0x7f3db40ce9a0 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f3da4001690 con 0x7f3db40ce9a0 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 >> v1:172.21.15.5:6789/0 conn(0x7f3db40ce9a0 legacy=0x7f3db40b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0039b0 0x7f3d9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d9c0043b0 0x7f3d9c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d9c005080 0x7f3d9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40b47e0 con 0x7f3d9c0043b0 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c00bfe0 con 0x7f3d9c005080 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c00c1e0 con 0x7f3d9c0039b0 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db3fff640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d9c0043b0 0x7f3d9c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db9161640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d9c005080 0x7f3d9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db8960640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0039b0 0x7f3d9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db3fff640 1 -- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0039b0 msgr2=0x7f3d9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db3fff640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0039b0 0x7f3d9c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db3fff640 1 -- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d9c005080 msgr2=0x7f3d9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db3fff640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d9c005080 0x7f3d9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db9161640 1 -- 172.21.15.5:0/3571031674 reap_dead start 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.761+0000 7f3db3fff640 1 -- 172.21.15.5:0/3571031674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c003520 con 0x7f3d9c0043b0 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.762+0000 7f3db3fff640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d9c0043b0 0x7f3d9c004880 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f3da8001860 tx=0x7f3d9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ac20d24c905001 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.762+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8037070 con 0x7f3d9c0043b0 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.762+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da802abe0 con 0x7f3d9c0043b0 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.762+0000 7f3db37fe640 1 -- 172.21.15.5:0/3571031674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8001430 con 0x7f3d9c0043b0 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.763+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3571031674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d9c0043b0 msgr2=0x7f3d9c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.763+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d9c0043b0 0x7f3d9c004880 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f3da8001860 tx=0x7f3d9c005830 comp rx=0 tx=0).stop 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.763+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3571031674 shutdown_connections 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.763+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3571031674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d9c0043b0 0x7f3d9c004880 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.763+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3571031674 >> 172.21.15.5:0/3571031674 conn(0x7f3db40d18f0 msgr2=0x7f3db40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.763+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3571031674 shutdown_connections 2024-04-25T09:06:47.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.763+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3571031674 wait complete. 2024-04-25T09:06:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.764+0000 7f3dbabc4640 1 Processor -- start 2024-04-25T09:06:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.764+0000 7f3dbabc4640 1 -- start start 2024-04-25T09:06:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3dbabc4640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0043b0 0x7f3db414d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3dbabc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3db40c5400 0x7f3db4159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3dbabc4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db4159b70 0x7f3db414bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3dbabc4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db415c1a0 con 0x7f3db4159b70 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3dbabc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40d09a0 con 0x7f3db40c5400 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3dbabc4640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db415c320 con 0x7f3d9c0043b0 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db4159b70 0x7f3db414bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db4159b70 0x7f3db414bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57106/0 (socket says 172.21.15.5:57106) 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 -- 172.21.15.5:0/3186729347 learned_addr learned my addr 172.21.15.5:0/3186729347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db3fff640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3db40c5400 0x7f3db4159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db8960640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0043b0 0x7f3db414d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 -- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0043b0 msgr2=0x7f3db414d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0043b0 0x7f3db414d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 -- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3db40c5400 msgr2=0x7f3db4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3db40c5400 0x7f3db4159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.765+0000 7f3db9161640 1 -- 172.21.15.5:0/3186729347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db414da10 con 0x7f3db4159b70 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.766+0000 7f3db9161640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db4159b70 0x7f3db414bd70 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.766+0000 7f3db17fa640 1 -- 172.21.15.5:0/3186729347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4007740 con 0x7f3db4159b70 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.766+0000 7f3db17fa640 1 -- 172.21.15.5:0/3186729347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da4018070 con 0x7f3db4159b70 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.766+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db414aa30 con 0x7f3db4159b70 2024-04-25T09:06:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.766+0000 7f3db17fa640 1 -- 172.21.15.5:0/3186729347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400f9f0 con 0x7f3db4159b70 2024-04-25T09:06:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.766+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db414afb0 con 0x7f3db4159b70 2024-04-25T09:06:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.767+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db4067ce0 con 0x7f3db4159b70 2024-04-25T09:06:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.767+0000 7f3db17fa640 1 -- 172.21.15.5:0/3186729347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3da400fb90 con 0x7f3db4159b70 2024-04-25T09:06:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.768+0000 7f3db17fa640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3da006b6a0 0x7f3da006db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.768+0000 7f3db17fa640 1 -- 172.21.15.5:0/3186729347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3da4089c10 con 0x7f3db4159b70 2024-04-25T09:06:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.768+0000 7f3db8960640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3da006b6a0 0x7f3da006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.768+0000 7f3db8960640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3da006b6a0 0x7f3da006db60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3db40b6270 tx=0x7f3dac00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.772+0000 7f3db17fa640 1 -- 172.21.15.5:0/3186729347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3db4067ce0 con 0x7f3db4159b70 2024-04-25T09:06:47.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:47.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:47.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.954+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3db40d2560 con 0x7f3db4159b70 2024-04-25T09:06:47.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.954+0000 7f3db17fa640 1 -- 172.21.15.5:0/3186729347 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f3db414da10 con 0x7f3db4159b70 2024-04-25T09:06:47.943 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:47.943 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":143,"fsid":"dc25bcb4-77ea-4563-9f35-ae8cfdf8a422","created":"2024-04-25T08:56:20.281240+0000","modified":"2024-04-25T09:06:44.638703+0000","last_up_change":"2024-04-25T08:56:30.886390+0000","last_in_change":"2024-04-25T08:56:22.341737+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:56:32.432002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a064f71-599e-4ab9-b8fb-23796c79795e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6801","nonce":1814386695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6803","nonce":1814386695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6807","nonce":1814386695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1814386695},{"type":"v1","addr":"172.21.15.5:6805","nonce":1814386695}]},"public_addr":"172.21.15.5:6801/1814386695","cluster_addr":"172.21.15.5:6803/1814386695","heartbeat_back_addr":"172.21.15.5:6807/1814386695","heartbeat_front_addr":"172.21.15.5:6805/1814386695","state":["exists","up"]},{"osd":1,"uuid":"71a83604-6b0e-42a3-bd0a-9e3306362178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6817","nonce":1158282071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6819","nonce":1158282071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6824","nonce":1158282071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1158282071},{"type":"v1","addr":"172.21.15.5:6821","nonce":1158282071}]},"public_addr":"172.21.15.5:6817/1158282071","cluster_addr":"172.21.15.5:6819/1158282071","heartbeat_back_addr":"172.21.15.5:6824/1158282071","heartbeat_front_addr":"172.21.15.5:6821/1158282071","state":["exists","up"]},{"osd":2,"uuid":"f8b7d74d-c9fe-49a3-a3a9-800a91021020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6825","nonce":3851787171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6827","nonce":3851787171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6831","nonce":3851787171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3851787171},{"type":"v1","addr":"172.21.15.5:6829","nonce":3851787171}]},"public_addr":"172.21.15.5:6825/3851787171","cluster_addr":"172.21.15.5:6827/3851787171","heartbeat_back_addr":"172.21.15.5:6831/3851787171","heartbeat_front_addr":"172.21.15.5:6829/3851787171","state":["exists","up"]},{"osd":3,"uuid":"93499828-762d-4087-8ee5-f7620b8ffa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6809","nonce":2008289449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6811","nonce":2008289449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6816","nonce":2008289449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2008289449},{"type":"v1","addr":"172.21.15.5:6813","nonce":2008289449}]},"public_addr":"172.21.15.5:6809/2008289449","cluster_addr":"172.21.15.5:6811/2008289449","heartbeat_back_addr":"172.21.15.5:6816/2008289449","heartbeat_front_addr":"172.21.15.5:6813/2008289449","state":["exists","up"]},{"osd":4,"uuid":"c4fbdf1d-dd3f-455a-8420-b8527fb95078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6817","nonce":1836296073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6819","nonce":1836296073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6823","nonce":1836296073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1836296073},{"type":"v1","addr":"172.21.15.80:6821","nonce":1836296073}]},"public_addr":"172.21.15.80:6817/1836296073","cluster_addr":"172.21.15.80:6819/1836296073","heartbeat_back_addr":"172.21.15.80:6823/1836296073","heartbeat_front_addr":"172.21.15.80:6821/1836296073","state":["exists","up"]},{"osd":5,"uuid":"399ef7ed-a941-4160-bd42-80121fbe96d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6825","nonce":1661516176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6827","nonce":1661516176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6831","nonce":1661516176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1661516176},{"type":"v1","addr":"172.21.15.80:6829","nonce":1661516176}]},"public_addr":"172.21.15.80:6825/1661516176","cluster_addr":"172.21.15.80:6827/1661516176","heartbeat_back_addr":"172.21.15.80:6831/1661516176","heartbeat_front_addr":"172.21.15.80:6829/1661516176","state":["exists","up"]},{"osd":6,"uuid":"d674a70b-f7bd-4f94-8fb3-29b46bbc4746","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6807","nonce":2858900277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6811","nonce":2858900277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6815","nonce":2858900277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":2858900277},{"type":"v1","addr":"172.21.15.80:6813","nonce":2858900277}]},"public_addr":"172.21.15.80:6807/2858900277","cluster_addr":"172.21.15.80:6811/2858900277","heartbeat_back_addr":"172.21.15.80:6815/2858900277","heartbeat_front_addr":"172.21.15.80:6813/2858900277","state":["exists","up"]},{"osd":7,"uuid":"b685a12f-237d-497f-b1b2-4b0dcf08a50d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6801","nonce":4179945280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6803","nonce":4179945280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6810","nonce":4179945280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4179945280},{"type":"v1","addr":"172.21.15.80:6806","nonce":4179945280}]},"public_addr":"172.21.15.80:6801/4179945280","cluster_addr":"172.21.15.80:6803/4179945280","heartbeat_back_addr":"172.21.15.80:6810/4179945280","heartbeat_front_addr":"172.21.15.80:6806/4179945280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.485382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.477658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.547667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.436422+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.546278+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.508037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.501399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:56:27.452291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1713726638":"2024-04-26T09:06:41.596735+0000","172.21.15.5:6834/1713726638":"2024-04-26T09:06:41.596735+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.956+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3da006b6a0 msgr2=0x7f3da006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.956+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3da006b6a0 0x7f3da006db60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3db40b6270 tx=0x7f3dac00b040 comp rx=0 tx=0).stop 2024-04-25T09:06:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.956+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db4159b70 msgr2=0x7f3db414bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.956+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db4159b70 0x7f3db414bd70 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da4007430 comp rx=0 tx=0).stop 2024-04-25T09:06:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 shutdown_connections 2024-04-25T09:06:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f3da006b6a0 0x7f3da006db60 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db4159b70 0x7f3db414bd70 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3db40c5400 0x7f3db4159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 --2- 172.21.15.5:0/3186729347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3d9c0043b0 0x7f3db414d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 >> 172.21.15.5:0/3186729347 conn(0x7f3db40d18f0 msgr2=0x7f3db40b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 shutdown_connections 2024-04-25T09:06:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:47.957+0000 7f3dbabc4640 1 -- 172.21.15.5:0/3186729347 wait complete. 2024-04-25T09:06:48.957 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T09:06:48.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.088+0000 7f4b65ed8640 1 Processor -- start 2024-04-25T09:06:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.088+0000 7f4b65ed8640 1 -- start start 2024-04-25T09:06:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b65ed8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b65ed8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b600ce900 0x7f4b6006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b65ed8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b600ae630 con 0x7f4b6006cad0 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b65ed8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6006ed30 con 0x7f4b600ce900 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b65ed8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6006f010 con 0x7f4b6015dd10 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b5effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b600ce900 0x7f4b6006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b5effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b600ce900 0x7f4b6006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57118/0 (socket says 172.21.15.5:57118) 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b5effd640 1 -- 172.21.15.5:0/2875683982 learned_addr learned my addr 172.21.15.5:0/2875683982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b5f7fe640 1 --2- 172.21.15.5:0/2875683982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b5effd640 1 -- 172.21.15.5:0/2875683982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 msgr2=0x7f4b60070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b5effd640 1 --2- 172.21.15.5:0/2875683982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.089+0000 7f4b5effd640 1 -- 172.21.15.5:0/2875683982 >> v1:172.21.15.80:6789/0 conn(0x7f4b6006cad0 legacy=0x7f4b600aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.090+0000 7f4b5effd640 1 -- 172.21.15.5:0/2875683982 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6006f2f0 con 0x7f4b600ce900 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.090+0000 7f4b5effd640 1 --2- 172.21.15.5:0/2875683982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b600ce900 0x7f4b6006e4e0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009870 tx=0x7f4b4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946511b29d47d8db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.090+0000 7f4b5e7fc640 1 -- 172.21.15.5:0/2875683982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48037070 con 0x7f4b600ce900 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.090+0000 7f4b5e7fc640 1 -- 172.21.15.5:0/2875683982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48032440 con 0x7f4b600ce900 2024-04-25T09:06:49.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.090+0000 7f4b5e7fc640 1 -- 172.21.15.5:0/2875683982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48032810 con 0x7f4b600ce900 2024-04-25T09:06:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 -- 172.21.15.5:0/2875683982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b600ce900 msgr2=0x7f4b6006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 --2- 172.21.15.5:0/2875683982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b600ce900 0x7f4b6006e4e0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009870 tx=0x7f4b4802a270 comp rx=0 tx=0).stop 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 -- 172.21.15.5:0/2875683982 shutdown_connections 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 --2- 172.21.15.5:0/2875683982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b600ce900 0x7f4b6006e4e0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 --2- 172.21.15.5:0/2875683982 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 -- 172.21.15.5:0/2875683982 >> 172.21.15.5:0/2875683982 conn(0x7f4b600b1da0 msgr2=0x7f4b600b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 -- 172.21.15.5:0/2875683982 shutdown_connections 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.091+0000 7f4b65ed8640 1 -- 172.21.15.5:0/2875683982 wait complete. 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.092+0000 7f4b65ed8640 1 Processor -- start 2024-04-25T09:06:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b65ed8640 1 -- start start 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b65ed8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6006cad0 0x7f4b601405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b65ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b600ce900 0x7f4b6015e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b65ed8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b65ed8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6015e0f0 con 0x7f4b6006cad0 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b65ed8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6006ea20 con 0x7f4b600ce900 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b65ed8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b60140b30 con 0x7f4b6015dd10 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.093+0000 7f4b5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6006cad0 0x7f4b601405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6006cad0 0x7f4b601405f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57134/0 (socket says 172.21.15.5:57134) 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 -- 172.21.15.5:0/941773781 learned_addr learned my addr 172.21.15.5:0/941773781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5effd640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b600ce900 0x7f4b6015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5ffff640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 -- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 msgr2=0x7f4b60142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 -- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b600ce900 msgr2=0x7f4b6015e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b600ce900 0x7f4b6015e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 -- 172.21.15.5:0/941773781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60159da0 con 0x7f4b6006cad0 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5ffff640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4b6015dd10 0x7f4b60142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b5f7fe640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6006cad0 0x7f4b601405f0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000d620 tx=0x7f4b5000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500125f0 con 0x7f4b6006cad0 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50019070 con 0x7f4b6006cad0 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500129d0 con 0x7f4b6006cad0 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6015a040 con 0x7f4b6006cad0 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.094+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6015a600 con 0x7f4b6006cad0 2024-04-25T09:06:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.095+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b6004ef20 con 0x7f4b6006cad0 2024-04-25T09:06:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.096+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4b50012b70 con 0x7f4b6006cad0 2024-04-25T09:06:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.096+0000 7f4b57fff640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b4006b4d0 0x7f4b4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.096+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4b5008ad50 con 0x7f4b6006cad0 2024-04-25T09:06:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.097+0000 7f4b5effd640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b4006b4d0 0x7f4b4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.097+0000 7f4b57fff640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f4b40071390 0x7f4b400737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.097+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 --> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b5000cfb0 con 0x7f4b40071390 2024-04-25T09:06:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.097+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b5008b1e0 con 0x7f4b6006cad0 2024-04-25T09:06:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.097+0000 7f4b5ffff640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f4b40071390 0x7f4b400737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.097+0000 7f4b5effd640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b4006b4d0 0x7f4b4006d990 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4b48034000 tx=0x7f4b4802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.097+0000 7f4b5ffff640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f4b40071390 0x7f4b400737b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.098+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== osd.0 v2:172.21.15.5:6800/1814386695 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4b5000cfb0 con 0x7f4b40071390 2024-04-25T09:06:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.111+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 --> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4b600740e0 con 0x7f4b40071390 2024-04-25T09:06:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.111+0000 7f4b57fff640 1 -- 172.21.15.5:0/941773781 <== osd.0 v2:172.21.15.5:6800/1814386695 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4b600740e0 con 0x7f4b40071390 2024-04-25T09:06:49.100 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:49.100 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:49.100 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f4b40071390 msgr2=0x7f4b400737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:6800/1814386695,v1:172.21.15.5:6801/1814386695] conn(0x7f4b40071390 0x7f4b400737b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b4006b4d0 msgr2=0x7f4b4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f4b4006b4d0 0x7f4b4006d990 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4b48034000 tx=0x7f4b4802e000 comp rx=0 tx=0).stop 2024-04-25T09:06:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6006cad0 msgr2=0x7f4b601405f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 --2- 172.21.15.5:0/941773781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6006cad0 0x7f4b601405f0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000d620 tx=0x7f4b5000dae0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b5ffff640 1 -- 172.21.15.5:0/941773781 reap_dead start 2024-04-25T09:06:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 shutdown_connections 2024-04-25T09:06:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 >> 172.21.15.5:0/941773781 conn(0x7f4b600b1da0 msgr2=0x7f4b600cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 shutdown_connections 2024-04-25T09:06:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.112+0000 7f4b65ed8640 1 -- 172.21.15.5:0/941773781 wait complete. 2024-04-25T09:06:49.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T09:06:49.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.226+0000 7f9067a5d640 1 Processor -- start 2024-04-25T09:06:49.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.226+0000 7f9067a5d640 1 -- start start 2024-04-25T09:06:49.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9067a5d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90600d3990 0x7f90600d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9067a5d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90600b29c0 con 0x7f90600b6f50 2024-04-25T09:06:49.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9067a5d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90600d2080 con 0x7f906015e0a0 2024-04-25T09:06:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9067a5d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90600d4330 con 0x7f90600d3990 2024-04-25T09:06:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9064ff8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90600d3990 0x7f90600d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9065ffa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90600b6f50 0x7f90600b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49126/0 (socket says 172.21.15.5:49126) 2024-04-25T09:06:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9065ffa640 1 -- 172.21.15.5:0/1242740460 learned_addr learned my addr 172.21.15.5:0/1242740460 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9064ff8640 1 -- 172.21.15.5:0/1242740460 >> v1:172.21.15.80:6789/0 conn(0x7f906015e0a0 legacy=0x7f90600d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9064ff8640 1 -- 172.21.15.5:0/1242740460 >> v1:172.21.15.5:6789/0 conn(0x7f90600b6f50 legacy=0x7f90600b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.227+0000 7f9064ff8640 1 -- 172.21.15.5:0/1242740460 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600d2360 con 0x7f90600d3990 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.228+0000 7f9064ff8640 1 --2- 172.21.15.5:0/1242740460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600d3df0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f90500097a0 tx=0x7f905002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bf7793af89610b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.228+0000 7f9057fff640 1 -- 172.21.15.5:0/1242740460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050037070 con 0x7f90600d3990 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.228+0000 7f9057fff640 1 -- 172.21.15.5:0/1242740460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050032440 con 0x7f90600d3990 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.228+0000 7f9057fff640 1 -- 172.21.15.5:0/1242740460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050032810 con 0x7f90600d3990 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.229+0000 7f9067a5d640 1 -- 172.21.15.5:0/1242740460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 msgr2=0x7f90600d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.229+0000 7f9067a5d640 1 --2- 172.21.15.5:0/1242740460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600d3df0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f90500097a0 tx=0x7f905002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.229+0000 7f9067a5d640 1 -- 172.21.15.5:0/1242740460 shutdown_connections 2024-04-25T09:06:49.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.229+0000 7f9067a5d640 1 --2- 172.21.15.5:0/1242740460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600d3df0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.229+0000 7f9067a5d640 1 -- 172.21.15.5:0/1242740460 >> 172.21.15.5:0/1242740460 conn(0x7f90600668f0 msgr2=0x7f9060066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.229+0000 7f9067a5d640 1 -- 172.21.15.5:0/1242740460 shutdown_connections 2024-04-25T09:06:49.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.229+0000 7f9067a5d640 1 -- 172.21.15.5:0/1242740460 wait complete. 2024-04-25T09:06:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.230+0000 7f9067a5d640 1 Processor -- start 2024-04-25T09:06:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.231+0000 7f9067a5d640 1 -- start start 2024-04-25T09:06:49.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9067a5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90600b6f50 0x7f90601608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9067a5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9067a5d640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f906015e0a0 0x7f90601f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9067a5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600d2920 con 0x7f90600d3990 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9067a5d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600d1460 con 0x7f90600b6f50 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9067a5d640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90600d2c00 con 0x7f906015e0a0 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57148/0 (socket says 172.21.15.5:57148) 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 -- 172.21.15.5:0/2468472053 learned_addr learned my addr 172.21.15.5:0/2468472053 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:49.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 -- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f906015e0a0 msgr2=0x7f90601f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f906015e0a0 0x7f90601f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 -- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90600b6f50 msgr2=0x7f90601608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f90657f9640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90600b6f50 0x7f90601608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90600b6f50 0x7f90601608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 -- 172.21.15.5:0/2468472053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600c8d30 con 0x7f90600d3990 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9064ff8640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600c9dd0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f9050000c00 tx=0x7f90500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9055ffb640 1 -- 172.21.15.5:0/2468472053 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050037040 con 0x7f90600d3990 2024-04-25T09:06:49.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9055ffb640 1 -- 172.21.15.5:0/2468472053 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050042070 con 0x7f90600d3990 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.232+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90600c9010 con 0x7f90600d3990 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.233+0000 7f9055ffb640 1 -- 172.21.15.5:0/2468472053 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050030a70 con 0x7f90600d3990 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.233+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90600c95d0 con 0x7f90600d3990 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.234+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906004ef20 con 0x7f90600d3990 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.234+0000 7f9055ffb640 1 -- 172.21.15.5:0/2468472053 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9050030c10 con 0x7f90600d3990 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.235+0000 7f9055ffb640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f904406b4d0 0x7f904406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.235+0000 7f9055ffb640 1 -- 172.21.15.5:0/2468472053 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f90500aa980 con 0x7f90600d3990 2024-04-25T09:06:49.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.235+0000 7f90657f9640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f904406b4d0 0x7f904406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.235+0000 7f90657f9640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f904406b4d0 0x7f904406d990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f905c003d90 tx=0x7f905c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.239+0000 7f9055ffb640 1 -- 172.21.15.5:0/2468472053 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9050045360 con 0x7f90600d3990 2024-04-25T09:06:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.447+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f90600cae20 con 0x7f904406b4d0 2024-04-25T09:06:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.448+0000 7f9055ffb640 1 -- 172.21.15.5:0/2468472053 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f90600cae20 con 0x7f904406b4d0 2024-04-25T09:06:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T09:06:49.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f904406b4d0 msgr2=0x7f904406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f904406b4d0 0x7f904406d990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f905c003d90 tx=0x7f905c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 msgr2=0x7f90600c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600c9dd0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f9050000c00 tx=0x7f90500046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 shutdown_connections 2024-04-25T09:06:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f904406b4d0 0x7f904406d990 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f906015e0a0 0x7f90601f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90600d3990 0x7f90600c9dd0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 --2- 172.21.15.5:0/2468472053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90600b6f50 0x7f90601608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 >> 172.21.15.5:0/2468472053 conn(0x7f90600668f0 msgr2=0x7f9060066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 shutdown_connections 2024-04-25T09:06:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.450+0000 7f9067a5d640 1 -- 172.21.15.5:0/2468472053 wait complete. 2024-04-25T09:06:49.450 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T09:06:49.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:49.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.570+0000 7f30fc90a640 1 Processor -- start 2024-04-25T09:06:49.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.570+0000 7f30fc90a640 1 -- start start 2024-04-25T09:06:49.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30fc90a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30f815a7d0 0x7f30f815e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30fc90a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815eac0 0x7f30f80713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30fc90a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f30f815abb0 0x7f30f8071930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30fc90a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f815f500 con 0x7f30f815a7d0 2024-04-25T09:06:49.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30fc90a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f815ef40 con 0x7f30f815abb0 2024-04-25T09:06:49.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30fc90a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f815f220 con 0x7f30f815eac0 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30f659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30f815a7d0 0x7f30f815e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30f659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30f815a7d0 0x7f30f815e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57154/0 (socket says 172.21.15.5:57154) 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30f659c640 1 -- 172.21.15.5:0/2042300882 learned_addr learned my addr 172.21.15.5:0/2042300882 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30f6d9d640 1 --2- 172.21.15.5:0/2042300882 >> v2:172.21.15.80:3300/0 conn(0x7f30f815abb0 0x7f30f8071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.571+0000 7f30f5d9b640 1 --2- 172.21.15.5:0/2042300882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815eac0 0x7f30f80713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f659c640 1 -- 172.21.15.5:0/2042300882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815eac0 msgr2=0x7f30f80713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f659c640 1 --2- 172.21.15.5:0/2042300882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815eac0 0x7f30f80713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f659c640 1 -- 172.21.15.5:0/2042300882 >> v2:172.21.15.80:3300/0 conn(0x7f30f815abb0 msgr2=0x7f30f8071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f659c640 1 --2- 172.21.15.5:0/2042300882 >> v2:172.21.15.80:3300/0 conn(0x7f30f815abb0 0x7f30f8071930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f659c640 1 -- 172.21.15.5:0/2042300882 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f806d520 con 0x7f30f815a7d0 2024-04-25T09:06:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f5d9b640 1 --2- 172.21.15.5:0/2042300882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815eac0 0x7f30f80713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f659c640 1 --2- 172.21.15.5:0/2042300882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815a7d0 0x7f30f815e580 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f30f80b4820 tx=0x7f30e002c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea17c45dd481c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.572+0000 7f30f559a640 1 -- 172.21.15.5:0/2042300882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0032700 con 0x7f30f815a7d0 2024-04-25T09:06:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30f559a640 1 -- 172.21.15.5:0/2042300882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e00328a0 con 0x7f30f815a7d0 2024-04-25T09:06:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30f559a640 1 -- 172.21.15.5:0/2042300882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0032c70 con 0x7f30f815a7d0 2024-04-25T09:06:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 -- 172.21.15.5:0/2042300882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815a7d0 msgr2=0x7f30f815e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 --2- 172.21.15.5:0/2042300882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815a7d0 0x7f30f815e580 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f30f80b4820 tx=0x7f30e002c800 comp rx=0 tx=0).stop 2024-04-25T09:06:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 -- 172.21.15.5:0/2042300882 shutdown_connections 2024-04-25T09:06:49.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 --2- 172.21.15.5:0/2042300882 >> v2:172.21.15.80:3300/0 conn(0x7f30f815abb0 0x7f30f8071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 --2- 172.21.15.5:0/2042300882 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815eac0 0x7f30f80713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 --2- 172.21.15.5:0/2042300882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815a7d0 0x7f30f815e580 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 -- 172.21.15.5:0/2042300882 >> 172.21.15.5:0/2042300882 conn(0x7f30f80d07f0 msgr2=0x7f30f80d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 -- 172.21.15.5:0/2042300882 shutdown_connections 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.573+0000 7f30fc90a640 1 -- 172.21.15.5:0/2042300882 wait complete. 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 Processor -- start 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 -- start start 2024-04-25T09:06:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815a7d0 0x7f30f81474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815abb0 0x7f30f81f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f815eac0 0x7f30f8145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80d0540 con 0x7f30f815abb0 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80d03c0 con 0x7f30f815eac0 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.575+0000 7f30fc90a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80b3780 con 0x7f30f815a7d0 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815abb0 0x7f30f81f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815abb0 0x7f30f81f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57166/0 (socket says 172.21.15.5:57166) 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 -- 172.21.15.5:0/921654037 learned_addr learned my addr 172.21.15.5:0/921654037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f659c640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815a7d0 0x7f30f81474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f6d9d640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f815eac0 0x7f30f8145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 -- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815a7d0 msgr2=0x7f30f81474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815a7d0 0x7f30f81474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 -- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f815eac0 msgr2=0x7f30f8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f815eac0 0x7f30f8145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 -- 172.21.15.5:0/921654037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f8147cd0 con 0x7f30f815abb0 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f6d9d640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f815eac0 0x7f30f8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f659c640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f30f815a7d0 0x7f30f81474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30f5d9b640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815abb0 0x7f30f81f70e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f30e800d7d0 tx=0x7f30e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8004030 con 0x7f30f815abb0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e80041d0 con 0x7f30f815abb0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f8147fb0 con 0x7f30f815abb0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800b6c0 con 0x7f30f815abb0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.576+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f81479e0 con 0x7f30f815abb0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.577+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30f8071900 con 0x7f30f815abb0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.578+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30e800b860 con 0x7f30f815abb0 2024-04-25T09:06:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.578+0000 7f30eeffd640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30d806b500 0x7f30d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f30e808ab40 con 0x7f30f815abb0 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30eeffd640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7f30d80713c0 0x7f30d80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 --> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30d8073e90 con 0x7f30d80713c0 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30e808afd0 con 0x7f30f815abb0 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30f659c640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30d806b500 0x7f30d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30f6d9d640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7f30d80713c0 0x7f30d80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30f6d9d640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7f30d80713c0 0x7f30d80737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.579+0000 7f30f659c640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30d806b500 0x7f30d806d9c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f30e0037000 tx=0x7f30e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.580+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== osd.1 v2:172.21.15.5:6815/1158282071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f30d8073e90 con 0x7f30d80713c0 2024-04-25T09:06:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.593+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 --> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f30f804ef20 con 0x7f30d80713c0 2024-04-25T09:06:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.593+0000 7f30eeffd640 1 -- 172.21.15.5:0/921654037 <== osd.1 v2:172.21.15.5:6815/1158282071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f30f804ef20 con 0x7f30d80713c0 2024-04-25T09:06:49.582 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:49.582 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7f30d80713c0 msgr2=0x7f30d80737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:6815/1158282071,v1:172.21.15.5:6817/1158282071] conn(0x7f30d80713c0 0x7f30d80737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30d806b500 msgr2=0x7f30d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f30d806b500 0x7f30d806d9c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f30e0037000 tx=0x7f30e0008040 comp rx=0 tx=0).stop 2024-04-25T09:06:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815abb0 msgr2=0x7f30f81f70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 --2- 172.21.15.5:0/921654037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f815abb0 0x7f30f81f70e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f30e800d7d0 tx=0x7f30e800dc90 comp rx=0 tx=0).stop 2024-04-25T09:06:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30f6d9d640 1 -- 172.21.15.5:0/921654037 reap_dead start 2024-04-25T09:06:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 shutdown_connections 2024-04-25T09:06:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 >> 172.21.15.5:0/921654037 conn(0x7f30f80d07f0 msgr2=0x7f30f806eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 shutdown_connections 2024-04-25T09:06:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.594+0000 7f30fc90a640 1 -- 172.21.15.5:0/921654037 wait complete. 2024-04-25T09:06:49.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T09:06:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.707+0000 7f5454037640 1 Processor -- start 2024-04-25T09:06:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.707+0000 7f5454037640 1 -- start start 2024-04-25T09:06:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f5454037640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f544c0d3990 0x7f544c0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f5454037640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c0b29c0 con 0x7f544c0b6f50 2024-04-25T09:06:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f5454037640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c0d2080 con 0x7f544c15e0a0 2024-04-25T09:06:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f5454037640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c0d4330 con 0x7f544c0d3990 2024-04-25T09:06:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f54525d4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f544c0b6f50 0x7f544c0b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49142/0 (socket says 172.21.15.5:49142) 2024-04-25T09:06:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f54525d4640 1 -- 172.21.15.5:0/3441947797 learned_addr learned my addr 172.21.15.5:0/3441947797 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f54515d2640 1 --2- 172.21.15.5:0/3441947797 >> v2:172.21.15.80:3300/0 conn(0x7f544c0d3990 0x7f544c0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843395456 0 0) 0x7f544c0b29c0 con 0x7f544c0b6f50 2024-04-25T09:06:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.708+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5438003520 con 0x7f544c0b6f50 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977873271 0 0) 0x7f5438003520 con 0x7f544c0b6f50 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 >> v2:172.21.15.80:3300/0 conn(0x7f544c0d3990 msgr2=0x7f544c0d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 --2- 172.21.15.5:0/3441947797 >> v2:172.21.15.80:3300/0 conn(0x7f544c0d3990 0x7f544c0d3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 >> v1:172.21.15.80:6789/0 conn(0x7f544c15e0a0 legacy=0x7f544c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0d2360 con 0x7f544c0b6f50 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f54440019f0 con 0x7f544c0b6f50 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 >> v1:172.21.15.5:6789/0 conn(0x7f544c0b6f50 legacy=0x7f544c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380039b0 0x7f5438003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5438004800 0x7f5438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54380051c0 0x7f543800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543800c030 con 0x7f54380051c0 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543800c1e0 con 0x7f5438004800 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543800c3e0 con 0x7f54380039b0 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f54525d4640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54380051c0 0x7f543800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f54515d2640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5438004800 0x7f5438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f5451dd3640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380039b0 0x7f5438003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f54525d4640 1 -- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380039b0 msgr2=0x7f5438003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f54525d4640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380039b0 0x7f5438003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f54525d4640 1 -- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5438004800 msgr2=0x7f5438004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f54525d4640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5438004800 0x7f5438004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.709+0000 7f54525d4640 1 -- 172.21.15.5:0/3441947797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438003520 con 0x7f54380051c0 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.710+0000 7f54525d4640 1 -- 172.21.15.5:0/3441947797 reap_dead start 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.710+0000 7f54525d4640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54380051c0 0x7f543800b9c0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f544400a860 tx=0x7f5438005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd939378913fb86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.710+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400a480 con 0x7f54380051c0 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.710+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544402f070 con 0x7f54380051c0 2024-04-25T09:06:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.710+0000 7f5450dd1640 1 -- 172.21.15.5:0/3441947797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544402bcc0 con 0x7f54380051c0 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.711+0000 7f5454037640 1 -- 172.21.15.5:0/3441947797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54380051c0 msgr2=0x7f543800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.711+0000 7f5454037640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54380051c0 0x7f543800b9c0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f544400a860 tx=0x7f5438005830 comp rx=0 tx=0).stop 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.711+0000 7f5454037640 1 -- 172.21.15.5:0/3441947797 shutdown_connections 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.711+0000 7f5454037640 1 --2- 172.21.15.5:0/3441947797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54380051c0 0x7f543800b9c0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.711+0000 7f5454037640 1 -- 172.21.15.5:0/3441947797 >> 172.21.15.5:0/3441947797 conn(0x7f544c0668f0 msgr2=0x7f544c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.711+0000 7f5454037640 1 -- 172.21.15.5:0/3441947797 shutdown_connections 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.711+0000 7f5454037640 1 -- 172.21.15.5:0/3441947797 wait complete. 2024-04-25T09:06:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.712+0000 7f5454037640 1 Processor -- start 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.712+0000 7f5454037640 1 -- start start 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f5454037640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380051c0 0x7f544c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f5454037640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f544c0acf60 0x7f544c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f5454037640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544c0aeb20 0x7f544c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f5454037640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0d2c00 con 0x7f544c0acf60 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f5454037640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0d2920 con 0x7f544c0aeb20 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f5454037640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c15e480 con 0x7f54380051c0 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f54515d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f544c0acf60 0x7f544c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f54515d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f544c0acf60 0x7f544c15bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57186/0 (socket says 172.21.15.5:57186) 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.713+0000 7f54515d2640 1 -- 172.21.15.5:0/1710663974 learned_addr learned my addr 172.21.15.5:0/1710663974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54525d4640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544c0aeb20 0x7f544c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f5451dd3640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380051c0 0x7f544c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54515d2640 1 -- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380051c0 msgr2=0x7f544c0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54515d2640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380051c0 0x7f544c0b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54515d2640 1 -- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544c0aeb20 msgr2=0x7f544c0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54515d2640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544c0aeb20 0x7f544c0aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54515d2640 1 -- 172.21.15.5:0/1710663974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0ad750 con 0x7f544c0acf60 2024-04-25T09:06:49.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54515d2640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f544c0acf60 0x7f544c15bf60 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f543c0118e0 tx=0x7f543c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54427fc640 1 -- 172.21.15.5:0/1710663974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00faf0 con 0x7f544c0acf60 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54427fc640 1 -- 172.21.15.5:0/1710663974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c00fc90 con 0x7f544c0acf60 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c0ada30 con 0x7f544c0acf60 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f54427fc640 1 -- 172.21.15.5:0/1710663974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c014440 con 0x7f544c0acf60 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.714+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c0aa6c0 con 0x7f544c0acf60 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.715+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c0adf50 con 0x7f544c0acf60 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.716+0000 7f54427fc640 1 -- 172.21.15.5:0/1710663974 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f543c012040 con 0x7f544c0acf60 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.716+0000 7f54427fc640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543006b500 0x7f543006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.716+0000 7f54427fc640 1 -- 172.21.15.5:0/1710663974 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f543c08a580 con 0x7f544c0acf60 2024-04-25T09:06:49.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.716+0000 7f5451dd3640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543006b500 0x7f543006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.717+0000 7f5451dd3640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543006b500 0x7f543006d9c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5448000c00 tx=0x7f5448009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.720+0000 7f54427fc640 1 -- 172.21.15.5:0/1710663974 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f544c0adf50 con 0x7f544c0acf60 2024-04-25T09:06:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.901+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f544c04ef20 con 0x7f543006b500 2024-04-25T09:06:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.902+0000 7f54427fc640 1 -- 172.21.15.5:0/1710663974 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f544c04ef20 con 0x7f543006b500 2024-04-25T09:06:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543006b500 msgr2=0x7f543006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543006b500 0x7f543006d9c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5448000c00 tx=0x7f5448009040 comp rx=0 tx=0).stop 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f544c0acf60 msgr2=0x7f544c15bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f544c0acf60 0x7f544c15bf60 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f543c0118e0 tx=0x7f543c011da0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 shutdown_connections 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f543006b500 0x7f543006d9c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544c0aeb20 0x7f544c0aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f544c0acf60 0x7f544c15bf60 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 --2- 172.21.15.5:0/1710663974 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f54380051c0 0x7f544c0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 >> 172.21.15.5:0/1710663974 conn(0x7f544c0668f0 msgr2=0x7f544c15d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 shutdown_connections 2024-04-25T09:06:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:49.904+0000 7f5454037640 1 -- 172.21.15.5:0/1710663974 wait complete. 2024-04-25T09:06:49.904 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T09:06:49.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.022+0000 7f7c11163640 1 Processor -- start 2024-04-25T09:06:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.022+0000 7f7c11163640 1 -- start start 2024-04-25T09:06:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c11163640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c0c067000 0x7f7c0c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c11163640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c0c0adef0 0x7f7c0c0713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c11163640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c15bbc0 con 0x7f7c0c15b7e0 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c11163640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c15f190 con 0x7f7c0c067000 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c11163640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b3780 con 0x7f7c0c0adef0 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c0c067000 0x7f7c0c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7c0c15b7e0 0x7f7c0c0668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49154/0 (socket says 172.21.15.5:49154) 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0ad9d640 1 -- 172.21.15.5:0/1857592352 learned_addr learned my addr 172.21.15.5:0/1857592352 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0b59e640 1 --2- 172.21.15.5:0/1857592352 >> v2:172.21.15.80:3300/0 conn(0x7f7c0c0adef0 0x7f7c0c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0a59c640 1 -- 172.21.15.5:0/1857592352 >> v2:172.21.15.80:3300/0 conn(0x7f7c0c0adef0 msgr2=0x7f7c0c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0a59c640 1 --2- 172.21.15.5:0/1857592352 >> v2:172.21.15.80:3300/0 conn(0x7f7c0c0adef0 0x7f7c0c0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0a59c640 1 -- 172.21.15.5:0/1857592352 >> v1:172.21.15.5:6789/0 conn(0x7f7c0c15b7e0 legacy=0x7f7c0c0668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c09d9b640 1 -- 172.21.15.5:0/1857592352 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492667844 0 0) 0x7f7c0c15bbc0 con 0x7f7c0c15b7e0 2024-04-25T09:06:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.023+0000 7f7c0a59c640 1 -- 172.21.15.5:0/1857592352 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c15e3d0 con 0x7f7c0c067000 2024-04-25T09:06:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.024+0000 7f7c0a59c640 1 --2- 172.21.15.5:0/1857592352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c067000 0x7f7c0c0ad9b0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0ae840 tx=0x7f7bfc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02102b9adf3f18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.024+0000 7f7c09d9b640 1 -- 172.21.15.5:0/1857592352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc037070 con 0x7f7c0c067000 2024-04-25T09:06:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.024+0000 7f7c09d9b640 1 -- 172.21.15.5:0/1857592352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc032440 con 0x7f7c0c067000 2024-04-25T09:06:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.024+0000 7f7c09d9b640 1 -- 172.21.15.5:0/1857592352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc02ae60 con 0x7f7c0c067000 2024-04-25T09:06:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 -- 172.21.15.5:0/1857592352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c067000 msgr2=0x7f7c0c0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 --2- 172.21.15.5:0/1857592352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c067000 0x7f7c0c0ad9b0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0ae840 tx=0x7f7bfc02a110 comp rx=0 tx=0).stop 2024-04-25T09:06:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 -- 172.21.15.5:0/1857592352 shutdown_connections 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 --2- 172.21.15.5:0/1857592352 >> v2:172.21.15.80:3300/0 conn(0x7f7c0c0adef0 0x7f7c0c0713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 --2- 172.21.15.5:0/1857592352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c067000 0x7f7c0c0ad9b0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 -- 172.21.15.5:0/1857592352 >> 172.21.15.5:0/1857592352 conn(0x7f7c0c0d07f0 msgr2=0x7f7c0c0d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 -- 172.21.15.5:0/1857592352 shutdown_connections 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.025+0000 7f7c11163640 1 -- 172.21.15.5:0/1857592352 wait complete. 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.026+0000 7f7c11163640 1 Processor -- start 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.026+0000 7f7c11163640 1 -- start start 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c11163640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c067000 0x7f7c0c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c11163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c0adef0 0x7f7c0c1f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c11163640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c0c15b7e0 0x7f7c0c1f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c11163640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c15e990 con 0x7f7c0c0adef0 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c11163640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c15ed00 con 0x7f7c0c067000 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c11163640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0ae340 con 0x7f7c0c15b7e0 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c0adef0 0x7f7c0c1f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c0adef0 0x7f7c0c1f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57202/0 (socket says 172.21.15.5:57202) 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 -- 172.21.15.5:0/2279586249 learned_addr learned my addr 172.21.15.5:0/2279586249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0ad9d640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c067000 0x7f7c0c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0b59e640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c0c15b7e0 0x7f7c0c1f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 -- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c0c15b7e0 msgr2=0x7f7c0c1f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7c0c15b7e0 0x7f7c0c1f71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 -- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c067000 msgr2=0x7f7c0c146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c067000 0x7f7c0c146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0a59c640 1 -- 172.21.15.5:0/2279586249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c1f7b50 con 0x7f7c0c0adef0 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.027+0000 7f7c0ad9d640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c067000 0x7f7c0c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.028+0000 7f7c0a59c640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c0adef0 0x7f7c0c1f4590 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc000c00 tx=0x7f7bfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.028+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc037050 con 0x7f7c0c0adef0 2024-04-25T09:06:50.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.028+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc038040 con 0x7f7c0c0adef0 2024-04-25T09:06:50.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.028+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc004470 con 0x7f7c0c0adef0 2024-04-25T09:06:50.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.028+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c1f7e30 con 0x7f7c0c0adef0 2024-04-25T09:06:50.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.028+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c146a40 con 0x7f7c0c0adef0 2024-04-25T09:06:50.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.029+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c0c1f3b90 con 0x7f7c0c0adef0 2024-04-25T09:06:50.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.029+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7bfc030900 con 0x7f7c0c0adef0 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7bf37fe640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7bf806b500 0x7f7bf806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7bfc0aaa00 con 0x7f7c0c0adef0 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7bf37fe640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f7bf80713c0 0x7f7bf80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 --> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bfc00af30 con 0x7f7bf80713c0 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bfc0af280 con 0x7f7c0c0adef0 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7c0ad9d640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7bf806b500 0x7f7bf806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7c0b59e640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f7bf80713c0 0x7f7bf80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.030+0000 7f7c0b59e640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f7bf80713c0 0x7f7bf80737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.031+0000 7f7c0ad9d640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7bf806b500 0x7f7bf806d9c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7c00000f60 tx=0x7f7c00007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.031+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== osd.2 v2:172.21.15.5:6823/3851787171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7bfc00af30 con 0x7f7bf80713c0 2024-04-25T09:06:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.057+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 --> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c0c04ef20 con 0x7f7bf80713c0 2024-04-25T09:06:50.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7bf37fe640 1 -- 172.21.15.5:0/2279586249 <== osd.2 v2:172.21.15.5:6823/3851787171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c0c04ef20 con 0x7f7bf80713c0 2024-04-25T09:06:50.046 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:50.046 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:50.046 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f7bf80713c0 msgr2=0x7f7bf80737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:6823/3851787171,v1:172.21.15.5:6825/3851787171] conn(0x7f7bf80713c0 0x7f7bf80737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7bf806b500 msgr2=0x7f7bf806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f7bf806b500 0x7f7bf806d9c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7c00000f60 tx=0x7f7c00007cc0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c0adef0 msgr2=0x7f7c0c1f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 --2- 172.21.15.5:0/2279586249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0c0adef0 0x7f7c0c1f4590 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc000c00 tx=0x7f7bfc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c0b59e640 1 -- 172.21.15.5:0/2279586249 reap_dead start 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 shutdown_connections 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 >> 172.21.15.5:0/2279586249 conn(0x7f7c0c0d07f0 msgr2=0x7f7c0c15d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 shutdown_connections 2024-04-25T09:06:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.058+0000 7f7c11163640 1 -- 172.21.15.5:0/2279586249 wait complete. 2024-04-25T09:06:50.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T09:06:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.174+0000 7f378544a640 1 Processor -- start 2024-04-25T09:06:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.174+0000 7f378544a640 1 -- start start 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f378544a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3780151080 0x7f378015b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f378544a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3780151460 0x7f3780071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f378544a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f37800aed30 0x7f37800b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f378544a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3780070c00 con 0x7f3780151460 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f378544a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3780071a60 con 0x7f37800aed30 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f378544a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3780070e50 con 0x7f3780151080 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f377e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3780151460 0x7f3780071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f377e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3780151460 0x7f3780071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57216/0 (socket says 172.21.15.5:57216) 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f377e7fc640 1 -- 172.21.15.5:0/744532129 learned_addr learned my addr 172.21.15.5:0/744532129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.175+0000 7f377effd640 1 --2- 172.21.15.5:0/744532129 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3780151080 0x7f378015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377e7fc640 1 -- 172.21.15.5:0/744532129 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3780151080 msgr2=0x7f378015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377e7fc640 1 --2- 172.21.15.5:0/744532129 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3780151080 0x7f378015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377e7fc640 1 -- 172.21.15.5:0/744532129 >> v2:172.21.15.80:3300/0 conn(0x7f37800aed30 msgr2=0x7f37800b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377f7fe640 1 --2- 172.21.15.5:0/744532129 >> v2:172.21.15.80:3300/0 conn(0x7f37800aed30 0x7f37800b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377e7fc640 1 --2- 172.21.15.5:0/744532129 >> v2:172.21.15.80:3300/0 conn(0x7f37800aed30 0x7f37800b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377e7fc640 1 -- 172.21.15.5:0/744532129 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780071130 con 0x7f3780151460 2024-04-25T09:06:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377f7fe640 1 --2- 172.21.15.5:0/744532129 >> v2:172.21.15.80:3300/0 conn(0x7f37800aed30 0x7f37800b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377e7fc640 1 --2- 172.21.15.5:0/744532129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f3780071ef0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f37800719d0 tx=0x7f377002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418d46c13e0c80a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.176+0000 7f377dffb640 1 -- 172.21.15.5:0/744532129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770037070 con 0x7f3780151460 2024-04-25T09:06:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f377dffb640 1 -- 172.21.15.5:0/744532129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770032440 con 0x7f3780151460 2024-04-25T09:06:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f377dffb640 1 -- 172.21.15.5:0/744532129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770032810 con 0x7f3780151460 2024-04-25T09:06:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 -- 172.21.15.5:0/744532129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 msgr2=0x7f3780071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 --2- 172.21.15.5:0/744532129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f3780071ef0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f37800719d0 tx=0x7f377002a140 comp rx=0 tx=0).stop 2024-04-25T09:06:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 -- 172.21.15.5:0/744532129 shutdown_connections 2024-04-25T09:06:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 --2- 172.21.15.5:0/744532129 >> v2:172.21.15.80:3300/0 conn(0x7f37800aed30 0x7f37800b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 --2- 172.21.15.5:0/744532129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f3780071ef0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 --2- 172.21.15.5:0/744532129 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3780151080 0x7f378015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 -- 172.21.15.5:0/744532129 >> 172.21.15.5:0/744532129 conn(0x7f37800668f0 msgr2=0x7f3780066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 -- 172.21.15.5:0/744532129 shutdown_connections 2024-04-25T09:06:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.177+0000 7f378544a640 1 -- 172.21.15.5:0/744532129 wait complete. 2024-04-25T09:06:50.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.178+0000 7f378544a640 1 Processor -- start 2024-04-25T09:06:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f378544a640 1 -- start start 2024-04-25T09:06:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f378544a640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37800aed30 0x7f37801e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f378544a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3780151080 0x7f37801400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f378544a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f378015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f378544a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780072430 con 0x7f3780151460 2024-04-25T09:06:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f378544a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800716f0 con 0x7f3780151080 2024-04-25T09:06:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f378544a640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800b30a0 con 0x7f37800aed30 2024-04-25T09:06:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f377f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f378015db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f377f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f378015db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57232/0 (socket says 172.21.15.5:57232) 2024-04-25T09:06:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f377f7fe640 1 -- 172.21.15.5:0/895825271 learned_addr learned my addr 172.21.15.5:0/895825271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f377effd640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37800aed30 0x7f37801e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.179+0000 7f377e7fc640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3780151080 0x7f37801400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f377f7fe640 1 -- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37800aed30 msgr2=0x7f37801e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f377f7fe640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37800aed30 0x7f37801e66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f377f7fe640 1 -- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3780151080 msgr2=0x7f37801400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f377f7fe640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3780151080 0x7f37801400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f377f7fe640 1 -- 172.21.15.5:0/895825271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800ad4c0 con 0x7f3780151460 2024-04-25T09:06:50.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f377f7fe640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f378015db10 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f377800ccf0 tx=0x7f377800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f37777fe640 1 -- 172.21.15.5:0/895825271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800e630 con 0x7f3780151460 2024-04-25T09:06:50.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f37777fe640 1 -- 172.21.15.5:0/895825271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800e7f0 con 0x7f3780151460 2024-04-25T09:06:50.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800ad7a0 con 0x7f3780151460 2024-04-25T09:06:50.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f37777fe640 1 -- 172.21.15.5:0/895825271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800ebe0 con 0x7f3780151460 2024-04-25T09:06:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.180+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37800add60 con 0x7f3780151460 2024-04-25T09:06:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.181+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378004ef20 con 0x7f3780151460 2024-04-25T09:06:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.182+0000 7f37777fe640 1 -- 172.21.15.5:0/895825271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3778016420 con 0x7f3780151460 2024-04-25T09:06:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.182+0000 7f37777fe640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f376006b4d0 0x7f376006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.182+0000 7f37777fe640 1 -- 172.21.15.5:0/895825271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f377808a9c0 con 0x7f3780151460 2024-04-25T09:06:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.182+0000 7f377effd640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f376006b4d0 0x7f376006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.183+0000 7f377effd640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f376006b4d0 0x7f376006d990 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3768006fd0 tx=0x7f3768008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.186+0000 7f37777fe640 1 -- 172.21.15.5:0/895825271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f377808ce20 con 0x7f3780151460 2024-04-25T09:06:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.368+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f37800b2c30 con 0x7f376006b4d0 2024-04-25T09:06:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.370+0000 7f37777fe640 1 -- 172.21.15.5:0/895825271 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f37800b2c30 con 0x7f376006b4d0 2024-04-25T09:06:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T09:06:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f376006b4d0 msgr2=0x7f376006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f376006b4d0 0x7f376006d990 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3768006fd0 tx=0x7f3768008040 comp rx=0 tx=0).stop 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 msgr2=0x7f378015db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f378015db10 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f377800ccf0 tx=0x7f377800a6a0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 shutdown_connections 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f376006b4d0 0x7f376006d990 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3780151460 0x7f378015db10 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3780151080 0x7f37801400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 --2- 172.21.15.5:0/895825271 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37800aed30 0x7f37801e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 >> 172.21.15.5:0/895825271 conn(0x7f37800668f0 msgr2=0x7f378006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 shutdown_connections 2024-04-25T09:06:50.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.371+0000 7f378544a640 1 -- 172.21.15.5:0/895825271 wait complete. 2024-04-25T09:06:50.371 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T09:06:50.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.488+0000 7fb156a12640 1 Processor -- start 2024-04-25T09:06:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.488+0000 7fb156a12640 1 -- start start 2024-04-25T09:06:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb156a12640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1500b9470 0x7fb1500ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb156a12640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb150162070 con 0x7fb15015dbd0 2024-04-25T09:06:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb156a12640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb150162350 con 0x7fb1500cecf0 2024-04-25T09:06:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb156a12640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1500cf120 con 0x7fb1500b9470 2024-04-25T09:06:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb15015dbd0 0x7fb1501617b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49158/0 (socket says 172.21.15.5:49158) 2024-04-25T09:06:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14ffff640 1 -- 172.21.15.5:0/2972849626 learned_addr learned my addr 172.21.15.5:0/2972849626 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197127199 0 0) 0x7fb150162070 con 0x7fb15015dbd0 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14f7fe640 1 --2- 172.21.15.5:0/2972849626 >> v2:172.21.15.80:3300/0 conn(0x7fb1500b9470 0x7fb1500ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb138003520 con 0x7fb15015dbd0 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1454399555 0 0) 0x7fb138003520 con 0x7fb15015dbd0 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 >> v2:172.21.15.80:3300/0 conn(0x7fb1500b9470 msgr2=0x7fb1500ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 --2- 172.21.15.5:0/2972849626 >> v2:172.21.15.80:3300/0 conn(0x7fb1500b9470 0x7fb1500ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 >> v1:172.21.15.80:6789/0 conn(0x7fb1500cecf0 legacy=0x7fb1500d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500d1c50 con 0x7fb15015dbd0 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7fb144001670 con 0x7fb15015dbd0 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 >> v1:172.21.15.5:6789/0 conn(0x7fb15015dbd0 legacy=0x7fb1501617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.489+0000 7fb14effd640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1380039b0 0x7fb138003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14effd640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14effd640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1380051c0 0x7fb13800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500cf120 con 0x7fb138004800 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800c060 con 0x7fb1380039b0 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800c260 con 0x7fb1380051c0 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14f7fe640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14ffff640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1380039b0 0x7fb138003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb154faf640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1380051c0 0x7fb13800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14f7fe640 1 -- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1380051c0 msgr2=0x7fb13800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14f7fe640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb1380051c0 0x7fb13800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14f7fe640 1 -- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1380039b0 msgr2=0x7fb138003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14f7fe640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1380039b0 0x7fb138003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb14f7fe640 1 -- 172.21.15.5:0/2972849626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138003520 con 0x7fb138004800 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.490+0000 7fb154faf640 1 -- 172.21.15.5:0/2972849626 reap_dead start 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb14f7fe640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb138004c80 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fb140009ac0 tx=0x7fb138005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b305a435a38b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140036070 con 0x7fb138004800 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140031400 con 0x7fb138004800 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb14effd640 1 -- 172.21.15.5:0/2972849626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140009690 con 0x7fb138004800 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb156a12640 1 -- 172.21.15.5:0/2972849626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 msgr2=0x7fb138004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb156a12640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb138004c80 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fb140009ac0 tx=0x7fb138005830 comp rx=0 tx=0).stop 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb156a12640 1 -- 172.21.15.5:0/2972849626 shutdown_connections 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb156a12640 1 --2- 172.21.15.5:0/2972849626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb138004c80 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb156a12640 1 -- 172.21.15.5:0/2972849626 >> 172.21.15.5:0/2972849626 conn(0x7fb150066ad0 msgr2=0x7fb150066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb156a12640 1 -- 172.21.15.5:0/2972849626 shutdown_connections 2024-04-25T09:06:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.491+0000 7fb156a12640 1 -- 172.21.15.5:0/2972849626 wait complete. 2024-04-25T09:06:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.493+0000 7fb156a12640 1 Processor -- start 2024-04-25T09:06:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.493+0000 7fb156a12640 1 -- start start 2024-04-25T09:06:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.493+0000 7fb156a12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb15014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.493+0000 7fb156a12640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15015e2b0 0x7fb15015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.493+0000 7fb156a12640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb150160450 0x7fb1501608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb156a12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15015dfb0 con 0x7fb138004800 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb156a12640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb150162630 con 0x7fb15015e2b0 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb156a12640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15015e130 con 0x7fb150160450 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb15014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb15014efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57254/0 (socket says 172.21.15.5:57254) 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 -- 172.21.15.5:0/4107362095 learned_addr learned my addr 172.21.15.5:0/4107362095 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 -- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb150160450 msgr2=0x7fb1501608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb150160450 0x7fb1501608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 -- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15015e2b0 msgr2=0x7fb15015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15015e2b0 0x7fb15015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 -- 172.21.15.5:0/4107362095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15015ed30 con 0x7fb138004800 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14ffff640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb15014efa0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fb144007340 tx=0x7fb144007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400f840 con 0x7fb138004800 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144018070 con 0x7fb138004800 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15015f010 con 0x7fb138004800 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400fc20 con 0x7fb138004800 2024-04-25T09:06:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.494+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15015f5d0 con 0x7fb138004800 2024-04-25T09:06:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.495+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb15004ef20 con 0x7fb138004800 2024-04-25T09:06:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.496+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb14401d460 con 0x7fb138004800 2024-04-25T09:06:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.496+0000 7fb14cff9640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb13c06b500 0x7fb13c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.496+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb144089f30 con 0x7fb138004800 2024-04-25T09:06:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.496+0000 7fb14cff9640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7fb13c0713c0 0x7fb13c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.496+0000 7fb14f7fe640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb13c06b500 0x7fb13c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.496+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 --> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb14400de90 con 0x7fb13c0713c0 2024-04-25T09:06:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.496+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14408c550 con 0x7fb138004800 2024-04-25T09:06:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.497+0000 7fb154faf640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7fb13c0713c0 0x7fb13c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.497+0000 7fb154faf640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7fb13c0713c0 0x7fb13c0737e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.497+0000 7fb14f7fe640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb13c06b500 0x7fb13c06d9c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb140033000 tx=0x7fb14002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.498+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== osd.3 v2:172.21.15.5:6808/2008289449 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb14400de90 con 0x7fb13c0713c0 2024-04-25T09:06:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 --> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1500d1760 con 0x7fb13c0713c0 2024-04-25T09:06:50.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb14cff9640 1 -- 172.21.15.5:0/4107362095 <== osd.3 v2:172.21.15.5:6808/2008289449 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb1500d1760 con 0x7fb13c0713c0 2024-04-25T09:06:50.499 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:50.499 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:50.500 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7fb13c0713c0 msgr2=0x7fb13c0737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:6808/2008289449,v1:172.21.15.5:6809/2008289449] conn(0x7fb13c0713c0 0x7fb13c0737e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb13c06b500 msgr2=0x7fb13c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fb13c06b500 0x7fb13c06d9c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb140033000 tx=0x7fb14002e000 comp rx=0 tx=0).stop 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 msgr2=0x7fb15014efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 --2- 172.21.15.5:0/4107362095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb138004800 0x7fb15014efa0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fb144007340 tx=0x7fb144007800 comp rx=0 tx=0).stop 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb154faf640 1 -- 172.21.15.5:0/4107362095 reap_dead start 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 shutdown_connections 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 >> 172.21.15.5:0/4107362095 conn(0x7fb150066ad0 msgr2=0x7fb1500b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 shutdown_connections 2024-04-25T09:06:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.511+0000 7fb156a12640 1 -- 172.21.15.5:0/4107362095 wait complete. 2024-04-25T09:06:50.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T09:06:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.622+0000 7fac1381f640 1 Processor -- start 2024-04-25T09:06:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.623+0000 7fac1381f640 1 -- start start 2024-04-25T09:06:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.623+0000 7fac1381f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac0c15ef00 0x7fac0c0668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.623+0000 7fac1381f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c067240 con 0x7fac0c1581e0 2024-04-25T09:06:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.623+0000 7fac1381f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0ae5e0 con 0x7fac0c066e30 2024-04-25T09:06:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.623+0000 7fac1381f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c0ae300 con 0x7fac0c15ef00 2024-04-25T09:06:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.623+0000 7fac10dba640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac0c15ef00 0x7fac0c0668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.624+0000 7fac115bb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fac0c1581e0 0x7fac0c0ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49174/0 (socket says 172.21.15.5:49174) 2024-04-25T09:06:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.624+0000 7fac115bb640 1 -- 172.21.15.5:0/308290605 learned_addr learned my addr 172.21.15.5:0/308290605 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.624+0000 7fac10dba640 1 -- 172.21.15.5:0/308290605 >> v1:172.21.15.80:6789/0 conn(0x7fac0c066e30 legacy=0x7fac0c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.624+0000 7fac10dba640 1 -- 172.21.15.5:0/308290605 >> v1:172.21.15.5:6789/0 conn(0x7fac0c1581e0 legacy=0x7fac0c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.624+0000 7fac10dba640 1 -- 172.21.15.5:0/308290605 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c15e420 con 0x7fac0c15ef00 2024-04-25T09:06:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.624+0000 7fac03fff640 1 -- 172.21.15.5:0/308290605 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797213357 0 0) 0x7fac08001110 con 0x7fac0c1581e0 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac10dba640 1 --2- 172.21.15.5:0/308290605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c15ef00 0x7fac0c0668f0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0097a0 tx=0x7fabfc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9eab4863850002 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac03fff640 1 -- 172.21.15.5:0/308290605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc037070 con 0x7fac0c15ef00 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac03fff640 1 -- 172.21.15.5:0/308290605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc032440 con 0x7fac0c15ef00 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac03fff640 1 -- 172.21.15.5:0/308290605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc032810 con 0x7fac0c15ef00 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac1381f640 1 -- 172.21.15.5:0/308290605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c15ef00 msgr2=0x7fac0c0668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac1381f640 1 --2- 172.21.15.5:0/308290605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c15ef00 0x7fac0c0668f0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0097a0 tx=0x7fabfc02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac1381f640 1 -- 172.21.15.5:0/308290605 shutdown_connections 2024-04-25T09:06:50.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac1381f640 1 --2- 172.21.15.5:0/308290605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c15ef00 0x7fac0c0668f0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac1381f640 1 -- 172.21.15.5:0/308290605 >> 172.21.15.5:0/308290605 conn(0x7fac0c0d0870 msgr2=0x7fac0c0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac1381f640 1 -- 172.21.15.5:0/308290605 shutdown_connections 2024-04-25T09:06:50.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.625+0000 7fac1381f640 1 -- 172.21.15.5:0/308290605 wait complete. 2024-04-25T09:06:50.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.626+0000 7fac1381f640 1 Processor -- start 2024-04-25T09:06:50.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac1381f640 1 -- start start 2024-04-25T09:06:50.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac1381f640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac0c066e30 0x7fac0c147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac1381f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c1581e0 0x7fac0c06abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac1381f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0c15ef00 0x7fac0c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac1381f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1585c0 con 0x7fac0c1581e0 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac1381f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c15e9e0 con 0x7fac0c15ef00 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac1381f640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0afd50 con 0x7fac0c066e30 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac10dba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c1581e0 0x7fac0c06abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac10dba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c1581e0 0x7fac0c06abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57264/0 (socket says 172.21.15.5:57264) 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac10dba640 1 -- 172.21.15.5:0/1046329110 learned_addr learned my addr 172.21.15.5:0/1046329110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:50.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.627+0000 7fac115bb640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac0c066e30 0x7fac0c147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac11dbc640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0c15ef00 0x7fac0c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac10dba640 1 -- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac0c066e30 msgr2=0x7fac0c147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac10dba640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac0c066e30 0x7fac0c147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac10dba640 1 -- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0c15ef00 msgr2=0x7fac0c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac10dba640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0c15ef00 0x7fac0c06b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac10dba640 1 -- 172.21.15.5:0/1046329110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c160550 con 0x7fac0c1581e0 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac10dba640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c1581e0 0x7fac0c06abe0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000c00 tx=0x7fabfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac01ffb640 1 -- 172.21.15.5:0/1046329110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc037040 con 0x7fac0c1581e0 2024-04-25T09:06:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac01ffb640 1 -- 172.21.15.5:0/1046329110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc042070 con 0x7fac0c1581e0 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c15f4b0 con 0x7fac0c1581e0 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac01ffb640 1 -- 172.21.15.5:0/1046329110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc030a70 con 0x7fac0c1581e0 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.628+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c15fa70 con 0x7fac0c1581e0 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.629+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c0d16a0 con 0x7fac0c1581e0 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.630+0000 7fac01ffb640 1 -- 172.21.15.5:0/1046329110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fabfc030c10 con 0x7fac0c1581e0 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.630+0000 7fac01ffb640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fabf006b4d0 0x7fabf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.631+0000 7fac01ffb640 1 -- 172.21.15.5:0/1046329110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fabfc0aa800 con 0x7fac0c1581e0 2024-04-25T09:06:50.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.631+0000 7fac115bb640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fabf006b4d0 0x7fabf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.631+0000 7fac115bb640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fabf006b4d0 0x7fabf006d990 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fac08000f60 tx=0x7fac08007b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.635+0000 7fac01ffb640 1 -- 172.21.15.5:0/1046329110 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fabfc0793c0 con 0x7fac0c1581e0 2024-04-25T09:06:50.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.819+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fac0c06c3b0 con 0x7fabf006b4d0 2024-04-25T09:06:50.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.821+0000 7fac01ffb640 1 -- 172.21.15.5:0/1046329110 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fac0c06c3b0 con 0x7fabf006b4d0 2024-04-25T09:06:50.808 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T09:06:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fabf006b4d0 msgr2=0x7fabf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fabf006b4d0 0x7fabf006d990 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fac08000f60 tx=0x7fac08007b50 comp rx=0 tx=0).stop 2024-04-25T09:06:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c1581e0 msgr2=0x7fac0c06abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c1581e0 0x7fac0c06abe0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000c00 tx=0x7fabfc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 shutdown_connections 2024-04-25T09:06:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fabf006b4d0 0x7fabf006d990 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0c15ef00 0x7fac0c06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac0c1581e0 0x7fac0c06abe0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 --2- 172.21.15.5:0/1046329110 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac0c066e30 0x7fac0c147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 >> 172.21.15.5:0/1046329110 conn(0x7fac0c0d0870 msgr2=0x7fac0c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 shutdown_connections 2024-04-25T09:06:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.822+0000 7fac1381f640 1 -- 172.21.15.5:0/1046329110 wait complete. 2024-04-25T09:06:50.821 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T09:06:50.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:50.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.938+0000 7ff830910640 1 Processor -- start 2024-04-25T09:06:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.938+0000 7ff830910640 1 -- start start 2024-04-25T09:06:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.939+0000 7ff830910640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff82c0d0af0 0x7ff82c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.939+0000 7ff830910640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0b6ed0 con 0x7ff82c0d2500 2024-04-25T09:06:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.939+0000 7ff830910640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0d2d90 con 0x7ff82c161610 2024-04-25T09:06:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.939+0000 7ff830910640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c1619f0 con 0x7ff82c0d0af0 2024-04-25T09:06:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.939+0000 7ff829d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff82c0d0af0 0x7ff82c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.939+0000 7ff82ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff82c0d2500 0x7ff82c0b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34988/0 (socket says 172.21.15.5:34988) 2024-04-25T09:06:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.939+0000 7ff82ad9d640 1 -- 172.21.15.5:0/1177706914 learned_addr learned my addr 172.21.15.5:0/1177706914 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.940+0000 7ff829d9b640 1 -- 172.21.15.5:0/1177706914 >> v1:172.21.15.80:6789/0 conn(0x7ff82c161610 legacy=0x7ff82c0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.940+0000 7ff829d9b640 1 -- 172.21.15.5:0/1177706914 >> v1:172.21.15.5:6789/0 conn(0x7ff82c0d2500 legacy=0x7ff82c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.940+0000 7ff829d9b640 1 -- 172.21.15.5:0/1177706914 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0d3070 con 0x7ff82c0d0af0 2024-04-25T09:06:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.940+0000 7ff82959a640 1 -- 172.21.15.5:0/1177706914 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381912912 0 0) 0x7ff81c001490 con 0x7ff82c0d2500 2024-04-25T09:06:50.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.940+0000 7ff829d9b640 1 --2- 172.21.15.5:0/1177706914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c0d0af0 0x7ff82c0d1fc0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7ff8200097a0 tx=0x7ff82002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a071061836ef9cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.940+0000 7ff82959a640 1 -- 172.21.15.5:0/1177706914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820037070 con 0x7ff82c0d0af0 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff82959a640 1 -- 172.21.15.5:0/1177706914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff820032440 con 0x7ff82c0d0af0 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff82959a640 1 -- 172.21.15.5:0/1177706914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820032810 con 0x7ff82c0d0af0 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff830910640 1 -- 172.21.15.5:0/1177706914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c0d0af0 msgr2=0x7ff82c0d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff830910640 1 --2- 172.21.15.5:0/1177706914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c0d0af0 0x7ff82c0d1fc0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7ff8200097a0 tx=0x7ff82002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff830910640 1 -- 172.21.15.5:0/1177706914 shutdown_connections 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff830910640 1 --2- 172.21.15.5:0/1177706914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c0d0af0 0x7ff82c0d1fc0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff830910640 1 -- 172.21.15.5:0/1177706914 >> 172.21.15.5:0/1177706914 conn(0x7ff82c0668f0 msgr2=0x7ff82c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff830910640 1 -- 172.21.15.5:0/1177706914 shutdown_connections 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.941+0000 7ff830910640 1 -- 172.21.15.5:0/1177706914 wait complete. 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.942+0000 7ff830910640 1 Processor -- start 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff830910640 1 -- start start 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff830910640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff82c0d0af0 0x7ff82c14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff830910640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff82c0d2500 0x7ff82c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff830910640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c161610 0x7ff82c0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff830910640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0d2950 con 0x7ff82c161610 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff830910640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0b74c0 con 0x7ff82c0d0af0 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff830910640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0d2ad0 con 0x7ff82c0d2500 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff82ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c161610 0x7ff82c0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff82ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c161610 0x7ff82c0c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39478/0 (socket says 172.21.15.5:39478) 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff82ad9d640 1 -- 172.21.15.5:0/4112540780 learned_addr learned my addr 172.21.15.5:0/4112540780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff82a59c640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff82c0d0af0 0x7ff82c14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.943+0000 7ff829d9b640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff82c0d2500 0x7ff82c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff82ad9d640 1 -- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff82c0d2500 msgr2=0x7ff82c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff82ad9d640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff82c0d2500 0x7ff82c0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff82ad9d640 1 -- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff82c0d0af0 msgr2=0x7ff82c14d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff82ad9d640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff82c0d0af0 0x7ff82c14d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff82ad9d640 1 -- 172.21.15.5:0/4112540780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0b3a80 con 0x7ff82c161610 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff82ad9d640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c161610 0x7ff82c0c98c0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c7f0 tx=0x7ff81c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c018070 con 0x7ff82c161610 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c00a5e0 con 0x7ff82c161610 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00aa10 con 0x7ff82c161610 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0b3d60 con 0x7ff82c161610 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.944+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0b4320 con 0x7ff82c161610 2024-04-25T09:06:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.945+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff82c04ef20 con 0x7ff82c161610 2024-04-25T09:06:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.945+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff81c01b070 con 0x7ff82c161610 2024-04-25T09:06:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.946+0000 7ff81affd640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff80c06b500 0x7ff80c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.946+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff81c089420 con 0x7ff82c161610 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.946+0000 7ff81affd640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7ff80c0713c0 0x7ff80c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.946+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 --> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff81c017ec0 con 0x7ff80c0713c0 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.946+0000 7ff82a59c640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff80c06b500 0x7ff80c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.946+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff81c090050 con 0x7ff82c161610 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.946+0000 7ff829d9b640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7ff80c0713c0 0x7ff80c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.947+0000 7ff82a59c640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff80c06b500 0x7ff80c06d9c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff824000f60 tx=0x7ff824009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.947+0000 7ff829d9b640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7ff80c0713c0 0x7ff80c0737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.948+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== osd.4 v2:172.21.15.80:6816/1836296073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff81c017ec0 con 0x7ff80c0713c0 2024-04-25T09:06:50.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.961+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 --> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff82c0ca660 con 0x7ff80c0713c0 2024-04-25T09:06:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.961+0000 7ff81affd640 1 -- 172.21.15.5:0/4112540780 <== osd.4 v2:172.21.15.80:6816/1836296073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff82c0ca660 con 0x7ff80c0713c0 2024-04-25T09:06:50.950 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:50.951 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:50.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7ff80c0713c0 msgr2=0x7ff80c0737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6816/1836296073,v1:172.21.15.80:6817/1836296073] conn(0x7ff80c0713c0 0x7ff80c0737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff80c06b500 msgr2=0x7ff80c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff80c06b500 0x7ff80c06d9c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff824000f60 tx=0x7ff824009040 comp rx=0 tx=0).stop 2024-04-25T09:06:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c161610 msgr2=0x7ff82c0c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 --2- 172.21.15.5:0/4112540780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff82c161610 0x7ff82c0c98c0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c7f0 tx=0x7ff81c00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff82ad9d640 1 -- 172.21.15.5:0/4112540780 reap_dead start 2024-04-25T09:06:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 shutdown_connections 2024-04-25T09:06:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 >> 172.21.15.5:0/4112540780 conn(0x7ff82c0668f0 msgr2=0x7ff82c15f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 shutdown_connections 2024-04-25T09:06:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:50.962+0000 7ff830910640 1 -- 172.21.15.5:0/4112540780 wait complete. 2024-04-25T09:06:50.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T09:06:51.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.074+0000 7f515afb6640 1 Processor -- start 2024-04-25T09:06:51.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.074+0000 7f515afb6640 1 -- start start 2024-04-25T09:06:51.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f515afb6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f515415de70 0x7f51540b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f515afb6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51540d20e0 con 0x7f51540ce7f0 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f515afb6640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51540d23c0 con 0x7f51540b2cc0 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f515afb6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51540d2a10 con 0x7f515415de70 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f5158d52640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f515415de70 0x7f51540b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f5159553640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f51540ce7f0 0x7f51540cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34990/0 (socket says 172.21.15.5:34990) 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f5159553640 1 -- 172.21.15.5:0/2815555029 learned_addr learned my addr 172.21.15.5:0/2815555029 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f5158d52640 1 -- 172.21.15.5:0/2815555029 >> v1:172.21.15.80:6789/0 conn(0x7f51540b2cc0 legacy=0x7f51540b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f5158d52640 1 -- 172.21.15.5:0/2815555029 >> v1:172.21.15.5:6789/0 conn(0x7f51540ce7f0 legacy=0x7f51540cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.076+0000 7f5158d52640 1 -- 172.21.15.5:0/2815555029 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540d26a0 con 0x7f515415de70 2024-04-25T09:06:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.075+0000 7f51537fe640 1 -- 172.21.15.5:0/2815555029 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171877567 0 0) 0x7f51540d20e0 con 0x7f51540ce7f0 2024-04-25T09:06:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.076+0000 7f5158d52640 1 --2- 172.21.15.5:0/2815555029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540b93e0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f514c009d90 tx=0x7f514c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58acd6fe93fbc29f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.076+0000 7f51537fe640 1 -- 172.21.15.5:0/2815555029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c007740 con 0x7f515415de70 2024-04-25T09:06:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.076+0000 7f51537fe640 1 -- 172.21.15.5:0/2815555029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c0078e0 con 0x7f515415de70 2024-04-25T09:06:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.076+0000 7f51537fe640 1 -- 172.21.15.5:0/2815555029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c007cb0 con 0x7f515415de70 2024-04-25T09:06:51.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.077+0000 7f515afb6640 1 -- 172.21.15.5:0/2815555029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 msgr2=0x7f51540b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.077+0000 7f515afb6640 1 --2- 172.21.15.5:0/2815555029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540b93e0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f514c009d90 tx=0x7f514c02a6f0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.077+0000 7f515afb6640 1 -- 172.21.15.5:0/2815555029 shutdown_connections 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.077+0000 7f515afb6640 1 --2- 172.21.15.5:0/2815555029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540b93e0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.077+0000 7f515afb6640 1 -- 172.21.15.5:0/2815555029 >> 172.21.15.5:0/2815555029 conn(0x7f515406b000 msgr2=0x7f515406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.077+0000 7f515afb6640 1 -- 172.21.15.5:0/2815555029 shutdown_connections 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.077+0000 7f515afb6640 1 -- 172.21.15.5:0/2815555029 wait complete. 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.078+0000 7f515afb6640 1 Processor -- start 2024-04-25T09:06:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.078+0000 7f515afb6640 1 -- start start 2024-04-25T09:06:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f515afb6640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51540b2cc0 0x7f515414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f515afb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51540ce7f0 0x7f51540c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f515afb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f515afb6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51540d2ea0 con 0x7f515415de70 2024-04-25T09:06:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f515afb6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51540b7300 con 0x7f51540ce7f0 2024-04-25T09:06:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f515afb6640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51540d3020 con 0x7f51540b2cc0 2024-04-25T09:06:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f5159553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f5159553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39496/0 (socket says 172.21.15.5:39496) 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f5159553640 1 -- 172.21.15.5:0/2768832066 learned_addr learned my addr 172.21.15.5:0/2768832066 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f5159553640 1 -- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51540b2cc0 msgr2=0x7f515414ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f5159553640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51540b2cc0 0x7f515414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f5159553640 1 -- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51540ce7f0 msgr2=0x7f51540c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.079+0000 7f5159553640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51540ce7f0 0x7f51540c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.080+0000 7f5159553640 1 -- 172.21.15.5:0/2768832066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5154150500 con 0x7f515415de70 2024-04-25T09:06:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.080+0000 7f5159553640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540c95d0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f514400c450 tx=0x7f514400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.080+0000 7f51517fa640 1 -- 172.21.15.5:0/2768832066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144018070 con 0x7f515415de70 2024-04-25T09:06:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.080+0000 7f51517fa640 1 -- 172.21.15.5:0/2768832066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5144007500 con 0x7f515415de70 2024-04-25T09:06:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.080+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51540c8340 con 0x7f515415de70 2024-04-25T09:06:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.080+0000 7f51517fa640 1 -- 172.21.15.5:0/2768832066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144004a20 con 0x7f515415de70 2024-04-25T09:06:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.080+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51540cb020 con 0x7f515415de70 2024-04-25T09:06:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.081+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515404ef20 con 0x7f515415de70 2024-04-25T09:06:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.081+0000 7f51517fa640 1 -- 172.21.15.5:0/2768832066 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f514401b070 con 0x7f515415de70 2024-04-25T09:06:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.082+0000 7f51517fa640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f514006b4d0 0x7f514006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.082+0000 7f51517fa640 1 -- 172.21.15.5:0/2768832066 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f51440890e0 con 0x7f515415de70 2024-04-25T09:06:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.082+0000 7f5158d52640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f514006b4d0 0x7f514006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.083+0000 7f5158d52640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f514006b4d0 0x7f514006d990 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f514c034000 tx=0x7f514c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.086+0000 7f51517fa640 1 -- 172.21.15.5:0/2768832066 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5154150500 con 0x7f515415de70 2024-04-25T09:06:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.265+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f515415d690 con 0x7f514006b4d0 2024-04-25T09:06:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.265+0000 7f51517fa640 1 -- 172.21.15.5:0/2768832066 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f515415d690 con 0x7f514006b4d0 2024-04-25T09:06:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f514006b4d0 msgr2=0x7f514006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f514006b4d0 0x7f514006d990 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f514c034000 tx=0x7f514c02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 msgr2=0x7f51540c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540c95d0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f514400c450 tx=0x7f514400c910 comp rx=0 tx=0).stop 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 shutdown_connections 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f514006b4d0 0x7f514006d990 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f515415de70 0x7f51540c95d0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51540ce7f0 0x7f51540c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 --2- 172.21.15.5:0/2768832066 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51540b2cc0 0x7f515414ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 >> 172.21.15.5:0/2768832066 conn(0x7f515406b000 msgr2=0x7f51540b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 shutdown_connections 2024-04-25T09:06:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.267+0000 7f515afb6640 1 -- 172.21.15.5:0/2768832066 wait complete. 2024-04-25T09:06:51.266 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T09:06:51.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:51.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.383+0000 7fac91088640 1 Processor -- start 2024-04-25T09:06:51.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.383+0000 7fac91088640 1 -- start start 2024-04-25T09:06:51.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac91088640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c1617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac91088640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac8c0b9470 0x7fac8c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac91088640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c162070 con 0x7fac8c0cecf0 2024-04-25T09:06:51.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac91088640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0cf160 con 0x7fac8c0b9470 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac91088640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c162350 con 0x7fac8c15dbd0 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac8c0b9470 0x7fac8c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac8c0b9470 0x7fac8c0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39504/0 (socket says 172.21.15.5:39504) 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8a59c640 1 -- 172.21.15.5:0/3531667105 learned_addr learned my addr 172.21.15.5:0/3531667105 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8ad9d640 1 --2- 172.21.15.5:0/3531667105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c1617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8a59c640 1 -- 172.21.15.5:0/3531667105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 msgr2=0x7fac8c1617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8a59c640 1 --2- 172.21.15.5:0/3531667105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c1617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8a59c640 1 -- 172.21.15.5:0/3531667105 >> v1:172.21.15.80:6789/0 conn(0x7fac8c0cecf0 legacy=0x7fac8c0b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:51.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.384+0000 7fac8a59c640 1 -- 172.21.15.5:0/3531667105 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0d1c50 con 0x7fac8c0b9470 2024-04-25T09:06:51.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.385+0000 7fac8a59c640 1 --2- 172.21.15.5:0/3531667105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0b9470 0x7fac8c0ce7b0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fac80009870 tx=0x7fac8002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbb190629e55aa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.385+0000 7fac89d9b640 1 -- 172.21.15.5:0/3531667105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80037070 con 0x7fac8c0b9470 2024-04-25T09:06:51.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.385+0000 7fac89d9b640 1 -- 172.21.15.5:0/3531667105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac80032440 con 0x7fac8c0b9470 2024-04-25T09:06:51.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.385+0000 7fac89d9b640 1 -- 172.21.15.5:0/3531667105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80032810 con 0x7fac8c0b9470 2024-04-25T09:06:51.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 -- 172.21.15.5:0/3531667105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0b9470 msgr2=0x7fac8c0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 --2- 172.21.15.5:0/3531667105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0b9470 0x7fac8c0ce7b0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fac80009870 tx=0x7fac8002a210 comp rx=0 tx=0).stop 2024-04-25T09:06:51.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 -- 172.21.15.5:0/3531667105 shutdown_connections 2024-04-25T09:06:51.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 --2- 172.21.15.5:0/3531667105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0b9470 0x7fac8c0ce7b0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 --2- 172.21.15.5:0/3531667105 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c1617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 -- 172.21.15.5:0/3531667105 >> 172.21.15.5:0/3531667105 conn(0x7fac8c066ad0 msgr2=0x7fac8c066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 -- 172.21.15.5:0/3531667105 shutdown_connections 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.386+0000 7fac91088640 1 -- 172.21.15.5:0/3531667105 wait complete. 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.387+0000 7fac91088640 1 Processor -- start 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.387+0000 7fac91088640 1 -- start start 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac91088640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c0b9470 0x7fac8c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac91088640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0cecf0 0x7fac8c160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac91088640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac91088640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c161cf0 con 0x7fac8c0cecf0 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac91088640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c162630 con 0x7fac8c0b9470 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac91088640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c15dfb0 con 0x7fac8c15dbd0 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0cecf0 0x7fac8c160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0cecf0 0x7fac8c160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39510/0 (socket says 172.21.15.5:39510) 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 -- 172.21.15.5:0/912778077 learned_addr learned my addr 172.21.15.5:0/912778077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 -- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 msgr2=0x7fac8c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8ad9d640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c0b9470 0x7fac8c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8b59e640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 -- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c0b9470 msgr2=0x7fac8c0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c0b9470 0x7fac8c0b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8a59c640 1 -- 172.21.15.5:0/912778077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0b58a0 con 0x7fac8c0cecf0 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8ad9d640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c0b9470 0x7fac8c0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.388+0000 7fac8b59e640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fac8c15dbd0 0x7fac8c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.389+0000 7fac8a59c640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0cecf0 0x7fac8c160a70 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fac80009870 tx=0x7fac800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.389+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80041020 con 0x7fac8c0cecf0 2024-04-25T09:06:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.389+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac80030970 con 0x7fac8c0cecf0 2024-04-25T09:06:51.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.389+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c0b5b80 con 0x7fac8c0cecf0 2024-04-25T09:06:51.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.389+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80037040 con 0x7fac8c0cecf0 2024-04-25T09:06:51.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.389+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c0cbba0 con 0x7fac8c0cecf0 2024-04-25T09:06:51.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.390+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac8c0b5f70 con 0x7fac8c0cecf0 2024-04-25T09:06:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.390+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac80044020 con 0x7fac8c0cecf0 2024-04-25T09:06:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac737fe640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac7806b4d0 0x7fac7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac800aa8c0 con 0x7fac8c0cecf0 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac737fe640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fac78071390 0x7fac780737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 --> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac80033e50 con 0x7fac78071390 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac8ad9d640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac7806b4d0 0x7fac7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac800af2c0 con 0x7fac8c0cecf0 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac8b59e640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fac78071390 0x7fac780737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.391+0000 7fac8ad9d640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac7806b4d0 0x7fac7806d990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fac7c007eb0 tx=0x7fac7c007400 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.392+0000 7fac8b59e640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fac78071390 0x7fac780737b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.392+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== osd.5 v2:172.21.15.80:6824/1661516176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fac80033e50 con 0x7fac78071390 2024-04-25T09:06:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.406+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 --> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fac8c04ef20 con 0x7fac78071390 2024-04-25T09:06:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.406+0000 7fac737fe640 1 -- 172.21.15.5:0/912778077 <== osd.5 v2:172.21.15.80:6824/1661516176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fac8c04ef20 con 0x7fac78071390 2024-04-25T09:06:51.395 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:51.395 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:51.395 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fac78071390 msgr2=0x7fac780737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6824/1661516176,v1:172.21.15.80:6825/1661516176] conn(0x7fac78071390 0x7fac780737b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac7806b4d0 msgr2=0x7fac7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fac7806b4d0 0x7fac7806d990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fac7c007eb0 tx=0x7fac7c007400 comp rx=0 tx=0).stop 2024-04-25T09:06:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0cecf0 msgr2=0x7fac8c160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 --2- 172.21.15.5:0/912778077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac8c0cecf0 0x7fac8c160a70 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fac80009870 tx=0x7fac800046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac8b59e640 1 -- 172.21.15.5:0/912778077 reap_dead start 2024-04-25T09:06:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 shutdown_connections 2024-04-25T09:06:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 >> 172.21.15.5:0/912778077 conn(0x7fac8c066ad0 msgr2=0x7fac8c0c7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 shutdown_connections 2024-04-25T09:06:51.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.407+0000 7fac91088640 1 -- 172.21.15.5:0/912778077 wait complete. 2024-04-25T09:06:51.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T09:06:51.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.522+0000 7f49039e7640 1 Processor -- start 2024-04-25T09:06:51.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.522+0000 7f49039e7640 1 -- start start 2024-04-25T09:06:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f49039e7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48fc0b0a50 0x7f48fc0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f49039e7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48fc0cbf40 0x7f48fc0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f49039e7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc06ba50 con 0x7f48fc0b0e30 2024-04-25T09:06:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f49039e7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc06b800 con 0x7f48fc0cbf40 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f49039e7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc06bd30 con 0x7f48fc0b0a50 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f4901f84640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48fc0cbf40 0x7f48fc0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f4900f82640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f48fc0b0e30 0x7f48fc0d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35000/0 (socket says 172.21.15.5:35000) 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.523+0000 7f4900f82640 1 -- 172.21.15.5:0/2741139454 learned_addr learned my addr 172.21.15.5:0/2741139454 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.524+0000 7f4901783640 1 --2- 172.21.15.5:0/2741139454 >> v2:172.21.15.80:3300/0 conn(0x7f48fc0b0a50 0x7f48fc0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.524+0000 7f4901f84640 1 -- 172.21.15.5:0/2741139454 >> v2:172.21.15.80:3300/0 conn(0x7f48fc0b0a50 msgr2=0x7f48fc0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.524+0000 7f4901f84640 1 --2- 172.21.15.5:0/2741139454 >> v2:172.21.15.80:3300/0 conn(0x7f48fc0b0a50 0x7f48fc0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.524+0000 7f4901f84640 1 -- 172.21.15.5:0/2741139454 >> v1:172.21.15.5:6789/0 conn(0x7f48fc0b0e30 legacy=0x7f48fc0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.524+0000 7f4901f84640 1 -- 172.21.15.5:0/2741139454 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc06c010 con 0x7f48fc0cbf40 2024-04-25T09:06:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.524+0000 7f4901f84640 1 --2- 172.21.15.5:0/2741139454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0cbf40 0x7f48fc0ce740 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f48fc071950 tx=0x7f48ec02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f720a3632319ba2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.524+0000 7f48fbfff640 1 -- 172.21.15.5:0/2741139454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007740 con 0x7f48fc0cbf40 2024-04-25T09:06:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f48fbfff640 1 -- 172.21.15.5:0/2741139454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec0078e0 con 0x7f48fc0cbf40 2024-04-25T09:06:51.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f48fbfff640 1 -- 172.21.15.5:0/2741139454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007cb0 con 0x7f48fc0cbf40 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 -- 172.21.15.5:0/2741139454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0cbf40 msgr2=0x7f48fc0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 --2- 172.21.15.5:0/2741139454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0cbf40 0x7f48fc0ce740 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f48fc071950 tx=0x7f48ec02a5f0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 -- 172.21.15.5:0/2741139454 shutdown_connections 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 --2- 172.21.15.5:0/2741139454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0cbf40 0x7f48fc0ce740 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 --2- 172.21.15.5:0/2741139454 >> v2:172.21.15.80:3300/0 conn(0x7f48fc0b0a50 0x7f48fc0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 -- 172.21.15.5:0/2741139454 >> 172.21.15.5:0/2741139454 conn(0x7f48fc0d18f0 msgr2=0x7f48fc0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 -- 172.21.15.5:0/2741139454 shutdown_connections 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.525+0000 7f49039e7640 1 -- 172.21.15.5:0/2741139454 wait complete. 2024-04-25T09:06:51.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.526+0000 7f49039e7640 1 Processor -- start 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.526+0000 7f49039e7640 1 -- start start 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f49039e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48fc0b0a50 0x7f48fc1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f49039e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0b0e30 0x7f48fc1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f49039e7640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f48fc0cbf40 0x7f48fc0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f49039e7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0b2bf0 con 0x7f48fc0b0e30 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f49039e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0cfd60 con 0x7f48fc0b0a50 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f49039e7640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc148c90 con 0x7f48fc0cbf40 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0b0e30 0x7f48fc1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0b0e30 0x7f48fc1587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39524/0 (socket says 172.21.15.5:39524) 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 -- 172.21.15.5:0/116761911 learned_addr learned my addr 172.21.15.5:0/116761911 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4901783640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48fc0b0a50 0x7f48fc1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4901f84640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f48fc0cbf40 0x7f48fc0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 -- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f48fc0cbf40 msgr2=0x7f48fc0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f48fc0cbf40 0x7f48fc0af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 -- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48fc0b0a50 msgr2=0x7f48fc1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48fc0b0a50 0x7f48fc1483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.527+0000 7f4900f82640 1 -- 172.21.15.5:0/116761911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc15b2c0 con 0x7f48fc0b0e30 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.528+0000 7f4900f82640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0b0e30 0x7f48fc1587a0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c3d0 tx=0x7f48f000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.528+0000 7f48f9ffb640 1 -- 172.21.15.5:0/116761911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0017070 con 0x7f48fc0b0e30 2024-04-25T09:06:51.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.528+0000 7f48f9ffb640 1 -- 172.21.15.5:0/116761911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0005ce0 con 0x7f48fc0b0e30 2024-04-25T09:06:51.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.528+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc15b5a0 con 0x7f48fc0b0e30 2024-04-25T09:06:51.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.528+0000 7f48f9ffb640 1 -- 172.21.15.5:0/116761911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00072f0 con 0x7f48fc0b0e30 2024-04-25T09:06:51.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.528+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc15af00 con 0x7f48fc0b0e30 2024-04-25T09:06:51.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.529+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc06cd70 con 0x7f48fc0b0e30 2024-04-25T09:06:51.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.529+0000 7f48f9ffb640 1 -- 172.21.15.5:0/116761911 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f48f001a070 con 0x7f48fc0b0e30 2024-04-25T09:06:51.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.530+0000 7f48f9ffb640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f48e806b4d0 0x7f48e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.530+0000 7f48f9ffb640 1 -- 172.21.15.5:0/116761911 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f48f00892b0 con 0x7f48fc0b0e30 2024-04-25T09:06:51.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.530+0000 7f4901783640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f48e806b4d0 0x7f48e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.530+0000 7f4901783640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f48e806b4d0 0x7f48e806d990 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f48f4006fd0 tx=0x7f48f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.534+0000 7f48f9ffb640 1 -- 172.21.15.5:0/116761911 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48f0058420 con 0x7f48fc0b0e30 2024-04-25T09:06:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.715+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f48fc148e40 con 0x7f48e806b4d0 2024-04-25T09:06:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.716+0000 7f48f9ffb640 1 -- 172.21.15.5:0/116761911 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f48f400b200 con 0x7f48e806b4d0 2024-04-25T09:06:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f48e806b4d0 msgr2=0x7f48e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f48e806b4d0 0x7f48e806d990 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f48f4006fd0 tx=0x7f48f4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0b0e30 msgr2=0x7f48fc1587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0b0e30 0x7f48fc1587a0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c3d0 tx=0x7f48f000c890 comp rx=0 tx=0).stop 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 shutdown_connections 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f48e806b4d0 0x7f48e806d990 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f48fc0cbf40 0x7f48fc0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48fc0b0e30 0x7f48fc1587a0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 --2- 172.21.15.5:0/116761911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48fc0b0a50 0x7f48fc1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 >> 172.21.15.5:0/116761911 conn(0x7f48fc0d18f0 msgr2=0x7f48fc0ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 shutdown_connections 2024-04-25T09:06:51.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.718+0000 7f49039e7640 1 -- 172.21.15.5:0/116761911 wait complete. 2024-04-25T09:06:51.717 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T09:06:51.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:51.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.833+0000 7ff9339e0640 1 Processor -- start 2024-04-25T09:06:51.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.833+0000 7ff9339e0640 1 -- start start 2024-04-25T09:06:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff9339e0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0b97f0 0x7ff92c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff9339e0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff92c0cee00 0x7ff92c0d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff9339e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c162820 con 0x7ff92c15dde0 2024-04-25T09:06:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff9339e0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c162260 con 0x7ff92c0cee00 2024-04-25T09:06:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff9339e0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c162540 con 0x7ff92c0b97f0 2024-04-25T09:06:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff931f7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff92c0cee00 0x7ff92c0d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff931f7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff92c0cee00 0x7ff92c0d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39532/0 (socket says 172.21.15.5:39532) 2024-04-25T09:06:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.834+0000 7ff931f7d640 1 -- 172.21.15.5:0/1582699663 learned_addr learned my addr 172.21.15.5:0/1582699663 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.835+0000 7ff930f7b640 1 --2- 172.21.15.5:0/1582699663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0b97f0 0x7ff92c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.835+0000 7ff931f7d640 1 -- 172.21.15.5:0/1582699663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0b97f0 msgr2=0x7ff92c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.835+0000 7ff931f7d640 1 --2- 172.21.15.5:0/1582699663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0b97f0 0x7ff92c0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.835+0000 7ff931f7d640 1 -- 172.21.15.5:0/1582699663 >> v1:172.21.15.80:6789/0 conn(0x7ff92c15dde0 legacy=0x7ff92c161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.835+0000 7ff931f7d640 1 -- 172.21.15.5:0/1582699663 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c0d1f90 con 0x7ff92c0cee00 2024-04-25T09:06:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.835+0000 7ff931f7d640 1 --2- 172.21.15.5:0/1582699663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0cee00 0x7ff92c0d2790 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce4445188f3d01f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff92bfff640 1 -- 172.21.15.5:0/1582699663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c036070 con 0x7ff92c0cee00 2024-04-25T09:06:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff92bfff640 1 -- 172.21.15.5:0/1582699663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c031600 con 0x7ff92c0cee00 2024-04-25T09:06:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff92bfff640 1 -- 172.21.15.5:0/1582699663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0319d0 con 0x7ff92c0cee00 2024-04-25T09:06:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 -- 172.21.15.5:0/1582699663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0cee00 msgr2=0x7ff92c0d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 --2- 172.21.15.5:0/1582699663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0cee00 0x7ff92c0d2790 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c02a7a0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 -- 172.21.15.5:0/1582699663 shutdown_connections 2024-04-25T09:06:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 --2- 172.21.15.5:0/1582699663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0cee00 0x7ff92c0d2790 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 --2- 172.21.15.5:0/1582699663 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0b97f0 0x7ff92c0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 -- 172.21.15.5:0/1582699663 >> 172.21.15.5:0/1582699663 conn(0x7ff92c0668f0 msgr2=0x7ff92c066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 -- 172.21.15.5:0/1582699663 shutdown_connections 2024-04-25T09:06:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.836+0000 7ff9339e0640 1 -- 172.21.15.5:0/1582699663 wait complete. 2024-04-25T09:06:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.837+0000 7ff9339e0640 1 Processor -- start 2024-04-25T09:06:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.837+0000 7ff9339e0640 1 -- start start 2024-04-25T09:06:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff9339e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0b97f0 0x7ff92c1f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff9339e0640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0cee00 0x7ff92c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff9339e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92c15dde0 0x7ff92c0ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff9339e0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c15e1c0 con 0x7ff92c0b97f0 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff9339e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0b6c90 con 0x7ff92c15dde0 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff9339e0640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0d2cd0 con 0x7ff92c0cee00 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff93177c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0b97f0 0x7ff92c1f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff93177c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0b97f0 0x7ff92c1f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39544/0 (socket says 172.21.15.5:39544) 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff93177c640 1 -- 172.21.15.5:0/3242374436 learned_addr learned my addr 172.21.15.5:0/3242374436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff930f7b640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0cee00 0x7ff92c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.838+0000 7ff931f7d640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92c15dde0 0x7ff92c0ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff93177c640 1 -- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0cee00 msgr2=0x7ff92c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff93177c640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0cee00 0x7ff92c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff93177c640 1 -- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92c15dde0 msgr2=0x7ff92c0ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff93177c640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92c15dde0 0x7ff92c0ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff93177c640 1 -- 172.21.15.5:0/3242374436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c1f4870 con 0x7ff92c0b97f0 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff930f7b640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ff92c0cee00 0x7ff92c15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff931f7d640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92c15dde0 0x7ff92c0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff93177c640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0b97f0 0x7ff92c1f4330 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c3c0 tx=0x7ff92400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240052d0 con 0x7ff92c0b97f0 2024-04-25T09:06:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924005490 con 0x7ff92c0b97f0 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c0ad280 con 0x7ff92c0b97f0 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924007260 con 0x7ff92c0b97f0 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.839+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c0aac10 con 0x7ff92c0b97f0 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.840+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff92c0ab5b0 con 0x7ff92c0b97f0 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff924007400 con 0x7ff92c0b97f0 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff929ffb640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91806b500 0x7ff91806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff924089350 con 0x7ff92c0b97f0 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff929ffb640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7ff9180713c0 0x7ff9180737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 --> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff924010e50 con 0x7ff9180713c0 2024-04-25T09:06:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff924090050 con 0x7ff92c0b97f0 2024-04-25T09:06:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff930f7b640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91806b500 0x7ff91806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.841+0000 7ff931f7d640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7ff9180713c0 0x7ff9180737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.842+0000 7ff930f7b640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91806b500 0x7ff91806d9c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0d48a0 tx=0x7ff920008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.842+0000 7ff931f7d640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7ff9180713c0 0x7ff9180737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.843+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== osd.6 v2:172.21.15.80:6805/2858900277 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff924010e50 con 0x7ff9180713c0 2024-04-25T09:06:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 --> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff92c04ef20 con 0x7ff9180713c0 2024-04-25T09:06:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff929ffb640 1 -- 172.21.15.5:0/3242374436 <== osd.6 v2:172.21.15.80:6805/2858900277 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff92c04ef20 con 0x7ff9180713c0 2024-04-25T09:06:51.844 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:51.845 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7ff9180713c0 msgr2=0x7ff9180737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff9339e0640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6805/2858900277,v1:172.21.15.80:6807/2858900277] conn(0x7ff9180713c0 0x7ff9180737e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91806b500 msgr2=0x7ff91806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff9339e0640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7ff91806b500 0x7ff91806d9c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0d48a0 tx=0x7ff920008040 comp rx=0 tx=0).stop 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0b97f0 msgr2=0x7ff92c1f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.856+0000 7ff9339e0640 1 --2- 172.21.15.5:0/3242374436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92c0b97f0 0x7ff92c1f4330 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c3c0 tx=0x7ff92400c880 comp rx=0 tx=0).stop 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.857+0000 7ff931f7d640 1 -- 172.21.15.5:0/3242374436 reap_dead start 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.857+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 shutdown_connections 2024-04-25T09:06:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.857+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 >> 172.21.15.5:0/3242374436 conn(0x7ff92c0668f0 msgr2=0x7ff92c0c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.857+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 shutdown_connections 2024-04-25T09:06:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.857+0000 7ff9339e0640 1 -- 172.21.15.5:0/3242374436 wait complete. 2024-04-25T09:06:51.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T09:06:51.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.969+0000 7f34f1b42640 1 Processor -- start 2024-04-25T09:06:51.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.969+0000 7f34f1b42640 1 -- start start 2024-04-25T09:06:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34f1b42640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34f1b42640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34ec06dd20 0x7f34ec0ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34f1b42640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34ec0b3860 0x7f34ec0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34f1b42640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec0b2850 con 0x7f34ec0b3860 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34f1b42640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec0b2aa0 con 0x7f34ec06dd20 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34f1b42640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0b2d80 con 0x7f34ec156250 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34ec0b3860 0x7f34ec0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34ec0b3860 0x7f34ec0aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39546/0 (socket says 172.21.15.5:39546) 2024-04-25T09:06:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 -- 172.21.15.5:0/3516816826 learned_addr learned my addr 172.21.15.5:0/3516816826 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34eb7fe640 1 --2- 172.21.15.5:0/3516816826 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34eaffd640 1 --2- 172.21.15.5:0/3516816826 >> v2:172.21.15.80:3300/0 conn(0x7f34ec06dd20 0x7f34ec0ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 -- 172.21.15.5:0/3516816826 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 msgr2=0x7f34ec0b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:51.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 --2- 172.21.15.5:0/3516816826 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec0b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 -- 172.21.15.5:0/3516816826 >> v2:172.21.15.80:3300/0 conn(0x7f34ec06dd20 msgr2=0x7f34ec0ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:51.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 --2- 172.21.15.5:0/3516816826 >> v2:172.21.15.80:3300/0 conn(0x7f34ec06dd20 0x7f34ec0ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.970+0000 7f34ebfff640 1 -- 172.21.15.5:0/3516816826 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec0b3060 con 0x7f34ec0b3860 2024-04-25T09:06:51.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34ebfff640 1 --2- 172.21.15.5:0/3516816826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec0aebd0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f34ec072620 tx=0x7f34e402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67dcb1af74b9de03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34ea7fc640 1 -- 172.21.15.5:0/3516816826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4036070 con 0x7f34ec0b3860 2024-04-25T09:06:51.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34ea7fc640 1 -- 172.21.15.5:0/3516816826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e4031600 con 0x7f34ec0b3860 2024-04-25T09:06:51.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34ea7fc640 1 -- 172.21.15.5:0/3516816826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40319d0 con 0x7f34ec0b3860 2024-04-25T09:06:51.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34f1b42640 1 -- 172.21.15.5:0/3516816826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 msgr2=0x7f34ec0aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34f1b42640 1 --2- 172.21.15.5:0/3516816826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec0aebd0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f34ec072620 tx=0x7f34e402a610 comp rx=0 tx=0).stop 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34f1b42640 1 -- 172.21.15.5:0/3516816826 shutdown_connections 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.971+0000 7f34f1b42640 1 --2- 172.21.15.5:0/3516816826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec0aebd0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.972+0000 7f34f1b42640 1 --2- 172.21.15.5:0/3516816826 >> v2:172.21.15.80:3300/0 conn(0x7f34ec06dd20 0x7f34ec0ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.972+0000 7f34f1b42640 1 --2- 172.21.15.5:0/3516816826 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec0b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.972+0000 7f34f1b42640 1 -- 172.21.15.5:0/3516816826 >> 172.21.15.5:0/3516816826 conn(0x7f34ec0668f0 msgr2=0x7f34ec066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.972+0000 7f34f1b42640 1 -- 172.21.15.5:0/3516816826 shutdown_connections 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.972+0000 7f34f1b42640 1 -- 172.21.15.5:0/3516816826 wait complete. 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.973+0000 7f34f1b42640 1 Processor -- start 2024-04-25T09:06:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.973+0000 7f34f1b42640 1 -- start start 2024-04-25T09:06:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34f1b42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34f1b42640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34f1b42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ec071b20 0x7f34ec158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34f1b42640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0b4b80 con 0x7f34ec0b3860 2024-04-25T09:06:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34f1b42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0b4a00 con 0x7f34ec071b20 2024-04-25T09:06:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34f1b42640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec06c420 con 0x7f34ec156250 2024-04-25T09:06:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39562/0 (socket says 172.21.15.5:39562) 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 -- 172.21.15.5:0/1238162363 learned_addr learned my addr 172.21.15.5:0/1238162363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eaffd640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34ebfff640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ec071b20 0x7f34ec158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 -- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 msgr2=0x7f34ec158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 -- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ec071b20 msgr2=0x7f34ec158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ec071b20 0x7f34ec158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 -- 172.21.15.5:0/1238162363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec1f3a30 con 0x7f34ec0b3860 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34ebfff640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ec071b20 0x7f34ec158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34eb7fe640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec157040 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f34e000e8a0 tx=0x7f34e000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34d3fff640 1 -- 172.21.15.5:0/1238162363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0017070 con 0x7f34ec0b3860 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34d3fff640 1 -- 172.21.15.5:0/1238162363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000c940 con 0x7f34ec0b3860 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ec14a810 con 0x7f34ec0b3860 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.974+0000 7f34d3fff640 1 -- 172.21.15.5:0/1238162363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000cd30 con 0x7f34ec0b3860 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.975+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec1f3fd0 con 0x7f34ec0b3860 2024-04-25T09:06:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.975+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec04ef20 con 0x7f34ec0b3860 2024-04-25T09:06:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.976+0000 7f34d3fff640 1 -- 172.21.15.5:0/1238162363 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34e001a070 con 0x7f34ec0b3860 2024-04-25T09:06:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.976+0000 7f34d3fff640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34d806b4d0 0x7f34d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.976+0000 7f34d3fff640 1 -- 172.21.15.5:0/1238162363 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f34e0089d00 con 0x7f34ec0b3860 2024-04-25T09:06:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.977+0000 7f34eaffd640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34d806b4d0 0x7f34d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.977+0000 7f34eaffd640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34d806b4d0 0x7f34d806d990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f34ec149d10 tx=0x7f34dc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:51.980+0000 7f34d3fff640 1 -- 172.21.15.5:0/1238162363 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34e0058820 con 0x7f34ec0b3860 2024-04-25T09:06:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.158+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f34ec15f260 con 0x7f34d806b4d0 2024-04-25T09:06:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.160+0000 7f34d3fff640 1 -- 172.21.15.5:0/1238162363 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f34ec15f260 con 0x7f34d806b4d0 2024-04-25T09:06:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T09:06:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34d806b4d0 msgr2=0x7f34d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34d806b4d0 0x7f34d806d990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f34ec149d10 tx=0x7f34dc009190 comp rx=0 tx=0).stop 2024-04-25T09:06:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 msgr2=0x7f34ec157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec157040 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f34e000e8a0 tx=0x7f34e000ed60 comp rx=0 tx=0).stop 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 shutdown_connections 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f34d806b4d0 0x7f34d806d990 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ec071b20 0x7f34ec158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f34ec156250 0x7f34ec158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 --2- 172.21.15.5:0/1238162363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec0b3860 0x7f34ec157040 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 >> 172.21.15.5:0/1238162363 conn(0x7f34ec0668f0 msgr2=0x7f34ec15a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 shutdown_connections 2024-04-25T09:06:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.161+0000 7f34f1b42640 1 -- 172.21.15.5:0/1238162363 wait complete. 2024-04-25T09:06:52.160 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T09:06:52.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:06:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.277+0000 7f203cfc8640 1 Processor -- start 2024-04-25T09:06:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.277+0000 7f203cfc8640 1 -- start start 2024-04-25T09:06:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f203cfc8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20380b4930 0x7f203806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f203cfc8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2038147a90 con 0x7f20381476b0 2024-04-25T09:06:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f203cfc8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380b4e60 con 0x7f2038070c90 2024-04-25T09:06:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f203cfc8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20380b3620 con 0x7f20380b4930 2024-04-25T09:06:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f203659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20381476b0 0x7f2038162130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35006/0 (socket says 172.21.15.5:35006) 2024-04-25T09:06:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f203659c640 1 -- 172.21.15.5:0/446256962 learned_addr learned my addr 172.21.15.5:0/446256962 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f202ffff640 1 --2- 172.21.15.5:0/446256962 >> v2:172.21.15.80:3300/0 conn(0x7f20380b4930 0x7f203806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302963947 0 0) 0x7f2038147a90 con 0x7f20381476b0 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2024003520 con 0x7f20381476b0 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881605983 0 0) 0x7f2024003520 con 0x7f20381476b0 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 >> v2:172.21.15.80:3300/0 conn(0x7f20380b4930 msgr2=0x7f203806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 --2- 172.21.15.5:0/446256962 >> v2:172.21.15.80:3300/0 conn(0x7f20380b4930 0x7f203806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 >> v1:172.21.15.80:6789/0 conn(0x7f2038070c90 legacy=0x7f20380ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20380ad9c0 con 0x7f20381476b0 2024-04-25T09:06:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f2028001670 con 0x7f20381476b0 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.278+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 >> v1:172.21.15.5:6789/0 conn(0x7f20381476b0 legacy=0x7f2038162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2035d9b640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240039b0 0x7f2024003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2035d9b640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20240043b0 0x7f2024004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2035d9b640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024005080 0x7f202400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b3620 con 0x7f20240043b0 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202400bfe0 con 0x7f2024005080 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202400c1e0 con 0x7f20240039b0 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f202ffff640 1 --2- 172.21.15.5:0/446256962 >> v2:172.21.15.80:3300/0 conn(0x7f20380b4930 0x7f203806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f202ffff640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20240043b0 0x7f2024004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2036d9d640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024005080 0x7f202400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f203659c640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240039b0 0x7f2024003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f202ffff640 1 -- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240039b0 msgr2=0x7f2024003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f202ffff640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240039b0 0x7f2024003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f202ffff640 1 -- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024005080 msgr2=0x7f202400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f202ffff640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024005080 0x7f202400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f202ffff640 1 -- 172.21.15.5:0/446256962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024003520 con 0x7f20240043b0 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.279+0000 7f2036d9d640 1 -- 172.21.15.5:0/446256962 reap_dead start 2024-04-25T09:06:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f202ffff640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20240043b0 0x7f2024004880 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f2020009c70 tx=0x7f2024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e14728e888a65f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020009840 con 0x7f20240043b0 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020004020 con 0x7f20240043b0 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f2035d9b640 1 -- 172.21.15.5:0/446256962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200043d0 con 0x7f20240043b0 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f203cfc8640 1 -- 172.21.15.5:0/446256962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20240043b0 msgr2=0x7f2024004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f203cfc8640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20240043b0 0x7f2024004880 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f2020009c70 tx=0x7f2024005830 comp rx=0 tx=0).stop 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f203cfc8640 1 -- 172.21.15.5:0/446256962 shutdown_connections 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f203cfc8640 1 --2- 172.21.15.5:0/446256962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20240043b0 0x7f2024004880 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f203cfc8640 1 -- 172.21.15.5:0/446256962 >> 172.21.15.5:0/446256962 conn(0x7f2038067170 msgr2=0x7f20380b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f203cfc8640 1 -- 172.21.15.5:0/446256962 shutdown_connections 2024-04-25T09:06:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.280+0000 7f203cfc8640 1 -- 172.21.15.5:0/446256962 wait complete. 2024-04-25T09:06:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.282+0000 7f203cfc8640 1 Processor -- start 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.282+0000 7f203cfc8640 1 -- start start 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.282+0000 7f203cfc8640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240043b0 0x7f20381f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.282+0000 7f203cfc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20380cdb00 0x7f20380cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f203cfc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f203813d420 0x7f203813d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f203cfc8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2038071100 con 0x7f20380cdb00 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f203cfc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380ae010 con 0x7f203813d420 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f203cfc8640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2038071280 con 0x7f20240043b0 2024-04-25T09:06:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20380cdb00 0x7f20380cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20380cdb00 0x7f20380cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39586/0 (socket says 172.21.15.5:39586) 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 -- 172.21.15.5:0/3861565109 learned_addr learned my addr 172.21.15.5:0/3861565109 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f203659c640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240043b0 0x7f20381f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 -- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240043b0 msgr2=0x7f20381f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f20240043b0 0x7f20381f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 -- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f203813d420 msgr2=0x7f203813d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f203813d420 0x7f203813d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 -- 172.21.15.5:0/3861565109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20381f83b0 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202ffff640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20380cdb00 0x7f20380cdf80 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f2020009c70 tx=0x7f2020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020040070 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020003610 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203813f410 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020006e10 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.283+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203813f9d0 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.284+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f203804ef20 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.285+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2020043070 con 0x7f20380cdb00 2024-04-25T09:06:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.285+0000 7f202effd640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201806b500 0x7f201806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.285+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f20200aa710 con 0x7f20380cdb00 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.285+0000 7f202effd640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7f20180713c0 0x7f20180737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.285+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 --> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2020039e50 con 0x7f20180713c0 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.285+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20200b1050 con 0x7f20380cdb00 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.285+0000 7f203659c640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201806b500 0x7f201806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.286+0000 7f2036d9d640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7f20180713c0 0x7f20180737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.286+0000 7f203659c640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201806b500 0x7f201806d9c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2028001050 tx=0x7f2028009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.286+0000 7f2036d9d640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7f20180713c0 0x7f20180737e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.287+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== osd.7 v2:172.21.15.80:6800/4179945280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2020039e50 con 0x7f20180713c0 2024-04-25T09:06:52.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.300+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 --> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f20380b33d0 con 0x7f20180713c0 2024-04-25T09:06:52.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f202effd640 1 -- 172.21.15.5:0/3861565109 <== osd.7 v2:172.21.15.80:6800/4179945280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f20380b33d0 con 0x7f20180713c0 2024-04-25T09:06:52.289 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-25T09:06:52.289 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:06:52.289 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-25T09:06:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7f20180713c0 msgr2=0x7f20180737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6800/4179945280,v1:172.21.15.80:6801/4179945280] conn(0x7f20180713c0 0x7f20180737e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201806b500 msgr2=0x7f201806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f201806b500 0x7f201806d9c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2028001050 tx=0x7f2028009040 comp rx=0 tx=0).stop 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20380cdb00 msgr2=0x7f20380cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 --2- 172.21.15.5:0/3861565109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20380cdb00 0x7f20380cdf80 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f2020009c70 tx=0x7f2020004730 comp rx=0 tx=0).stop 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f2036d9d640 1 -- 172.21.15.5:0/3861565109 reap_dead start 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 shutdown_connections 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 >> 172.21.15.5:0/3861565109 conn(0x7f2038067170 msgr2=0x7f20380b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 shutdown_connections 2024-04-25T09:06:52.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.302+0000 7f203cfc8640 1 -- 172.21.15.5:0/3861565109 wait complete. 2024-04-25T09:06:52.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T09:06:52.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.413+0000 7feb395e2640 1 Processor -- start 2024-04-25T09:06:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.413+0000 7feb395e2640 1 -- start start 2024-04-25T09:06:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb395e2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb340b2cc0 0x7feb340b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb395e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340d20e0 con 0x7feb340b7130 2024-04-25T09:06:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb395e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340d23c0 con 0x7feb3415de70 2024-04-25T09:06:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb395e2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb340d2a10 con 0x7feb340b2cc0 2024-04-25T09:06:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb337fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb340b7130 0x7feb340ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35010/0 (socket says 172.21.15.5:35010) 2024-04-25T09:06:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb337fe640 1 -- 172.21.15.5:0/13313793 learned_addr learned my addr 172.21.15.5:0/13313793 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb2bfff640 1 --2- 172.21.15.5:0/13313793 >> v2:172.21.15.80:3300/0 conn(0x7feb340b2cc0 0x7feb340b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692953048 0 0) 0x7feb340d20e0 con 0x7feb340b7130 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb20003520 con 0x7feb340b7130 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164576266 0 0) 0x7feb340d23c0 con 0x7feb3415de70 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb340d20e0 con 0x7feb3415de70 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 817191874 0 0) 0x7feb20003520 con 0x7feb340b7130 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb2bfff640 1 -- 172.21.15.5:0/13313793 >> v1:172.21.15.80:6789/0 conn(0x7feb3415de70 legacy=0x7feb340b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb2bfff640 1 -- 172.21.15.5:0/13313793 >> v1:172.21.15.5:6789/0 conn(0x7feb340b7130 legacy=0x7feb340ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.414+0000 7feb2bfff640 1 -- 172.21.15.5:0/13313793 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb340d26a0 con 0x7feb340b2cc0 2024-04-25T09:06:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.415+0000 7feb2bfff640 1 --2- 172.21.15.5:0/13313793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b2cc0 0x7feb340b6bf0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097d0 tx=0x7feb1c02a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01e5aadd133059 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.415+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 <== mon.1 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c037070 con 0x7feb340b2cc0 2024-04-25T09:06:52.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.415+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 <== mon.1 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c02ac90 con 0x7feb340b2cc0 2024-04-25T09:06:52.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.415+0000 7feb327fc640 1 -- 172.21.15.5:0/13313793 <== mon.1 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0019f0 con 0x7feb340b2cc0 2024-04-25T09:06:52.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.416+0000 7feb395e2640 1 -- 172.21.15.5:0/13313793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b2cc0 msgr2=0x7feb340b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.416+0000 7feb395e2640 1 --2- 172.21.15.5:0/13313793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b2cc0 0x7feb340b6bf0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097d0 tx=0x7feb1c02a200 comp rx=0 tx=0).stop 2024-04-25T09:06:52.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.416+0000 7feb395e2640 1 -- 172.21.15.5:0/13313793 shutdown_connections 2024-04-25T09:06:52.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.416+0000 7feb395e2640 1 --2- 172.21.15.5:0/13313793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b2cc0 0x7feb340b6bf0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.416+0000 7feb395e2640 1 -- 172.21.15.5:0/13313793 >> 172.21.15.5:0/13313793 conn(0x7feb3406b000 msgr2=0x7feb3406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.416+0000 7feb395e2640 1 -- 172.21.15.5:0/13313793 shutdown_connections 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.416+0000 7feb395e2640 1 -- 172.21.15.5:0/13313793 wait complete. 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.417+0000 7feb395e2640 1 Processor -- start 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.417+0000 7feb395e2640 1 -- start start 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb395e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb340b2cc0 0x7feb3415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb395e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b7130 0x7feb341f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb395e2640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb3415de70 0x7feb341f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb395e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb340d2ea0 con 0x7feb340b2cc0 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb395e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb340cf110 con 0x7feb340b7130 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb395e2640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb340d3020 con 0x7feb3415de70 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb340b2cc0 0x7feb3415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb340b2cc0 0x7feb3415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39600/0 (socket says 172.21.15.5:39600) 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 -- 172.21.15.5:0/2204464533 learned_addr learned my addr 172.21.15.5:0/2204464533 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb2bfff640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b7130 0x7feb341f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb337fe640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb3415de70 0x7feb341f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 -- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb3415de70 msgr2=0x7feb341f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb3415de70 0x7feb341f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 -- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b7130 msgr2=0x7feb341f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b7130 0x7feb341f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb32ffd640 1 -- 172.21.15.5:0/2204464533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb340cb9a0 con 0x7feb340b2cc0 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.418+0000 7feb337fe640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb3415de70 0x7feb341f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.419+0000 7feb32ffd640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb340b2cc0 0x7feb3415bf30 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c430 tx=0x7feb2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.419+0000 7feb2b7fe640 1 -- 172.21.15.5:0/2204464533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24017070 con 0x7feb340b2cc0 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.419+0000 7feb2b7fe640 1 -- 172.21.15.5:0/2204464533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb240052f0 con 0x7feb340b2cc0 2024-04-25T09:06:52.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.419+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb340aaa90 con 0x7feb340b2cc0 2024-04-25T09:06:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.419+0000 7feb2b7fe640 1 -- 172.21.15.5:0/2204464533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24003830 con 0x7feb340b2cc0 2024-04-25T09:06:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.419+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb340cbf20 con 0x7feb340b2cc0 2024-04-25T09:06:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.420+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3404ef20 con 0x7feb340b2cc0 2024-04-25T09:06:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.420+0000 7feb2b7fe640 1 -- 172.21.15.5:0/2204464533 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feb2401a070 con 0x7feb340b2cc0 2024-04-25T09:06:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.421+0000 7feb2b7fe640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb1406b4d0 0x7feb1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.421+0000 7feb2b7fe640 1 -- 172.21.15.5:0/2204464533 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb240893c0 con 0x7feb340b2cc0 2024-04-25T09:06:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.421+0000 7feb2bfff640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb1406b4d0 0x7feb1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.421+0000 7feb2bfff640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb1406b4d0 0x7feb1406d990 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feb1c034000 tx=0x7feb1c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.425+0000 7feb2b7fe640 1 -- 172.21.15.5:0/2204464533 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb240584c0 con 0x7feb340b2cc0 2024-04-25T09:06:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.604+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7feb3415c470 con 0x7feb1406b4d0 2024-04-25T09:06:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.604+0000 7feb2b7fe640 1 -- 172.21.15.5:0/2204464533 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feb1c03e460 con 0x7feb1406b4d0 2024-04-25T09:06:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T09:06:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb1406b4d0 msgr2=0x7feb1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb1406b4d0 0x7feb1406d990 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feb1c034000 tx=0x7feb1c02e000 comp rx=0 tx=0).stop 2024-04-25T09:06:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb340b2cc0 msgr2=0x7feb3415bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb340b2cc0 0x7feb3415bf30 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c430 tx=0x7feb2400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 shutdown_connections 2024-04-25T09:06:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7feb1406b4d0 0x7feb1406d990 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7feb3415de70 0x7feb341f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb340b7130 0x7feb341f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 --2- 172.21.15.5:0/2204464533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb340b2cc0 0x7feb3415bf30 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 >> 172.21.15.5:0/2204464533 conn(0x7feb3406b000 msgr2=0x7feb340b9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 shutdown_connections 2024-04-25T09:06:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.606+0000 7feb395e2640 1 -- 172.21.15.5:0/2204464533 wait complete. 2024-04-25T09:06:52.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.719+0000 7f79e7b09640 1 Processor -- start 2024-04-25T09:06:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.719+0000 7f79e7b09640 1 -- start start 2024-04-25T09:06:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e7b09640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e015f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e7b09640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79e015fd80 0x7f79e006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e7b09640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e015ef10 con 0x7f79e006adf0 2024-04-25T09:06:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e7b09640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00cfd60 con 0x7f79e015fd80 2024-04-25T09:06:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e7b09640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e015f480 con 0x7f79e00cea80 2024-04-25T09:06:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e58a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e50a4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79e015fd80 0x7f79e006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e60a6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f79e006adf0 0x7f79e00d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.5:48722/0 (socket says 172.21.15.5:48722) 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e58a5640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e015f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.5:40178/0 (socket says 172.21.15.5:40178) 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e50a4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79e015fd80 0x7f79e006b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.5:51644/0 (socket says 172.21.15.5:51644) 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.720+0000 7f79e60a6640 1 -- 172.21.15.5:0/474633817 learned_addr learned my addr 172.21.15.5:0/474633817 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.721+0000 7f79e58a5640 1 -- 172.21.15.5:0/474633817 >> v2:172.21.15.80:3300/0 conn(0x7f79e015fd80 msgr2=0x7f79e006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.721+0000 7f79e58a5640 1 --2- 172.21.15.5:0/474633817 >> v2:172.21.15.80:3300/0 conn(0x7f79e015fd80 0x7f79e006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.721+0000 7f79e58a5640 1 -- 172.21.15.5:0/474633817 >> v1:172.21.15.80:6789/0 conn(0x7f79e006adf0 legacy=0x7f79e00d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.721+0000 7f79e58a5640 1 -- 172.21.15.5:0/474633817 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e015f1a0 con 0x7f79e00cea80 2024-04-25T09:06:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.721+0000 7f79e48a3640 1 -- 172.21.15.5:0/474633817 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636756156 0 0) 0x7f79e015ef10 con 0x7f79e006adf0 2024-04-25T09:06:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.721+0000 7f79e50a4640 1 --2- 172.21.15.5:0/474633817 >> v2:172.21.15.80:3300/0 conn(0x7f79e015fd80 0x7f79e006b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.721+0000 7f79e58a5640 1 --2- 172.21.15.5:0/474633817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e015f840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0097a0 tx=0x7f79dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e5838eb2aa1b9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e48a3640 1 -- 172.21.15.5:0/474633817 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc037070 con 0x7f79e00cea80 2024-04-25T09:06:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e48a3640 1 -- 172.21.15.5:0/474633817 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc032440 con 0x7f79e00cea80 2024-04-25T09:06:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e48a3640 1 -- 172.21.15.5:0/474633817 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc032810 con 0x7f79e00cea80 2024-04-25T09:06:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 -- 172.21.15.5:0/474633817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 msgr2=0x7f79e015f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 --2- 172.21.15.5:0/474633817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e015f840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0097a0 tx=0x7f79dc02a180 comp rx=0 tx=0).stop 2024-04-25T09:06:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 -- 172.21.15.5:0/474633817 shutdown_connections 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 --2- 172.21.15.5:0/474633817 >> v2:172.21.15.80:3300/0 conn(0x7f79e015fd80 0x7f79e006b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 --2- 172.21.15.5:0/474633817 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e015f840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 -- 172.21.15.5:0/474633817 >> 172.21.15.5:0/474633817 conn(0x7f79e00d19f0 msgr2=0x7f79e00d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 -- 172.21.15.5:0/474633817 shutdown_connections 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.722+0000 7f79e7b09640 1 -- 172.21.15.5:0/474633817 wait complete. 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.723+0000 7f79e7b09640 1 Processor -- start 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.723+0000 7f79e7b09640 1 -- start start 2024-04-25T09:06:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e7b09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e006adf0 0x7f79e01e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e7b09640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e7b09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e00b2dd0 0x7f79e00b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e7b09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00d1660 con 0x7f79e006adf0 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e7b09640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00d0270 con 0x7f79e00b2dd0 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e7b09640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00d17e0 con 0x7f79e00cea80 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e58a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e006adf0 0x7f79e01e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e58a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e006adf0 0x7f79e01e86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39616/0 (socket says 172.21.15.5:39616) 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e58a5640 1 -- 172.21.15.5:0/3667328260 learned_addr learned my addr 172.21.15.5:0/3667328260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:06:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e50a4640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.724+0000 7f79e60a6640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e00b2dd0 0x7f79e00b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e58a5640 1 -- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 msgr2=0x7f79e0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e58a5640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e0159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e58a5640 1 -- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e00b2dd0 msgr2=0x7f79e00b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e58a5640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e00b2dd0 0x7f79e00b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e58a5640 1 -- 172.21.15.5:0/3667328260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00b58c0 con 0x7f79e006adf0 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e60a6640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e00b2dd0 0x7f79e00b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:52.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e58a5640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e006adf0 0x7f79e01e86e0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f79dc035040 tx=0x7f79dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79d67fc640 1 -- 172.21.15.5:0/3667328260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc037040 con 0x7f79e006adf0 2024-04-25T09:06:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79d67fc640 1 -- 172.21.15.5:0/3667328260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc030500 con 0x7f79e006adf0 2024-04-25T09:06:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e015a120 con 0x7f79e006adf0 2024-04-25T09:06:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79d67fc640 1 -- 172.21.15.5:0/3667328260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc030910 con 0x7f79e006adf0 2024-04-25T09:06:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.725+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00b5e20 con 0x7f79e006adf0 2024-04-25T09:06:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.726+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e004ef20 con 0x7f79e006adf0 2024-04-25T09:06:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.726+0000 7f79d67fc640 1 -- 172.21.15.5:0/3667328260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79dc044020 con 0x7f79e006adf0 2024-04-25T09:06:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.727+0000 7f79d67fc640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79c406b4d0 0x7f79c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.727+0000 7f79d67fc640 1 -- 172.21.15.5:0/3667328260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f79dc0aa110 con 0x7f79e006adf0 2024-04-25T09:06:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.727+0000 7f79e50a4640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79c406b4d0 0x7f79c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.728+0000 7f79e50a4640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79c406b4d0 0x7f79c406d990 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f79e01f7670 tx=0x7f79d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.731+0000 7f79d67fc640 1 -- 172.21.15.5:0/3667328260 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79e00b58c0 con 0x7f79e006adf0 2024-04-25T09:06:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.906+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79e00cefa0 con 0x7f79c406b4d0 2024-04-25T09:06:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.908+0000 7f79d67fc640 1 -- 172.21.15.5:0/3667328260 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13412 (secure 0 0 0) 0x7f79e00cefa0 con 0x7f79c406b4d0 2024-04-25T09:06:52.896 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:06:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:06:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.909+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79c406b4d0 msgr2=0x7f79c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.909+0000 7f79e7b09640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79c406b4d0 0x7f79c406d990 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f79e01f7670 tx=0x7f79d0008040 comp rx=0 tx=0).stop 2024-04-25T09:06:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.909+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e006adf0 msgr2=0x7f79e01e86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.909+0000 7f79e7b09640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e006adf0 0x7f79e01e86e0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f79dc035040 tx=0x7f79dc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 shutdown_connections 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f79c406b4d0 0x7f79c406d990 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e00b2dd0 0x7f79e00b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f79e00cea80 0x7f79e0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 --2- 172.21.15.5:0/3667328260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e006adf0 0x7f79e01e86e0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 >> 172.21.15.5:0/3667328260 conn(0x7f79e00d19f0 msgr2=0x7f79e015e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 shutdown_connections 2024-04-25T09:06:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:06:52.910+0000 7f79e7b09640 1 -- 172.21.15.5:0/3667328260 wait complete. 2024-04-25T09:06:52.908 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":447,"stamp":"2024-04-25T09:06:52.527444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":454804,"kb_used_data":15208,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754519916,"statfs":{"total":773094113280,"available":772628393984,"internally_reserved":0,"allocated":15572992,"data_stored":7462736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1073741824,"num_objects":-1024,"num_object_clones":0,"num_object_copies":-2048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1024,"num_write_kb":-1048576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-14,"num_bytes_recovered":-14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.895479"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":402,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.320738+0000","last_change":"2024-04-25T08:56:33.928556+0000","last_active":"2024-04-25T09:06:45.320738+0000","last_peered":"2024-04-25T09:06:45.320738+0000","last_clean":"2024-04-25T09:06:45.320738+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:06:45.320738+0000","last_undegraded":"2024-04-25T09:06:45.320738+0000","last_fullsized":"2024-04-25T09:06:45.320738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:32.432086+0000","last_clean_scrub_stamp":"2024-04-25T08:56:32.432086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:43.514913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59304,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55724,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316116,"statfs":{"total":96636764160,"available":96579702784,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:52.911 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T08:56:32.432086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=8, tm_min=56, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=6, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:06:52.911 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T09:07:12.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.039+0000 7f43de0a3640 1 Processor -- start 2024-04-25T09:07:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.039+0000 7f43de0a3640 1 -- start start 2024-04-25T09:07:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43de0a3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 0x7f43d80b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43de0a3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d80b3f30 con 0x7f43d815bbd0 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43de0a3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d815b0f0 con 0x7f43d80cfc90 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43de0a3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d815b3d0 con 0x7f43d8154f10 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43d6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f43d815bbd0 0x7f43d80cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50014/0 (socket says 172.21.15.5:50014) 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43d6ffd640 1 -- 172.21.15.5:0/1792217500 learned_addr learned my addr 172.21.15.5:0/1792217500 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43d77fe640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 0x7f43d80b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791661083 0 0) 0x7f43d80b3f30 con 0x7f43d815bbd0 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.040+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c0003520 con 0x7f43d815bbd0 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 <== mon.1 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363303934 0 0) 0x7f43d815b0f0 con 0x7f43d80cfc90 2024-04-25T09:07:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d80b3f30 con 0x7f43d80cfc90 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2868553081 0 0) 0x7f43c0003520 con 0x7f43d815bbd0 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 msgr2=0x7f43d80b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 0x7f43d80b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 >> v1:172.21.15.80:6789/0 conn(0x7f43d80cfc90 legacy=0x7f43d8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d81552f0 con 0x7f43d815bbd0 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402414645 0 0) 0x7f43cc001670 con 0x7f43d815bbd0 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d77fe640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 0x7f43d80b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 >> v1:172.21.15.5:6789/0 conn(0x7f43d815bbd0 legacy=0x7f43d80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43c0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43c0004800 0x7f43c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 0x7f43c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d815b3d0 con 0x7f43c0003b70 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c000baa0 con 0x7f43c0004800 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c000bca0 con 0x7f43d8154f10 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d77fe640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43c0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d6ffd640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43c0004800 0x7f43c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d7fff640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 0x7f43c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d77fe640 1 -- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 msgr2=0x7f43c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d77fe640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d8154f10 0x7f43c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d77fe640 1 -- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43c0004800 msgr2=0x7f43c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d77fe640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43c0004800 0x7f43c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.041+0000 7f43d77fe640 1 -- 172.21.15.5:0/1792217500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0003520 con 0x7f43c0003b70 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.042+0000 7f43d77fe640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43c0003f70 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009c60 tx=0x7f43c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44550a2244c5a084 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.042+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8036070 con 0x7f43c0003b70 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.042+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c8031400 con 0x7f43c0003b70 2024-04-25T09:07:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.042+0000 7f43d67fc640 1 -- 172.21.15.5:0/1792217500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8009860 con 0x7f43c0003b70 2024-04-25T09:07:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.043+0000 7f43de0a3640 1 -- 172.21.15.5:0/1792217500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 msgr2=0x7f43c0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.043+0000 7f43de0a3640 1 --2- 172.21.15.5:0/1792217500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43c0003f70 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009c60 tx=0x7f43c0005830 comp rx=0 tx=0).stop 2024-04-25T09:07:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.043+0000 7f43d7fff640 1 -- 172.21.15.5:0/1792217500 reap_dead start 2024-04-25T09:07:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.043+0000 7f43de0a3640 1 -- 172.21.15.5:0/1792217500 shutdown_connections 2024-04-25T09:07:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.043+0000 7f43de0a3640 1 -- 172.21.15.5:0/1792217500 >> 172.21.15.5:0/1792217500 conn(0x7f43d80668f0 msgr2=0x7f43d8066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.043+0000 7f43de0a3640 1 -- 172.21.15.5:0/1792217500 shutdown_connections 2024-04-25T09:07:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.043+0000 7f43de0a3640 1 -- 172.21.15.5:0/1792217500 wait complete. 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.044+0000 7f43de0a3640 1 Processor -- start 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.044+0000 7f43de0a3640 1 -- start start 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43de0a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43d81423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43de0a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43d814fee0 0x7f43d81517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43de0a3640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d81599b0 0x7f43d8159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43de0a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d80717e0 con 0x7f43c0003b70 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43de0a3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d8071660 con 0x7f43d814fee0 2024-04-25T09:07:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43de0a3640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d8071960 con 0x7f43d81599b0 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43d81423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43d81423c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47904/0 (socket says 172.21.15.5:47904) 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43d77fe640 1 -- 172.21.15.5:0/519346830 learned_addr learned my addr 172.21.15.5:0/519346830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43d7fff640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d81599b0 0x7f43d8159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.045+0000 7f43d6ffd640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43d814fee0 0x7f43d81517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43d77fe640 1 -- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d81599b0 msgr2=0x7f43d8159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43d77fe640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d81599b0 0x7f43d8159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43d77fe640 1 -- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43d814fee0 msgr2=0x7f43d81517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43d77fe640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43d814fee0 0x7f43d81517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43d77fe640 1 -- 172.21.15.5:0/519346830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d814bb20 con 0x7f43c0003b70 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43d6ffd640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43d814fee0 0x7f43d81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43d77fe640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43d81423c0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009c60 tx=0x7f43c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43bffff640 1 -- 172.21.15.5:0/519346830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8041020 con 0x7f43c0003b70 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43bffff640 1 -- 172.21.15.5:0/519346830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80093e0 con 0x7f43c0003b70 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d81503c0 con 0x7f43c0003b70 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43bffff640 1 -- 172.21.15.5:0/519346830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8036040 con 0x7f43c0003b70 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.046+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d8150980 con 0x7f43c0003b70 2024-04-25T09:07:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.047+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d804ef20 con 0x7f43c0003b70 2024-04-25T09:07:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.048+0000 7f43bffff640 1 -- 172.21.15.5:0/519346830 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43c8044020 con 0x7f43c0003b70 2024-04-25T09:07:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.048+0000 7f43bffff640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43c406b500 0x7f43c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.048+0000 7f43bffff640 1 -- 172.21.15.5:0/519346830 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f43c80aa360 con 0x7f43c0003b70 2024-04-25T09:07:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.048+0000 7f43d6ffd640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43c406b500 0x7f43c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.049+0000 7f43d6ffd640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43c406b500 0x7f43c406d9c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f43d80ce620 tx=0x7f43cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.052+0000 7f43bffff640 1 -- 172.21.15.5:0/519346830 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43c804b070 con 0x7f43c0003b70 2024-04-25T09:07:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.234+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 --> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43d8070d30 con 0x7f43c406b500 2024-04-25T09:07:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.235+0000 7f43bffff640 1 -- 172.21.15.5:0/519346830 <== mgr.4106 v2:172.21.15.80:6832/353132559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13379 (secure 0 0 0) 0x7f43d8070d30 con 0x7f43c406b500 2024-04-25T09:07:13.223 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:07:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-25T09:07:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43c406b500 msgr2=0x7f43c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43c406b500 0x7f43c406d9c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f43d80ce620 tx=0x7f43cc009040 comp rx=0 tx=0).stop 2024-04-25T09:07:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 msgr2=0x7f43d81423c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43d81423c0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009c60 tx=0x7f43c8004730 comp rx=0 tx=0).stop 2024-04-25T09:07:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 shutdown_connections 2024-04-25T09:07:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f43c406b500 0x7f43c406d9c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f43d81599b0 0x7f43d8159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43d814fee0 0x7f43d81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 --2- 172.21.15.5:0/519346830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43c0003b70 0x7f43d81423c0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 >> 172.21.15.5:0/519346830 conn(0x7f43d80668f0 msgr2=0x7f43d80cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 shutdown_connections 2024-04-25T09:07:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.237+0000 7f43de0a3640 1 -- 172.21.15.5:0/519346830 wait complete. 2024-04-25T09:07:13.236 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":457,"stamp":"2024-04-25T09:07:12.531728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":454796,"kb_used_data":15208,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754519924,"statfs":{"total":773094113280,"available":772628402176,"internally_reserved":0,"allocated":15572992,"data_stored":7462736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002357"},"pg_stats":[{"pgid":"1.0","version":"143'119","reported_seq":413,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T09:06:52.961496+0000","last_change":"2024-04-25T09:06:52.961533+0000","last_active":"2024-04-25T09:06:52.961496+0000","last_peered":"2024-04-25T09:06:52.961496+0000","last_clean":"2024-04-25T09:06:52.961496+0000","last_became_active":"2024-04-25T08:56:33.927677+0000","last_became_peered":"2024-04-25T08:56:33.927677+0000","last_unstale":"2024-04-25T09:06:52.961496+0000","last_undegraded":"2024-04-25T09:06:52.961496+0000","last_fullsized":"2024-04-25T09:06:52.961496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'119","last_scrub_stamp":"2024-04-25T09:06:52.961411+0000","last_deep_scrub":"143'119","last_deep_scrub_stamp":"2024-04-25T09:06:52.961411+0000","last_clean_scrub_stamp":"2024-04-25T09:06:52.961411+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:58.690620+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59880,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311960,"statfs":{"total":96636764160,"available":96575447040,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59304,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59308,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":785250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55720,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316120,"statfs":{"total":96636764160,"available":96579706880,"internally_reserved":0,"allocated":2392064,"data_stored":1375618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:13.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T09:07:13.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.349+0000 7fd528f02640 1 Processor -- start 2024-04-25T09:07:13.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.349+0000 7fd528f02640 1 -- start start 2024-04-25T09:07:13.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd528f02640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5240cefe0 0x7fd524168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd528f02640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524162150 con 0x7fd52415df10 2024-04-25T09:07:13.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd528f02640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524162430 con 0x7fd5240b6250 2024-04-25T09:07:13.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd528f02640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5240d20d0 con 0x7fd5240cefe0 2024-04-25T09:07:13.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd522d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5240cefe0 0x7fd524168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd52259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd52415df10 0x7fd5241618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50020/0 (socket says 172.21.15.5:50020) 2024-04-25T09:07:13.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd52259c640 1 -- 172.21.15.5:0/3971949980 learned_addr learned my addr 172.21.15.5:0/3971949980 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:07:13.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.350+0000 7fd522d9d640 1 -- 172.21.15.5:0/3971949980 >> v1:172.21.15.80:6789/0 conn(0x7fd5240b6250 legacy=0x7fd5240ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:13.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.351+0000 7fd522d9d640 1 -- 172.21.15.5:0/3971949980 >> v1:172.21.15.5:6789/0 conn(0x7fd52415df10 legacy=0x7fd5241618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.351+0000 7fd522d9d640 1 -- 172.21.15.5:0/3971949980 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524162710 con 0x7fd5240cefe0 2024-04-25T09:07:13.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.351+0000 7fd52159a640 1 -- 172.21.15.5:0/3971949980 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558803814 0 0) 0x7fd524162150 con 0x7fd52415df10 2024-04-25T09:07:13.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.351+0000 7fd522d9d640 1 --2- 172.21.15.5:0/3971949980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240cefe0 0x7fd524168c40 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fd514009d90 tx=0x7fd51402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10482ac722c084e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.351+0000 7fd52159a640 1 -- 172.21.15.5:0/3971949980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514007740 con 0x7fd5240cefe0 2024-04-25T09:07:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.351+0000 7fd52159a640 1 -- 172.21.15.5:0/3971949980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5140078e0 con 0x7fd5240cefe0 2024-04-25T09:07:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.351+0000 7fd52159a640 1 -- 172.21.15.5:0/3971949980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514007cb0 con 0x7fd5240cefe0 2024-04-25T09:07:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.352+0000 7fd528f02640 1 -- 172.21.15.5:0/3971949980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240cefe0 msgr2=0x7fd524168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.352+0000 7fd528f02640 1 --2- 172.21.15.5:0/3971949980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240cefe0 0x7fd524168c40 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fd514009d90 tx=0x7fd51402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.352+0000 7fd528f02640 1 -- 172.21.15.5:0/3971949980 shutdown_connections 2024-04-25T09:07:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.352+0000 7fd528f02640 1 --2- 172.21.15.5:0/3971949980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240cefe0 0x7fd524168c40 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.352+0000 7fd528f02640 1 -- 172.21.15.5:0/3971949980 >> 172.21.15.5:0/3971949980 conn(0x7fd5240668f0 msgr2=0x7fd524066d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:13.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.352+0000 7fd528f02640 1 -- 172.21.15.5:0/3971949980 shutdown_connections 2024-04-25T09:07:13.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.352+0000 7fd528f02640 1 -- 172.21.15.5:0/3971949980 wait complete. 2024-04-25T09:07:13.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.353+0000 7fd528f02640 1 Processor -- start 2024-04-25T09:07:13.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.353+0000 7fd528f02640 1 -- start start 2024-04-25T09:07:13.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd528f02640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240b6250 0x7fd52415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd528f02640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5240cefe0 0x7fd52415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd528f02640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd52415df10 0x7fd52415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd528f02640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240d36f0 con 0x7fd5240b6250 2024-04-25T09:07:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd528f02640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240d3570 con 0x7fd5240cefe0 2024-04-25T09:07:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd528f02640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240d3870 con 0x7fd52415df10 2024-04-25T09:07:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240b6250 0x7fd52415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240b6250 0x7fd52415ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47922/0 (socket says 172.21.15.5:47922) 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 -- 172.21.15.5:0/1722241681 learned_addr learned my addr 172.21.15.5:0/1722241681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd521d9b640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5240cefe0 0x7fd52415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd522d9d640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd52415df10 0x7fd52415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 -- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd52415df10 msgr2=0x7fd52415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd52415df10 0x7fd52415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 -- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5240cefe0 msgr2=0x7fd52415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5240cefe0 0x7fd52415e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.354+0000 7fd52259c640 1 -- 172.21.15.5:0/1722241681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52415b570 con 0x7fd5240b6250 2024-04-25T09:07:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.355+0000 7fd52259c640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240b6250 0x7fd52415ac50 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c460 tx=0x7fd51c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.355+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c018070 con 0x7fd5240b6250 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.355+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c007500 con 0x7fd5240b6250 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.355+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52415b850 con 0x7fd5240b6250 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.355+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c004a20 con 0x7fd5240b6250 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.355+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52415be10 con 0x7fd5240b6250 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.356+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52404ef20 con 0x7fd5240b6250 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.356+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd51c01b070 con 0x7fd5240b6250 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.357+0000 7fd512ffd640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd50406b4d0 0x7fd50406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.357+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd51c089140 con 0x7fd5240b6250 2024-04-25T09:07:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.357+0000 7fd521d9b640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd50406b4d0 0x7fd50406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.357+0000 7fd521d9b640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd50406b4d0 0x7fd50406d990 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd5241f77d0 tx=0x7fd518009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.361+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd51c058350 con 0x7fd5240b6250 2024-04-25T09:07:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.542+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd5240b3340 con 0x7fd5240b6250 2024-04-25T09:07:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.545+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v28)=0 v28) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd51c057c50 con 0x7fd5240b6250 2024-04-25T09:07:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.546+0000 7fd512ffd640 1 -- 172.21.15.5:0/1722241681 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd51c05bda0 con 0x7fd5240b6250 2024-04-25T09:07:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd50406b4d0 msgr2=0x7fd50406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd50406b4d0 0x7fd50406d990 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd5241f77d0 tx=0x7fd518009040 comp rx=0 tx=0).stop 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240b6250 msgr2=0x7fd52415ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240b6250 0x7fd52415ac50 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c460 tx=0x7fd51c00c920 comp rx=0 tx=0).stop 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 shutdown_connections 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7fd50406b4d0 0x7fd50406d990 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd52415df10 0x7fd52415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5240cefe0 0x7fd52415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 --2- 172.21.15.5:0/1722241681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5240b6250 0x7fd52415ac50 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 >> 172.21.15.5:0/1722241681 conn(0x7fd5240668f0 msgr2=0x7fd5240b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 shutdown_connections 2024-04-25T09:07:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.548+0000 7fd528f02640 1 -- 172.21.15.5:0/1722241681 wait complete. 2024-04-25T09:07:13.547 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:07:13.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.660+0000 7f2ae3b7e640 1 Processor -- start 2024-04-25T09:07:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.660+0000 7f2ae3b7e640 1 -- start start 2024-04-25T09:07:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.661+0000 7f2ae3b7e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2adc0c6930 0x7f2adc0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.661+0000 7f2ae3b7e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0c5440 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.661+0000 7f2ae3b7e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0cff70 con 0x7f2adc15f280 2024-04-25T09:07:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.661+0000 7f2ae3b7e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc15f660 con 0x7f2adc0c6930 2024-04-25T09:07:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.661+0000 7f2ae211b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2adc0c6930 0x7f2adc0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.661+0000 7f2ae1119640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2adc0ce9f0 0x7f2adc0cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50034/0 (socket says 172.21.15.5:50034) 2024-04-25T09:07:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.661+0000 7f2ae1119640 1 -- 172.21.15.5:0/2104330115 learned_addr learned my addr 172.21.15.5:0/2104330115 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-25T09:07:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.662+0000 7f2ae211b640 1 -- 172.21.15.5:0/2104330115 >> v1:172.21.15.80:6789/0 conn(0x7f2adc15f280 legacy=0x7f2adc0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.662+0000 7f2ae211b640 1 -- 172.21.15.5:0/2104330115 >> v1:172.21.15.5:6789/0 conn(0x7f2adc0ce9f0 legacy=0x7f2adc0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.662+0000 7f2ae0918640 1 -- 172.21.15.5:0/2104330115 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460144148 0 0) 0x7f2adc0c5440 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.662+0000 7f2ae211b640 1 -- 172.21.15.5:0/2104330115 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0d0230 con 0x7f2adc0c6930 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.662+0000 7f2ae211b640 1 --2- 172.21.15.5:0/2104330115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0c6930 0x7f2adc0ccc10 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009d90 tx=0x7f2acc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2c3595e23486d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae0918640 1 -- 172.21.15.5:0/2104330115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc007740 con 0x7f2adc0c6930 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae0918640 1 -- 172.21.15.5:0/2104330115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2acc0078e0 con 0x7f2adc0c6930 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae0918640 1 -- 172.21.15.5:0/2104330115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc007cd0 con 0x7f2adc0c6930 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/2104330115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0c6930 msgr2=0x7f2adc0ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/2104330115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0c6930 0x7f2adc0ccc10 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009d90 tx=0x7f2acc02a660 comp rx=0 tx=0).stop 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/2104330115 shutdown_connections 2024-04-25T09:07:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/2104330115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0c6930 0x7f2adc0ccc10 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/2104330115 >> 172.21.15.5:0/2104330115 conn(0x7f2adc0d18f0 msgr2=0x7f2adc0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/2104330115 shutdown_connections 2024-04-25T09:07:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.663+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/2104330115 wait complete. 2024-04-25T09:07:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.664+0000 7f2ae3b7e640 1 Processor -- start 2024-04-25T09:07:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.664+0000 7f2ae3b7e640 1 -- start start 2024-04-25T09:07:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae3b7e640 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2adc0c6930 0x7f2adc14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae3b7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0ce9f0 0x7f2adc15df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae3b7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2adc15f280 0x7f2adc15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae3b7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0cf190 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae3b7e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0d07f0 con 0x7f2adc15f280 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae3b7e640 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0d2480 con 0x7f2adc0c6930 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae1119640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0ce9f0 0x7f2adc15df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae1119640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0ce9f0 0x7f2adc15df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47940/0 (socket says 172.21.15.5:47940) 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae1119640 1 -- 172.21.15.5:0/4232286147 learned_addr learned my addr 172.21.15.5:0/4232286147 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.665+0000 7f2ae191a640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2adc0c6930 0x7f2adc14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae211b640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2adc15f280 0x7f2adc15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae1119640 1 -- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2adc0c6930 msgr2=0x7f2adc14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae1119640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2adc0c6930 0x7f2adc14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae1119640 1 -- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2adc15f280 msgr2=0x7f2adc15d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae1119640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2adc15f280 0x7f2adc15d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae1119640 1 -- 172.21.15.5:0/4232286147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0b4510 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae191a640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2adc0c6930 0x7f2adc14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae1119640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0ce9f0 0x7f2adc15df70 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c4a0 tx=0x7f2ad000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ada7fc640 1 -- 172.21.15.5:0/4232286147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0018070 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ada7fc640 1 -- 172.21.15.5:0/4232286147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2ad00074e0 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0b47b0 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ada7fc640 1 -- 172.21.15.5:0/4232286147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0004a40 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.666+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc0b4d70 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.667+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc04ef20 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.668+0000 7f2ada7fc640 1 -- 172.21.15.5:0/4232286147 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ad001b070 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.668+0000 7f2ada7fc640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ac806b4d0 0x7f2ac806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.668+0000 7f2ada7fc640 1 -- 172.21.15.5:0/4232286147 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ad00892c0 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.668+0000 7f2ae191a640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ac806b4d0 0x7f2ac806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.669+0000 7f2ae191a640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ac806b4d0 0x7f2ac806d990 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007fd0 tx=0x7f2ad4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.672+0000 7f2ada7fc640 1 -- 172.21.15.5:0/4232286147 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ad00583b0 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.889+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2adc0c8250 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.890+0000 7f2ada7fc640 1 -- 172.21.15.5:0/4232286147 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+3690 (secure 0 0 0) 0x7f2ad0057cb0 con 0x7f2adc0ce9f0 2024-04-25T09:07:13.878 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-25T09:07:13.879 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":94,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/761919900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":761919900},{"type":"v1","addr":"172.21.15.80:6837","nonce":761919900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":7565,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1288684552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1288684552},{"type":"v1","addr":"172.21.15.5:6835","nonce":1288684552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94},{"gid":8422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3263983484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3263983484},{"type":"v1","addr":"172.21.15.80:6836","nonce":3263983484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":9903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1350587801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1350587801},{"type":"v1","addr":"172.21.15.5:6833","nonce":1350587801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[]} 2024-04-25T09:07:13.879 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 94 2024-04-25T09:07:13.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ac806b4d0 msgr2=0x7f2ac806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ac806b4d0 0x7f2ac806d990 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007fd0 tx=0x7f2ad4009040 comp rx=0 tx=0).stop 2024-04-25T09:07:13.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0ce9f0 msgr2=0x7f2adc15df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:13.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0ce9f0 0x7f2adc15df70 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c4a0 tx=0x7f2ad000c960 comp rx=0 tx=0).stop 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 shutdown_connections 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:6832/353132559,v1:172.21.15.80:6833/353132559] conn(0x7f2ac806b4d0 0x7f2ac806d990 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2adc15f280 0x7f2adc15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2adc0ce9f0 0x7f2adc15df70 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 --2- 172.21.15.5:0/4232286147 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f2adc0c6930 0x7f2adc14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 >> 172.21.15.5:0/4232286147 conn(0x7f2adc0d18f0 msgr2=0x7f2adc0c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 shutdown_connections 2024-04-25T09:07:13.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-25T09:07:13.892+0000 7f2ae3b7e640 1 -- 172.21.15.5:0/4232286147 wait complete. 2024-04-25T09:07:13.893 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T09:07:13.894 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T09:07:13.894 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:07:13.894 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:13.903 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:07:13.903 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:07:13.903 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:13.952 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:07:13.952 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:07:13.952 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:13.963 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:07:13.964 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:07:13.964 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.015 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:07:14.015 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T09:07:14.015 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T09:07:14.015 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.048 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T09:07:14.049 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T09:07:14.049 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.118 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T09:07:14.118 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T09:07:14.119 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.196 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T09:07:14.196 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T09:07:14.196 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.265 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T09:07:14.266 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T09:07:14.266 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.305 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T09:07:14.306 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T09:07:14.306 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.377 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T09:07:14.378 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T09:07:14.378 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.449 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T09:07:14.449 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T09:07:14.449 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.522 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T09:07:14.522 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T09:07:14.523 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T09:07:14.523 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.548 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T09:07:14.548 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T09:07:14.548 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.591 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T09:07:14.591 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T09:07:14.592 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T09:07:14.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.603 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T09:07:14.603 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T09:07:14.603 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.643 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T09:07:14.644 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T09:07:14.644 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:14.695 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T09:07:14.695 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T09:07:14.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-04-25T09:07:14.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:07:14.727 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T09:07:14.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:07:14.958 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T09:07:15.043 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:07:15.043 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T09:07:15.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:07:15.098 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T09:07:15.157 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T09:07:15.157 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T09:07:15.300 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T09:07:15.300 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T09:07:15.377 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T09:07:15.378 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T09:07:15.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T09:07:15.455 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T09:07:15.513 INFO:tasks.ceph:Archiving mon data... 2024-04-25T09:07:15.514 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/data/mon.a.tgz 2024-04-25T09:07:15.514 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-04-25T09:07:15.530 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.TqR0FiZSc6 2024-04-25T09:07:15.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TqR0FiZSc6 2024-04-25T09:07:15.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.TqR0FiZSc6 2024-04-25T09:07:15.781 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.TqR0FiZSc6 is 420KB 2024-04-25T09:07:15.879 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.TqR0FiZSc6 2024-04-25T09:07:15.894 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/data/mon.b.tgz 2024-04-25T09:07:15.894 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-04-25T09:07:15.912 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.z1DAiHD3Gq 2024-04-25T09:07:15.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.z1DAiHD3Gq 2024-04-25T09:07:16.067 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.z1DAiHD3Gq 2024-04-25T09:07:16.150 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.z1DAiHD3Gq is 422KB 2024-04-25T09:07:16.246 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.z1DAiHD3Gq 2024-04-25T09:07:16.261 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/data/mon.c.tgz 2024-04-25T09:07:16.261 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-04-25T09:07:16.315 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.H4CfuvTx4s 2024-04-25T09:07:16.315 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.H4CfuvTx4s 2024-04-25T09:07:16.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.H4CfuvTx4s 2024-04-25T09:07:16.534 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.H4CfuvTx4s is 422KB 2024-04-25T09:07:16.631 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.H4CfuvTx4s 2024-04-25T09:07:16.645 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T09:07:16.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:07:16.648 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:07:16.730 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:07:16.763 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:07:16.763 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T09:07:16.765 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/remote/smithi005/crash 2024-04-25T09:07:16.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:07:16.796 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/remote/smithi080/crash 2024-04-25T09:07:16.797 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:07:16.826 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T09:07:16.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:16.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:16.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:16.931 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:16.969 INFO:tasks.ceph:Compressing logs... 2024-04-25T09:07:16.970 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:07:16.974 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:07:16.997 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64898.log 2024-04-25T09:07:16.997 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28336.log 2024-04-25T09:07:16.997 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54202.log 2024-04-25T09:07:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34528.log 2024-04-25T09:07:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34652.log 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34528.log: /var/log/ceph/ceph-client.admin.34652.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34528.log.gz 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34652.log.gz 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34819.log 2024-04-25T09:07:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34819.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.4.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34819.log.gz 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41297.log 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mon.c.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.3.41297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41297.log.gz 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34739.log: 93.7% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-04-25T09:07:17.064 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34608.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34779.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40905.log 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34568.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34699.log 2024-04-25T09:07:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.1.40905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40905.log.gz 2024-04-25T09:07:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T09:07:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34699.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34699.log.gz 2024-04-25T09:07:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T09:07:17.088 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T09:07:17.192 INFO:teuthology.orchestra.run.smithi080.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T09:07:17.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.28336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93971.log 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64898.log.gz -- replaced with /var/log/ceph/ceph.tmp-client.admin.28336.log.gz 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63611.log 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59075.log 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54202.log: /var/log/ceph/ceph-client.admin.93971.log: /var/log/ceph/ceph-client.admin.63611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98046.log 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93971.log.gz 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63611.log.gz 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81850.log 2024-04-25T09:07:17.287 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54202.log.gz 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78005.log 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81850.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98046.log.gz 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63906.log 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59075.log.gz 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81850.log.gz 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82879.log 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55119.log 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78005.log.gz 2024-04-25T09:07:17.288 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63906.log.gz 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87662.log 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55119.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82879.log.gz 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61359.log 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87662.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55119.log.gz 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60112.log 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87662.log.gz 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97448.log 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61359.log.gz 2024-04-25T09:07:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64728.log 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60112.log.gz 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.97448.log: /var/log/ceph/ceph-client.admin.62253.log 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89711.log 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97448.log.gz 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62253.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64728.log.gz 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76783.log 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89711.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62253.log.gz 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88801.log 2024-04-25T09:07:17.290 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89711.log.gz 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87998.log 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58433.log 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.76783.log.gz 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.87998.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63405.log 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88801.log.gz 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98509.log 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87998.log.gz 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2024-04-25T09:07:17.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98509.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63405.log.gz 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44392.log 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58433.log.gz 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84095.log 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98509.log.gz 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89024.log 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44392.log.gz 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84053.log 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84095.log.gz 2024-04-25T09:07:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76717.log 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78047.log 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84053.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89024.log.gz 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74342.log 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84053.log.gz 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44671.log 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74342.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.76717.log.gz 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78047.log.gz -5 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40828.log 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74342.log.gz 2024-04-25T09:07:17.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81337.log 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97115.log 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44671.log.gz 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64135.log 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40828.log.gz 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97115.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.88889.log -- replaced with /var/log/ceph/ceph-client.admin.81337.log.gz 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64135.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97115.log.gz 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47224.log 2024-04-25T09:07:17.294 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64135.log.gz 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46747.log 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92590.log 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88889.log.gz 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87077.log 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47224.log.gz 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46747.log.gz 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62211.log 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87077.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92590.log.gz 2024-04-25T09:07:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59430.log 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62211.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87077.log.gz 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41343.log 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91635.log 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62211.log.gz 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59430.log.gz 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86627.log 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78686.log 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41343.log.gz 2024-04-25T09:07:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86627.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91635.log.gz 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65461.log 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89753.log 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65461.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.86627.log.gz 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.78686.log.gz -5 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.77332.log 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65461.log.gz 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41006.log 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77332.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.89753.log.gz 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60808.log 2024-04-25T09:07:17.297 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41006.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77332.log.gz 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58822.log 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41006.log.gz 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81976.log 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40260.log 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60808.log.gz 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44755.log 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81976.log.gz 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58925.log 2024-04-25T09:07:17.298 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58822.log.gz 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44755.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.98089.log -- replaced with /var/log/ceph/ceph-client.admin.40260.log.gz 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93748.log 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44755.log.gz 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97868.log 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93748.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.98089.log.gz 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.58925.log.gz -- 2024-04-25T09:07:17.299 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.78812.log 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97868.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93748.log.gz 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97868.log.gz 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41676.log 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78812.log.gz 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59598.log 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44140.log: /var/log/ceph/ceph-client.admin.41676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60605.log 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79022.log 87.8% 2024-04-25T09:07:17.300 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41676.log.gz 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59598.log.gz 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88250.log 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79022.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60605.log.gz 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63184.log 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.79022.log.gz 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82197.log 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88250.log.gz 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92107.log 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91719.log 2024-04-25T09:07:17.301 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82197.log.gz 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63696.log 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63184.log.gz 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92107.log.gz 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88471.log 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46325.log 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91719.log.gz 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88471.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.63696.log.gz 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.88166.log 2024-04-25T09:07:17.302 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88471.log.gz 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40092.log 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54691.log 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46325.log.gz 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40092.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.88166.log.gz -5 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46245.log 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40092.log.gz 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78387.log 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54691.log.gz 2024-04-25T09:07:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93664.log 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78387.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.46245.log.gz 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.79064.log 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78387.log.gz 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56704.log 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56512.log 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93664.log.gz 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56704.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79064.log.gz 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63497.log 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56704.log.gz 2024-04-25T09:07:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61527.log 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56512.log: /var/log/ceph/ceph-client.admin.63497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62750.log 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56512.log.gz 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61527.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63497.log.gz 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62750.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61527.log.gz 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93281.log 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82281.log 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62750.log.gz 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81892.log 2024-04-25T09:07:17.305 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93281.log.gz 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73517.log 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93155.log 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.82281.log.gz 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73517.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.81892.log.gz -- 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.57159.log 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73517.log.gz 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84137.log 2024-04-25T09:07:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81548.log 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93155.log.gz 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84137.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57159.log.gz 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74552.log 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84137.log.gz 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62902.log 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74552.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81548.log.gz 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73181.log 2024-04-25T09:07:17.307 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74552.log.gz 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89110.log 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62902.log.gz 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74174.log 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.89152.log 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73181.log.gz 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89110.log: /var/log/ceph/ceph-client.admin.74174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83969.log 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89110.log.gz 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74174.log.gz 2024-04-25T09:07:17.308 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.89152.log: /var/log/ceph/ceph-client.admin.91593.log 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89152.log.gz 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45859.log 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83969.log.gz 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62169.log 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log/var/log/ceph/ceph-client.admin.45859.log: 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91593.log.gz 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94201.log 87.6% 2024-04-25T09:07:17.309 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45859.log.gz 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62169.log.gz 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94201.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz --verbose 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.58648.log 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43678.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94201.log.gz 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82669.log 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58648.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46495.log 2024-04-25T09:07:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82669.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58648.log.gz 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45397.log 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46495.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.82669.log.gz 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59472.log 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45397.log: gzip 88.5% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46495.log.gz /var/log/ceph/ceph-osd.2.log 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45397.log.gz 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74973.log 2024-04-25T09:07:17.311 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59472.log.gz 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61317.log 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.74973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86477.log 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74973.log.gz 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61317.log.gz 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86693.log 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92548.log 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86477.log.gz 2024-04-25T09:07:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86693.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83843.log 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86693.log.gz 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82501.log 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92548.log.gz 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92065.log 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83005.log 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83843.log.gz 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92065.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82501.log.gz 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58499.log 2024-04-25T09:07:17.313 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92065.log.gz 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58367.log 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74786.log 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83005.log.gz 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97681.log 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74786.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58499.log.gz 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92632.log 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.74786.log.gz 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77094.log 2024-04-25T09:07:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97681.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58367.log.gz 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87914.log 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97681.log.gz 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77094.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92632.log.gz 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40348.log 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77094.log.gz 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83515.log 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40348.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87914.log.gz 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78644.log 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83515.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.93887.log 2024-04-25T09:07:17.315 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40348.log.gz 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78644.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83515.log.gz 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78644.log.gz 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44224.log 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93887.log.gz 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83801.log 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88633.log 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44224.log.gz 2024-04-25T09:07:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41345.log 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41000.log 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83801.log.gz 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41345.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88633.log.gz 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47182.log 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41345.log.gz 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76849.log 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78514.log 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41000.log.gz 2024-04-25T09:07:17.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76849.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88040.log 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.76849.log.gz 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88040.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78514.log.gz 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62353.log 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72229.log 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88040.log.gz 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43930.log: /var/log/ceph/ceph-client.admin.62353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59986.log 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2024-04-25T09:07:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92412.log 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62353.log.gz 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98341.log 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59986.log.gz 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.72229.log.gz 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92286.log 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92412.log: /var/log/ceph/ceph-client.admin.98341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40744.log 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92412.log.gz 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98341.log.gz 2024-04-25T09:07:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84179.log 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92286.log: /var/log/ceph/ceph-client.admin.40744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92286.log.gz 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72541.log 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40744.log.gz 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.84179.log.gz 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2024-04-25T09:07:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73055.log 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72541.log.gz 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45733.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59818.log 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81055.log 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73055.log: /var/log/ceph/ceph-client.admin.59818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86393.log 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73055.log.gz 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59818.log.gz 2024-04-25T09:07:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81055.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64854.log 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.81055.log.gz 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86393.log.gz 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45439.log 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60426.log 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64854.log: /var/log/ceph/ceph-client.admin.45439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61065.log 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64854.log.gz 2024-04-25T09:07:17.322 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45439.log.gz 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96395.log 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62085.log 88.3% 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60426.log.gz 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61065.log: /var/log/ceph/ceph-client.admin.96395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77584.log 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61065.log.gz 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86993.log 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.96395.log.gz 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62085.log.gz 2024-04-25T09:07:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77921.log 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77584.log.gz 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86993.log.gz 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94580.log 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61149.log 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44959.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77921.log.gz 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58209.log 2024-04-25T09:07:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.94580.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94580.log.gz 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61149.log.gz 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98299.log 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83759.log 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58209.log.gz 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82837.log 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98299.log.gz 2024-04-25T09:07:17.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93418.log 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74384.log 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83759.log.gz 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82837.log.gz 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76957.log 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93418.log.gz 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62836.log 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74384.log.gz 2024-04-25T09:07:17.326 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76957.log.gz 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92506.log 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77626.log 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62836.log: /var/log/ceph/ceph-client.admin.92506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57477.log 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92506.log.gz 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74636.log 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62836.log.gz 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59776.log 2024-04-25T09:07:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77626.log.gz 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59860.log 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59776.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74636.log.gz 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.57477.log.gz -5 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.77878.log 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59776.log.gz 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45235.log 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77878.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.59860.log.gz 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.88982.log 2024-04-25T09:07:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86951.log 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77878.log.gz 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45235.log.gz 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87358.log 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88982.log.gz 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74072.log 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73942.log 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86951.log.gz 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74072.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87358.log.gz 2024-04-25T09:07:17.329 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74258.log 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74072.log.gz 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40618.log 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92149.log 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73942.log.gz 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40618.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74258.log.gz 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55172.log 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40618.log.gz 2024-04-25T09:07:17.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64303.log 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65041.log 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92149.log.gz 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46928.log 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55172.log.gz 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64303.log.gz 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74300.log 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65041.log.gz 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53986.log 2024-04-25T09:07:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86735.log 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46928.log.gz 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53986.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74300.log.gz 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45649.log 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62794.log 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45649.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53986.log.gz 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86735.log.gz 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98593.log 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45649.log.gz 2024-04-25T09:07:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72761.log 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62794.log.gz 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56596.log 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72761.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98593.log.gz 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76651.log 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54859.log 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72761.log.gz 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76651.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56596.log.gz 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97918.log 2024-04-25T09:07:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54859.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54859.log.gz 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97031.log 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.76651.log.gz 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97918.log.gz 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45481.log 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97031.log.gz 2024-04-25T09:07:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56176.log 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74114.log 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45481.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89068.log 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45481.log.gz 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56176.log.gz 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41678.log 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74114.log.gz 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43636.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89068.log.gz 2024-04-25T09:07:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94015.log 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41678.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59207.log 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41678.log.gz 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98257.log 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94015.log.gz 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78131.log 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59207.log: /var/log/ceph/ceph-client.admin.98257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88940.log 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59207.log.gz 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78131.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98257.log.gz 2024-04-25T09:07:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63780.log 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88940.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78131.log.gz 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56132.log 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63780.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88940.log.gz 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97158.log 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63780.log.gz 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86777.log 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56132.log.gz 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91949.log 2024-04-25T09:07:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97158.log: /var/log/ceph/ceph-client.admin.86777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82795.log 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97158.log.gz 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63738.log 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91949.log.gz 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54429.log 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.86777.log.gz 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40432.log 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.82795.log.gz 2024-04-25T09:07:17.338 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63738.log: /var/log/ceph/ceph-client.admin.54429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56554.log 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63738.log.gz 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40432.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54429.log.gz 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97322.log 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40432.log.gz 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40660.log 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56554.log: /var/log/ceph/ceph-client.admin.97322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73097.log 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56554.log.gz 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97322.log.gz 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76915.log 2024-04-25T09:07:17.339 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40660.log.gz 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73097.log: /var/log/ceph/ceph-client.admin.76915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78600.log 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73097.log.gz 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76915.log.gz 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81295.log 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65653.log 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78600.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47098.log 2024-04-25T09:07:17.340 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78600.log.gz 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81295.log.gz 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64429.log 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47098.log: gzip -5 87.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.65653.log.gz /var/log/ceph/ceph-client.admin.55806.log 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47098.log.gz 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88334.log 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65377.log 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55806.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64429.log.gz 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 88.1% 2024-04-25T09:07:17.341 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55806.log.gz 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59315.log 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88334.log.gz/var/log/ceph/ceph-client.admin.65377.log: 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45902.log 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65377.log.gz 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57287.log 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59315.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45902.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.59315.log.gz 2024-04-25T09:07:17.342 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40134.log 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9%/var/log/ceph/ceph-client.admin.57287.log: -- replaced with /var/log/ceph/ceph-client.admin.45902.log.gz 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57287.log.gz 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58143.log 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92328.log 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40134.log: /var/log/ceph/ceph-client.admin.58143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65209.log 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40134.log.gz 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58143.log.gz 2024-04-25T09:07:17.343 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92328.log.gz 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63654.log 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65209.log: /var/log/ceph/ceph-client.admin.45001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62127.log 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65209.log.gz 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83885.log 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63654.log: /var/log/ceph/ceph-client.admin.62127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88292.log 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63654.log.gz 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58991.log 2024-04-25T09:07:17.344 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62127.log.gz 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41342.log 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83885.log.gz 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58991.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88292.log.gz 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60384.log 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41342.log.gz 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58991.log.gz 2024-04-25T09:07:17.345 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60384.log: gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60384.log.gz 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.82239.log 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83131.log 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73559.log 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83131.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82239.log.gz 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91803.log 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83131.log.gz 2024-04-25T09:07:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73559.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73559.log.gz 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82627.log 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81742.log 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82627.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91803.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82627.log.gz 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81742.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.81742.log.gz 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64812.log 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83348.log 2024-04-25T09:07:17.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64812.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47476.log 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64812.log.gz 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83348.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83348.log.gz 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97200.log 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41009.log 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62469.log 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.47476.log.gz 2024-04-25T09:07:17.348 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97200.log.gz 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41009.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41009.log.gz 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56090.log 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39830.log 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56090.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62469.log.gz 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64261.log 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56090.log.gz 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39830.log.gz 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T09:07:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40304.log 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91865.log 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64261.log.gz 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54817.log 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98215.log 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40304.log.gz 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91865.log: gzip/var/log/ceph/ceph-client.admin.54817.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.93509.log 2024-04-25T09:07:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98215.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54817.log.gz 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91865.log.gz 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.98215.log.gz 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73815.log 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46663.log 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93509.log.gz 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63362.log 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73815.log.gz 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87788.log 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46663.log.gz 2024-04-25T09:07:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78938.log 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63362.log: /var/log/ceph/ceph-client.admin.87788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47350.log 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78938.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63362.log.gz 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87788.log.gz 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78938.log.gz -5 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57031.log 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34674.log 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47350.log: /var/log/ceph/ceph-client.admin.57031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41331.log 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34674.log: 88.6% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47350.log.gz 2024-04-25T09:07:17.352 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57031.log.gz 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34674.log.gz 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55764.log 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57734.log 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41331.log: /var/log/ceph/ceph-client.admin.55764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59249.log 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41331.log.gz 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57734.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55764.log.gz 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57734.log.gz 2024-04-25T09:07:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87578.log 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41681.log 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93029.log 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87578.log.gz 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59249.log.gz 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64770.log 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60766.log 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41681.log.gz 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64770.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93029.log.gz 2024-04-25T09:07:17.354 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64770.log.gz 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42646.log 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45043.log 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42646.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60766.log.gz 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92244.log 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42646.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58743.log 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45043.log: /var/log/ceph/ceph-client.admin.92244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43422.log 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58743.log: 88.2% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45043.log.gz 2024-04-25T09:07:17.355 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92244.log.gz 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.58743.log.gz /var/log/ceph/ceph-client.admin.77668.log 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87221.log 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.43422.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.77668.log: /var/log/ceph/ceph-client.admin.83173.log 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43422.log.gz 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4%/var/log/ceph/ceph-client.admin.87221.log: -- replaced with /var/log/ceph/ceph-client.admin.77668.log.gz 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78471.log 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83173.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87221.log.gz 2024-04-25T09:07:17.356 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83173.log.gz 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94159.log 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.78471.log: -- /var/log/ceph/ceph-client.admin.47392.log 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94159.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78471.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43888.log 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94159.log.gz 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96300.log 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47392.log: /var/log/ceph/ceph-client.admin.43888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42046.log 2024-04-25T09:07:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96300.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47392.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43888.log.gz 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87620.log 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96300.log.gz 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87316.log 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42046.log.gz 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87620.log: /var/log/ceph/ceph-client.admin.47056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63864.log 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87316.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87620.log.gz 2024-04-25T09:07:17.358 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87316.log.gz 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.92978.log 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54387.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63864.log.gz 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93580.log 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92978.log.gz 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54387.log.gz 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40702.log 2024-04-25T09:07:17.359 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93580.log.gz 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58305.log 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77374.log 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41346.log 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58305.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40702.log.gz 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77374.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58305.log.gz 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77374.log.gz 2024-04-25T09:07:17.360 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.81632.log 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61275.log 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41346.log.gz/var/log/ceph/ceph-client.admin.81632.log: 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96862.log 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81632.log.gz/var/log/ceph/ceph-client.admin.61275.log: 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60468.log 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61275.log.gz 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40218.log 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74720.log 2024-04-25T09:07:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60468.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96862.log.gz 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40218.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60468.log.gz 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40218.log.gz 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.96641.log 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54268.log 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54513.log 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.74720.log.gz 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96641.log.gz 2024-04-25T09:07:17.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83089.log 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64387.log 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54513.log: 91.0%/var/log/ceph/ceph-client.admin.83089.log: -- replaced with /var/log/ceph/ceph-client.admin.54268.log.gz 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54513.log.gz 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83089.log.gz 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93706.log 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64524.log 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64387.log: /var/log/ceph/ceph-client.admin.93706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65840.log 2024-04-25T09:07:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64524.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64387.log.gz 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93706.log.gz 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61191.log 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64524.log.gz 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83268.log 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.65840.log: /var/log/ceph/ceph-client.admin.61191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46886.log 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65840.log.gz 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83268.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57837.log 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61191.log.gz 2024-04-25T09:07:17.364 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83268.log.gz 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56260.log 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46886.log: /var/log/ceph/ceph-client.admin.57837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45193.log 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46886.log.gz 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98004.log 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56260.log.gz 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57837.log.gzgzip 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54118.log 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45193.log: /var/log/ceph/ceph-client.admin.98004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98553.log 2024-04-25T09:07:17.365 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5%/var/log/ceph/ceph-client.admin.54118.log: -- replaced with /var/log/ceph/ceph-client.admin.45193.log.gz 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98004.log.gz 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72583.log 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57221.log 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8%/var/log/ceph/ceph-client.admin.98553.log: -- replaced with /var/log/ceph/ceph-client.admin.54118.log.gz 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56428.log 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98553.log.gz 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72583.log.gz 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2024-04-25T09:07:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60299.log 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56428.log: 91.0%/var/log/ceph/ceph-client.admin.44434.log: -- replaced with /var/log/ceph/ceph-client.admin.57221.log.gz 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56428.log.gz 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43594.log 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89633.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60299.log.gz 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43594.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43594.log.gz 2024-04-25T09:07:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.89633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.89633.log.gz 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47308.log 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96258.log 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97826.log 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96258.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96258.log.gz 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81808.log 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97826.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97826.log.gz 2024-04-25T09:07:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73307.log 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60257.log 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81808.log.gz 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65503.log 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60257.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73307.log.gz 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60257.log.gz 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61023.log 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94057.log 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65503.log.gz 2024-04-25T09:07:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57415.log 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94057.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61023.log.gz 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94057.log.gz 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55382.log 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56302.log 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57415.log.gz 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83927.log 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56302.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55382.log.gz 2024-04-25T09:07:17.370 INFO:teuthology.orchestra.run.smithi005.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56302.log.gz 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93792.log 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72163.log 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83927.log.gz 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41340.log 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72163.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93792.log.gz 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72163.log.gz 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77178.log 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34793.log 2024-04-25T09:07:17.371 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41340.log.gz 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82543.log 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34793.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77178.log.gz 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34793.log.gz 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59734.log 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46705.log 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82543.log.gz 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72499.log 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46705.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59734.log.gz 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46705.log.gz 2024-04-25T09:07:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93323.log 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98383.log 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72499.log.gz 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82113.log 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9%/var/log/ceph/ceph-client.admin.98383.log: -- replaced with /var/log/ceph/ceph-client.admin.93323.log.gz 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98383.log.gz 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44917.log 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78429.log 2024-04-25T09:07:17.373 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82113.log.gz 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44917.log.gz 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78429.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78429.log.gz 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57093.log 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82018.log 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62330.log 2024-04-25T09:07:17.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82018.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82018.log.gz 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57093.log.gz 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93622.log 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72379.log 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62330.log.gz 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54052.log 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72379.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93622.log.gz 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72379.log.gz 2024-04-25T09:07:17.375 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84432.log 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92800.log 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.84432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.84432.log.gz 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54052.log.gz 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92020.log 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83557.log 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92800.log.gz 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62468.log 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83557.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92020.log.gz 2024-04-25T09:07:17.376 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83557.log.gz 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78854.log 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79172.log 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62468.log.gz 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79172.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78854.log.gz 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79172.log.gz 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54649.log 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42990.log 2024-04-25T09:07:17.377 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59944.log 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54649.log.gz 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.42990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42990.log.gz 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60979.log 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54985.log 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59944.log.gz/var/log/ceph/ceph-client.admin.60979.log: 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 88.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.78770.log 2024-04-25T09:07:17.378 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60979.log.gz 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63450.log 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54985.log: /var/log/ceph/ceph-client.admin.78770.log: 88.3% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54985.log.gz 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78770.log.gz 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88208.log 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40516.log 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63450.log: /var/log/ceph/ceph-client.admin.88208.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63450.log.gz 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.88208.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2024-04-25T09:07:17.379 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73433.log 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40516.log: /var/log/ceph/ceph-client.admin.42340.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40516.log.gz 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55891.log 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73433.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73433.log.gz 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96599.log 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92926.log 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55891.log: /var/log/ceph/ceph-client.admin.96599.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55891.log.gz 2024-04-25T09:07:17.380 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96599.log.gz 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73265.log 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65167.log 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73265.log: /var/log/ceph/ceph-client.admin.92926.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92926.log.gz 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73265.log.gz 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55340.log 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74678.log 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65167.log: /var/log/ceph/ceph-client.admin.55340.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65167.log.gz 2024-04-25T09:07:17.381 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55340.log.gzgzip 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55027.log 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46367.log 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74678.log: /var/log/ceph/ceph-client.admin.55027.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74678.log.gz 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98467.log 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55027.log.gz 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77752.log 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98467.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46367.log.gz 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98467.log.gz 2024-04-25T09:07:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56030.log 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77752.log: /var/log/ceph/ceph-client.admin.56030.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77752.log.gz 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94327.log 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56030.log.gz 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78089.log 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46165.log: /var/log/ceph/ceph-client.admin.94327.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.94327.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97765.log 2024-04-25T09:07:17.383 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94243.log 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78089.log: /var/log/ceph/ceph-client.admin.97765.log: 87.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97765.log.gz 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78089.log.gz 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73984.log 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94243.log.gz 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81590.log 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73984.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-04-25T09:07:17.384 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73984.log.gz 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86435.log 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65125.log 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81590.log: /var/log/ceph/ceph-client.admin.86435.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.81590.log.gz 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86435.log.gz 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81187.log 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97723.log 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81187.log: /var/log/ceph/ceph-client.admin.65125.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65125.log.gz 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.81187.log.gz 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94393.log 2024-04-25T09:07:17.385 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40176.log 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97723.log.gz 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60893.log 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40176.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.94393.log.gz 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40176.log.gz 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73734.log 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82711.log 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73734.log: /var/log/ceph/ceph-client.admin.60893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60893.log.gz 2024-04-25T09:07:17.386 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73734.log.gz 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89446.log 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88759.log 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82711.log: /var/log/ceph/ceph-client.admin.89446.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82711.log.gz 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89446.log.gz 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91907.log 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88759.log: /var/log/ceph/ceph-client.admin.44629.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88759.log.gz 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61233.log 2024-04-25T09:07:17.387 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56638.log 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61233.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91907.log.gz 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61233.log.gz 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46409.log 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41675.log 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56638.log: /var/log/ceph/ceph-client.admin.46409.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46409.log.gz 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56638.log.gz 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60070.log 2024-04-25T09:07:17.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94285.log 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41675.log.gz 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60070.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60070.log.gz 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.89338.log 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72313.log 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94285.log: /var/log/ceph/ceph-client.admin.89338.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94285.log.gz 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55722.log 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89338.log.gz/var/log/ceph/ceph-client.admin.72313.log: 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97364.log 2024-04-25T09:07:17.389 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.72313.log.gz 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77963.log 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97364.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55722.log.gz 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97364.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40390.log 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87872.log 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40390.log: /var/log/ceph/ceph-client.admin.77963.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40390.log.gz 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77963.log.gz 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55214.log 2024-04-25T09:07:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56891.log 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87872.log.gz 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60850.log 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.56891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56891.log.gz 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55214.log.gz 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91761.log 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73391.log 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60850.log.gz 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78306.log 2024-04-25T09:07:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73391.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91761.log.gz 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73391.log.gz 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64999.log 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78306.log.gz 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77220.log 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64999.log.gz 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2024-04-25T09:07:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55256.log 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43804.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77220.log.gz 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82585.log 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61653.log 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82585.log: /var/log/ceph/ceph-client.admin.55256.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55256.log.gz 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82585.log.gz 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41001.log 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60935.log 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61653.log: /var/log/ceph/ceph-client.admin.41001.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41001.log.gz 2024-04-25T09:07:17.393 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61653.log.gz 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45996.log 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65587.log 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60935.log.gz 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92842.log 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4%/var/log/ceph/ceph-client.admin.65587.log: -- replaced with /var/log/ceph/ceph-client.admin.45996.log.gz 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65587.log.gz 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79106.log 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86561.log 2024-04-25T09:07:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92842.log: /var/log/ceph/ceph-client.admin.79106.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92842.log.gz 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60028.log 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86561.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79106.log.gz 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.86561.log.gz 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89380.log 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72097.log 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89380.log: /var/log/ceph/ceph-client.admin.60028.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60028.log.gz 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.89380.log.gz 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73223.log 2024-04-25T09:07:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64686.log 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73223.log: /var/log/ceph/ceph-client.admin.72097.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73223.log.gz 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72097.log.gz 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47729.log 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64686.log: /var/log/ceph/ceph-client.admin.42466.log: 89.0% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64686.log.gz 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60510.log 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64092.log 2024-04-25T09:07:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.47729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47729.log.gz 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88571.log 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64092.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60510.log.gz 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64092.log.gz 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84011.log 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54471.log 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88571.log: /var/log/ceph/ceph-client.admin.84011.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88571.log.gz 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84011.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56344.log 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54471.log: /var/log/ceph/ceph-client.admin.56344.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54471.log.gz 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 87.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.89278.log 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56344.log.gz 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96353.log 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42214.log: /var/log/ceph/ceph-client.admin.89278.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89278.log.gz 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54943.log 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74468.log 2024-04-25T09:07:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96353.log: /var/log/ceph/ceph-client.admin.54943.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96353.log.gz 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54943.log.gz 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86177.log 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74468.log.gz 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44182.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.86177.log.gz 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45607.log 2024-04-25T09:07:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84245.log 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93929.log 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84245.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45607.log.gz 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84245.log.gz 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55298.log 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.93929.log: -- /var/log/ceph/ceph-client.admin.86843.log 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93929.log.gz 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77052.log 2024-04-25T09:07:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86843.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55298.log.gz 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 90.7% -- replaced with /var/log/ceph/ceph-client.admin.86843.log.gz 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63822.log 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88082.log 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77052.log: /var/log/ceph/ceph-client.admin.63822.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77052.log.gz 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81121.log 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3%/var/log/ceph/ceph-client.admin.88082.log: -- replaced with /var/log/ceph/ceph-client.admin.63822.log.gz 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88082.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93071.log 2024-04-25T09:07:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43720.log: /var/log/ceph/ceph-client.admin.81121.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.81121.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61443.log 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93071.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93071.log.gz 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47807.log 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34410.log 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61443.log: /var/log/ceph/ceph-client.admin.47807.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61443.log.gz 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93239.log 2024-04-25T09:07:17.402 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47807.log.gz/var/log/ceph/ceph-client.admin.34410.log: 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34410.log.gz 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59141.log 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94117.log 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93239.log: /var/log/ceph/ceph-client.admin.59141.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93239.log.gz 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97406.log 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94117.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59141.log.gz 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94117.log.gz 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43846.log 2024-04-25T09:07:17.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86111.log 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97406.log.gz 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74216.log 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86111.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43846.log.gz 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65251.log 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.86111.log.gz 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54901.log 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65251.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74216.log.gz 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65251.log.gz 2024-04-25T09:07:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82375.log 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54901.log: /var/log/ceph/ceph-client.admin.42298.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54901.log.gz 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92758.log 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96820.log 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82375.log.gz 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98173.log 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96820.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92758.log.gz 2024-04-25T09:07:17.405 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96820.log.gz 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96515.log 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45151.log 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98173.log: /var/log/ceph/ceph-client.admin.96515.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98173.log.gz 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96515.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82459.log 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82963.log 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82459.log: /var/log/ceph/ceph-client.admin.45151.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45151.log.gz 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82459.log.gz 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55935.log 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41679.log 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82963.log.gz 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46081.log 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41679.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55935.log.gz 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41679.log.gz 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87484.log 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46081.log: -- /var/log/ceph/ceph-client.admin.41542.log 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46081.log.gz 2024-04-25T09:07:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45947.log 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41542.log: 87.7% 87.0% -- replaced with /var/log/ceph/ceph-client.admin.87484.log.gz -- replaced with /var/log/ceph/ceph-client.admin.41542.log.gz 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59556.log 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45691.log 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45947.log.gz 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88376.log 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45691.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59556.log.gz 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45691.log.gz 2024-04-25T09:07:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93197.log 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72971.log 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93197.log: /var/log/ceph/ceph-client.admin.88376.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88376.log.gz 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93197.log.gz 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98425.log 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58565.log 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72971.log: /var/log/ceph/ceph-client.admin.98425.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72971.log.gz 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98425.log.gz 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81934.log 2024-04-25T09:07:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57349.log 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58565.log: /var/log/ceph/ceph-client.admin.81934.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81934.log.gz 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.58565.log.gz 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40786.log 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88124.log 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40786.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57349.log.gz 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40786.log.gz 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39926.log 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88124.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88124.log.gz 2024-04-25T09:07:17.410 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.0.63089.log 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98635.log 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39926.log: /var/log/ceph/ceph-client.0.63089.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39926.log.gz 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63089.log.gz 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55466.log 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47014.log 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98635.log.gz 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60162.log 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47014.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55466.log.gz 2024-04-25T09:07:17.411 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86309.log 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60162.log: /var/log/ceph/ceph-client.admin.86309.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60162.log.gz 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45523.log 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86309.log.gz 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96683.log 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43552.log: /var/log/ceph/ceph-client.admin.45523.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45523.log.gz 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-04-25T09:07:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56386.log 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77458.log 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96683.log.gz 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55641.log 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77458.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56386.log.gz 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77458.log.gz 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63990.log 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97960.log 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55641.log: /var/log/ceph/ceph-client.admin.63990.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55641.log.gz 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63990.log.gzgzip 2024-04-25T09:07:17.413 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40474.log 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44875.log 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40474.log: /var/log/ceph/ceph-client.admin.97960.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40474.log.gz 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97960.log.gz 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62466.log 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57969.log 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44875.log.gz/var/log/ceph/ceph-client.admin.62466.log: 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64942.log 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57969.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62466.log.gz 2024-04-25T09:07:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87442.log 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57969.log.gz 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55069.log 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87442.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64942.log.gz 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87442.log.gz 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72625.log 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78728.log 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7%/var/log/ceph/ceph-client.admin.72625.log: -- replaced with /var/log/ceph/ceph-client.admin.55069.log.gz 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83431.log 2024-04-25T09:07:17.415 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72625.log.gz/var/log/ceph/ceph-client.admin.78728.log: 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78728.log.gz 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96947.log 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89236.log 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83431.log.gz 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62626.log 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89236.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96947.log.gz 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89236.log.gz 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87704.log 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78980.log 2024-04-25T09:07:17.416 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62626.log.gz 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61569.log 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78980.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87704.log.gz 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78980.log.gz 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56218.log 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56470.log 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61569.log: /var/log/ceph/ceph-client.admin.56218.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61569.log.gz 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56218.log.gz 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58035.log 2024-04-25T09:07:17.417 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88845.log 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58035.log: /var/log/ceph/ceph-client.admin.56470.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56470.log.gz 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78556.log 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58035.log.gz 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87400.log 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78556.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88845.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78556.log.gz 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72803.log 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55979.log 2024-04-25T09:07:17.418 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87400.log.gz 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43121.log 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55979.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72803.log.gz 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55979.log.gz 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58869.log 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64032.log 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58869.log: /var/log/ceph/ceph-client.admin.43121.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43121.log.gz 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.58869.log.gz 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65918.log 2024-04-25T09:07:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97639.log 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64032.log: /var/log/ceph/ceph-client.admin.65918.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64032.log.gz 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65918.log.gz 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41005.log 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86243.log 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41005.log: /var/log/ceph/ceph-client.admin.97639.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97639.log.gz 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41005.log.gz 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65293.log 2024-04-25T09:07:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87956.log 2024-04-25T09:07:17.421 INFO:teuthology.orchestra.run.smithi080.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T09:07:17.460 INFO:teuthology.orchestra.run.smithi080.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T09:07:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86243.log: /var/log/ceph/ceph-client.admin.65293.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65293.log.gz 2024-04-25T09:07:17.478 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.86243.log.gz 2024-04-25T09:07:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77794.log 2024-04-25T09:07:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87956.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87956.log.gz 2024-04-25T09:07:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77542.log 2024-04-25T09:07:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46970.log 2024-04-25T09:07:17.478 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77794.log.gz 2024-04-25T09:07:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82921.log 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46970.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77542.log.gz 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46970.log.gz 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81253.log 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57781.log 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82921.log.gz 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81253.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46621.log 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81253.log.gz 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40049.log 2024-04-25T09:07:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57781.log: /var/log/ceph/ceph-client.admin.46621.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46621.log.gz 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.57781.log.gz 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44056.log 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77136.log 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40049.log: /var/log/ceph/ceph-client.admin.44056.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40049.log.gz 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44056.log.gz 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73475.log 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89194.log 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77136.log: /var/log/ceph/ceph-client.admin.73475.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77136.log.gz 2024-04-25T09:07:17.480 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73475.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41338.log 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97270.log 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89194.log: /var/log/ceph/ceph-client.admin.41338.log: 88.0% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89194.log.gz 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41338.log.gz 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74426.log 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97270.log: /var/log/ceph/ceph-client.admin.43972.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97270.log.gz 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2024-04-25T09:07:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65545.log 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77416.log 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74426.log: /var/log/ceph/ceph-client.admin.65545.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74426.log.gz 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65545.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54733.log 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74510.log 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77416.log: /var/log/ceph/ceph-client.admin.54733.log: 87.4% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77416.log.gz 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54733.log.gz 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86351.log 2024-04-25T09:07:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45319.log 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74510.log: /var/log/ceph/ceph-client.admin.86351.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74510.log.gz 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86351.log.gz 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62467.log 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83473.log 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45319.log: /var/log/ceph/ceph-client.admin.62467.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45319.log.gz 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62467.log.gz 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T09:07:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83473.log: /var/log/ceph/ceph-client.admin.46453.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83473.log.gz 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41002.log 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78896.log 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.41002.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41002.log.gz 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59692.log 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78896.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78896.log.gz 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93113.log 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59692.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59692.log.gz 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2024-04-25T09:07:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93113.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93113.log.gz 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81379.log 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46835.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74028.log 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81379.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81379.log.gz 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61485.log 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74028.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74028.log.gz 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44476.log 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61485.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61485.log.gz 2024-04-25T09:07:17.485 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57903.log 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44476.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44476.log.gz 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60685.log 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57903.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57903.log.gz 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64345.log 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60685.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60685.log.gz 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44797.log 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64345.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64345.log.gz 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79359.log 2024-04-25T09:07:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44797.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44797.log.gz 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42172.log 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.79359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.79359.log.gz 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86519.log 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42172.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42172.log.gz 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96557.log 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86519.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86519.log.gz 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47266.log 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96557.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96557.log.gz 2024-04-25T09:07:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47266.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47266.log.gz 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73349.log 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42508.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91527.log 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73349.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73349.log.gz 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64219.log 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91527.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.91527.log.gz 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92370.log 2024-04-25T09:07:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64219.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64219.log.gz 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82155.log 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92370.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92370.log.gz 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73139.log 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82155.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82155.log.gz 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55424.log 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73139.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73139.log.gz 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55424.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55424.log.gz 2024-04-25T09:07:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72845.log 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42256.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72845.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72845.log.gz 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63948.log 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46038.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59514.log 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63948.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63948.log.gz 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82753.log 2024-04-25T09:07:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59514.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59514.log.gz 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59902.log 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82753.log.gz 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92884.log 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59902.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59902.log.gz 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41680.log 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92884.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92884.log.gz 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45277.log 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41680.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41680.log.gz 2024-04-25T09:07:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61107.log 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45277.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45277.log.gz 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87746.log 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61107.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61107.log.gz 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61924.log 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87746.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87746.log.gz 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96905.log 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.61924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61924.log.gz 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65083.log 2024-04-25T09:07:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96905.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96905.log.gz 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72929.log 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65083.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65083.log.gz 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45817.log 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72929.log.gz 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45817.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45817.log.gz 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39749.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2024-04-25T09:07:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40007.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72667.log 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45565.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57560.log 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72667.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72667.log.gz 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61401.log 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57560.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57560.log.gz 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96989.log 2024-04-25T09:07:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61401.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61401.log.gz 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83717.log 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96989.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96989.log.gz 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54775.log 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83717.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83717.log.gz 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61611.log 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54775.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54775.log.gz 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91677.log 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61611.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61611.log.gz 2024-04-25T09:07:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58101.log 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91677.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91677.log.gz 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87179.log 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58101.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58101.log.gz 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41004.log 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87179.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87179.log.gz 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41010.log 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41004.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41004.log.gz 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54555.log 2024-04-25T09:07:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41010.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41010.log.gz 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83047.log 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54555.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54555.log.gz 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64177.log 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83047.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83047.log.gz 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64177.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64177.log.gz 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87830.log 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45775.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-04-25T09:07:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87830.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87830.log.gz 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44713.log 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41920.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77836.log 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44713.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44713.log.gz 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97073.log 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77836.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77836.log.gz 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87035.log 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97073.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97073.log.gz 2024-04-25T09:07:17.498 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81464.log 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87035.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87035.log.gz 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77500.log 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81464.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81464.log.gz 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62708.log 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77500.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77500.log.gz 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83672.log 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62708.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62708.log.gz 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82417.log 2024-04-25T09:07:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83672.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83672.log.gz 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60341.log 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82417.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.82417.log.gz 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73013.log 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60341.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60341.log.gz 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73654.log 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73013.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73013.log.gz 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92674.log 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73654.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73654.log.gz 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41878.log 2024-04-25T09:07:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92674.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92674.log.gz 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98131.log 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41878.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41878.log.gz 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65335.log 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.98131.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.98131.log.gz 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46579.log 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65335.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65335.log.gz 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88675.log 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46579.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46579.log.gz 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63320.log 2024-04-25T09:07:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88675.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88675.log.gz 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88717.log 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63320.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63320.log.gz 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93836.log 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88717.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88717.log.gz 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86909.log 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93836.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93836.log.gz 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55561.log 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86909.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86909.log.gz 2024-04-25T09:07:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40576.log 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55561.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55561.log.gz 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40576.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73857.log 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42004.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64604.log 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73857.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73857.log.gz 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55849.log 2024-04-25T09:07:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64604.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64604.log.gz 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87119.log 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55849.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55849.log.gz 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87119.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87119.log.gz 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81675.log 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42130.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74594.log 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81675.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.81675.log.gz 2024-04-25T09:07:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77710.log 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74594.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74594.log.gz 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65419.log 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77710.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77710.log.gz 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61719.log 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65419.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65419.log.gz 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61719.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61719.log.gz 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91395.log 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46791.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2024-04-25T09:07:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83600.log 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91395.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.91395.log.gz 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60215.log 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.83600.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83600.log.gz 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73899.log 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60215.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60215.log.gz 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92716.log 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73899.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73899.log.gz 2024-04-25T09:07:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78226.log 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92716.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92716.log.gz 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72887.log 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78226.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78226.log.gz 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81422.log 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72887.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72887.log.gz 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91461.log 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81422.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81422.log.gz 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81506.log 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91461.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.91461.log.gz 2024-04-25T09:07:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57655.log 2024-04-25T09:07:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81506.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81506.log.gz 2024-04-25T09:07:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41682.log 2024-04-25T09:07:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57655.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57655.log.gz 2024-04-25T09:07:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41682.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41682.log.gz 2024-04-25T09:07:18.089 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T09:07:18.538 INFO:teuthology.orchestra.run.smithi080.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T09:07:18.744 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T09:07:18.818 INFO:teuthology.orchestra.run.smithi005.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T09:07:18.854 INFO:teuthology.orchestra.run.smithi080.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T09:07:18.952 INFO:teuthology.orchestra.run.smithi005.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T09:07:19.077 INFO:teuthology.orchestra.run.smithi005.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T09:07:19.142 INFO:teuthology.orchestra.run.smithi005.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T09:07:19.310 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T09:07:19.329 INFO:teuthology.orchestra.run.smithi005.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T09:07:38.286 INFO:teuthology.orchestra.run.smithi080.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T09:07:38.288 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T09:07:38.288 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m21.263s 2024-04-25T09:07:38.288 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m28.508s 2024-04-25T09:07:38.288 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.924s 2024-04-25T09:07:40.743 INFO:teuthology.orchestra.run.smithi005.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T09:07:40.744 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-25T09:07:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m23.758s 2024-04-25T09:07:40.745 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m33.718s 2024-04-25T09:07:40.745 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m1.410s 2024-04-25T09:07:40.745 INFO:tasks.ceph:Archiving logs... 2024-04-25T09:07:40.745 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/remote/smithi005/log 2024-04-25T09:07:40.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:07:45.583 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/remote/smithi080/log 2024-04-25T09:07:45.584 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:07:49.576 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T09:07:49.586 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T09:07:49.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:07:49.589 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:07:49.678 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T09:07:49.687 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T09:07:49.688 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:07:49.690 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:07:49.705 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:07:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:07:49.710 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:07:49.711 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-25T09:07:49.711 INFO:teuthology.orchestra.run.smithi005.stdout:^- hv01.front.sepia.ceph.com 2 6 377 44 +2047us[+1935us] +/- 663ms 2024-04-25T09:07:49.711 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -544us[ -544us] +/- 51ms 2024-04-25T09:07:49.711 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv03.front.sepia.ceph.com 3 6 377 41 +782us[ +670us] +/- 79ms 2024-04-25T09:07:49.711 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:07:49.714 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:07:49.714 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-25T09:07:49.714 INFO:teuthology.orchestra.run.smithi080.stdout:^- hv01.front.sepia.ceph.com 2 6 377 40 +2027us[+2027us] +/- 663ms 2024-04-25T09:07:49.714 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -553us[ -553us] +/- 51ms 2024-04-25T09:07:49.715 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv03.front.sepia.ceph.com 3 6 377 41 +793us[ +666us] +/- 79ms 2024-04-25T09:07:49.715 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:07:49.715 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T09:07:49.725 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T09:07:49.726 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T09:07:49.748 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:07:49.844 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:07:49.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T09:07:49.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:07:49.940 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T09:07:49.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:07:49.968 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T09:07:49.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T09:07:50.007 INFO:teuthology.task.internal:Duration was 1034.460886 seconds 2024-04-25T09:07:50.008 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T09:07:50.041 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T09:07:50.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:07:50.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:07:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:07:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:07:50.401 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T09:07:50.401 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-04-25T09:07:50.402 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:07:50.464 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T09:07:50.464 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:07:50.490 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T09:07:50.490 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:07:50.506 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:07:50.554 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T09:07:50.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:07:50.574 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:07:50.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T09:07:50.716 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T09:07:50.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:07:50.741 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:07:50.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T09:07:50.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:07:50.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:07:50.803 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-04-25T09:07:50.826 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-04-25T09:07:50.838 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:07:50.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:07:50.870 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:07:50.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:07:50.893 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T09:07:50.903 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T09:07:50.904 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/remote/smithi005 2024-04-25T09:07:50.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:07:50.946 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008/remote/smithi080 2024-04-25T09:07:50.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:07:50.977 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T09:07:50.977 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:07:50.982 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:07:51.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T09:07:51.039 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T09:07:51.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T09:07:51.090 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T09:07:51.091 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:07:51.093 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:07:51.106 INFO:teuthology.orchestra.run.smithi005.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:07 /home/ubuntu/cephtest 2024-04-25T09:07:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:07 /home/ubuntu/cephtest 2024-04-25T09:07:51.108 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T09:07:51.125 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T09:07:51.191 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T09:07:51.220 DEBUG:teuthology.nuke:shortname: smithi005 2024-04-25T09:07:51.220 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:07:51.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:45:04.229249', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXYbjecAw0nYeMl1wDM7sXDzLGe8Ual9MKxZFMt0YV57aaalTn8HSzu35uaBTfhSwSQKZ3tK620Oi99K9ki0I8='} 2024-04-25T09:07:51.249 DEBUG:teuthology.nuke:shortname: smithi080 2024-04-25T09:07:51.249 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:07:51.273 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673008', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:45:04.227214', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPunG97XKwp74rS7Oo8zEpB9fJYhZtR0GCCNlGYOEh6keKDgZJLjRgsruOCy8mXOEFE+ndv45rhJWIFNlAtjaLE='} 2024-04-25T09:07:51.293 INFO:teuthology.orchestra.console.smithi005:Power off 2024-04-25T09:07:51.293 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T09:07:51.316 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-04-25T09:07:51.317 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:07:51.332 INFO:teuthology.orchestra.console.smithi080:Power off 2024-04-25T09:07:51.333 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T09:07:51.343 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-04-25T09:07:51.357 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-04-25T09:07:51.357 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:07:51.380 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-04-25T09:07:55.344 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:07:55.381 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:07:55.455 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-04-25T09:07:55.490 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-04-25T09:07:59.457 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:07:59.491 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:07:59.566 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-04-25T09:07:59.599 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-04-25T09:07:59.668 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-04-25T09:07:59.700 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-04-25T09:07:59.806 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} duration: 1034.4608857631683 failure_reason: 'Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4bafad7c786d4396b254a6fbf7e7e3ef status: fail success: false 2024-04-25T09:07:59.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:07:59.875 INFO:teuthology.run:FAIL